-- Logs begin at Mon 2022-08-29 14:39:45 UTC, end at Mon 2022-08-29 17:21:09 UTC. -- Aug 29 15:14:25.417655 n-d-839401-11 systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 15:14:25.426748 n-d-839401-11 devstack@n-api.service[106495]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 15:14:25.428815 n-d-839401-11 devstack@n-api.service[106495]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 15:14:25 2022] *** Aug 29 15:14:25.428815 n-d-839401-11 devstack@n-api.service[106495]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 15:14:25.428815 n-d-839401-11 devstack@n-api.service[106495]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 15:14:25.428815 n-d-839401-11 devstack@n-api.service[106495]: nodename: n-d-839401-11 Aug 29 15:14:25.428815 n-d-839401-11 devstack@n-api.service[106495]: machine: x86_64 Aug 29 15:14:25.428815 n-d-839401-11 devstack@n-api.service[106495]: clock source: unix Aug 29 15:14:25.428815 n-d-839401-11 devstack@n-api.service[106495]: pcre jit disabled Aug 29 15:14:25.428815 n-d-839401-11 devstack@n-api.service[106495]: detected number of CPU cores: 4 Aug 29 15:14:25.428815 n-d-839401-11 devstack@n-api.service[106495]: current working directory: / Aug 29 15:14:25.428815 n-d-839401-11 devstack@n-api.service[106495]: detected binary path: /usr/bin/uwsgi-core Aug 29 15:14:25.429511 n-d-839401-11 devstack@n-api.service[106495]: your processes number limit is 47680 Aug 29 15:14:25.429511 n-d-839401-11 devstack@n-api.service[106495]: your memory page size is 4096 bytes Aug 29 15:14:25.429511 n-d-839401-11 devstack@n-api.service[106495]: detected max file descriptor number: 2048 Aug 29 15:14:25.429511 n-d-839401-11 devstack@n-api.service[106495]: lock engine: pthread robust mutexes Aug 29 15:14:25.429511 n-d-839401-11 devstack@n-api.service[106495]: thunder lock: enabled Aug 29 15:14:25.429511 n-d-839401-11 devstack@n-api.service[106495]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 15:14:25.429511 n-d-839401-11 devstack@n-api.service[106495]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 15:14:25.467929 n-d-839401-11 devstack@n-api.service[106495]: Python main interpreter initialized at 0x55b6cdfd99c0 Aug 29 15:14:25.467929 n-d-839401-11 devstack@n-api.service[106495]: python threads support enabled Aug 29 15:14:25.467929 n-d-839401-11 devstack@n-api.service[106495]: your server socket listen backlog is limited to 100 connections Aug 29 15:14:25.467929 n-d-839401-11 devstack@n-api.service[106495]: your mercy for graceful operations on workers is 90 seconds Aug 29 15:14:25.468277 n-d-839401-11 devstack@n-api.service[106495]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 15:14:25.468348 n-d-839401-11 devstack@n-api.service[106495]: *** Operational MODE: preforking *** Aug 29 15:14:25.468586 n-d-839401-11 devstack@n-api.service[106495]: *** uWSGI is running in multiple interpreter mode *** Aug 29 15:14:25.468586 n-d-839401-11 devstack@n-api.service[106495]: spawned uWSGI master process (pid: 106495) Aug 29 15:14:25.468774 n-d-839401-11 systemd[1]: Started Devstack devstack@n-api.service. Aug 29 15:14:25.469837 n-d-839401-11 devstack@n-api.service[106495]: spawned uWSGI worker 1 (pid: 106496, cores: 1) Aug 29 15:14:25.469837 n-d-839401-11 devstack@n-api.service[106495]: spawned uWSGI worker 2 (pid: 106497, cores: 1) Aug 29 15:14:25.469837 n-d-839401-11 devstack@n-api.service[106495]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 15:14:26.119665 n-d-839401-11 devstack@n-api.service[106496]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 15:14:26.120245 n-d-839401-11 devstack@n-api.service[106497]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 15:14:27.192390 n-d-839401-11 devstack@n-api.service[106497]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:14:27.192390 n-d-839401-11 devstack@n-api.service[106497]: from cryptography.utils import int_from_bytes Aug 29 15:14:27.193106 n-d-839401-11 devstack@n-api.service[106496]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:14:27.193106 n-d-839401-11 devstack@n-api.service[106496]: from cryptography.utils import int_from_bytes Aug 29 15:14:27.193106 n-d-839401-11 devstack@n-api.service[106496]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:14:27.193106 n-d-839401-11 devstack@n-api.service[106496]: from cryptography.utils import int_from_bytes Aug 29 15:14:27.193783 n-d-839401-11 devstack@n-api.service[106497]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:14:27.193783 n-d-839401-11 devstack@n-api.service[106497]: from cryptography.utils import int_from_bytes Aug 29 15:14:29.634547 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 15:14:29.635233 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 15:14:29.635587 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 15:14:29.635672 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 15:14:29.635751 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 15:14:29.635819 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 15:14:29.635890 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 15:14:29.635960 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 15:14:29.636025 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 15:14:29.636097 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 15:14:29.636280 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.636375 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.636577 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.636712 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.636869 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.636962 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.637241 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.637377 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.637535 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.637629 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.637877 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.638009 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.638152 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.638242 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.638503 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.638671 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.638778 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.638861 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.639044 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.639144 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.639384 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.639513 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.639700 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-839401-11 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.639850 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-839401-11 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.640022 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.640154 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.640324 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.640474 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.640605 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.640711 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.640947 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.641115 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.641243 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.641361 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.641590 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.641725 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.641905 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.642036 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.642391 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.642563 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.643666 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.643804 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.643914 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.644037 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.644176 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.644262 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.644262 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.644406 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.644485 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.644563 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.644649 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.644724 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.644801 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.644886 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.644972 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.645065 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.645241 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.645391 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.645549 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.645637 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.645939 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-839401-11 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.646054 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-839401-11 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.646283 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.646385 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.646596 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.646686 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.646909 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.646998 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.647314 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.647421 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.647622 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.647706 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.647927 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.648019 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.648247 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.648330 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.648563 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.648650 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.648871 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.648979 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.649215 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.649319 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.649531 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.649623 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.649848 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.649933 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.650161 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.650246 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.650461 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.650544 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.650763 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.650861 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.651069 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.651154 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.651384 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.651477 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.651685 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.651772 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.651987 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.652078 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.652231 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.652323 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.652536 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.652622 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.652853 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.652937 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.653199 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.653309 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.653519 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.653623 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.653771 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.653864 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.654015 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.654101 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.654525 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.654626 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.654702 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.654771 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.654935 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.655042 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.655237 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.655331 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.655540 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.655642 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.655842 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.655928 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.656144 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.656227 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.656443 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.656541 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.656745 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.656829 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.657046 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.657152 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.657386 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.657483 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.657701 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.657793 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.658016 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.658132 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.658322 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.658500 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.658639 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.658732 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.659348 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.659443 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.659596 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.659682 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.659901 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.659994 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.660236 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.660320 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.660554 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.660639 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.660856 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.660939 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.661192 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.661280 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.661514 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.661602 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.661860 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.661981 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.662170 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.662263 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.662475 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.662560 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.662788 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.662879 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.663122 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.663268 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.663423 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.663515 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.663668 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.663757 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.663969 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.664068 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.664270 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.664356 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.664583 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.664675 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.664884 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.664991 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.665207 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.665295 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.665512 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.665640 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.665808 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.665906 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.666108 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.666227 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.666409 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.666492 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.666708 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.666800 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.667009 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.667094 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.667311 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.667396 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.667611 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.667704 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.667913 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.667998 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.668213 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.668296 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.668511 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.668595 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.668827 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.668919 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.669169 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.669268 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.669482 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.669601 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.669780 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.669865 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.670082 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.670176 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.670384 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.670476 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.670695 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.670779 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.670997 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.671090 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.671299 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.671392 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.671614 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.671698 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.671915 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.672001 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.672216 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.672308 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.672530 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.672615 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.672834 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.672917 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.673161 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.673250 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.673479 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.673566 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.673777 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.673869 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.674082 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.674167 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.674398 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.674480 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.674701 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.674792 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.675001 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.675084 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.675301 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.675386 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.675601 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.675728 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.675901 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.675994 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.676202 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.676327 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.676500 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.676593 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.676797 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.676880 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.677106 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.677190 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.677454 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.677554 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.677776 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.677861 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.678080 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.678164 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.678383 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.678468 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.678685 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.678769 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.678998 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.679082 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:14:29.679333 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.679425 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.679662 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.679810 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.680003 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.680141 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.680316 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.680446 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.680648 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.680778 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.680996 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.681175 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.681305 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.681432 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.681616 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.681744 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.681928 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.682070 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.682253 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.682381 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.682568 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.682702 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.682876 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.682986 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.683187 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.683283 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.683506 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.683613 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.683821 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.684004 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.684148 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.684236 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.684464 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.684559 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.684779 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.684873 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.685118 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.685208 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.685427 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.685515 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.685746 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.685898 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.686070 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.686197 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.686388 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.686515 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.686697 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.686837 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.687033 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.687164 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.687383 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.687500 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.687689 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.687775 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.688009 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.688092 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.688326 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.688414 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.688637 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.688730 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.688943 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.689028 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.689279 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.689389 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.689600 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.689694 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.689934 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.690070 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.690244 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.690375 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.690559 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.690691 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.690868 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.690998 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.691188 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.691327 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.691495 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.691635 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.691802 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.691942 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.692111 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.692250 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.692418 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.692548 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.692724 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.692856 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.693106 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.693280 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.693441 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.693570 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.693764 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.693891 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.694075 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.694220 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.694386 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.694517 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.694701 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.694839 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.695010 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.695147 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.695317 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.695445 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.695624 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.695773 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.695930 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.696042 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.696230 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.696327 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.696530 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.696617 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.696836 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.696923 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.697155 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.697244 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.697477 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.697571 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.697801 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.697896 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.698106 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.698193 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.698438 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.698530 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.698741 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.698827 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.699047 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.699132 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.699357 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.699466 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.699680 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.699765 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.699971 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.700071 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.700275 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.700373 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.700581 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.700685 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.700881 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.700976 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.701227 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.701347 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.701544 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.701634 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.701851 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.701946 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.702175 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.702271 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.702479 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.702567 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.702784 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.702871 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.703099 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.703187 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.703407 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.703495 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.703718 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.703816 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.704028 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.704115 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.704333 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.704419 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.704656 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.704741 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.704965 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.705053 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.705301 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.705390 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.705636 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.705734 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.705970 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.706117 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.706274 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.706409 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.706594 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.706735 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.706917 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.707050 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.707231 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.707361 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.707533 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.707673 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.707840 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.707985 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.708124 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.708254 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.708428 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.708638 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.708778 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.708911 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.709041 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.709192 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.709365 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.709557 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.709757 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.709953 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.710094 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.710223 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.710359 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.710490 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.710620 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.710751 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.710883 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.711014 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.711156 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.711295 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.711461 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.711603 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.711767 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.711905 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.712071 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.712210 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.712413 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.712546 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.712714 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.712844 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.713057 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.713223 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.713413 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.713553 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.713733 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.713870 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.714055 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.714138 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.714367 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.714451 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.714678 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.714770 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.714989 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.715075 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.715298 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.715390 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.715607 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.715703 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.715916 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.716000 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.716235 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.716367 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.716545 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.716684 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.716861 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.717000 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.717192 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.717322 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.717518 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.717648 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.717830 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.717961 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.718149 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.718281 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.718454 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.718587 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.718768 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.718906 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.719109 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.719249 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.719444 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.719583 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.719760 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.719890 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.720082 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.720208 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.720391 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.720478 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.720704 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.720787 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.721012 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.721116 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.721348 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.721442 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.721658 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.721743 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.721970 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.722064 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.722288 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.722379 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.722598 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.722681 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.722914 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.723013 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.723225 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.723309 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.723545 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.723629 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.723855 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.723947 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.724172 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.724262 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.724537 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.724909 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.725078 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.725256 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.725440 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.725587 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.725779 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.725922 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.726094 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.726233 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.726412 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.726545 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.726738 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.726867 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.727053 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.727180 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.727367 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.727492 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.727680 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.727802 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.727991 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.728107 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.728300 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.728413 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.728611 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.728722 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.728927 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.729020 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.729275 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.729373 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.729587 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.729683 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.729894 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.729979 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.730212 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.730347 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.730523 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.730670 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.730823 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.730954 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.731126 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.731264 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.731432 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.731576 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.731752 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.731883 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.732060 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.732200 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.732379 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.732518 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.732696 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.732827 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.733000 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.733180 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.733331 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.733470 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.733655 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.733789 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.733966 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.734094 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.734291 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.734451 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.734590 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.734717 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.734849 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.734987 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.735191 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.735322 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.735500 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.735595 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.735801 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.735886 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.736112 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.736197 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.736432 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.736531 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.736741 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.736838 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.737055 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.737200 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.737387 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.737481 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.737695 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.737868 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.738012 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.738097 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.738322 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.738405 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.738625 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.738718 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.738934 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.739025 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.739239 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.739322 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.739547 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.739640 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.739855 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.739937 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.740203 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.740297 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.740512 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.740614 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.740825 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.740910 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.741160 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.741249 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.741468 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.741566 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.741777 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.741860 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.742092 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.742176 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.742668 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.742763 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.743004 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.743089 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.743317 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.743400 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.743636 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.743739 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.743953 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.744038 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.744298 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.744404 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.744629 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.744722 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.744955 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.745048 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.745295 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.745382 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.745602 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.745686 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.745911 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.745995 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.746216 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.746308 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.746521 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.746606 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.746828 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.746913 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.747131 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.747217 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.747437 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.747523 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.747741 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.747825 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.748044 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.748127 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.748347 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.748438 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.748646 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.748730 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.748948 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.749041 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.749275 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.749372 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.749587 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.749672 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.749893 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.750014 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.750198 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.750315 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.750497 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.750585 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.750817 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.750909 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.751122 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.751223 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.751424 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.751508 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.751726 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.751810 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.752029 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.752121 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.752365 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.752450 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.752670 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.752764 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.753007 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.753137 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.753365 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.753450 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.753706 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.753790 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.754010 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.754096 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.754313 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.754397 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.754634 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.754726 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.754937 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.755022 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.755237 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.755321 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.755561 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.755683 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.755900 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.755994 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.756208 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.756300 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.756511 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.756648 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.756820 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.756908 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.757149 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.757237 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.757462 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.757555 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.757769 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.757861 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.758071 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.758156 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.758376 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.758468 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.758679 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.758764 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.758991 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.759074 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.759297 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.759381 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.759596 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.759687 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.759899 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.759984 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.760206 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.760291 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.760510 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.760636 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.760813 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.760897 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.761142 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.761230 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.761447 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.761532 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.761764 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.761927 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.762068 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.762159 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.762370 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.762454 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.762674 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.762774 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.762980 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.763065 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.763289 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.763373 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.763594 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.763689 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.763914 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.763997 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.764222 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.764314 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.764524 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.764620 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.764824 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.764914 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.765171 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.765259 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.765457 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.765549 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.765760 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.765844 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.766064 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.766148 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.766384 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.766470 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.766700 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.766783 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.767000 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.767083 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.767309 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.767402 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.767613 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.767697 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.767915 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.767999 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.768219 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.768313 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.768526 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.768610 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.768825 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.768926 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.769145 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.769231 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.769445 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.769529 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.769744 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.769841 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.770043 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.770135 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.770361 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.770445 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.770663 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.770757 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.770963 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.771047 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.771289 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.771383 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.771590 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.771691 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.771928 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.772013 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.772227 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.772318 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.772588 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.772674 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.772891 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.772976 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.773232 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.773321 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.773554 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.773649 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.773862 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.773954 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.774169 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.774255 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.774480 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.774564 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.774779 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.774862 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.775091 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.775174 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.775395 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.775480 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.775702 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.775786 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.776000 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.776087 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.776300 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.776386 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.776617 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.776702 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.776926 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.777022 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.777256 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.777355 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.777577 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.777662 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.777894 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.777988 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.778216 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.778300 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.778514 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.778598 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.778821 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.778918 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.779127 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.779212 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.779431 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.779515 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.779734 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.779827 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.780039 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.780133 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.780347 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.780440 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.780656 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.780747 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.780963 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.781074 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.781344 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.781441 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.781605 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.781692 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.781909 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.782000 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.782214 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.782300 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.782521 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.782607 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.782820 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.782911 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.783142 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.783227 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.783449 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.783536 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.783747 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.784141 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.784358 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.784456 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.784660 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.784747 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.784964 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.785048 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.785291 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.785391 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.785721 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.785805 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.786030 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.786113 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.786338 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.786431 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.786640 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.786724 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.787002 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.787089 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.787311 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.787404 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.787626 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.787710 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.787934 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.788018 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.788238 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.788323 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.788649 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.788741 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.788959 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.789055 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.789291 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.789377 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.789601 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.789685 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.789905 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.790107 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.790215 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.790514 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.790830 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.791131 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.791432 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.791733 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.792053 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.792357 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.792675 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.793105 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.793422 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.793727 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.794140 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.794533 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.794654 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.794840 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.794987 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.795178 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.795387 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.795501 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.795704 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.795792 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.796036 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.796182 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.796361 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.796449 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.796670 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.796771 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.796992 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.797223 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.797339 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.797448 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.797727 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.797969 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.798486 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.798581 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.798663 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.798757 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.798889 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.799212 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.799342 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.799528 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.799687 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.799856 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.799951 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.800183 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.800514 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.800828 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.800948 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.801173 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.801271 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.801491 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.801582 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.801820 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.801925 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.802157 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.802246 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.802507 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.802606 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.802829 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.802931 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.803138 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.803297 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.803451 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.803540 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.803758 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.803848 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.804067 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.804155 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.804388 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.804475 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.804691 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.804795 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.805000 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.805143 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.805344 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.805437 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.805655 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.805743 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.805960 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.806071 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.806268 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.806380 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.806593 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.806689 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.806896 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.806985 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.807220 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.807316 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.807533 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.807620 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.807855 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.807943 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.808166 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.808264 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.808471 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.808556 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.808778 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.808877 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.809104 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.809212 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.809413 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.809501 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.809714 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.809801 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.810014 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.810109 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.810324 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.810410 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.810645 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.810798 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.810960 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.811070 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.811285 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.811391 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.811606 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.811702 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.811911 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.812007 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.812233 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.812331 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.812541 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.812644 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.812843 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.812940 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.813170 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.813271 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.813477 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.813579 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.813785 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.813873 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.814095 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.814183 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.814404 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.814501 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.814709 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.814799 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.815016 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.815101 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.815322 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.815428 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.815629 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.815727 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.815934 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.816024 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.816240 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.816338 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.816541 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.816629 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.816863 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.816952 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.817256 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.817371 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.817495 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.817583 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.817808 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.817898 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.818152 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.818243 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.818462 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.818564 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.818764 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.818854 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.819071 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.819177 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.819374 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.819463 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.819676 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.819766 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.819979 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.820070 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.820300 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.820388 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.820604 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.820700 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.820917 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.821015 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.821248 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.821344 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.821553 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.821654 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.821861 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.821951 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.822165 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.822253 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.822480 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.822581 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.822787 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.822876 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.823101 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.823189 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.823406 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.823501 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.823720 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.823807 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.824034 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.824253 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.824349 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.824585 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.824687 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.824900 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.824996 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.825237 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.825343 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.825550 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.825639 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.825866 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.825955 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.826176 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.826273 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.826484 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.826572 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.826796 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.826880 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.827140 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.827243 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.827447 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.827631 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.827720 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.828008 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.828107 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.828346 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.828441 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.828674 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.828761 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.828985 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.829098 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.829326 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.829413 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.829635 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.829721 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.829946 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.830048 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.830254 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.830349 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.830562 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.830650 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.830866 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.830968 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.831198 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.831291 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.831498 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.831612 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.831810 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.831924 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.832122 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.832253 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.832433 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.832523 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.832746 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.832833 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.833058 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.833176 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.833392 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.833565 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.833827 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.833924 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.834155 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.834250 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.834474 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.834580 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.834790 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.834877 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.835105 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.835194 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.835417 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.835505 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.835726 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.835818 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.836037 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.836132 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.836346 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.836434 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.836655 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.836875 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.836970 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.837217 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.837328 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.837555 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.837655 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.837883 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.837978 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.838206 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.838294 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.838522 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.838617 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.838835 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.838922 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.839146 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.839242 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.839453 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.839548 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.839761 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.839856 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.840070 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.840281 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.840395 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.840593 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.840716 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.840952 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.841109 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.841306 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.841427 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.841589 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.841701 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.841902 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.842015 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.842209 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.842321 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.842531 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.842739 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.842864 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.843089 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.843209 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.843405 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.843519 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.843706 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.843827 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.844007 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.844120 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.844325 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.844437 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.844752 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.844863 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.844952 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.845030 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.845249 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.845359 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.845556 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.845650 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.845872 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.846081 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.846178 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.846429 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.846518 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.846744 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.846840 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.847059 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.847154 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.847368 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.847465 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.847675 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.847776 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.847975 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.848076 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.848276 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.848364 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.848585 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.848680 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.848888 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.848986 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.849211 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.849302 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.849545 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.849632 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.849844 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.849943 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.850145 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.850233 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.850449 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.850544 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.850748 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.850844 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.851048 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.851151 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.851361 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.851488 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.851651 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.851747 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.851956 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.852043 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.852261 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.852358 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.852560 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.852647 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.852860 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.852955 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.853191 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.853282 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.853491 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.853587 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.853789 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.853883 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.854089 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.854178 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.854390 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.854479 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.854702 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.854832 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.854999 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.855091 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.855303 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.855399 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.855603 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.855690 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.855909 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.856006 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.856205 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.856292 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.856510 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.856598 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.856868 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.857098 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.857220 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.857438 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.857527 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.857757 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.857863 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.858090 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.858179 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.858400 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.858487 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.858717 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.858804 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.859022 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.859117 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.859324 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.859436 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.859649 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.859787 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.859959 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.860101 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.860268 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.860579 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.860667 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.860892 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.860982 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.861227 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.861336 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.861535 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.861666 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.861845 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.861999 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.862154 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.862304 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.862463 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.862639 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.862772 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.862896 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.863081 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.863218 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.863387 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.863528 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.863695 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.863833 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.864006 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.864139 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.864317 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.864446 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.864657 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.864755 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.865040 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.865173 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.865421 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.865525 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.865739 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.865836 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.866041 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.866128 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.866350 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.866438 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.866653 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.866740 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.866959 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.867057 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.867265 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.867353 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.867565 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.867652 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.867875 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.867973 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.868194 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.868282 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.868496 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.868585 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.868807 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.868901 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.869136 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.869229 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.869451 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.869539 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.869758 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.869853 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.870063 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.870150 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.870367 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.870457 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.870669 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.870770 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.870979 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.871067 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.871305 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.871401 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.871614 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.871703 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.871913 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.872013 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.872278 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.872365 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.872608 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.872697 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.872917 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.873002 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.873240 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.873342 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.873547 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.873636 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.873855 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.873943 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.874163 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.874263 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.874464 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.874559 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.874772 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.874858 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.875073 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.875181 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.875373 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.875502 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.875680 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.875840 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.875981 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.876169 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.876284 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.876490 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.876579 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.876793 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.876889 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.877120 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.877211 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.877424 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.877511 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.877732 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.877832 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.878047 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.878153 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.878344 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.878438 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.878641 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.878741 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.878940 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.879035 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.879242 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.879329 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.879540 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.879639 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.879840 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.879926 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.880137 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.880230 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.880438 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.880553 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.880762 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.880849 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.881061 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.881224 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.881372 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.881461 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.881670 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.881794 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.881971 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.882059 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.882271 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.882359 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.882570 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.882658 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.882875 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.882965 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.883174 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.883263 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.883476 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.883572 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.883774 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.883870 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.884072 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.884160 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.884369 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.884464 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.884749 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.884856 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.885033 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.885220 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.885368 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.885464 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.885679 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.885777 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.885984 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.886072 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.886289 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.886383 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.886591 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.886691 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.886909 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.887006 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.887209 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.887297 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.887523 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.887612 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.887828 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.887915 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.888146 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.888253 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.888451 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.888539 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.888758 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.888844 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.889061 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.889209 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.889398 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.889496 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.889703 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.889790 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.890006 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.890102 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.890311 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.890406 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.890620 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.890744 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.890936 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.891097 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.891246 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.891359 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.891555 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.891643 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.891871 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.891972 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.892187 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.892275 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.892514 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.892601 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.892839 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.892928 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.893175 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.893265 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.893487 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.893574 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.893794 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.893883 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.894104 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.894191 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.894415 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.894504 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.894731 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.894820 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.895037 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.895124 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.895346 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.895457 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.895659 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.895747 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.895967 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.896054 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.896272 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 15:14:29.896376 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.896707 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.897016 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.897363 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.897689 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.898032 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.898342 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.898684 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.899009 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.899319 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.899626 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.899927 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:14:29.900168 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 15:14:30.050332 n-d-839401-11 devstack@n-api.service[106497]: INFO dbcounter [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] Registered counter for database nova_api Aug 29 15:14:30.054359 n-d-839401-11 devstack@n-api.service[106496]: INFO dbcounter [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] Registered counter for database nova_api Aug 29 15:14:30.072616 n-d-839401-11 devstack@n-api.service[106497]: DEBUG oslo_db.sqlalchemy.engines [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:14:30.074717 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_db.sqlalchemy.engines [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:14:30.080712 n-d-839401-11 devstack@n-api.service[106497]: DEBUG dbcounter [-] [106497] Writer thread running {{(pid=106497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:14:30.081766 n-d-839401-11 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writer thread running {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:14:30.137405 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.context [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dcf211bc-da73-4d63-b885-2b9e7c1e329b(cell1) {{(pid=106497) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 15:14:30.140512 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.context [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dcf211bc-da73-4d63-b885-2b9e7c1e329b(cell1) {{(pid=106496) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 15:14:30.141292 n-d-839401-11 devstack@n-api.service[106497]: DEBUG oslo_concurrency.lockutils [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:14:30.141760 n-d-839401-11 devstack@n-api.service[106497]: DEBUG oslo_concurrency.lockutils [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:14:30.143320 n-d-839401-11 devstack@n-api.service[106497]: DEBUG oslo_concurrency.lockutils [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:14:30.144057 n-d-839401-11 devstack@n-api.service[106497]: DEBUG oslo_concurrency.lockutils [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:14:30.144422 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:14:30.144558 n-d-839401-11 devstack@n-api.service[106497]: DEBUG oslo_concurrency.lockutils [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:14:30.144899 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:14:30.146531 n-d-839401-11 devstack@n-api.service[106497]: DEBUG oslo_concurrency.lockutils [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:14:30.146686 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:14:30.147292 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:14:30.147733 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:14:30.148507 n-d-839401-11 devstack@n-api.service[106497]: INFO dbcounter [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] Registered counter for database nova_cell0 Aug 29 15:14:30.149749 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:14:30.151773 n-d-839401-11 devstack@n-api.service[106496]: INFO dbcounter [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] Registered counter for database nova_cell0 Aug 29 15:14:30.152469 n-d-839401-11 devstack@n-api.service[106497]: INFO dbcounter [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] Registered counter for database nova_cell1 Aug 29 15:14:30.155758 n-d-839401-11 devstack@n-api.service[106496]: INFO dbcounter [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] Registered counter for database nova_cell1 Aug 29 15:14:30.161715 n-d-839401-11 devstack@n-api.service[106497]: DEBUG oslo_db.sqlalchemy.engines [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:14:30.162504 n-d-839401-11 devstack@n-api.service[106497]: DEBUG oslo_db.sqlalchemy.engines [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:14:30.163338 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_db.sqlalchemy.engines [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:14:30.167352 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_db.sqlalchemy.engines [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:14:30.168946 n-d-839401-11 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writer thread running {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:14:30.169836 n-d-839401-11 devstack@n-api.service[106497]: DEBUG dbcounter [-] [106497] Writer thread running {{(pid=106497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:14:30.171255 n-d-839401-11 devstack@n-api.service[106497]: DEBUG dbcounter [-] [106497] Writer thread running {{(pid=106497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:14:30.313458 n-d-839401-11 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writer thread running {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:14:30.318765 n-d-839401-11 devstack@n-api.service[106497]: INFO dbcounter [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] Registered counter for database nova_cell0 Aug 29 15:14:30.322815 n-d-839401-11 devstack@n-api.service[106496]: INFO dbcounter [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] Registered counter for database nova_cell0 Aug 29 15:14:30.326030 n-d-839401-11 devstack@n-api.service[106497]: DEBUG oslo_db.sqlalchemy.engines [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:14:30.331193 n-d-839401-11 devstack@n-api.service[106497]: DEBUG dbcounter [-] [106497] Writer thread running {{(pid=106497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:14:30.331779 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_db.sqlalchemy.engines [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:14:30.336564 n-d-839401-11 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writer thread running {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:14:30.663799 n-d-839401-11 devstack@n-api.service[106496]: WARNING keystonemiddleware.auth_token [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:14:30.665246 n-d-839401-11 devstack@n-api.service[106497]: WARNING keystonemiddleware.auth_token [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:14:30.671270 n-d-839401-11 devstack@n-api.service[106496]: WARNING keystonemiddleware.auth_token [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:14:30.672629 n-d-839401-11 devstack@n-api.service[106497]: WARNING keystonemiddleware.auth_token [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:14:31.011584 n-d-839401-11 devstack@n-api.service[106496]: WARNING keystonemiddleware.auth_token [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:14:31.015809 n-d-839401-11 devstack@n-api.service[106497]: WARNING keystonemiddleware.auth_token [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:14:31.017642 n-d-839401-11 devstack@n-api.service[106496]: WARNING keystonemiddleware.auth_token [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:14:31.021853 n-d-839401-11 devstack@n-api.service[106497]: WARNING keystonemiddleware.auth_token [None req-18e28abf-c9ff-4ea7-a87a-4b6c15026a5c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:14:31.022793 n-d-839401-11 devstack@n-api.service[106496]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b6cdfd99c0 pid: 106496 (default app) Aug 29 15:14:31.024900 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:14:31.026156 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001781 Aug 29 15:14:31.026568 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Mon Aug 29 15:14:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:14:31.027098 n-d-839401-11 devstack@n-api.service[106497]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b6cdfd99c0 pid: 106497 (default app) Aug 29 15:15:49.888424 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:15:49.889464 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 29 15:15:49.889870 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 15:15:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:15:49.902656 n-d-839401-11 devstack@n-api.service[106497]: DEBUG dbcounter [-] [106497] Writing DB stats nova_api:SELECT=3 {{(pid=106497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:49.903775 n-d-839401-11 devstack@n-api.service[106497]: DEBUG dbcounter [-] [106497] Writing DB stats nova_cell1:SELECT=3 {{(pid=106497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:49.904844 n-d-839401-11 devstack@n-api.service[106497]: DEBUG dbcounter [-] [106497] Writing DB stats nova_cell0:SELECT=3 {{(pid=106497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:49.905707 n-d-839401-11 devstack@n-api.service[106497]: DEBUG dbcounter [-] [106497] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:50.779598 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-7d69b15e-f41d-4c2e-979b-5bfaf4114449 admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:15:50.812624 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-7d69b15e-f41d-4c2e-979b-5bfaf4114449 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.915837 Aug 29 15:15:50.813408 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Aug 29 15:15:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:15:53.170913 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:15:53.171484 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-7fbb7825-9e80-4ca1-9f07-4ef25ad3ebf1 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Aug 29 15:15:53.186636 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 3/4] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 15:15:53 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:15:53.597953 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-483b8b6e-d771-416f-9718-872d93f9fa3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:15:53.649338 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-483b8b6e-d771-416f-9718-872d93f9fa3e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.471390 Aug 29 15:15:53.650001 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 2/5] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 15:15:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:15:53.877403 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-2804aa9b-9a57-4998-a042-6a6627adb2df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:15:53.900415 n-d-839401-11 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writing DB stats nova_api:SELECT=3 {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:53.901447 n-d-839401-11 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writing DB stats nova_cell0:SELECT=3 {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:53.902330 n-d-839401-11 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writing DB stats nova_cell1:SELECT=3 {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:53.903088 n-d-839401-11 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:15:53.947424 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-2804aa9b-9a57-4998-a042-6a6627adb2df admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288780 Aug 29 15:15:53.948013 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 4/6] 10.222.0.62 () {64 vars in 1336 bytes} [Mon Aug 29 15:15:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:15:56.293252 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-483b8b6e-d771-416f-9718-872d93f9fa3e admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:15:56.294359 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-483b8b6e-d771-416f-9718-872d93f9fa3e admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Aug 29 15:15:56.294747 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 3/7] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 15:15:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:15:57.017009 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-47c196fe-6266-4536-a594-ab95ebfc642d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M", "swap": 0}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:15:57.063204 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-47c196fe-6266-4536-a594-ab95ebfc642d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.755046 Aug 29 15:15:57.064080 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 5/8] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 15:15:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:15:57.076953 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-52e47b11-8ba6-419a-a525-fb93df3fe6e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:15:57.114022 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-52e47b11-8ba6-419a-a525-fb93df3fe6e6 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040591 Aug 29 15:15:57.115007 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 4/9] 10.222.0.62 () {64 vars in 1336 bytes} [Mon Aug 29 15:15:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:15:59.630033 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-47c196fe-6266-4536-a594-ab95ebfc642d admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:15:59.631853 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-47c196fe-6266-4536-a594-ab95ebfc642d admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002288 Aug 29 15:15:59.632756 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 15:15:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:00.089694 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-c0a9add1-9ac8-4f20-89ed-c83c9d63629a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:00.118383 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-c0a9add1-9ac8-4f20-89ed-c83c9d63629a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.479159 Aug 29 15:16:00.121728 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 5/11] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 15:15:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:16:00.133328 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-0e9fb9bb-28f7-48a4-933f-ed4113c49d1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:00.165019 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-0e9fb9bb-28f7-48a4-933f-ed4113c49d1b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035345 Aug 29 15:16:00.173758 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 7/12] 10.222.0.62 () {64 vars in 1336 bytes} [Mon Aug 29 15:16:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:16:02.712648 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-c0a9add1-9ac8-4f20-89ed-c83c9d63629a admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:02.714237 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-c0a9add1-9ac8-4f20-89ed-c83c9d63629a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002137 Aug 29 15:16:02.714784 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 6/13] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 15:16:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:03.195856 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-6584becb-f209-487c-bd67-4922be2eac6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "id": "d3", "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:03.216134 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-6584becb-f209-487c-bd67-4922be2eac6f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.494797 Aug 29 15:16:03.216717 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 8/14] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 15:16:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:16:03.228861 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-ccbfe3b8-ca98-4776-abe4-a8d7c78ace2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:03.254494 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-ccbfe3b8-ca98-4776-abe4-a8d7c78ace2a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029313 Aug 29 15:16:03.255131 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 7/15] 10.222.0.62 () {64 vars in 1336 bytes} [Mon Aug 29 15:16:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:16:05.640660 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-6584becb-f209-487c-bd67-4922be2eac6f admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:05.642405 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-6584becb-f209-487c-bd67-4922be2eac6f admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002207 Aug 29 15:16:05.643480 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 9/16] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 15:16:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:06.143502 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-00c1555a-2d04-4436-b655-13f5a5e45112 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "vcpus": 4, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0}} {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:06.173342 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-00c1555a-2d04-4436-b655-13f5a5e45112 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.520440 Aug 29 15:16:06.180998 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 8/17] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 15:16:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:16:06.187405 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-759684bd-a3a0-4301-9c91-19b89803239c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:06.218999 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-759684bd-a3a0-4301-9c91-19b89803239c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035243 Aug 29 15:16:06.223385 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 10/18] 10.222.0.62 () {64 vars in 1336 bytes} [Mon Aug 29 15:16:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:16:08.649190 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-00c1555a-2d04-4436-b655-13f5a5e45112 admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:08.650907 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-00c1555a-2d04-4436-b655-13f5a5e45112 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002178 Aug 29 15:16:08.656630 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 9/19] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 15:16:08 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:09.069688 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-ea274f0a-e584-490e-ae2d-854ffec7f510 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:09.096164 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-ea274f0a-e584-490e-ae2d-854ffec7f510 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.438015 Aug 29 15:16:09.097113 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Aug 29 15:16:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:16:11.661922 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-00c1555a-2d04-4436-b655-13f5a5e45112 admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:11.662966 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-00c1555a-2d04-4436-b655-13f5a5e45112 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001703 Aug 29 15:16:11.663543 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 15:16:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:12.080873 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-e697fe18-4707-46ff-b20a-a62dd67506f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "name": "m1.tiny", "ram": 512, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:12.105164 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-e697fe18-4707-46ff-b20a-a62dd67506f1 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.434770 Aug 29 15:16:12.105912 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 12/22] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 15:16:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:16:12.119050 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-35758d95-6ddc-4699-a32f-30ee5a70d7ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:12.146060 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-35758d95-6ddc-4699-a32f-30ee5a70d7ae admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031193 Aug 29 15:16:12.146677 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 11/23] 10.222.0.62 () {64 vars in 1333 bytes} [Mon Aug 29 15:16:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:16:14.504585 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-e697fe18-4707-46ff-b20a-a62dd67506f1 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:14.505844 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-e697fe18-4707-46ff-b20a-a62dd67506f1 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Aug 29 15:16:14.506300 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 15:16:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:14.950254 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-f196837b-ba50-42f4-8b30-4071e81c1fef admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:14.971926 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-f196837b-ba50-42f4-8b30-4071e81c1fef admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458707 Aug 29 15:16:14.972509 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 12/25] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 15:16:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:16:14.984918 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-069c0a11-e22a-41fc-a5b2-1fa16f405955 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:15.013769 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-069c0a11-e22a-41fc-a5b2-1fa16f405955 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032602 Aug 29 15:16:15.025154 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 14/26] 10.222.0.62 () {64 vars in 1333 bytes} [Mon Aug 29 15:16:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:16:17.391574 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-f196837b-ba50-42f4-8b30-4071e81c1fef admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:17.392811 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-f196837b-ba50-42f4-8b30-4071e81c1fef admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001667 Aug 29 15:16:17.393248 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 13/27] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 15:16:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:17.807515 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-2b363c36-040c-4060-ae03-2112a38e3ce6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:17.829863 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-2b363c36-040c-4060-ae03-2112a38e3ce6 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.430149 Aug 29 15:16:17.830873 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 15/28] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 15:16:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:16:17.843316 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-458686b5-d038-4d54-88d4-eb9e79d2ecf8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:17.870362 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-458686b5-d038-4d54-88d4-eb9e79d2ecf8 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030851 Aug 29 15:16:17.870950 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 14/29] 10.222.0.62 () {64 vars in 1333 bytes} [Mon Aug 29 15:16:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:16:20.210234 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-2b363c36-040c-4060-ae03-2112a38e3ce6 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:20.211302 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-2b363c36-040c-4060-ae03-2112a38e3ce6 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 29 15:16:20.211694 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 16/30] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 15:16:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:20.601652 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-b5da4119-08db-4e60-8509-34af752da5ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "os-flavor-access:is_public": true, "swap": 0, "id": "4", "ram": 8192, "name": "m1.large", "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:20.607412 n-d-839401-11 devstack@n-api.service[106497]: DEBUG dbcounter [-] [106497] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:20.625007 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-b5da4119-08db-4e60-8509-34af752da5ee admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.406934 Aug 29 15:16:20.625579 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 15/31] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 15:16:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:16:20.638247 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-a698ef95-2836-4469-8076-674e1973efdb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:20.665331 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-a698ef95-2836-4469-8076-674e1973efdb admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031084 Aug 29 15:16:20.666479 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 17/32] 10.222.0.62 () {64 vars in 1333 bytes} [Mon Aug 29 15:16:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:16:23.047177 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-b5da4119-08db-4e60-8509-34af752da5ee admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:23.048203 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-b5da4119-08db-4e60-8509-34af752da5ee admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 29 15:16:23.048868 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 16/33] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 15:16:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:23.480511 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-3d7345fa-c91a-44f7-8004-229452e5b59a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:23.503896 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-3d7345fa-c91a-44f7-8004-229452e5b59a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.448775 Aug 29 15:16:23.509154 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 18/34] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 15:16:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:16:23.517261 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-8253bbeb-8da9-4bb4-9e6d-0ddd7e471696 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:23.545675 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-8253bbeb-8da9-4bb4-9e6d-0ddd7e471696 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032329 Aug 29 15:16:23.546418 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 17/35] 10.222.0.62 () {64 vars in 1333 bytes} [Mon Aug 29 15:16:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:16:46.890783 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-3d7345fa-c91a-44f7-8004-229452e5b59a admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:46.891806 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-3d7345fa-c91a-44f7-8004-229452e5b59a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 29 15:16:46.892203 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 19/36] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 15:16:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:46.906382 n-d-839401-11 devstack@n-api.service[106497]: DEBUG dbcounter [-] [106497] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:47.341782 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-28bdc834-cf33-4aa4-bd63-1c21a375790f admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:47.359739 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-28bdc834-cf33-4aa4-bd63-1c21a375790f admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.460892 Aug 29 15:16:47.360466 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Aug 29 15:16:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:16:48.424158 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-3d7345fa-c91a-44f7-8004-229452e5b59a admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:48.425261 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-3d7345fa-c91a-44f7-8004-229452e5b59a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 29 15:16:48.425688 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 20/38] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 15:16:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:49.035217 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-e051b882-af5b-48b8-af99-eaa954f84bc8 admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:49.042033 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.wsgi [None req-e051b882-af5b-48b8-af99-eaa954f84bc8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-e051b882-af5b-48b8-af99-eaa954f84bc8 admin admin] Request method failure captured: Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: Accept: application/json Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: Accept-Encoding: gzip, deflate Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: Connection: keep-alive Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: Content-Length: 0 Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: Host: 10.222.0.62 Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: Openstack-Api-Version: compute 2.90 Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: Openstack-System-Scope: None Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: User-Agent: python-novaclient Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: X-Auth-Token: gAAAAABjDNhgJRKjseNP8h-l8msMLLQTyDknqiCDMNGifDI4Oz5m6F_D17Hd0T106y-uHBjfLaCJuVAEUcxRm7w94cwlw5h35uIQHM6ed0B8s8Sdvls4bJRERE0eTaav10JPc9xJ-tp8Z6QmErBtGwsQCbaCidJ_SsFYI3EiJ2Ox98sgLwNkwX4 Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: X-Domain-Id: None Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: X-Domain-Name: None Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: X-Identity-Status: Confirmed Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: X-Is-Admin-Project: True Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: X-Project-Domain-Id: default Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: X-Project-Domain-Name: Default Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: X-Project-Id: 0db6623e969f401e96c9e7fb9ef93d53 Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: X-Project-Name: admin Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: X-Role: reader,member,admin Aug 29 15:16:49.045401 n-d-839401-11 devstack@n-api.service[106497]: X-Roles: reader,member,admin Aug 29 15:16:49.047096 n-d-839401-11 devstack@n-api.service[106497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0db6623e969f401e96c9e7fb9ef93d53", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0db6623e969f401e96c9e7fb9ef93d53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0db6623e969f401e96c9e7fb9ef93d53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0db6623e969f401e96c9e7fb9ef93d53"}]}] Aug 29 15:16:49.047096 n-d-839401-11 devstack@n-api.service[106497]: X-Tenant: admin Aug 29 15:16:49.047096 n-d-839401-11 devstack@n-api.service[106497]: X-Tenant-Id: 0db6623e969f401e96c9e7fb9ef93d53 Aug 29 15:16:49.047096 n-d-839401-11 devstack@n-api.service[106497]: X-Tenant-Name: admin Aug 29 15:16:49.047096 n-d-839401-11 devstack@n-api.service[106497]: X-User: admin Aug 29 15:16:49.047096 n-d-839401-11 devstack@n-api.service[106497]: X-User-Domain-Id: default Aug 29 15:16:49.047096 n-d-839401-11 devstack@n-api.service[106497]: X-User-Domain-Name: Default Aug 29 15:16:49.047096 n-d-839401-11 devstack@n-api.service[106497]: X-User-Id: 373008e94a9a49a8ba77e31df9e31448 Aug 29 15:16:49.047096 n-d-839401-11 devstack@n-api.service[106497]: X-User-Name: admin Aug 29 15:16:49.047096 n-d-839401-11 devstack@n-api.service[106497]: method: > Aug 29 15:16:49.047096 n-d-839401-11 devstack@n-api.service[106497]: exception: Flavor 42 could not be found. Aug 29 15:16:49.047096 n-d-839401-11 devstack@n-api.service[106497]: action_args: {'id': '42'} Aug 29 15:16:49.047096 n-d-839401-11 devstack@n-api.service[106497]: {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:16:49.047096 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:16:49.048157 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Aug 29 15:16:49.049891 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-e051b882-af5b-48b8-af99-eaa954f84bc8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:16:49.051231 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-e051b882-af5b-48b8-af99-eaa954f84bc8 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.461627 Aug 29 15:16:49.051231 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 19/39] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Aug 29 15:16:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 463 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:49.057014 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-4430fb66-40bc-4a40-af30-0a20f2333dd6 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:49.061229 n-d-839401-11 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:16:49.080522 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-4430fb66-40bc-4a40-af30-0a20f2333dd6 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027212 Aug 29 15:16:49.081065 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Aug 29 15:16:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:16:49.092134 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-30e648ce-88ce-4466-a039-93960891a463 admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:49.114927 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-30e648ce-88ce-4466-a039-93960891a463 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026863 Aug 29 15:16:49.115474 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 20/41] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Aug 29 15:16:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:16:49.125485 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-52f10398-ceba-4482-9c68-77a40fecf917 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:49.131449 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.wsgi [None req-52f10398-ceba-4482-9c68-77a40fecf917 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-52f10398-ceba-4482-9c68-77a40fecf917 admin admin] Request method failure captured: Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: Accept: application/json Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: Accept-Encoding: gzip, deflate Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: Connection: keep-alive Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: Content-Length: 0 Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: Host: 10.222.0.62 Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: Openstack-Api-Version: compute 2.90 Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: Openstack-System-Scope: None Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: User-Agent: python-novaclient Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: X-Auth-Token: gAAAAABjDNhgJRKjseNP8h-l8msMLLQTyDknqiCDMNGifDI4Oz5m6F_D17Hd0T106y-uHBjfLaCJuVAEUcxRm7w94cwlw5h35uIQHM6ed0B8s8Sdvls4bJRERE0eTaav10JPc9xJ-tp8Z6QmErBtGwsQCbaCidJ_SsFYI3EiJ2Ox98sgLwNkwX4 Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: X-Domain-Id: None Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: X-Domain-Name: None Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: X-Identity-Status: Confirmed Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: X-Is-Admin-Project: True Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: X-Project-Domain-Id: default Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: X-Project-Domain-Name: Default Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: X-Project-Id: 0db6623e969f401e96c9e7fb9ef93d53 Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: X-Project-Name: admin Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: X-Role: reader,member,admin Aug 29 15:16:49.135476 n-d-839401-11 devstack@n-api.service[106496]: X-Roles: reader,member,admin Aug 29 15:16:49.136954 n-d-839401-11 devstack@n-api.service[106496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0db6623e969f401e96c9e7fb9ef93d53", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0db6623e969f401e96c9e7fb9ef93d53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0db6623e969f401e96c9e7fb9ef93d53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0db6623e969f401e96c9e7fb9ef93d53"}]}] Aug 29 15:16:49.136954 n-d-839401-11 devstack@n-api.service[106496]: X-Tenant: admin Aug 29 15:16:49.136954 n-d-839401-11 devstack@n-api.service[106496]: X-Tenant-Id: 0db6623e969f401e96c9e7fb9ef93d53 Aug 29 15:16:49.136954 n-d-839401-11 devstack@n-api.service[106496]: X-Tenant-Name: admin Aug 29 15:16:49.136954 n-d-839401-11 devstack@n-api.service[106496]: X-User: admin Aug 29 15:16:49.136954 n-d-839401-11 devstack@n-api.service[106496]: X-User-Domain-Id: default Aug 29 15:16:49.136954 n-d-839401-11 devstack@n-api.service[106496]: X-User-Domain-Name: Default Aug 29 15:16:49.136954 n-d-839401-11 devstack@n-api.service[106496]: X-User-Id: 373008e94a9a49a8ba77e31df9e31448 Aug 29 15:16:49.136954 n-d-839401-11 devstack@n-api.service[106496]: X-User-Name: admin Aug 29 15:16:49.136954 n-d-839401-11 devstack@n-api.service[106496]: method: > Aug 29 15:16:49.136954 n-d-839401-11 devstack@n-api.service[106496]: exception: Flavor 42 could not be found. Aug 29 15:16:49.136954 n-d-839401-11 devstack@n-api.service[106496]: action_args: {'id': '42'} Aug 29 15:16:49.136954 n-d-839401-11 devstack@n-api.service[106496]: {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:16:49.136954 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:16:49.137918 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Aug 29 15:16:49.138969 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-52f10398-ceba-4482-9c68-77a40fecf917 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:16:49.140038 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-52f10398-ceba-4482-9c68-77a40fecf917 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015380 Aug 29 15:16:49.140038 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 22/42] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Aug 29 15:16:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:50.121691 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-30e648ce-88ce-4466-a039-93960891a463 admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:50.123068 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-30e648ce-88ce-4466-a039-93960891a463 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002188 Aug 29 15:16:50.123609 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 21/43] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 15:16:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:50.663806 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-78918ba0-fce7-4b2b-9cba-f9f1ab0dcb27 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:50.669281 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.wsgi [None req-78918ba0-fce7-4b2b-9cba-f9f1ab0dcb27 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-78918ba0-fce7-4b2b-9cba-f9f1ab0dcb27 admin admin] Request method failure captured: Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: Accept: application/json Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: Accept-Encoding: gzip, deflate Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: Connection: keep-alive Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: Content-Length: 0 Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: Host: 10.222.0.62 Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: Openstack-Api-Version: compute 2.90 Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: Openstack-System-Scope: None Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: User-Agent: python-novaclient Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: X-Auth-Token: gAAAAABjDNhihrxltx5ywujnLJsnRYw_fBAhdtPm99c_WV3ZTBmYd62cn8K4JAbkefqg-RAfTwieLy4ntzbpPKG797gKVVfYZfkutxAacDoDUIgak9TygfwGqNQQ15GdQu2PJzc-5W2HdvJQEGA7hokaBOPCK3JToX8Pgfv-8bpShj0xEBufqlc Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: X-Domain-Id: None Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: X-Domain-Name: None Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: X-Identity-Status: Confirmed Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: X-Is-Admin-Project: True Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: X-Project-Domain-Id: default Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: X-Project-Domain-Name: Default Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: X-Project-Id: 0db6623e969f401e96c9e7fb9ef93d53 Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: X-Project-Name: admin Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: X-Role: reader,member,admin Aug 29 15:16:50.670831 n-d-839401-11 devstack@n-api.service[106496]: X-Roles: reader,member,admin Aug 29 15:16:50.672151 n-d-839401-11 devstack@n-api.service[106496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0db6623e969f401e96c9e7fb9ef93d53", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0db6623e969f401e96c9e7fb9ef93d53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0db6623e969f401e96c9e7fb9ef93d53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0db6623e969f401e96c9e7fb9ef93d53"}]}] Aug 29 15:16:50.672151 n-d-839401-11 devstack@n-api.service[106496]: X-Tenant: admin Aug 29 15:16:50.672151 n-d-839401-11 devstack@n-api.service[106496]: X-Tenant-Id: 0db6623e969f401e96c9e7fb9ef93d53 Aug 29 15:16:50.672151 n-d-839401-11 devstack@n-api.service[106496]: X-Tenant-Name: admin Aug 29 15:16:50.672151 n-d-839401-11 devstack@n-api.service[106496]: X-User: admin Aug 29 15:16:50.672151 n-d-839401-11 devstack@n-api.service[106496]: X-User-Domain-Id: default Aug 29 15:16:50.672151 n-d-839401-11 devstack@n-api.service[106496]: X-User-Domain-Name: Default Aug 29 15:16:50.672151 n-d-839401-11 devstack@n-api.service[106496]: X-User-Id: 373008e94a9a49a8ba77e31df9e31448 Aug 29 15:16:50.672151 n-d-839401-11 devstack@n-api.service[106496]: X-User-Name: admin Aug 29 15:16:50.672151 n-d-839401-11 devstack@n-api.service[106496]: method: > Aug 29 15:16:50.672151 n-d-839401-11 devstack@n-api.service[106496]: exception: Flavor 84 could not be found. Aug 29 15:16:50.672151 n-d-839401-11 devstack@n-api.service[106496]: action_args: {'id': '84'} Aug 29 15:16:50.672151 n-d-839401-11 devstack@n-api.service[106496]: {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:16:50.672151 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:16:50.672992 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Aug 29 15:16:50.674680 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-78918ba0-fce7-4b2b-9cba-f9f1ab0dcb27 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:16:50.676514 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-78918ba0-fce7-4b2b-9cba-f9f1ab0dcb27 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.413875 Aug 29 15:16:50.676514 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Aug 29 15:16:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:50.684270 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-83cc064f-789e-473c-bd05-fc2a4eb7ae81 admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:50.699947 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-83cc064f-789e-473c-bd05-fc2a4eb7ae81 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019339 Aug 29 15:16:50.700487 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Aug 29 15:16:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:16:50.710332 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-435542bc-a796-4c27-ae50-2bb9ffbf2e60 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:50.725764 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-435542bc-a796-4c27-ae50-2bb9ffbf2e60 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019076 Aug 29 15:16:50.726634 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Aug 29 15:16:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:16:50.736170 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-44b21a11-186b-442f-8334-41c0595f718c admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:50.741989 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.wsgi [None req-44b21a11-186b-442f-8334-41c0595f718c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-44b21a11-186b-442f-8334-41c0595f718c admin admin] Request method failure captured: Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: Accept: application/json Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: Accept-Encoding: gzip, deflate Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: Connection: keep-alive Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: Content-Length: 0 Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: Host: 10.222.0.62 Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: Openstack-Api-Version: compute 2.90 Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: Openstack-System-Scope: None Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: User-Agent: python-novaclient Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: X-Auth-Token: gAAAAABjDNhihrxltx5ywujnLJsnRYw_fBAhdtPm99c_WV3ZTBmYd62cn8K4JAbkefqg-RAfTwieLy4ntzbpPKG797gKVVfYZfkutxAacDoDUIgak9TygfwGqNQQ15GdQu2PJzc-5W2HdvJQEGA7hokaBOPCK3JToX8Pgfv-8bpShj0xEBufqlc Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: X-Domain-Id: None Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: X-Domain-Name: None Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: X-Identity-Status: Confirmed Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: X-Is-Admin-Project: True Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: X-Project-Domain-Id: default Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: X-Project-Domain-Name: Default Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: X-Project-Id: 0db6623e969f401e96c9e7fb9ef93d53 Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: X-Project-Name: admin Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: X-Role: reader,member,admin Aug 29 15:16:50.743519 n-d-839401-11 devstack@n-api.service[106497]: X-Roles: reader,member,admin Aug 29 15:16:50.744993 n-d-839401-11 devstack@n-api.service[106497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0db6623e969f401e96c9e7fb9ef93d53", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0db6623e969f401e96c9e7fb9ef93d53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0db6623e969f401e96c9e7fb9ef93d53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0db6623e969f401e96c9e7fb9ef93d53"}]}] Aug 29 15:16:50.744993 n-d-839401-11 devstack@n-api.service[106497]: X-Tenant: admin Aug 29 15:16:50.744993 n-d-839401-11 devstack@n-api.service[106497]: X-Tenant-Id: 0db6623e969f401e96c9e7fb9ef93d53 Aug 29 15:16:50.744993 n-d-839401-11 devstack@n-api.service[106497]: X-Tenant-Name: admin Aug 29 15:16:50.744993 n-d-839401-11 devstack@n-api.service[106497]: X-User: admin Aug 29 15:16:50.744993 n-d-839401-11 devstack@n-api.service[106497]: X-User-Domain-Id: default Aug 29 15:16:50.744993 n-d-839401-11 devstack@n-api.service[106497]: X-User-Domain-Name: Default Aug 29 15:16:50.744993 n-d-839401-11 devstack@n-api.service[106497]: X-User-Id: 373008e94a9a49a8ba77e31df9e31448 Aug 29 15:16:50.744993 n-d-839401-11 devstack@n-api.service[106497]: X-User-Name: admin Aug 29 15:16:50.744993 n-d-839401-11 devstack@n-api.service[106497]: method: > Aug 29 15:16:50.744993 n-d-839401-11 devstack@n-api.service[106497]: exception: Flavor 84 could not be found. Aug 29 15:16:50.744993 n-d-839401-11 devstack@n-api.service[106497]: action_args: {'id': '84'} Aug 29 15:16:50.744993 n-d-839401-11 devstack@n-api.service[106497]: {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:16:50.744993 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:16:50.745921 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Aug 29 15:16:50.747195 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-44b21a11-186b-442f-8334-41c0595f718c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:16:50.748408 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-44b21a11-186b-442f-8334-41c0595f718c admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012337 Aug 29 15:16:50.748408 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 23/47] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Aug 29 15:16:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:51.728008 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-435542bc-a796-4c27-ae50-2bb9ffbf2e60 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:51.729023 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-435542bc-a796-4c27-ae50-2bb9ffbf2e60 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 29 15:16:51.729454 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 25/48] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 15:16:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:52.301019 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-5a2fcdf2-b29f-43b1-ad4e-b3f3c20c3a28 admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:52.307079 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.wsgi [None req-5a2fcdf2-b29f-43b1-ad4e-b3f3c20c3a28 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-5a2fcdf2-b29f-43b1-ad4e-b3f3c20c3a28 admin admin] Request method failure captured: Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: Accept: application/json Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: Accept-Encoding: gzip, deflate Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: Connection: keep-alive Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: Content-Length: 0 Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: Host: 10.222.0.62 Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: Openstack-Api-Version: compute 2.90 Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: Openstack-System-Scope: None Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: User-Agent: python-novaclient Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: X-Auth-Token: gAAAAABjDNhjoPFbfJdd9AIydh9fd_a2RlDQxxTBORWQ3jIHpkHjaw4Gylj4J_7u0We5mCWzAbkbMgTAX5GkTWeeg3ZIYCsZOssd5a6xPVHulRdz0BvEKLJrjEQC268yW2aeX4xQcQIYzwTMXdl-WRjUv7CHzdghlP70iohtQ85sug0jOI1Ccxk Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: X-Domain-Id: None Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: X-Domain-Name: None Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: X-Identity-Status: Confirmed Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: X-Is-Admin-Project: True Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: X-Project-Domain-Id: default Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: X-Project-Domain-Name: Default Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: X-Project-Id: 0db6623e969f401e96c9e7fb9ef93d53 Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: X-Project-Name: admin Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: X-Role: reader,member,admin Aug 29 15:16:52.308586 n-d-839401-11 devstack@n-api.service[106497]: X-Roles: reader,member,admin Aug 29 15:16:52.310210 n-d-839401-11 devstack@n-api.service[106497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0db6623e969f401e96c9e7fb9ef93d53", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0db6623e969f401e96c9e7fb9ef93d53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0db6623e969f401e96c9e7fb9ef93d53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0db6623e969f401e96c9e7fb9ef93d53"}]}] Aug 29 15:16:52.310210 n-d-839401-11 devstack@n-api.service[106497]: X-Tenant: admin Aug 29 15:16:52.310210 n-d-839401-11 devstack@n-api.service[106497]: X-Tenant-Id: 0db6623e969f401e96c9e7fb9ef93d53 Aug 29 15:16:52.310210 n-d-839401-11 devstack@n-api.service[106497]: X-Tenant-Name: admin Aug 29 15:16:52.310210 n-d-839401-11 devstack@n-api.service[106497]: X-User: admin Aug 29 15:16:52.310210 n-d-839401-11 devstack@n-api.service[106497]: X-User-Domain-Id: default Aug 29 15:16:52.310210 n-d-839401-11 devstack@n-api.service[106497]: X-User-Domain-Name: Default Aug 29 15:16:52.310210 n-d-839401-11 devstack@n-api.service[106497]: X-User-Id: 373008e94a9a49a8ba77e31df9e31448 Aug 29 15:16:52.310210 n-d-839401-11 devstack@n-api.service[106497]: X-User-Name: admin Aug 29 15:16:52.310210 n-d-839401-11 devstack@n-api.service[106497]: method: > Aug 29 15:16:52.310210 n-d-839401-11 devstack@n-api.service[106497]: exception: Flavor 451 could not be found. Aug 29 15:16:52.310210 n-d-839401-11 devstack@n-api.service[106497]: action_args: {'id': '451'} Aug 29 15:16:52.310210 n-d-839401-11 devstack@n-api.service[106497]: {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:16:52.310210 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:16:52.311100 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: ERROR nova.api.openstack.wsgi Aug 29 15:16:52.312408 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-5a2fcdf2-b29f-43b1-ad4e-b3f3c20c3a28 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:16:52.313659 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-5a2fcdf2-b29f-43b1-ad4e-b3f3c20c3a28 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.445161 Aug 29 15:16:52.313659 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 24/49] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Aug 29 15:16:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:52.319974 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-c78f6387-7d63-4163-bea1-e4763d7d21c8 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:52.335727 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-c78f6387-7d63-4163-bea1-e4763d7d21c8 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019348 Aug 29 15:16:52.336273 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Aug 29 15:16:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:16:52.346118 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-4053a073-1ace-488a-befb-4bd02642b34c admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:52.361657 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-4053a073-1ace-488a-befb-4bd02642b34c admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019249 Aug 29 15:16:52.362185 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Aug 29 15:16:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:16:52.371638 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-00104114-5abf-4e6e-ad3e-a843f2b706af admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:52.377037 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.wsgi [None req-00104114-5abf-4e6e-ad3e-a843f2b706af admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-00104114-5abf-4e6e-ad3e-a843f2b706af admin admin] Request method failure captured: Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: Accept: application/json Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: Accept-Encoding: gzip, deflate Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: Connection: keep-alive Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: Content-Length: 0 Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: Host: 10.222.0.62 Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: Openstack-Api-Version: compute 2.90 Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: Openstack-System-Scope: None Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: User-Agent: python-novaclient Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: X-Auth-Token: gAAAAABjDNhjoPFbfJdd9AIydh9fd_a2RlDQxxTBORWQ3jIHpkHjaw4Gylj4J_7u0We5mCWzAbkbMgTAX5GkTWeeg3ZIYCsZOssd5a6xPVHulRdz0BvEKLJrjEQC268yW2aeX4xQcQIYzwTMXdl-WRjUv7CHzdghlP70iohtQ85sug0jOI1Ccxk Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: X-Domain-Id: None Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: X-Domain-Name: None Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: X-Identity-Status: Confirmed Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: X-Is-Admin-Project: True Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: X-Project-Domain-Id: default Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: X-Project-Domain-Name: Default Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: X-Project-Id: 0db6623e969f401e96c9e7fb9ef93d53 Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: X-Project-Name: admin Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: X-Role: reader,member,admin Aug 29 15:16:52.378579 n-d-839401-11 devstack@n-api.service[106496]: X-Roles: reader,member,admin Aug 29 15:16:52.380059 n-d-839401-11 devstack@n-api.service[106496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0db6623e969f401e96c9e7fb9ef93d53", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0db6623e969f401e96c9e7fb9ef93d53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0db6623e969f401e96c9e7fb9ef93d53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0db6623e969f401e96c9e7fb9ef93d53"}]}] Aug 29 15:16:52.380059 n-d-839401-11 devstack@n-api.service[106496]: X-Tenant: admin Aug 29 15:16:52.380059 n-d-839401-11 devstack@n-api.service[106496]: X-Tenant-Id: 0db6623e969f401e96c9e7fb9ef93d53 Aug 29 15:16:52.380059 n-d-839401-11 devstack@n-api.service[106496]: X-Tenant-Name: admin Aug 29 15:16:52.380059 n-d-839401-11 devstack@n-api.service[106496]: X-User: admin Aug 29 15:16:52.380059 n-d-839401-11 devstack@n-api.service[106496]: X-User-Domain-Id: default Aug 29 15:16:52.380059 n-d-839401-11 devstack@n-api.service[106496]: X-User-Domain-Name: Default Aug 29 15:16:52.380059 n-d-839401-11 devstack@n-api.service[106496]: X-User-Id: 373008e94a9a49a8ba77e31df9e31448 Aug 29 15:16:52.380059 n-d-839401-11 devstack@n-api.service[106496]: X-User-Name: admin Aug 29 15:16:52.380059 n-d-839401-11 devstack@n-api.service[106496]: method: > Aug 29 15:16:52.380059 n-d-839401-11 devstack@n-api.service[106496]: exception: Flavor 451 could not be found. Aug 29 15:16:52.380059 n-d-839401-11 devstack@n-api.service[106496]: action_args: {'id': '451'} Aug 29 15:16:52.380059 n-d-839401-11 devstack@n-api.service[106496]: {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:16:52.380059 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:16:52.381020 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: ERROR nova.api.openstack.wsgi Aug 29 15:16:52.382441 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-00104114-5abf-4e6e-ad3e-a843f2b706af admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:16:52.383688 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-00104114-5abf-4e6e-ad3e-a843f2b706af admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011861 Aug 29 15:16:52.383688 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 27/52] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Aug 29 15:16:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:16:53.367817 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-4053a073-1ace-488a-befb-4bd02642b34c admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:53.368811 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-4053a073-1ace-488a-befb-4bd02642b34c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 29 15:16:53.369245 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 15:16:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:53.957864 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-ee4e587b-8074-464a-8891-91c7c8eda9e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:53.981236 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-ee4e587b-8074-464a-8891-91c7c8eda9e1 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.462580 Aug 29 15:16:53.981771 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 28/54] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Aug 29 15:16:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:16:54.992272 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-4053a073-1ace-488a-befb-4bd02642b34c admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:54.993307 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-4053a073-1ace-488a-befb-4bd02642b34c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 29 15:16:54.993990 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 15:16:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:55.553580 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-21fefcf9-a39a-4ad9-8fac-d54921928680 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:55.578618 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-21fefcf9-a39a-4ad9-8fac-d54921928680 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.448688 Aug 29 15:16:55.579287 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Aug 29 15:16:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:16:56.574995 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-4053a073-1ace-488a-befb-4bd02642b34c admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:56.576003 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-4053a073-1ace-488a-befb-4bd02642b34c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 29 15:16:56.576438 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 15:16:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:16:57.138912 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-1304a4f4-3e02-4034-a4cb-9d692f1e9198 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:57.162230 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-1304a4f4-3e02-4034-a4cb-9d692f1e9198 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.448819 Aug 29 15:16:57.162873 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Aug 29 15:16:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:16:58.148156 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-4053a073-1ace-488a-befb-4bd02642b34c admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:58.149219 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-4053a073-1ace-488a-befb-4bd02642b34c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 29 15:16:58.149642 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 29/59] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 15:16:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:16:58.693262 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-1769dd9f-cfd2-4e4b-8cb5-3c3322e5debb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:16:58.713336 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-1769dd9f-cfd2-4e4b-8cb5-3c3322e5debb admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.426907 Aug 29 15:16:58.713807 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 31/60] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Aug 29 15:16:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:16:59.714810 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-4053a073-1ace-488a-befb-4bd02642b34c admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:16:59.715858 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-4053a073-1ace-488a-befb-4bd02642b34c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 29 15:16:59.716297 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 30/61] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 15:16:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:17:00.271897 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-5c32283f-49d6-464d-8a78-f6c90b9aa264 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:00.299709 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-5c32283f-49d6-464d-8a78-f6c90b9aa264 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.449590 Aug 29 15:17:00.300232 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1202 bytes} [Mon Aug 29 15:16:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:17:54.071566 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-4053a073-1ace-488a-befb-4bd02642b34c admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:54.072686 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-4053a073-1ace-488a-befb-4bd02642b34c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Aug 29 15:17:54.073233 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 15:17:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:17:54.085911 n-d-839401-11 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:54.485318 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-0b5cb817-58e0-484f-98e4-2f0e9f47c840 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:54.512431 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-0b5cb817-58e0-484f-98e4-2f0e9f47c840 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.432873 Aug 29 15:17:54.512962 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Aug 29 15:17:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:17:54.534054 n-d-839401-11 devstack@n-api.service[106497]: DEBUG dbcounter [-] [106497] Writing DB stats nova_api:SELECT=14 {{(pid=106497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:17:54.537848 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-0b892d5f-8995-4cbf-9a1e-a3535d677f0f admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:54.545641 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-0b892d5f-8995-4cbf-9a1e-a3535d677f0f admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013349 Aug 29 15:17:54.546168 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1283 bytes} [Mon Aug 29 15:17:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:17:54.558222 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-cc20549c-08c6-41f5-8b90-7b0fe7652183 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:54.567192 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-cc20549c-08c6-41f5-8b90-7b0fe7652183 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012294 Aug 29 15:17:54.568130 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 34/66] 10.222.0.62 () {60 vars in 1286 bytes} [Mon Aug 29 15:17:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:17:54.580344 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-0cda72de-3ef4-4093-ae76-6b3d16ddeba3 admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:54.588526 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-0cda72de-3ef4-4093-ae76-6b3d16ddeba3 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011871 Aug 29 15:17:54.589039 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1286 bytes} [Mon Aug 29 15:17:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:17:54.604336 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-14fee2c1-74d0-4940-a5d0-35009e6bf9b6 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:17:54.616425 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-14fee2c1-74d0-4940-a5d0-35009e6bf9b6 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018223 Aug 29 15:17:54.616951 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 35/68] 10.222.0.62 () {60 vars in 1283 bytes} [Mon Aug 29 15:17:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:23:18.495550 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-0cda72de-3ef4-4093-ae76-6b3d16ddeba3 admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:23:18.496542 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-0cda72de-3ef4-4093-ae76-6b3d16ddeba3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 29 15:23:18.496935 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 34/69] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 15:23:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:23:18.635858 n-d-839401-11 devstack@n-api.service[106496]: DEBUG dbcounter [-] [106496] Writing DB stats nova_api:SELECT=6 {{(pid=106496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:23:18.777763 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-f1c90426-f22a-4d2f-81ea-37eaff94ede3 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:23:18.781509 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-f1c90426-f22a-4d2f-81ea-37eaff94ede3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:23:18.781989 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-f1c90426-f22a-4d2f-81ea-37eaff94ede3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:23:18.782416 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-f1c90426-f22a-4d2f-81ea-37eaff94ede3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:23:18.783161 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-f1c90426-f22a-4d2f-81ea-37eaff94ede3 admin admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:23:18.783606 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-f1c90426-f22a-4d2f-81ea-37eaff94ede3 admin admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:23:18.784022 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-f1c90426-f22a-4d2f-81ea-37eaff94ede3 admin admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:23:18.824382 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-f1c90426-f22a-4d2f-81ea-37eaff94ede3 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.189936 Aug 29 15:23:18.825199 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 36/70] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Aug 29 15:23:18 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:23:19.657706 n-d-839401-11 devstack@n-api.service[106497]: DEBUG nova.api.openstack.wsgi [None req-0cda72de-3ef4-4093-ae76-6b3d16ddeba3 admin admin] Calling method '>' {{(pid=106497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:23:19.658747 n-d-839401-11 devstack@n-api.service[106497]: INFO nova.api.openstack.requestlog [None req-0cda72de-3ef4-4093-ae76-6b3d16ddeba3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 29 15:23:19.659113 n-d-839401-11 devstack@n-api.service[106497]: [pid: 106497|app: 0|req: 35/71] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 15:23:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:23:19.862911 n-d-839401-11 devstack@n-api.service[106496]: DEBUG nova.api.openstack.wsgi [None req-5f4e6297-cfa3-451a-b76e-9172cc116704 admin admin] Calling method '>' {{(pid=106496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:23:19.866277 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-5f4e6297-cfa3-451a-b76e-9172cc116704 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:23:19.866751 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-5f4e6297-cfa3-451a-b76e-9172cc116704 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:23:19.867308 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-5f4e6297-cfa3-451a-b76e-9172cc116704 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:23:19.868551 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-5f4e6297-cfa3-451a-b76e-9172cc116704 admin admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:23:19.869005 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-5f4e6297-cfa3-451a-b76e-9172cc116704 admin admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:23:19.869449 n-d-839401-11 devstack@n-api.service[106496]: DEBUG oslo_concurrency.lockutils [None req-5f4e6297-cfa3-451a-b76e-9172cc116704 admin admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:23:19.891455 n-d-839401-11 devstack@n-api.service[106496]: INFO nova.api.openstack.requestlog [None req-5f4e6297-cfa3-451a-b76e-9172cc116704 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.091285 Aug 29 15:23:19.892071 n-d-839401-11 devstack@n-api.service[106496]: [pid: 106496|app: 0|req: 37/72] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Aug 29 15:23:19 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:24:05.855617 n-d-839401-11 devstack@n-api.service[106495]: Mon Aug 29 15:24:05 2022 - graceful shutdown triggered... Aug 29 15:24:05.855275 n-d-839401-11 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 15:24:05.856570 n-d-839401-11 devstack@n-api.service[106496]: Gracefully killing worker 1 (pid: 106496)... Aug 29 15:24:05.856965 n-d-839401-11 devstack@n-api.service[106497]: Gracefully killing worker 2 (pid: 106497)... Aug 29 15:24:06.856466 n-d-839401-11 devstack@n-api.service[106495]: worker 1 buried after 1 seconds Aug 29 15:24:06.856466 n-d-839401-11 devstack@n-api.service[106495]: worker 2 buried after 1 seconds Aug 29 15:24:06.856466 n-d-839401-11 devstack@n-api.service[106495]: goodbye to uWSGI. Aug 29 15:24:06.858274 n-d-839401-11 systemd[1]: devstack@n-api.service: Succeeded. Aug 29 15:24:06.858850 n-d-839401-11 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 15:24:06.861630 n-d-839401-11 systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 15:24:06.893275 n-d-839401-11 devstack@n-api.service[122351]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 15:24:06.925112 n-d-839401-11 devstack@n-api.service[122351]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 15:24:06 2022] *** Aug 29 15:24:06.925112 n-d-839401-11 devstack@n-api.service[122351]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 15:24:06.925112 n-d-839401-11 devstack@n-api.service[122351]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 15:24:06.925112 n-d-839401-11 devstack@n-api.service[122351]: nodename: n-d-839401-11 Aug 29 15:24:06.925112 n-d-839401-11 devstack@n-api.service[122351]: machine: x86_64 Aug 29 15:24:06.925112 n-d-839401-11 devstack@n-api.service[122351]: clock source: unix Aug 29 15:24:06.925112 n-d-839401-11 devstack@n-api.service[122351]: pcre jit disabled Aug 29 15:24:06.925112 n-d-839401-11 devstack@n-api.service[122351]: detected number of CPU cores: 4 Aug 29 15:24:06.925112 n-d-839401-11 devstack@n-api.service[122351]: current working directory: / Aug 29 15:24:06.925112 n-d-839401-11 devstack@n-api.service[122351]: detected binary path: /usr/bin/uwsgi-core Aug 29 15:24:06.925112 n-d-839401-11 devstack@n-api.service[122351]: your processes number limit is 47680 Aug 29 15:24:06.925112 n-d-839401-11 devstack@n-api.service[122351]: your memory page size is 4096 bytes Aug 29 15:24:06.925112 n-d-839401-11 devstack@n-api.service[122351]: detected max file descriptor number: 2048 Aug 29 15:24:06.925112 n-d-839401-11 devstack@n-api.service[122351]: lock engine: pthread robust mutexes Aug 29 15:24:06.926205 n-d-839401-11 devstack@n-api.service[122351]: thunder lock: enabled Aug 29 15:24:06.926205 n-d-839401-11 devstack@n-api.service[122351]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 15:24:06.926205 n-d-839401-11 devstack@n-api.service[122351]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 15:24:06.964516 n-d-839401-11 devstack@n-api.service[122351]: Python main interpreter initialized at 0x555c120fd9c0 Aug 29 15:24:06.964516 n-d-839401-11 devstack@n-api.service[122351]: python threads support enabled Aug 29 15:24:06.964516 n-d-839401-11 devstack@n-api.service[122351]: your server socket listen backlog is limited to 100 connections Aug 29 15:24:06.964516 n-d-839401-11 devstack@n-api.service[122351]: your mercy for graceful operations on workers is 90 seconds Aug 29 15:24:06.968866 n-d-839401-11 devstack@n-api.service[122351]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 15:24:06.969018 n-d-839401-11 devstack@n-api.service[122351]: *** Operational MODE: preforking *** Aug 29 15:24:06.970790 n-d-839401-11 devstack@n-api.service[122351]: *** uWSGI is running in multiple interpreter mode *** Aug 29 15:24:06.970790 n-d-839401-11 devstack@n-api.service[122351]: spawned uWSGI master process (pid: 122351) Aug 29 15:24:06.971029 n-d-839401-11 systemd[1]: Started Devstack devstack@n-api.service. Aug 29 15:24:06.972315 n-d-839401-11 devstack@n-api.service[122351]: spawned uWSGI worker 1 (pid: 122360, cores: 1) Aug 29 15:24:06.972832 n-d-839401-11 devstack@n-api.service[122351]: spawned uWSGI worker 2 (pid: 122361, cores: 1) Aug 29 15:24:06.973269 n-d-839401-11 devstack@n-api.service[122351]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 15:24:07.624741 n-d-839401-11 devstack@n-api.service[122360]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 15:24:07.625657 n-d-839401-11 devstack@n-api.service[122361]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 15:24:08.774421 n-d-839401-11 devstack@n-api.service[122360]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:24:08.774421 n-d-839401-11 devstack@n-api.service[122360]: from cryptography.utils import int_from_bytes Aug 29 15:24:08.775221 n-d-839401-11 devstack@n-api.service[122360]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:24:08.775221 n-d-839401-11 devstack@n-api.service[122360]: from cryptography.utils import int_from_bytes Aug 29 15:24:08.778396 n-d-839401-11 devstack@n-api.service[122361]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:24:08.778396 n-d-839401-11 devstack@n-api.service[122361]: from cryptography.utils import int_from_bytes Aug 29 15:24:08.779183 n-d-839401-11 devstack@n-api.service[122361]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:24:08.779183 n-d-839401-11 devstack@n-api.service[122361]: from cryptography.utils import int_from_bytes Aug 29 15:24:11.219304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 15:24:11.220043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 15:24:11.220043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 15:24:11.220312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 15:24:11.220793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 15:24:11.221233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.221515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.221819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.222195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.222432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.222753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.223070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.223381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.223709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.223963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.224273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.224589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-839401-11 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.224896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.225216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 15:24:11.225658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.225765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 15:24:11.225872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.225872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.226100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.226259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 15:24:11.226391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.226771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 15:24:11.226889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.227139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 15:24:11.227378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.227654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.228030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.228336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.228802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.229147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.229489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.229798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.230014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.230268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.230457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.230641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.230842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.231039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.231039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.231437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.231634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-839401-11 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.231831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.232027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.232027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.232455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.232653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.232852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.233049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.233049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.233464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.233627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.233799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.233973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.234116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.234274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.234274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.234613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-839401-11 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.234764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.234764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.235057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.235219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.235366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.235567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.235702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.236265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.236462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.236661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.236816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.236816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.237198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.237336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.237494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.237640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.237640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.237929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.238077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.238215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.238506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.238693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.238844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.239024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.239193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.239326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.239522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.239739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.239877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.240027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.240163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.240384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.240555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.240704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.240965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.241138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.241291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.241509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.241657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.241856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.241994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.242130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.242470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.242632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.242768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.242932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.243068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.243336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.243494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.243646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.244025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-839401-11 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.245240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.245240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.245551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.245704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.245849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.246002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.246169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.246341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.246341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.246663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.247221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.247366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.247515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.247515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.247789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.247926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.247926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.248207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.248341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.248487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.248775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.248775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.249074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.249262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.249262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.249572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.249714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.249927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.250068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.250068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.250362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.250592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.250592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.250881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.251056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.251207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.251340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.251340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.251617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.251753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.251753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.252038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.252180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.252326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.252474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.252474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.252746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.252902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.252902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.253227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.253375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.253510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.253645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.253645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.253934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.254069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.254216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.254350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.254494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.254763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.254929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.255078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.255279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.255431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.255645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.255804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.255952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.256094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.256250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.256518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.256692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.256829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.257492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.257641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.257792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.257941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.257941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.258200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.258345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.258345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.258625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.258901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.259055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.259200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.259200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.259487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.259663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.259854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.260074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.260337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.260478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.260625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.260832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.260972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.261220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.261376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.261545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.261840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.261989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.262174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.262341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.262480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.262758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.262912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.263053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.263297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.263440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.263706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.263861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.264030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.264240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.264379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.264665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.264833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.264976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.265215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.265394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.265590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.265740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.265900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.266159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.266301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.266510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.266665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.266865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.267192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.267729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.267729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.268003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.268151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.268287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.268434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.268434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.268703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.268965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.269203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.269366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.269366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.269670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.269840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.269973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.270186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.270186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.270481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.270618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.270794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.270930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.271122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.271279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.271432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.271654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.271811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.272032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.272167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.272343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.272563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.272707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.272938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.273103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.273282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.273507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.273651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.273900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.274049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.274212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.274419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.274571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.274818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.274967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.275122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.275330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.275478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.275713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.275864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.275999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.276237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.276375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.276619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.276769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.276916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.277302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.277687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.277687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.278169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.278307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.278753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.278930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.278930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.279331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.279480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.279616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.279797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.279797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.280065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.280215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.280215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.280557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.280704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.280859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.281060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.281246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.281388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.281532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.281811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.281981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.282137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.282299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.282480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.282780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.282919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.283080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.283273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.283419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.283676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.283810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.283981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.284196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.284353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.284570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.284706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.284887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.285137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.285291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.285505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.285668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.285817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.286062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.286209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.286400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.286542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.286711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.286992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.287136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.287433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.287819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.288165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.288313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.288463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.288619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.288766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.288766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.289044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.289329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.289464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.289612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.289612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.289893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.289987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.290086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.290288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.290388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.290792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.290916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.291129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.291348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.291441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.291720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.291910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.292024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.292323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.292483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.292626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.292925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.293029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.293252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.293534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.293631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.293837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.294095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.294194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.294437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.294650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:24:11.294742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.295026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.295236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.295335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.295607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.295823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.295943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.296245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.296420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.296582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.296906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.297030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.297259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.297544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.297665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.298086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.298353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.298453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.298540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.298633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.298786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.299092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.299318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.299427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.299649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.299756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.299987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.300262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.300356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.300594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.300834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.300951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.301227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.301426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.301532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.301833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.301983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.302168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.302474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.302570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.302802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.303044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.303144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.303419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.303618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.303717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.304017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.304180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.304320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.304623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.304714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.304930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.305743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.305868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.305968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.306055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.306055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.306218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.306304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.306478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.306785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.306885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.307087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.307353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.307445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.307691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.308001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.308113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.308440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.308545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.308632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.308899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.309139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.309249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.310068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.310179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.310304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.310406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.310501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.310501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.310675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.310769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.310993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.311242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.311335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.311572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.311795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.311894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.312167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.312350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.312469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.312776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.312921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.313103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.313406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.313522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.313756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.314051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.314154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.314365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.314619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.314719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.314970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.315179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.315270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.315573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.315762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.315855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.316204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.316310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.316478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.316776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.316875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.317074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.317359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.317451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.317768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.317892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.318005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.318386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.318681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.318780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.318944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.319051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.319250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.319570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.319677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.319855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.320079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.320188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.320465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.320643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.320775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.321100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.321202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.321407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.321706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.322013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.322198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.322299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.322508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.322780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.322872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.323124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.323347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.323438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.323720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.323950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.324049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.324309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.324498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.324622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.324974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.325227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.325488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.325582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.325854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.326056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.326164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.326468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.329420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.329548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.329806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.329915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.330006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.330100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.330244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.330343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.330430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.330515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.330607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.330693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.330693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.330857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.330943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.331043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.331152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.331152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.331336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.331423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.331423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.331423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.331423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.331733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.331826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.331826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.331826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.332057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.332149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.332364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.332483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.332735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.332946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.333047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.333376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.333645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.333750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.333959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.334237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.334340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.334577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.334842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.334948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.335195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.335433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.335533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.335841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.336025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.336141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.336442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.336602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.336760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.337059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.337202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.337555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.337668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.337852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.338158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.338257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.338461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.338756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.338856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.339189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.339655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.339889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.339889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.340065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.340152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.340289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.340446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.340554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.340790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.341029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.341149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.341412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.341665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.341771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.341994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.342269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.342389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.342588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.342853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.342960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.343179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.343450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.343542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.343774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.344063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.344157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.344359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.344645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.344736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.345026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.345284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.345501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.345785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.345883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.346105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.346366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.346471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.346748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.346944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.347037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.347295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.347511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.347612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.347877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.348092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.348192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.348484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.348689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.348782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.349097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.349538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.349937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.350035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.350132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.350132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.350334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.350430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.350564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.350829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.351006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.351126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.351421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.351511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.351720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.351997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.352098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.352317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.352571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.352684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.353517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.353645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.353735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.353831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.353925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.353925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.354118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.354284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.354469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.354771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.354862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.355080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.355376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.355477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.355690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.355983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.356087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.356289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.356588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.356687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.356899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.357211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.357323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.357520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.357798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.357892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.358104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.358424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.358548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.358708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.358998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.359099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.359313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.359737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.360124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.360124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.360302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.360467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.360569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.360663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.360817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.361138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.361251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.361448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.362050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.362169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.362266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.362364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.362459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.362634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.362960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.363065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.363232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.363482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.363585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.363825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.364073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.364173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.366554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.366696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.366787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.366881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.366976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.367063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.367156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.367252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.367346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.367433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.367526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.367612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.367712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.367712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.367712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.367712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.368034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.368120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.368120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.368285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.369358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.369478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.369579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.369685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.369788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.369788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.369959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.370504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.370613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.370701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.370799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.370886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.372501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.372622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.372725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.372826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.372922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.373036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.373191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.373283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.373369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.373369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.373369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.373616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.373701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.373701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.373701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.374058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.374171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.374371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.374680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.374799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.375077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.375277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.375390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.375675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.375871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.375982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.376424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.376532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.376860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.376970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.377201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.377518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.377651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.377826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.378148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.378265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.378465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.378737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.378859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.379069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.379325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.379439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.379675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.379936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.380058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.380285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.380524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.380640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.380998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.381159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.381340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.381631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.381737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.382035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.382209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.382364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.382556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.382804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.382910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.383157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.383388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.383508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.383746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.383982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.384111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.384917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.385044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.385177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.385276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.385276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.385452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.385599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.385748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.386056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.386162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.386521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.386631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.386720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.386971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.387232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.387348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.387585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.387828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.387940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.388189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.388442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.388564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.388795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.389049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.389207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.389410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.390402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.390533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.390643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.390745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.390745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.390958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.391068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.391068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.391242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.391474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.391592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.391881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.392081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.392207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.392519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.392693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.392804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.393239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.393446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.393782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.393897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.394074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.394368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.394489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.394678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.394870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.394983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.395289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.395511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.395619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.395847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.396107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.396246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.396434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.396687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.396813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.397040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.397335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.397471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.397688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.397963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.398079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.398277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.398538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.398658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.398901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.399135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.399240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.399508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.399776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.400049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.400331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.400450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.400629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.400830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.401010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.401265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.401521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.401628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.401870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.402064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.402187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.402485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.402600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.402784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.403101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.403239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.403718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.403999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.404127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.404500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.404607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.404902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.405108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.405264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.405581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.405888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.406201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.406474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.406581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.406803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.407066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.407166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.407453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.407761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.407860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.408088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.408370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.408469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.408711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.408971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.409073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.409371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.409589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.409682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.409980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.410292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.410529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.410645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.410956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.411144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.411247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.411552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.411751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.411886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.412158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.412344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.412474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.412761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.412962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.413106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.413402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.413602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.413697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.414002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.414216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.414349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.414606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.414848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.414953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.415243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.415412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.416599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.416719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.416807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.416894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.416979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.417163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.417259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.417346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.417432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.417675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.417826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.417985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.418135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.418331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.418483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.418757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.418884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.419013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.419297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.419405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.419630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.419897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.420006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.420201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.420474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.420574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.420789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.421064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.421198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.421436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.421677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.421782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.422060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.422253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.422358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.422774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.422910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.423627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.423749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.423840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.423966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.424102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.424195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.424376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.424491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.424743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.424974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.425170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.425385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.425587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.425707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.425983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.426156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.426287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.426589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.426725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.426916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.427202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.427314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.427505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.427805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.427988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.428116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.428365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.428464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.428702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.428903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.429041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.429334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.429429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.429639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.429913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.430021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.430237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.430439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.430539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.430824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.431014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.431346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.431544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.431647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.431930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.432189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.432295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.432521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.432698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.432831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.433164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.433286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.433533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.433804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.433908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.434125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.434385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.434489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.434727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.435001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.435109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.435322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.435562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.435668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.435986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.436129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.436256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.436564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.436699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.436875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.437258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.437480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.437762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.437855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.438115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.438621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.438743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.438841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.438929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.439293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.439408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.439597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.439900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.440002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.440223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.440479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.440573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.440828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.441047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.441209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.441470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.441654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.441778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.442085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.442236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.442401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.442701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.442798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.442994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.443295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.443393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.443637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.443895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.443989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.444197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.444475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.444581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.444804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.445065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.445257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.445461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.445665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.445760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.446074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.446209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.446387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.446519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.446694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.446800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.447001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.447097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.447305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.447409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.447611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.447707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.447922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.448024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.448246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.448351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.448554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.448647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.448855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.448949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.449188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.449300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.449508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.449603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.449837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.449940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.450161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.450263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.450471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.450565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.450786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.450889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.451097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.451191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.451412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.451517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.451720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.451830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.452025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.452119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.452333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.452427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.452641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.452750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.452947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.453040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.453282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.453392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.453591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.453695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.453897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.453998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.454219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.454316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.454523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.454620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.454835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.454928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.455139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.455232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.455439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.455544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.455758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.455866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.456040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.456145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.456341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.456444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.456642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.456743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.456943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.457048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.457267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.457374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.457573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.457676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.457873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.457980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.458172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.458266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.458484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.458578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.458769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.458880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.459068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.459188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.459366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.459496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.459672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.459805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.459970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.460130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.460269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.460443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.460565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.460761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.460857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.461102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.461199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.461483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.461589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.461814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.461916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.462121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.462213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.462434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.462616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.462745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.462926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.463055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.463245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.463375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.463550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.463689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.463869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.464003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.464186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.464320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.464500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.464635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.464807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.464947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.465179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.465316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.465516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.465623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.465849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.465957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.466144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.466248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.466449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.466553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.466689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.466784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.467060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.467177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.467313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.467407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.467673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.467782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.467924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.468013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.468238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.468348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.468552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.468664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.468869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.468995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.469207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.469337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.469516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.469654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.469887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.470015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.470197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.470330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.470502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.470644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.470809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.494038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.495059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.498295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.498687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.498979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.499714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.500136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.500634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.502323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.502586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.504120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.504334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.504532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.504707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.505450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.505603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.505831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.506078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.506253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.506528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.506528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.506792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.506983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.507114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.507244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.507439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.507653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.507986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.508216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.508436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.508582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.508802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.508940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.509142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.509420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.509590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.509760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.509921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.510069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 15:24:11.510228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.510228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.510228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.510228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.510228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.510228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.510228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.510228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.511181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.511181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.511181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.511181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.511181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.511181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.511181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.511181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.512157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.512157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.512157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.512157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.512157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.512157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.512157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.512157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.513223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.513223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.513223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.513223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.513223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.513223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.513223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.513223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.514329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.514329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.514329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.514329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.514329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.514329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.514329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.514329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.515300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.515300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.515300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.515300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.515300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.515300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.515300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.515300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.516260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.516260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.516260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.516260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.516260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.516260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.516260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.516260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.517286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.517286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.517286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.517286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.517286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.517286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.517286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.517286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.518429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.518429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.518429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.518429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.518429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.518429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.518429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.518429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.519388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.519388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.519388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.519388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.519388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.519388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.519388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.519388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.520395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.520395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.520395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.520395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.520395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.520395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.520395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.520395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.521401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.521401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.521401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.521401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.521401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.521401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.521401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.521401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.522381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.522381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.522381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.522381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.522381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.522381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.522381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.522381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.523377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.523377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.523377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.523377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.523377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.523377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.523377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.524326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.524326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.524326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.524326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.524326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.524326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.524326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.525225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.525225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.525225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.525225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.525225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.525225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.525225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.525225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.526244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.526244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.526244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.526244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.526244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.526244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.526244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.526244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.527212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.527212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.527212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.527212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.527212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.527833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.527833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.528093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.528386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.528892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.529247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.529566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.529877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.530203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.530519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.531062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.531481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.531723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.532055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.532473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.532800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.533153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.533488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.533804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.534122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.534442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.534762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.535072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.535383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.535699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.536013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.536321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.536635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.536941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.537325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.537639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.537951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.538264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.538581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.538893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.539201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.539514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.539824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.540140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.540452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.540765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.541074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.541410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.541720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.542034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.542392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.542723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.542871 n-d-839401-11 devstack@n-api.service[122361]: INFO dbcounter [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] Registered counter for database nova_api Aug 29 15:24:11.543031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.543339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.544009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.544009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.544285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.544600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.544914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.545299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.545635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.546167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.546510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.546838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.547178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.547511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.547821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.548165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.548716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.548880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.550648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.550648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.550648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.550648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.550648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.550648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.551044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.551249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.551721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.553157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.553360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.553702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.554104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.554321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.554648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.555040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.555367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.555693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.556017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.556340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.556659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.556975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.557333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.557651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.557972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.558309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.558625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.558625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.558625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.558625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.560172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.560247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.560588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.560898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.561252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.561570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.561896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.562211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.562551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.562898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.563229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.563634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.563974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.564269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.564588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.564905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.565559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.565559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.566408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.566408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.566533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.566775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.567084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.567393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.567704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.568017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.568327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.568617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.571042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.571042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.571042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.571042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.571042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.571042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.571452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_db.sqlalchemy.engines [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:24:11.571529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.571529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.571529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.577247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.577247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.577247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.577247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.577247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.577247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.577247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.577247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.577710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.577710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.577710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.577710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.577710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.577710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.577710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.577710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.578139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.578139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.578139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.578139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.578139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.578139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.578459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.579414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.579414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.579597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.580476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.580476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.580476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.583264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.583264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.583264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.583264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.583264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.583264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.583264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.584225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.584225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.584225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.584584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.585657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.585657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.585657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.585864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.586110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.586461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.586795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.587119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.587432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.587745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:24:11.587990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 15:24:11.599047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writer thread running {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:24:11.651431 n-d-839401-11 devstack@n-api.service[122360]: INFO dbcounter [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] Registered counter for database nova_api Aug 29 15:24:11.658559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.context [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dcf211bc-da73-4d63-b885-2b9e7c1e329b(cell1) {{(pid=122361) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 15:24:11.662887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:11.663369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:11.664956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:11.665731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:11.666181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:11.668187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:11.670266 n-d-839401-11 devstack@n-api.service[122361]: INFO dbcounter [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] Registered counter for database nova_cell0 Aug 29 15:24:11.672336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_db.sqlalchemy.engines [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:24:11.676004 n-d-839401-11 devstack@n-api.service[122361]: INFO dbcounter [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] Registered counter for database nova_cell1 Aug 29 15:24:11.679950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writer thread running {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:24:11.683377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_db.sqlalchemy.engines [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:24:11.687094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_db.sqlalchemy.engines [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:24:11.689649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writer thread running {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:24:11.743726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.context [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dcf211bc-da73-4d63-b885-2b9e7c1e329b(cell1) {{(pid=122360) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 15:24:11.748233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:11.748862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:11.750606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:11.751720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:11.752306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:11.754485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:11.756654 n-d-839401-11 devstack@n-api.service[122360]: INFO dbcounter [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] Registered counter for database nova_cell0 Aug 29 15:24:11.762725 n-d-839401-11 devstack@n-api.service[122360]: INFO dbcounter [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] Registered counter for database nova_cell1 Aug 29 15:24:11.770621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_db.sqlalchemy.engines [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:24:11.772863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_db.sqlalchemy.engines [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:24:11.781057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writer thread running {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:24:11.782677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writer thread running {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:24:11.838518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writer thread running {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:24:11.850739 n-d-839401-11 devstack@n-api.service[122361]: INFO dbcounter [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] Registered counter for database nova_cell0 Aug 29 15:24:11.858257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_db.sqlalchemy.engines [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:24:11.863117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writer thread running {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:24:11.938334 n-d-839401-11 devstack@n-api.service[122360]: INFO dbcounter [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] Registered counter for database nova_cell0 Aug 29 15:24:11.945425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_db.sqlalchemy.engines [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:24:11.950455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writer thread running {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:24:12.191777 n-d-839401-11 devstack@n-api.service[122361]: WARNING keystonemiddleware.auth_token [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:24:12.199329 n-d-839401-11 devstack@n-api.service[122361]: WARNING keystonemiddleware.auth_token [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:24:12.271216 n-d-839401-11 devstack@n-api.service[122360]: WARNING keystonemiddleware.auth_token [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:24:12.279132 n-d-839401-11 devstack@n-api.service[122360]: WARNING keystonemiddleware.auth_token [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:24:12.541415 n-d-839401-11 devstack@n-api.service[122361]: WARNING keystonemiddleware.auth_token [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:24:12.547547 n-d-839401-11 devstack@n-api.service[122361]: WARNING keystonemiddleware.auth_token [None req-2d2162c7-157c-4aad-9a0f-22cb4ba3c112 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:24:12.552838 n-d-839401-11 devstack@n-api.service[122361]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555c120fd9c0 pid: 122361 (default app) Aug 29 15:24:12.618737 n-d-839401-11 devstack@n-api.service[122360]: WARNING keystonemiddleware.auth_token [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:24:12.624895 n-d-839401-11 devstack@n-api.service[122360]: WARNING keystonemiddleware.auth_token [None req-5f214ea8-34dd-4988-970d-e13e45eabd8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:24:12.630223 n-d-839401-11 devstack@n-api.service[122360]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555c120fd9c0 pid: 122360 (default app) Aug 29 15:24:52.159437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:52.161042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:52.162038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:52.163024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:53.522903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d0815812-9eb6-4966-b951-74c24aa715b1 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1799119367", "id": 1445564498, "os-flavor-access:is_public": "True"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:53.582071 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d0815812-9eb6-4966-b951-74c24aa715b1 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 1.429136 Aug 29 15:24:53.582667 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:24:52 2022] POST /compute/v2.1/flavors => generated 430 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:24:53.598252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:53.599107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:53.599874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:53.600772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:53.810999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-529944c8-ab71-498d-8de2-8e236aac23d5 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:53.855932 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-529944c8-ab71-498d-8de2-8e236aac23d5 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/1445564498" status: 202 len: 0 microversion: 2.1 time: 0.262887 Aug 29 15:24:53.859801 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1/2] 10.222.0.62 () {58 vars in 1161 bytes} [Mon Aug 29 15:24:53 2022] DELETE /compute/v2.1/flavors/1445564498 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:24:53.865161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-23e33a30-4703-4551-85bc-068cff80d692 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:53.907968 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-23e33a30-4703-4551-85bc-068cff80d692 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046709 Aug 29 15:24:53.908556 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:24:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:53.928206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-508f8751-26d3-45b1-83a0-8c40912186e6 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1886366926", "id": 1776755594, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:53.978148 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-508f8751-26d3-45b1-83a0-8c40912186e6 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.054506 Aug 29 15:24:53.978744 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3/4] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:24:53 2022] POST /compute/v2.1/flavors => generated 417 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:53.990674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dccfaa8f-b93b-4b3f-b772-a0168fbd57dc tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:54.014475 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dccfaa8f-b93b-4b3f-b772-a0168fbd57dc tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.027445 Aug 29 15:24:54.015060 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4/5] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:24:53 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:54.210841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-102afee3-dd67-4bbd-b79e-1efef0898246 tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-116307275", "ram": 512, "vcpus": 1, "disk": 10, "id": 1133057524, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:54.231407 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-102afee3-dd67-4bbd-b79e-1efef0898246 tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.489040 Aug 29 15:24:54.231992 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2/6] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:24:53 2022] POST /compute/v2.1/flavors => generated 415 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:24:54.237222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d32987eb-733e-4bd1-9363-1cc89aaa6748 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:54.274501 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d32987eb-733e-4bd1-9363-1cc89aaa6748 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/1776755594" status: 202 len: 0 microversion: 2.1 time: 0.041263 Aug 29 15:24:54.275350 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3/7] 10.222.0.62 () {58 vars in 1161 bytes} [Mon Aug 29 15:24:54 2022] DELETE /compute/v2.1/flavors/1776755594 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:24:54.488100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d17e5b1b-2b1a-43e7-be65-d6052fc9fce8 tempest-AZAdminNegativeTestJSON-953392301 tempest-AZAdminNegativeTestJSON-953392301-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:54.489810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d17e5b1b-2b1a-43e7-be65-d6052fc9fce8 tempest-AZAdminNegativeTestJSON-953392301 tempest-AZAdminNegativeTestJSON-953392301-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '56d27843ef14473ba25e7f2d1be18546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd713f4efff6d4db6acf1b26e6ab7759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d17e5b1b-2b1a-43e7-be65-d6052fc9fce8 tempest-AZAdminNegativeTestJSON-953392301 tempest-AZAdminNegativeTestJSON-953392301-project] Request method failure captured: Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpD3cIJQcUvoqgrmSeE72TfKlSWhaZ8_W_pmuwLIcgMm8AmfZdLdmbYc4NbRmc0kx02fuHt_L1g1mSQRtiTFU6D8aoasYf5golGkp1s8uPw5IJrNXMr9jku_FzZyF0D9Blfb8BLKkcMTpPY4Z7mzUEkfFo37cLkanJ-3M9BaMv6Ecs Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d713f4efff6d4db6acf1b26e6ab7759a Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AZAdminNegativeTestJSON-953392301 Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:24:54.493259 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:24:54.494632 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d713f4efff6d4db6acf1b26e6ab7759a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d713f4efff6d4db6acf1b26e6ab7759a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d713f4efff6d4db6acf1b26e6ab7759a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d713f4efff6d4db6acf1b26e6ab7759a"}]}] Aug 29 15:24:54.494632 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AZAdminNegativeTestJSON-953392301 Aug 29 15:24:54.494632 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d713f4efff6d4db6acf1b26e6ab7759a Aug 29 15:24:54.494632 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-953392301 Aug 29 15:24:54.494632 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AZAdminNegativeTestJSON-953392301-project Aug 29 15:24:54.494632 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:24:54.494632 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:24:54.494632 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 56d27843ef14473ba25e7f2d1be18546 Aug 29 15:24:54.494632 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AZAdminNegativeTestJSON-953392301-project Aug 29 15:24:54.494632 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:24:54.494632 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 29 15:24:54.494632 n-d-839401-11 devstack@n-api.service[122361]: action_args: {} Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:24:54.495472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:24:54.496524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d17e5b1b-2b1a-43e7-be65-d6052fc9fce8 tempest-AZAdminNegativeTestJSON-953392301 tempest-AZAdminNegativeTestJSON-953392301-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:24:54.499562 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d17e5b1b-2b1a-43e7-be65-d6052fc9fce8 tempest-AZAdminNegativeTestJSON-953392301 tempest-AZAdminNegativeTestJSON-953392301-project] 10.222.0.62 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.218224 Aug 29 15:24:54.500401 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1185 bytes} [Mon Aug 29 15:24:54 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 224 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:24:54.516789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-801eeb4e-c563-4e51-91bc-318662e99543 tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:54.557826 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-801eeb4e-c563-4e51-91bc-318662e99543 tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors/1133057524/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056242 Aug 29 15:24:54.558547 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 5/9] 10.222.0.62 () {60 vars in 1224 bytes} [Mon Aug 29 15:24:54 2022] POST /compute/v2.1/flavors/1133057524/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:24:54.567026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-459a9eb8-d87b-481e-a56d-0c0e7646ae82 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:54.597416 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-459a9eb8-d87b-481e-a56d-0c0e7646ae82 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.037298 Aug 29 15:24:54.598385 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 6/10] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:24:54 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:54.711870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bb552fa0-86bb-4807-bc3a-0389c3a9c7c3 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Calling method '.version_select at 0x7fc4311a9a60>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:54.721835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bb552fa0-86bb-4807-bc3a-0389c3a9c7c3 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dcf211bc-da73-4d63-b885-2b9e7c1e329b(cell1) {{(pid=122360) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 29 15:24:54.722853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb552fa0-86bb-4807-bc3a-0389c3a9c7c3 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:54.723464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb552fa0-86bb-4807-bc3a-0389c3a9c7c3 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:54.724178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb552fa0-86bb-4807-bc3a-0389c3a9c7c3 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:54.751894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb552fa0-86bb-4807-bc3a-0389c3a9c7c3 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:54.752503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb552fa0-86bb-4807-bc3a-0389c3a9c7c3 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:54.752999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb552fa0-86bb-4807-bc3a-0389c3a9c7c3 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:54.767358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb552fa0-86bb-4807-bc3a-0389c3a9c7c3 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:54.768048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb552fa0-86bb-4807-bc3a-0389c3a9c7c3 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:54.768608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb552fa0-86bb-4807-bc3a-0389c3a9c7c3 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:54.774984 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bb552fa0-86bb-4807-bc3a-0389c3a9c7c3 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.758971 Aug 29 15:24:54.775841 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 5/11] 10.222.0.62 () {60 vars in 1208 bytes} [Mon Aug 29 15:24:54 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:24:55.000474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-937227444", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:55.031888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-debe836d-638e-4fbf-900f-4df51c74d91c tempest-FlavorsExtraSpecsTestJSON-512891676 tempest-FlavorsExtraSpecsTestJSON-512891676-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:55.059469 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-debe836d-638e-4fbf-900f-4df51c74d91c tempest-FlavorsExtraSpecsTestJSON-512891676 tempest-FlavorsExtraSpecsTestJSON-512891676-project] 10.222.0.62 "GET /compute/v2.1/flavors/1133057524/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.282391 Aug 29 15:24:55.060166 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 6/12] 10.222.0.62 () {58 vars in 1203 bytes} [Mon Aug 29 15:24:54 2022] GET /compute/v2.1/flavors/1133057524/os-extra_specs => generated 66 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:24:55.204435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-32d2435d-5f4e-44b3-abdc-a76cecf00cf3 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:55.208442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32d2435d-5f4e-44b3-abdc-a76cecf00cf3 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:55.209073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32d2435d-5f4e-44b3-abdc-a76cecf00cf3 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:55.209611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32d2435d-5f4e-44b3-abdc-a76cecf00cf3 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:55.210594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32d2435d-5f4e-44b3-abdc-a76cecf00cf3 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:55.211156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32d2435d-5f4e-44b3-abdc-a76cecf00cf3 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:55.211569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32d2435d-5f4e-44b3-abdc-a76cecf00cf3 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:55.255894 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-32d2435d-5f4e-44b3-abdc-a76cecf00cf3 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.187768 Aug 29 15:24:55.256692 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 7/13] 10.222.0.62 () {58 vars in 1176 bytes} [Mon Aug 29 15:24:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:55.260973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d88368d6-36e4-4fc3-8107-b04a5538aeed tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1836466194", "id": 592415533, "os-flavor-access:is_public": "True"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:55.295800 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d88368d6-36e4-4fc3-8107-b04a5538aeed tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.038105 Aug 29 15:24:55.296599 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 8/14] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:24:55 2022] POST /compute/v2.1/flavors => generated 426 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:55.525049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:24:55.576526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0c7dd7a1-1896-4cad-b4c0-8c655d7a5f87 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '.version_select at 0x7fc431154dc0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:55.578418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c7dd7a1-1896-4cad-b4c0-8c655d7a5f87 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:55.579004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c7dd7a1-1896-4cad-b4c0-8c655d7a5f87 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:55.579549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c7dd7a1-1896-4cad-b4c0-8c655d7a5f87 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:55.604980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c7dd7a1-1896-4cad-b4c0-8c655d7a5f87 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:55.605674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c7dd7a1-1896-4cad-b4c0-8c655d7a5f87 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:55.606249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c7dd7a1-1896-4cad-b4c0-8c655d7a5f87 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:55.619245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c7dd7a1-1896-4cad-b4c0-8c655d7a5f87 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:55.620225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c7dd7a1-1896-4cad-b4c0-8c655d7a5f87 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:55.620803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c7dd7a1-1896-4cad-b4c0-8c655d7a5f87 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:55.628155 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0c7dd7a1-1896-4cad-b4c0-8c655d7a5f87 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.330373 Aug 29 15:24:55.628968 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 9/15] 10.222.0.62 () {58 vars in 1167 bytes} [Mon Aug 29 15:24:55 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:55.634229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c527ac7a-11e0-4e46-919f-fef3c61859ec tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-143367782"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:55.639058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.aggregate [None req-c527ac7a-11e0-4e46-919f-fef3c61859ec tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Generated uuid a296b702-48c3-45fb-a261-1be62fbc1b9b for aggregate {{(pid=122360) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:24:55.706978 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c527ac7a-11e0-4e46-919f-fef3c61859ec tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.076789 Aug 29 15:24:55.714647 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 10/16] 10.222.0.62 () {62 vars in 1205 bytes} [Mon Aug 29 15:24:55 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:24:55.722545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c5fb5ae0-dd9c-4fea-b0c7-7d093ea06add tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:55.762027 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c5fb5ae0-dd9c-4fea-b0c7-7d093ea06add tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors/1133057524/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044767 Aug 29 15:24:55.762774 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 11/17] 10.222.0.62 () {60 vars in 1224 bytes} [Mon Aug 29 15:24:55 2022] POST /compute/v2.1/flavors/1133057524/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:24:55.773794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-05f55e88-e1aa-4771-8b6a-f9be83771b41 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:55.796085 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-05f55e88-e1aa-4771-8b6a-f9be83771b41 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/592415533" status: 202 len: 0 microversion: 2.1 time: 0.026495 Aug 29 15:24:55.796671 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 12/18] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 15:24:55 2022] DELETE /compute/v2.1/flavors/592415533 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:24:55.806847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3ada8866-1524-4cce-b99c-1771ba12f404 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-112391867"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:55.892843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:24:55.893817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:24:55.894517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:24:55.895076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:24:55.895495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:24:55.910747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:55.911488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:55.911931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:55.912653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:55.913116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:55.913691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:55.941693 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3ada8866-1524-4cce-b99c-1771ba12f404 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.142947 Aug 29 15:24:55.942805 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 13/19] 10.222.0.62 () {62 vars in 1210 bytes} [Mon Aug 29 15:24:55 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:24:55.948413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-88834431-93c4-49a2-a5f3-1b84f4ca5d46 tempest-FlavorsExtraSpecsTestJSON-512891676 tempest-FlavorsExtraSpecsTestJSON-512891676-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:55.961857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Getting quotas for project c9b78af2e97440639d6e8f3110342110. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:24:55.964096 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-88834431-93c4-49a2-a5f3-1b84f4ca5d46 tempest-FlavorsExtraSpecsTestJSON-512891676 tempest-FlavorsExtraSpecsTestJSON-512891676-project] 10.222.0.62 "GET /compute/v2.1/flavors/1133057524/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.019086 Aug 29 15:24:55.965651 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 14/20] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:24:55 2022] GET /compute/v2.1/flavors/1133057524/os-extra_specs/hw:numa_nodes => generated 22 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:24:55.970403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fb94ad14-2e4d-444e-8cc7-c1b85a5ea186 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:55.975373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Getting quotas for user 84f612b7294244dba43a0fdc0ed8b632 and project c9b78af2e97440639d6e8f3110342110. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:24:55.989541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:24:55.993800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:24:55.997778 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fb94ad14-2e4d-444e-8cc7-c1b85a5ea186 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.031022 Aug 29 15:24:56.010306 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 15/21] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:24:55 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:56.010306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-855e87d9-f113-40ed-bc15-a238126d6103 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:56.010306 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-855e87d9-f113-40ed-bc15-a238126d6103 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] 10.222.0.62 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.010871 Aug 29 15:24:56.010924 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 16/22] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Aug 29 15:24:55 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:24:56.017162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0e8bca66-a4d3-4914-8d10-7856ee3bfea5 tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:56.039799 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0e8bca66-a4d3-4914-8d10-7856ee3bfea5 tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors/1133057524/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027989 Aug 29 15:24:56.040683 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 17/23] 10.222.0.62 () {60 vars in 1224 bytes} [Mon Aug 29 15:24:56 2022] POST /compute/v2.1/flavors/1133057524/os-extra_specs => generated 66 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:24:56.045299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7c598ec1-4c51-4b57-bc71-67de5457090e tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-839401-11"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:56.057188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7c598ec1-4c51-4b57-bc71-67de5457090e tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:56.057683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7c598ec1-4c51-4b57-bc71-67de5457090e tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:56.058122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7c598ec1-4c51-4b57-bc71-67de5457090e tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:56.130768 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7b32daae-ad6d-431d-a277-5225896e1186 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.529684 Aug 29 15:24:56.134324 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 7/24] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:24:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:24:56.148004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-663f2993-f126-493b-82e7-45db9aa90660 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-461521279", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:56.183603 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-663f2993-f126-493b-82e7-45db9aa90660 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.046692 Aug 29 15:24:56.186744 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 8/25] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:24:56 2022] POST /compute/v2.1/flavors => generated 506 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:56.196356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4978fcc3-5fdb-45fc-96de-c8eb77484a67 tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:56.211803 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4978fcc3-5fdb-45fc-96de-c8eb77484a67 tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/1133057524/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.020732 Aug 29 15:24:56.212841 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 9/26] 10.222.0.62 () {58 vars in 1203 bytes} [Mon Aug 29 15:24:56 2022] GET /compute/v2.1/flavors/1133057524/os-extra_specs => generated 66 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:24:56.218160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8dd69572-6c63-4648-8f9b-b7ece5d8ea95 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:56.218831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8dd69572-6c63-4648-8f9b-b7ece5d8ea95 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:24:56.511834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8dd69572-6c63-4648-8f9b-b7ece5d8ea95 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:24:56.540797 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8dd69572-6c63-4648-8f9b-b7ece5d8ea95 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1219 microversion: 2.1 time: 0.326792 Aug 29 15:24:56.541504 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 10/27] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:24:56 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1219 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:56.547107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b9c01199-010f-4377-93b1-672f9b26bb1a tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:56.567921 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b9c01199-010f-4377-93b1-672f9b26bb1a tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/8fab4c20-ed8e-4aee-a3a0-b61344718489" status: 202 len: 0 microversion: 2.1 time: 0.024449 Aug 29 15:24:56.572628 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 11/28] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:24:56 2022] DELETE /compute/v2.1/flavors/8fab4c20-ed8e-4aee-a3a0-b61344718489 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:24:56.578675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-55d6b1a6-f2fb-4690-bcaf-b7301afc495e tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:56.591481 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7c598ec1-4c51-4b57-bc71-67de5457090e tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 0.549839 Aug 29 15:24:56.599034 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 18/29] 10.222.0.62 () {62 vars in 1232 bytes} [Mon Aug 29 15:24:56 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:24:56.628881 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-55d6b1a6-f2fb-4690-bcaf-b7301afc495e tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] 10.222.0.62 "PUT /compute/v2.1/flavors/1133057524/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.054448 Aug 29 15:24:56.637260 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 12/30] 10.222.0.62 () {60 vars in 1265 bytes} [Mon Aug 29 15:24:56 2022] PUT /compute/v2.1/flavors/1133057524/os-extra_specs/hw:numa_nodes => generated 22 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:24:56.641770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e12d1c80-03c4-45d8-93e2-14f7f4bd0464 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:56.679351 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e12d1c80-03c4-45d8-93e2-14f7f4bd0464 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.044863 Aug 29 15:24:56.680628 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 13/31] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:24:56 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:56.686537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-57c86de4-8b91-450c-a8f2-d6151c9f36ae tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-839401-11"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:56.733822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57c86de4-8b91-450c-a8f2-d6151c9f36ae tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:56.734322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57c86de4-8b91-450c-a8f2-d6151c9f36ae tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:56.734759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57c86de4-8b91-450c-a8f2-d6151c9f36ae tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:56.967980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-624c2daf-ef50-4ddc-afaa-3b8925885a93 tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-705016203", "id": 380145731, "os-flavor-access:is_public": "False"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:57.012510 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-624c2daf-ef50-4ddc-afaa-3b8925885a93 tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.412166 Aug 29 15:24:57.021887 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 19/32] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:24:56 2022] POST /compute/v2.1/flavors => generated 427 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:57.026593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-147592af-f4f3-40ef-bd44-f38c7bdbe0ea tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:57.035495 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-147592af-f4f3-40ef-bd44-f38c7bdbe0ea tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/1133057524/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012488 Aug 29 15:24:57.036564 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 20/33] 10.222.0.62 () {58 vars in 1203 bytes} [Mon Aug 29 15:24:57 2022] GET /compute/v2.1/flavors/1133057524/os-extra_specs => generated 66 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:24:57.041638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c61c3946-2021-40da-b922-72e12ee9756b tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1629231468", "id": "6118cdfd-5468-442d-a3b1-60b28569b53e", "os-flavor-access:is_public": "True"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:57.065979 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c61c3946-2021-40da-b922-72e12ee9756b tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.028180 Aug 29 15:24:57.067726 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 21/34] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:24:57 2022] POST /compute/v2.1/flavors => generated 507 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:57.078656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-074458c7-7282-469b-a21c-bf6ea5e2e38b tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7bd29df174ab4d7ea36788cfed80ba8c"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:57.219224 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-57c86de4-8b91-450c-a8f2-d6151c9f36ae tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.537039 Aug 29 15:24:57.220625 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 14/35] 10.222.0.62 () {62 vars in 1232 bytes} [Mon Aug 29 15:24:56 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:24:57.232340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-39603432-9644-4e14-a7c2-6c06401e125c tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:57.265543 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-39603432-9644-4e14-a7c2-6c06401e125c tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/1133057524/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.041834 Aug 29 15:24:57.266606 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 15/36] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:24:57 2022] DELETE /compute/v2.1/flavors/1133057524/os-extra_specs/hw:numa_nodes => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:24:57.272634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-03f28da9-b368-4aa2-9b4f-c5400a4d728d tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:57.293743 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-03f28da9-b368-4aa2-9b4f-c5400a4d728d tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/6118cdfd-5468-442d-a3b1-60b28569b53e" status: 202 len: 0 microversion: 2.1 time: 0.025658 Aug 29 15:24:57.298395 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 16/37] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:24:57 2022] DELETE /compute/v2.1/flavors/6118cdfd-5468-442d-a3b1-60b28569b53e => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:24:57.305073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e558de30-d886-4ee8-b110-97050b8fc6a6 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:57.312199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=8,nova_api:DELETE=11,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:57.344442 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e558de30-d886-4ee8-b110-97050b8fc6a6 tempest-AggregatesAdminTestV241-1887331031 tempest-AggregatesAdminTestV241-1887331031-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.044840 Aug 29 15:24:57.350103 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 17/38] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Aug 29 15:24:57 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:57.356060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9a5fbfb0-0645-46e1-9f06-f6f06a76dc3c tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:57.356155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=6,nova_api:INSERT=7,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:24:57.379962 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-074458c7-7282-469b-a21c-bf6ea5e2e38b tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors/380145731/action" status: 200 len: 96 microversion: 2.1 time: 0.310592 Aug 29 15:24:57.380634 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 22/39] 10.222.0.62 () {60 vars in 1197 bytes} [Mon Aug 29 15:24:57 2022] POST /compute/v2.1/flavors/380145731/action => generated 96 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:24:57.391743 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9a5fbfb0-0645-46e1-9f06-f6f06a76dc3c tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/1133057524/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.040026 Aug 29 15:24:57.392605 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 18/40] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:24:57 2022] DELETE /compute/v2.1/flavors/1133057524/os-extra_specs/hw:cpu_policy => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:24:57.401047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-52995e75-9f1b-4440-b581-d2b15150614d tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:57.425899 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-52995e75-9f1b-4440-b581-d2b15150614d tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.040929 Aug 29 15:24:57.426515 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 23/41] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:24:57 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:57.432870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c7a3737-9226-4f02-8792-6eac2b000908 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1026916044", "name": "tempest-test_aggregate-934237908"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:57.454642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.aggregate [None req-5c7a3737-9226-4f02-8792-6eac2b000908 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Generated uuid 0895160c-199a-4f2b-b9b4-3f49f7df3993 for aggregate {{(pid=122360) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:24:57.485506 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5c7a3737-9226-4f02-8792-6eac2b000908 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.057707 Aug 29 15:24:57.489396 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 24/42] 10.222.0.62 () {60 vars in 1165 bytes} [Mon Aug 29 15:24:57 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:57.495670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6cf68ec9-c10c-42ca-b98c-c76c3fa9472a tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:57.505607 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6cf68ec9-c10c-42ca-b98c-c76c3fa9472a tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/1133057524/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014989 Aug 29 15:24:57.506616 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 25/43] 10.222.0.62 () {58 vars in 1203 bytes} [Mon Aug 29 15:24:57 2022] GET /compute/v2.1/flavors/1133057524/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:24:57.513057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6888ae6f-0a50-4096-9496-0fe4e5f4e85f tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1041595462", "id": 1792967573, "os-flavor-access:is_public": "True"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:57.534394 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6888ae6f-0a50-4096-9496-0fe4e5f4e85f tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.026612 Aug 29 15:24:57.535171 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 26/44] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:24:57 2022] POST /compute/v2.1/flavors => generated 414 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:57.539417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5efd8265-eb8e-4189-a8f0-f7a4eb565c86 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:57.551123 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5efd8265-eb8e-4189-a8f0-f7a4eb565c86 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.015025 Aug 29 15:24:57.551909 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 27/45] 10.222.0.62 () {58 vars in 1143 bytes} [Mon Aug 29 15:24:57 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:57.558330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-df88bfa6-4a13-459d-9668-73a99d95fbbf tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:57.578200 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-df88bfa6-4a13-459d-9668-73a99d95fbbf tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/1133057524" status: 202 len: 0 microversion: 2.1 time: 0.023954 Aug 29 15:24:57.578787 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 28/46] 10.222.0.62 () {58 vars in 1161 bytes} [Mon Aug 29 15:24:57 2022] DELETE /compute/v2.1/flavors/1133057524 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:24:57.583455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e084a6dc-065d-44ee-82ba-87fe7c391486 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:57.596190 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e084a6dc-065d-44ee-82ba-87fe7c391486 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/1792967573" status: 200 len: 414 microversion: 2.1 time: 0.016238 Aug 29 15:24:57.604062 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 29/47] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 15:24:57 2022] GET /compute/v2.1/flavors/1792967573 => generated 414 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:57.609507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cceada18-6a8e-4c62-b6cf-13a44faa922c tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-839401-11"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:57.621421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cceada18-6a8e-4c62-b6cf-13a44faa922c tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:57.622090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cceada18-6a8e-4c62-b6cf-13a44faa922c tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:57.622683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cceada18-6a8e-4c62-b6cf-13a44faa922c tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:57.755900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c867ec80-6c0c-42d7-a700-6775cccccf0e tempest-FlavorsAccessTestJSON-2073855681 tempest-FlavorsAccessTestJSON-2073855681-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:57.819578 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c867ec80-6c0c-42d7-a700-6775cccccf0e tempest-FlavorsAccessTestJSON-2073855681 tempest-FlavorsAccessTestJSON-2073855681-project] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.424757 Aug 29 15:24:57.820564 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 19/48] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:24:57 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:57.826192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-11348f78-5437-4304-a365-a6e4f4621ecf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:57.827197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-11348f78-5437-4304-a365-a6e4f4621ecf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:24:57.833955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11348f78-5437-4304-a365-a6e4f4621ecf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:57.834677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11348f78-5437-4304-a365-a6e4f4621ecf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:57.835890 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cceada18-6a8e-4c62-b6cf-13a44faa922c tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 315 microversion: 2.1 time: 0.230404 Aug 29 15:24:57.836302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11348f78-5437-4304-a365-a6e4f4621ecf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:57.836503 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 30/49] 10.222.0.62 () {60 vars in 1191 bytes} [Mon Aug 29 15:24:57 2022] POST /compute/v2.1/os-aggregates/2/action => generated 315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:57.850615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11348f78-5437-4304-a365-a6e4f4621ecf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:57.850752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fc443555-90e1-44fa-ab30-2bd2162b47d5 tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:57.851158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11348f78-5437-4304-a365-a6e4f4621ecf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:57.851719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11348f78-5437-4304-a365-a6e4f4621ecf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:57.881268 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fc443555-90e1-44fa-ab30-2bd2162b47d5 tempest-FlavorsExtraSpecsTestJSON-843056726 tempest-FlavorsExtraSpecsTestJSON-843056726-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.042700 Aug 29 15:24:57.894264 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 31/50] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:24:57 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:58.005520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-11348f78-5437-4304-a365-a6e4f4621ecf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:24:58.019835 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-11348f78-5437-4304-a365-a6e4f4621ecf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1215 microversion: 2.1 time: 0.197937 Aug 29 15:24:58.020436 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 20/51] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:24:57 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1215 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:58.025401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bd2d72ea-f32c-4d99-b1c3-269accc34e23 tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7bd29df174ab4d7ea36788cfed80ba8c"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:58.454393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b196c230-5dea-479a-a6e5-de55cfa6e505 tempest-FlavorsAdminTestJSON-1276382554 tempest-FlavorsAdminTestJSON-1276382554-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:58.487955 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b196c230-5dea-479a-a6e5-de55cfa6e505 tempest-FlavorsAdminTestJSON-1276382554 tempest-FlavorsAdminTestJSON-1276382554-project] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.592437 Aug 29 15:24:58.488639 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 32/52] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:24:57 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:58.533547 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bd2d72ea-f32c-4d99-b1c3-269accc34e23 tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors/380145731/action" status: 200 len: 21 microversion: 2.1 time: 0.511998 Aug 29 15:24:58.539170 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 21/53] 10.222.0.62 () {60 vars in 1197 bytes} [Mon Aug 29 15:24:58 2022] POST /compute/v2.1/flavors/380145731/action => generated 21 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:24:58.539170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-75f575fd-818d-4f9a-a233-87f6e4acb08d tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:58.558863 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-75f575fd-818d-4f9a-a233-87f6e4acb08d tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/1792967573" status: 202 len: 0 microversion: 2.1 time: 0.022609 Aug 29 15:24:58.559692 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 22/54] 10.222.0.62 () {58 vars in 1161 bytes} [Mon Aug 29 15:24:58 2022] DELETE /compute/v2.1/flavors/1792967573 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:24:58.568490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5be5a8d5-ddca-40c8-8523-5a7125caea9c tempest-FlavorsAccessTestJSON-2073855681 tempest-FlavorsAccessTestJSON-2073855681-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:58.593376 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5be5a8d5-ddca-40c8-8523-5a7125caea9c tempest-FlavorsAccessTestJSON-2073855681 tempest-FlavorsAccessTestJSON-2073855681-project] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032242 Aug 29 15:24:58.593976 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 23/55] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:24:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:58.608095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b2b07279-b533-45b5-8ac8-7be8e21ecfdb tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:58.629136 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b2b07279-b533-45b5-8ac8-7be8e21ecfdb tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030588 Aug 29 15:24:58.629903 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 24/56] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:24:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:58.634882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-79258834-a9be-454a-9093-50109b5ba686 tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:58.666607 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-79258834-a9be-454a-9093-50109b5ba686 tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/380145731" status: 202 len: 0 microversion: 2.1 time: 0.035236 Aug 29 15:24:58.667544 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 25/57] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 15:24:58 2022] DELETE /compute/v2.1/flavors/380145731 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:24:58.672826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-107f5c87-600a-4e16-9c6c-0fa1005f88e5 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-647086930", "id": 2010347706, "os-flavor-access:is_public": "False"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:58.695710 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-107f5c87-600a-4e16-9c6c-0fa1005f88e5 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.026538 Aug 29 15:24:58.696633 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 26/58] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:24:58 2022] POST /compute/v2.1/flavors => generated 429 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:58.708523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1daf22e3-2412-4a2b-af02-8a5c9f699699 tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:58.758618 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1daf22e3-2412-4a2b-af02-8a5c9f699699 tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059631 Aug 29 15:24:58.759725 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 27/59] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:24:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:58.767744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e036979f-672d-44da-8913-10af57ddd82b tempest-FlavorsAdminTestJSON-1276382554 tempest-FlavorsAdminTestJSON-1276382554-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "2010347706"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:58.785610 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-e036979f-672d-44da-8913-10af57ddd82b tempest-FlavorsAdminTestJSON-1276382554 tempest-FlavorsAdminTestJSON-1276382554-project] HTTP exception thrown: Flavor 2010347706 could not be found. Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e036979f-672d-44da-8913-10af57ddd82b tempest-FlavorsAdminTestJSON-1276382554 tempest-FlavorsAdminTestJSON-1276382554-project] Request method failure captured: Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 107 Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpBEuRPL7xRG8kAZbWDYFNKpufPjGm3fuUTRq9j8GigsDUP8A6XzRQz4CqtuMkaL9STPsm8Ptg4dOWh5SQ8p2dl8Rub4PtxvcFjZHajpvDOo-Dj7QwKyRUluq-j7LX0BTdBXy1XlVmojvQyx08hFbMsFQFjx04Xy7BDe1cEQo0N3os Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: c138b0f468994cf7bb96edac6432aa17 Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-FlavorsAdminTestJSON-1276382554 Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:24:58.790271 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:24:58.791799 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c138b0f468994cf7bb96edac6432aa17", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c138b0f468994cf7bb96edac6432aa17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c138b0f468994cf7bb96edac6432aa17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c138b0f468994cf7bb96edac6432aa17"}]}] Aug 29 15:24:58.791799 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-FlavorsAdminTestJSON-1276382554 Aug 29 15:24:58.791799 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: c138b0f468994cf7bb96edac6432aa17 Aug 29 15:24:58.791799 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1276382554 Aug 29 15:24:58.791799 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-FlavorsAdminTestJSON-1276382554-project Aug 29 15:24:58.791799 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:24:58.791799 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:24:58.791799 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: eb294b0969fc4022a4b5830d60e21016 Aug 29 15:24:58.791799 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-FlavorsAdminTestJSON-1276382554-project Aug 29 15:24:58.791799 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:24:58.791799 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "test", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "2010347706"}} Aug 29 15:24:58.791799 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:24:58.791799 n-d-839401-11 devstack@n-api.service[122361]: exception: Flavor 2010347706 could not be found. Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '2010347706'}}} Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2010347706 could not be found. Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:24:58.792728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2010347706 could not be found. Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:24:58.793916 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:24:58.795092 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:24:58.795092 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:24:58.795092 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:24:58.795092 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2010347706 could not be found. Aug 29 15:24:58.795092 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:24:58.806716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e036979f-672d-44da-8913-10af57ddd82b tempest-FlavorsAdminTestJSON-1276382554 tempest-FlavorsAdminTestJSON-1276382554-project] Returning 400 to user: Flavor 2010347706 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:24:58.809499 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e036979f-672d-44da-8913-10af57ddd82b tempest-FlavorsAdminTestJSON-1276382554 tempest-FlavorsAdminTestJSON-1276382554-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.048596 Aug 29 15:24:58.810236 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 28/60] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:24:58 2022] POST /compute/v2.1/servers => generated 81 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:24:58.826454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f59f64c-fff7-407d-a8dc-8bf7cce7ed86 tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1678429644", "id": 625482207, "os-flavor-access:is_public": "False"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:58.865442 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9f59f64c-fff7-407d-a8dc-8bf7cce7ed86 tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.046824 Aug 29 15:24:58.868348 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 29/61] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:24:58 2022] POST /compute/v2.1/flavors => generated 428 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:58.881826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f2ee7082-255d-4262-b012-5452ce127560 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:58.931166 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f2ee7082-255d-4262-b012-5452ce127560 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/2010347706" status: 202 len: 0 microversion: 2.1 time: 0.059314 Aug 29 15:24:58.934981 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 30/62] 10.222.0.62 () {58 vars in 1161 bytes} [Mon Aug 29 15:24:58 2022] DELETE /compute/v2.1/flavors/2010347706 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:24:58.942856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-596e0019-e027-40cd-8017-b2c5c087d272 tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:58.969454 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-596e0019-e027-40cd-8017-b2c5c087d272 tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/625482207/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.030561 Aug 29 15:24:58.971753 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 31/63] 10.222.0.62 () {58 vars in 1206 bytes} [Mon Aug 29 15:24:58 2022] GET /compute/v2.1/flavors/625482207/os-flavor-access => generated 21 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:24:58.982481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ce035b85-4d2e-4b2d-b439-951bc8545636 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:59.042647 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ce035b85-4d2e-4b2d-b439-951bc8545636 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068728 Aug 29 15:24:59.044172 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 32/64] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:24:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:59.057311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5d14bc4b-04cd-43de-afbe-eaf4276e4cde tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:59.080206 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5d14bc4b-04cd-43de-afbe-eaf4276e4cde tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/625482207" status: 202 len: 0 microversion: 2.1 time: 0.034886 Aug 29 15:24:59.081277 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 33/65] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 15:24:59 2022] DELETE /compute/v2.1/flavors/625482207 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:24:59.088696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-84272877", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "availability_zone": "tempest-test_az-1026916044"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:59.093283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-646b092e-865c-41fa-9eef-c37eb10ce38f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:59.094560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-646b092e-865c-41fa-9eef-c37eb10ce38f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:24:59.104166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-646b092e-865c-41fa-9eef-c37eb10ce38f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:59.105107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-646b092e-865c-41fa-9eef-c37eb10ce38f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:59.105873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-646b092e-865c-41fa-9eef-c37eb10ce38f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:59.106103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:59.106603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:59.107038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:59.107712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-646b092e-865c-41fa-9eef-c37eb10ce38f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:59.107813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:59.108341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:59.108686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-646b092e-865c-41fa-9eef-c37eb10ce38f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:59.108892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:59.109447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-646b092e-865c-41fa-9eef-c37eb10ce38f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:24:59.213183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-646b092e-865c-41fa-9eef-c37eb10ce38f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:24:59.222824 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-646b092e-865c-41fa-9eef-c37eb10ce38f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1277 microversion: 2.1 time: 0.136241 Aug 29 15:24:59.236428 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 34/66] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:24:59 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:59.236428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-24a6234d-5b3c-4c54-9e70-0923cd92dd42 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1218764555", "id": 1786652760, "os-flavor-access:is_public": "False"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:59.266928 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-24a6234d-5b3c-4c54-9e70-0923cd92dd42 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.042134 Aug 29 15:24:59.269401 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 35/67] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:24:59 2022] POST /compute/v2.1/flavors => generated 415 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:59.278005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cdd10f07-23c8-4741-ab14-37a7a4c6d1e6 tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:59.329317 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cdd10f07-23c8-4741-ab14-37a7a4c6d1e6 tempest-FlavorsAccessTestJSON-1464015695 tempest-FlavorsAccessTestJSON-1464015695-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058660 Aug 29 15:24:59.329917 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 36/68] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:24:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:24:59.329917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c068937c-de6b-4584-a8cc-a8044863e1a3 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2125668080", "id": 246684184, "os-flavor-access:is_public": "True"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:24:59.382073 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c068937c-de6b-4584-a8cc-a8044863e1a3 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.047130 Aug 29 15:24:59.384953 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 37/69] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:24:59 2022] POST /compute/v2.1/flavors => generated 411 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:59.400038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1d35c398-9832-49de-bff8-a1a8980bea7e tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:59.446700 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1d35c398-9832-49de-bff8-a1a8980bea7e tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.052128 Aug 29 15:24:59.450464 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 38/70] 10.222.0.62 () {58 vars in 1169 bytes} [Mon Aug 29 15:24:59 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:59.463582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-59f2c208-b763-49fc-ae3f-dd2f654d67e3 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:59.475325 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-59f2c208-b763-49fc-ae3f-dd2f654d67e3 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.015522 Aug 29 15:24:59.476103 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 39/71] 10.222.0.62 () {58 vars in 1177 bytes} [Mon Aug 29 15:24:59 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:24:59.488303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b904d9b-f2a6-4c10-8a4b-0fce7ca9cf57 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:59.499064 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4b904d9b-f2a6-4c10-8a4b-0fce7ca9cf57 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.014477 Aug 29 15:24:59.507277 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 40/72] 10.222.0.62 () {58 vars in 1171 bytes} [Mon Aug 29 15:24:59 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:59.513615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f036af78-0695-4fbd-a14f-138228697f96 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:59.524555 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f036af78-0695-4fbd-a14f-138228697f96 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.016096 Aug 29 15:24:59.525201 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 41/73] 10.222.0.62 () {58 vars in 1169 bytes} [Mon Aug 29 15:24:59 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:24:59.971528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Calling method '.version_select at 0x7fc4306471f0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:24:59.990838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dcf211bc-da73-4d63-b885-2b9e7c1e329b(cell1) {{(pid=122361) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 29 15:24:59.992039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:24:59.993784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:24:59.995640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:00.035351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:00.037073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:00.038816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:00.102706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:00.105202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:00.105784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:00.131667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:00.135529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:00.136368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:00.178267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=16,nova_api:INSERT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:00.183328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:00.183840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:00.184288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:00.197528 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d70a1668-9710-4b00-a0ef-76f44112885f tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1668 microversion: 2.53 time: 0.661926 Aug 29 15:25:00.201136 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 42/74] 10.222.0.62 () {60 vars in 1243 bytes} [Mon Aug 29 15:24:59 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1668 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:25:00.221988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-921ee082-ba81-4c11-a083-a7e3d1a79e3a tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:00.275347 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-921ee082-ba81-4c11-a083-a7e3d1a79e3a tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.076051 Aug 29 15:25:00.276437 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 43/75] 10.222.0.62 () {58 vars in 1169 bytes} [Mon Aug 29 15:25:00 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:00.283606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Calling method '.version_select at 0x7fc43075bca0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:00.287827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:00.288489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:00.289033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:00.296229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] validate_networks() for None {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:25:00.317161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:00.317161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:00.322429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:00.349357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:00.349929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:00.350654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:00.371212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:00.372671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:00.373299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:00.413777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:00.416539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:00.417066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:00.433868 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a9cca0ff-bf68-403f-8b48-e5b5b17005da tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 359 microversion: 2.53 time: 0.155929 Aug 29 15:25:00.441280 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 44/76] 10.222.0.62 () {60 vars in 1222 bytes} [Mon Aug 29 15:25:00 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:00.451826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d942b87b-ff23-4e94-9688-91f905b6f0d7 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:00.455001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d942b87b-ff23-4e94-9688-91f905b6f0d7 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:00.469501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d942b87b-ff23-4e94-9688-91f905b6f0d7 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:00.475218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d942b87b-ff23-4e94-9688-91f905b6f0d7 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:00.475218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d942b87b-ff23-4e94-9688-91f905b6f0d7 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:00.476182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d942b87b-ff23-4e94-9688-91f905b6f0d7 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:00.476820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d942b87b-ff23-4e94-9688-91f905b6f0d7 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:00.478512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d942b87b-ff23-4e94-9688-91f905b6f0d7 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:00.670472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:25:00.671004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:25:00.671685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:25:00.672290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:25:00.672959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:25:00.719612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:00.721778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:00.723307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:00.724344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:00.727024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:00.727680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:00.816151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Getting quotas for project 78479eb062e543aeb3fd37659d88ac15. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:25:00.819663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d942b87b-ff23-4e94-9688-91f905b6f0d7 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:00.834098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Getting quotas for user 792d186543044e919ffd914f0a8794e4 and project 78479eb062e543aeb3fd37659d88ac15. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:25:00.836393 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d942b87b-ff23-4e94-9688-91f905b6f0d7 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.398876 Aug 29 15:25:00.837192 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 45/77] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:00 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:00.849891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:25:00.865293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:25:00.872334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-47659ea4-8d5e-4700-8a25-1cd6c09bc4a5 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:00.943910 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-47659ea4-8d5e-4700-8a25-1cd6c09bc4a5 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.104992 Aug 29 15:25:00.958195 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 46/78] 10.222.0.62 () {58 vars in 1175 bytes} [Mon Aug 29 15:25:00 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:00.973237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a10ff5f6-8438-49cf-a17a-d47672459836 tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Calling method '.version_select at 0x7fc43075bee0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:00.980434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a10ff5f6-8438-49cf-a17a-d47672459836 tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:00.981769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a10ff5f6-8438-49cf-a17a-d47672459836 tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:00.983948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a10ff5f6-8438-49cf-a17a-d47672459836 tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:01.042858 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e371c307-3e40-423a-b282-00566dea8da6 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.549361 Aug 29 15:25:01.045366 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 33/79] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:24:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:25:01.053568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a10ff5f6-8438-49cf-a17a-d47672459836 tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:01.054077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a10ff5f6-8438-49cf-a17a-d47672459836 tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:01.054517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a10ff5f6-8438-49cf-a17a-d47672459836 tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:01.059553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5040157c-d015-43cd-9c37-da95dc84c87a tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:01.094371 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a10ff5f6-8438-49cf-a17a-d47672459836 tempest-HypervisorAdminV253TestBase-51851403 tempest-HypervisorAdminV253TestBase-51851403-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/cd959b1d-2708-4a46-9577-e4f5edc783b1" status: 200 len: 793 microversion: 2.53 time: 0.133337 Aug 29 15:25:01.118860 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5040157c-d015-43cd-9c37-da95dc84c87a tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.071452 Aug 29 15:25:01.124141 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 34/80] 10.222.0.62 () {58 vars in 1173 bytes} [Mon Aug 29 15:25:01 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:01.131512 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 47/81] 10.222.0.62 () {60 vars in 1298 bytes} [Mon Aug 29 15:25:00 2022] GET /compute/v2.1/os-hypervisors/cd959b1d-2708-4a46-9577-e4f5edc783b1 => generated 793 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:01.150091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c6fb90b2-1e34-4e9a-b910-d026358a68fc tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:01.151757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c6fb90b2-1e34-4e9a-b910-d026358a68fc tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:01.154095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9acd8a10-b6d2-4326-96e2-ca6ec94dd5cb tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:01.198864 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9acd8a10-b6d2-4326-96e2-ca6ec94dd5cb tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.057533 Aug 29 15:25:01.201137 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 48/82] 10.222.0.62 () {58 vars in 1169 bytes} [Mon Aug 29 15:25:01 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:01.221710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-845d2989-f148-4893-a059-0237a35aed1b tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:01.280325 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-845d2989-f148-4893-a059-0237a35aed1b tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/246684184" status: 202 len: 0 microversion: 2.1 time: 0.063298 Aug 29 15:25:01.286843 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 49/83] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 15:25:01 2022] DELETE /compute/v2.1/flavors/246684184 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:25:01.299101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d9f99c49-2e51-4db7-99fc-6e42a9cc00d1 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:01.392727 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d9f99c49-2e51-4db7-99fc-6e42a9cc00d1 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.074944 Aug 29 15:25:01.395016 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 50/84] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:25:01.422759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a628b24a-3727-46ac-acef-199f95359f58 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:01.477472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c6fb90b2-1e34-4e9a-b910-d026358a68fc tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:01.493905 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a628b24a-3727-46ac-acef-199f95359f58 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/1786652760" status: 202 len: 0 microversion: 2.1 time: 0.081723 Aug 29 15:25:01.499540 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c6fb90b2-1e34-4e9a-b910-d026358a68fc tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1241 microversion: 2.1 time: 0.372477 Aug 29 15:25:01.500601 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 35/86] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:01 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1241 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:01.509351 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 51/86] 10.222.0.62 () {58 vars in 1161 bytes} [Mon Aug 29 15:25:01 2022] DELETE /compute/v2.1/flavors/1786652760 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:25:01.515630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7595d31b-afe8-4a73-ae3d-5552bd8df213 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:01.615280 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7595d31b-afe8-4a73-ae3d-5552bd8df213 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.111868 Aug 29 15:25:01.616332 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 52/87] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:01.635733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1eb8c6e5-d51d-45f6-8b67-a554401fb6bb tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-545040240", "id": 245245430, "os-flavor-access:is_public": "False"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:01.679558 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1eb8c6e5-d51d-45f6-8b67-a554401fb6bb tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.047600 Aug 29 15:25:01.692204 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 36/88] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:25:01 2022] POST /compute/v2.1/flavors => generated 411 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:01.692589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-abac6094-d1f5-472b-a72f-2de3cb2c652f tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:01.731561 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-abac6094-d1f5-472b-a72f-2de3cb2c652f tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038372 Aug 29 15:25:01.732693 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 53/89] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:01.750251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c5061c32-2442-437f-bd84-1e21ae51d20e tempest-FlavorsAdminTestJSON-1276382554 tempest-FlavorsAdminTestJSON-1276382554-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:01.791356 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c5061c32-2442-437f-bd84-1e21ae51d20e tempest-FlavorsAdminTestJSON-1276382554 tempest-FlavorsAdminTestJSON-1276382554-project] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044786 Aug 29 15:25:01.793157 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 37/90] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:01.814282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c3c3488-a59b-4eb6-9c6c-429422b4288b tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:01.855837 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6c3c3488-a59b-4eb6-9c6c-429422b4288b tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/245245430" status: 202 len: 0 microversion: 2.1 time: 0.046664 Aug 29 15:25:01.857453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c2b13899-1d2a-40a3-92dd-ec28cef9532c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:01.858167 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 54/91] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 15:25:01 2022] DELETE /compute/v2.1/flavors/245245430 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:25:01.858283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c2b13899-1d2a-40a3-92dd-ec28cef9532c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:01.869531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b13899-1d2a-40a3-92dd-ec28cef9532c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:01.870061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b13899-1d2a-40a3-92dd-ec28cef9532c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:01.870524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b13899-1d2a-40a3-92dd-ec28cef9532c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:01.871248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b13899-1d2a-40a3-92dd-ec28cef9532c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:01.872438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b13899-1d2a-40a3-92dd-ec28cef9532c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:01.873625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1b9a70af-529b-4eb7-ae56-0645707876d0 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:01.874085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b13899-1d2a-40a3-92dd-ec28cef9532c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:01.925068 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1b9a70af-529b-4eb7-ae56-0645707876d0 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063623 Aug 29 15:25:01.928458 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 55/92] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:01.952070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3d9d8a46-3119-413c-acbd-08c64327f96d tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1623490362", "id": 194584843, "os-flavor-access:is_public": "True"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:01.987251 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3d9d8a46-3119-413c-acbd-08c64327f96d tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.039093 Aug 29 15:25:01.989740 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 56/93] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:25:01 2022] POST /compute/v2.1/flavors => generated 411 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:02.013506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f9c9c619-2bd9-4645-8517-e68d7b87d106 tempest-FlavorsAdminTestJSON-1276382554 tempest-FlavorsAdminTestJSON-1276382554-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:02.070001 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f9c9c619-2bd9-4645-8517-e68d7b87d106 tempest-FlavorsAdminTestJSON-1276382554 tempest-FlavorsAdminTestJSON-1276382554-project] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.071313 Aug 29 15:25:02.070610 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 57/94] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:01 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:02.093826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-84135542-08c4-4f62-9aaf-526ce3b6e395 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:02.140957 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-84135542-08c4-4f62-9aaf-526ce3b6e395 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/194584843" status: 202 len: 0 microversion: 2.1 time: 0.053592 Aug 29 15:25:02.147630 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 58/95] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 15:25:02 2022] DELETE /compute/v2.1/flavors/194584843 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:25:02.158555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b19686f2-4238-48bf-afbd-77fb7ae39f56 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:02.202663 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b19686f2-4238-48bf-afbd-77fb7ae39f56 tempest-FlavorsAdminTestJSON-1388153201 tempest-FlavorsAdminTestJSON-1388153201-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053417 Aug 29 15:25:02.217942 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 59/96] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:02.420337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c2b13899-1d2a-40a3-92dd-ec28cef9532c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:02.440530 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c2b13899-1d2a-40a3-92dd-ec28cef9532c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.586769 Aug 29 15:25:02.442361 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 38/97] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:01 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:25:02.524009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f75fdd52-27db-4379-b705-3f4b16922926 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:02.524730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f75fdd52-27db-4379-b705-3f4b16922926 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:02.661326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f75fdd52-27db-4379-b705-3f4b16922926 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:02.668717 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f75fdd52-27db-4379-b705-3f4b16922926 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1241 microversion: 2.1 time: 0.148819 Aug 29 15:25:02.671234 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 60/98] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:02 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1241 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:03.469419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ebc2efd5-e077-4d8d-9947-a11cf0bf7d13 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:03.470524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ebc2efd5-e077-4d8d-9947-a11cf0bf7d13 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:03.484531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebc2efd5-e077-4d8d-9947-a11cf0bf7d13 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:03.487063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebc2efd5-e077-4d8d-9947-a11cf0bf7d13 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:03.487574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebc2efd5-e077-4d8d-9947-a11cf0bf7d13 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:03.488599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebc2efd5-e077-4d8d-9947-a11cf0bf7d13 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:03.489103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebc2efd5-e077-4d8d-9947-a11cf0bf7d13 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:03.489913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebc2efd5-e077-4d8d-9947-a11cf0bf7d13 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:03.693144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a64d465c-25c3-469d-9b5c-b07946ba30b0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:03.693766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a64d465c-25c3-469d-9b5c-b07946ba30b0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:03.713427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a64d465c-25c3-469d-9b5c-b07946ba30b0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:03.713922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a64d465c-25c3-469d-9b5c-b07946ba30b0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:03.714356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a64d465c-25c3-469d-9b5c-b07946ba30b0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:03.715068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a64d465c-25c3-469d-9b5c-b07946ba30b0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:03.715515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a64d465c-25c3-469d-9b5c-b07946ba30b0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:03.717370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a64d465c-25c3-469d-9b5c-b07946ba30b0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:04.006253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ebc2efd5-e077-4d8d-9947-a11cf0bf7d13 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:04.016785 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ebc2efd5-e077-4d8d-9947-a11cf0bf7d13 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.552694 Aug 29 15:25:04.035747 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 39/99] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:03 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:04.041118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a64d465c-25c3-469d-9b5c-b07946ba30b0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:04.049899 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a64d465c-25c3-469d-9b5c-b07946ba30b0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1297 microversion: 2.1 time: 0.360818 Aug 29 15:25:04.051257 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 61/100] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:03 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1297 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:05.042906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dac1a710-6950-4e09-a238-ac83f0271ebe tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:05.044333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dac1a710-6950-4e09-a238-ac83f0271ebe tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:05.052294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dac1a710-6950-4e09-a238-ac83f0271ebe tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:05.058452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dac1a710-6950-4e09-a238-ac83f0271ebe tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:05.059145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dac1a710-6950-4e09-a238-ac83f0271ebe tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:05.060091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dac1a710-6950-4e09-a238-ac83f0271ebe tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:05.060702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dac1a710-6950-4e09-a238-ac83f0271ebe tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:05.061314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dac1a710-6950-4e09-a238-ac83f0271ebe tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:05.092474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a760c196-82a5-4497-937b-cfecaf35f43a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:05.092474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a760c196-82a5-4497-937b-cfecaf35f43a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:05.092474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a760c196-82a5-4497-937b-cfecaf35f43a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:05.092474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a760c196-82a5-4497-937b-cfecaf35f43a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:05.093244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a760c196-82a5-4497-937b-cfecaf35f43a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:05.093244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a760c196-82a5-4497-937b-cfecaf35f43a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:05.093244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a760c196-82a5-4497-937b-cfecaf35f43a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:05.093244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a760c196-82a5-4497-937b-cfecaf35f43a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:05.279096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a760c196-82a5-4497-937b-cfecaf35f43a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:05.294526 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a760c196-82a5-4497-937b-cfecaf35f43a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1295 microversion: 2.1 time: 0.224235 Aug 29 15:25:05.296502 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 62/101] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:05 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1295 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:05.552916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dac1a710-6950-4e09-a238-ac83f0271ebe tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:05.567812 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dac1a710-6950-4e09-a238-ac83f0271ebe tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.528249 Aug 29 15:25:05.573683 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 40/102] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:05 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:06.316727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-225f2307-8fd6-43c7-a4ca-a8fc30a9f922 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:06.317378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-225f2307-8fd6-43c7-a4ca-a8fc30a9f922 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:06.320313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:06.332465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-225f2307-8fd6-43c7-a4ca-a8fc30a9f922 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:06.332956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-225f2307-8fd6-43c7-a4ca-a8fc30a9f922 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:06.333429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-225f2307-8fd6-43c7-a4ca-a8fc30a9f922 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:06.334198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-225f2307-8fd6-43c7-a4ca-a8fc30a9f922 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:06.334649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-225f2307-8fd6-43c7-a4ca-a8fc30a9f922 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:06.335063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-225f2307-8fd6-43c7-a4ca-a8fc30a9f922 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:06.596917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-57ab2fca-5b00-4c9a-96a0-f29e2ea1bfb8 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:06.598498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-57ab2fca-5b00-4c9a-96a0-f29e2ea1bfb8 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:06.620721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57ab2fca-5b00-4c9a-96a0-f29e2ea1bfb8 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:06.621998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57ab2fca-5b00-4c9a-96a0-f29e2ea1bfb8 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:06.625247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57ab2fca-5b00-4c9a-96a0-f29e2ea1bfb8 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:06.627616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57ab2fca-5b00-4c9a-96a0-f29e2ea1bfb8 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:06.630270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57ab2fca-5b00-4c9a-96a0-f29e2ea1bfb8 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:06.631588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57ab2fca-5b00-4c9a-96a0-f29e2ea1bfb8 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:07.007787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-225f2307-8fd6-43c7-a4ca-a8fc30a9f922 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:07.020753 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-225f2307-8fd6-43c7-a4ca-a8fc30a9f922 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.708153 Aug 29 15:25:07.021768 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 63/103] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:06 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:07.302515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-57ab2fca-5b00-4c9a-96a0-f29e2ea1bfb8 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:07.327088 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-57ab2fca-5b00-4c9a-96a0-f29e2ea1bfb8 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.734970 Aug 29 15:25:07.334300 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 41/104] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:06 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:07.749928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-2d42815e-b9a8-486b-8cc1-1574a248a207 req-267eae22-4c68-4626-9c5d-bd40b2f9c06b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d998f970-2fb9-48d6-9a9d-2907f9019b14", "tag": "20b6ee8b-60d3-45f8-b988-c6db2eac9751"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:07.784924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2d42815e-b9a8-486b-8cc1-1574a248a207 req-267eae22-4c68-4626-9c5d-bd40b2f9c06b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:07.786974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2d42815e-b9a8-486b-8cc1-1574a248a207 req-267eae22-4c68-4626-9c5d-bd40b2f9c06b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:07.787868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2d42815e-b9a8-486b-8cc1-1574a248a207 req-267eae22-4c68-4626-9c5d-bd40b2f9c06b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:07.863380 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-2d42815e-b9a8-486b-8cc1-1574a248a207 req-267eae22-4c68-4626-9c5d-bd40b2f9c06b service nova] Creating event network-changed:20b6ee8b-60d3-45f8-b988-c6db2eac9751 for instance d998f970-2fb9-48d6-9a9d-2907f9019b14 on n-h2-839401-11 Aug 29 15:25:07.876525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2d42815e-b9a8-486b-8cc1-1574a248a207 req-267eae22-4c68-4626-9c5d-bd40b2f9c06b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:25:07.877124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2d42815e-b9a8-486b-8cc1-1574a248a207 req-267eae22-4c68-4626-9c5d-bd40b2f9c06b service nova] Acquired lock "compute-rpcapi-router" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:25:07.878645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6dddf4f0-d88f-4f19-b6b7-7ee829790340 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:07.880738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6dddf4f0-d88f-4f19-b6b7-7ee829790340 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:07.882712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6dddf4f0-d88f-4f19-b6b7-7ee829790340 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:07.885736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6dddf4f0-d88f-4f19-b6b7-7ee829790340 None None] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:07.887675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6dddf4f0-d88f-4f19-b6b7-7ee829790340 None None] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:07.888411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6dddf4f0-d88f-4f19-b6b7-7ee829790340 None None] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:07.919067 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.compute.rpcapi [None req-6dddf4f0-d88f-4f19-b6b7-7ee829790340 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 15:25:07.921814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6dddf4f0-d88f-4f19-b6b7-7ee829790340 None None] Releasing lock "compute-rpcapi-router" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:25:07.975768 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6dddf4f0-d88f-4f19-b6b7-7ee829790340 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.945058 Aug 29 15:25:07.979439 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 64/105] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:08.044115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7d5a31a4-2f15-41c7-bea6-a28c37ff551c tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:08.045171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7d5a31a4-2f15-41c7-bea6-a28c37ff551c tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:08.062058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d5a31a4-2f15-41c7-bea6-a28c37ff551c tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:08.065432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d5a31a4-2f15-41c7-bea6-a28c37ff551c tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:08.067592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d5a31a4-2f15-41c7-bea6-a28c37ff551c tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:08.068934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d5a31a4-2f15-41c7-bea6-a28c37ff551c tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:08.072068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d5a31a4-2f15-41c7-bea6-a28c37ff551c tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:08.072813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d5a31a4-2f15-41c7-bea6-a28c37ff551c tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:08.382595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f860524f-42f9-494d-ba84-29aafba0ce1b tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2088706463", "ram": 512, "vcpus": 1, "disk": 10, "id": 776124520, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:08.417575 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f860524f-42f9-494d-ba84-29aafba0ce1b tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.561289 Aug 29 15:25:08.423802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7d5a31a4-2f15-41c7-bea6-a28c37ff551c tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:08.429904 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 42/106] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:25:07 2022] POST /compute/v2.1/flavors => generated 413 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:08.436932 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7d5a31a4-2f15-41c7-bea6-a28c37ff551c tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.397935 Aug 29 15:25:08.438605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a4bade9f-9a34-45f5-a1b6-ad4dd2c12bdf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:08.440421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a4bade9f-9a34-45f5-a1b6-ad4dd2c12bdf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:08.441482 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 65/107] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:08 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:08.468618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4bade9f-9a34-45f5-a1b6-ad4dd2c12bdf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:08.469661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4bade9f-9a34-45f5-a1b6-ad4dd2c12bdf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:08.470400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4bade9f-9a34-45f5-a1b6-ad4dd2c12bdf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:08.471299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4bade9f-9a34-45f5-a1b6-ad4dd2c12bdf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:08.472037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4bade9f-9a34-45f5-a1b6-ad4dd2c12bdf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:08.472884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4bade9f-9a34-45f5-a1b6-ad4dd2c12bdf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:08.710765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a4bade9f-9a34-45f5-a1b6-ad4dd2c12bdf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:08.741201 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a4bade9f-9a34-45f5-a1b6-ad4dd2c12bdf tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.296271 Aug 29 15:25:08.769276 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 43/108] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:08 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:09.217042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a4222c38-9be2-4b70-a009-9500e196177a tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:09.230200 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-a4222c38-9be2-4b70-a009-9500e196177a tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] HTTP exception thrown: Flavor 776124520 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a4222c38-9be2-4b70-a009-9500e196177a tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] Request method failure captured: Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/flavors/776124520/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpPKe0zFY_KO7IR99EfuSdZ5dlRH4-nsEqy7hP-5gvgvA3TdyS1KYVcZHPoS1edDovDBn897MBZjJlZkbjWxSfJT5SmAyyeHkpMWKiwdtNMn_45qmnjSvXWNuch6HRawOtocl8386S01S1ik-G47cO3TpgOhLETQ3ZisiB0MvUYBxY Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d04200bd19334ca6950c62e49717ae8e Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:09.232178 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:09.233606 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d04200bd19334ca6950c62e49717ae8e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d04200bd19334ca6950c62e49717ae8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d04200bd19334ca6950c62e49717ae8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d04200bd19334ca6950c62e49717ae8e"}]}] Aug 29 15:25:09.233606 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 Aug 29 15:25:09.233606 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d04200bd19334ca6950c62e49717ae8e Aug 29 15:25:09.233606 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 Aug 29 15:25:09.233606 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project Aug 29 15:25:09.233606 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:09.233606 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:09.233606 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 85657a03c6254edf88aa6cd96827939f Aug 29 15:25:09.233606 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project Aug 29 15:25:09.233606 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:25:09.233606 n-d-839401-11 devstack@n-api.service[122361]: exception: Flavor 776124520 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'flavor_id': '776124520', 'id': 'hw:cpu_thread_policy'} Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 776124520 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:09.234281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.235555 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.235555 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:09.235555 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:09.235555 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:09.235555 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:09.235555 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 776124520 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:25:09.235555 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.237563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a4222c38-9be2-4b70-a009-9500e196177a tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] Returning 404 to user: Flavor 776124520 has no extra specs with key hw:cpu_thread_policy. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:09.238923 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a4222c38-9be2-4b70-a009-9500e196177a tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] 10.222.0.62 "GET /compute/v2.1/flavors/776124520/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.795830 Aug 29 15:25:09.246630 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 66/109] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:25:08 2022] GET /compute/v2.1/flavors/776124520/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 804 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:09.254100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-de2cd5f7-7699-4038-82f0-1d7e87582c86 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:09.258752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-de2cd5f7-7699-4038-82f0-1d7e87582c86 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '85657a03c6254edf88aa6cd96827939f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04200bd19334ca6950c62e49717ae8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-de2cd5f7-7699-4038-82f0-1d7e87582c86 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] Request method failure captured: Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/flavors/776124520/os-extra_specs HTTP/1.1 Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 66 Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpPKe0zFY_KO7IR99EfuSdZ5dlRH4-nsEqy7hP-5gvgvA3TdyS1KYVcZHPoS1edDovDBn897MBZjJlZkbjWxSfJT5SmAyyeHkpMWKiwdtNMn_45qmnjSvXWNuch6HRawOtocl8386S01S1ik-G47cO3TpgOhLETQ3ZisiB0MvUYBxY Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d04200bd19334ca6950c62e49717ae8e Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:09.264465 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:09.265690 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d04200bd19334ca6950c62e49717ae8e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d04200bd19334ca6950c62e49717ae8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d04200bd19334ca6950c62e49717ae8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d04200bd19334ca6950c62e49717ae8e"}]}] Aug 29 15:25:09.265690 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 Aug 29 15:25:09.265690 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d04200bd19334ca6950c62e49717ae8e Aug 29 15:25:09.265690 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 Aug 29 15:25:09.265690 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project Aug 29 15:25:09.265690 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:09.265690 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:09.265690 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 85657a03c6254edf88aa6cd96827939f Aug 29 15:25:09.265690 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project Aug 29 15:25:09.265690 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:25:09.265690 n-d-839401-11 devstack@n-api.service[122361]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 29 15:25:09.265690 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'flavor_id': '776124520', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:09.266403 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 29 15:25:09.267487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.270468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-de2cd5f7-7699-4038-82f0-1d7e87582c86 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:09.272485 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-de2cd5f7-7699-4038-82f0-1d7e87582c86 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] 10.222.0.62 "POST /compute/v2.1/flavors/776124520/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.023458 Aug 29 15:25:09.279889 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 67/110] 10.222.0.62 () {60 vars in 1221 bytes} [Mon Aug 29 15:25:09 2022] POST /compute/v2.1/flavors/776124520/os-extra_specs => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:09.287667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-99b6327f-3477-411a-919f-0412fd33d7e5 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:09.328877 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-99b6327f-3477-411a-919f-0412fd33d7e5 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors/776124520/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046470 Aug 29 15:25:09.338194 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 68/111] 10.222.0.62 () {60 vars in 1221 bytes} [Mon Aug 29 15:25:09 2022] POST /compute/v2.1/flavors/776124520/os-extra_specs => generated 66 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:25:09.344345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b5461a55-4a6a-4224-acd1-f774c0669644 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:09.346438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b5461a55-4a6a-4224-acd1-f774c0669644 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '85657a03c6254edf88aa6cd96827939f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04200bd19334ca6950c62e49717ae8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b5461a55-4a6a-4224-acd1-f774c0669644 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] Request method failure captured: Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/flavors/776124520/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpPKe0zFY_KO7IR99EfuSdZ5dlRH4-nsEqy7hP-5gvgvA3TdyS1KYVcZHPoS1edDovDBn897MBZjJlZkbjWxSfJT5SmAyyeHkpMWKiwdtNMn_45qmnjSvXWNuch6HRawOtocl8386S01S1ik-G47cO3TpgOhLETQ3ZisiB0MvUYBxY Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d04200bd19334ca6950c62e49717ae8e Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:09.349041 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:09.350359 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d04200bd19334ca6950c62e49717ae8e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d04200bd19334ca6950c62e49717ae8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d04200bd19334ca6950c62e49717ae8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d04200bd19334ca6950c62e49717ae8e"}]}] Aug 29 15:25:09.350359 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 Aug 29 15:25:09.350359 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d04200bd19334ca6950c62e49717ae8e Aug 29 15:25:09.350359 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 Aug 29 15:25:09.350359 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project Aug 29 15:25:09.350359 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:09.350359 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:09.350359 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 85657a03c6254edf88aa6cd96827939f Aug 29 15:25:09.350359 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project Aug 29 15:25:09.350359 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:25:09.350359 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'flavor_id': '776124520', 'id': 'hw:numa_nodes'} Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:09.351047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:09.352149 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:09.352149 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:09.352149 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:09.352149 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:09.352149 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:09.352149 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 29 15:25:09.352149 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.352149 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:09.352149 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.352149 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.352149 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:09.352149 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:09.352149 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:09.352149 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:09.352149 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 29 15:25:09.352149 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.355236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b5461a55-4a6a-4224-acd1-f774c0669644 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:09.356437 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b5461a55-4a6a-4224-acd1-f774c0669644 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] 10.222.0.62 "DELETE /compute/v2.1/flavors/776124520/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016889 Aug 29 15:25:09.357608 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 69/112] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:25:09 2022] DELETE /compute/v2.1/flavors/776124520/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:09.369747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e76cb844-41a9-45a8-9286-4db12c35fbdc tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:09.384341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-69019adc-ee49-426c-837f-28d1fdd8b6d1 tempest-FlavorsV255TestJSON-6512138 tempest-FlavorsV255TestJSON-6512138-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1933218200", "id": 1903014281, "os-flavor-access:is_public": "True"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:09.402730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=12,nova_api:INSERT=3,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:09.407338 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e76cb844-41a9-45a8-9286-4db12c35fbdc tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors/776124520/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040871 Aug 29 15:25:09.408777 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 70/113] 10.222.0.62 () {60 vars in 1221 bytes} [Mon Aug 29 15:25:09 2022] POST /compute/v2.1/flavors/776124520/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:25:09.428003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea81196a-c558-44f3-b974-1ed841889c22 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:09.435026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ea81196a-c558-44f3-b974-1ed841889c22 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '85657a03c6254edf88aa6cd96827939f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd04200bd19334ca6950c62e49717ae8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea81196a-c558-44f3-b974-1ed841889c22 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] Request method failure captured: Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: request: PUT /compute/v2.1/flavors/776124520/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 22 Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpPKe0zFY_KO7IR99EfuSdZ5dlRH4-nsEqy7hP-5gvgvA3TdyS1KYVcZHPoS1edDovDBn897MBZjJlZkbjWxSfJT5SmAyyeHkpMWKiwdtNMn_45qmnjSvXWNuch6HRawOtocl8386S01S1ik-G47cO3TpgOhLETQ3ZisiB0MvUYBxY Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d04200bd19334ca6950c62e49717ae8e Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:09.437078 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:09.438194 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d04200bd19334ca6950c62e49717ae8e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d04200bd19334ca6950c62e49717ae8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d04200bd19334ca6950c62e49717ae8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d04200bd19334ca6950c62e49717ae8e"}]}] Aug 29 15:25:09.438194 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 Aug 29 15:25:09.438194 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d04200bd19334ca6950c62e49717ae8e Aug 29 15:25:09.438194 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 Aug 29 15:25:09.438194 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project Aug 29 15:25:09.438194 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:09.438194 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:09.438194 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 85657a03c6254edf88aa6cd96827939f Aug 29 15:25:09.438194 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project Aug 29 15:25:09.438194 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:25:09.438194 n-d-839401-11 devstack@n-api.service[122361]: {"hw:numa_nodes": "1"} Aug 29 15:25:09.438194 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:25:09.438194 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'flavor_id': '776124520', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:09.438978 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 29 15:25:09.439932 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.440993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea81196a-c558-44f3-b974-1ed841889c22 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:09.441061 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-69019adc-ee49-426c-837f-28d1fdd8b6d1 tempest-FlavorsV255TestJSON-6512138 tempest-FlavorsV255TestJSON-6512138-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.667357 Aug 29 15:25:09.441164 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ea81196a-c558-44f3-b974-1ed841889c22 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074 tempest-FlavorsExtraSpecsNegativeTestJSON-1548916074-project] 10.222.0.62 "PUT /compute/v2.1/flavors/776124520/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.022960 Aug 29 15:25:09.441241 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 44/114] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:25:08 2022] POST /compute/v2.1/flavors => generated 449 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:09.446209 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 71/115] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 15:25:09 2022] PUT /compute/v2.1/flavors/776124520/os-extra_specs/hw:numa_nodes => generated 124 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:09.451589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dbca01cd-c1bf-4e2e-b758-3017e1dad94e tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:09.473843 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-dbca01cd-c1bf-4e2e-b758-3017e1dad94e tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] HTTP exception thrown: Flavor 776124520 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dbca01cd-c1bf-4e2e-b758-3017e1dad94e tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] Request method failure captured: Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/flavors/776124520/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpTeJok0-Jcpg0ZZ_eU51Nk7B1Kj6gcauPzHckI7aYXd-WwOeBPLvClJ0yrbyeTIcCfwAb1eTlvi_S9_vtacr2J0hSQ7rFKS4hwMtXnZxnWRt3i58MyuOMR46GZO7sNQxCBSaey7QLQCwpjHIv1sNZw-vodi8qKBOCOQ0l8vi5LMKY Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d2d67c128fab4dc2a111ab27899971e1 Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:25:09.477449 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:25:09.482418 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d2d67c128fab4dc2a111ab27899971e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d2d67c128fab4dc2a111ab27899971e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d2d67c128fab4dc2a111ab27899971e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d2d67c128fab4dc2a111ab27899971e1"}]}] Aug 29 15:25:09.482418 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 Aug 29 15:25:09.482418 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d2d67c128fab4dc2a111ab27899971e1 Aug 29 15:25:09.482418 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 Aug 29 15:25:09.482418 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin Aug 29 15:25:09.482418 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:09.482418 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:09.482418 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 18e38e186bb449fbbe37522004f5b93a Aug 29 15:25:09.482418 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin Aug 29 15:25:09.482418 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:09.482418 n-d-839401-11 devstack@n-api.service[122360]: exception: Flavor 776124520 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'flavor_id': '776124520', 'id': 'hw:cpu_thread_policy'} Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 776124520 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:09.483048 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.484164 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.484164 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:09.484164 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:09.484164 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:09.484164 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:09.484164 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 776124520 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:25:09.484164 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.484164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dbca01cd-c1bf-4e2e-b758-3017e1dad94e tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] Returning 404 to user: Flavor 776124520 has no extra specs with key hw:cpu_thread_policy. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:09.484164 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dbca01cd-c1bf-4e2e-b758-3017e1dad94e tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/776124520/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.032558 Aug 29 15:25:09.484164 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 45/116] 10.222.0.62 () {58 vars in 1266 bytes} [Mon Aug 29 15:25:09 2022] DELETE /compute/v2.1/flavors/776124520/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:09.491822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bf911b7d-f6b9-4c62-bebd-4c24dbb78f56 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:09.492714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bf911b7d-f6b9-4c62-bebd-4c24dbb78f56 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:09.501699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf911b7d-f6b9-4c62-bebd-4c24dbb78f56 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:09.502490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf911b7d-f6b9-4c62-bebd-4c24dbb78f56 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:09.503317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf911b7d-f6b9-4c62-bebd-4c24dbb78f56 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:09.504277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf911b7d-f6b9-4c62-bebd-4c24dbb78f56 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:09.506544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf911b7d-f6b9-4c62-bebd-4c24dbb78f56 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:09.507583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf911b7d-f6b9-4c62-bebd-4c24dbb78f56 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:09.737748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bf911b7d-f6b9-4c62-bebd-4c24dbb78f56 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:09.747331 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bf911b7d-f6b9-4c62-bebd-4c24dbb78f56 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.266287 Aug 29 15:25:09.750795 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 46/117] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:09 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:09.762432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7b50ec2-e2c0-4c1c-8be4-5e66a70946b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:09.771704 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-f7b50ec2-e2c0-4c1c-8be4-5e66a70946b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7b50ec2-e2c0-4c1c-8be4-5e66a70946b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] Request method failure captured: Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: request: PUT /compute/v2.1/flavors/776124520/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 27 Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpTeJok0-Jcpg0ZZ_eU51Nk7B1Kj6gcauPzHckI7aYXd-WwOeBPLvClJ0yrbyeTIcCfwAb1eTlvi_S9_vtacr2J0hSQ7rFKS4hwMtXnZxnWRt3i58MyuOMR46GZO7sNQxCBSaey7QLQCwpjHIv1sNZw-vodi8qKBOCOQ0l8vi5LMKY Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d2d67c128fab4dc2a111ab27899971e1 Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:25:09.775821 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:25:09.777048 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d2d67c128fab4dc2a111ab27899971e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d2d67c128fab4dc2a111ab27899971e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d2d67c128fab4dc2a111ab27899971e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d2d67c128fab4dc2a111ab27899971e1"}]}] Aug 29 15:25:09.777048 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 Aug 29 15:25:09.777048 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d2d67c128fab4dc2a111ab27899971e1 Aug 29 15:25:09.777048 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 Aug 29 15:25:09.777048 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin Aug 29 15:25:09.777048 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:09.777048 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:09.777048 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 18e38e186bb449fbbe37522004f5b93a Aug 29 15:25:09.777048 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin Aug 29 15:25:09.777048 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:25:09.777048 n-d-839401-11 devstack@n-api.service[122360]: {"hw:cpu_policy": "shared"} Aug 29 15:25:09.777048 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:09.777048 n-d-839401-11 devstack@n-api.service[122360]: exception: Request body and URI mismatch Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'flavor_id': '776124520', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:09.777799 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:09.779697 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:09.779697 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:09.779697 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 29 15:25:09.779697 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.779697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7b50ec2-e2c0-4c1c-8be4-5e66a70946b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:09.780340 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f7b50ec2-e2c0-4c1c-8be4-5e66a70946b8 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] 10.222.0.62 "PUT /compute/v2.1/flavors/776124520/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.024473 Aug 29 15:25:09.781384 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 47/118] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 15:25:09 2022] PUT /compute/v2.1/flavors/776124520/os-extra_specs/hw:numa_nodes => generated 73 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:09.788212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e418e0b7-9726-43c3-b582-630e34d0a80f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:09.789462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e418e0b7-9726-43c3-b582-630e34d0a80f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:09.806499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fbb69e37-8306-4819-b380-5fe0c683ea7c tempest-FlavorsV255TestJSON-392764390 tempest-FlavorsV255TestJSON-392764390-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:09.808236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10,nova_api:DELETE=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:09.820304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e418e0b7-9726-43c3-b582-630e34d0a80f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:09.822673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e418e0b7-9726-43c3-b582-630e34d0a80f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:09.823326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e418e0b7-9726-43c3-b582-630e34d0a80f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:09.826560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e418e0b7-9726-43c3-b582-630e34d0a80f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:09.828717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e418e0b7-9726-43c3-b582-630e34d0a80f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:09.829435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e418e0b7-9726-43c3-b582-630e34d0a80f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:09.840980 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fbb69e37-8306-4819-b380-5fe0c683ea7c tempest-FlavorsV255TestJSON-392764390 tempest-FlavorsV255TestJSON-392764390-project] 10.222.0.62 "GET /compute/v2.1/flavors/1903014281" status: 200 len: 449 microversion: 2.55 time: 0.388524 Aug 29 15:25:09.842631 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 72/119] 10.222.0.62 () {60 vars in 1199 bytes} [Mon Aug 29 15:25:09 2022] GET /compute/v2.1/flavors/1903014281 => generated 449 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:25:09.858133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dfd3d11e-824e-4534-88c8-dfb1deb30ffe tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dfd3d11e-824e-4534-88c8-dfb1deb30ffe tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] Request method failure captured: Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: request: PUT /compute/v2.1/flavors/776124520/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 49 Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpTeJok0-Jcpg0ZZ_eU51Nk7B1Kj6gcauPzHckI7aYXd-WwOeBPLvClJ0yrbyeTIcCfwAb1eTlvi_S9_vtacr2J0hSQ7rFKS4hwMtXnZxnWRt3i58MyuOMR46GZO7sNQxCBSaey7QLQCwpjHIv1sNZw-vodi8qKBOCOQ0l8vi5LMKY Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d2d67c128fab4dc2a111ab27899971e1 Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:25:09.878268 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:25:09.879570 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d2d67c128fab4dc2a111ab27899971e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d2d67c128fab4dc2a111ab27899971e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d2d67c128fab4dc2a111ab27899971e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d2d67c128fab4dc2a111ab27899971e1"}]}] Aug 29 15:25:09.879570 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 Aug 29 15:25:09.879570 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d2d67c128fab4dc2a111ab27899971e1 Aug 29 15:25:09.879570 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 Aug 29 15:25:09.879570 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin Aug 29 15:25:09.879570 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:09.879570 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:09.879570 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 18e38e186bb449fbbe37522004f5b93a Aug 29 15:25:09.879570 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin Aug 29 15:25:09.879570 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:25:09.879570 n-d-839401-11 devstack@n-api.service[122361]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 29 15:25:09.879570 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'flavor_id': '776124520', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance: Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 29 15:25:09.880338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.881650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:09.882704 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:09.882704 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:09.882704 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:25:09.882704 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:25:09.882704 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 15:25:09.882704 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:09.882704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dfd3d11e-824e-4534-88c8-dfb1deb30ffe tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:09.882704 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dfd3d11e-824e-4534-88c8-dfb1deb30ffe tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] 10.222.0.62 "PUT /compute/v2.1/flavors/776124520/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.034762 Aug 29 15:25:09.882704 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 73/120] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 15:25:09 2022] PUT /compute/v2.1/flavors/776124520/os-extra_specs/hw:numa_nodes => generated 117 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:25:09.902844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1485331f-e836-4502-8134-c0b509ef3913 tempest-FlavorsV255TestJSON-6512138 tempest-FlavorsV255TestJSON-6512138-project-admin] Action: 'update', calling method: .version_select at 0x7fc43171adc0>, body: {"flavor": {"description": "new"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:10.009684 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1485331f-e836-4502-8134-c0b509ef3913 tempest-FlavorsV255TestJSON-6512138 tempest-FlavorsV255TestJSON-6512138-project-admin] 10.222.0.62 "PUT /compute/v2.1/flavors/1903014281" status: 200 len: 450 microversion: 2.55 time: 0.126555 Aug 29 15:25:10.024170 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 74/121] 10.222.0.62 () {62 vars in 1219 bytes} [Mon Aug 29 15:25:09 2022] PUT /compute/v2.1/flavors/1903014281 => generated 450 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:10.043287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-81a8c8bd-1556-4c22-bac4-671774f10cdf tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:10.085029 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-81a8c8bd-1556-4c22-bac4-671774f10cdf tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/776124520" status: 202 len: 0 microversion: 2.1 time: 0.051863 Aug 29 15:25:10.086301 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 75/122] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 15:25:10 2022] DELETE /compute/v2.1/flavors/776124520 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:25:10.098885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-08743d8d-b822-4e24-b60e-422e4088ed3a tempest-FlavorsV255TestJSON-392764390 tempest-FlavorsV255TestJSON-392764390-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:10.142021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e418e0b7-9726-43c3-b582-630e34d0a80f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:10.154895 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e418e0b7-9726-43c3-b582-630e34d0a80f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.371335 Aug 29 15:25:10.160172 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-08743d8d-b822-4e24-b60e-422e4088ed3a tempest-FlavorsV255TestJSON-392764390 tempest-FlavorsV255TestJSON-392764390-project] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.071843 Aug 29 15:25:10.169268 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 76/123] 10.222.0.62 () {60 vars in 1187 bytes} [Mon Aug 29 15:25:10 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:25:10.177495 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 48/124] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:09 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:10.190815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cdc0893a-9d12-491e-b3d5-d7b5b2e66f2b tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:10.191374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-125fa245-b861-4e8a-897d-7221b5b8b4c7 tempest-FlavorsV255TestJSON-392764390 tempest-FlavorsV255TestJSON-392764390-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:10.234424 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-125fa245-b861-4e8a-897d-7221b5b8b4c7 tempest-FlavorsV255TestJSON-392764390 tempest-FlavorsV255TestJSON-392764390-project] 10.222.0.62 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.043300 Aug 29 15:25:10.237360 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 49/125] 10.222.0.62 () {60 vars in 1166 bytes} [Mon Aug 29 15:25:10 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:25:10.239189 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cdc0893a-9d12-491e-b3d5-d7b5b2e66f2b tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982 tempest-FlavorsExtraSpecsNegativeTestJSON-1326375982-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.067389 Aug 29 15:25:10.249709 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 77/126] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:10 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:10.261205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b113911f-badc-4f16-a445-fb02a7373903 tempest-FlavorsV255TestJSON-6512138 tempest-FlavorsV255TestJSON-6512138-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:10.334210 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b113911f-badc-4f16-a445-fb02a7373903 tempest-FlavorsV255TestJSON-6512138 tempest-FlavorsV255TestJSON-6512138-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/1903014281" status: 202 len: 0 microversion: 2.55 time: 0.081414 Aug 29 15:25:10.337154 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 50/127] 10.222.0.62 () {60 vars in 1202 bytes} [Mon Aug 29 15:25:10 2022] DELETE /compute/v2.1/flavors/1903014281 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:25:10.346087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f04107e8-ae12-4e52-b64b-10353fe620d8 tempest-FlavorsV255TestJSON-6512138 tempest-FlavorsV255TestJSON-6512138-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:10.394775 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f04107e8-ae12-4e52-b64b-10353fe620d8 tempest-FlavorsV255TestJSON-6512138 tempest-FlavorsV255TestJSON-6512138-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.052726 Aug 29 15:25:10.399467 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 78/128] 10.222.0.62 () {60 vars in 1187 bytes} [Mon Aug 29 15:25:10 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:25:10.788871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2adddb0e-3ae3-479c-ab1f-6b859cef530f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:10.790354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2adddb0e-3ae3-479c-ab1f-6b859cef530f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:10.792840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:10.803120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2adddb0e-3ae3-479c-ab1f-6b859cef530f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:10.807011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2adddb0e-3ae3-479c-ab1f-6b859cef530f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:10.807831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2adddb0e-3ae3-479c-ab1f-6b859cef530f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:10.808912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2adddb0e-3ae3-479c-ab1f-6b859cef530f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:10.809869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2adddb0e-3ae3-479c-ab1f-6b859cef530f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:10.810708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2adddb0e-3ae3-479c-ab1f-6b859cef530f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:10.904882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-0a40bf2a-71e5-4242-aa2d-34d7c013a5e3 req-0c9608a4-1cd6-49cb-bde7-5856142e1a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b616b8-2701-458b-8b8a-9f44b708e6fc", "tag": "9a441fd6-9720-4d58-b5b1-296c1d7b3bb0"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:10.929391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0a40bf2a-71e5-4242-aa2d-34d7c013a5e3 req-0c9608a4-1cd6-49cb-bde7-5856142e1a4d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:10.929391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0a40bf2a-71e5-4242-aa2d-34d7c013a5e3 req-0c9608a4-1cd6-49cb-bde7-5856142e1a4d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:10.929668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0a40bf2a-71e5-4242-aa2d-34d7c013a5e3 req-0c9608a4-1cd6-49cb-bde7-5856142e1a4d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:10.979275 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-0a40bf2a-71e5-4242-aa2d-34d7c013a5e3 req-0c9608a4-1cd6-49cb-bde7-5856142e1a4d service nova] Creating event network-changed:9a441fd6-9720-4d58-b5b1-296c1d7b3bb0 for instance 43b616b8-2701-458b-8b8a-9f44b708e6fc on n-h1-839401-11 Aug 29 15:25:10.997065 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-0a40bf2a-71e5-4242-aa2d-34d7c013a5e3 req-0c9608a4-1cd6-49cb-bde7-5856142e1a4d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094238 Aug 29 15:25:11.001125 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 79/129] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:11.157628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2adddb0e-3ae3-479c-ab1f-6b859cef530f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:11.174624 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2adddb0e-3ae3-479c-ab1f-6b859cef530f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.390116 Aug 29 15:25:11.184501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-931ac4d0-0b46-41c3-82fc-0fd57c4d3314 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:11.185488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-931ac4d0-0b46-41c3-82fc-0fd57c4d3314 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:11.190385 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 51/130] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:10 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:11.199233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-931ac4d0-0b46-41c3-82fc-0fd57c4d3314 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:11.199727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-931ac4d0-0b46-41c3-82fc-0fd57c4d3314 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:11.200169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-931ac4d0-0b46-41c3-82fc-0fd57c4d3314 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:11.201413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-931ac4d0-0b46-41c3-82fc-0fd57c4d3314 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:11.203559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-931ac4d0-0b46-41c3-82fc-0fd57c4d3314 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:11.209136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-931ac4d0-0b46-41c3-82fc-0fd57c4d3314 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:11.685304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-931ac4d0-0b46-41c3-82fc-0fd57c4d3314 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:11.694201 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-931ac4d0-0b46-41c3-82fc-0fd57c4d3314 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.513894 Aug 29 15:25:11.697356 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 80/131] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:11 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:12.200788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c4ba0d75-119a-4b86-a69d-1ea8e5989a77 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:12.204170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c4ba0d75-119a-4b86-a69d-1ea8e5989a77 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:12.240723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:12.257979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4ba0d75-119a-4b86-a69d-1ea8e5989a77 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:12.258476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4ba0d75-119a-4b86-a69d-1ea8e5989a77 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:12.258912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4ba0d75-119a-4b86-a69d-1ea8e5989a77 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:12.263234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4ba0d75-119a-4b86-a69d-1ea8e5989a77 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:12.269824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4ba0d75-119a-4b86-a69d-1ea8e5989a77 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:12.271320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4ba0d75-119a-4b86-a69d-1ea8e5989a77 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:12.667319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=10 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:12.787983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c4ba0d75-119a-4b86-a69d-1ea8e5989a77 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:12.797273 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c4ba0d75-119a-4b86-a69d-1ea8e5989a77 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.601888 Aug 29 15:25:12.797951 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 52/132] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:12 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:12.848341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-03d8da9b-dc19-485d-bc9d-0b8b2599c70f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:12.851786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-03d8da9b-dc19-485d-bc9d-0b8b2599c70f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:12.896616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03d8da9b-dc19-485d-bc9d-0b8b2599c70f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:12.899991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03d8da9b-dc19-485d-bc9d-0b8b2599c70f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:12.904949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03d8da9b-dc19-485d-bc9d-0b8b2599c70f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:12.906702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03d8da9b-dc19-485d-bc9d-0b8b2599c70f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:12.909531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03d8da9b-dc19-485d-bc9d-0b8b2599c70f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:12.914966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03d8da9b-dc19-485d-bc9d-0b8b2599c70f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:13.259322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8380ac30-3bef-452c-910e-d04414cc9100 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Calling method '.version_select at 0x7fc4305d1ca0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:13.262360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8380ac30-3bef-452c-910e-d04414cc9100 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:13.263002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8380ac30-3bef-452c-910e-d04414cc9100 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:13.264096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8380ac30-3bef-452c-910e-d04414cc9100 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:13.352626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8380ac30-3bef-452c-910e-d04414cc9100 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:13.353289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8380ac30-3bef-452c-910e-d04414cc9100 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:13.360614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8380ac30-3bef-452c-910e-d04414cc9100 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:13.422017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8380ac30-3bef-452c-910e-d04414cc9100 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:13.428404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8380ac30-3bef-452c-910e-d04414cc9100 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:13.431582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8380ac30-3bef-452c-910e-d04414cc9100 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:13.458224 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8380ac30-3bef-452c-910e-d04414cc9100 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 1.216150 Aug 29 15:25:13.464751 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 81/133] 10.222.0.62 () {60 vars in 1187 bytes} [Mon Aug 29 15:25:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:13.476427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-426f9338-d1f0-43ae-bad0-fe0f7f979906 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Calling method '.version_select at 0x7fc4305d1670>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:13.491042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-426f9338-d1f0-43ae-bad0-fe0f7f979906 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:13.496354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-426f9338-d1f0-43ae-bad0-fe0f7f979906 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:13.499440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-426f9338-d1f0-43ae-bad0-fe0f7f979906 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:13.588266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-426f9338-d1f0-43ae-bad0-fe0f7f979906 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:13.589304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-426f9338-d1f0-43ae-bad0-fe0f7f979906 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:13.590805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-426f9338-d1f0-43ae-bad0-fe0f7f979906 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:13.603749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-03d8da9b-dc19-485d-bc9d-0b8b2599c70f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:13.623530 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-03d8da9b-dc19-485d-bc9d-0b8b2599c70f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.819307 Aug 29 15:25:13.626097 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 53/134] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:12 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:13.626551 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-426f9338-d1f0-43ae-bad0-fe0f7f979906 tempest-HypervisorAdminV228Test-889518605 tempest-HypervisorAdminV228Test-889518605-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.154553 Aug 29 15:25:13.630760 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 82/135] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Aug 29 15:25:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:13.823093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d6f2237-8505-4c0b-9a2e-6ef690712428 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:13.823093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2d6f2237-8505-4c0b-9a2e-6ef690712428 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:13.839080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d6f2237-8505-4c0b-9a2e-6ef690712428 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:13.839859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d6f2237-8505-4c0b-9a2e-6ef690712428 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:13.840967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d6f2237-8505-4c0b-9a2e-6ef690712428 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:13.843367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d6f2237-8505-4c0b-9a2e-6ef690712428 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:13.844255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d6f2237-8505-4c0b-9a2e-6ef690712428 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:13.846532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d6f2237-8505-4c0b-9a2e-6ef690712428 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:14.078121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d6f2237-8505-4c0b-9a2e-6ef690712428 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:14.090232 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d6f2237-8505-4c0b-9a2e-6ef690712428 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.272962 Aug 29 15:25:14.091752 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 54/136] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:13 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:14.656557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8bbeb410-da04-46e3-9b95-27db3eafc2cd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:14.657610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8bbeb410-da04-46e3-9b95-27db3eafc2cd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:14.671354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8bbeb410-da04-46e3-9b95-27db3eafc2cd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:14.671947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8bbeb410-da04-46e3-9b95-27db3eafc2cd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:14.672385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8bbeb410-da04-46e3-9b95-27db3eafc2cd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:14.674805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8bbeb410-da04-46e3-9b95-27db3eafc2cd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:14.675276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8bbeb410-da04-46e3-9b95-27db3eafc2cd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:14.675706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8bbeb410-da04-46e3-9b95-27db3eafc2cd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:14.713964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7e5a978c-6bef-4d78-9398-0bfac5fe9ff0 tempest-QuotaClassesAdminTestJSON-668607962 tempest-QuotaClassesAdminTestJSON-668607962-project-admin] Calling method '.version_select at 0x7fc4305d14c0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:14.738595 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7e5a978c-6bef-4d78-9398-0bfac5fe9ff0 tempest-QuotaClassesAdminTestJSON-668607962 tempest-QuotaClassesAdminTestJSON-668607962-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.579144 Aug 29 15:25:14.740565 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 83/137] 10.222.0.62 () {58 vars in 1185 bytes} [Mon Aug 29 15:25:14 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:14.760614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ebdbea71-6127-4d42-a157-241dd7f88571 tempest-QuotaClassesAdminTestJSON-668607962 tempest-QuotaClassesAdminTestJSON-668607962-project-admin] Action: 'update', calling method: .version_select at 0x7fc4305d1a60>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:15.042483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8bbeb410-da04-46e3-9b95-27db3eafc2cd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:15.065898 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8bbeb410-da04-46e3-9b95-27db3eafc2cd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.414326 Aug 29 15:25:15.066947 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 55/138] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:14 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:15.116502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7eefe8ed-4b40-4dc4-b01b-3adba33fb497 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:15.117159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7eefe8ed-4b40-4dc4-b01b-3adba33fb497 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:15.127126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eefe8ed-4b40-4dc4-b01b-3adba33fb497 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:15.129336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eefe8ed-4b40-4dc4-b01b-3adba33fb497 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:15.134744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eefe8ed-4b40-4dc4-b01b-3adba33fb497 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:15.140229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eefe8ed-4b40-4dc4-b01b-3adba33fb497 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:15.140734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eefe8ed-4b40-4dc4-b01b-3adba33fb497 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:15.141189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eefe8ed-4b40-4dc4-b01b-3adba33fb497 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:15.145770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:15.420131 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ebdbea71-6127-4d42-a157-241dd7f88571 tempest-QuotaClassesAdminTestJSON-668607962 tempest-QuotaClassesAdminTestJSON-668607962-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.663153 Aug 29 15:25:15.420759 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 84/139] 10.222.0.62 () {60 vars in 1206 bytes} [Mon Aug 29 15:25:14 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:15.443812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c7a2e451-5e10-48af-a090-1471a1576979 tempest-QuotaClassesAdminTestJSON-668607962 tempest-QuotaClassesAdminTestJSON-668607962-project-admin] Calling method '.version_select at 0x7fc430574700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:15.481852 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c7a2e451-5e10-48af-a090-1471a1576979 tempest-QuotaClassesAdminTestJSON-668607962 tempest-QuotaClassesAdminTestJSON-668607962-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.046862 Aug 29 15:25:15.484657 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 85/140] 10.222.0.62 () {58 vars in 1185 bytes} [Mon Aug 29 15:25:15 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:15.495099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-af7c3026-7f53-4941-a2a8-0ab0ca4eb5dd tempest-QuotaClassesAdminTestJSON-668607962 tempest-QuotaClassesAdminTestJSON-668607962-project-admin] Action: 'update', calling method: .version_select at 0x7fc4304ec940>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:15.514034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=14,nova_api:DELETE=3,nova_api:INSERT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:15.589721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7eefe8ed-4b40-4dc4-b01b-3adba33fb497 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:15.604072 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7eefe8ed-4b40-4dc4-b01b-3adba33fb497 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.492685 Aug 29 15:25:15.612370 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 56/141] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:15 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:15.698764 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-af7c3026-7f53-4941-a2a8-0ab0ca4eb5dd tempest-QuotaClassesAdminTestJSON-668607962 tempest-QuotaClassesAdminTestJSON-668607962-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.207887 Aug 29 15:25:15.699899 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 86/142] 10.222.0.62 () {60 vars in 1206 bytes} [Mon Aug 29 15:25:15 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:25:16.091797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-66ed96da-4d67-4866-b7be-19d7cab491d1 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:16.093184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-66ed96da-4d67-4866-b7be-19d7cab491d1 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:16.102183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66ed96da-4d67-4866-b7be-19d7cab491d1 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:16.103152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66ed96da-4d67-4866-b7be-19d7cab491d1 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:16.104196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66ed96da-4d67-4866-b7be-19d7cab491d1 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:16.105299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66ed96da-4d67-4866-b7be-19d7cab491d1 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:16.106429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66ed96da-4d67-4866-b7be-19d7cab491d1 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:16.107648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66ed96da-4d67-4866-b7be-19d7cab491d1 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:16.115102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:16.305676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-66ed96da-4d67-4866-b7be-19d7cab491d1 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:16.314470 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-66ed96da-4d67-4866-b7be-19d7cab491d1 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.227741 Aug 29 15:25:16.328027 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 87/143] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:16 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:16.338056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7058baa0-58ee-4be5-af13-54eafca4df96 tempest-FlavorsV261TestJSON-1987543124 tempest-FlavorsV261TestJSON-1987543124-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-516927517", "id": 425623470, "os-flavor-access:is_public": "True"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:16.373002 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7058baa0-58ee-4be5-af13-54eafca4df96 tempest-FlavorsV261TestJSON-1987543124 tempest-FlavorsV261TestJSON-1987543124-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.581697 Aug 29 15:25:16.386259 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 57/144] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:25:15 2022] POST /compute/v2.1/flavors => generated 464 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:25:16.626429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8c6f695f-b989-4327-bcbf-e907bc7edc3a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:16.627270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8c6f695f-b989-4327-bcbf-e907bc7edc3a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:16.635739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c6f695f-b989-4327-bcbf-e907bc7edc3a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:16.637763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c6f695f-b989-4327-bcbf-e907bc7edc3a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:16.638217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c6f695f-b989-4327-bcbf-e907bc7edc3a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:16.640394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c6f695f-b989-4327-bcbf-e907bc7edc3a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:16.640862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c6f695f-b989-4327-bcbf-e907bc7edc3a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:16.641323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c6f695f-b989-4327-bcbf-e907bc7edc3a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:16.688113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-65d80686-8978-42af-b8b3-35ba438dc04b tempest-FlavorsV261TestJSON-1181108244 tempest-FlavorsV261TestJSON-1181108244-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:16.699624 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-65d80686-8978-42af-b8b3-35ba438dc04b tempest-FlavorsV261TestJSON-1181108244 tempest-FlavorsV261TestJSON-1181108244-project] 10.222.0.62 "GET /compute/v2.1/flavors/425623470" status: 200 len: 464 microversion: 2.61 time: 0.316895 Aug 29 15:25:16.700561 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 88/145] 10.222.0.62 () {60 vars in 1196 bytes} [Mon Aug 29 15:25:16 2022] GET /compute/v2.1/flavors/425623470 => generated 464 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:16.714388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c496d2b4-cf68-448c-a9cf-afa6b9875ca1 tempest-FlavorsV261TestJSON-1987543124 tempest-FlavorsV261TestJSON-1987543124-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:16.748768 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c496d2b4-cf68-448c-a9cf-afa6b9875ca1 tempest-FlavorsV261TestJSON-1987543124 tempest-FlavorsV261TestJSON-1987543124-project-admin] 10.222.0.62 "PUT /compute/v2.1/flavors/425623470" status: 200 len: 465 microversion: 2.61 time: 0.038551 Aug 29 15:25:16.750505 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 89/146] 10.222.0.62 () {62 vars in 1216 bytes} [Mon Aug 29 15:25:16 2022] PUT /compute/v2.1/flavors/425623470 => generated 465 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:16.768655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-423e36a3-c792-4892-83c2-ddf1b1e4c6b6 tempest-FlavorsV261TestJSON-1181108244 tempest-FlavorsV261TestJSON-1181108244-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:16.811932 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-423e36a3-c792-4892-83c2-ddf1b1e4c6b6 tempest-FlavorsV261TestJSON-1181108244 tempest-FlavorsV261TestJSON-1181108244-project] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.048350 Aug 29 15:25:16.812454 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 90/147] 10.222.0.62 () {60 vars in 1187 bytes} [Mon Aug 29 15:25:16 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:25:16.834645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e5a22746-fcb7-45fc-9d75-834651812b96 tempest-FlavorsV261TestJSON-1181108244 tempest-FlavorsV261TestJSON-1181108244-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:16.867692 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e5a22746-fcb7-45fc-9d75-834651812b96 tempest-FlavorsV261TestJSON-1181108244 tempest-FlavorsV261TestJSON-1181108244-project] 10.222.0.62 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.038709 Aug 29 15:25:16.869516 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 91/148] 10.222.0.62 () {60 vars in 1166 bytes} [Mon Aug 29 15:25:16 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:25:16.885650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ba7380e7-d6f9-41e7-a2fe-c3e95c6fc3f9 tempest-FlavorsV261TestJSON-1987543124 tempest-FlavorsV261TestJSON-1987543124-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:16.894355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8c6f695f-b989-4327-bcbf-e907bc7edc3a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:16.906339 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8c6f695f-b989-4327-bcbf-e907bc7edc3a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.284465 Aug 29 15:25:16.921153 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 58/149] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:16 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:25:16.951454 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ba7380e7-d6f9-41e7-a2fe-c3e95c6fc3f9 tempest-FlavorsV261TestJSON-1987543124 tempest-FlavorsV261TestJSON-1987543124-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/425623470" status: 202 len: 0 microversion: 2.61 time: 0.069992 Aug 29 15:25:16.952253 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 92/150] 10.222.0.62 () {60 vars in 1199 bytes} [Mon Aug 29 15:25:16 2022] DELETE /compute/v2.1/flavors/425623470 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:25:16.961667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6ffbe952-027e-49a0-84f6-cd9052ce3205 tempest-FlavorsV261TestJSON-1987543124 tempest-FlavorsV261TestJSON-1987543124-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:16.986952 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6ffbe952-027e-49a0-84f6-cd9052ce3205 tempest-FlavorsV261TestJSON-1987543124 tempest-FlavorsV261TestJSON-1987543124-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.029778 Aug 29 15:25:17.001186 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 59/151] 10.222.0.62 () {60 vars in 1187 bytes} [Mon Aug 29 15:25:16 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:25:17.338478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fbe724fb-f824-4aa3-a1f2-73c7cd25db30 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:17.340942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fbe724fb-f824-4aa3-a1f2-73c7cd25db30 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:17.349059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbe724fb-f824-4aa3-a1f2-73c7cd25db30 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:17.349742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbe724fb-f824-4aa3-a1f2-73c7cd25db30 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:17.350361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbe724fb-f824-4aa3-a1f2-73c7cd25db30 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:17.351531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbe724fb-f824-4aa3-a1f2-73c7cd25db30 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:17.351983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbe724fb-f824-4aa3-a1f2-73c7cd25db30 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:17.352598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbe724fb-f824-4aa3-a1f2-73c7cd25db30 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:17.497254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fbe724fb-f824-4aa3-a1f2-73c7cd25db30 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:17.505497 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fbe724fb-f824-4aa3-a1f2-73c7cd25db30 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.173672 Aug 29 15:25:17.506267 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 93/152] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:17 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:17.934668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-07182f70-b3b1-40e6-9070-cde8fc3e9007 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:17.937787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-07182f70-b3b1-40e6-9070-cde8fc3e9007 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:17.948294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07182f70-b3b1-40e6-9070-cde8fc3e9007 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:17.948790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07182f70-b3b1-40e6-9070-cde8fc3e9007 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:17.949417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07182f70-b3b1-40e6-9070-cde8fc3e9007 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:17.950132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07182f70-b3b1-40e6-9070-cde8fc3e9007 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:17.950589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07182f70-b3b1-40e6-9070-cde8fc3e9007 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:17.951273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07182f70-b3b1-40e6-9070-cde8fc3e9007 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:18.187860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-07182f70-b3b1-40e6-9070-cde8fc3e9007 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:18.201755 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-07182f70-b3b1-40e6-9070-cde8fc3e9007 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.276211 Aug 29 15:25:18.203058 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 60/153] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:17 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:18.526333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-979e1a7f-6432-41ad-b301-33c2c7fcc3fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:18.527635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-979e1a7f-6432-41ad-b301-33c2c7fcc3fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:18.534831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:18.536958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-979e1a7f-6432-41ad-b301-33c2c7fcc3fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:18.537980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-979e1a7f-6432-41ad-b301-33c2c7fcc3fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:18.538859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-979e1a7f-6432-41ad-b301-33c2c7fcc3fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:18.540048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-979e1a7f-6432-41ad-b301-33c2c7fcc3fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:18.540640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-979e1a7f-6432-41ad-b301-33c2c7fcc3fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:18.541076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-979e1a7f-6432-41ad-b301-33c2c7fcc3fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:18.908059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-979e1a7f-6432-41ad-b301-33c2c7fcc3fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:18.919732 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-979e1a7f-6432-41ad-b301-33c2c7fcc3fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.397030 Aug 29 15:25:18.933316 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 94/154] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:18 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:19.223840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c7e4541e-c699-446f-b849-d53242b0f1e0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:19.224442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c7e4541e-c699-446f-b849-d53242b0f1e0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:19.231634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7e4541e-c699-446f-b849-d53242b0f1e0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:19.232374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7e4541e-c699-446f-b849-d53242b0f1e0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:19.232994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7e4541e-c699-446f-b849-d53242b0f1e0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:19.233896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7e4541e-c699-446f-b849-d53242b0f1e0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:19.234526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7e4541e-c699-446f-b849-d53242b0f1e0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:19.235231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7e4541e-c699-446f-b849-d53242b0f1e0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:19.391416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c7e4541e-c699-446f-b849-d53242b0f1e0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:19.399079 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c7e4541e-c699-446f-b849-d53242b0f1e0 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.180531 Aug 29 15:25:19.399649 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 95/155] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:19 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:25:19.444704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-74cbf054-5eda-4750-8542-3998b5047156 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Calling method '.version_select at 0x7fc43071b310>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:19.447897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74cbf054-5eda-4750-8542-3998b5047156 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:19.448545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74cbf054-5eda-4750-8542-3998b5047156 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:19.449296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74cbf054-5eda-4750-8542-3998b5047156 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:19.466111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74cbf054-5eda-4750-8542-3998b5047156 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:19.466815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74cbf054-5eda-4750-8542-3998b5047156 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:19.467244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74cbf054-5eda-4750-8542-3998b5047156 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:19.478130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74cbf054-5eda-4750-8542-3998b5047156 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:19.478638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74cbf054-5eda-4750-8542-3998b5047156 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:19.479059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74cbf054-5eda-4750-8542-3998b5047156 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:19.485900 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-74cbf054-5eda-4750-8542-3998b5047156 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.357331 Aug 29 15:25:19.486674 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 61/156] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:19 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:19.496905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dbf2cf1f-71cb-403c-844d-510392bbd160 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Calling method '.version_select at 0x7fc4304f8ee0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:19.498664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbf2cf1f-71cb-403c-844d-510392bbd160 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:19.499124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbf2cf1f-71cb-403c-844d-510392bbd160 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:19.499746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbf2cf1f-71cb-403c-844d-510392bbd160 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:19.514982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbf2cf1f-71cb-403c-844d-510392bbd160 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:19.515471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbf2cf1f-71cb-403c-844d-510392bbd160 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:19.515906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbf2cf1f-71cb-403c-844d-510392bbd160 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:19.535370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbf2cf1f-71cb-403c-844d-510392bbd160 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:19.536534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbf2cf1f-71cb-403c-844d-510392bbd160 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:19.536978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbf2cf1f-71cb-403c-844d-510392bbd160 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:19.543524 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dbf2cf1f-71cb-403c-844d-510392bbd160 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/n-h1-839401-11/servers" status: 200 len: 197 microversion: 2.1 time: 0.050269 Aug 29 15:25:19.550726 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 96/157] 10.222.0.62 () {58 vars in 1215 bytes} [Mon Aug 29 15:25:19 2022] GET /compute/v2.1/os-hypervisors/n-h1-839401-11/servers => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:19.555574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-62f31d80-2404-44f7-bb5d-d2207d23f227 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Calling method '.version_select at 0x7fc4306e5af0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:19.557601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62f31d80-2404-44f7-bb5d-d2207d23f227 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:19.558233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62f31d80-2404-44f7-bb5d-d2207d23f227 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:19.558816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62f31d80-2404-44f7-bb5d-d2207d23f227 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:19.572678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62f31d80-2404-44f7-bb5d-d2207d23f227 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:19.573179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62f31d80-2404-44f7-bb5d-d2207d23f227 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:19.573814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62f31d80-2404-44f7-bb5d-d2207d23f227 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:19.584860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62f31d80-2404-44f7-bb5d-d2207d23f227 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:19.585369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62f31d80-2404-44f7-bb5d-d2207d23f227 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:19.585797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62f31d80-2404-44f7-bb5d-d2207d23f227 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:19.591823 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-62f31d80-2404-44f7-bb5d-d2207d23f227 tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.039860 Aug 29 15:25:19.592466 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 62/158] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:19 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:19.602489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-47dc7f31-eb2f-4188-9e98-c46af34b9a6a tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Calling method '.version_select at 0x7fc4305d1af0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:19.604355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47dc7f31-eb2f-4188-9e98-c46af34b9a6a tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:19.604836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47dc7f31-eb2f-4188-9e98-c46af34b9a6a tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:19.605407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47dc7f31-eb2f-4188-9e98-c46af34b9a6a tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:19.617379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47dc7f31-eb2f-4188-9e98-c46af34b9a6a tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:19.617870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47dc7f31-eb2f-4188-9e98-c46af34b9a6a tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:19.618411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47dc7f31-eb2f-4188-9e98-c46af34b9a6a tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:19.624361 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-47dc7f31-eb2f-4188-9e98-c46af34b9a6a tempest-HypervisorAdminUnderV252Test-366791949 tempest-HypervisorAdminUnderV252Test-366791949-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/n-h1-839401-11/search" status: 200 len: 105 microversion: 2.1 time: 0.025521 Aug 29 15:25:19.624956 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 97/159] 10.222.0.62 () {58 vars in 1212 bytes} [Mon Aug 29 15:25:19 2022] GET /compute/v2.1/os-hypervisors/n-h1-839401-11/search => generated 105 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:19.941034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c5ac9c84-0793-4fc2-875f-a560310bdc4e tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:19.941947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c5ac9c84-0793-4fc2-875f-a560310bdc4e tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:19.948417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5ac9c84-0793-4fc2-875f-a560310bdc4e tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:19.950247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5ac9c84-0793-4fc2-875f-a560310bdc4e tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:19.950892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5ac9c84-0793-4fc2-875f-a560310bdc4e tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:19.951994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5ac9c84-0793-4fc2-875f-a560310bdc4e tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:19.952639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5ac9c84-0793-4fc2-875f-a560310bdc4e tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:19.953590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5ac9c84-0793-4fc2-875f-a560310bdc4e tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.033893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4573f576-775a-4572-b13f-460654586f2b tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Calling method '.version_select at 0x7fc430795b80>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:20.035893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4573f576-775a-4572-b13f-460654586f2b tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.036386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4573f576-775a-4572-b13f-460654586f2b tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.036827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4573f576-775a-4572-b13f-460654586f2b tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.076216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4573f576-775a-4572-b13f-460654586f2b tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.076901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4573f576-775a-4572-b13f-460654586f2b tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.077562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4573f576-775a-4572-b13f-460654586f2b tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.092295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4573f576-775a-4572-b13f-460654586f2b tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.093329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4573f576-775a-4572-b13f-460654586f2b tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.094321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4573f576-775a-4572-b13f-460654586f2b tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.101849 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4573f576-775a-4572-b13f-460654586f2b tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.439286 Aug 29 15:25:20.110560 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 63/160] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:19 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:20.120801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c5ac9c84-0793-4fc2-875f-a560310bdc4e tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:20.121030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c922f8db-3583-4571-809b-ef368ed528fe tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Calling method '.version_select at 0x7fc4306cf550>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:20.122872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c922f8db-3583-4571-809b-ef368ed528fe tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.123355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c922f8db-3583-4571-809b-ef368ed528fe tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.123785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c922f8db-3583-4571-809b-ef368ed528fe tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.136025 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c5ac9c84-0793-4fc2-875f-a560310bdc4e tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.199207 Aug 29 15:25:20.137536 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 98/161] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:19 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:20.163548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c922f8db-3583-4571-809b-ef368ed528fe tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.164038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c922f8db-3583-4571-809b-ef368ed528fe tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.164473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c922f8db-3583-4571-809b-ef368ed528fe tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.179071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c922f8db-3583-4571-809b-ef368ed528fe tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.179540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c922f8db-3583-4571-809b-ef368ed528fe tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.179968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c922f8db-3583-4571-809b-ef368ed528fe tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.187531 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c922f8db-3583-4571-809b-ef368ed528fe tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.075856 Aug 29 15:25:20.198048 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 64/162] 10.222.0.62 () {58 vars in 1167 bytes} [Mon Aug 29 15:25:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:20.205182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d0868fdb-a5e7-4488-bbcb-40bf5669579c tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Calling method '.version_select at 0x7fc430574dc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:20.207320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0868fdb-a5e7-4488-bbcb-40bf5669579c tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.208310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0868fdb-a5e7-4488-bbcb-40bf5669579c tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.208897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0868fdb-a5e7-4488-bbcb-40bf5669579c tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.224144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0868fdb-a5e7-4488-bbcb-40bf5669579c tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.224854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0868fdb-a5e7-4488-bbcb-40bf5669579c tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.225470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0868fdb-a5e7-4488-bbcb-40bf5669579c tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.237111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0868fdb-a5e7-4488-bbcb-40bf5669579c tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.238479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0868fdb-a5e7-4488-bbcb-40bf5669579c tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.239220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0868fdb-a5e7-4488-bbcb-40bf5669579c tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.247204 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d0868fdb-a5e7-4488-bbcb-40bf5669579c tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.045752 Aug 29 15:25:20.253345 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 99/163] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:20 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:20.258865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0f5ef229-8d34-4038-ace5-af989ffa6f1d tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Calling method '.version_select at 0x7fc43071b5e0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:20.260643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f5ef229-8d34-4038-ace5-af989ffa6f1d tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.261155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f5ef229-8d34-4038-ace5-af989ffa6f1d tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.261590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f5ef229-8d34-4038-ace5-af989ffa6f1d tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.286676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f5ef229-8d34-4038-ace5-af989ffa6f1d tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.287590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f5ef229-8d34-4038-ace5-af989ffa6f1d tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.288342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f5ef229-8d34-4038-ace5-af989ffa6f1d tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.296058 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0f5ef229-8d34-4038-ace5-af989ffa6f1d tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.041105 Aug 29 15:25:20.297027 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 65/164] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:20.313246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e2c4e07-aa65-44fa-a03a-080fa31603a3 tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Calling method '.version_select at 0x7fc4304ec160>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:20.315089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e2c4e07-aa65-44fa-a03a-080fa31603a3 tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.315574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e2c4e07-aa65-44fa-a03a-080fa31603a3 tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.316021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e2c4e07-aa65-44fa-a03a-080fa31603a3 tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.339295 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9e2c4e07-aa65-44fa-a03a-080fa31603a3 tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.029539 Aug 29 15:25:20.340176 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 100/165] 10.222.0.62 () {58 vars in 1179 bytes} [Mon Aug 29 15:25:20 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:20.355422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4cbe5d2b-b4b5-4f5d-a690-9a3ba936bbac tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Calling method '.version_select at 0x7fc43071b9d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:20.357331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cbe5d2b-b4b5-4f5d-a690-9a3ba936bbac tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.357802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cbe5d2b-b4b5-4f5d-a690-9a3ba936bbac tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.358227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cbe5d2b-b4b5-4f5d-a690-9a3ba936bbac tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.388540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cbe5d2b-b4b5-4f5d-a690-9a3ba936bbac tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.389400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cbe5d2b-b4b5-4f5d-a690-9a3ba936bbac tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.389983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cbe5d2b-b4b5-4f5d-a690-9a3ba936bbac tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.401851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cbe5d2b-b4b5-4f5d-a690-9a3ba936bbac tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.402617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cbe5d2b-b4b5-4f5d-a690-9a3ba936bbac tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.403221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cbe5d2b-b4b5-4f5d-a690-9a3ba936bbac tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.410188 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4cbe5d2b-b4b5-4f5d-a690-9a3ba936bbac tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.059893 Aug 29 15:25:20.411306 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 66/166] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:20 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:20.421144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f2c8e8c1-c3dc-4c08-b924-33d28a9946dd tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:20.422557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f2c8e8c1-c3dc-4c08-b924-33d28a9946dd tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:20.428308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-100e0f7a-912c-40f1-aa85-962fac9d0c38 tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Calling method '.version_select at 0x7fc43071b8b0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:20.431308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2c8e8c1-c3dc-4c08-b924-33d28a9946dd tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.432087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2c8e8c1-c3dc-4c08-b924-33d28a9946dd tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.432898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2c8e8c1-c3dc-4c08-b924-33d28a9946dd tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.433236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-100e0f7a-912c-40f1-aa85-962fac9d0c38 tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.434394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2c8e8c1-c3dc-4c08-b924-33d28a9946dd tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.435070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2c8e8c1-c3dc-4c08-b924-33d28a9946dd tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.435693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2c8e8c1-c3dc-4c08-b924-33d28a9946dd tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.436375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-100e0f7a-912c-40f1-aa85-962fac9d0c38 tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.436864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-100e0f7a-912c-40f1-aa85-962fac9d0c38 tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.466043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-100e0f7a-912c-40f1-aa85-962fac9d0c38 tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.466617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-100e0f7a-912c-40f1-aa85-962fac9d0c38 tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.467038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-100e0f7a-912c-40f1-aa85-962fac9d0c38 tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.484230 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-100e0f7a-912c-40f1-aa85-962fac9d0c38 tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.065090 Aug 29 15:25:20.485321 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 67/167] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:20.505600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c6773c4-65dc-4e05-869b-01829cd9087e tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Calling method '.version_select at 0x7fc4307954c0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:20.507545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c6773c4-65dc-4e05-869b-01829cd9087e tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.508027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c6773c4-65dc-4e05-869b-01829cd9087e tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.508463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c6773c4-65dc-4e05-869b-01829cd9087e tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.521463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c6773c4-65dc-4e05-869b-01829cd9087e tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.521946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c6773c4-65dc-4e05-869b-01829cd9087e tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.522377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c6773c4-65dc-4e05-869b-01829cd9087e tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.528991 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5c6773c4-65dc-4e05-869b-01829cd9087e tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.026644 Aug 29 15:25:20.529656 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 68/168] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:20 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:20.543729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-01919b5b-9702-4f23-a8de-5f4c776692ee tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Calling method '.version_select at 0x7fc4306e59d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:20.545575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01919b5b-9702-4f23-a8de-5f4c776692ee tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.546050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01919b5b-9702-4f23-a8de-5f4c776692ee tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.546477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01919b5b-9702-4f23-a8de-5f4c776692ee tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.560102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01919b5b-9702-4f23-a8de-5f4c776692ee tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.560588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01919b5b-9702-4f23-a8de-5f4c776692ee tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.561576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01919b5b-9702-4f23-a8de-5f4c776692ee tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.576423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01919b5b-9702-4f23-a8de-5f4c776692ee tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.577559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01919b5b-9702-4f23-a8de-5f4c776692ee tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.578432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01919b5b-9702-4f23-a8de-5f4c776692ee tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.584318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01919b5b-9702-4f23-a8de-5f4c776692ee tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:25:20.584715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01919b5b-9702-4f23-a8de-5f4c776692ee tempest-HypervisorAdminTestJSON-1719683794 tempest-HypervisorAdminTestJSON-1719683794-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:25:20.585831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb20f91d-d4d8-4c0f-8bc5-a1ed0a43f5bf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.586286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb20f91d-d4d8-4c0f-8bc5-a1ed0a43f5bf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.586704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb20f91d-d4d8-4c0f-8bc5-a1ed0a43f5bf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.587545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb20f91d-d4d8-4c0f-8bc5-a1ed0a43f5bf None None] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:20.587996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb20f91d-d4d8-4c0f-8bc5-a1ed0a43f5bf None None] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:20.588409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb20f91d-d4d8-4c0f-8bc5-a1ed0a43f5bf None None] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:20.597026 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.compute.rpcapi [None req-eb20f91d-d4d8-4c0f-8bc5-a1ed0a43f5bf None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 15:25:20.597960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb20f91d-d4d8-4c0f-8bc5-a1ed0a43f5bf None None] Releasing lock "compute-rpcapi-router" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:25:20.670643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f2c8e8c1-c3dc-4c08-b924-33d28a9946dd tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:20.680657 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f2c8e8c1-c3dc-4c08-b924-33d28a9946dd tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.264124 Aug 29 15:25:20.690550 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 101/169] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:20 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:21.158504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0367933f-2d5c-47ad-a4ae-cc8928e041dd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:21.159114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0367933f-2d5c-47ad-a4ae-cc8928e041dd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:21.165528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0367933f-2d5c-47ad-a4ae-cc8928e041dd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:21.166017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0367933f-2d5c-47ad-a4ae-cc8928e041dd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:21.166451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0367933f-2d5c-47ad-a4ae-cc8928e041dd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:21.167150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0367933f-2d5c-47ad-a4ae-cc8928e041dd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:21.167599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0367933f-2d5c-47ad-a4ae-cc8928e041dd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:21.168187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0367933f-2d5c-47ad-a4ae-cc8928e041dd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:21.310646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0367933f-2d5c-47ad-a4ae-cc8928e041dd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:21.319457 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0367933f-2d5c-47ad-a4ae-cc8928e041dd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.164836 Aug 29 15:25:21.330192 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 102/170] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:21 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:25:21.691836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c128c07-96e3-4fef-8545-69856c1d8676 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Action: 'update', calling method: .version_select at 0x7fc4304b3670>, body: {"quota_set": {"ram": "5120"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:21.956189 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eb20f91d-d4d8-4c0f-8bc5-a1ed0a43f5bf None None] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 1.415952 Aug 29 15:25:21.957354 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 69/171] 10.222.0.62 () {58 vars in 1173 bytes} [Mon Aug 29 15:25:20 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:21.962941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f05a0e3f-629f-44f7-8640-ab09bc103da8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:21.963819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f05a0e3f-629f-44f7-8640-ab09bc103da8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:21.978751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f05a0e3f-629f-44f7-8640-ab09bc103da8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:21.979593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f05a0e3f-629f-44f7-8640-ab09bc103da8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:21.980229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f05a0e3f-629f-44f7-8640-ab09bc103da8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:21.981153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f05a0e3f-629f-44f7-8640-ab09bc103da8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:21.981801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f05a0e3f-629f-44f7-8640-ab09bc103da8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:21.982416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f05a0e3f-629f-44f7-8640-ab09bc103da8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:22.020081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c128c07-96e3-4fef-8545-69856c1d8676 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:22.020586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c128c07-96e3-4fef-8545-69856c1d8676 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:22.021024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c128c07-96e3-4fef-8545-69856c1d8676 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:22.023968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c128c07-96e3-4fef-8545-69856c1d8676 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:22.024556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c128c07-96e3-4fef-8545-69856c1d8676 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:22.024998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c128c07-96e3-4fef-8545-69856c1d8676 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:22.120489 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6c128c07-96e3-4fef-8545-69856c1d8676 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-sets/b5255936f7ee4ec9987314f226218bf8" status: 200 len: 148 microversion: 2.57 time: 0.788148 Aug 29 15:25:22.121836 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 103/172] 10.222.0.62 () {62 vars in 1303 bytes} [Mon Aug 29 15:25:21 2022] PUT /compute/v2.1/os-quota-sets/b5255936f7ee4ec9987314f226218bf8 => generated 148 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:22.173673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f05a0e3f-629f-44f7-8640-ab09bc103da8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:22.185836 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f05a0e3f-629f-44f7-8640-ab09bc103da8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.225067 Aug 29 15:25:22.186424 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 70/173] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:21 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:22.191001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-df90372f-c86e-43a5-83dc-3d03e44ff8e6 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Calling method '.version_select at 0x7fc43062e4c0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:22.422842 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-867f6adf-fca2-4d30-8cac-e7b6928909a4 tempest-TenantUsagesNegativeTestJSON-350993363 tempest-TenantUsagesNegativeTestJSON-350993363-project-admin] 10.222.0.62 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-28T15%3A25%3A22.051055&end=2022-08-30T15%3A25%3A22.051055" status: 404 len: 112 microversion: - time: 0.299528 Aug 29 15:25:22.424706 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 104/174] 10.222.0.62 () {58 vars in 1316 bytes} [Mon Aug 29 15:25:22 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-28T15%3A25%3A22.051055&end=2022-08-30T15%3A25%3A22.051055 => generated 112 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 15:25:22.430171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b07902a8-8d37-4417-b613-2abec11df7ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:22.430985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b07902a8-8d37-4417-b613-2abec11df7ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:22.439410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b07902a8-8d37-4417-b613-2abec11df7ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:22.440055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b07902a8-8d37-4417-b613-2abec11df7ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:22.440661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b07902a8-8d37-4417-b613-2abec11df7ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:22.441552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b07902a8-8d37-4417-b613-2abec11df7ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:22.442178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b07902a8-8d37-4417-b613-2abec11df7ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:22.442741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b07902a8-8d37-4417-b613-2abec11df7ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:22.591466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b07902a8-8d37-4417-b613-2abec11df7ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:22.600727 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b07902a8-8d37-4417-b613-2abec11df7ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.174819 Aug 29 15:25:22.601329 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 105/175] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:22 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:22.605875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5c08d565-e71f-45eb-a90c-9853378c5d3c tempest-TenantUsagesNegativeTestJSON-350993363 tempest-TenantUsagesNegativeTestJSON-350993363-project-admin] Calling method '.version_select at 0x7fc4304f80d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:22.611823 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-5c08d565-e71f-45eb-a90c-9853378c5d3c tempest-TenantUsagesNegativeTestJSON-350993363 tempest-TenantUsagesNegativeTestJSON-350993363-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5c08d565-e71f-45eb-a90c-9853378c5d3c tempest-TenantUsagesNegativeTestJSON-350993363 tempest-TenantUsagesNegativeTestJSON-350993363-project-admin] Request method failure captured: Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-simple-tenant-usage/9fefd650bf52414b9ad9980be5ee8c95?start=2022-08-30T15%3A25%3A22.051055&end=2022-08-28T15%3A25%3A22.051055 HTTP/1.1 Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNphWvfqz2em2Xwc0q633xKaYNe5nvfNGUW8ZnYGZpGF9fNDGO0FExUFF_yRFsNIdl1svhiMeMF4AkHBye6Whrm1-p0J-Z0lQNL42TUPRjlftLie0BmChtEagyfQcbB1fnRkVns3L6_1TrPRb8hCTw9pR1Ng9bqgrdlnZtR-SAY4ChU Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 436e433073ae47eca369072e99f737ac Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-350993363 Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:25:22.613595 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:25:22.614859 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_436e433073ae47eca369072e99f737ac", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/436e433073ae47eca369072e99f737ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/436e433073ae47eca369072e99f737ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/436e433073ae47eca369072e99f737ac"}]}] Aug 29 15:25:22.614859 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-350993363 Aug 29 15:25:22.614859 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 436e433073ae47eca369072e99f737ac Aug 29 15:25:22.614859 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-350993363 Aug 29 15:25:22.614859 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TenantUsagesNegativeTestJSON-350993363-project-admin Aug 29 15:25:22.614859 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:22.614859 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:22.614859 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: fb2750d486ab4a879ea595fdd2e5bc11 Aug 29 15:25:22.614859 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-350993363-project-admin Aug 29 15:25:22.614859 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:22.614859 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid start time. The start time cannot occur after the end time. Aug 29 15:25:22.614859 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '9fefd650bf52414b9ad9980be5ee8c95'} Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 15:25:22.615580 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 29 15:25:22.616596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:22.616596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:22.616596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:22.616596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:22.616596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:22.616596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:22.616596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:22.616596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:22.616596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 29 15:25:22.616596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:22.616596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5c08d565-e71f-45eb-a90c-9853378c5d3c tempest-TenantUsagesNegativeTestJSON-350993363 tempest-TenantUsagesNegativeTestJSON-350993363-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:22.616596 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5c08d565-e71f-45eb-a90c-9853378c5d3c tempest-TenantUsagesNegativeTestJSON-350993363 tempest-TenantUsagesNegativeTestJSON-350993363-project-admin] 10.222.0.62 "GET /compute/v2.1/os-simple-tenant-usage/9fefd650bf52414b9ad9980be5ee8c95?start=2022-08-30T15%3A25%3A22.051055&end=2022-08-28T15%3A25%3A22.051055" status: 400 len: 111 microversion: 2.1 time: 0.012790 Aug 29 15:25:22.617348 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 106/176] 10.222.0.62 () {58 vars in 1412 bytes} [Mon Aug 29 15:25:22 2022] GET /compute/v2.1/os-simple-tenant-usage/9fefd650bf52414b9ad9980be5ee8c95?start=2022-08-30T15%3A25%3A22.051055&end=2022-08-28T15%3A25%3A22.051055 => generated 111 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:25:22.736634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df90372f-c86e-43a5-83dc-3d03e44ff8e6 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:22.737035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df90372f-c86e-43a5-83dc-3d03e44ff8e6 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:22.737517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df90372f-c86e-43a5-83dc-3d03e44ff8e6 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:22.738245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df90372f-c86e-43a5-83dc-3d03e44ff8e6 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:22.738693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df90372f-c86e-43a5-83dc-3d03e44ff8e6 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:22.739398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df90372f-c86e-43a5-83dc-3d03e44ff8e6 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:22.762256 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-df90372f-c86e-43a5-83dc-3d03e44ff8e6 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/b5255936f7ee4ec9987314f226218bf8/detail" status: 200 len: 463 microversion: 2.57 time: 0.574599 Aug 29 15:25:22.762872 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 71/177] 10.222.0.62 () {60 vars in 1304 bytes} [Mon Aug 29 15:25:22 2022] GET /compute/v2.1/os-quota-sets/b5255936f7ee4ec9987314f226218bf8/detail => generated 463 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:23.016453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-45f1a54b-c54d-4ac9-9c48-8ea118a827c0 req-f195bef8-5fc3-49d9-964c-8eb33940d064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d998f970-2fb9-48d6-9a9d-2907f9019b14", "name": "network-vif-plugged", "status": "completed", "tag": "20b6ee8b-60d3-45f8-b988-c6db2eac9751"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:23.040480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-45f1a54b-c54d-4ac9-9c48-8ea118a827c0 req-f195bef8-5fc3-49d9-964c-8eb33940d064 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:23.041364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-45f1a54b-c54d-4ac9-9c48-8ea118a827c0 req-f195bef8-5fc3-49d9-964c-8eb33940d064 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:23.042739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-45f1a54b-c54d-4ac9-9c48-8ea118a827c0 req-f195bef8-5fc3-49d9-964c-8eb33940d064 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:23.055460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-02cca9ef-5017-464f-b6bb-1497d52fd6ad tempest-TenantUsagesNegativeTestJSON-1849042479 tempest-TenantUsagesNegativeTestJSON-1849042479-project] Calling method '.version_select at 0x7fc4304deaf0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:23.065209 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-45f1a54b-c54d-4ac9-9c48-8ea118a827c0 req-f195bef8-5fc3-49d9-964c-8eb33940d064 service nova] Creating event network-vif-plugged:20b6ee8b-60d3-45f8-b988-c6db2eac9751 for instance d998f970-2fb9-48d6-9a9d-2907f9019b14 on n-h2-839401-11 Aug 29 15:25:23.066360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-02cca9ef-5017-464f-b6bb-1497d52fd6ad tempest-TenantUsagesNegativeTestJSON-1849042479 tempest-TenantUsagesNegativeTestJSON-1849042479-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'ba613ad5462748c0bba5b76922a0eeef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fefd650bf52414b9ad9980be5ee8c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-02cca9ef-5017-464f-b6bb-1497d52fd6ad tempest-TenantUsagesNegativeTestJSON-1849042479 tempest-TenantUsagesNegativeTestJSON-1849042479-project] Request method failure captured: Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T15%3A25%3A22.051055&end=2022-08-30T15%3A25%3A22.051055&detailed=1 HTTP/1.1 Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpgYh5_kyDrdSWzsu4PbAwnQ6K27EVdk6v7D477HNPMg0KelrqHYhRfiJ8lM0PUjMq8xDtHN_iVs5-e7c_te6Da7Wux38Sc3Q9M7RwCHaih79V9K8vvGsuJmonAgTpfLkyVqu-_9y1m4fRyY_KUYY9Ihska3ejK65D_2P5oyInLLJI Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 9fefd650bf52414b9ad9980be5ee8c95 Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1849042479 Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:23.070183 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:23.071356 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9fefd650bf52414b9ad9980be5ee8c95", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9fefd650bf52414b9ad9980be5ee8c95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9fefd650bf52414b9ad9980be5ee8c95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9fefd650bf52414b9ad9980be5ee8c95"}]}] Aug 29 15:25:23.071356 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1849042479 Aug 29 15:25:23.071356 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 9fefd650bf52414b9ad9980be5ee8c95 Aug 29 15:25:23.071356 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1849042479 Aug 29 15:25:23.071356 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TenantUsagesNegativeTestJSON-1849042479-project Aug 29 15:25:23.071356 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:23.071356 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:23.071356 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: ba613ad5462748c0bba5b76922a0eeef Aug 29 15:25:23.071356 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1849042479-project Aug 29 15:25:23.071356 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:23.071356 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 29 15:25:23.071356 n-d-839401-11 devstack@n-api.service[122361]: action_args: {} Aug 29 15:25:23.071356 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:23.072158 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:23.073718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:23.074711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 29 15:25:23.074711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:23.074829 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-45f1a54b-c54d-4ac9-9c48-8ea118a827c0 req-f195bef8-5fc3-49d9-964c-8eb33940d064 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.308239 Aug 29 15:25:23.074829 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 72/178] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:23.075628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-45f1a54b-c54d-4ac9-9c48-8ea118a827c0 req-f195bef8-5fc3-49d9-964c-8eb33940d064 service nova] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:23.078085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-02cca9ef-5017-464f-b6bb-1497d52fd6ad tempest-TenantUsagesNegativeTestJSON-1849042479 tempest-TenantUsagesNegativeTestJSON-1849042479-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:23.079575 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-02cca9ef-5017-464f-b6bb-1497d52fd6ad tempest-TenantUsagesNegativeTestJSON-1849042479 tempest-TenantUsagesNegativeTestJSON-1849042479-project] 10.222.0.62 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T15%3A25%3A22.051055&end=2022-08-30T15%3A25%3A22.051055&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.458003 Aug 29 15:25:23.089140 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-45f1a54b-c54d-4ac9-9c48-8ea118a827c0 req-f195bef8-5fc3-49d9-964c-8eb33940d064 service nova] 10.222.0.62 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001311 Aug 29 15:25:23.089140 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 73/179] 10.222.0.62 () {56 vars in 886 bytes} [Mon Aug 29 15:25:23 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 15:25:23.090540 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 107/180] 10.222.0.62 () {58 vars in 1335 bytes} [Mon Aug 29 15:25:22 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T15%3A25%3A22.051055&end=2022-08-30T15%3A25%3A22.051055&detailed=1 => generated 123 bytes in 469 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:25:23.207441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-36f3c3c6-b778-4da1-aa86-0958bedf8cca tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:23.208186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-36f3c3c6-b778-4da1-aa86-0958bedf8cca tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:23.215290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36f3c3c6-b778-4da1-aa86-0958bedf8cca tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:23.215780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36f3c3c6-b778-4da1-aa86-0958bedf8cca tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:23.216214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36f3c3c6-b778-4da1-aa86-0958bedf8cca tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:23.216934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36f3c3c6-b778-4da1-aa86-0958bedf8cca tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:23.219071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36f3c3c6-b778-4da1-aa86-0958bedf8cca tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:23.219507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36f3c3c6-b778-4da1-aa86-0958bedf8cca tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:23.423473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-36f3c3c6-b778-4da1-aa86-0958bedf8cca tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:23.435182 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-36f3c3c6-b778-4da1-aa86-0958bedf8cca tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.231737 Aug 29 15:25:23.448150 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 74/181] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:23 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:23.625905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-87a9aed5-6048-418d-ba94-03954ff716d6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:23.627117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-87a9aed5-6048-418d-ba94-03954ff716d6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:23.646596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87a9aed5-6048-418d-ba94-03954ff716d6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:23.647409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87a9aed5-6048-418d-ba94-03954ff716d6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:23.648279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87a9aed5-6048-418d-ba94-03954ff716d6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:23.649537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87a9aed5-6048-418d-ba94-03954ff716d6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:23.650485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87a9aed5-6048-418d-ba94-03954ff716d6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:23.651193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87a9aed5-6048-418d-ba94-03954ff716d6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:23.801349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f836aaa8-d3d7-4f65-b577-5f072f00006b tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Action: 'update', calling method: .version_select at 0x7fc43070da60>, body: {"quota_set": {"ram": "2048"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:23.818974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-87a9aed5-6048-418d-ba94-03954ff716d6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:23.827297 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-87a9aed5-6048-418d-ba94-03954ff716d6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.208753 Aug 29 15:25:23.827865 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 108/182] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:23 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:24.459575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-62fa125c-4f8d-4acd-9f9c-dc83cded5fd9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:24.460197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-62fa125c-4f8d-4acd-9f9c-dc83cded5fd9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:24.466771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62fa125c-4f8d-4acd-9f9c-dc83cded5fd9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:24.469134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62fa125c-4f8d-4acd-9f9c-dc83cded5fd9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:24.470493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62fa125c-4f8d-4acd-9f9c-dc83cded5fd9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:24.471250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62fa125c-4f8d-4acd-9f9c-dc83cded5fd9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:24.472052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62fa125c-4f8d-4acd-9f9c-dc83cded5fd9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:24.475992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62fa125c-4f8d-4acd-9f9c-dc83cded5fd9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:24.541645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f836aaa8-d3d7-4f65-b577-5f072f00006b tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:24.542183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f836aaa8-d3d7-4f65-b577-5f072f00006b tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:24.542561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f836aaa8-d3d7-4f65-b577-5f072f00006b tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:24.543427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f836aaa8-d3d7-4f65-b577-5f072f00006b tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:24.543893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f836aaa8-d3d7-4f65-b577-5f072f00006b tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:24.544321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f836aaa8-d3d7-4f65-b577-5f072f00006b tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:24.588810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f836aaa8-d3d7-4f65-b577-5f072f00006b tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:24.589728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f836aaa8-d3d7-4f65-b577-5f072f00006b tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:24.590190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f836aaa8-d3d7-4f65-b577-5f072f00006b tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:24.591085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f836aaa8-d3d7-4f65-b577-5f072f00006b tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:24.591554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f836aaa8-d3d7-4f65-b577-5f072f00006b tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:24.591980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f836aaa8-d3d7-4f65-b577-5f072f00006b tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:24.723271 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f836aaa8-d3d7-4f65-b577-5f072f00006b tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-sets/b5255936f7ee4ec9987314f226218bf8?user_id=8c734ce45bc845faaee37f8267ef1015" status: 200 len: 148 microversion: 2.57 time: 0.925407 Aug 29 15:25:24.724697 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 75/183] 10.222.0.62 () {62 vars in 1384 bytes} [Mon Aug 29 15:25:23 2022] PUT /compute/v2.1/os-quota-sets/b5255936f7ee4ec9987314f226218bf8?user_id=8c734ce45bc845faaee37f8267ef1015 => generated 148 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:24.725454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-62fa125c-4f8d-4acd-9f9c-dc83cded5fd9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:24.735996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5504984a-87e7-4eba-847b-0c9c222c0244 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] Calling method '.version_select at 0x7fc43061d310>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:24.737694 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-62fa125c-4f8d-4acd-9f9c-dc83cded5fd9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.281553 Aug 29 15:25:24.740294 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 109/184] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:24 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:24.852985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-26fc4e7c-b210-46ea-bb73-d7ec273d796d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:24.853650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-26fc4e7c-b210-46ea-bb73-d7ec273d796d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:24.859995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26fc4e7c-b210-46ea-bb73-d7ec273d796d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:24.860879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26fc4e7c-b210-46ea-bb73-d7ec273d796d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:24.861730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26fc4e7c-b210-46ea-bb73-d7ec273d796d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:24.862670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26fc4e7c-b210-46ea-bb73-d7ec273d796d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:24.863351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26fc4e7c-b210-46ea-bb73-d7ec273d796d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:24.864044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26fc4e7c-b210-46ea-bb73-d7ec273d796d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:25.035028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-26fc4e7c-b210-46ea-bb73-d7ec273d796d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:25.049650 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-26fc4e7c-b210-46ea-bb73-d7ec273d796d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.205211 Aug 29 15:25:25.050260 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 110/185] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:24 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:25.402654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:25.420108 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5504984a-87e7-4eba-847b-0c9c222c0244 tempest-QuotasAdminTestV257-69183720 tempest-QuotasAdminTestV257-69183720-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/b5255936f7ee4ec9987314f226218bf8?user_id=8c734ce45bc845faaee37f8267ef1015" status: 200 len: 190 microversion: 2.57 time: 0.688088 Aug 29 15:25:25.427946 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 76/186] 10.222.0.62 () {60 vars in 1364 bytes} [Mon Aug 29 15:25:24 2022] GET /compute/v2.1/os-quota-sets/b5255936f7ee4ec9987314f226218bf8?user_id=8c734ce45bc845faaee37f8267ef1015 => generated 190 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:25:25.760018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-76dc4aa2-dad1-4d60-95e4-75873d19a23a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:25.761203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-76dc4aa2-dad1-4d60-95e4-75873d19a23a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:25.768442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76dc4aa2-dad1-4d60-95e4-75873d19a23a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:25.768950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76dc4aa2-dad1-4d60-95e4-75873d19a23a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:25.769423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76dc4aa2-dad1-4d60-95e4-75873d19a23a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:25.770246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76dc4aa2-dad1-4d60-95e4-75873d19a23a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:25.770910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76dc4aa2-dad1-4d60-95e4-75873d19a23a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:25.771207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76dc4aa2-dad1-4d60-95e4-75873d19a23a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:25.924025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-76dc4aa2-dad1-4d60-95e4-75873d19a23a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:25.935130 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-76dc4aa2-dad1-4d60-95e4-75873d19a23a tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.178860 Aug 29 15:25:25.949324 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 111/187] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:25 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:26.072197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-17267aa9-8f57-46d2-8094-52aaec62311f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:26.073605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-17267aa9-8f57-46d2-8094-52aaec62311f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:26.083794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17267aa9-8f57-46d2-8094-52aaec62311f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:26.085165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17267aa9-8f57-46d2-8094-52aaec62311f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:26.085876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17267aa9-8f57-46d2-8094-52aaec62311f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:26.087093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17267aa9-8f57-46d2-8094-52aaec62311f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:26.087858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17267aa9-8f57-46d2-8094-52aaec62311f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:26.089247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17267aa9-8f57-46d2-8094-52aaec62311f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:26.151103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-0793cbf1-f29d-4926-af0b-3ec6af279668 req-c7f114b5-570d-4940-a955-1a0a5077e642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b616b8-2701-458b-8b8a-9f44b708e6fc", "name": "network-vif-plugged", "status": "completed", "tag": "9a441fd6-9720-4d58-b5b1-296c1d7b3bb0"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:26.170099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0793cbf1-f29d-4926-af0b-3ec6af279668 req-c7f114b5-570d-4940-a955-1a0a5077e642 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:26.170809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0793cbf1-f29d-4926-af0b-3ec6af279668 req-c7f114b5-570d-4940-a955-1a0a5077e642 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:26.172696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0793cbf1-f29d-4926-af0b-3ec6af279668 req-c7f114b5-570d-4940-a955-1a0a5077e642 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:26.223880 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-0793cbf1-f29d-4926-af0b-3ec6af279668 req-c7f114b5-570d-4940-a955-1a0a5077e642 service nova] Creating event network-vif-plugged:9a441fd6-9720-4d58-b5b1-296c1d7b3bb0 for instance 43b616b8-2701-458b-8b8a-9f44b708e6fc on n-h1-839401-11 Aug 29 15:25:26.232210 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-0793cbf1-f29d-4926-af0b-3ec6af279668 req-c7f114b5-570d-4940-a955-1a0a5077e642 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083051 Aug 29 15:25:26.237113 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 112/188] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:26.296483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-17267aa9-8f57-46d2-8094-52aaec62311f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:26.304491 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-17267aa9-8f57-46d2-8094-52aaec62311f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1319 microversion: 2.1 time: 0.237819 Aug 29 15:25:26.313776 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 77/189] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:26 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:26.781537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-72b63811-a466-4a4c-a849-e1f480daf481 tempest-InstanceUsageAuditLogTestJSON-1635239008 tempest-InstanceUsageAuditLogTestJSON-1635239008-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:26.803601 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-72b63811-a466-4a4c-a849-e1f480daf481 tempest-InstanceUsageAuditLogTestJSON-1635239008 tempest-InstanceUsageAuditLogTestJSON-1635239008-project-admin] 10.222.0.62 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29 15:25:26" status: 200 len: 318 microversion: 2.1 time: 0.313849 Aug 29 15:25:26.812241 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 113/190] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 15:25:26 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29%2015%3A25%3A26 => generated 318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:26.818232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c3cc3e78-370f-4a20-afa1-729c18f9c45e tempest-InstanceUsageAuditLogTestJSON-1635239008 tempest-InstanceUsageAuditLogTestJSON-1635239008-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:26.841692 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c3cc3e78-370f-4a20-afa1-729c18f9c45e tempest-InstanceUsageAuditLogTestJSON-1635239008 tempest-InstanceUsageAuditLogTestJSON-1635239008-project-admin] 10.222.0.62 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.028024 Aug 29 15:25:26.842845 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 78/191] 10.222.0.62 () {58 vars in 1185 bytes} [Mon Aug 29 15:25:26 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:25:26.956904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d78ef633-cc38-4cb6-8317-9aa5103b8552 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:26.957745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d78ef633-cc38-4cb6-8317-9aa5103b8552 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:26.964494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d78ef633-cc38-4cb6-8317-9aa5103b8552 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:26.964981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d78ef633-cc38-4cb6-8317-9aa5103b8552 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:26.965694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d78ef633-cc38-4cb6-8317-9aa5103b8552 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:26.966543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d78ef633-cc38-4cb6-8317-9aa5103b8552 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:26.967140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d78ef633-cc38-4cb6-8317-9aa5103b8552 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:26.967549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d78ef633-cc38-4cb6-8317-9aa5103b8552 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:27.178260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d78ef633-cc38-4cb6-8317-9aa5103b8552 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:27.182263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:27.187391 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d78ef633-cc38-4cb6-8317-9aa5103b8552 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.234645 Aug 29 15:25:27.188492 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 114/192] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:26 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:27.325639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec2028cd-7c26-4e6c-b248-d946c2609993 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:27.326822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ec2028cd-7c26-4e6c-b248-d946c2609993 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:27.337208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec2028cd-7c26-4e6c-b248-d946c2609993 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:27.337775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec2028cd-7c26-4e6c-b248-d946c2609993 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:27.338342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec2028cd-7c26-4e6c-b248-d946c2609993 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:27.342276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec2028cd-7c26-4e6c-b248-d946c2609993 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:27.342757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec2028cd-7c26-4e6c-b248-d946c2609993 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:27.343434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec2028cd-7c26-4e6c-b248-d946c2609993 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:27.531470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ec2028cd-7c26-4e6c-b248-d946c2609993 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:27.540142 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ec2028cd-7c26-4e6c-b248-d946c2609993 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1469 microversion: 2.1 time: 0.218373 Aug 29 15:25:27.540944 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 79/193] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:27 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1469 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:28.003107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4e8b51b7-d2a1-41e5-9e1c-4bcae406b023 tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:28.003750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4e8b51b7-d2a1-41e5-9e1c-4bcae406b023 tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:28.009960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e8b51b7-d2a1-41e5-9e1c-4bcae406b023 tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:28.010916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e8b51b7-d2a1-41e5-9e1c-4bcae406b023 tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:28.011653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e8b51b7-d2a1-41e5-9e1c-4bcae406b023 tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:28.012812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e8b51b7-d2a1-41e5-9e1c-4bcae406b023 tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:28.013364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e8b51b7-d2a1-41e5-9e1c-4bcae406b023 tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:28.014196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e8b51b7-d2a1-41e5-9e1c-4bcae406b023 tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:28.082471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4e8b51b7-d2a1-41e5-9e1c-4bcae406b023 tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:25:28.210450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cb657e15-208a-4fc5-96f2-3a3a0242b9f8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:28.211170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cb657e15-208a-4fc5-96f2-3a3a0242b9f8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:28.224850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb657e15-208a-4fc5-96f2-3a3a0242b9f8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:28.225386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb657e15-208a-4fc5-96f2-3a3a0242b9f8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:28.229319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb657e15-208a-4fc5-96f2-3a3a0242b9f8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:28.232477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb657e15-208a-4fc5-96f2-3a3a0242b9f8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:28.234178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb657e15-208a-4fc5-96f2-3a3a0242b9f8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:28.236529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb657e15-208a-4fc5-96f2-3a3a0242b9f8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:28.271774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:28.401572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=12,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:28.447296 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4e8b51b7-d2a1-41e5-9e1c-4bcae406b023 tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] 10.222.0.62 "DELETE /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 204 len: 0 microversion: 2.1 time: 0.889971 Aug 29 15:25:28.453772 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 115/194] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:25:27 2022] DELETE /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 0 bytes in 894 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:25:28.461507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cb657e15-208a-4fc5-96f2-3a3a0242b9f8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:28.473374 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cb657e15-208a-4fc5-96f2-3a3a0242b9f8 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1337 microversion: 2.1 time: 0.267770 Aug 29 15:25:28.474340 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 80/195] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:28 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1337 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:28.480087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-06201c60-ce76-46a7-ab0d-cec48ba3f231 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:28.480700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-06201c60-ce76-46a7-ab0d-cec48ba3f231 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:28.486561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06201c60-ce76-46a7-ab0d-cec48ba3f231 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:28.487880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06201c60-ce76-46a7-ab0d-cec48ba3f231 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:28.488395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06201c60-ce76-46a7-ab0d-cec48ba3f231 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:28.489437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06201c60-ce76-46a7-ab0d-cec48ba3f231 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:28.490043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06201c60-ce76-46a7-ab0d-cec48ba3f231 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:28.490641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06201c60-ce76-46a7-ab0d-cec48ba3f231 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:28.658866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-06201c60-ce76-46a7-ab0d-cec48ba3f231 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:28.668419 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-06201c60-ce76-46a7-ab0d-cec48ba3f231 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1475 microversion: 2.1 time: 0.192844 Aug 29 15:25:28.669002 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 81/196] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:28 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1475 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:28.788968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-de1e8523-39a1-464c-9074-3c617de50da8 tempest-FlavorsV2NegativeTest-1615909897 tempest-FlavorsV2NegativeTest-1615909897-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:28.798087 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-de1e8523-39a1-464c-9074-3c617de50da8 tempest-FlavorsV2NegativeTest-1615909897 tempest-FlavorsV2NegativeTest-1615909897-project] 10.222.0.62 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.345805 Aug 29 15:25:28.819678 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 116/197] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:25:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:29.380816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a0af2f73-8a56-42da-a045-80d7af86ef8a tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Calling method '.version_select at 0x7fc43061d5e0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:29.382640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0af2f73-8a56-42da-a045-80d7af86ef8a tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:29.383114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0af2f73-8a56-42da-a045-80d7af86ef8a tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:29.383540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0af2f73-8a56-42da-a045-80d7af86ef8a tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:29.414870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0af2f73-8a56-42da-a045-80d7af86ef8a tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:29.415443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0af2f73-8a56-42da-a045-80d7af86ef8a tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:29.416051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0af2f73-8a56-42da-a045-80d7af86ef8a tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:29.428038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0af2f73-8a56-42da-a045-80d7af86ef8a tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:29.428508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0af2f73-8a56-42da-a045-80d7af86ef8a tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:29.428956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0af2f73-8a56-42da-a045-80d7af86ef8a tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:29.436378 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a0af2f73-8a56-42da-a045-80d7af86ef8a tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.276912 Aug 29 15:25:29.437316 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 82/198] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:29 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:29.495298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-00ebbd64-5c9e-4e8d-a1d8-148ff7a645d9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:29.495913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-00ebbd64-5c9e-4e8d-a1d8-148ff7a645d9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:29.503098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00ebbd64-5c9e-4e8d-a1d8-148ff7a645d9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:29.503834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00ebbd64-5c9e-4e8d-a1d8-148ff7a645d9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:29.504523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00ebbd64-5c9e-4e8d-a1d8-148ff7a645d9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:29.505333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00ebbd64-5c9e-4e8d-a1d8-148ff7a645d9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:29.505870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00ebbd64-5c9e-4e8d-a1d8-148ff7a645d9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:29.506512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00ebbd64-5c9e-4e8d-a1d8-148ff7a645d9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:29.655353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-00ebbd64-5c9e-4e8d-a1d8-148ff7a645d9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:29.666598 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-00ebbd64-5c9e-4e8d-a1d8-148ff7a645d9 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1487 microversion: 2.1 time: 0.174958 Aug 29 15:25:29.667400 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 83/199] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:29 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1487 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:25:29.721843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-04d3f842-11f3-4e9b-a7dd-5ae93b63869c tempest-HypervisorAdminNegativeUnderV252Test-1715510187 tempest-HypervisorAdminNegativeUnderV252Test-1715510187-project] Calling method '.version_select at 0x7fc4305a5700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:29.726006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-04d3f842-11f3-4e9b-a7dd-5ae93b63869c tempest-HypervisorAdminNegativeUnderV252Test-1715510187 tempest-HypervisorAdminNegativeUnderV252Test-1715510187-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'b5f85b86e4bf4efdbd6cd94b4d2e214f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c147851b154ec885d1b9d8078b1e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-04d3f842-11f3-4e9b-a7dd-5ae93b63869c tempest-HypervisorAdminNegativeUnderV252Test-1715510187 tempest-HypervisorAdminNegativeUnderV252Test-1715510187-project] Request method failure captured: Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-hypervisors/n-h1-839401-11/search HTTP/1.1 Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpncqiq3yGtR-2YWo6bG8Mv4jg_6QHFWAEYU_5qn4zN_27FEGCA-QXC3qtQtYnIWbtEgnWgfWnuJdA2lcXeMqjULJdm3SBixGg2fwMhAFf9T34HuKhbY0WyvGaa6Sf3l2wSyphMJ37LTt5DVnOGnv5WpPJP82FrIvM2liRQyiy3RIw Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 50c147851b154ec885d1b9d8078b1e49 Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1715510187 Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:29.728855 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:29.729997 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_50c147851b154ec885d1b9d8078b1e49", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/50c147851b154ec885d1b9d8078b1e49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/50c147851b154ec885d1b9d8078b1e49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/50c147851b154ec885d1b9d8078b1e49"}]}] Aug 29 15:25:29.729997 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1715510187 Aug 29 15:25:29.729997 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 50c147851b154ec885d1b9d8078b1e49 Aug 29 15:25:29.729997 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1715510187 Aug 29 15:25:29.729997 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1715510187-project Aug 29 15:25:29.729997 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:29.729997 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:29.729997 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b5f85b86e4bf4efdbd6cd94b4d2e214f Aug 29 15:25:29.729997 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1715510187-project Aug 29 15:25:29.729997 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:29.729997 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 29 15:25:29.729997 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'n-h1-839401-11'} Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:29.730645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 29 15:25:29.731598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:29.734584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-04d3f842-11f3-4e9b-a7dd-5ae93b63869c tempest-HypervisorAdminNegativeUnderV252Test-1715510187 tempest-HypervisorAdminNegativeUnderV252Test-1715510187-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:29.735711 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-04d3f842-11f3-4e9b-a7dd-5ae93b63869c tempest-HypervisorAdminNegativeUnderV252Test-1715510187 tempest-HypervisorAdminNegativeUnderV252Test-1715510187-project] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/n-h1-839401-11/search" status: 403 len: 117 microversion: 2.1 time: 0.290570 Aug 29 15:25:29.736488 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 117/200] 10.222.0.62 () {58 vars in 1212 bytes} [Mon Aug 29 15:25:29 2022] GET /compute/v2.1/os-hypervisors/n-h1-839401-11/search => generated 117 bytes in 293 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:25:29.741463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8e2ecd26-f1be-4169-8417-b83c50cb9ac0 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:29.742521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8e2ecd26-f1be-4169-8417-b83c50cb9ac0 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:29.750871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e2ecd26-f1be-4169-8417-b83c50cb9ac0 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:29.751695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e2ecd26-f1be-4169-8417-b83c50cb9ac0 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:29.752060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e2ecd26-f1be-4169-8417-b83c50cb9ac0 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:29.753308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e2ecd26-f1be-4169-8417-b83c50cb9ac0 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:29.753541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e2ecd26-f1be-4169-8417-b83c50cb9ac0 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:29.754031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e2ecd26-f1be-4169-8417-b83c50cb9ac0 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:29.791046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-597c3e08-35a5-4f93-8c37-304e4113170b tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Calling method '.version_select at 0x7fc43062e550>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:29.800698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-597c3e08-35a5-4f93-8c37-304e4113170b tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:29.801514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-597c3e08-35a5-4f93-8c37-304e4113170b tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:29.802412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-597c3e08-35a5-4f93-8c37-304e4113170b tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:29.803360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-597c3e08-35a5-4f93-8c37-304e4113170b tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:29.803965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-597c3e08-35a5-4f93-8c37-304e4113170b tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:29.804566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-597c3e08-35a5-4f93-8c37-304e4113170b tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:29.866313 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-597c3e08-35a5-4f93-8c37-304e4113170b tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.197387 Aug 29 15:25:29.867085 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 84/201] 10.222.0.62 () {58 vars in 1128 bytes} [Mon Aug 29 15:25:29 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:29.872315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-58faf96c-1db5-4233-a6bf-462fecfd543c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:29.873245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-58faf96c-1db5-4233-a6bf-462fecfd543c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:29.880385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58faf96c-1db5-4233-a6bf-462fecfd543c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:29.881182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58faf96c-1db5-4233-a6bf-462fecfd543c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:29.881883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58faf96c-1db5-4233-a6bf-462fecfd543c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:29.882887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58faf96c-1db5-4233-a6bf-462fecfd543c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:29.883591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58faf96c-1db5-4233-a6bf-462fecfd543c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:29.884336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58faf96c-1db5-4233-a6bf-462fecfd543c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:30.035309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-58faf96c-1db5-4233-a6bf-462fecfd543c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:30.044165 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-58faf96c-1db5-4233-a6bf-462fecfd543c tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1475 microversion: 2.1 time: 0.175623 Aug 29 15:25:30.045795 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8e2ecd26-f1be-4169-8417-b83c50cb9ac0 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1640 microversion: 2.1 time: 0.306777 Aug 29 15:25:30.046557 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 85/202] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:29 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1475 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:30.047559 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 118/203] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:29 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1640 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:30.063746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dd8d9142-c092-4b90-8ae4-f4b0c6fea949 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Calling method '.version_select at 0x7fc43061d1f0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:30.064533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f298344-229f-4c5a-af0a-e9c32fd164ed tempest-FlavorsV2NegativeTest-1615909897 tempest-FlavorsV2NegativeTest-1615909897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1460565562", "imageRef": "a1174248-4732-4187-9bba-2dea8cdcd879", "flavorRef": "452"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:30.065525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd8d9142-c092-4b90-8ae4-f4b0c6fea949 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:30.066004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd8d9142-c092-4b90-8ae4-f4b0c6fea949 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:30.066444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd8d9142-c092-4b90-8ae4-f4b0c6fea949 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:30.089711 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-dd8d9142-c092-4b90-8ae4-f4b0c6fea949 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dd8d9142-c092-4b90-8ae4-f4b0c6fea949 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Request method failure captured: Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpp-BokjNjISdzuHu4aP2ixGzCvnTC1F-t8HmLx8IsyF8MzJR3lCmCc5-1LjVcniZ8u12CVUBmEkJGSRI9PtOnK8OOWf2_8vKrqmHIg-p3PjATq_vDhSAiv-MvKCbzLzmoRlSRttGcXEPuOQBSRzaLLJqBgVH3Fwm3gsI_AJqFK_Gw Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: f7a8237ddb2448efb81171b30cc4fd68 Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1430330788 Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:25:30.091584 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:25:30.092712 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f7a8237ddb2448efb81171b30cc4fd68", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f7a8237ddb2448efb81171b30cc4fd68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7a8237ddb2448efb81171b30cc4fd68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7a8237ddb2448efb81171b30cc4fd68"}]}] Aug 29 15:25:30.092712 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1430330788 Aug 29 15:25:30.092712 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: f7a8237ddb2448efb81171b30cc4fd68 Aug 29 15:25:30.092712 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1430330788 Aug 29 15:25:30.092712 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin Aug 29 15:25:30.092712 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:30.092712 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:30.092712 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 07d457039e4245e98398820b79788d93 Aug 29 15:25:30.092712 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin Aug 29 15:25:30.092712 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:25:30.092712 n-d-839401-11 devstack@n-api.service[122360]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 15:25:30.092712 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.093608 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.094672 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.094672 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:30.094672 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:30.094672 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 15:25:30.094672 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.094672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dd8d9142-c092-4b90-8ae4-f4b0c6fea949 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.094672 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dd8d9142-c092-4b90-8ae4-f4b0c6fea949 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.045011 Aug 29 15:25:30.094672 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 86/204] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 15:25:30 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:30.151253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-9f298344-229f-4c5a-af0a-e9c32fd164ed tempest-FlavorsV2NegativeTest-1615909897 tempest-FlavorsV2NegativeTest-1615909897-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:25:30.319404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-073eec13-e31b-4b6c-9bd5-f60fc810d7fd tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Calling method '.version_select at 0x7fc4305a0a60>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:30.323332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-073eec13-e31b-4b6c-9bd5-f60fc810d7fd tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '00b7c2f56ee842fcbf2d7ccd05f7d30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaa40156fae4d8f9714898654faa9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-073eec13-e31b-4b6c-9bd5-f60fc810d7fd tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Request method failure captured: Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpn8D0rVh13EmC6axOXPbHLouBF6yMjHEbmpr65opLxCrVCGfxZohZ1FQjX5QdavIoLnsoHloBHfcusw7prmQEiqvb0-VNqC5pkZDuhd-vh_plC0bD-3cYm78k1QkZu9aXNLfWwGex8WTqyUlR7rwveUpqWnql3SJ6GYOdcHzwbm8g Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: eaaa40156fae4d8f9714898654faa9da Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:25:30.327951 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:25:30.329317 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaaa40156fae4d8f9714898654faa9da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaaa40156fae4d8f9714898654faa9da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaaa40156fae4d8f9714898654faa9da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaaa40156fae4d8f9714898654faa9da"}]}] Aug 29 15:25:30.329317 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.329317 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: eaaa40156fae4d8f9714898654faa9da Aug 29 15:25:30.329317 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.329317 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-HostsAdminNegativeTestJSON-105919838-project Aug 29 15:25:30.329317 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:30.329317 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:30.329317 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 00b7c2f56ee842fcbf2d7ccd05f7d30b Aug 29 15:25:30.329317 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-HostsAdminNegativeTestJSON-105919838-project Aug 29 15:25:30.329317 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:25:30.329317 n-d-839401-11 devstack@n-api.service[122360]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 29 15:25:30.329317 n-d-839401-11 devstack@n-api.service[122360]: action_args: {} Aug 29 15:25:30.329317 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:30.330116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 29 15:25:30.331114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.332065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-073eec13-e31b-4b6c-9bd5-f60fc810d7fd tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.332065 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-073eec13-e31b-4b6c-9bd5-f60fc810d7fd tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] 10.222.0.62 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.234050 Aug 29 15:25:30.332065 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 87/205] 10.222.0.62 () {58 vars in 1128 bytes} [Mon Aug 29 15:25:30 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 235 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:30.347990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e5be755d-48ef-43e5-adb2-49b53c3b8b28 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:30.348527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e5be755d-48ef-43e5-adb2-49b53c3b8b28 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:30.356157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5be755d-48ef-43e5-adb2-49b53c3b8b28 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:30.356704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5be755d-48ef-43e5-adb2-49b53c3b8b28 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:30.357415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5be755d-48ef-43e5-adb2-49b53c3b8b28 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:30.358314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5be755d-48ef-43e5-adb2-49b53c3b8b28 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:30.358935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5be755d-48ef-43e5-adb2-49b53c3b8b28 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:30.359520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5be755d-48ef-43e5-adb2-49b53c3b8b28 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:30.397383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e5be755d-48ef-43e5-adb2-49b53c3b8b28 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:25:30.423720 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-9f298344-229f-4c5a-af0a-e9c32fd164ed tempest-FlavorsV2NegativeTest-1615909897 tempest-FlavorsV2NegativeTest-1615909897-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f298344-229f-4c5a-af0a-e9c32fd164ed tempest-FlavorsV2NegativeTest-1615909897 tempest-FlavorsV2NegativeTest-1615909897-project] Request method failure captured: Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 143 Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpokXSP24xd11DeIpmhrCyP6nMAeEn5XfDAg3Tqu0NAHCU4yqlX9zpXAId9Z7s3k6g0rOnTUiJRM0BPpparrmZ7YD0zpxBix0OULGW4gBwAebJG2E8kVIBibqh3x5W-HVYXjhyhSjstP2VA9zlSbCAtfxdTBY1zZjb-hq7Kj16nLfU Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 06573ada1ced4ff1bd7fe4cd89c459da Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-FlavorsV2NegativeTest-1615909897 Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:30.428133 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:30.429349 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_06573ada1ced4ff1bd7fe4cd89c459da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/06573ada1ced4ff1bd7fe4cd89c459da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/06573ada1ced4ff1bd7fe4cd89c459da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/06573ada1ced4ff1bd7fe4cd89c459da"}]}] Aug 29 15:25:30.429349 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-FlavorsV2NegativeTest-1615909897 Aug 29 15:25:30.429349 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 06573ada1ced4ff1bd7fe4cd89c459da Aug 29 15:25:30.429349 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1615909897 Aug 29 15:25:30.429349 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-FlavorsV2NegativeTest-1615909897-project Aug 29 15:25:30.429349 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:30.429349 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:30.429349 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 96eb3e493dfa48a281d4a3e0f4b72b88 Aug 29 15:25:30.429349 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-FlavorsV2NegativeTest-1615909897-project Aug 29 15:25:30.429349 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:25:30.429349 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1460565562", "imageRef": "a1174248-4732-4187-9bba-2dea8cdcd879", "flavorRef": "452"}} Aug 29 15:25:30.429349 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: exception: Flavor's memory is too small for requested image. Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1460565562', 'imageRef': 'a1174248-4732-4187-9bba-2dea8cdcd879', 'flavorRef': '452'}}} Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.430001 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.431058 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.432156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.432156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.432156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:30.432156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:30.432156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 29 15:25:30.432156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.432156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f298344-229f-4c5a-af0a-e9c32fd164ed tempest-FlavorsV2NegativeTest-1615909897 tempest-FlavorsV2NegativeTest-1615909897-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.432156 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9f298344-229f-4c5a-af0a-e9c32fd164ed tempest-FlavorsV2NegativeTest-1615909897 tempest-FlavorsV2NegativeTest-1615909897-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.379408 Aug 29 15:25:30.436251 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 119/206] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:25:30 2022] POST /compute/v2.1/servers => generated 93 bytes in 388 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:25:30.443113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-654a914f-f1af-4f22-aed9-ce8ca97ed879 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Calling method '.version_select at 0x7fc4304e7310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:30.443615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-654a914f-f1af-4f22-aed9-ce8ca97ed879 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:30.444113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-654a914f-f1af-4f22-aed9-ce8ca97ed879 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:30.444517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-654a914f-f1af-4f22-aed9-ce8ca97ed879 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:30.482104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-654a914f-f1af-4f22-aed9-ce8ca97ed879 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:30.482591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-654a914f-f1af-4f22-aed9-ce8ca97ed879 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:30.483020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-654a914f-f1af-4f22-aed9-ce8ca97ed879 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:30.493843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-654a914f-f1af-4f22-aed9-ce8ca97ed879 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:30.494357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-654a914f-f1af-4f22-aed9-ce8ca97ed879 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:30.494784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-654a914f-f1af-4f22-aed9-ce8ca97ed879 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:30.501420 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-654a914f-f1af-4f22-aed9-ce8ca97ed879 tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.063973 Aug 29 15:25:30.502331 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 120/207] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:30 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:30.507003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3f77eec3-704e-487a-b17c-e8db381d0419 tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Calling method '.version_select at 0x7fc430492550>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:30.508846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3f77eec3-704e-487a-b17c-e8db381d0419 tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '00b7c2f56ee842fcbf2d7ccd05f7d30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaa40156fae4d8f9714898654faa9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3f77eec3-704e-487a-b17c-e8db381d0419 tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Request method failure captured: Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-hosts/n-d-839401-11/reboot HTTP/1.1 Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpn8D0rVh13EmC6axOXPbHLouBF6yMjHEbmpr65opLxCrVCGfxZohZ1FQjX5QdavIoLnsoHloBHfcusw7prmQEiqvb0-VNqC5pkZDuhd-vh_plC0bD-3cYm78k1QkZu9aXNLfWwGex8WTqyUlR7rwveUpqWnql3SJ6GYOdcHzwbm8g Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: eaaa40156fae4d8f9714898654faa9da Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:30.511409 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:30.512640 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaaa40156fae4d8f9714898654faa9da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaaa40156fae4d8f9714898654faa9da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaaa40156fae4d8f9714898654faa9da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaaa40156fae4d8f9714898654faa9da"}]}] Aug 29 15:25:30.512640 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.512640 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: eaaa40156fae4d8f9714898654faa9da Aug 29 15:25:30.512640 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.512640 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HostsAdminNegativeTestJSON-105919838-project Aug 29 15:25:30.512640 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:30.512640 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:30.512640 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 00b7c2f56ee842fcbf2d7ccd05f7d30b Aug 29 15:25:30.512640 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HostsAdminNegativeTestJSON-105919838-project Aug 29 15:25:30.512640 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:30.512640 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 29 15:25:30.512640 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'n-d-839401-11'} Aug 29 15:25:30.512640 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:30.513446 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 29 15:25:30.514430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.516884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3f77eec3-704e-487a-b17c-e8db381d0419 tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.517933 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3f77eec3-704e-487a-b17c-e8db381d0419 tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] 10.222.0.62 "GET /compute/v2.1/os-hosts/n-d-839401-11/reboot" status: 403 len: 111 microversion: 2.1 time: 0.014597 Aug 29 15:25:30.518649 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 121/208] 10.222.0.62 () {58 vars in 1191 bytes} [Mon Aug 29 15:25:30 2022] GET /compute/v2.1/os-hosts/n-d-839401-11/reboot => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:30.524677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-78a79853-c77e-48ab-b78a-5dc7e97a1600 tempest-HypervisorAdminNegativeUnderV252Test-1715510187 tempest-HypervisorAdminNegativeUnderV252Test-1715510187-project] Calling method '.version_select at 0x7fc4304f8dc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:30.527090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-78a79853-c77e-48ab-b78a-5dc7e97a1600 tempest-HypervisorAdminNegativeUnderV252Test-1715510187 tempest-HypervisorAdminNegativeUnderV252Test-1715510187-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'b5f85b86e4bf4efdbd6cd94b4d2e214f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c147851b154ec885d1b9d8078b1e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-78a79853-c77e-48ab-b78a-5dc7e97a1600 tempest-HypervisorAdminNegativeUnderV252Test-1715510187 tempest-HypervisorAdminNegativeUnderV252Test-1715510187-project] Request method failure captured: Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpncqiq3yGtR-2YWo6bG8Mv4jg_6QHFWAEYU_5qn4zN_27FEGCA-QXC3qtQtYnIWbtEgnWgfWnuJdA2lcXeMqjULJdm3SBixGg2fwMhAFf9T34HuKhbY0WyvGaa6Sf3l2wSyphMJ37LTt5DVnOGnv5WpPJP82FrIvM2liRQyiy3RIw Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 50c147851b154ec885d1b9d8078b1e49 Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1715510187 Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:30.529809 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:30.530943 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_50c147851b154ec885d1b9d8078b1e49", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/50c147851b154ec885d1b9d8078b1e49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/50c147851b154ec885d1b9d8078b1e49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/50c147851b154ec885d1b9d8078b1e49"}]}] Aug 29 15:25:30.530943 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1715510187 Aug 29 15:25:30.530943 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 50c147851b154ec885d1b9d8078b1e49 Aug 29 15:25:30.530943 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1715510187 Aug 29 15:25:30.530943 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1715510187-project Aug 29 15:25:30.530943 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:30.530943 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:30.530943 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b5f85b86e4bf4efdbd6cd94b4d2e214f Aug 29 15:25:30.530943 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1715510187-project Aug 29 15:25:30.530943 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:30.530943 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 29 15:25:30.530943 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '1'} Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:30.531590 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 29 15:25:30.532616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.534456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-78a79853-c77e-48ab-b78a-5dc7e97a1600 tempest-HypervisorAdminNegativeUnderV252Test-1715510187 tempest-HypervisorAdminNegativeUnderV252Test-1715510187-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.537840 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-78a79853-c77e-48ab-b78a-5dc7e97a1600 tempest-HypervisorAdminNegativeUnderV252Test-1715510187 tempest-HypervisorAdminNegativeUnderV252Test-1715510187-project] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.018124 Aug 29 15:25:30.538574 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 122/209] 10.222.0.62 () {58 vars in 1176 bytes} [Mon Aug 29 15:25:30 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:30.545906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-569b77a9-a2d8-4924-ad56-0e8ba740dbe9 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Calling method '.version_select at 0x7fc4305af280>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:30.561565 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-569b77a9-a2d8-4924-ad56-0e8ba740dbe9 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-569b77a9-a2d8-4924-ad56-0e8ba740dbe9 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Request method failure captured: Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNppy1jpMQJ3GF4bIuQjYyGHUeVLt-zoH1OxkIfFwe59lOJxO4bMBghuahieUrsBRkyycCqekRxOfnM_T5zCdrHh5FamFyYuNSREk7faR1i2-xFt3VoxOUP6gbXFCwRi99eVaitqR774Ajpw2-QcDyh5Ccsah4oekzpvwLx4_Qe3HHc Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 31b0928fe3e4452c83521a5405a24696 Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:25:30.570650 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:25:30.571870 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31b0928fe3e4452c83521a5405a24696", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31b0928fe3e4452c83521a5405a24696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31b0928fe3e4452c83521a5405a24696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31b0928fe3e4452c83521a5405a24696"}]}] Aug 29 15:25:30.571870 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.571870 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 31b0928fe3e4452c83521a5405a24696 Aug 29 15:25:30.571870 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.571870 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HostsAdminNegativeTestJSON-1121338273-project-admin Aug 29 15:25:30.571870 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:30.571870 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:30.571870 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e687126ca24c4e6f9b06fb0e25238894 Aug 29 15:25:30.571870 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1121338273-project-admin Aug 29 15:25:30.571870 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:30.571870 n-d-839401-11 devstack@n-api.service[122361]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.571870 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'nonexistent_hostname'} Aug 29 15:25:30.571870 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:30.572575 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 29 15:25:30.574033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:30.575004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.575004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.575004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.575004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.575004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.575004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.575004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.575004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:30.575004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:30.575004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.575004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.575004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-569b77a9-a2d8-4924-ad56-0e8ba740dbe9 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.575004 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-569b77a9-a2d8-4924-ad56-0e8ba740dbe9 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.032631 Aug 29 15:25:30.575004 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 123/210] 10.222.0.62 () {58 vars in 1212 bytes} [Mon Aug 29 15:25:30 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:25:30.584404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e12e9649-2fd3-43e9-9a66-6ae78d0d9f7b tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Calling method '.version_select at 0x7fc4304e7af0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:30.593831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e12e9649-2fd3-43e9-9a66-6ae78d0d9f7b tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:30.594468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e12e9649-2fd3-43e9-9a66-6ae78d0d9f7b tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:30.594865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e12e9649-2fd3-43e9-9a66-6ae78d0d9f7b tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:30.621143 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e5be755d-48ef-43e5-adb2-49b53c3b8b28 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "DELETE /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 204 len: 0 microversion: 2.1 time: 0.284526 Aug 29 15:25:30.622393 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 88/211] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:25:30 2022] DELETE /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:25:30.629020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-df035b33-d8f8-4541-aa2f-6816aabe2525 tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Calling method '.version_select at 0x7fc43054caf0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:30.631460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-df035b33-d8f8-4541-aa2f-6816aabe2525 tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '00b7c2f56ee842fcbf2d7ccd05f7d30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaa40156fae4d8f9714898654faa9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-df035b33-d8f8-4541-aa2f-6816aabe2525 tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Request method failure captured: Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/os-hosts/n-d-839401-11 HTTP/1.1 Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpn8D0rVh13EmC6axOXPbHLouBF6yMjHEbmpr65opLxCrVCGfxZohZ1FQjX5QdavIoLnsoHloBHfcusw7prmQEiqvb0-VNqC5pkZDuhd-vh_plC0bD-3cYm78k1QkZu9aXNLfWwGex8WTqyUlR7rwveUpqWnql3SJ6GYOdcHzwbm8g Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: eaaa40156fae4d8f9714898654faa9da Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:25:30.633510 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:25:30.634708 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaaa40156fae4d8f9714898654faa9da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaaa40156fae4d8f9714898654faa9da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaaa40156fae4d8f9714898654faa9da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaaa40156fae4d8f9714898654faa9da"}]}] Aug 29 15:25:30.634708 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.634708 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: eaaa40156fae4d8f9714898654faa9da Aug 29 15:25:30.634708 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.634708 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-HostsAdminNegativeTestJSON-105919838-project Aug 29 15:25:30.634708 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:30.634708 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:30.634708 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 00b7c2f56ee842fcbf2d7ccd05f7d30b Aug 29 15:25:30.634708 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-HostsAdminNegativeTestJSON-105919838-project Aug 29 15:25:30.634708 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:25:30.634708 n-d-839401-11 devstack@n-api.service[122360]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 29 15:25:30.634708 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'n-d-839401-11'} Aug 29 15:25:30.634708 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:30.635408 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 29 15:25:30.636356 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.638744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-df035b33-d8f8-4541-aa2f-6816aabe2525 tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.639871 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-df035b33-d8f8-4541-aa2f-6816aabe2525 tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] 10.222.0.62 "GET /compute/v2.1/os-hosts/n-d-839401-11" status: 403 len: 109 microversion: 2.1 time: 0.015486 Aug 29 15:25:30.640689 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 89/212] 10.222.0.62 () {58 vars in 1170 bytes} [Mon Aug 29 15:25:30 2022] GET /compute/v2.1/os-hosts/n-d-839401-11 => generated 109 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:30.645554 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-e12e9649-2fd3-43e9-9a66-6ae78d0d9f7b tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] HTTP exception thrown: No hypervisor matching 'fe4f1210-4cbc-4071-ae21-54caa4a7db35' could be found. Aug 29 15:25:30.648422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-53f8efff-5933-4cb6-945e-96aaa609b484 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:30.649326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-53f8efff-5933-4cb6-945e-96aaa609b484 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e12e9649-2fd3-43e9-9a66-6ae78d0d9f7b tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Request method failure captured: Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-hypervisors/fe4f1210-4cbc-4071-ae21-54caa4a7db35/servers HTTP/1.1 Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpp-BokjNjISdzuHu4aP2ixGzCvnTC1F-t8HmLx8IsyF8MzJR3lCmCc5-1LjVcniZ8u12CVUBmEkJGSRI9PtOnK8OOWf2_8vKrqmHIg-p3PjATq_vDhSAiv-MvKCbzLzmoRlSRttGcXEPuOQBSRzaLLJqBgVH3Fwm3gsI_AJqFK_Gw Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: f7a8237ddb2448efb81171b30cc4fd68 Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1430330788 Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:25:30.651705 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:25:30.652896 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f7a8237ddb2448efb81171b30cc4fd68", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f7a8237ddb2448efb81171b30cc4fd68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7a8237ddb2448efb81171b30cc4fd68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7a8237ddb2448efb81171b30cc4fd68"}]}] Aug 29 15:25:30.652896 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1430330788 Aug 29 15:25:30.652896 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: f7a8237ddb2448efb81171b30cc4fd68 Aug 29 15:25:30.652896 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1430330788 Aug 29 15:25:30.652896 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin Aug 29 15:25:30.652896 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:30.652896 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:30.652896 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 07d457039e4245e98398820b79788d93 Aug 29 15:25:30.652896 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin Aug 29 15:25:30.652896 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:30.652896 n-d-839401-11 devstack@n-api.service[122361]: exception: No hypervisor matching 'fe4f1210-4cbc-4071-ae21-54caa4a7db35' could be found. Aug 29 15:25:30.652896 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'fe4f1210-4cbc-4071-ae21-54caa4a7db35'} Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'fe4f1210-4cbc-4071-ae21-54caa4a7db35' could be found. Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.653967 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.660072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.660072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.660072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:30.660072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:30.660072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'fe4f1210-4cbc-4071-ae21-54caa4a7db35' could be found. Aug 29 15:25:30.660072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.660072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e12e9649-2fd3-43e9-9a66-6ae78d0d9f7b tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] Returning 404 to user: No hypervisor matching 'fe4f1210-4cbc-4071-ae21-54caa4a7db35' could be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.660072 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e12e9649-2fd3-43e9-9a66-6ae78d0d9f7b tempest-HypervisorAdminNegativeUnderV252Test-1430330788 tempest-HypervisorAdminNegativeUnderV252Test-1430330788-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/fe4f1210-4cbc-4071-ae21-54caa4a7db35/servers" status: 404 len: 123 microversion: 2.1 time: 0.077594 Aug 29 15:25:30.660072 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 124/213] 10.222.0.62 () {58 vars in 1281 bytes} [Mon Aug 29 15:25:30 2022] GET /compute/v2.1/os-hypervisors/fe4f1210-4cbc-4071-ae21-54caa4a7db35/servers => generated 123 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:30.663003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53f8efff-5933-4cb6-945e-96aaa609b484 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:30.663551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53f8efff-5933-4cb6-945e-96aaa609b484 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:30.664402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53f8efff-5933-4cb6-945e-96aaa609b484 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:30.665471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53f8efff-5933-4cb6-945e-96aaa609b484 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:30.666905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53f8efff-5933-4cb6-945e-96aaa609b484 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:30.667390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53f8efff-5933-4cb6-945e-96aaa609b484 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:30.671746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9afbb98d-136f-4570-9a39-c28a5205bad8 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Calling method '.version_select at 0x7fc4304f8280>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:30.687145 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-9afbb98d-136f-4570-9a39-c28a5205bad8 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9afbb98d-136f-4570-9a39-c28a5205bad8 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Request method failure captured: Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNppy1jpMQJ3GF4bIuQjYyGHUeVLt-zoH1OxkIfFwe59lOJxO4bMBghuahieUrsBRkyycCqekRxOfnM_T5zCdrHh5FamFyYuNSREk7faR1i2-xFt3VoxOUP6gbXFCwRi99eVaitqR774Ajpw2-QcDyh5Ccsah4oekzpvwLx4_Qe3HHc Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 31b0928fe3e4452c83521a5405a24696 Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:25:30.690937 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:25:30.692078 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31b0928fe3e4452c83521a5405a24696", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31b0928fe3e4452c83521a5405a24696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31b0928fe3e4452c83521a5405a24696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31b0928fe3e4452c83521a5405a24696"}]}] Aug 29 15:25:30.692078 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.692078 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 31b0928fe3e4452c83521a5405a24696 Aug 29 15:25:30.692078 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.692078 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HostsAdminNegativeTestJSON-1121338273-project-admin Aug 29 15:25:30.692078 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:30.692078 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:30.692078 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e687126ca24c4e6f9b06fb0e25238894 Aug 29 15:25:30.692078 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1121338273-project-admin Aug 29 15:25:30.692078 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:30.692078 n-d-839401-11 devstack@n-api.service[122361]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.692078 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'nonexistent_hostname'} Aug 29 15:25:30.692078 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.692867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.693952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.698609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9afbb98d-136f-4570-9a39-c28a5205bad8 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.700424 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9afbb98d-136f-4570-9a39-c28a5205bad8 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.045437 Aug 29 15:25:30.701396 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 125/214] 10.222.0.62 () {58 vars in 1191 bytes} [Mon Aug 29 15:25:30 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:25:30.711369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb8d01ac-db9b-4df1-bb1a-c1a78ffc5f9f tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Calling method '.version_select at 0x7fc4304e7ca0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:30.713772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bb8d01ac-db9b-4df1-bb1a-c1a78ffc5f9f tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '00b7c2f56ee842fcbf2d7ccd05f7d30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaa40156fae4d8f9714898654faa9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb8d01ac-db9b-4df1-bb1a-c1a78ffc5f9f tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Request method failure captured: Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-hosts/n-d-839401-11/shutdown HTTP/1.1 Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpn8D0rVh13EmC6axOXPbHLouBF6yMjHEbmpr65opLxCrVCGfxZohZ1FQjX5QdavIoLnsoHloBHfcusw7prmQEiqvb0-VNqC5pkZDuhd-vh_plC0bD-3cYm78k1QkZu9aXNLfWwGex8WTqyUlR7rwveUpqWnql3SJ6GYOdcHzwbm8g Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: eaaa40156fae4d8f9714898654faa9da Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:30.719189 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:30.720401 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaaa40156fae4d8f9714898654faa9da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaaa40156fae4d8f9714898654faa9da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaaa40156fae4d8f9714898654faa9da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaaa40156fae4d8f9714898654faa9da"}]}] Aug 29 15:25:30.720401 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.720401 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: eaaa40156fae4d8f9714898654faa9da Aug 29 15:25:30.720401 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.720401 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HostsAdminNegativeTestJSON-105919838-project Aug 29 15:25:30.720401 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:30.720401 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:30.720401 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 00b7c2f56ee842fcbf2d7ccd05f7d30b Aug 29 15:25:30.720401 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HostsAdminNegativeTestJSON-105919838-project Aug 29 15:25:30.720401 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:30.720401 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 29 15:25:30.720401 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'n-d-839401-11'} Aug 29 15:25:30.720401 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:30.721068 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 29 15:25:30.722587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.730745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb8d01ac-db9b-4df1-bb1a-c1a78ffc5f9f tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.731606 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bb8d01ac-db9b-4df1-bb1a-c1a78ffc5f9f tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] 10.222.0.62 "GET /compute/v2.1/os-hosts/n-d-839401-11/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.024052 Aug 29 15:25:30.736436 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 126/215] 10.222.0.62 () {58 vars in 1197 bytes} [Mon Aug 29 15:25:30 2022] GET /compute/v2.1/os-hosts/n-d-839401-11/shutdown => generated 113 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:30.749356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dd229455-2991-4eb1-aabb-f661ca84cb5e tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Calling method '.version_select at 0x7fc4304ecaf0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:30.770385 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-dd229455-2991-4eb1-aabb-f661ca84cb5e tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dd229455-2991-4eb1-aabb-f661ca84cb5e tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Request method failure captured: Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNppy1jpMQJ3GF4bIuQjYyGHUeVLt-zoH1OxkIfFwe59lOJxO4bMBghuahieUrsBRkyycCqekRxOfnM_T5zCdrHh5FamFyYuNSREk7faR1i2-xFt3VoxOUP6gbXFCwRi99eVaitqR774Ajpw2-QcDyh5Ccsah4oekzpvwLx4_Qe3HHc Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 31b0928fe3e4452c83521a5405a24696 Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:25:30.771997 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:25:30.773172 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31b0928fe3e4452c83521a5405a24696", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31b0928fe3e4452c83521a5405a24696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31b0928fe3e4452c83521a5405a24696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31b0928fe3e4452c83521a5405a24696"}]}] Aug 29 15:25:30.773172 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.773172 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 31b0928fe3e4452c83521a5405a24696 Aug 29 15:25:30.773172 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.773172 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HostsAdminNegativeTestJSON-1121338273-project-admin Aug 29 15:25:30.773172 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:30.773172 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:30.773172 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e687126ca24c4e6f9b06fb0e25238894 Aug 29 15:25:30.773172 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1121338273-project-admin Aug 29 15:25:30.773172 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:30.773172 n-d-839401-11 devstack@n-api.service[122361]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.773172 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'nonexistent_hostname'} Aug 29 15:25:30.773172 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:30.774219 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 29 15:25:30.775242 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:30.776212 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.776212 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.776212 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.776212 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.776212 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.776212 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.776212 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.776212 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:30.776212 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:30.776212 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.776212 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.776212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dd229455-2991-4eb1-aabb-f661ca84cb5e tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.776212 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dd229455-2991-4eb1-aabb-f661ca84cb5e tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.035991 Aug 29 15:25:30.777104 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 127/216] 10.222.0.62 () {58 vars in 1218 bytes} [Mon Aug 29 15:25:30 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:25:30.786442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e9ad7b4-2d15-4dad-975b-549dc6884ae6 tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Calling method '.version_select at 0x7fc4304e78b0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:30.788287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9e9ad7b4-2d15-4dad-975b-549dc6884ae6 tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '00b7c2f56ee842fcbf2d7ccd05f7d30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaa40156fae4d8f9714898654faa9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e9ad7b4-2d15-4dad-975b-549dc6884ae6 tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Request method failure captured: Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-hosts/n-d-839401-11/startup HTTP/1.1 Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpn8D0rVh13EmC6axOXPbHLouBF6yMjHEbmpr65opLxCrVCGfxZohZ1FQjX5QdavIoLnsoHloBHfcusw7prmQEiqvb0-VNqC5pkZDuhd-vh_plC0bD-3cYm78k1QkZu9aXNLfWwGex8WTqyUlR7rwveUpqWnql3SJ6GYOdcHzwbm8g Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: eaaa40156fae4d8f9714898654faa9da Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:30.789871 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:30.791022 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaaa40156fae4d8f9714898654faa9da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaaa40156fae4d8f9714898654faa9da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaaa40156fae4d8f9714898654faa9da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaaa40156fae4d8f9714898654faa9da"}]}] Aug 29 15:25:30.791022 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.791022 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: eaaa40156fae4d8f9714898654faa9da Aug 29 15:25:30.791022 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.791022 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HostsAdminNegativeTestJSON-105919838-project Aug 29 15:25:30.791022 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:30.791022 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:30.791022 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 00b7c2f56ee842fcbf2d7ccd05f7d30b Aug 29 15:25:30.791022 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HostsAdminNegativeTestJSON-105919838-project Aug 29 15:25:30.791022 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:30.791022 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 29 15:25:30.791022 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'n-d-839401-11'} Aug 29 15:25:30.791022 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:30.791984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 29 15:25:30.795086 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.796435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e9ad7b4-2d15-4dad-975b-549dc6884ae6 tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.796435 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9e9ad7b4-2d15-4dad-975b-549dc6884ae6 tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] 10.222.0.62 "GET /compute/v2.1/os-hosts/n-d-839401-11/startup" status: 403 len: 110 microversion: 2.1 time: 0.008712 Aug 29 15:25:30.797309 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 128/217] 10.222.0.62 () {58 vars in 1194 bytes} [Mon Aug 29 15:25:30 2022] GET /compute/v2.1/os-hosts/n-d-839401-11/startup => generated 110 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:25:30.801955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-46d8f6d0-1db4-4e66-97a9-acfbeea2e32d tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Calling method '.version_select at 0x7fc4304f8a60>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:30.824533 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-46d8f6d0-1db4-4e66-97a9-acfbeea2e32d tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-46d8f6d0-1db4-4e66-97a9-acfbeea2e32d tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Request method failure captured: Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNppy1jpMQJ3GF4bIuQjYyGHUeVLt-zoH1OxkIfFwe59lOJxO4bMBghuahieUrsBRkyycCqekRxOfnM_T5zCdrHh5FamFyYuNSREk7faR1i2-xFt3VoxOUP6gbXFCwRi99eVaitqR774Ajpw2-QcDyh5Ccsah4oekzpvwLx4_Qe3HHc Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 31b0928fe3e4452c83521a5405a24696 Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:25:30.827134 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:25:30.828472 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31b0928fe3e4452c83521a5405a24696", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31b0928fe3e4452c83521a5405a24696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31b0928fe3e4452c83521a5405a24696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31b0928fe3e4452c83521a5405a24696"}]}] Aug 29 15:25:30.828472 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.828472 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 31b0928fe3e4452c83521a5405a24696 Aug 29 15:25:30.828472 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.828472 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HostsAdminNegativeTestJSON-1121338273-project-admin Aug 29 15:25:30.828472 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:30.828472 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:30.828472 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e687126ca24c4e6f9b06fb0e25238894 Aug 29 15:25:30.828472 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1121338273-project-admin Aug 29 15:25:30.828472 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:30.828472 n-d-839401-11 devstack@n-api.service[122361]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.828472 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'nonexistent_hostname'} Aug 29 15:25:30.828472 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:30.829329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 29 15:25:30.830739 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:30.832298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.832298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.832298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.832298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.832298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.832298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.832298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.832298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:30.832298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:30.832298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.832298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.832298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-46d8f6d0-1db4-4e66-97a9-acfbeea2e32d tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.832298 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-46d8f6d0-1db4-4e66-97a9-acfbeea2e32d tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.030120 Aug 29 15:25:30.833611 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 129/218] 10.222.0.62 () {58 vars in 1215 bytes} [Mon Aug 29 15:25:30 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:25:30.848383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-76a95560-089d-4bbd-8caf-02602c2fc779 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Action: 'update', calling method: .version_select at 0x7fc4304e70d0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-76a95560-089d-4bbd-8caf-02602c2fc779 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Request method failure captured: Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: request: PUT /compute/v2.1/os-hosts/n-d-839401-11 HTTP/1.1 Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 51 Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNppy1jpMQJ3GF4bIuQjYyGHUeVLt-zoH1OxkIfFwe59lOJxO4bMBghuahieUrsBRkyycCqekRxOfnM_T5zCdrHh5FamFyYuNSREk7faR1i2-xFt3VoxOUP6gbXFCwRi99eVaitqR774Ajpw2-QcDyh5Ccsah4oekzpvwLx4_Qe3HHc Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 31b0928fe3e4452c83521a5405a24696 Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:25:30.852463 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:25:30.854303 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31b0928fe3e4452c83521a5405a24696", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31b0928fe3e4452c83521a5405a24696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31b0928fe3e4452c83521a5405a24696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31b0928fe3e4452c83521a5405a24696"}]}] Aug 29 15:25:30.854303 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.854303 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 31b0928fe3e4452c83521a5405a24696 Aug 29 15:25:30.854303 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.854303 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HostsAdminNegativeTestJSON-1121338273-project-admin Aug 29 15:25:30.854303 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:30.854303 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:30.854303 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e687126ca24c4e6f9b06fb0e25238894 Aug 29 15:25:30.854303 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1121338273-project-admin Aug 29 15:25:30.854303 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:25:30.854303 n-d-839401-11 devstack@n-api.service[122361]: {"status": "enable", "maintenance_mode": "invalid"} Aug 29 15:25:30.854303 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:30.854303 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'n-d-839401-11', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'disable', Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'Enable', Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'Disable', Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance: Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.855132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.856479 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.858300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.858300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:25:30.858300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:25:30.858300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:25:30.858300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.858300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-76a95560-089d-4bbd-8caf-02602c2fc779 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.858300 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-76a95560-089d-4bbd-8caf-02602c2fc779 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-hosts/n-d-839401-11" status: 400 len: 199 microversion: 2.1 time: 0.022338 Aug 29 15:25:30.861488 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 130/219] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Aug 29 15:25:30 2022] PUT /compute/v2.1/os-hosts/n-d-839401-11 => generated 199 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:25:30.862810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-53f8efff-5933-4cb6-945e-96aaa609b484 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:30.866354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-08d12c18-c2ae-41cc-854d-e67d24a898c8 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Action: 'update', calling method: .version_select at 0x7fc4304de8b0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-08d12c18-c2ae-41cc-854d-e67d24a898c8 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Request method failure captured: Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: request: PUT /compute/v2.1/os-hosts/n-d-839401-11 HTTP/1.1 Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 51 Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNppy1jpMQJ3GF4bIuQjYyGHUeVLt-zoH1OxkIfFwe59lOJxO4bMBghuahieUrsBRkyycCqekRxOfnM_T5zCdrHh5FamFyYuNSREk7faR1i2-xFt3VoxOUP6gbXFCwRi99eVaitqR774Ajpw2-QcDyh5Ccsah4oekzpvwLx4_Qe3HHc Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 31b0928fe3e4452c83521a5405a24696 Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:25:30.870550 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:25:30.872347 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31b0928fe3e4452c83521a5405a24696", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31b0928fe3e4452c83521a5405a24696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31b0928fe3e4452c83521a5405a24696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31b0928fe3e4452c83521a5405a24696"}]}] Aug 29 15:25:30.872347 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.872347 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 31b0928fe3e4452c83521a5405a24696 Aug 29 15:25:30.872347 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.872347 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HostsAdminNegativeTestJSON-1121338273-project-admin Aug 29 15:25:30.872347 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:30.872347 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:30.872347 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e687126ca24c4e6f9b06fb0e25238894 Aug 29 15:25:30.872347 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1121338273-project-admin Aug 29 15:25:30.872347 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:25:30.872347 n-d-839401-11 devstack@n-api.service[122361]: {"status": "invalid", "maintenance_mode": "enable"} Aug 29 15:25:30.872347 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:30.872347 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'n-d-839401-11', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'disable', Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'Enable', Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'Disable', Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance: Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.873218 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.874782 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.876026 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.876026 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:25:30.876026 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:25:30.876026 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:25:30.876026 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.876026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-08d12c18-c2ae-41cc-854d-e67d24a898c8 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.876026 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-08d12c18-c2ae-41cc-854d-e67d24a898c8 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-hosts/n-d-839401-11" status: 400 len: 189 microversion: 2.1 time: 0.009525 Aug 29 15:25:30.877143 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 131/220] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Aug 29 15:25:30 2022] PUT /compute/v2.1/os-hosts/n-d-839401-11 => generated 189 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:25:30.881683 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-53f8efff-5933-4cb6-945e-96aaa609b484 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1493 microversion: 2.1 time: 0.238827 Aug 29 15:25:30.882781 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 90/221] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:30 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1493 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:30.887830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e1383fdb-3be7-4e3d-b8ce-e3a49e2fed9a tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Action: 'update', calling method: .version_select at 0x7fc430365af0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:30.892037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e1383fdb-3be7-4e3d-b8ce-e3a49e2fed9a tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '00b7c2f56ee842fcbf2d7ccd05f7d30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaa40156fae4d8f9714898654faa9da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e1383fdb-3be7-4e3d-b8ce-e3a49e2fed9a tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Request method failure captured: Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: request: PUT /compute/v2.1/os-hosts/n-d-839401-11 HTTP/1.1 Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 50 Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpn8D0rVh13EmC6axOXPbHLouBF6yMjHEbmpr65opLxCrVCGfxZohZ1FQjX5QdavIoLnsoHloBHfcusw7prmQEiqvb0-VNqC5pkZDuhd-vh_plC0bD-3cYm78k1QkZu9aXNLfWwGex8WTqyUlR7rwveUpqWnql3SJ6GYOdcHzwbm8g Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: eaaa40156fae4d8f9714898654faa9da Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:30.895017 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:30.896428 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaaa40156fae4d8f9714898654faa9da", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaaa40156fae4d8f9714898654faa9da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaaa40156fae4d8f9714898654faa9da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaaa40156fae4d8f9714898654faa9da"}]}] Aug 29 15:25:30.896428 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.896428 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: eaaa40156fae4d8f9714898654faa9da Aug 29 15:25:30.896428 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-105919838 Aug 29 15:25:30.896428 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HostsAdminNegativeTestJSON-105919838-project Aug 29 15:25:30.896428 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:30.896428 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:30.896428 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 00b7c2f56ee842fcbf2d7ccd05f7d30b Aug 29 15:25:30.896428 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HostsAdminNegativeTestJSON-105919838-project Aug 29 15:25:30.896428 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:25:30.896428 n-d-839401-11 devstack@n-api.service[122361]: {"status": "enable", "maintenance_mode": "enable"} Aug 29 15:25:30.896428 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:30.896428 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 29 15:25:30.896428 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'n-d-839401-11', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:30.897411 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 29 15:25:30.898851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.901328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e1383fdb-3be7-4e3d-b8ce-e3a49e2fed9a tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.902328 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e1383fdb-3be7-4e3d-b8ce-e3a49e2fed9a tempest-HostsAdminNegativeTestJSON-105919838 tempest-HostsAdminNegativeTestJSON-105919838-project] 10.222.0.62 "PUT /compute/v2.1/os-hosts/n-d-839401-11" status: 403 len: 111 microversion: 2.1 time: 0.022021 Aug 29 15:25:30.903345 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 132/222] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Aug 29 15:25:30 2022] PUT /compute/v2.1/os-hosts/n-d-839401-11 => generated 111 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:25:30.915889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-da49d1a5-3428-4a06-b64b-7e88fbce8996 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Action: 'update', calling method: .version_select at 0x7fc430525af0>, body: {"status": null, "maintenance_mode": null} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-da49d1a5-3428-4a06-b64b-7e88fbce8996 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Request method failure captured: Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: request: PUT /compute/v2.1/os-hosts/n-d-839401-11 HTTP/1.1 Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 42 Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNppy1jpMQJ3GF4bIuQjYyGHUeVLt-zoH1OxkIfFwe59lOJxO4bMBghuahieUrsBRkyycCqekRxOfnM_T5zCdrHh5FamFyYuNSREk7faR1i2-xFt3VoxOUP6gbXFCwRi99eVaitqR774Ajpw2-QcDyh5Ccsah4oekzpvwLx4_Qe3HHc Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 31b0928fe3e4452c83521a5405a24696 Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:25:30.921759 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:25:30.923557 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31b0928fe3e4452c83521a5405a24696", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31b0928fe3e4452c83521a5405a24696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31b0928fe3e4452c83521a5405a24696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31b0928fe3e4452c83521a5405a24696"}]}] Aug 29 15:25:30.923557 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.923557 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 31b0928fe3e4452c83521a5405a24696 Aug 29 15:25:30.923557 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.923557 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-HostsAdminNegativeTestJSON-1121338273-project-admin Aug 29 15:25:30.923557 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:30.923557 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:30.923557 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e687126ca24c4e6f9b06fb0e25238894 Aug 29 15:25:30.923557 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1121338273-project-admin Aug 29 15:25:30.923557 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:25:30.923557 n-d-839401-11 devstack@n-api.service[122360]: {"status": null, "maintenance_mode": null} Aug 29 15:25:30.923557 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:25:30.923557 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 29 15:25:30.923557 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'n-d-839401-11', 'body': {'status': None, 'maintenance_mode': None}} Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'disable', Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'Enable', Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'Disable', Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance: Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi None Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.924420 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.926027 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.927222 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:25:30.927222 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:25:30.927222 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 29 15:25:30.927222 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.928870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-da49d1a5-3428-4a06-b64b-7e88fbce8996 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.929916 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-da49d1a5-3428-4a06-b64b-7e88fbce8996 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-hosts/n-d-839401-11" status: 400 len: 127 microversion: 2.1 time: 0.020707 Aug 29 15:25:30.931141 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 91/223] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Aug 29 15:25:30 2022] PUT /compute/v2.1/os-hosts/n-d-839401-11 => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:25:30.967139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c81ac462-4669-4a30-be80-176ac51f71e1 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Action: 'update', calling method: .version_select at 0x7fc4304ded30>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:30.972936 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.hosts [None req-c81ac462-4669-4a30-be80-176ac51f71e1 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Enabling host nonexistent_hostname. Aug 29 15:25:30.991979 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-c81ac462-4669-4a30-be80-176ac51f71e1 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c81ac462-4669-4a30-be80-176ac51f71e1 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Request method failure captured: Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 50 Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNppy1jpMQJ3GF4bIuQjYyGHUeVLt-zoH1OxkIfFwe59lOJxO4bMBghuahieUrsBRkyycCqekRxOfnM_T5zCdrHh5FamFyYuNSREk7faR1i2-xFt3VoxOUP6gbXFCwRi99eVaitqR774Ajpw2-QcDyh5Ccsah4oekzpvwLx4_Qe3HHc Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 31b0928fe3e4452c83521a5405a24696 Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:25:30.994795 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:25:30.996046 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31b0928fe3e4452c83521a5405a24696", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31b0928fe3e4452c83521a5405a24696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31b0928fe3e4452c83521a5405a24696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31b0928fe3e4452c83521a5405a24696"}]}] Aug 29 15:25:30.996046 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.996046 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 31b0928fe3e4452c83521a5405a24696 Aug 29 15:25:30.996046 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1121338273 Aug 29 15:25:30.996046 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HostsAdminNegativeTestJSON-1121338273-project-admin Aug 29 15:25:30.996046 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:30.996046 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:30.996046 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e687126ca24c4e6f9b06fb0e25238894 Aug 29 15:25:30.996046 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1121338273-project-admin Aug 29 15:25:30.996046 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:25:30.996046 n-d-839401-11 devstack@n-api.service[122361]: {"status": "enable", "maintenance_mode": "enable"} Aug 29 15:25:30.996046 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:30.996046 n-d-839401-11 devstack@n-api.service[122361]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.996046 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:25:30.996818 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:30.997810 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 29 15:25:30.998874 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 29 15:25:30.998874 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 29 15:25:30.998874 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:30.998874 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.998874 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.998874 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:30.998874 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.998874 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:30.998874 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:30.998874 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:30.998874 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:30.998874 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:30.998874 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:25:30.998874 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:30.998874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c81ac462-4669-4a30-be80-176ac51f71e1 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:30.999700 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c81ac462-4669-4a30-be80-176ac51f71e1 tempest-HostsAdminNegativeTestJSON-1121338273 tempest-HostsAdminNegativeTestJSON-1121338273-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.059365 Aug 29 15:25:31.003191 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 133/224] 10.222.0.62 () {60 vars in 1211 bytes} [Mon Aug 29 15:25:30 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:25:31.069302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b8e97c22-f868-4ceb-9d07-38cdc229a8ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:31.070697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b8e97c22-f868-4ceb-9d07-38cdc229a8ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:31.083530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8e97c22-f868-4ceb-9d07-38cdc229a8ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:31.095139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8e97c22-f868-4ceb-9d07-38cdc229a8ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:31.097122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8e97c22-f868-4ceb-9d07-38cdc229a8ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:31.100393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8e97c22-f868-4ceb-9d07-38cdc229a8ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:31.102133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8e97c22-f868-4ceb-9d07-38cdc229a8ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:31.103416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8e97c22-f868-4ceb-9d07-38cdc229a8ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:31.162221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-eca59689-1a38-4c92-a646-8c6a586b3912 req-ce1ca676-78cf-4182-86f0-a838fcbe5072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d998f970-2fb9-48d6-9a9d-2907f9019b14", "name": "network-vif-deleted", "tag": "20b6ee8b-60d3-45f8-b988-c6db2eac9751"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:31.190174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-eca59689-1a38-4c92-a646-8c6a586b3912 req-ce1ca676-78cf-4182-86f0-a838fcbe5072 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:31.191842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-eca59689-1a38-4c92-a646-8c6a586b3912 req-ce1ca676-78cf-4182-86f0-a838fcbe5072 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:31.196181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-eca59689-1a38-4c92-a646-8c6a586b3912 req-ce1ca676-78cf-4182-86f0-a838fcbe5072 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:31.219560 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-eca59689-1a38-4c92-a646-8c6a586b3912 req-ce1ca676-78cf-4182-86f0-a838fcbe5072 service nova] Creating event network-vif-deleted:20b6ee8b-60d3-45f8-b988-c6db2eac9751 for instance d998f970-2fb9-48d6-9a9d-2907f9019b14 on n-h2-839401-11 Aug 29 15:25:31.227620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b8e97c22-f868-4ceb-9d07-38cdc229a8ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:31.237851 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b8e97c22-f868-4ceb-9d07-38cdc229a8ef tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 200 len: 1433 microversion: 2.1 time: 0.174801 Aug 29 15:25:31.239149 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 92/225] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:31 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 1433 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:31.245646 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-eca59689-1a38-4c92-a646-8c6a586b3912 req-ce1ca676-78cf-4182-86f0-a838fcbe5072 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073085 Aug 29 15:25:31.246575 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 134/226] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:31.903947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-46d3e228-43a3-4ac7-a80d-b2334ed923a5 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:31.904541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-46d3e228-43a3-4ac7-a80d-b2334ed923a5 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:31.915001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d3e228-43a3-4ac7-a80d-b2334ed923a5 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:31.915701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d3e228-43a3-4ac7-a80d-b2334ed923a5 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:31.916133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d3e228-43a3-4ac7-a80d-b2334ed923a5 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:31.916833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d3e228-43a3-4ac7-a80d-b2334ed923a5 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:31.930281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d3e228-43a3-4ac7-a80d-b2334ed923a5 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:31.931556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d3e228-43a3-4ac7-a80d-b2334ed923a5 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:32.103448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:32.350975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-46d3e228-43a3-4ac7-a80d-b2334ed923a5 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:32.360783 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-46d3e228-43a3-4ac7-a80d-b2334ed923a5 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1493 microversion: 2.1 time: 0.460869 Aug 29 15:25:32.361854 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 93/227] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:31 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1493 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:32.368145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c87e4c65-aeb5-4a5c-98f7-dbadec0860b9 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:32.369233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c87e4c65-aeb5-4a5c-98f7-dbadec0860b9 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:32.375853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87e4c65-aeb5-4a5c-98f7-dbadec0860b9 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:32.376685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87e4c65-aeb5-4a5c-98f7-dbadec0860b9 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:32.377346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87e4c65-aeb5-4a5c-98f7-dbadec0860b9 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:32.378136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87e4c65-aeb5-4a5c-98f7-dbadec0860b9 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:32.378712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87e4c65-aeb5-4a5c-98f7-dbadec0860b9 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:32.379220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87e4c65-aeb5-4a5c-98f7-dbadec0860b9 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:32.411139 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-c87e4c65-aeb5-4a5c-98f7-dbadec0860b9 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] HTTP exception thrown: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c87e4c65-aeb5-4a5c-98f7-dbadec0860b9 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Request method failure captured: Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 HTTP/1.1 Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpDqrToHXeMIhQx6Z0qo1G8yRi_WT0aaZLTsqRX2qltDNC96qfM8_jeLxQ5frFGYIwrCcRnkeHS59fO3UK2jh1vjFhZRKSKiSjyky3Xv5mBBPNO7mnjp0VII-3d9J_leb3mimcDDXobP1RweXR8y66crXxtFEvm3hJnvJRZQlk_668 Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: c9b78af2e97440639d6e8f3110342110 Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:25:32.418418 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:25:32.420072 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9b78af2e97440639d6e8f3110342110", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9b78af2e97440639d6e8f3110342110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9b78af2e97440639d6e8f3110342110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9b78af2e97440639d6e8f3110342110"}]}] Aug 29 15:25:32.420072 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:25:32.420072 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: c9b78af2e97440639d6e8f3110342110 Aug 29 15:25:32.420072 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:25:32.420072 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersAdminTestJSON-255653099-project Aug 29 15:25:32.420072 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:32.420072 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:32.420072 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 84f612b7294244dba43a0fdc0ed8b632 Aug 29 15:25:32.420072 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersAdminTestJSON-255653099-project Aug 29 15:25:32.420072 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:32.420072 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. Aug 29 15:25:32.420072 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'd998f970-2fb9-48d6-9a9d-2907f9019b14'} Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:32.420931 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. Aug 29 15:25:32.426270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:32.427268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c87e4c65-aeb5-4a5c-98f7-dbadec0860b9 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Returning 404 to user: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:32.427268 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c87e4c65-aeb5-4a5c-98f7-dbadec0860b9 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 404 len: 111 microversion: 2.1 time: 0.058869 Aug 29 15:25:32.427268 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 94/228] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:32 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:32.483189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b486207e-6ed9-4918-be84-1d9de8f3c9df tempest-InstanceUsageAuditLogNegativeTestJSON-1754832623 tempest-InstanceUsageAuditLogNegativeTestJSON-1754832623-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:32.485414 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-b486207e-6ed9-4918-be84-1d9de8f3c9df tempest-InstanceUsageAuditLogNegativeTestJSON-1754832623 tempest-InstanceUsageAuditLogNegativeTestJSON-1754832623-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b486207e-6ed9-4918-be84-1d9de8f3c9df tempest-InstanceUsageAuditLogNegativeTestJSON-1754832623 tempest-InstanceUsageAuditLogNegativeTestJSON-1754832623-project-admin] Request method failure captured: Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpruTts8qv2AAbhO97ljRVOrFub2x7cJ47oczF1LeEgyIYvz00bxO_IAKFX-EjIQds0ULjyNMuturMuWdhB98V3MhQ_H9hpAPCsX8B1IoRV9-gooTfo0Uvt5TPbJQ_kmvWpccMmW1gFaE0yogE07htmdxieB8ZgK02LCHHy9ZXmwd4 Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 0c1d678141924e5fbbcb3a1bcd6285fc Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1754832623 Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:25:32.491585 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:25:32.493121 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0c1d678141924e5fbbcb3a1bcd6285fc", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0c1d678141924e5fbbcb3a1bcd6285fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0c1d678141924e5fbbcb3a1bcd6285fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0c1d678141924e5fbbcb3a1bcd6285fc"}]}] Aug 29 15:25:32.493121 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1754832623 Aug 29 15:25:32.493121 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 0c1d678141924e5fbbcb3a1bcd6285fc Aug 29 15:25:32.493121 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1754832623 Aug 29 15:25:32.493121 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1754832623-project-admin Aug 29 15:25:32.493121 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:32.493121 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:32.493121 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: d509bc0a6a724bf3b7319c46abe5e6e1 Aug 29 15:25:32.493121 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1754832623-project-admin Aug 29 15:25:32.493121 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:25:32.493121 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid timestamp for date invalid_time Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'invalid_time'} Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:32.493779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:32.494871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 29 15:25:32.494871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 29 15:25:32.494871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 29 15:25:32.494871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:32.494871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:32.494871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:32.494871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:32.494871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:32.494871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:32.494871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:32.494871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:32.494871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 29 15:25:32.494871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:32.495591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b486207e-6ed9-4918-be84-1d9de8f3c9df tempest-InstanceUsageAuditLogNegativeTestJSON-1754832623 tempest-InstanceUsageAuditLogNegativeTestJSON-1754832623-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:32.499192 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b486207e-6ed9-4918-be84-1d9de8f3c9df tempest-InstanceUsageAuditLogNegativeTestJSON-1754832623 tempest-InstanceUsageAuditLogNegativeTestJSON-1754832623-project-admin] 10.222.0.62 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.395459 Aug 29 15:25:32.499192 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 135/229] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 29 15:25:32 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 398 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 29 15:25:32.583372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-263688845", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:32.648712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:25:32.998524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-461e5319-2b85-48b2-840e-36f28117fee5 tempest-InstanceUsageAuditLogNegativeTestJSON-139364133 tempest-InstanceUsageAuditLogNegativeTestJSON-139364133-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:33.002533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-461e5319-2b85-48b2-840e-36f28117fee5 tempest-InstanceUsageAuditLogNegativeTestJSON-139364133 tempest-InstanceUsageAuditLogNegativeTestJSON-139364133-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'ac24421cd9e64694b598a6f4bf11711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b7ab9c6ed14219b89bb32aa36f9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-461e5319-2b85-48b2-840e-36f28117fee5 tempest-InstanceUsageAuditLogNegativeTestJSON-139364133 tempest-InstanceUsageAuditLogNegativeTestJSON-139364133-project] Request method failure captured: Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpqgxlnUzOVTfbspyJ10SP3T-QP9KlFgHC5S16lqy0E5TPNcvB9Wg51BFeV6AFL2FNPW60fKZypMm-fc60hN-AGeQp8Wrcg_vTy4hn9eM7u0ApGg2ox7Q7B_gqTFoQXm3_lB27_hTWkH3cxYxTXsAoyr6oDZOvFRkggKvBzYw2XppA Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: f5b7ab9c6ed14219b89bb32aa36f9b15 Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-139364133 Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:25:33.008923 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:25:33.010202 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f5b7ab9c6ed14219b89bb32aa36f9b15", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f5b7ab9c6ed14219b89bb32aa36f9b15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f5b7ab9c6ed14219b89bb32aa36f9b15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f5b7ab9c6ed14219b89bb32aa36f9b15"}]}] Aug 29 15:25:33.010202 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-139364133 Aug 29 15:25:33.010202 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: f5b7ab9c6ed14219b89bb32aa36f9b15 Aug 29 15:25:33.010202 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-139364133 Aug 29 15:25:33.010202 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-139364133-project Aug 29 15:25:33.010202 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:33.010202 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:33.010202 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: ac24421cd9e64694b598a6f4bf11711c Aug 29 15:25:33.010202 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-139364133-project Aug 29 15:25:33.010202 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: action_args: {} Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:33.010793 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 29 15:25:33.011845 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:33.014721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-461e5319-2b85-48b2-840e-36f28117fee5 tempest-InstanceUsageAuditLogNegativeTestJSON-139364133 tempest-InstanceUsageAuditLogNegativeTestJSON-139364133-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:33.016181 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-461e5319-2b85-48b2-840e-36f28117fee5 tempest-InstanceUsageAuditLogNegativeTestJSON-139364133 tempest-InstanceUsageAuditLogNegativeTestJSON-139364133-project] 10.222.0.62 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.512218 Aug 29 15:25:33.017502 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 95/230] 10.222.0.62 () {58 vars in 1185 bytes} [Mon Aug 29 15:25:32 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 514 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:33.033782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f593c96-fac5-4502-ba2c-dfdb4d668fbd tempest-InstanceUsageAuditLogNegativeTestJSON-139364133 tempest-InstanceUsageAuditLogNegativeTestJSON-139364133-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:33.035956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3f593c96-fac5-4502-ba2c-dfdb4d668fbd tempest-InstanceUsageAuditLogNegativeTestJSON-139364133 tempest-InstanceUsageAuditLogNegativeTestJSON-139364133-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'ac24421cd9e64694b598a6f4bf11711c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b7ab9c6ed14219b89bb32aa36f9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f593c96-fac5-4502-ba2c-dfdb4d668fbd tempest-InstanceUsageAuditLogNegativeTestJSON-139364133 tempest-InstanceUsageAuditLogNegativeTestJSON-139364133-project] Request method failure captured: Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29%2015:25:33 HTTP/1.1 Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpqgxlnUzOVTfbspyJ10SP3T-QP9KlFgHC5S16lqy0E5TPNcvB9Wg51BFeV6AFL2FNPW60fKZypMm-fc60hN-AGeQp8Wrcg_vTy4hn9eM7u0ApGg2ox7Q7B_gqTFoQXm3_lB27_hTWkH3cxYxTXsAoyr6oDZOvFRkggKvBzYw2XppA Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: f5b7ab9c6ed14219b89bb32aa36f9b15 Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-139364133 Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:25:33.039269 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:25:33.040478 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f5b7ab9c6ed14219b89bb32aa36f9b15", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f5b7ab9c6ed14219b89bb32aa36f9b15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f5b7ab9c6ed14219b89bb32aa36f9b15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f5b7ab9c6ed14219b89bb32aa36f9b15"}]}] Aug 29 15:25:33.040478 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-139364133 Aug 29 15:25:33.040478 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: f5b7ab9c6ed14219b89bb32aa36f9b15 Aug 29 15:25:33.040478 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-139364133 Aug 29 15:25:33.040478 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-139364133-project Aug 29 15:25:33.040478 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:33.040478 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:33.040478 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: ac24421cd9e64694b598a6f4bf11711c Aug 29 15:25:33.040478 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-139364133-project Aug 29 15:25:33.040478 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '2022-08-29 15:25:33'} Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:33.041025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 29 15:25:33.042116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:33.045071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f593c96-fac5-4502-ba2c-dfdb4d668fbd tempest-InstanceUsageAuditLogNegativeTestJSON-139364133 tempest-InstanceUsageAuditLogNegativeTestJSON-139364133-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:33.046213 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3f593c96-fac5-4502-ba2c-dfdb4d668fbd tempest-InstanceUsageAuditLogNegativeTestJSON-139364133 tempest-InstanceUsageAuditLogNegativeTestJSON-139364133-project] 10.222.0.62 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29 15:25:33" status: 403 len: 128 microversion: 2.1 time: 0.023073 Aug 29 15:25:33.047286 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 96/231] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 15:25:33 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29%2015%3A25%3A33 => generated 128 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:33.380889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:25:33.382015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:25:33.382122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:25:33.383687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:25:33.384534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:25:33.384840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4872f43e-7b4d-430e-8d41-1c166a315633 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:33.385487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4872f43e-7b4d-430e-8d41-1c166a315633 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:33.397148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4872f43e-7b4d-430e-8d41-1c166a315633 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:33.398013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4872f43e-7b4d-430e-8d41-1c166a315633 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:33.401031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4872f43e-7b4d-430e-8d41-1c166a315633 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:33.402119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4872f43e-7b4d-430e-8d41-1c166a315633 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:33.404343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4872f43e-7b4d-430e-8d41-1c166a315633 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:33.405067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4872f43e-7b4d-430e-8d41-1c166a315633 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:33.405772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:33.407442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:33.407872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:33.412086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:33.412576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:33.413010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:33.470632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Getting quotas for project c9b78af2e97440639d6e8f3110342110. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:25:33.485310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Getting quotas for user 84f612b7294244dba43a0fdc0ed8b632 and project c9b78af2e97440639d6e8f3110342110. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:25:33.527142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:25:33.531568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:25:33.612764 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9bb84fbf-e83e-45dc-bb7c-1975c1558dfa tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.033774 Aug 29 15:25:33.613823 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 136/232] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:25:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:25:33.624658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-12faddce-bb9e-42a9-80fa-efa380f0cce6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:33.625315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-12faddce-bb9e-42a9-80fa-efa380f0cce6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:33.711765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-12faddce-bb9e-42a9-80fa-efa380f0cce6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:33.721388 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-12faddce-bb9e-42a9-80fa-efa380f0cce6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1219 microversion: 2.1 time: 0.100268 Aug 29 15:25:33.734443 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 137/233] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:33 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:25:33.889563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-7fba94dd-aaf4-4dea-ab84-fd427c9e0f69 req-4f7dab81-a3b7-450e-9540-0193e71a81dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b616b8-2701-458b-8b8a-9f44b708e6fc", "name": "network-vif-deleted", "tag": "9a441fd6-9720-4d58-b5b1-296c1d7b3bb0"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:33.922736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7fba94dd-aaf4-4dea-ab84-fd427c9e0f69 req-4f7dab81-a3b7-450e-9540-0193e71a81dc service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:33.927107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7fba94dd-aaf4-4dea-ab84-fd427c9e0f69 req-4f7dab81-a3b7-450e-9540-0193e71a81dc service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:33.930620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7fba94dd-aaf4-4dea-ab84-fd427c9e0f69 req-4f7dab81-a3b7-450e-9540-0193e71a81dc service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:33.970194 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-7fba94dd-aaf4-4dea-ab84-fd427c9e0f69 req-4f7dab81-a3b7-450e-9540-0193e71a81dc service nova] Creating event network-vif-deleted:9a441fd6-9720-4d58-b5b1-296c1d7b3bb0 for instance 43b616b8-2701-458b-8b8a-9f44b708e6fc on n-h1-839401-11 Aug 29 15:25:33.987002 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-7fba94dd-aaf4-4dea-ab84-fd427c9e0f69 req-4f7dab81-a3b7-450e-9540-0193e71a81dc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101912 Aug 29 15:25:33.987701 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 138/234] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:25:34.272459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4872f43e-7b4d-430e-8d41-1c166a315633 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792d186543044e919ffd914f0a8794e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78479eb062e543aeb3fd37659d88ac15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:34.285583 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4872f43e-7b4d-430e-8d41-1c166a315633 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 200 len: 1493 microversion: 2.1 time: 0.905181 Aug 29 15:25:34.286180 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 97/235] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:33 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 1493 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:34.744749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e90e3350-c1eb-4e47-9094-f0246e87cbbb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:34.745789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e90e3350-c1eb-4e47-9094-f0246e87cbbb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:34.752476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e90e3350-c1eb-4e47-9094-f0246e87cbbb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:34.753071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e90e3350-c1eb-4e47-9094-f0246e87cbbb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:34.753777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e90e3350-c1eb-4e47-9094-f0246e87cbbb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:34.754554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e90e3350-c1eb-4e47-9094-f0246e87cbbb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:34.755323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e90e3350-c1eb-4e47-9094-f0246e87cbbb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:34.755938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e90e3350-c1eb-4e47-9094-f0246e87cbbb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:34.832897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e90e3350-c1eb-4e47-9094-f0246e87cbbb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:34.849593 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e90e3350-c1eb-4e47-9094-f0246e87cbbb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1271 microversion: 2.1 time: 0.109116 Aug 29 15:25:34.850252 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 139/236] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:34 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:35.309163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b2b8ea7-d139-4300-9b8f-bf690d511149 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:35.309797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8b2b8ea7-d139-4300-9b8f-bf690d511149 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:35.318054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b2b8ea7-d139-4300-9b8f-bf690d511149 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:35.318545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b2b8ea7-d139-4300-9b8f-bf690d511149 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:35.318983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b2b8ea7-d139-4300-9b8f-bf690d511149 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:35.324139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b2b8ea7-d139-4300-9b8f-bf690d511149 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:35.325612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b2b8ea7-d139-4300-9b8f-bf690d511149 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:35.327214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b2b8ea7-d139-4300-9b8f-bf690d511149 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:35.361884 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-8b2b8ea7-d139-4300-9b8f-bf690d511149 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] HTTP exception thrown: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b2b8ea7-d139-4300-9b8f-bf690d511149 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Request method failure captured: Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc HTTP/1.1 Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpE3i7vLV-BahUMPOXrbfQCq_rgXHGT0TYP86LwTZnpOmDiHwcPenxfG-WpPE0jZAbb0XLATl1VdeiHabTqf9d2komH_wFOAacWqZMIEhU_V9Rgq4_SD4I6ca6owG_61U8pSAyfcn2Xr-fpcZdnpZTBClnjhgFcERQOpk_XisGWW_Y Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 78479eb062e543aeb3fd37659d88ac15 Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AggregatesAdminTestJSON-1090991663 Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:25:35.365844 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:25:35.367296 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_78479eb062e543aeb3fd37659d88ac15", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/78479eb062e543aeb3fd37659d88ac15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/78479eb062e543aeb3fd37659d88ac15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/78479eb062e543aeb3fd37659d88ac15"}]}] Aug 29 15:25:35.367296 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AggregatesAdminTestJSON-1090991663 Aug 29 15:25:35.367296 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 78479eb062e543aeb3fd37659d88ac15 Aug 29 15:25:35.367296 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1090991663 Aug 29 15:25:35.367296 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AggregatesAdminTestJSON-1090991663-project Aug 29 15:25:35.367296 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:35.367296 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:35.367296 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 792d186543044e919ffd914f0a8794e4 Aug 29 15:25:35.367296 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AggregatesAdminTestJSON-1090991663-project Aug 29 15:25:35.367296 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:35.367296 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. Aug 29 15:25:35.367296 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '43b616b8-2701-458b-8b8a-9f44b708e6fc'} Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:35.368098 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. Aug 29 15:25:35.369445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:35.370626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b2b8ea7-d139-4300-9b8f-bf690d511149 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Returning 404 to user: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:35.370626 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8b2b8ea7-d139-4300-9b8f-bf690d511149 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 404 len: 111 microversion: 2.1 time: 0.063838 Aug 29 15:25:35.370626 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 98/237] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:35 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:35.377533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ee83ae13-2f28-4d21-adfb-e18efbb6913d tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-839401-11"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:35.389139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee83ae13-2f28-4d21-adfb-e18efbb6913d tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:35.389494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee83ae13-2f28-4d21-adfb-e18efbb6913d tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:35.389927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee83ae13-2f28-4d21-adfb-e18efbb6913d tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:35.605713 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ee83ae13-2f28-4d21-adfb-e18efbb6913d tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.1 time: 0.232369 Aug 29 15:25:35.606339 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 140/238] 10.222.0.62 () {60 vars in 1191 bytes} [Mon Aug 29 15:25:35 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:25:35.622894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-660bc52e-6f0d-4c12-aee2-107aafd67ffd tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:35.700886 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-660bc52e-6f0d-4c12-aee2-107aafd67ffd tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.086571 Aug 29 15:25:35.701497 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 99/239] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:35 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:35.716255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-28b3fe8e-09ed-4d44-b103-46775f1f5423 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-659891476"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:35.721829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.aggregate [None req-28b3fe8e-09ed-4d44-b103-46775f1f5423 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Generated uuid 73f6e139-787c-41e0-952f-445454805f99 for aggregate {{(pid=122361) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:35.791922 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-28b3fe8e-09ed-4d44-b103-46775f1f5423 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.080160 Aug 29 15:25:35.796749 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 141/240] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:35 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:35.807029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f0f608b-d7be-4dba-8329-0921ac7069d5 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-839401-11"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:35.825637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f0f608b-d7be-4dba-8329-0921ac7069d5 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:35.826393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f0f608b-d7be-4dba-8329-0921ac7069d5 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:35.828635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f0f608b-d7be-4dba-8329-0921ac7069d5 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:35.874857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d50143b1-e78b-4c11-87ed-b2438df3ebe4 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:35.876257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d50143b1-e78b-4c11-87ed-b2438df3ebe4 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:35.900341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50143b1-e78b-4c11-87ed-b2438df3ebe4 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:35.900858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50143b1-e78b-4c11-87ed-b2438df3ebe4 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:35.902441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50143b1-e78b-4c11-87ed-b2438df3ebe4 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:35.904901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50143b1-e78b-4c11-87ed-b2438df3ebe4 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:35.906224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50143b1-e78b-4c11-87ed-b2438df3ebe4 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:35.906816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50143b1-e78b-4c11-87ed-b2438df3ebe4 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:36.042117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d50143b1-e78b-4c11-87ed-b2438df3ebe4 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:36.060180 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d50143b1-e78b-4c11-87ed-b2438df3ebe4 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1277 microversion: 2.1 time: 0.190449 Aug 29 15:25:36.067902 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3f0f608b-d7be-4dba-8329-0921ac7069d5 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.264567 Aug 29 15:25:36.068617 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 100/241] 10.222.0.62 () {60 vars in 1191 bytes} [Mon Aug 29 15:25:35 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:36.074700 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 142/242] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:35 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:36.088361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b0591f6-d324-4072-b5ec-3877696b9083 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-839401-11"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:36.121237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b0591f6-d324-4072-b5ec-3877696b9083 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:36.121946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b0591f6-d324-4072-b5ec-3877696b9083 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:36.122859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b0591f6-d324-4072-b5ec-3877696b9083 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:36.176709 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-6b0591f6-d324-4072-b5ec-3877696b9083 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] HTTP exception thrown: Aggregate 3 already has host n-h1-839401-11. Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b0591f6-d324-4072-b5ec-3877696b9083 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Request method failure captured: Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 40 Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpGZVatLCncpe98xrMICgS5D94JY8aUEcGMY9o-a_5Bq_DUQXK5pjrwDWPz3r2aXsVL99YzcoS_sugtHH9yzdSvLWD37NNUeDBsoO_QXFUpgnRwQOyZsoyJBesOliql_JT-gTlduJpm16HTuBv5ifa9Q0laP4meDSK2AkVo_gMCzPg Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 97762c0f4aad40ee89465ace1c52cede Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:25:36.197180 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:25:36.198474 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_97762c0f4aad40ee89465ace1c52cede", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/97762c0f4aad40ee89465ace1c52cede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/97762c0f4aad40ee89465ace1c52cede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/97762c0f4aad40ee89465ace1c52cede"}]}] Aug 29 15:25:36.198474 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:36.198474 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 97762c0f4aad40ee89465ace1c52cede Aug 29 15:25:36.198474 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:36.198474 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin Aug 29 15:25:36.198474 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:36.198474 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:36.198474 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 33392f26b6424b45b5cd71eabcd15bf9 Aug 29 15:25:36.198474 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin Aug 29 15:25:36.198474 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:25:36.198474 n-d-839401-11 devstack@n-api.service[122360]: {"add_host": {"host": "n-h1-839401-11"}} Aug 29 15:25:36.198474 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:36.198474 n-d-839401-11 devstack@n-api.service[122360]: exception: Aggregate 3 already has host n-h1-839401-11. Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-839401-11'}}} Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:25:36.199461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-839401-11-3' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi session.flush() Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:25:36.200882 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:25:36.203366 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:25:36.207015 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-839401-11-3' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 29, 15, 25, 36, 164542), 'updated_at': None, 'host': 'n-h1-839401-11', 'aggregate_id': 3}] Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:36.211982 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 3 already has host n-h1-839401-11. Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:36.217077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 3 already has host n-h1-839401-11. Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:36.220505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:36.225161 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 3 already has host n-h1-839401-11. Aug 29 15:25:36.225161 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:36.225161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b0591f6-d324-4072-b5ec-3877696b9083 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Returning 409 to user: Aggregate 3 already has host n-h1-839401-11. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:36.225161 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6b0591f6-d324-4072-b5ec-3877696b9083 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/3/action" status: 409 len: 96 microversion: 2.1 time: 0.125733 Aug 29 15:25:36.225161 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 101/243] 10.222.0.62 () {60 vars in 1191 bytes} [Mon Aug 29 15:25:36 2022] POST /compute/v2.1/os-aggregates/3/action => generated 96 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 29 15:25:36.232555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f61cae4-a2b6-4f7b-980c-a5a63fb3a7ad tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-839401-11"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:36.249951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f61cae4-a2b6-4f7b-980c-a5a63fb3a7ad tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:36.250859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f61cae4-a2b6-4f7b-980c-a5a63fb3a7ad tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:36.251619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f61cae4-a2b6-4f7b-980c-a5a63fb3a7ad tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:36.431197 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9f61cae4-a2b6-4f7b-980c-a5a63fb3a7ad tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.214872 Aug 29 15:25:36.432298 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 143/244] 10.222.0.62 () {60 vars in 1191 bytes} [Mon Aug 29 15:25:36 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:36.446414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e8df7e2e-9efa-4f22-b3b6-e978ffc9850d tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:36.522265 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e8df7e2e-9efa-4f22-b3b6-e978ffc9850d tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.081749 Aug 29 15:25:36.523078 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 102/245] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:36 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:36.536330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0c49cb07-fca4-4d35-9e5c-d4e21ee8bed7 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1084166443"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:36.539945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.aggregate [None req-0c49cb07-fca4-4d35-9e5c-d4e21ee8bed7 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Generated uuid 50d4c24c-4f69-44cd-b285-953fa8a8567b for aggregate {{(pid=122361) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:36.571898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-11158b7e-7525-41ea-b0fe-3a21e4639707 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1911600669"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:36.576675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.aggregate [None req-11158b7e-7525-41ea-b0fe-3a21e4639707 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Generated uuid cf96b200-1c54-45f8-9c8a-2e5e7bd74d4c for aggregate {{(pid=122360) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:36.578387 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0c49cb07-fca4-4d35-9e5c-d4e21ee8bed7 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.045953 Aug 29 15:25:36.579294 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 144/246] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:36.632251 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-11158b7e-7525-41ea-b0fe-3a21e4639707 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063783 Aug 29 15:25:36.632881 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 103/247] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:36.644825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2e7640ea-93d4-45f4-9d73-7ddc1b57068d tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-839401-11"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:36.672742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e7640ea-93d4-45f4-9d73-7ddc1b57068d tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:36.673317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e7640ea-93d4-45f4-9d73-7ddc1b57068d tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:36.678560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e7640ea-93d4-45f4-9d73-7ddc1b57068d tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:36.841263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=22 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:36.890756 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2e7640ea-93d4-45f4-9d73-7ddc1b57068d tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 243 microversion: 2.1 time: 0.249538 Aug 29 15:25:36.891719 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 104/248] 10.222.0.62 () {60 vars in 1191 bytes} [Mon Aug 29 15:25:36 2022] POST /compute/v2.1/os-aggregates/5/action => generated 243 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:25:36.902214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-935b1316-bc19-464c-b716-999591832fd4 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:36.924924 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-935b1316-bc19-464c-b716-999591832fd4 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "GET /compute/v2.1/os-aggregates/5" status: 200 len: 243 microversion: 2.1 time: 0.026403 Aug 29 15:25:36.925948 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 105/249] 10.222.0.62 () {58 vars in 1149 bytes} [Mon Aug 29 15:25:36 2022] GET /compute/v2.1/os-aggregates/5 => generated 243 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:25:36.942023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-68218e6f-dbdd-4f9e-8698-51a0eeeaec7b tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-839401-11"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:36.969670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68218e6f-dbdd-4f9e-8698-51a0eeeaec7b tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:36.975369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68218e6f-dbdd-4f9e-8698-51a0eeeaec7b tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:36.978855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68218e6f-dbdd-4f9e-8698-51a0eeeaec7b tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:37.163138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-080f50fc-16b4-48e5-93cd-f6735177674b tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-839401-11"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:37.171895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-080f50fc-16b4-48e5-93cd-f6735177674b tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'aec01767281843908fef58889bb1508a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43b659a0434e389dc09d139fc1b401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-080f50fc-16b4-48e5-93cd-f6735177674b tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Request method failure captured: Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 40 Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpEn7qJZicsBwp7OEEsvKnz6xHVr_Zdu_wVI9JxyKYe5PH5hshLZSztV_kOjkR58LHkk35PXaHmJjoFzJJ0pRFIb1iYsVktDe3TSQRvaPw1di42Ey9Lz8CNXdwh-9rWGIMoe92a-eTlTs_YcTweBSoMJnT_hFaANl8xLHd33YtEpOI Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bc43b659a0434e389dc09d139fc1b401 Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:37.189323 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:37.190526 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc43b659a0434e389dc09d139fc1b401", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc43b659a0434e389dc09d139fc1b401"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc43b659a0434e389dc09d139fc1b401"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc43b659a0434e389dc09d139fc1b401"}]}] Aug 29 15:25:37.190526 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:37.190526 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bc43b659a0434e389dc09d139fc1b401 Aug 29 15:25:37.190526 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:37.190526 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AggregatesAdminNegativeTestJSON-1997319088-project Aug 29 15:25:37.190526 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:37.190526 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:37.190526 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: aec01767281843908fef58889bb1508a Aug 29 15:25:37.190526 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088-project Aug 29 15:25:37.190526 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:25:37.190526 n-d-839401-11 devstack@n-api.service[122361]: {"add_host": {"host": "n-h1-839401-11"}} Aug 29 15:25:37.190526 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:25:37.190526 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '4', 'body': {'add_host': {'host': 'n-h1-839401-11'}}} Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:37.191261 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 29 15:25:37.192312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.193379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-080f50fc-16b4-48e5-93cd-f6735177674b tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:37.193379 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-080f50fc-16b4-48e5-93cd-f6735177674b tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] 10.222.0.62 "POST /compute/v2.1/os-aggregates/4/action" status: 403 len: 118 microversion: 2.1 time: 0.603682 Aug 29 15:25:37.201687 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-68218e6f-dbdd-4f9e-8698-51a0eeeaec7b tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.264631 Aug 29 15:25:37.202314 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 106/250] 10.222.0.62 () {60 vars in 1191 bytes} [Mon Aug 29 15:25:36 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:37.203952 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 145/251] 10.222.0.62 () {60 vars in 1191 bytes} [Mon Aug 29 15:25:36 2022] POST /compute/v2.1/os-aggregates/4/action => generated 118 bytes in 617 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:37.228643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e5512d75-e1ed-4d04-ae11-3ebcbb435b60 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:37.228943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-28a70e9e-af61-429d-b1e8-e671685e7826 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:37.233117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-28a70e9e-af61-429d-b1e8-e671685e7826 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:37.244364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28a70e9e-af61-429d-b1e8-e671685e7826 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:37.245868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28a70e9e-af61-429d-b1e8-e671685e7826 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:37.246522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28a70e9e-af61-429d-b1e8-e671685e7826 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:37.247803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28a70e9e-af61-429d-b1e8-e671685e7826 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:37.248619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28a70e9e-af61-429d-b1e8-e671685e7826 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:37.256175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28a70e9e-af61-429d-b1e8-e671685e7826 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:37.290017 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e5512d75-e1ed-4d04-ae11-3ebcbb435b60 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.081631 Aug 29 15:25:37.292324 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 146/252] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:37 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:37.312778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e7a6ee1-b52d-4eeb-92b0-9ba813822db8 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:37.355000 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9e7a6ee1-b52d-4eeb-92b0-9ba813822db8 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.061307 Aug 29 15:25:37.356544 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 147/253] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:37 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:37.370950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f458e0a-56ee-4a26-beaa-665a9d35511a tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-415766047"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:37.379564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.aggregate [None req-9f458e0a-56ee-4a26-beaa-665a9d35511a tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Generated uuid 700b08f7-0dbd-4ee6-9bed-1e75fdae06e0 for aggregate {{(pid=122361) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:37.422134 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9f458e0a-56ee-4a26-beaa-665a9d35511a tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.063330 Aug 29 15:25:37.425489 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 148/254] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:37 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:37.437847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9787f386-6287-49a9-9256-c2f2dd4d8b14 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-512583596"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:37.443441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.aggregate [None req-9787f386-6287-49a9-9256-c2f2dd4d8b14 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Generated uuid b774193d-05b6-4a71-83a0-c25bd2aa7eb3 for aggregate {{(pid=122361) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:37.495555 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9787f386-6287-49a9-9256-c2f2dd4d8b14 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.068799 Aug 29 15:25:37.497121 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 149/255] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:37 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:37.504226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ebe16e50-0fc2-42a8-9c2e-64d914d7af2e tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-842379945"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:37.524843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:37.533650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebe16e50-0fc2-42a8-9c2e-64d914d7af2e tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:37.535189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebe16e50-0fc2-42a8-9c2e-64d914d7af2e tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:37.536549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebe16e50-0fc2-42a8-9c2e-64d914d7af2e tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:37.551400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebe16e50-0fc2-42a8-9c2e-64d914d7af2e tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:37.552220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebe16e50-0fc2-42a8-9c2e-64d914d7af2e tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:37.552904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebe16e50-0fc2-42a8-9c2e-64d914d7af2e tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:37.567397 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-ebe16e50-0fc2-42a8-9c2e-64d914d7af2e tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-842379945 could not be found. Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ebe16e50-0fc2-42a8-9c2e-64d914d7af2e tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Request method failure captured: Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 57 Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpGZVatLCncpe98xrMICgS5D94JY8aUEcGMY9o-a_5Bq_DUQXK5pjrwDWPz3r2aXsVL99YzcoS_sugtHH9yzdSvLWD37NNUeDBsoO_QXFUpgnRwQOyZsoyJBesOliql_JT-gTlduJpm16HTuBv5ifa9Q0laP4meDSK2AkVo_gMCzPg Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 97762c0f4aad40ee89465ace1c52cede Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:25:37.569907 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:25:37.571217 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_97762c0f4aad40ee89465ace1c52cede", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/97762c0f4aad40ee89465ace1c52cede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/97762c0f4aad40ee89465ace1c52cede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/97762c0f4aad40ee89465ace1c52cede"}]}] Aug 29 15:25:37.571217 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:37.571217 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 97762c0f4aad40ee89465ace1c52cede Aug 29 15:25:37.571217 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:37.571217 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin Aug 29 15:25:37.571217 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:37.571217 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:37.571217 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 33392f26b6424b45b5cd71eabcd15bf9 Aug 29 15:25:37.571217 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin Aug 29 15:25:37.571217 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:25:37.571217 n-d-839401-11 devstack@n-api.service[122361]: {"add_host": {"host": "tempest-nonexist_host-842379945"}} Aug 29 15:25:37.571217 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: exception: Compute host tempest-nonexist_host-842379945 could not be found. Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '6', 'body': {'add_host': {'host': 'tempest-nonexist_host-842379945'}}} Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-842379945' is not mapped to any cell Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.571868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 29 15:25:37.573154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-842379945 could not be found. Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-842379945 could not be found. Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:37.574237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.577750 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.577750 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:37.577750 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:37.577750 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:37.577750 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:37.577750 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-842379945 could not be found. Aug 29 15:25:37.577750 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.579851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ebe16e50-0fc2-42a8-9c2e-64d914d7af2e tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-842379945 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:37.580975 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ebe16e50-0fc2-42a8-9c2e-64d914d7af2e tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/6/action" status: 404 len: 110 microversion: 2.1 time: 0.082684 Aug 29 15:25:37.585260 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 150/256] 10.222.0.62 () {60 vars in 1191 bytes} [Mon Aug 29 15:25:37 2022] POST /compute/v2.1/os-aggregates/6/action => generated 110 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:37.592149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-79ce7364-14cf-4a17-be7b-a840ae7f2a02 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-839401-11"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:37.600734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-28a70e9e-af61-429d-b1e8-e671685e7826 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:37.609589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79ce7364-14cf-4a17-be7b-a840ae7f2a02 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:37.610437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79ce7364-14cf-4a17-be7b-a840ae7f2a02 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:37.611828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79ce7364-14cf-4a17-be7b-a840ae7f2a02 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:37.612790 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-28a70e9e-af61-429d-b1e8-e671685e7826 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1319 microversion: 2.1 time: 0.409292 Aug 29 15:25:37.618035 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 107/257] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:37 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1319 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:37.631475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-410e4e12-09bd-4ced-a9d7-64fde292a335 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:37.669838 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-410e4e12-09bd-4ced-a9d7-64fde292a335 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.048908 Aug 29 15:25:37.671059 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 108/258] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:37 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:37.689803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d1e3447-bc4b-4975-91aa-671a86259324 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d1e3447-bc4b-4975-91aa-671a86259324 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Request method failure captured: Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 283 Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpGZVatLCncpe98xrMICgS5D94JY8aUEcGMY9o-a_5Bq_DUQXK5pjrwDWPz3r2aXsVL99YzcoS_sugtHH9yzdSvLWD37NNUeDBsoO_QXFUpgnRwQOyZsoyJBesOliql_JT-gTlduJpm16HTuBv5ifa9Q0laP4meDSK2AkVo_gMCzPg Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 97762c0f4aad40ee89465ace1c52cede Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:25:37.699094 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:25:37.700286 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_97762c0f4aad40ee89465ace1c52cede", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/97762c0f4aad40ee89465ace1c52cede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/97762c0f4aad40ee89465ace1c52cede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/97762c0f4aad40ee89465ace1c52cede"}]}] Aug 29 15:25:37.700286 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:37.700286 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 97762c0f4aad40ee89465ace1c52cede Aug 29 15:25:37.700286 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:37.700286 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin Aug 29 15:25:37.700286 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:37.700286 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:37.700286 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 33392f26b6424b45b5cd71eabcd15bf9 Aug 29 15:25:37.700286 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin Aug 29 15:25:37.700286 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:25:37.700824 n-d-839401-11 devstack@n-api.service[122360]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 29 15:25:37.700824 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:37.700824 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:25:37.700824 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 29 15:25:37.700824 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:37.700824 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.700824 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:25:37.700824 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:25:37.700824 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:25:37.700824 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:37.701458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:37.702353 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:37.702353 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:37.702353 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:25:37.702353 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:25:37.702353 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:25:37.702353 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:25:37.702353 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:25:37.702353 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:25:37.702353 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:25:37.702353 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.702353 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:37.702353 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.702353 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.702353 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:37.702353 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:37.703154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:25:37.703154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:25:37.703154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:25:37.703154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.703154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d1e3447-bc4b-4975-91aa-671a86259324 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:37.703469 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d1e3447-bc4b-4975-91aa-671a86259324 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.022950 Aug 29 15:25:37.706462 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 109/259] 10.222.0.62 () {60 vars in 1165 bytes} [Mon Aug 29 15:25:37 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:25:37.715590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98b7d798-ea68-4de2-9139-0d9637eb9ddc tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98b7d798-ea68-4de2-9139-0d9637eb9ddc tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Request method failure captured: Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 27 Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpGZVatLCncpe98xrMICgS5D94JY8aUEcGMY9o-a_5Bq_DUQXK5pjrwDWPz3r2aXsVL99YzcoS_sugtHH9yzdSvLWD37NNUeDBsoO_QXFUpgnRwQOyZsoyJBesOliql_JT-gTlduJpm16HTuBv5ifa9Q0laP4meDSK2AkVo_gMCzPg Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 97762c0f4aad40ee89465ace1c52cede Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:25:37.721348 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:25:37.722617 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_97762c0f4aad40ee89465ace1c52cede", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/97762c0f4aad40ee89465ace1c52cede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/97762c0f4aad40ee89465ace1c52cede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/97762c0f4aad40ee89465ace1c52cede"}]}] Aug 29 15:25:37.722617 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:37.722617 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 97762c0f4aad40ee89465ace1c52cede Aug 29 15:25:37.722617 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:37.722617 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin Aug 29 15:25:37.722617 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:37.722617 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:37.722617 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 33392f26b6424b45b5cd71eabcd15bf9 Aug 29 15:25:37.722617 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin Aug 29 15:25:37.722617 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:25:37.722617 n-d-839401-11 devstack@n-api.service[122360]: {"aggregate": {"name": ""}} Aug 29 15:25:37.722617 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:37.722617 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi '' Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:37.723316 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:25:37.725871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.729131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98b7d798-ea68-4de2-9139-0d9637eb9ddc tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:37.729131 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-98b7d798-ea68-4de2-9139-0d9637eb9ddc tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.015260 Aug 29 15:25:37.729131 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 110/260] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:37 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:25:37.734459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4c3b1069-366d-4e67-a25b-64539770c38a tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-306393714"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:37.744461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4c3b1069-366d-4e67-a25b-64539770c38a tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'aec01767281843908fef58889bb1508a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43b659a0434e389dc09d139fc1b401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4c3b1069-366d-4e67-a25b-64539770c38a tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Request method failure captured: Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 59 Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpEn7qJZicsBwp7OEEsvKnz6xHVr_Zdu_wVI9JxyKYe5PH5hshLZSztV_kOjkR58LHkk35PXaHmJjoFzJJ0pRFIb1iYsVktDe3TSQRvaPw1di42Ey9Lz8CNXdwh-9rWGIMoe92a-eTlTs_YcTweBSoMJnT_hFaANl8xLHd33YtEpOI Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bc43b659a0434e389dc09d139fc1b401 Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:25:37.746460 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:25:37.747641 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc43b659a0434e389dc09d139fc1b401", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc43b659a0434e389dc09d139fc1b401"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc43b659a0434e389dc09d139fc1b401"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc43b659a0434e389dc09d139fc1b401"}]}] Aug 29 15:25:37.747641 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:37.747641 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bc43b659a0434e389dc09d139fc1b401 Aug 29 15:25:37.747641 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:37.747641 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AggregatesAdminNegativeTestJSON-1997319088-project Aug 29 15:25:37.747641 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:37.747641 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:37.747641 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: aec01767281843908fef58889bb1508a Aug 29 15:25:37.747641 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088-project Aug 29 15:25:37.747641 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:25:37.747641 n-d-839401-11 devstack@n-api.service[122360]: {"aggregate": {"name": "tempest-test_aggregate-306393714"}} Aug 29 15:25:37.747641 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:37.747641 n-d-839401-11 devstack@n-api.service[122360]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-306393714'}}} Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:37.748440 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:37.750265 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 29 15:25:37.753186 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.753186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4c3b1069-366d-4e67-a25b-64539770c38a tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:37.753186 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4c3b1069-366d-4e67-a25b-64539770c38a tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.018548 Aug 29 15:25:37.754449 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 111/261] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:37 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:37.759741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-45590b40-e8f9-403d-81b8-e3e2b0767de8 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1194061754"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:37.765416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.aggregate [None req-45590b40-e8f9-403d-81b8-e3e2b0767de8 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Generated uuid c986d6b0-3829-4adf-b6c1-d0497d197fe2 for aggregate {{(pid=122360) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:37.807379 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-45590b40-e8f9-403d-81b8-e3e2b0767de8 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049276 Aug 29 15:25:37.815006 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 112/262] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:37.830265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-64d59455-2dda-4f09-b0ff-2b24a05f22a9 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1194061754"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:37.840044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.aggregate [None req-64d59455-2dda-4f09-b0ff-2b24a05f22a9 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Generated uuid be115eb2-3406-4ab9-8e48-719e10ce9369 for aggregate {{(pid=122360) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:37.840923 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-79ce7364-14cf-4a17-be7b-a840ae7f2a02 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.253978 Aug 29 15:25:37.842060 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 151/263] 10.222.0.62 () {60 vars in 1191 bytes} [Mon Aug 29 15:25:37 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:37.854676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e47d18c0-82a1-45c1-a2d5-4c196a447837 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:37.854857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=7,nova_api:INSERT=5 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:37.870433 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-64d59455-2dda-4f09-b0ff-2b24a05f22a9 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1194061754 already exists. Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-64d59455-2dda-4f09-b0ff-2b24a05f22a9 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Request method failure captured: Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 60 Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpGZVatLCncpe98xrMICgS5D94JY8aUEcGMY9o-a_5Bq_DUQXK5pjrwDWPz3r2aXsVL99YzcoS_sugtHH9yzdSvLWD37NNUeDBsoO_QXFUpgnRwQOyZsoyJBesOliql_JT-gTlduJpm16HTuBv5ifa9Q0laP4meDSK2AkVo_gMCzPg Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 97762c0f4aad40ee89465ace1c52cede Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:25:37.879269 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:25:37.880783 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_97762c0f4aad40ee89465ace1c52cede", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/97762c0f4aad40ee89465ace1c52cede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/97762c0f4aad40ee89465ace1c52cede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/97762c0f4aad40ee89465ace1c52cede"}]}] Aug 29 15:25:37.880783 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:37.880783 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 97762c0f4aad40ee89465ace1c52cede Aug 29 15:25:37.880783 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:37.880783 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin Aug 29 15:25:37.880783 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:37.880783 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:37.880783 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 33392f26b6424b45b5cd71eabcd15bf9 Aug 29 15:25:37.880783 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin Aug 29 15:25:37.880783 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:25:37.880783 n-d-839401-11 devstack@n-api.service[122360]: {"aggregate": {"name": "tempest-test_aggregate-1194061754"}} Aug 29 15:25:37.880783 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:37.880783 n-d-839401-11 devstack@n-api.service[122360]: exception: Aggregate tempest-test_aggregate-1194061754 already exists. Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1194061754'}}} Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 29 15:25:37.881727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1194061754 already exists. Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:37.882970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 29 15:25:37.884262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 29 15:25:37.884262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1194061754 already exists. Aug 29 15:25:37.884262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.884262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:37.884262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.884262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:37.884262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:37.884262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:37.884262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:37.884262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:37.884262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1194061754 already exists. Aug 29 15:25:37.884262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:37.890994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-64d59455-2dda-4f09-b0ff-2b24a05f22a9 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1194061754 already exists. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:37.892167 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-64d59455-2dda-4f09-b0ff-2b24a05f22a9 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.074321 Aug 29 15:25:37.892364 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e47d18c0-82a1-45c1-a2d5-4c196a447837 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "GET /compute/v2.1/os-aggregates" status: 200 len: 459 microversion: 2.1 time: 0.040310 Aug 29 15:25:37.894722 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 113/264] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:37 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:25:37.894861 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 152/265] 10.222.0.62 () {58 vars in 1143 bytes} [Mon Aug 29 15:25:37 2022] GET /compute/v2.1/os-aggregates => generated 459 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:25:37.911206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-57f93eb4-9d96-4aab-8c57-446b57f4b025 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:37.914737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-26a60d6a-f5be-460b-a23e-0cd87a861dd1 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-839401-11"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:37.943677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26a60d6a-f5be-460b-a23e-0cd87a861dd1 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:37.944318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26a60d6a-f5be-460b-a23e-0cd87a861dd1 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:37.945805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26a60d6a-f5be-460b-a23e-0cd87a861dd1 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:37.958445 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-57f93eb4-9d96-4aab-8c57-446b57f4b025 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.059537 Aug 29 15:25:37.959193 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 153/266] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:37 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:37.976772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-124520ca-fad1-4a93-9c3d-edb5110f8b26 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1203651031"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:37.987173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:37.989836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.aggregate [None req-124520ca-fad1-4a93-9c3d-edb5110f8b26 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Generated uuid 199317ca-30dc-4b61-8430-db5223ce17c0 for aggregate {{(pid=122361) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:38.039454 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-124520ca-fad1-4a93-9c3d-edb5110f8b26 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072918 Aug 29 15:25:38.040067 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 154/267] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:38.061304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0e4b8c60-af98-447b-b088-e137fd38a102 tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:38.071408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0e4b8c60-af98-447b-b088-e137fd38a102 tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'aec01767281843908fef58889bb1508a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43b659a0434e389dc09d139fc1b401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0e4b8c60-af98-447b-b088-e137fd38a102 tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Request method failure captured: Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/os-aggregates/9 HTTP/1.1 Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpEn7qJZicsBwp7OEEsvKnz6xHVr_Zdu_wVI9JxyKYe5PH5hshLZSztV_kOjkR58LHkk35PXaHmJjoFzJJ0pRFIb1iYsVktDe3TSQRvaPw1di42Ey9Lz8CNXdwh-9rWGIMoe92a-eTlTs_YcTweBSoMJnT_hFaANl8xLHd33YtEpOI Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bc43b659a0434e389dc09d139fc1b401 Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:38.078343 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:38.080153 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc43b659a0434e389dc09d139fc1b401", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc43b659a0434e389dc09d139fc1b401"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc43b659a0434e389dc09d139fc1b401"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc43b659a0434e389dc09d139fc1b401"}]}] Aug 29 15:25:38.080153 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:38.080153 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bc43b659a0434e389dc09d139fc1b401 Aug 29 15:25:38.080153 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:38.080153 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AggregatesAdminNegativeTestJSON-1997319088-project Aug 29 15:25:38.080153 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:38.080153 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:38.080153 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: aec01767281843908fef58889bb1508a Aug 29 15:25:38.080153 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088-project Aug 29 15:25:38.080153 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:25:38.080153 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 29 15:25:38.080153 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '9'} Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:38.080951 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:38.082205 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:38.082205 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:38.082205 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:38.082205 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:38.082205 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:38.082205 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 29 15:25:38.082205 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.082205 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:38.082205 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.082205 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:38.082205 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:38.082205 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:38.082205 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:38.082205 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:38.082205 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 29 15:25:38.082205 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.086155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0e4b8c60-af98-447b-b088-e137fd38a102 tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:38.089352 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0e4b8c60-af98-447b-b088-e137fd38a102 tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/9" status: 403 len: 116 microversion: 2.1 time: 0.036616 Aug 29 15:25:38.090701 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 155/268] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:38 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 116 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:38.102831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-89ac433a-8a0d-4c29-b249-7eadfc52d562 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:38.135794 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-89ac433a-8a0d-4c29-b249-7eadfc52d562 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.038528 Aug 29 15:25:38.135794 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 156/269] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:38 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:38.155099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-23803687-94cf-40d2-9b88-0e72f46594c8 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:38.162408 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-26a60d6a-f5be-460b-a23e-0cd87a861dd1 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 226 microversion: 2.1 time: 0.256536 Aug 29 15:25:38.163026 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 114/270] 10.222.0.62 () {60 vars in 1191 bytes} [Mon Aug 29 15:25:37 2022] POST /compute/v2.1/os-aggregates/7/action => generated 226 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:25:38.175171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-27c842c3-ba04-48da-9ee6-5d8ccfa228f7 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:38.189332 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-23803687-94cf-40d2-9b88-0e72f46594c8 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-23803687-94cf-40d2-9b88-0e72f46594c8 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Request method failure captured: Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpGZVatLCncpe98xrMICgS5D94JY8aUEcGMY9o-a_5Bq_DUQXK5pjrwDWPz3r2aXsVL99YzcoS_sugtHH9yzdSvLWD37NNUeDBsoO_QXFUpgnRwQOyZsoyJBesOliql_JT-gTlduJpm16HTuBv5ifa9Q0laP4meDSK2AkVo_gMCzPg Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 97762c0f4aad40ee89465ace1c52cede Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:25:38.192834 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:25:38.194053 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_97762c0f4aad40ee89465ace1c52cede", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/97762c0f4aad40ee89465ace1c52cede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/97762c0f4aad40ee89465ace1c52cede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/97762c0f4aad40ee89465ace1c52cede"}]}] Aug 29 15:25:38.194053 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:38.194053 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 97762c0f4aad40ee89465ace1c52cede Aug 29 15:25:38.194053 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:38.194053 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin Aug 29 15:25:38.194053 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:38.194053 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:38.194053 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 33392f26b6424b45b5cd71eabcd15bf9 Aug 29 15:25:38.194053 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin Aug 29 15:25:38.194053 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:25:38.194053 n-d-839401-11 devstack@n-api.service[122361]: exception: Aggregate -1 could not be found. Aug 29 15:25:38.194053 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '-1'} Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:25:38.194697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.195697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:38.197330 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:38.197330 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:38.197330 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:38.197330 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:38.197330 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 29 15:25:38.197330 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.197330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-23803687-94cf-40d2-9b88-0e72f46594c8 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:38.197330 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-23803687-94cf-40d2-9b88-0e72f46594c8 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.045369 Aug 29 15:25:38.203100 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 157/271] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 15:25:38 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:25:38.210887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9353573a-3854-46f4-a170-cc1f5bd0fd8a tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1275736127"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:38.216840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.aggregate [None req-9353573a-3854-46f4-a170-cc1f5bd0fd8a tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Generated uuid c7101ced-99bf-4f3c-b6fc-8cf156f5f2b9 for aggregate {{(pid=122361) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:38.226853 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-27c842c3-ba04-48da-9ee6-5d8ccfa228f7 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.055540 Aug 29 15:25:38.227859 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 115/272] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:38 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:38.239337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-183ade5f-db12-4f72-911a-702fb07d850a tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1897649324"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:38.245830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.aggregate [None req-183ade5f-db12-4f72-911a-702fb07d850a tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Generated uuid 620c53b6-596f-4c34-9652-99387a3ad745 for aggregate {{(pid=122360) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:38.260164 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9353573a-3854-46f4-a170-cc1f5bd0fd8a tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.053376 Aug 29 15:25:38.260775 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 158/273] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:38.279700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-45c99ab6-c658-4815-93f3-bd513520e27b tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:38.281417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-45c99ab6-c658-4815-93f3-bd513520e27b tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'aec01767281843908fef58889bb1508a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43b659a0434e389dc09d139fc1b401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-45c99ab6-c658-4815-93f3-bd513520e27b tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Request method failure captured: Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-aggregates/10 HTTP/1.1 Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpEn7qJZicsBwp7OEEsvKnz6xHVr_Zdu_wVI9JxyKYe5PH5hshLZSztV_kOjkR58LHkk35PXaHmJjoFzJJ0pRFIb1iYsVktDe3TSQRvaPw1di42Ey9Lz8CNXdwh-9rWGIMoe92a-eTlTs_YcTweBSoMJnT_hFaANl8xLHd33YtEpOI Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bc43b659a0434e389dc09d139fc1b401 Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:38.283607 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:38.284814 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc43b659a0434e389dc09d139fc1b401", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc43b659a0434e389dc09d139fc1b401"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc43b659a0434e389dc09d139fc1b401"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc43b659a0434e389dc09d139fc1b401"}]}] Aug 29 15:25:38.284814 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:38.284814 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bc43b659a0434e389dc09d139fc1b401 Aug 29 15:25:38.284814 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:38.284814 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AggregatesAdminNegativeTestJSON-1997319088-project Aug 29 15:25:38.284814 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:38.284814 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:38.284814 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: aec01767281843908fef58889bb1508a Aug 29 15:25:38.284814 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088-project Aug 29 15:25:38.284814 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:25:38.284814 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 29 15:25:38.284814 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '10'} Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:38.289454 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.290777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-45c99ab6-c658-4815-93f3-bd513520e27b tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:38.291682 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-45c99ab6-c658-4815-93f3-bd513520e27b tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] 10.222.0.62 "GET /compute/v2.1/os-aggregates/10" status: 403 len: 114 microversion: 2.1 time: 0.016414 Aug 29 15:25:38.291682 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 159/274] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:38 2022] GET /compute/v2.1/os-aggregates/10 => generated 114 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:38.300733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ca7e0b83-a2e9-4e6d-a8d2-5bb5bcc03bef tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:38.302633 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-183ade5f-db12-4f72-911a-702fb07d850a tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.068361 Aug 29 15:25:38.303815 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 116/275] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:38.315725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5d12c97c-8d13-40ac-91c0-654e42d62d98 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-839401-11"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:38.343115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d12c97c-8d13-40ac-91c0-654e42d62d98 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:38.343627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d12c97c-8d13-40ac-91c0-654e42d62d98 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:38.344069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d12c97c-8d13-40ac-91c0-654e42d62d98 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:38.366522 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ca7e0b83-a2e9-4e6d-a8d2-5bb5bcc03bef tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.070808 Aug 29 15:25:38.372608 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 160/276] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 15:25:38 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:38.381191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-940d8630-1138-4832-bbc7-7a66d1bc3a00 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:38.399767 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-940d8630-1138-4832-bbc7-7a66d1bc3a00 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-940d8630-1138-4832-bbc7-7a66d1bc3a00 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Request method failure captured: Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpGZVatLCncpe98xrMICgS5D94JY8aUEcGMY9o-a_5Bq_DUQXK5pjrwDWPz3r2aXsVL99YzcoS_sugtHH9yzdSvLWD37NNUeDBsoO_QXFUpgnRwQOyZsoyJBesOliql_JT-gTlduJpm16HTuBv5ifa9Q0laP4meDSK2AkVo_gMCzPg Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 97762c0f4aad40ee89465ace1c52cede Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:25:38.406620 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:25:38.408055 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_97762c0f4aad40ee89465ace1c52cede", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/97762c0f4aad40ee89465ace1c52cede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/97762c0f4aad40ee89465ace1c52cede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/97762c0f4aad40ee89465ace1c52cede"}]}] Aug 29 15:25:38.408055 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:38.408055 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 97762c0f4aad40ee89465ace1c52cede Aug 29 15:25:38.408055 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:38.408055 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin Aug 29 15:25:38.408055 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:38.408055 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:38.408055 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 33392f26b6424b45b5cd71eabcd15bf9 Aug 29 15:25:38.408055 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin Aug 29 15:25:38.408055 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:25:38.408055 n-d-839401-11 devstack@n-api.service[122361]: exception: Aggregate -1 could not be found. Aug 29 15:25:38.408055 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '-1'} Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:38.408791 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 29 15:25:38.409900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.412630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-940d8630-1138-4832-bbc7-7a66d1bc3a00 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:38.415790 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-940d8630-1138-4832-bbc7-7a66d1bc3a00 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.041780 Aug 29 15:25:38.425588 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 161/277] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:38 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:25:38.441448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ce8f5ea8-4e35-4922-a369-85b8b6764006 tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:38.443030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ce8f5ea8-4e35-4922-a369-85b8b6764006 tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'aec01767281843908fef58889bb1508a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43b659a0434e389dc09d139fc1b401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ce8f5ea8-4e35-4922-a369-85b8b6764006 tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Request method failure captured: Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpEn7qJZicsBwp7OEEsvKnz6xHVr_Zdu_wVI9JxyKYe5PH5hshLZSztV_kOjkR58LHkk35PXaHmJjoFzJJ0pRFIb1iYsVktDe3TSQRvaPw1di42Ey9Lz8CNXdwh-9rWGIMoe92a-eTlTs_YcTweBSoMJnT_hFaANl8xLHd33YtEpOI Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bc43b659a0434e389dc09d139fc1b401 Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:38.444579 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:38.445969 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc43b659a0434e389dc09d139fc1b401", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc43b659a0434e389dc09d139fc1b401"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc43b659a0434e389dc09d139fc1b401"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc43b659a0434e389dc09d139fc1b401"}]}] Aug 29 15:25:38.445969 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:38.445969 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bc43b659a0434e389dc09d139fc1b401 Aug 29 15:25:38.445969 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:38.445969 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AggregatesAdminNegativeTestJSON-1997319088-project Aug 29 15:25:38.445969 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:38.445969 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:38.445969 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: aec01767281843908fef58889bb1508a Aug 29 15:25:38.445969 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088-project Aug 29 15:25:38.445969 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:25:38.445969 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 29 15:25:38.445969 n-d-839401-11 devstack@n-api.service[122361]: action_args: {} Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:38.446644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:38.449467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:38.449467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:38.449467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:38.449467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:38.449467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:38.449467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 29 15:25:38.449467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.449467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:38.449467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.449467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:38.449467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:38.449467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:38.449467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:38.449467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:38.449467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 29 15:25:38.449467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:38.465902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ce8f5ea8-4e35-4922-a369-85b8b6764006 tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:38.467031 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ce8f5ea8-4e35-4922-a369-85b8b6764006 tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] 10.222.0.62 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.038579 Aug 29 15:25:38.472582 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 162/278] 10.222.0.62 () {58 vars in 1143 bytes} [Mon Aug 29 15:25:38 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:38.608579 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5d12c97c-8d13-40ac-91c0-654e42d62d98 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 244 microversion: 2.1 time: 0.296765 Aug 29 15:25:38.610024 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 117/279] 10.222.0.62 () {60 vars in 1194 bytes} [Mon Aug 29 15:25:38 2022] POST /compute/v2.1/os-aggregates/11/action => generated 244 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:25:38.624180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c9fe249d-f293-40dd-ae4e-47de87430dfa tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-839401-11"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:38.634067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-12914f0e-839c-4c5a-aaf6-0b586c01f3be tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:38.634771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-12914f0e-839c-4c5a-aaf6-0b586c01f3be tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:38.635178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9fe249d-f293-40dd-ae4e-47de87430dfa tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:38.635880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9fe249d-f293-40dd-ae4e-47de87430dfa tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:38.636695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9fe249d-f293-40dd-ae4e-47de87430dfa tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:38.674739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12914f0e-839c-4c5a-aaf6-0b586c01f3be tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:38.676165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12914f0e-839c-4c5a-aaf6-0b586c01f3be tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:38.677147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12914f0e-839c-4c5a-aaf6-0b586c01f3be tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:38.678593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12914f0e-839c-4c5a-aaf6-0b586c01f3be tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:38.679423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12914f0e-839c-4c5a-aaf6-0b586c01f3be tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:38.680119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12914f0e-839c-4c5a-aaf6-0b586c01f3be tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:38.834188 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c9fe249d-f293-40dd-ae4e-47de87430dfa tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.215618 Aug 29 15:25:38.837441 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 163/280] 10.222.0.62 () {60 vars in 1194 bytes} [Mon Aug 29 15:25:38 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:38.856138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a3cd54ec-1eec-4acf-9301-ebeed13c7eb8 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:38.892275 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a3cd54ec-1eec-4acf-9301-ebeed13c7eb8 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.045923 Aug 29 15:25:38.893207 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 164/281] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 15:25:38 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:38.917298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d4688638-7654-4493-ac79-71b2d65484e2 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1020388864"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:38.926947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.aggregate [None req-d4688638-7654-4493-ac79-71b2d65484e2 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Generated uuid e32fa119-7896-4dd6-838d-5b15be459a39 for aggregate {{(pid=122361) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:38.978856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-12914f0e-839c-4c5a-aaf6-0b586c01f3be tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:38.979048 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d4688638-7654-4493-ac79-71b2d65484e2 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.078158 Aug 29 15:25:38.980658 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 165/282] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:39.012712 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-12914f0e-839c-4c5a-aaf6-0b586c01f3be tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1319 microversion: 2.1 time: 0.381160 Aug 29 15:25:39.015077 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 118/283] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:38 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:39.024247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aafa5bc0-fd02-488f-815a-3b1643f687b3 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1585692349"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:39.044826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.aggregate [None req-aafa5bc0-fd02-488f-815a-3b1643f687b3 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Generated uuid f2fd6d95-e012-446e-a97c-d99f95323766 for aggregate {{(pid=122360) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:39.094491 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aafa5bc0-fd02-488f-815a-3b1643f687b3 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.075174 Aug 29 15:25:39.101436 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 119/284] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:39.116982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1df363a5-fc99-4eee-bf23-4ace8fcc3ab2 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:39.162390 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1df363a5-fc99-4eee-bf23-4ace8fcc3ab2 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.058530 Aug 29 15:25:39.163158 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 120/285] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 15:25:39 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:39.173536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-38bd0def-7afd-492f-bfe6-e4f7274c87e0 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-839401-11"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:39.211900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38bd0def-7afd-492f-bfe6-e4f7274c87e0 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:39.213552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38bd0def-7afd-492f-bfe6-e4f7274c87e0 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:39.215964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38bd0def-7afd-492f-bfe6-e4f7274c87e0 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:39.475496 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-38bd0def-7afd-492f-bfe6-e4f7274c87e0 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 244 microversion: 2.1 time: 0.311081 Aug 29 15:25:39.483262 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 121/286] 10.222.0.62 () {60 vars in 1194 bytes} [Mon Aug 29 15:25:39 2022] POST /compute/v2.1/os-aggregates/13/action => generated 244 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:39.488040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-974e2586-c65c-4388-a42e-9d040a4aa61b tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:39.504435 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-974e2586-c65c-4388-a42e-9d040a4aa61b tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-974e2586-c65c-4388-a42e-9d040a4aa61b tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Request method failure captured: Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpGQgScBgkz1JV5jR2tYcWeF8ejG3BjY9bAupmmDlRGPkGTluDwjsghSop6uX9GWFmr8uEABZHgWy1XgwAO__9dyviJrKN0vhIL6xOa7FPCEYEXR5J4J_hS4sxpf0EmRZlfvdlcwh2kSFuA3Vf-Q_4pJu6uUv5KUC2pWYh9G_on96o Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 2c59275f55b44049a08758188de63139 Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AggregatesAdminTestJSON-609932427 Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:25:39.510021 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:25:39.511312 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2c59275f55b44049a08758188de63139", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2c59275f55b44049a08758188de63139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2c59275f55b44049a08758188de63139"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2c59275f55b44049a08758188de63139"}]}] Aug 29 15:25:39.511312 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AggregatesAdminTestJSON-609932427 Aug 29 15:25:39.511312 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 2c59275f55b44049a08758188de63139 Aug 29 15:25:39.511312 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-609932427 Aug 29 15:25:39.511312 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AggregatesAdminTestJSON-609932427-project-admin Aug 29 15:25:39.511312 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:39.511312 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:39.511312 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: fb43ce813ea9446d9ee27dc3e594582f Aug 29 15:25:39.511312 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AggregatesAdminTestJSON-609932427-project-admin Aug 29 15:25:39.511312 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:39.511312 n-d-839401-11 devstack@n-api.service[122360]: exception: Aggregate 12 could not be found. Aug 29 15:25:39.511312 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '12'} Aug 29 15:25:39.511312 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:39.512120 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 29 15:25:39.513204 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.516622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-974e2586-c65c-4388-a42e-9d040a4aa61b tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:39.516622 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-974e2586-c65c-4388-a42e-9d040a4aa61b tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.033454 Aug 29 15:25:39.516622 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 122/287] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:39 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:25:39.524922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-135f0f48-9497-43be-9a4f-f47242ec67a8 tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-839401-11"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:39.532508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-135f0f48-9497-43be-9a4f-f47242ec67a8 tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'aec01767281843908fef58889bb1508a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc43b659a0434e389dc09d139fc1b401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-135f0f48-9497-43be-9a4f-f47242ec67a8 tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Request method failure captured: Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 43 Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpEn7qJZicsBwp7OEEsvKnz6xHVr_Zdu_wVI9JxyKYe5PH5hshLZSztV_kOjkR58LHkk35PXaHmJjoFzJJ0pRFIb1iYsVktDe3TSQRvaPw1di42Ey9Lz8CNXdwh-9rWGIMoe92a-eTlTs_YcTweBSoMJnT_hFaANl8xLHd33YtEpOI Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bc43b659a0434e389dc09d139fc1b401 Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:25:39.534207 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:25:39.535386 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc43b659a0434e389dc09d139fc1b401", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc43b659a0434e389dc09d139fc1b401"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc43b659a0434e389dc09d139fc1b401"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc43b659a0434e389dc09d139fc1b401"}]}] Aug 29 15:25:39.535386 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:39.535386 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bc43b659a0434e389dc09d139fc1b401 Aug 29 15:25:39.535386 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088 Aug 29 15:25:39.535386 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AggregatesAdminNegativeTestJSON-1997319088-project Aug 29 15:25:39.535386 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:39.535386 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:39.535386 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: aec01767281843908fef58889bb1508a Aug 29 15:25:39.535386 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1997319088-project Aug 29 15:25:39.535386 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:25:39.535386 n-d-839401-11 devstack@n-api.service[122360]: {"remove_host": {"host": "n-h1-839401-11"}} Aug 29 15:25:39.535386 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:39.535386 n-d-839401-11 devstack@n-api.service[122360]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-839401-11'}}} Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:39.536100 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 29 15:25:39.537114 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.538117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-135f0f48-9497-43be-9a4f-f47242ec67a8 tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:39.544472 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-135f0f48-9497-43be-9a4f-f47242ec67a8 tempest-AggregatesAdminNegativeTestJSON-1997319088 tempest-AggregatesAdminNegativeTestJSON-1997319088-project] 10.222.0.62 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.031360 Aug 29 15:25:39.548531 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 123/288] 10.222.0.62 () {60 vars in 1194 bytes} [Mon Aug 29 15:25:39 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:39.557829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3fcd0f5c-6f49-42f4-b383-062ff1ab80b1 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:39.583448 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-3fcd0f5c-6f49-42f4-b383-062ff1ab80b1 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3fcd0f5c-6f49-42f4-b383-062ff1ab80b1 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Request method failure captured: Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpGQgScBgkz1JV5jR2tYcWeF8ejG3BjY9bAupmmDlRGPkGTluDwjsghSop6uX9GWFmr8uEABZHgWy1XgwAO__9dyviJrKN0vhIL6xOa7FPCEYEXR5J4J_hS4sxpf0EmRZlfvdlcwh2kSFuA3Vf-Q_4pJu6uUv5KUC2pWYh9G_on96o Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 2c59275f55b44049a08758188de63139 Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AggregatesAdminTestJSON-609932427 Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:25:39.586979 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:25:39.588164 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2c59275f55b44049a08758188de63139", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2c59275f55b44049a08758188de63139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2c59275f55b44049a08758188de63139"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2c59275f55b44049a08758188de63139"}]}] Aug 29 15:25:39.588164 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AggregatesAdminTestJSON-609932427 Aug 29 15:25:39.588164 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 2c59275f55b44049a08758188de63139 Aug 29 15:25:39.588164 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-609932427 Aug 29 15:25:39.588164 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AggregatesAdminTestJSON-609932427-project-admin Aug 29 15:25:39.588164 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:39.588164 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:39.588164 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: fb43ce813ea9446d9ee27dc3e594582f Aug 29 15:25:39.588164 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AggregatesAdminTestJSON-609932427-project-admin Aug 29 15:25:39.588164 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:39.588164 n-d-839401-11 devstack@n-api.service[122360]: exception: Aggregate 12 could not be found. Aug 29 15:25:39.588164 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '12'} Aug 29 15:25:39.588164 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:39.588863 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:39.590257 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:39.591445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:39.591445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:39.591445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:39.591445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 29 15:25:39.591445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.591445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3fcd0f5c-6f49-42f4-b383-062ff1ab80b1 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:39.591808 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3fcd0f5c-6f49-42f4-b383-062ff1ab80b1 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.044716 Aug 29 15:25:39.598464 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 124/289] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 15:25:39 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:25:39.604490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a0ca7502-98fe-4699-b96d-0c470e9db3f4 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-839401-11"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:39.634826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0ca7502-98fe-4699-b96d-0c470e9db3f4 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:39.636027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0ca7502-98fe-4699-b96d-0c470e9db3f4 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:39.636236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0ca7502-98fe-4699-b96d-0c470e9db3f4 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:39.709270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7a62597a-1ec8-499b-9c36-1ad5f86d13ad tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Calling method '.version_select at 0x7fc430365a60>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:39.714688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7a62597a-1ec8-499b-9c36-1ad5f86d13ad tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '6039a827b8e64cf68e1ab1946bb6ef25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81fb756a0fe4f919ea487c944acc920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7a62597a-1ec8-499b-9c36-1ad5f86d13ad tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Request method failure captured: Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpw4HhHrq1LLn7Kg8Afs7oNalVplwHFiWxiw2BxD7IQHWYDaXEWEBg9WTlZcR5viDbyNdaU01LMiUyQGXRM0mhEHWFlOQzLm98GkDCbxrpz9kyV3txJV5nfVywQrKiCgvpdz3SSebDqAjoHdKMdqtPlojE7zTPQB9z4zl7JeXr-YhI Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d81fb756a0fe4f919ea487c944acc920 Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1365219212 Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:39.718166 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:39.719708 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d81fb756a0fe4f919ea487c944acc920", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d81fb756a0fe4f919ea487c944acc920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d81fb756a0fe4f919ea487c944acc920"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d81fb756a0fe4f919ea487c944acc920"}]}] Aug 29 15:25:39.719708 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1365219212 Aug 29 15:25:39.719708 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d81fb756a0fe4f919ea487c944acc920 Aug 29 15:25:39.719708 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1365219212 Aug 29 15:25:39.719708 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HypervisorAdminNegativeTestJSON-1365219212-project Aug 29 15:25:39.719708 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:39.719708 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:39.719708 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6039a827b8e64cf68e1ab1946bb6ef25 Aug 29 15:25:39.719708 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1365219212-project Aug 29 15:25:39.719708 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:39.719708 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 29 15:25:39.719708 n-d-839401-11 devstack@n-api.service[122361]: action_args: {} Aug 29 15:25:39.719708 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:39.721004 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 29 15:25:39.722040 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.726679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7a62597a-1ec8-499b-9c36-1ad5f86d13ad tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:39.727709 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7a62597a-1ec8-499b-9c36-1ad5f86d13ad tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.736169 Aug 29 15:25:39.737349 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 166/290] 10.222.0.62 () {58 vars in 1167 bytes} [Mon Aug 29 15:25:38 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 756 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:39.757317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-83216785-b17c-45af-9ec7-0d7301701aa4 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1367535315", "name": "tempest-test_aggregate-1449867872"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:39.784912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.aggregate [None req-83216785-b17c-45af-9ec7-0d7301701aa4 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Generated uuid 7803928b-9ad5-44c4-9321-4c3f3691de54 for aggregate {{(pid=122361) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:39.822642 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a0ca7502-98fe-4699-b96d-0c470e9db3f4 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.226634 Aug 29 15:25:39.825963 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 125/291] 10.222.0.62 () {60 vars in 1194 bytes} [Mon Aug 29 15:25:39 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:39.827342 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-83216785-b17c-45af-9ec7-0d7301701aa4 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.088252 Aug 29 15:25:39.829916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=11 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:39.832441 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 167/292] 10.222.0.62 () {60 vars in 1165 bytes} [Mon Aug 29 15:25:39 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:39.842417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-697e0d18-ca7b-4aa8-916c-1aa77e36f64c tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:39.860618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-15c84793-d6b0-4b4c-9bc4-ec7f06a60625 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Calling method '.version_select at 0x7fc4301821f0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:39.872718 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-697e0d18-ca7b-4aa8-916c-1aa77e36f64c tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.039025 Aug 29 15:25:39.872867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-15c84793-d6b0-4b4c-9bc4-ec7f06a60625 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '6039a827b8e64cf68e1ab1946bb6ef25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81fb756a0fe4f919ea487c944acc920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:39.880421 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 168/293] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 15:25:39 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-15c84793-d6b0-4b4c-9bc4-ec7f06a60625 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Request method failure captured: Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpw4HhHrq1LLn7Kg8Afs7oNalVplwHFiWxiw2BxD7IQHWYDaXEWEBg9WTlZcR5viDbyNdaU01LMiUyQGXRM0mhEHWFlOQzLm98GkDCbxrpz9kyV3txJV5nfVywQrKiCgvpdz3SSebDqAjoHdKMdqtPlojE7zTPQB9z4zl7JeXr-YhI Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d81fb756a0fe4f919ea487c944acc920 Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1365219212 Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:25:39.881132 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:25:39.882287 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d81fb756a0fe4f919ea487c944acc920", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d81fb756a0fe4f919ea487c944acc920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d81fb756a0fe4f919ea487c944acc920"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d81fb756a0fe4f919ea487c944acc920"}]}] Aug 29 15:25:39.882287 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1365219212 Aug 29 15:25:39.882287 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d81fb756a0fe4f919ea487c944acc920 Aug 29 15:25:39.882287 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1365219212 Aug 29 15:25:39.882287 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-HypervisorAdminNegativeTestJSON-1365219212-project Aug 29 15:25:39.882287 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:39.882287 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:39.882287 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6039a827b8e64cf68e1ab1946bb6ef25 Aug 29 15:25:39.882287 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1365219212-project Aug 29 15:25:39.882287 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:25:39.882287 n-d-839401-11 devstack@n-api.service[122360]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 29 15:25:39.882287 n-d-839401-11 devstack@n-api.service[122360]: action_args: {} Aug 29 15:25:39.882287 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:39.883004 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 29 15:25:39.884031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:39.887736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-15c84793-d6b0-4b4c-9bc4-ec7f06a60625 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:39.887736 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-15c84793-d6b0-4b4c-9bc4-ec7f06a60625 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] 10.222.0.62 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.055459 Aug 29 15:25:39.890235 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 126/294] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:39 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 63 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:39.893664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d9cc7d61-094e-427f-9f98-bd100a2160a4 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:39.902394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-375626fa-e6e7-40b4-ad5f-e22fe60a2f41 req-c6975051-bb11-4b26-ac5d-f7c14e9a3b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cca7e11-1c42-471e-9b89-0b824a56618c", "tag": "0a551a27-53a7-4d37-a830-0211d8ad0f7b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:39.937669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-375626fa-e6e7-40b4-ad5f-e22fe60a2f41 req-c6975051-bb11-4b26-ac5d-f7c14e9a3b71 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:39.938084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-375626fa-e6e7-40b4-ad5f-e22fe60a2f41 req-c6975051-bb11-4b26-ac5d-f7c14e9a3b71 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:39.938572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-375626fa-e6e7-40b4-ad5f-e22fe60a2f41 req-c6975051-bb11-4b26-ac5d-f7c14e9a3b71 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:39.946600 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d9cc7d61-094e-427f-9f98-bd100a2160a4 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.060877 Aug 29 15:25:39.952442 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 169/295] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 15:25:39 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:39.965412 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-375626fa-e6e7-40b4-ad5f-e22fe60a2f41 req-c6975051-bb11-4b26-ac5d-f7c14e9a3b71 service nova] Creating event network-changed:0a551a27-53a7-4d37-a830-0211d8ad0f7b for instance 7cca7e11-1c42-471e-9b89-0b824a56618c on n-h2-839401-11 Aug 29 15:25:39.965603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3896a907-a244-42f5-86e8-3936ea7ebbba tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-6740845"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:39.975424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.aggregate [None req-3896a907-a244-42f5-86e8-3936ea7ebbba tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Generated uuid 8dc321e0-0876-4427-bc9e-aa26f733ce8c for aggregate {{(pid=122361) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:39.982188 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-375626fa-e6e7-40b4-ad5f-e22fe60a2f41 req-c6975051-bb11-4b26-ac5d-f7c14e9a3b71 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088589 Aug 29 15:25:39.984867 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 127/296] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:40.000490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0a70c0d0-eea0-448d-9d49-b43e128f96a9 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Calling method '.version_select at 0x7fc43037e040>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:40.005776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0a70c0d0-eea0-448d-9d49-b43e128f96a9 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '6039a827b8e64cf68e1ab1946bb6ef25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81fb756a0fe4f919ea487c944acc920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0a70c0d0-eea0-448d-9d49-b43e128f96a9 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Request method failure captured: Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpw4HhHrq1LLn7Kg8Afs7oNalVplwHFiWxiw2BxD7IQHWYDaXEWEBg9WTlZcR5viDbyNdaU01LMiUyQGXRM0mhEHWFlOQzLm98GkDCbxrpz9kyV3txJV5nfVywQrKiCgvpdz3SSebDqAjoHdKMdqtPlojE7zTPQB9z4zl7JeXr-YhI Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d81fb756a0fe4f919ea487c944acc920 Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1365219212 Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:25:40.009192 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:25:40.010518 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d81fb756a0fe4f919ea487c944acc920", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d81fb756a0fe4f919ea487c944acc920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d81fb756a0fe4f919ea487c944acc920"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d81fb756a0fe4f919ea487c944acc920"}]}] Aug 29 15:25:40.010518 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1365219212 Aug 29 15:25:40.010518 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d81fb756a0fe4f919ea487c944acc920 Aug 29 15:25:40.010518 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1365219212 Aug 29 15:25:40.010518 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-HypervisorAdminNegativeTestJSON-1365219212-project Aug 29 15:25:40.010518 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:40.010518 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:40.010518 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6039a827b8e64cf68e1ab1946bb6ef25 Aug 29 15:25:40.010518 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1365219212-project Aug 29 15:25:40.010518 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:25:40.010518 n-d-839401-11 devstack@n-api.service[122360]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 29 15:25:40.010518 n-d-839401-11 devstack@n-api.service[122360]: action_args: {} Aug 29 15:25:40.010518 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:40.011223 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 29 15:25:40.012238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.013174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0a70c0d0-eea0-448d-9d49-b43e128f96a9 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:40.013174 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0a70c0d0-eea0-448d-9d49-b43e128f96a9 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.025802 Aug 29 15:25:40.013174 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 128/297] 10.222.0.62 () {58 vars in 1179 bytes} [Mon Aug 29 15:25:39 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:40.029943 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3896a907-a244-42f5-86e8-3936ea7ebbba tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.076261 Aug 29 15:25:40.030442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e42109c2-9842-428a-8821-1131050d4645 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:40.043376 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 170/298] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:39 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:40.049531 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-e42109c2-9842-428a-8821-1131050d4645 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e42109c2-9842-428a-8821-1131050d4645 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Request method failure captured: Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpGQgScBgkz1JV5jR2tYcWeF8ejG3BjY9bAupmmDlRGPkGTluDwjsghSop6uX9GWFmr8uEABZHgWy1XgwAO__9dyviJrKN0vhIL6xOa7FPCEYEXR5J4J_hS4sxpf0EmRZlfvdlcwh2kSFuA3Vf-Q_4pJu6uUv5KUC2pWYh9G_on96o Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 2c59275f55b44049a08758188de63139 Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AggregatesAdminTestJSON-609932427 Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:25:40.051935 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:25:40.053615 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2c59275f55b44049a08758188de63139", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2c59275f55b44049a08758188de63139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2c59275f55b44049a08758188de63139"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2c59275f55b44049a08758188de63139"}]}] Aug 29 15:25:40.053615 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AggregatesAdminTestJSON-609932427 Aug 29 15:25:40.053615 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 2c59275f55b44049a08758188de63139 Aug 29 15:25:40.053615 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-609932427 Aug 29 15:25:40.053615 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AggregatesAdminTestJSON-609932427-project-admin Aug 29 15:25:40.053615 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:40.053615 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:40.053615 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: fb43ce813ea9446d9ee27dc3e594582f Aug 29 15:25:40.053615 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AggregatesAdminTestJSON-609932427-project-admin Aug 29 15:25:40.053615 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:40.053615 n-d-839401-11 devstack@n-api.service[122360]: exception: Aggregate 14 could not be found. Aug 29 15:25:40.053615 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '14'} Aug 29 15:25:40.053615 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.054331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 29 15:25:40.055322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.057755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e42109c2-9842-428a-8821-1131050d4645 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:40.057755 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e42109c2-9842-428a-8821-1131050d4645 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.040559 Aug 29 15:25:40.057755 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 129/299] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:40 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:25:40.064517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-36348d82-e219-4f21-ac4d-efe8dbd5cb24 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:40.065495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-36348d82-e219-4f21-ac4d-efe8dbd5cb24 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:40.073382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36348d82-e219-4f21-ac4d-efe8dbd5cb24 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:40.074018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36348d82-e219-4f21-ac4d-efe8dbd5cb24 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:40.074783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36348d82-e219-4f21-ac4d-efe8dbd5cb24 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:40.075393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36348d82-e219-4f21-ac4d-efe8dbd5cb24 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:40.076952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36348d82-e219-4f21-ac4d-efe8dbd5cb24 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:40.077583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36348d82-e219-4f21-ac4d-efe8dbd5cb24 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:40.298215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-36348d82-e219-4f21-ac4d-efe8dbd5cb24 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:40.311149 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-36348d82-e219-4f21-ac4d-efe8dbd5cb24 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1319 microversion: 2.1 time: 0.255224 Aug 29 15:25:40.311730 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 130/300] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:40 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:40.322406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2fa8860e-cd68-4eb8-8319-7c523b02d6ef tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:40.353703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2fa8860e-cd68-4eb8-8319-7c523b02d6ef tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:40.354209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2fa8860e-cd68-4eb8-8319-7c523b02d6ef tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:40.354649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2fa8860e-cd68-4eb8-8319-7c523b02d6ef tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:40.370521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2fa8860e-cd68-4eb8-8319-7c523b02d6ef tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:40.371306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2fa8860e-cd68-4eb8-8319-7c523b02d6ef tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:40.372042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2fa8860e-cd68-4eb8-8319-7c523b02d6ef tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:40.382436 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.compute.aggregates [None req-2fa8860e-cd68-4eb8-8319-7c523b02d6ef tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 29 15:25:40.383845 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-2fa8860e-cd68-4eb8-8319-7c523b02d6ef tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2fa8860e-cd68-4eb8-8319-7c523b02d6ef tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Request method failure captured: Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 42 Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpGZVatLCncpe98xrMICgS5D94JY8aUEcGMY9o-a_5Bq_DUQXK5pjrwDWPz3r2aXsVL99YzcoS_sugtHH9yzdSvLWD37NNUeDBsoO_QXFUpgnRwQOyZsoyJBesOliql_JT-gTlduJpm16HTuBv5ifa9Q0laP4meDSK2AkVo_gMCzPg Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 97762c0f4aad40ee89465ace1c52cede Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:25:40.388298 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:25:40.389560 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_97762c0f4aad40ee89465ace1c52cede", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/97762c0f4aad40ee89465ace1c52cede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/97762c0f4aad40ee89465ace1c52cede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/97762c0f4aad40ee89465ace1c52cede"}]}] Aug 29 15:25:40.389560 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:40.389560 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 97762c0f4aad40ee89465ace1c52cede Aug 29 15:25:40.389560 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355 Aug 29 15:25:40.389560 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin Aug 29 15:25:40.389560 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:40.389560 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:40.389560 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 33392f26b6424b45b5cd71eabcd15bf9 Aug 29 15:25:40.389560 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin Aug 29 15:25:40.389560 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:25:40.389560 n-d-839401-11 devstack@n-api.service[122360]: {"remove_host": {"host": "nonexist_host"}} Aug 29 15:25:40.389560 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:40.389560 n-d-839401-11 devstack@n-api.service[122360]: exception: Cannot remove host nonexist_host in aggregate 15 Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 29 15:25:40.390270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 29 15:25:40.391497 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.395077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.396708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:40.396708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:40.396708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:40.396708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:40.396708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Aug 29 15:25:40.396708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.399921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2fa8860e-cd68-4eb8-8319-7c523b02d6ef tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:40.401035 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2fa8860e-cd68-4eb8-8319-7c523b02d6ef tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.083166 Aug 29 15:25:40.402894 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 131/301] 10.222.0.62 () {60 vars in 1194 bytes} [Mon Aug 29 15:25:40 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:25:40.409818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-93f8ddef-98c9-4161-9fc1-75566e9c8498 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:40.424290 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-93f8ddef-98c9-4161-9fc1-75566e9c8498 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-93f8ddef-98c9-4161-9fc1-75566e9c8498 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Request method failure captured: Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpGQgScBgkz1JV5jR2tYcWeF8ejG3BjY9bAupmmDlRGPkGTluDwjsghSop6uX9GWFmr8uEABZHgWy1XgwAO__9dyviJrKN0vhIL6xOa7FPCEYEXR5J4J_hS4sxpf0EmRZlfvdlcwh2kSFuA3Vf-Q_4pJu6uUv5KUC2pWYh9G_on96o Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 2c59275f55b44049a08758188de63139 Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AggregatesAdminTestJSON-609932427 Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:25:40.426250 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:25:40.427399 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2c59275f55b44049a08758188de63139", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2c59275f55b44049a08758188de63139"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2c59275f55b44049a08758188de63139"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2c59275f55b44049a08758188de63139"}]}] Aug 29 15:25:40.427399 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AggregatesAdminTestJSON-609932427 Aug 29 15:25:40.427399 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 2c59275f55b44049a08758188de63139 Aug 29 15:25:40.427399 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-609932427 Aug 29 15:25:40.427399 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AggregatesAdminTestJSON-609932427-project-admin Aug 29 15:25:40.427399 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:40.427399 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:40.427399 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: fb43ce813ea9446d9ee27dc3e594582f Aug 29 15:25:40.427399 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AggregatesAdminTestJSON-609932427-project-admin Aug 29 15:25:40.427399 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:40.427399 n-d-839401-11 devstack@n-api.service[122360]: exception: Aggregate 14 could not be found. Aug 29 15:25:40.427399 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '14'} Aug 29 15:25:40.427399 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:25:40.428081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.429151 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:40.430238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:40.430238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:40.430238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:40.430238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 29 15:25:40.430238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.433856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-93f8ddef-98c9-4161-9fc1-75566e9c8498 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:40.434990 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-93f8ddef-98c9-4161-9fc1-75566e9c8498 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.030655 Aug 29 15:25:40.436056 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 132/302] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 15:25:40 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:25:40.441359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-34ed565c-944c-48ce-b078-0407686bd613 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:40.470960 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-34ed565c-944c-48ce-b078-0407686bd613 tempest-AggregatesAdminNegativeTestJSON-1934221355 tempest-AggregatesAdminNegativeTestJSON-1934221355-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.033386 Aug 29 15:25:40.472125 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 133/303] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 15:25:40 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:40.477908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e0390e72-2589-4501-8e87-f7fac0b9c2c7 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-796766888"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:40.482004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.aggregate [None req-e0390e72-2589-4501-8e87-f7fac0b9c2c7 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Generated uuid eaf07b5e-8f11-4329-a3f8-da8907acf0d5 for aggregate {{(pid=122360) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:40.509927 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e0390e72-2589-4501-8e87-f7fac0b9c2c7 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.036509 Aug 29 15:25:40.511123 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 134/304] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:40 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:40.527940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2df9e9ba-2fb8-480f-9538-e43062059758 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:40.535567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-51aaae0b-fffc-40ef-b06b-a1c1d867996d tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Calling method '.version_select at 0x7fc430365a60>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:40.537554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51aaae0b-fffc-40ef-b06b-a1c1d867996d tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:40.538249 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2df9e9ba-2fb8-480f-9538-e43062059758 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 227 microversion: 2.1 time: 0.019514 Aug 29 15:25:40.538372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51aaae0b-fffc-40ef-b06b-a1c1d867996d tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:40.545127 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 135/305] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:40 2022] GET /compute/v2.1/os-aggregates/16 => generated 227 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:40.546112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51aaae0b-fffc-40ef-b06b-a1c1d867996d tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:40.554198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-41536b57-bf78-425b-b7c5-a62b9a0201c0 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:40.575233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51aaae0b-fffc-40ef-b06b-a1c1d867996d tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:40.575712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51aaae0b-fffc-40ef-b06b-a1c1d867996d tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:40.577330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51aaae0b-fffc-40ef-b06b-a1c1d867996d tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:40.588234 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-41536b57-bf78-425b-b7c5-a62b9a0201c0 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 265 microversion: 2.1 time: 0.037886 Aug 29 15:25:40.592233 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 136/306] 10.222.0.62 () {60 vars in 1194 bytes} [Mon Aug 29 15:25:40 2022] POST /compute/v2.1/os-aggregates/16/action => generated 265 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:40.599835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c54b5c02-51bc-4aba-8e32-c724198c7d77 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:40.608281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51aaae0b-fffc-40ef-b06b-a1c1d867996d tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:40.609057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51aaae0b-fffc-40ef-b06b-a1c1d867996d tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:40.610031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51aaae0b-fffc-40ef-b06b-a1c1d867996d tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:40.620594 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-51aaae0b-fffc-40ef-b06b-a1c1d867996d tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.575891 Aug 29 15:25:40.622220 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 171/307] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:40 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:40.635791 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c54b5c02-51bc-4aba-8e32-c724198c7d77 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 241 microversion: 2.1 time: 0.039753 Aug 29 15:25:40.636888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e5d50bb5-f4a7-47ae-8438-61e14182e6b1 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Calling method '.version_select at 0x7fc4302b6b80>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:40.637398 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 137/308] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:40 2022] GET /compute/v2.1/os-aggregates/16 => generated 241 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:40.639970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e5d50bb5-f4a7-47ae-8438-61e14182e6b1 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '6039a827b8e64cf68e1ab1946bb6ef25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81fb756a0fe4f919ea487c944acc920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e5d50bb5-f4a7-47ae-8438-61e14182e6b1 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Request method failure captured: Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpw4HhHrq1LLn7Kg8Afs7oNalVplwHFiWxiw2BxD7IQHWYDaXEWEBg9WTlZcR5viDbyNdaU01LMiUyQGXRM0mhEHWFlOQzLm98GkDCbxrpz9kyV3txJV5nfVywQrKiCgvpdz3SSebDqAjoHdKMdqtPlojE7zTPQB9z4zl7JeXr-YhI Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d81fb756a0fe4f919ea487c944acc920 Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1365219212 Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:40.642839 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:40.644041 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d81fb756a0fe4f919ea487c944acc920", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d81fb756a0fe4f919ea487c944acc920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d81fb756a0fe4f919ea487c944acc920"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d81fb756a0fe4f919ea487c944acc920"}]}] Aug 29 15:25:40.644041 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1365219212 Aug 29 15:25:40.644041 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d81fb756a0fe4f919ea487c944acc920 Aug 29 15:25:40.644041 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1365219212 Aug 29 15:25:40.644041 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HypervisorAdminNegativeTestJSON-1365219212-project Aug 29 15:25:40.644041 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:40.644041 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:40.644041 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6039a827b8e64cf68e1ab1946bb6ef25 Aug 29 15:25:40.644041 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1365219212-project Aug 29 15:25:40.644041 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:40.644041 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 29 15:25:40.644041 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '1'} Aug 29 15:25:40.644041 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:40.644754 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 29 15:25:40.646090 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.646984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e5d50bb5-f4a7-47ae-8438-61e14182e6b1 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:40.646984 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e5d50bb5-f4a7-47ae-8438-61e14182e6b1 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.018740 Aug 29 15:25:40.651480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9fb3fcdb-31a4-4b74-86e3-df400cb33ef7 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:40.652146 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 172/309] 10.222.0.62 () {58 vars in 1173 bytes} [Mon Aug 29 15:25:40 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:25:40.657710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e4dfd20a-dc89-4002-b9df-e5bd78015017 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Calling method '.version_select at 0x7fc4303f8700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:40.659860 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-e4dfd20a-dc89-4002-b9df-e5bd78015017 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] HTTP exception thrown: Hypervisor with ID '71b7cbde-a6e2-4389-b2d7-b22b1ae3ed95' could not be found. Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e4dfd20a-dc89-4002-b9df-e5bd78015017 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Request method failure captured: Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-hypervisors/71b7cbde-a6e2-4389-b2d7-b22b1ae3ed95/uptime HTTP/1.1 Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpyJr9MqD2YHUWBtG1N77b0uFaE_rdTbUGCmenbhuBCS-M3iVn2iNaTkU5Qf_OFGjUzqThyI-axO4sY88hiu1Eyc-RTtgXT8E7ZVGqH0xY_vDkVIaDtIxbVqeTie-ZZFc8E5CJimMcQ1M5aQWnDQd0tounva_rdyJHb8tea4-8ouqA Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 0df5de2bcec94a479598914d1baa2fb5 Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1720821542 Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:25:40.675950 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:25:40.677309 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0df5de2bcec94a479598914d1baa2fb5", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0df5de2bcec94a479598914d1baa2fb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0df5de2bcec94a479598914d1baa2fb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0df5de2bcec94a479598914d1baa2fb5"}]}] Aug 29 15:25:40.677309 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1720821542 Aug 29 15:25:40.677309 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 0df5de2bcec94a479598914d1baa2fb5 Aug 29 15:25:40.677309 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1720821542 Aug 29 15:25:40.677309 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin Aug 29 15:25:40.677309 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:40.677309 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:40.677309 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6d429d1f13e24f69a23b6ceb67fd8b8f Aug 29 15:25:40.677309 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin Aug 29 15:25:40.677309 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:40.677309 n-d-839401-11 devstack@n-api.service[122361]: exception: Hypervisor with ID '71b7cbde-a6e2-4389-b2d7-b22b1ae3ed95' could not be found. Aug 29 15:25:40.677309 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '71b7cbde-a6e2-4389-b2d7-b22b1ae3ed95'} Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '71b7cbde-a6e2-4389-b2d7-b22b1ae3ed95' Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 29 15:25:40.678151 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '71b7cbde-a6e2-4389-b2d7-b22b1ae3ed95' could not be found. Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.679319 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.680482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.680482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:40.680482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:40.680482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:40.680482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:40.680482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '71b7cbde-a6e2-4389-b2d7-b22b1ae3ed95' could not be found. Aug 29 15:25:40.680482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.682898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e4dfd20a-dc89-4002-b9df-e5bd78015017 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Returning 404 to user: Hypervisor with ID '71b7cbde-a6e2-4389-b2d7-b22b1ae3ed95' could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:40.684156 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e4dfd20a-dc89-4002-b9df-e5bd78015017 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/71b7cbde-a6e2-4389-b2d7-b22b1ae3ed95/uptime" status: 404 len: 123 microversion: 2.1 time: 0.030817 Aug 29 15:25:40.684979 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 173/310] 10.222.0.62 () {58 vars in 1278 bytes} [Mon Aug 29 15:25:40 2022] GET /compute/v2.1/os-hypervisors/71b7cbde-a6e2-4389-b2d7-b22b1ae3ed95/uptime => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:40.689310 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9fb3fcdb-31a4-4b74-86e3-df400cb33ef7 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.042139 Aug 29 15:25:40.692816 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 138/311] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 15:25:40 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 29 15:25:40.697570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7fea14fb-a17d-43b8-af88-ca499d696677 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Calling method '.version_select at 0x7fc4304ded30>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:40.698904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0e5115d6-754f-4ba3-a4a0-58dc48a9b15f tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2032554211", "availability_zone": "tempest-test_az-1108915159"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:40.700013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fea14fb-a17d-43b8-af88-ca499d696677 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:40.700716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fea14fb-a17d-43b8-af88-ca499d696677 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:40.701381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fea14fb-a17d-43b8-af88-ca499d696677 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:40.703582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.aggregate [None req-0e5115d6-754f-4ba3-a4a0-58dc48a9b15f tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Generated uuid a14388ae-90ec-4bae-8275-9cf9609aa1ed for aggregate {{(pid=122360) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:40.716562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fea14fb-a17d-43b8-af88-ca499d696677 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:40.717209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fea14fb-a17d-43b8-af88-ca499d696677 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:40.717737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fea14fb-a17d-43b8-af88-ca499d696677 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:40.732268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fea14fb-a17d-43b8-af88-ca499d696677 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:40.732911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fea14fb-a17d-43b8-af88-ca499d696677 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:40.733549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fea14fb-a17d-43b8-af88-ca499d696677 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:40.741983 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0e5115d6-754f-4ba3-a4a0-58dc48a9b15f tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.047706 Aug 29 15:25:40.749032 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 139/312] 10.222.0.62 () {60 vars in 1165 bytes} [Mon Aug 29 15:25:40 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:40.751140 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7fea14fb-a17d-43b8-af88-ca499d696677 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.050442 Aug 29 15:25:40.753102 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 174/313] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:25:40 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:40.768520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b04a64cf-0631-4108-92e5-b2d921d5d6f9 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2032554211_new", "availability_zone": "tempest-test_az-1108915159_new"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:40.772350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3d46aa16-393c-443b-82b1-bf9e9e499764 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Calling method '.version_select at 0x7fc4302b6e50>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:40.777309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3d46aa16-393c-443b-82b1-bf9e9e499764 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '6039a827b8e64cf68e1ab1946bb6ef25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81fb756a0fe4f919ea487c944acc920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3d46aa16-393c-443b-82b1-bf9e9e499764 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Request method failure captured: Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpw4HhHrq1LLn7Kg8Afs7oNalVplwHFiWxiw2BxD7IQHWYDaXEWEBg9WTlZcR5viDbyNdaU01LMiUyQGXRM0mhEHWFlOQzLm98GkDCbxrpz9kyV3txJV5nfVywQrKiCgvpdz3SSebDqAjoHdKMdqtPlojE7zTPQB9z4zl7JeXr-YhI Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d81fb756a0fe4f919ea487c944acc920 Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1365219212 Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:40.782436 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:40.783854 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d81fb756a0fe4f919ea487c944acc920", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d81fb756a0fe4f919ea487c944acc920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d81fb756a0fe4f919ea487c944acc920"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d81fb756a0fe4f919ea487c944acc920"}]}] Aug 29 15:25:40.783854 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1365219212 Aug 29 15:25:40.783854 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d81fb756a0fe4f919ea487c944acc920 Aug 29 15:25:40.783854 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1365219212 Aug 29 15:25:40.783854 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HypervisorAdminNegativeTestJSON-1365219212-project Aug 29 15:25:40.783854 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:40.783854 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:40.783854 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6039a827b8e64cf68e1ab1946bb6ef25 Aug 29 15:25:40.783854 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1365219212-project Aug 29 15:25:40.783854 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:40.783854 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 29 15:25:40.783854 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '1'} Aug 29 15:25:40.783854 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:25:40.784816 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 29 15:25:40.786125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.792008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3d46aa16-393c-443b-82b1-bf9e9e499764 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:40.792008 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3d46aa16-393c-443b-82b1-bf9e9e499764 tempest-HypervisorAdminNegativeTestJSON-1365219212 tempest-HypervisorAdminNegativeTestJSON-1365219212-project] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.024503 Aug 29 15:25:40.792008 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 175/314] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:25:40 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:25:40.802676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=10,nova_api:INSERT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:40.804475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d30b48d8-0ca8-4633-88a7-1e5e3afbadf8 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Calling method '.version_select at 0x7fc4302ce040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:40.806443 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-d30b48d8-0ca8-4633-88a7-1e5e3afbadf8 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] HTTP exception thrown: Hypervisor with ID 'ace758b0-d226-46e3-852a-bf50bd47ca23' could not be found. Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d30b48d8-0ca8-4633-88a7-1e5e3afbadf8 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Request method failure captured: Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-hypervisors/ace758b0-d226-46e3-852a-bf50bd47ca23 HTTP/1.1 Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpyJr9MqD2YHUWBtG1N77b0uFaE_rdTbUGCmenbhuBCS-M3iVn2iNaTkU5Qf_OFGjUzqThyI-axO4sY88hiu1Eyc-RTtgXT8E7ZVGqH0xY_vDkVIaDtIxbVqeTie-ZZFc8E5CJimMcQ1M5aQWnDQd0tounva_rdyJHb8tea4-8ouqA Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 0df5de2bcec94a479598914d1baa2fb5 Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1720821542 Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:25:40.808540 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:25:40.809964 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0df5de2bcec94a479598914d1baa2fb5", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0df5de2bcec94a479598914d1baa2fb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0df5de2bcec94a479598914d1baa2fb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0df5de2bcec94a479598914d1baa2fb5"}]}] Aug 29 15:25:40.809964 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1720821542 Aug 29 15:25:40.809964 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 0df5de2bcec94a479598914d1baa2fb5 Aug 29 15:25:40.809964 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1720821542 Aug 29 15:25:40.809964 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin Aug 29 15:25:40.809964 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:40.809964 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:40.809964 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6d429d1f13e24f69a23b6ceb67fd8b8f Aug 29 15:25:40.809964 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin Aug 29 15:25:40.809964 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:40.809964 n-d-839401-11 devstack@n-api.service[122361]: exception: Hypervisor with ID 'ace758b0-d226-46e3-852a-bf50bd47ca23' could not be found. Aug 29 15:25:40.809964 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'ace758b0-d226-46e3-852a-bf50bd47ca23'} Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'ace758b0-d226-46e3-852a-bf50bd47ca23' Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 29 15:25:40.810752 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:25:40.812146 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'ace758b0-d226-46e3-852a-bf50bd47ca23' could not be found. Aug 29 15:25:40.813720 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.813720 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:40.813720 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.813720 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:40.813720 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:40.813720 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:40.813720 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:40.813720 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:40.813720 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'ace758b0-d226-46e3-852a-bf50bd47ca23' could not be found. Aug 29 15:25:40.813720 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:40.813720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d30b48d8-0ca8-4633-88a7-1e5e3afbadf8 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] Returning 404 to user: Hypervisor with ID 'ace758b0-d226-46e3-852a-bf50bd47ca23' could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:40.813720 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d30b48d8-0ca8-4633-88a7-1e5e3afbadf8 tempest-HypervisorAdminNegativeTestJSON-1720821542 tempest-HypervisorAdminNegativeTestJSON-1720821542-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors/ace758b0-d226-46e3-852a-bf50bd47ca23" status: 404 len: 123 microversion: 2.1 time: 0.017161 Aug 29 15:25:40.817711 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 176/315] 10.222.0.62 () {58 vars in 1257 bytes} [Mon Aug 29 15:25:40 2022] GET /compute/v2.1/os-hypervisors/ace758b0-d226-46e3-852a-bf50bd47ca23 => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:40.847071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b04a64cf-0631-4108-92e5-b2d921d5d6f9 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:40.850536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b04a64cf-0631-4108-92e5-b2d921d5d6f9 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:40.850946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b04a64cf-0631-4108-92e5-b2d921d5d6f9 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:40.926948 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b04a64cf-0631-4108-92e5-b2d921d5d6f9 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.174519 Aug 29 15:25:40.929108 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 140/316] 10.222.0.62 () {60 vars in 1173 bytes} [Mon Aug 29 15:25:40 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:40.941053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-adebda71-83b6-44a0-b5bd-01d302e0864a tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:40.963136 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-adebda71-83b6-44a0-b5bd-01d302e0864a tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.026521 Aug 29 15:25:40.970953 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 177/317] 10.222.0.62 () {58 vars in 1143 bytes} [Mon Aug 29 15:25:40 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:40.978922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-733d8814-ab11-4bf3-b0ca-bad66e5e27d3 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:41.028439 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-733d8814-ab11-4bf3-b0ca-bad66e5e27d3 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.055480 Aug 29 15:25:41.032782 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 141/318] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 15:25:40 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:41.049452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c29ea79c-f92a-42c5-b4e9-31d0e8d1ec73 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-340151303"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:41.055001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.aggregate [None req-c29ea79c-f92a-42c5-b4e9-31d0e8d1ec73 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Generated uuid 4c773b25-009e-46ea-89ba-05b1a7bcab8b for aggregate {{(pid=122360) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:25:41.103454 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c29ea79c-f92a-42c5-b4e9-31d0e8d1ec73 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063458 Aug 29 15:25:41.104952 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 142/319] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:25:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:41.120652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6f63869b-c5b4-4528-a224-eaf81f061614 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:41.139982 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6f63869b-c5b4-4528-a224-eaf81f061614 tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.027128 Aug 29 15:25:41.142055 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 143/320] 10.222.0.62 () {58 vars in 1143 bytes} [Mon Aug 29 15:25:41 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:25:41.154647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cdd238c8-86f7-497f-a121-ceeda1fd5b2d tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:41.193307 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cdd238c8-86f7-497f-a121-ceeda1fd5b2d tempest-AggregatesAdminTestJSON-609932427 tempest-AggregatesAdminTestJSON-609932427-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.042378 Aug 29 15:25:41.201637 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 144/321] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 15:25:41 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:25:41.213278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7f4e9afe-bcbe-49fb-bfd7-302d3dec973f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:41.215775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7f4e9afe-bcbe-49fb-bfd7-302d3dec973f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:41.230154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f4e9afe-bcbe-49fb-bfd7-302d3dec973f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:41.230945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f4e9afe-bcbe-49fb-bfd7-302d3dec973f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:41.231808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f4e9afe-bcbe-49fb-bfd7-302d3dec973f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:41.233131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f4e9afe-bcbe-49fb-bfd7-302d3dec973f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:41.233511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f4e9afe-bcbe-49fb-bfd7-302d3dec973f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:41.234091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f4e9afe-bcbe-49fb-bfd7-302d3dec973f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:41.259533 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-7f4e9afe-bcbe-49fb-bfd7-302d3dec973f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] HTTP exception thrown: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7f4e9afe-bcbe-49fb-bfd7-302d3dec973f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Request method failure captured: Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc HTTP/1.1 Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpE3i7vLV-BahUMPOXrbfQCq_rgXHGT0TYP86LwTZnpOmDiHwcPenxfG-WpPE0jZAbb0XLATl1VdeiHabTqf9d2komH_wFOAacWqZMIEhU_V9Rgq4_SD4I6ca6owG_61U8pSAyfcn2Xr-fpcZdnpZTBClnjhgFcERQOpk_XisGWW_Y Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 78479eb062e543aeb3fd37659d88ac15 Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AggregatesAdminTestJSON-1090991663 Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:25:41.261614 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:25:41.263069 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_78479eb062e543aeb3fd37659d88ac15", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/78479eb062e543aeb3fd37659d88ac15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/78479eb062e543aeb3fd37659d88ac15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/78479eb062e543aeb3fd37659d88ac15"}]}] Aug 29 15:25:41.263069 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AggregatesAdminTestJSON-1090991663 Aug 29 15:25:41.263069 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 78479eb062e543aeb3fd37659d88ac15 Aug 29 15:25:41.263069 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1090991663 Aug 29 15:25:41.263069 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AggregatesAdminTestJSON-1090991663-project Aug 29 15:25:41.263069 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:25:41.263069 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:25:41.263069 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 792d186543044e919ffd914f0a8794e4 Aug 29 15:25:41.263069 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AggregatesAdminTestJSON-1090991663-project Aug 29 15:25:41.263069 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:25:41.263069 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. Aug 29 15:25:41.263069 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '43b616b8-2701-458b-8b8a-9f44b708e6fc'} Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:41.263890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. Aug 29 15:25:41.265218 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:25:41.266562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7f4e9afe-bcbe-49fb-bfd7-302d3dec973f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Returning 404 to user: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:41.273225 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7f4e9afe-bcbe-49fb-bfd7-302d3dec973f tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "DELETE /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 404 len: 111 microversion: 2.1 time: 0.069406 Aug 29 15:25:41.277117 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 145/322] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:25:41 2022] DELETE /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:41.544811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4e0fc90a-047c-4b94-ae2f-2d90c04f0367 tempest-NetworksTest-924514972 tempest-NetworksTest-924514972-project-admin] Calling method '.version_select at 0x7fc4318590d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:41.902484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-893b8e5c-5ddc-49d7-af43-0340bc46edaf tempest-SecurityGroupsTestAdminJSON-1062139827 tempest-SecurityGroupsTestAdminJSON-1062139827-project] Action: 'create', calling method: .version_select at 0x7fc43037eca0>, body: {"security_group": {"name": "tempest-securitygroup-1962366162", "description": "tempest-description-1266696230"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:41.934950 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4e0fc90a-047c-4b94-ae2f-2d90c04f0367 tempest-NetworksTest-924514972 tempest-NetworksTest-924514972-project-admin] 10.222.0.62 "GET /compute/v2.1/os-networks" status: 200 len: 3325 microversion: 2.1 time: 0.945807 Aug 29 15:25:41.936480 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 178/323] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:25:40 2022] GET /compute/v2.1/os-networks => generated 3325 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:41.943136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ef6f2763-b650-4f70-b401-52b3ce240c51 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:41.943748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ef6f2763-b650-4f70-b401-52b3ce240c51 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] [instance: 43b616b8-2701-458b-8b8a-9f44b708e6fc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:41.950368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef6f2763-b650-4f70-b401-52b3ce240c51 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:41.950875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef6f2763-b650-4f70-b401-52b3ce240c51 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:41.951306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef6f2763-b650-4f70-b401-52b3ce240c51 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:41.952014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef6f2763-b650-4f70-b401-52b3ce240c51 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:41.952488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef6f2763-b650-4f70-b401-52b3ce240c51 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:41.957821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef6f2763-b650-4f70-b401-52b3ce240c51 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:41.995774 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-ef6f2763-b650-4f70-b401-52b3ce240c51 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] HTTP exception thrown: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ef6f2763-b650-4f70-b401-52b3ce240c51 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Request method failure captured: Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc HTTP/1.1 Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNpE3i7vLV-BahUMPOXrbfQCq_rgXHGT0TYP86LwTZnpOmDiHwcPenxfG-WpPE0jZAbb0XLATl1VdeiHabTqf9d2komH_wFOAacWqZMIEhU_V9Rgq4_SD4I6ca6owG_61U8pSAyfcn2Xr-fpcZdnpZTBClnjhgFcERQOpk_XisGWW_Y Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 78479eb062e543aeb3fd37659d88ac15 Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AggregatesAdminTestJSON-1090991663 Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:41.998741 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:42.000016 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_78479eb062e543aeb3fd37659d88ac15", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/78479eb062e543aeb3fd37659d88ac15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/78479eb062e543aeb3fd37659d88ac15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/78479eb062e543aeb3fd37659d88ac15"}]}] Aug 29 15:25:42.000016 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AggregatesAdminTestJSON-1090991663 Aug 29 15:25:42.000016 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 78479eb062e543aeb3fd37659d88ac15 Aug 29 15:25:42.000016 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1090991663 Aug 29 15:25:42.000016 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AggregatesAdminTestJSON-1090991663-project Aug 29 15:25:42.000016 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:42.000016 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:42.000016 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 792d186543044e919ffd914f0a8794e4 Aug 29 15:25:42.000016 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AggregatesAdminTestJSON-1090991663-project Aug 29 15:25:42.000016 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:25:42.000016 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. Aug 29 15:25:42.000016 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '43b616b8-2701-458b-8b8a-9f44b708e6fc'} Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:42.000803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. Aug 29 15:25:42.002156 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:42.004280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ef6f2763-b650-4f70-b401-52b3ce240c51 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] Returning 404 to user: Instance 43b616b8-2701-458b-8b8a-9f44b708e6fc could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:42.006127 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ef6f2763-b650-4f70-b401-52b3ce240c51 tempest-AggregatesAdminTestJSON-1090991663 tempest-AggregatesAdminTestJSON-1090991663-project] 10.222.0.62 "GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc" status: 404 len: 111 microversion: 2.1 time: 0.068388 Aug 29 15:25:42.009548 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 179/324] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:41 2022] GET /compute/v2.1/servers/43b616b8-2701-458b-8b8a-9f44b708e6fc => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:42.031188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3ef41789-f87a-4b1f-82e5-b025af1ecdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:42.031977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3ef41789-f87a-4b1f-82e5-b025af1ecdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:42.042692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ef41789-f87a-4b1f-82e5-b025af1ecdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:42.043489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ef41789-f87a-4b1f-82e5-b025af1ecdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:42.045819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ef41789-f87a-4b1f-82e5-b025af1ecdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:42.047066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ef41789-f87a-4b1f-82e5-b025af1ecdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:42.047911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ef41789-f87a-4b1f-82e5-b025af1ecdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:42.048639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ef41789-f87a-4b1f-82e5-b025af1ecdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:42.395088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3ef41789-f87a-4b1f-82e5-b025af1ecdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:42.410083 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3ef41789-f87a-4b1f-82e5-b025af1ecdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1319 microversion: 2.1 time: 0.387550 Aug 29 15:25:42.410667 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 180/325] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:42 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1319 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:42.422738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2adb5529-1107-4a5e-8ccd-3d7a855b1a79 tempest-NetworksTest-924514972 tempest-NetworksTest-924514972-project-admin] Calling method '.version_select at 0x7fc4302ceca0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:42.856899 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2adb5529-1107-4a5e-8ccd-3d7a855b1a79 tempest-NetworksTest-924514972 tempest-NetworksTest-924514972-project-admin] 10.222.0.62 "GET /compute/v2.1/os-networks/29a1b9f9-a46a-46a0-85cc-fb255d980b29" status: 200 len: 652 microversion: 2.1 time: 0.445168 Aug 29 15:25:42.858852 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 181/326] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:25:42 2022] GET /compute/v2.1/os-networks/29a1b9f9-a46a-46a0-85cc-fb255d980b29 => generated 652 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:42.869276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-479b729b-9a47-47d6-b6db-43078c165d85 tempest-NetworksTest-924514972 tempest-NetworksTest-924514972-project-admin] Calling method '.version_select at 0x7fc430261f70>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:43.211293 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-479b729b-9a47-47d6-b6db-43078c165d85 tempest-NetworksTest-924514972 tempest-NetworksTest-924514972-project-admin] 10.222.0.62 "GET /compute/v2.1/os-networks" status: 200 len: 3325 microversion: 2.1 time: 0.345666 Aug 29 15:25:43.216677 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 182/327] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:25:42 2022] GET /compute/v2.1/os-networks => generated 3325 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:43.274386 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-893b8e5c-5ddc-49d7-af43-0340bc46edaf tempest-SecurityGroupsTestAdminJSON-1062139827 tempest-SecurityGroupsTestAdminJSON-1062139827-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.995974 Aug 29 15:25:43.275277 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 146/328] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:25:41 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:43.288989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1734ca92-1791-4ff8-acf1-6595113296c0 tempest-SecurityGroupsTestAdminJSON-1062139827 tempest-SecurityGroupsTestAdminJSON-1062139827-project] Action: 'create', calling method: .version_select at 0x7fc4302614c0>, body: {"security_group": {"name": "tempest-securitygroup-981160988", "description": "tempest-description-86144622"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:43.443787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7fbbf2b7-5db2-4cbd-a04c-4338be46f444 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:43.444440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7fbbf2b7-5db2-4cbd-a04c-4338be46f444 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:43.459401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fbbf2b7-5db2-4cbd-a04c-4338be46f444 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:43.459906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fbbf2b7-5db2-4cbd-a04c-4338be46f444 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:43.460353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fbbf2b7-5db2-4cbd-a04c-4338be46f444 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:43.461595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fbbf2b7-5db2-4cbd-a04c-4338be46f444 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:43.462292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fbbf2b7-5db2-4cbd-a04c-4338be46f444 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:43.463433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fbbf2b7-5db2-4cbd-a04c-4338be46f444 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:43.716268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=64,nova_cell0:UPDATE=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:43.886398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7fbbf2b7-5db2-4cbd-a04c-4338be46f444 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:43.899072 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7fbbf2b7-5db2-4cbd-a04c-4338be46f444 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1319 microversion: 2.1 time: 0.463045 Aug 29 15:25:43.899906 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 147/329] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:43 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1319 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:44.304901 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1734ca92-1791-4ff8-acf1-6595113296c0 tempest-SecurityGroupsTestAdminJSON-1062139827 tempest-SecurityGroupsTestAdminJSON-1062139827-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 1.021011 Aug 29 15:25:44.312643 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 183/330] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:25:43 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:44.859149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-87299bda-94ce-439c-91f7-02672f1b72b4 tempest-SecurityGroupsTestAdminJSON-1178612712 tempest-SecurityGroupsTestAdminJSON-1178612712-project-admin] Action: 'create', calling method: .version_select at 0x7fc43037e040>, body: {"security_group": {"name": "tempest-securitygroup-1174347022", "description": "tempest-description-683134267"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:44.930541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-501e445d-fd3d-48af-b6d1-d6bf70dfa983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:44.931649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-501e445d-fd3d-48af-b6d1-d6bf70dfa983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:44.939453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-501e445d-fd3d-48af-b6d1-d6bf70dfa983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:44.941707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-501e445d-fd3d-48af-b6d1-d6bf70dfa983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:44.942367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-501e445d-fd3d-48af-b6d1-d6bf70dfa983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:44.943346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-501e445d-fd3d-48af-b6d1-d6bf70dfa983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:44.944161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-501e445d-fd3d-48af-b6d1-d6bf70dfa983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:44.945016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-501e445d-fd3d-48af-b6d1-d6bf70dfa983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:45.291223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-501e445d-fd3d-48af-b6d1-d6bf70dfa983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:45.304322 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-501e445d-fd3d-48af-b6d1-d6bf70dfa983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1319 microversion: 2.1 time: 0.387516 Aug 29 15:25:45.304987 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 184/331] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:44 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:46.215403 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-87299bda-94ce-439c-91f7-02672f1b72b4 tempest-SecurityGroupsTestAdminJSON-1178612712 tempest-SecurityGroupsTestAdminJSON-1178612712-project-admin] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.901229 Aug 29 15:25:46.216384 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 148/332] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:25:44 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:46.236221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e4e5b7b7-23e5-467c-b26e-17032d62c7df tempest-SecurityGroupsTestAdminJSON-1178612712 tempest-SecurityGroupsTestAdminJSON-1178612712-project-admin] Action: 'create', calling method: .version_select at 0x7fc430261790>, body: {"security_group": {"name": "tempest-securitygroup-1966948628", "description": "tempest-description-352010283"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:46.327156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9e1c77a9-ae52-4e7d-aaf5-7d5c48d71ad6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:46.328218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9e1c77a9-ae52-4e7d-aaf5-7d5c48d71ad6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:46.346712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e1c77a9-ae52-4e7d-aaf5-7d5c48d71ad6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:46.347217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e1c77a9-ae52-4e7d-aaf5-7d5c48d71ad6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:46.347655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e1c77a9-ae52-4e7d-aaf5-7d5c48d71ad6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:46.349896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e1c77a9-ae52-4e7d-aaf5-7d5c48d71ad6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:46.352344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e1c77a9-ae52-4e7d-aaf5-7d5c48d71ad6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:46.354391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e1c77a9-ae52-4e7d-aaf5-7d5c48d71ad6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:46.790274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e1c77a9-ae52-4e7d-aaf5-7d5c48d71ad6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:46.802040 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9e1c77a9-ae52-4e7d-aaf5-7d5c48d71ad6 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1319 microversion: 2.1 time: 0.479537 Aug 29 15:25:46.815396 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 149/333] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:46 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:25:47.547962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:47.553756 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e4e5b7b7-23e5-467c-b26e-17032d62c7df tempest-SecurityGroupsTestAdminJSON-1178612712 tempest-SecurityGroupsTestAdminJSON-1178612712-project-admin] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.328307 Aug 29 15:25:47.562056 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 185/334] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:25:46 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:47.567791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-14780bed-e0e2-4dc5-ad0e-98cd796da6c3 tempest-SecurityGroupsTestAdminJSON-1178612712 tempest-SecurityGroupsTestAdminJSON-1178612712-project-admin] Calling method '.version_select at 0x7fc430128c10>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:47.839649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d85b7da2-1a79-4d69-a102-57a2743c20ab tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:47.840270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d85b7da2-1a79-4d69-a102-57a2743c20ab tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:47.862419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d85b7da2-1a79-4d69-a102-57a2743c20ab tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:47.862911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d85b7da2-1a79-4d69-a102-57a2743c20ab tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:47.864202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d85b7da2-1a79-4d69-a102-57a2743c20ab tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:47.865232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d85b7da2-1a79-4d69-a102-57a2743c20ab tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:47.867012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d85b7da2-1a79-4d69-a102-57a2743c20ab tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:47.869806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d85b7da2-1a79-4d69-a102-57a2743c20ab tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:48.485626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d85b7da2-1a79-4d69-a102-57a2743c20ab tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:48.496776 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d85b7da2-1a79-4d69-a102-57a2743c20ab tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1319 microversion: 2.1 time: 0.672086 Aug 29 15:25:48.499949 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 186/335] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:47 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1319 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:49.524230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2743cf2a-e2d7-498a-a79f-ec0ca27bdf60 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:49.525185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2743cf2a-e2d7-498a-a79f-ec0ca27bdf60 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:49.538981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2743cf2a-e2d7-498a-a79f-ec0ca27bdf60 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:49.539509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2743cf2a-e2d7-498a-a79f-ec0ca27bdf60 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:49.540005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2743cf2a-e2d7-498a-a79f-ec0ca27bdf60 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:49.544414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2743cf2a-e2d7-498a-a79f-ec0ca27bdf60 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:49.545074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2743cf2a-e2d7-498a-a79f-ec0ca27bdf60 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:49.545659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2743cf2a-e2d7-498a-a79f-ec0ca27bdf60 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:49.604812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:50.234066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2743cf2a-e2d7-498a-a79f-ec0ca27bdf60 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:50.246975 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2743cf2a-e2d7-498a-a79f-ec0ca27bdf60 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1319 microversion: 2.1 time: 0.724453 Aug 29 15:25:50.264144 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 187/336] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:49 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1319 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:50.366205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:50.557134 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-14780bed-e0e2-4dc5-ad0e-98cd796da6c3 tempest-SecurityGroupsTestAdminJSON-1178612712 tempest-SecurityGroupsTestAdminJSON-1178612712-project-admin] 10.222.0.62 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 6316 microversion: 2.1 time: 2.993577 Aug 29 15:25:50.557820 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 150/337] 10.222.0.62 () {58 vars in 1191 bytes} [Mon Aug 29 15:25:47 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 6316 bytes in 2995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:50.578314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a779bba-960e-435a-b5bc-3264169388a1 tempest-SecurityGroupsTestAdminJSON-1062139827 tempest-SecurityGroupsTestAdminJSON-1062139827-project] Calling method '.version_select at 0x7fc430128ee0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:50.784715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f2d14834-0706-4aef-9612-6ef507809a4f tempest-FloatingIPDetailsNegativeTestJSON-1821843734 tempest-FloatingIPDetailsNegativeTestJSON-1821843734-project] Calling method '.version_select at 0x7fc4302b6550>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.040044 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a779bba-960e-435a-b5bc-3264169388a1 tempest-SecurityGroupsTestAdminJSON-1062139827 tempest-SecurityGroupsTestAdminJSON-1062139827-project] 10.222.0.62 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.465609 Aug 29 15:25:51.041334 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 151/338] 10.222.0.62 () {58 vars in 1191 bytes} [Mon Aug 29 15:25:50 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:51.046482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-4d18f809-5347-49cd-8feb-d20206cec726 req-7c1ce39a-6ed8-48ee-9e90-fa038a7a2738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cca7e11-1c42-471e-9b89-0b824a56618c", "name": "network-vif-plugged", "status": "completed", "tag": "0a551a27-53a7-4d37-a830-0211d8ad0f7b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:51.052866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG neutronclient.v2_0.client [None req-f2d14834-0706-4aef-9612-6ef507809a4f tempest-FloatingIPDetailsNegativeTestJSON-1821843734 tempest-FloatingIPDetailsNegativeTestJSON-1821843734-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP db9ea114-f645-4258-a871-9fc8a8c7a71b could not be found", "detail": ""}} {{(pid=122361) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:25:51.053204 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-f2d14834-0706-4aef-9612-6ef507809a4f tempest-FloatingIPDetailsNegativeTestJSON-1821843734 tempest-FloatingIPDetailsNegativeTestJSON-1821843734-project] HTTP exception thrown: Floating IP not found for ID db9ea114-f645-4258-a871-9fc8a8c7a71b Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f2d14834-0706-4aef-9612-6ef507809a4f tempest-FloatingIPDetailsNegativeTestJSON-1821843734 tempest-FloatingIPDetailsNegativeTestJSON-1821843734-project] Request method failure captured: Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-floating-ips/db9ea114-f645-4258-a871-9fc8a8c7a71b HTTP/1.1 Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNp9zRukrM7Jilca4A8jhnACtDh8nvBcy93BTIHRcWeQtifyWkz_FO-DnF5mEcBq1-e1YH7w3bkrbvGKogtPNtDSZlSgBz_zBAW87BEXOfPw73-nDCQQtafvsvaY_KGbp75LtU4bFm3z1l--l4TxF-cvNZA-gxw-2FqfC0NA1w15BY4 Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 064bf8e3f8aa4da2931ebd14858b61a7 Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1821843734 Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:25:51.068776 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:25:51.070391 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_064bf8e3f8aa4da2931ebd14858b61a7", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/064bf8e3f8aa4da2931ebd14858b61a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/064bf8e3f8aa4da2931ebd14858b61a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/064bf8e3f8aa4da2931ebd14858b61a7"}]}] Aug 29 15:25:51.070391 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1821843734 Aug 29 15:25:51.070391 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 064bf8e3f8aa4da2931ebd14858b61a7 Aug 29 15:25:51.070391 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1821843734 Aug 29 15:25:51.070391 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1821843734-project Aug 29 15:25:51.070391 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:25:51.070391 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:25:51.070391 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 23fd4ada1b6a481d907ac138f6474f1d Aug 29 15:25:51.070391 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1821843734-project Aug 29 15:25:51.070391 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:25:51.070391 n-d-839401-11 devstack@n-api.service[122361]: exception: Floating IP not found for ID db9ea114-f645-4258-a871-9fc8a8c7a71b Aug 29 15:25:51.070391 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'db9ea114-f645-4258-a871-9fc8a8c7a71b'} Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:25:51.071298 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP db9ea114-f645-4258-a871-9fc8a8c7a71b could not be found Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cf44329-3a3e-47b8-af7d-ec1c75529165'] Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID db9ea114-f645-4258-a871-9fc8a8c7a71b. Aug 29 15:25:51.072707 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID db9ea114-f645-4258-a871-9fc8a8c7a71b Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:25:51.074183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:25:51.075458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:25:51.075458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID db9ea114-f645-4258-a871-9fc8a8c7a71b Aug 29 15:25:51.075458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:25:51.075458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f2d14834-0706-4aef-9612-6ef507809a4f tempest-FloatingIPDetailsNegativeTestJSON-1821843734 tempest-FloatingIPDetailsNegativeTestJSON-1821843734-project] Returning 404 to user: Floating IP not found for ID db9ea114-f645-4258-a871-9fc8a8c7a71b {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:25:51.075458 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f2d14834-0706-4aef-9612-6ef507809a4f tempest-FloatingIPDetailsNegativeTestJSON-1821843734 tempest-FloatingIPDetailsNegativeTestJSON-1821843734-project] 10.222.0.62 "GET /compute/v2.1/os-floating-ips/db9ea114-f645-4258-a871-9fc8a8c7a71b" status: 404 len: 111 microversion: 2.1 time: 0.805024 Aug 29 15:25:51.075458 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 188/339] 10.222.0.62 () {58 vars in 1260 bytes} [Mon Aug 29 15:25:50 2022] GET /compute/v2.1/os-floating-ips/db9ea114-f645-4258-a871-9fc8a8c7a71b => generated 111 bytes in 807 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:25:51.075849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4d18f809-5347-49cd-8feb-d20206cec726 req-7c1ce39a-6ed8-48ee-9e90-fa038a7a2738 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:51.075849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4d18f809-5347-49cd-8feb-d20206cec726 req-7c1ce39a-6ed8-48ee-9e90-fa038a7a2738 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:51.093454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4d18f809-5347-49cd-8feb-d20206cec726 req-7c1ce39a-6ed8-48ee-9e90-fa038a7a2738 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:51.135584 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-4d18f809-5347-49cd-8feb-d20206cec726 req-7c1ce39a-6ed8-48ee-9e90-fa038a7a2738 service nova] Creating event network-vif-plugged:0a551a27-53a7-4d37-a830-0211d8ad0f7b for instance 7cca7e11-1c42-471e-9b89-0b824a56618c on n-h2-839401-11 Aug 29 15:25:51.147395 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-4d18f809-5347-49cd-8feb-d20206cec726 req-7c1ce39a-6ed8-48ee-9e90-fa038a7a2738 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103910 Aug 29 15:25:51.159005 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 152/340] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:51.171589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a4f072c3-afa6-49b8-a324-770d1e521a7e tempest-SecurityGroupsTestAdminJSON-1178612712 tempest-SecurityGroupsTestAdminJSON-1178612712-project-admin] Calling method '.version_select at 0x7fc43012e790>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.808303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3fe9a0f4-df9d-4bd3-b450-6daec9fc09bc tempest-AZAdminV2TestJSON-1349839064 tempest-AZAdminV2TestJSON-1349839064-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.809900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fe9a0f4-df9d-4bd3-b450-6daec9fc09bc tempest-AZAdminV2TestJSON-1349839064 tempest-AZAdminV2TestJSON-1349839064-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:51.810387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fe9a0f4-df9d-4bd3-b450-6daec9fc09bc tempest-AZAdminV2TestJSON-1349839064 tempest-AZAdminV2TestJSON-1349839064-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:51.810822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fe9a0f4-df9d-4bd3-b450-6daec9fc09bc tempest-AZAdminV2TestJSON-1349839064 tempest-AZAdminV2TestJSON-1349839064-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:51.811561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fe9a0f4-df9d-4bd3-b450-6daec9fc09bc tempest-AZAdminV2TestJSON-1349839064 tempest-AZAdminV2TestJSON-1349839064-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:51.812018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fe9a0f4-df9d-4bd3-b450-6daec9fc09bc tempest-AZAdminV2TestJSON-1349839064 tempest-AZAdminV2TestJSON-1349839064-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:51.812446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fe9a0f4-df9d-4bd3-b450-6daec9fc09bc tempest-AZAdminV2TestJSON-1349839064 tempest-AZAdminV2TestJSON-1349839064-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:51.883277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:DELETE=13 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:25:51.926046 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3fe9a0f4-df9d-4bd3-b450-6daec9fc09bc tempest-AZAdminV2TestJSON-1349839064 tempest-AZAdminV2TestJSON-1349839064-project-admin] 10.222.0.62 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.852390 Aug 29 15:25:51.927160 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 189/341] 10.222.0.62 () {58 vars in 1164 bytes} [Mon Aug 29 15:25:51 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:25:51.947336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3f00c2ae-10f0-428d-8692-c6d37cf44983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:51.948003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3f00c2ae-10f0-428d-8692-c6d37cf44983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:51.983602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f00c2ae-10f0-428d-8692-c6d37cf44983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:51.984123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f00c2ae-10f0-428d-8692-c6d37cf44983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:51.986787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f00c2ae-10f0-428d-8692-c6d37cf44983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:51.987581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f00c2ae-10f0-428d-8692-c6d37cf44983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:51.989131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f00c2ae-10f0-428d-8692-c6d37cf44983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:51.990083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f00c2ae-10f0-428d-8692-c6d37cf44983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:52.162117 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a4f072c3-afa6-49b8-a324-770d1e521a7e tempest-SecurityGroupsTestAdminJSON-1178612712 tempest-SecurityGroupsTestAdminJSON-1178612712-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/7b16dca7-b3ae-4810-9c52-ea85c39d7ebc" status: 202 len: 0 microversion: 2.1 time: 1.001749 Aug 29 15:25:52.163366 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 153/342] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:25:51 2022] DELETE /compute/v2.1/os-security-groups/7b16dca7-b3ae-4810-9c52-ea85c39d7ebc => generated 0 bytes in 1004 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:25:52.170014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f45d9119-8c84-4d2b-b43e-7e782db2f511 tempest-AZAdminV2TestJSON-1349839064 tempest-AZAdminV2TestJSON-1349839064-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:52.172662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f45d9119-8c84-4d2b-b43e-7e782db2f511 tempest-AZAdminV2TestJSON-1349839064 tempest-AZAdminV2TestJSON-1349839064-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:52.175175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f45d9119-8c84-4d2b-b43e-7e782db2f511 tempest-AZAdminV2TestJSON-1349839064 tempest-AZAdminV2TestJSON-1349839064-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:52.175783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f45d9119-8c84-4d2b-b43e-7e782db2f511 tempest-AZAdminV2TestJSON-1349839064 tempest-AZAdminV2TestJSON-1349839064-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:52.176723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f45d9119-8c84-4d2b-b43e-7e782db2f511 tempest-AZAdminV2TestJSON-1349839064 tempest-AZAdminV2TestJSON-1349839064-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:52.182290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f45d9119-8c84-4d2b-b43e-7e782db2f511 tempest-AZAdminV2TestJSON-1349839064 tempest-AZAdminV2TestJSON-1349839064-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:52.183458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f45d9119-8c84-4d2b-b43e-7e782db2f511 tempest-AZAdminV2TestJSON-1349839064 tempest-AZAdminV2TestJSON-1349839064-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:52.256614 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f45d9119-8c84-4d2b-b43e-7e782db2f511 tempest-AZAdminV2TestJSON-1349839064 tempest-AZAdminV2TestJSON-1349839064-project-admin] 10.222.0.62 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.092024 Aug 29 15:25:52.264951 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 154/343] 10.222.0.62 () {58 vars in 1185 bytes} [Mon Aug 29 15:25:52 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:25:52.277493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6ba418d3-cf50-4e31-9607-a87ed03b3a95 tempest-SecurityGroupsTestAdminJSON-1178612712 tempest-SecurityGroupsTestAdminJSON-1178612712-project-admin] Calling method '.version_select at 0x7fc430387ca0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:52.791911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3f00c2ae-10f0-428d-8692-c6d37cf44983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:52.808836 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3f00c2ae-10f0-428d-8692-c6d37cf44983 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1319 microversion: 2.1 time: 0.877896 Aug 29 15:25:52.823760 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 190/344] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:51 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1319 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:53.825801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-20f80cd4-a164-4af2-a53c-173841208ca7 tempest-QuotaClassesAdmin257Test-1190013397 tempest-QuotaClassesAdmin257Test-1190013397-project-admin] Calling method '.version_select at 0x7fc430365ca0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:53.860838 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-20f80cd4-a164-4af2-a53c-173841208ca7 tempest-QuotaClassesAdmin257Test-1190013397 tempest-QuotaClassesAdmin257Test-1190013397-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.266018 Aug 29 15:25:53.861699 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 191/345] 10.222.0.62 () {60 vars in 1226 bytes} [Mon Aug 29 15:25:53 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:25:53.867097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6d2b122f-7f6f-41ae-a2ae-ed14c0b93a1f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:53.868113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6d2b122f-7f6f-41ae-a2ae-ed14c0b93a1f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:53.875375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d2b122f-7f6f-41ae-a2ae-ed14c0b93a1f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:53.876116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d2b122f-7f6f-41ae-a2ae-ed14c0b93a1f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:53.876729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d2b122f-7f6f-41ae-a2ae-ed14c0b93a1f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:53.877765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d2b122f-7f6f-41ae-a2ae-ed14c0b93a1f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:53.878366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d2b122f-7f6f-41ae-a2ae-ed14c0b93a1f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:53.878965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d2b122f-7f6f-41ae-a2ae-ed14c0b93a1f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:54.002383 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6ba418d3-cf50-4e31-9607-a87ed03b3a95 tempest-SecurityGroupsTestAdminJSON-1178612712 tempest-SecurityGroupsTestAdminJSON-1178612712-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/73cc95fc-7496-4af9-b78e-50312a56ac57" status: 202 len: 0 microversion: 2.1 time: 1.735647 Aug 29 15:25:54.004838 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 155/346] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:25:52 2022] DELETE /compute/v2.1/os-security-groups/73cc95fc-7496-4af9-b78e-50312a56ac57 => generated 0 bytes in 1739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:25:54.012957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-780dd610-4efe-4643-a339-9e3568c54a7b tempest-QuotaClassesAdmin257Test-1190013397 tempest-QuotaClassesAdmin257Test-1190013397-project-admin] Action: 'update', calling method: .version_select at 0x7fc43012e4c0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:54.204508 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-780dd610-4efe-4643-a339-9e3568c54a7b tempest-QuotaClassesAdmin257Test-1190013397 tempest-QuotaClassesAdmin257Test-1190013397-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.196705 Aug 29 15:25:54.213043 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 156/347] 10.222.0.62 () {62 vars in 1247 bytes} [Mon Aug 29 15:25:54 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:54.229146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3d82cf00-6e24-4824-ba7f-15253faa9037 tempest-SecurityGroupsTestAdminJSON-1062139827 tempest-SecurityGroupsTestAdminJSON-1062139827-project] Calling method '.version_select at 0x7fc430189310>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:54.700102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6d2b122f-7f6f-41ae-a2ae-ed14c0b93a1f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:54.703549 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3d82cf00-6e24-4824-ba7f-15253faa9037 tempest-SecurityGroupsTestAdminJSON-1062139827 tempest-SecurityGroupsTestAdminJSON-1062139827-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/22b0548d-e9fb-415c-b27a-dd6537fb1c33" status: 202 len: 0 microversion: 2.1 time: 0.488922 Aug 29 15:25:54.710533 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 157/348] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:25:54 2022] DELETE /compute/v2.1/os-security-groups/22b0548d-e9fb-415c-b27a-dd6537fb1c33 => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:25:54.715728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-61cc6209-eacf-469f-9746-2cf31eee0f90 tempest-QuotaClassesAdmin257Test-1190013397 tempest-QuotaClassesAdmin257Test-1190013397-project-admin] Calling method '.version_select at 0x7fc430189af0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:54.716646 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6d2b122f-7f6f-41ae-a2ae-ed14c0b93a1f tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1469 microversion: 2.1 time: 0.852779 Aug 29 15:25:54.728470 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-61cc6209-eacf-469f-9746-2cf31eee0f90 tempest-QuotaClassesAdmin257Test-1190013397 tempest-QuotaClassesAdmin257Test-1190013397-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.016482 Aug 29 15:25:54.736216 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 192/349] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:53 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1469 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:54.736830 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 158/350] 10.222.0.62 () {60 vars in 1226 bytes} [Mon Aug 29 15:25:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:54.742288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8e6b6f44-2f2e-4a68-8913-c902c09c585b tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:54.745413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8cf4366b-a402-4607-8682-b2893f2807a4 tempest-SecurityGroupsTestAdminJSON-1062139827 tempest-SecurityGroupsTestAdminJSON-1062139827-project] Calling method '.version_select at 0x7fc43013dc10>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:54.746946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8e6b6f44-2f2e-4a68-8913-c902c09c585b tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:54.755742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e6b6f44-2f2e-4a68-8913-c902c09c585b tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:54.756830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e6b6f44-2f2e-4a68-8913-c902c09c585b tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:54.757625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e6b6f44-2f2e-4a68-8913-c902c09c585b tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:54.759378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e6b6f44-2f2e-4a68-8913-c902c09c585b tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:54.760057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e6b6f44-2f2e-4a68-8913-c902c09c585b tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:54.760916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e6b6f44-2f2e-4a68-8913-c902c09c585b tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:54.943538 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8e6b6f44-2f2e-4a68-8913-c902c09c585b tempest-DeleteServersAdminTestJSON-1447485726 tempest-DeleteServersAdminTestJSON-1447485726-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c/action" status: 202 len: 0 microversion: 2.1 time: 0.204676 Aug 29 15:25:54.945148 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 159/351] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:25:54 2022] POST /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:25:54.952759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-efbc77bd-209f-483a-9d50-6cc7d98e6f29 tempest-QuotaClassesAdmin257Test-1190013397 tempest-QuotaClassesAdmin257Test-1190013397-project-admin] Action: 'update', calling method: .version_select at 0x7fc43013a8b0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:25:55.084932 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-efbc77bd-209f-483a-9d50-6cc7d98e6f29 tempest-QuotaClassesAdmin257Test-1190013397 tempest-QuotaClassesAdmin257Test-1190013397-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.138150 Aug 29 15:25:55.091121 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 160/352] 10.222.0.62 () {62 vars in 1247 bytes} [Mon Aug 29 15:25:54 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:25:55.130192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e1705305-1676-4959-afde-caf8850b1635 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:55.132629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e1705305-1676-4959-afde-caf8850b1635 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:55.146070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1705305-1676-4959-afde-caf8850b1635 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:55.147959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1705305-1676-4959-afde-caf8850b1635 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:55.148760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1705305-1676-4959-afde-caf8850b1635 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:55.151354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1705305-1676-4959-afde-caf8850b1635 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:55.152650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1705305-1676-4959-afde-caf8850b1635 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:55.154622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1705305-1676-4959-afde-caf8850b1635 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:55.252702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1705305-1676-4959-afde-caf8850b1635 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:55.252702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1705305-1676-4959-afde-caf8850b1635 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:55.252702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1705305-1676-4959-afde-caf8850b1635 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:55.252702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-e1705305-1676-4959-afde-caf8850b1635 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lazy-loading 'fault' on Instance uuid 7cca7e11-1c42-471e-9b89-0b824a56618c {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:25:55.602479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e1705305-1676-4959-afde-caf8850b1635 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:55.616382 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e1705305-1676-4959-afde-caf8850b1635 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1452 microversion: 2.1 time: 0.523122 Aug 29 15:25:55.641138 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 161/353] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:55 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1452 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:55.652360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-78a61722-8886-4560-95f4-7beffa6d3302 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:55.653882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-78a61722-8886-4560-95f4-7beffa6d3302 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:55.662137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a61722-8886-4560-95f4-7beffa6d3302 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:55.662984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a61722-8886-4560-95f4-7beffa6d3302 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:55.663642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a61722-8886-4560-95f4-7beffa6d3302 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:55.664579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a61722-8886-4560-95f4-7beffa6d3302 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:55.665271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a61722-8886-4560-95f4-7beffa6d3302 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:55.665904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a61722-8886-4560-95f4-7beffa6d3302 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:55.771814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-78a61722-8886-4560-95f4-7beffa6d3302 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:25:56.084317 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-78a61722-8886-4560-95f4-7beffa6d3302 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 204 len: 0 microversion: 2.1 time: 0.441215 Aug 29 15:25:56.086277 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 162/354] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:25:55 2022] DELETE /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:25:56.109050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-83ebb74e-bfdd-49d2-bd93-137059c35142 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:56.109741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-83ebb74e-bfdd-49d2-bd93-137059c35142 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:56.131870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83ebb74e-bfdd-49d2-bd93-137059c35142 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:56.132377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83ebb74e-bfdd-49d2-bd93-137059c35142 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:56.132816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83ebb74e-bfdd-49d2-bd93-137059c35142 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:56.142234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83ebb74e-bfdd-49d2-bd93-137059c35142 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:56.142799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83ebb74e-bfdd-49d2-bd93-137059c35142 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:56.143254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83ebb74e-bfdd-49d2-bd93-137059c35142 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:56.212409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83ebb74e-bfdd-49d2-bd93-137059c35142 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:56.213023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83ebb74e-bfdd-49d2-bd93-137059c35142 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:56.218663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83ebb74e-bfdd-49d2-bd93-137059c35142 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:56.222398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-83ebb74e-bfdd-49d2-bd93-137059c35142 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lazy-loading 'fault' on Instance uuid 7cca7e11-1c42-471e-9b89-0b824a56618c {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:25:56.503166 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8cf4366b-a402-4607-8682-b2893f2807a4 tempest-SecurityGroupsTestAdminJSON-1062139827 tempest-SecurityGroupsTestAdminJSON-1062139827-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/d9871a37-8af2-4f17-874b-659b85bc6b22" status: 202 len: 0 microversion: 2.1 time: 1.765215 Aug 29 15:25:56.503744 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 193/355] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:25:54 2022] DELETE /compute/v2.1/os-security-groups/d9871a37-8af2-4f17-874b-659b85bc6b22 => generated 0 bytes in 1767 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:25:57.039735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-83ebb74e-bfdd-49d2-bd93-137059c35142 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:57.054043 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-83ebb74e-bfdd-49d2-bd93-137059c35142 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1458 microversion: 2.1 time: 0.960949 Aug 29 15:25:57.055183 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 163/356] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:56 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1458 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:25:58.076308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-438ee272-50b4-4012-8a92-485dcda9bdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:25:58.077025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-438ee272-50b4-4012-8a92-485dcda9bdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:25:58.093404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-438ee272-50b4-4012-8a92-485dcda9bdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:58.101440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-438ee272-50b4-4012-8a92-485dcda9bdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:58.102101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-438ee272-50b4-4012-8a92-485dcda9bdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:58.104812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-438ee272-50b4-4012-8a92-485dcda9bdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:58.105385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-438ee272-50b4-4012-8a92-485dcda9bdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:58.109485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-438ee272-50b4-4012-8a92-485dcda9bdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:58.225070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-438ee272-50b4-4012-8a92-485dcda9bdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:25:58.226086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-438ee272-50b4-4012-8a92-485dcda9bdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:25:58.226829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-438ee272-50b4-4012-8a92-485dcda9bdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:25:58.227312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-438ee272-50b4-4012-8a92-485dcda9bdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lazy-loading 'fault' on Instance uuid 7cca7e11-1c42-471e-9b89-0b824a56618c {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:25:59.541220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-438ee272-50b4-4012-8a92-485dcda9bdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:25:59.556949 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-438ee272-50b4-4012-8a92-485dcda9bdeb tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1458 microversion: 2.1 time: 1.482975 Aug 29 15:25:59.571086 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 194/357] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:25:58 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1458 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:00.583370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e5eb842a-3594-4dc6-93f9-a492ec2c3d1d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:00.584176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e5eb842a-3594-4dc6-93f9-a492ec2c3d1d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:00.594947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5eb842a-3594-4dc6-93f9-a492ec2c3d1d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:00.596032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5eb842a-3594-4dc6-93f9-a492ec2c3d1d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:00.598113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5eb842a-3594-4dc6-93f9-a492ec2c3d1d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:00.599954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5eb842a-3594-4dc6-93f9-a492ec2c3d1d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:00.602739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5eb842a-3594-4dc6-93f9-a492ec2c3d1d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:00.605029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5eb842a-3594-4dc6-93f9-a492ec2c3d1d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:00.658478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:00.708455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5eb842a-3594-4dc6-93f9-a492ec2c3d1d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:00.709201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5eb842a-3594-4dc6-93f9-a492ec2c3d1d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:00.713021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5eb842a-3594-4dc6-93f9-a492ec2c3d1d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:00.714916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-e5eb842a-3594-4dc6-93f9-a492ec2c3d1d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lazy-loading 'fault' on Instance uuid 7cca7e11-1c42-471e-9b89-0b824a56618c {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:26:01.510394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e5eb842a-3594-4dc6-93f9-a492ec2c3d1d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:01.521743 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e5eb842a-3594-4dc6-93f9-a492ec2c3d1d tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1458 microversion: 2.1 time: 0.944230 Aug 29 15:26:01.550101 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 164/358] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:00 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1458 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:01.933661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-cf05a974-0eac-4b6b-91e7-2b10be644945 req-73e72d44-0992-4597-9401-e30419879b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cca7e11-1c42-471e-9b89-0b824a56618c", "name": "network-vif-deleted", "tag": "0a551a27-53a7-4d37-a830-0211d8ad0f7b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:01.943844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:01.971786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cf05a974-0eac-4b6b-91e7-2b10be644945 req-73e72d44-0992-4597-9401-e30419879b4a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:01.972209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cf05a974-0eac-4b6b-91e7-2b10be644945 req-73e72d44-0992-4597-9401-e30419879b4a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:01.980098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cf05a974-0eac-4b6b-91e7-2b10be644945 req-73e72d44-0992-4597-9401-e30419879b4a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:02.022285 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-cf05a974-0eac-4b6b-91e7-2b10be644945 req-73e72d44-0992-4597-9401-e30419879b4a service nova] Creating event network-vif-deleted:0a551a27-53a7-4d37-a830-0211d8ad0f7b for instance 7cca7e11-1c42-471e-9b89-0b824a56618c on n-h2-839401-11 Aug 29 15:26:02.038851 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-cf05a974-0eac-4b6b-91e7-2b10be644945 req-73e72d44-0992-4597-9401-e30419879b4a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110470 Aug 29 15:26:02.039770 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 195/359] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:02.549121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:02.553098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-36aa5f6e-444e-47c1-b96a-7f8a0105a3df tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:02.553754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-36aa5f6e-444e-47c1-b96a-7f8a0105a3df tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:02.555633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=17,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:02.573048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36aa5f6e-444e-47c1-b96a-7f8a0105a3df tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:02.573576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36aa5f6e-444e-47c1-b96a-7f8a0105a3df tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:02.573989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36aa5f6e-444e-47c1-b96a-7f8a0105a3df tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:02.574696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36aa5f6e-444e-47c1-b96a-7f8a0105a3df tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:02.575145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36aa5f6e-444e-47c1-b96a-7f8a0105a3df tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:02.575561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36aa5f6e-444e-47c1-b96a-7f8a0105a3df tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:02.704656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36aa5f6e-444e-47c1-b96a-7f8a0105a3df tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:02.705183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36aa5f6e-444e-47c1-b96a-7f8a0105a3df tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:02.705718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36aa5f6e-444e-47c1-b96a-7f8a0105a3df tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:02.706228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-36aa5f6e-444e-47c1-b96a-7f8a0105a3df tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lazy-loading 'fault' on Instance uuid 7cca7e11-1c42-471e-9b89-0b824a56618c {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:26:03.205003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-36aa5f6e-444e-47c1-b96a-7f8a0105a3df tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f612b7294244dba43a0fdc0ed8b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b78af2e97440639d6e8f3110342110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:03.217740 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-36aa5f6e-444e-47c1-b96a-7f8a0105a3df tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 200 len: 1309 microversion: 2.1 time: 0.667760 Aug 29 15:26:03.221016 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 165/360] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:02 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 1309 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:03.858900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:04.134523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-984979330", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:04.246488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d64044a8-a20e-4162-b66f-2097efa1ca51 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:04.247736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d64044a8-a20e-4162-b66f-2097efa1ca51 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:04.293358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:26:04.294472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d64044a8-a20e-4162-b66f-2097efa1ca51 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.299295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d64044a8-a20e-4162-b66f-2097efa1ca51 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.300003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d64044a8-a20e-4162-b66f-2097efa1ca51 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.305235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d64044a8-a20e-4162-b66f-2097efa1ca51 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.308084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d64044a8-a20e-4162-b66f-2097efa1ca51 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.309699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d64044a8-a20e-4162-b66f-2097efa1ca51 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.360459 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-d64044a8-a20e-4162-b66f-2097efa1ca51 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] HTTP exception thrown: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d64044a8-a20e-4162-b66f-2097efa1ca51 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Request method failure captured: Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c HTTP/1.1 Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpDqrToHXeMIhQx6Z0qo1G8yRi_WT0aaZLTsqRX2qltDNC96qfM8_jeLxQ5frFGYIwrCcRnkeHS59fO3UK2jh1vjFhZRKSKiSjyky3Xv5mBBPNO7mnjp0VII-3d9J_leb3mimcDDXobP1RweXR8y66crXxtFEvm3hJnvJRZQlk_668 Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: c9b78af2e97440639d6e8f3110342110 Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:26:04.362906 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:26:04.364181 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9b78af2e97440639d6e8f3110342110", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9b78af2e97440639d6e8f3110342110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9b78af2e97440639d6e8f3110342110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9b78af2e97440639d6e8f3110342110"}]}] Aug 29 15:26:04.364181 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:26:04.364181 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: c9b78af2e97440639d6e8f3110342110 Aug 29 15:26:04.364181 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:26:04.364181 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersAdminTestJSON-255653099-project Aug 29 15:26:04.364181 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:26:04.364181 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:26:04.364181 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 84f612b7294244dba43a0fdc0ed8b632 Aug 29 15:26:04.364181 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersAdminTestJSON-255653099-project Aug 29 15:26:04.364181 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:26:04.364181 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. Aug 29 15:26:04.364181 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7cca7e11-1c42-471e-9b89-0b824a56618c'} Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:04.364888 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. Aug 29 15:26:04.366453 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.371737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d64044a8-a20e-4162-b66f-2097efa1ca51 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Returning 404 to user: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:04.374036 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d64044a8-a20e-4162-b66f-2097efa1ca51 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 404 len: 111 microversion: 2.1 time: 0.132247 Aug 29 15:26:04.375398 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 166/361] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:04 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:26:04.399921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2404b2a6-cbf7-418e-8198-cf4c2d4408f0 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:04.401722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2404b2a6-cbf7-418e-8198-cf4c2d4408f0 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:04.430140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2404b2a6-cbf7-418e-8198-cf4c2d4408f0 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.432643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2404b2a6-cbf7-418e-8198-cf4c2d4408f0 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.434106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2404b2a6-cbf7-418e-8198-cf4c2d4408f0 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.435157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2404b2a6-cbf7-418e-8198-cf4c2d4408f0 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.437399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2404b2a6-cbf7-418e-8198-cf4c2d4408f0 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.439038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2404b2a6-cbf7-418e-8198-cf4c2d4408f0 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.459628 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-2404b2a6-cbf7-418e-8198-cf4c2d4408f0 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] HTTP exception thrown: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2404b2a6-cbf7-418e-8198-cf4c2d4408f0 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Request method failure captured: Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c HTTP/1.1 Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpDqrToHXeMIhQx6Z0qo1G8yRi_WT0aaZLTsqRX2qltDNC96qfM8_jeLxQ5frFGYIwrCcRnkeHS59fO3UK2jh1vjFhZRKSKiSjyky3Xv5mBBPNO7mnjp0VII-3d9J_leb3mimcDDXobP1RweXR8y66crXxtFEvm3hJnvJRZQlk_668 Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: c9b78af2e97440639d6e8f3110342110 Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:26:04.461382 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:26:04.462811 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9b78af2e97440639d6e8f3110342110", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9b78af2e97440639d6e8f3110342110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9b78af2e97440639d6e8f3110342110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9b78af2e97440639d6e8f3110342110"}]}] Aug 29 15:26:04.462811 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:26:04.462811 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: c9b78af2e97440639d6e8f3110342110 Aug 29 15:26:04.462811 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:26:04.462811 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersAdminTestJSON-255653099-project Aug 29 15:26:04.462811 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:26:04.462811 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:26:04.462811 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 84f612b7294244dba43a0fdc0ed8b632 Aug 29 15:26:04.462811 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersAdminTestJSON-255653099-project Aug 29 15:26:04.462811 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:26:04.462811 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. Aug 29 15:26:04.462811 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7cca7e11-1c42-471e-9b89-0b824a56618c'} Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:04.463547 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. Aug 29 15:26:04.464617 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.465822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2404b2a6-cbf7-418e-8198-cf4c2d4408f0 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Returning 404 to user: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:04.465822 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2404b2a6-cbf7-418e-8198-cf4c2d4408f0 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 404 len: 111 microversion: 2.1 time: 0.075724 Aug 29 15:26:04.465822 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 167/362] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:26:04 2022] DELETE /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:04.472929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7fb349f-68bc-4a5c-a315-90178dff08db tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:04.473629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f7fb349f-68bc-4a5c-a315-90178dff08db tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: 7cca7e11-1c42-471e-9b89-0b824a56618c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:04.480236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7fb349f-68bc-4a5c-a315-90178dff08db tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.480726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7fb349f-68bc-4a5c-a315-90178dff08db tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.485417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7fb349f-68bc-4a5c-a315-90178dff08db tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.486662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7fb349f-68bc-4a5c-a315-90178dff08db tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.489417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7fb349f-68bc-4a5c-a315-90178dff08db tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.490847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7fb349f-68bc-4a5c-a315-90178dff08db tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.523358 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-f7fb349f-68bc-4a5c-a315-90178dff08db tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] HTTP exception thrown: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7fb349f-68bc-4a5c-a315-90178dff08db tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Request method failure captured: Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c HTTP/1.1 Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpDqrToHXeMIhQx6Z0qo1G8yRi_WT0aaZLTsqRX2qltDNC96qfM8_jeLxQ5frFGYIwrCcRnkeHS59fO3UK2jh1vjFhZRKSKiSjyky3Xv5mBBPNO7mnjp0VII-3d9J_leb3mimcDDXobP1RweXR8y66crXxtFEvm3hJnvJRZQlk_668 Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: c9b78af2e97440639d6e8f3110342110 Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:26:04.525580 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:26:04.526771 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9b78af2e97440639d6e8f3110342110", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9b78af2e97440639d6e8f3110342110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9b78af2e97440639d6e8f3110342110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9b78af2e97440639d6e8f3110342110"}]}] Aug 29 15:26:04.526771 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:26:04.526771 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: c9b78af2e97440639d6e8f3110342110 Aug 29 15:26:04.526771 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:26:04.526771 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersAdminTestJSON-255653099-project Aug 29 15:26:04.526771 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:26:04.526771 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:26:04.526771 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 84f612b7294244dba43a0fdc0ed8b632 Aug 29 15:26:04.526771 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersAdminTestJSON-255653099-project Aug 29 15:26:04.526771 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:26:04.526771 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. Aug 29 15:26:04.526771 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7cca7e11-1c42-471e-9b89-0b824a56618c'} Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:04.528006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. Aug 29 15:26:04.529465 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.533989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7fb349f-68bc-4a5c-a315-90178dff08db tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Returning 404 to user: Instance 7cca7e11-1c42-471e-9b89-0b824a56618c could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:04.535284 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f7fb349f-68bc-4a5c-a315-90178dff08db tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c" status: 404 len: 111 microversion: 2.1 time: 0.066658 Aug 29 15:26:04.536355 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 168/363] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:04 2022] GET /compute/v2.1/servers/7cca7e11-1c42-471e-9b89-0b824a56618c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:26:04.547429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aede07da-56a9-4b59-a91d-d6d4d40b6ce5 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:04.547767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aede07da-56a9-4b59-a91d-d6d4d40b6ce5 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:04.556434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aede07da-56a9-4b59-a91d-d6d4d40b6ce5 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.557194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aede07da-56a9-4b59-a91d-d6d4d40b6ce5 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.557797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aede07da-56a9-4b59-a91d-d6d4d40b6ce5 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.558824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aede07da-56a9-4b59-a91d-d6d4d40b6ce5 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.559677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aede07da-56a9-4b59-a91d-d6d4d40b6ce5 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.560250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aede07da-56a9-4b59-a91d-d6d4d40b6ce5 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.585539 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-aede07da-56a9-4b59-a91d-d6d4d40b6ce5 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] HTTP exception thrown: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aede07da-56a9-4b59-a91d-d6d4d40b6ce5 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Request method failure captured: Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 HTTP/1.1 Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpDqrToHXeMIhQx6Z0qo1G8yRi_WT0aaZLTsqRX2qltDNC96qfM8_jeLxQ5frFGYIwrCcRnkeHS59fO3UK2jh1vjFhZRKSKiSjyky3Xv5mBBPNO7mnjp0VII-3d9J_leb3mimcDDXobP1RweXR8y66crXxtFEvm3hJnvJRZQlk_668 Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: c9b78af2e97440639d6e8f3110342110 Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:26:04.587456 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:26:04.588929 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9b78af2e97440639d6e8f3110342110", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9b78af2e97440639d6e8f3110342110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9b78af2e97440639d6e8f3110342110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9b78af2e97440639d6e8f3110342110"}]}] Aug 29 15:26:04.588929 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:26:04.588929 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: c9b78af2e97440639d6e8f3110342110 Aug 29 15:26:04.588929 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:26:04.588929 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersAdminTestJSON-255653099-project Aug 29 15:26:04.588929 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:26:04.588929 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:26:04.588929 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 84f612b7294244dba43a0fdc0ed8b632 Aug 29 15:26:04.588929 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersAdminTestJSON-255653099-project Aug 29 15:26:04.588929 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:26:04.588929 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. Aug 29 15:26:04.588929 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'd998f970-2fb9-48d6-9a9d-2907f9019b14'} Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:04.589804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. Aug 29 15:26:04.591743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.597741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aede07da-56a9-4b59-a91d-d6d4d40b6ce5 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Returning 404 to user: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:04.598879 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aede07da-56a9-4b59-a91d-d6d4d40b6ce5 tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 404 len: 111 microversion: 2.1 time: 0.056825 Aug 29 15:26:04.600057 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 169/364] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:26:04 2022] DELETE /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:26:04.610157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-91b0df82-6d16-4ed2-b99b-8291d553b4fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:04.611482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-91b0df82-6d16-4ed2-b99b-8291d553b4fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] [instance: d998f970-2fb9-48d6-9a9d-2907f9019b14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:04.620706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91b0df82-6d16-4ed2-b99b-8291d553b4fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.621229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91b0df82-6d16-4ed2-b99b-8291d553b4fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.621889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91b0df82-6d16-4ed2-b99b-8291d553b4fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.622810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91b0df82-6d16-4ed2-b99b-8291d553b4fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:04.624890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91b0df82-6d16-4ed2-b99b-8291d553b4fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:04.626933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91b0df82-6d16-4ed2-b99b-8291d553b4fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:04.667815 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-91b0df82-6d16-4ed2-b99b-8291d553b4fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] HTTP exception thrown: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-91b0df82-6d16-4ed2-b99b-8291d553b4fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Request method failure captured: Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 HTTP/1.1 Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNpDqrToHXeMIhQx6Z0qo1G8yRi_WT0aaZLTsqRX2qltDNC96qfM8_jeLxQ5frFGYIwrCcRnkeHS59fO3UK2jh1vjFhZRKSKiSjyky3Xv5mBBPNO7mnjp0VII-3d9J_leb3mimcDDXobP1RweXR8y66crXxtFEvm3hJnvJRZQlk_668 Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: c9b78af2e97440639d6e8f3110342110 Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:26:04.669879 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:26:04.671077 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9b78af2e97440639d6e8f3110342110", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9b78af2e97440639d6e8f3110342110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9b78af2e97440639d6e8f3110342110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9b78af2e97440639d6e8f3110342110"}]}] Aug 29 15:26:04.671077 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:26:04.671077 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: c9b78af2e97440639d6e8f3110342110 Aug 29 15:26:04.671077 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-255653099 Aug 29 15:26:04.671077 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersAdminTestJSON-255653099-project Aug 29 15:26:04.671077 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:26:04.671077 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:26:04.671077 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 84f612b7294244dba43a0fdc0ed8b632 Aug 29 15:26:04.671077 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersAdminTestJSON-255653099-project Aug 29 15:26:04.671077 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:26:04.671077 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. Aug 29 15:26:04.671077 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'd998f970-2fb9-48d6-9a9d-2907f9019b14'} Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:04.671764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. Aug 29 15:26:04.672960 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:04.683364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-91b0df82-6d16-4ed2-b99b-8291d553b4fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] Returning 404 to user: Instance d998f970-2fb9-48d6-9a9d-2907f9019b14 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:04.684521 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-91b0df82-6d16-4ed2-b99b-8291d553b4fd tempest-DeleteServersAdminTestJSON-255653099 tempest-DeleteServersAdminTestJSON-255653099-project] 10.222.0.62 "GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14" status: 404 len: 111 microversion: 2.1 time: 0.080788 Aug 29 15:26:04.688915 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 170/365] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:04 2022] GET /compute/v2.1/servers/d998f970-2fb9-48d6-9a9d-2907f9019b14 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:26:05.223845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:05.639778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-93c4a6ca-8a2d-4e95-af8d-88bc464366ef tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-77206552", "id": 844478447, "os-flavor-access:is_public": "False"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:05.675787 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-93c4a6ca-8a2d-4e95-af8d-88bc464366ef tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.456355 Aug 29 15:26:05.676380 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 171/366] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:05 2022] POST /compute/v2.1/flavors => generated 434 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:05.693999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-83d10d32-7c08-4e6d-b9de-62d66b9dd585 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b2797d226dd7433fb38ad83bde5f888c"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:05.761396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:26:05.762030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:26:05.762530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:26:05.763040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:26:05.763693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:26:05.796198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:05.796709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:05.806264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:05.807290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:05.807794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:05.808235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:05.897844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Getting quotas for project 6a741530ffa14110887b496a6424a0a2. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:26:05.911580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Getting quotas for user e6ef9a5fbe854fc0a457827081376490 and project 6a741530ffa14110887b496a6424a0a2. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:26:05.960706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:26:05.967046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:26:06.080151 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-05c67feb-3244-4232-8c07-2e6811b45e18 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.322331 Aug 29 15:26:06.087033 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 196/367] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:26:06.095849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e8a10626-817a-44a4-8b3f-17b0ead51b25 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:06.096596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e8a10626-817a-44a4-8b3f-17b0ead51b25 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:06.370052 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-83d10d32-7c08-4e6d-b9de-62d66b9dd585 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors/844478447/action" status: 200 len: 96 microversion: 2.1 time: 0.679615 Aug 29 15:26:06.373585 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 172/368] 10.222.0.62 () {60 vars in 1197 bytes} [Mon Aug 29 15:26:05 2022] POST /compute/v2.1/flavors/844478447/action => generated 96 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:26:06.383171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-38d8a9ee-52a0-470e-9073-cb9a2c8c2421 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b2797d226dd7433fb38ad83bde5f888c"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:06.419675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e8a10626-817a-44a4-8b3f-17b0ead51b25 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:06.432405 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e8a10626-817a-44a4-8b3f-17b0ead51b25 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 200 len: 1222 microversion: 2.1 time: 0.339375 Aug 29 15:26:06.433495 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 197/369] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:06 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 1222 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:07.172180 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-38d8a9ee-52a0-470e-9073-cb9a2c8c2421 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] HTTP exception thrown: Flavor access already exists for flavor 32 and project b2797d226dd7433fb38ad83bde5f888c combination. Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-38d8a9ee-52a0-470e-9073-cb9a2c8c2421 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Request method failure captured: Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/flavors/844478447/action HTTP/1.1 Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 67 Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqLqPGY734673zVn72gIahvDIdUm3Q4uRYNkVPfhFjSOmQ3Tjymsq1k63VkSHvhTuY6m6I5ko2CITSGpI-G4ATjHHRoFn85Yd9lvf5EGFA6XNSdFQv4Q3wzKNZzZZ3BHN4JRXfVFWvyDpJKvGLFyArqob5ArZFbv83VahTEYUXGpEE Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: c331b3e1fdf94a32a6073f0cdf23f042 Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-605962135 Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:26:07.189188 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:26:07.190409 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c331b3e1fdf94a32a6073f0cdf23f042", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c331b3e1fdf94a32a6073f0cdf23f042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c331b3e1fdf94a32a6073f0cdf23f042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c331b3e1fdf94a32a6073f0cdf23f042"}]}] Aug 29 15:26:07.190409 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-605962135 Aug 29 15:26:07.190409 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: c331b3e1fdf94a32a6073f0cdf23f042 Aug 29 15:26:07.190409 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-605962135 Aug 29 15:26:07.190409 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin Aug 29 15:26:07.190409 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:26:07.190409 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:26:07.190409 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 3ac1a93eb9ae4c93874a6827a10c9aa1 Aug 29 15:26:07.190409 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin Aug 29 15:26:07.190409 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:26:07.190409 n-d-839401-11 devstack@n-api.service[122360]: {"addTenantAccess": {"tenant": "b2797d226dd7433fb38ad83bde5f888c"}} Aug 29 15:26:07.190409 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: exception: Flavor access already exists for flavor 32 and project b2797d226dd7433fb38ad83bde5f888c combination. Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '844478447', 'body': {'addTenantAccess': {'tenant': 'b2797d226dd7433fb38ad83bde5f888c'}}} Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:26:07.191168 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '32-b2797d226dd7433fb38ad83bde5f888c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi session.flush() Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:26:07.192152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:26:07.193294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:26:07.194311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '32-b2797d226dd7433fb38ad83bde5f888c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 29, 15, 26, 7, 164604), 'updated_at': None, 'flavor_id': 32, 'project_id': 'b2797d226dd7433fb38ad83bde5f888c'}] Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:07.197021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 32 and project b2797d226dd7433fb38ad83bde5f888c combination. Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:07.199297 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 32 and project b2797d226dd7433fb38ad83bde5f888c combination. Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:07.201521 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:07.202967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 32 and project b2797d226dd7433fb38ad83bde5f888c combination. Aug 29 15:26:07.202967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:07.202967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-38d8a9ee-52a0-470e-9073-cb9a2c8c2421 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Returning 409 to user: Flavor access already exists for flavor 32 and project b2797d226dd7433fb38ad83bde5f888c combination. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:07.202967 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-38d8a9ee-52a0-470e-9073-cb9a2c8c2421 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors/844478447/action" status: 409 len: 152 microversion: 2.1 time: 0.811497 Aug 29 15:26:07.202967 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 173/370] 10.222.0.62 () {60 vars in 1197 bytes} [Mon Aug 29 15:26:06 2022] POST /compute/v2.1/flavors/844478447/action => generated 152 bytes in 820 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:26:07.208765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-65ea45a8-6ee6-4efa-828e-216268481ecf tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b2797d226dd7433fb38ad83bde5f888c"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:07.453575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c8ab9a5d-1c12-45b8-9a77-a9226bc5b346 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:07.454254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c8ab9a5d-1c12-45b8-9a77-a9226bc5b346 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:07.463496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8ab9a5d-1c12-45b8-9a77-a9226bc5b346 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:07.468798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8ab9a5d-1c12-45b8-9a77-a9226bc5b346 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:07.469523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8ab9a5d-1c12-45b8-9a77-a9226bc5b346 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:07.470491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8ab9a5d-1c12-45b8-9a77-a9226bc5b346 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:07.473523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8ab9a5d-1c12-45b8-9a77-a9226bc5b346 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:07.474303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8ab9a5d-1c12-45b8-9a77-a9226bc5b346 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:07.721109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c8ab9a5d-1c12-45b8-9a77-a9226bc5b346 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:07.737961 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c8ab9a5d-1c12-45b8-9a77-a9226bc5b346 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 200 len: 1226 microversion: 2.1 time: 0.288107 Aug 29 15:26:07.739458 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 174/371] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:07 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 1226 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:08.416473 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-65ea45a8-6ee6-4efa-828e-216268481ecf tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors/844478447/action" status: 200 len: 21 microversion: 2.1 time: 1.211529 Aug 29 15:26:08.417521 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 198/372] 10.222.0.62 () {60 vars in 1197 bytes} [Mon Aug 29 15:26:07 2022] POST /compute/v2.1/flavors/844478447/action => generated 21 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:26:08.780221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-852346580", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "26d82d80-e2bf-4b2e-bd4a-38c04c1b6f6c"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:08.854006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1532616824", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:08.890248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] validate_networks() for [('26d82d80-e2bf-4b2e-bd4a-38c04c1b6f6c', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:26:08.978806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] validate_networks() for None {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:26:10.026164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:26:10.027951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:26:10.030444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:26:10.031041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:26:10.031637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:26:10.052144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:10.053924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:10.057291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:10.061789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:10.062520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:10.063757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:10.115720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Getting quotas for project 3794161498684ce19acf188df258eeff. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:26:10.129683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Getting quotas for user 32267072a4ed46cb8c596117db38fae5 and project 3794161498684ce19acf188df258eeff. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:26:10.175120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:26:10.180273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:26:10.295181 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-483c2153-0d3f-4ef1-9910-3a1afacd8141 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.374934 Aug 29 15:26:10.298033 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 175/373] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:26:10.318519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4d991a94-1a9d-4adc-8553-d8d577a30f82 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:10.357933 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4d991a94-1a9d-4adc-8553-d8d577a30f82 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/844478447" status: 202 len: 0 microversion: 2.1 time: 0.049045 Aug 29 15:26:10.359058 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 176/374] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 15:26:10 2022] DELETE /compute/v2.1/flavors/844478447 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:26:10.367338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4469672b-c3a9-40ab-8dd3-71f507cebb3d tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:10.368044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4469672b-c3a9-40ab-8dd3-71f507cebb3d tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:10.396101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4469672b-c3a9-40ab-8dd3-71f507cebb3d tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:10.396393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4469672b-c3a9-40ab-8dd3-71f507cebb3d tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:10.397206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4469672b-c3a9-40ab-8dd3-71f507cebb3d tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:10.398056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4469672b-c3a9-40ab-8dd3-71f507cebb3d tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:10.398596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4469672b-c3a9-40ab-8dd3-71f507cebb3d tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:10.399092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4469672b-c3a9-40ab-8dd3-71f507cebb3d tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:10.652498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4469672b-c3a9-40ab-8dd3-71f507cebb3d tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:10.666996 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4469672b-c3a9-40ab-8dd3-71f507cebb3d tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 200 len: 1280 microversion: 2.1 time: 0.306729 Aug 29 15:26:10.673586 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 177/375] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:10 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 1280 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:10.678873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bfc0bb04-83f7-432b-a501-be93683d9fae tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:10.697366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bfc0bb04-83f7-432b-a501-be93683d9fae tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:11.055571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bfc0bb04-83f7-432b-a501-be93683d9fae tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:11.065257 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bfc0bb04-83f7-432b-a501-be93683d9fae tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1222 microversion: 2.1 time: 0.390208 Aug 29 15:26:11.070496 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 178/376] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:10 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1222 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:11.085503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dd61e90e-53a7-4cbe-8b35-590ba4f8f3d6 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:11.158941 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dd61e90e-53a7-4cbe-8b35-590ba4f8f3d6 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.087113 Aug 29 15:26:11.170156 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 179/377] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:11.718366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4fa8d146-d198-4fb4-ae2e-f21fc0bfb822 tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] Action: 'create', calling method: .version_select at 0x7fc43002e9d0>, body: {"pool": null} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:12.809689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:26:12.810511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:26:12.810793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:26:12.811113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:26:12.811431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:26:12.854491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:12.855330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:12.870262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:12.871797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:12.872760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:12.873687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:12.919382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Getting quotas for project ef5a2735bd95451ab466c5560cbe28fe. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:26:12.929859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Getting quotas for user 9011569d41804e27a53fe5831988a88a and project ef5a2735bd95451ab466c5560cbe28fe. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:26:12.959577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:26:12.968946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:26:13.139439 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c844d1f3-fe06-435f-9d69-3712f1a892ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.718917 Aug 29 15:26:13.147943 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 199/378] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:26:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 4728 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:26:13.155550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3763ea17-491f-46ab-8cf2-e44ab6b66722 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-27421079", "id": 1372399957, "os-flavor-access:is_public": "True"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:13.200624 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3763ea17-491f-46ab-8cf2-e44ab6b66722 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.049020 Aug 29 15:26:13.202919 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 200/379] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:13 2022] POST /compute/v2.1/flavors => generated 436 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:13.209123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-da3e5943-ebed-4233-8207-99b7d3ec681a tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:13.211210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-da3e5943-ebed-4233-8207-99b7d3ec681a tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:13.221173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da3e5943-ebed-4233-8207-99b7d3ec681a tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:13.221996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da3e5943-ebed-4233-8207-99b7d3ec681a tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:13.222629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da3e5943-ebed-4233-8207-99b7d3ec681a tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:13.223675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da3e5943-ebed-4233-8207-99b7d3ec681a tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:13.238080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da3e5943-ebed-4233-8207-99b7d3ec681a tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:13.239569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da3e5943-ebed-4233-8207-99b7d3ec681a tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:14.237622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-da3e5943-ebed-4233-8207-99b7d3ec681a tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:14.251903 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-da3e5943-ebed-4233-8207-99b7d3ec681a tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 200 len: 1322 microversion: 2.1 time: 1.047668 Aug 29 15:26:14.257183 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 201/380] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:13 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 1322 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:14.267200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1be373e6-441e-475a-a5c1-118a01044c97 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:14.271797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1be373e6-441e-475a-a5c1-118a01044c97 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:14.287118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1be373e6-441e-475a-a5c1-118a01044c97 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:14.289297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1be373e6-441e-475a-a5c1-118a01044c97 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:14.291527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1be373e6-441e-475a-a5c1-118a01044c97 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:14.300085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1be373e6-441e-475a-a5c1-118a01044c97 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:14.300859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1be373e6-441e-475a-a5c1-118a01044c97 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:14.301502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1be373e6-441e-475a-a5c1-118a01044c97 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:14.502013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1be373e6-441e-475a-a5c1-118a01044c97 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:14.511927 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1be373e6-441e-475a-a5c1-118a01044c97 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1280 microversion: 2.1 time: 0.250407 Aug 29 15:26:14.525802 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 202/381] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:14 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1280 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:14.540965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d2c6c804-aaf9-4a22-8609-4c8d16da8627 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:14.541535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d2c6c804-aaf9-4a22-8609-4c8d16da8627 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:14.558809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2c6c804-aaf9-4a22-8609-4c8d16da8627 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:14.559501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2c6c804-aaf9-4a22-8609-4c8d16da8627 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:14.560099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2c6c804-aaf9-4a22-8609-4c8d16da8627 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:14.560967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2c6c804-aaf9-4a22-8609-4c8d16da8627 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:14.561622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2c6c804-aaf9-4a22-8609-4c8d16da8627 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:14.562202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2c6c804-aaf9-4a22-8609-4c8d16da8627 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:14.825591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d2c6c804-aaf9-4a22-8609-4c8d16da8627 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:14.841195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d2c6c804-aaf9-4a22-8609-4c8d16da8627 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:14.846907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d2c6c804-aaf9-4a22-8609-4c8d16da8627 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:14.852502 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d2c6c804-aaf9-4a22-8609-4c8d16da8627 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1313 microversion: 2.25 time: 0.325435 Aug 29 15:26:14.854574 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 203/382] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:14 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:14.869049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c4ade9c6-b308-48a3-9c7f-8a361e16273b tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:14.886643 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-c4ade9c6-b308-48a3-9c7f-8a361e16273b tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c4ade9c6-b308-48a3-9c7f-8a361e16273b tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Request method failure captured: Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/flavors/1372399957/os-flavor-access HTTP/1.1 Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNqLqPGY734673zVn72gIahvDIdUm3Q4uRYNkVPfhFjSOmQ3Tjymsq1k63VkSHvhTuY6m6I5ko2CITSGpI-G4ATjHHRoFn85Yd9lvf5EGFA6XNSdFQv4Q3wzKNZzZZ3BHN4JRXfVFWvyDpJKvGLFyArqob5ArZFbv83VahTEYUXGpEE Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: c331b3e1fdf94a32a6073f0cdf23f042 Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-605962135 Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:26:14.891911 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:26:14.893517 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c331b3e1fdf94a32a6073f0cdf23f042", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c331b3e1fdf94a32a6073f0cdf23f042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c331b3e1fdf94a32a6073f0cdf23f042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c331b3e1fdf94a32a6073f0cdf23f042"}]}] Aug 29 15:26:14.893517 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-605962135 Aug 29 15:26:14.893517 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: c331b3e1fdf94a32a6073f0cdf23f042 Aug 29 15:26:14.893517 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-605962135 Aug 29 15:26:14.893517 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin Aug 29 15:26:14.893517 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:26:14.893517 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:26:14.893517 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 3ac1a93eb9ae4c93874a6827a10c9aa1 Aug 29 15:26:14.893517 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin Aug 29 15:26:14.893517 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:26:14.893517 n-d-839401-11 devstack@n-api.service[122361]: exception: Access list not available for public flavors. Aug 29 15:26:14.893517 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'flavor_id': '1372399957'} Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 29 15:26:14.894323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:14.898960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c4ade9c6-b308-48a3-9c7f-8a361e16273b tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:14.900830 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c4ade9c6-b308-48a3-9c7f-8a361e16273b tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/1372399957/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.041820 Aug 29 15:26:14.901597 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 204/383] 10.222.0.62 () {58 vars in 1209 bytes} [Mon Aug 29 15:26:14 2022] GET /compute/v2.1/flavors/1372399957/os-flavor-access => generated 91 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:26:15.228334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c62af48-ccc1-4d8e-94ad-acbdf30c0470 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Calling method '.version_select at 0x7fc430130040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:15.243542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c62af48-ccc1-4d8e-94ad-acbdf30c0470 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:15.246590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c62af48-ccc1-4d8e-94ad-acbdf30c0470 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:15.247045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c62af48-ccc1-4d8e-94ad-acbdf30c0470 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:15.253495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c62af48-ccc1-4d8e-94ad-acbdf30c0470 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:15.256409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c62af48-ccc1-4d8e-94ad-acbdf30c0470 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:15.257052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c62af48-ccc1-4d8e-94ad-acbdf30c0470 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:15.357677 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6c62af48-ccc1-4d8e-94ad-acbdf30c0470 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.453727 Aug 29 15:26:15.359938 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 205/384] 10.222.0.62 () {58 vars in 1128 bytes} [Mon Aug 29 15:26:14 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:15.369018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cfbbfac3-7dab-402b-9eb6-9740034a84cd tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:15.401440 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cfbbfac3-7dab-402b-9eb6-9740034a84cd tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/1372399957" status: 202 len: 0 microversion: 2.1 time: 0.038787 Aug 29 15:26:15.408829 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 206/385] 10.222.0.62 () {58 vars in 1161 bytes} [Mon Aug 29 15:26:15 2022] DELETE /compute/v2.1/flavors/1372399957 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:26:15.414131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-88445c8b-1ba7-459a-a486-5678ef09fd7b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:15.424101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-88445c8b-1ba7-459a-a486-5678ef09fd7b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:15.432373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88445c8b-1ba7-459a-a486-5678ef09fd7b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:15.435753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88445c8b-1ba7-459a-a486-5678ef09fd7b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:15.438450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88445c8b-1ba7-459a-a486-5678ef09fd7b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:15.439385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88445c8b-1ba7-459a-a486-5678ef09fd7b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:15.440061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88445c8b-1ba7-459a-a486-5678ef09fd7b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:15.447025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88445c8b-1ba7-459a-a486-5678ef09fd7b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:16.324311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-88445c8b-1ba7-459a-a486-5678ef09fd7b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:16.332531 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-88445c8b-1ba7-459a-a486-5678ef09fd7b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 200 len: 1322 microversion: 2.1 time: 0.922114 Aug 29 15:26:16.346285 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 207/386] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:15 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 1322 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:16.352276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-87ec65bf-9533-426d-b62f-eb75d2fc7c98 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Calling method '.version_select at 0x7fc4302c6430>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:16.356247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87ec65bf-9533-426d-b62f-eb75d2fc7c98 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:16.356927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87ec65bf-9533-426d-b62f-eb75d2fc7c98 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:16.357627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87ec65bf-9533-426d-b62f-eb75d2fc7c98 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:16.358542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87ec65bf-9533-426d-b62f-eb75d2fc7c98 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:16.361024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87ec65bf-9533-426d-b62f-eb75d2fc7c98 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:16.361750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87ec65bf-9533-426d-b62f-eb75d2fc7c98 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:16.387989 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-87ec65bf-9533-426d-b62f-eb75d2fc7c98 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.040335 Aug 29 15:26:16.398058 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 208/387] 10.222.0.62 () {58 vars in 1139 bytes} [Mon Aug 29 15:26:16 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:16.403148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c5354d90-b9ad-4d64-8267-82ce078ddba4 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:16.427425 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c5354d90-b9ad-4d64-8267-82ce078ddba4 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027865 Aug 29 15:26:16.428693 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 209/388] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:16.433614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e65f4a7e-5927-4ab6-bef5-b686e80ffee6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:16.434409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e65f4a7e-5927-4ab6-bef5-b686e80ffee6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:16.441336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e65f4a7e-5927-4ab6-bef5-b686e80ffee6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:16.442081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e65f4a7e-5927-4ab6-bef5-b686e80ffee6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:16.442712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e65f4a7e-5927-4ab6-bef5-b686e80ffee6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:16.446212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e65f4a7e-5927-4ab6-bef5-b686e80ffee6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:16.446864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e65f4a7e-5927-4ab6-bef5-b686e80ffee6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:16.447486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e65f4a7e-5927-4ab6-bef5-b686e80ffee6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:16.603020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e65f4a7e-5927-4ab6-bef5-b686e80ffee6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:16.612092 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e65f4a7e-5927-4ab6-bef5-b686e80ffee6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1280 microversion: 2.1 time: 0.182013 Aug 29 15:26:16.615642 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 210/389] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:16 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1280 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:16.623231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6b7021b0-4e67-4d92-be3e-be00884f3bf0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:16.627637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6b7021b0-4e67-4d92-be3e-be00884f3bf0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:16.639063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b7021b0-4e67-4d92-be3e-be00884f3bf0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:16.641754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b7021b0-4e67-4d92-be3e-be00884f3bf0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:16.642279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b7021b0-4e67-4d92-be3e-be00884f3bf0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:16.643774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b7021b0-4e67-4d92-be3e-be00884f3bf0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:16.645626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b7021b0-4e67-4d92-be3e-be00884f3bf0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:16.646161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b7021b0-4e67-4d92-be3e-be00884f3bf0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:17.104676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6b7021b0-4e67-4d92-be3e-be00884f3bf0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:17.117014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6b7021b0-4e67-4d92-be3e-be00884f3bf0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:17.120834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6b7021b0-4e67-4d92-be3e-be00884f3bf0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:17.125555 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6b7021b0-4e67-4d92-be3e-be00884f3bf0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1319 microversion: 2.25 time: 0.508645 Aug 29 15:26:17.126266 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 211/390] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:16 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:17.137847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-05c74512-21b4-43ed-8635-b76bf8a7ac1c req-abfdb700-39e8-4cf5-9357-8388cfcb648a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f88a208-e1f7-4f75-9665-06c232424f14", "tag": "c5f04826-f0a6-42a1-98f6-2fcd03fd3473"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:17.164106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-05c74512-21b4-43ed-8635-b76bf8a7ac1c req-abfdb700-39e8-4cf5-9357-8388cfcb648a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:17.164718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-05c74512-21b4-43ed-8635-b76bf8a7ac1c req-abfdb700-39e8-4cf5-9357-8388cfcb648a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:17.165309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-05c74512-21b4-43ed-8635-b76bf8a7ac1c req-abfdb700-39e8-4cf5-9357-8388cfcb648a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:17.194332 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-05c74512-21b4-43ed-8635-b76bf8a7ac1c req-abfdb700-39e8-4cf5-9357-8388cfcb648a service nova] Creating event network-changed:c5f04826-f0a6-42a1-98f6-2fcd03fd3473 for instance 7f88a208-e1f7-4f75-9665-06c232424f14 on n-h2-839401-11 Aug 29 15:26:17.204440 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-05c74512-21b4-43ed-8635-b76bf8a7ac1c req-abfdb700-39e8-4cf5-9357-8388cfcb648a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076421 Aug 29 15:26:17.206491 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 212/391] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:17.225069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-82b8c5b0-3186-4171-a3b2-b31b4dc698d8 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Calling method '.version_select at 0x7fc4301699d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:17.230315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82b8c5b0-3186-4171-a3b2-b31b4dc698d8 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:17.230964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82b8c5b0-3186-4171-a3b2-b31b4dc698d8 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:17.231699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82b8c5b0-3186-4171-a3b2-b31b4dc698d8 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:17.232677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82b8c5b0-3186-4171-a3b2-b31b4dc698d8 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:17.233470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82b8c5b0-3186-4171-a3b2-b31b4dc698d8 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:17.235611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82b8c5b0-3186-4171-a3b2-b31b4dc698d8 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:17.292126 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4fa8d146-d198-4fb4-ae2e-f21fc0bfb822 tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] 10.222.0.62 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.117708 Aug 29 15:26:17.292716 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 180/392] 10.222.0.62 () {60 vars in 1170 bytes} [Mon Aug 29 15:26:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:17.299175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ae9f6c5c-e534-40c2-b14b-ee2b9285ee46 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1511700871", "id": 1419570200, "os-flavor-access:is_public": "False"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:17.322135 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-82b8c5b0-3186-4171-a3b2-b31b4dc698d8 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.101284 Aug 29 15:26:17.322762 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 213/393] 10.222.0.62 () {58 vars in 1145 bytes} [Mon Aug 29 15:26:17 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:26:17.339151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8c53bee8-bc6c-4256-8634-840671d3413a tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] Calling method '.version_select at 0x7fc430130310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:17.346610 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ae9f6c5c-e534-40c2-b14b-ee2b9285ee46 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.051965 Aug 29 15:26:17.350546 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 181/394] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:17 2022] POST /compute/v2.1/flavors => generated 439 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:17.370830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-209c0845-2616-4840-847d-53c7a11faf43 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Calling method '.version_select at 0x7fc4300861f0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:17.376709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-209c0845-2616-4840-847d-53c7a11faf43 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:17.377800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-209c0845-2616-4840-847d-53c7a11faf43 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:17.378476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-209c0845-2616-4840-847d-53c7a11faf43 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:17.381010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-209c0845-2616-4840-847d-53c7a11faf43 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:17.381834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-209c0845-2616-4840-847d-53c7a11faf43 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:17.384174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-209c0845-2616-4840-847d-53c7a11faf43 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:17.432038 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-209c0845-2616-4840-847d-53c7a11faf43 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.076123 Aug 29 15:26:17.432989 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 182/395] 10.222.0.62 () {58 vars in 1128 bytes} [Mon Aug 29 15:26:17 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:17.438151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4d1e12c4-6072-4075-81bc-44c97fcb0a3c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:17.439059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4d1e12c4-6072-4075-81bc-44c97fcb0a3c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:17.450349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d1e12c4-6072-4075-81bc-44c97fcb0a3c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:17.451667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d1e12c4-6072-4075-81bc-44c97fcb0a3c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:17.452159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d1e12c4-6072-4075-81bc-44c97fcb0a3c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:17.453007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d1e12c4-6072-4075-81bc-44c97fcb0a3c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:17.453597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d1e12c4-6072-4075-81bc-44c97fcb0a3c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:17.454048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d1e12c4-6072-4075-81bc-44c97fcb0a3c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:17.786930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4d1e12c4-6072-4075-81bc-44c97fcb0a3c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:17.800592 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4d1e12c4-6072-4075-81bc-44c97fcb0a3c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 200 len: 1322 microversion: 2.1 time: 0.365968 Aug 29 15:26:17.802490 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 183/396] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:17 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:18.033852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3746447b-23e7-4511-8832-0b5e8a751830 tempest-FlavorsAccessNegativeTestJSON-2051868412 tempest-FlavorsAccessNegativeTestJSON-2051868412-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b2797d226dd7433fb38ad83bde5f888c"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:18.040038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3746447b-23e7-4511-8832-0b5e8a751830 tempest-FlavorsAccessNegativeTestJSON-2051868412 tempest-FlavorsAccessNegativeTestJSON-2051868412-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'dc3b973d10d5404ebdf7a79be18eabef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2797d226dd7433fb38ad83bde5f888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3746447b-23e7-4511-8832-0b5e8a751830 tempest-FlavorsAccessNegativeTestJSON-2051868412 tempest-FlavorsAccessNegativeTestJSON-2051868412-project] Request method failure captured: Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/flavors/1419570200/action HTTP/1.1 Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 67 Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqJzj69aZMPYwlQrXXRpEFogq-x5E6DCj8lKEqIMuYATVyauLtXMIfiRQrdYD99C4drbslkLoMfknj-cCYaX9LHr0UCamRd4iyL9juUlbKEG5xxkna8oRm-pd-f5oEkLIB2pb3lpeK8lvbspD6Zpqiw2935a_dKMmWKR0QBw_Ohn1I Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: b2797d226dd7433fb38ad83bde5f888c Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2051868412 Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:26:18.042299 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:26:18.043808 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b2797d226dd7433fb38ad83bde5f888c", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b2797d226dd7433fb38ad83bde5f888c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2797d226dd7433fb38ad83bde5f888c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2797d226dd7433fb38ad83bde5f888c"}]}] Aug 29 15:26:18.043808 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2051868412 Aug 29 15:26:18.043808 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: b2797d226dd7433fb38ad83bde5f888c Aug 29 15:26:18.043808 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2051868412 Aug 29 15:26:18.043808 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-FlavorsAccessNegativeTestJSON-2051868412-project Aug 29 15:26:18.043808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:26:18.043808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:26:18.043808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: dc3b973d10d5404ebdf7a79be18eabef Aug 29 15:26:18.043808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2051868412-project Aug 29 15:26:18.043808 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:26:18.043808 n-d-839401-11 devstack@n-api.service[122360]: {"addTenantAccess": {"tenant": "b2797d226dd7433fb38ad83bde5f888c"}} Aug 29 15:26:18.043808 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '1419570200', 'body': {'addTenantAccess': {'tenant': 'b2797d226dd7433fb38ad83bde5f888c'}}} Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:18.044649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 29 15:26:18.045969 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:18.050344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3746447b-23e7-4511-8832-0b5e8a751830 tempest-FlavorsAccessNegativeTestJSON-2051868412 tempest-FlavorsAccessNegativeTestJSON-2051868412-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:18.052977 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3746447b-23e7-4511-8832-0b5e8a751830 tempest-FlavorsAccessNegativeTestJSON-2051868412 tempest-FlavorsAccessNegativeTestJSON-2051868412-project] 10.222.0.62 "POST /compute/v2.1/flavors/1419570200/action" status: 403 len: 130 microversion: 2.1 time: 0.249043 Aug 29 15:26:18.056459 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 184/397] 10.222.0.62 () {60 vars in 1200 bytes} [Mon Aug 29 15:26:17 2022] POST /compute/v2.1/flavors/1419570200/action => generated 130 bytes in 253 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:18.063972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8e380cfe-6fff-4f4e-93cd-42dfb54066f5 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Calling method '.version_select at 0x7fc4300d7820>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:18.071903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e380cfe-6fff-4f4e-93cd-42dfb54066f5 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.072392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e380cfe-6fff-4f4e-93cd-42dfb54066f5 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.072827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e380cfe-6fff-4f4e-93cd-42dfb54066f5 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:18.073601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e380cfe-6fff-4f4e-93cd-42dfb54066f5 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.077271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e380cfe-6fff-4f4e-93cd-42dfb54066f5 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.078128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e380cfe-6fff-4f4e-93cd-42dfb54066f5 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:18.128571 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8e380cfe-6fff-4f4e-93cd-42dfb54066f5 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.070180 Aug 29 15:26:18.129870 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 185/398] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 15:26:18 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:18.136135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a138c840-f342-4913-90e4-af3208944587 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:18.137426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a138c840-f342-4913-90e4-af3208944587 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:18.154859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a138c840-f342-4913-90e4-af3208944587 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.155736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a138c840-f342-4913-90e4-af3208944587 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.158776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a138c840-f342-4913-90e4-af3208944587 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:18.160606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a138c840-f342-4913-90e4-af3208944587 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.161228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a138c840-f342-4913-90e4-af3208944587 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.163297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a138c840-f342-4913-90e4-af3208944587 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:18.503221 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8c53bee8-bc6c-4256-8634-840671d3413a tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] 10.222.0.62 "GET /compute/v2.1/os-floating-ips/2e3bd042-0bd1-447f-b901-299ca05a390a" status: 200 len: 142 microversion: 2.1 time: 1.175788 Aug 29 15:26:18.506202 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 214/399] 10.222.0.62 () {58 vars in 1260 bytes} [Mon Aug 29 15:26:17 2022] GET /compute/v2.1/os-floating-ips/2e3bd042-0bd1-447f-b901-299ca05a390a => generated 142 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:18.512908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2076d8ea-57ec-4527-991f-1b4b3e7c402c tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:18.535481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:DELETE=5 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:18.577708 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2076d8ea-57ec-4527-991f-1b4b3e7c402c tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/1419570200" status: 202 len: 0 microversion: 2.1 time: 0.068975 Aug 29 15:26:18.580594 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 215/400] 10.222.0.62 () {58 vars in 1161 bytes} [Mon Aug 29 15:26:18 2022] DELETE /compute/v2.1/flavors/1419570200 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:26:18.618968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-69cb0d13-91c4-49a4-a3ea-a6fa17a05947 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Calling method '.version_select at 0x7fc430169f70>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:18.629478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69cb0d13-91c4-49a4-a3ea-a6fa17a05947 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.633829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69cb0d13-91c4-49a4-a3ea-a6fa17a05947 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.636542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69cb0d13-91c4-49a4-a3ea-a6fa17a05947 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:18.647346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69cb0d13-91c4-49a4-a3ea-a6fa17a05947 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.647906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69cb0d13-91c4-49a4-a3ea-a6fa17a05947 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.649970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69cb0d13-91c4-49a4-a3ea-a6fa17a05947 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:18.718698 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-69cb0d13-91c4-49a4-a3ea-a6fa17a05947 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.134948 Aug 29 15:26:18.720091 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 216/401] 10.222.0.62 () {58 vars in 1128 bytes} [Mon Aug 29 15:26:18 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:18.726134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-438ddc44-d847-4e44-a23b-da8ea77051d2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:18.727328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-438ddc44-d847-4e44-a23b-da8ea77051d2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:18.740058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-438ddc44-d847-4e44-a23b-da8ea77051d2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.740847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-438ddc44-d847-4e44-a23b-da8ea77051d2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.741503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-438ddc44-d847-4e44-a23b-da8ea77051d2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:18.742614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-438ddc44-d847-4e44-a23b-da8ea77051d2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:18.743273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-438ddc44-d847-4e44-a23b-da8ea77051d2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:18.744177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-438ddc44-d847-4e44-a23b-da8ea77051d2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.147078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-438ddc44-d847-4e44-a23b-da8ea77051d2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:19.159134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-438ddc44-d847-4e44-a23b-da8ea77051d2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:19.160937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-438ddc44-d847-4e44-a23b-da8ea77051d2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:19.162299 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-438ddc44-d847-4e44-a23b-da8ea77051d2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1361 microversion: 2.25 time: 0.440728 Aug 29 15:26:19.163513 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 217/402] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:18 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1361 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:19.168275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7174e98b-b193-49df-bf9f-710aee16ac2d tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] Calling method '.version_select at 0x7fc430150c10>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:19.394269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a138c840-f342-4913-90e4-af3208944587 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:19.409034 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a138c840-f342-4913-90e4-af3208944587 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1322 microversion: 2.1 time: 1.277749 Aug 29 15:26:19.412697 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 186/403] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:18 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1322 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:19.429268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-852d4aae-9a58-4690-be3c-7e5b3bd953d4 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:19.454901 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-852d4aae-9a58-4690-be3c-7e5b3bd953d4 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040825 Aug 29 15:26:19.473582 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 187/404] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:19.478810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-67573ccc-5af5-4326-b36b-8267db8597f1 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Calling method '.version_select at 0x7fc43002e5e0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:19.488210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67573ccc-5af5-4326-b36b-8267db8597f1 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.492265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67573ccc-5af5-4326-b36b-8267db8597f1 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.492729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67573ccc-5af5-4326-b36b-8267db8597f1 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.518648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67573ccc-5af5-4326-b36b-8267db8597f1 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.519773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67573ccc-5af5-4326-b36b-8267db8597f1 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.520412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67573ccc-5af5-4326-b36b-8267db8597f1 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.559409 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-67573ccc-5af5-4326-b36b-8267db8597f1 tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hosts/n-h1-839401-11" status: 200 len: 471 microversion: 2.1 time: 0.082991 Aug 29 15:26:19.561315 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 188/405] 10.222.0.62 () {58 vars in 1173 bytes} [Mon Aug 29 15:26:19 2022] GET /compute/v2.1/os-hosts/n-h1-839401-11 => generated 471 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:19.571768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-09b0b792-275e-4a2d-bdbf-89b9de7b32c5 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:19.572634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-09b0b792-275e-4a2d-bdbf-89b9de7b32c5 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:19.580921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09b0b792-275e-4a2d-bdbf-89b9de7b32c5 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.581613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09b0b792-275e-4a2d-bdbf-89b9de7b32c5 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.582204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09b0b792-275e-4a2d-bdbf-89b9de7b32c5 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.583823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09b0b792-275e-4a2d-bdbf-89b9de7b32c5 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.584916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09b0b792-275e-4a2d-bdbf-89b9de7b32c5 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.587987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09b0b792-275e-4a2d-bdbf-89b9de7b32c5 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:19.895608 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7174e98b-b193-49df-bf9f-710aee16ac2d tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] 10.222.0.62 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.730573 Aug 29 15:26:19.896900 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 218/406] 10.222.0.62 () {58 vars in 1149 bytes} [Mon Aug 29 15:26:19 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:19.916899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-923ffefd-f900-4c6a-be0c-09a989a92c88 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1825290607", "id": 652883944, "os-flavor-access:is_public": "False"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:19.958481 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-923ffefd-f900-4c6a-be0c-09a989a92c88 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.060230 Aug 29 15:26:19.963643 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 219/407] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:19 2022] POST /compute/v2.1/flavors => generated 436 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:19.973874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1c0ab183-0117-474b-b85d-7f79140cabab tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Calling method '.version_select at 0x7fc4302b60d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:19.990923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c0ab183-0117-474b-b85d-7f79140cabab tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:19.991704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c0ab183-0117-474b-b85d-7f79140cabab tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:19.992491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c0ab183-0117-474b-b85d-7f79140cabab tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:20.002971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=85 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:20.029135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c0ab183-0117-474b-b85d-7f79140cabab tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:20.029636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c0ab183-0117-474b-b85d-7f79140cabab tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:20.030071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c0ab183-0117-474b-b85d-7f79140cabab tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:20.066156 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1c0ab183-0117-474b-b85d-7f79140cabab tempest-HostsAdminTestJSON-1507137380 tempest-HostsAdminTestJSON-1507137380-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hosts/n-h2-839401-11" status: 200 len: 603 microversion: 2.1 time: 0.100550 Aug 29 15:26:20.067265 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 220/408] 10.222.0.62 () {58 vars in 1173 bytes} [Mon Aug 29 15:26:19 2022] GET /compute/v2.1/os-hosts/n-h2-839401-11 => generated 603 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:20.075373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-afac9fce-3133-45af-bbbe-2fe97f173bfc tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] Calling method '.version_select at 0x7fc430150dc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:20.426519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-09b0b792-275e-4a2d-bdbf-89b9de7b32c5 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:20.443496 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-09b0b792-275e-4a2d-bdbf-89b9de7b32c5 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 200 len: 1322 microversion: 2.1 time: 0.878688 Aug 29 15:26:20.446037 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 189/409] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:19 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 1322 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:20.461751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-387f990b-8d6f-4fa9-9f96-215abd117bde tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b2797d226dd7433fb38ad83bde5f888c"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:20.790992 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-387f990b-8d6f-4fa9-9f96-215abd117bde tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors/652883944/action" status: 200 len: 96 microversion: 2.1 time: 0.340527 Aug 29 15:26:20.793966 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 190/410] 10.222.0.62 () {60 vars in 1197 bytes} [Mon Aug 29 15:26:20 2022] POST /compute/v2.1/flavors/652883944/action => generated 96 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:26:20.805978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-07cfef57-4dfd-42dd-84f1-fef8bda6597b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:20.809259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-07cfef57-4dfd-42dd-84f1-fef8bda6597b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:20.825742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07cfef57-4dfd-42dd-84f1-fef8bda6597b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:20.826253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07cfef57-4dfd-42dd-84f1-fef8bda6597b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:20.826698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07cfef57-4dfd-42dd-84f1-fef8bda6597b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:20.827422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07cfef57-4dfd-42dd-84f1-fef8bda6597b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:20.842221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07cfef57-4dfd-42dd-84f1-fef8bda6597b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:20.842737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07cfef57-4dfd-42dd-84f1-fef8bda6597b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:21.063578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:21.185631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-07cfef57-4dfd-42dd-84f1-fef8bda6597b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:21.204336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-07cfef57-4dfd-42dd-84f1-fef8bda6597b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:21.207571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-07cfef57-4dfd-42dd-84f1-fef8bda6597b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:21.208780 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-07cfef57-4dfd-42dd-84f1-fef8bda6597b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1361 microversion: 2.25 time: 0.412646 Aug 29 15:26:21.209392 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 191/411] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:20 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1361 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:21.218797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ef634473-5d66-4cc7-ba11-9adc34987696 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:21.219497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ef634473-5d66-4cc7-ba11-9adc34987696 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:21.238563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef634473-5d66-4cc7-ba11-9adc34987696 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:21.239065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef634473-5d66-4cc7-ba11-9adc34987696 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:21.239497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef634473-5d66-4cc7-ba11-9adc34987696 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:21.240225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef634473-5d66-4cc7-ba11-9adc34987696 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:21.240689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef634473-5d66-4cc7-ba11-9adc34987696 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:21.241135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef634473-5d66-4cc7-ba11-9adc34987696 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:21.774422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ef634473-5d66-4cc7-ba11-9adc34987696 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:21.789007 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ef634473-5d66-4cc7-ba11-9adc34987696 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1322 microversion: 2.1 time: 0.577936 Aug 29 15:26:21.789652 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 192/412] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:21 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:21.817351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-4dc8ff0f-3c6a-4653-b4c6-09e319946e93 req-4778a8c1-4e61-4e50-aaa9-a7cc3b8b0c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "210b41e1-4270-4fb9-99e9-894536b94b41", "tag": "25ba1b63-7433-40d1-a6be-570eca2697f6"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:21.841236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4dc8ff0f-3c6a-4653-b4c6-09e319946e93 req-4778a8c1-4e61-4e50-aaa9-a7cc3b8b0c2d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:21.843827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4dc8ff0f-3c6a-4653-b4c6-09e319946e93 req-4778a8c1-4e61-4e50-aaa9-a7cc3b8b0c2d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:21.844434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4dc8ff0f-3c6a-4653-b4c6-09e319946e93 req-4778a8c1-4e61-4e50-aaa9-a7cc3b8b0c2d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:21.871205 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-4dc8ff0f-3c6a-4653-b4c6-09e319946e93 req-4778a8c1-4e61-4e50-aaa9-a7cc3b8b0c2d service nova] Creating event network-changed:25ba1b63-7433-40d1-a6be-570eca2697f6 for instance 210b41e1-4270-4fb9-99e9-894536b94b41 on n-h1-839401-11 Aug 29 15:26:21.887390 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-4dc8ff0f-3c6a-4653-b4c6-09e319946e93 req-4778a8c1-4e61-4e50-aaa9-a7cc3b8b0c2d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083776 Aug 29 15:26:21.893629 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 193/413] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:21.899264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d748ce0-8d56-4d20-806c-55b3036e4e64 tempest-FlavorsAccessNegativeTestJSON-2051868412 tempest-FlavorsAccessNegativeTestJSON-2051868412-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b2797d226dd7433fb38ad83bde5f888c"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:21.909721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9d748ce0-8d56-4d20-806c-55b3036e4e64 tempest-FlavorsAccessNegativeTestJSON-2051868412 tempest-FlavorsAccessNegativeTestJSON-2051868412-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'dc3b973d10d5404ebdf7a79be18eabef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2797d226dd7433fb38ad83bde5f888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d748ce0-8d56-4d20-806c-55b3036e4e64 tempest-FlavorsAccessNegativeTestJSON-2051868412 tempest-FlavorsAccessNegativeTestJSON-2051868412-project] Request method failure captured: Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/flavors/652883944/action HTTP/1.1 Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 70 Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqJzj69aZMPYwlQrXXRpEFogq-x5E6DCj8lKEqIMuYATVyauLtXMIfiRQrdYD99C4drbslkLoMfknj-cCYaX9LHr0UCamRd4iyL9juUlbKEG5xxkna8oRm-pd-f5oEkLIB2pb3lpeK8lvbspD6Zpqiw2935a_dKMmWKR0QBw_Ohn1I Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: b2797d226dd7433fb38ad83bde5f888c Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2051868412 Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:26:21.927342 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:26:21.928888 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b2797d226dd7433fb38ad83bde5f888c", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b2797d226dd7433fb38ad83bde5f888c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2797d226dd7433fb38ad83bde5f888c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2797d226dd7433fb38ad83bde5f888c"}]}] Aug 29 15:26:21.928888 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2051868412 Aug 29 15:26:21.928888 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: b2797d226dd7433fb38ad83bde5f888c Aug 29 15:26:21.928888 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2051868412 Aug 29 15:26:21.928888 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-FlavorsAccessNegativeTestJSON-2051868412-project Aug 29 15:26:21.928888 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:26:21.928888 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:26:21.928888 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: dc3b973d10d5404ebdf7a79be18eabef Aug 29 15:26:21.928888 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2051868412-project Aug 29 15:26:21.928888 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:26:21.928888 n-d-839401-11 devstack@n-api.service[122360]: {"removeTenantAccess": {"tenant": "b2797d226dd7433fb38ad83bde5f888c"}} Aug 29 15:26:21.928888 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '652883944', 'body': {'removeTenantAccess': {'tenant': 'b2797d226dd7433fb38ad83bde5f888c'}}} Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi context.can( Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:21.929770 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 29 15:26:21.931613 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:21.932865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d748ce0-8d56-4d20-806c-55b3036e4e64 tempest-FlavorsAccessNegativeTestJSON-2051868412 tempest-FlavorsAccessNegativeTestJSON-2051868412-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:21.932865 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d748ce0-8d56-4d20-806c-55b3036e4e64 tempest-FlavorsAccessNegativeTestJSON-2051868412 tempest-FlavorsAccessNegativeTestJSON-2051868412-project] 10.222.0.62 "POST /compute/v2.1/flavors/652883944/action" status: 403 len: 133 microversion: 2.1 time: 0.035922 Aug 29 15:26:21.932865 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 194/414] 10.222.0.62 () {60 vars in 1197 bytes} [Mon Aug 29 15:26:21 2022] POST /compute/v2.1/flavors/652883944/action => generated 133 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:21.957309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d5859ab4-d239-4aef-bdba-7a83f5044bd3 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:21.958600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d5859ab4-d239-4aef-bdba-7a83f5044bd3 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:21.977168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5859ab4-d239-4aef-bdba-7a83f5044bd3 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:21.978629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5859ab4-d239-4aef-bdba-7a83f5044bd3 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:21.980316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5859ab4-d239-4aef-bdba-7a83f5044bd3 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:21.981848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5859ab4-d239-4aef-bdba-7a83f5044bd3 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:21.990029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5859ab4-d239-4aef-bdba-7a83f5044bd3 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:21.991790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5859ab4-d239-4aef-bdba-7a83f5044bd3 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:22.652290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d5859ab4-d239-4aef-bdba-7a83f5044bd3 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:22.660665 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d5859ab4-d239-4aef-bdba-7a83f5044bd3 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 200 len: 1322 microversion: 2.1 time: 0.719979 Aug 29 15:26:22.680637 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 195/415] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:21 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 1322 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:22.689709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-09d3e0ae-1d22-4f1f-975d-ee3a713f61df tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b2797d226dd7433fb38ad83bde5f888c"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:22.800452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:22.838491 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-09d3e0ae-1d22-4f1f-975d-ee3a713f61df tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors/652883944/action" status: 200 len: 21 microversion: 2.1 time: 0.156346 Aug 29 15:26:22.839242 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 196/416] 10.222.0.62 () {60 vars in 1197 bytes} [Mon Aug 29 15:26:22 2022] POST /compute/v2.1/flavors/652883944/action => generated 21 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:26:22.866585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6adeac08-7c10-4cb0-a594-1be50ae36be8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:22.867704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6adeac08-7c10-4cb0-a594-1be50ae36be8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:22.874223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6adeac08-7c10-4cb0-a594-1be50ae36be8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:22.875035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6adeac08-7c10-4cb0-a594-1be50ae36be8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:22.875695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6adeac08-7c10-4cb0-a594-1be50ae36be8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:22.876734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6adeac08-7c10-4cb0-a594-1be50ae36be8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:22.877345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6adeac08-7c10-4cb0-a594-1be50ae36be8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:22.877853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6adeac08-7c10-4cb0-a594-1be50ae36be8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:22.938201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=14 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:23.392584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6adeac08-7c10-4cb0-a594-1be50ae36be8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:23.409269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6adeac08-7c10-4cb0-a594-1be50ae36be8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:23.411957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6adeac08-7c10-4cb0-a594-1be50ae36be8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:23.412263 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6adeac08-7c10-4cb0-a594-1be50ae36be8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1361 microversion: 2.25 time: 0.564713 Aug 29 15:26:23.412859 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 197/417] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:22 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1361 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:23.432740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-593b67f3-ff8d-4fb1-b221-ff523ec85cf5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:23.435850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-593b67f3-ff8d-4fb1-b221-ff523ec85cf5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:23.436101 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-afac9fce-3133-45af-bbbe-2fe97f173bfc tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] 10.222.0.62 "DELETE /compute/v2.1/os-floating-ips/2e3bd042-0bd1-447f-b901-299ca05a390a" status: 202 len: 0 microversion: 2.1 time: 3.367552 Aug 29 15:26:23.436898 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 221/418] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:26:20 2022] DELETE /compute/v2.1/os-floating-ips/2e3bd042-0bd1-447f-b901-299ca05a390a => generated 0 bytes in 3369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:26:23.441641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f09747b8-fbd2-45f8-9383-a4c32bceeb67 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:23.444574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-593b67f3-ff8d-4fb1-b221-ff523ec85cf5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:23.445451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-593b67f3-ff8d-4fb1-b221-ff523ec85cf5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:23.445889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-593b67f3-ff8d-4fb1-b221-ff523ec85cf5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:23.446593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-593b67f3-ff8d-4fb1-b221-ff523ec85cf5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:23.447048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-593b67f3-ff8d-4fb1-b221-ff523ec85cf5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:23.449402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-593b67f3-ff8d-4fb1-b221-ff523ec85cf5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:23.486830 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f09747b8-fbd2-45f8-9383-a4c32bceeb67 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/652883944" status: 202 len: 0 microversion: 2.1 time: 0.048924 Aug 29 15:26:23.487435 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 222/419] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 15:26:23 2022] DELETE /compute/v2.1/flavors/652883944 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:26:23.494190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fd3cf605-e602-4319-9ce0-41a145ec8176 tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] Action: 'create', calling method: .version_select at 0x7fc430130700>, body: {"pool": null} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:24.058816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-593b67f3-ff8d-4fb1-b221-ff523ec85cf5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:24.069673 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-593b67f3-ff8d-4fb1-b221-ff523ec85cf5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1322 microversion: 2.1 time: 0.643380 Aug 29 15:26:24.074413 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 198/420] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:23 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1322 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:24.082628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c1f31b2a-66c4-4c4f-9b47-8af11364625d tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:24.111154 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c1f31b2a-66c4-4c4f-9b47-8af11364625d tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032007 Aug 29 15:26:24.112187 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 199/421] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:24.116990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cfae7be7-935e-4b6d-a2f0-88016b1f25ed tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:24.117879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cfae7be7-935e-4b6d-a2f0-88016b1f25ed tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:24.123869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfae7be7-935e-4b6d-a2f0-88016b1f25ed tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.124612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfae7be7-935e-4b6d-a2f0-88016b1f25ed tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.125316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfae7be7-935e-4b6d-a2f0-88016b1f25ed tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.126295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfae7be7-935e-4b6d-a2f0-88016b1f25ed tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.126788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfae7be7-935e-4b6d-a2f0-88016b1f25ed tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.127225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfae7be7-935e-4b6d-a2f0-88016b1f25ed tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.150082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:24.465641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cfae7be7-935e-4b6d-a2f0-88016b1f25ed tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:24.491287 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cfae7be7-935e-4b6d-a2f0-88016b1f25ed tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 200 len: 1322 microversion: 2.1 time: 0.376109 Aug 29 15:26:24.494795 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 200/422] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:24 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:24.515694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-1ec9e44b-8ab5-4866-ad01-7b4468559025 req-b5d47ef9-cc05-4dcb-871d-aee477f0cc5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89c49de-27db-4e19-a013-217c6075debb", "tag": "0b3487a8-bae5-4c07-9952-d6c8810ee302"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:24.538011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1ec9e44b-8ab5-4866-ad01-7b4468559025 req-b5d47ef9-cc05-4dcb-871d-aee477f0cc5c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.538894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1ec9e44b-8ab5-4866-ad01-7b4468559025 req-b5d47ef9-cc05-4dcb-871d-aee477f0cc5c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.540449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1ec9e44b-8ab5-4866-ad01-7b4468559025 req-b5d47ef9-cc05-4dcb-871d-aee477f0cc5c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.574653 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-1ec9e44b-8ab5-4866-ad01-7b4468559025 req-b5d47ef9-cc05-4dcb-871d-aee477f0cc5c service nova] Creating event network-changed:0b3487a8-bae5-4c07-9952-d6c8810ee302 for instance a89c49de-27db-4e19-a013-217c6075debb on n-h2-839401-11 Aug 29 15:26:24.580499 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-1ec9e44b-8ab5-4866-ad01-7b4468559025 req-b5d47ef9-cc05-4dcb-871d-aee477f0cc5c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079553 Aug 29 15:26:24.581710 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 201/423] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:24.586878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ba0ae303-881d-42f2-ac62-8829a6ab5d55 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-83256974", "id": 260452281, "os-flavor-access:is_public": "False"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:24.620825 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ba0ae303-881d-42f2-ac62-8829a6ab5d55 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.037710 Aug 29 15:26:24.621459 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 202/424] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:24 2022] POST /compute/v2.1/flavors => generated 434 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:24.632680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e6b25e30-45f2-40c9-b1e3-9d8998996ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:24.633451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e6b25e30-45f2-40c9-b1e3-9d8998996ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:24.650912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6b25e30-45f2-40c9-b1e3-9d8998996ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.651410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6b25e30-45f2-40c9-b1e3-9d8998996ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.651841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6b25e30-45f2-40c9-b1e3-9d8998996ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:24.656050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6b25e30-45f2-40c9-b1e3-9d8998996ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:24.656574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6b25e30-45f2-40c9-b1e3-9d8998996ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:24.656958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6b25e30-45f2-40c9-b1e3-9d8998996ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:25.232347 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fd3cf605-e602-4319-9ce0-41a145ec8176 tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] 10.222.0.62 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.743582 Aug 29 15:26:25.233383 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 223/425] 10.222.0.62 () {60 vars in 1170 bytes} [Mon Aug 29 15:26:23 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:25.239608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c4abf03e-aa0b-49fb-a74b-eea4394eca8e tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "34b6383eb3fd47fb91b0d3ffee8a1270"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:25.515308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e6b25e30-45f2-40c9-b1e3-9d8998996ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:25.528924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e6b25e30-45f2-40c9-b1e3-9d8998996ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:25.534590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e6b25e30-45f2-40c9-b1e3-9d8998996ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:25.539720 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e6b25e30-45f2-40c9-b1e3-9d8998996ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1361 microversion: 2.25 time: 0.917223 Aug 29 15:26:25.542860 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 203/426] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:24 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1361 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:25.567958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4a78b251-2ad2-4739-a396-3d1d93e7dfaf tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:25.568564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4a78b251-2ad2-4739-a396-3d1d93e7dfaf tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:25.582516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a78b251-2ad2-4739-a396-3d1d93e7dfaf tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:25.585853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a78b251-2ad2-4739-a396-3d1d93e7dfaf tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:25.587699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a78b251-2ad2-4739-a396-3d1d93e7dfaf tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:25.592547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a78b251-2ad2-4739-a396-3d1d93e7dfaf tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:25.593267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a78b251-2ad2-4739-a396-3d1d93e7dfaf tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:25.593902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a78b251-2ad2-4739-a396-3d1d93e7dfaf tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:25.695506 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-c4abf03e-aa0b-49fb-a74b-eea4394eca8e tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] HTTP exception thrown: Flavor access not found for 36 / 34b6383eb3fd47fb91b0d3ffee8a1270 combination. Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c4abf03e-aa0b-49fb-a74b-eea4394eca8e tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Request method failure captured: Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/flavors/260452281/action HTTP/1.1 Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 70 Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNqLqPGY734673zVn72gIahvDIdUm3Q4uRYNkVPfhFjSOmQ3Tjymsq1k63VkSHvhTuY6m6I5ko2CITSGpI-G4ATjHHRoFn85Yd9lvf5EGFA6XNSdFQv4Q3wzKNZzZZ3BHN4JRXfVFWvyDpJKvGLFyArqob5ArZFbv83VahTEYUXGpEE Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: c331b3e1fdf94a32a6073f0cdf23f042 Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-605962135 Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:26:25.699603 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:26:25.700950 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c331b3e1fdf94a32a6073f0cdf23f042", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c331b3e1fdf94a32a6073f0cdf23f042"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c331b3e1fdf94a32a6073f0cdf23f042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c331b3e1fdf94a32a6073f0cdf23f042"}]}] Aug 29 15:26:25.700950 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-605962135 Aug 29 15:26:25.700950 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: c331b3e1fdf94a32a6073f0cdf23f042 Aug 29 15:26:25.700950 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-605962135 Aug 29 15:26:25.700950 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin Aug 29 15:26:25.700950 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:26:25.700950 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:26:25.700950 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 3ac1a93eb9ae4c93874a6827a10c9aa1 Aug 29 15:26:25.700950 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin Aug 29 15:26:25.700950 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:26:25.700950 n-d-839401-11 devstack@n-api.service[122361]: {"removeTenantAccess": {"tenant": "34b6383eb3fd47fb91b0d3ffee8a1270"}} Aug 29 15:26:25.700950 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: exception: Flavor access not found for 36 / 34b6383eb3fd47fb91b0d3ffee8a1270 combination. Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '260452281', 'body': {'removeTenantAccess': {'tenant': '34b6383eb3fd47fb91b0d3ffee8a1270'}}} Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 29 15:26:25.701732 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 36 / 34b6383eb3fd47fb91b0d3ffee8a1270 combination. Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 36 / 34b6383eb3fd47fb91b0d3ffee8a1270 combination. Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.702859 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:25.703969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:25.703969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:25.703969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:25.703969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:25.703969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 36 / 34b6383eb3fd47fb91b0d3ffee8a1270 combination. Aug 29 15:26:25.703969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:25.703969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c4abf03e-aa0b-49fb-a74b-eea4394eca8e tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Returning 404 to user: Flavor access not found for 36 / 34b6383eb3fd47fb91b0d3ffee8a1270 combination. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:25.703969 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c4abf03e-aa0b-49fb-a74b-eea4394eca8e tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors/260452281/action" status: 404 len: 124 microversion: 2.1 time: 0.468313 Aug 29 15:26:25.703969 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 224/427] 10.222.0.62 () {60 vars in 1197 bytes} [Mon Aug 29 15:26:25 2022] POST /compute/v2.1/flavors/260452281/action => generated 124 bytes in 470 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:25.710816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-491fa3db-df9e-4aa3-ba55-762766062f4b tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] Calling method '.version_select at 0x7fc430130040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:26.375231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4a78b251-2ad2-4739-a396-3d1d93e7dfaf tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:26.386139 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4a78b251-2ad2-4739-a396-3d1d93e7dfaf tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1322 microversion: 2.1 time: 0.839931 Aug 29 15:26:26.386765 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 204/428] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:25 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1322 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:26.402874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c389b04e-d382-4eab-8290-042b5587a2c9 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:26.404778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c389b04e-d382-4eab-8290-042b5587a2c9 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:26.422447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c389b04e-d382-4eab-8290-042b5587a2c9 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.423009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c389b04e-d382-4eab-8290-042b5587a2c9 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.423468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c389b04e-d382-4eab-8290-042b5587a2c9 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.424204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c389b04e-d382-4eab-8290-042b5587a2c9 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.426044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c389b04e-d382-4eab-8290-042b5587a2c9 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.426670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c389b04e-d382-4eab-8290-042b5587a2c9 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.716421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c389b04e-d382-4eab-8290-042b5587a2c9 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:26.748525 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c389b04e-d382-4eab-8290-042b5587a2c9 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 200 len: 1322 microversion: 2.1 time: 0.357941 Aug 29 15:26:26.752058 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 205/429] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:26 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 1322 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:26.766703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3d8f039d-f08a-4696-9fed-11528493e55d tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:26.833846 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3d8f039d-f08a-4696-9fed-11528493e55d tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/260452281" status: 202 len: 0 microversion: 2.1 time: 0.077810 Aug 29 15:26:26.836697 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 206/430] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 15:26:26 2022] DELETE /compute/v2.1/flavors/260452281 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:26:26.843094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-32bc4c93-829a-47f9-855e-a79cabf45263 req-cee07281-401f-4650-bc84-a53cc95342b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f88a208-e1f7-4f75-9665-06c232424f14", "name": "network-vif-plugged", "status": "completed", "tag": "c5f04826-f0a6-42a1-98f6-2fcd03fd3473"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:26.878395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-32bc4c93-829a-47f9-855e-a79cabf45263 req-cee07281-401f-4650-bc84-a53cc95342b1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.879219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-32bc4c93-829a-47f9-855e-a79cabf45263 req-cee07281-401f-4650-bc84-a53cc95342b1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.879866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-32bc4c93-829a-47f9-855e-a79cabf45263 req-cee07281-401f-4650-bc84-a53cc95342b1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:26.930441 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-32bc4c93-829a-47f9-855e-a79cabf45263 req-cee07281-401f-4650-bc84-a53cc95342b1 service nova] Creating event network-vif-plugged:c5f04826-f0a6-42a1-98f6-2fcd03fd3473 for instance 7f88a208-e1f7-4f75-9665-06c232424f14 on n-h2-839401-11 Aug 29 15:26:26.945348 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-32bc4c93-829a-47f9-855e-a79cabf45263 req-cee07281-401f-4650-bc84-a53cc95342b1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107135 Aug 29 15:26:26.948268 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 207/431] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:26.960132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c9082800-1e43-4354-8bf6-b4cf8bdf8fc2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:26.965185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c9082800-1e43-4354-8bf6-b4cf8bdf8fc2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:26.994345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9082800-1e43-4354-8bf6-b4cf8bdf8fc2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:26.998971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9082800-1e43-4354-8bf6-b4cf8bdf8fc2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:26.999799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9082800-1e43-4354-8bf6-b4cf8bdf8fc2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:27.008494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9082800-1e43-4354-8bf6-b4cf8bdf8fc2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:27.010467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9082800-1e43-4354-8bf6-b4cf8bdf8fc2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:27.012482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9082800-1e43-4354-8bf6-b4cf8bdf8fc2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:27.476498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c9082800-1e43-4354-8bf6-b4cf8bdf8fc2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:27.515579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c9082800-1e43-4354-8bf6-b4cf8bdf8fc2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:27.521865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c9082800-1e43-4354-8bf6-b4cf8bdf8fc2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:27.523511 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c9082800-1e43-4354-8bf6-b4cf8bdf8fc2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1361 microversion: 2.25 time: 0.573314 Aug 29 15:26:27.527533 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 208/432] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:26 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1361 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:27.545262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4eb50a03-3c6f-48aa-97af-67e9d4f63ad3 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:27.570015 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4eb50a03-3c6f-48aa-97af-67e9d4f63ad3 tempest-FlavorsAccessNegativeTestJSON-605962135 tempest-FlavorsAccessNegativeTestJSON-605962135-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038735 Aug 29 15:26:27.571301 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 209/433] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:26:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:27.741734 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-491fa3db-df9e-4aa3-ba55-762766062f4b tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] 10.222.0.62 "DELETE /compute/v2.1/os-floating-ips/e31b158c-0af0-4b54-9fc1-2a1a95ffe071" status: 202 len: 0 microversion: 2.1 time: 2.036980 Aug 29 15:26:27.742441 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 225/434] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:26:25 2022] DELETE /compute/v2.1/os-floating-ips/e31b158c-0af0-4b54-9fc1-2a1a95ffe071 => generated 0 bytes in 2038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:26:27.747643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f90e4203-90a7-4c5c-ade6-f75b8e139d88 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:27.748484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f90e4203-90a7-4c5c-ade6-f75b8e139d88 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:27.768089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f90e4203-90a7-4c5c-ade6-f75b8e139d88 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:27.769681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f90e4203-90a7-4c5c-ade6-f75b8e139d88 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:27.772040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f90e4203-90a7-4c5c-ade6-f75b8e139d88 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:27.775407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f90e4203-90a7-4c5c-ade6-f75b8e139d88 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:27.776832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f90e4203-90a7-4c5c-ade6-f75b8e139d88 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:27.778020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f90e4203-90a7-4c5c-ade6-f75b8e139d88 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:27.806611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1675306366", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "87336f61-716d-4260-865c-7edd4c9b9df9"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:27.875028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] validate_networks() for [('87336f61-716d-4260-865c-7edd4c9b9df9', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:26:28.092126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:28.175231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f90e4203-90a7-4c5c-ade6-f75b8e139d88 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:28.187533 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f90e4203-90a7-4c5c-ade6-f75b8e139d88 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1322 microversion: 2.1 time: 0.443657 Aug 29 15:26:28.189301 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 226/435] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:27 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:28.482512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-adf18c0e-627c-49d6-9e83-13b53d8ca5fa tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:28.496424 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-adf18c0e-627c-49d6-9e83-13b53d8ca5fa tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.303365 Aug 29 15:26:28.497036 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 227/436] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:26:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:28.507087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9aaf40e1-74aa-4e65-8372-2b83466adb73 tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] Calling method '.version_select at 0x7fc430150160>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:28.576982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG neutronclient.v2_0.client [None req-9aaf40e1-74aa-4e65-8372-2b83466adb73 tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e31b158c-0af0-4b54-9fc1-2a1a95ffe071 could not be found", "detail": ""}} {{(pid=122361) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:26:28.577895 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-9aaf40e1-74aa-4e65-8372-2b83466adb73 tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] HTTP exception thrown: Floating IP not found for ID e31b158c-0af0-4b54-9fc1-2a1a95ffe071 Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9aaf40e1-74aa-4e65-8372-2b83466adb73 tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] Request method failure captured: Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-floating-ips/e31b158c-0af0-4b54-9fc1-2a1a95ffe071 HTTP/1.1 Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNqSYJmgr-639Y-P2j9BbFMsuvwIKzUtqcjdY149Jh87ywFg0USUk_JaHB5K5bNBlfZZH9bAV-59uYCguWHlEmzYAY6mKl_HvbYlB_sU_E0Hb3uGraq-SdLyoI5rzDC_ENIjL-EzAX72R1UqvIoyghMpt005N1AxKyn5kE8wJ6yV5Sw Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 63dd700e53b848e68912f3997e2a1fa4 Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-FloatingIPsTestJSON-327704010 Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:26:28.579741 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:26:28.581365 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_63dd700e53b848e68912f3997e2a1fa4", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/63dd700e53b848e68912f3997e2a1fa4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/63dd700e53b848e68912f3997e2a1fa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/63dd700e53b848e68912f3997e2a1fa4"}]}] Aug 29 15:26:28.581365 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-FloatingIPsTestJSON-327704010 Aug 29 15:26:28.581365 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 63dd700e53b848e68912f3997e2a1fa4 Aug 29 15:26:28.581365 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-FloatingIPsTestJSON-327704010 Aug 29 15:26:28.581365 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-FloatingIPsTestJSON-327704010-project Aug 29 15:26:28.581365 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:26:28.581365 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:26:28.581365 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: eec8816ed1764a1ea60d060e0309f665 Aug 29 15:26:28.581365 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-FloatingIPsTestJSON-327704010-project Aug 29 15:26:28.581365 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:26:28.581365 n-d-839401-11 devstack@n-api.service[122361]: exception: Floating IP not found for ID e31b158c-0af0-4b54-9fc1-2a1a95ffe071 Aug 29 15:26:28.581365 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'e31b158c-0af0-4b54-9fc1-2a1a95ffe071'} Aug 29 15:26:28.581365 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:26:28.582285 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e31b158c-0af0-4b54-9fc1-2a1a95ffe071 could not be found Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dab9a35b-6f52-4cc2-9ffe-dde25950daa1'] Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e31b158c-0af0-4b54-9fc1-2a1a95ffe071. Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:28.583566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e31b158c-0af0-4b54-9fc1-2a1a95ffe071 Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:28.584877 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:28.586445 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e31b158c-0af0-4b54-9fc1-2a1a95ffe071 Aug 29 15:26:28.586445 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:28.586445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9aaf40e1-74aa-4e65-8372-2b83466adb73 tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] Returning 404 to user: Floating IP not found for ID e31b158c-0af0-4b54-9fc1-2a1a95ffe071 {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:28.586445 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9aaf40e1-74aa-4e65-8372-2b83466adb73 tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] 10.222.0.62 "GET /compute/v2.1/os-floating-ips/e31b158c-0af0-4b54-9fc1-2a1a95ffe071" status: 404 len: 111 microversion: 2.1 time: 0.078192 Aug 29 15:26:28.586445 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 228/437] 10.222.0.62 () {58 vars in 1260 bytes} [Mon Aug 29 15:26:28 2022] GET /compute/v2.1/os-floating-ips/e31b158c-0af0-4b54-9fc1-2a1a95ffe071 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:28.587389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c802d1f6-9910-4575-93b0-e8b2da04ff2e tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:28.587389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c802d1f6-9910-4575-93b0-e8b2da04ff2e tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:28.613581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c802d1f6-9910-4575-93b0-e8b2da04ff2e tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:28.614084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c802d1f6-9910-4575-93b0-e8b2da04ff2e tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:28.614587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c802d1f6-9910-4575-93b0-e8b2da04ff2e tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:28.615223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c802d1f6-9910-4575-93b0-e8b2da04ff2e tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:28.615783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c802d1f6-9910-4575-93b0-e8b2da04ff2e tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:28.617641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c802d1f6-9910-4575-93b0-e8b2da04ff2e tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:28.679885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:29.237133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c802d1f6-9910-4575-93b0-e8b2da04ff2e tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:29.251724 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c802d1f6-9910-4575-93b0-e8b2da04ff2e tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 200 len: 1322 microversion: 2.1 time: 0.665189 Aug 29 15:26:29.252595 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 229/438] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:28 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 1322 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:29.387705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:26:29.388776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:26:29.390375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:26:29.390954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:26:29.391543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:26:29.412763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:29.416702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:29.419178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:29.420159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:29.420811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:29.421541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:29.442682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Getting quotas for project 70e459b5cdf34889a8a76de8a1af6405. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:26:29.451191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Getting quotas for user 9c3094a327b84ac288c39c4ff590db3b and project 70e459b5cdf34889a8a76de8a1af6405. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:26:29.467483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:26:29.474686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:26:29.541349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c537808d-edc1-4f19-8a42-b26c9484babf tempest-ServersWithSpecificFlavorTestJSON-343320010 tempest-ServersWithSpecificFlavorTestJSON-343320010-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1065056392", "id": 1821141378, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:29.543006 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1498d579-0b0f-4d39-a00b-5d916feb74d5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.970226 Aug 29 15:26:29.544617 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 210/439] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:26:29.566503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5e005c41-eaac-4247-9f83-631990753c7d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:29.567387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5e005c41-eaac-4247-9f83-631990753c7d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:29.584270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e005c41-eaac-4247-9f83-631990753c7d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:29.585048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e005c41-eaac-4247-9f83-631990753c7d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:29.585699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e005c41-eaac-4247-9f83-631990753c7d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:29.586836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e005c41-eaac-4247-9f83-631990753c7d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:29.587481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e005c41-eaac-4247-9f83-631990753c7d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:29.589515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e005c41-eaac-4247-9f83-631990753c7d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:29.593170 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c537808d-edc1-4f19-8a42-b26c9484babf tempest-ServersWithSpecificFlavorTestJSON-343320010 tempest-ServersWithSpecificFlavorTestJSON-343320010-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.339077 Aug 29 15:26:29.593775 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 230/440] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:29 2022] POST /compute/v2.1/flavors => generated 425 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:29.599366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-df556fe3-4c60-4ea4-86c5-46c5aa4c4233 tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] Calling method '.version_select at 0x7fc430150af0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:29.818225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG neutronclient.v2_0.client [None req-df556fe3-4c60-4ea4-86c5-46c5aa4c4233 tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e31b158c-0af0-4b54-9fc1-2a1a95ffe071 could not be found", "detail": ""}} {{(pid=122361) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:26:29.818925 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-df556fe3-4c60-4ea4-86c5-46c5aa4c4233 tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] HTTP exception thrown: Floating IP not found for ID e31b158c-0af0-4b54-9fc1-2a1a95ffe071 Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-df556fe3-4c60-4ea4-86c5-46c5aa4c4233 tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] Request method failure captured: Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/os-floating-ips/e31b158c-0af0-4b54-9fc1-2a1a95ffe071 HTTP/1.1 Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNqSYJmgr-639Y-P2j9BbFMsuvwIKzUtqcjdY149Jh87ywFg0USUk_JaHB5K5bNBlfZZH9bAV-59uYCguWHlEmzYAY6mKl_HvbYlB_sU_E0Hb3uGraq-SdLyoI5rzDC_ENIjL-EzAX72R1UqvIoyghMpt005N1AxKyn5kE8wJ6yV5Sw Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 63dd700e53b848e68912f3997e2a1fa4 Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-FloatingIPsTestJSON-327704010 Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:26:29.820717 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:26:29.822233 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_63dd700e53b848e68912f3997e2a1fa4", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/63dd700e53b848e68912f3997e2a1fa4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/63dd700e53b848e68912f3997e2a1fa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/63dd700e53b848e68912f3997e2a1fa4"}]}] Aug 29 15:26:29.822233 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-FloatingIPsTestJSON-327704010 Aug 29 15:26:29.822233 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 63dd700e53b848e68912f3997e2a1fa4 Aug 29 15:26:29.822233 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-FloatingIPsTestJSON-327704010 Aug 29 15:26:29.822233 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-FloatingIPsTestJSON-327704010-project Aug 29 15:26:29.822233 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:26:29.822233 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:26:29.822233 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: eec8816ed1764a1ea60d060e0309f665 Aug 29 15:26:29.822233 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-FloatingIPsTestJSON-327704010-project Aug 29 15:26:29.822233 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:26:29.822233 n-d-839401-11 devstack@n-api.service[122361]: exception: Floating IP not found for ID e31b158c-0af0-4b54-9fc1-2a1a95ffe071 Aug 29 15:26:29.822233 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'e31b158c-0af0-4b54-9fc1-2a1a95ffe071'} Aug 29 15:26:29.822233 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:26:29.823011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e31b158c-0af0-4b54-9fc1-2a1a95ffe071 could not be found Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c332f6ad-a700-47cb-899e-d026099da974'] Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e31b158c-0af0-4b54-9fc1-2a1a95ffe071. Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:29.824232 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e31b158c-0af0-4b54-9fc1-2a1a95ffe071 Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:29.827645 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:29.830410 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e31b158c-0af0-4b54-9fc1-2a1a95ffe071 Aug 29 15:26:29.830410 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:29.830410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-df556fe3-4c60-4ea4-86c5-46c5aa4c4233 tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] Returning 404 to user: Floating IP not found for ID e31b158c-0af0-4b54-9fc1-2a1a95ffe071 {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:29.830410 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-df556fe3-4c60-4ea4-86c5-46c5aa4c4233 tempest-FloatingIPsTestJSON-327704010 tempest-FloatingIPsTestJSON-327704010-project] 10.222.0.62 "DELETE /compute/v2.1/os-floating-ips/e31b158c-0af0-4b54-9fc1-2a1a95ffe071" status: 404 len: 111 microversion: 2.1 time: 0.227244 Aug 29 15:26:29.830410 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 231/441] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:26:29 2022] DELETE /compute/v2.1/os-floating-ips/e31b158c-0af0-4b54-9fc1-2a1a95ffe071 => generated 111 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:29.836346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-34ad65e3-0ee4-4429-a5d2-522ac6628c1b tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:29.836817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e005c41-eaac-4247-9f83-631990753c7d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:29.836969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-34ad65e3-0ee4-4429-a5d2-522ac6628c1b tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:29.854582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34ad65e3-0ee4-4429-a5d2-522ac6628c1b tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:29.854778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e005c41-eaac-4247-9f83-631990753c7d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:29.855086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34ad65e3-0ee4-4429-a5d2-522ac6628c1b tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:29.855531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34ad65e3-0ee4-4429-a5d2-522ac6628c1b tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:29.856248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34ad65e3-0ee4-4429-a5d2-522ac6628c1b tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:29.856711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34ad65e3-0ee4-4429-a5d2-522ac6628c1b tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:29.860885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e005c41-eaac-4247-9f83-631990753c7d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:29.863634 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5e005c41-eaac-4247-9f83-631990753c7d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1361 microversion: 2.25 time: 0.309124 Aug 29 15:26:29.868326 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 211/442] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:29 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1361 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:29.874689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-759a6858-4fdd-4430-8614-2013a910d6d7 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:29.875743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-759a6858-4fdd-4430-8614-2013a910d6d7 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:29.881390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34ad65e3-0ee4-4429-a5d2-522ac6628c1b tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:30.043546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-759a6858-4fdd-4430-8614-2013a910d6d7 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:30.059433 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-759a6858-4fdd-4430-8614-2013a910d6d7 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1216 microversion: 2.1 time: 0.189503 Aug 29 15:26:30.063155 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 212/443] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:29 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1216 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:30.080402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-80be8c1e-dcef-4eaa-b466-35497aca18a8 tempest-ServersWithSpecificFlavorTestJSON-343320010 tempest-ServersWithSpecificFlavorTestJSON-343320010-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:30.105736 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-80be8c1e-dcef-4eaa-b466-35497aca18a8 tempest-ServersWithSpecificFlavorTestJSON-343320010 tempest-ServersWithSpecificFlavorTestJSON-343320010-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.037825 Aug 29 15:26:30.109830 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 213/444] 10.222.0.62 () {58 vars in 1182 bytes} [Mon Aug 29 15:26:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:26:30.123614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fc536204-b6e7-4d8a-af07-ed41c4ed9414 tempest-ServersWithSpecificFlavorTestJSON-343320010 tempest-ServersWithSpecificFlavorTestJSON-343320010-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-48443580", "id": 2112833216, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:30.194880 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fc536204-b6e7-4d8a-af07-ed41c4ed9414 tempest-ServersWithSpecificFlavorTestJSON-343320010 tempest-ServersWithSpecificFlavorTestJSON-343320010-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.077040 Aug 29 15:26:30.197957 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 214/445] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:30 2022] POST /compute/v2.1/flavors => generated 423 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:30.208642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7371d935-1d00-4d55-84c7-43a979a1eb7a tempest-ServersWithSpecificFlavorTestJSON-343320010 tempest-ServersWithSpecificFlavorTestJSON-343320010-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:30.237846 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7371d935-1d00-4d55-84c7-43a979a1eb7a tempest-ServersWithSpecificFlavorTestJSON-343320010 tempest-ServersWithSpecificFlavorTestJSON-343320010-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.033583 Aug 29 15:26:30.240489 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 215/446] 10.222.0.62 () {58 vars in 1182 bytes} [Mon Aug 29 15:26:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:26:30.253446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2ddb05e3-92e9-444d-ac27-4241337a1a19 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Action: 'create', calling method: .version_select at 0x7fc4300e2e50>, body: {"keypair": {"name": "tempest-keypair-1081306532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNV8dxOmRHtKks7/k3yuQxBikc/ypiJ87/HIcXSh6ocxMVn2D6mMaFmEuxS4pJttqO5nhY0c/nHYNNhCwGTZJ4ns+0OxXfHumG+3TSxuwi1ji58hE7pHtK3sd8aaLZWBLA=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:30.309769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-2ddb05e3-92e9-444d-ac27-4241337a1a19 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Getting quotas for project be837968b7df43d89c7fc806a7387b18. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:26:30.326349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-2ddb05e3-92e9-444d-ac27-4241337a1a19 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Getting quotas for user e36b9be537be45d88b1a7ef3543f26b4 and project be837968b7df43d89c7fc806a7387b18. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:26:30.338606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-34ad65e3-0ee4-4429-a5d2-522ac6628c1b tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:30.354582 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-34ad65e3-0ee4-4429-a5d2-522ac6628c1b tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1322 microversion: 2.1 time: 0.526303 Aug 29 15:26:30.358611 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 232/447] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:29 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1322 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:30.364423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-50d6462a-4447-459d-9aee-828d92036c01 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:30.366819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-50d6462a-4447-459d-9aee-828d92036c01 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:30.383439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d6462a-4447-459d-9aee-828d92036c01 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:30.387969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d6462a-4447-459d-9aee-828d92036c01 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:30.388725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d6462a-4447-459d-9aee-828d92036c01 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:30.389738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d6462a-4447-459d-9aee-828d92036c01 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:30.392801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d6462a-4447-459d-9aee-828d92036c01 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:30.393500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d6462a-4447-459d-9aee-828d92036c01 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:30.406573 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2ddb05e3-92e9-444d-ac27-4241337a1a19 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.157480 Aug 29 15:26:30.420877 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 216/448] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:26:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:30.861795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-50d6462a-4447-459d-9aee-828d92036c01 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:30.873233 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-50d6462a-4447-459d-9aee-828d92036c01 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 200 len: 1472 microversion: 2.1 time: 0.509924 Aug 29 15:26:30.874361 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 233/449] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:30 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 1472 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:30.895188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1aa8dc75-32ad-40c3-bc7f-374f0c96267c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:30.899236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4bb56b60-f828-4bcd-9abf-2d08d9706c63 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:30.900059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4bb56b60-f828-4bcd-9abf-2d08d9706c63 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:30.900885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1aa8dc75-32ad-40c3-bc7f-374f0c96267c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:30.912292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bb56b60-f828-4bcd-9abf-2d08d9706c63 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:30.919111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1aa8dc75-32ad-40c3-bc7f-374f0c96267c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:30.919853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1aa8dc75-32ad-40c3-bc7f-374f0c96267c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:30.920833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bb56b60-f828-4bcd-9abf-2d08d9706c63 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:30.921160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bb56b60-f828-4bcd-9abf-2d08d9706c63 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:30.921907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bb56b60-f828-4bcd-9abf-2d08d9706c63 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:30.922441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bb56b60-f828-4bcd-9abf-2d08d9706c63 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:30.923124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1aa8dc75-32ad-40c3-bc7f-374f0c96267c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:30.923994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1aa8dc75-32ad-40c3-bc7f-374f0c96267c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:30.924586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1aa8dc75-32ad-40c3-bc7f-374f0c96267c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:30.929395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1aa8dc75-32ad-40c3-bc7f-374f0c96267c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:30.930250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bb56b60-f828-4bcd-9abf-2d08d9706c63 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:31.088576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1aa8dc75-32ad-40c3-bc7f-374f0c96267c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1aa8dc75-32ad-40c3-bc7f-374f0c96267c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Request method failure captured: Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14/diagnostics HTTP/1.1 Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNqJVXDwv5g1k6Q85FmxHpMKVO0l6ZFDBbSwdDG9I2Nmfn-P4QTP7tUmDZMOBg3PeeFg2tX8UEt827oGmpnRLox7vBPcjeAKf2kYHFjprH2E4cKZ9lWAtNLoLDp7jWQ7dT9hUCz7HkVGOVR332YhV4y9KWkUdJ5eV6EePsLqOgJoc6k Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 6a741530ffa14110887b496a6424a0a2 Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1583250004 Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:26:31.103568 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:26:31.105062 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a741530ffa14110887b496a6424a0a2", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a741530ffa14110887b496a6424a0a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a741530ffa14110887b496a6424a0a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a741530ffa14110887b496a6424a0a2"}]}] Aug 29 15:26:31.105062 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1583250004 Aug 29 15:26:31.105062 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 6a741530ffa14110887b496a6424a0a2 Aug 29 15:26:31.105062 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1583250004 Aug 29 15:26:31.105062 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerDiagnosticsNegativeTest-1583250004-project Aug 29 15:26:31.105062 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:26:31.105062 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:26:31.105062 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e6ef9a5fbe854fc0a457827081376490 Aug 29 15:26:31.105062 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1583250004-project Aug 29 15:26:31.105062 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:26:31.105062 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'server_id': '7f88a208-e1f7-4f75-9665-06c232424f14'} Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:26:31.105762 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:26:31.106866 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:26:31.106866 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:26:31.106866 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:26:31.106866 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:26:31.106866 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:26:31.106866 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 29 15:26:31.106866 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:31.106866 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:31.106866 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:31.106866 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:31.106866 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:31.106866 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:31.106866 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:26:31.106866 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:26:31.106866 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 29 15:26:31.106866 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:26:31.108812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1aa8dc75-32ad-40c3-bc7f-374f0c96267c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:31.111875 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1aa8dc75-32ad-40c3-bc7f-374f0c96267c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.218925 Aug 29 15:26:31.112616 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 234/450] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:26:30 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14/diagnostics => generated 117 bytes in 222 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:26:31.117697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0c6c0fac-0cf6-40d5-a90e-9badcaeadd60 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:31.121982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0c6c0fac-0cf6-40d5-a90e-9badcaeadd60 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:31.142727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c6c0fac-0cf6-40d5-a90e-9badcaeadd60 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:31.143153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c6c0fac-0cf6-40d5-a90e-9badcaeadd60 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:31.143581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c6c0fac-0cf6-40d5-a90e-9badcaeadd60 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:31.147769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c6c0fac-0cf6-40d5-a90e-9badcaeadd60 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:31.151026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c6c0fac-0cf6-40d5-a90e-9badcaeadd60 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:31.151678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c6c0fac-0cf6-40d5-a90e-9badcaeadd60 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:31.211911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4bb56b60-f828-4bcd-9abf-2d08d9706c63 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:31.229198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4bb56b60-f828-4bcd-9abf-2d08d9706c63 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:31.231595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4bb56b60-f828-4bcd-9abf-2d08d9706c63 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:31.235512 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4bb56b60-f828-4bcd-9abf-2d08d9706c63 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1361 microversion: 2.25 time: 0.346571 Aug 29 15:26:31.236098 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 217/451] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:30 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1361 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:31.246704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c53b943f-0c9f-4dfc-a71d-7d09ed312c94 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:31.252685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c53b943f-0c9f-4dfc-a71d-7d09ed312c94 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:31.271051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c53b943f-0c9f-4dfc-a71d-7d09ed312c94 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:31.272970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c53b943f-0c9f-4dfc-a71d-7d09ed312c94 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:31.274724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c53b943f-0c9f-4dfc-a71d-7d09ed312c94 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:31.276758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c53b943f-0c9f-4dfc-a71d-7d09ed312c94 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:31.279445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c53b943f-0c9f-4dfc-a71d-7d09ed312c94 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:31.281961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c53b943f-0c9f-4dfc-a71d-7d09ed312c94 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:31.332858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0c6c0fac-0cf6-40d5-a90e-9badcaeadd60 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:31.345395 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0c6c0fac-0cf6-40d5-a90e-9badcaeadd60 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1268 microversion: 2.1 time: 0.228931 Aug 29 15:26:31.346671 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 235/452] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:31 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1268 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:31.365790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c53b943f-0c9f-4dfc-a71d-7d09ed312c94 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:26:31.383857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-af430361-202f-468b-91e7-37f90564018a tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:31.385263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-af430361-202f-468b-91e7-37f90564018a tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:31.419783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af430361-202f-468b-91e7-37f90564018a tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:31.422405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af430361-202f-468b-91e7-37f90564018a tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:31.424517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af430361-202f-468b-91e7-37f90564018a tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:31.425497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af430361-202f-468b-91e7-37f90564018a tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:31.438208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af430361-202f-468b-91e7-37f90564018a tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:31.440392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af430361-202f-468b-91e7-37f90564018a tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:31.578253 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c53b943f-0c9f-4dfc-a71d-7d09ed312c94 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 204 len: 0 microversion: 2.1 time: 0.339669 Aug 29 15:26:31.582550 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 218/453] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:26:31 2022] DELETE /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:26:31.601755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1ed0e38f-6a5a-45fc-91be-03d5692e9e6b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:31.602940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1ed0e38f-6a5a-45fc-91be-03d5692e9e6b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:31.611537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ed0e38f-6a5a-45fc-91be-03d5692e9e6b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:31.612381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ed0e38f-6a5a-45fc-91be-03d5692e9e6b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:31.623403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ed0e38f-6a5a-45fc-91be-03d5692e9e6b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:31.624669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ed0e38f-6a5a-45fc-91be-03d5692e9e6b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:31.626382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ed0e38f-6a5a-45fc-91be-03d5692e9e6b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:31.627461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ed0e38f-6a5a-45fc-91be-03d5692e9e6b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:32.078212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1ed0e38f-6a5a-45fc-91be-03d5692e9e6b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:32.112700 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1ed0e38f-6a5a-45fc-91be-03d5692e9e6b tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 200 len: 1478 microversion: 2.1 time: 0.525151 Aug 29 15:26:32.115742 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 219/454] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:31 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 1478 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:32.268160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f8e43a26-cbdc-4cdf-811e-65843dbc2fb9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:32.270172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f8e43a26-cbdc-4cdf-811e-65843dbc2fb9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:32.308377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8e43a26-cbdc-4cdf-811e-65843dbc2fb9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:32.310124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8e43a26-cbdc-4cdf-811e-65843dbc2fb9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:32.315043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8e43a26-cbdc-4cdf-811e-65843dbc2fb9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:32.319415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8e43a26-cbdc-4cdf-811e-65843dbc2fb9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:32.320502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8e43a26-cbdc-4cdf-811e-65843dbc2fb9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:32.330680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8e43a26-cbdc-4cdf-811e-65843dbc2fb9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:32.665126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-af430361-202f-468b-91e7-37f90564018a tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:32.674743 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-af430361-202f-468b-91e7-37f90564018a tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1322 microversion: 2.1 time: 1.298372 Aug 29 15:26:32.709597 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 236/455] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:31 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1322 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:32.722610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c9aa3ffe-7420-4c34-b85e-7d889f54df5e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:32.723326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c9aa3ffe-7420-4c34-b85e-7d889f54df5e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:32.735602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9aa3ffe-7420-4c34-b85e-7d889f54df5e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:32.738560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9aa3ffe-7420-4c34-b85e-7d889f54df5e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:32.739215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9aa3ffe-7420-4c34-b85e-7d889f54df5e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:32.740110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9aa3ffe-7420-4c34-b85e-7d889f54df5e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:32.741389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9aa3ffe-7420-4c34-b85e-7d889f54df5e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:32.742029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9aa3ffe-7420-4c34-b85e-7d889f54df5e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:32.863622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f8e43a26-cbdc-4cdf-811e-65843dbc2fb9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:32.875055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f8e43a26-cbdc-4cdf-811e-65843dbc2fb9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:32.876547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f8e43a26-cbdc-4cdf-811e-65843dbc2fb9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:32.877708 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f8e43a26-cbdc-4cdf-811e-65843dbc2fb9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1361 microversion: 2.25 time: 0.620104 Aug 29 15:26:32.886126 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 220/456] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:32 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1361 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:26:33.133053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c9aa3ffe-7420-4c34-b85e-7d889f54df5e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:33.138059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e8829ddb-1d79-4243-97a9-2557d2d4bc1c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:33.138668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e8829ddb-1d79-4243-97a9-2557d2d4bc1c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:33.149982 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c9aa3ffe-7420-4c34-b85e-7d889f54df5e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1274 microversion: 2.1 time: 0.437615 Aug 29 15:26:33.153988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8829ddb-1d79-4243-97a9-2557d2d4bc1c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:33.159964 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 237/457] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:32 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1274 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:33.161011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8829ddb-1d79-4243-97a9-2557d2d4bc1c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:33.161708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8829ddb-1d79-4243-97a9-2557d2d4bc1c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:33.168290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8829ddb-1d79-4243-97a9-2557d2d4bc1c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:33.169068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8829ddb-1d79-4243-97a9-2557d2d4bc1c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:33.169772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8829ddb-1d79-4243-97a9-2557d2d4bc1c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:33.541378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-46729ed0-3f05-4be4-9b96-72d0ca7367a6 req-43362351-3b01-48f0-9d04-21bfdbb4331d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89c49de-27db-4e19-a013-217c6075debb", "name": "network-vif-plugged", "status": "completed", "tag": "0b3487a8-bae5-4c07-9952-d6c8810ee302"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:33.563063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-46729ed0-3f05-4be4-9b96-72d0ca7367a6 req-43362351-3b01-48f0-9d04-21bfdbb4331d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:33.563200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-46729ed0-3f05-4be4-9b96-72d0ca7367a6 req-43362351-3b01-48f0-9d04-21bfdbb4331d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:33.563569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-46729ed0-3f05-4be4-9b96-72d0ca7367a6 req-43362351-3b01-48f0-9d04-21bfdbb4331d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:33.618704 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-46729ed0-3f05-4be4-9b96-72d0ca7367a6 req-43362351-3b01-48f0-9d04-21bfdbb4331d service nova] Creating event network-vif-plugged:0b3487a8-bae5-4c07-9952-d6c8810ee302 for instance a89c49de-27db-4e19-a013-217c6075debb on n-h2-839401-11 Aug 29 15:26:33.635733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e8829ddb-1d79-4243-97a9-2557d2d4bc1c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:33.638366 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-46729ed0-3f05-4be4-9b96-72d0ca7367a6 req-43362351-3b01-48f0-9d04-21bfdbb4331d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099283 Aug 29 15:26:33.640879 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 238/458] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:33.648937 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e8829ddb-1d79-4243-97a9-2557d2d4bc1c tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 200 len: 1478 microversion: 2.1 time: 0.512096 Aug 29 15:26:33.663965 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 221/459] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:33 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 1478 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:33.697390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-36cff89f-5d89-4075-83a8-40a5d9eef163 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:33.698114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-36cff89f-5d89-4075-83a8-40a5d9eef163 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:33.718817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36cff89f-5d89-4075-83a8-40a5d9eef163 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:33.719344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36cff89f-5d89-4075-83a8-40a5d9eef163 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:33.719926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36cff89f-5d89-4075-83a8-40a5d9eef163 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:33.729490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36cff89f-5d89-4075-83a8-40a5d9eef163 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:33.729691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36cff89f-5d89-4075-83a8-40a5d9eef163 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:33.730408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36cff89f-5d89-4075-83a8-40a5d9eef163 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:33.878982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-477994387", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "2112833216", "adminPass": "***", "networks": [{"uuid": "4d6a5945-ca4d-426d-97ed-ccb169b5644e"}], "security_groups": [{"name": "tempest-securitygroup--1492071322"}], "key_name": "tempest-keypair-1081306532", "user_data": "}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:34.098220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] validate_networks() for [('4d6a5945-ca4d-426d-97ed-ccb169b5644e', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:26:34.658815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36cff89f-5d89-4075-83a8-40a5d9eef163 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:34.671242 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-36cff89f-5d89-4075-83a8-40a5d9eef163 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1322 microversion: 2.1 time: 0.979529 Aug 29 15:26:34.672463 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 239/460] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:33 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1322 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:34.679047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-69335782-df4b-43bd-8aaa-2dfc8835e016 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:34.680222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-69335782-df4b-43bd-8aaa-2dfc8835e016 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:34.694894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69335782-df4b-43bd-8aaa-2dfc8835e016 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:34.695563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69335782-df4b-43bd-8aaa-2dfc8835e016 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:34.696269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69335782-df4b-43bd-8aaa-2dfc8835e016 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:34.697253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69335782-df4b-43bd-8aaa-2dfc8835e016 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:34.698003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69335782-df4b-43bd-8aaa-2dfc8835e016 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:34.699120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69335782-df4b-43bd-8aaa-2dfc8835e016 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:34.733516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:26:34.734203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:26:34.734837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:26:34.736193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:26:34.736782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:26:34.740698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=4,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:34.751427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:34.752617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:34.753716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:34.754917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:34.755595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:34.756558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:34.784929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Getting quotas for project be837968b7df43d89c7fc806a7387b18. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:26:34.792086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Getting quotas for user e36b9be537be45d88b1a7ef3543f26b4 and project be837968b7df43d89c7fc806a7387b18. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:26:34.812998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:26:34.815802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:26:34.903268 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8c68d0bf-1d68-4d30-8773-af5b1a2be46e tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.029323 Aug 29 15:26:34.913954 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 222/461] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:26:34.921831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0278ee99-e2cb-4a34-ac69-0a36eab05b73 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:34.922723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0278ee99-e2cb-4a34-ac69-0a36eab05b73 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:34.944299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0278ee99-e2cb-4a34-ac69-0a36eab05b73 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:34.947952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0278ee99-e2cb-4a34-ac69-0a36eab05b73 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:34.950552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0278ee99-e2cb-4a34-ac69-0a36eab05b73 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:34.951911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0278ee99-e2cb-4a34-ac69-0a36eab05b73 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:34.952544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0278ee99-e2cb-4a34-ac69-0a36eab05b73 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:34.953439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0278ee99-e2cb-4a34-ac69-0a36eab05b73 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:35.079476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0278ee99-e2cb-4a34-ac69-0a36eab05b73 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:35.090120 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0278ee99-e2cb-4a34-ac69-0a36eab05b73 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1274 microversion: 2.1 time: 0.174851 Aug 29 15:26:35.101679 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 223/462] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:34 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1274 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:35.109441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-78d880ce-250b-4c47-84cd-26848980a226 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:35.110163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-78d880ce-250b-4c47-84cd-26848980a226 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:35.121000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d880ce-250b-4c47-84cd-26848980a226 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:35.122053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d880ce-250b-4c47-84cd-26848980a226 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:35.122841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d880ce-250b-4c47-84cd-26848980a226 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:35.123921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d880ce-250b-4c47-84cd-26848980a226 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:35.124645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d880ce-250b-4c47-84cd-26848980a226 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:35.125504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d880ce-250b-4c47-84cd-26848980a226 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:35.360615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-78d880ce-250b-4c47-84cd-26848980a226 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:35.372929 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-78d880ce-250b-4c47-84cd-26848980a226 tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 200 len: 1478 microversion: 2.1 time: 0.269919 Aug 29 15:26:35.374846 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 224/463] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:35 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 1478 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:35.379712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d492316c-953c-4a1a-90c9-41ded46f6087 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:35.383423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d492316c-953c-4a1a-90c9-41ded46f6087 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:35.470365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d492316c-953c-4a1a-90c9-41ded46f6087 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:35.479103 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d492316c-953c-4a1a-90c9-41ded46f6087 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 200 len: 1264 microversion: 2.1 time: 0.103103 Aug 29 15:26:35.492460 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 225/464] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:35 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 1264 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:35.631917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-69335782-df4b-43bd-8aaa-2dfc8835e016 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:35.643396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-69335782-df4b-43bd-8aaa-2dfc8835e016 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:35.646938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-69335782-df4b-43bd-8aaa-2dfc8835e016 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:35.648535 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-69335782-df4b-43bd-8aaa-2dfc8835e016 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1361 microversion: 2.25 time: 0.974898 Aug 29 15:26:35.650440 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 240/465] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:34 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1361 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:35.668697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-71878b4f-e52a-4522-a42e-a815d4d3d966 tempest-FlavorMetadataValidation-39423031 tempest-FlavorMetadataValidation-39423031-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1947882563", "id": 1412452620, "os-flavor-access:is_public": "True"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:35.680713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-fb579b36-a319-4490-b65d-dd9c4084370f req-e969daf6-67e6-4d69-a31b-21f1adbd87e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210b41e1-4270-4fb9-99e9-894536b94b41", "name": "network-vif-plugged", "status": "completed", "tag": "25ba1b63-7433-40d1-a6be-570eca2697f6"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:35.696693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fb579b36-a319-4490-b65d-dd9c4084370f req-e969daf6-67e6-4d69-a31b-21f1adbd87e8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:35.703991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fb579b36-a319-4490-b65d-dd9c4084370f req-e969daf6-67e6-4d69-a31b-21f1adbd87e8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:35.704880 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-71878b4f-e52a-4522-a42e-a815d4d3d966 tempest-FlavorMetadataValidation-39423031 tempest-FlavorMetadataValidation-39423031-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.220184 Aug 29 15:26:35.705539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fb579b36-a319-4490-b65d-dd9c4084370f req-e969daf6-67e6-4d69-a31b-21f1adbd87e8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:35.705783 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 226/466] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:26:35 2022] POST /compute/v2.1/flavors => generated 471 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:35.728614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-154aa89c-dec5-4b79-abae-7c77a9f32b1c tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:35.729289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-154aa89c-dec5-4b79-abae-7c77a9f32b1c tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:35.737235 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-fb579b36-a319-4490-b65d-dd9c4084370f req-e969daf6-67e6-4d69-a31b-21f1adbd87e8 service nova] Creating event network-vif-plugged:25ba1b63-7433-40d1-a6be-570eca2697f6 for instance 210b41e1-4270-4fb9-99e9-894536b94b41 on n-h1-839401-11 Aug 29 15:26:35.740010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154aa89c-dec5-4b79-abae-7c77a9f32b1c tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:35.740803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154aa89c-dec5-4b79-abae-7c77a9f32b1c tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:35.741510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154aa89c-dec5-4b79-abae-7c77a9f32b1c tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:35.742416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154aa89c-dec5-4b79-abae-7c77a9f32b1c tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:35.743037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154aa89c-dec5-4b79-abae-7c77a9f32b1c tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:35.743786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154aa89c-dec5-4b79-abae-7c77a9f32b1c tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:35.744429 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-fb579b36-a319-4490-b65d-dd9c4084370f req-e969daf6-67e6-4d69-a31b-21f1adbd87e8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071432 Aug 29 15:26:35.745753 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 241/467] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:35.756764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0be84c17-953d-4eb7-a53b-8c246e74e379 tempest-FlavorMetadataValidation-39423031 tempest-FlavorMetadataValidation-39423031-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:36.078908 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0be84c17-953d-4eb7-a53b-8c246e74e379 tempest-FlavorMetadataValidation-39423031 tempest-FlavorMetadataValidation-39423031-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors/1412452620/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.331650 Aug 29 15:26:36.079781 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 242/468] 10.222.0.62 () {62 vars in 1265 bytes} [Mon Aug 29 15:26:35 2022] POST /compute/v2.1/flavors/1412452620/os-extra_specs => generated 62 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:36.110093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2825c0fc-e87a-460e-aaa0-4d54f13afe8c tempest-FlavorMetadataValidation-39423031 tempest-FlavorMetadataValidation-39423031-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:36.121714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-154aa89c-dec5-4b79-abae-7c77a9f32b1c tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:36.138133 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-154aa89c-dec5-4b79-abae-7c77a9f32b1c tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1322 microversion: 2.1 time: 0.428734 Aug 29 15:26:36.139293 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 227/469] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:35 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:36.143491 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2825c0fc-e87a-460e-aaa0-4d54f13afe8c tempest-FlavorMetadataValidation-39423031 tempest-FlavorMetadataValidation-39423031-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/1412452620" status: 202 len: 0 microversion: 2.86 time: 0.056597 Aug 29 15:26:36.147890 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 243/470] 10.222.0.62 () {60 vars in 1202 bytes} [Mon Aug 29 15:26:36 2022] DELETE /compute/v2.1/flavors/1412452620 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:26:36.149436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a4af294b-0c08-4900-bbdb-3b3c3ec6822a tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:36.150142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a4af294b-0c08-4900-bbdb-3b3c3ec6822a tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:36.163948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-62245f75-01ed-4e83-a751-0c5e7e7ae6ea tempest-FlavorMetadataValidation-39423031 tempest-FlavorMetadataValidation-39423031-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:36.168427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4af294b-0c08-4900-bbdb-3b3c3ec6822a tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:36.169821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4af294b-0c08-4900-bbdb-3b3c3ec6822a tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:36.171127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4af294b-0c08-4900-bbdb-3b3c3ec6822a tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:36.173131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4af294b-0c08-4900-bbdb-3b3c3ec6822a tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:36.174214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4af294b-0c08-4900-bbdb-3b3c3ec6822a tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:36.176402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4af294b-0c08-4900-bbdb-3b3c3ec6822a tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:36.185986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:36.226217 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-62245f75-01ed-4e83-a751-0c5e7e7ae6ea tempest-FlavorMetadataValidation-39423031 tempest-FlavorMetadataValidation-39423031-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 6683 microversion: 2.86 time: 0.070971 Aug 29 15:26:36.242410 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 244/471] 10.222.0.62 () {60 vars in 1187 bytes} [Mon Aug 29 15:26:36 2022] GET /compute/v2.1/flavors/detail => generated 6683 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:36.394472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ee8fd823-ab46-4994-b321-e5eeb5cc25fa tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:36.396132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ee8fd823-ab46-4994-b321-e5eeb5cc25fa tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:36.412522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee8fd823-ab46-4994-b321-e5eeb5cc25fa tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:36.414388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee8fd823-ab46-4994-b321-e5eeb5cc25fa tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:36.417988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee8fd823-ab46-4994-b321-e5eeb5cc25fa tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:36.419300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee8fd823-ab46-4994-b321-e5eeb5cc25fa tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:36.421834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee8fd823-ab46-4994-b321-e5eeb5cc25fa tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:36.427202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a4af294b-0c08-4900-bbdb-3b3c3ec6822a tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:36.428063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee8fd823-ab46-4994-b321-e5eeb5cc25fa tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:36.441242 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a4af294b-0c08-4900-bbdb-3b3c3ec6822a tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1316 microversion: 2.1 time: 0.299958 Aug 29 15:26:36.442239 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 228/472] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:36 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:36.502319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-817434f5-59eb-457c-ad02-95c2b068d870 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:36.502947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-817434f5-59eb-457c-ad02-95c2b068d870 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:36.512621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817434f5-59eb-457c-ad02-95c2b068d870 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:36.512621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817434f5-59eb-457c-ad02-95c2b068d870 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:36.513103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817434f5-59eb-457c-ad02-95c2b068d870 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:36.513846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817434f5-59eb-457c-ad02-95c2b068d870 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:36.514368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817434f5-59eb-457c-ad02-95c2b068d870 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:36.514727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817434f5-59eb-457c-ad02-95c2b068d870 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:36.710882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ee8fd823-ab46-4994-b321-e5eeb5cc25fa tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ef9a5fbe854fc0a457827081376490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a741530ffa14110887b496a6424a0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:36.732045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-817434f5-59eb-457c-ad02-95c2b068d870 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:36.736526 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ee8fd823-ab46-4994-b321-e5eeb5cc25fa tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 200 len: 1436 microversion: 2.1 time: 0.343094 Aug 29 15:26:36.750662 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 245/473] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:36 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 1436 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:36.755708 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-817434f5-59eb-457c-ad02-95c2b068d870 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 200 len: 1316 microversion: 2.1 time: 0.259052 Aug 29 15:26:36.756955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-340a6fc7-e330-4bc6-a8a0-f664bd1c725f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:36.757735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-340a6fc7-e330-4bc6-a8a0-f664bd1c725f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:36.764775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-340a6fc7-e330-4bc6-a8a0-f664bd1c725f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:36.765577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-340a6fc7-e330-4bc6-a8a0-f664bd1c725f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:36.766242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-340a6fc7-e330-4bc6-a8a0-f664bd1c725f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:36.767454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-340a6fc7-e330-4bc6-a8a0-f664bd1c725f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:36.768114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-340a6fc7-e330-4bc6-a8a0-f664bd1c725f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:36.768795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-340a6fc7-e330-4bc6-a8a0-f664bd1c725f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:36.771156 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 229/474] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:36 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:36.815572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-49ef6f4c-f4c1-4635-b11a-e4bcb76bcbfd req-357c25a2-f52a-452b-9e91-d98eb20e4b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f88a208-e1f7-4f75-9665-06c232424f14", "name": "network-vif-deleted", "tag": "c5f04826-f0a6-42a1-98f6-2fcd03fd3473"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:36.830467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-49ef6f4c-f4c1-4635-b11a-e4bcb76bcbfd req-357c25a2-f52a-452b-9e91-d98eb20e4b76 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:36.830955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-49ef6f4c-f4c1-4635-b11a-e4bcb76bcbfd req-357c25a2-f52a-452b-9e91-d98eb20e4b76 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:36.831389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-49ef6f4c-f4c1-4635-b11a-e4bcb76bcbfd req-357c25a2-f52a-452b-9e91-d98eb20e4b76 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:36.859149 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-49ef6f4c-f4c1-4635-b11a-e4bcb76bcbfd req-357c25a2-f52a-452b-9e91-d98eb20e4b76 service nova] Creating event network-vif-deleted:c5f04826-f0a6-42a1-98f6-2fcd03fd3473 for instance 7f88a208-e1f7-4f75-9665-06c232424f14 on n-h2-839401-11 Aug 29 15:26:36.868717 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-49ef6f4c-f4c1-4635-b11a-e4bcb76bcbfd req-357c25a2-f52a-452b-9e91-d98eb20e4b76 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056319 Aug 29 15:26:36.869679 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 230/475] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:37.144610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-340a6fc7-e330-4bc6-a8a0-f664bd1c725f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:37.160315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e96e8f5a-faae-4d1e-a595-ca6dbdacd8cc tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:37.161003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e96e8f5a-faae-4d1e-a595-ca6dbdacd8cc tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:37.168605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-340a6fc7-e330-4bc6-a8a0-f664bd1c725f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:37.173505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-340a6fc7-e330-4bc6-a8a0-f664bd1c725f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:37.175221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e96e8f5a-faae-4d1e-a595-ca6dbdacd8cc tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:37.175863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e96e8f5a-faae-4d1e-a595-ca6dbdacd8cc tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:37.177339 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-340a6fc7-e330-4bc6-a8a0-f664bd1c725f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1558 microversion: 2.25 time: 0.424800 Aug 29 15:26:37.177964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e96e8f5a-faae-4d1e-a595-ca6dbdacd8cc tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:37.185258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e96e8f5a-faae-4d1e-a595-ca6dbdacd8cc tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:37.185759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e96e8f5a-faae-4d1e-a595-ca6dbdacd8cc tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:37.186976 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 246/476] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:36 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1558 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:37.187656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e96e8f5a-faae-4d1e-a595-ca6dbdacd8cc tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:37.527441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f8ddaa03-adf1-4eb6-8e9d-edd7c2622df8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:37.531805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f8ddaa03-adf1-4eb6-8e9d-edd7c2622df8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:37.547228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8ddaa03-adf1-4eb6-8e9d-edd7c2622df8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:37.547423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e96e8f5a-faae-4d1e-a595-ca6dbdacd8cc tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:37.548733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8ddaa03-adf1-4eb6-8e9d-edd7c2622df8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:37.549527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8ddaa03-adf1-4eb6-8e9d-edd7c2622df8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:37.550454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8ddaa03-adf1-4eb6-8e9d-edd7c2622df8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:37.551127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8ddaa03-adf1-4eb6-8e9d-edd7c2622df8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:37.552131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8ddaa03-adf1-4eb6-8e9d-edd7c2622df8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:37.558658 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e96e8f5a-faae-4d1e-a595-ca6dbdacd8cc tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1322 microversion: 2.1 time: 0.402533 Aug 29 15:26:37.559259 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 231/477] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:37 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:37.579411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-815136a1-aba9-498c-988a-3d13b5b9a3e4 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:37.580202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-815136a1-aba9-498c-988a-3d13b5b9a3e4 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:37.598053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-815136a1-aba9-498c-988a-3d13b5b9a3e4 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:37.598618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-815136a1-aba9-498c-988a-3d13b5b9a3e4 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:37.598969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-815136a1-aba9-498c-988a-3d13b5b9a3e4 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:37.599668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-815136a1-aba9-498c-988a-3d13b5b9a3e4 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:37.600118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-815136a1-aba9-498c-988a-3d13b5b9a3e4 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:37.600536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-815136a1-aba9-498c-988a-3d13b5b9a3e4 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.080631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-815136a1-aba9-498c-988a-3d13b5b9a3e4 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:38.089178 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-815136a1-aba9-498c-988a-3d13b5b9a3e4 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1316 microversion: 2.1 time: 0.528651 Aug 29 15:26:38.090140 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 232/478] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:37 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:38.109861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0bcee108-0453-4254-ad80-829cc326b1dc tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:38.110049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0bcee108-0453-4254-ad80-829cc326b1dc tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] [instance: 7f88a208-e1f7-4f75-9665-06c232424f14] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:38.123972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bcee108-0453-4254-ad80-829cc326b1dc tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.125070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bcee108-0453-4254-ad80-829cc326b1dc tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.125909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bcee108-0453-4254-ad80-829cc326b1dc tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.127233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bcee108-0453-4254-ad80-829cc326b1dc tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.129404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bcee108-0453-4254-ad80-829cc326b1dc tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.129986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bcee108-0453-4254-ad80-829cc326b1dc tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.147550 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-0bcee108-0453-4254-ad80-829cc326b1dc tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] HTTP exception thrown: Instance 7f88a208-e1f7-4f75-9665-06c232424f14 could not be found. Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0bcee108-0453-4254-ad80-829cc326b1dc tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Request method failure captured: Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 HTTP/1.1 Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqJVXDwv5g1k6Q85FmxHpMKVO0l6ZFDBbSwdDG9I2Nmfn-P4QTP7tUmDZMOBg3PeeFg2tX8UEt827oGmpnRLox7vBPcjeAKf2kYHFjprH2E4cKZ9lWAtNLoLDp7jWQ7dT9hUCz7HkVGOVR332YhV4y9KWkUdJ5eV6EePsLqOgJoc6k Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 6a741530ffa14110887b496a6424a0a2 Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1583250004 Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:26:38.149309 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:26:38.150736 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a741530ffa14110887b496a6424a0a2", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a741530ffa14110887b496a6424a0a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a741530ffa14110887b496a6424a0a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a741530ffa14110887b496a6424a0a2"}]}] Aug 29 15:26:38.150736 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1583250004 Aug 29 15:26:38.150736 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 6a741530ffa14110887b496a6424a0a2 Aug 29 15:26:38.150736 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1583250004 Aug 29 15:26:38.150736 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerDiagnosticsNegativeTest-1583250004-project Aug 29 15:26:38.150736 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:26:38.150736 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:26:38.150736 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e6ef9a5fbe854fc0a457827081376490 Aug 29 15:26:38.150736 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1583250004-project Aug 29 15:26:38.150736 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:26:38.150736 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 7f88a208-e1f7-4f75-9665-06c232424f14 could not be found. Aug 29 15:26:38.150736 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7f88a208-e1f7-4f75-9665-06c232424f14'} Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f88a208-e1f7-4f75-9665-06c232424f14 could not be found. Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:38.155444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f88a208-e1f7-4f75-9665-06c232424f14 could not be found. Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f88a208-e1f7-4f75-9665-06c232424f14 could not be found. Aug 29 15:26:38.156764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:38.159908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0bcee108-0453-4254-ad80-829cc326b1dc tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] Returning 404 to user: Instance 7f88a208-e1f7-4f75-9665-06c232424f14 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:38.159908 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0bcee108-0453-4254-ad80-829cc326b1dc tempest-ServerDiagnosticsNegativeTest-1583250004 tempest-ServerDiagnosticsNegativeTest-1583250004-project] 10.222.0.62 "GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14" status: 404 len: 111 microversion: 2.1 time: 0.045552 Aug 29 15:26:38.159908 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 233/479] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:38 2022] GET /compute/v2.1/servers/7f88a208-e1f7-4f75-9665-06c232424f14 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:38.160823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6f8a62d3-c6b5-48b0-acce-de954ed65de1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:38.162939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6f8a62d3-c6b5-48b0-acce-de954ed65de1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:38.176603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f8a62d3-c6b5-48b0-acce-de954ed65de1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.179230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f8a62d3-c6b5-48b0-acce-de954ed65de1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.181591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f8a62d3-c6b5-48b0-acce-de954ed65de1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.181946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f8a62d3-c6b5-48b0-acce-de954ed65de1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.182371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f8a62d3-c6b5-48b0-acce-de954ed65de1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.183967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f8a62d3-c6b5-48b0-acce-de954ed65de1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.293671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6f8a62d3-c6b5-48b0-acce-de954ed65de1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:38.306435 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6f8a62d3-c6b5-48b0-acce-de954ed65de1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 200 len: 1322 microversion: 2.1 time: 0.153561 Aug 29 15:26:38.309179 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 234/480] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:38 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:38.318553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-f8ddaa03-adf1-4eb6-8e9d-edd7c2622df8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'services' on Instance uuid a89c49de-27db-4e19-a013-217c6075debb {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:26:38.462612 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f8ddaa03-adf1-4eb6-8e9d-edd7c2622df8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 2052 microversion: 2.25 time: 1.252511 Aug 29 15:26:38.479076 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 247/481] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:37 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 2052 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:38.492971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8fa8cd2d-63b8-43df-909e-5dcf47142c23 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:38.498771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8fa8cd2d-63b8-43df-909e-5dcf47142c23 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:38.520639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8fa8cd2d-63b8-43df-909e-5dcf47142c23 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.522965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8fa8cd2d-63b8-43df-909e-5dcf47142c23 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.525371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8fa8cd2d-63b8-43df-909e-5dcf47142c23 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.527996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8fa8cd2d-63b8-43df-909e-5dcf47142c23 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.530893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8fa8cd2d-63b8-43df-909e-5dcf47142c23 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.538661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8fa8cd2d-63b8-43df-909e-5dcf47142c23 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.584825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7c8b973d-9c07-4d65-92ac-69217d77ba59 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:38.586014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7c8b973d-9c07-4d65-92ac-69217d77ba59 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:38.599517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8b973d-9c07-4d65-92ac-69217d77ba59 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.600822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8b973d-9c07-4d65-92ac-69217d77ba59 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.601968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8b973d-9c07-4d65-92ac-69217d77ba59 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:38.603697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8b973d-9c07-4d65-92ac-69217d77ba59 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:38.606397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8b973d-9c07-4d65-92ac-69217d77ba59 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:38.607134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8b973d-9c07-4d65-92ac-69217d77ba59 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.254292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-8fa8cd2d-63b8-43df-909e-5dcf47142c23 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'services' on Instance uuid a89c49de-27db-4e19-a013-217c6075debb {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:26:39.393139 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8fa8cd2d-63b8-43df-909e-5dcf47142c23 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 2052 microversion: 2.25 time: 0.907399 Aug 29 15:26:39.396277 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 235/482] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:38 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 2052 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:39.401746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c1e46424-ea27-4d68-b05c-5d6ac6a34713 req-c885c92c-732e-495a-a484-3a2b88979a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e8b4865-90f7-40ae-a4d6-cedb0af05d3c", "tag": "10a29cc3-7d6e-438d-8ea2-0470cd224974"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:39.430083 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c1e46424-ea27-4d68-b05c-5d6ac6a34713 req-c885c92c-732e-495a-a484-3a2b88979a10 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.430831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c1e46424-ea27-4d68-b05c-5d6ac6a34713 req-c885c92c-732e-495a-a484-3a2b88979a10 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.431719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c1e46424-ea27-4d68-b05c-5d6ac6a34713 req-c885c92c-732e-495a-a484-3a2b88979a10 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.445704 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c1e46424-ea27-4d68-b05c-5d6ac6a34713 req-c885c92c-732e-495a-a484-3a2b88979a10 service nova] Creating event network-changed:10a29cc3-7d6e-438d-8ea2-0470cd224974 for instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c on n-h1-839401-11 Aug 29 15:26:39.455949 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c1e46424-ea27-4d68-b05c-5d6ac6a34713 req-c885c92c-732e-495a-a484-3a2b88979a10 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058017 Aug 29 15:26:39.457815 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 236/483] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:39.465943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fb2f136e-051f-4e59-8c19-e83ff0c56419 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:39.467117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fb2f136e-051f-4e59-8c19-e83ff0c56419 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:39.475109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb2f136e-051f-4e59-8c19-e83ff0c56419 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.475940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb2f136e-051f-4e59-8c19-e83ff0c56419 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.476762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb2f136e-051f-4e59-8c19-e83ff0c56419 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.479319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb2f136e-051f-4e59-8c19-e83ff0c56419 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.479958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb2f136e-051f-4e59-8c19-e83ff0c56419 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.482037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb2f136e-051f-4e59-8c19-e83ff0c56419 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.800807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7c8b973d-9c07-4d65-92ac-69217d77ba59 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:39.817566 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7c8b973d-9c07-4d65-92ac-69217d77ba59 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1472 microversion: 2.1 time: 1.240197 Aug 29 15:26:39.818181 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 248/484] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:38 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1472 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:39.832257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4d1148d3-b258-4641-a143-3ad138093e12 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:39.833143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4d1148d3-b258-4641-a143-3ad138093e12 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:39.846861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d1148d3-b258-4641-a143-3ad138093e12 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.847595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d1148d3-b258-4641-a143-3ad138093e12 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.848226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d1148d3-b258-4641-a143-3ad138093e12 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:39.849784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d1148d3-b258-4641-a143-3ad138093e12 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:39.850415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d1148d3-b258-4641-a143-3ad138093e12 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:39.851606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d1148d3-b258-4641-a143-3ad138093e12 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:40.035758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fb2f136e-051f-4e59-8c19-e83ff0c56419 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:40.046594 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fb2f136e-051f-4e59-8c19-e83ff0c56419 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1316 microversion: 2.1 time: 0.586759 Aug 29 15:26:40.047577 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 237/485] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:39 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1316 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:40.052682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-258c9529-482c-4e91-87a0-7d4ecb3891cb tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:40.056872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-258c9529-482c-4e91-87a0-7d4ecb3891cb tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:40.057599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-258c9529-482c-4e91-87a0-7d4ecb3891cb tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:40.058198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-258c9529-482c-4e91-87a0-7d4ecb3891cb tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:40.059105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-258c9529-482c-4e91-87a0-7d4ecb3891cb tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:40.059734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-258c9529-482c-4e91-87a0-7d4ecb3891cb tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:40.060379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-258c9529-482c-4e91-87a0-7d4ecb3891cb tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:40.085921 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-258c9529-482c-4e91-87a0-7d4ecb3891cb tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.037062 Aug 29 15:26:40.086745 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 238/486] 10.222.0.62 () {60 vars in 1217 bytes} [Mon Aug 29 15:26:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:26:40.524464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ab50c0f-9e86-4d4d-807d-aa5348ee1853 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:40.526362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ab50c0f-9e86-4d4d-807d-aa5348ee1853 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] [instance: 2570c7c3-3aa1-4e46-a280-810514828115] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:40.560078 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-5ab50c0f-9e86-4d4d-807d-aa5348ee1853 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] HTTP exception thrown: Instance 2570c7c3-3aa1-4e46-a280-810514828115 could not be found. Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ab50c0f-9e86-4d4d-807d-aa5348ee1853 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Request method failure captured: Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/2570c7c3-3aa1-4e46-a280-810514828115/action HTTP/1.1 Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 15 Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqPT7iohAqcNPmZsCWSJaZHQ4c20FA1meyxBi93zBoOdMMaHysQNxn3LDfbabBVxzUBlKnOBazSQjDabV5OS0aXL7BUYoB5pueT8yyrkC3jPaL0DwI-jLHOdO2s4eho-MHBAPwtd9zZv0MFuPxq57uJa29FBLuKn28kTztsmJeOPxc Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: f63fe3e4102445219a161ea8880e0c6a Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1595742544 Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:26:40.563446 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:26:40.565066 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f63fe3e4102445219a161ea8880e0c6a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f63fe3e4102445219a161ea8880e0c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f63fe3e4102445219a161ea8880e0c6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f63fe3e4102445219a161ea8880e0c6a"}]}] Aug 29 15:26:40.565066 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1595742544 Aug 29 15:26:40.565066 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: f63fe3e4102445219a161ea8880e0c6a Aug 29 15:26:40.565066 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1595742544 Aug 29 15:26:40.565066 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersAdminNegativeTestJSON-1595742544-project-admin Aug 29 15:26:40.565066 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:26:40.565066 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:26:40.565066 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 85c62ded2c864d3b866ee07d39804812 Aug 29 15:26:40.565066 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1595742544-project-admin Aug 29 15:26:40.565066 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:26:40.565066 n-d-839401-11 devstack@n-api.service[122360]: {"migrate": {}} Aug 29 15:26:40.565066 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:26:40.565066 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 2570c7c3-3aa1-4e46-a280-810514828115 could not be found. Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '2570c7c3-3aa1-4e46-a280-810514828115', 'body': {'migrate': {}}} Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2570c7c3-3aa1-4e46-a280-810514828115 could not be found. Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:26:40.566116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2570c7c3-3aa1-4e46-a280-810514828115 could not be found. Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2570c7c3-3aa1-4e46-a280-810514828115 could not be found. Aug 29 15:26:40.567904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:26:40.570023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ab50c0f-9e86-4d4d-807d-aa5348ee1853 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Returning 404 to user: Instance 2570c7c3-3aa1-4e46-a280-810514828115 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:26:40.571551 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ab50c0f-9e86-4d4d-807d-aa5348ee1853 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/2570c7c3-3aa1-4e46-a280-810514828115/action" status: 404 len: 111 microversion: 2.1 time: 0.483558 Aug 29 15:26:40.572322 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 239/487] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:26:40 2022] POST /compute/v2.1/servers/2570c7c3-3aa1-4e46-a280-810514828115/action => generated 111 bytes in 485 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:26:40.577584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-831a8d67-1798-4d12-92d5-c621a0953961 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-839401-11", "block_migration": "auto"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:40.580271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-831a8d67-1798-4d12-92d5-c621a0953961 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:40.591863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-831a8d67-1798-4d12-92d5-c621a0953961 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:40.592405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-831a8d67-1798-4d12-92d5-c621a0953961 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:40.592850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-831a8d67-1798-4d12-92d5-c621a0953961 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:40.593781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-831a8d67-1798-4d12-92d5-c621a0953961 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:40.594228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-831a8d67-1798-4d12-92d5-c621a0953961 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:40.594901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-831a8d67-1798-4d12-92d5-c621a0953961 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:40.659819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4d1148d3-b258-4641-a143-3ad138093e12 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:40.670821 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4d1148d3-b258-4641-a143-3ad138093e12 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 200 len: 1390 microversion: 2.1 time: 0.851352 Aug 29 15:26:40.671430 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 249/488] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:39 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 1390 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:40.754299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-831a8d67-1798-4d12-92d5-c621a0953961 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'flavor' on Instance uuid a89c49de-27db-4e19-a013-217c6075debb {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:26:40.811819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-831a8d67-1798-4d12-92d5-c621a0953961 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: a89c49de-27db-4e19-a013-217c6075debb] Going to try to live migrate instance to n-h1-839401-11 {{(pid=122360) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:26:40.863555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-995539424", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:41.037544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:26:41.887671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:26:41.888291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:26:41.888582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:26:41.889202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:26:41.889785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:26:41.914328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:41.915043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:41.919774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:41.920817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:41.921788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:41.922388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:41.950300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:41.991024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Getting quotas for project 3794161498684ce19acf188df258eeff. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:26:42.006836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Getting quotas for user 32267072a4ed46cb8c596117db38fae5 and project 3794161498684ce19acf188df258eeff. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:26:42.017075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:DELETE=9,nova_api:SELECT=83,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:42.049846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:26:42.056638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:26:42.197981 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-38ae5e61-6e59-4933-b84c-86b4bdf93652 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.340548 Aug 29 15:26:42.200343 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 250/489] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:26:42.214086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8c61a2d1-8372-4807-b13c-302330aeb8f8 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:42.218359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8c61a2d1-8372-4807-b13c-302330aeb8f8 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:42.263693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c61a2d1-8372-4807-b13c-302330aeb8f8 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:42.265301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c61a2d1-8372-4807-b13c-302330aeb8f8 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:42.265768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c61a2d1-8372-4807-b13c-302330aeb8f8 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:42.266515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c61a2d1-8372-4807-b13c-302330aeb8f8 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:42.268378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c61a2d1-8372-4807-b13c-302330aeb8f8 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:42.270536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c61a2d1-8372-4807-b13c-302330aeb8f8 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:42.726585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8c61a2d1-8372-4807-b13c-302330aeb8f8 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:42.737810 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8c61a2d1-8372-4807-b13c-302330aeb8f8 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1316 microversion: 2.1 time: 0.535753 Aug 29 15:26:42.739114 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 251/490] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:42 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1316 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:42.745987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fd5a2ad9-a64e-4eba-bcf8-82712eb08581 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:42.747187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fd5a2ad9-a64e-4eba-bcf8-82712eb08581 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:42.767668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd5a2ad9-a64e-4eba-bcf8-82712eb08581 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:42.768623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd5a2ad9-a64e-4eba-bcf8-82712eb08581 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:42.769574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd5a2ad9-a64e-4eba-bcf8-82712eb08581 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:42.773389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd5a2ad9-a64e-4eba-bcf8-82712eb08581 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:42.777942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd5a2ad9-a64e-4eba-bcf8-82712eb08581 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:42.779917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd5a2ad9-a64e-4eba-bcf8-82712eb08581 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:43.760326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fd5a2ad9-a64e-4eba-bcf8-82712eb08581 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:43.773015 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fd5a2ad9-a64e-4eba-bcf8-82712eb08581 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 200 len: 1390 microversion: 2.1 time: 1.031989 Aug 29 15:26:43.773870 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 252/491] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:42 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 1390 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:43.784112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-07703942-aa75-48e0-9f77-d2e2b96a7ac0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:43.785026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-07703942-aa75-48e0-9f77-d2e2b96a7ac0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:43.804102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07703942-aa75-48e0-9f77-d2e2b96a7ac0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:43.805951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07703942-aa75-48e0-9f77-d2e2b96a7ac0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:43.808163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07703942-aa75-48e0-9f77-d2e2b96a7ac0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:43.811163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07703942-aa75-48e0-9f77-d2e2b96a7ac0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:43.811893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07703942-aa75-48e0-9f77-d2e2b96a7ac0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:43.812578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07703942-aa75-48e0-9f77-d2e2b96a7ac0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:44.074501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-07703942-aa75-48e0-9f77-d2e2b96a7ac0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:44.089297 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-07703942-aa75-48e0-9f77-d2e2b96a7ac0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1273 microversion: 2.1 time: 0.313072 Aug 29 15:26:44.090529 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 253/492] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:43 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1273 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:44.097328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-dd05f41e-0825-489d-9fa7-08aab42fa09d req-8dbb4337-ddf4-456e-b602-73c55fa7086a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f44b5e-bcae-4e95-a11a-c781e6cf06df", "tag": "3f638867-a674-40ea-b7b1-b095f9393504"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:44.117896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-dd05f41e-0825-489d-9fa7-08aab42fa09d req-8dbb4337-ddf4-456e-b602-73c55fa7086a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:44.120051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-dd05f41e-0825-489d-9fa7-08aab42fa09d req-8dbb4337-ddf4-456e-b602-73c55fa7086a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:44.121361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-dd05f41e-0825-489d-9fa7-08aab42fa09d req-8dbb4337-ddf4-456e-b602-73c55fa7086a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:44.145065 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-dd05f41e-0825-489d-9fa7-08aab42fa09d req-8dbb4337-ddf4-456e-b602-73c55fa7086a service nova] Creating event network-changed:3f638867-a674-40ea-b7b1-b095f9393504 for instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df on n-h2-839401-11 Aug 29 15:26:44.157448 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-dd05f41e-0825-489d-9fa7-08aab42fa09d req-8dbb4337-ddf4-456e-b602-73c55fa7086a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065046 Aug 29 15:26:44.158178 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 254/493] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:44.168745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c7284cbd-0187-4e94-8410-8a8ee1a09036 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:44.172245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c7284cbd-0187-4e94-8410-8a8ee1a09036 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:44.185739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7284cbd-0187-4e94-8410-8a8ee1a09036 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:44.188061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7284cbd-0187-4e94-8410-8a8ee1a09036 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:44.189452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7284cbd-0187-4e94-8410-8a8ee1a09036 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:44.191645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7284cbd-0187-4e94-8410-8a8ee1a09036 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:44.193242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7284cbd-0187-4e94-8410-8a8ee1a09036 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:44.197569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7284cbd-0187-4e94-8410-8a8ee1a09036 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:44.612113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c7284cbd-0187-4e94-8410-8a8ee1a09036 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:44.647620 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c7284cbd-0187-4e94-8410-8a8ee1a09036 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1316 microversion: 2.1 time: 0.484261 Aug 29 15:26:44.648229 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 255/494] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:44 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1316 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:45.360512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1670841159", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:45.465566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:26:45.476102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=20 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:45.588541 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-831a8d67-1798-4d12-92d5-c621a0953961 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb/action" status: 202 len: 0 microversion: 2.25 time: 5.014915 Aug 29 15:26:45.589187 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 240/495] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 15:26:40 2022] POST /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb/action => generated 0 bytes in 5016 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:26:45.594914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-81140e87-e421-4513-b6fc-b3d70d0034bb tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:45.595807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-81140e87-e421-4513-b6fc-b3d70d0034bb tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:45.602490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81140e87-e421-4513-b6fc-b3d70d0034bb tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:45.602985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81140e87-e421-4513-b6fc-b3d70d0034bb tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:45.603422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81140e87-e421-4513-b6fc-b3d70d0034bb tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:45.604148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81140e87-e421-4513-b6fc-b3d70d0034bb tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:45.604608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81140e87-e421-4513-b6fc-b3d70d0034bb tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:45.605032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81140e87-e421-4513-b6fc-b3d70d0034bb tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:45.963498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:26:45.964099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:26:45.964630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:26:45.965048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:26:45.965529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:26:45.976649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:45.977170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:45.977612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:45.978341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:45.978947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:45.979428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:46.007756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Getting quotas for project dd0dbe26a46a40afade4fdb4e7e6aed6. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:26:46.014385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Getting quotas for user f102bed161a64edc82820db2e358017b and project dd0dbe26a46a40afade4fdb4e7e6aed6. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:26:46.030544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:26:46.033810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:26:46.100776 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-85508062-3395-4d52-9c93-5dab9c2b7d27 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.451318 Aug 29 15:26:46.107799 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 256/496] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:26:46.114088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-71eaab73-8354-4560-b3b1-1647ca607eb3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:46.114715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-71eaab73-8354-4560-b3b1-1647ca607eb3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:46.121962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71eaab73-8354-4560-b3b1-1647ca607eb3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:46.122605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71eaab73-8354-4560-b3b1-1647ca607eb3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:46.123055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71eaab73-8354-4560-b3b1-1647ca607eb3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:46.123772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71eaab73-8354-4560-b3b1-1647ca607eb3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:46.124235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71eaab73-8354-4560-b3b1-1647ca607eb3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:46.124665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71eaab73-8354-4560-b3b1-1647ca607eb3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:46.134782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-81140e87-e421-4513-b6fc-b3d70d0034bb tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:46.158707 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-81140e87-e421-4513-b6fc-b3d70d0034bb tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 200 len: 1390 microversion: 2.1 time: 0.568030 Aug 29 15:26:46.161158 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 241/497] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:45 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 1390 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:46.170094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-20b99d29-768d-4285-a01a-4144ec1a4cdf tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:46.190040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-20b99d29-768d-4285-a01a-4144ec1a4cdf tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:46.205456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20b99d29-768d-4285-a01a-4144ec1a4cdf tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:46.205957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20b99d29-768d-4285-a01a-4144ec1a4cdf tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:46.216353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20b99d29-768d-4285-a01a-4144ec1a4cdf tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:46.217508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20b99d29-768d-4285-a01a-4144ec1a4cdf tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:46.218131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20b99d29-768d-4285-a01a-4144ec1a4cdf tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:46.218717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20b99d29-768d-4285-a01a-4144ec1a4cdf tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:46.313587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-71eaab73-8354-4560-b3b1-1647ca607eb3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:46.327350 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-71eaab73-8354-4560-b3b1-1647ca607eb3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1291 microversion: 2.1 time: 0.218243 Aug 29 15:26:46.328525 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 257/498] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:46 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1291 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:46.339394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-40e621d5-87ec-418d-a5c4-12c4ab91d236 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:46.341913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-40e621d5-87ec-418d-a5c4-12c4ab91d236 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:46.362986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40e621d5-87ec-418d-a5c4-12c4ab91d236 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:46.367918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40e621d5-87ec-418d-a5c4-12c4ab91d236 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:46.368593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40e621d5-87ec-418d-a5c4-12c4ab91d236 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:46.370336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40e621d5-87ec-418d-a5c4-12c4ab91d236 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:46.371367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40e621d5-87ec-418d-a5c4-12c4ab91d236 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:46.371959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40e621d5-87ec-418d-a5c4-12c4ab91d236 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:46.660935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-40e621d5-87ec-418d-a5c4-12c4ab91d236 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:46.670734 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-40e621d5-87ec-418d-a5c4-12c4ab91d236 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1316 microversion: 2.1 time: 0.339062 Aug 29 15:26:46.672194 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 258/499] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:46 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:46.687073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2d7678e4-59ce-4653-8525-75849a8527ff tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:46.689221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2d7678e4-59ce-4653-8525-75849a8527ff tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:46.804259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-20b99d29-768d-4285-a01a-4144ec1a4cdf tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:46.813330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-20b99d29-768d-4285-a01a-4144ec1a4cdf tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:46.821752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-20b99d29-768d-4285-a01a-4144ec1a4cdf tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:46.831233 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-20b99d29-768d-4285-a01a-4144ec1a4cdf tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1568 microversion: 2.25 time: 0.668083 Aug 29 15:26:46.838360 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 242/500] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:46 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1568 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:46.853012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-2fe1f1fe-2dc1-497c-87c1-a25586d06350 req-ed3473d0-ecb8-4e96-a17e-80bb22b99638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e8b4865-90f7-40ae-a4d6-cedb0af05d3c", "name": "network-vif-plugged", "status": "completed", "tag": "10a29cc3-7d6e-438d-8ea2-0470cd224974"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:46.885453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2fe1f1fe-2dc1-497c-87c1-a25586d06350 req-ed3473d0-ecb8-4e96-a17e-80bb22b99638 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:46.892414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2fe1f1fe-2dc1-497c-87c1-a25586d06350 req-ed3473d0-ecb8-4e96-a17e-80bb22b99638 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:46.893220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2fe1f1fe-2dc1-497c-87c1-a25586d06350 req-ed3473d0-ecb8-4e96-a17e-80bb22b99638 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:46.935144 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-2fe1f1fe-2dc1-497c-87c1-a25586d06350 req-ed3473d0-ecb8-4e96-a17e-80bb22b99638 service nova] Creating event network-vif-plugged:10a29cc3-7d6e-438d-8ea2-0470cd224974 for instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c on n-h1-839401-11 Aug 29 15:26:46.947012 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-2fe1f1fe-2dc1-497c-87c1-a25586d06350 req-ed3473d0-ecb8-4e96-a17e-80bb22b99638 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104315 Aug 29 15:26:46.950711 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 243/501] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:47.000700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2d7678e4-59ce-4653-8525-75849a8527ff tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:47.014025 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2d7678e4-59ce-4653-8525-75849a8527ff tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1219 microversion: 2.1 time: 0.337603 Aug 29 15:26:47.014700 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 259/502] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:46 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1219 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:47.186689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-08c2f630-f19b-470e-b4c4-a28650cf3217 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:47.187516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-08c2f630-f19b-470e-b4c4-a28650cf3217 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:47.198068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08c2f630-f19b-470e-b4c4-a28650cf3217 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:47.198564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08c2f630-f19b-470e-b4c4-a28650cf3217 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:47.199000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08c2f630-f19b-470e-b4c4-a28650cf3217 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:47.199719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08c2f630-f19b-470e-b4c4-a28650cf3217 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:47.200177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08c2f630-f19b-470e-b4c4-a28650cf3217 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:47.200603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08c2f630-f19b-470e-b4c4-a28650cf3217 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:47.298716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-269519500", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:47.399389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] validate_networks() for None {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:26:48.005552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-08c2f630-f19b-470e-b4c4-a28650cf3217 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:48.020800 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-08c2f630-f19b-470e-b4c4-a28650cf3217 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 200 len: 1390 microversion: 2.1 time: 0.842256 Aug 29 15:26:48.021438 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 260/503] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:47 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 1390 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:48.037336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-40dcf14c-3da3-45d9-b104-c967447285c5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:48.039087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-40dcf14c-3da3-45d9-b104-c967447285c5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:48.053220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40dcf14c-3da3-45d9-b104-c967447285c5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:48.053922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40dcf14c-3da3-45d9-b104-c967447285c5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:48.054542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40dcf14c-3da3-45d9-b104-c967447285c5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:48.055771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40dcf14c-3da3-45d9-b104-c967447285c5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:48.056403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40dcf14c-3da3-45d9-b104-c967447285c5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:48.059935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40dcf14c-3da3-45d9-b104-c967447285c5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:48.223183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-40dcf14c-3da3-45d9-b104-c967447285c5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:48.235069 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-40dcf14c-3da3-45d9-b104-c967447285c5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1279 microversion: 2.1 time: 0.211236 Aug 29 15:26:48.247390 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 261/504] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:48 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1279 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:48.254679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6789330f-4959-4a17-93a2-a52717384faf tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:48.256356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6789330f-4959-4a17-93a2-a52717384faf tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:48.269897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6789330f-4959-4a17-93a2-a52717384faf tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:48.270497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6789330f-4959-4a17-93a2-a52717384faf tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:48.271030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6789330f-4959-4a17-93a2-a52717384faf tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:48.271842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6789330f-4959-4a17-93a2-a52717384faf tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:48.272368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6789330f-4959-4a17-93a2-a52717384faf tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:48.272895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6789330f-4959-4a17-93a2-a52717384faf tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:48.605007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6789330f-4959-4a17-93a2-a52717384faf tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:48.614168 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6789330f-4959-4a17-93a2-a52717384faf tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1316 microversion: 2.1 time: 0.363797 Aug 29 15:26:48.616286 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 262/505] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:48 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:48.624806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7f84e94a-ae85-4aea-8a5c-0042de051d5e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:48.625725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7f84e94a-ae85-4aea-8a5c-0042de051d5e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:48.635000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f84e94a-ae85-4aea-8a5c-0042de051d5e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:48.636625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f84e94a-ae85-4aea-8a5c-0042de051d5e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:48.637556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f84e94a-ae85-4aea-8a5c-0042de051d5e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:48.639244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f84e94a-ae85-4aea-8a5c-0042de051d5e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:48.640397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f84e94a-ae85-4aea-8a5c-0042de051d5e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:48.641285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f84e94a-ae85-4aea-8a5c-0042de051d5e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:48.819946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:26:48.820506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:26:48.820815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:26:48.821298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:26:48.821981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:26:48.832683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:48.833195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:48.833826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:48.834712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:48.835329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:48.835910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:48.859743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:26:48.867154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:26:48.885761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:26:48.888507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:26:48.999002 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ae25a005-265d-4908-be7e-b8ea634b742c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.046203 Aug 29 15:26:49.000041 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 244/506] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:26:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:26:49.018708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b432b6c6-229d-46f4-95eb-ecf2b42db390 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:49.019600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b432b6c6-229d-46f4-95eb-ecf2b42db390 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:49.034155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b432b6c6-229d-46f4-95eb-ecf2b42db390 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:49.050699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b432b6c6-229d-46f4-95eb-ecf2b42db390 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:49.053915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b432b6c6-229d-46f4-95eb-ecf2b42db390 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:49.054839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b432b6c6-229d-46f4-95eb-ecf2b42db390 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:49.055993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b432b6c6-229d-46f4-95eb-ecf2b42db390 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:49.056575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b432b6c6-229d-46f4-95eb-ecf2b42db390 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:49.121470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7f84e94a-ae85-4aea-8a5c-0042de051d5e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:49.132413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7f84e94a-ae85-4aea-8a5c-0042de051d5e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:49.133904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7f84e94a-ae85-4aea-8a5c-0042de051d5e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:49.142201 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7f84e94a-ae85-4aea-8a5c-0042de051d5e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1568 microversion: 2.25 time: 0.517624 Aug 29 15:26:49.142882 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 263/507] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:48 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1568 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:49.164013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c1f04b87-3467-43ee-924e-c1ed997ecaca tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:49.169976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c1f04b87-3467-43ee-924e-c1ed997ecaca tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:49.370465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c1f04b87-3467-43ee-924e-c1ed997ecaca tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:49.384055 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c1f04b87-3467-43ee-924e-c1ed997ecaca tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1216 microversion: 2.1 time: 0.238488 Aug 29 15:26:49.398306 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 264/508] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:49 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1216 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:49.415813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fe7ad4b7-d79c-44af-9c39-56f5cc45bdfe tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:49.418694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fe7ad4b7-d79c-44af-9c39-56f5cc45bdfe tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:49.439548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe7ad4b7-d79c-44af-9c39-56f5cc45bdfe tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:49.441273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe7ad4b7-d79c-44af-9c39-56f5cc45bdfe tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:49.443368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe7ad4b7-d79c-44af-9c39-56f5cc45bdfe tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:49.445356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe7ad4b7-d79c-44af-9c39-56f5cc45bdfe tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:49.447835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe7ad4b7-d79c-44af-9c39-56f5cc45bdfe tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:49.449203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe7ad4b7-d79c-44af-9c39-56f5cc45bdfe tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:49.808669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b432b6c6-229d-46f4-95eb-ecf2b42db390 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:49.822796 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b432b6c6-229d-46f4-95eb-ecf2b42db390 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1271 microversion: 2.1 time: 0.821160 Aug 29 15:26:49.824183 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 245/509] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:49 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1271 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:49.836983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e1ccb219-0e01-4ae4-9a7b-4995a669eba6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:49.837745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e1ccb219-0e01-4ae4-9a7b-4995a669eba6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:49.850643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fe7ad4b7-d79c-44af-9c39-56f5cc45bdfe tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:49.854939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1ccb219-0e01-4ae4-9a7b-4995a669eba6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:49.855899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1ccb219-0e01-4ae4-9a7b-4995a669eba6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:49.857157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1ccb219-0e01-4ae4-9a7b-4995a669eba6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:49.858921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1ccb219-0e01-4ae4-9a7b-4995a669eba6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:49.860982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1ccb219-0e01-4ae4-9a7b-4995a669eba6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:49.862115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1ccb219-0e01-4ae4-9a7b-4995a669eba6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:49.862239 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fe7ad4b7-d79c-44af-9c39-56f5cc45bdfe tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 200 len: 1390 microversion: 2.1 time: 0.461748 Aug 29 15:26:49.865991 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 265/510] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:49 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 1390 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:49.883285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-341bf08b-c0e0-4dd4-9afb-df1d4c252645 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:49.884358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-341bf08b-c0e0-4dd4-9afb-df1d4c252645 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:49.891593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-341bf08b-c0e0-4dd4-9afb-df1d4c252645 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:49.898112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-341bf08b-c0e0-4dd4-9afb-df1d4c252645 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:49.898876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-341bf08b-c0e0-4dd4-9afb-df1d4c252645 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:49.899926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-341bf08b-c0e0-4dd4-9afb-df1d4c252645 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:49.900602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-341bf08b-c0e0-4dd4-9afb-df1d4c252645 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:49.901278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-341bf08b-c0e0-4dd4-9afb-df1d4c252645 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:50.246742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-341bf08b-c0e0-4dd4-9afb-df1d4c252645 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:50.256120 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-341bf08b-c0e0-4dd4-9afb-df1d4c252645 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1505 microversion: 2.1 time: 0.388754 Aug 29 15:26:50.263441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e1ccb219-0e01-4ae4-9a7b-4995a669eba6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:50.269450 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 266/511] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:49 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:50.275300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d05ac005-10a8-4964-af9e-a7644df38aeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:50.276161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d05ac005-10a8-4964-af9e-a7644df38aeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:50.280027 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e1ccb219-0e01-4ae4-9a7b-4995a669eba6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1321 microversion: 2.1 time: 0.454079 Aug 29 15:26:50.295033 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 246/512] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:49 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1321 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:50.295168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05ac005-10a8-4964-af9e-a7644df38aeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:50.295686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05ac005-10a8-4964-af9e-a7644df38aeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:50.296124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05ac005-10a8-4964-af9e-a7644df38aeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:50.303770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05ac005-10a8-4964-af9e-a7644df38aeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:50.304254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05ac005-10a8-4964-af9e-a7644df38aeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:50.304691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05ac005-10a8-4964-af9e-a7644df38aeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:50.309708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e12c653d-8d22-412b-b177-da0c8a730829 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:50.311273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e12c653d-8d22-412b-b177-da0c8a730829 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:50.328471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e12c653d-8d22-412b-b177-da0c8a730829 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:50.329679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e12c653d-8d22-412b-b177-da0c8a730829 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:50.330627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e12c653d-8d22-412b-b177-da0c8a730829 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:50.331585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e12c653d-8d22-412b-b177-da0c8a730829 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:50.332342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e12c653d-8d22-412b-b177-da0c8a730829 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:50.332979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e12c653d-8d22-412b-b177-da0c8a730829 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:50.376303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:50.389387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e12c653d-8d22-412b-b177-da0c8a730829 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:26:50.604127 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e12c653d-8d22-412b-b177-da0c8a730829 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 204 len: 0 microversion: 2.1 time: 0.304693 Aug 29 15:26:50.605289 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 247/513] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:26:50 2022] DELETE /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:26:50.613311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ca18e1ee-ba29-44b4-af4d-635bf74d1e42 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:50.614524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ca18e1ee-ba29-44b4-af4d-635bf74d1e42 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:50.638089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d05ac005-10a8-4964-af9e-a7644df38aeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:50.640686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca18e1ee-ba29-44b4-af4d-635bf74d1e42 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:50.644293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca18e1ee-ba29-44b4-af4d-635bf74d1e42 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:50.645174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca18e1ee-ba29-44b4-af4d-635bf74d1e42 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:50.646334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca18e1ee-ba29-44b4-af4d-635bf74d1e42 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:50.647335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca18e1ee-ba29-44b4-af4d-635bf74d1e42 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:50.648011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca18e1ee-ba29-44b4-af4d-635bf74d1e42 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:50.649404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d05ac005-10a8-4964-af9e-a7644df38aeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:50.653360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d05ac005-10a8-4964-af9e-a7644df38aeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:50.659116 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d05ac005-10a8-4964-af9e-a7644df38aeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1568 microversion: 2.25 time: 0.386695 Aug 29 15:26:50.660450 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 267/514] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:50 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1568 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:50.668003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ec34257f-0529-4f90-a64b-f97ca6f8c1dc tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:50.673781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ec34257f-0529-4f90-a64b-f97ca6f8c1dc tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:50.692539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec34257f-0529-4f90-a64b-f97ca6f8c1dc tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:50.697205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec34257f-0529-4f90-a64b-f97ca6f8c1dc tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:50.697903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec34257f-0529-4f90-a64b-f97ca6f8c1dc tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:50.698666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec34257f-0529-4f90-a64b-f97ca6f8c1dc tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:50.699122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec34257f-0529-4f90-a64b-f97ca6f8c1dc tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:50.699675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec34257f-0529-4f90-a64b-f97ca6f8c1dc tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:50.802069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ca18e1ee-ba29-44b4-af4d-635bf74d1e42 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:50.818177 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ca18e1ee-ba29-44b4-af4d-635bf74d1e42 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1268 microversion: 2.1 time: 0.211103 Aug 29 15:26:50.835441 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 248/515] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:50 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1268 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:50.846614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-78008067-655e-468e-90da-7cd93500c048 req-fe6c6240-c0d1-4ce9-a979-c89f4cac8177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5026556-58ce-42c9-9606-f75fbb77c2bf", "tag": "9b1727cd-673b-4493-96b0-efd887ebebc8"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:50.863443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-78008067-655e-468e-90da-7cd93500c048 req-fe6c6240-c0d1-4ce9-a979-c89f4cac8177 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:50.864359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-78008067-655e-468e-90da-7cd93500c048 req-fe6c6240-c0d1-4ce9-a979-c89f4cac8177 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:50.865156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-78008067-655e-468e-90da-7cd93500c048 req-fe6c6240-c0d1-4ce9-a979-c89f4cac8177 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:50.900252 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-78008067-655e-468e-90da-7cd93500c048 req-fe6c6240-c0d1-4ce9-a979-c89f4cac8177 service nova] Creating event network-changed:9b1727cd-673b-4493-96b0-efd887ebebc8 for instance b5026556-58ce-42c9-9606-f75fbb77c2bf on n-h2-839401-11 Aug 29 15:26:50.909623 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-78008067-655e-468e-90da-7cd93500c048 req-fe6c6240-c0d1-4ce9-a979-c89f4cac8177 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069605 Aug 29 15:26:50.911224 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 249/516] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:50.918686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ea3a7074-2a36-4009-98c3-b756a811a743 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:50.920096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ea3a7074-2a36-4009-98c3-b756a811a743 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:50.944203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea3a7074-2a36-4009-98c3-b756a811a743 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:50.945214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea3a7074-2a36-4009-98c3-b756a811a743 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:50.945949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea3a7074-2a36-4009-98c3-b756a811a743 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:50.947156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea3a7074-2a36-4009-98c3-b756a811a743 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:50.960983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea3a7074-2a36-4009-98c3-b756a811a743 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:50.962908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea3a7074-2a36-4009-98c3-b756a811a743 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.030274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ec34257f-0529-4f90-a64b-f97ca6f8c1dc tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:51.046497 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ec34257f-0529-4f90-a64b-f97ca6f8c1dc tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1511 microversion: 2.1 time: 0.382003 Aug 29 15:26:51.047974 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 268/517] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:50 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1511 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:51.054951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3a793fdb-d74e-42a7-b0e2-eaa5034354c8 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:51.056316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3a793fdb-d74e-42a7-b0e2-eaa5034354c8 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:51.065377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a793fdb-d74e-42a7-b0e2-eaa5034354c8 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.067621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a793fdb-d74e-42a7-b0e2-eaa5034354c8 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.068341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a793fdb-d74e-42a7-b0e2-eaa5034354c8 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.069991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a793fdb-d74e-42a7-b0e2-eaa5034354c8 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.070741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a793fdb-d74e-42a7-b0e2-eaa5034354c8 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.071450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a793fdb-d74e-42a7-b0e2-eaa5034354c8 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.213522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ea3a7074-2a36-4009-98c3-b756a811a743 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:51.222433 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ea3a7074-2a36-4009-98c3-b756a811a743 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1277 microversion: 2.1 time: 0.309306 Aug 29 15:26:51.222950 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 250/518] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:50 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1277 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:51.306916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-873cf56e-01ae-492a-8c58-52bb8fc8e61d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:51.307548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-873cf56e-01ae-492a-8c58-52bb8fc8e61d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:51.324878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-873cf56e-01ae-492a-8c58-52bb8fc8e61d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.325654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-873cf56e-01ae-492a-8c58-52bb8fc8e61d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.325802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-873cf56e-01ae-492a-8c58-52bb8fc8e61d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.326509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-873cf56e-01ae-492a-8c58-52bb8fc8e61d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.326961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-873cf56e-01ae-492a-8c58-52bb8fc8e61d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.327499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-873cf56e-01ae-492a-8c58-52bb8fc8e61d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.665925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-873cf56e-01ae-492a-8c58-52bb8fc8e61d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:51.673737 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-873cf56e-01ae-492a-8c58-52bb8fc8e61d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1321 microversion: 2.1 time: 0.371328 Aug 29 15:26:51.685758 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 251/519] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:51 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:51.694631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7276e963-a8dd-4af2-b330-0f8be5cf83b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:51.695270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7276e963-a8dd-4af2-b330-0f8be5cf83b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:51.698251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:51.703445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7276e963-a8dd-4af2-b330-0f8be5cf83b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.703935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7276e963-a8dd-4af2-b330-0f8be5cf83b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.704434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7276e963-a8dd-4af2-b330-0f8be5cf83b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.705167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7276e963-a8dd-4af2-b330-0f8be5cf83b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:51.706307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7276e963-a8dd-4af2-b330-0f8be5cf83b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:51.706307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7276e963-a8dd-4af2-b330-0f8be5cf83b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:51.980179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3a793fdb-d74e-42a7-b0e2-eaa5034354c8 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:52.002847 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3a793fdb-d74e-42a7-b0e2-eaa5034354c8 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 200 len: 1390 microversion: 2.1 time: 0.953263 Aug 29 15:26:52.005286 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 269/520] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:51 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 1390 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:52.014268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-32ec11b7-113a-4896-9677-324cb2024da7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:52.015318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-32ec11b7-113a-4896-9677-324cb2024da7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:52.026197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32ec11b7-113a-4896-9677-324cb2024da7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:52.026980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32ec11b7-113a-4896-9677-324cb2024da7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:52.027628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32ec11b7-113a-4896-9677-324cb2024da7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:52.028527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32ec11b7-113a-4896-9677-324cb2024da7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:52.029526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32ec11b7-113a-4896-9677-324cb2024da7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:52.030660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32ec11b7-113a-4896-9677-324cb2024da7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:52.102811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7276e963-a8dd-4af2-b330-0f8be5cf83b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:52.121499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7276e963-a8dd-4af2-b330-0f8be5cf83b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:52.123537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7276e963-a8dd-4af2-b330-0f8be5cf83b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:52.124863 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7276e963-a8dd-4af2-b330-0f8be5cf83b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1568 microversion: 2.25 time: 0.438019 Aug 29 15:26:52.125693 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 252/521] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:51 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1568 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:52.130576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f2ad43f2-2a05-4690-9920-9485df36e6d9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:52.139162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f2ad43f2-2a05-4690-9920-9485df36e6d9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:52.152339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2ad43f2-2a05-4690-9920-9485df36e6d9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:52.153000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2ad43f2-2a05-4690-9920-9485df36e6d9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:52.158138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2ad43f2-2a05-4690-9920-9485df36e6d9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:52.159148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2ad43f2-2a05-4690-9920-9485df36e6d9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:52.159869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2ad43f2-2a05-4690-9920-9485df36e6d9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:52.161332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2ad43f2-2a05-4690-9920-9485df36e6d9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:52.212727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-32ec11b7-113a-4896-9677-324cb2024da7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:52.225291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:52.231018 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-32ec11b7-113a-4896-9677-324cb2024da7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1274 microversion: 2.1 time: 0.222875 Aug 29 15:26:52.231631 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 270/522] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:52 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1274 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:52.252227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bc40321c-3d60-4aad-aad1-2ea2bf1ea5fa tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:52.253067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bc40321c-3d60-4aad-aad1-2ea2bf1ea5fa tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:52.259384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc40321c-3d60-4aad-aad1-2ea2bf1ea5fa tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:52.260395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc40321c-3d60-4aad-aad1-2ea2bf1ea5fa tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:52.261002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc40321c-3d60-4aad-aad1-2ea2bf1ea5fa tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:52.261907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc40321c-3d60-4aad-aad1-2ea2bf1ea5fa tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:52.262553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc40321c-3d60-4aad-aad1-2ea2bf1ea5fa tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:52.263165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc40321c-3d60-4aad-aad1-2ea2bf1ea5fa tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:52.832093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bc40321c-3d60-4aad-aad1-2ea2bf1ea5fa tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:52.843488 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bc40321c-3d60-4aad-aad1-2ea2bf1ea5fa tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1319 microversion: 2.1 time: 0.600140 Aug 29 15:26:52.857287 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 271/523] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:52 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1319 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:52.863744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a9cf5327-b359-4f55-94b5-790d6502b8a4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:52.869619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a9cf5327-b359-4f55-94b5-790d6502b8a4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:52.870489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f2ad43f2-2a05-4690-9920-9485df36e6d9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:52.878525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cf5327-b359-4f55-94b5-790d6502b8a4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:52.879099 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f2ad43f2-2a05-4690-9920-9485df36e6d9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1511 microversion: 2.1 time: 0.752155 Aug 29 15:26:52.879409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cf5327-b359-4f55-94b5-790d6502b8a4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:52.880184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cf5327-b359-4f55-94b5-790d6502b8a4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:52.881049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cf5327-b359-4f55-94b5-790d6502b8a4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:52.881656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cf5327-b359-4f55-94b5-790d6502b8a4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:52.882213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9cf5327-b359-4f55-94b5-790d6502b8a4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:52.883655 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 253/524] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:52 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1511 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:53.026855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4289d7fd-deac-4d16-ba40-c26be7aa89b0 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:53.027329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4289d7fd-deac-4d16-ba40-c26be7aa89b0 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:53.035805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4289d7fd-deac-4d16-ba40-c26be7aa89b0 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:53.036933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4289d7fd-deac-4d16-ba40-c26be7aa89b0 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:53.037844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4289d7fd-deac-4d16-ba40-c26be7aa89b0 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:53.043354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4289d7fd-deac-4d16-ba40-c26be7aa89b0 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:53.047715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4289d7fd-deac-4d16-ba40-c26be7aa89b0 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:53.048392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4289d7fd-deac-4d16-ba40-c26be7aa89b0 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:53.533024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a9cf5327-b359-4f55-94b5-790d6502b8a4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:53.546752 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a9cf5327-b359-4f55-94b5-790d6502b8a4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1321 microversion: 2.1 time: 0.687917 Aug 29 15:26:53.549748 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 272/525] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:52 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1321 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:53.555773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9184d6ac-7469-4b8b-b315-370019e86bea tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:53.556644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9184d6ac-7469-4b8b-b315-370019e86bea tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:53.565112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9184d6ac-7469-4b8b-b315-370019e86bea tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:53.567152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9184d6ac-7469-4b8b-b315-370019e86bea tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:53.567802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9184d6ac-7469-4b8b-b315-370019e86bea tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:53.572181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9184d6ac-7469-4b8b-b315-370019e86bea tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:53.575678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9184d6ac-7469-4b8b-b315-370019e86bea tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:53.576990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9184d6ac-7469-4b8b-b315-370019e86bea tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:53.696041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4289d7fd-deac-4d16-ba40-c26be7aa89b0 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:53.713645 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4289d7fd-deac-4d16-ba40-c26be7aa89b0 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 200 len: 1390 microversion: 2.1 time: 0.683345 Aug 29 15:26:53.714702 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 254/526] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:53 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 1390 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:53.719543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-2cfe89c6-e41c-4ba6-b698-b19266ee6453 req-56dc1ef0-9b11-463b-8286-5f8f9b7cf0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f44b5e-bcae-4e95-a11a-c781e6cf06df", "name": "network-vif-plugged", "status": "completed", "tag": "3f638867-a674-40ea-b7b1-b095f9393504"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:53.739162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2cfe89c6-e41c-4ba6-b698-b19266ee6453 req-56dc1ef0-9b11-463b-8286-5f8f9b7cf0d4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:53.739656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2cfe89c6-e41c-4ba6-b698-b19266ee6453 req-56dc1ef0-9b11-463b-8286-5f8f9b7cf0d4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:53.740089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2cfe89c6-e41c-4ba6-b698-b19266ee6453 req-56dc1ef0-9b11-463b-8286-5f8f9b7cf0d4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:53.769928 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-2cfe89c6-e41c-4ba6-b698-b19266ee6453 req-56dc1ef0-9b11-463b-8286-5f8f9b7cf0d4 service nova] Creating event network-vif-plugged:3f638867-a674-40ea-b7b1-b095f9393504 for instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df on n-h2-839401-11 Aug 29 15:26:53.779356 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-2cfe89c6-e41c-4ba6-b698-b19266ee6453 req-56dc1ef0-9b11-463b-8286-5f8f9b7cf0d4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062968 Aug 29 15:26:53.780038 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 255/527] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:53.797247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1beb336d-c58f-42b0-8e68-c362a40fb8ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:53.798546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1beb336d-c58f-42b0-8e68-c362a40fb8ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:53.806287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1beb336d-c58f-42b0-8e68-c362a40fb8ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:53.807061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1beb336d-c58f-42b0-8e68-c362a40fb8ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:53.813260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1beb336d-c58f-42b0-8e68-c362a40fb8ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:53.814728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1beb336d-c58f-42b0-8e68-c362a40fb8ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:53.815410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1beb336d-c58f-42b0-8e68-c362a40fb8ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:53.816002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1beb336d-c58f-42b0-8e68-c362a40fb8ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:54.538312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9184d6ac-7469-4b8b-b315-370019e86bea tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:54.551822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9184d6ac-7469-4b8b-b315-370019e86bea tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:54.554835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9184d6ac-7469-4b8b-b315-370019e86bea tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:54.557307 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9184d6ac-7469-4b8b-b315-370019e86bea tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1568 microversion: 2.25 time: 1.006290 Aug 29 15:26:54.558586 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 273/528] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:53 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1568 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:54.578708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-67f245a7-c050-4d64-a5a3-ba69453eec28 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:54.579441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-67f245a7-c050-4d64-a5a3-ba69453eec28 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:54.594609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67f245a7-c050-4d64-a5a3-ba69453eec28 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:54.595258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67f245a7-c050-4d64-a5a3-ba69453eec28 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:54.595701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67f245a7-c050-4d64-a5a3-ba69453eec28 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:54.596424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67f245a7-c050-4d64-a5a3-ba69453eec28 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:54.596882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67f245a7-c050-4d64-a5a3-ba69453eec28 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:54.597348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67f245a7-c050-4d64-a5a3-ba69453eec28 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:54.908880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1beb336d-c58f-42b0-8e68-c362a40fb8ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:54.916706 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1beb336d-c58f-42b0-8e68-c362a40fb8ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1316 microversion: 2.1 time: 1.135546 Aug 29 15:26:54.922331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-67f245a7-c050-4d64-a5a3-ba69453eec28 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:54.936255 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-67f245a7-c050-4d64-a5a3-ba69453eec28 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1319 microversion: 2.1 time: 0.375381 Aug 29 15:26:54.950208 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 274/529] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:54 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:54.956131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e40f29aa-38e3-4c06-91be-ff68219e8f16 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:54.957764 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 256/530] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:53 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1316 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:54.970946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e40f29aa-38e3-4c06-91be-ff68219e8f16 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:54.989548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e40f29aa-38e3-4c06-91be-ff68219e8f16 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:54.996660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e40f29aa-38e3-4c06-91be-ff68219e8f16 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:54.997444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e40f29aa-38e3-4c06-91be-ff68219e8f16 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:55.003968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e40f29aa-38e3-4c06-91be-ff68219e8f16 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:55.011409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e40f29aa-38e3-4c06-91be-ff68219e8f16 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:55.011962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e40f29aa-38e3-4c06-91be-ff68219e8f16 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:55.118874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-b2d22627-605b-4345-8898-3522f90d546d req-ba88a42a-4ddd-4cb0-8b95-9368caf406fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89c49de-27db-4e19-a013-217c6075debb", "name": "network-vif-unplugged", "status": "completed", "tag": "0b3487a8-bae5-4c07-9952-d6c8810ee302"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:55.130654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b2d22627-605b-4345-8898-3522f90d546d req-ba88a42a-4ddd-4cb0-8b95-9368caf406fb service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:55.131377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b2d22627-605b-4345-8898-3522f90d546d req-ba88a42a-4ddd-4cb0-8b95-9368caf406fb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:55.131969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b2d22627-605b-4345-8898-3522f90d546d req-ba88a42a-4ddd-4cb0-8b95-9368caf406fb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:55.144771 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-b2d22627-605b-4345-8898-3522f90d546d req-ba88a42a-4ddd-4cb0-8b95-9368caf406fb service nova] Creating event network-vif-unplugged:0b3487a8-bae5-4c07-9952-d6c8810ee302 for instance a89c49de-27db-4e19-a013-217c6075debb on n-h2-839401-11 Aug 29 15:26:55.154153 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-b2d22627-605b-4345-8898-3522f90d546d req-ba88a42a-4ddd-4cb0-8b95-9368caf406fb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.193879 Aug 29 15:26:55.154788 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 257/531] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:55.161921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-96f01164-95a9-4fdd-be2b-94a8e42ca873 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:55.162920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-96f01164-95a9-4fdd-be2b-94a8e42ca873 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:55.169789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96f01164-95a9-4fdd-be2b-94a8e42ca873 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:55.170825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96f01164-95a9-4fdd-be2b-94a8e42ca873 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:55.171612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96f01164-95a9-4fdd-be2b-94a8e42ca873 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:55.172795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96f01164-95a9-4fdd-be2b-94a8e42ca873 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:55.176007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96f01164-95a9-4fdd-be2b-94a8e42ca873 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:55.176450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96f01164-95a9-4fdd-be2b-94a8e42ca873 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:55.619890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e40f29aa-38e3-4c06-91be-ff68219e8f16 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:55.633135 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e40f29aa-38e3-4c06-91be-ff68219e8f16 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1511 microversion: 2.1 time: 0.681340 Aug 29 15:26:55.633921 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 275/532] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:54 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1511 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:55.639243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5548e961-8177-40a7-8704-dfe1076666ad tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:55.640081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5548e961-8177-40a7-8704-dfe1076666ad tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:55.652528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5548e961-8177-40a7-8704-dfe1076666ad tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:55.652978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5548e961-8177-40a7-8704-dfe1076666ad tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:55.657577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5548e961-8177-40a7-8704-dfe1076666ad tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:55.658337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5548e961-8177-40a7-8704-dfe1076666ad tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:55.658807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5548e961-8177-40a7-8704-dfe1076666ad tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:55.661205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5548e961-8177-40a7-8704-dfe1076666ad tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:55.941842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5548e961-8177-40a7-8704-dfe1076666ad tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:55.955854 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5548e961-8177-40a7-8704-dfe1076666ad tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 200 len: 1390 microversion: 2.1 time: 0.318420 Aug 29 15:26:55.957183 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 276/533] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:55 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 1390 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:55.965674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-700af821-069c-45b7-9a2f-367b850b8fa9 req-613f2d32-932b-4075-b76a-ed642081c21c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b83a8f-d9af-4e23-a78a-2eb71813082a", "tag": "6dfad95f-5f07-4626-ac31-5a820ebd231e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:55.989912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-700af821-069c-45b7-9a2f-367b850b8fa9 req-613f2d32-932b-4075-b76a-ed642081c21c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:55.990707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-700af821-069c-45b7-9a2f-367b850b8fa9 req-613f2d32-932b-4075-b76a-ed642081c21c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:55.991233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-700af821-069c-45b7-9a2f-367b850b8fa9 req-613f2d32-932b-4075-b76a-ed642081c21c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:55.995654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:56.021302 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-700af821-069c-45b7-9a2f-367b850b8fa9 req-613f2d32-932b-4075-b76a-ed642081c21c service nova] Creating event network-changed:6dfad95f-5f07-4626-ac31-5a820ebd231e for instance c2b83a8f-d9af-4e23-a78a-2eb71813082a on n-h1-839401-11 Aug 29 15:26:56.033526 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-700af821-069c-45b7-9a2f-367b850b8fa9 req-613f2d32-932b-4075-b76a-ed642081c21c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072234 Aug 29 15:26:56.034386 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 277/534] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:56.039966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fa93db89-9a9d-44fd-976a-7c4eba94fe8a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:56.040899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fa93db89-9a9d-44fd-976a-7c4eba94fe8a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:56.050571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa93db89-9a9d-44fd-976a-7c4eba94fe8a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:56.051416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa93db89-9a9d-44fd-976a-7c4eba94fe8a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:56.052019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa93db89-9a9d-44fd-976a-7c4eba94fe8a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:56.053052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa93db89-9a9d-44fd-976a-7c4eba94fe8a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:56.053790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa93db89-9a9d-44fd-976a-7c4eba94fe8a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:56.054367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa93db89-9a9d-44fd-976a-7c4eba94fe8a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:56.157132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-96f01164-95a9-4fdd-be2b-94a8e42ca873 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:56.177633 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-96f01164-95a9-4fdd-be2b-94a8e42ca873 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1321 microversion: 2.1 time: 1.013028 Aug 29 15:26:56.179024 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 258/535] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:55 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1321 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:56.185456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-182a2b1c-8a4a-4d79-94e6-508ff3e30e26 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:56.188156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-182a2b1c-8a4a-4d79-94e6-508ff3e30e26 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:56.196370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-182a2b1c-8a4a-4d79-94e6-508ff3e30e26 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:56.197423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-182a2b1c-8a4a-4d79-94e6-508ff3e30e26 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:56.198866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-182a2b1c-8a4a-4d79-94e6-508ff3e30e26 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:56.199945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-182a2b1c-8a4a-4d79-94e6-508ff3e30e26 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:56.200598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-182a2b1c-8a4a-4d79-94e6-508ff3e30e26 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:56.201253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-182a2b1c-8a4a-4d79-94e6-508ff3e30e26 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:56.405285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fa93db89-9a9d-44fd-976a-7c4eba94fe8a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:56.422027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fa93db89-9a9d-44fd-976a-7c4eba94fe8a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:56.424727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fa93db89-9a9d-44fd-976a-7c4eba94fe8a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:56.428631 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fa93db89-9a9d-44fd-976a-7c4eba94fe8a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1568 microversion: 2.25 time: 0.392880 Aug 29 15:26:56.430219 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 278/536] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:56 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1568 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:56.438849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-818b247a-8bc9-407c-9017-0275eb7933f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:56.442867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-818b247a-8bc9-407c-9017-0275eb7933f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:56.450186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-818b247a-8bc9-407c-9017-0275eb7933f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:56.450662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-818b247a-8bc9-407c-9017-0275eb7933f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:56.451279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-818b247a-8bc9-407c-9017-0275eb7933f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:56.452211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-818b247a-8bc9-407c-9017-0275eb7933f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:56.452800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-818b247a-8bc9-407c-9017-0275eb7933f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:56.453457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-818b247a-8bc9-407c-9017-0275eb7933f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:56.527391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-182a2b1c-8a4a-4d79-94e6-508ff3e30e26 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:56.539207 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-182a2b1c-8a4a-4d79-94e6-508ff3e30e26 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1316 microversion: 2.1 time: 0.358587 Aug 29 15:26:56.553115 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 259/537] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:56 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:56.653308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c2b11894-4bca-4149-8747-57b78dbbad72 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:56.654552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c2b11894-4bca-4149-8747-57b78dbbad72 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:56.662045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b11894-4bca-4149-8747-57b78dbbad72 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:56.662702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b11894-4bca-4149-8747-57b78dbbad72 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:56.663281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b11894-4bca-4149-8747-57b78dbbad72 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:56.664304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b11894-4bca-4149-8747-57b78dbbad72 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:56.664934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b11894-4bca-4149-8747-57b78dbbad72 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:56.665669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b11894-4bca-4149-8747-57b78dbbad72 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:56.717028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-818b247a-8bc9-407c-9017-0275eb7933f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:56.731314 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-818b247a-8bc9-407c-9017-0275eb7933f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1319 microversion: 2.1 time: 0.298415 Aug 29 15:26:56.732066 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 279/538] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:56 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:56.746259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b11894-4bca-4149-8747-57b78dbbad72 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:56.746259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b11894-4bca-4149-8747-57b78dbbad72 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:56.746259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b11894-4bca-4149-8747-57b78dbbad72 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:56.746259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-c2b11894-4bca-4149-8747-57b78dbbad72 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lazy-loading 'fault' on Instance uuid 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:26:56.839372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c2b11894-4bca-4149-8747-57b78dbbad72 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:56.851276 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c2b11894-4bca-4149-8747-57b78dbbad72 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1306 microversion: 2.1 time: 0.201565 Aug 29 15:26:56.866705 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 260/539] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:56 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1306 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:26:56.979521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-73151665-9a08-44db-ad47-ae79c64529d6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:56.980911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-73151665-9a08-44db-ad47-ae79c64529d6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:56.989005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73151665-9a08-44db-ad47-ae79c64529d6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:56.990271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73151665-9a08-44db-ad47-ae79c64529d6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:56.990756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73151665-9a08-44db-ad47-ae79c64529d6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:56.991488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73151665-9a08-44db-ad47-ae79c64529d6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:56.991972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73151665-9a08-44db-ad47-ae79c64529d6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:56.992403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73151665-9a08-44db-ad47-ae79c64529d6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:57.206078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6326b2df-bb96-47e5-9b5d-42c4c83807f5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:57.206078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6326b2df-bb96-47e5-9b5d-42c4c83807f5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:57.214736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6326b2df-bb96-47e5-9b5d-42c4c83807f5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:57.219471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6326b2df-bb96-47e5-9b5d-42c4c83807f5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:57.220118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6326b2df-bb96-47e5-9b5d-42c4c83807f5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:57.221376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6326b2df-bb96-47e5-9b5d-42c4c83807f5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:57.221838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6326b2df-bb96-47e5-9b5d-42c4c83807f5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:57.223954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6326b2df-bb96-47e5-9b5d-42c4c83807f5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:57.244384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-73151665-9a08-44db-ad47-ae79c64529d6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:57.252740 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-73151665-9a08-44db-ad47-ae79c64529d6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 200 len: 1390 microversion: 2.1 time: 0.278209 Aug 29 15:26:57.257903 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 280/540] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:56 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 1390 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:57.284241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-5176a3bb-8011-42af-81a1-a14342f71beb req-8b1029d7-651f-4e05-afd5-81d26a83ed8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e8b4865-90f7-40ae-a4d6-cedb0af05d3c", "name": "network-vif-deleted", "tag": "10a29cc3-7d6e-438d-8ea2-0470cd224974"}, {"name": "network-changed", "server_uuid": "a89c49de-27db-4e19-a013-217c6075debb", "tag": "0b3487a8-bae5-4c07-9952-d6c8810ee302"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:57.295961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5176a3bb-8011-42af-81a1-a14342f71beb req-8b1029d7-651f-4e05-afd5-81d26a83ed8c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:57.296610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5176a3bb-8011-42af-81a1-a14342f71beb req-8b1029d7-651f-4e05-afd5-81d26a83ed8c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:57.297042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5176a3bb-8011-42af-81a1-a14342f71beb req-8b1029d7-651f-4e05-afd5-81d26a83ed8c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:57.313827 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5176a3bb-8011-42af-81a1-a14342f71beb req-8b1029d7-651f-4e05-afd5-81d26a83ed8c service nova] Creating event network-vif-deleted:10a29cc3-7d6e-438d-8ea2-0470cd224974 for instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c on n-h1-839401-11 Aug 29 15:26:57.314344 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5176a3bb-8011-42af-81a1-a14342f71beb req-8b1029d7-651f-4e05-afd5-81d26a83ed8c service nova] Creating event network-changed:0b3487a8-bae5-4c07-9952-d6c8810ee302 for instance a89c49de-27db-4e19-a013-217c6075debb on n-h2-839401-11 Aug 29 15:26:57.331520 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-5176a3bb-8011-42af-81a1-a14342f71beb req-8b1029d7-651f-4e05-afd5-81d26a83ed8c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.057658 Aug 29 15:26:57.332139 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 281/541] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:26:57.457413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3a79ff6d-f9d4-45ca-8403-f181d8e7dbae tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:57.458407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3a79ff6d-f9d4-45ca-8403-f181d8e7dbae tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:57.467755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a79ff6d-f9d4-45ca-8403-f181d8e7dbae tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:57.468598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a79ff6d-f9d4-45ca-8403-f181d8e7dbae tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:57.469465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a79ff6d-f9d4-45ca-8403-f181d8e7dbae tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:57.470627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a79ff6d-f9d4-45ca-8403-f181d8e7dbae tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:57.471340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a79ff6d-f9d4-45ca-8403-f181d8e7dbae tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:57.472297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a79ff6d-f9d4-45ca-8403-f181d8e7dbae tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:57.738473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3a79ff6d-f9d4-45ca-8403-f181d8e7dbae tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:57.751567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3a79ff6d-f9d4-45ca-8403-f181d8e7dbae tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:57.752276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3a79ff6d-f9d4-45ca-8403-f181d8e7dbae tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:57.753560 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3a79ff6d-f9d4-45ca-8403-f181d8e7dbae tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1568 microversion: 2.25 time: 0.302775 Aug 29 15:26:57.768221 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 282/542] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:57 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1568 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:26:57.768221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-238b8236-2e0b-49f8-b515-a907fdc3f40f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:57.768221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-238b8236-2e0b-49f8-b515-a907fdc3f40f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:57.769579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-238b8236-2e0b-49f8-b515-a907fdc3f40f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:57.770398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-238b8236-2e0b-49f8-b515-a907fdc3f40f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:57.773694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-238b8236-2e0b-49f8-b515-a907fdc3f40f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:57.775731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-238b8236-2e0b-49f8-b515-a907fdc3f40f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:57.776819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-238b8236-2e0b-49f8-b515-a907fdc3f40f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:57.776819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-238b8236-2e0b-49f8-b515-a907fdc3f40f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:57.892116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6326b2df-bb96-47e5-9b5d-42c4c83807f5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:57.922134 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6326b2df-bb96-47e5-9b5d-42c4c83807f5 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1321 microversion: 2.1 time: 0.720079 Aug 29 15:26:57.937399 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 261/543] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:57 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1321 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:57.950264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a953e7c9-b83f-4876-a11c-6eb3c376d53c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:57.951695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a953e7c9-b83f-4876-a11c-6eb3c376d53c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:57.974539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a953e7c9-b83f-4876-a11c-6eb3c376d53c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:57.975373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a953e7c9-b83f-4876-a11c-6eb3c376d53c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:57.976249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a953e7c9-b83f-4876-a11c-6eb3c376d53c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:57.977298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a953e7c9-b83f-4876-a11c-6eb3c376d53c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:57.977951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a953e7c9-b83f-4876-a11c-6eb3c376d53c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:57.978552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a953e7c9-b83f-4876-a11c-6eb3c376d53c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.016384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-238b8236-2e0b-49f8-b515-a907fdc3f40f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:58.026708 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-238b8236-2e0b-49f8-b515-a907fdc3f40f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1316 microversion: 2.1 time: 0.271394 Aug 29 15:26:58.028449 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 283/544] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:57 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:58.035311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2b898081-8805-4c83-aaf8-702a840f4ce9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:58.036170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2b898081-8805-4c83-aaf8-702a840f4ce9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:58.043663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b898081-8805-4c83-aaf8-702a840f4ce9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:58.044457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b898081-8805-4c83-aaf8-702a840f4ce9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:58.044989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b898081-8805-4c83-aaf8-702a840f4ce9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.045843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b898081-8805-4c83-aaf8-702a840f4ce9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:58.046543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b898081-8805-4c83-aaf8-702a840f4ce9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:58.047350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b898081-8805-4c83-aaf8-702a840f4ce9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.086481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b898081-8805-4c83-aaf8-702a840f4ce9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:58.087075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b898081-8805-4c83-aaf8-702a840f4ce9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:58.087673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b898081-8805-4c83-aaf8-702a840f4ce9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.088188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-2b898081-8805-4c83-aaf8-702a840f4ce9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lazy-loading 'fault' on Instance uuid 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:26:58.169598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2b898081-8805-4c83-aaf8-702a840f4ce9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:58.206920 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2b898081-8805-4c83-aaf8-702a840f4ce9 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1306 microversion: 2.1 time: 0.176888 Aug 29 15:26:58.210527 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 284/545] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:58 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1306 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:58.225158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-197ff842-4b99-47ea-a14a-2ec9441570fd req-8e0af4f8-aaaa-4313-84b4-97eb2b50b4ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e1bd29-189f-45ae-8cfe-ec70a91cf5c1", "tag": "bbeff5e6-3289-4102-a95e-bc912e6e924d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:26:58.263079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-197ff842-4b99-47ea-a14a-2ec9441570fd req-8e0af4f8-aaaa-4313-84b4-97eb2b50b4ea service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:58.270183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-197ff842-4b99-47ea-a14a-2ec9441570fd req-8e0af4f8-aaaa-4313-84b4-97eb2b50b4ea service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:58.270816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-197ff842-4b99-47ea-a14a-2ec9441570fd req-8e0af4f8-aaaa-4313-84b4-97eb2b50b4ea service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.288059 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-197ff842-4b99-47ea-a14a-2ec9441570fd req-8e0af4f8-aaaa-4313-84b4-97eb2b50b4ea service nova] Creating event network-changed:bbeff5e6-3289-4102-a95e-bc912e6e924d for instance 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 on n-h2-839401-11 Aug 29 15:26:58.295090 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-197ff842-4b99-47ea-a14a-2ec9441570fd req-8e0af4f8-aaaa-4313-84b4-97eb2b50b4ea service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082311 Aug 29 15:26:58.296242 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 285/546] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:58.303010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-febec1a4-d9ce-4907-8377-cec8b1042118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:58.304121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-febec1a4-d9ce-4907-8377-cec8b1042118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:58.313116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-febec1a4-d9ce-4907-8377-cec8b1042118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:58.313890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-febec1a4-d9ce-4907-8377-cec8b1042118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:58.314476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-febec1a4-d9ce-4907-8377-cec8b1042118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.315347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-febec1a4-d9ce-4907-8377-cec8b1042118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:58.315963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-febec1a4-d9ce-4907-8377-cec8b1042118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:58.316532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-febec1a4-d9ce-4907-8377-cec8b1042118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.493322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a953e7c9-b83f-4876-a11c-6eb3c376d53c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:58.510664 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a953e7c9-b83f-4876-a11c-6eb3c376d53c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1319 microversion: 2.1 time: 0.565032 Aug 29 15:26:58.511620 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 262/547] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:57 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1319 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:58.626087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-febec1a4-d9ce-4907-8377-cec8b1042118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:58.647957 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-febec1a4-d9ce-4907-8377-cec8b1042118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 200 len: 1589 microversion: 2.1 time: 0.350313 Aug 29 15:26:58.664541 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 286/548] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:58 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 1589 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:58.671540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-42c69779-a698-4fc1-8f81-6f2c2b98a80a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:58.672045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-42c69779-a698-4fc1-8f81-6f2c2b98a80a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:58.679141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42c69779-a698-4fc1-8f81-6f2c2b98a80a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:58.679843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42c69779-a698-4fc1-8f81-6f2c2b98a80a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:58.680434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42c69779-a698-4fc1-8f81-6f2c2b98a80a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.681358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42c69779-a698-4fc1-8f81-6f2c2b98a80a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:58.681956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42c69779-a698-4fc1-8f81-6f2c2b98a80a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:58.682525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42c69779-a698-4fc1-8f81-6f2c2b98a80a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.780130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b754ba4b-22e5-4dad-8c43-4d5a1f088216 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:58.780752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b754ba4b-22e5-4dad-8c43-4d5a1f088216 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:58.783867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:58.788852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b754ba4b-22e5-4dad-8c43-4d5a1f088216 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:58.789563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b754ba4b-22e5-4dad-8c43-4d5a1f088216 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:58.789877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b754ba4b-22e5-4dad-8c43-4d5a1f088216 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.790587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b754ba4b-22e5-4dad-8c43-4d5a1f088216 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:58.791045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b754ba4b-22e5-4dad-8c43-4d5a1f088216 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:58.791657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b754ba4b-22e5-4dad-8c43-4d5a1f088216 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.848066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:58.872881 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-42c69779-a698-4fc1-8f81-6f2c2b98a80a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.206178 Aug 29 15:26:58.873866 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 263/549] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:26:58 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df/os-interface => generated 285 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:26:58.941240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:58.948537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b08d4e39-6516-4da4-af88-9a1d02ac53ad tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:58.949443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b08d4e39-6516-4da4-af88-9a1d02ac53ad tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:58.973222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b08d4e39-6516-4da4-af88-9a1d02ac53ad tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:58.984703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b08d4e39-6516-4da4-af88-9a1d02ac53ad tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:58.985174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b08d4e39-6516-4da4-af88-9a1d02ac53ad tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:58.986511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b08d4e39-6516-4da4-af88-9a1d02ac53ad tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:58.987704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b08d4e39-6516-4da4-af88-9a1d02ac53ad tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:58.991458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b08d4e39-6516-4da4-af88-9a1d02ac53ad tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:59.015975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:59.318028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b754ba4b-22e5-4dad-8c43-4d5a1f088216 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:59.326719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b754ba4b-22e5-4dad-8c43-4d5a1f088216 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:59.328145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b754ba4b-22e5-4dad-8c43-4d5a1f088216 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:59.329425 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b754ba4b-22e5-4dad-8c43-4d5a1f088216 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1568 microversion: 2.25 time: 0.554211 Aug 29 15:26:59.335253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b08d4e39-6516-4da4-af88-9a1d02ac53ad tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:59.339364 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 287/550] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:26:58 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1568 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:26:59.344792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0c6c1b4e-6fc1-4495-9bd0-dd8c720fe440 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:59.349799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0c6c1b4e-6fc1-4495-9bd0-dd8c720fe440 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:59.350507 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b08d4e39-6516-4da4-af88-9a1d02ac53ad tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1321 microversion: 2.1 time: 0.405166 Aug 29 15:26:59.359574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c6c1b4e-6fc1-4495-9bd0-dd8c720fe440 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:59.365588 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 264/551] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:58 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1321 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:59.365796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c6c1b4e-6fc1-4495-9bd0-dd8c720fe440 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:59.366300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c6c1b4e-6fc1-4495-9bd0-dd8c720fe440 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:59.367072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c6c1b4e-6fc1-4495-9bd0-dd8c720fe440 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:59.367555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c6c1b4e-6fc1-4495-9bd0-dd8c720fe440 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:59.367990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c6c1b4e-6fc1-4495-9bd0-dd8c720fe440 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:59.376464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d3ae90bc-78d2-40d7-a19f-f4810489273d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:59.377304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d3ae90bc-78d2-40d7-a19f-f4810489273d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:59.393370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ae90bc-78d2-40d7-a19f-f4810489273d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:59.405920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ae90bc-78d2-40d7-a19f-f4810489273d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:59.406721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ae90bc-78d2-40d7-a19f-f4810489273d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:59.407874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ae90bc-78d2-40d7-a19f-f4810489273d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:59.408770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ae90bc-78d2-40d7-a19f-f4810489273d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:59.409468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ae90bc-78d2-40d7-a19f-f4810489273d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:59.436690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=16 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:26:59.498442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ae90bc-78d2-40d7-a19f-f4810489273d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:59.499550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ae90bc-78d2-40d7-a19f-f4810489273d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:59.500180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ae90bc-78d2-40d7-a19f-f4810489273d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:59.500831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-d3ae90bc-78d2-40d7-a19f-f4810489273d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lazy-loading 'fault' on Instance uuid 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:26:59.725511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d3ae90bc-78d2-40d7-a19f-f4810489273d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3094a327b84ac288c39c4ff590db3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e459b5cdf34889a8a76de8a1af6405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:59.738242 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d3ae90bc-78d2-40d7-a19f-f4810489273d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 200 len: 1306 microversion: 2.1 time: 0.370066 Aug 29 15:26:59.738487 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 265/552] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:59 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 1306 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:26:59.762847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-99deff0d-bcd5-4a6c-bef0-07c907f3386b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:26:59.766298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-99deff0d-bcd5-4a6c-bef0-07c907f3386b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:26:59.824533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99deff0d-bcd5-4a6c-bef0-07c907f3386b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:59.828121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99deff0d-bcd5-4a6c-bef0-07c907f3386b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:59.828906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99deff0d-bcd5-4a6c-bef0-07c907f3386b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:59.829934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99deff0d-bcd5-4a6c-bef0-07c907f3386b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:26:59.831468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99deff0d-bcd5-4a6c-bef0-07c907f3386b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:26:59.832660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99deff0d-bcd5-4a6c-bef0-07c907f3386b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:26:59.874626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0c6c1b4e-6fc1-4495-9bd0-dd8c720fe440 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:26:59.888827 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0c6c1b4e-6fc1-4495-9bd0-dd8c720fe440 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1316 microversion: 2.1 time: 0.548276 Aug 29 15:26:59.889457 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 288/553] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:59 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1316 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:00.360450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-35bc096b-9e2e-42c1-bc4a-0378d11a058f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:00.361226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-35bc096b-9e2e-42c1-bc4a-0378d11a058f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:00.375299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35bc096b-9e2e-42c1-bc4a-0378d11a058f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:00.379541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35bc096b-9e2e-42c1-bc4a-0378d11a058f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:00.380073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35bc096b-9e2e-42c1-bc4a-0378d11a058f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:00.380992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35bc096b-9e2e-42c1-bc4a-0378d11a058f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:00.381503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35bc096b-9e2e-42c1-bc4a-0378d11a058f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:00.382387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35bc096b-9e2e-42c1-bc4a-0378d11a058f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:00.411461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:00.547617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-99deff0d-bcd5-4a6c-bef0-07c907f3386b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:00.563126 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-99deff0d-bcd5-4a6c-bef0-07c907f3386b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1319 microversion: 2.1 time: 0.821474 Aug 29 15:27:00.577707 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 266/554] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:26:59 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1319 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:00.589514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f6067899-31cd-4779-be1c-23ec535173c7 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:00.591285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f6067899-31cd-4779-be1c-23ec535173c7 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:00.609166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6067899-31cd-4779-be1c-23ec535173c7 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:00.609719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6067899-31cd-4779-be1c-23ec535173c7 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:00.610188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6067899-31cd-4779-be1c-23ec535173c7 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:00.610937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6067899-31cd-4779-be1c-23ec535173c7 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:00.611386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6067899-31cd-4779-be1c-23ec535173c7 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:00.611800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6067899-31cd-4779-be1c-23ec535173c7 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:00.818509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-35bc096b-9e2e-42c1-bc4a-0378d11a058f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:00.831785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-35bc096b-9e2e-42c1-bc4a-0378d11a058f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:00.835221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-35bc096b-9e2e-42c1-bc4a-0378d11a058f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:00.837622 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-35bc096b-9e2e-42c1-bc4a-0378d11a058f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1568 microversion: 2.25 time: 0.484885 Aug 29 15:27:00.849162 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 289/555] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:00 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1568 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:27:00.869406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-078c39f1-094a-4b54-a52f-3919f9b86f9e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:00.871740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-078c39f1-094a-4b54-a52f-3919f9b86f9e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:00.893728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-078c39f1-094a-4b54-a52f-3919f9b86f9e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:00.895061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-078c39f1-094a-4b54-a52f-3919f9b86f9e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:00.896637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-078c39f1-094a-4b54-a52f-3919f9b86f9e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:00.897610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-078c39f1-094a-4b54-a52f-3919f9b86f9e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:00.899658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-078c39f1-094a-4b54-a52f-3919f9b86f9e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:00.901473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-078c39f1-094a-4b54-a52f-3919f9b86f9e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:00.933887 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-078c39f1-094a-4b54-a52f-3919f9b86f9e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] HTTP exception thrown: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-078c39f1-094a-4b54-a52f-3919f9b86f9e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Request method failure captured: Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c HTTP/1.1 Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNqihBM8WQUVyUCYI2eiN5Wdglr0WzJ2WxMwbpQrZ0vEhgukCk2eJTKV8Ba85Gxqwo7UPLJGkRF0UQfbEINV2kLhU7pVtHlRRYuvDDF8NAsiOdfua0Svd-U9GAmqLhADgG8Kpeew0OxSunN_3x7LpGshqizS0fKLV5akXXqc5u3_W28 Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 70e459b5cdf34889a8a76de8a1af6405 Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:27:00.937891 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:27:00.939704 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_70e459b5cdf34889a8a76de8a1af6405", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/70e459b5cdf34889a8a76de8a1af6405"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/70e459b5cdf34889a8a76de8a1af6405"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/70e459b5cdf34889a8a76de8a1af6405"}]}] Aug 29 15:27:00.939704 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:00.939704 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 70e459b5cdf34889a8a76de8a1af6405 Aug 29 15:27:00.939704 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:00.939704 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesNegativeTestJSON-267488908-project Aug 29 15:27:00.939704 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:27:00.939704 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:27:00.939704 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 9c3094a327b84ac288c39c4ff590db3b Aug 29 15:27:00.939704 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesNegativeTestJSON-267488908-project Aug 29 15:27:00.939704 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:27:00.939704 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:00.939704 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '7e8b4865-90f7-40ae-a4d6-cedb0af05d3c'} Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:00.940646 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:00.942089 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:00.944694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f6067899-31cd-4779-be1c-23ec535173c7 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:00.949628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-078c39f1-094a-4b54-a52f-3919f9b86f9e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Returning 404 to user: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:00.951174 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-078c39f1-094a-4b54-a52f-3919f9b86f9e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 404 len: 111 microversion: 2.1 time: 0.098134 Aug 29 15:27:00.952467 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 290/556] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:00 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:27:00.958152 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f6067899-31cd-4779-be1c-23ec535173c7 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1321 microversion: 2.1 time: 0.381098 Aug 29 15:27:00.971627 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 267/557] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:00 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:00.971627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5bc59381-ddfb-46cc-badd-ca0b4926fde4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:00.971627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5bc59381-ddfb-46cc-badd-ca0b4926fde4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:00.980679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bc59381-ddfb-46cc-badd-ca0b4926fde4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:00.981210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bc59381-ddfb-46cc-badd-ca0b4926fde4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:00.981677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bc59381-ddfb-46cc-badd-ca0b4926fde4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:00.985573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bc59381-ddfb-46cc-badd-ca0b4926fde4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:00.986101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bc59381-ddfb-46cc-badd-ca0b4926fde4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:00.986542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bc59381-ddfb-46cc-badd-ca0b4926fde4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:01.097965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1092428425", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "7ead68ac-9b85-4a15-900a-c59cae425b9c"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:01.172575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] validate_networks() for [('7ead68ac-9b85-4a15-900a-c59cae425b9c', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:27:01.540658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5bc59381-ddfb-46cc-badd-ca0b4926fde4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:01.550134 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5bc59381-ddfb-46cc-badd-ca0b4926fde4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1316 microversion: 2.1 time: 0.590089 Aug 29 15:27:01.551958 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 268/558] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:00 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1316 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:01.558555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e91eacf0-262e-46c7-958b-66770e4d058e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2050452741", "metadata": {"image_type": "test"}}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:01.562985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e91eacf0-262e-46c7-958b-66770e4d058e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:01.570405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e91eacf0-262e-46c7-958b-66770e4d058e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:01.571243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e91eacf0-262e-46c7-958b-66770e4d058e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:01.572504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e91eacf0-262e-46c7-958b-66770e4d058e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:01.573786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e91eacf0-262e-46c7-958b-66770e4d058e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:01.574409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e91eacf0-262e-46c7-958b-66770e4d058e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:01.575762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e91eacf0-262e-46c7-958b-66770e4d058e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:01.596880 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-e91eacf0-262e-46c7-958b-66770e4d058e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] HTTP exception thrown: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e91eacf0-262e-46c7-958b-66770e4d058e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Request method failure captured: Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c/action HTTP/1.1 Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 112 Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqihBM8WQUVyUCYI2eiN5Wdglr0WzJ2WxMwbpQrZ0vEhgukCk2eJTKV8Ba85Gxqwo7UPLJGkRF0UQfbEINV2kLhU7pVtHlRRYuvDDF8NAsiOdfua0Svd-U9GAmqLhADgG8Kpeew0OxSunN_3x7LpGshqizS0fKLV5akXXqc5u3_W28 Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 70e459b5cdf34889a8a76de8a1af6405 Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:27:01.600410 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:27:01.602060 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_70e459b5cdf34889a8a76de8a1af6405", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/70e459b5cdf34889a8a76de8a1af6405"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/70e459b5cdf34889a8a76de8a1af6405"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/70e459b5cdf34889a8a76de8a1af6405"}]}] Aug 29 15:27:01.602060 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:01.602060 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 70e459b5cdf34889a8a76de8a1af6405 Aug 29 15:27:01.602060 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:01.602060 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesNegativeTestJSON-267488908-project Aug 29 15:27:01.602060 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:27:01.602060 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:27:01.602060 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 9c3094a327b84ac288c39c4ff590db3b Aug 29 15:27:01.602060 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesNegativeTestJSON-267488908-project Aug 29 15:27:01.602060 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:27:01.602060 n-d-839401-11 devstack@n-api.service[122360]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2050452741", "metadata": {"image_type": "test"}}} Aug 29 15:27:01.602060 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7e8b4865-90f7-40ae-a4d6-cedb0af05d3c', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2050452741', 'metadata': {'image_type': 'test'}}}} Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:01.602927 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:01.604330 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:01.606683 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:01.606683 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:01.606683 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:01.606683 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:01.606683 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:01.608281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e91eacf0-262e-46c7-958b-66770e4d058e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Returning 404 to user: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:01.609765 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e91eacf0-262e-46c7-958b-66770e4d058e tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "POST /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c/action" status: 404 len: 111 microversion: 2.1 time: 0.055997 Aug 29 15:27:01.616476 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 269/559] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Aug 29 15:27:01 2022] POST /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:27:01.622445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-990b48cb-4a28-4983-90fa-fccf479c73fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:01.623262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-990b48cb-4a28-4983-90fa-fccf479c73fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:01.632858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-990b48cb-4a28-4983-90fa-fccf479c73fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:01.633640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-990b48cb-4a28-4983-90fa-fccf479c73fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:01.634268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-990b48cb-4a28-4983-90fa-fccf479c73fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:01.635196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-990b48cb-4a28-4983-90fa-fccf479c73fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:01.636377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-990b48cb-4a28-4983-90fa-fccf479c73fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:01.637066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-990b48cb-4a28-4983-90fa-fccf479c73fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:01.856883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:27:01.858684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:27:01.859281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:27:01.859793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:27:01.860616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:27:01.879932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:01.880557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:01.881286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:01.882339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:01.883525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:01.884201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:01.903988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Getting quotas for project 31544ac2992c46aa8fecdff53a43ae42. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:01.910674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Getting quotas for user 498e44c8a15f451ba8ff39eff4156075 and project 31544ac2992c46aa8fecdff53a43ae42. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:01.926856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:27:01.929818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:27:01.991776 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-421c9b16-cd6c-4379-9d32-04fae40bbbd5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.037903 Aug 29 15:27:02.000036 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 291/560] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:27:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:27:02.005800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7e13b0d6-76aa-4abc-b3d2-018a22d2edd5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1324100897", "metadata": {"image_type": "test"}}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:02.010985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7e13b0d6-76aa-4abc-b3d2-018a22d2edd5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Failed to fetch instance by id tempest-invalid-288465223 {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:27:02.011732 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-7e13b0d6-76aa-4abc-b3d2-018a22d2edd5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] HTTP exception thrown: Instance tempest-invalid-288465223 could not be found. Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7e13b0d6-76aa-4abc-b3d2-018a22d2edd5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Request method failure captured: Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/tempest-invalid-288465223/action HTTP/1.1 Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 112 Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNqihBM8WQUVyUCYI2eiN5Wdglr0WzJ2WxMwbpQrZ0vEhgukCk2eJTKV8Ba85Gxqwo7UPLJGkRF0UQfbEINV2kLhU7pVtHlRRYuvDDF8NAsiOdfua0Svd-U9GAmqLhADgG8Kpeew0OxSunN_3x7LpGshqizS0fKLV5akXXqc5u3_W28 Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 70e459b5cdf34889a8a76de8a1af6405 Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:27:02.013607 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:27:02.014899 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_70e459b5cdf34889a8a76de8a1af6405", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/70e459b5cdf34889a8a76de8a1af6405"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/70e459b5cdf34889a8a76de8a1af6405"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/70e459b5cdf34889a8a76de8a1af6405"}]}] Aug 29 15:27:02.014899 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:02.014899 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 70e459b5cdf34889a8a76de8a1af6405 Aug 29 15:27:02.014899 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:02.014899 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesNegativeTestJSON-267488908-project Aug 29 15:27:02.014899 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:27:02.014899 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:27:02.014899 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 9c3094a327b84ac288c39c4ff590db3b Aug 29 15:27:02.014899 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesNegativeTestJSON-267488908-project Aug 29 15:27:02.014899 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:27:02.014899 n-d-839401-11 devstack@n-api.service[122361]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1324100897", "metadata": {"image_type": "test"}}} Aug 29 15:27:02.014899 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:27:02.014899 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance tempest-invalid-288465223 could not be found. Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'tempest-invalid-288465223', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1324100897', 'metadata': {'image_type': 'test'}}}} Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-288465223 could not be found. Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:02.015841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-288465223 could not be found. Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-288465223 could not be found. Aug 29 15:27:02.017124 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:02.021257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7e13b0d6-76aa-4abc-b3d2-018a22d2edd5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Returning 404 to user: Instance tempest-invalid-288465223 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:02.022884 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7e13b0d6-76aa-4abc-b3d2-018a22d2edd5 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "POST /compute/v2.1/servers/tempest-invalid-288465223/action" status: 404 len: 100 microversion: 2.1 time: 0.021258 Aug 29 15:27:02.025672 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 292/561] 10.222.0.62 () {60 vars in 1246 bytes} [Mon Aug 29 15:27:02 2022] POST /compute/v2.1/servers/tempest-invalid-288465223/action => generated 100 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:27:02.033585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e14e15fb-b6b5-4dd0-82c6-751a99cfb36a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:02.034282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e14e15fb-b6b5-4dd0-82c6-751a99cfb36a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:02.042286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e14e15fb-b6b5-4dd0-82c6-751a99cfb36a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:02.043032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e14e15fb-b6b5-4dd0-82c6-751a99cfb36a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:02.043673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e14e15fb-b6b5-4dd0-82c6-751a99cfb36a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:02.044608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e14e15fb-b6b5-4dd0-82c6-751a99cfb36a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:02.045299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e14e15fb-b6b5-4dd0-82c6-751a99cfb36a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:02.045935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e14e15fb-b6b5-4dd0-82c6-751a99cfb36a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:02.112876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-990b48cb-4a28-4983-90fa-fccf479c73fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:02.124401 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-990b48cb-4a28-4983-90fa-fccf479c73fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1319 microversion: 2.1 time: 0.505995 Aug 29 15:27:02.130919 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 270/562] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:01 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:02.139948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-fa18c427-cecd-4c78-9f7f-b1b60dc9e685 req-873aba17-42fa-4785-8522-b7dfcb08e62d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f44b5e-bcae-4e95-a11a-c781e6cf06df", "tag": "3f638867-a674-40ea-b7b1-b095f9393504"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:02.165625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fa18c427-cecd-4c78-9f7f-b1b60dc9e685 req-873aba17-42fa-4785-8522-b7dfcb08e62d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:02.166327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fa18c427-cecd-4c78-9f7f-b1b60dc9e685 req-873aba17-42fa-4785-8522-b7dfcb08e62d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:02.166918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fa18c427-cecd-4c78-9f7f-b1b60dc9e685 req-873aba17-42fa-4785-8522-b7dfcb08e62d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:02.221794 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-fa18c427-cecd-4c78-9f7f-b1b60dc9e685 req-873aba17-42fa-4785-8522-b7dfcb08e62d service nova] Creating event network-changed:3f638867-a674-40ea-b7b1-b095f9393504 for instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df on n-h2-839401-11 Aug 29 15:27:02.229766 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-fa18c427-cecd-4c78-9f7f-b1b60dc9e685 req-873aba17-42fa-4785-8522-b7dfcb08e62d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097286 Aug 29 15:27:02.230982 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 271/563] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:02.237627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4fd03563-1b09-4591-9eb3-e64646b1257e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:02.239418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4fd03563-1b09-4591-9eb3-e64646b1257e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:02.247418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fd03563-1b09-4591-9eb3-e64646b1257e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:02.249950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fd03563-1b09-4591-9eb3-e64646b1257e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:02.251144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fd03563-1b09-4591-9eb3-e64646b1257e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:02.252495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fd03563-1b09-4591-9eb3-e64646b1257e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:02.254203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fd03563-1b09-4591-9eb3-e64646b1257e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:02.254869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fd03563-1b09-4591-9eb3-e64646b1257e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:02.572789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e14e15fb-b6b5-4dd0-82c6-751a99cfb36a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:02.583764 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e14e15fb-b6b5-4dd0-82c6-751a99cfb36a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 200 len: 1589 microversion: 2.1 time: 0.556599 Aug 29 15:27:02.584704 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 293/564] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:02 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 1589 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:02.596580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0de8e348-a2e5-466a-bf5a-ac00ca825cc8 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:02.597596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0de8e348-a2e5-466a-bf5a-ac00ca825cc8 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:02.613480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0de8e348-a2e5-466a-bf5a-ac00ca825cc8 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:02.614129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0de8e348-a2e5-466a-bf5a-ac00ca825cc8 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:02.614649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0de8e348-a2e5-466a-bf5a-ac00ca825cc8 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:02.615443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0de8e348-a2e5-466a-bf5a-ac00ca825cc8 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:02.615990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0de8e348-a2e5-466a-bf5a-ac00ca825cc8 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:02.622017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0de8e348-a2e5-466a-bf5a-ac00ca825cc8 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:03.014248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4fd03563-1b09-4591-9eb3-e64646b1257e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:03.030203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4fd03563-1b09-4591-9eb3-e64646b1257e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:03.032287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4fd03563-1b09-4591-9eb3-e64646b1257e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:03.036358 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4fd03563-1b09-4591-9eb3-e64646b1257e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1568 microversion: 2.25 time: 0.803634 Aug 29 15:27:03.038328 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 272/565] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:02 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1568 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:03.069734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-57805e2f-8395-47fa-940a-5d829cbe92b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:03.072323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-57805e2f-8395-47fa-940a-5d829cbe92b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:03.081574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57805e2f-8395-47fa-940a-5d829cbe92b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:03.083346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57805e2f-8395-47fa-940a-5d829cbe92b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:03.084684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57805e2f-8395-47fa-940a-5d829cbe92b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:03.087829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57805e2f-8395-47fa-940a-5d829cbe92b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:03.088664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57805e2f-8395-47fa-940a-5d829cbe92b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:03.089333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57805e2f-8395-47fa-940a-5d829cbe92b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:03.210837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0de8e348-a2e5-466a-bf5a-ac00ca825cc8 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:03.230074 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0de8e348-a2e5-466a-bf5a-ac00ca825cc8 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1321 microversion: 2.1 time: 0.643337 Aug 29 15:27:03.230666 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 294/566] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:02 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1321 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:03.241357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-623345a4-59ff-48a9-ab0f-121c9f8fb8ae tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1239707629"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:03.267142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-623345a4-59ff-48a9-ab0f-121c9f8fb8ae tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:27:03.267685 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-623345a4-59ff-48a9-ab0f-121c9f8fb8ae tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-623345a4-59ff-48a9-ab0f-121c9f8fb8ae tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Request method failure captured: Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 57 Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNqihBM8WQUVyUCYI2eiN5Wdglr0WzJ2WxMwbpQrZ0vEhgukCk2eJTKV8Ba85Gxqwo7UPLJGkRF0UQfbEINV2kLhU7pVtHlRRYuvDDF8NAsiOdfua0Svd-U9GAmqLhADgG8Kpeew0OxSunN_3x7LpGshqizS0fKLV5akXXqc5u3_W28 Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 70e459b5cdf34889a8a76de8a1af6405 Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:27:03.269300 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:27:03.270913 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_70e459b5cdf34889a8a76de8a1af6405", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/70e459b5cdf34889a8a76de8a1af6405"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/70e459b5cdf34889a8a76de8a1af6405"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/70e459b5cdf34889a8a76de8a1af6405"}]}] Aug 29 15:27:03.270913 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:03.270913 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 70e459b5cdf34889a8a76de8a1af6405 Aug 29 15:27:03.270913 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:03.270913 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesNegativeTestJSON-267488908-project Aug 29 15:27:03.270913 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:27:03.270913 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:27:03.270913 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 9c3094a327b84ac288c39c4ff590db3b Aug 29 15:27:03.270913 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesNegativeTestJSON-267488908-project Aug 29 15:27:03.270913 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:27:03.270913 n-d-839401-11 devstack@n-api.service[122361]: {"createImage": {"name": "tempest-test-snap-1239707629"}} Aug 29 15:27:03.270913 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:27:03.270913 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1239707629'}}} Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:03.271883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:27:03.273482 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:03.274873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-623345a4-59ff-48a9-ab0f-121c9f8fb8ae tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:03.274873 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-623345a4-59ff-48a9-ab0f-121c9f8fb8ae tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.033508 Aug 29 15:27:03.301549 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 295/567] 10.222.0.62 () {60 vars in 1275 bytes} [Mon Aug 29 15:27:03 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:27:03.310133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d901d342-406e-437e-9509-db27cd003675 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:03.310766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d901d342-406e-437e-9509-db27cd003675 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:03.341038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-57805e2f-8395-47fa-940a-5d829cbe92b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:03.345601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d901d342-406e-437e-9509-db27cd003675 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:03.346114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d901d342-406e-437e-9509-db27cd003675 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:03.346562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d901d342-406e-437e-9509-db27cd003675 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:03.347305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d901d342-406e-437e-9509-db27cd003675 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:03.347773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d901d342-406e-437e-9509-db27cd003675 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:03.348194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d901d342-406e-437e-9509-db27cd003675 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:03.354995 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-57805e2f-8395-47fa-940a-5d829cbe92b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1215 microversion: 2.1 time: 0.302288 Aug 29 15:27:03.356751 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 273/568] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:03 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1215 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:03.362184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c941774d-b46c-461c-b5f6-972b91a608cb tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:03.366082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c941774d-b46c-461c-b5f6-972b91a608cb tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:03.394246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c941774d-b46c-461c-b5f6-972b91a608cb tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:03.395085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c941774d-b46c-461c-b5f6-972b91a608cb tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:03.395813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c941774d-b46c-461c-b5f6-972b91a608cb tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:03.396883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c941774d-b46c-461c-b5f6-972b91a608cb tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:03.397539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c941774d-b46c-461c-b5f6-972b91a608cb tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:03.398133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c941774d-b46c-461c-b5f6-972b91a608cb tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:03.676143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c941774d-b46c-461c-b5f6-972b91a608cb tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:03.684861 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c941774d-b46c-461c-b5f6-972b91a608cb tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1319 microversion: 2.1 time: 0.326729 Aug 29 15:27:03.690929 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 274/569] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:03 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:03.708365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cb562f9c-180e-487c-b543-840c77009cce tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1120021170"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:03.711248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cb562f9c-180e-487c-b543-840c77009cce tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:27:03.711987 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-cb562f9c-180e-487c-b543-840c77009cce tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cb562f9c-180e-487c-b543-840c77009cce tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Request method failure captured: Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 57 Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqihBM8WQUVyUCYI2eiN5Wdglr0WzJ2WxMwbpQrZ0vEhgukCk2eJTKV8Ba85Gxqwo7UPLJGkRF0UQfbEINV2kLhU7pVtHlRRYuvDDF8NAsiOdfua0Svd-U9GAmqLhADgG8Kpeew0OxSunN_3x7LpGshqizS0fKLV5akXXqc5u3_W28 Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 70e459b5cdf34889a8a76de8a1af6405 Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:27:03.720731 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:27:03.722288 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_70e459b5cdf34889a8a76de8a1af6405", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/70e459b5cdf34889a8a76de8a1af6405"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/70e459b5cdf34889a8a76de8a1af6405"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/70e459b5cdf34889a8a76de8a1af6405"}]}] Aug 29 15:27:03.722288 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:03.722288 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 70e459b5cdf34889a8a76de8a1af6405 Aug 29 15:27:03.722288 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:03.722288 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesNegativeTestJSON-267488908-project Aug 29 15:27:03.722288 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:27:03.722288 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:27:03.722288 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 9c3094a327b84ac288c39c4ff590db3b Aug 29 15:27:03.722288 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesNegativeTestJSON-267488908-project Aug 29 15:27:03.722288 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:27:03.722288 n-d-839401-11 devstack@n-api.service[122360]: {"createImage": {"name": "tempest-test-snap-1120021170"}} Aug 29 15:27:03.722288 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:27:03.722288 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1120021170'}}} Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:03.723081 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 15:27:03.724254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:03.726556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cb562f9c-180e-487c-b543-840c77009cce tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:03.726556 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cb562f9c-180e-487c-b543-840c77009cce tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.030682 Aug 29 15:27:03.726556 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 275/570] 10.222.0.62 () {60 vars in 1281 bytes} [Mon Aug 29 15:27:03 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:27:03.734507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-1b03e07a-e920-4955-9c47-866c6a6dbb8d req-5d58fb34-752c-4b86-812e-a7535d46374e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5026556-58ce-42c9-9606-f75fbb77c2bf", "name": "network-vif-plugged", "status": "completed", "tag": "9b1727cd-673b-4493-96b0-efd887ebebc8"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:03.750307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1b03e07a-e920-4955-9c47-866c6a6dbb8d req-5d58fb34-752c-4b86-812e-a7535d46374e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:03.750784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1b03e07a-e920-4955-9c47-866c6a6dbb8d req-5d58fb34-752c-4b86-812e-a7535d46374e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:03.751290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1b03e07a-e920-4955-9c47-866c6a6dbb8d req-5d58fb34-752c-4b86-812e-a7535d46374e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:03.769968 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-1b03e07a-e920-4955-9c47-866c6a6dbb8d req-5d58fb34-752c-4b86-812e-a7535d46374e service nova] Creating event network-vif-plugged:9b1727cd-673b-4493-96b0-efd887ebebc8 for instance b5026556-58ce-42c9-9606-f75fbb77c2bf on n-h2-839401-11 Aug 29 15:27:03.777350 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-1b03e07a-e920-4955-9c47-866c6a6dbb8d req-5d58fb34-752c-4b86-812e-a7535d46374e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052382 Aug 29 15:27:03.778393 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 276/571] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:03.864788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5a761a96-9463-4fd2-93b3-555057bbbdcd tempest-FloatingIPsNegativeTestJSON-584535898 tempest-FloatingIPsNegativeTestJSON-584535898-project] Calling method '.version_select at 0x7fc42bf260d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:03.980752 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5a761a96-9463-4fd2-93b3-555057bbbdcd tempest-FloatingIPsNegativeTestJSON-584535898 tempest-FloatingIPsNegativeTestJSON-584535898-project] 10.222.0.62 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.200514 Aug 29 15:27:03.989494 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 277/572] 10.222.0.62 () {58 vars in 1149 bytes} [Mon Aug 29 15:27:03 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:27:03.995593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1ba1c3a9-f023-46c8-8080-4d6f87111b8d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:03.996670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1ba1c3a9-f023-46c8-8080-4d6f87111b8d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:04.007941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d901d342-406e-437e-9509-db27cd003675 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:04.014922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ba1c3a9-f023-46c8-8080-4d6f87111b8d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:04.018392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ba1c3a9-f023-46c8-8080-4d6f87111b8d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:04.019000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ba1c3a9-f023-46c8-8080-4d6f87111b8d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:04.021262 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d901d342-406e-437e-9509-db27cd003675 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1316 microversion: 2.1 time: 0.718409 Aug 29 15:27:04.021466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ba1c3a9-f023-46c8-8080-4d6f87111b8d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:04.022197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ba1c3a9-f023-46c8-8080-4d6f87111b8d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:04.024127 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 296/573] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:03 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1316 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:04.036891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ba1c3a9-f023-46c8-8080-4d6f87111b8d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:04.039225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0c0c086e-f065-4283-b903-081803b96032 tempest-FloatingIPsNegativeTestJSON-584535898 tempest-FloatingIPsNegativeTestJSON-584535898-project] Action: 'create', calling method: .version_select at 0x7fc430075d30>, body: {"pool": "non_exist_pool"} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:04.056412 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-1ba1c3a9-f023-46c8-8080-4d6f87111b8d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] HTTP exception thrown: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1ba1c3a9-f023-46c8-8080-4d6f87111b8d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Request method failure captured: Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c HTTP/1.1 Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqihBM8WQUVyUCYI2eiN5Wdglr0WzJ2WxMwbpQrZ0vEhgukCk2eJTKV8Ba85Gxqwo7UPLJGkRF0UQfbEINV2kLhU7pVtHlRRYuvDDF8NAsiOdfua0Svd-U9GAmqLhADgG8Kpeew0OxSunN_3x7LpGshqizS0fKLV5akXXqc5u3_W28 Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 70e459b5cdf34889a8a76de8a1af6405 Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:27:04.058525 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:27:04.060888 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_70e459b5cdf34889a8a76de8a1af6405", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/70e459b5cdf34889a8a76de8a1af6405"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/70e459b5cdf34889a8a76de8a1af6405"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/70e459b5cdf34889a8a76de8a1af6405"}]}] Aug 29 15:27:04.060888 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:04.060888 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 70e459b5cdf34889a8a76de8a1af6405 Aug 29 15:27:04.060888 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:04.060888 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesNegativeTestJSON-267488908-project Aug 29 15:27:04.060888 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:27:04.060888 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:27:04.060888 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 9c3094a327b84ac288c39c4ff590db3b Aug 29 15:27:04.060888 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesNegativeTestJSON-267488908-project Aug 29 15:27:04.060888 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:27:04.060888 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:04.060888 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7e8b4865-90f7-40ae-a4d6-cedb0af05d3c'} Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:04.062125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:04.063615 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.065065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1ba1c3a9-f023-46c8-8080-4d6f87111b8d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Returning 404 to user: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:04.066235 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1ba1c3a9-f023-46c8-8080-4d6f87111b8d tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 404 len: 111 microversion: 2.1 time: 0.075250 Aug 29 15:27:04.067498 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 278/574] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:27:03 2022] DELETE /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:27:04.074786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f93b09c8-64c7-45f7-973c-00098d50cbfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:04.078361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f93b09c8-64c7-45f7-973c-00098d50cbfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:04.093349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f93b09c8-64c7-45f7-973c-00098d50cbfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:04.097053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f93b09c8-64c7-45f7-973c-00098d50cbfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:04.098272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f93b09c8-64c7-45f7-973c-00098d50cbfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:04.100114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f93b09c8-64c7-45f7-973c-00098d50cbfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:04.102056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f93b09c8-64c7-45f7-973c-00098d50cbfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:04.104598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f93b09c8-64c7-45f7-973c-00098d50cbfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:04.249431 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-0c0c086e-f065-4283-b903-081803b96032 tempest-FloatingIPsNegativeTestJSON-584535898 tempest-FloatingIPsNegativeTestJSON-584535898-project] HTTP exception thrown: Floating IP pool not found. Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0c0c086e-f065-4283-b903-081803b96032 tempest-FloatingIPsNegativeTestJSON-584535898 tempest-FloatingIPsNegativeTestJSON-584535898-project] Request method failure captured: Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 26 Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNrHWFwba2QW-gMnG2cvXOHXhwHTAy94fePiJ4AqEZAs7EDiptc9SxCLaXV8SR4_JtcPl9_mAOKrkVQVTCRMwPvZYK1V8_vKoO_xocs_431GSD0qMpfHhusqGLKLmdyU-V8eL_ohvX177lSEZ6oIIPkzzOpEsVQ7d2LQJRKCI7Kieug Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 8e56f63bed734a289c03f940270d9461 Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-584535898 Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:27:04.252308 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:27:04.253794 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8e56f63bed734a289c03f940270d9461", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8e56f63bed734a289c03f940270d9461"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e56f63bed734a289c03f940270d9461"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e56f63bed734a289c03f940270d9461"}]}] Aug 29 15:27:04.253794 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-584535898 Aug 29 15:27:04.253794 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 8e56f63bed734a289c03f940270d9461 Aug 29 15:27:04.253794 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-584535898 Aug 29 15:27:04.253794 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-FloatingIPsNegativeTestJSON-584535898-project Aug 29 15:27:04.253794 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:27:04.253794 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:27:04.253794 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 971f288fc6c24192a06bb907b10e63ee Aug 29 15:27:04.253794 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-584535898-project Aug 29 15:27:04.253794 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:27:04.253794 n-d-839401-11 devstack@n-api.service[122361]: {"pool": "non_exist_pool"} Aug 29 15:27:04.253794 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:27:04.253794 n-d-839401-11 devstack@n-api.service[122361]: exception: Floating IP pool not found. Aug 29 15:27:04.253794 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 29 15:27:04.253794 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:04.254748 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:04.259169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 29 15:27:04.259169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:04.259169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 29 15:27:04.259169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.259169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:04.259169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.259169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:04.259169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:04.259169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:04.259169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:04.259169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:04.259169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 29 15:27:04.259169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.265715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0c0c086e-f065-4283-b903-081803b96032 tempest-FloatingIPsNegativeTestJSON-584535898 tempest-FloatingIPsNegativeTestJSON-584535898-project] Returning 404 to user: Floating IP pool not found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:04.266876 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0c0c086e-f065-4283-b903-081803b96032 tempest-FloatingIPsNegativeTestJSON-584535898 tempest-FloatingIPsNegativeTestJSON-584535898-project] 10.222.0.62 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.241508 Aug 29 15:27:04.268027 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 297/575] 10.222.0.62 () {60 vars in 1170 bytes} [Mon Aug 29 15:27:04 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:27:04.275569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-49a39b6b-beed-4bf3-b547-05e382fadba0 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:04.276590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-49a39b6b-beed-4bf3-b547-05e382fadba0 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] [instance: 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:04.288991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49a39b6b-beed-4bf3-b547-05e382fadba0 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:04.290106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49a39b6b-beed-4bf3-b547-05e382fadba0 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:04.290790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49a39b6b-beed-4bf3-b547-05e382fadba0 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:04.292055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49a39b6b-beed-4bf3-b547-05e382fadba0 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:04.294915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49a39b6b-beed-4bf3-b547-05e382fadba0 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:04.295621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49a39b6b-beed-4bf3-b547-05e382fadba0 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:04.359327 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-49a39b6b-beed-4bf3-b547-05e382fadba0 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] HTTP exception thrown: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-49a39b6b-beed-4bf3-b547-05e382fadba0 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Request method failure captured: Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c HTTP/1.1 Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNqihBM8WQUVyUCYI2eiN5Wdglr0WzJ2WxMwbpQrZ0vEhgukCk2eJTKV8Ba85Gxqwo7UPLJGkRF0UQfbEINV2kLhU7pVtHlRRYuvDDF8NAsiOdfua0Svd-U9GAmqLhADgG8Kpeew0OxSunN_3x7LpGshqizS0fKLV5akXXqc5u3_W28 Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 70e459b5cdf34889a8a76de8a1af6405 Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:27:04.368621 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:27:04.370450 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_70e459b5cdf34889a8a76de8a1af6405", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/70e459b5cdf34889a8a76de8a1af6405"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/70e459b5cdf34889a8a76de8a1af6405"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/70e459b5cdf34889a8a76de8a1af6405"}]}] Aug 29 15:27:04.370450 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:04.370450 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 70e459b5cdf34889a8a76de8a1af6405 Aug 29 15:27:04.370450 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-267488908 Aug 29 15:27:04.370450 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesNegativeTestJSON-267488908-project Aug 29 15:27:04.370450 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:27:04.370450 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:27:04.370450 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 9c3094a327b84ac288c39c4ff590db3b Aug 29 15:27:04.370450 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesNegativeTestJSON-267488908-project Aug 29 15:27:04.370450 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:27:04.370450 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:04.370450 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '7e8b4865-90f7-40ae-a4d6-cedb0af05d3c'} Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:04.371175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. Aug 29 15:27:04.372347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.373430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-49a39b6b-beed-4bf3-b547-05e382fadba0 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] Returning 404 to user: Instance 7e8b4865-90f7-40ae-a4d6-cedb0af05d3c could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:04.374109 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-49a39b6b-beed-4bf3-b547-05e382fadba0 tempest-ImagesNegativeTestJSON-267488908 tempest-ImagesNegativeTestJSON-267488908-project] 10.222.0.62 "GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c" status: 404 len: 111 microversion: 2.1 time: 0.104908 Aug 29 15:27:04.377395 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 298/576] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:04 2022] GET /compute/v2.1/servers/7e8b4865-90f7-40ae-a4d6-cedb0af05d3c => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:27:04.390057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-00d1c519-8a53-4073-ac29-a6abcf49fcc3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:04.394048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-00d1c519-8a53-4073-ac29-a6abcf49fcc3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:04.409272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00d1c519-8a53-4073-ac29-a6abcf49fcc3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:04.410757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00d1c519-8a53-4073-ac29-a6abcf49fcc3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:04.411394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00d1c519-8a53-4073-ac29-a6abcf49fcc3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:04.412882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00d1c519-8a53-4073-ac29-a6abcf49fcc3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:04.415061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00d1c519-8a53-4073-ac29-a6abcf49fcc3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:04.415695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00d1c519-8a53-4073-ac29-a6abcf49fcc3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:04.463504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f93b09c8-64c7-45f7-973c-00098d50cbfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:04.474719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f93b09c8-64c7-45f7-973c-00098d50cbfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:04.476317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f93b09c8-64c7-45f7-973c-00098d50cbfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:04.477557 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f93b09c8-64c7-45f7-973c-00098d50cbfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1568 microversion: 2.25 time: 0.408908 Aug 29 15:27:04.497765 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 279/577] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:04 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1568 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:04.507085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9cedd0bc-0982-425c-a8ff-7762b85f2056 tempest-FloatingIPsNegativeTestJSON-584535898 tempest-FloatingIPsNegativeTestJSON-584535898-project] Calling method '.version_select at 0x7fc42bf26c10>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:04.587717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG neutronclient.v2_0.client [None req-9cedd0bc-0982-425c-a8ff-7762b85f2056 tempest-FloatingIPsNegativeTestJSON-584535898 tempest-FloatingIPsNegativeTestJSON-584535898-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5ca078a7-bbe3-4f6d-b4bf-1a9e6e744476 could not be found", "detail": ""}} {{(pid=122360) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:27:04.588416 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-9cedd0bc-0982-425c-a8ff-7762b85f2056 tempest-FloatingIPsNegativeTestJSON-584535898 tempest-FloatingIPsNegativeTestJSON-584535898-project] HTTP exception thrown: Floating IP not found for ID 5ca078a7-bbe3-4f6d-b4bf-1a9e6e744476 Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9cedd0bc-0982-425c-a8ff-7762b85f2056 tempest-FloatingIPsNegativeTestJSON-584535898 tempest-FloatingIPsNegativeTestJSON-584535898-project] Request method failure captured: Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/os-floating-ips/5ca078a7-bbe3-4f6d-b4bf-1a9e6e744476 HTTP/1.1 Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNrHWFwba2QW-gMnG2cvXOHXhwHTAy94fePiJ4AqEZAs7EDiptc9SxCLaXV8SR4_JtcPl9_mAOKrkVQVTCRMwPvZYK1V8_vKoO_xocs_431GSD0qMpfHhusqGLKLmdyU-V8eL_ohvX177lSEZ6oIIPkzzOpEsVQ7d2LQJRKCI7Kieug Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 8e56f63bed734a289c03f940270d9461 Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-584535898 Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:27:04.593784 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:27:04.595227 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8e56f63bed734a289c03f940270d9461", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8e56f63bed734a289c03f940270d9461"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e56f63bed734a289c03f940270d9461"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e56f63bed734a289c03f940270d9461"}]}] Aug 29 15:27:04.595227 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-584535898 Aug 29 15:27:04.595227 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 8e56f63bed734a289c03f940270d9461 Aug 29 15:27:04.595227 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-584535898 Aug 29 15:27:04.595227 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-FloatingIPsNegativeTestJSON-584535898-project Aug 29 15:27:04.595227 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:27:04.595227 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:27:04.595227 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 971f288fc6c24192a06bb907b10e63ee Aug 29 15:27:04.595227 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-584535898-project Aug 29 15:27:04.595227 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:27:04.595227 n-d-839401-11 devstack@n-api.service[122360]: exception: Floating IP not found for ID 5ca078a7-bbe3-4f6d-b4bf-1a9e6e744476 Aug 29 15:27:04.595227 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '5ca078a7-bbe3-4f6d-b4bf-1a9e6e744476'} Aug 29 15:27:04.595227 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:27:04.596022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5ca078a7-bbe3-4f6d-b4bf-1a9e6e744476 could not be found Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41d0a791-83b5-4288-8c99-3c0e39a4a47e'] Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5ca078a7-bbe3-4f6d-b4bf-1a9e6e744476. Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:04.597198 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5ca078a7-bbe3-4f6d-b4bf-1a9e6e744476 Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:04.598400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:04.599618 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5ca078a7-bbe3-4f6d-b4bf-1a9e6e744476 Aug 29 15:27:04.599618 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:04.599618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9cedd0bc-0982-425c-a8ff-7762b85f2056 tempest-FloatingIPsNegativeTestJSON-584535898 tempest-FloatingIPsNegativeTestJSON-584535898-project] Returning 404 to user: Floating IP not found for ID 5ca078a7-bbe3-4f6d-b4bf-1a9e6e744476 {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:04.599618 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9cedd0bc-0982-425c-a8ff-7762b85f2056 tempest-FloatingIPsNegativeTestJSON-584535898 tempest-FloatingIPsNegativeTestJSON-584535898-project] 10.222.0.62 "DELETE /compute/v2.1/os-floating-ips/5ca078a7-bbe3-4f6d-b4bf-1a9e6e744476" status: 404 len: 111 microversion: 2.1 time: 0.096530 Aug 29 15:27:04.599618 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 280/578] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:27:04 2022] DELETE /compute/v2.1/os-floating-ips/5ca078a7-bbe3-4f6d-b4bf-1a9e6e744476 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:27:04.602986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0555eccc-8100-457a-b5e2-21e5bd9cf2e9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:04.603621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0555eccc-8100-457a-b5e2-21e5bd9cf2e9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:04.613447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0555eccc-8100-457a-b5e2-21e5bd9cf2e9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:04.613939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0555eccc-8100-457a-b5e2-21e5bd9cf2e9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:04.614377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0555eccc-8100-457a-b5e2-21e5bd9cf2e9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:04.615317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0555eccc-8100-457a-b5e2-21e5bd9cf2e9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:04.615784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0555eccc-8100-457a-b5e2-21e5bd9cf2e9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:04.616186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0555eccc-8100-457a-b5e2-21e5bd9cf2e9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:04.896199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0555eccc-8100-457a-b5e2-21e5bd9cf2e9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:04.905272 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0555eccc-8100-457a-b5e2-21e5bd9cf2e9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1269 microversion: 2.1 time: 0.307718 Aug 29 15:27:04.905872 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 281/579] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:04 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1269 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:04.934681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b73e6ca0-1b42-407d-a5fb-66aba1b3ceea tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:04.935304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b73e6ca0-1b42-407d-a5fb-66aba1b3ceea tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:04.959227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73e6ca0-1b42-407d-a5fb-66aba1b3ceea tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:04.960720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73e6ca0-1b42-407d-a5fb-66aba1b3ceea tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:04.961167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73e6ca0-1b42-407d-a5fb-66aba1b3ceea tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:04.961902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73e6ca0-1b42-407d-a5fb-66aba1b3ceea tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:04.962363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73e6ca0-1b42-407d-a5fb-66aba1b3ceea tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:04.962791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73e6ca0-1b42-407d-a5fb-66aba1b3ceea tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:05.286102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-00d1c519-8a53-4073-ac29-a6abcf49fcc3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:05.295541 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-00d1c519-8a53-4073-ac29-a6abcf49fcc3 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1321 microversion: 2.1 time: 0.916798 Aug 29 15:27:05.300021 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 299/580] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:04 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1321 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:05.305729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-15023afd-5501-42e5-ae7f-0b1345101610 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:05.311597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-15023afd-5501-42e5-ae7f-0b1345101610 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:05.323933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15023afd-5501-42e5-ae7f-0b1345101610 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:05.324465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15023afd-5501-42e5-ae7f-0b1345101610 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:05.324855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15023afd-5501-42e5-ae7f-0b1345101610 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:05.330124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15023afd-5501-42e5-ae7f-0b1345101610 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:05.330863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15023afd-5501-42e5-ae7f-0b1345101610 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:05.331537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15023afd-5501-42e5-ae7f-0b1345101610 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:05.469962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b73e6ca0-1b42-407d-a5fb-66aba1b3ceea tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:05.512094 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b73e6ca0-1b42-407d-a5fb-66aba1b3ceea tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1319 microversion: 2.1 time: 0.581477 Aug 29 15:27:05.513022 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 282/581] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:04 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1319 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:05.518303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6bfc6063-7a85-4d6a-8931-9babff0830c0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:05.519083 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6bfc6063-7a85-4d6a-8931-9babff0830c0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:05.525790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bfc6063-7a85-4d6a-8931-9babff0830c0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:05.533337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bfc6063-7a85-4d6a-8931-9babff0830c0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:05.534309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bfc6063-7a85-4d6a-8931-9babff0830c0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:05.548105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bfc6063-7a85-4d6a-8931-9babff0830c0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:05.548852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bfc6063-7a85-4d6a-8931-9babff0830c0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:05.549602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bfc6063-7a85-4d6a-8931-9babff0830c0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:05.894409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-15023afd-5501-42e5-ae7f-0b1345101610 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:05.910947 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-15023afd-5501-42e5-ae7f-0b1345101610 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1316 microversion: 2.1 time: 0.609483 Aug 29 15:27:05.911705 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 300/582] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:05 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1316 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:05.916575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-c2532f21-b9ef-4d66-a31a-0e66346a6ef1 req-28b94953-fc05-4377-9c4c-069cd4a8931f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b83a8f-d9af-4e23-a78a-2eb71813082a", "name": "network-vif-plugged", "status": "completed", "tag": "6dfad95f-5f07-4626-ac31-5a820ebd231e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:05.939769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c2532f21-b9ef-4d66-a31a-0e66346a6ef1 req-28b94953-fc05-4377-9c4c-069cd4a8931f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:05.940650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c2532f21-b9ef-4d66-a31a-0e66346a6ef1 req-28b94953-fc05-4377-9c4c-069cd4a8931f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:05.941332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c2532f21-b9ef-4d66-a31a-0e66346a6ef1 req-28b94953-fc05-4377-9c4c-069cd4a8931f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:05.965202 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-c2532f21-b9ef-4d66-a31a-0e66346a6ef1 req-28b94953-fc05-4377-9c4c-069cd4a8931f service nova] Creating event network-vif-plugged:6dfad95f-5f07-4626-ac31-5a820ebd231e for instance c2b83a8f-d9af-4e23-a78a-2eb71813082a on n-h1-839401-11 Aug 29 15:27:05.983022 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-c2532f21-b9ef-4d66-a31a-0e66346a6ef1 req-28b94953-fc05-4377-9c4c-069cd4a8931f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069587 Aug 29 15:27:05.984063 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 301/583] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:05.998006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-262fca06-d666-4698-a5a2-ea59d988392f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:05.999123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-262fca06-d666-4698-a5a2-ea59d988392f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:06.022793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-262fca06-d666-4698-a5a2-ea59d988392f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:06.024407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-262fca06-d666-4698-a5a2-ea59d988392f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:06.026165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-262fca06-d666-4698-a5a2-ea59d988392f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:06.028454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-262fca06-d666-4698-a5a2-ea59d988392f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:06.040034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-262fca06-d666-4698-a5a2-ea59d988392f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:06.040034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-262fca06-d666-4698-a5a2-ea59d988392f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:06.123120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6bfc6063-7a85-4d6a-8931-9babff0830c0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:06.133651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6bfc6063-7a85-4d6a-8931-9babff0830c0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:06.147186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6bfc6063-7a85-4d6a-8931-9babff0830c0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:06.148436 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6bfc6063-7a85-4d6a-8931-9babff0830c0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1568 microversion: 2.25 time: 0.634128 Aug 29 15:27:06.149007 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 283/584] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:05 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1568 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:06.320222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-262fca06-d666-4698-a5a2-ea59d988392f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:06.320832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-08a5b126-bb82-488f-b5e6-5343b1e022f6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:06.321452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-08a5b126-bb82-488f-b5e6-5343b1e022f6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:06.328640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08a5b126-bb82-488f-b5e6-5343b1e022f6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:06.329578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08a5b126-bb82-488f-b5e6-5343b1e022f6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:06.330117 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-262fca06-d666-4698-a5a2-ea59d988392f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1269 microversion: 2.1 time: 0.343107 Aug 29 15:27:06.331467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08a5b126-bb82-488f-b5e6-5343b1e022f6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:06.332102 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 302/585] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:05 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1269 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:06.349836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08a5b126-bb82-488f-b5e6-5343b1e022f6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:06.350672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08a5b126-bb82-488f-b5e6-5343b1e022f6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:06.356599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08a5b126-bb82-488f-b5e6-5343b1e022f6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:06.538400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-41cf51fd-ef53-4960-8d3d-0603d39c22fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:06.539487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-41cf51fd-ef53-4960-8d3d-0603d39c22fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:06.548216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41cf51fd-ef53-4960-8d3d-0603d39c22fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:06.548712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41cf51fd-ef53-4960-8d3d-0603d39c22fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:06.549187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41cf51fd-ef53-4960-8d3d-0603d39c22fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:06.550137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41cf51fd-ef53-4960-8d3d-0603d39c22fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:06.550594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41cf51fd-ef53-4960-8d3d-0603d39c22fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:06.553238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41cf51fd-ef53-4960-8d3d-0603d39c22fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:06.727716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-08a5b126-bb82-488f-b5e6-5343b1e022f6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:06.741553 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-08a5b126-bb82-488f-b5e6-5343b1e022f6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1471 microversion: 2.1 time: 0.425713 Aug 29 15:27:06.742511 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 284/586] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:06 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1471 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:06.766396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-63225559-a4a3-406c-a460-2607fd8b5aed tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:06.766906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-63225559-a4a3-406c-a460-2607fd8b5aed tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:06.782597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63225559-a4a3-406c-a460-2607fd8b5aed tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:06.783212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63225559-a4a3-406c-a460-2607fd8b5aed tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:06.785854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63225559-a4a3-406c-a460-2607fd8b5aed tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:06.786963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63225559-a4a3-406c-a460-2607fd8b5aed tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:06.787521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63225559-a4a3-406c-a460-2607fd8b5aed tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:06.788915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63225559-a4a3-406c-a460-2607fd8b5aed tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:06.847384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-63225559-a4a3-406c-a460-2607fd8b5aed tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lazy-loading 'flavor' on Instance uuid b5026556-58ce-42c9-9606-f75fbb77c2bf {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:27:06.885404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-41cf51fd-ef53-4960-8d3d-0603d39c22fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:06.895210 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-41cf51fd-ef53-4960-8d3d-0603d39c22fd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1319 microversion: 2.1 time: 0.364969 Aug 29 15:27:06.901876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:06.905002 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 303/587] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:06 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:06.932394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ee9c1643-55f2-4291-92ee-f1db1a970bf3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:06.933346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ee9c1643-55f2-4291-92ee-f1db1a970bf3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:06.942031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee9c1643-55f2-4291-92ee-f1db1a970bf3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:06.944437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee9c1643-55f2-4291-92ee-f1db1a970bf3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:06.945204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee9c1643-55f2-4291-92ee-f1db1a970bf3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:06.946864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee9c1643-55f2-4291-92ee-f1db1a970bf3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:06.953357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee9c1643-55f2-4291-92ee-f1db1a970bf3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:06.954952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee9c1643-55f2-4291-92ee-f1db1a970bf3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:06.982794 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-63225559-a4a3-406c-a460-2607fd8b5aed tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf/action" status: 202 len: 0 microversion: 2.1 time: 0.224089 Aug 29 15:27:06.986610 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 285/588] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:27:06 2022] POST /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:27:06.996396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-842c5fa3-d0dc-4b4f-b68c-ec94fa2803a1 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:06.998066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-842c5fa3-d0dc-4b4f-b68c-ec94fa2803a1 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:07.015900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-842c5fa3-d0dc-4b4f-b68c-ec94fa2803a1 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:07.017076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-842c5fa3-d0dc-4b4f-b68c-ec94fa2803a1 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:07.017772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-842c5fa3-d0dc-4b4f-b68c-ec94fa2803a1 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:07.018747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-842c5fa3-d0dc-4b4f-b68c-ec94fa2803a1 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:07.019367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-842c5fa3-d0dc-4b4f-b68c-ec94fa2803a1 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:07.019950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-842c5fa3-d0dc-4b4f-b68c-ec94fa2803a1 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:07.329075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ee9c1643-55f2-4291-92ee-f1db1a970bf3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:07.337975 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ee9c1643-55f2-4291-92ee-f1db1a970bf3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1316 microversion: 2.1 time: 0.409552 Aug 29 15:27:07.351769 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 304/589] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:06 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:07.357472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-468af563-8772-4f77-a125-2b1be6166529 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:07.358356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-468af563-8772-4f77-a125-2b1be6166529 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:07.365376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-468af563-8772-4f77-a125-2b1be6166529 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:07.366193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-468af563-8772-4f77-a125-2b1be6166529 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:07.366859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-468af563-8772-4f77-a125-2b1be6166529 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:07.367774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-468af563-8772-4f77-a125-2b1be6166529 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:07.368428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-468af563-8772-4f77-a125-2b1be6166529 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:07.369049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-468af563-8772-4f77-a125-2b1be6166529 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:07.632442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-468af563-8772-4f77-a125-2b1be6166529 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:07.652219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-468af563-8772-4f77-a125-2b1be6166529 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:07.654202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-468af563-8772-4f77-a125-2b1be6166529 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:07.655611 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-468af563-8772-4f77-a125-2b1be6166529 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1568 microversion: 2.25 time: 0.302398 Aug 29 15:27:07.656391 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 305/590] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:07 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1568 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:07.670088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f64dfbac-3053-4d47-989b-b97f4b006dda tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:07.671651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f64dfbac-3053-4d47-989b-b97f4b006dda tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:07.678795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f64dfbac-3053-4d47-989b-b97f4b006dda tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:07.679543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f64dfbac-3053-4d47-989b-b97f4b006dda tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:07.680295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f64dfbac-3053-4d47-989b-b97f4b006dda tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:07.693597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f64dfbac-3053-4d47-989b-b97f4b006dda tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:07.694144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f64dfbac-3053-4d47-989b-b97f4b006dda tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:07.694587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f64dfbac-3053-4d47-989b-b97f4b006dda tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:07.767004 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-842c5fa3-d0dc-4b4f-b68c-ec94fa2803a1 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1632 microversion: 2.1 time: 0.775656 Aug 29 15:27:07.771748 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 286/591] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:06 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1632 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:07.942192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b78a4db5-84f4-4cc5-83cf-22ca07caaa15 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:07.942929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b78a4db5-84f4-4cc5-83cf-22ca07caaa15 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:07.966705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b78a4db5-84f4-4cc5-83cf-22ca07caaa15 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:07.967801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b78a4db5-84f4-4cc5-83cf-22ca07caaa15 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:07.968542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b78a4db5-84f4-4cc5-83cf-22ca07caaa15 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:07.969706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b78a4db5-84f4-4cc5-83cf-22ca07caaa15 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:07.970571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b78a4db5-84f4-4cc5-83cf-22ca07caaa15 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:07.971327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b78a4db5-84f4-4cc5-83cf-22ca07caaa15 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:08.145427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f64dfbac-3053-4d47-989b-b97f4b006dda tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:08.161340 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f64dfbac-3053-4d47-989b-b97f4b006dda tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1311 microversion: 2.1 time: 0.503469 Aug 29 15:27:08.185806 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 306/592] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:07 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1311 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:08.198549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-7de4666d-3915-49a5-a5ad-21e68ba74b65 req-42ede17f-1a13-4040-a4fc-d43ac3e654cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e1bd29-189f-45ae-8cfe-ec70a91cf5c1", "name": "network-vif-plugged", "status": "completed", "tag": "bbeff5e6-3289-4102-a95e-bc912e6e924d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:08.212795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7de4666d-3915-49a5-a5ad-21e68ba74b65 req-42ede17f-1a13-4040-a4fc-d43ac3e654cb service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:08.213014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7de4666d-3915-49a5-a5ad-21e68ba74b65 req-42ede17f-1a13-4040-a4fc-d43ac3e654cb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:08.213666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7de4666d-3915-49a5-a5ad-21e68ba74b65 req-42ede17f-1a13-4040-a4fc-d43ac3e654cb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:08.228873 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-7de4666d-3915-49a5-a5ad-21e68ba74b65 req-42ede17f-1a13-4040-a4fc-d43ac3e654cb service nova] Creating event network-vif-plugged:bbeff5e6-3289-4102-a95e-bc912e6e924d for instance 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 on n-h2-839401-11 Aug 29 15:27:08.234678 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-7de4666d-3915-49a5-a5ad-21e68ba74b65 req-42ede17f-1a13-4040-a4fc-d43ac3e654cb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045794 Aug 29 15:27:08.235968 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 307/593] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:08.360742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a80fb77e-9298-4af9-9d96-9dfa1feec9d6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:08.362246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a80fb77e-9298-4af9-9d96-9dfa1feec9d6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:08.369657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a80fb77e-9298-4af9-9d96-9dfa1feec9d6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:08.370159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a80fb77e-9298-4af9-9d96-9dfa1feec9d6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:08.370902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a80fb77e-9298-4af9-9d96-9dfa1feec9d6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:08.371605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a80fb77e-9298-4af9-9d96-9dfa1feec9d6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:08.372273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a80fb77e-9298-4af9-9d96-9dfa1feec9d6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:08.372700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a80fb77e-9298-4af9-9d96-9dfa1feec9d6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:08.459622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b78a4db5-84f4-4cc5-83cf-22ca07caaa15 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:08.468611 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b78a4db5-84f4-4cc5-83cf-22ca07caaa15 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1319 microversion: 2.1 time: 0.546584 Aug 29 15:27:08.470190 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 287/594] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:07 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1319 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:08.680379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6627e8e4-82e4-4396-ae6f-636122009282 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:08.681476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6627e8e4-82e4-4396-ae6f-636122009282 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:08.688761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6627e8e4-82e4-4396-ae6f-636122009282 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:08.689293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6627e8e4-82e4-4396-ae6f-636122009282 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:08.690266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6627e8e4-82e4-4396-ae6f-636122009282 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:08.691185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6627e8e4-82e4-4396-ae6f-636122009282 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:08.691631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6627e8e4-82e4-4396-ae6f-636122009282 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:08.692234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6627e8e4-82e4-4396-ae6f-636122009282 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:08.946367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6627e8e4-82e4-4396-ae6f-636122009282 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:08.957263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6627e8e4-82e4-4396-ae6f-636122009282 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:08.958694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6627e8e4-82e4-4396-ae6f-636122009282 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:08.959910 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6627e8e4-82e4-4396-ae6f-636122009282 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1568 microversion: 2.25 time: 0.283518 Aug 29 15:27:08.960668 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 288/595] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:08 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1568 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:27:08.999678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-82237385-07ba-4f36-8459-1c349e0ab615 req-6932ae5a-9796-4324-a80e-98cf76994653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a6423f-2bd0-4c93-acc1-3cec1fe811ff", "tag": "e0ec5ed9-c9fd-4c5d-98bc-c1fe2504891d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:09.009346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a80fb77e-9298-4af9-9d96-9dfa1feec9d6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:09.022272 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a80fb77e-9298-4af9-9d96-9dfa1feec9d6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1316 microversion: 2.1 time: 0.667150 Aug 29 15:27:09.036718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-82237385-07ba-4f36-8459-1c349e0ab615 req-6932ae5a-9796-4324-a80e-98cf76994653 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:09.036718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-82237385-07ba-4f36-8459-1c349e0ab615 req-6932ae5a-9796-4324-a80e-98cf76994653 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:09.036718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-82237385-07ba-4f36-8459-1c349e0ab615 req-6932ae5a-9796-4324-a80e-98cf76994653 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:09.038570 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 308/596] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:08 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1316 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:09.045419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb2b5da0-f8fe-4e07-8fc9-b07475fe1aa5 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:09.046458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bb2b5da0-f8fe-4e07-8fc9-b07475fe1aa5 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:09.054857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb2b5da0-f8fe-4e07-8fc9-b07475fe1aa5 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:09.055740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb2b5da0-f8fe-4e07-8fc9-b07475fe1aa5 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:09.056696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb2b5da0-f8fe-4e07-8fc9-b07475fe1aa5 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:09.058150 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-82237385-07ba-4f36-8459-1c349e0ab615 req-6932ae5a-9796-4324-a80e-98cf76994653 service nova] Creating event network-changed:e0ec5ed9-c9fd-4c5d-98bc-c1fe2504891d for instance f5a6423f-2bd0-4c93-acc1-3cec1fe811ff on n-h1-839401-11 Aug 29 15:27:09.060629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb2b5da0-f8fe-4e07-8fc9-b07475fe1aa5 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:09.061579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb2b5da0-f8fe-4e07-8fc9-b07475fe1aa5 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:09.062238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb2b5da0-f8fe-4e07-8fc9-b07475fe1aa5 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:09.066151 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-82237385-07ba-4f36-8459-1c349e0ab615 req-6932ae5a-9796-4324-a80e-98cf76994653 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070075 Aug 29 15:27:09.074952 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 289/597] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:09.182527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f6e41dc6-6f6d-4022-b7c4-30138d838dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:09.183800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f6e41dc6-6f6d-4022-b7c4-30138d838dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:09.197477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6e41dc6-6f6d-4022-b7c4-30138d838dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:09.198250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6e41dc6-6f6d-4022-b7c4-30138d838dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:09.198686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6e41dc6-6f6d-4022-b7c4-30138d838dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:09.199582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6e41dc6-6f6d-4022-b7c4-30138d838dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:09.200194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6e41dc6-6f6d-4022-b7c4-30138d838dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:09.213959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6e41dc6-6f6d-4022-b7c4-30138d838dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:09.624188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f6e41dc6-6f6d-4022-b7c4-30138d838dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:09.637731 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f6e41dc6-6f6d-4022-b7c4-30138d838dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1311 microversion: 2.1 time: 0.458274 Aug 29 15:27:09.639160 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 290/598] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:09 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1311 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:09.648794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a8fd8176-5b7b-41e1-b6f9-9bb6312fcef9 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:09.654535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a8fd8176-5b7b-41e1-b6f9-9bb6312fcef9 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:09.669934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8fd8176-5b7b-41e1-b6f9-9bb6312fcef9 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:09.670578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8fd8176-5b7b-41e1-b6f9-9bb6312fcef9 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:09.671667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8fd8176-5b7b-41e1-b6f9-9bb6312fcef9 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:09.676199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8fd8176-5b7b-41e1-b6f9-9bb6312fcef9 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:09.677060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8fd8176-5b7b-41e1-b6f9-9bb6312fcef9 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:09.677734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8fd8176-5b7b-41e1-b6f9-9bb6312fcef9 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:09.711626 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bb2b5da0-f8fe-4e07-8fc9-b07475fe1aa5 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1615 microversion: 2.1 time: 0.671370 Aug 29 15:27:09.727797 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 309/599] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:09 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1615 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:09.740533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d00e0820-015c-41ef-9fbf-599b82d3cdd8 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:09.741135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d00e0820-015c-41ef-9fbf-599b82d3cdd8 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:09.755636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d00e0820-015c-41ef-9fbf-599b82d3cdd8 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:09.756320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d00e0820-015c-41ef-9fbf-599b82d3cdd8 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:09.756762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d00e0820-015c-41ef-9fbf-599b82d3cdd8 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:09.757496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d00e0820-015c-41ef-9fbf-599b82d3cdd8 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:09.760295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d00e0820-015c-41ef-9fbf-599b82d3cdd8 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:09.760945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d00e0820-015c-41ef-9fbf-599b82d3cdd8 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:09.928258 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-d00e0820-015c-41ef-9fbf-599b82d3cdd8 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] HTTP exception thrown: Cannot 'migrate' instance b5026556-58ce-42c9-9606-f75fbb77c2bf while it is in vm_state suspended Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d00e0820-015c-41ef-9fbf-599b82d3cdd8 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Request method failure captured: Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf/action HTTP/1.1 Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 15 Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNqPT7iohAqcNPmZsCWSJaZHQ4c20FA1meyxBi93zBoOdMMaHysQNxn3LDfbabBVxzUBlKnOBazSQjDabV5OS0aXL7BUYoB5pueT8yyrkC3jPaL0DwI-jLHOdO2s4eho-MHBAPwtd9zZv0MFuPxq57uJa29FBLuKn28kTztsmJeOPxc Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: f63fe3e4102445219a161ea8880e0c6a Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1595742544 Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:27:09.932610 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:27:09.934254 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f63fe3e4102445219a161ea8880e0c6a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f63fe3e4102445219a161ea8880e0c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f63fe3e4102445219a161ea8880e0c6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f63fe3e4102445219a161ea8880e0c6a"}]}] Aug 29 15:27:09.934254 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1595742544 Aug 29 15:27:09.934254 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: f63fe3e4102445219a161ea8880e0c6a Aug 29 15:27:09.934254 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1595742544 Aug 29 15:27:09.934254 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersAdminNegativeTestJSON-1595742544-project-admin Aug 29 15:27:09.934254 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:27:09.934254 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:27:09.934254 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 85c62ded2c864d3b866ee07d39804812 Aug 29 15:27:09.934254 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1595742544-project-admin Aug 29 15:27:09.934254 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:27:09.934254 n-d-839401-11 devstack@n-api.service[122361]: {"migrate": {}} Aug 29 15:27:09.934254 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:27:09.934254 n-d-839401-11 devstack@n-api.service[122361]: exception: Cannot 'migrate' instance b5026556-58ce-42c9-9606-f75fbb77c2bf while it is in vm_state suspended Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'b5026556-58ce-42c9-9606-f75fbb77c2bf', 'body': {'migrate': {}}} Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b5026556-58ce-42c9-9606-f75fbb77c2bf in vm_state suspended. Cannot resize while the instance is in this state. Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:09.935193 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance b5026556-58ce-42c9-9606-f75fbb77c2bf while it is in vm_state suspended Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:09.936616 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:09.937970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:09.937970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:09.937970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance b5026556-58ce-42c9-9606-f75fbb77c2bf while it is in vm_state suspended Aug 29 15:27:09.937970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:09.937970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d00e0820-015c-41ef-9fbf-599b82d3cdd8 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Returning 409 to user: Cannot 'migrate' instance b5026556-58ce-42c9-9606-f75fbb77c2bf while it is in vm_state suspended {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:09.937970 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d00e0820-015c-41ef-9fbf-599b82d3cdd8 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf/action" status: 409 len: 148 microversion: 2.1 time: 0.197545 Aug 29 15:27:09.940551 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 310/600] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:27:09 2022] POST /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf/action => generated 148 bytes in 204 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:27:09.958335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1ba97ddf-0e6e-4017-a584-8377da3a6236 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1ba97ddf-0e6e-4017-a584-8377da3a6236 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Request method failure captured: Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41/action HTTP/1.1 Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 39 Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNqPT7iohAqcNPmZsCWSJaZHQ4c20FA1meyxBi93zBoOdMMaHysQNxn3LDfbabBVxzUBlKnOBazSQjDabV5OS0aXL7BUYoB5pueT8yyrkC3jPaL0DwI-jLHOdO2s4eho-MHBAPwtd9zZv0MFuPxq57uJa29FBLuKn28kTztsmJeOPxc Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: f63fe3e4102445219a161ea8880e0c6a Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1595742544 Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:27:09.966253 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:27:09.967932 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f63fe3e4102445219a161ea8880e0c6a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f63fe3e4102445219a161ea8880e0c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f63fe3e4102445219a161ea8880e0c6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f63fe3e4102445219a161ea8880e0c6a"}]}] Aug 29 15:27:09.967932 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1595742544 Aug 29 15:27:09.967932 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: f63fe3e4102445219a161ea8880e0c6a Aug 29 15:27:09.967932 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1595742544 Aug 29 15:27:09.967932 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersAdminNegativeTestJSON-1595742544-project-admin Aug 29 15:27:09.967932 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:27:09.967932 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:27:09.967932 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 85c62ded2c864d3b866ee07d39804812 Aug 29 15:27:09.967932 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1595742544-project-admin Aug 29 15:27:09.967932 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:27:09.967932 n-d-839401-11 devstack@n-api.service[122361]: {"os-resetState": {"state": "invalid"}} Aug 29 15:27:09.967932 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '210b41e1-4270-4fb9-99e9-894536b94b41', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:09.968794 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:27:09.971112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 29 15:27:09.972521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:09.974264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1ba97ddf-0e6e-4017-a584-8377da3a6236 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:09.975966 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1ba97ddf-0e6e-4017-a584-8377da3a6236 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41/action" status: 400 len: 144 microversion: 2.1 time: 0.026546 Aug 29 15:27:09.977116 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 311/601] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:27:09 2022] POST /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41/action => generated 144 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:27:09.992960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e6a23002-8009-47ab-9753-b1872719529c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:09.994224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e6a23002-8009-47ab-9753-b1872719529c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:09.997138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a8fd8176-5b7b-41e1-b6f9-9bb6312fcef9 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:10.002759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6a23002-8009-47ab-9753-b1872719529c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:10.003821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6a23002-8009-47ab-9753-b1872719529c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:10.004595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6a23002-8009-47ab-9753-b1872719529c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:10.005718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6a23002-8009-47ab-9753-b1872719529c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:10.007119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6a23002-8009-47ab-9753-b1872719529c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:10.007733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6a23002-8009-47ab-9753-b1872719529c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:10.008919 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a8fd8176-5b7b-41e1-b6f9-9bb6312fcef9 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1319 microversion: 2.1 time: 0.367314 Aug 29 15:27:10.009582 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 291/602] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:09 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:10.018570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1bf44bdc-4a9b-4579-8d4e-670131e796d6 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1bf44bdc-4a9b-4579-8d4e-670131e796d6 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Request method failure captured: Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41/action HTTP/1.1 Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 31 Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqPT7iohAqcNPmZsCWSJaZHQ4c20FA1meyxBi93zBoOdMMaHysQNxn3LDfbabBVxzUBlKnOBazSQjDabV5OS0aXL7BUYoB5pueT8yyrkC3jPaL0DwI-jLHOdO2s4eho-MHBAPwtd9zZv0MFuPxq57uJa29FBLuKn28kTztsmJeOPxc Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: f63fe3e4102445219a161ea8880e0c6a Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1595742544 Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:27:10.027567 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:27:10.029570 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f63fe3e4102445219a161ea8880e0c6a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f63fe3e4102445219a161ea8880e0c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f63fe3e4102445219a161ea8880e0c6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f63fe3e4102445219a161ea8880e0c6a"}]}] Aug 29 15:27:10.029570 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1595742544 Aug 29 15:27:10.029570 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: f63fe3e4102445219a161ea8880e0c6a Aug 29 15:27:10.029570 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1595742544 Aug 29 15:27:10.029570 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersAdminNegativeTestJSON-1595742544-project-admin Aug 29 15:27:10.029570 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:27:10.029570 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:27:10.029570 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 85c62ded2c864d3b866ee07d39804812 Aug 29 15:27:10.029570 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1595742544-project-admin Aug 29 15:27:10.029570 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:27:10.029570 n-d-839401-11 devstack@n-api.service[122360]: {"os-resetState": {"state": 1}} Aug 29 15:27:10.029570 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:27:10.029570 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '210b41e1-4270-4fb9-99e9-894536b94b41', 'body': {'os-resetState': {'state': 1}}} Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 1 Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:10.030553 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 29 15:27:10.033802 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:10.035498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1bf44bdc-4a9b-4579-8d4e-670131e796d6 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:10.035498 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1bf44bdc-4a9b-4579-8d4e-670131e796d6 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41/action" status: 400 len: 120 microversion: 2.1 time: 0.018304 Aug 29 15:27:10.035498 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 292/603] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:27:10 2022] POST /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41/action => generated 120 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:27:10.044842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-77bc7f12-a72d-4116-bfb5-cda0cf72fd82 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:10.047350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-77bc7f12-a72d-4116-bfb5-cda0cf72fd82 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Failed to fetch instance by id 999 {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:27:10.047629 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-77bc7f12-a72d-4116-bfb5-cda0cf72fd82 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-77bc7f12-a72d-4116-bfb5-cda0cf72fd82 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Request method failure captured: Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 37 Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqPT7iohAqcNPmZsCWSJaZHQ4c20FA1meyxBi93zBoOdMMaHysQNxn3LDfbabBVxzUBlKnOBazSQjDabV5OS0aXL7BUYoB5pueT8yyrkC3jPaL0DwI-jLHOdO2s4eho-MHBAPwtd9zZv0MFuPxq57uJa29FBLuKn28kTztsmJeOPxc Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: f63fe3e4102445219a161ea8880e0c6a Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1595742544 Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:27:10.061759 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:27:10.063366 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f63fe3e4102445219a161ea8880e0c6a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f63fe3e4102445219a161ea8880e0c6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f63fe3e4102445219a161ea8880e0c6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f63fe3e4102445219a161ea8880e0c6a"}]}] Aug 29 15:27:10.063366 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1595742544 Aug 29 15:27:10.063366 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: f63fe3e4102445219a161ea8880e0c6a Aug 29 15:27:10.063366 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1595742544 Aug 29 15:27:10.063366 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersAdminNegativeTestJSON-1595742544-project-admin Aug 29 15:27:10.063366 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:27:10.063366 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:27:10.063366 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 85c62ded2c864d3b866ee07d39804812 Aug 29 15:27:10.063366 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1595742544-project-admin Aug 29 15:27:10.063366 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:27:10.063366 n-d-839401-11 devstack@n-api.service[122360]: {"os-resetState": {"state": "error"}} Aug 29 15:27:10.063366 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:27:10.063366 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 999 could not be found. Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:10.064374 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 29 15:27:10.065929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:27:10.065929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:27:10.065929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:10.065929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 29 15:27:10.065929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:10.065929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:10.065929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:10.065929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:10.065929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:10.065929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:10.065929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:10.065929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:10.065929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 29 15:27:10.065929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:10.065929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-77bc7f12-a72d-4116-bfb5-cda0cf72fd82 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:10.065929 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-77bc7f12-a72d-4116-bfb5-cda0cf72fd82 tempest-ServersAdminNegativeTestJSON-1595742544 tempest-ServersAdminNegativeTestJSON-1595742544-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.024088 Aug 29 15:27:10.070552 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 293/604] 10.222.0.62 () {60 vars in 1179 bytes} [Mon Aug 29 15:27:10 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:27:10.083192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2a8b9031-11ce-4a45-a7ea-b96cbe3914e3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:10.083849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2a8b9031-11ce-4a45-a7ea-b96cbe3914e3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:10.099749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a8b9031-11ce-4a45-a7ea-b96cbe3914e3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:10.105238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a8b9031-11ce-4a45-a7ea-b96cbe3914e3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:10.105743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a8b9031-11ce-4a45-a7ea-b96cbe3914e3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:10.106515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a8b9031-11ce-4a45-a7ea-b96cbe3914e3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:10.107017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a8b9031-11ce-4a45-a7ea-b96cbe3914e3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:10.107452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a8b9031-11ce-4a45-a7ea-b96cbe3914e3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:10.326454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e6a23002-8009-47ab-9753-b1872719529c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:10.343771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e6a23002-8009-47ab-9753-b1872719529c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:10.347322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e6a23002-8009-47ab-9753-b1872719529c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:10.348620 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e6a23002-8009-47ab-9753-b1872719529c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1568 microversion: 2.25 time: 0.365794 Aug 29 15:27:10.349207 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 312/605] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:09 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1568 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:27:10.358025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c12e769d-9283-453c-b133-440c88423abb tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:10.358524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c12e769d-9283-453c-b133-440c88423abb tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:10.379400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c12e769d-9283-453c-b133-440c88423abb tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:10.380751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c12e769d-9283-453c-b133-440c88423abb tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:10.382923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c12e769d-9283-453c-b133-440c88423abb tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:10.384836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c12e769d-9283-453c-b133-440c88423abb tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:10.385451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c12e769d-9283-453c-b133-440c88423abb tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:10.385953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c12e769d-9283-453c-b133-440c88423abb tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:10.387046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2a8b9031-11ce-4a45-a7ea-b96cbe3914e3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:10.420963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:10.425803 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2a8b9031-11ce-4a45-a7ea-b96cbe3914e3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1316 microversion: 2.1 time: 0.353997 Aug 29 15:27:10.430439 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 294/606] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:10 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:10.460556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c12e769d-9283-453c-b133-440c88423abb tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:27:10.629704 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c12e769d-9283-453c-b133-440c88423abb tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 204 len: 0 microversion: 2.1 time: 0.279022 Aug 29 15:27:10.634395 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 313/607] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:27:10 2022] DELETE /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:27:10.638948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0746a043-c6b3-48ce-b723-a338538ef823 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:10.639923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0746a043-c6b3-48ce-b723-a338538ef823 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:10.661418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2785983c-bb3a-41e6-a819-f90b04cdf124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:10.662143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2785983c-bb3a-41e6-a819-f90b04cdf124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:10.662289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0746a043-c6b3-48ce-b723-a338538ef823 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:10.662813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0746a043-c6b3-48ce-b723-a338538ef823 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:10.663332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0746a043-c6b3-48ce-b723-a338538ef823 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:10.664076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0746a043-c6b3-48ce-b723-a338538ef823 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:10.666791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0746a043-c6b3-48ce-b723-a338538ef823 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:10.667426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0746a043-c6b3-48ce-b723-a338538ef823 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:10.673404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2785983c-bb3a-41e6-a819-f90b04cdf124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:10.673918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2785983c-bb3a-41e6-a819-f90b04cdf124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:10.674362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2785983c-bb3a-41e6-a819-f90b04cdf124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:10.675095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2785983c-bb3a-41e6-a819-f90b04cdf124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:10.675535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2785983c-bb3a-41e6-a819-f90b04cdf124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:10.680224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2785983c-bb3a-41e6-a819-f90b04cdf124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:11.175614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2785983c-bb3a-41e6-a819-f90b04cdf124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:11.188519 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2785983c-bb3a-41e6-a819-f90b04cdf124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1311 microversion: 2.1 time: 0.531686 Aug 29 15:27:11.203215 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 314/608] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:10 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1311 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:11.208634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eb7d3290-81c7-4065-bc3b-c1a1f006c754 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:11.209282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eb7d3290-81c7-4065-bc3b-c1a1f006c754 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:11.225633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb7d3290-81c7-4065-bc3b-c1a1f006c754 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:11.226126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb7d3290-81c7-4065-bc3b-c1a1f006c754 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:11.226563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb7d3290-81c7-4065-bc3b-c1a1f006c754 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:11.227282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb7d3290-81c7-4065-bc3b-c1a1f006c754 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:11.227744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb7d3290-81c7-4065-bc3b-c1a1f006c754 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:11.228154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb7d3290-81c7-4065-bc3b-c1a1f006c754 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:11.517270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eb7d3290-81c7-4065-bc3b-c1a1f006c754 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:11.530126 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eb7d3290-81c7-4065-bc3b-c1a1f006c754 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1469 microversion: 2.1 time: 0.324479 Aug 29 15:27:11.557946 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 315/609] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:11 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1469 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:11.564026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-61a25268-f072-47eb-bb56-e7cae814d9ef tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:11.564899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-61a25268-f072-47eb-bb56-e7cae814d9ef tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:11.574632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61a25268-f072-47eb-bb56-e7cae814d9ef tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:11.575355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61a25268-f072-47eb-bb56-e7cae814d9ef tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:11.575973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61a25268-f072-47eb-bb56-e7cae814d9ef tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:11.576879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61a25268-f072-47eb-bb56-e7cae814d9ef tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:11.577558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61a25268-f072-47eb-bb56-e7cae814d9ef tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:11.578165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61a25268-f072-47eb-bb56-e7cae814d9ef tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:11.653536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0746a043-c6b3-48ce-b723-a338538ef823 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:11.669138 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0746a043-c6b3-48ce-b723-a338538ef823 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1468 microversion: 2.1 time: 1.034224 Aug 29 15:27:11.670322 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 295/610] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:10 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1468 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:11.675912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2e7dc6e2-6b58-4d6d-ad90-84ef30a11073 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:11.676932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2e7dc6e2-6b58-4d6d-ad90-84ef30a11073 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:11.685292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e7dc6e2-6b58-4d6d-ad90-84ef30a11073 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:11.686699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e7dc6e2-6b58-4d6d-ad90-84ef30a11073 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:11.687365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e7dc6e2-6b58-4d6d-ad90-84ef30a11073 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:11.688233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e7dc6e2-6b58-4d6d-ad90-84ef30a11073 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:11.688898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e7dc6e2-6b58-4d6d-ad90-84ef30a11073 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:11.689486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e7dc6e2-6b58-4d6d-ad90-84ef30a11073 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:11.860607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-61a25268-f072-47eb-bb56-e7cae814d9ef tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:11.894502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-61a25268-f072-47eb-bb56-e7cae814d9ef tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:11.900273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-61a25268-f072-47eb-bb56-e7cae814d9ef tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:11.901650 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-61a25268-f072-47eb-bb56-e7cae814d9ef tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1568 microversion: 2.25 time: 0.342226 Aug 29 15:27:11.924032 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 316/611] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:11 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1568 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:11.933863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:11.935955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:12.146774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cddefee4-ca50-4f1b-95c8-29c986c28cfc tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1425845165", "block_migration": true, "disk_over_commit": false}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:12.149834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cddefee4-ca50-4f1b-95c8-29c986c28cfc tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:12.160843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cddefee4-ca50-4f1b-95c8-29c986c28cfc tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:12.167102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cddefee4-ca50-4f1b-95c8-29c986c28cfc tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:12.168467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cddefee4-ca50-4f1b-95c8-29c986c28cfc tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:12.169510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cddefee4-ca50-4f1b-95c8-29c986c28cfc tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:12.170349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cddefee4-ca50-4f1b-95c8-29c986c28cfc tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:12.170982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cddefee4-ca50-4f1b-95c8-29c986c28cfc tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:12.256427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2e7dc6e2-6b58-4d6d-ad90-84ef30a11073 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:12.265943 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2e7dc6e2-6b58-4d6d-ad90-84ef30a11073 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1466 microversion: 2.1 time: 0.594207 Aug 29 15:27:12.268366 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 296/612] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:11 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1466 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:12.276736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-cddefee4-ca50-4f1b-95c8-29c986c28cfc tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lazy-loading 'flavor' on Instance uuid c2b83a8f-d9af-4e23-a78a-2eb71813082a {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:27:12.281540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-95016123-0279-4f1e-aaee-10fb16501564 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:12.282485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-95016123-0279-4f1e-aaee-10fb16501564 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:12.296535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95016123-0279-4f1e-aaee-10fb16501564 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:12.297508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95016123-0279-4f1e-aaee-10fb16501564 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:12.298303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95016123-0279-4f1e-aaee-10fb16501564 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:12.299984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95016123-0279-4f1e-aaee-10fb16501564 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:12.300777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95016123-0279-4f1e-aaee-10fb16501564 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:12.301471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95016123-0279-4f1e-aaee-10fb16501564 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:12.368604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cddefee4-ca50-4f1b-95c8-29c986c28cfc tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Going to try to live migrate instance to tempest-host-1425845165 {{(pid=122361) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:27:12.378138 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-cddefee4-ca50-4f1b-95c8-29c986c28cfc tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] HTTP exception thrown: Compute host tempest-host-1425845165 could not be found. Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cddefee4-ca50-4f1b-95c8-29c986c28cfc tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Request method failure captured: Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a/action HTTP/1.1 Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 107 Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNqzZcxKho5sSnI9EQLkDbyf6vLKy50UIYhKaFamgzv5krMJ6gSqpo6E3B4BIIuC48xLnYo_8VX6G_HVnqMciZgoIe1Sr-5aP52o89NWeVBYptZjO9FMbMD23k0MesCoBx8qlxn-wunBxV5X-QTJ9bzUx1W32sx-hZlkzSEy2NTmTHM Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: ed50d792be774f549c717ab9c0312aa0 Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-LiveMigrationNegativeTest-984807124 Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:27:12.383030 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:27:12.384480 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ed50d792be774f549c717ab9c0312aa0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ed50d792be774f549c717ab9c0312aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ed50d792be774f549c717ab9c0312aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ed50d792be774f549c717ab9c0312aa0"}]}] Aug 29 15:27:12.384480 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-LiveMigrationNegativeTest-984807124 Aug 29 15:27:12.384480 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: ed50d792be774f549c717ab9c0312aa0 Aug 29 15:27:12.384480 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-984807124 Aug 29 15:27:12.384480 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-LiveMigrationNegativeTest-984807124-project-admin Aug 29 15:27:12.384480 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:27:12.384480 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:27:12.384480 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 2aed3bffd52f49f2a963b53516f62135 Aug 29 15:27:12.384480 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-LiveMigrationNegativeTest-984807124-project-admin Aug 29 15:27:12.384480 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:27:12.384480 n-d-839401-11 devstack@n-api.service[122361]: {"os-migrateLive": {"host": "tempest-host-1425845165", "block_migration": true, "disk_over_commit": false}} Aug 29 15:27:12.384480 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: exception: Compute host tempest-host-1425845165 could not be found. Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'c2b83a8f-d9af-4e23-a78a-2eb71813082a', 'body': {'os-migrateLive': {'host': 'tempest-host-1425845165', 'block_migration': True, 'disk_over_commit': False}}} Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:27:12.385476 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1425845165 could not be found. Aug 29 15:27:12.386586 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1425845165 could not be found. Aug 29 15:27:12.387729 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:12.388881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:12.388881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:12.388881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:12.388881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:12.388881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:12.388881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:12.388881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:12.388881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1425845165 could not be found. Aug 29 15:27:12.388881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:12.392897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cddefee4-ca50-4f1b-95c8-29c986c28cfc tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Returning 400 to user: Compute host tempest-host-1425845165 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:12.394037 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cddefee4-ca50-4f1b-95c8-29c986c28cfc tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a/action" status: 400 len: 100 microversion: 2.1 time: 0.468607 Aug 29 15:27:12.394874 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 317/613] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Aug 29 15:27:11 2022] POST /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a/action => generated 100 bytes in 470 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:27:12.472577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c6b2ba1b-cc5e-416b-a734-c495cbf58c81 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:12.473848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c6b2ba1b-cc5e-416b-a734-c495cbf58c81 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:12.483034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6b2ba1b-cc5e-416b-a734-c495cbf58c81 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:12.483963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6b2ba1b-cc5e-416b-a734-c495cbf58c81 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:12.484581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6b2ba1b-cc5e-416b-a734-c495cbf58c81 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:12.485770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6b2ba1b-cc5e-416b-a734-c495cbf58c81 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:12.486364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6b2ba1b-cc5e-416b-a734-c495cbf58c81 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:12.487283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6b2ba1b-cc5e-416b-a734-c495cbf58c81 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:12.633594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-95016123-0279-4f1e-aaee-10fb16501564 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:12.649433 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-95016123-0279-4f1e-aaee-10fb16501564 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1311 microversion: 2.1 time: 0.377653 Aug 29 15:27:12.665455 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 297/614] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:12 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1311 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:12.672462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-78d61076-7e93-4d91-b179-4f1deddd4fd7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:12.673503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-78d61076-7e93-4d91-b179-4f1deddd4fd7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:12.681562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d61076-7e93-4d91-b179-4f1deddd4fd7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:12.682410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d61076-7e93-4d91-b179-4f1deddd4fd7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:12.684059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d61076-7e93-4d91-b179-4f1deddd4fd7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:12.686244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d61076-7e93-4d91-b179-4f1deddd4fd7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:12.687148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d61076-7e93-4d91-b179-4f1deddd4fd7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:12.688315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d61076-7e93-4d91-b179-4f1deddd4fd7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:13.045770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-78d61076-7e93-4d91-b179-4f1deddd4fd7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:13.068767 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-78d61076-7e93-4d91-b179-4f1deddd4fd7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1469 microversion: 2.1 time: 0.400383 Aug 29 15:27:13.085960 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 298/615] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:12 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1469 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:13.093208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8608d166-71f4-4ef5-9b80-17d36286cb40 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:13.094239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8608d166-71f4-4ef5-9b80-17d36286cb40 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:13.105430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8608d166-71f4-4ef5-9b80-17d36286cb40 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:13.109503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8608d166-71f4-4ef5-9b80-17d36286cb40 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:13.110048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8608d166-71f4-4ef5-9b80-17d36286cb40 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:13.111883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8608d166-71f4-4ef5-9b80-17d36286cb40 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:13.113052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8608d166-71f4-4ef5-9b80-17d36286cb40 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:13.115366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8608d166-71f4-4ef5-9b80-17d36286cb40 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:13.847184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8608d166-71f4-4ef5-9b80-17d36286cb40 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:13.860081 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8608d166-71f4-4ef5-9b80-17d36286cb40 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1468 microversion: 2.1 time: 0.775670 Aug 29 15:27:13.860933 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 299/616] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:13 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1468 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:13.874275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2b40777e-c94d-44a1-84d8-c3c34240a686 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:13.874690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2b40777e-c94d-44a1-84d8-c3c34240a686 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:13.888093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b40777e-c94d-44a1-84d8-c3c34240a686 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:13.888565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b40777e-c94d-44a1-84d8-c3c34240a686 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:13.889007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b40777e-c94d-44a1-84d8-c3c34240a686 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:13.889751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b40777e-c94d-44a1-84d8-c3c34240a686 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:13.890105 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c6b2ba1b-cc5e-416b-a734-c495cbf58c81 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1619 microversion: 2.1 time: 1.493851 Aug 29 15:27:13.890562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b40777e-c94d-44a1-84d8-c3c34240a686 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:13.890652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b40777e-c94d-44a1-84d8-c3c34240a686 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:13.891827 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 318/617] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:12 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1619 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:13.926367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-65016738", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:13.987506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:27:14.162938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2b40777e-c94d-44a1-84d8-c3c34240a686 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:14.172218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2b40777e-c94d-44a1-84d8-c3c34240a686 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:14.173722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2b40777e-c94d-44a1-84d8-c3c34240a686 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:14.174899 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2b40777e-c94d-44a1-84d8-c3c34240a686 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1558 microversion: 2.25 time: 0.308469 Aug 29 15:27:14.175467 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 300/618] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:13 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1558 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:14.179934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-afee0311-0725-44b8-8c1b-54dd48f7f06c req-fa75463b-b000-4834-bc55-41860cc5a950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89c49de-27db-4e19-a013-217c6075debb", "name": "network-vif-plugged", "status": "completed", "tag": "0b3487a8-bae5-4c07-9952-d6c8810ee302"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:14.189722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-afee0311-0725-44b8-8c1b-54dd48f7f06c req-fa75463b-b000-4834-bc55-41860cc5a950 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:14.190448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-afee0311-0725-44b8-8c1b-54dd48f7f06c req-fa75463b-b000-4834-bc55-41860cc5a950 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:14.191023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-afee0311-0725-44b8-8c1b-54dd48f7f06c req-fa75463b-b000-4834-bc55-41860cc5a950 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:14.203938 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-afee0311-0725-44b8-8c1b-54dd48f7f06c req-fa75463b-b000-4834-bc55-41860cc5a950 service nova] Creating event network-vif-plugged:0b3487a8-bae5-4c07-9952-d6c8810ee302 for instance a89c49de-27db-4e19-a013-217c6075debb on n-h1-839401-11 Aug 29 15:27:14.217639 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-afee0311-0725-44b8-8c1b-54dd48f7f06c req-fa75463b-b000-4834-bc55-41860cc5a950 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040336 Aug 29 15:27:14.219012 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 301/619] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:14.226663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d36be2b1-1fac-40d1-936f-ee4afd6de28c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:14.227797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d36be2b1-1fac-40d1-936f-ee4afd6de28c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:14.235566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d36be2b1-1fac-40d1-936f-ee4afd6de28c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:14.236103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d36be2b1-1fac-40d1-936f-ee4afd6de28c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:14.236807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d36be2b1-1fac-40d1-936f-ee4afd6de28c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:14.238209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d36be2b1-1fac-40d1-936f-ee4afd6de28c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:14.239085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d36be2b1-1fac-40d1-936f-ee4afd6de28c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:14.239713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d36be2b1-1fac-40d1-936f-ee4afd6de28c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:14.501786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:27:14.502199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:27:14.503180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:27:14.503761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:27:14.504500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:27:14.533771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:14.534357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:14.535063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:14.535970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:14.536688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:14.537558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:14.572245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Getting quotas for project dd0dbe26a46a40afade4fdb4e7e6aed6. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:14.576407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d36be2b1-1fac-40d1-936f-ee4afd6de28c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:14.579427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Getting quotas for user f102bed161a64edc82820db2e358017b and project dd0dbe26a46a40afade4fdb4e7e6aed6. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:14.602337 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d36be2b1-1fac-40d1-936f-ee4afd6de28c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1311 microversion: 2.1 time: 0.377482 Aug 29 15:27:14.602550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:27:14.613276 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 302/620] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:14 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1311 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:14.613509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:27:14.613645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-29f6ccea-4379-4d94-a9c2-e7581c92734e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Action: 'create', calling method: .version_select at 0x7fc42be021f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1525832612", "policies": ["affinity"]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:14.626268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:14.635974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-29f6ccea-4379-4d94-a9c2-e7581c92734e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_groups'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:14.642267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-29f6ccea-4379-4d94-a9c2-e7581c92734e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_groups'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:14.687066 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-03f2b12d-016b-4096-a55d-45164900ef96 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793836 Aug 29 15:27:14.688955 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 319/621] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:27:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:27:14.702459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3a148dcd-698b-4df0-a643-ac3aceeca16f tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '.version_select at 0x7fc42bec3820>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:14.707179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a148dcd-698b-4df0-a643-ac3aceeca16f tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:14.707621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-29f6ccea-4379-4d94-a9c2-e7581c92734e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_groups'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:14.708260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a148dcd-698b-4df0-a643-ac3aceeca16f tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:14.708869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a148dcd-698b-4df0-a643-ac3aceeca16f tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:14.720014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-29f6ccea-4379-4d94-a9c2-e7581c92734e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_groups'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:14.729214 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3a148dcd-698b-4df0-a643-ac3aceeca16f tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/os-migrations" status: 200 len: 684 microversion: 2.25 time: 0.032174 Aug 29 15:27:14.730649 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 320/622] 10.222.0.62 () {60 vars in 1184 bytes} [Mon Aug 29 15:27:14 2022] GET /compute/v2.1/os-migrations => generated 684 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:27:14.736732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-19ff6a1f-0f66-4125-baf0-338fb275009a req-891961da-fc17-4376-9991-338897ecee0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5026556-58ce-42c9-9606-f75fbb77c2bf", "name": "network-vif-deleted", "tag": "9b1727cd-673b-4493-96b0-efd887ebebc8"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:14.751197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-19ff6a1f-0f66-4125-baf0-338fb275009a req-891961da-fc17-4376-9991-338897ecee0e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:14.751833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-19ff6a1f-0f66-4125-baf0-338fb275009a req-891961da-fc17-4376-9991-338897ecee0e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:14.752259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-19ff6a1f-0f66-4125-baf0-338fb275009a req-891961da-fc17-4376-9991-338897ecee0e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:14.755123 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-29f6ccea-4379-4d94-a9c2-e7581c92734e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.149917 Aug 29 15:27:14.757457 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 303/623] 10.222.0.62 () {60 vars in 1174 bytes} [Mon Aug 29 15:27:14 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:14.762748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cb9a4ddf-93b7-49b4-baf1-5e7ecf05ff37 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:14.763733 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-19ff6a1f-0f66-4125-baf0-338fb275009a req-891961da-fc17-4376-9991-338897ecee0e service nova] Creating event network-vif-deleted:9b1727cd-673b-4493-96b0-efd887ebebc8 for instance b5026556-58ce-42c9-9606-f75fbb77c2bf on n-h2-839401-11 Aug 29 15:27:14.764209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cb9a4ddf-93b7-49b4-baf1-5e7ecf05ff37 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:14.769731 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-19ff6a1f-0f66-4125-baf0-338fb275009a req-891961da-fc17-4376-9991-338897ecee0e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037596 Aug 29 15:27:14.771090 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 321/624] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:14.777985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-52251c4b-18d4-4d82-949a-9270ba178b05 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:14.779834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-52251c4b-18d4-4d82-949a-9270ba178b05 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:14.792280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52251c4b-18d4-4d82-949a-9270ba178b05 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:14.793846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52251c4b-18d4-4d82-949a-9270ba178b05 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:14.794470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52251c4b-18d4-4d82-949a-9270ba178b05 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:14.795400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52251c4b-18d4-4d82-949a-9270ba178b05 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:14.796359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52251c4b-18d4-4d82-949a-9270ba178b05 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:14.796941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52251c4b-18d4-4d82-949a-9270ba178b05 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:14.872239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cb9a4ddf-93b7-49b4-baf1-5e7ecf05ff37 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:14.883657 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cb9a4ddf-93b7-49b4-baf1-5e7ecf05ff37 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 200 len: 1217 microversion: 2.1 time: 0.125011 Aug 29 15:27:14.897678 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 304/625] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:14 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 1217 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:14.902952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1422146c-8dc5-43f3-8768-83668c6d1ac6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:14.904201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1422146c-8dc5-43f3-8768-83668c6d1ac6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:14.911958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1422146c-8dc5-43f3-8768-83668c6d1ac6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:14.912730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1422146c-8dc5-43f3-8768-83668c6d1ac6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:14.913375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1422146c-8dc5-43f3-8768-83668c6d1ac6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:14.914264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1422146c-8dc5-43f3-8768-83668c6d1ac6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:14.914868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1422146c-8dc5-43f3-8768-83668c6d1ac6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:14.915562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1422146c-8dc5-43f3-8768-83668c6d1ac6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:14.961768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1422146c-8dc5-43f3-8768-83668c6d1ac6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:14.962362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1422146c-8dc5-43f3-8768-83668c6d1ac6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:14.962943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1422146c-8dc5-43f3-8768-83668c6d1ac6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:14.963480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-1422146c-8dc5-43f3-8768-83668c6d1ac6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lazy-loading 'fault' on Instance uuid b5026556-58ce-42c9-9606-f75fbb77c2bf {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:27:15.067261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-52251c4b-18d4-4d82-949a-9270ba178b05 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'services' on Instance uuid a89c49de-27db-4e19-a013-217c6075debb {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:27:15.086941 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-52251c4b-18d4-4d82-949a-9270ba178b05 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 2052 microversion: 2.25 time: 0.313850 Aug 29 15:27:15.089207 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 322/626] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:14 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 2052 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:15.097051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1928689106", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c566e375-8caf-4447-b72d-a55ae9c852fc"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:15.143766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1422146c-8dc5-43f3-8768-83668c6d1ac6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:15.164704 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1422146c-8dc5-43f3-8768-83668c6d1ac6 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 200 len: 1311 microversion: 2.1 time: 0.265574 Aug 29 15:27:15.165814 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 305/627] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:14 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 1311 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:15.189126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:27:15.349873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1147559637", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "26d82d80-e2bf-4b2e-bd4a-38c04c1b6f6c"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:15.442270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] validate_networks() for [('26d82d80-e2bf-4b2e-bd4a-38c04c1b6f6c', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:27:15.536420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:27:15.537042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:27:15.538565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:27:15.539292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:27:15.540061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:27:15.569696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:15.578413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:15.579018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:15.579490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:15.580246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:15.580697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:15.581254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:15.607635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:15.613901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:15.628478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Going to run 2 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:27:15.631346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 039c62b6-55e7-4b8a-bf96-c079addd6fe6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:27:15.702766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122361) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 29 15:27:15.728188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_group_members'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:15.733897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_group_members'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:15.797794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_group_members'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:15.805728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_group_members'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:15.829512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=039c62b6-55e7-4b8a-bf96-c079addd6fe6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:27:15.942331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_group_members'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:15.949429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_group_members'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:16.014559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_group_members'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:16.022967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_group_members'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:16.067699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:27:16.068670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:27:16.069282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:27:16.069925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:27:16.070551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:27:16.079046 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5eb9a3ae-9082-4f56-a2f4-d8d0cb7aa7e2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.988126 Aug 29 15:27:16.080103 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 323/628] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:27:15 2022] POST /compute/v2.1/servers => generated 32 bytes in 990 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:27:16.084124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:16.084889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:16.085014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e7d5f0b0-7b8c-4e17-8b7c-8cf9470ce314 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:16.085770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:16.086010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e7d5f0b0-7b8c-4e17-8b7c-8cf9470ce314 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:16.087770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:16.088646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:16.089340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:16.093010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7d5f0b0-7b8c-4e17-8b7c-8cf9470ce314 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:16.093964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7d5f0b0-7b8c-4e17-8b7c-8cf9470ce314 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:16.094053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7d5f0b0-7b8c-4e17-8b7c-8cf9470ce314 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:16.094893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7d5f0b0-7b8c-4e17-8b7c-8cf9470ce314 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:16.095364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7d5f0b0-7b8c-4e17-8b7c-8cf9470ce314 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:16.096291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7d5f0b0-7b8c-4e17-8b7c-8cf9470ce314 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:16.116784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Getting quotas for project ef5a2735bd95451ab466c5560cbe28fe. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:16.129338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Getting quotas for user 9011569d41804e27a53fe5831988a88a and project ef5a2735bd95451ab466c5560cbe28fe. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:16.145349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:27:16.148619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:27:16.219268 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1a7ebdf4-dc24-4b05-93e5-c7695e13cbdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.876161 Aug 29 15:27:16.221819 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 306/629] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:27:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 15:27:16.230437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aa592431-9e61-48ec-8ffd-c459c8a823dd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:16.231105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aa592431-9e61-48ec-8ffd-c459c8a823dd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:16.263158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa592431-9e61-48ec-8ffd-c459c8a823dd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:16.263673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa592431-9e61-48ec-8ffd-c459c8a823dd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:16.274054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa592431-9e61-48ec-8ffd-c459c8a823dd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:16.275140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa592431-9e61-48ec-8ffd-c459c8a823dd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:16.275644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa592431-9e61-48ec-8ffd-c459c8a823dd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:16.276093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa592431-9e61-48ec-8ffd-c459c8a823dd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:16.299376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:16.395327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e7d5f0b0-7b8c-4e17-8b7c-8cf9470ce314 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:16.404704 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e7d5f0b0-7b8c-4e17-8b7c-8cf9470ce314 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1311 microversion: 2.1 time: 0.323433 Aug 29 15:27:16.415745 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 324/630] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:16 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1311 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:16.426977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3651752e-8b7d-4a15-9eef-128b6cfcd336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:16.429051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aa592431-9e61-48ec-8ffd-c459c8a823dd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:16.436765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3651752e-8b7d-4a15-9eef-128b6cfcd336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:16.442593 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aa592431-9e61-48ec-8ffd-c459c8a823dd tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 200 len: 1269 microversion: 2.1 time: 0.219543 Aug 29 15:27:16.446019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3651752e-8b7d-4a15-9eef-128b6cfcd336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Searching by: {'deleted': False, 'project_id': '0393aa9c32934da4a9f478c563135bbb'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:27:16.464855 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 307/631] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:16 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 1269 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:16.473378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2ab44242-6879-44b8-92e5-616938d08eb0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:16.474247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2ab44242-6879-44b8-92e5-616938d08eb0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: b5026556-58ce-42c9-9606-f75fbb77c2bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:16.481510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ab44242-6879-44b8-92e5-616938d08eb0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:16.482204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ab44242-6879-44b8-92e5-616938d08eb0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:16.482904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ab44242-6879-44b8-92e5-616938d08eb0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:16.483770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ab44242-6879-44b8-92e5-616938d08eb0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:16.484382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ab44242-6879-44b8-92e5-616938d08eb0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:16.485027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ab44242-6879-44b8-92e5-616938d08eb0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:16.504369 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-2ab44242-6879-44b8-92e5-616938d08eb0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] HTTP exception thrown: Instance b5026556-58ce-42c9-9606-f75fbb77c2bf could not be found. Aug 29 15:27:16.504870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3651752e-8b7d-4a15-9eef-128b6cfcd336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:16.506085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3651752e-8b7d-4a15-9eef-128b6cfcd336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2ab44242-6879-44b8-92e5-616938d08eb0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Request method failure captured: Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf HTTP/1.1 Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqNtDEBAzoVjbrO3xU3FGmfW_IV4Q5-RQ8fDwz8p35rHEO1bVYTo0kcW1j8YQTee-OEZ1m-CarHxvQtaQjuEX7_SeuoiSWtL0KcelTG6SFTpThYk7_l-ZDd0u6szfvdBIfe7SwhYNoTVJXtGZvZtdLxxgdhr4je3_s3BaEDJPrK5mk Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 3794161498684ce19acf188df258eeff Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1906412873 Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:27:16.507081 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:27:16.508423 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3794161498684ce19acf188df258eeff", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3794161498684ce19acf188df258eeff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3794161498684ce19acf188df258eeff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3794161498684ce19acf188df258eeff"}]}] Aug 29 15:27:16.508423 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1906412873 Aug 29 15:27:16.508423 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 3794161498684ce19acf188df258eeff Aug 29 15:27:16.508423 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1906412873 Aug 29 15:27:16.508423 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersAdminNegativeTestJSON-1906412873-project Aug 29 15:27:16.508423 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:27:16.508423 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:27:16.508423 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 32267072a4ed46cb8c596117db38fae5 Aug 29 15:27:16.508423 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1906412873-project Aug 29 15:27:16.508423 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:27:16.508423 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance b5026556-58ce-42c9-9606-f75fbb77c2bf could not be found. Aug 29 15:27:16.508423 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b5026556-58ce-42c9-9606-f75fbb77c2bf'} Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5026556-58ce-42c9-9606-f75fbb77c2bf could not be found. Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:16.509210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5026556-58ce-42c9-9606-f75fbb77c2bf could not be found. Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5026556-58ce-42c9-9606-f75fbb77c2bf could not be found. Aug 29 15:27:16.510439 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:16.511524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3651752e-8b7d-4a15-9eef-128b6cfcd336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:16.511524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3651752e-8b7d-4a15-9eef-128b6cfcd336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:16.511524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3651752e-8b7d-4a15-9eef-128b6cfcd336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:16.511750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3651752e-8b7d-4a15-9eef-128b6cfcd336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:16.513421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2ab44242-6879-44b8-92e5-616938d08eb0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Returning 404 to user: Instance b5026556-58ce-42c9-9606-f75fbb77c2bf could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:16.514858 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2ab44242-6879-44b8-92e5-616938d08eb0 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf" status: 404 len: 111 microversion: 2.1 time: 0.048485 Aug 29 15:27:16.515753 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 308/632] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:16 2022] GET /compute/v2.1/servers/b5026556-58ce-42c9-9606-f75fbb77c2bf => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:27:16.524130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6eb93244-fda4-4af8-bddd-ec2a17017983 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:16.525254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6eb93244-fda4-4af8-bddd-ec2a17017983 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:16.625327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6eb93244-fda4-4af8-bddd-ec2a17017983 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:16.640076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6eb93244-fda4-4af8-bddd-ec2a17017983 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:16.648052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6eb93244-fda4-4af8-bddd-ec2a17017983 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:16.654394 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6eb93244-fda4-4af8-bddd-ec2a17017983 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1262 microversion: 2.25 time: 0.134898 Aug 29 15:27:16.656658 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 309/633] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:16 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1262 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:16.734335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-3651752e-8b7d-4a15-9eef-128b6cfcd336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:27:16.929385 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3651752e-8b7d-4a15-9eef-128b6cfcd336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.509506 Aug 29 15:27:16.934247 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 325/634] 10.222.0.62 () {58 vars in 1125 bytes} [Mon Aug 29 15:27:16 2022] GET /compute/v2.1/servers => generated 1003 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:16.941216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-578676518", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:16.941440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c4dbfe85-6aaa-442b-8c4b-66d72f89162d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:16.944360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c4dbfe85-6aaa-442b-8c4b-66d72f89162d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:16.959199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4dbfe85-6aaa-442b-8c4b-66d72f89162d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:16.962034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4dbfe85-6aaa-442b-8c4b-66d72f89162d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:16.963319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4dbfe85-6aaa-442b-8c4b-66d72f89162d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:16.967012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4dbfe85-6aaa-442b-8c4b-66d72f89162d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:16.968204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4dbfe85-6aaa-442b-8c4b-66d72f89162d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:16.971393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4dbfe85-6aaa-442b-8c4b-66d72f89162d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:17.036156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] validate_networks() for None {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:27:17.053994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c4dbfe85-6aaa-442b-8c4b-66d72f89162d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:27:17.256388 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c4dbfe85-6aaa-442b-8c4b-66d72f89162d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "DELETE /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 204 len: 0 microversion: 2.1 time: 0.320961 Aug 29 15:27:17.260259 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 326/635] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:27:16 2022] DELETE /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:27:17.270138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bf69ddf8-58b6-4db8-a8da-ae0809048503 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:17.272741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bf69ddf8-58b6-4db8-a8da-ae0809048503 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:17.410320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bf69ddf8-58b6-4db8-a8da-ae0809048503 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:17.418043 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bf69ddf8-58b6-4db8-a8da-ae0809048503 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1219 microversion: 2.1 time: 0.156131 Aug 29 15:27:17.419363 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 327/636] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:17 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:17.433133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-057af978-2d5d-4b7d-b9f8-1c13c35fbc69 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:17.434094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-057af978-2d5d-4b7d-b9f8-1c13c35fbc69 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:17.443512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-057af978-2d5d-4b7d-b9f8-1c13c35fbc69 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:17.444234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-057af978-2d5d-4b7d-b9f8-1c13c35fbc69 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:17.444674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-057af978-2d5d-4b7d-b9f8-1c13c35fbc69 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:17.445411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-057af978-2d5d-4b7d-b9f8-1c13c35fbc69 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:17.445871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-057af978-2d5d-4b7d-b9f8-1c13c35fbc69 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:17.446297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-057af978-2d5d-4b7d-b9f8-1c13c35fbc69 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:17.628364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-057af978-2d5d-4b7d-b9f8-1c13c35fbc69 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:17.640723 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-057af978-2d5d-4b7d-b9f8-1c13c35fbc69 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1478 microversion: 2.1 time: 0.218967 Aug 29 15:27:17.654329 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 328/637] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:17 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1478 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:17.654329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-885a120f-1446-4860-bd2f-25db75ad090b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:17.654329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-885a120f-1446-4860-bd2f-25db75ad090b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:17.655989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-885a120f-1446-4860-bd2f-25db75ad090b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:17.655989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-885a120f-1446-4860-bd2f-25db75ad090b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:17.656184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-885a120f-1446-4860-bd2f-25db75ad090b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:17.657382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-885a120f-1446-4860-bd2f-25db75ad090b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:17.657946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-885a120f-1446-4860-bd2f-25db75ad090b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:17.658557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-885a120f-1446-4860-bd2f-25db75ad090b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:17.675555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:17.737691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:27:17.738165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:27:17.738553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:27:17.738953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:27:17.739669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:27:17.751173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:17.753147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:17.754185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:17.755601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:17.756737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:17.757526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:17.779429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Getting quotas for project a902f071321a4216b4d17078181a61c6. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:17.785421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Getting quotas for user 72442d50b3f74cb6acdfba7eeebe2274 and project a902f071321a4216b4d17078181a61c6. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:17.815187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:27:17.817627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:27:17.885052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-885a120f-1446-4860-bd2f-25db75ad090b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:17.893575 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-885a120f-1446-4860-bd2f-25db75ad090b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1311 microversion: 2.1 time: 0.251093 Aug 29 15:27:17.894169 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 329/638] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:17 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1311 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:17.914087 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dc272475-ffc3-424f-be4e-1483770114a2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.255166 Aug 29 15:27:17.914657 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 310/639] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:27:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:27:17.920657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-442623d0-1388-4908-831a-e3ed3c140745 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:17.921077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-442623d0-1388-4908-831a-e3ed3c140745 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:17.922519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-16544e70-b3da-445b-a6ca-e8c32d9642e0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:17.926298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-16544e70-b3da-445b-a6ca-e8c32d9642e0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:17.933806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16544e70-b3da-445b-a6ca-e8c32d9642e0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:17.934297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16544e70-b3da-445b-a6ca-e8c32d9642e0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:17.935864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16544e70-b3da-445b-a6ca-e8c32d9642e0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:17.936734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16544e70-b3da-445b-a6ca-e8c32d9642e0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:17.937599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16544e70-b3da-445b-a6ca-e8c32d9642e0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:17.939201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16544e70-b3da-445b-a6ca-e8c32d9642e0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:17.944409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-442623d0-1388-4908-831a-e3ed3c140745 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:17.944902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-442623d0-1388-4908-831a-e3ed3c140745 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:17.945370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-442623d0-1388-4908-831a-e3ed3c140745 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:17.946082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-442623d0-1388-4908-831a-e3ed3c140745 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:17.946538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-442623d0-1388-4908-831a-e3ed3c140745 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:17.946978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-442623d0-1388-4908-831a-e3ed3c140745 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:18.064686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-16544e70-b3da-445b-a6ca-e8c32d9642e0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:18.079605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-16544e70-b3da-445b-a6ca-e8c32d9642e0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:18.081221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-16544e70-b3da-445b-a6ca-e8c32d9642e0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:18.082368 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-16544e70-b3da-445b-a6ca-e8c32d9642e0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1258 microversion: 2.25 time: 0.166193 Aug 29 15:27:18.099264 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 311/640] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:17 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:18.104998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ae46e698-b4db-45c0-bb74-3b464b01ab65 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:18.105694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ae46e698-b4db-45c0-bb74-3b464b01ab65 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:18.242649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ae46e698-b4db-45c0-bb74-3b464b01ab65 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:18.251366 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ae46e698-b4db-45c0-bb74-3b464b01ab65 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1216 microversion: 2.1 time: 0.150871 Aug 29 15:27:18.251940 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 312/641] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:18 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:18.281666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-442623d0-1388-4908-831a-e3ed3c140745 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:18.292939 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-442623d0-1388-4908-831a-e3ed3c140745 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 200 len: 1317 microversion: 2.1 time: 0.376418 Aug 29 15:27:18.295662 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 330/642] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:17 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:18.439212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b457b0d-b754-49a8-a41e-8d13352ea0f5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:18.440219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6b457b0d-b754-49a8-a41e-8d13352ea0f5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:18.450520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b457b0d-b754-49a8-a41e-8d13352ea0f5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:18.452398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b457b0d-b754-49a8-a41e-8d13352ea0f5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:18.453046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b457b0d-b754-49a8-a41e-8d13352ea0f5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:18.454805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b457b0d-b754-49a8-a41e-8d13352ea0f5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:18.457480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b457b0d-b754-49a8-a41e-8d13352ea0f5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:18.458228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b457b0d-b754-49a8-a41e-8d13352ea0f5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:18.594230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b457b0d-b754-49a8-a41e-8d13352ea0f5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:18.604044 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6b457b0d-b754-49a8-a41e-8d13352ea0f5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1223 microversion: 2.1 time: 0.168957 Aug 29 15:27:18.618265 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 313/643] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:18 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1223 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:18.663838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-781037b1-5b30-46b4-9296-ee79ede99b19 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:18.664904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-781037b1-5b30-46b4-9296-ee79ede99b19 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:18.673653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-781037b1-5b30-46b4-9296-ee79ede99b19 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:18.674626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-781037b1-5b30-46b4-9296-ee79ede99b19 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:18.675240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-781037b1-5b30-46b4-9296-ee79ede99b19 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:18.676679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-781037b1-5b30-46b4-9296-ee79ede99b19 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:18.677329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-781037b1-5b30-46b4-9296-ee79ede99b19 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:18.677950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-781037b1-5b30-46b4-9296-ee79ede99b19 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:18.915287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c72f2e65-f11c-4c1c-ad57-46636a3ad377 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:18.915897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c72f2e65-f11c-4c1c-ad57-46636a3ad377 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:18.924503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c72f2e65-f11c-4c1c-ad57-46636a3ad377 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:18.924992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c72f2e65-f11c-4c1c-ad57-46636a3ad377 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:18.925463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c72f2e65-f11c-4c1c-ad57-46636a3ad377 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:18.926169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c72f2e65-f11c-4c1c-ad57-46636a3ad377 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:18.926626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c72f2e65-f11c-4c1c-ad57-46636a3ad377 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:18.927046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c72f2e65-f11c-4c1c-ad57-46636a3ad377 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:19.014058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-781037b1-5b30-46b4-9296-ee79ede99b19 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:19.025612 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-781037b1-5b30-46b4-9296-ee79ede99b19 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1478 microversion: 2.1 time: 0.365530 Aug 29 15:27:19.028184 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 331/644] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:18 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1478 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:19.112870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1dbe0e28-4466-438d-a5bb-a7ed7e6f1227 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:19.129592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1dbe0e28-4466-438d-a5bb-a7ed7e6f1227 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:19.166823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1dbe0e28-4466-438d-a5bb-a7ed7e6f1227 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:19.168228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1dbe0e28-4466-438d-a5bb-a7ed7e6f1227 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:19.170585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1dbe0e28-4466-438d-a5bb-a7ed7e6f1227 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:19.171627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1dbe0e28-4466-438d-a5bb-a7ed7e6f1227 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:19.172537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1dbe0e28-4466-438d-a5bb-a7ed7e6f1227 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:19.177151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1dbe0e28-4466-438d-a5bb-a7ed7e6f1227 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:19.295598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c72f2e65-f11c-4c1c-ad57-46636a3ad377 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:19.304696 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c72f2e65-f11c-4c1c-ad57-46636a3ad377 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1311 microversion: 2.1 time: 0.393274 Aug 29 15:27:19.305744 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 314/645] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:18 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1311 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:19.325962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-3277f78b-06d3-4aa7-98ee-db5955380916 req-ee4ce04d-6f58-4d3f-9494-24409f60ea3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dccfea7-bbcc-497d-bf3b-b129b04a0784", "tag": "c1792e5c-3b00-48fd-b016-b6d36bd731d6"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:19.338208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3277f78b-06d3-4aa7-98ee-db5955380916 req-ee4ce04d-6f58-4d3f-9494-24409f60ea3b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:19.338897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3277f78b-06d3-4aa7-98ee-db5955380916 req-ee4ce04d-6f58-4d3f-9494-24409f60ea3b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:19.339477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3277f78b-06d3-4aa7-98ee-db5955380916 req-ee4ce04d-6f58-4d3f-9494-24409f60ea3b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:19.352494 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-3277f78b-06d3-4aa7-98ee-db5955380916 req-ee4ce04d-6f58-4d3f-9494-24409f60ea3b service nova] Creating event network-changed:c1792e5c-3b00-48fd-b016-b6d36bd731d6 for instance 7dccfea7-bbcc-497d-bf3b-b129b04a0784 on n-h2-839401-11 Aug 29 15:27:19.360118 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-3277f78b-06d3-4aa7-98ee-db5955380916 req-ee4ce04d-6f58-4d3f-9494-24409f60ea3b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038432 Aug 29 15:27:19.362520 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 315/646] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:19.371701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d5b6ca5a-44f5-4ff4-82de-0619da3f58c3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:19.372796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d5b6ca5a-44f5-4ff4-82de-0619da3f58c3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:19.380425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5b6ca5a-44f5-4ff4-82de-0619da3f58c3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:19.381522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5b6ca5a-44f5-4ff4-82de-0619da3f58c3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:19.382319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5b6ca5a-44f5-4ff4-82de-0619da3f58c3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:19.383219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5b6ca5a-44f5-4ff4-82de-0619da3f58c3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:19.384430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5b6ca5a-44f5-4ff4-82de-0619da3f58c3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:19.385257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5b6ca5a-44f5-4ff4-82de-0619da3f58c3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:19.575955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1dbe0e28-4466-438d-a5bb-a7ed7e6f1227 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:19.583190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d5b6ca5a-44f5-4ff4-82de-0619da3f58c3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:19.592987 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d5b6ca5a-44f5-4ff4-82de-0619da3f58c3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1268 microversion: 2.1 time: 0.228750 Aug 29 15:27:19.593839 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 316/647] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:19 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1268 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:19.599515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a4bfbb07-3759-4854-85aa-6936c41adff5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:19.600112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a4bfbb07-3759-4854-85aa-6936c41adff5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:19.615202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1dbe0e28-4466-438d-a5bb-a7ed7e6f1227 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:19.621066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4bfbb07-3759-4854-85aa-6936c41adff5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:19.622622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4bfbb07-3759-4854-85aa-6936c41adff5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:19.623180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1dbe0e28-4466-438d-a5bb-a7ed7e6f1227 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:19.623757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4bfbb07-3759-4854-85aa-6936c41adff5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:19.625005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4bfbb07-3759-4854-85aa-6936c41adff5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:19.627191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4bfbb07-3759-4854-85aa-6936c41adff5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:19.627952 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1dbe0e28-4466-438d-a5bb-a7ed7e6f1227 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1314 microversion: 2.25 time: 0.518802 Aug 29 15:27:19.628802 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 332/648] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:19 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:19.629057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4bfbb07-3759-4854-85aa-6936c41adff5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:19.651618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9231a9f8-d308-4999-8309-43b8431ae2ca tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:19.652257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9231a9f8-d308-4999-8309-43b8431ae2ca tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:19.666457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9231a9f8-d308-4999-8309-43b8431ae2ca tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:19.666994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9231a9f8-d308-4999-8309-43b8431ae2ca tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:19.669015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9231a9f8-d308-4999-8309-43b8431ae2ca tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:19.671588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9231a9f8-d308-4999-8309-43b8431ae2ca tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:19.673869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9231a9f8-d308-4999-8309-43b8431ae2ca tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:19.674695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9231a9f8-d308-4999-8309-43b8431ae2ca tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:19.922522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9231a9f8-d308-4999-8309-43b8431ae2ca tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:19.932293 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9231a9f8-d308-4999-8309-43b8431ae2ca tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1271 microversion: 2.1 time: 0.298741 Aug 29 15:27:19.936602 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 333/649] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:19 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1271 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:20.056122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4f202aa3-0ec0-444e-b6e9-e5c8a873d06e tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:20.058323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4f202aa3-0ec0-444e-b6e9-e5c8a873d06e tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:20.069133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f202aa3-0ec0-444e-b6e9-e5c8a873d06e tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:20.071933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f202aa3-0ec0-444e-b6e9-e5c8a873d06e tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:20.073255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f202aa3-0ec0-444e-b6e9-e5c8a873d06e tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:20.074543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f202aa3-0ec0-444e-b6e9-e5c8a873d06e tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:20.075023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f202aa3-0ec0-444e-b6e9-e5c8a873d06e tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:20.075588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f202aa3-0ec0-444e-b6e9-e5c8a873d06e tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:20.095273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a4bfbb07-3759-4854-85aa-6936c41adff5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:20.116692 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a4bfbb07-3759-4854-85aa-6936c41adff5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 200 len: 1317 microversion: 2.1 time: 0.520738 Aug 29 15:27:20.117495 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 317/650] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:19 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:20.122275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-37a112c0-afde-4502-886a-d6052b5b70d5 req-b84f5aca-3b4d-4fc1-9a94-a3fb42e7c3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a6423f-2bd0-4c93-acc1-3cec1fe811ff", "name": "network-vif-plugged", "status": "completed", "tag": "e0ec5ed9-c9fd-4c5d-98bc-c1fe2504891d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:20.151461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-37a112c0-afde-4502-886a-d6052b5b70d5 req-b84f5aca-3b4d-4fc1-9a94-a3fb42e7c3f9 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:20.152227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-37a112c0-afde-4502-886a-d6052b5b70d5 req-b84f5aca-3b4d-4fc1-9a94-a3fb42e7c3f9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:20.152813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-37a112c0-afde-4502-886a-d6052b5b70d5 req-b84f5aca-3b4d-4fc1-9a94-a3fb42e7c3f9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:20.173014 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-37a112c0-afde-4502-886a-d6052b5b70d5 req-b84f5aca-3b4d-4fc1-9a94-a3fb42e7c3f9 service nova] Creating event network-vif-plugged:e0ec5ed9-c9fd-4c5d-98bc-c1fe2504891d for instance f5a6423f-2bd0-4c93-acc1-3cec1fe811ff on n-h1-839401-11 Aug 29 15:27:20.178898 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-37a112c0-afde-4502-886a-d6052b5b70d5 req-b84f5aca-3b4d-4fc1-9a94-a3fb42e7c3f9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060136 Aug 29 15:27:20.180714 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 318/651] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:20.326475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1a4c8a82-7a8f-4262-9512-665cd15d2b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:20.327143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1a4c8a82-7a8f-4262-9512-665cd15d2b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:20.335717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a4c8a82-7a8f-4262-9512-665cd15d2b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:20.336744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a4c8a82-7a8f-4262-9512-665cd15d2b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:20.337800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a4c8a82-7a8f-4262-9512-665cd15d2b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:20.338605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a4c8a82-7a8f-4262-9512-665cd15d2b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:20.339252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a4c8a82-7a8f-4262-9512-665cd15d2b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:20.339809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a4c8a82-7a8f-4262-9512-665cd15d2b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:20.826055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4f202aa3-0ec0-444e-b6e9-e5c8a873d06e tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:20.837796 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4f202aa3-0ec0-444e-b6e9-e5c8a873d06e tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1478 microversion: 2.1 time: 0.791578 Aug 29 15:27:20.838399 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 334/652] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:20 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1478 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:20.847663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e46b8fbb-7d74-4a3b-a554-d26fd7a9faa0 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:20.853645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e46b8fbb-7d74-4a3b-a554-d26fd7a9faa0 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:20.872851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e46b8fbb-7d74-4a3b-a554-d26fd7a9faa0 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:20.873396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e46b8fbb-7d74-4a3b-a554-d26fd7a9faa0 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:20.873835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e46b8fbb-7d74-4a3b-a554-d26fd7a9faa0 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:20.874556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e46b8fbb-7d74-4a3b-a554-d26fd7a9faa0 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:20.875020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e46b8fbb-7d74-4a3b-a554-d26fd7a9faa0 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:20.875449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e46b8fbb-7d74-4a3b-a554-d26fd7a9faa0 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:21.058996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e46b8fbb-7d74-4a3b-a554-d26fd7a9faa0 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:21.070181 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e46b8fbb-7d74-4a3b-a554-d26fd7a9faa0 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1274 microversion: 2.1 time: 0.230681 Aug 29 15:27:21.074062 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 335/653] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:20 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:21.087148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2ebef945-7658-4fda-8425-dce56abea78d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:21.089582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2ebef945-7658-4fda-8425-dce56abea78d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:21.107722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:21.117674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ebef945-7658-4fda-8425-dce56abea78d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:21.118459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ebef945-7658-4fda-8425-dce56abea78d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:21.119242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ebef945-7658-4fda-8425-dce56abea78d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:21.126560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ebef945-7658-4fda-8425-dce56abea78d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:21.129307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ebef945-7658-4fda-8425-dce56abea78d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:21.129963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ebef945-7658-4fda-8425-dce56abea78d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:21.319119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2ebef945-7658-4fda-8425-dce56abea78d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:21.336964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2ebef945-7658-4fda-8425-dce56abea78d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:21.343301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2ebef945-7658-4fda-8425-dce56abea78d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:21.345581 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2ebef945-7658-4fda-8425-dce56abea78d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1320 microversion: 2.25 time: 0.270272 Aug 29 15:27:21.348517 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 336/654] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:21 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1320 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:21.356436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ff6724f1-c7f0-41ab-932a-6708abd886c1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:21.358379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ff6724f1-c7f0-41ab-932a-6708abd886c1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:21.377534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff6724f1-c7f0-41ab-932a-6708abd886c1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:21.379166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff6724f1-c7f0-41ab-932a-6708abd886c1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:21.379883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff6724f1-c7f0-41ab-932a-6708abd886c1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:21.380959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff6724f1-c7f0-41ab-932a-6708abd886c1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:21.382341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff6724f1-c7f0-41ab-932a-6708abd886c1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:21.383250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff6724f1-c7f0-41ab-932a-6708abd886c1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:21.460852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1a4c8a82-7a8f-4262-9512-665cd15d2b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:21.470393 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1a4c8a82-7a8f-4262-9512-665cd15d2b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1311 microversion: 2.1 time: 1.148197 Aug 29 15:27:21.471146 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 319/655] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:20 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1311 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:21.489656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7ea665a7-978a-459f-9d25-c1424792bfaf tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:21.491078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7ea665a7-978a-459f-9d25-c1424792bfaf tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:21.499454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ea665a7-978a-459f-9d25-c1424792bfaf tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:21.500557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ea665a7-978a-459f-9d25-c1424792bfaf tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:21.501547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ea665a7-978a-459f-9d25-c1424792bfaf tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:21.504124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ea665a7-978a-459f-9d25-c1424792bfaf tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:21.505127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ea665a7-978a-459f-9d25-c1424792bfaf tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:21.505769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ea665a7-978a-459f-9d25-c1424792bfaf tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:21.618365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ff6724f1-c7f0-41ab-932a-6708abd886c1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:21.629807 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ff6724f1-c7f0-41ab-932a-6708abd886c1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1277 microversion: 2.1 time: 0.280004 Aug 29 15:27:21.641750 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 337/656] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:21 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1277 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:21.770123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-bf57bedd-38f4-4029-b018-dc707bf6a329 req-a02ecd9e-2950-46d1-ae88-f80d8b63406b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210b41e1-4270-4fb9-99e9-894536b94b41", "name": "network-vif-deleted", "tag": "25ba1b63-7433-40d1-a6be-570eca2697f6"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:21.790514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-bf57bedd-38f4-4029-b018-dc707bf6a329 req-a02ecd9e-2950-46d1-ae88-f80d8b63406b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:21.791080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-bf57bedd-38f4-4029-b018-dc707bf6a329 req-a02ecd9e-2950-46d1-ae88-f80d8b63406b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:21.791604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-bf57bedd-38f4-4029-b018-dc707bf6a329 req-a02ecd9e-2950-46d1-ae88-f80d8b63406b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:21.817392 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-bf57bedd-38f4-4029-b018-dc707bf6a329 req-a02ecd9e-2950-46d1-ae88-f80d8b63406b service nova] Creating event network-vif-deleted:25ba1b63-7433-40d1-a6be-570eca2697f6 for instance 210b41e1-4270-4fb9-99e9-894536b94b41 on n-h1-839401-11 Aug 29 15:27:21.830889 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-bf57bedd-38f4-4029-b018-dc707bf6a329 req-a02ecd9e-2950-46d1-ae88-f80d8b63406b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065519 Aug 29 15:27:21.833045 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 338/657] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:27:21.861715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-db07597f-89dd-44cc-beab-c930af3e50d4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:21.863465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-db07597f-89dd-44cc-beab-c930af3e50d4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:21.872940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db07597f-89dd-44cc-beab-c930af3e50d4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:21.874602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db07597f-89dd-44cc-beab-c930af3e50d4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:21.875041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db07597f-89dd-44cc-beab-c930af3e50d4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:21.875913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db07597f-89dd-44cc-beab-c930af3e50d4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:21.876484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db07597f-89dd-44cc-beab-c930af3e50d4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:21.877437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db07597f-89dd-44cc-beab-c930af3e50d4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:21.894695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7ea665a7-978a-459f-9d25-c1424792bfaf tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:21.910303 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7ea665a7-978a-459f-9d25-c1424792bfaf tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 200 len: 1317 microversion: 2.1 time: 0.427636 Aug 29 15:27:21.910949 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 320/658] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:21 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:22.028191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-db07597f-89dd-44cc-beab-c930af3e50d4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:22.041557 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-db07597f-89dd-44cc-beab-c930af3e50d4 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1436 microversion: 2.1 time: 0.185288 Aug 29 15:27:22.042861 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 339/659] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:21 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1436 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:22.098391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fae3ea57-7cb3-43fb-8052-0dd8242dfbb2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:22.099191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fae3ea57-7cb3-43fb-8052-0dd8242dfbb2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:22.106355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fae3ea57-7cb3-43fb-8052-0dd8242dfbb2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:22.107207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fae3ea57-7cb3-43fb-8052-0dd8242dfbb2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:22.107828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fae3ea57-7cb3-43fb-8052-0dd8242dfbb2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:22.108729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fae3ea57-7cb3-43fb-8052-0dd8242dfbb2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:22.109589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fae3ea57-7cb3-43fb-8052-0dd8242dfbb2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:22.110177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fae3ea57-7cb3-43fb-8052-0dd8242dfbb2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:22.207849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fae3ea57-7cb3-43fb-8052-0dd8242dfbb2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:22.224121 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fae3ea57-7cb3-43fb-8052-0dd8242dfbb2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1274 microversion: 2.1 time: 0.129549 Aug 29 15:27:22.224928 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 321/660] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:22 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1274 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:22.377610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f226c942-54ef-49e7-b67e-e55d883cbc30 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:22.378505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f226c942-54ef-49e7-b67e-e55d883cbc30 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:22.387180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f226c942-54ef-49e7-b67e-e55d883cbc30 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:22.388623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f226c942-54ef-49e7-b67e-e55d883cbc30 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:22.389299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f226c942-54ef-49e7-b67e-e55d883cbc30 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:22.390180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f226c942-54ef-49e7-b67e-e55d883cbc30 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:22.390802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f226c942-54ef-49e7-b67e-e55d883cbc30 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:22.391379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f226c942-54ef-49e7-b67e-e55d883cbc30 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:22.493228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4ba08843-866a-4e09-bdc9-511ef5b36b24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:22.494591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4ba08843-866a-4e09-bdc9-511ef5b36b24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:22.500996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba08843-866a-4e09-bdc9-511ef5b36b24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:22.502012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba08843-866a-4e09-bdc9-511ef5b36b24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:22.502668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba08843-866a-4e09-bdc9-511ef5b36b24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:22.503338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f226c942-54ef-49e7-b67e-e55d883cbc30 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:22.503848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba08843-866a-4e09-bdc9-511ef5b36b24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:22.504505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba08843-866a-4e09-bdc9-511ef5b36b24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:22.505163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba08843-866a-4e09-bdc9-511ef5b36b24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:22.522486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f226c942-54ef-49e7-b67e-e55d883cbc30 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:22.524018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f226c942-54ef-49e7-b67e-e55d883cbc30 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:22.525197 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f226c942-54ef-49e7-b67e-e55d883cbc30 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1320 microversion: 2.25 time: 0.153585 Aug 29 15:27:22.525781 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 340/661] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:22 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1320 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:22.654278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4d655f7c-5946-4b7a-94a8-bf8132e19777 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:22.654912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4d655f7c-5946-4b7a-94a8-bf8132e19777 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:22.666197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d655f7c-5946-4b7a-94a8-bf8132e19777 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:22.666719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d655f7c-5946-4b7a-94a8-bf8132e19777 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:22.667157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d655f7c-5946-4b7a-94a8-bf8132e19777 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:22.667883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d655f7c-5946-4b7a-94a8-bf8132e19777 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:22.668348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d655f7c-5946-4b7a-94a8-bf8132e19777 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:22.668772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d655f7c-5946-4b7a-94a8-bf8132e19777 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:22.798743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4d655f7c-5946-4b7a-94a8-bf8132e19777 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:22.807607 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4d655f7c-5946-4b7a-94a8-bf8132e19777 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1277 microversion: 2.1 time: 0.158274 Aug 29 15:27:22.820764 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 341/662] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:22 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:22.932882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7508c2bd-0fb5-4aff-abba-0c78b7a4879b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:22.934295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7508c2bd-0fb5-4aff-abba-0c78b7a4879b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:22.955204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7508c2bd-0fb5-4aff-abba-0c78b7a4879b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:22.962321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7508c2bd-0fb5-4aff-abba-0c78b7a4879b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:22.964684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7508c2bd-0fb5-4aff-abba-0c78b7a4879b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:22.966615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7508c2bd-0fb5-4aff-abba-0c78b7a4879b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:22.969584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7508c2bd-0fb5-4aff-abba-0c78b7a4879b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:22.970283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7508c2bd-0fb5-4aff-abba-0c78b7a4879b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:23.313618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7508c2bd-0fb5-4aff-abba-0c78b7a4879b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:23.326501 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7508c2bd-0fb5-4aff-abba-0c78b7a4879b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 200 len: 1317 microversion: 2.1 time: 0.398469 Aug 29 15:27:23.328023 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 342/663] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:22 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:23.337891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a6dd203c-6c34-427a-8595-b4e6e1be3eb9 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:23.340006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a6dd203c-6c34-427a-8595-b4e6e1be3eb9 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:23.350013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6dd203c-6c34-427a-8595-b4e6e1be3eb9 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:23.351126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6dd203c-6c34-427a-8595-b4e6e1be3eb9 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:23.352417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6dd203c-6c34-427a-8595-b4e6e1be3eb9 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:23.358859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6dd203c-6c34-427a-8595-b4e6e1be3eb9 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:23.360090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6dd203c-6c34-427a-8595-b4e6e1be3eb9 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:23.360870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6dd203c-6c34-427a-8595-b4e6e1be3eb9 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:23.459712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6dd203c-6c34-427a-8595-b4e6e1be3eb9 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:23.460458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6dd203c-6c34-427a-8595-b4e6e1be3eb9 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:23.463910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6dd203c-6c34-427a-8595-b4e6e1be3eb9 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:23.464860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-a6dd203c-6c34-427a-8595-b4e6e1be3eb9 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lazy-loading 'fault' on Instance uuid 210b41e1-4270-4fb9-99e9-894536b94b41 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:27:23.499540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4ba08843-866a-4e09-bdc9-511ef5b36b24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:23.514235 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4ba08843-866a-4e09-bdc9-511ef5b36b24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1311 microversion: 2.1 time: 1.024810 Aug 29 15:27:23.517821 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 322/664] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:22 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1311 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:23.524265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aafa717a-c2ee-4456-b29b-a4b69f67d44a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:23.525371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aafa717a-c2ee-4456-b29b-a4b69f67d44a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:23.535366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aafa717a-c2ee-4456-b29b-a4b69f67d44a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:23.536297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aafa717a-c2ee-4456-b29b-a4b69f67d44a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:23.536914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aafa717a-c2ee-4456-b29b-a4b69f67d44a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:23.537946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aafa717a-c2ee-4456-b29b-a4b69f67d44a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:23.538825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aafa717a-c2ee-4456-b29b-a4b69f67d44a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:23.539485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aafa717a-c2ee-4456-b29b-a4b69f67d44a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:23.556469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a6dd203c-6c34-427a-8595-b4e6e1be3eb9 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32267072a4ed46cb8c596117db38fae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3794161498684ce19acf188df258eeff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:23.570166 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a6dd203c-6c34-427a-8595-b4e6e1be3eb9 tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 200 len: 1312 microversion: 2.1 time: 0.239594 Aug 29 15:27:23.584078 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 343/665] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:23 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 1312 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:23.597659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a119375f-aa8c-40c6-a97f-abd044da29c2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:23.598278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a119375f-aa8c-40c6-a97f-abd044da29c2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:23.649514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a119375f-aa8c-40c6-a97f-abd044da29c2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:23.654408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a119375f-aa8c-40c6-a97f-abd044da29c2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:23.655983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a119375f-aa8c-40c6-a97f-abd044da29c2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:23.670221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a119375f-aa8c-40c6-a97f-abd044da29c2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:23.670766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a119375f-aa8c-40c6-a97f-abd044da29c2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:23.671213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a119375f-aa8c-40c6-a97f-abd044da29c2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:23.787090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a119375f-aa8c-40c6-a97f-abd044da29c2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:23.805373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a119375f-aa8c-40c6-a97f-abd044da29c2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:23.807544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a119375f-aa8c-40c6-a97f-abd044da29c2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:23.810240 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a119375f-aa8c-40c6-a97f-abd044da29c2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1320 microversion: 2.25 time: 0.218040 Aug 29 15:27:23.811477 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 344/666] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:23 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1320 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:23.831307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7cc74900-e3e5-47ea-8b99-ae6609614b3f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:23.832643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7cc74900-e3e5-47ea-8b99-ae6609614b3f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:23.848800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cc74900-e3e5-47ea-8b99-ae6609614b3f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:23.849313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cc74900-e3e5-47ea-8b99-ae6609614b3f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:23.849808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cc74900-e3e5-47ea-8b99-ae6609614b3f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:23.850599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cc74900-e3e5-47ea-8b99-ae6609614b3f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:23.851057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cc74900-e3e5-47ea-8b99-ae6609614b3f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:23.851470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cc74900-e3e5-47ea-8b99-ae6609614b3f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:24.083857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aafa717a-c2ee-4456-b29b-a4b69f67d44a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:24.102473 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aafa717a-c2ee-4456-b29b-a4b69f67d44a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1316 microversion: 2.1 time: 0.581286 Aug 29 15:27:24.118310 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 323/667] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:23 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1316 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:24.181543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7cc74900-e3e5-47ea-8b99-ae6609614b3f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:24.200437 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7cc74900-e3e5-47ea-8b99-ae6609614b3f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1277 microversion: 2.1 time: 0.372909 Aug 29 15:27:24.203670 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 345/668] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:23 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1277 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:24.356838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-62e67667-f529-4121-bff3-a2b8fa6944f7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:24.357511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-62e67667-f529-4121-bff3-a2b8fa6944f7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:24.362212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:24.382473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62e67667-f529-4121-bff3-a2b8fa6944f7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:24.384726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62e67667-f529-4121-bff3-a2b8fa6944f7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:24.385473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62e67667-f529-4121-bff3-a2b8fa6944f7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:24.391201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62e67667-f529-4121-bff3-a2b8fa6944f7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:24.392076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62e67667-f529-4121-bff3-a2b8fa6944f7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:24.393103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62e67667-f529-4121-bff3-a2b8fa6944f7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:24.546929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-70acdf98-befc-4ef8-b6f8-2063282e2924 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:24.547561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-70acdf98-befc-4ef8-b6f8-2063282e2924 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:24.556594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70acdf98-befc-4ef8-b6f8-2063282e2924 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:24.557111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70acdf98-befc-4ef8-b6f8-2063282e2924 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:24.557621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70acdf98-befc-4ef8-b6f8-2063282e2924 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:24.558416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70acdf98-befc-4ef8-b6f8-2063282e2924 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:24.558866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70acdf98-befc-4ef8-b6f8-2063282e2924 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:24.567031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70acdf98-befc-4ef8-b6f8-2063282e2924 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:24.601187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:24.783866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-62e67667-f529-4121-bff3-a2b8fa6944f7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:24.793596 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-62e67667-f529-4121-bff3-a2b8fa6944f7 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 200 len: 1317 microversion: 2.1 time: 0.443650 Aug 29 15:27:24.794545 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 324/669] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:24 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:24.813425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3ca10099-b2e3-4454-a200-c4e8ea93402d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:24.814511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3ca10099-b2e3-4454-a200-c4e8ea93402d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] [instance: 210b41e1-4270-4fb9-99e9-894536b94b41] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:24.821742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ca10099-b2e3-4454-a200-c4e8ea93402d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:24.822674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ca10099-b2e3-4454-a200-c4e8ea93402d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:24.823380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ca10099-b2e3-4454-a200-c4e8ea93402d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:24.824315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ca10099-b2e3-4454-a200-c4e8ea93402d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:24.824984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ca10099-b2e3-4454-a200-c4e8ea93402d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:24.825646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ca10099-b2e3-4454-a200-c4e8ea93402d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:24.843719 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-3ca10099-b2e3-4454-a200-c4e8ea93402d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] HTTP exception thrown: Instance 210b41e1-4270-4fb9-99e9-894536b94b41 could not be found. Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3ca10099-b2e3-4454-a200-c4e8ea93402d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Request method failure captured: Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 HTTP/1.1 Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqNtDEBAzoVjbrO3xU3FGmfW_IV4Q5-RQ8fDwz8p35rHEO1bVYTo0kcW1j8YQTee-OEZ1m-CarHxvQtaQjuEX7_SeuoiSWtL0KcelTG6SFTpThYk7_l-ZDd0u6szfvdBIfe7SwhYNoTVJXtGZvZtdLxxgdhr4je3_s3BaEDJPrK5mk Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 3794161498684ce19acf188df258eeff Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1906412873 Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:27:24.845868 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:27:24.847185 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3794161498684ce19acf188df258eeff", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3794161498684ce19acf188df258eeff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3794161498684ce19acf188df258eeff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3794161498684ce19acf188df258eeff"}]}] Aug 29 15:27:24.847185 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1906412873 Aug 29 15:27:24.847185 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 3794161498684ce19acf188df258eeff Aug 29 15:27:24.847185 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1906412873 Aug 29 15:27:24.847185 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersAdminNegativeTestJSON-1906412873-project Aug 29 15:27:24.847185 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:27:24.847185 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:27:24.847185 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 32267072a4ed46cb8c596117db38fae5 Aug 29 15:27:24.847185 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1906412873-project Aug 29 15:27:24.847185 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:27:24.847185 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 210b41e1-4270-4fb9-99e9-894536b94b41 could not be found. Aug 29 15:27:24.847185 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '210b41e1-4270-4fb9-99e9-894536b94b41'} Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210b41e1-4270-4fb9-99e9-894536b94b41 could not be found. Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:24.847904 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210b41e1-4270-4fb9-99e9-894536b94b41 could not be found. Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210b41e1-4270-4fb9-99e9-894536b94b41 could not be found. Aug 29 15:27:24.849652 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:24.852448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3ca10099-b2e3-4454-a200-c4e8ea93402d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] Returning 404 to user: Instance 210b41e1-4270-4fb9-99e9-894536b94b41 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:24.853736 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3ca10099-b2e3-4454-a200-c4e8ea93402d tempest-ServersAdminNegativeTestJSON-1906412873 tempest-ServersAdminNegativeTestJSON-1906412873-project] 10.222.0.62 "GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41" status: 404 len: 111 microversion: 2.1 time: 0.046499 Aug 29 15:27:24.854880 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 325/670] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:24 2022] GET /compute/v2.1/servers/210b41e1-4270-4fb9-99e9-894536b94b41 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:27:24.868394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aa9af0df-de8c-44bb-8911-5870b4ebaced tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:24.876699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aa9af0df-de8c-44bb-8911-5870b4ebaced tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:24.892795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa9af0df-de8c-44bb-8911-5870b4ebaced tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:24.896747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa9af0df-de8c-44bb-8911-5870b4ebaced tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:24.898367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa9af0df-de8c-44bb-8911-5870b4ebaced tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:24.899440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa9af0df-de8c-44bb-8911-5870b4ebaced tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:24.902024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa9af0df-de8c-44bb-8911-5870b4ebaced tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:24.904674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa9af0df-de8c-44bb-8911-5870b4ebaced tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:24.978268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-70acdf98-befc-4ef8-b6f8-2063282e2924 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:24.991866 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-70acdf98-befc-4ef8-b6f8-2063282e2924 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1495 microversion: 2.1 time: 0.448946 Aug 29 15:27:24.993725 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 346/671] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:24 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1495 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:25.292629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-86ed1554-25c2-4eb3-bf6a-523a6622a788 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:25.293911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-86ed1554-25c2-4eb3-bf6a-523a6622a788 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:25.305637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86ed1554-25c2-4eb3-bf6a-523a6622a788 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:25.306162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86ed1554-25c2-4eb3-bf6a-523a6622a788 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:25.309804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86ed1554-25c2-4eb3-bf6a-523a6622a788 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:25.310562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86ed1554-25c2-4eb3-bf6a-523a6622a788 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:25.311037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86ed1554-25c2-4eb3-bf6a-523a6622a788 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:25.311472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86ed1554-25c2-4eb3-bf6a-523a6622a788 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:25.755765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aa9af0df-de8c-44bb-8911-5870b4ebaced tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:25.767730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aa9af0df-de8c-44bb-8911-5870b4ebaced tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:25.772655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aa9af0df-de8c-44bb-8911-5870b4ebaced tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:25.786315 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aa9af0df-de8c-44bb-8911-5870b4ebaced tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1362 microversion: 2.25 time: 0.929844 Aug 29 15:27:25.787972 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 326/672] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:24 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1362 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:25.812225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6d708b0e-6144-4b9d-b411-00b7f3e5fc2e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:25.812866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6d708b0e-6144-4b9d-b411-00b7f3e5fc2e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:25.822191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d708b0e-6144-4b9d-b411-00b7f3e5fc2e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:25.823673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d708b0e-6144-4b9d-b411-00b7f3e5fc2e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:25.824329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d708b0e-6144-4b9d-b411-00b7f3e5fc2e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:25.825607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d708b0e-6144-4b9d-b411-00b7f3e5fc2e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:25.826288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d708b0e-6144-4b9d-b411-00b7f3e5fc2e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:25.827544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d708b0e-6144-4b9d-b411-00b7f3e5fc2e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:26.313145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6d708b0e-6144-4b9d-b411-00b7f3e5fc2e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:26.322399 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6d708b0e-6144-4b9d-b411-00b7f3e5fc2e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1316 microversion: 2.1 time: 0.524923 Aug 29 15:27:26.323169 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 327/673] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:25 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1316 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:26.328500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ccc3e5ee-4402-436b-aee9-e1f3bb366984 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:26.329652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ccc3e5ee-4402-436b-aee9-e1f3bb366984 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:26.339568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccc3e5ee-4402-436b-aee9-e1f3bb366984 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:26.340279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccc3e5ee-4402-436b-aee9-e1f3bb366984 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:26.340856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccc3e5ee-4402-436b-aee9-e1f3bb366984 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:26.341784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccc3e5ee-4402-436b-aee9-e1f3bb366984 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:26.342418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccc3e5ee-4402-436b-aee9-e1f3bb366984 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:26.342962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccc3e5ee-4402-436b-aee9-e1f3bb366984 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:26.411713 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-86ed1554-25c2-4eb3-bf6a-523a6622a788 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1648 microversion: 2.1 time: 1.396185 Aug 29 15:27:26.417429 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 347/674] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:25 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1648 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:26.424839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c0d8bcbe-9a61-47f8-919b-637cb8851eca tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:26.426723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c0d8bcbe-9a61-47f8-919b-637cb8851eca tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:26.440386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d8bcbe-9a61-47f8-919b-637cb8851eca tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:26.441257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d8bcbe-9a61-47f8-919b-637cb8851eca tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:26.442147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d8bcbe-9a61-47f8-919b-637cb8851eca tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:26.444550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d8bcbe-9a61-47f8-919b-637cb8851eca tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:26.445372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d8bcbe-9a61-47f8-919b-637cb8851eca tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:26.445829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d8bcbe-9a61-47f8-919b-637cb8851eca tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:26.627563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:26.891342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c0d8bcbe-9a61-47f8-919b-637cb8851eca tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:26.907995 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c0d8bcbe-9a61-47f8-919b-637cb8851eca tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 200 len: 1317 microversion: 2.1 time: 0.488693 Aug 29 15:27:26.909785 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 348/675] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:26 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:26.915598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aef38acb-51b3-4eb9-a40b-13a2f0c51b90 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:26.916974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aef38acb-51b3-4eb9-a40b-13a2f0c51b90 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:26.931276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aef38acb-51b3-4eb9-a40b-13a2f0c51b90 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:26.932111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aef38acb-51b3-4eb9-a40b-13a2f0c51b90 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:26.933550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aef38acb-51b3-4eb9-a40b-13a2f0c51b90 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:26.934818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aef38acb-51b3-4eb9-a40b-13a2f0c51b90 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:26.935911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aef38acb-51b3-4eb9-a40b-13a2f0c51b90 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:26.937764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aef38acb-51b3-4eb9-a40b-13a2f0c51b90 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:27.066298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ccc3e5ee-4402-436b-aee9-e1f3bb366984 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:27.081790 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ccc3e5ee-4402-436b-aee9-e1f3bb366984 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1319 microversion: 2.1 time: 0.757018 Aug 29 15:27:27.082374 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 328/676] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:26 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1319 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:27.087023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-20ca0394-27a9-485b-b7eb-6128711629f5 req-defc4f1e-a985-4122-88b0-7d53af443fdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039c62b6-55e7-4b8a-bf96-c079addd6fe6", "tag": "482320d1-9c00-4266-9780-97bd22da1637"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:27.107634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-20ca0394-27a9-485b-b7eb-6128711629f5 req-defc4f1e-a985-4122-88b0-7d53af443fdb service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:27.108131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-20ca0394-27a9-485b-b7eb-6128711629f5 req-defc4f1e-a985-4122-88b0-7d53af443fdb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:27.108638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-20ca0394-27a9-485b-b7eb-6128711629f5 req-defc4f1e-a985-4122-88b0-7d53af443fdb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:27.118939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:27.140085 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-20ca0394-27a9-485b-b7eb-6128711629f5 req-defc4f1e-a985-4122-88b0-7d53af443fdb service nova] Creating event network-changed:482320d1-9c00-4266-9780-97bd22da1637 for instance 039c62b6-55e7-4b8a-bf96-c079addd6fe6 on n-h1-839401-11 Aug 29 15:27:27.148404 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-20ca0394-27a9-485b-b7eb-6128711629f5 req-defc4f1e-a985-4122-88b0-7d53af443fdb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064813 Aug 29 15:27:27.149820 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 329/677] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:27.156750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b341fa9a-c2b4-429a-a3f4-08ffeb1b5a0d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:27.158373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b341fa9a-c2b4-429a-a3f4-08ffeb1b5a0d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:27.168116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b341fa9a-c2b4-429a-a3f4-08ffeb1b5a0d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:27.169046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b341fa9a-c2b4-429a-a3f4-08ffeb1b5a0d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:27.169812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b341fa9a-c2b4-429a-a3f4-08ffeb1b5a0d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:27.171027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b341fa9a-c2b4-429a-a3f4-08ffeb1b5a0d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:27.171724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b341fa9a-c2b4-429a-a3f4-08ffeb1b5a0d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:27.172386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b341fa9a-c2b4-429a-a3f4-08ffeb1b5a0d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:27.415578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=30 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:27.595176 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aef38acb-51b3-4eb9-a40b-13a2f0c51b90 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1648 microversion: 2.1 time: 0.683864 Aug 29 15:27:27.596101 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 349/678] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:26 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1648 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:27.601484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-87518326-93f7-453c-a1f8-6f11335a0dc5 req-40306fdc-f326-4a11-8db3-505cd414c378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dccfea7-bbcc-497d-bf3b-b129b04a0784", "name": "network-vif-plugged", "status": "completed", "tag": "c1792e5c-3b00-48fd-b016-b6d36bd731d6"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:27.619289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-87518326-93f7-453c-a1f8-6f11335a0dc5 req-40306fdc-f326-4a11-8db3-505cd414c378 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:27.619811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-87518326-93f7-453c-a1f8-6f11335a0dc5 req-40306fdc-f326-4a11-8db3-505cd414c378 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:27.620244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-87518326-93f7-453c-a1f8-6f11335a0dc5 req-40306fdc-f326-4a11-8db3-505cd414c378 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:27.633834 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-87518326-93f7-453c-a1f8-6f11335a0dc5 req-40306fdc-f326-4a11-8db3-505cd414c378 service nova] Creating event network-vif-plugged:c1792e5c-3b00-48fd-b016-b6d36bd731d6 for instance 7dccfea7-bbcc-497d-bf3b-b129b04a0784 on n-h2-839401-11 Aug 29 15:27:27.641382 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-87518326-93f7-453c-a1f8-6f11335a0dc5 req-40306fdc-f326-4a11-8db3-505cd414c378 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043669 Aug 29 15:27:27.642292 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 350/679] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:27.652186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea5f8da8-6daf-4264-bbd4-cda1cddef0bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:27.653236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ea5f8da8-6daf-4264-bbd4-cda1cddef0bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:27.660633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea5f8da8-6daf-4264-bbd4-cda1cddef0bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:27.661391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea5f8da8-6daf-4264-bbd4-cda1cddef0bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:27.661842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea5f8da8-6daf-4264-bbd4-cda1cddef0bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:27.662612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea5f8da8-6daf-4264-bbd4-cda1cddef0bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:27.663069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea5f8da8-6daf-4264-bbd4-cda1cddef0bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:27.663751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea5f8da8-6daf-4264-bbd4-cda1cddef0bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:27.705204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b341fa9a-c2b4-429a-a3f4-08ffeb1b5a0d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:27.715875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b341fa9a-c2b4-429a-a3f4-08ffeb1b5a0d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:27.717482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b341fa9a-c2b4-429a-a3f4-08ffeb1b5a0d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:27.720715 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b341fa9a-c2b4-429a-a3f4-08ffeb1b5a0d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1362 microversion: 2.25 time: 0.569545 Aug 29 15:27:27.722259 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 330/680] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:27 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1362 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:27.730141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-4814b692-7a8e-4079-96ae-dc7d9574192f req-9d9d042b-6fa4-4fba-82af-72e1aa2a7ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf46166-597d-4649-a09a-600d8c57524d", "tag": "fb9190f9-2a49-4198-bf76-f097d8ef044f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:27.745040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4814b692-7a8e-4079-96ae-dc7d9574192f req-9d9d042b-6fa4-4fba-82af-72e1aa2a7ff1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:27.745725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4814b692-7a8e-4079-96ae-dc7d9574192f req-9d9d042b-6fa4-4fba-82af-72e1aa2a7ff1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:27.746323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4814b692-7a8e-4079-96ae-dc7d9574192f req-9d9d042b-6fa4-4fba-82af-72e1aa2a7ff1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:27.761147 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-4814b692-7a8e-4079-96ae-dc7d9574192f req-9d9d042b-6fa4-4fba-82af-72e1aa2a7ff1 service nova] Creating event network-changed:fb9190f9-2a49-4198-bf76-f097d8ef044f for instance 4cf46166-597d-4649-a09a-600d8c57524d on n-h1-839401-11 Aug 29 15:27:27.767842 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-4814b692-7a8e-4079-96ae-dc7d9574192f req-9d9d042b-6fa4-4fba-82af-72e1aa2a7ff1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044080 Aug 29 15:27:27.769002 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 331/681] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:27.772460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:27.779958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-021c6e63-22b3-4eb6-9b89-e4f999533f0d tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:27.786215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-021c6e63-22b3-4eb6-9b89-e4f999533f0d tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:27.786874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-021c6e63-22b3-4eb6-9b89-e4f999533f0d tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:27.787671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-021c6e63-22b3-4eb6-9b89-e4f999533f0d tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:27.788607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-021c6e63-22b3-4eb6-9b89-e4f999533f0d tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:27.789193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-021c6e63-22b3-4eb6-9b89-e4f999533f0d tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:27.789887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-021c6e63-22b3-4eb6-9b89-e4f999533f0d tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:27.819691 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-021c6e63-22b3-4eb6-9b89-e4f999533f0d tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.048115 Aug 29 15:27:27.820625 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 332/682] 10.222.0.62 () {58 vars in 1176 bytes} [Mon Aug 29 15:27:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:27.838274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9325516c-df4d-4a15-83ad-818dc4ab12fd tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-839401-11", "block_migration": true, "disk_over_commit": false}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:27.841370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9325516c-df4d-4a15-83ad-818dc4ab12fd tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:27.850437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9325516c-df4d-4a15-83ad-818dc4ab12fd tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:27.851164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9325516c-df4d-4a15-83ad-818dc4ab12fd tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:27.851815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9325516c-df4d-4a15-83ad-818dc4ab12fd tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:27.852842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9325516c-df4d-4a15-83ad-818dc4ab12fd tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:27.854409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9325516c-df4d-4a15-83ad-818dc4ab12fd tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:27.855035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9325516c-df4d-4a15-83ad-818dc4ab12fd tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:27.901594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-9325516c-df4d-4a15-83ad-818dc4ab12fd tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lazy-loading 'flavor' on Instance uuid f5a6423f-2bd0-4c93-acc1-3cec1fe811ff {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:27:27.919774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9325516c-df4d-4a15-83ad-818dc4ab12fd tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Going to try to live migrate instance to n-h2-839401-11 {{(pid=122360) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:27:28.201072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ea5f8da8-6daf-4264-bbd4-cda1cddef0bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:28.212987 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ea5f8da8-6daf-4264-bbd4-cda1cddef0bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1316 microversion: 2.1 time: 0.568775 Aug 29 15:27:28.214743 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 351/683] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:27 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:28.224870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-30fdd4eb-6098-4191-b3a0-0abfdd6aad83 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:28.226082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-30fdd4eb-6098-4191-b3a0-0abfdd6aad83 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:28.247818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=26 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:28.248304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30fdd4eb-6098-4191-b3a0-0abfdd6aad83 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:28.248743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30fdd4eb-6098-4191-b3a0-0abfdd6aad83 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:28.249389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30fdd4eb-6098-4191-b3a0-0abfdd6aad83 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:28.251863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30fdd4eb-6098-4191-b3a0-0abfdd6aad83 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:28.252620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30fdd4eb-6098-4191-b3a0-0abfdd6aad83 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:28.253316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30fdd4eb-6098-4191-b3a0-0abfdd6aad83 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:28.485211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-30fdd4eb-6098-4191-b3a0-0abfdd6aad83 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:28.493970 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-30fdd4eb-6098-4191-b3a0-0abfdd6aad83 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 200 len: 1317 microversion: 2.1 time: 0.277385 Aug 29 15:27:28.507780 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 352/684] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:28 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:28.513227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0d19e136-fb82-4e8f-b818-bc27a894b47a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:28.513854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0d19e136-fb82-4e8f-b818-bc27a894b47a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:28.520146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d19e136-fb82-4e8f-b818-bc27a894b47a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:28.520645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d19e136-fb82-4e8f-b818-bc27a894b47a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:28.521126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d19e136-fb82-4e8f-b818-bc27a894b47a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:28.521853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d19e136-fb82-4e8f-b818-bc27a894b47a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:28.522312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d19e136-fb82-4e8f-b818-bc27a894b47a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:28.522918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d19e136-fb82-4e8f-b818-bc27a894b47a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:28.766254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0d19e136-fb82-4e8f-b818-bc27a894b47a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:28.775755 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0d19e136-fb82-4e8f-b818-bc27a894b47a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1319 microversion: 2.1 time: 0.266827 Aug 29 15:27:28.776876 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 353/685] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:28 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:28.937521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c4c16e17-5fa8-4799-99ca-6856d71caede tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] Action: 'create', calling method: .version_select at 0x7fc42bdb9e50>, body: {"pool": null} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:30.199979 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c4c16e17-5fa8-4799-99ca-6856d71caede tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] 10.222.0.62 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.421734 Aug 29 15:27:30.200672 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 354/686] 10.222.0.62 () {60 vars in 1170 bytes} [Mon Aug 29 15:27:28 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:30.205506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1f7e030b-4977-4e03-8e00-19d04a2debc4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:30.206172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1f7e030b-4977-4e03-8e00-19d04a2debc4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:30.213028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f7e030b-4977-4e03-8e00-19d04a2debc4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:30.213739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f7e030b-4977-4e03-8e00-19d04a2debc4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:30.214165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f7e030b-4977-4e03-8e00-19d04a2debc4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:30.214872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f7e030b-4977-4e03-8e00-19d04a2debc4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:30.215348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f7e030b-4977-4e03-8e00-19d04a2debc4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:30.215765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f7e030b-4977-4e03-8e00-19d04a2debc4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:30.349278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1f7e030b-4977-4e03-8e00-19d04a2debc4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:30.358105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1f7e030b-4977-4e03-8e00-19d04a2debc4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:30.359584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1f7e030b-4977-4e03-8e00-19d04a2debc4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:30.360783 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1f7e030b-4977-4e03-8e00-19d04a2debc4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1362 microversion: 2.25 time: 0.158993 Aug 29 15:27:30.361375 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 355/687] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:30 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:30.366024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-0f079842-c55d-421c-bdf6-367e53b8d423 req-49f4b700-fae5-4a96-9fe1-9c3f1b3e9346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45d3d180-599f-4c45-a0ea-53f2180484d5", "tag": "a173d34f-0b58-4d2d-91dc-183ed4b4d4a6"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:30.377757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0f079842-c55d-421c-bdf6-367e53b8d423 req-49f4b700-fae5-4a96-9fe1-9c3f1b3e9346 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:30.378240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0f079842-c55d-421c-bdf6-367e53b8d423 req-49f4b700-fae5-4a96-9fe1-9c3f1b3e9346 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:30.378643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0f079842-c55d-421c-bdf6-367e53b8d423 req-49f4b700-fae5-4a96-9fe1-9c3f1b3e9346 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:30.390079 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-0f079842-c55d-421c-bdf6-367e53b8d423 req-49f4b700-fae5-4a96-9fe1-9c3f1b3e9346 service nova] Creating event network-changed:a173d34f-0b58-4d2d-91dc-183ed4b4d4a6 for instance 45d3d180-599f-4c45-a0ea-53f2180484d5 on n-h2-839401-11 Aug 29 15:27:30.395120 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-0f079842-c55d-421c-bdf6-367e53b8d423 req-49f4b700-fae5-4a96-9fe1-9c3f1b3e9346 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032664 Aug 29 15:27:30.395728 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 356/688] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:30.401754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c7448fd5-d8c9-4586-bf50-0205f32651bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:30.402449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c7448fd5-d8c9-4586-bf50-0205f32651bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:30.409119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7448fd5-d8c9-4586-bf50-0205f32651bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:30.409626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7448fd5-d8c9-4586-bf50-0205f32651bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:30.410027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7448fd5-d8c9-4586-bf50-0205f32651bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:30.410759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7448fd5-d8c9-4586-bf50-0205f32651bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:30.411206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7448fd5-d8c9-4586-bf50-0205f32651bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:30.411630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7448fd5-d8c9-4586-bf50-0205f32651bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:30.552162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c7448fd5-d8c9-4586-bf50-0205f32651bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:30.560285 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c7448fd5-d8c9-4586-bf50-0205f32651bb tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1316 microversion: 2.1 time: 0.163200 Aug 29 15:27:30.560867 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 357/689] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:30 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:30.565726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-44b66ca5-76d9-4508-9ecb-5de3712ebb62 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:30.566472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-44b66ca5-76d9-4508-9ecb-5de3712ebb62 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:30.572561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44b66ca5-76d9-4508-9ecb-5de3712ebb62 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:30.573042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44b66ca5-76d9-4508-9ecb-5de3712ebb62 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:30.573484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44b66ca5-76d9-4508-9ecb-5de3712ebb62 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:30.574184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44b66ca5-76d9-4508-9ecb-5de3712ebb62 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:30.574731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44b66ca5-76d9-4508-9ecb-5de3712ebb62 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:30.575155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44b66ca5-76d9-4508-9ecb-5de3712ebb62 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:30.709556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-44b66ca5-76d9-4508-9ecb-5de3712ebb62 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:30.717719 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-44b66ca5-76d9-4508-9ecb-5de3712ebb62 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 200 len: 1317 microversion: 2.1 time: 0.155791 Aug 29 15:27:30.718304 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 358/690] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:30 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:30.725463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-631dbc05-7553-4aa8-98d7-882d45639935 req-9f8a2212-8b36-49ab-bf23-284f83b933f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3056427-5687-4dbf-93e9-a257b3ec51cf", "tag": "82913e05-d281-471d-920c-eef2d54c9c67"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:30.735219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-631dbc05-7553-4aa8-98d7-882d45639935 req-9f8a2212-8b36-49ab-bf23-284f83b933f3 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:30.735752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-631dbc05-7553-4aa8-98d7-882d45639935 req-9f8a2212-8b36-49ab-bf23-284f83b933f3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:30.736178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-631dbc05-7553-4aa8-98d7-882d45639935 req-9f8a2212-8b36-49ab-bf23-284f83b933f3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:30.748185 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-631dbc05-7553-4aa8-98d7-882d45639935 req-9f8a2212-8b36-49ab-bf23-284f83b933f3 service nova] Creating event network-changed:82913e05-d281-471d-920c-eef2d54c9c67 for instance a3056427-5687-4dbf-93e9-a257b3ec51cf on n-h1-839401-11 Aug 29 15:27:30.753249 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-631dbc05-7553-4aa8-98d7-882d45639935 req-9f8a2212-8b36-49ab-bf23-284f83b933f3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033805 Aug 29 15:27:30.753877 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 359/691] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:30.759050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d0746290-8ed6-432f-8a98-7d37dac43810 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:30.759734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d0746290-8ed6-432f-8a98-7d37dac43810 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:30.766308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0746290-8ed6-432f-8a98-7d37dac43810 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:30.766837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0746290-8ed6-432f-8a98-7d37dac43810 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:30.767273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0746290-8ed6-432f-8a98-7d37dac43810 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:30.768053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0746290-8ed6-432f-8a98-7d37dac43810 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:30.768513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0746290-8ed6-432f-8a98-7d37dac43810 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:30.768936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0746290-8ed6-432f-8a98-7d37dac43810 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:30.963972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d0746290-8ed6-432f-8a98-7d37dac43810 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:30.971865 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d0746290-8ed6-432f-8a98-7d37dac43810 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1319 microversion: 2.1 time: 0.216809 Aug 29 15:27:30.985953 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 360/692] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:30 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:31.135926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dcbfd256-04bb-42d0-8dc8-81d53c919a80 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Action: 'update', calling method: .version_select at 0x7fc42bcba430>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:31.139739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcbfd256-04bb-42d0-8dc8-81d53c919a80 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:31.140784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcbfd256-04bb-42d0-8dc8-81d53c919a80 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:31.140784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcbfd256-04bb-42d0-8dc8-81d53c919a80 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:31.159181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcbfd256-04bb-42d0-8dc8-81d53c919a80 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:31.159669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcbfd256-04bb-42d0-8dc8-81d53c919a80 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:31.160100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcbfd256-04bb-42d0-8dc8-81d53c919a80 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:31.168645 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-dcbfd256-04bb-42d0-8dc8-81d53c919a80 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] HTTP exception thrown: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dcbfd256-04bb-42d0-8dc8-81d53c919a80 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Request method failure captured: Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: request: PUT /compute/v2.1/os-services/eec5e65a-a503-4c1c-b910-6d0f2ede6294 HTTP/1.1 Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 56 Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNrhbG4fIwVzO6phb1vEXScry7uIwVprqp65ELSlFS6ZFDlmQfgRi7-jgcgKIGLoy8t8HbrDVCwiKCKZyC1V4TT3UqU3T5MZXyhyMgKb69mwn56lIykbtpDAhwpKIg-AzxBdrPfP0_MXsZTvllwrbjJWVktQZjm-XU7bp8Z3ocN-Lgc Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 4cfaad1ee0be4375b8b2c94abdf62a80 Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-956418586 Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:27:31.171302 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:27:31.173261 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4cfaad1ee0be4375b8b2c94abdf62a80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4cfaad1ee0be4375b8b2c94abdf62a80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4cfaad1ee0be4375b8b2c94abdf62a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4cfaad1ee0be4375b8b2c94abdf62a80"}]}] Aug 29 15:27:31.173261 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-956418586 Aug 29 15:27:31.173261 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 4cfaad1ee0be4375b8b2c94abdf62a80 Aug 29 15:27:31.173261 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-956418586 Aug 29 15:27:31.173261 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin Aug 29 15:27:31.173261 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:27:31.173261 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:27:31.173261 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: af3d4b1bc2f943ccba6136346f72789e Aug 29 15:27:31.173261 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin Aug 29 15:27:31.173261 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:27:31.173261 n-d-839401-11 devstack@n-api.service[122361]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 29 15:27:31.173261 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:27:31.173261 n-d-839401-11 devstack@n-api.service[122361]: exception: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'eec5e65a-a503-4c1c-b910-6d0f2ede6294', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:31.174270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:31.178422 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:31.180871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:31.180871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. Aug 29 15:27:31.180871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:31.180871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dcbfd256-04bb-42d0-8dc8-81d53c919a80 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Returning 404 to user: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:31.180871 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dcbfd256-04bb-42d0-8dc8-81d53c919a80 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-services/eec5e65a-a503-4c1c-b910-6d0f2ede6294" status: 404 len: 110 microversion: 2.53 time: 0.185735 Aug 29 15:27:31.180871 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 361/693] 10.222.0.62 () {62 vars in 1309 bytes} [Mon Aug 29 15:27:30 2022] PUT /compute/v2.1/os-services/eec5e65a-a503-4c1c-b910-6d0f2ede6294 => generated 110 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:27:31.180871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2ac632ce-7e2f-4127-8089-a42c94b12f7e tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] Action: 'create', calling method: .version_select at 0x7fc42bcba040>, body: {"pool": null} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:32.662742 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2ac632ce-7e2f-4127-8089-a42c94b12f7e tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] 10.222.0.62 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.487704 Aug 29 15:27:32.663345 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 362/694] 10.222.0.62 () {60 vars in 1170 bytes} [Mon Aug 29 15:27:31 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:32.668265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea8d6941-ee1f-40ee-bd82-051106345db0 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Action: 'update', calling method: .version_select at 0x7fc42bcba550>, body: {"status": "disabled"} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:32.672065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea8d6941-ee1f-40ee-bd82-051106345db0 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:32.672633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea8d6941-ee1f-40ee-bd82-051106345db0 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:32.673285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea8d6941-ee1f-40ee-bd82-051106345db0 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:32.682468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea8d6941-ee1f-40ee-bd82-051106345db0 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:32.683167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea8d6941-ee1f-40ee-bd82-051106345db0 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:32.683800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea8d6941-ee1f-40ee-bd82-051106345db0 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:32.689004 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-ea8d6941-ee1f-40ee-bd82-051106345db0 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] HTTP exception thrown: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea8d6941-ee1f-40ee-bd82-051106345db0 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Request method failure captured: Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: request: PUT /compute/v2.1/os-services/eec5e65a-a503-4c1c-b910-6d0f2ede6294 HTTP/1.1 Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 22 Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNrhbG4fIwVzO6phb1vEXScry7uIwVprqp65ELSlFS6ZFDlmQfgRi7-jgcgKIGLoy8t8HbrDVCwiKCKZyC1V4TT3UqU3T5MZXyhyMgKb69mwn56lIykbtpDAhwpKIg-AzxBdrPfP0_MXsZTvllwrbjJWVktQZjm-XU7bp8Z3ocN-Lgc Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 4cfaad1ee0be4375b8b2c94abdf62a80 Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-956418586 Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:27:32.690730 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:27:32.692162 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4cfaad1ee0be4375b8b2c94abdf62a80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4cfaad1ee0be4375b8b2c94abdf62a80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4cfaad1ee0be4375b8b2c94abdf62a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4cfaad1ee0be4375b8b2c94abdf62a80"}]}] Aug 29 15:27:32.692162 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-956418586 Aug 29 15:27:32.692162 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 4cfaad1ee0be4375b8b2c94abdf62a80 Aug 29 15:27:32.692162 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-956418586 Aug 29 15:27:32.692162 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin Aug 29 15:27:32.692162 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:27:32.692162 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:27:32.692162 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: af3d4b1bc2f943ccba6136346f72789e Aug 29 15:27:32.692162 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin Aug 29 15:27:32.692162 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:27:32.692162 n-d-839401-11 devstack@n-api.service[122361]: {"status": "disabled"} Aug 29 15:27:32.692162 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:27:32.692162 n-d-839401-11 devstack@n-api.service[122361]: exception: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. Aug 29 15:27:32.692162 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'eec5e65a-a503-4c1c-b910-6d0f2ede6294', 'body': {'status': 'disabled'}} Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:32.692999 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:32.697047 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:32.698955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. Aug 29 15:27:32.698955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:32.698955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea8d6941-ee1f-40ee-bd82-051106345db0 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Returning 404 to user: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:32.698955 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ea8d6941-ee1f-40ee-bd82-051106345db0 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-services/eec5e65a-a503-4c1c-b910-6d0f2ede6294" status: 404 len: 110 microversion: 2.53 time: 0.027781 Aug 29 15:27:32.698955 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 363/695] 10.222.0.62 () {62 vars in 1309 bytes} [Mon Aug 29 15:27:32 2022] PUT /compute/v2.1/os-services/eec5e65a-a503-4c1c-b910-6d0f2ede6294 => generated 110 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:27:32.698955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d845048e-9211-4fa2-84bb-70d47aab7403 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:32.699708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d845048e-9211-4fa2-84bb-70d47aab7403 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:32.704871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d845048e-9211-4fa2-84bb-70d47aab7403 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:32.705394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d845048e-9211-4fa2-84bb-70d47aab7403 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:32.705836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d845048e-9211-4fa2-84bb-70d47aab7403 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:32.706540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d845048e-9211-4fa2-84bb-70d47aab7403 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:32.706995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d845048e-9211-4fa2-84bb-70d47aab7403 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:32.707417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d845048e-9211-4fa2-84bb-70d47aab7403 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:32.943331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d845048e-9211-4fa2-84bb-70d47aab7403 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:32.951706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d845048e-9211-4fa2-84bb-70d47aab7403 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:32.953166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d845048e-9211-4fa2-84bb-70d47aab7403 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:32.954301 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d845048e-9211-4fa2-84bb-70d47aab7403 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1362 microversion: 2.25 time: 0.260651 Aug 29 15:27:32.954843 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 364/696] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:32 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:32.959275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6462a8d1-4b77-4c05-9ca0-64cffbfe49db tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:32.959894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6462a8d1-4b77-4c05-9ca0-64cffbfe49db tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:32.965993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6462a8d1-4b77-4c05-9ca0-64cffbfe49db tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:32.966486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6462a8d1-4b77-4c05-9ca0-64cffbfe49db tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:32.966914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6462a8d1-4b77-4c05-9ca0-64cffbfe49db tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:32.967623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6462a8d1-4b77-4c05-9ca0-64cffbfe49db tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:32.968071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6462a8d1-4b77-4c05-9ca0-64cffbfe49db tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:32.968475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6462a8d1-4b77-4c05-9ca0-64cffbfe49db tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:33.178919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6462a8d1-4b77-4c05-9ca0-64cffbfe49db tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:33.187462 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6462a8d1-4b77-4c05-9ca0-64cffbfe49db tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1316 microversion: 2.1 time: 0.231593 Aug 29 15:27:33.188243 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 365/697] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:32 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:33.193474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a68f619f-0f9b-4c78-9e2d-0536f0ed86b0 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:33.194343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a68f619f-0f9b-4c78-9e2d-0536f0ed86b0 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:33.200435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a68f619f-0f9b-4c78-9e2d-0536f0ed86b0 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:33.201128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a68f619f-0f9b-4c78-9e2d-0536f0ed86b0 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:33.201725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a68f619f-0f9b-4c78-9e2d-0536f0ed86b0 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:33.202290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a68f619f-0f9b-4c78-9e2d-0536f0ed86b0 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:33.202746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a68f619f-0f9b-4c78-9e2d-0536f0ed86b0 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:33.203181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a68f619f-0f9b-4c78-9e2d-0536f0ed86b0 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:33.345663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a68f619f-0f9b-4c78-9e2d-0536f0ed86b0 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:33.355940 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a68f619f-0f9b-4c78-9e2d-0536f0ed86b0 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 200 len: 1467 microversion: 2.1 time: 0.166257 Aug 29 15:27:33.356557 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 366/698] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:33 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 1467 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:33.361197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c6bf36bb-0d02-49f3-a66e-5f5467fc4d47 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:33.361808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c6bf36bb-0d02-49f3-a66e-5f5467fc4d47 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:33.368454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6bf36bb-0d02-49f3-a66e-5f5467fc4d47 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:33.368931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6bf36bb-0d02-49f3-a66e-5f5467fc4d47 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:33.369396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6bf36bb-0d02-49f3-a66e-5f5467fc4d47 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:33.370080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6bf36bb-0d02-49f3-a66e-5f5467fc4d47 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:33.370528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6bf36bb-0d02-49f3-a66e-5f5467fc4d47 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:33.370947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6bf36bb-0d02-49f3-a66e-5f5467fc4d47 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:33.505538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c6bf36bb-0d02-49f3-a66e-5f5467fc4d47 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:33.516869 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c6bf36bb-0d02-49f3-a66e-5f5467fc4d47 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1319 microversion: 2.1 time: 0.159047 Aug 29 15:27:33.517715 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 367/699] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:33 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:33.524271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1aab609d-c3ba-4b7b-8c85-73cf398fb841 tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] Action: 'create', calling method: .version_select at 0x7fc42bdb9700>, body: {"pool": null} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:34.626672 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1aab609d-c3ba-4b7b-8c85-73cf398fb841 tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] 10.222.0.62 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.107810 Aug 29 15:27:34.627339 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 368/700] 10.222.0.62 () {60 vars in 1170 bytes} [Mon Aug 29 15:27:33 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:34.631919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0f95915d-a8ca-412c-b90b-9a344a2d468c tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Action: 'update', calling method: .version_select at 0x7fc42bdb9f70>, body: {"status": "enabled"} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:34.635895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f95915d-a8ca-412c-b90b-9a344a2d468c tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:34.636382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f95915d-a8ca-412c-b90b-9a344a2d468c tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:34.636820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f95915d-a8ca-412c-b90b-9a344a2d468c tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:34.642843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f95915d-a8ca-412c-b90b-9a344a2d468c tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:34.643318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f95915d-a8ca-412c-b90b-9a344a2d468c tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:34.643864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f95915d-a8ca-412c-b90b-9a344a2d468c tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:34.648892 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-0f95915d-a8ca-412c-b90b-9a344a2d468c tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] HTTP exception thrown: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0f95915d-a8ca-412c-b90b-9a344a2d468c tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Request method failure captured: Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: request: PUT /compute/v2.1/os-services/eec5e65a-a503-4c1c-b910-6d0f2ede6294 HTTP/1.1 Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 21 Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNrhbG4fIwVzO6phb1vEXScry7uIwVprqp65ELSlFS6ZFDlmQfgRi7-jgcgKIGLoy8t8HbrDVCwiKCKZyC1V4TT3UqU3T5MZXyhyMgKb69mwn56lIykbtpDAhwpKIg-AzxBdrPfP0_MXsZTvllwrbjJWVktQZjm-XU7bp8Z3ocN-Lgc Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 4cfaad1ee0be4375b8b2c94abdf62a80 Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-956418586 Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:27:34.650544 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:27:34.652260 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4cfaad1ee0be4375b8b2c94abdf62a80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4cfaad1ee0be4375b8b2c94abdf62a80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4cfaad1ee0be4375b8b2c94abdf62a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4cfaad1ee0be4375b8b2c94abdf62a80"}]}] Aug 29 15:27:34.652260 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-956418586 Aug 29 15:27:34.652260 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 4cfaad1ee0be4375b8b2c94abdf62a80 Aug 29 15:27:34.652260 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-956418586 Aug 29 15:27:34.652260 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin Aug 29 15:27:34.652260 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:27:34.652260 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:27:34.652260 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: af3d4b1bc2f943ccba6136346f72789e Aug 29 15:27:34.652260 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin Aug 29 15:27:34.652260 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:27:34.652260 n-d-839401-11 devstack@n-api.service[122361]: {"status": "enabled"} Aug 29 15:27:34.652260 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:27:34.652260 n-d-839401-11 devstack@n-api.service[122361]: exception: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. Aug 29 15:27:34.652260 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'eec5e65a-a503-4c1c-b910-6d0f2ede6294', 'body': {'status': 'enabled'}} Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:34.653547 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:34.655543 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:34.656981 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. Aug 29 15:27:34.656981 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:34.656981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0f95915d-a8ca-412c-b90b-9a344a2d468c tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Returning 404 to user: Service eec5e65a-a503-4c1c-b910-6d0f2ede6294 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:34.656981 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0f95915d-a8ca-412c-b90b-9a344a2d468c tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-services/eec5e65a-a503-4c1c-b910-6d0f2ede6294" status: 404 len: 110 microversion: 2.53 time: 0.023653 Aug 29 15:27:34.656981 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 369/701] 10.222.0.62 () {62 vars in 1309 bytes} [Mon Aug 29 15:27:34 2022] PUT /compute/v2.1/os-services/eec5e65a-a503-4c1c-b910-6d0f2ede6294 => generated 110 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:27:34.658783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b4200777-e1ad-4460-b854-286ba44eef9f tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:34.659323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b4200777-e1ad-4460-b854-286ba44eef9f tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:34.667339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4200777-e1ad-4460-b854-286ba44eef9f tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:34.667841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4200777-e1ad-4460-b854-286ba44eef9f tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:34.668312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4200777-e1ad-4460-b854-286ba44eef9f tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:34.669045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4200777-e1ad-4460-b854-286ba44eef9f tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:34.669549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4200777-e1ad-4460-b854-286ba44eef9f tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:34.669986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4200777-e1ad-4460-b854-286ba44eef9f tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:34.672923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:34.696556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-b4200777-e1ad-4460-b854-286ba44eef9f tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lazy-loading 'flavor' on Instance uuid 7dccfea7-bbcc-497d-bf3b-b129b04a0784 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:27:34.774799 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b4200777-e1ad-4460-b854-286ba44eef9f tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784/action" status: 202 len: 0 microversion: 2.1 time: 0.121158 Aug 29 15:27:34.775796 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 370/702] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:27:34 2022] POST /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:27:34.786269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-1a37cf4e-6d27-4fbc-846d-f4207879d4ec req-38efd2e2-8d5d-42b4-85bd-2065a8e9ec37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039c62b6-55e7-4b8a-bf96-c079addd6fe6", "name": "network-vif-plugged", "status": "completed", "tag": "482320d1-9c00-4266-9780-97bd22da1637"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:34.796903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1a37cf4e-6d27-4fbc-846d-f4207879d4ec req-38efd2e2-8d5d-42b4-85bd-2065a8e9ec37 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:34.797639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1a37cf4e-6d27-4fbc-846d-f4207879d4ec req-38efd2e2-8d5d-42b4-85bd-2065a8e9ec37 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:34.798102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1a37cf4e-6d27-4fbc-846d-f4207879d4ec req-38efd2e2-8d5d-42b4-85bd-2065a8e9ec37 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:34.811602 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-1a37cf4e-6d27-4fbc-846d-f4207879d4ec req-38efd2e2-8d5d-42b4-85bd-2065a8e9ec37 service nova] Creating event network-vif-plugged:482320d1-9c00-4266-9780-97bd22da1637 for instance 039c62b6-55e7-4b8a-bf96-c079addd6fe6 on n-h1-839401-11 Aug 29 15:27:34.816137 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-1a37cf4e-6d27-4fbc-846d-f4207879d4ec req-38efd2e2-8d5d-42b4-85bd-2065a8e9ec37 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037601 Aug 29 15:27:34.816914 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 371/703] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:34.822115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-acc4814a-0ebb-4751-898a-61d3c799d42d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:34.822808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-acc4814a-0ebb-4751-898a-61d3c799d42d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:34.834631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acc4814a-0ebb-4751-898a-61d3c799d42d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:34.835347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acc4814a-0ebb-4751-898a-61d3c799d42d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:34.835563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acc4814a-0ebb-4751-898a-61d3c799d42d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:34.836272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acc4814a-0ebb-4751-898a-61d3c799d42d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:34.836736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acc4814a-0ebb-4751-898a-61d3c799d42d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:34.837185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acc4814a-0ebb-4751-898a-61d3c799d42d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:35.130386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-acc4814a-0ebb-4751-898a-61d3c799d42d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:35.147077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-acc4814a-0ebb-4751-898a-61d3c799d42d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:35.148542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-acc4814a-0ebb-4751-898a-61d3c799d42d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:35.149791 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-acc4814a-0ebb-4751-898a-61d3c799d42d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1362 microversion: 2.25 time: 0.331846 Aug 29 15:27:35.165225 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 372/704] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:34 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:35.170246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-515d123e-77ee-4f71-b092-31ffd0b793a7 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:35.170867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-515d123e-77ee-4f71-b092-31ffd0b793a7 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:35.176985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-515d123e-77ee-4f71-b092-31ffd0b793a7 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:35.177511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-515d123e-77ee-4f71-b092-31ffd0b793a7 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:35.177952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-515d123e-77ee-4f71-b092-31ffd0b793a7 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:35.178661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-515d123e-77ee-4f71-b092-31ffd0b793a7 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:35.179117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-515d123e-77ee-4f71-b092-31ffd0b793a7 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:35.179832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-515d123e-77ee-4f71-b092-31ffd0b793a7 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:35.428476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-515d123e-77ee-4f71-b092-31ffd0b793a7 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:35.436701 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-515d123e-77ee-4f71-b092-31ffd0b793a7 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1316 microversion: 2.1 time: 0.270307 Aug 29 15:27:35.437311 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 373/705] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:35 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1316 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:35.441751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-916b22ea-8ba2-4540-9359-c5adbbdada3c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:35.442632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-916b22ea-8ba2-4540-9359-c5adbbdada3c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:35.448638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-916b22ea-8ba2-4540-9359-c5adbbdada3c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:35.449154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-916b22ea-8ba2-4540-9359-c5adbbdada3c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:35.449582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-916b22ea-8ba2-4540-9359-c5adbbdada3c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:35.450307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-916b22ea-8ba2-4540-9359-c5adbbdada3c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:35.451119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-916b22ea-8ba2-4540-9359-c5adbbdada3c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:35.451247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-916b22ea-8ba2-4540-9359-c5adbbdada3c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:35.628936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-916b22ea-8ba2-4540-9359-c5adbbdada3c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:35.636840 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-916b22ea-8ba2-4540-9359-c5adbbdada3c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1319 microversion: 2.1 time: 0.198569 Aug 29 15:27:35.637452 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 374/706] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:35 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:35.641930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a4e5fe5e-abe3-4654-a4b5-da87623d2c05 tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] Action: 'create', calling method: .version_select at 0x7fc42bcba670>, body: {"pool": null} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:35.877168 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9325516c-df4d-4a15-83ad-818dc4ab12fd tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff/action" status: 202 len: 0 microversion: 2.1 time: 8.042809 Aug 29 15:27:35.879016 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 333/707] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:27:27 2022] POST /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff/action => generated 0 bytes in 8046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:27:35.884035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-93855729-802f-47e8-ba01-2b909b33a109 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:35.888959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93855729-802f-47e8-ba01-2b909b33a109 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:35.889836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93855729-802f-47e8-ba01-2b909b33a109 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:35.890547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93855729-802f-47e8-ba01-2b909b33a109 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:35.892319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93855729-802f-47e8-ba01-2b909b33a109 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:35.892990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93855729-802f-47e8-ba01-2b909b33a109 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:35.893711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93855729-802f-47e8-ba01-2b909b33a109 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:35.925865 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-93855729-802f-47e8-ba01-2b909b33a109 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.045329 Aug 29 15:27:35.927764 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 334/708] 10.222.0.62 () {60 vars in 1178 bytes} [Mon Aug 29 15:27:35 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:35.938806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b7582e6-07a0-44f2-b31e-2f9817dcb48d tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:35.939212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8b7582e6-07a0-44f2-b31e-2f9817dcb48d tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:35.945356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b7582e6-07a0-44f2-b31e-2f9817dcb48d tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:35.945847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b7582e6-07a0-44f2-b31e-2f9817dcb48d tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:35.946291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b7582e6-07a0-44f2-b31e-2f9817dcb48d tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:35.947036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b7582e6-07a0-44f2-b31e-2f9817dcb48d tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:35.947468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b7582e6-07a0-44f2-b31e-2f9817dcb48d tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:35.947895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b7582e6-07a0-44f2-b31e-2f9817dcb48d tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.090541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8b7582e6-07a0-44f2-b31e-2f9817dcb48d tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:36.098715 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8b7582e6-07a0-44f2-b31e-2f9817dcb48d tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 200 len: 1458 microversion: 2.1 time: 0.168958 Aug 29 15:27:36.099383 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 335/709] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:35 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 1458 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:36.109183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7ce0627-542a-4916-9864-32bea8b8e2d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:36.110078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f7ce0627-542a-4916-9864-32bea8b8e2d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:36.116793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7ce0627-542a-4916-9864-32bea8b8e2d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.117387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7ce0627-542a-4916-9864-32bea8b8e2d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.117885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7ce0627-542a-4916-9864-32bea8b8e2d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.118588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7ce0627-542a-4916-9864-32bea8b8e2d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.119051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7ce0627-542a-4916-9864-32bea8b8e2d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.119483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7ce0627-542a-4916-9864-32bea8b8e2d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.255714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f7ce0627-542a-4916-9864-32bea8b8e2d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:36.264132 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f7ce0627-542a-4916-9864-32bea8b8e2d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.163667 Aug 29 15:27:36.264772 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 336/710] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:36 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:36.282234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fe63285d-cd41-45b0-aefe-7b96b1424615 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:36.285917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe63285d-cd41-45b0-aefe-7b96b1424615 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.286469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe63285d-cd41-45b0-aefe-7b96b1424615 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.286969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe63285d-cd41-45b0-aefe-7b96b1424615 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.287757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe63285d-cd41-45b0-aefe-7b96b1424615 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.288299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe63285d-cd41-45b0-aefe-7b96b1424615 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.288786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe63285d-cd41-45b0-aefe-7b96b1424615 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.312203 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fe63285d-cd41-45b0-aefe-7b96b1424615 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.033823 Aug 29 15:27:36.313207 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 337/711] 10.222.0.62 () {60 vars in 1211 bytes} [Mon Aug 29 15:27:36 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:36.317451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2e03d48a-5399-44af-aafe-d9f7c4db3e05 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:36.318144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2e03d48a-5399-44af-aafe-d9f7c4db3e05 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:36.324955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e03d48a-5399-44af-aafe-d9f7c4db3e05 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.325485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e03d48a-5399-44af-aafe-d9f7c4db3e05 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.325920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e03d48a-5399-44af-aafe-d9f7c4db3e05 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.326619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e03d48a-5399-44af-aafe-d9f7c4db3e05 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.327077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e03d48a-5399-44af-aafe-d9f7c4db3e05 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.327501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e03d48a-5399-44af-aafe-d9f7c4db3e05 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.556008 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2e03d48a-5399-44af-aafe-d9f7c4db3e05 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 200 len: 1611 microversion: 2.1 time: 0.241760 Aug 29 15:27:36.556724 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 338/712] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:36 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 1611 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:36.561662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f3b32fa0-1c1a-4728-bc68-08031358396b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:36.562342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f3b32fa0-1c1a-4728-bc68-08031358396b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:36.568550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3b32fa0-1c1a-4728-bc68-08031358396b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.569181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3b32fa0-1c1a-4728-bc68-08031358396b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.569695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3b32fa0-1c1a-4728-bc68-08031358396b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.570479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3b32fa0-1c1a-4728-bc68-08031358396b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.571262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3b32fa0-1c1a-4728-bc68-08031358396b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.571687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3b32fa0-1c1a-4728-bc68-08031358396b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.712493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f3b32fa0-1c1a-4728-bc68-08031358396b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:36.722692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f3b32fa0-1c1a-4728-bc68-08031358396b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:36.724536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f3b32fa0-1c1a-4728-bc68-08031358396b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:36.725697 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f3b32fa0-1c1a-4728-bc68-08031358396b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1362 microversion: 2.25 time: 0.167680 Aug 29 15:27:36.726260 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 339/713] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:36 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:36.730645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a698b58f-1bfc-46c7-ae4f-79440f56b9c4 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:36.734119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a698b58f-1bfc-46c7-ae4f-79440f56b9c4 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.734598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a698b58f-1bfc-46c7-ae4f-79440f56b9c4 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.735032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a698b58f-1bfc-46c7-ae4f-79440f56b9c4 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.735840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a698b58f-1bfc-46c7-ae4f-79440f56b9c4 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.736302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a698b58f-1bfc-46c7-ae4f-79440f56b9c4 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.736767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a698b58f-1bfc-46c7-ae4f-79440f56b9c4 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.763835 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a698b58f-1bfc-46c7-ae4f-79440f56b9c4 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.036455 Aug 29 15:27:36.771393 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 340/714] 10.222.0.62 () {60 vars in 1178 bytes} [Mon Aug 29 15:27:36 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:36.771393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1a519591-1b9a-47b9-bc5f-376a27ec401a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:36.771393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1a519591-1b9a-47b9-bc5f-376a27ec401a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:36.776366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a519591-1b9a-47b9-bc5f-376a27ec401a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.777518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a519591-1b9a-47b9-bc5f-376a27ec401a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.778007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a519591-1b9a-47b9-bc5f-376a27ec401a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.778699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a519591-1b9a-47b9-bc5f-376a27ec401a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.779545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a519591-1b9a-47b9-bc5f-376a27ec401a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.780011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a519591-1b9a-47b9-bc5f-376a27ec401a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.866946 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a4e5fe5e-abe3-4654-a4b5-da87623d2c05 tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] 10.222.0.62 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.228410 Aug 29 15:27:36.867541 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 375/715] 10.222.0.62 () {60 vars in 1170 bytes} [Mon Aug 29 15:27:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:36.872376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b0516ef5-7c99-4ed4-bf3b-dbfd0ff5bc5b tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:36.876616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0516ef5-7c99-4ed4-bf3b-dbfd0ff5bc5b tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.877125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0516ef5-7c99-4ed4-bf3b-dbfd0ff5bc5b tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.877571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0516ef5-7c99-4ed4-bf3b-dbfd0ff5bc5b tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.878314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0516ef5-7c99-4ed4-bf3b-dbfd0ff5bc5b tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.878772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0516ef5-7c99-4ed4-bf3b-dbfd0ff5bc5b tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.879206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0516ef5-7c99-4ed4-bf3b-dbfd0ff5bc5b tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.905134 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b0516ef5-7c99-4ed4-bf3b-dbfd0ff5bc5b tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.036208 Aug 29 15:27:36.905753 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 376/716] 10.222.0.62 () {58 vars in 1176 bytes} [Mon Aug 29 15:27:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:36.910207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1d9ed3d2-12e1-469e-97da-bc5deb178de5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:36.910801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1d9ed3d2-12e1-469e-97da-bc5deb178de5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:36.916802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d9ed3d2-12e1-469e-97da-bc5deb178de5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.917330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d9ed3d2-12e1-469e-97da-bc5deb178de5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.917767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d9ed3d2-12e1-469e-97da-bc5deb178de5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.918465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d9ed3d2-12e1-469e-97da-bc5deb178de5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.919831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1a519591-1b9a-47b9-bc5f-376a27ec401a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:36.920308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d9ed3d2-12e1-469e-97da-bc5deb178de5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.920308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d9ed3d2-12e1-469e-97da-bc5deb178de5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.927459 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1a519591-1b9a-47b9-bc5f-376a27ec401a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1316 microversion: 2.1 time: 0.161922 Aug 29 15:27:36.928412 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 341/717] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:36 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:36.933607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4662d9cf-b9d2-4549-b4bd-16ebc7adc6d9 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:36.937760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4662d9cf-b9d2-4549-b4bd-16ebc7adc6d9 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.938344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4662d9cf-b9d2-4549-b4bd-16ebc7adc6d9 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.938961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4662d9cf-b9d2-4549-b4bd-16ebc7adc6d9 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.939973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4662d9cf-b9d2-4549-b4bd-16ebc7adc6d9 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.940594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4662d9cf-b9d2-4549-b4bd-16ebc7adc6d9 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.941051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4662d9cf-b9d2-4549-b4bd-16ebc7adc6d9 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.967749 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4662d9cf-b9d2-4549-b4bd-16ebc7adc6d9 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?host=n-d-839401-11&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.038279 Aug 29 15:27:36.968576 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 342/718] 10.222.0.62 () {60 vars in 1237 bytes} [Mon Aug 29 15:27:36 2022] GET /compute/v2.1/os-services?host=n-d-839401-11&binary=xxx => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:36.973000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-1d95d216-8f8d-44ea-bed9-9e888e6ba0f6 req-bfc97b11-ebeb-4ec4-8ca8-af47af3ada70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d3d180-599f-4c45-a0ea-53f2180484d5", "name": "network-vif-plugged", "status": "completed", "tag": "a173d34f-0b58-4d2d-91dc-183ed4b4d4a6"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:36.982904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1d95d216-8f8d-44ea-bed9-9e888e6ba0f6 req-bfc97b11-ebeb-4ec4-8ca8-af47af3ada70 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:36.983394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1d95d216-8f8d-44ea-bed9-9e888e6ba0f6 req-bfc97b11-ebeb-4ec4-8ca8-af47af3ada70 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:36.983838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1d95d216-8f8d-44ea-bed9-9e888e6ba0f6 req-bfc97b11-ebeb-4ec4-8ca8-af47af3ada70 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:36.995328 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-1d95d216-8f8d-44ea-bed9-9e888e6ba0f6 req-bfc97b11-ebeb-4ec4-8ca8-af47af3ada70 service nova] Creating event network-vif-plugged:a173d34f-0b58-4d2d-91dc-183ed4b4d4a6 for instance 45d3d180-599f-4c45-a0ea-53f2180484d5 on n-h2-839401-11 Aug 29 15:27:37.000380 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-1d95d216-8f8d-44ea-bed9-9e888e6ba0f6 req-bfc97b11-ebeb-4ec4-8ca8-af47af3ada70 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030865 Aug 29 15:27:37.000988 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 343/719] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:37.006506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6d8d821d-e985-4283-bc4d-8e64aa699635 tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] Calling method '.version_select at 0x7fc42bcdb3a0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:37.199660 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6d8d821d-e985-4283-bc4d-8e64aa699635 tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] 10.222.0.62 "GET /compute/v2.1/os-floating-ips/595b1cc7-0987-49c9-9be7-abd663e3d4a1" status: 200 len: 142 microversion: 2.1 time: 0.197015 Aug 29 15:27:37.200295 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 344/720] 10.222.0.62 () {58 vars in 1260 bytes} [Mon Aug 29 15:27:37 2022] GET /compute/v2.1/os-floating-ips/595b1cc7-0987-49c9-9be7-abd663e3d4a1 => generated 142 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:37.204835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e2bf4f9b-ba38-499d-beea-93a5e14cd367 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-839401-11", "block_migration": true, "disk_over_commit": false}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:37.207614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e2bf4f9b-ba38-499d-beea-93a5e14cd367 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:37.214366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2bf4f9b-ba38-499d-beea-93a5e14cd367 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:37.214849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2bf4f9b-ba38-499d-beea-93a5e14cd367 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:37.215303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2bf4f9b-ba38-499d-beea-93a5e14cd367 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:37.216006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2bf4f9b-ba38-499d-beea-93a5e14cd367 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:37.216452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2bf4f9b-ba38-499d-beea-93a5e14cd367 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:37.216868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2bf4f9b-ba38-499d-beea-93a5e14cd367 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:37.241792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-e2bf4f9b-ba38-499d-beea-93a5e14cd367 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Lazy-loading 'flavor' on Instance uuid 7dccfea7-bbcc-497d-bf3b-b129b04a0784 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:27:37.254575 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-e2bf4f9b-ba38-499d-beea-93a5e14cd367 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 7dccfea7-bbcc-497d-bf3b-b129b04a0784 while it is in vm_state suspended Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e2bf4f9b-ba38-499d-beea-93a5e14cd367 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Request method failure captured: Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784/action HTTP/1.1 Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 98 Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqzZcxKho5sSnI9EQLkDbyf6vLKy50UIYhKaFamgzv5krMJ6gSqpo6E3B4BIIuC48xLnYo_8VX6G_HVnqMciZgoIe1Sr-5aP52o89NWeVBYptZjO9FMbMD23k0MesCoBx8qlxn-wunBxV5X-QTJ9bzUx1W32sx-hZlkzSEy2NTmTHM Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: ed50d792be774f549c717ab9c0312aa0 Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-LiveMigrationNegativeTest-984807124 Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:27:37.256439 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:27:37.258105 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ed50d792be774f549c717ab9c0312aa0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ed50d792be774f549c717ab9c0312aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ed50d792be774f549c717ab9c0312aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ed50d792be774f549c717ab9c0312aa0"}]}] Aug 29 15:27:37.258105 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-LiveMigrationNegativeTest-984807124 Aug 29 15:27:37.258105 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: ed50d792be774f549c717ab9c0312aa0 Aug 29 15:27:37.258105 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-984807124 Aug 29 15:27:37.258105 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-LiveMigrationNegativeTest-984807124-project-admin Aug 29 15:27:37.258105 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:27:37.258105 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:27:37.258105 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 2aed3bffd52f49f2a963b53516f62135 Aug 29 15:27:37.258105 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-LiveMigrationNegativeTest-984807124-project-admin Aug 29 15:27:37.258105 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:27:37.258105 n-d-839401-11 devstack@n-api.service[122360]: {"os-migrateLive": {"host": "n-h1-839401-11", "block_migration": true, "disk_over_commit": false}} Aug 29 15:27:37.258105 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: exception: Cannot 'os-migrateLive' instance 7dccfea7-bbcc-497d-bf3b-b129b04a0784 while it is in vm_state suspended Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7dccfea7-bbcc-497d-bf3b-b129b04a0784', 'body': {'os-migrateLive': {'host': 'n-h1-839401-11', 'block_migration': True, 'disk_over_commit': False}}} Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 29 15:27:37.258884 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7dccfea7-bbcc-497d-bf3b-b129b04a0784 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:37.260206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 7dccfea7-bbcc-497d-bf3b-b129b04a0784 while it is in vm_state suspended Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 7dccfea7-bbcc-497d-bf3b-b129b04a0784 while it is in vm_state suspended Aug 29 15:27:37.266755 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:37.268417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e2bf4f9b-ba38-499d-beea-93a5e14cd367 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 7dccfea7-bbcc-497d-bf3b-b129b04a0784 while it is in vm_state suspended {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:37.268417 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e2bf4f9b-ba38-499d-beea-93a5e14cd367 tempest-LiveMigrationNegativeTest-984807124 tempest-LiveMigrationNegativeTest-984807124-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784/action" status: 409 len: 155 microversion: 2.1 time: 0.056652 Aug 29 15:27:37.268417 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 345/721] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:27:37 2022] POST /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784/action => generated 155 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:27:37.268417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8ccd33ae-c7b7-4773-95ba-8aa31b904025 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:37.268788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ccd33ae-c7b7-4773-95ba-8aa31b904025 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:37.268788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ccd33ae-c7b7-4773-95ba-8aa31b904025 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:37.268788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ccd33ae-c7b7-4773-95ba-8aa31b904025 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:37.269061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ccd33ae-c7b7-4773-95ba-8aa31b904025 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:37.269388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ccd33ae-c7b7-4773-95ba-8aa31b904025 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:37.269805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ccd33ae-c7b7-4773-95ba-8aa31b904025 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:37.294001 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8ccd33ae-c7b7-4773-95ba-8aa31b904025 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.034595 Aug 29 15:27:37.294591 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 346/722] 10.222.0.62 () {60 vars in 1178 bytes} [Mon Aug 29 15:27:37 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:37.299513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d57c2435-adc0-4bc3-a493-9a8693b373ac tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] Calling method '.version_select at 0x7fc42be02c10>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:37.421544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1d9ed3d2-12e1-469e-97da-bc5deb178de5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:37.429893 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1d9ed3d2-12e1-469e-97da-bc5deb178de5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1319 microversion: 2.1 time: 0.523162 Aug 29 15:27:37.430576 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 377/723] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:36 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:37.447650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-993b2c89-041f-4bb0-b7ff-61cba40727f5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:37.447986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-993b2c89-041f-4bb0-b7ff-61cba40727f5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:37.454071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-993b2c89-041f-4bb0-b7ff-61cba40727f5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:37.454557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-993b2c89-041f-4bb0-b7ff-61cba40727f5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:37.454986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-993b2c89-041f-4bb0-b7ff-61cba40727f5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:37.455675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-993b2c89-041f-4bb0-b7ff-61cba40727f5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:37.456232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-993b2c89-041f-4bb0-b7ff-61cba40727f5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:37.456744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-993b2c89-041f-4bb0-b7ff-61cba40727f5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:37.482014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-993b2c89-041f-4bb0-b7ff-61cba40727f5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:27:37.560863 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-993b2c89-041f-4bb0-b7ff-61cba40727f5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 204 len: 0 microversion: 2.1 time: 0.116740 Aug 29 15:27:37.561535 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 378/724] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:27:37 2022] DELETE /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:27:37.568559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-75b49e0e-e4bb-4f78-b7c7-2205ce45f8f9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:37.569277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-75b49e0e-e4bb-4f78-b7c7-2205ce45f8f9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:37.575142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75b49e0e-e4bb-4f78-b7c7-2205ce45f8f9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:37.575628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75b49e0e-e4bb-4f78-b7c7-2205ce45f8f9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:37.576065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75b49e0e-e4bb-4f78-b7c7-2205ce45f8f9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:37.576760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75b49e0e-e4bb-4f78-b7c7-2205ce45f8f9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:37.577484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75b49e0e-e4bb-4f78-b7c7-2205ce45f8f9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:37.577886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75b49e0e-e4bb-4f78-b7c7-2205ce45f8f9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:37.714388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-75b49e0e-e4bb-4f78-b7c7-2205ce45f8f9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:37.722840 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-75b49e0e-e4bb-4f78-b7c7-2205ce45f8f9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.160119 Aug 29 15:27:37.723434 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 379/725] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:37 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:37.728041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-05eadc6b-774f-492b-baa1-c4058705ba21 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:37.731955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05eadc6b-774f-492b-baa1-c4058705ba21 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:37.732446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05eadc6b-774f-492b-baa1-c4058705ba21 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:37.732923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05eadc6b-774f-492b-baa1-c4058705ba21 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:37.733695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05eadc6b-774f-492b-baa1-c4058705ba21 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:37.734152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05eadc6b-774f-492b-baa1-c4058705ba21 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:37.734575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05eadc6b-774f-492b-baa1-c4058705ba21 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:37.758512 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-05eadc6b-774f-492b-baa1-c4058705ba21 tempest-ServicesAdminNegativeV253TestJSON-956418586 tempest-ServicesAdminNegativeV253TestJSON-956418586-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.033973 Aug 29 15:27:37.759136 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 380/726] 10.222.0.62 () {60 vars in 1239 bytes} [Mon Aug 29 15:27:37 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:37.763718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3dd844a5-b4a8-4f2a-9651-a3a0c5401b3b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:37.765721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3dd844a5-b4a8-4f2a-9651-a3a0c5401b3b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:37.770691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3dd844a5-b4a8-4f2a-9651-a3a0c5401b3b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:37.771183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3dd844a5-b4a8-4f2a-9651-a3a0c5401b3b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:37.771622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3dd844a5-b4a8-4f2a-9651-a3a0c5401b3b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:37.772331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3dd844a5-b4a8-4f2a-9651-a3a0c5401b3b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:37.772783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3dd844a5-b4a8-4f2a-9651-a3a0c5401b3b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:37.773245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3dd844a5-b4a8-4f2a-9651-a3a0c5401b3b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:37.911388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3dd844a5-b4a8-4f2a-9651-a3a0c5401b3b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:37.919010 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3dd844a5-b4a8-4f2a-9651-a3a0c5401b3b tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 200 len: 1464 microversion: 2.1 time: 0.158925 Aug 29 15:27:37.919578 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 381/727] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:37 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:37.924425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c01dc532-0afa-4992-b349-d10e257abc06 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:37.925057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c01dc532-0afa-4992-b349-d10e257abc06 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:37.932097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01dc532-0afa-4992-b349-d10e257abc06 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:37.932791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01dc532-0afa-4992-b349-d10e257abc06 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:37.933268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01dc532-0afa-4992-b349-d10e257abc06 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:37.933973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01dc532-0afa-4992-b349-d10e257abc06 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:37.934430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01dc532-0afa-4992-b349-d10e257abc06 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:37.934862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01dc532-0afa-4992-b349-d10e257abc06 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:38.068930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c01dc532-0afa-4992-b349-d10e257abc06 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:38.077258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c01dc532-0afa-4992-b349-d10e257abc06 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:38.078712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c01dc532-0afa-4992-b349-d10e257abc06 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:38.079844 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c01dc532-0afa-4992-b349-d10e257abc06 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1362 microversion: 2.25 time: 0.159168 Aug 29 15:27:38.080440 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 382/728] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:37 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:38.191402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3f493abb-e213-4bbf-97a3-b4c456491157 tempest-ServicesAdminNegativeV253TestJSON-1433582983 tempest-ServicesAdminNegativeV253TestJSON-1433582983-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:38.194978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3f493abb-e213-4bbf-97a3-b4c456491157 tempest-ServicesAdminNegativeV253TestJSON-1433582983 tempest-ServicesAdminNegativeV253TestJSON-1433582983-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '6b100cd3c72e4f8db8e9555f4e3fb7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d51f2cc84e94ef090cf48e8a5dd2ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3f493abb-e213-4bbf-97a3-b4c456491157 tempest-ServicesAdminNegativeV253TestJSON-1433582983 tempest-ServicesAdminNegativeV253TestJSON-1433582983-project] Request method failure captured: Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNrhWsCv6Lh14jLCmRMP0RtpG7GeQdz-XN89Eg1KxtJiz370gvE2zLS8ixR4ZeOVkY4WNjdquLwRizS2DOkL_HXrPoWgvAVLfPeYOVjKM874LrA5uqwRzsEB8p0jRaqEtUgG4fTbrp-cElh2N-zc0T3uJ6PWoqpPzi1pU7D2Y31Mw6w Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 8d51f2cc84e94ef090cf48e8a5dd2ea2 Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1433582983 Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:27:38.196681 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:27:38.198314 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8d51f2cc84e94ef090cf48e8a5dd2ea2", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8d51f2cc84e94ef090cf48e8a5dd2ea2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8d51f2cc84e94ef090cf48e8a5dd2ea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8d51f2cc84e94ef090cf48e8a5dd2ea2"}]}] Aug 29 15:27:38.198314 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1433582983 Aug 29 15:27:38.198314 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 8d51f2cc84e94ef090cf48e8a5dd2ea2 Aug 29 15:27:38.198314 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1433582983 Aug 29 15:27:38.198314 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1433582983-project Aug 29 15:27:38.198314 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:27:38.198314 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:27:38.198314 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6b100cd3c72e4f8db8e9555f4e3fb7bb Aug 29 15:27:38.198314 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1433582983-project Aug 29 15:27:38.198314 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:27:38.198314 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:27:38.198314 n-d-839401-11 devstack@n-api.service[122361]: action_args: {} Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:27:38.199257 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:27:38.200666 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:27:38.203132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3f493abb-e213-4bbf-97a3-b4c456491157 tempest-ServicesAdminNegativeV253TestJSON-1433582983 tempest-ServicesAdminNegativeV253TestJSON-1433582983-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:38.203132 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3f493abb-e213-4bbf-97a3-b4c456491157 tempest-ServicesAdminNegativeV253TestJSON-1433582983 tempest-ServicesAdminNegativeV253TestJSON-1433582983-project] 10.222.0.62 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.116738 Aug 29 15:27:38.203132 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 383/729] 10.222.0.62 () {60 vars in 1178 bytes} [Mon Aug 29 15:27:38 2022] GET /compute/v2.1/os-services => generated 112 bytes in 118 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:27:38.204667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fc2f314a-b651-4261-b099-d2d0805422fc tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:38.205310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fc2f314a-b651-4261-b099-d2d0805422fc tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:38.212483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc2f314a-b651-4261-b099-d2d0805422fc tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:38.213225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc2f314a-b651-4261-b099-d2d0805422fc tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:38.213670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc2f314a-b651-4261-b099-d2d0805422fc tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:38.214378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc2f314a-b651-4261-b099-d2d0805422fc tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:38.214838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc2f314a-b651-4261-b099-d2d0805422fc tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:38.215268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc2f314a-b651-4261-b099-d2d0805422fc tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:38.314829 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d57c2435-adc0-4bc3-a493-9a8693b373ac tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] 10.222.0.62 "DELETE /compute/v2.1/os-floating-ips/595b1cc7-0987-49c9-9be7-abd663e3d4a1" status: 202 len: 0 microversion: 2.1 time: 1.019202 Aug 29 15:27:38.315486 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 347/730] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:27:37 2022] DELETE /compute/v2.1/os-floating-ips/595b1cc7-0987-49c9-9be7-abd663e3d4a1 => generated 0 bytes in 1020 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:27:38.325374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f693046c-deed-4fce-819e-946c80f7f480 tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] Calling method '.version_select at 0x7fc42bc540d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:38.359530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fc2f314a-b651-4261-b099-d2d0805422fc tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:38.370871 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fc2f314a-b651-4261-b099-d2d0805422fc tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1316 microversion: 2.1 time: 0.170991 Aug 29 15:27:38.385684 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 384/731] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:38 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:38.450186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-528a30c4-852e-4cf2-829c-3f1d0876dbaf tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:38.450839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-528a30c4-852e-4cf2-829c-3f1d0876dbaf tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:38.456971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-528a30c4-852e-4cf2-829c-3f1d0876dbaf tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:38.457766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-528a30c4-852e-4cf2-829c-3f1d0876dbaf tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:38.458360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-528a30c4-852e-4cf2-829c-3f1d0876dbaf tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:38.459224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-528a30c4-852e-4cf2-829c-3f1d0876dbaf tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:38.459836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-528a30c4-852e-4cf2-829c-3f1d0876dbaf tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:38.460414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-528a30c4-852e-4cf2-829c-3f1d0876dbaf tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:38.592183 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f693046c-deed-4fce-819e-946c80f7f480 tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] 10.222.0.62 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.271406 Aug 29 15:27:38.593542 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 348/732] 10.222.0.62 () {58 vars in 1164 bytes} [Mon Aug 29 15:27:38 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:27:38.611948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f0ba860e-6ab4-45b3-8052-eaafa961e827 tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] Calling method '.version_select at 0x7fc42bc6c0d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:38.641294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-528a30c4-852e-4cf2-829c-3f1d0876dbaf tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:38.651458 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-528a30c4-852e-4cf2-829c-3f1d0876dbaf tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1319 microversion: 2.1 time: 0.205050 Aug 29 15:27:38.654391 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 385/733] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:38 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:38.744615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-232c7cf8-05aa-4b1e-8ff2-813238c417d5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:38.745377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-232c7cf8-05aa-4b1e-8ff2-813238c417d5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:38.751987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-232c7cf8-05aa-4b1e-8ff2-813238c417d5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:38.752984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-232c7cf8-05aa-4b1e-8ff2-813238c417d5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:38.753701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-232c7cf8-05aa-4b1e-8ff2-813238c417d5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:38.754520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-232c7cf8-05aa-4b1e-8ff2-813238c417d5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:38.754970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-232c7cf8-05aa-4b1e-8ff2-813238c417d5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:38.755564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-232c7cf8-05aa-4b1e-8ff2-813238c417d5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:38.833340 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f0ba860e-6ab4-45b3-8052-eaafa961e827 tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] 10.222.0.62 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.227707 Aug 29 15:27:38.833340 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 349/734] 10.222.0.62 () {58 vars in 1149 bytes} [Mon Aug 29 15:27:38 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:27:38.844105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-38fbce7b-c1c5-4f1b-9590-0a94177ced97 tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] Calling method '.version_select at 0x7fc42bc0aee0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:39.044348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-232c7cf8-05aa-4b1e-8ff2-813238c417d5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:39.053580 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-232c7cf8-05aa-4b1e-8ff2-813238c417d5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.313320 Aug 29 15:27:39.062944 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 386/735] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:38 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:39.068051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e52ecaf0-fe3d-4eb4-8279-10e23ad4825c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:39.068619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e52ecaf0-fe3d-4eb4-8279-10e23ad4825c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:39.075425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e52ecaf0-fe3d-4eb4-8279-10e23ad4825c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:39.076151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e52ecaf0-fe3d-4eb4-8279-10e23ad4825c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:39.076585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e52ecaf0-fe3d-4eb4-8279-10e23ad4825c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:39.077429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e52ecaf0-fe3d-4eb4-8279-10e23ad4825c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:39.078222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e52ecaf0-fe3d-4eb4-8279-10e23ad4825c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:39.078222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e52ecaf0-fe3d-4eb4-8279-10e23ad4825c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:39.095804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:39.267415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e52ecaf0-fe3d-4eb4-8279-10e23ad4825c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:39.281868 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e52ecaf0-fe3d-4eb4-8279-10e23ad4825c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 200 len: 1464 microversion: 2.1 time: 0.217700 Aug 29 15:27:39.282457 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 387/736] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:39 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 1464 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:39.300622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-20ba5f7b-da7c-4a23-b7b9-c93eff7b541f req-8288ed79-6143-4e7e-b40c-84762d797812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf46166-597d-4649-a09a-600d8c57524d", "name": "network-vif-plugged", "status": "completed", "tag": "fb9190f9-2a49-4198-bf76-f097d8ef044f"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:39.307946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:39.313343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-20ba5f7b-da7c-4a23-b7b9-c93eff7b541f req-8288ed79-6143-4e7e-b40c-84762d797812 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:39.313928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-20ba5f7b-da7c-4a23-b7b9-c93eff7b541f req-8288ed79-6143-4e7e-b40c-84762d797812 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:39.314486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-20ba5f7b-da7c-4a23-b7b9-c93eff7b541f req-8288ed79-6143-4e7e-b40c-84762d797812 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:39.329949 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-20ba5f7b-da7c-4a23-b7b9-c93eff7b541f req-8288ed79-6143-4e7e-b40c-84762d797812 service nova] Creating event network-vif-plugged:fb9190f9-2a49-4198-bf76-f097d8ef044f for instance 4cf46166-597d-4649-a09a-600d8c57524d on n-h1-839401-11 Aug 29 15:27:39.335441 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-20ba5f7b-da7c-4a23-b7b9-c93eff7b541f req-8288ed79-6143-4e7e-b40c-84762d797812 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039971 Aug 29 15:27:39.337208 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 388/737] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:39.346270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-769b2794-0e45-4a72-8d82-ebff6611c858 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:39.347519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-769b2794-0e45-4a72-8d82-ebff6611c858 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:39.354253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-769b2794-0e45-4a72-8d82-ebff6611c858 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:39.354803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-769b2794-0e45-4a72-8d82-ebff6611c858 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:39.355190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-769b2794-0e45-4a72-8d82-ebff6611c858 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:39.355900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-769b2794-0e45-4a72-8d82-ebff6611c858 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:39.356354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-769b2794-0e45-4a72-8d82-ebff6611c858 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:39.356807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-769b2794-0e45-4a72-8d82-ebff6611c858 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:39.525243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-769b2794-0e45-4a72-8d82-ebff6611c858 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:39.534835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-769b2794-0e45-4a72-8d82-ebff6611c858 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:39.536291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-769b2794-0e45-4a72-8d82-ebff6611c858 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:39.537556 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-769b2794-0e45-4a72-8d82-ebff6611c858 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1362 microversion: 2.25 time: 0.198423 Aug 29 15:27:39.538565 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 389/738] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:39 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:39.554372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1f3a386e-b471-4484-8df0-0b4ff78c0e80 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:39.554991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1f3a386e-b471-4484-8df0-0b4ff78c0e80 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:39.570206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f3a386e-b471-4484-8df0-0b4ff78c0e80 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:39.570712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f3a386e-b471-4484-8df0-0b4ff78c0e80 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:39.571254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f3a386e-b471-4484-8df0-0b4ff78c0e80 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:39.572176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f3a386e-b471-4484-8df0-0b4ff78c0e80 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:39.573393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f3a386e-b471-4484-8df0-0b4ff78c0e80 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:39.573924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f3a386e-b471-4484-8df0-0b4ff78c0e80 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:39.659245 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-38fbce7b-c1c5-4f1b-9590-0a94177ced97 tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] 10.222.0.62 "DELETE /compute/v2.1/os-floating-ips/7d191c15-6ea9-4b14-8e60-81fef9949ef6" status: 202 len: 0 microversion: 2.1 time: 0.818881 Aug 29 15:27:39.660031 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 350/739] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:27:38 2022] DELETE /compute/v2.1/os-floating-ips/7d191c15-6ea9-4b14-8e60-81fef9949ef6 => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:27:39.667909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ffa5e1f7-7c76-4750-81c3-ce4a337c0fe6 tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] Calling method '.version_select at 0x7fc43002a8b0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:39.877569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1f3a386e-b471-4484-8df0-0b4ff78c0e80 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:39.888242 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1f3a386e-b471-4484-8df0-0b4ff78c0e80 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1316 microversion: 2.1 time: 0.347615 Aug 29 15:27:39.889615 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 390/740] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:39 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:39.909860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8c12bbe2-d273-41d5-9442-83795612b684 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:39.910483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8c12bbe2-d273-41d5-9442-83795612b684 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:39.918951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c12bbe2-d273-41d5-9442-83795612b684 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:39.919482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c12bbe2-d273-41d5-9442-83795612b684 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:39.919994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c12bbe2-d273-41d5-9442-83795612b684 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:39.920792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c12bbe2-d273-41d5-9442-83795612b684 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:39.921348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c12bbe2-d273-41d5-9442-83795612b684 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:39.921886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c12bbe2-d273-41d5-9442-83795612b684 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:40.251134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8c12bbe2-d273-41d5-9442-83795612b684 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:40.260463 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8c12bbe2-d273-41d5-9442-83795612b684 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1319 microversion: 2.1 time: 0.356196 Aug 29 15:27:40.275955 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 391/741] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:39 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:40.282177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a1977557-7a0f-46b9-9bad-37a5bcef30a1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:40.283448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a1977557-7a0f-46b9-9bad-37a5bcef30a1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:40.290940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1977557-7a0f-46b9-9bad-37a5bcef30a1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:40.291797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1977557-7a0f-46b9-9bad-37a5bcef30a1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:40.292526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1977557-7a0f-46b9-9bad-37a5bcef30a1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:40.293511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1977557-7a0f-46b9-9bad-37a5bcef30a1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:40.294181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1977557-7a0f-46b9-9bad-37a5bcef30a1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:40.294818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1977557-7a0f-46b9-9bad-37a5bcef30a1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:40.721434 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ffa5e1f7-7c76-4750-81c3-ce4a337c0fe6 tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] 10.222.0.62 "DELETE /compute/v2.1/os-floating-ips/c72c63cd-7888-4dde-b2af-97c1fb4f135d" status: 202 len: 0 microversion: 2.1 time: 1.057164 Aug 29 15:27:40.722736 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 351/742] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:27:39 2022] DELETE /compute/v2.1/os-floating-ips/c72c63cd-7888-4dde-b2af-97c1fb4f135d => generated 0 bytes in 1059 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:27:40.726494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a1977557-7a0f-46b9-9bad-37a5bcef30a1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:40.729361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5b997d6d-e134-4490-bc8e-769464b5e427 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:40.730249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5b997d6d-e134-4490-bc8e-769464b5e427 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:40.738737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b997d6d-e134-4490-bc8e-769464b5e427 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:40.739387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b997d6d-e134-4490-bc8e-769464b5e427 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:40.740027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b997d6d-e134-4490-bc8e-769464b5e427 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:40.740953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b997d6d-e134-4490-bc8e-769464b5e427 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:40.741528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b997d6d-e134-4490-bc8e-769464b5e427 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:40.742187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b997d6d-e134-4490-bc8e-769464b5e427 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:40.748139 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a1977557-7a0f-46b9-9bad-37a5bcef30a1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.466125 Aug 29 15:27:40.748139 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 392/743] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:40 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:40.763206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2db92b0f-8587-48d1-8269-c2f4b5ad3d88 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:40.764513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2db92b0f-8587-48d1-8269-c2f4b5ad3d88 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:40.774150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2db92b0f-8587-48d1-8269-c2f4b5ad3d88 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:40.775488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2db92b0f-8587-48d1-8269-c2f4b5ad3d88 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:40.776477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2db92b0f-8587-48d1-8269-c2f4b5ad3d88 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:40.777531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2db92b0f-8587-48d1-8269-c2f4b5ad3d88 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:40.781573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2db92b0f-8587-48d1-8269-c2f4b5ad3d88 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:40.783383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2db92b0f-8587-48d1-8269-c2f4b5ad3d88 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:40.858063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5b997d6d-e134-4490-bc8e-769464b5e427 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:40.869264 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5b997d6d-e134-4490-bc8e-769464b5e427 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 200 len: 1422 microversion: 2.1 time: 0.145212 Aug 29 15:27:40.870338 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 352/744] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:40 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 1422 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:40.876819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7eaa0737-5168-4a70-bd99-e872b0d35103 tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] Calling method '.version_select at 0x7fc42bc24670>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:41.160227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2db92b0f-8587-48d1-8269-c2f4b5ad3d88 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:41.171853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2db92b0f-8587-48d1-8269-c2f4b5ad3d88 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:41.174228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2db92b0f-8587-48d1-8269-c2f4b5ad3d88 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:41.176016 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2db92b0f-8587-48d1-8269-c2f4b5ad3d88 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1362 microversion: 2.25 time: 0.426082 Aug 29 15:27:41.190585 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 393/745] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:40 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1362 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:41.216326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4dbfcb19-277e-4f2c-8723-3e93a1820b04 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:41.216947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4dbfcb19-277e-4f2c-8723-3e93a1820b04 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:41.237188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbfcb19-277e-4f2c-8723-3e93a1820b04 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:41.237831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbfcb19-277e-4f2c-8723-3e93a1820b04 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:41.238619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbfcb19-277e-4f2c-8723-3e93a1820b04 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:41.239338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbfcb19-277e-4f2c-8723-3e93a1820b04 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:41.239808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbfcb19-277e-4f2c-8723-3e93a1820b04 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:41.240258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbfcb19-277e-4f2c-8723-3e93a1820b04 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:41.610391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4dbfcb19-277e-4f2c-8723-3e93a1820b04 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:41.621351 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4dbfcb19-277e-4f2c-8723-3e93a1820b04 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1466 microversion: 2.1 time: 0.429464 Aug 29 15:27:41.621984 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 394/746] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:41 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1466 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:41.632080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-96fbb21b-3ecb-4e90-a632-c317b8522059 req-bce4cb76-e2e4-4cb7-b84b-578493cc71a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dccfea7-bbcc-497d-bf3b-b129b04a0784", "name": "network-vif-deleted", "tag": "c1792e5c-3b00-48fd-b016-b6d36bd731d6"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:41.650326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-96fbb21b-3ecb-4e90-a632-c317b8522059 req-bce4cb76-e2e4-4cb7-b84b-578493cc71a5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:41.651188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-96fbb21b-3ecb-4e90-a632-c317b8522059 req-bce4cb76-e2e4-4cb7-b84b-578493cc71a5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:41.651781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-96fbb21b-3ecb-4e90-a632-c317b8522059 req-bce4cb76-e2e4-4cb7-b84b-578493cc71a5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:41.668793 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-96fbb21b-3ecb-4e90-a632-c317b8522059 req-bce4cb76-e2e4-4cb7-b84b-578493cc71a5 service nova] Creating event network-vif-deleted:c1792e5c-3b00-48fd-b016-b6d36bd731d6 for instance 7dccfea7-bbcc-497d-bf3b-b129b04a0784 on n-h2-839401-11 Aug 29 15:27:41.675047 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-96fbb21b-3ecb-4e90-a632-c317b8522059 req-bce4cb76-e2e4-4cb7-b84b-578493cc71a5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051704 Aug 29 15:27:41.675809 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 395/747] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:41.692679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f6a78547-e483-4bd4-8a48-b202b688d60e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:41.693421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f6a78547-e483-4bd4-8a48-b202b688d60e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:41.702114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6a78547-e483-4bd4-8a48-b202b688d60e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:41.702884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6a78547-e483-4bd4-8a48-b202b688d60e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:41.703328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6a78547-e483-4bd4-8a48-b202b688d60e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:41.704238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6a78547-e483-4bd4-8a48-b202b688d60e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:41.704705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6a78547-e483-4bd4-8a48-b202b688d60e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:41.705309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6a78547-e483-4bd4-8a48-b202b688d60e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:41.914640 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7eaa0737-5168-4a70-bd99-e872b0d35103 tempest-FloatingIPDetailsTestJSON-1052630054 tempest-FloatingIPDetailsTestJSON-1052630054-project] 10.222.0.62 "DELETE /compute/v2.1/os-floating-ips/2e03634e-78d2-474e-bb7e-a64fafe32547" status: 202 len: 0 microversion: 2.1 time: 1.042948 Aug 29 15:27:41.916034 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 353/748] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:27:40 2022] DELETE /compute/v2.1/os-floating-ips/2e03634e-78d2-474e-bb7e-a64fafe32547 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:27:41.923782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2a2493de-e033-422f-86e0-ad665a03866e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-608720947", "metadata": {"image_type": "test"}}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:41.928669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2a2493de-e033-422f-86e0-ad665a03866e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:41.936001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a2493de-e033-422f-86e0-ad665a03866e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:41.936750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a2493de-e033-422f-86e0-ad665a03866e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:41.937388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a2493de-e033-422f-86e0-ad665a03866e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:41.938387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a2493de-e033-422f-86e0-ad665a03866e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:41.939165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a2493de-e033-422f-86e0-ad665a03866e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:41.939747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a2493de-e033-422f-86e0-ad665a03866e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:41.970322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f6a78547-e483-4bd4-8a48-b202b688d60e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:41.983677 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f6a78547-e483-4bd4-8a48-b202b688d60e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1319 microversion: 2.1 time: 0.303398 Aug 29 15:27:41.985021 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 396/749] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:41 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:42.012043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6a33b62c-6217-4c09-ae9f-5bf0ad52ea3f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:42.013522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6a33b62c-6217-4c09-ae9f-5bf0ad52ea3f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:42.032048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a33b62c-6217-4c09-ae9f-5bf0ad52ea3f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:42.032823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a33b62c-6217-4c09-ae9f-5bf0ad52ea3f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:42.034621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a33b62c-6217-4c09-ae9f-5bf0ad52ea3f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:42.035775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a33b62c-6217-4c09-ae9f-5bf0ad52ea3f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:42.037158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-2a2493de-e033-422f-86e0-ad665a03866e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Getting quotas for project a902f071321a4216b4d17078181a61c6. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:42.040045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a33b62c-6217-4c09-ae9f-5bf0ad52ea3f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:42.042423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a33b62c-6217-4c09-ae9f-5bf0ad52ea3f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:42.056795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-2a2493de-e033-422f-86e0-ad665a03866e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Getting quotas for user 72442d50b3f74cb6acdfba7eeebe2274 and project a902f071321a4216b4d17078181a61c6. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:42.296435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:42.317676 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2a2493de-e033-422f-86e0-ad665a03866e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "POST /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5/action" status: 202 len: 0 microversion: 2.1 time: 0.399315 Aug 29 15:27:42.319233 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 354/750] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:27:41 2022] POST /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:27:42.336500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-83e69050-9d56-4a1b-970e-856ac323e7b8 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:42.338834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-83e69050-9d56-4a1b-970e-856ac323e7b8 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: 7dccfea7-bbcc-497d-bf3b-b129b04a0784] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:42.350734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e69050-9d56-4a1b-970e-856ac323e7b8 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:42.351303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e69050-9d56-4a1b-970e-856ac323e7b8 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:42.351746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e69050-9d56-4a1b-970e-856ac323e7b8 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:42.352994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e69050-9d56-4a1b-970e-856ac323e7b8 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:42.353669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e69050-9d56-4a1b-970e-856ac323e7b8 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:42.354291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e69050-9d56-4a1b-970e-856ac323e7b8 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:42.373935 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-83e69050-9d56-4a1b-970e-856ac323e7b8 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] HTTP exception thrown: Instance 7dccfea7-bbcc-497d-bf3b-b129b04a0784 could not be found. Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-83e69050-9d56-4a1b-970e-856ac323e7b8 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Request method failure captured: Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 HTTP/1.1 Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqyiAdomSTaWvb1slG208_u-DWazUjFhBtxUaapF-ou13lSQtTYt0aiRtagaONGsGKgGJzFMpCBhXYiBxUW075r_lljOl-IUsuLfPSjCQA80bfTNNQv8AsYY2wOIAMTSEan_8JZOSSGV49INvgTdBl9G4dbE0YjNlydQHfTNKiwSqU Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: dd0dbe26a46a40afade4fdb4e7e6aed6 Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-LiveMigrationNegativeTest-484033057 Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:27:42.376081 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:27:42.377823 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_dd0dbe26a46a40afade4fdb4e7e6aed6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/dd0dbe26a46a40afade4fdb4e7e6aed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dd0dbe26a46a40afade4fdb4e7e6aed6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dd0dbe26a46a40afade4fdb4e7e6aed6"}]}] Aug 29 15:27:42.377823 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-LiveMigrationNegativeTest-484033057 Aug 29 15:27:42.377823 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: dd0dbe26a46a40afade4fdb4e7e6aed6 Aug 29 15:27:42.377823 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-484033057 Aug 29 15:27:42.377823 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-LiveMigrationNegativeTest-484033057-project Aug 29 15:27:42.377823 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:27:42.377823 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:27:42.377823 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: f102bed161a64edc82820db2e358017b Aug 29 15:27:42.377823 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-LiveMigrationNegativeTest-484033057-project Aug 29 15:27:42.377823 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:27:42.377823 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 7dccfea7-bbcc-497d-bf3b-b129b04a0784 could not be found. Aug 29 15:27:42.377823 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7dccfea7-bbcc-497d-bf3b-b129b04a0784'} Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dccfea7-bbcc-497d-bf3b-b129b04a0784 could not be found. Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:42.378739 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dccfea7-bbcc-497d-bf3b-b129b04a0784 could not be found. Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dccfea7-bbcc-497d-bf3b-b129b04a0784 could not be found. Aug 29 15:27:42.380290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:42.384648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-83e69050-9d56-4a1b-970e-856ac323e7b8 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Returning 404 to user: Instance 7dccfea7-bbcc-497d-bf3b-b129b04a0784 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:42.385863 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-83e69050-9d56-4a1b-970e-856ac323e7b8 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784" status: 404 len: 111 microversion: 2.1 time: 0.065191 Aug 29 15:27:42.386949 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 355/751] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:42 2022] GET /compute/v2.1/servers/7dccfea7-bbcc-497d-bf3b-b129b04a0784 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:27:42.392893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-451b823a-540e-47e4-bfcc-bb8e8fd554c3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:42.394011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-451b823a-540e-47e4-bfcc-bb8e8fd554c3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:42.400703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-451b823a-540e-47e4-bfcc-bb8e8fd554c3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:42.401623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-451b823a-540e-47e4-bfcc-bb8e8fd554c3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:42.402394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-451b823a-540e-47e4-bfcc-bb8e8fd554c3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:42.403345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-451b823a-540e-47e4-bfcc-bb8e8fd554c3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:42.404449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-451b823a-540e-47e4-bfcc-bb8e8fd554c3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:42.405073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-451b823a-540e-47e4-bfcc-bb8e8fd554c3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:42.428493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6a33b62c-6217-4c09-ae9f-5bf0ad52ea3f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:42.436479 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6a33b62c-6217-4c09-ae9f-5bf0ad52ea3f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.435305 Aug 29 15:27:42.437069 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 397/752] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:41 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:42.452933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1597d95e-3cb3-44ff-a1ed-4007861b911c tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bcba8b0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:42.503689 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1597d95e-3cb3-44ff-a1ed-4007861b911c tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.056408 Aug 29 15:27:42.513512 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 398/753] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:42 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:42.519700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-87561406-6704-43de-851d-7562de68ce4e tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:42.520524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-87561406-6704-43de-851d-7562de68ce4e tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:42.528097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87561406-6704-43de-851d-7562de68ce4e tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:42.529285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87561406-6704-43de-851d-7562de68ce4e tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:42.529902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87561406-6704-43de-851d-7562de68ce4e tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:42.530775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87561406-6704-43de-851d-7562de68ce4e tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:42.531407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87561406-6704-43de-851d-7562de68ce4e tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:42.532273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87561406-6704-43de-851d-7562de68ce4e tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:42.572496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-87561406-6704-43de-851d-7562de68ce4e tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:27:42.692852 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-87561406-6704-43de-851d-7562de68ce4e tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 204 len: 0 microversion: 2.1 time: 0.175935 Aug 29 15:27:42.695212 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 399/754] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:27:42 2022] DELETE /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:27:42.710187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-61712bca-41a0-4168-9627-acdd2f052ac5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:42.712632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-61712bca-41a0-4168-9627-acdd2f052ac5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:42.722297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61712bca-41a0-4168-9627-acdd2f052ac5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:42.723047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61712bca-41a0-4168-9627-acdd2f052ac5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:42.723679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61712bca-41a0-4168-9627-acdd2f052ac5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:42.724990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61712bca-41a0-4168-9627-acdd2f052ac5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:42.726643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61712bca-41a0-4168-9627-acdd2f052ac5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:42.727869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61712bca-41a0-4168-9627-acdd2f052ac5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:42.750424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-451b823a-540e-47e4-bfcc-bb8e8fd554c3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:42.766618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-451b823a-540e-47e4-bfcc-bb8e8fd554c3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:42.768359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-451b823a-540e-47e4-bfcc-bb8e8fd554c3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:42.769714 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-451b823a-540e-47e4-bfcc-bb8e8fd554c3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1558 microversion: 2.25 time: 0.381577 Aug 29 15:27:42.770601 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 356/755] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:42 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1558 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:42.798502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f213d39c-e2d2-43f9-ae36-3c7a2ef43ea2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:42.799969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f213d39c-e2d2-43f9-ae36-3c7a2ef43ea2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:42.808218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f213d39c-e2d2-43f9-ae36-3c7a2ef43ea2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:42.809141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f213d39c-e2d2-43f9-ae36-3c7a2ef43ea2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:42.809752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f213d39c-e2d2-43f9-ae36-3c7a2ef43ea2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:42.811198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f213d39c-e2d2-43f9-ae36-3c7a2ef43ea2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:42.811841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f213d39c-e2d2-43f9-ae36-3c7a2ef43ea2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:42.812474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f213d39c-e2d2-43f9-ae36-3c7a2ef43ea2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.023611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-61712bca-41a0-4168-9627-acdd2f052ac5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:43.035286 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-61712bca-41a0-4168-9627-acdd2f052ac5 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1475 microversion: 2.1 time: 0.334596 Aug 29 15:27:43.036058 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 400/756] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:42 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1475 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:43.041161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8383337b-e790-4f72-a4c0-f702b33594ae tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:43.042360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8383337b-e790-4f72-a4c0-f702b33594ae tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:43.049825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8383337b-e790-4f72-a4c0-f702b33594ae tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.050628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8383337b-e790-4f72-a4c0-f702b33594ae tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.051415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8383337b-e790-4f72-a4c0-f702b33594ae tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.052619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8383337b-e790-4f72-a4c0-f702b33594ae tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.053312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8383337b-e790-4f72-a4c0-f702b33594ae tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.053973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8383337b-e790-4f72-a4c0-f702b33594ae tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.256662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-f213d39c-e2d2-43f9-ae36-3c7a2ef43ea2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'services' on Instance uuid 4cf46166-597d-4649-a09a-600d8c57524d {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:27:43.285640 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f213d39c-e2d2-43f9-ae36-3c7a2ef43ea2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 2053 microversion: 2.25 time: 0.491302 Aug 29 15:27:43.286766 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 357/757] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:42 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 2053 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:27:43.309490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-b9e62e4d-e20f-4cb7-a6ce-9040a0dafad9 req-a12c46d0-fef4-4270-8dc6-581d1b53ce2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3056427-5687-4dbf-93e9-a257b3ec51cf", "name": "network-vif-plugged", "status": "completed", "tag": "82913e05-d281-471d-920c-eef2d54c9c67"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:43.315388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8383337b-e790-4f72-a4c0-f702b33594ae tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:43.323192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b9e62e4d-e20f-4cb7-a6ce-9040a0dafad9 req-a12c46d0-fef4-4270-8dc6-581d1b53ce2c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.323678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b9e62e4d-e20f-4cb7-a6ce-9040a0dafad9 req-a12c46d0-fef4-4270-8dc6-581d1b53ce2c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.324128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b9e62e4d-e20f-4cb7-a6ce-9040a0dafad9 req-a12c46d0-fef4-4270-8dc6-581d1b53ce2c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.328299 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8383337b-e790-4f72-a4c0-f702b33594ae tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1319 microversion: 2.1 time: 0.290872 Aug 29 15:27:43.328982 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 401/758] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:43 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:43.333641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7f415926-33c5-4267-a2f6-f21f041cb57e tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:43.337598 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-b9e62e4d-e20f-4cb7-a6ce-9040a0dafad9 req-a12c46d0-fef4-4270-8dc6-581d1b53ce2c service nova] Creating event network-vif-plugged:82913e05-d281-471d-920c-eef2d54c9c67 for instance a3056427-5687-4dbf-93e9-a257b3ec51cf on n-h1-839401-11 Aug 29 15:27:43.338447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7f415926-33c5-4267-a2f6-f21f041cb57e tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:43.345232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f415926-33c5-4267-a2f6-f21f041cb57e tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.346039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f415926-33c5-4267-a2f6-f21f041cb57e tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.346680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f415926-33c5-4267-a2f6-f21f041cb57e tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.346809 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-b9e62e4d-e20f-4cb7-a6ce-9040a0dafad9 req-a12c46d0-fef4-4270-8dc6-581d1b53ce2c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043491 Aug 29 15:27:43.347661 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 358/759] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:43.347993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f415926-33c5-4267-a2f6-f21f041cb57e tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.348533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f415926-33c5-4267-a2f6-f21f041cb57e tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.349032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f415926-33c5-4267-a2f6-f21f041cb57e tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.460439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-855b75e7-6bdc-49c3-995b-757ee947cd86 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:43.461851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-855b75e7-6bdc-49c3-995b-757ee947cd86 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:43.476485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-855b75e7-6bdc-49c3-995b-757ee947cd86 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.476990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-855b75e7-6bdc-49c3-995b-757ee947cd86 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.477468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-855b75e7-6bdc-49c3-995b-757ee947cd86 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.478209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-855b75e7-6bdc-49c3-995b-757ee947cd86 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.478666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-855b75e7-6bdc-49c3-995b-757ee947cd86 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.479090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-855b75e7-6bdc-49c3-995b-757ee947cd86 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.504802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-7f415926-33c5-4267-a2f6-f21f041cb57e tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'services' on Instance uuid 4cf46166-597d-4649-a09a-600d8c57524d {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:27:43.523668 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7f415926-33c5-4267-a2f6-f21f041cb57e tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 2053 microversion: 2.25 time: 0.193493 Aug 29 15:27:43.524563 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 402/760] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:43 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 2053 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:43.530017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9ca44334-e2f9-464f-bd63-79f6d15a8acc tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bc6f820>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:43.582767 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9ca44334-e2f9-464f-bd63-79f6d15a8acc tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.056916 Aug 29 15:27:43.592030 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 403/761] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:43 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:43.597478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0ea9869c-0dc0-4504-b6f6-5a46545ebded tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:43.602910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ea9869c-0dc0-4504-b6f6-5a46545ebded tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.604438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ea9869c-0dc0-4504-b6f6-5a46545ebded tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.605071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ea9869c-0dc0-4504-b6f6-5a46545ebded tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.606062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ea9869c-0dc0-4504-b6f6-5a46545ebded tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.606697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ea9869c-0dc0-4504-b6f6-5a46545ebded tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.608233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ea9869c-0dc0-4504-b6f6-5a46545ebded tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.636665 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0ea9869c-0dc0-4504-b6f6-5a46545ebded tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.043148 Aug 29 15:27:43.637594 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 404/762] 10.222.0.62 () {60 vars in 1217 bytes} [Mon Aug 29 15:27:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:27:43.651373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e74d603a-5653-455c-abc4-cbb1cf82731d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:43.652189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e74d603a-5653-455c-abc4-cbb1cf82731d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:43.659311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e74d603a-5653-455c-abc4-cbb1cf82731d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.660830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e74d603a-5653-455c-abc4-cbb1cf82731d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.661631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e74d603a-5653-455c-abc4-cbb1cf82731d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.662509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e74d603a-5653-455c-abc4-cbb1cf82731d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.663142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e74d603a-5653-455c-abc4-cbb1cf82731d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.663572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e74d603a-5653-455c-abc4-cbb1cf82731d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.713380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:43.757746 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e74d603a-5653-455c-abc4-cbb1cf82731d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d/action" status: 202 len: 0 microversion: 2.25 time: 0.111299 Aug 29 15:27:43.759080 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 405/763] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 15:27:43 2022] POST /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:27:43.765782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-5bbe4cef-e870-4791-b69c-13e07d156e5f req-e9e15597-3797-42be-8191-df68993e5741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a6423f-2bd0-4c93-acc1-3cec1fe811ff", "name": "network-vif-unplugged", "status": "completed", "tag": "e0ec5ed9-c9fd-4c5d-98bc-c1fe2504891d"}, {"name": "network-changed", "server_uuid": "f5a6423f-2bd0-4c93-acc1-3cec1fe811ff", "tag": "e0ec5ed9-c9fd-4c5d-98bc-c1fe2504891d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:43.780517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5bbe4cef-e870-4791-b69c-13e07d156e5f req-e9e15597-3797-42be-8191-df68993e5741 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.781757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5bbe4cef-e870-4791-b69c-13e07d156e5f req-e9e15597-3797-42be-8191-df68993e5741 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.782449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5bbe4cef-e870-4791-b69c-13e07d156e5f req-e9e15597-3797-42be-8191-df68993e5741 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.799067 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5bbe4cef-e870-4791-b69c-13e07d156e5f req-e9e15597-3797-42be-8191-df68993e5741 service nova] Creating event network-vif-unplugged:e0ec5ed9-c9fd-4c5d-98bc-c1fe2504891d for instance f5a6423f-2bd0-4c93-acc1-3cec1fe811ff on n-h1-839401-11 Aug 29 15:27:43.799849 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5bbe4cef-e870-4791-b69c-13e07d156e5f req-e9e15597-3797-42be-8191-df68993e5741 service nova] Creating event network-changed:e0ec5ed9-c9fd-4c5d-98bc-c1fe2504891d for instance f5a6423f-2bd0-4c93-acc1-3cec1fe811ff on n-h1-839401-11 Aug 29 15:27:43.806297 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-5bbe4cef-e870-4791-b69c-13e07d156e5f req-e9e15597-3797-42be-8191-df68993e5741 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.045451 Aug 29 15:27:43.807485 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 406/764] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:43.812940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ff6d7985-943e-48d7-8809-d7bef52744d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:43.814058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ff6d7985-943e-48d7-8809-d7bef52744d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:43.820739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff6d7985-943e-48d7-8809-d7bef52744d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.821479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff6d7985-943e-48d7-8809-d7bef52744d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.822355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff6d7985-943e-48d7-8809-d7bef52744d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.823337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff6d7985-943e-48d7-8809-d7bef52744d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:43.824165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff6d7985-943e-48d7-8809-d7bef52744d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:43.824905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff6d7985-943e-48d7-8809-d7bef52744d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:43.874088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-855b75e7-6bdc-49c3-995b-757ee947cd86 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:43.887410 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-855b75e7-6bdc-49c3-995b-757ee947cd86 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.431295 Aug 29 15:27:43.898688 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 359/765] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:43 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:44.059867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fbbe91f0-46c6-4256-a354-ae6c9091957c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:44.060699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fbbe91f0-46c6-4256-a354-ae6c9091957c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:44.068317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbbe91f0-46c6-4256-a354-ae6c9091957c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:44.074982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbbe91f0-46c6-4256-a354-ae6c9091957c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:44.075704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbbe91f0-46c6-4256-a354-ae6c9091957c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:44.076630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbbe91f0-46c6-4256-a354-ae6c9091957c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:44.077306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbbe91f0-46c6-4256-a354-ae6c9091957c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:44.077890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbbe91f0-46c6-4256-a354-ae6c9091957c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:44.110571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-ff6d7985-943e-48d7-8809-d7bef52744d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'services' on Instance uuid 4cf46166-597d-4649-a09a-600d8c57524d {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:27:44.148671 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ff6d7985-943e-48d7-8809-d7bef52744d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 2058 microversion: 2.25 time: 0.339821 Aug 29 15:27:44.149907 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 407/766] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:43 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 2058 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:44.326501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fbbe91f0-46c6-4256-a354-ae6c9091957c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:44.338439 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fbbe91f0-46c6-4256-a354-ae6c9091957c tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1475 microversion: 2.1 time: 0.282438 Aug 29 15:27:44.339793 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 360/767] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:44 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1475 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:44.348902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-56a7b873-4039-4d24-b758-f389081eace9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:44.349679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-56a7b873-4039-4d24-b758-f389081eace9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:44.367766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56a7b873-4039-4d24-b758-f389081eace9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:44.368678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56a7b873-4039-4d24-b758-f389081eace9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:44.369396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56a7b873-4039-4d24-b758-f389081eace9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:44.371445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56a7b873-4039-4d24-b758-f389081eace9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:44.372196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56a7b873-4039-4d24-b758-f389081eace9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:44.372911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56a7b873-4039-4d24-b758-f389081eace9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:44.601919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d6a377dc-33db-48e9-b86e-3ec4ee6f2182 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bcd5d30>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:44.658529 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d6a377dc-33db-48e9-b86e-3ec4ee6f2182 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.063712 Aug 29 15:27:44.669741 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 361/768] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:44 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:44.911420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b61e404d-c110-4248-8caa-e29d1fc51cfd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:44.912290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b61e404d-c110-4248-8caa-e29d1fc51cfd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:44.958951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b61e404d-c110-4248-8caa-e29d1fc51cfd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:44.960345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b61e404d-c110-4248-8caa-e29d1fc51cfd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:44.969773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b61e404d-c110-4248-8caa-e29d1fc51cfd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:44.974340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b61e404d-c110-4248-8caa-e29d1fc51cfd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:44.976403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b61e404d-c110-4248-8caa-e29d1fc51cfd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:44.984649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b61e404d-c110-4248-8caa-e29d1fc51cfd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:45.142208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-56a7b873-4039-4d24-b758-f389081eace9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:45.154694 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-56a7b873-4039-4d24-b758-f389081eace9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1319 microversion: 2.1 time: 0.809671 Aug 29 15:27:45.157246 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 408/769] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:44 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1319 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:45.180392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-369f64ea-7012-4759-bae2-07250b9bccf4 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:45.181017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-369f64ea-7012-4759-bae2-07250b9bccf4 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:45.195458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-369f64ea-7012-4759-bae2-07250b9bccf4 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:45.198985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-369f64ea-7012-4759-bae2-07250b9bccf4 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:45.199445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-369f64ea-7012-4759-bae2-07250b9bccf4 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:45.200216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-369f64ea-7012-4759-bae2-07250b9bccf4 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:45.200909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-369f64ea-7012-4759-bae2-07250b9bccf4 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:45.203873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-369f64ea-7012-4759-bae2-07250b9bccf4 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:45.379876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b61e404d-c110-4248-8caa-e29d1fc51cfd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:45.389102 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b61e404d-c110-4248-8caa-e29d1fc51cfd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.482676 Aug 29 15:27:45.397841 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 362/770] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:44 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:45.403126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-45f93609-043f-452f-8b6e-3f543388f098 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:45.404346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-45f93609-043f-452f-8b6e-3f543388f098 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:45.424023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45f93609-043f-452f-8b6e-3f543388f098 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:45.424740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45f93609-043f-452f-8b6e-3f543388f098 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:45.425376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45f93609-043f-452f-8b6e-3f543388f098 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:45.426245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45f93609-043f-452f-8b6e-3f543388f098 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:45.426910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45f93609-043f-452f-8b6e-3f543388f098 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:45.427438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45f93609-043f-452f-8b6e-3f543388f098 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:45.724501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-369f64ea-7012-4759-bae2-07250b9bccf4 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'services' on Instance uuid 4cf46166-597d-4649-a09a-600d8c57524d {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:27:45.745343 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-369f64ea-7012-4759-bae2-07250b9bccf4 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 2038 microversion: 2.25 time: 0.573084 Aug 29 15:27:45.761174 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 409/771] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:45 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 2038 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:27:45.761174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2e923af8-4b9e-415b-b6b4-c0b564796563 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bd45f70>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:45.835681 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2e923af8-4b9e-415b-b6b4-c0b564796563 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.082377 Aug 29 15:27:45.842357 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 410/772] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:45 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:45.846038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1ab32f3d-c571-401d-87b4-118b3c9c85c9 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-839401-11", "block_migration": "auto"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:45.848559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1ab32f3d-c571-401d-87b4-118b3c9c85c9 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:45.855483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ab32f3d-c571-401d-87b4-118b3c9c85c9 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:45.856107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ab32f3d-c571-401d-87b4-118b3c9c85c9 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:45.856403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ab32f3d-c571-401d-87b4-118b3c9c85c9 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:45.857324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ab32f3d-c571-401d-87b4-118b3c9c85c9 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:45.857929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ab32f3d-c571-401d-87b4-118b3c9c85c9 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:45.858529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ab32f3d-c571-401d-87b4-118b3c9c85c9 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:45.874897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-45f93609-043f-452f-8b6e-3f543388f098 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:45.889577 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-45f93609-043f-452f-8b6e-3f543388f098 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1475 microversion: 2.1 time: 0.489312 Aug 29 15:27:45.891216 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 363/773] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:45 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1475 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:45.916897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-1ab32f3d-c571-401d-87b4-118b3c9c85c9 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'flavor' on Instance uuid 4cf46166-597d-4649-a09a-600d8c57524d {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:27:45.947734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1ab32f3d-c571-401d-87b4-118b3c9c85c9 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Going to try to live migrate instance to n-h2-839401-11 {{(pid=122361) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:27:46.180700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6bce39e7-ae27-4d17-bb27-1c11fb7a5d96 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:46.181765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6bce39e7-ae27-4d17-bb27-1c11fb7a5d96 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:46.194543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bce39e7-ae27-4d17-bb27-1c11fb7a5d96 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:46.195657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bce39e7-ae27-4d17-bb27-1c11fb7a5d96 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:46.196565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bce39e7-ae27-4d17-bb27-1c11fb7a5d96 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:46.198157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bce39e7-ae27-4d17-bb27-1c11fb7a5d96 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:46.198971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bce39e7-ae27-4d17-bb27-1c11fb7a5d96 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:46.199670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bce39e7-ae27-4d17-bb27-1c11fb7a5d96 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:47.048911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6bce39e7-ae27-4d17-bb27-1c11fb7a5d96 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:47.061550 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6bce39e7-ae27-4d17-bb27-1c11fb7a5d96 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1319 microversion: 2.1 time: 0.884878 Aug 29 15:27:47.062179 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 364/774] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:46 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1319 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:47.080315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e0ca1044-e87f-4b71-9a86-e3be70a51d30 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:47.080980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e0ca1044-e87f-4b71-9a86-e3be70a51d30 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:47.094666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0ca1044-e87f-4b71-9a86-e3be70a51d30 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:47.095698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0ca1044-e87f-4b71-9a86-e3be70a51d30 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:47.096312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0ca1044-e87f-4b71-9a86-e3be70a51d30 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:47.097238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0ca1044-e87f-4b71-9a86-e3be70a51d30 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:47.097843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0ca1044-e87f-4b71-9a86-e3be70a51d30 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:47.098425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0ca1044-e87f-4b71-9a86-e3be70a51d30 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:47.276061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=12 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:47.445393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e0ca1044-e87f-4b71-9a86-e3be70a51d30 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:47.455179 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e0ca1044-e87f-4b71-9a86-e3be70a51d30 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.384393 Aug 29 15:27:47.471142 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 365/775] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:47 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:47.492080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-607d9899-96ab-436a-a531-2c22a0bf2213 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bbe1670>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:47.560220 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-607d9899-96ab-436a-a531-2c22a0bf2213 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.087757 Aug 29 15:27:47.577420 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 366/776] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:47 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:47.591860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-02f02aeb-ece0-4c49-888c-632d23c2e8f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:47.599497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-02f02aeb-ece0-4c49-888c-632d23c2e8f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:47.616558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02f02aeb-ece0-4c49-888c-632d23c2e8f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:47.619216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02f02aeb-ece0-4c49-888c-632d23c2e8f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:47.620580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02f02aeb-ece0-4c49-888c-632d23c2e8f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:47.621505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02f02aeb-ece0-4c49-888c-632d23c2e8f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:47.622183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02f02aeb-ece0-4c49-888c-632d23c2e8f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:47.622866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02f02aeb-ece0-4c49-888c-632d23c2e8f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:47.693370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02f02aeb-ece0-4c49-888c-632d23c2e8f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:47.694829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02f02aeb-ece0-4c49-888c-632d23c2e8f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:47.697399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02f02aeb-ece0-4c49-888c-632d23c2e8f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:47.698490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-02f02aeb-ece0-4c49-888c-632d23c2e8f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lazy-loading 'fault' on Instance uuid c2b83a8f-d9af-4e23-a78a-2eb71813082a {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:27:47.765396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-02f02aeb-ece0-4c49-888c-632d23c2e8f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f102bed161a64edc82820db2e358017b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd0dbe26a46a40afade4fdb4e7e6aed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:47.779950 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-02f02aeb-ece0-4c49-888c-632d23c2e8f2 tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 200 len: 1309 microversion: 2.1 time: 0.190603 Aug 29 15:27:47.781954 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 367/777] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:47 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 1309 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:47.789474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-752a6f68-6299-4081-a0aa-16186dff61ae req-27402663-6a5f-4e18-9b17-b69b1c3c0ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b83a8f-d9af-4e23-a78a-2eb71813082a", "name": "network-vif-deleted", "tag": "6dfad95f-5f07-4626-ac31-5a820ebd231e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:47.819553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-752a6f68-6299-4081-a0aa-16186dff61ae req-27402663-6a5f-4e18-9b17-b69b1c3c0ff4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:47.822656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-752a6f68-6299-4081-a0aa-16186dff61ae req-27402663-6a5f-4e18-9b17-b69b1c3c0ff4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:47.823105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-752a6f68-6299-4081-a0aa-16186dff61ae req-27402663-6a5f-4e18-9b17-b69b1c3c0ff4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:47.845230 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-752a6f68-6299-4081-a0aa-16186dff61ae req-27402663-6a5f-4e18-9b17-b69b1c3c0ff4 service nova] Creating event network-vif-deleted:6dfad95f-5f07-4626-ac31-5a820ebd231e for instance c2b83a8f-d9af-4e23-a78a-2eb71813082a on n-h1-839401-11 Aug 29 15:27:47.852318 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-752a6f68-6299-4081-a0aa-16186dff61ae req-27402663-6a5f-4e18-9b17-b69b1c3c0ff4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068592 Aug 29 15:27:47.853212 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 368/778] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:48.083290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-32147e75-269e-4a0d-aff9-e055de647214 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:48.083977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-32147e75-269e-4a0d-aff9-e055de647214 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:48.090637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32147e75-269e-4a0d-aff9-e055de647214 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:48.091235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32147e75-269e-4a0d-aff9-e055de647214 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:48.091572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32147e75-269e-4a0d-aff9-e055de647214 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:48.092299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32147e75-269e-4a0d-aff9-e055de647214 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:48.092762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32147e75-269e-4a0d-aff9-e055de647214 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:48.093355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32147e75-269e-4a0d-aff9-e055de647214 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:48.346314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-32147e75-269e-4a0d-aff9-e055de647214 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:48.353542 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1ab32f3d-c571-401d-87b4-118b3c9c85c9 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d/action" status: 202 len: 0 microversion: 2.25 time: 2.513767 Aug 29 15:27:48.358449 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-32147e75-269e-4a0d-aff9-e055de647214 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1469 microversion: 2.1 time: 0.279505 Aug 29 15:27:48.360198 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 411/779] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 15:27:45 2022] POST /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d/action => generated 0 bytes in 2521 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:27:48.362512 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 369/780] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:48 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1469 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:48.387710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eb809a77-cd7a-44d2-ac90-9f28fc0d76be tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:48.388253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cf651cd1-d261-4fe2-8853-e0e5debc20e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:48.388877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cf651cd1-d261-4fe2-8853-e0e5debc20e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 039c62b6-55e7-4b8a-bf96-c079addd6fe6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:48.401940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf651cd1-d261-4fe2-8853-e0e5debc20e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:48.402329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf651cd1-d261-4fe2-8853-e0e5debc20e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:48.403052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf651cd1-d261-4fe2-8853-e0e5debc20e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:48.406476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf651cd1-d261-4fe2-8853-e0e5debc20e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:48.407294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf651cd1-d261-4fe2-8853-e0e5debc20e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:48.407978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eb809a77-cd7a-44d2-ac90-9f28fc0d76be tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:48.408154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf651cd1-d261-4fe2-8853-e0e5debc20e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:48.451700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb809a77-cd7a-44d2-ac90-9f28fc0d76be tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:48.455194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb809a77-cd7a-44d2-ac90-9f28fc0d76be tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:48.457464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb809a77-cd7a-44d2-ac90-9f28fc0d76be tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:48.462055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb809a77-cd7a-44d2-ac90-9f28fc0d76be tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:48.464371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb809a77-cd7a-44d2-ac90-9f28fc0d76be tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:48.464989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb809a77-cd7a-44d2-ac90-9f28fc0d76be tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:48.799133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cf651cd1-d261-4fe2-8853-e0e5debc20e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:48.818223 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cf651cd1-d261-4fe2-8853-e0e5debc20e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6" status: 200 len: 1469 microversion: 2.1 time: 0.434826 Aug 29 15:27:48.819806 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 370/781] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:48 2022] GET /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6 => generated 1469 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:48.852516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-389bfaad-ae6b-4cdd-ba22-e1dabcc1a503 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:48.853366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-389bfaad-ae6b-4cdd-ba22-e1dabcc1a503 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:48.857900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:48.869113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-389bfaad-ae6b-4cdd-ba22-e1dabcc1a503 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:48.869642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-389bfaad-ae6b-4cdd-ba22-e1dabcc1a503 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:48.870117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-389bfaad-ae6b-4cdd-ba22-e1dabcc1a503 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:48.873721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-389bfaad-ae6b-4cdd-ba22-e1dabcc1a503 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:48.874219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-389bfaad-ae6b-4cdd-ba22-e1dabcc1a503 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:48.874639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-389bfaad-ae6b-4cdd-ba22-e1dabcc1a503 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:49.106420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-389bfaad-ae6b-4cdd-ba22-e1dabcc1a503 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:49.115789 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-389bfaad-ae6b-4cdd-ba22-e1dabcc1a503 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.294600 Aug 29 15:27:49.116806 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 371/782] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:48 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:49.124901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e2d5a44d-f3f5-467a-ada6-7beba826e71c tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bbe1ee0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:49.203872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eb809a77-cd7a-44d2-ac90-9f28fc0d76be tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:49.204483 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e2d5a44d-f3f5-467a-ada6-7beba826e71c tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.083247 Aug 29 15:27:49.205382 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 372/783] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:49 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:49.215872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0c14eecb-a06d-4a81-bef0-792056ab3b8f tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:49.216443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eb809a77-cd7a-44d2-ac90-9f28fc0d76be tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:49.216581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0c14eecb-a06d-4a81-bef0-792056ab3b8f tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] [instance: c2b83a8f-d9af-4e23-a78a-2eb71813082a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:49.219972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eb809a77-cd7a-44d2-ac90-9f28fc0d76be tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:49.222422 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eb809a77-cd7a-44d2-ac90-9f28fc0d76be tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.847107 Aug 29 15:27:49.223098 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 412/784] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:48 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:49.229148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-797f6777-6bdd-4e5a-a78c-dce51926073c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:49.235733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-797f6777-6bdd-4e5a-a78c-dce51926073c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:49.237143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-797f6777-6bdd-4e5a-a78c-dce51926073c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Searching by: {'reservation_id': 'r-fqkfnt0s', 'deleted': False, 'project_id': '0393aa9c32934da4a9f478c563135bbb'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:27:49.244122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c14eecb-a06d-4a81-bef0-792056ab3b8f tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:49.244616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c14eecb-a06d-4a81-bef0-792056ab3b8f tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:49.245052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c14eecb-a06d-4a81-bef0-792056ab3b8f tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:49.245799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c14eecb-a06d-4a81-bef0-792056ab3b8f tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:49.246859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c14eecb-a06d-4a81-bef0-792056ab3b8f tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:49.246859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c14eecb-a06d-4a81-bef0-792056ab3b8f tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:49.254930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-797f6777-6bdd-4e5a-a78c-dce51926073c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:49.255652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-797f6777-6bdd-4e5a-a78c-dce51926073c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:49.256305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-797f6777-6bdd-4e5a-a78c-dce51926073c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:49.257276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-797f6777-6bdd-4e5a-a78c-dce51926073c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:49.258916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-797f6777-6bdd-4e5a-a78c-dce51926073c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:49.259730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-797f6777-6bdd-4e5a-a78c-dce51926073c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:49.263047 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-0c14eecb-a06d-4a81-bef0-792056ab3b8f tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] HTTP exception thrown: Instance c2b83a8f-d9af-4e23-a78a-2eb71813082a could not be found. Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0c14eecb-a06d-4a81-bef0-792056ab3b8f tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Request method failure captured: Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a HTTP/1.1 Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqyiAdomSTaWvb1slG208_u-DWazUjFhBtxUaapF-ou13lSQtTYt0aiRtagaONGsGKgGJzFMpCBhXYiBxUW075r_lljOl-IUsuLfPSjCQA80bfTNNQv8AsYY2wOIAMTSEan_8JZOSSGV49INvgTdBl9G4dbE0YjNlydQHfTNKiwSqU Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: dd0dbe26a46a40afade4fdb4e7e6aed6 Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-LiveMigrationNegativeTest-484033057 Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:27:49.264906 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:27:49.266225 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_dd0dbe26a46a40afade4fdb4e7e6aed6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/dd0dbe26a46a40afade4fdb4e7e6aed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dd0dbe26a46a40afade4fdb4e7e6aed6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dd0dbe26a46a40afade4fdb4e7e6aed6"}]}] Aug 29 15:27:49.266225 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-LiveMigrationNegativeTest-484033057 Aug 29 15:27:49.266225 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: dd0dbe26a46a40afade4fdb4e7e6aed6 Aug 29 15:27:49.266225 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-484033057 Aug 29 15:27:49.266225 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-LiveMigrationNegativeTest-484033057-project Aug 29 15:27:49.266225 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:27:49.266225 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:27:49.266225 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: f102bed161a64edc82820db2e358017b Aug 29 15:27:49.266225 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-LiveMigrationNegativeTest-484033057-project Aug 29 15:27:49.266225 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:27:49.266225 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance c2b83a8f-d9af-4e23-a78a-2eb71813082a could not be found. Aug 29 15:27:49.266225 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'c2b83a8f-d9af-4e23-a78a-2eb71813082a'} Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b83a8f-d9af-4e23-a78a-2eb71813082a could not be found. Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:27:49.266968 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b83a8f-d9af-4e23-a78a-2eb71813082a could not be found. Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b83a8f-d9af-4e23-a78a-2eb71813082a could not be found. Aug 29 15:27:49.268210 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:27:49.270300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0c14eecb-a06d-4a81-bef0-792056ab3b8f tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] Returning 404 to user: Instance c2b83a8f-d9af-4e23-a78a-2eb71813082a could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:27:49.270300 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0c14eecb-a06d-4a81-bef0-792056ab3b8f tempest-LiveMigrationNegativeTest-484033057 tempest-LiveMigrationNegativeTest-484033057-project] 10.222.0.62 "GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a" status: 404 len: 111 microversion: 2.1 time: 0.060040 Aug 29 15:27:49.270300 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 373/785] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:49 2022] GET /compute/v2.1/servers/c2b83a8f-d9af-4e23-a78a-2eb71813082a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:27:49.440618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-797f6777-6bdd-4e5a-a78c-dce51926073c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:27:49.538585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-797f6777-6bdd-4e5a-a78c-dce51926073c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:49.546432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-797f6777-6bdd-4e5a-a78c-dce51926073c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:49.547084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-797f6777-6bdd-4e5a-a78c-dce51926073c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:49.547674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-797f6777-6bdd-4e5a-a78c-dce51926073c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:49.827218 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-797f6777-6bdd-4e5a-a78c-dce51926073c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/detail?reservation_id=r-fqkfnt0s" status: 200 len: 2931 microversion: 2.1 time: 0.602698 Aug 29 15:27:49.827898 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 413/786] 10.222.0.62 () {58 vars in 1197 bytes} [Mon Aug 29 15:27:49 2022] GET /compute/v2.1/servers/detail?reservation_id=r-fqkfnt0s => generated 2931 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:49.855967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8d8d9552-6993-4389-b692-e50bf7a1cedb tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:49.938503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.compute.server_groups [None req-8d8d9552-6993-4389-b692-e50bf7a1cedb tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Querying cell dcf211bc-da73-4d63-b885-2b9e7c1e329b(cell1) for 2 instances {{(pid=122360) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 15:27:49.941163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d8d9552-6993-4389-b692-e50bf7a1cedb tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:49.941795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d8d9552-6993-4389-b692-e50bf7a1cedb tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:49.942325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d8d9552-6993-4389-b692-e50bf7a1cedb tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:50.006615 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8d8d9552-6993-4389-b692-e50bf7a1cedb tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/os-server-groups/c566e375-8caf-4447-b72d-a55ae9c852fc" status: 200 len: 266 microversion: 2.1 time: 0.155879 Aug 29 15:27:50.007814 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 374/787] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:27:49 2022] GET /compute/v2.1/os-server-groups/c566e375-8caf-4447-b72d-a55ae9c852fc => generated 266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:50.019099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2de83a1f-c86e-4589-afc3-3d355534ace0 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:50.019979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2de83a1f-c86e-4589-afc3-3d355534ace0 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] [instance: 039c62b6-55e7-4b8a-bf96-c079addd6fe6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:50.028184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2de83a1f-c86e-4589-afc3-3d355534ace0 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:50.028667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2de83a1f-c86e-4589-afc3-3d355534ace0 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:50.029445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2de83a1f-c86e-4589-afc3-3d355534ace0 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:50.031648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2de83a1f-c86e-4589-afc3-3d355534ace0 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:50.032112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2de83a1f-c86e-4589-afc3-3d355534ace0 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:50.032604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2de83a1f-c86e-4589-afc3-3d355534ace0 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:50.142066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dcb009c5-2d5d-4134-b102-ad40edb83267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:50.142638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dcb009c5-2d5d-4134-b102-ad40edb83267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:50.153234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcb009c5-2d5d-4134-b102-ad40edb83267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:50.157182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcb009c5-2d5d-4134-b102-ad40edb83267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:50.162558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcb009c5-2d5d-4134-b102-ad40edb83267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:50.163028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcb009c5-2d5d-4134-b102-ad40edb83267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:50.163601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcb009c5-2d5d-4134-b102-ad40edb83267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:50.164116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcb009c5-2d5d-4134-b102-ad40edb83267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:50.372407 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2de83a1f-c86e-4589-afc3-3d355534ace0 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6" status: 200 len: 1622 microversion: 2.1 time: 0.356729 Aug 29 15:27:50.390738 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 414/788] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:50 2022] GET /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6 => generated 1622 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:50.405825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6bb831de-296d-44b9-933c-a8440fa679ca tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bc12c10>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:50.425068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dcb009c5-2d5d-4134-b102-ad40edb83267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:50.439543 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dcb009c5-2d5d-4134-b102-ad40edb83267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.300569 Aug 29 15:27:50.442105 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 375/789] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:50 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:50.452986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-57311e91-ea73-497a-95e2-c42b8bc17969 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:50.455105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-57311e91-ea73-497a-95e2-c42b8bc17969 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:50.472472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57311e91-ea73-497a-95e2-c42b8bc17969 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:50.473271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57311e91-ea73-497a-95e2-c42b8bc17969 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:50.474310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57311e91-ea73-497a-95e2-c42b8bc17969 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:50.477429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57311e91-ea73-497a-95e2-c42b8bc17969 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:50.479391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57311e91-ea73-497a-95e2-c42b8bc17969 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:50.480010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57311e91-ea73-497a-95e2-c42b8bc17969 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:50.482302 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6bb831de-296d-44b9-933c-a8440fa679ca tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.089932 Aug 29 15:27:50.491447 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 415/790] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:50 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:50.497563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c6180a3d-bd95-4d51-9d25-b6318b80266e tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:50.498589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c6180a3d-bd95-4d51-9d25-b6318b80266e tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:50.506413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6180a3d-bd95-4d51-9d25-b6318b80266e tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:50.507199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6180a3d-bd95-4d51-9d25-b6318b80266e tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:50.507814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6180a3d-bd95-4d51-9d25-b6318b80266e tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:50.508728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6180a3d-bd95-4d51-9d25-b6318b80266e tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:50.509505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6180a3d-bd95-4d51-9d25-b6318b80266e tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:50.510151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6180a3d-bd95-4d51-9d25-b6318b80266e tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:50.840013 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c6180a3d-bd95-4d51-9d25-b6318b80266e tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 200 len: 1622 microversion: 2.1 time: 0.344041 Aug 29 15:27:50.843450 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 416/791] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:50 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 1622 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:50.849396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-87fd7ee4-ba90-434b-8bd1-a305574ec4d7 req-38d146b2-5baa-4c59-8d2d-2b7743c33aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d3d180-599f-4c45-a0ea-53f2180484d5", "name": "network-vif-plugged", "status": "completed", "tag": "a173d34f-0b58-4d2d-91dc-183ed4b4d4a6"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:50.884514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-87fd7ee4-ba90-434b-8bd1-a305574ec4d7 req-38d146b2-5baa-4c59-8d2d-2b7743c33aab service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:50.886528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-57311e91-ea73-497a-95e2-c42b8bc17969 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:50.887141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-87fd7ee4-ba90-434b-8bd1-a305574ec4d7 req-38d146b2-5baa-4c59-8d2d-2b7743c33aab service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:50.887834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-87fd7ee4-ba90-434b-8bd1-a305574ec4d7 req-38d146b2-5baa-4c59-8d2d-2b7743c33aab service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:50.890231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:50.900623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-57311e91-ea73-497a-95e2-c42b8bc17969 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:50.914411 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-87fd7ee4-ba90-434b-8bd1-a305574ec4d7 req-38d146b2-5baa-4c59-8d2d-2b7743c33aab service nova] Creating event network-vif-plugged:a173d34f-0b58-4d2d-91dc-183ed4b4d4a6 for instance 45d3d180-599f-4c45-a0ea-53f2180484d5 on n-h2-839401-11 Aug 29 15:27:50.915971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-57311e91-ea73-497a-95e2-c42b8bc17969 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:50.919022 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-57311e91-ea73-497a-95e2-c42b8bc17969 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.472666 Aug 29 15:27:50.921041 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 376/792] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:50 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:50.938375 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-87fd7ee4-ba90-434b-8bd1-a305574ec4d7 req-38d146b2-5baa-4c59-8d2d-2b7743c33aab service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093420 Aug 29 15:27:50.939980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-170f99d0-7b0b-4ebc-94ca-163eb03bfe20 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Action: 'create', calling method: .version_select at 0x7fc42bc6cee0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1634971729", "policies": ["anti-affinity"]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:50.945963 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 417/793] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:50.965494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-170f99d0-7b0b-4ebc-94ca-163eb03bfe20 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_groups'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:50.973171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-170f99d0-7b0b-4ebc-94ca-163eb03bfe20 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_groups'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:51.022382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-170f99d0-7b0b-4ebc-94ca-163eb03bfe20 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_groups'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:51.029261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-170f99d0-7b0b-4ebc-94ca-163eb03bfe20 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_groups'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:51.046712 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-170f99d0-7b0b-4ebc-94ca-163eb03bfe20 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.124019 Aug 29 15:27:51.053132 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 377/794] 10.222.0.62 () {60 vars in 1174 bytes} [Mon Aug 29 15:27:50 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:51.344726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-898632998", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "01e17389-4ffc-405a-88d9-6586c585fcb9"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:51.467375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f4139224-8276-44c4-85d5-77b76c2b6245 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:51.467852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:27:51.467964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f4139224-8276-44c4-85d5-77b76c2b6245 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:51.480758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4139224-8276-44c4-85d5-77b76c2b6245 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:51.482417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4139224-8276-44c4-85d5-77b76c2b6245 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:51.482915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4139224-8276-44c4-85d5-77b76c2b6245 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:51.483708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4139224-8276-44c4-85d5-77b76c2b6245 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:51.485894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4139224-8276-44c4-85d5-77b76c2b6245 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:51.486529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4139224-8276-44c4-85d5-77b76c2b6245 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:51.740708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f4139224-8276-44c4-85d5-77b76c2b6245 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:51.748839 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f4139224-8276-44c4-85d5-77b76c2b6245 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.285258 Aug 29 15:27:51.756368 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 378/795] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:51 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:51.766350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5a14e175-946d-4c61-a4ff-64fa55ad2b6e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bc0a3a0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:51.827427 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5a14e175-946d-4c61-a4ff-64fa55ad2b6e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.066179 Aug 29 15:27:51.829993 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 379/796] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:51 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:51.835875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:27:51.836450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:27:51.837053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:27:51.837652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:27:51.838210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:27:51.856509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:51.857130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:51.857663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:51.858629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:51.859158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:51.859652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:51.880513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:51.886332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:51.901418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Going to run 2 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:27:51.904273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 340bdcfa-c954-4f51-941a-c4324800f6d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:27:51.962076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_group_members'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:51.968678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_group_members'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:52.020039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_group_members'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:52.033748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:52.034828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_group_members'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:52.103935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=340bdcfa-c954-4f51-941a-c4324800f6d8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:27:52.217002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_group_members'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:52.229608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_group_members'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:52.301514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_group_members'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:52.315418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'server_group_members'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:52.438964 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-37b27de4-aa7c-4178-bc91-ffc865cdc9ec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.099362 Aug 29 15:27:52.443581 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 418/797] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:27:51 2022] POST /compute/v2.1/servers => generated 32 bytes in 1104 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:27:52.448440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fa387cf6-9f2f-44aa-b8ed-d1e1e2cde362 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:52.449047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fa387cf6-9f2f-44aa-b8ed-d1e1e2cde362 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:52.481201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa387cf6-9f2f-44aa-b8ed-d1e1e2cde362 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:52.483497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa387cf6-9f2f-44aa-b8ed-d1e1e2cde362 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:52.486952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa387cf6-9f2f-44aa-b8ed-d1e1e2cde362 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:52.488009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa387cf6-9f2f-44aa-b8ed-d1e1e2cde362 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:52.488598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa387cf6-9f2f-44aa-b8ed-d1e1e2cde362 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:52.490121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa387cf6-9f2f-44aa-b8ed-d1e1e2cde362 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:52.595466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8332a3fa-c184-4c73-9308-37dc3240a2ed tempest-AbsoluteLimitsTestJSON-1400069064 tempest-AbsoluteLimitsTestJSON-1400069064-project] Calling method '.version_select at 0x7fc42bbfb310>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:52.621058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8332a3fa-c184-4c73-9308-37dc3240a2ed tempest-AbsoluteLimitsTestJSON-1400069064 tempest-AbsoluteLimitsTestJSON-1400069064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:52.622174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8332a3fa-c184-4c73-9308-37dc3240a2ed tempest-AbsoluteLimitsTestJSON-1400069064 tempest-AbsoluteLimitsTestJSON-1400069064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:52.622847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8332a3fa-c184-4c73-9308-37dc3240a2ed tempest-AbsoluteLimitsTestJSON-1400069064 tempest-AbsoluteLimitsTestJSON-1400069064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:52.623906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8332a3fa-c184-4c73-9308-37dc3240a2ed tempest-AbsoluteLimitsTestJSON-1400069064 tempest-AbsoluteLimitsTestJSON-1400069064-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:52.624573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8332a3fa-c184-4c73-9308-37dc3240a2ed tempest-AbsoluteLimitsTestJSON-1400069064 tempest-AbsoluteLimitsTestJSON-1400069064-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:52.626206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8332a3fa-c184-4c73-9308-37dc3240a2ed tempest-AbsoluteLimitsTestJSON-1400069064 tempest-AbsoluteLimitsTestJSON-1400069064-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:52.693860 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8332a3fa-c184-4c73-9308-37dc3240a2ed tempest-AbsoluteLimitsTestJSON-1400069064 tempest-AbsoluteLimitsTestJSON-1400069064-project] 10.222.0.62 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.862313 Aug 29 15:27:52.695036 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 380/798] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 15:27:51 2022] GET /compute/v2.1/limits => generated 511 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:27:52.700704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e8ab090d-6fa4-4a1c-a8da-8f13d5441fd3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:52.731984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e8ab090d-6fa4-4a1c-a8da-8f13d5441fd3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:52.735838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e8ab090d-6fa4-4a1c-a8da-8f13d5441fd3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Searching by: {'deleted': False, 'project_id': '0393aa9c32934da4a9f478c563135bbb'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:27:52.793677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8ab090d-6fa4-4a1c-a8da-8f13d5441fd3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:52.796091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8ab090d-6fa4-4a1c-a8da-8f13d5441fd3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:52.797822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8ab090d-6fa4-4a1c-a8da-8f13d5441fd3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:52.801286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8ab090d-6fa4-4a1c-a8da-8f13d5441fd3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:52.802045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8ab090d-6fa4-4a1c-a8da-8f13d5441fd3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:52.803867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8ab090d-6fa4-4a1c-a8da-8f13d5441fd3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:53.011436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fa387cf6-9f2f-44aa-b8ed-d1e1e2cde362 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:53.023749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fa387cf6-9f2f-44aa-b8ed-d1e1e2cde362 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:53.027936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fa387cf6-9f2f-44aa-b8ed-d1e1e2cde362 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:53.030728 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fa387cf6-9f2f-44aa-b8ed-d1e1e2cde362 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.585307 Aug 29 15:27:53.047166 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 419/799] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:52 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:53.059589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d4e2c6f2-b8b7-4769-9324-7da631b0aacd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:53.060410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d4e2c6f2-b8b7-4769-9324-7da631b0aacd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:53.074185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4e2c6f2-b8b7-4769-9324-7da631b0aacd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:53.077005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4e2c6f2-b8b7-4769-9324-7da631b0aacd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:53.077503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4e2c6f2-b8b7-4769-9324-7da631b0aacd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:53.078464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4e2c6f2-b8b7-4769-9324-7da631b0aacd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:53.079739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4e2c6f2-b8b7-4769-9324-7da631b0aacd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:53.081501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4e2c6f2-b8b7-4769-9324-7da631b0aacd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:53.164768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-e8ab090d-6fa4-4a1c-a8da-8f13d5441fd3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:27:53.477911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d4e2c6f2-b8b7-4769-9324-7da631b0aacd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:53.487522 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d4e2c6f2-b8b7-4769-9324-7da631b0aacd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.439180 Aug 29 15:27:53.492136 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 420/800] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:53 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:53.513978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f9248b20-2f1c-4e5b-a7cc-49bae0d0a380 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bdb9ca0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:53.627590 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f9248b20-2f1c-4e5b-a7cc-49bae0d0a380 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.121193 Aug 29 15:27:53.628915 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 421/801] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:53 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:54.058299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a3f993e0-0df1-4a1a-9a99-988bfee1cc2b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:54.059782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a3f993e0-0df1-4a1a-9a99-988bfee1cc2b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:54.068274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f993e0-0df1-4a1a-9a99-988bfee1cc2b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:54.081818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f993e0-0df1-4a1a-9a99-988bfee1cc2b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:54.082694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f993e0-0df1-4a1a-9a99-988bfee1cc2b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:54.085040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f993e0-0df1-4a1a-9a99-988bfee1cc2b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:54.086541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f993e0-0df1-4a1a-9a99-988bfee1cc2b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:54.087199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f993e0-0df1-4a1a-9a99-988bfee1cc2b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:54.223509 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e8ab090d-6fa4-4a1c-a8da-8f13d5441fd3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 1.526419 Aug 29 15:27:54.225506 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 381/802] 10.222.0.62 () {58 vars in 1125 bytes} [Mon Aug 29 15:27:52 2022] GET /compute/v2.1/servers => generated 1663 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:54.259799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b612091-8e9f-4715-9505-aac9da2294a0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:54.260506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8b612091-8e9f-4715-9505-aac9da2294a0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:54.569187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8b612091-8e9f-4715-9505-aac9da2294a0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:54.582099 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8b612091-8e9f-4715-9505-aac9da2294a0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1218 microversion: 2.1 time: 0.345029 Aug 29 15:27:54.584903 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 382/803] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:54 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1218 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:54.601906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cd831f83-66e9-464f-811d-f9b887b2857f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:54.602549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cd831f83-66e9-464f-811d-f9b887b2857f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:54.634064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd831f83-66e9-464f-811d-f9b887b2857f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:54.638815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd831f83-66e9-464f-811d-f9b887b2857f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:54.641042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd831f83-66e9-464f-811d-f9b887b2857f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:54.642096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd831f83-66e9-464f-811d-f9b887b2857f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:54.644773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd831f83-66e9-464f-811d-f9b887b2857f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:54.646558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd831f83-66e9-464f-811d-f9b887b2857f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:55.268618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cd831f83-66e9-464f-811d-f9b887b2857f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:55.301509 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cd831f83-66e9-464f-811d-f9b887b2857f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.713431 Aug 29 15:27:55.309837 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 383/804] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:54 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:55.354858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2383bc7b-16f7-437e-aaa9-2329b93ff035 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bcd4670>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:55.488717 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2383bc7b-16f7-437e-aaa9-2329b93ff035 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.173925 Aug 29 15:27:55.491796 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 384/805] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:55 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:55.608071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-787e74f7-562c-4ee1-8a2b-e3270168b607 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:55.610338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-787e74f7-562c-4ee1-8a2b-e3270168b607 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:55.631933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-787e74f7-562c-4ee1-8a2b-e3270168b607 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:55.634535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-787e74f7-562c-4ee1-8a2b-e3270168b607 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:55.635401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-787e74f7-562c-4ee1-8a2b-e3270168b607 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:55.636769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-787e74f7-562c-4ee1-8a2b-e3270168b607 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:55.637520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-787e74f7-562c-4ee1-8a2b-e3270168b607 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:55.638183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-787e74f7-562c-4ee1-8a2b-e3270168b607 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:55.816985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-787e74f7-562c-4ee1-8a2b-e3270168b607 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:55.841618 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-787e74f7-562c-4ee1-8a2b-e3270168b607 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1270 microversion: 2.1 time: 0.240070 Aug 29 15:27:55.854771 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 385/806] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:55 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1270 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:56.008745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a3f993e0-0df1-4a1a-9a99-988bfee1cc2b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:56.044979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a3f993e0-0df1-4a1a-9a99-988bfee1cc2b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:56.065657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a3f993e0-0df1-4a1a-9a99-988bfee1cc2b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:56.067173 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a3f993e0-0df1-4a1a-9a99-988bfee1cc2b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 2.014390 Aug 29 15:27:56.081608 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 422/807] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:54 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:56.328316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9de0bfc8-016d-4ce1-8e44-df2e93633da9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:56.329157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9de0bfc8-016d-4ce1-8e44-df2e93633da9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:56.352573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9de0bfc8-016d-4ce1-8e44-df2e93633da9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:56.358148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9de0bfc8-016d-4ce1-8e44-df2e93633da9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:56.374324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9de0bfc8-016d-4ce1-8e44-df2e93633da9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:56.376230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9de0bfc8-016d-4ce1-8e44-df2e93633da9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:56.378510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9de0bfc8-016d-4ce1-8e44-df2e93633da9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:56.379870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9de0bfc8-016d-4ce1-8e44-df2e93633da9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:56.466605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:27:56.760949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1500431107", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": "none"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:56.954876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:27:56.955295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:27:56.955760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:27:56.956160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:27:56.956563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:27:57.002831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:57.003198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:57.011479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:57.012332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:57.012822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:57.013294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:57.128554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Getting quotas for project 19b6d0ad7c834a5b9ea5aef3bd540f99. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:27:57.145798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Getting quotas for user 912df97993a14b4a8918e1e22d4bbca1 and project 19b6d0ad7c834a5b9ea5aef3bd540f99. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:27:57.176274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9de0bfc8-016d-4ce1-8e44-df2e93633da9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:57.219450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:27:57.225402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:27:57.228550 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9de0bfc8-016d-4ce1-8e44-df2e93633da9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.904404 Aug 29 15:27:57.237149 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 423/808] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:56 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:57.256202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-67efe2a9-30f2-4f2a-ae7e-59af0255ada3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bdb9940>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:57.391213 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-67efe2a9-30f2-4f2a-ae7e-59af0255ada3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.152712 Aug 29 15:27:57.394650 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 424/809] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:57 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:57.412360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-959479f9-4335-4b0a-8bae-f2df8100ecc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:57.416068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-959479f9-4335-4b0a-8bae-f2df8100ecc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:57.430468 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-494b0d2f-7bf9-49e8-a85a-080acdaf2fc4 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 1.438669 Aug 29 15:27:57.432707 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 386/810] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:27:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:27:57.444404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8227f310-fb82-4223-8df9-46d6b0ff77f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:57.446348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8227f310-fb82-4223-8df9-46d6b0ff77f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:57.456067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8227f310-fb82-4223-8df9-46d6b0ff77f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:57.456899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8227f310-fb82-4223-8df9-46d6b0ff77f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:57.457789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8227f310-fb82-4223-8df9-46d6b0ff77f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:57.459024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8227f310-fb82-4223-8df9-46d6b0ff77f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:57.459727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8227f310-fb82-4223-8df9-46d6b0ff77f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:57.460380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8227f310-fb82-4223-8df9-46d6b0ff77f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:57.463790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-959479f9-4335-4b0a-8bae-f2df8100ecc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:57.464453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-959479f9-4335-4b0a-8bae-f2df8100ecc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:57.464991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-959479f9-4335-4b0a-8bae-f2df8100ecc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:57.465997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-959479f9-4335-4b0a-8bae-f2df8100ecc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:57.480865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-959479f9-4335-4b0a-8bae-f2df8100ecc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:57.489507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-959479f9-4335-4b0a-8bae-f2df8100ecc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:57.813500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8227f310-fb82-4223-8df9-46d6b0ff77f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:57.826399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8227f310-fb82-4223-8df9-46d6b0ff77f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:57.827883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8227f310-fb82-4223-8df9-46d6b0ff77f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:57.838174 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8227f310-fb82-4223-8df9-46d6b0ff77f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.403654 Aug 29 15:27:57.841006 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 387/811] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:57 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:57.854381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-54907594-041b-4870-8045-68ee769d97b7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:27:57.860108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-54907594-041b-4870-8045-68ee769d97b7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:57.928867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-959479f9-4335-4b0a-8bae-f2df8100ecc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:57.938432 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-959479f9-4335-4b0a-8bae-f2df8100ecc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1276 microversion: 2.1 time: 0.542535 Aug 29 15:27:57.941832 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 425/812] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:57 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1276 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:58.069966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-54907594-041b-4870-8045-68ee769d97b7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:58.084916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-54907594-041b-4870-8045-68ee769d97b7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:58.096102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-54907594-041b-4870-8045-68ee769d97b7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:58.114703 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-54907594-041b-4870-8045-68ee769d97b7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "PUT /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1359 microversion: 2.75 time: 0.271136 Aug 29 15:27:58.116617 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 388/813] 10.222.0.62 () {62 vars in 1297 bytes} [Mon Aug 29 15:27:57 2022] PUT /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:58.146219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f3fc34b5-42d6-4d71-94d1-de40937bedc2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:58.147236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f3fc34b5-42d6-4d71-94d1-de40937bedc2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:58.257588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-01a413bf-ae4e-4b02-b04a-ae1c038853ea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:58.258559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-01a413bf-ae4e-4b02-b04a-ae1c038853ea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:58.275377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01a413bf-ae4e-4b02-b04a-ae1c038853ea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:58.276370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01a413bf-ae4e-4b02-b04a-ae1c038853ea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:58.277268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01a413bf-ae4e-4b02-b04a-ae1c038853ea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:58.279905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01a413bf-ae4e-4b02-b04a-ae1c038853ea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:58.287999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01a413bf-ae4e-4b02-b04a-ae1c038853ea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:58.290715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01a413bf-ae4e-4b02-b04a-ae1c038853ea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:58.607278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f3fc34b5-42d6-4d71-94d1-de40937bedc2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:58.617822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f3fc34b5-42d6-4d71-94d1-de40937bedc2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:58.619414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f3fc34b5-42d6-4d71-94d1-de40937bedc2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:58.643242 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f3fc34b5-42d6-4d71-94d1-de40937bedc2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1359 microversion: 2.75 time: 0.500910 Aug 29 15:27:58.648745 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 426/814] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:58 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1359 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:27:58.654931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7c702098-0820-4e82-a7a5-50509feecd9d tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bbda5e0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:58.811462 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7c702098-0820-4e82-a7a5-50509feecd9d tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.161130 Aug 29 15:27:58.812057 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 427/815] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:27:58 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:58.872027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a439d1f5-3091-46d5-8fe5-9be59e061f47 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:58.872649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a439d1f5-3091-46d5-8fe5-9be59e061f47 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:58.895233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a439d1f5-3091-46d5-8fe5-9be59e061f47 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:58.895846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a439d1f5-3091-46d5-8fe5-9be59e061f47 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:58.896305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a439d1f5-3091-46d5-8fe5-9be59e061f47 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:58.897063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a439d1f5-3091-46d5-8fe5-9be59e061f47 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:58.897549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a439d1f5-3091-46d5-8fe5-9be59e061f47 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:58.897975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a439d1f5-3091-46d5-8fe5-9be59e061f47 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:58.959901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-01a413bf-ae4e-4b02-b04a-ae1c038853ea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:58.980367 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-01a413bf-ae4e-4b02-b04a-ae1c038853ea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.726180 Aug 29 15:27:58.984069 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 389/816] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:58 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:27:59.002464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-02c449e9-189c-4cad-a2df-aa936a96d21e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:59.007961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-02c449e9-189c-4cad-a2df-aa936a96d21e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:59.027069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02c449e9-189c-4cad-a2df-aa936a96d21e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:59.030679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02c449e9-189c-4cad-a2df-aa936a96d21e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:59.031160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02c449e9-189c-4cad-a2df-aa936a96d21e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:59.033584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02c449e9-189c-4cad-a2df-aa936a96d21e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:59.035359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02c449e9-189c-4cad-a2df-aa936a96d21e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:59.037334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02c449e9-189c-4cad-a2df-aa936a96d21e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:59.275258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-02c449e9-189c-4cad-a2df-aa936a96d21e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:27:59.308005 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-02c449e9-189c-4cad-a2df-aa936a96d21e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1276 microversion: 2.1 time: 0.303461 Aug 29 15:27:59.308005 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 390/817] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:27:58 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1276 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:27:59.676705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c05461f6-c1c6-48df-8d05-247b527e070c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:59.677263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c05461f6-c1c6-48df-8d05-247b527e070c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:27:59.689718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c05461f6-c1c6-48df-8d05-247b527e070c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:59.690225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c05461f6-c1c6-48df-8d05-247b527e070c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:59.690672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c05461f6-c1c6-48df-8d05-247b527e070c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:59.691469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c05461f6-c1c6-48df-8d05-247b527e070c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:59.694141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c05461f6-c1c6-48df-8d05-247b527e070c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:59.695274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c05461f6-c1c6-48df-8d05-247b527e070c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:00.076177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c05461f6-c1c6-48df-8d05-247b527e070c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:00.114787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c05461f6-c1c6-48df-8d05-247b527e070c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:00.120822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c05461f6-c1c6-48df-8d05-247b527e070c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:00.138675 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c05461f6-c1c6-48df-8d05-247b527e070c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1411 microversion: 2.75 time: 0.465979 Aug 29 15:28:00.174707 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 391/818] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:59 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1411 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:28:00.181808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-43fc8799-eafa-4cd4-865a-04060ca6ce02 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bcd4790>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:00.293120 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-43fc8799-eafa-4cd4-865a-04060ca6ce02 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.116652 Aug 29 15:28:00.294563 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 392/819] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:00 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:00.316960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3cab6c69-99ed-4c35-98c0-88821235c46d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:00.317653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3cab6c69-99ed-4c35-98c0-88821235c46d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:00.340984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cab6c69-99ed-4c35-98c0-88821235c46d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:00.341433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cab6c69-99ed-4c35-98c0-88821235c46d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:00.341918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cab6c69-99ed-4c35-98c0-88821235c46d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:00.349793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cab6c69-99ed-4c35-98c0-88821235c46d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:00.354845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cab6c69-99ed-4c35-98c0-88821235c46d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:00.357429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cab6c69-99ed-4c35-98c0-88821235c46d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:00.898258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3cab6c69-99ed-4c35-98c0-88821235c46d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:00.912346 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3cab6c69-99ed-4c35-98c0-88821235c46d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.604049 Aug 29 15:28:00.928833 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 393/820] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:00 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:00.939823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aec671da-c925-4ed0-b05e-39aa29ad0e10 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:00.942071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aec671da-c925-4ed0-b05e-39aa29ad0e10 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:00.956011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec671da-c925-4ed0-b05e-39aa29ad0e10 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:00.956513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec671da-c925-4ed0-b05e-39aa29ad0e10 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:00.956958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec671da-c925-4ed0-b05e-39aa29ad0e10 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:00.957740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec671da-c925-4ed0-b05e-39aa29ad0e10 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:00.958201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec671da-c925-4ed0-b05e-39aa29ad0e10 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:00.958633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec671da-c925-4ed0-b05e-39aa29ad0e10 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:00.965139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a439d1f5-3091-46d5-8fe5-9be59e061f47 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:00.984104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a439d1f5-3091-46d5-8fe5-9be59e061f47 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:00.986024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a439d1f5-3091-46d5-8fe5-9be59e061f47 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:00.988296 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a439d1f5-3091-46d5-8fe5-9be59e061f47 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 2.119540 Aug 29 15:28:00.999184 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 428/821] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:27:58 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 2132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:28:01.101145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aec671da-c925-4ed0-b05e-39aa29ad0e10 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:01.128258 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aec671da-c925-4ed0-b05e-39aa29ad0e10 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1276 microversion: 2.1 time: 0.194752 Aug 29 15:28:01.136411 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 394/822] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:00 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1276 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:01.168959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-75fae77c-360a-45ca-8b78-dd635dfd8d26 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:01.169777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-75fae77c-360a-45ca-8b78-dd635dfd8d26 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:01.179693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75fae77c-360a-45ca-8b78-dd635dfd8d26 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:01.180392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75fae77c-360a-45ca-8b78-dd635dfd8d26 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:01.184876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75fae77c-360a-45ca-8b78-dd635dfd8d26 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:01.185810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75fae77c-360a-45ca-8b78-dd635dfd8d26 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:01.187367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75fae77c-360a-45ca-8b78-dd635dfd8d26 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:01.187918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75fae77c-360a-45ca-8b78-dd635dfd8d26 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:01.313305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-74fd57e5-51e4-417e-bf7c-0524c1d3fd05 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bc80940>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:01.416908 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-74fd57e5-51e4-417e-bf7c-0524c1d3fd05 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.111868 Aug 29 15:28:01.424283 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 395/823] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:01 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:01.870878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=16 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:01.945285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c8e0fec-c9ce-49c0-b3f4-6ec66a0602c3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:01.947063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5c8e0fec-c9ce-49c0-b3f4-6ec66a0602c3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:01.969244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c8e0fec-c9ce-49c0-b3f4-6ec66a0602c3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:01.970292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c8e0fec-c9ce-49c0-b3f4-6ec66a0602c3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:01.971017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c8e0fec-c9ce-49c0-b3f4-6ec66a0602c3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:01.971922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c8e0fec-c9ce-49c0-b3f4-6ec66a0602c3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:01.972528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c8e0fec-c9ce-49c0-b3f4-6ec66a0602c3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:01.973123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c8e0fec-c9ce-49c0-b3f4-6ec66a0602c3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:01.976959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-75fae77c-360a-45ca-8b78-dd635dfd8d26 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:01.986395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-75fae77c-360a-45ca-8b78-dd635dfd8d26 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:01.991483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-75fae77c-360a-45ca-8b78-dd635dfd8d26 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:02.010888 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-75fae77c-360a-45ca-8b78-dd635dfd8d26 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1417 microversion: 2.75 time: 0.838821 Aug 29 15:28:02.011718 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 429/824] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:01 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1417 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:02.021227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2c06f764-c9b9-4116-b351-066ede5e7d2c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:02.023916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2c06f764-c9b9-4116-b351-066ede5e7d2c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:02.041755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c06f764-c9b9-4116-b351-066ede5e7d2c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:02.042528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c06f764-c9b9-4116-b351-066ede5e7d2c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:02.043647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c06f764-c9b9-4116-b351-066ede5e7d2c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:02.044850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c06f764-c9b9-4116-b351-066ede5e7d2c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:02.047827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c06f764-c9b9-4116-b351-066ede5e7d2c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:02.048542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c06f764-c9b9-4116-b351-066ede5e7d2c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:02.377843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5c8e0fec-c9ce-49c0-b3f4-6ec66a0602c3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:02.413318 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5c8e0fec-c9ce-49c0-b3f4-6ec66a0602c3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.477660 Aug 29 15:28:02.426156 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 396/825] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:01 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:02.444507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5448f098-8d90-492b-8425-d6b13246cfd2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:02.451184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5448f098-8d90-492b-8425-d6b13246cfd2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:02.471103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5448f098-8d90-492b-8425-d6b13246cfd2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:02.475274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5448f098-8d90-492b-8425-d6b13246cfd2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:02.476350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5448f098-8d90-492b-8425-d6b13246cfd2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:02.479170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5448f098-8d90-492b-8425-d6b13246cfd2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:02.490217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5448f098-8d90-492b-8425-d6b13246cfd2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:02.491764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5448f098-8d90-492b-8425-d6b13246cfd2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:02.749411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2c06f764-c9b9-4116-b351-066ede5e7d2c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:02.771359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2c06f764-c9b9-4116-b351-066ede5e7d2c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:02.772834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2c06f764-c9b9-4116-b351-066ede5e7d2c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:02.787219 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2c06f764-c9b9-4116-b351-066ede5e7d2c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.772599 Aug 29 15:28:02.788091 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 430/826] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:02 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:02.817352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e247a0c9-e9b9-4403-b6ce-4c83c46bcf10 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc4301fa310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:02.944758 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e247a0c9-e9b9-4403-b6ce-4c83c46bcf10 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.146677 Aug 29 15:28:02.945398 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 431/827] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:02 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:03.036761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-170f4dce-87cb-41b2-8ed5-041668bcffd7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:03.037672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-170f4dce-87cb-41b2-8ed5-041668bcffd7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:03.049655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-170f4dce-87cb-41b2-8ed5-041668bcffd7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:03.050133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-170f4dce-87cb-41b2-8ed5-041668bcffd7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:03.059573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-170f4dce-87cb-41b2-8ed5-041668bcffd7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:03.070257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-170f4dce-87cb-41b2-8ed5-041668bcffd7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:03.071045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-170f4dce-87cb-41b2-8ed5-041668bcffd7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:03.071668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-170f4dce-87cb-41b2-8ed5-041668bcffd7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:03.207066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-170f4dce-87cb-41b2-8ed5-041668bcffd7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:03.219934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-170f4dce-87cb-41b2-8ed5-041668bcffd7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:03.231256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-170f4dce-87cb-41b2-8ed5-041668bcffd7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:03.246588 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-170f4dce-87cb-41b2-8ed5-041668bcffd7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1417 microversion: 2.75 time: 0.214190 Aug 29 15:28:03.248170 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 432/828] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:03 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1417 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:28:03.451546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-634f3cce-1635-4ce8-80c9-deb16862792e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:03.452080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-634f3cce-1635-4ce8-80c9-deb16862792e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:03.475062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-634f3cce-1635-4ce8-80c9-deb16862792e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:03.475760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-634f3cce-1635-4ce8-80c9-deb16862792e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:03.476372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-634f3cce-1635-4ce8-80c9-deb16862792e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:03.477308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-634f3cce-1635-4ce8-80c9-deb16862792e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:03.477925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-634f3cce-1635-4ce8-80c9-deb16862792e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:03.478523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-634f3cce-1635-4ce8-80c9-deb16862792e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:04.126642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5448f098-8d90-492b-8425-d6b13246cfd2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:04.152226 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5448f098-8d90-492b-8425-d6b13246cfd2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1318 microversion: 2.1 time: 1.724447 Aug 29 15:28:04.154382 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 397/829] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:02 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1318 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:04.160824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4f3e2f84-23d3-4821-9f9f-d80384b57862 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:04.161931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4f3e2f84-23d3-4821-9f9f-d80384b57862 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:04.164242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:04.172678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f3e2f84-23d3-4821-9f9f-d80384b57862 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:04.173653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f3e2f84-23d3-4821-9f9f-d80384b57862 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:04.174287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f3e2f84-23d3-4821-9f9f-d80384b57862 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:04.175364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f3e2f84-23d3-4821-9f9f-d80384b57862 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:04.176101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f3e2f84-23d3-4821-9f9f-d80384b57862 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:04.176742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f3e2f84-23d3-4821-9f9f-d80384b57862 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:04.485567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-634f3cce-1635-4ce8-80c9-deb16862792e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:04.493960 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-634f3cce-1635-4ce8-80c9-deb16862792e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 1.046716 Aug 29 15:28:04.494540 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 433/830] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:03 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:04.518808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8f537476-2bbb-4cfd-89e0-41cf9f33ffef tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42badba60>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:04.599756 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8f537476-2bbb-4cfd-89e0-41cf9f33ffef tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.086616 Aug 29 15:28:04.600356 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 434/831] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:04 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:04.605313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-adf70abd-2fab-4004-80eb-29b31f9c32b9 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:04.626311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-adf70abd-2fab-4004-80eb-29b31f9c32b9 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:04.637560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf70abd-2fab-4004-80eb-29b31f9c32b9 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:04.638902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf70abd-2fab-4004-80eb-29b31f9c32b9 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:04.639880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf70abd-2fab-4004-80eb-29b31f9c32b9 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:04.641113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf70abd-2fab-4004-80eb-29b31f9c32b9 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:04.642059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf70abd-2fab-4004-80eb-29b31f9c32b9 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:04.642665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf70abd-2fab-4004-80eb-29b31f9c32b9 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:04.808264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-adf70abd-2fab-4004-80eb-29b31f9c32b9 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:04.819102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-adf70abd-2fab-4004-80eb-29b31f9c32b9 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:04.822211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-adf70abd-2fab-4004-80eb-29b31f9c32b9 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:04.862240 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-adf70abd-2fab-4004-80eb-29b31f9c32b9 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1417 microversion: 2.75 time: 0.260565 Aug 29 15:28:04.863180 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 435/832] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:04 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1417 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:04.882615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4f3e2f84-23d3-4821-9f9f-d80384b57862 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:04.916305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4f3e2f84-23d3-4821-9f9f-d80384b57862 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:04.958008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4f3e2f84-23d3-4821-9f9f-d80384b57862 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:04.962108 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4f3e2f84-23d3-4821-9f9f-d80384b57862 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.806282 Aug 29 15:28:04.964988 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 398/833] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:04 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:05.176389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-42b35c40-3240-4f1f-bf0c-7aee8dc99a62 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:05.177032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-42b35c40-3240-4f1f-bf0c-7aee8dc99a62 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:05.195202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42b35c40-3240-4f1f-bf0c-7aee8dc99a62 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:05.195943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42b35c40-3240-4f1f-bf0c-7aee8dc99a62 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:05.196536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42b35c40-3240-4f1f-bf0c-7aee8dc99a62 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:05.197482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42b35c40-3240-4f1f-bf0c-7aee8dc99a62 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:05.198112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42b35c40-3240-4f1f-bf0c-7aee8dc99a62 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:05.199094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42b35c40-3240-4f1f-bf0c-7aee8dc99a62 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:05.443624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-42b35c40-3240-4f1f-bf0c-7aee8dc99a62 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:05.458089 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-42b35c40-3240-4f1f-bf0c-7aee8dc99a62 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1318 microversion: 2.1 time: 0.285868 Aug 29 15:28:05.459310 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 436/834] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:05 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:05.515568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-db5d95a4-337b-4189-97cf-137344ba3312 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:05.516330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-db5d95a4-337b-4189-97cf-137344ba3312 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:05.529953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db5d95a4-337b-4189-97cf-137344ba3312 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:05.530562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db5d95a4-337b-4189-97cf-137344ba3312 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:05.531202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db5d95a4-337b-4189-97cf-137344ba3312 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:05.531725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db5d95a4-337b-4189-97cf-137344ba3312 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:05.532187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db5d95a4-337b-4189-97cf-137344ba3312 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:05.532654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db5d95a4-337b-4189-97cf-137344ba3312 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:05.615158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-43761dae-6e49-4dd0-b2fa-84218e9eb85f tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc4301fa700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:05.704528 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-43761dae-6e49-4dd0-b2fa-84218e9eb85f tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.093199 Aug 29 15:28:05.705165 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 437/835] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:05 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:05.711794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-8e60dd97-ff98-4101-8ee3-143815e80825 req-87d8c08a-89f5-4aa1-bd55-ff84bb3d4159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "789a7b2e-44e3-453f-9ee3-0656d92773f6", "tag": "b927a394-a17e-4e31-89a0-4093856ef8a5"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:05.740096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8e60dd97-ff98-4101-8ee3-143815e80825 req-87d8c08a-89f5-4aa1-bd55-ff84bb3d4159 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:05.740958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8e60dd97-ff98-4101-8ee3-143815e80825 req-87d8c08a-89f5-4aa1-bd55-ff84bb3d4159 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:05.741611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8e60dd97-ff98-4101-8ee3-143815e80825 req-87d8c08a-89f5-4aa1-bd55-ff84bb3d4159 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:05.760614 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-8e60dd97-ff98-4101-8ee3-143815e80825 req-87d8c08a-89f5-4aa1-bd55-ff84bb3d4159 service nova] Creating event network-changed:b927a394-a17e-4e31-89a0-4093856ef8a5 for instance 789a7b2e-44e3-453f-9ee3-0656d92773f6 on n-h1-839401-11 Aug 29 15:28:05.774983 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-8e60dd97-ff98-4101-8ee3-143815e80825 req-87d8c08a-89f5-4aa1-bd55-ff84bb3d4159 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066717 Aug 29 15:28:05.776000 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 438/836] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:05.890623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2d0c3525-d262-4c8f-a557-0f142a067314 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:05.891606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2d0c3525-d262-4c8f-a557-0f142a067314 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:05.903127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d0c3525-d262-4c8f-a557-0f142a067314 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:05.904232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d0c3525-d262-4c8f-a557-0f142a067314 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:05.904868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d0c3525-d262-4c8f-a557-0f142a067314 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:05.905775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d0c3525-d262-4c8f-a557-0f142a067314 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:05.909752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d0c3525-d262-4c8f-a557-0f142a067314 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:05.910405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d0c3525-d262-4c8f-a557-0f142a067314 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:06.154550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-db5d95a4-337b-4189-97cf-137344ba3312 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:06.169073 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-db5d95a4-337b-4189-97cf-137344ba3312 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1505 microversion: 2.1 time: 0.657372 Aug 29 15:28:06.169719 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 399/837] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:05 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1505 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:06.191845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dd8f1353-58c4-44fe-9e3a-ca4613b3600e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:06.192472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dd8f1353-58c4-44fe-9e3a-ca4613b3600e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:06.216333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd8f1353-58c4-44fe-9e3a-ca4613b3600e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:06.221504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd8f1353-58c4-44fe-9e3a-ca4613b3600e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:06.225500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd8f1353-58c4-44fe-9e3a-ca4613b3600e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:06.226563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd8f1353-58c4-44fe-9e3a-ca4613b3600e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:06.227813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd8f1353-58c4-44fe-9e3a-ca4613b3600e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:06.229068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd8f1353-58c4-44fe-9e3a-ca4613b3600e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:06.375039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2d0c3525-d262-4c8f-a557-0f142a067314 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:06.387078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2d0c3525-d262-4c8f-a557-0f142a067314 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:06.394336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2d0c3525-d262-4c8f-a557-0f142a067314 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:06.405693 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2d0c3525-d262-4c8f-a557-0f142a067314 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1417 microversion: 2.75 time: 0.519264 Aug 29 15:28:06.408367 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 439/838] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:05 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1417 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:28:06.479149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6b902050-974e-4800-988c-268176e68ea0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:06.480997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6b902050-974e-4800-988c-268176e68ea0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:06.493362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b902050-974e-4800-988c-268176e68ea0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:06.499600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b902050-974e-4800-988c-268176e68ea0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:06.500391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b902050-974e-4800-988c-268176e68ea0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:06.501645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b902050-974e-4800-988c-268176e68ea0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:06.502813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b902050-974e-4800-988c-268176e68ea0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:06.503494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b902050-974e-4800-988c-268176e68ea0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:06.962762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dd8f1353-58c4-44fe-9e3a-ca4613b3600e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:06.984770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dd8f1353-58c4-44fe-9e3a-ca4613b3600e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:06.991817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dd8f1353-58c4-44fe-9e3a-ca4613b3600e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:06.994407 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dd8f1353-58c4-44fe-9e3a-ca4613b3600e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.820349 Aug 29 15:28:06.997937 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 400/839] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:06 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:07.009578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-768bd098-2939-4b81-ae39-a8e6afbe758b tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc43002a160>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:07.051602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:07.118920 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-768bd098-2939-4b81-ae39-a8e6afbe758b tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.118451 Aug 29 15:28:07.120731 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 401/840] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:06 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:07.192474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ff25d653-5687-4358-b7f6-9e7adf73c25f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:07.193245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ff25d653-5687-4358-b7f6-9e7adf73c25f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:07.207098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff25d653-5687-4358-b7f6-9e7adf73c25f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:07.207806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff25d653-5687-4358-b7f6-9e7adf73c25f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:07.208639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff25d653-5687-4358-b7f6-9e7adf73c25f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:07.214170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff25d653-5687-4358-b7f6-9e7adf73c25f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:07.215116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff25d653-5687-4358-b7f6-9e7adf73c25f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:07.216058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff25d653-5687-4358-b7f6-9e7adf73c25f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:07.243998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6b902050-974e-4800-988c-268176e68ea0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:07.253849 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6b902050-974e-4800-988c-268176e68ea0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1318 microversion: 2.1 time: 0.778592 Aug 29 15:28:07.277114 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 440/841] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:06 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1318 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:07.277381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:07.439510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8c90254d-e224-4dd7-a80f-2d825d1947c7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:07.440416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8c90254d-e224-4dd7-a80f-2d825d1947c7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:07.459830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c90254d-e224-4dd7-a80f-2d825d1947c7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:07.461306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c90254d-e224-4dd7-a80f-2d825d1947c7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:07.463391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c90254d-e224-4dd7-a80f-2d825d1947c7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:07.464719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c90254d-e224-4dd7-a80f-2d825d1947c7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:07.470358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c90254d-e224-4dd7-a80f-2d825d1947c7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:07.471228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c90254d-e224-4dd7-a80f-2d825d1947c7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:07.720880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8c90254d-e224-4dd7-a80f-2d825d1947c7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:07.820562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8c90254d-e224-4dd7-a80f-2d825d1947c7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:07.823526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8c90254d-e224-4dd7-a80f-2d825d1947c7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:07.872156 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8c90254d-e224-4dd7-a80f-2d825d1947c7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1438 microversion: 2.75 time: 0.440566 Aug 29 15:28:07.875473 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 441/842] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:07 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1438 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:28:07.899783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:07.909786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:07.956884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:07.959894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:07.962854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:07.968057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:07.969796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:07.973056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:08.075433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=20 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:08.262103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:28:08.263575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ff25d653-5687-4358-b7f6-9e7adf73c25f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:08.265237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:28:08.265757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:28:08.268241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:28:08.274828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:28:08.276554 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ff25d653-5687-4358-b7f6-9e7adf73c25f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1495 microversion: 2.1 time: 1.089137 Aug 29 15:28:08.278204 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 402/843] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:07 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1495 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:08.285146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a47edcfd-66e0-43a9-9e91-15710f9794f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:08.286130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a47edcfd-66e0-43a9-9e91-15710f9794f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:08.315174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47edcfd-66e0-43a9-9e91-15710f9794f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:08.317376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47edcfd-66e0-43a9-9e91-15710f9794f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:08.320554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47edcfd-66e0-43a9-9e91-15710f9794f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:08.322799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47edcfd-66e0-43a9-9e91-15710f9794f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:08.329925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47edcfd-66e0-43a9-9e91-15710f9794f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:08.330863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47edcfd-66e0-43a9-9e91-15710f9794f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:08.470892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:08.480857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:08.481733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:08.482423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:08.483373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:08.484710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:08.486918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:08.614297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=26 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:08.725163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:08.734785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:08.736708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:08.744223 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a92928f7-b62b-467c-bbc4-7ff6feb0d4a2 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "POST /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0/action" status: 202 len: 1495 microversion: 2.75 time: 0.848776 Aug 29 15:28:08.769634 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 442/844] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 15:28:07 2022] POST /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0/action => generated 1495 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 15:28:08.775549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8c955c80-2143-4a0f-abe2-73a94d04c239 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc4301fa700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:08.868376 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8c955c80-2143-4a0f-abe2-73a94d04c239 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.097173 Aug 29 15:28:08.871763 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 443/845] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:08 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:08.876988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-40bb6dba-eb46-4cc9-83d8-5345bb5e928c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:08.878258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-40bb6dba-eb46-4cc9-83d8-5345bb5e928c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:08.885489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40bb6dba-eb46-4cc9-83d8-5345bb5e928c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:08.886567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40bb6dba-eb46-4cc9-83d8-5345bb5e928c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:08.887248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40bb6dba-eb46-4cc9-83d8-5345bb5e928c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:08.888396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40bb6dba-eb46-4cc9-83d8-5345bb5e928c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:08.902149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40bb6dba-eb46-4cc9-83d8-5345bb5e928c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:08.903183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40bb6dba-eb46-4cc9-83d8-5345bb5e928c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:09.226872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a47edcfd-66e0-43a9-9e91-15710f9794f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:09.236062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a47edcfd-66e0-43a9-9e91-15710f9794f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:09.237582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a47edcfd-66e0-43a9-9e91-15710f9794f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:09.238817 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a47edcfd-66e0-43a9-9e91-15710f9794f2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.958869 Aug 29 15:28:09.239401 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 403/846] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:08 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:09.272983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-91d4eea0-248a-4c7a-937f-078565259562 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '.version_select at 0x7fc42bcd4a60>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:09.286354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91d4eea0-248a-4c7a-937f-078565259562 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:09.291795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91d4eea0-248a-4c7a-937f-078565259562 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:09.292250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91d4eea0-248a-4c7a-937f-078565259562 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:09.356615 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-91d4eea0-248a-4c7a-937f-078565259562 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.100120 Aug 29 15:28:09.360294 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 404/847] 10.222.0.62 () {58 vars in 1143 bytes} [Mon Aug 29 15:28:09 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:09.365601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-56e8eb33-a92f-4c80-be57-7e2b0267a141 req-a6a98c89-17a4-48ae-ae42-d451b30602ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "340bdcfa-c954-4f51-941a-c4324800f6d8", "tag": "641712b3-932e-44d2-85a3-694a0a38de21"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:09.400347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-56e8eb33-a92f-4c80-be57-7e2b0267a141 req-a6a98c89-17a4-48ae-ae42-d451b30602ab service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:09.400970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-56e8eb33-a92f-4c80-be57-7e2b0267a141 req-a6a98c89-17a4-48ae-ae42-d451b30602ab service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:09.402746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-56e8eb33-a92f-4c80-be57-7e2b0267a141 req-a6a98c89-17a4-48ae-ae42-d451b30602ab service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:09.446672 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-56e8eb33-a92f-4c80-be57-7e2b0267a141 req-a6a98c89-17a4-48ae-ae42-d451b30602ab service nova] Creating event network-changed:641712b3-932e-44d2-85a3-694a0a38de21 for instance 340bdcfa-c954-4f51-941a-c4324800f6d8 on n-h2-839401-11 Aug 29 15:28:09.462358 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-56e8eb33-a92f-4c80-be57-7e2b0267a141 req-a6a98c89-17a4-48ae-ae42-d451b30602ab service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097244 Aug 29 15:28:09.463809 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 405/848] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:09.482761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-964f7ebd-aea0-48d2-9d6c-0c0893a2f59b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:09.483995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-964f7ebd-aea0-48d2-9d6c-0c0893a2f59b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:09.505652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-964f7ebd-aea0-48d2-9d6c-0c0893a2f59b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:09.508636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-964f7ebd-aea0-48d2-9d6c-0c0893a2f59b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:09.510471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-964f7ebd-aea0-48d2-9d6c-0c0893a2f59b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:09.511526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-964f7ebd-aea0-48d2-9d6c-0c0893a2f59b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:09.513430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-964f7ebd-aea0-48d2-9d6c-0c0893a2f59b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:09.516694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-964f7ebd-aea0-48d2-9d6c-0c0893a2f59b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:09.682455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-964f7ebd-aea0-48d2-9d6c-0c0893a2f59b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:09.698553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-964f7ebd-aea0-48d2-9d6c-0c0893a2f59b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:09.700422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-964f7ebd-aea0-48d2-9d6c-0c0893a2f59b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:09.713560 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-964f7ebd-aea0-48d2-9d6c-0c0893a2f59b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.243562 Aug 29 15:28:09.714197 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 406/849] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:09 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:09.726862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b073b6f5-e9eb-4390-a2b0-b97760767732 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:09.727760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b073b6f5-e9eb-4390-a2b0-b97760767732 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:09.741381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b073b6f5-e9eb-4390-a2b0-b97760767732 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:09.747099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b073b6f5-e9eb-4390-a2b0-b97760767732 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:09.747888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b073b6f5-e9eb-4390-a2b0-b97760767732 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:09.749858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b073b6f5-e9eb-4390-a2b0-b97760767732 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:09.750594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b073b6f5-e9eb-4390-a2b0-b97760767732 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:09.751394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b073b6f5-e9eb-4390-a2b0-b97760767732 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:09.812023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-40bb6dba-eb46-4cc9-83d8-5345bb5e928c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:09.823688 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-40bb6dba-eb46-4cc9-83d8-5345bb5e928c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1318 microversion: 2.1 time: 0.950610 Aug 29 15:28:09.835137 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 444/850] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:08 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1318 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:09.885309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c5c8875f-300a-4771-9265-4b89c50cea06 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bc48af0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:09.976049 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c5c8875f-300a-4771-9265-4b89c50cea06 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.094724 Aug 29 15:28:09.976939 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 445/851] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:09 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:10.270868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3630145a-0298-47ff-93ec-981b2c18dbad tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:10.272016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3630145a-0298-47ff-93ec-981b2c18dbad tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:10.313843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3630145a-0298-47ff-93ec-981b2c18dbad tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:10.314677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3630145a-0298-47ff-93ec-981b2c18dbad tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:10.315416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3630145a-0298-47ff-93ec-981b2c18dbad tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:10.325296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3630145a-0298-47ff-93ec-981b2c18dbad tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:10.326314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3630145a-0298-47ff-93ec-981b2c18dbad tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:10.326956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3630145a-0298-47ff-93ec-981b2c18dbad tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:10.358323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:10.365431 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b073b6f5-e9eb-4390-a2b0-b97760767732 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1648 microversion: 2.1 time: 0.648969 Aug 29 15:28:10.368011 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 407/852] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:09 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1648 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:10.672734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-97934182", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "7ead68ac-9b85-4a15-900a-c59cae425b9c"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:10.773420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3630145a-0298-47ff-93ec-981b2c18dbad tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:10.783468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3630145a-0298-47ff-93ec-981b2c18dbad tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:10.784952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3630145a-0298-47ff-93ec-981b2c18dbad tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:10.786603 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3630145a-0298-47ff-93ec-981b2c18dbad tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.523631 Aug 29 15:28:10.787551 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 446/853] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:10 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:10.805625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ee865908-f349-4264-be71-9205a30ba834 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:10.807673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ee865908-f349-4264-be71-9205a30ba834 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:10.820767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] validate_networks() for [('7ead68ac-9b85-4a15-900a-c59cae425b9c', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:28:10.823310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee865908-f349-4264-be71-9205a30ba834 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:10.823802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee865908-f349-4264-be71-9205a30ba834 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:10.824258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee865908-f349-4264-be71-9205a30ba834 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:10.825003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee865908-f349-4264-be71-9205a30ba834 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:10.830623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee865908-f349-4264-be71-9205a30ba834 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:10.831126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee865908-f349-4264-be71-9205a30ba834 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:11.642904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ee865908-f349-4264-be71-9205a30ba834 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:11.658672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ee865908-f349-4264-be71-9205a30ba834 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:11.660210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ee865908-f349-4264-be71-9205a30ba834 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:11.691421 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ee865908-f349-4264-be71-9205a30ba834 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.902460 Aug 29 15:28:11.693313 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 447/854] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:10 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:11.705588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a4d3e86c-4789-4144-a42e-c31addd80e4e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:11.706528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a4d3e86c-4789-4144-a42e-c31addd80e4e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:11.745456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4d3e86c-4789-4144-a42e-c31addd80e4e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:11.756541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4d3e86c-4789-4144-a42e-c31addd80e4e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:11.757022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4d3e86c-4789-4144-a42e-c31addd80e4e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:11.757840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4d3e86c-4789-4144-a42e-c31addd80e4e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:11.758328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4d3e86c-4789-4144-a42e-c31addd80e4e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:11.758771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4d3e86c-4789-4144-a42e-c31addd80e4e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:12.381812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:28:12.383206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:28:12.384048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:28:12.384831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:28:12.386143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:28:12.395218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a4d3e86c-4789-4144-a42e-c31addd80e4e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:12.410786 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a4d3e86c-4789-4144-a42e-c31addd80e4e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1318 microversion: 2.1 time: 0.715850 Aug 29 15:28:12.411034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:12.411386 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 448/855] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:11 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1318 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:12.412367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:12.412831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:12.416811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:12.417613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:12.418477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:12.422830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-97e7181d-f355-4bb7-a57e-ebc8280ee245 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bb87700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:12.488061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Getting quotas for project 31544ac2992c46aa8fecdff53a43ae42. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:12.501334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Getting quotas for user 498e44c8a15f451ba8ff39eff4156075 and project 31544ac2992c46aa8fecdff53a43ae42. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:12.547627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:28:12.555765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:28:12.706971 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1218e818-ea1a-478c-a383-d89d348e6e9e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.035681 Aug 29 15:28:12.708260 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 408/856] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:28:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:28:12.722527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e264ec1a-dac8-44d1-abc5-c8190be9c9d4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:12.726621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e264ec1a-dac8-44d1-abc5-c8190be9c9d4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:12.753285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e264ec1a-dac8-44d1-abc5-c8190be9c9d4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:12.753635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e264ec1a-dac8-44d1-abc5-c8190be9c9d4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:12.754093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e264ec1a-dac8-44d1-abc5-c8190be9c9d4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:12.754827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e264ec1a-dac8-44d1-abc5-c8190be9c9d4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:12.755291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e264ec1a-dac8-44d1-abc5-c8190be9c9d4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:12.755726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e264ec1a-dac8-44d1-abc5-c8190be9c9d4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:13.742616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e264ec1a-dac8-44d1-abc5-c8190be9c9d4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:13.765506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e264ec1a-dac8-44d1-abc5-c8190be9c9d4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:13.767709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e264ec1a-dac8-44d1-abc5-c8190be9c9d4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:13.770487 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e264ec1a-dac8-44d1-abc5-c8190be9c9d4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 1.059665 Aug 29 15:28:13.772610 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 409/857] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:12 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:13.790670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-31e3ff2b-2b2e-4caf-89ea-efcfbbf22143 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:13.791406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-31e3ff2b-2b2e-4caf-89ea-efcfbbf22143 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:14.032587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-31e3ff2b-2b2e-4caf-89ea-efcfbbf22143 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:14.044727 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-31e3ff2b-2b2e-4caf-89ea-efcfbbf22143 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1209 microversion: 2.1 time: 0.267683 Aug 29 15:28:14.046497 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 410/858] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:13 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1209 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:14.060408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d6050247-7444-4f1e-96db-2f61204dcc41 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:14.063903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d6050247-7444-4f1e-96db-2f61204dcc41 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:14.106091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6050247-7444-4f1e-96db-2f61204dcc41 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:14.112034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6050247-7444-4f1e-96db-2f61204dcc41 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:14.113592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6050247-7444-4f1e-96db-2f61204dcc41 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:14.118102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6050247-7444-4f1e-96db-2f61204dcc41 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:14.122337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6050247-7444-4f1e-96db-2f61204dcc41 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:14.126425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6050247-7444-4f1e-96db-2f61204dcc41 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:14.423525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d6050247-7444-4f1e-96db-2f61204dcc41 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:14.442776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d6050247-7444-4f1e-96db-2f61204dcc41 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:14.444857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d6050247-7444-4f1e-96db-2f61204dcc41 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:14.473660 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d6050247-7444-4f1e-96db-2f61204dcc41 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.425044 Aug 29 15:28:14.497721 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 411/859] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:14 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:14.497721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5e33944f-e813-4d17-98ed-e89fecee37a3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:14.497721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5e33944f-e813-4d17-98ed-e89fecee37a3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:14.515364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e33944f-e813-4d17-98ed-e89fecee37a3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:14.516353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e33944f-e813-4d17-98ed-e89fecee37a3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:14.517489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e33944f-e813-4d17-98ed-e89fecee37a3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:14.524549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e33944f-e813-4d17-98ed-e89fecee37a3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:14.526713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e33944f-e813-4d17-98ed-e89fecee37a3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:14.527526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e33944f-e813-4d17-98ed-e89fecee37a3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:15.127702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e33944f-e813-4d17-98ed-e89fecee37a3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:15.140892 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5e33944f-e813-4d17-98ed-e89fecee37a3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1318 microversion: 2.1 time: 0.665358 Aug 29 15:28:15.154276 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 412/860] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:14 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:15.160364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9c363813-1b69-4558-802d-d671a4be939a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:15.160980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9c363813-1b69-4558-802d-d671a4be939a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:15.168024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c363813-1b69-4558-802d-d671a4be939a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:15.168781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c363813-1b69-4558-802d-d671a4be939a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:15.169463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c363813-1b69-4558-802d-d671a4be939a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:15.170388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c363813-1b69-4558-802d-d671a4be939a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:15.171011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c363813-1b69-4558-802d-d671a4be939a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:15.171587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c363813-1b69-4558-802d-d671a4be939a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:15.435960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9c363813-1b69-4558-802d-d671a4be939a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:15.446371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9c363813-1b69-4558-802d-d671a4be939a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:15.450214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9c363813-1b69-4558-802d-d671a4be939a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:15.452142 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9c363813-1b69-4558-802d-d671a4be939a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.296825 Aug 29 15:28:15.462315 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 413/861] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:15 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:15.476350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-93a8fa7f-faf2-4ba0-b60e-2c4777b281ba tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:15.477313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-93a8fa7f-faf2-4ba0-b60e-2c4777b281ba tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:15.485137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93a8fa7f-faf2-4ba0-b60e-2c4777b281ba tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:15.486004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93a8fa7f-faf2-4ba0-b60e-2c4777b281ba tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:15.486615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93a8fa7f-faf2-4ba0-b60e-2c4777b281ba tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:15.487530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93a8fa7f-faf2-4ba0-b60e-2c4777b281ba tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:15.488131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93a8fa7f-faf2-4ba0-b60e-2c4777b281ba tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:15.488687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93a8fa7f-faf2-4ba0-b60e-2c4777b281ba tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:15.601029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-93a8fa7f-faf2-4ba0-b60e-2c4777b281ba tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:15.616116 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-93a8fa7f-faf2-4ba0-b60e-2c4777b281ba tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1261 microversion: 2.1 time: 0.145269 Aug 29 15:28:15.616902 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 414/862] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:15 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:16.050787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-269da465-e5db-44b9-b8c5-5de0cf12199a tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Action: 'create', calling method: .version_select at 0x7fc42bc9b310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1796206944", "description": "tempest-description-977903925"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:17.394016 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-269da465-e5db-44b9-b8c5-5de0cf12199a tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.775825 Aug 29 15:28:17.410183 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 415/863] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:28:15 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:17.425953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b58c3752-2962-40b5-9793-badce9a27a54 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:17.427267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b58c3752-2962-40b5-9793-badce9a27a54 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:17.476879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b58c3752-2962-40b5-9793-badce9a27a54 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:17.477410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b58c3752-2962-40b5-9793-badce9a27a54 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:17.477865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b58c3752-2962-40b5-9793-badce9a27a54 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:17.494999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b58c3752-2962-40b5-9793-badce9a27a54 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:17.497527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b58c3752-2962-40b5-9793-badce9a27a54 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:17.498039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b58c3752-2962-40b5-9793-badce9a27a54 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:17.758786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b58c3752-2962-40b5-9793-badce9a27a54 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:17.768647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b58c3752-2962-40b5-9793-badce9a27a54 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:17.784425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b58c3752-2962-40b5-9793-badce9a27a54 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:17.806929 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b58c3752-2962-40b5-9793-badce9a27a54 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.395225 Aug 29 15:28:17.807533 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 416/864] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:17 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:17.854204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fd51c72f-9169-4009-849d-ce49b7c48dee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:17.854830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fd51c72f-9169-4009-849d-ce49b7c48dee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:17.879963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd51c72f-9169-4009-849d-ce49b7c48dee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:17.885808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd51c72f-9169-4009-849d-ce49b7c48dee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:17.888911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd51c72f-9169-4009-849d-ce49b7c48dee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:17.889902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd51c72f-9169-4009-849d-ce49b7c48dee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:17.893812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd51c72f-9169-4009-849d-ce49b7c48dee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:17.896989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd51c72f-9169-4009-849d-ce49b7c48dee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:18.351791 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-97e7181d-f355-4bb7-a57e-ebc8280ee245 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 5.938057 Aug 29 15:28:18.352439 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 449/865] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:12 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 5940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:18.365947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5d7d6831-2423-4142-85d2-990932975f20 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:18.366594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5d7d6831-2423-4142-85d2-990932975f20 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:18.393294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:18.395839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7d6831-2423-4142-85d2-990932975f20 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:18.396390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7d6831-2423-4142-85d2-990932975f20 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:18.396881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7d6831-2423-4142-85d2-990932975f20 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:18.409527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7d6831-2423-4142-85d2-990932975f20 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:18.410046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7d6831-2423-4142-85d2-990932975f20 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:18.410499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7d6831-2423-4142-85d2-990932975f20 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:18.443506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd51c72f-9169-4009-849d-ce49b7c48dee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:18.455335 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fd51c72f-9169-4009-849d-ce49b7c48dee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1318 microversion: 2.1 time: 0.646609 Aug 29 15:28:18.463318 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 417/866] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:17 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:18.468527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2f2f173a-60cf-4252-9277-76ff5a83061e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:18.469458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2f2f173a-60cf-4252-9277-76ff5a83061e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:18.480068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f2f173a-60cf-4252-9277-76ff5a83061e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:18.482901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f2f173a-60cf-4252-9277-76ff5a83061e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:18.483748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f2f173a-60cf-4252-9277-76ff5a83061e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:18.484815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f2f173a-60cf-4252-9277-76ff5a83061e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:18.485572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f2f173a-60cf-4252-9277-76ff5a83061e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:18.486217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f2f173a-60cf-4252-9277-76ff5a83061e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:18.586538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2f2f173a-60cf-4252-9277-76ff5a83061e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:18.599326 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2f2f173a-60cf-4252-9277-76ff5a83061e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1267 microversion: 2.1 time: 0.134421 Aug 29 15:28:18.600321 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 418/867] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:18 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1267 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:18.608763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-be3a7b7f-68a2-4eb6-9b13-a84c92523e80 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Action: 'create', calling method: .version_select at 0x7fc42bfab670>, body: {"security_group_rule": {"parent_group_id": "cbb5e058-7f01-4ad3-99eb-8db5bac3bfd4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:18.957429 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-be3a7b7f-68a2-4eb6-9b13-a84c92523e80 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.352649 Aug 29 15:28:18.958313 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 419/868] 10.222.0.62 () {60 vars in 1195 bytes} [Mon Aug 29 15:28:18 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:18.966419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d5dfa16-39aa-4984-8946-e56f15a6b412 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:18.967067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2d5dfa16-39aa-4984-8946-e56f15a6b412 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:18.986117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5dfa16-39aa-4984-8946-e56f15a6b412 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:18.986619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5dfa16-39aa-4984-8946-e56f15a6b412 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:18.987103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5dfa16-39aa-4984-8946-e56f15a6b412 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:18.991142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5dfa16-39aa-4984-8946-e56f15a6b412 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:18.993178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5dfa16-39aa-4984-8946-e56f15a6b412 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:18.993769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5dfa16-39aa-4984-8946-e56f15a6b412 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:19.070720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5d7d6831-2423-4142-85d2-990932975f20 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:19.090433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5d7d6831-2423-4142-85d2-990932975f20 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:19.091909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5d7d6831-2423-4142-85d2-990932975f20 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:19.119914 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5d7d6831-2423-4142-85d2-990932975f20 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.762531 Aug 29 15:28:19.125804 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 450/869] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:18 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:19.152384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-32a18174-4956-4a83-a4bb-694589c6b67b tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Action: 'create', calling method: .version_select at 0x7fc42bad1a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-928419594", "description": "tempest-description-1745341003"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:19.213147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d5dfa16-39aa-4984-8946-e56f15a6b412 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:19.237824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d5dfa16-39aa-4984-8946-e56f15a6b412 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:19.239711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d5dfa16-39aa-4984-8946-e56f15a6b412 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:19.247069 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d5dfa16-39aa-4984-8946-e56f15a6b412 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.287693 Aug 29 15:28:19.248253 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 420/870] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:18 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:19.298878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-00d7ebf4-cda3-495b-b754-dc93d72da24e req-3af72023-5145-4b78-8719-48877c64d3de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf46166-597d-4649-a09a-600d8c57524d", "name": "network-vif-unplugged", "status": "completed", "tag": "fb9190f9-2a49-4198-bf76-f097d8ef044f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:19.337120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-00d7ebf4-cda3-495b-b754-dc93d72da24e req-3af72023-5145-4b78-8719-48877c64d3de service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:19.337631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-00d7ebf4-cda3-495b-b754-dc93d72da24e req-3af72023-5145-4b78-8719-48877c64d3de service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:19.340555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-00d7ebf4-cda3-495b-b754-dc93d72da24e req-3af72023-5145-4b78-8719-48877c64d3de service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:19.408738 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-00d7ebf4-cda3-495b-b754-dc93d72da24e req-3af72023-5145-4b78-8719-48877c64d3de service nova] Creating event network-vif-unplugged:fb9190f9-2a49-4198-bf76-f097d8ef044f for instance 4cf46166-597d-4649-a09a-600d8c57524d on n-h1-839401-11 Aug 29 15:28:19.431086 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-00d7ebf4-cda3-495b-b754-dc93d72da24e req-3af72023-5145-4b78-8719-48877c64d3de service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134561 Aug 29 15:28:19.437229 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 421/871] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:28:19.466210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2e06bca6-e956-4856-8411-c514ebf868f1 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bc54ca0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:19.570649 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2e06bca6-e956-4856-8411-c514ebf868f1 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1421 microversion: 2.1 time: 0.130796 Aug 29 15:28:19.577842 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 422/872] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:19 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1421 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:19.580863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0a528614-e20b-4b01-9528-00566f6a0038 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:19.583510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0a528614-e20b-4b01-9528-00566f6a0038 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:19.613460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a528614-e20b-4b01-9528-00566f6a0038 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:19.616423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a528614-e20b-4b01-9528-00566f6a0038 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:19.621118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a528614-e20b-4b01-9528-00566f6a0038 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:19.622853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a528614-e20b-4b01-9528-00566f6a0038 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:19.625984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a528614-e20b-4b01-9528-00566f6a0038 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:19.629608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a528614-e20b-4b01-9528-00566f6a0038 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:19.940094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0a528614-e20b-4b01-9528-00566f6a0038 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:19.967663 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0a528614-e20b-4b01-9528-00566f6a0038 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1318 microversion: 2.1 time: 0.394751 Aug 29 15:28:19.968869 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 423/873] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:19 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:19.974175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1cb5b72d-e8f6-4d83-a7bf-81a8dc67d78d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:19.974820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1cb5b72d-e8f6-4d83-a7bf-81a8dc67d78d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:19.985405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cb5b72d-e8f6-4d83-a7bf-81a8dc67d78d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:19.985954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cb5b72d-e8f6-4d83-a7bf-81a8dc67d78d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:19.986398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cb5b72d-e8f6-4d83-a7bf-81a8dc67d78d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:19.987153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cb5b72d-e8f6-4d83-a7bf-81a8dc67d78d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:19.987619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cb5b72d-e8f6-4d83-a7bf-81a8dc67d78d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:19.988368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cb5b72d-e8f6-4d83-a7bf-81a8dc67d78d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:20.331988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1cb5b72d-e8f6-4d83-a7bf-81a8dc67d78d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:20.344052 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1cb5b72d-e8f6-4d83-a7bf-81a8dc67d78d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1309 microversion: 2.1 time: 0.373581 Aug 29 15:28:20.345298 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 424/874] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:19 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1309 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:20.350873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5f614c88-acd6-47b3-ab44-9d84a59da06a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:20.351680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5f614c88-acd6-47b3-ab44-9d84a59da06a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:20.359227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f614c88-acd6-47b3-ab44-9d84a59da06a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:20.360258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f614c88-acd6-47b3-ab44-9d84a59da06a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:20.360905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f614c88-acd6-47b3-ab44-9d84a59da06a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:20.361837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f614c88-acd6-47b3-ab44-9d84a59da06a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:20.362428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f614c88-acd6-47b3-ab44-9d84a59da06a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:20.363259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f614c88-acd6-47b3-ab44-9d84a59da06a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:20.727108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5f614c88-acd6-47b3-ab44-9d84a59da06a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:20.733891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:20.752576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5f614c88-acd6-47b3-ab44-9d84a59da06a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:20.754805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5f614c88-acd6-47b3-ab44-9d84a59da06a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:20.763185 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5f614c88-acd6-47b3-ab44-9d84a59da06a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.416424 Aug 29 15:28:20.775679 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 425/875] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:20 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:20.782694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-66af6c62-2d76-426d-808e-a003bb34b116 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:20.783600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-66af6c62-2d76-426d-808e-a003bb34b116 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:20.790853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66af6c62-2d76-426d-808e-a003bb34b116 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:20.791620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66af6c62-2d76-426d-808e-a003bb34b116 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:20.792658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66af6c62-2d76-426d-808e-a003bb34b116 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:20.793644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66af6c62-2d76-426d-808e-a003bb34b116 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:20.794307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66af6c62-2d76-426d-808e-a003bb34b116 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:20.795166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66af6c62-2d76-426d-808e-a003bb34b116 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:20.885737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-66af6c62-2d76-426d-808e-a003bb34b116 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:20.896014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-66af6c62-2d76-426d-808e-a003bb34b116 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:20.897664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-66af6c62-2d76-426d-808e-a003bb34b116 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:20.910018 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-66af6c62-2d76-426d-808e-a003bb34b116 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.129596 Aug 29 15:28:20.920462 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 426/876] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:20 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:20.920462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-3e65e6b7-a305-4207-89a0-fe62eadf1608 req-265f93eb-e431-4c12-a664-d358b74516fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "789a7b2e-44e3-453f-9ee3-0656d92773f6", "name": "network-vif-plugged", "status": "completed", "tag": "b927a394-a17e-4e31-89a0-4093856ef8a5"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:20.930159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3e65e6b7-a305-4207-89a0-fe62eadf1608 req-265f93eb-e431-4c12-a664-d358b74516fc service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:20.930665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3e65e6b7-a305-4207-89a0-fe62eadf1608 req-265f93eb-e431-4c12-a664-d358b74516fc service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:20.937126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3e65e6b7-a305-4207-89a0-fe62eadf1608 req-265f93eb-e431-4c12-a664-d358b74516fc service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:20.952021 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-3e65e6b7-a305-4207-89a0-fe62eadf1608 req-265f93eb-e431-4c12-a664-d358b74516fc service nova] Creating event network-vif-plugged:b927a394-a17e-4e31-89a0-4093856ef8a5 for instance 789a7b2e-44e3-453f-9ee3-0656d92773f6 on n-h1-839401-11 Aug 29 15:28:20.961943 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-3e65e6b7-a305-4207-89a0-fe62eadf1608 req-265f93eb-e431-4c12-a664-d358b74516fc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049357 Aug 29 15:28:20.963077 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 427/877] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:20.968871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f73d2ed5-8100-4eee-a3f8-5202ae8d8b73 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc430189280>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:21.040474 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f73d2ed5-8100-4eee-a3f8-5202ae8d8b73 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1430 microversion: 2.1 time: 0.076062 Aug 29 15:28:21.052849 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 428/878] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:20 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1430 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:21.061814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d69ad187-f57e-46a7-8dd2-5d09d5d55d2d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:21.071414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d69ad187-f57e-46a7-8dd2-5d09d5d55d2d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:21.079376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d69ad187-f57e-46a7-8dd2-5d09d5d55d2d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.079993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d69ad187-f57e-46a7-8dd2-5d09d5d55d2d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.085355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d69ad187-f57e-46a7-8dd2-5d09d5d55d2d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.086542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d69ad187-f57e-46a7-8dd2-5d09d5d55d2d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.087041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d69ad187-f57e-46a7-8dd2-5d09d5d55d2d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.087546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d69ad187-f57e-46a7-8dd2-5d09d5d55d2d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.390609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d69ad187-f57e-46a7-8dd2-5d09d5d55d2d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:21.403750 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d69ad187-f57e-46a7-8dd2-5d09d5d55d2d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1318 microversion: 2.1 time: 0.349370 Aug 29 15:28:21.409115 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 429/879] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:21 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:21.410225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fc918412-6062-4796-aad7-ecd710a201ab tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc430525ca0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:21.481346 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fc918412-6062-4796-aad7-ecd710a201ab tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 200 len: 1430 microversion: 2.1 time: 0.074693 Aug 29 15:28:21.482544 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 430/880] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:21 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 1430 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:21.488099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-020b2567-897a-4577-95cc-797b9fc99f52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:21.488882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-020b2567-897a-4577-95cc-797b9fc99f52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:21.497425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-020b2567-897a-4577-95cc-797b9fc99f52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.498208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-020b2567-897a-4577-95cc-797b9fc99f52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.498821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-020b2567-897a-4577-95cc-797b9fc99f52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.499846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-020b2567-897a-4577-95cc-797b9fc99f52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.500472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-020b2567-897a-4577-95cc-797b9fc99f52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.501052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-020b2567-897a-4577-95cc-797b9fc99f52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.596686 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-32a18174-4956-4a83-a4bb-694589c6b67b tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.469467 Aug 29 15:28:21.598032 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 451/881] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:28:19 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:21.603009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cec1ab5d-8e7f-4985-b869-2cfbb30be826 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:21.603623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cec1ab5d-8e7f-4985-b869-2cfbb30be826 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:21.626947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cec1ab5d-8e7f-4985-b869-2cfbb30be826 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.627484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cec1ab5d-8e7f-4985-b869-2cfbb30be826 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.628288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cec1ab5d-8e7f-4985-b869-2cfbb30be826 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.629382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cec1ab5d-8e7f-4985-b869-2cfbb30be826 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.630032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cec1ab5d-8e7f-4985-b869-2cfbb30be826 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.630624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cec1ab5d-8e7f-4985-b869-2cfbb30be826 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.727055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-020b2567-897a-4577-95cc-797b9fc99f52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:21.736848 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-020b2567-897a-4577-95cc-797b9fc99f52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1309 microversion: 2.1 time: 0.252993 Aug 29 15:28:21.738668 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 431/882] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:21 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1309 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:21.744033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-90d38984-2985-443b-853e-fb8c84be1818 req-84e2ce05-6984-4342-9d9a-2189f2f55010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf46166-597d-4649-a09a-600d8c57524d", "tag": "fb9190f9-2a49-4198-bf76-f097d8ef044f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:21.781189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-90d38984-2985-443b-853e-fb8c84be1818 req-84e2ce05-6984-4342-9d9a-2189f2f55010 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:21.781699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-90d38984-2985-443b-853e-fb8c84be1818 req-84e2ce05-6984-4342-9d9a-2189f2f55010 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:21.782285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-90d38984-2985-443b-853e-fb8c84be1818 req-84e2ce05-6984-4342-9d9a-2189f2f55010 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:21.814527 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-90d38984-2985-443b-853e-fb8c84be1818 req-84e2ce05-6984-4342-9d9a-2189f2f55010 service nova] Creating event network-changed:fb9190f9-2a49-4198-bf76-f097d8ef044f for instance 4cf46166-597d-4649-a09a-600d8c57524d on n-h1-839401-11 Aug 29 15:28:21.823589 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-90d38984-2985-443b-853e-fb8c84be1818 req-84e2ce05-6984-4342-9d9a-2189f2f55010 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083360 Aug 29 15:28:21.824399 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 432/883] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:21.838864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9796fb4b-ec51-4edf-a0ac-d167c9696e6d tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Action: 'create', calling method: .version_select at 0x7fc42bdc1c10>, body: {"security_group_rule": {"parent_group_id": "51e7c2f1-19bf-4f6b-832a-4b7510a06b27", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:22.069421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cec1ab5d-8e7f-4985-b869-2cfbb30be826 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:22.080692 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cec1ab5d-8e7f-4985-b869-2cfbb30be826 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1466 microversion: 2.1 time: 0.481175 Aug 29 15:28:22.084197 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 452/884] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:21 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1466 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:22.092757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ceabed42-0834-4f30-b2a6-3498e7753edd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:22.093724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ceabed42-0834-4f30-b2a6-3498e7753edd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:22.106500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ceabed42-0834-4f30-b2a6-3498e7753edd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.114380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ceabed42-0834-4f30-b2a6-3498e7753edd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.118595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ceabed42-0834-4f30-b2a6-3498e7753edd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.122006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ceabed42-0834-4f30-b2a6-3498e7753edd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.122646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ceabed42-0834-4f30-b2a6-3498e7753edd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.122954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ceabed42-0834-4f30-b2a6-3498e7753edd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.237663 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9796fb4b-ec51-4edf-a0ac-d167c9696e6d tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.408649 Aug 29 15:28:22.238287 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 433/885] 10.222.0.62 () {60 vars in 1195 bytes} [Mon Aug 29 15:28:21 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:22.243323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-217119d0-6d64-451f-8494-fa2a7f9cd1a8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:22.244401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-217119d0-6d64-451f-8494-fa2a7f9cd1a8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:22.257012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-217119d0-6d64-451f-8494-fa2a7f9cd1a8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.258072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-217119d0-6d64-451f-8494-fa2a7f9cd1a8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.258700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-217119d0-6d64-451f-8494-fa2a7f9cd1a8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.259919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-217119d0-6d64-451f-8494-fa2a7f9cd1a8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.260616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-217119d0-6d64-451f-8494-fa2a7f9cd1a8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.261815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-217119d0-6d64-451f-8494-fa2a7f9cd1a8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.350640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-217119d0-6d64-451f-8494-fa2a7f9cd1a8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:22.365933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-217119d0-6d64-451f-8494-fa2a7f9cd1a8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:22.378538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-217119d0-6d64-451f-8494-fa2a7f9cd1a8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:22.378538 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-217119d0-6d64-451f-8494-fa2a7f9cd1a8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.135845 Aug 29 15:28:22.396024 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 434/886] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:22 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:22.420889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c8fdc6d6-7483-4a3c-a7ad-0b6a97a81bfd tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc43012e700>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:22.457549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:22.496753 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c8fdc6d6-7483-4a3c-a7ad-0b6a97a81bfd tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/2c042d4c-e5f7-47c3-ac9e-1fb093df192c" status: 200 len: 784 microversion: 2.1 time: 0.089381 Aug 29 15:28:22.498687 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 435/887] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:22 2022] GET /compute/v2.1/images/2c042d4c-e5f7-47c3-ac9e-1fb093df192c => generated 784 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:22.517391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fc95ef14-987d-43a2-bff8-65d920286f83 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Action: 'create', calling method: .version_select at 0x7fc43009d9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-493156404", "description": "tempest-description-92166783"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:22.538518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ceabed42-0834-4f30-b2a6-3498e7753edd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:22.556336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ceabed42-0834-4f30-b2a6-3498e7753edd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:22.581366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ceabed42-0834-4f30-b2a6-3498e7753edd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:22.583624 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ceabed42-0834-4f30-b2a6-3498e7753edd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.497322 Aug 29 15:28:22.586639 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 453/888] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:22 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:22.604089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ed6b0258-8cd1-429d-a626-0bdf8c386cb2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:22.606962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ed6b0258-8cd1-429d-a626-0bdf8c386cb2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:22.624276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed6b0258-8cd1-429d-a626-0bdf8c386cb2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.626059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed6b0258-8cd1-429d-a626-0bdf8c386cb2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.627167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed6b0258-8cd1-429d-a626-0bdf8c386cb2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.628224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed6b0258-8cd1-429d-a626-0bdf8c386cb2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.630401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed6b0258-8cd1-429d-a626-0bdf8c386cb2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.631704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed6b0258-8cd1-429d-a626-0bdf8c386cb2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.862605 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fc95ef14-987d-43a2-bff8-65d920286f83 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.362185 Aug 29 15:28:22.864803 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 436/889] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:28:22 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:22.871411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2bbd4386-f655-42df-8c84-c893f5e762cf tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:22.920671 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2bbd4386-f655-42df-8c84-c893f5e762cf tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.054212 Aug 29 15:28:22.924292 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 437/890] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:28:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:22.930651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eb8e6b03-eeae-4f19-98e2-807240597b32 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:22.932393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eb8e6b03-eeae-4f19-98e2-807240597b32 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:22.954691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb8e6b03-eeae-4f19-98e2-807240597b32 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.961337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb8e6b03-eeae-4f19-98e2-807240597b32 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.962429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb8e6b03-eeae-4f19-98e2-807240597b32 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.963425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb8e6b03-eeae-4f19-98e2-807240597b32 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:22.964058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb8e6b03-eeae-4f19-98e2-807240597b32 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:22.964812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb8e6b03-eeae-4f19-98e2-807240597b32 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:22.981043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ed6b0258-8cd1-429d-a626-0bdf8c386cb2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:23.011881 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ed6b0258-8cd1-429d-a626-0bdf8c386cb2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1318 microversion: 2.1 time: 0.413352 Aug 29 15:28:23.026355 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 454/891] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:22 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:23.038815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-953884da-0938-4435-ad9f-f5dbf94ac8b3 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Action: 'create', calling method: .version_select at 0x7fc42bc123a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1469507855", "description": "tempest-description-1427258932"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:23.375911 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-953884da-0938-4435-ad9f-f5dbf94ac8b3 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.347736 Aug 29 15:28:23.384372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eb8e6b03-eeae-4f19-98e2-807240597b32 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:23.391733 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eb8e6b03-eeae-4f19-98e2-807240597b32 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1309 microversion: 2.1 time: 0.465531 Aug 29 15:28:23.392709 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 438/892] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:22 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1309 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:23.400916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6dd2c988-b8c4-41df-9571-46989515a6fa tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc43013a8b0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:23.402362 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 455/893] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:28:23 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:23.430612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f05ee04a-847b-42e1-bb3c-f1fb8513c77b req-aeaa9b38-5e2a-4aa9-adeb-148da072e04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340bdcfa-c954-4f51-941a-c4324800f6d8", "name": "network-vif-plugged", "status": "completed", "tag": "641712b3-932e-44d2-85a3-694a0a38de21"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:23.467151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f05ee04a-847b-42e1-bb3c-f1fb8513c77b req-aeaa9b38-5e2a-4aa9-adeb-148da072e04a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:23.472393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f05ee04a-847b-42e1-bb3c-f1fb8513c77b req-aeaa9b38-5e2a-4aa9-adeb-148da072e04a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:23.476581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f05ee04a-847b-42e1-bb3c-f1fb8513c77b req-aeaa9b38-5e2a-4aa9-adeb-148da072e04a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:23.510629 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f05ee04a-847b-42e1-bb3c-f1fb8513c77b req-aeaa9b38-5e2a-4aa9-adeb-148da072e04a service nova] Creating event network-vif-plugged:641712b3-932e-44d2-85a3-694a0a38de21 for instance 340bdcfa-c954-4f51-941a-c4324800f6d8 on n-h2-839401-11 Aug 29 15:28:23.521608 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f05ee04a-847b-42e1-bb3c-f1fb8513c77b req-aeaa9b38-5e2a-4aa9-adeb-148da072e04a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116328 Aug 29 15:28:23.536671 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 456/894] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:23.547742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ac0d84ae-fc3f-423a-a3e0-fef4f02bd84b tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Action: 'create', calling method: .version_select at 0x7fc4300b1d30>, body: {"security_group_rule": {"parent_group_id": "fd05e2db-4a20-4520-af20-28ae7f761acb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "bc32fc9d-f659-423f-b1ee-a0439acf9439"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:24.038149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:24.272964 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ac0d84ae-fc3f-423a-a3e0-fef4f02bd84b tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.734706 Aug 29 15:28:24.274361 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 457/895] 10.222.0.62 () {60 vars in 1195 bytes} [Mon Aug 29 15:28:23 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:24.285998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d33a6361-240f-4367-b987-e35f69c53f5c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:24.286986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d33a6361-240f-4367-b987-e35f69c53f5c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:24.303197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d33a6361-240f-4367-b987-e35f69c53f5c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.305253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d33a6361-240f-4367-b987-e35f69c53f5c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.305698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d33a6361-240f-4367-b987-e35f69c53f5c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.306416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d33a6361-240f-4367-b987-e35f69c53f5c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.306885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d33a6361-240f-4367-b987-e35f69c53f5c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.307485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d33a6361-240f-4367-b987-e35f69c53f5c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.347345 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6dd2c988-b8c4-41df-9571-46989515a6fa tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "DELETE /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 204 len: 0 microversion: 2.1 time: 0.953254 Aug 29 15:28:24.348146 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 439/896] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:23 2022] DELETE /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 0 bytes in 955 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:28:24.353280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4c9bfa14-cd66-4b42-9599-3d7eefa4f769 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:24.354163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4c9bfa14-cd66-4b42-9599-3d7eefa4f769 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:24.360976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c9bfa14-cd66-4b42-9599-3d7eefa4f769 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.361737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c9bfa14-cd66-4b42-9599-3d7eefa4f769 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.362373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c9bfa14-cd66-4b42-9599-3d7eefa4f769 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.363251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c9bfa14-cd66-4b42-9599-3d7eefa4f769 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.363866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c9bfa14-cd66-4b42-9599-3d7eefa4f769 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.364453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c9bfa14-cd66-4b42-9599-3d7eefa4f769 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.407051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d33a6361-240f-4367-b987-e35f69c53f5c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:24.417561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d33a6361-240f-4367-b987-e35f69c53f5c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:24.419539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d33a6361-240f-4367-b987-e35f69c53f5c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:24.425787 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d33a6361-240f-4367-b987-e35f69c53f5c tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.149824 Aug 29 15:28:24.427389 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 458/897] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:24 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:24.432699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-593d60f7-4e0f-4732-b3d8-72d1bea03eb0 req-fc79e460-816f-4a13-a6b4-d68395094b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b00ee0c9-6348-4a38-a096-53fcbded92c7", "tag": "fc2e3960-31a2-4784-b5a4-edc91e5a8f77"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:24.447632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-593d60f7-4e0f-4732-b3d8-72d1bea03eb0 req-fc79e460-816f-4a13-a6b4-d68395094b0f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.448615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-593d60f7-4e0f-4732-b3d8-72d1bea03eb0 req-fc79e460-816f-4a13-a6b4-d68395094b0f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.450765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-593d60f7-4e0f-4732-b3d8-72d1bea03eb0 req-fc79e460-816f-4a13-a6b4-d68395094b0f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.466886 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-593d60f7-4e0f-4732-b3d8-72d1bea03eb0 req-fc79e460-816f-4a13-a6b4-d68395094b0f service nova] Creating event network-changed:fc2e3960-31a2-4784-b5a4-edc91e5a8f77 for instance b00ee0c9-6348-4a38-a096-53fcbded92c7 on n-h1-839401-11 Aug 29 15:28:24.472917 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-593d60f7-4e0f-4732-b3d8-72d1bea03eb0 req-fc79e460-816f-4a13-a6b4-d68395094b0f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044119 Aug 29 15:28:24.474221 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 459/898] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:24.482058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dec8f728-78d9-4c9f-bc13-a5e8df7e883a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:24.483115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dec8f728-78d9-4c9f-bc13-a5e8df7e883a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:24.490193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dec8f728-78d9-4c9f-bc13-a5e8df7e883a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.491186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dec8f728-78d9-4c9f-bc13-a5e8df7e883a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.491849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dec8f728-78d9-4c9f-bc13-a5e8df7e883a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.492805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dec8f728-78d9-4c9f-bc13-a5e8df7e883a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.493740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dec8f728-78d9-4c9f-bc13-a5e8df7e883a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.495154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dec8f728-78d9-4c9f-bc13-a5e8df7e883a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.532507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4c9bfa14-cd66-4b42-9599-3d7eefa4f769 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:24.542831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4c9bfa14-cd66-4b42-9599-3d7eefa4f769 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:24.544898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4c9bfa14-cd66-4b42-9599-3d7eefa4f769 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:24.546353 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4c9bfa14-cd66-4b42-9599-3d7eefa4f769 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.196979 Aug 29 15:28:24.547138 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 440/899] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:24 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:24.552630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-042b608d-3d4c-4c7b-b18f-736258ecaf89 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Action: 'create', calling method: .version_select at 0x7fc42bdc7ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-298996426", "description": "tempest-description-369688364"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:24.693778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dec8f728-78d9-4c9f-bc13-a5e8df7e883a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:24.704731 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dec8f728-78d9-4c9f-bc13-a5e8df7e883a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1466 microversion: 2.1 time: 0.227460 Aug 29 15:28:24.713566 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-042b608d-3d4c-4c7b-b18f-736258ecaf89 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.162899 Aug 29 15:28:24.714662 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 441/900] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:28:24 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:24.726256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-84c1f0eb-38ab-45c2-b663-9176c47bdb9e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc4300e2c10>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:24.731524 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 460/901] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:24 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1466 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:24.737001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-601068d1-4d9e-4cd3-ab21-655abc757889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:24.737854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-601068d1-4d9e-4cd3-ab21-655abc757889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:24.744718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601068d1-4d9e-4cd3-ab21-655abc757889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.745437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601068d1-4d9e-4cd3-ab21-655abc757889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.745959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601068d1-4d9e-4cd3-ab21-655abc757889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.746870 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-84c1f0eb-38ab-45c2-b663-9176c47bdb9e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] HTTP exception thrown: Image not found. Aug 29 15:28:24.746988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601068d1-4d9e-4cd3-ab21-655abc757889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.747426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601068d1-4d9e-4cd3-ab21-655abc757889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.747909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601068d1-4d9e-4cd3-ab21-655abc757889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-84c1f0eb-38ab-45c2-b663-9176c47bdb9e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Request method failure captured: Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b HTTP/1.1 Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNrU3pY8KEJeQ70V4Ew9UiAh-quHtjqVb-e-SqU-d9sNmeVy-bASVP11bcHjm1fQVMPxxGZYKInsaJOCSZK7Ho5GXKCMPjIIZTOM9IUPhzpxAevgUGvEJ1KtA9D88GZouhkSJrrnUx5vAo72Dp6hv34vbSYa6W2NhXV6f6U2jwkahaE Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: a902f071321a4216b4d17078181a61c6 Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesOneServerTestJSON-363047811 Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:28:24.768542 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:28:24.770260 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a902f071321a4216b4d17078181a61c6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a902f071321a4216b4d17078181a61c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a902f071321a4216b4d17078181a61c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a902f071321a4216b4d17078181a61c6"}]}] Aug 29 15:28:24.770260 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesOneServerTestJSON-363047811 Aug 29 15:28:24.770260 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: a902f071321a4216b4d17078181a61c6 Aug 29 15:28:24.770260 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-363047811 Aug 29 15:28:24.770260 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesOneServerTestJSON-363047811-project Aug 29 15:28:24.770260 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:28:24.770260 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:28:24.770260 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 72442d50b3f74cb6acdfba7eeebe2274 Aug 29 15:28:24.770260 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesOneServerTestJSON-363047811-project Aug 29 15:28:24.770260 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:28:24.770260 n-d-839401-11 devstack@n-api.service[122360]: exception: Image not found. Aug 29 15:28:24.770260 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'aacaee8d-8bbc-4153-928d-a6ddb42e4b4b'} Aug 29 15:28:24.770260 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:28:24.771193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID aacaee8d-8bbc-4153-928d-a6ddb42e4b4b Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:28:24.772384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aacaee8d-8bbc-4153-928d-a6ddb42e4b4b could not be found. Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:28:24.773721 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-84c1f0eb-38ab-45c2-b663-9176c47bdb9e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Returning 404 to user: Image not found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:24.775025 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-84c1f0eb-38ab-45c2-b663-9176c47bdb9e tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 404 len: 62 microversion: 2.1 time: 0.054597 Aug 29 15:28:24.778224 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 442/902] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:24 2022] GET /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:28:24.787178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-26f14f0b-9510-4c90-a048-b3a8fef2eef8 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Action: 'create', calling method: .version_select at 0x7fc42bc80c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1121756817", "description": "tempest-description-768495116"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:24.917792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-601068d1-4d9e-4cd3-ab21-655abc757889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:24.927921 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-601068d1-4d9e-4cd3-ab21-655abc757889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1309 microversion: 2.1 time: 0.194876 Aug 29 15:28:24.936960 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 461/903] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:24 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1309 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:24.943568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4282edcc-a429-47e0-bd87-f7f1dcdad07d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:24.945890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4282edcc-a429-47e0-bd87-f7f1dcdad07d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 340bdcfa-c954-4f51-941a-c4324800f6d8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:24.952788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4282edcc-a429-47e0-bd87-f7f1dcdad07d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.953681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4282edcc-a429-47e0-bd87-f7f1dcdad07d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.954301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4282edcc-a429-47e0-bd87-f7f1dcdad07d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.955191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4282edcc-a429-47e0-bd87-f7f1dcdad07d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.955794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4282edcc-a429-47e0-bd87-f7f1dcdad07d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.956415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4282edcc-a429-47e0-bd87-f7f1dcdad07d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.970711 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-26f14f0b-9510-4c90-a048-b3a8fef2eef8 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.189887 Aug 29 15:28:24.972082 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 443/904] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:28:24 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:24.977396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-88ea988f-ad5e-4646-a691-dc0846c295c6 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1018126264"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:24.981539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-88ea988f-ad5e-4646-a691-dc0846c295c6 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:24.989413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88ea988f-ad5e-4646-a691-dc0846c295c6 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.990801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88ea988f-ad5e-4646-a691-dc0846c295c6 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.991411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88ea988f-ad5e-4646-a691-dc0846c295c6 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:24.992458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88ea988f-ad5e-4646-a691-dc0846c295c6 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:24.993162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88ea988f-ad5e-4646-a691-dc0846c295c6 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:24.993925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88ea988f-ad5e-4646-a691-dc0846c295c6 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.148911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4282edcc-a429-47e0-bd87-f7f1dcdad07d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:25.158739 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4282edcc-a429-47e0-bd87-f7f1dcdad07d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8" status: 200 len: 1318 microversion: 2.1 time: 0.228714 Aug 29 15:28:25.159987 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 462/905] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:24 2022] GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:25.165431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-054e2ee1-2ba0-4917-8481-c399eac25a90 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Action: 'create', calling method: .version_select at 0x7fc4300759d0>, body: {"security_group_rule": {"parent_group_id": "94a3f229-5d6b-4f7e-924c-d3b782282b88", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "33fdd07b-4ee0-48af-9280-6b854ec1861c"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:25.233898 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-88ea988f-ad5e-4646-a691-dc0846c295c6 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "POST /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5/action" status: 202 len: 0 microversion: 2.1 time: 0.260309 Aug 29 15:28:25.234887 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 444/906] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:28:24 2022] POST /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:28:25.246555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2f728c18-643d-4f3e-905a-e083bb140e6b tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bc80040>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:25.306049 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2f728c18-643d-4f3e-905a-e083bb140e6b tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 0.063707 Aug 29 15:28:25.307379 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 445/907] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:25 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:25.462873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-73b8cb60-28d7-4b27-99d8-724bde47a0c3 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:25.464102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-73b8cb60-28d7-4b27-99d8-724bde47a0c3 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:25.481560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73b8cb60-28d7-4b27-99d8-724bde47a0c3 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.482418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73b8cb60-28d7-4b27-99d8-724bde47a0c3 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.483012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73b8cb60-28d7-4b27-99d8-724bde47a0c3 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.483914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73b8cb60-28d7-4b27-99d8-724bde47a0c3 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.484568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73b8cb60-28d7-4b27-99d8-724bde47a0c3 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.485188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73b8cb60-28d7-4b27-99d8-724bde47a0c3 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.500446 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-054e2ee1-2ba0-4917-8481-c399eac25a90 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.339119 Aug 29 15:28:25.501058 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 463/908] 10.222.0.62 () {60 vars in 1195 bytes} [Mon Aug 29 15:28:25 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:25.518957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eed198e8-a7b1-458e-b498-1fd2ed0fa951 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Calling method '.version_select at 0x7fc42bc123a0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:25.575742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-73b8cb60-28d7-4b27-99d8-724bde47a0c3 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:25.587166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-73b8cb60-28d7-4b27-99d8-724bde47a0c3 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:25.589349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-73b8cb60-28d7-4b27-99d8-724bde47a0c3 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:25.597188 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-73b8cb60-28d7-4b27-99d8-724bde47a0c3 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.139744 Aug 29 15:28:25.621060 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 446/909] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:25 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:25.633793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-790535ba-1931-471f-ad7f-60deb4d06ee1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:25.636168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-790535ba-1931-471f-ad7f-60deb4d06ee1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:25.649748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-790535ba-1931-471f-ad7f-60deb4d06ee1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.650479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-790535ba-1931-471f-ad7f-60deb4d06ee1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.651072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-790535ba-1931-471f-ad7f-60deb4d06ee1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.651966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-790535ba-1931-471f-ad7f-60deb4d06ee1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.652567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-790535ba-1931-471f-ad7f-60deb4d06ee1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.653176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-790535ba-1931-471f-ad7f-60deb4d06ee1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.853223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-790535ba-1931-471f-ad7f-60deb4d06ee1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:25.873811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-790535ba-1931-471f-ad7f-60deb4d06ee1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:25.876905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-790535ba-1931-471f-ad7f-60deb4d06ee1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:25.883970 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-790535ba-1931-471f-ad7f-60deb4d06ee1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.259418 Aug 29 15:28:25.884699 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 447/910] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:25 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:25.891000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a1079c4e-07aa-439c-b6f1-34e381bf85ec req-d93d644b-a4c0-40f7-b256-e448d231ab44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d3d180-599f-4c45-a0ea-53f2180484d5", "name": "network-vif-unplugged", "status": "completed", "tag": "a173d34f-0b58-4d2d-91dc-183ed4b4d4a6"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:25.908002 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eed198e8-a7b1-458e-b498-1fd2ed0fa951 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/33fdd07b-4ee0-48af-9280-6b854ec1861c" status: 202 len: 0 microversion: 2.1 time: 0.392257 Aug 29 15:28:25.910465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:25.912008 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 464/911] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:28:25 2022] DELETE /compute/v2.1/os-security-groups/33fdd07b-4ee0-48af-9280-6b854ec1861c => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:28:25.913938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a1079c4e-07aa-439c-b6f1-34e381bf85ec req-d93d644b-a4c0-40f7-b256-e448d231ab44 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.918033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a1079c4e-07aa-439c-b6f1-34e381bf85ec req-d93d644b-a4c0-40f7-b256-e448d231ab44 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.918647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a1079c4e-07aa-439c-b6f1-34e381bf85ec req-d93d644b-a4c0-40f7-b256-e448d231ab44 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.924412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2039a2d0-61ef-41b8-805d-ab9118c87a61 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Calling method '.version_select at 0x7fc42bbdadc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:25.943553 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a1079c4e-07aa-439c-b6f1-34e381bf85ec req-d93d644b-a4c0-40f7-b256-e448d231ab44 service nova] Creating event network-vif-unplugged:a173d34f-0b58-4d2d-91dc-183ed4b4d4a6 for instance 45d3d180-599f-4c45-a0ea-53f2180484d5 on n-h2-839401-11 Aug 29 15:28:25.950210 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a1079c4e-07aa-439c-b6f1-34e381bf85ec req-d93d644b-a4c0-40f7-b256-e448d231ab44 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062834 Aug 29 15:28:25.951558 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 448/912] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:25.957790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c0a03d15-6710-442c-a83a-5118fb4e2274 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:25.958676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c0a03d15-6710-442c-a83a-5118fb4e2274 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:25.979316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a03d15-6710-442c-a83a-5118fb4e2274 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.985534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a03d15-6710-442c-a83a-5118fb4e2274 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.986279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a03d15-6710-442c-a83a-5118fb4e2274 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:25.987240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a03d15-6710-442c-a83a-5118fb4e2274 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:25.987907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a03d15-6710-442c-a83a-5118fb4e2274 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:25.988588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a03d15-6710-442c-a83a-5118fb4e2274 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.010968 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2039a2d0-61ef-41b8-805d-ab9118c87a61 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "GET /compute/v2.1/os-security-groups/94a3f229-5d6b-4f7e-924c-d3b782282b88" status: 200 len: 246 microversion: 2.1 time: 0.097632 Aug 29 15:28:26.011613 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 465/913] 10.222.0.62 () {58 vars in 1269 bytes} [Mon Aug 29 15:28:25 2022] GET /compute/v2.1/os-security-groups/94a3f229-5d6b-4f7e-924c-d3b782282b88 => generated 246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:26.028628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d9b309ab-4f61-46b0-ada5-807f87dbea88 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Action: 'create', calling method: .version_select at 0x7fc42bb874c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2000080175", "description": "tempest-description-1233091455"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:26.176580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c0a03d15-6710-442c-a83a-5118fb4e2274 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:26.184718 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c0a03d15-6710-442c-a83a-5118fb4e2274 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1309 microversion: 2.1 time: 0.231789 Aug 29 15:28:26.185500 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 449/914] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:25 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1309 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:26.190881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6436f70b-ad3c-4991-9ef5-4b515bd54354 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:26.191505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6436f70b-ad3c-4991-9ef5-4b515bd54354 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 340bdcfa-c954-4f51-941a-c4324800f6d8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:26.198449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6436f70b-ad3c-4991-9ef5-4b515bd54354 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:26.199280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6436f70b-ad3c-4991-9ef5-4b515bd54354 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:26.199998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6436f70b-ad3c-4991-9ef5-4b515bd54354 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.200870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6436f70b-ad3c-4991-9ef5-4b515bd54354 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:26.201568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6436f70b-ad3c-4991-9ef5-4b515bd54354 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:26.202314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6436f70b-ad3c-4991-9ef5-4b515bd54354 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.215885 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d9b309ab-4f61-46b0-ada5-807f87dbea88 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.191508 Aug 29 15:28:26.216627 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 466/915] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:28:26 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:28:26.232325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f66c5b17-a37b-4758-862f-2b332f9f386d tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Action: 'create', calling method: .version_select at 0x7fc42bbda790>, body: {"security_group_rule": {"parent_group_id": "d82e51a7-1ccd-4abd-87a0-baae96b22a74", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:26.405640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6436f70b-ad3c-4991-9ef5-4b515bd54354 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:26.417060 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6436f70b-ad3c-4991-9ef5-4b515bd54354 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8" status: 200 len: 1318 microversion: 2.1 time: 0.229932 Aug 29 15:28:26.425120 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 450/916] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:26 2022] GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:26.431476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f814e045-2371-4a7e-b9ca-61d9625b7524 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc43002a1f0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:26.493806 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f814e045-2371-4a7e-b9ca-61d9625b7524 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 0.068258 Aug 29 15:28:26.499361 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 451/917] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:26 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:26.512534 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f66c5b17-a37b-4758-862f-2b332f9f386d tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.284384 Aug 29 15:28:26.513715 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 467/918] 10.222.0.62 () {60 vars in 1195 bytes} [Mon Aug 29 15:28:26 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:28:26.526027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-96332e1a-d517-451e-8270-7246882f1582 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Action: 'create', calling method: .version_select at 0x7fc43013a940>, body: {"security_group_rule": {"parent_group_id": "d82e51a7-1ccd-4abd-87a0-baae96b22a74", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:26.651061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e007640a-de15-436e-8aa3-97a38ed3ef07 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:26.652193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e007640a-de15-436e-8aa3-97a38ed3ef07 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:26.660497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e007640a-de15-436e-8aa3-97a38ed3ef07 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:26.661123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e007640a-de15-436e-8aa3-97a38ed3ef07 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:26.661711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e007640a-de15-436e-8aa3-97a38ed3ef07 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.662532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e007640a-de15-436e-8aa3-97a38ed3ef07 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:26.663066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e007640a-de15-436e-8aa3-97a38ed3ef07 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:26.663609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e007640a-de15-436e-8aa3-97a38ed3ef07 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.745792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e007640a-de15-436e-8aa3-97a38ed3ef07 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:26.761483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e007640a-de15-436e-8aa3-97a38ed3ef07 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:26.763154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e007640a-de15-436e-8aa3-97a38ed3ef07 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:26.767139 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-96332e1a-d517-451e-8270-7246882f1582 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.245070 Aug 29 15:28:26.767944 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 452/919] 10.222.0.62 () {60 vars in 1195 bytes} [Mon Aug 29 15:28:26 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:26.775313 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e007640a-de15-436e-8aa3-97a38ed3ef07 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.128752 Aug 29 15:28:26.775919 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 468/920] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:26 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:26.781949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fe982e56-c3a5-4871-ac51-2a836ed1d6ee tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Calling method '.version_select at 0x7fc42bdc7d30>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:26.840131 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fe982e56-c3a5-4871-ac51-2a836ed1d6ee tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "GET /compute/v2.1/os-security-groups/d82e51a7-1ccd-4abd-87a0-baae96b22a74" status: 200 len: 665 microversion: 2.1 time: 0.062174 Aug 29 15:28:26.840879 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 453/921] 10.222.0.62 () {58 vars in 1269 bytes} [Mon Aug 29 15:28:26 2022] GET /compute/v2.1/os-security-groups/d82e51a7-1ccd-4abd-87a0-baae96b22a74 => generated 665 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:26.854917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f47eaccb-c9bb-4ca9-86fc-fb289432cc20 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Calling method '.version_select at 0x7fc42bdb9f70>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:26.910453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dcde710b-e134-49e9-a023-dc2caf1b821c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:26.911498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dcde710b-e134-49e9-a023-dc2caf1b821c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:26.920952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcde710b-e134-49e9-a023-dc2caf1b821c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:26.921928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcde710b-e134-49e9-a023-dc2caf1b821c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:26.923823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcde710b-e134-49e9-a023-dc2caf1b821c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:26.924923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcde710b-e134-49e9-a023-dc2caf1b821c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:26.925793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcde710b-e134-49e9-a023-dc2caf1b821c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:26.926343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcde710b-e134-49e9-a023-dc2caf1b821c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.097023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dcde710b-e134-49e9-a023-dc2caf1b821c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:27.114756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dcde710b-e134-49e9-a023-dc2caf1b821c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:27.114756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dcde710b-e134-49e9-a023-dc2caf1b821c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:27.114756 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dcde710b-e134-49e9-a023-dc2caf1b821c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.203990 Aug 29 15:28:27.115144 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 454/922] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:26 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:28:27.179341 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f47eaccb-c9bb-4ca9-86fc-fb289432cc20 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-group-rules/30531444-f5fe-4473-943d-836e2aa04aa4" status: 202 len: 0 microversion: 2.1 time: 0.328434 Aug 29 15:28:27.180018 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 469/923] 10.222.0.62 () {58 vars in 1287 bytes} [Mon Aug 29 15:28:26 2022] DELETE /compute/v2.1/os-security-group-rules/30531444-f5fe-4473-943d-836e2aa04aa4 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:28:27.191543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0197591a-a476-42a5-b3c9-3cce78a7fe8b tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Calling method '.version_select at 0x7fc43002a160>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:27.216016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2a1619b7-e12e-4d64-bd3b-afb7042f8712 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:27.218167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2a1619b7-e12e-4d64-bd3b-afb7042f8712 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:27.232256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a1619b7-e12e-4d64-bd3b-afb7042f8712 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.238097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a1619b7-e12e-4d64-bd3b-afb7042f8712 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.238578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a1619b7-e12e-4d64-bd3b-afb7042f8712 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.240130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a1619b7-e12e-4d64-bd3b-afb7042f8712 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.240702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a1619b7-e12e-4d64-bd3b-afb7042f8712 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.243152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a1619b7-e12e-4d64-bd3b-afb7042f8712 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.447371 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0197591a-a476-42a5-b3c9-3cce78a7fe8b tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/d82e51a7-1ccd-4abd-87a0-baae96b22a74" status: 202 len: 0 microversion: 2.1 time: 0.261935 Aug 29 15:28:27.451202 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 455/924] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:28:27 2022] DELETE /compute/v2.1/os-security-groups/d82e51a7-1ccd-4abd-87a0-baae96b22a74 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:28:27.454612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c5b5daf8-8032-49fa-ba64-56cc43e628e6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:27.455249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c5b5daf8-8032-49fa-ba64-56cc43e628e6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 340bdcfa-c954-4f51-941a-c4324800f6d8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:27.462687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5b5daf8-8032-49fa-ba64-56cc43e628e6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.463569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5b5daf8-8032-49fa-ba64-56cc43e628e6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.463702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5b5daf8-8032-49fa-ba64-56cc43e628e6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.465291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5b5daf8-8032-49fa-ba64-56cc43e628e6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.465938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5b5daf8-8032-49fa-ba64-56cc43e628e6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.466395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5b5daf8-8032-49fa-ba64-56cc43e628e6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.518759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2a1619b7-e12e-4d64-bd3b-afb7042f8712 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:27.528621 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2a1619b7-e12e-4d64-bd3b-afb7042f8712 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1309 microversion: 2.1 time: 0.317075 Aug 29 15:28:27.532221 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 470/925] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:27 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1309 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:27.538698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b032dc2-bc3a-4f96-b27d-e5be3de7e1c4 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Calling method '.version_select at 0x7fc4301fa700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:27.600597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG neutronclient.v2_0.client [None req-4b032dc2-bc3a-4f96-b27d-e5be3de7e1c4 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 33fdd07b-4ee0-48af-9280-6b854ec1861c does not exist", "detail": ""}} {{(pid=122361) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:28:27.601451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.security_group_api [None req-4b032dc2-bc3a-4f96-b27d-e5be3de7e1c4 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Neutron security group 33fdd07b-4ee0-48af-9280-6b854ec1861c not found {{(pid=122361) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:28:27.602156 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-4b032dc2-bc3a-4f96-b27d-e5be3de7e1c4 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] HTTP exception thrown: Security group 33fdd07b-4ee0-48af-9280-6b854ec1861c does not exist Aug 29 15:28:27.602156 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-b53d0f23-3283-4678-83ad-fda8fcbf2cc6'] Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b032dc2-bc3a-4f96-b27d-e5be3de7e1c4 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Request method failure captured: Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/os-security-groups/33fdd07b-4ee0-48af-9280-6b854ec1861c HTTP/1.1 Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNsOdKY39KQiXhgbGMk-OuHVIkAKp_P6gQNCKlVo-721_V2Mg7R340MpF2s6EBn79O7aSenLqvSZTu0QrJrIfTMp81dPByI2dFrlyuhIm4shOIqznu2WZSNmkVQNuD86AXJKhEsBGYR2MByOv0j2_NApuMNWm9OftSmPOFiqYagSYBI Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: a3acba12d10f40ca94084586ba8f30e5 Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1401106952 Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:28:27.610726 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:28:27.612391 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a3acba12d10f40ca94084586ba8f30e5", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a3acba12d10f40ca94084586ba8f30e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a3acba12d10f40ca94084586ba8f30e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a3acba12d10f40ca94084586ba8f30e5"}]}] Aug 29 15:28:27.612391 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1401106952 Aug 29 15:28:27.612391 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: a3acba12d10f40ca94084586ba8f30e5 Aug 29 15:28:27.612391 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1401106952 Aug 29 15:28:27.612391 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-SecurityGroupRulesTestJSON-1401106952-project Aug 29 15:28:27.612391 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:28:27.612391 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:28:27.612391 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 5491b206c3844d6499e5ca1085b1806d Aug 29 15:28:27.612391 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1401106952-project Aug 29 15:28:27.612391 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:28:27.612391 n-d-839401-11 devstack@n-api.service[122361]: exception: Security group 33fdd07b-4ee0-48af-9280-6b854ec1861c does not exist Aug 29 15:28:27.612391 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-b53d0f23-3283-4678-83ad-fda8fcbf2cc6'] Aug 29 15:28:27.612391 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '33fdd07b-4ee0-48af-9280-6b854ec1861c'} Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:28:27.613441 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 33fdd07b-4ee0-48af-9280-6b854ec1861c does not exist Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b53d0f23-3283-4678-83ad-fda8fcbf2cc6'] Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:28:27.615072 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 33fdd07b-4ee0-48af-9280-6b854ec1861c does not exist Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b53d0f23-3283-4678-83ad-fda8fcbf2cc6'] Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 33fdd07b-4ee0-48af-9280-6b854ec1861c does not exist Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b53d0f23-3283-4678-83ad-fda8fcbf2cc6'] Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.616768 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:28:27.618430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:28:27.618430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:28:27.618430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:28:27.618430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:28:27.618430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 33fdd07b-4ee0-48af-9280-6b854ec1861c does not exist Aug 29 15:28:27.618430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b53d0f23-3283-4678-83ad-fda8fcbf2cc6'] Aug 29 15:28:27.618430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:28:27.618430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b032dc2-bc3a-4f96-b27d-e5be3de7e1c4 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Returning 404 to user: Security group 33fdd07b-4ee0-48af-9280-6b854ec1861c does not exist Aug 29 15:28:27.618430 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-b53d0f23-3283-4678-83ad-fda8fcbf2cc6'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:28:27.618430 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4b032dc2-bc3a-4f96-b27d-e5be3de7e1c4 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/33fdd07b-4ee0-48af-9280-6b854ec1861c" status: 404 len: 194 microversion: 2.1 time: 0.082359 Aug 29 15:28:27.618430 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 471/926] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:28:27 2022] DELETE /compute/v2.1/os-security-groups/33fdd07b-4ee0-48af-9280-6b854ec1861c => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:28:27.625443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c2523b27-4a5e-4bb0-9d0d-b4851e2baeff tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bbda0d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:27.691650 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c2523b27-4a5e-4bb0-9d0d-b4851e2baeff tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 0.073344 Aug 29 15:28:27.697386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c5b5daf8-8032-49fa-ba64-56cc43e628e6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:27.700963 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 472/927] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:27 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:27.706461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1f8e624b-04fd-4cdc-a8f2-07091a2f42e1 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Calling method '.version_select at 0x7fc42bbdaca0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:27.708513 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c5b5daf8-8032-49fa-ba64-56cc43e628e6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8" status: 200 len: 1467 microversion: 2.1 time: 0.259049 Aug 29 15:28:27.709477 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 456/928] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:27 2022] GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8 => generated 1467 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:27.734071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-56c646ed-c934-44b4-ab3e-8b8cf5e8f0ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:27.753295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-56c646ed-c934-44b4-ab3e-8b8cf5e8f0ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:27.754411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-56c646ed-c934-44b4-ab3e-8b8cf5e8f0ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Searching by: {'reservation_id': 'r-eemrfxcn', 'deleted': False, 'project_id': '0393aa9c32934da4a9f478c563135bbb'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:28:27.765894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c646ed-c934-44b4-ab3e-8b8cf5e8f0ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.766406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c646ed-c934-44b4-ab3e-8b8cf5e8f0ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.766946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c646ed-c934-44b4-ab3e-8b8cf5e8f0ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.767690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c646ed-c934-44b4-ab3e-8b8cf5e8f0ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.768150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c646ed-c934-44b4-ab3e-8b8cf5e8f0ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.768565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c646ed-c934-44b4-ab3e-8b8cf5e8f0ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.884278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-56c646ed-c934-44b4-ab3e-8b8cf5e8f0ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:28:27.932161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:27.948685 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1f8e624b-04fd-4cdc-a8f2-07091a2f42e1 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/94a3f229-5d6b-4f7e-924c-d3b782282b88" status: 202 len: 0 microversion: 2.1 time: 0.246332 Aug 29 15:28:27.952324 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 473/929] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:28:27 2022] DELETE /compute/v2.1/os-security-groups/94a3f229-5d6b-4f7e-924c-d3b782282b88 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:28:27.955146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-426d4bff-bacc-4d22-9290-a3692ebbbfb8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:27.955791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-426d4bff-bacc-4d22-9290-a3692ebbbfb8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:27.967989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-56c646ed-c934-44b4-ab3e-8b8cf5e8f0ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:27.976600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-426d4bff-bacc-4d22-9290-a3692ebbbfb8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.977261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-426d4bff-bacc-4d22-9290-a3692ebbbfb8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.977695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c646ed-c934-44b4-ab3e-8b8cf5e8f0ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.977818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-426d4bff-bacc-4d22-9290-a3692ebbbfb8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.978486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-426d4bff-bacc-4d22-9290-a3692ebbbfb8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:27.978961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-426d4bff-bacc-4d22-9290-a3692ebbbfb8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.979091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c646ed-c934-44b4-ab3e-8b8cf5e8f0ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:27.979380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-426d4bff-bacc-4d22-9290-a3692ebbbfb8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:27.979983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c646ed-c934-44b4-ab3e-8b8cf5e8f0ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.072892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-426d4bff-bacc-4d22-9290-a3692ebbbfb8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:28.082618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-426d4bff-bacc-4d22-9290-a3692ebbbfb8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:28.084096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-426d4bff-bacc-4d22-9290-a3692ebbbfb8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:28.089846 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-426d4bff-bacc-4d22-9290-a3692ebbbfb8 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.139209 Aug 29 15:28:28.090943 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 474/930] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:27 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:28.096440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d9a2efe6-6a6f-420e-b818-e02f22061d66 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Calling method '.version_select at 0x7fc42bad15e0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:28.121950 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-56c646ed-c934-44b4-ab3e-8b8cf5e8f0ba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/detail?reservation_id=r-eemrfxcn" status: 200 len: 2926 microversion: 2.1 time: 0.396672 Aug 29 15:28:28.140371 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 457/931] 10.222.0.62 () {58 vars in 1197 bytes} [Mon Aug 29 15:28:27 2022] GET /compute/v2.1/servers/detail?reservation_id=r-eemrfxcn => generated 2926 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:28.146798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4bdd1e51-98dd-4785-acea-9f8be4bacef2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:28.147407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4bdd1e51-98dd-4785-acea-9f8be4bacef2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:28.163245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bdd1e51-98dd-4785-acea-9f8be4bacef2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:28.163736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bdd1e51-98dd-4785-acea-9f8be4bacef2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:28.164166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bdd1e51-98dd-4785-acea-9f8be4bacef2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.164861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bdd1e51-98dd-4785-acea-9f8be4bacef2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:28.165334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bdd1e51-98dd-4785-acea-9f8be4bacef2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:28.165754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bdd1e51-98dd-4785-acea-9f8be4bacef2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.308047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4bdd1e51-98dd-4785-acea-9f8be4bacef2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:28.317671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4bdd1e51-98dd-4785-acea-9f8be4bacef2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:28.319160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4bdd1e51-98dd-4785-acea-9f8be4bacef2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:28.326198 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4bdd1e51-98dd-4785-acea-9f8be4bacef2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.183346 Aug 29 15:28:28.327636 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 458/932] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:28 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:28.332685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-89e605d8-df29-4585-8313-569ad3b53df9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:28.353156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.compute.server_groups [None req-89e605d8-df29-4585-8313-569ad3b53df9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Querying cell dcf211bc-da73-4d63-b885-2b9e7c1e329b(cell1) for 2 instances {{(pid=122360) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 15:28:28.354171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89e605d8-df29-4585-8313-569ad3b53df9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:28.354851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89e605d8-df29-4585-8313-569ad3b53df9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:28.355542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89e605d8-df29-4585-8313-569ad3b53df9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.363513 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d9a2efe6-6a6f-420e-b818-e02f22061d66 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/bc32fc9d-f659-423f-b1ee-a0439acf9439" status: 202 len: 0 microversion: 2.1 time: 0.271262 Aug 29 15:28:28.364313 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 475/933] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:28:28 2022] DELETE /compute/v2.1/os-security-groups/bc32fc9d-f659-423f-b1ee-a0439acf9439 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:28:28.377549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-80590fa8-8b02-4488-be99-9c044d6d3813 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Calling method '.version_select at 0x7fc43013d550>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:28.385012 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-89e605d8-df29-4585-8313-569ad3b53df9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/os-server-groups/01e17389-4ffc-405a-88d9-6586c585fcb9" status: 200 len: 271 microversion: 2.1 time: 0.055991 Aug 29 15:28:28.386092 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 459/934] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:28:28 2022] GET /compute/v2.1/os-server-groups/01e17389-4ffc-405a-88d9-6586c585fcb9 => generated 271 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:28.409782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cb5f1164-cd04-493f-887e-ccecfdd6667d tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:28.411948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cb5f1164-cd04-493f-887e-ccecfdd6667d tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:28.420122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb5f1164-cd04-493f-887e-ccecfdd6667d tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:28.420616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb5f1164-cd04-493f-887e-ccecfdd6667d tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:28.421049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb5f1164-cd04-493f-887e-ccecfdd6667d tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.421794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb5f1164-cd04-493f-887e-ccecfdd6667d tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:28.422246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb5f1164-cd04-493f-887e-ccecfdd6667d tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:28.422668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb5f1164-cd04-493f-887e-ccecfdd6667d tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.595651 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cb5f1164-cd04-493f-887e-ccecfdd6667d tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 200 len: 1619 microversion: 2.1 time: 0.196560 Aug 29 15:28:28.597616 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 460/935] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:28 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 1619 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:28.603915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ea1d8ae2-7bd9-4d00-b57d-c5059637ea4b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:28.604762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ea1d8ae2-7bd9-4d00-b57d-c5059637ea4b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:28.612566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea1d8ae2-7bd9-4d00-b57d-c5059637ea4b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:28.613497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea1d8ae2-7bd9-4d00-b57d-c5059637ea4b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:28.614076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea1d8ae2-7bd9-4d00-b57d-c5059637ea4b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.615020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea1d8ae2-7bd9-4d00-b57d-c5059637ea4b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:28.615817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea1d8ae2-7bd9-4d00-b57d-c5059637ea4b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:28.616426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea1d8ae2-7bd9-4d00-b57d-c5059637ea4b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.620184 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-80590fa8-8b02-4488-be99-9c044d6d3813 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/fd05e2db-4a20-4520-af20-28ae7f761acb" status: 202 len: 0 microversion: 2.1 time: 0.250654 Aug 29 15:28:28.620803 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 476/936] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:28:28 2022] DELETE /compute/v2.1/os-security-groups/fd05e2db-4a20-4520-af20-28ae7f761acb => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:28:28.626093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9a7fe5c2-a90c-4e51-a49b-923d80d2c261 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:28.626692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9a7fe5c2-a90c-4e51-a49b-923d80d2c261 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] [instance: 340bdcfa-c954-4f51-941a-c4324800f6d8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:28.639121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a7fe5c2-a90c-4e51-a49b-923d80d2c261 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:28.640055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a7fe5c2-a90c-4e51-a49b-923d80d2c261 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:28.641176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a7fe5c2-a90c-4e51-a49b-923d80d2c261 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.642714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a7fe5c2-a90c-4e51-a49b-923d80d2c261 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:28.643541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a7fe5c2-a90c-4e51-a49b-923d80d2c261 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:28.644466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a7fe5c2-a90c-4e51-a49b-923d80d2c261 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:28.813403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ea1d8ae2-7bd9-4d00-b57d-c5059637ea4b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:28.825848 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ea1d8ae2-7bd9-4d00-b57d-c5059637ea4b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1309 microversion: 2.1 time: 0.226804 Aug 29 15:28:28.826463 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 461/937] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:28 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1309 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:28.831251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-29644730-41a4-47f6-8255-baf884cd4742 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Calling method '.version_select at 0x7fc43013a8b0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:28.849248 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9a7fe5c2-a90c-4e51-a49b-923d80d2c261 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8" status: 200 len: 1620 microversion: 2.1 time: 0.225170 Aug 29 15:28:28.857331 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 477/938] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:28 2022] GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8 => generated 1620 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:28.857331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b50bf391-f0c6-4fde-b688-251006d83fc2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bf98a60>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:28.935361 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b50bf391-f0c6-4fde-b688-251006d83fc2 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 0.083646 Aug 29 15:28:28.943471 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 478/939] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:28 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:28.999559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-139139260", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "06e1bd29-189f-45ae-8cfe-ec70a91cf5c1"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:29.082897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:28:29.111929 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-29644730-41a4-47f6-8255-baf884cd4742 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/51e7c2f1-19bf-4f6b-832a-4b7510a06b27" status: 202 len: 0 microversion: 2.1 time: 0.284382 Aug 29 15:28:29.116043 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 462/940] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:28:28 2022] DELETE /compute/v2.1/os-security-groups/51e7c2f1-19bf-4f6b-832a-4b7510a06b27 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:28:29.123473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-be967796-c171-424b-ab79-311bce634bd0 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] Calling method '.version_select at 0x7fc42bcd4940>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:29.374676 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-be967796-c171-424b-ab79-311bce634bd0 tempest-SecurityGroupRulesTestJSON-1401106952 tempest-SecurityGroupRulesTestJSON-1401106952-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/cbb5e058-7f01-4ad3-99eb-8db5bac3bfd4" status: 202 len: 0 microversion: 2.1 time: 0.255628 Aug 29 15:28:29.375789 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 463/941] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:28:29 2022] DELETE /compute/v2.1/os-security-groups/cbb5e058-7f01-4ad3-99eb-8db5bac3bfd4 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:28:29.389419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8a22f127-a48d-4dbd-9c37-266e833f84e1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:29.391139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8a22f127-a48d-4dbd-9c37-266e833f84e1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:29.404497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a22f127-a48d-4dbd-9c37-266e833f84e1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.409965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a22f127-a48d-4dbd-9c37-266e833f84e1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.411021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a22f127-a48d-4dbd-9c37-266e833f84e1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.412058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a22f127-a48d-4dbd-9c37-266e833f84e1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.413463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a22f127-a48d-4dbd-9c37-266e833f84e1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.415707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a22f127-a48d-4dbd-9c37-266e833f84e1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.542644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8a22f127-a48d-4dbd-9c37-266e833f84e1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:29.557224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8a22f127-a48d-4dbd-9c37-266e833f84e1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:29.559847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8a22f127-a48d-4dbd-9c37-266e833f84e1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:29.566997 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8a22f127-a48d-4dbd-9c37-266e833f84e1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.185869 Aug 29 15:28:29.568034 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 464/942] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:29 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:29.575726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:28:29.576399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:28:29.577115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:28:29.577738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:28:29.578326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:28:29.579478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-81a1b98f-1917-4a59-be76-24693249cda4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:29.581212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-81a1b98f-1917-4a59-be76-24693249cda4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:29.594055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81a1b98f-1917-4a59-be76-24693249cda4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.595873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81a1b98f-1917-4a59-be76-24693249cda4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.596927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.597307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81a1b98f-1917-4a59-be76-24693249cda4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.598086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.598537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.598652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81a1b98f-1917-4a59-be76-24693249cda4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.599285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.599534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81a1b98f-1917-4a59-be76-24693249cda4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.599741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.600276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81a1b98f-1917-4a59-be76-24693249cda4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.602690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.662880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:29.668986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:29.690182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:28:29.692564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:28:29.850208 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1a4409ad-8c0e-40b1-9e8a-cdddede6e0ce tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.854819 Aug 29 15:28:29.856960 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 479/943] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:28:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:28:29.863029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4e86a343-c899-423d-88ac-22bf78393d38 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:29.863663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4e86a343-c899-423d-88ac-22bf78393d38 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:29.884767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e86a343-c899-423d-88ac-22bf78393d38 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.885312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e86a343-c899-423d-88ac-22bf78393d38 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.886436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e86a343-c899-423d-88ac-22bf78393d38 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:29.887413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e86a343-c899-423d-88ac-22bf78393d38 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:29.887895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e86a343-c899-423d-88ac-22bf78393d38 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:29.888338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e86a343-c899-423d-88ac-22bf78393d38 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:30.189502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4e86a343-c899-423d-88ac-22bf78393d38 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:30.192285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-81a1b98f-1917-4a59-be76-24693249cda4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:30.205202 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4e86a343-c899-423d-88ac-22bf78393d38 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1309 microversion: 2.1 time: 0.341938 Aug 29 15:28:30.206268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-81a1b98f-1917-4a59-be76-24693249cda4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:30.206560 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 480/944] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:29 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1309 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:30.208697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-81a1b98f-1917-4a59-be76-24693249cda4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:30.212140 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-81a1b98f-1917-4a59-be76-24693249cda4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.642886 Aug 29 15:28:30.213964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0310743e-87a4-4f7d-afa0-441ae391d3d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:30.214783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0310743e-87a4-4f7d-afa0-441ae391d3d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:30.232191 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 465/945] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:29 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:30.241491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-39bc08ac-892a-4112-aa39-c19d3a33cd58 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:30.243029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-39bc08ac-892a-4112-aa39-c19d3a33cd58 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:30.265322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39bc08ac-892a-4112-aa39-c19d3a33cd58 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:30.266722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39bc08ac-892a-4112-aa39-c19d3a33cd58 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:30.267892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39bc08ac-892a-4112-aa39-c19d3a33cd58 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:30.268735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39bc08ac-892a-4112-aa39-c19d3a33cd58 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:30.269346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39bc08ac-892a-4112-aa39-c19d3a33cd58 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:30.269877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39bc08ac-892a-4112-aa39-c19d3a33cd58 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:30.329596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0310743e-87a4-4f7d-afa0-441ae391d3d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:30.335236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-39bc08ac-892a-4112-aa39-c19d3a33cd58 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:28:30.339319 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0310743e-87a4-4f7d-afa0-441ae391d3d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1216 microversion: 2.1 time: 0.130503 Aug 29 15:28:30.341146 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 481/946] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:30 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1216 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:30.353171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-542a0861-2b0e-4605-9f63-22136a7ce7d7 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bac2040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:30.448462 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-542a0861-2b0e-4605-9f63-22136a7ce7d7 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 0.106023 Aug 29 15:28:30.451110 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 482/947] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:30 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:30.473182 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-39bc08ac-892a-4112-aa39-c19d3a33cd58 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 204 len: 0 microversion: 2.1 time: 0.239345 Aug 29 15:28:30.473745 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 466/948] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:28:30 2022] DELETE /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:28:30.598889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c280b02d-a9f6-4f25-8c69-dc635ae52c85 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:30.600957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c280b02d-a9f6-4f25-8c69-dc635ae52c85 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:30.618243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c280b02d-a9f6-4f25-8c69-dc635ae52c85 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:30.621011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c280b02d-a9f6-4f25-8c69-dc635ae52c85 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:30.621501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c280b02d-a9f6-4f25-8c69-dc635ae52c85 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:30.625004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c280b02d-a9f6-4f25-8c69-dc635ae52c85 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:30.627526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c280b02d-a9f6-4f25-8c69-dc635ae52c85 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:30.627975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c280b02d-a9f6-4f25-8c69-dc635ae52c85 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:30.651412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:30.674736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1182016801", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "1821141378", "adminPass": "***", "networks": [{"uuid": "4d6a5945-ca4d-426d-97ed-ccb169b5644e"}], "security_groups": [{"name": "tempest-securitygroup--1492071322"}], "key_name": "tempest-keypair-1081306532", "user_data": "}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:30.764168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c280b02d-a9f6-4f25-8c69-dc635ae52c85 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:30.775314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c280b02d-a9f6-4f25-8c69-dc635ae52c85 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:30.776828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c280b02d-a9f6-4f25-8c69-dc635ae52c85 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:30.783664 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c280b02d-a9f6-4f25-8c69-dc635ae52c85 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.191698 Aug 29 15:28:30.785788 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 483/949] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:30 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:30.947138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] validate_networks() for [('4d6a5945-ca4d-426d-97ed-ccb169b5644e', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:28:31.227147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-881e325d-01e7-4399-b85b-449b1e3e97c5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:31.227577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-881e325d-01e7-4399-b85b-449b1e3e97c5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:31.234862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-881e325d-01e7-4399-b85b-449b1e3e97c5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.235356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-881e325d-01e7-4399-b85b-449b1e3e97c5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.243381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-881e325d-01e7-4399-b85b-449b1e3e97c5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.244246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-881e325d-01e7-4399-b85b-449b1e3e97c5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.244733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-881e325d-01e7-4399-b85b-449b1e3e97c5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.245198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-881e325d-01e7-4399-b85b-449b1e3e97c5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.517910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-881e325d-01e7-4399-b85b-449b1e3e97c5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:31.532028 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-881e325d-01e7-4399-b85b-449b1e3e97c5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1309 microversion: 2.1 time: 0.309451 Aug 29 15:28:31.532950 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 484/950] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:31 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1309 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:31.552731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-082a1ab8-382d-490a-a182-ab8aecc26477 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:31.553416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-082a1ab8-382d-490a-a182-ab8aecc26477 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:31.560229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-082a1ab8-382d-490a-a182-ab8aecc26477 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.561035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-082a1ab8-382d-490a-a182-ab8aecc26477 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.561698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-082a1ab8-382d-490a-a182-ab8aecc26477 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.562597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-082a1ab8-382d-490a-a182-ab8aecc26477 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.563249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-082a1ab8-382d-490a-a182-ab8aecc26477 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.564104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-082a1ab8-382d-490a-a182-ab8aecc26477 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.747402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:28:31.748492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:28:31.749194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:28:31.749764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:28:31.750336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:28:31.771712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.774156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.776301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.777342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.782238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.783235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.812209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-082a1ab8-382d-490a-a182-ab8aecc26477 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:31.846114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Getting quotas for project be837968b7df43d89c7fc806a7387b18. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:31.850131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-082a1ab8-382d-490a-a182-ab8aecc26477 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:31.851394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-082a1ab8-382d-490a-a182-ab8aecc26477 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:31.852687 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-082a1ab8-382d-490a-a182-ab8aecc26477 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.305213 Aug 29 15:28:31.856155 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 485/951] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:31 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:31.875218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f056e8bf-4327-4078-a2ea-ed1c65a9ca6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:31.875900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f056e8bf-4327-4078-a2ea-ed1c65a9ca6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:31.876178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Getting quotas for user e36b9be537be45d88b1a7ef3543f26b4 and project be837968b7df43d89c7fc806a7387b18. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:31.893906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:28:31.897270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:28:31.897461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f056e8bf-4327-4078-a2ea-ed1c65a9ca6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.897867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f056e8bf-4327-4078-a2ea-ed1c65a9ca6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.898331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f056e8bf-4327-4078-a2ea-ed1c65a9ca6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:31.899068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f056e8bf-4327-4078-a2ea-ed1c65a9ca6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:31.899532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f056e8bf-4327-4078-a2ea-ed1c65a9ca6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:31.899972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f056e8bf-4327-4078-a2ea-ed1c65a9ca6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:32.015998 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c69a7f11-6b5d-4108-8b9a-6f43191a29f3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.347404 Aug 29 15:28:32.020420 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 467/952] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:28:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:28:32.030305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e10e530e-ef42-412e-9884-f92ff9d21710 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bc6c3a0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:32.144392 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e10e530e-ef42-412e-9884-f92ff9d21710 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 0.122267 Aug 29 15:28:32.145487 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 468/953] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:32 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:32.160652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ed43f9cb-fd2c-4688-b396-447645c15db1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:32.161433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ed43f9cb-fd2c-4688-b396-447645c15db1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:32.178913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed43f9cb-fd2c-4688-b396-447645c15db1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:32.186583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed43f9cb-fd2c-4688-b396-447645c15db1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:32.190037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed43f9cb-fd2c-4688-b396-447645c15db1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:32.195601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed43f9cb-fd2c-4688-b396-447645c15db1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:32.197399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed43f9cb-fd2c-4688-b396-447645c15db1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:32.206524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed43f9cb-fd2c-4688-b396-447645c15db1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:32.342193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ed43f9cb-fd2c-4688-b396-447645c15db1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:32.384971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ed43f9cb-fd2c-4688-b396-447645c15db1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:32.397982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f056e8bf-4327-4078-a2ea-ed1c65a9ca6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:32.406969 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f056e8bf-4327-4078-a2ea-ed1c65a9ca6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1268 microversion: 2.1 time: 0.549729 Aug 29 15:28:32.409739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ed43f9cb-fd2c-4688-b396-447645c15db1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:32.414831 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 486/954] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:31 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1268 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:32.419922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-53a4bfbf-eaa4-4b7b-abd0-fa2e65342258 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:32.424636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-53a4bfbf-eaa4-4b7b-abd0-fa2e65342258 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:32.439102 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ed43f9cb-fd2c-4688-b396-447645c15db1 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.291789 Aug 29 15:28:32.440132 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 469/955] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:32 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:32.556838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-45cf1f97-16cc-4894-928b-9742ae88c958 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:32.557615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-45cf1f97-16cc-4894-928b-9742ae88c958 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:32.575634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cf1f97-16cc-4894-928b-9742ae88c958 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:32.585767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cf1f97-16cc-4894-928b-9742ae88c958 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:32.588364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cf1f97-16cc-4894-928b-9742ae88c958 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:32.590865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cf1f97-16cc-4894-928b-9742ae88c958 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:32.596195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cf1f97-16cc-4894-928b-9742ae88c958 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:32.601195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cf1f97-16cc-4894-928b-9742ae88c958 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.002739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-53a4bfbf-eaa4-4b7b-abd0-fa2e65342258 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:33.004259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-45cf1f97-16cc-4894-928b-9742ae88c958 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:33.012495 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-45cf1f97-16cc-4894-928b-9742ae88c958 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1309 microversion: 2.1 time: 0.459743 Aug 29 15:28:33.013123 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 470/956] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:32 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1309 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:33.015099 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-53a4bfbf-eaa4-4b7b-abd0-fa2e65342258 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1265 microversion: 2.1 time: 0.598321 Aug 29 15:28:33.017073 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 487/957] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:32 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1265 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:33.025190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3ddea7ef-66fa-45a8-9636-1378802eb212 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:33.026114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3ddea7ef-66fa-45a8-9636-1378802eb212 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:33.035319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ddea7ef-66fa-45a8-9636-1378802eb212 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.036338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ddea7ef-66fa-45a8-9636-1378802eb212 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.036955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ddea7ef-66fa-45a8-9636-1378802eb212 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.037848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ddea7ef-66fa-45a8-9636-1378802eb212 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.038468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ddea7ef-66fa-45a8-9636-1378802eb212 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.039057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ddea7ef-66fa-45a8-9636-1378802eb212 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.051905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-01213bc5-7c1c-4d56-9232-465f614ab615 req-9afe534f-6c8c-4e1a-bddc-5bb7a7eae969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b00ee0c9-6348-4a38-a096-53fcbded92c7", "name": "network-vif-plugged", "status": "completed", "tag": "fc2e3960-31a2-4784-b5a4-edc91e5a8f77"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:33.091828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-01213bc5-7c1c-4d56-9232-465f614ab615 req-9afe534f-6c8c-4e1a-bddc-5bb7a7eae969 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.092089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-01213bc5-7c1c-4d56-9232-465f614ab615 req-9afe534f-6c8c-4e1a-bddc-5bb7a7eae969 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.092528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-01213bc5-7c1c-4d56-9232-465f614ab615 req-9afe534f-6c8c-4e1a-bddc-5bb7a7eae969 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.140178 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-01213bc5-7c1c-4d56-9232-465f614ab615 req-9afe534f-6c8c-4e1a-bddc-5bb7a7eae969 service nova] Creating event network-vif-plugged:fc2e3960-31a2-4784-b5a4-edc91e5a8f77 for instance b00ee0c9-6348-4a38-a096-53fcbded92c7 on n-h1-839401-11 Aug 29 15:28:33.157992 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-01213bc5-7c1c-4d56-9232-465f614ab615 req-9afe534f-6c8c-4e1a-bddc-5bb7a7eae969 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143198 Aug 29 15:28:33.158925 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 471/958] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:33.172807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0b6819d8-b09e-4c13-90f0-56b53fec396d tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc4305a0310>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:33.302113 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0b6819d8-b09e-4c13-90f0-56b53fec396d tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 0.141072 Aug 29 15:28:33.303035 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 472/959] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:33 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:33.436606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7d36cea7-382d-4523-800a-59648bca6793 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:33.437415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7d36cea7-382d-4523-800a-59648bca6793 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:33.451640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d36cea7-382d-4523-800a-59648bca6793 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.452159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d36cea7-382d-4523-800a-59648bca6793 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.452599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d36cea7-382d-4523-800a-59648bca6793 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.453349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d36cea7-382d-4523-800a-59648bca6793 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.458478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d36cea7-382d-4523-800a-59648bca6793 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.459405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d36cea7-382d-4523-800a-59648bca6793 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.620475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7d36cea7-382d-4523-800a-59648bca6793 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:33.631837 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7d36cea7-382d-4523-800a-59648bca6793 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1274 microversion: 2.1 time: 0.200064 Aug 29 15:28:33.635673 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 473/960] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:33 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1274 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:33.645509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4673ab57-cc60-4415-86ed-ff9b464753f7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:33.646287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4673ab57-cc60-4415-86ed-ff9b464753f7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:33.664920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4673ab57-cc60-4415-86ed-ff9b464753f7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.665616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4673ab57-cc60-4415-86ed-ff9b464753f7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.666176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4673ab57-cc60-4415-86ed-ff9b464753f7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.667058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4673ab57-cc60-4415-86ed-ff9b464753f7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:33.667611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4673ab57-cc60-4415-86ed-ff9b464753f7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:33.668298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4673ab57-cc60-4415-86ed-ff9b464753f7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:33.728265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3ddea7ef-66fa-45a8-9636-1378802eb212 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:33.737831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3ddea7ef-66fa-45a8-9636-1378802eb212 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:33.746552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3ddea7ef-66fa-45a8-9636-1378802eb212 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:33.748216 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3ddea7ef-66fa-45a8-9636-1378802eb212 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.729960 Aug 29 15:28:33.749021 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 488/961] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:33 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:33.957005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4673ab57-cc60-4415-86ed-ff9b464753f7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:33.970450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4673ab57-cc60-4415-86ed-ff9b464753f7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:33.973030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4673ab57-cc60-4415-86ed-ff9b464753f7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:33.987575 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4673ab57-cc60-4415-86ed-ff9b464753f7 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.350632 Aug 29 15:28:34.006065 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 474/962] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:33 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:34.036240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5e1f6f25-d522-4818-94d2-c84c4e79f291 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:34.041954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c4d50419-c884-4503-8dae-29068ceb1d62 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:34.043019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c4d50419-c884-4503-8dae-29068ceb1d62 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:34.044051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5e1f6f25-d522-4818-94d2-c84c4e79f291 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:34.056613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e1f6f25-d522-4818-94d2-c84c4e79f291 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:34.058297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4d50419-c884-4503-8dae-29068ceb1d62 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:34.059083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e1f6f25-d522-4818-94d2-c84c4e79f291 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:34.059786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4d50419-c884-4503-8dae-29068ceb1d62 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:34.060444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e1f6f25-d522-4818-94d2-c84c4e79f291 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.061145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4d50419-c884-4503-8dae-29068ceb1d62 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.062147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e1f6f25-d522-4818-94d2-c84c4e79f291 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:34.063134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4d50419-c884-4503-8dae-29068ceb1d62 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:34.064013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e1f6f25-d522-4818-94d2-c84c4e79f291 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:34.064770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4d50419-c884-4503-8dae-29068ceb1d62 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:34.065557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4d50419-c884-4503-8dae-29068ceb1d62 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.066105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e1f6f25-d522-4818-94d2-c84c4e79f291 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.210908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c4d50419-c884-4503-8dae-29068ceb1d62 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:34.228757 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c4d50419-c884-4503-8dae-29068ceb1d62 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1317 microversion: 2.1 time: 0.189225 Aug 29 15:28:34.229990 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 475/963] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:34 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:34.317933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fde4c3c5-813d-42d2-9c64-707dec973b8a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bcb2160>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:34.395124 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fde4c3c5-813d-42d2-9c64-707dec973b8a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 0.079658 Aug 29 15:28:34.395904 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 476/964] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:34 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:34.655811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-df0c5b4d-20ac-4d05-957f-530b2da4fc59 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:34.656437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-df0c5b4d-20ac-4d05-957f-530b2da4fc59 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:34.676982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df0c5b4d-20ac-4d05-957f-530b2da4fc59 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:34.677744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df0c5b4d-20ac-4d05-957f-530b2da4fc59 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:34.680314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df0c5b4d-20ac-4d05-957f-530b2da4fc59 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.681138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df0c5b4d-20ac-4d05-957f-530b2da4fc59 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:34.681579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df0c5b4d-20ac-4d05-957f-530b2da4fc59 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:34.689718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df0c5b4d-20ac-4d05-957f-530b2da4fc59 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.871689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5e1f6f25-d522-4818-94d2-c84c4e79f291 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:34.894044 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5e1f6f25-d522-4818-94d2-c84c4e79f291 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1309 microversion: 2.1 time: 0.861655 Aug 29 15:28:34.913761 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 489/965] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:34 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1309 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:34.919834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0982cf7a-2b6d-4b48-b75a-a51b8c37e598 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:34.921509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0982cf7a-2b6d-4b48-b75a-a51b8c37e598 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:34.928901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0982cf7a-2b6d-4b48-b75a-a51b8c37e598 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:34.929812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0982cf7a-2b6d-4b48-b75a-a51b8c37e598 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:34.930495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0982cf7a-2b6d-4b48-b75a-a51b8c37e598 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.932147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0982cf7a-2b6d-4b48-b75a-a51b8c37e598 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:34.932870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0982cf7a-2b6d-4b48-b75a-a51b8c37e598 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:34.933584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0982cf7a-2b6d-4b48-b75a-a51b8c37e598 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:34.957282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-df0c5b4d-20ac-4d05-957f-530b2da4fc59 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:34.973727 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-df0c5b4d-20ac-4d05-957f-530b2da4fc59 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1274 microversion: 2.1 time: 0.322642 Aug 29 15:28:34.978118 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 477/966] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:34 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1274 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:35.017779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-19425469-f20d-4ca9-b517-95e0c3542dc0 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:35.019135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-19425469-f20d-4ca9-b517-95e0c3542dc0 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:35.049406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19425469-f20d-4ca9-b517-95e0c3542dc0 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.050458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19425469-f20d-4ca9-b517-95e0c3542dc0 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.051494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19425469-f20d-4ca9-b517-95e0c3542dc0 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:35.057907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19425469-f20d-4ca9-b517-95e0c3542dc0 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.060427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19425469-f20d-4ca9-b517-95e0c3542dc0 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.062015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19425469-f20d-4ca9-b517-95e0c3542dc0 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:35.294732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-19425469-f20d-4ca9-b517-95e0c3542dc0 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:35.313541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-19425469-f20d-4ca9-b517-95e0c3542dc0 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:35.315439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-19425469-f20d-4ca9-b517-95e0c3542dc0 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:35.321742 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-19425469-f20d-4ca9-b517-95e0c3542dc0 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.312057 Aug 29 15:28:35.322987 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 478/967] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:35 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:35.327893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a742758c-607e-49d7-b91b-0412b2cfe3c9 req-71b1ba35-2dc3-4661-b717-5b82551c59d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d3d180-599f-4c45-a0ea-53f2180484d5", "name": "network-vif-plugged", "status": "completed", "tag": "a173d34f-0b58-4d2d-91dc-183ed4b4d4a6"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:35.340460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a742758c-607e-49d7-b91b-0412b2cfe3c9 req-71b1ba35-2dc3-4661-b717-5b82551c59d8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.341358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a742758c-607e-49d7-b91b-0412b2cfe3c9 req-71b1ba35-2dc3-4661-b717-5b82551c59d8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.342610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a742758c-607e-49d7-b91b-0412b2cfe3c9 req-71b1ba35-2dc3-4661-b717-5b82551c59d8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:35.364863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:35.390059 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a742758c-607e-49d7-b91b-0412b2cfe3c9 req-71b1ba35-2dc3-4661-b717-5b82551c59d8 service nova] Creating event network-vif-plugged:a173d34f-0b58-4d2d-91dc-183ed4b4d4a6 for instance 45d3d180-599f-4c45-a0ea-53f2180484d5 on n-h2-839401-11 Aug 29 15:28:35.405615 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a742758c-607e-49d7-b91b-0412b2cfe3c9 req-71b1ba35-2dc3-4661-b717-5b82551c59d8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080875 Aug 29 15:28:35.414385 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 479/968] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:35.426075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d7e979a-628c-454b-8792-4dd30bac4064 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:35.428131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2d7e979a-628c-454b-8792-4dd30bac4064 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:35.441718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d7e979a-628c-454b-8792-4dd30bac4064 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.441971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d7e979a-628c-454b-8792-4dd30bac4064 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.444588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d7e979a-628c-454b-8792-4dd30bac4064 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:35.446500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d7e979a-628c-454b-8792-4dd30bac4064 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.449413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d7e979a-628c-454b-8792-4dd30bac4064 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.450064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d7e979a-628c-454b-8792-4dd30bac4064 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:35.588447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0982cf7a-2b6d-4b48-b75a-a51b8c37e598 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:35.607476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0982cf7a-2b6d-4b48-b75a-a51b8c37e598 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:35.609349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0982cf7a-2b6d-4b48-b75a-a51b8c37e598 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:35.610660 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0982cf7a-2b6d-4b48-b75a-a51b8c37e598 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1568 microversion: 2.25 time: 0.695417 Aug 29 15:28:35.617938 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 490/969] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:34 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1568 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:35.634186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d7e979a-628c-454b-8792-4dd30bac4064 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:35.643293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ec9bff9a-2d88-45f5-8b9d-ceaaeef7666c tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bafd700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:35.662216 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d7e979a-628c-454b-8792-4dd30bac4064 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1323 microversion: 2.1 time: 0.232667 Aug 29 15:28:35.667429 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 480/970] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:35 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1323 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:35.744439 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ec9bff9a-2d88-45f5-8b9d-ceaaeef7666c tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 0.112228 Aug 29 15:28:35.748494 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 491/971] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:35 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:35.918333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0b28241b-5afc-4062-a69c-9ce38c19ae52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:35.919985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0b28241b-5afc-4062-a69c-9ce38c19ae52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:35.932000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b28241b-5afc-4062-a69c-9ce38c19ae52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.945397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b28241b-5afc-4062-a69c-9ce38c19ae52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.946859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b28241b-5afc-4062-a69c-9ce38c19ae52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:35.949046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b28241b-5afc-4062-a69c-9ce38c19ae52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:35.952089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b28241b-5afc-4062-a69c-9ce38c19ae52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:35.954846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b28241b-5afc-4062-a69c-9ce38c19ae52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.003929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3cde00a7-bf1e-43e2-a60c-03ddda76a6d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:36.004680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3cde00a7-bf1e-43e2-a60c-03ddda76a6d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:36.018858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cde00a7-bf1e-43e2-a60c-03ddda76a6d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.025539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cde00a7-bf1e-43e2-a60c-03ddda76a6d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.026128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cde00a7-bf1e-43e2-a60c-03ddda76a6d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.031286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cde00a7-bf1e-43e2-a60c-03ddda76a6d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.033841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cde00a7-bf1e-43e2-a60c-03ddda76a6d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.035448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cde00a7-bf1e-43e2-a60c-03ddda76a6d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.385159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0b28241b-5afc-4062-a69c-9ce38c19ae52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:36.396702 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0b28241b-5afc-4062-a69c-9ce38c19ae52 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1492 microversion: 2.1 time: 0.485043 Aug 29 15:28:36.411017 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 481/972] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:35 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1492 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:36.428456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ffa60f72-6b50-40fe-8a52-8d0581d269ef tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:36.429101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ffa60f72-6b50-40fe-8a52-8d0581d269ef tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:36.455409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffa60f72-6b50-40fe-8a52-8d0581d269ef tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.456464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffa60f72-6b50-40fe-8a52-8d0581d269ef tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.457248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffa60f72-6b50-40fe-8a52-8d0581d269ef tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.466488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffa60f72-6b50-40fe-8a52-8d0581d269ef tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.467462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffa60f72-6b50-40fe-8a52-8d0581d269ef tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.468295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffa60f72-6b50-40fe-8a52-8d0581d269ef tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.712558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ffa60f72-6b50-40fe-8a52-8d0581d269ef tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:36.726893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ffa60f72-6b50-40fe-8a52-8d0581d269ef tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:36.731820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ffa60f72-6b50-40fe-8a52-8d0581d269ef tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:36.746501 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ffa60f72-6b50-40fe-8a52-8d0581d269ef tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.334370 Aug 29 15:28:36.748603 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 482/973] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:36 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:36.766467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-db07f84a-32c4-496c-a47e-c04dc09d9ac9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:36.767616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-db07f84a-32c4-496c-a47e-c04dc09d9ac9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:36.781792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db07f84a-32c4-496c-a47e-c04dc09d9ac9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.782671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db07f84a-32c4-496c-a47e-c04dc09d9ac9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.783316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db07f84a-32c4-496c-a47e-c04dc09d9ac9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:36.784233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db07f84a-32c4-496c-a47e-c04dc09d9ac9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:36.786209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db07f84a-32c4-496c-a47e-c04dc09d9ac9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:36.786945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db07f84a-32c4-496c-a47e-c04dc09d9ac9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.130653 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-db07f84a-32c4-496c-a47e-c04dc09d9ac9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1645 microversion: 2.1 time: 0.376261 Aug 29 15:28:37.135155 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 483/974] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:36 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1645 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:37.156303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e9dc5616-4d1c-4b4b-b61c-03a988e5990a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:37.164249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e9dc5616-4d1c-4b4b-b61c-03a988e5990a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:37.177601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9dc5616-4d1c-4b4b-b61c-03a988e5990a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.179547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9dc5616-4d1c-4b4b-b61c-03a988e5990a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.190954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3cde00a7-bf1e-43e2-a60c-03ddda76a6d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:37.203237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9dc5616-4d1c-4b4b-b61c-03a988e5990a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.204503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9dc5616-4d1c-4b4b-b61c-03a988e5990a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.208430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9dc5616-4d1c-4b4b-b61c-03a988e5990a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.208815 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3cde00a7-bf1e-43e2-a60c-03ddda76a6d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1316 microversion: 2.1 time: 1.205378 Aug 29 15:28:37.209732 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 492/975] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:35 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1316 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:37.210401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9dc5616-4d1c-4b4b-b61c-03a988e5990a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.233485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-56cc4e73-765a-4155-ab5a-b842c90a9f43 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:37.237342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-56cc4e73-765a-4155-ab5a-b842c90a9f43 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:37.260215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56cc4e73-765a-4155-ab5a-b842c90a9f43 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.263627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56cc4e73-765a-4155-ab5a-b842c90a9f43 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.265244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56cc4e73-765a-4155-ab5a-b842c90a9f43 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.275939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56cc4e73-765a-4155-ab5a-b842c90a9f43 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.276772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56cc4e73-765a-4155-ab5a-b842c90a9f43 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.278373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56cc4e73-765a-4155-ab5a-b842c90a9f43 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.477653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-56cc4e73-765a-4155-ab5a-b842c90a9f43 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:37.488432 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-56cc4e73-765a-4155-ab5a-b842c90a9f43 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1323 microversion: 2.1 time: 0.276121 Aug 29 15:28:37.493655 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 493/976] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:37 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1323 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:37.511278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b771555a-e3fa-4d7a-8445-27a9b31508aa tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bbda700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:37.802082 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b771555a-e3fa-4d7a-8445-27a9b31508aa tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 0.300546 Aug 29 15:28:37.809815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e9dc5616-4d1c-4b4b-b61c-03a988e5990a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:37.821402 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 494/977] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:37 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:37.832461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e9dc5616-4d1c-4b4b-b61c-03a988e5990a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:37.835959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e9dc5616-4d1c-4b4b-b61c-03a988e5990a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:37.837979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6242e48c-6381-454d-9ac8-3fddcb79fe07 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:37.842374 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e9dc5616-4d1c-4b4b-b61c-03a988e5990a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1543 microversion: 2.25 time: 0.690447 Aug 29 15:28:37.843140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6242e48c-6381-454d-9ac8-3fddcb79fe07 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:37.850941 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 484/978] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:37 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1543 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:37.866405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6242e48c-6381-454d-9ac8-3fddcb79fe07 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.869383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-329408e0-d620-49db-afe6-83e4bd311385 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:37.870075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6242e48c-6381-454d-9ac8-3fddcb79fe07 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.871774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6242e48c-6381-454d-9ac8-3fddcb79fe07 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.876931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-329408e0-d620-49db-afe6-83e4bd311385 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:37.878038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6242e48c-6381-454d-9ac8-3fddcb79fe07 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.880932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6242e48c-6381-454d-9ac8-3fddcb79fe07 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.881711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6242e48c-6381-454d-9ac8-3fddcb79fe07 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.895203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-329408e0-d620-49db-afe6-83e4bd311385 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.898438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-329408e0-d620-49db-afe6-83e4bd311385 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.901922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-329408e0-d620-49db-afe6-83e4bd311385 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:37.902904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-329408e0-d620-49db-afe6-83e4bd311385 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:37.903526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-329408e0-d620-49db-afe6-83e4bd311385 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:37.912119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-329408e0-d620-49db-afe6-83e4bd311385 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:38.174097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-329408e0-d620-49db-afe6-83e4bd311385 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:38.189797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-329408e0-d620-49db-afe6-83e4bd311385 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:38.191487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-329408e0-d620-49db-afe6-83e4bd311385 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:38.213149 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-329408e0-d620-49db-afe6-83e4bd311385 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.360554 Aug 29 15:28:38.215115 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 485/979] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:37 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:38.222895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b2698035-a22f-4dbb-9657-394aa8f809b9 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '.version_select at 0x7fc42bcd5f70>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:38.241929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2698035-a22f-4dbb-9657-394aa8f809b9 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:38.242515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2698035-a22f-4dbb-9657-394aa8f809b9 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:38.256266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2698035-a22f-4dbb-9657-394aa8f809b9 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:38.277797 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b2698035-a22f-4dbb-9657-394aa8f809b9 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/os-migrations" status: 200 len: 1532 microversion: 2.25 time: 0.058525 Aug 29 15:28:38.296382 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 486/980] 10.222.0.62 () {60 vars in 1184 bytes} [Mon Aug 29 15:28:38 2022] GET /compute/v2.1/os-migrations => generated 1532 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:38.306596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0d23c030-0bf6-4dad-9f62-d348c2c45fc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:38.307201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0d23c030-0bf6-4dad-9f62-d348c2c45fc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:38.341105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d23c030-0bf6-4dad-9f62-d348c2c45fc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:38.342115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d23c030-0bf6-4dad-9f62-d348c2c45fc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:38.345657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d23c030-0bf6-4dad-9f62-d348c2c45fc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:38.347827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d23c030-0bf6-4dad-9f62-d348c2c45fc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:38.348557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d23c030-0bf6-4dad-9f62-d348c2c45fc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:38.352095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d23c030-0bf6-4dad-9f62-d348c2c45fc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:38.872426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0d23c030-0bf6-4dad-9f62-d348c2c45fc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:38.892186 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0d23c030-0bf6-4dad-9f62-d348c2c45fc7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1316 microversion: 2.1 time: 0.594475 Aug 29 15:28:38.912206 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 487/981] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:38 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1316 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:38.930841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-45ae3618-2b99-4f34-9261-c572cb9166e2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:38.947001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-45ae3618-2b99-4f34-9261-c572cb9166e2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:38.975579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45ae3618-2b99-4f34-9261-c572cb9166e2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:38.990382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45ae3618-2b99-4f34-9261-c572cb9166e2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:38.991470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45ae3618-2b99-4f34-9261-c572cb9166e2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:38.992272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45ae3618-2b99-4f34-9261-c572cb9166e2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:38.992753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45ae3618-2b99-4f34-9261-c572cb9166e2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:38.993233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45ae3618-2b99-4f34-9261-c572cb9166e2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:39.274118 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6242e48c-6381-454d-9ac8-3fddcb79fe07 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1645 microversion: 2.1 time: 1.451117 Aug 29 15:28:39.280002 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 495/982] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:37 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1645 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:39.298134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3c769897-6960-434b-bc67-73b163e61d3f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:39.302572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3c769897-6960-434b-bc67-73b163e61d3f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:39.326476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c769897-6960-434b-bc67-73b163e61d3f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:39.326984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c769897-6960-434b-bc67-73b163e61d3f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:39.327433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c769897-6960-434b-bc67-73b163e61d3f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:39.347249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c769897-6960-434b-bc67-73b163e61d3f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:39.347799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c769897-6960-434b-bc67-73b163e61d3f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:39.348256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c769897-6960-434b-bc67-73b163e61d3f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:39.626711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:39.688689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3c769897-6960-434b-bc67-73b163e61d3f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:39.725841 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3c769897-6960-434b-bc67-73b163e61d3f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1323 microversion: 2.1 time: 0.444228 Aug 29 15:28:39.734910 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 496/983] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:39 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1323 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:39.749317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-45ae3618-2b99-4f34-9261-c572cb9166e2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'services' on Instance uuid 4cf46166-597d-4649-a09a-600d8c57524d {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:39.772250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-69cad9dd-c953-4a29-b4f4-2bd921e8be52 req-a5493020-2b63-416d-8ba8-ba7a88380db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f44b5e-bcae-4e95-a11a-c781e6cf06df", "name": "network-vif-deleted", "tag": "3f638867-a674-40ea-b7b1-b095f9393504"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:39.789202 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-45ae3618-2b99-4f34-9261-c572cb9166e2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 2038 microversion: 2.25 time: 0.875314 Aug 29 15:28:39.790225 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 488/984] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:38 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 2038 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:39.808797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-69cad9dd-c953-4a29-b4f4-2bd921e8be52 req-a5493020-2b63-416d-8ba8-ba7a88380db6 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:39.809816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-69cad9dd-c953-4a29-b4f4-2bd921e8be52 req-a5493020-2b63-416d-8ba8-ba7a88380db6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:39.812421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-69cad9dd-c953-4a29-b4f4-2bd921e8be52 req-a5493020-2b63-416d-8ba8-ba7a88380db6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:39.817004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-084d0fb7-c0dc-4ab5-bbc2-ec7e3ac2a020 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bfabc10>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:39.863621 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-69cad9dd-c953-4a29-b4f4-2bd921e8be52 req-a5493020-2b63-416d-8ba8-ba7a88380db6 service nova] Creating event network-vif-deleted:3f638867-a674-40ea-b7b1-b095f9393504 for instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df on n-h2-839401-11 Aug 29 15:28:39.874710 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-69cad9dd-c953-4a29-b4f4-2bd921e8be52 req-a5493020-2b63-416d-8ba8-ba7a88380db6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108677 Aug 29 15:28:39.875372 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 497/985] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:39.883599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f556d2fd-34a5-4cc3-be67-4dc35bd2c7ff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:39.884612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f556d2fd-34a5-4cc3-be67-4dc35bd2c7ff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:39.894159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f556d2fd-34a5-4cc3-be67-4dc35bd2c7ff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:39.896629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f556d2fd-34a5-4cc3-be67-4dc35bd2c7ff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:39.898420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f556d2fd-34a5-4cc3-be67-4dc35bd2c7ff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:39.899554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f556d2fd-34a5-4cc3-be67-4dc35bd2c7ff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:39.900204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f556d2fd-34a5-4cc3-be67-4dc35bd2c7ff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:39.900797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f556d2fd-34a5-4cc3-be67-4dc35bd2c7ff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:40.061220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f556d2fd-34a5-4cc3-be67-4dc35bd2c7ff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:40.080024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f556d2fd-34a5-4cc3-be67-4dc35bd2c7ff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:40.091129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f556d2fd-34a5-4cc3-be67-4dc35bd2c7ff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:40.104449 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f556d2fd-34a5-4cc3-be67-4dc35bd2c7ff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1447 microversion: 2.75 time: 0.225003 Aug 29 15:28:40.129490 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 498/986] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:39 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1447 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:40.139143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c2b40edc-0f6c-4c67-897a-cc0fe62500f5 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:40.143539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c2b40edc-0f6c-4c67-897a-cc0fe62500f5 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:40.154695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c2b40edc-0f6c-4c67-897a-cc0fe62500f5 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:40.155735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c2b40edc-0f6c-4c67-897a-cc0fe62500f5 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:40.157590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c2b40edc-0f6c-4c67-897a-cc0fe62500f5 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:40.174929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c2b40edc-0f6c-4c67-897a-cc0fe62500f5 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:40.175780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c2b40edc-0f6c-4c67-897a-cc0fe62500f5 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:40.252090 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c2b40edc-0f6c-4c67-897a-cc0fe62500f5 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.121383 Aug 29 15:28:40.260012 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 499/987] 10.222.0.62 () {58 vars in 1176 bytes} [Mon Aug 29 15:28:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:40.274316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5abeae6f-e398-46fd-a12b-71001241f3c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Action: 'create', calling method: .version_select at 0x7fc430150430>, body: {"keypair": {"name": "tempest-keypair-1134045687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrWrTXMz3lWiVK1+4pWWarE8ZlxnnwnridjxfN9q6qaAQbcm6igSRqaCDeknJBuOiX0SFXyZggc64Dxiooj2gIDslP6HqrxusEvy8C4fP1vf7e9BI0snleeASrv6wHz6A=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:40.333653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5abeae6f-e398-46fd-a12b-71001241f3c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Getting quotas for project ef5a2735bd95451ab466c5560cbe28fe. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:40.340012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5abeae6f-e398-46fd-a12b-71001241f3c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Getting quotas for user 9011569d41804e27a53fe5831988a88a and project ef5a2735bd95451ab466c5560cbe28fe. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:40.348458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:40.435942 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5abeae6f-e398-46fd-a12b-71001241f3c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.174651 Aug 29 15:28:40.439543 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 500/988] 10.222.0.62 () {62 vars in 1200 bytes} [Mon Aug 29 15:28:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:28:40.466946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-26617805-4c52-4b7a-af1f-bd9f8aa70eba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:40.467648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-26617805-4c52-4b7a-af1f-bd9f8aa70eba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:40.508592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26617805-4c52-4b7a-af1f-bd9f8aa70eba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:40.509366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26617805-4c52-4b7a-af1f-bd9f8aa70eba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:40.510061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26617805-4c52-4b7a-af1f-bd9f8aa70eba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:40.512840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26617805-4c52-4b7a-af1f-bd9f8aa70eba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:40.517711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26617805-4c52-4b7a-af1f-bd9f8aa70eba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:40.525741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26617805-4c52-4b7a-af1f-bd9f8aa70eba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:41.359983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-26617805-4c52-4b7a-af1f-bd9f8aa70eba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:41.382375 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-26617805-4c52-4b7a-af1f-bd9f8aa70eba tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1316 microversion: 2.1 time: 0.939519 Aug 29 15:28:41.388063 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 501/989] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:40 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1316 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:41.396228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bc342f4a-dfa2-484c-9238-d4cea18945b0 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:41.401653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bc342f4a-dfa2-484c-9238-d4cea18945b0 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:41.451364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc342f4a-dfa2-484c-9238-d4cea18945b0 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:41.452139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc342f4a-dfa2-484c-9238-d4cea18945b0 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:41.452709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc342f4a-dfa2-484c-9238-d4cea18945b0 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:41.456690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc342f4a-dfa2-484c-9238-d4cea18945b0 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:41.457589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc342f4a-dfa2-484c-9238-d4cea18945b0 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:41.458358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc342f4a-dfa2-484c-9238-d4cea18945b0 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:41.711446 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bc342f4a-dfa2-484c-9238-d4cea18945b0 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7/action" status: 202 len: 0 microversion: 2.1 time: 0.321774 Aug 29 15:28:41.721885 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 502/990] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:28:41 2022] POST /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:28:41.735133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ff4a93da-25f8-4d2e-a2e1-2091fa0aaef7 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:41.749477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ff4a93da-25f8-4d2e-a2e1-2091fa0aaef7 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:41.785620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff4a93da-25f8-4d2e-a2e1-2091fa0aaef7 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:41.787199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff4a93da-25f8-4d2e-a2e1-2091fa0aaef7 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:41.788461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff4a93da-25f8-4d2e-a2e1-2091fa0aaef7 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:41.792034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff4a93da-25f8-4d2e-a2e1-2091fa0aaef7 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:41.796151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff4a93da-25f8-4d2e-a2e1-2091fa0aaef7 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:41.796939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff4a93da-25f8-4d2e-a2e1-2091fa0aaef7 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:41.819175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:41.888925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:42.776584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ff4a93da-25f8-4d2e-a2e1-2091fa0aaef7 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:42.789520 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ff4a93da-25f8-4d2e-a2e1-2091fa0aaef7 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1391 microversion: 2.1 time: 1.063658 Aug 29 15:28:42.796305 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 503/991] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:41 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1391 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:42.801643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-30c60112-9c81-492b-b13f-57d43c0ab4dd tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:42.803980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-30c60112-9c81-492b-b13f-57d43c0ab4dd tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:42.820755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30c60112-9c81-492b-b13f-57d43c0ab4dd tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:42.821660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30c60112-9c81-492b-b13f-57d43c0ab4dd tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:42.822288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30c60112-9c81-492b-b13f-57d43c0ab4dd tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:42.823248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30c60112-9c81-492b-b13f-57d43c0ab4dd tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:42.823890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30c60112-9c81-492b-b13f-57d43c0ab4dd tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:42.825978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30c60112-9c81-492b-b13f-57d43c0ab4dd tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:42.834177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:43.047450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-30c60112-9c81-492b-b13f-57d43c0ab4dd tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:43.068490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-30c60112-9c81-492b-b13f-57d43c0ab4dd tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:43.070381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-30c60112-9c81-492b-b13f-57d43c0ab4dd tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:43.085537 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-30c60112-9c81-492b-b13f-57d43c0ab4dd tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1453 microversion: 2.75 time: 0.287766 Aug 29 15:28:43.086685 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 504/992] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:42 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1453 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:43.091426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b0e3fd6-04a4-4344-afe0-9c8535490d16 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:43.092267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4b0e3fd6-04a4-4344-afe0-9c8535490d16 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:43.099415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b0e3fd6-04a4-4344-afe0-9c8535490d16 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:43.100118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b0e3fd6-04a4-4344-afe0-9c8535490d16 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:43.100713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b0e3fd6-04a4-4344-afe0-9c8535490d16 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:43.101645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b0e3fd6-04a4-4344-afe0-9c8535490d16 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:43.102262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b0e3fd6-04a4-4344-afe0-9c8535490d16 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:43.102901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b0e3fd6-04a4-4344-afe0-9c8535490d16 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:43.703358 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4b0e3fd6-04a4-4344-afe0-9c8535490d16 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1630 microversion: 2.1 time: 0.615387 Aug 29 15:28:43.708559 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 505/993] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:43 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1630 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:43.717638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-95e0969a-8d70-4116-80ce-1018c1ba863e req-003358e4-421e-4c7c-bb6a-a8d4740a4a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846c548e-ff1e-48f9-ac29-a5c464d824f5", "tag": "ced95222-d171-4206-b2e5-08be8cf02bfb"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:43.740582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-95e0969a-8d70-4116-80ce-1018c1ba863e req-003358e4-421e-4c7c-bb6a-a8d4740a4a68 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:43.741165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-95e0969a-8d70-4116-80ce-1018c1ba863e req-003358e4-421e-4c7c-bb6a-a8d4740a4a68 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:43.741603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-95e0969a-8d70-4116-80ce-1018c1ba863e req-003358e4-421e-4c7c-bb6a-a8d4740a4a68 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:43.767976 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-95e0969a-8d70-4116-80ce-1018c1ba863e req-003358e4-421e-4c7c-bb6a-a8d4740a4a68 service nova] Creating event network-changed:ced95222-d171-4206-b2e5-08be8cf02bfb for instance 846c548e-ff1e-48f9-ac29-a5c464d824f5 on n-h1-839401-11 Aug 29 15:28:43.777398 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-95e0969a-8d70-4116-80ce-1018c1ba863e req-003358e4-421e-4c7c-bb6a-a8d4740a4a68 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064588 Aug 29 15:28:43.778379 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 506/994] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:43.797462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2d0cb2db-50af-4a0f-9db7-06ff75dfd459 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:43.798228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2d0cb2db-50af-4a0f-9db7-06ff75dfd459 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:43.804596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d0cb2db-50af-4a0f-9db7-06ff75dfd459 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:43.805121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d0cb2db-50af-4a0f-9db7-06ff75dfd459 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:43.805563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d0cb2db-50af-4a0f-9db7-06ff75dfd459 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:43.806351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d0cb2db-50af-4a0f-9db7-06ff75dfd459 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:43.806814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d0cb2db-50af-4a0f-9db7-06ff75dfd459 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:43.812765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d0cb2db-50af-4a0f-9db7-06ff75dfd459 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:44.460925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2d0cb2db-50af-4a0f-9db7-06ff75dfd459 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:44.469043 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2d0cb2db-50af-4a0f-9db7-06ff75dfd459 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1316 microversion: 2.1 time: 0.689839 Aug 29 15:28:44.480392 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 507/995] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:43 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1316 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:44.485534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8fea60ad-e719-4bff-b88b-ffefa719d930 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-839401-11", "block_migration": true, "disk_over_commit": false}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:44.494539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8fea60ad-e719-4bff-b88b-ffefa719d930 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:44.516619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fea60ad-e719-4bff-b88b-ffefa719d930 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:44.520344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fea60ad-e719-4bff-b88b-ffefa719d930 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:44.522257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fea60ad-e719-4bff-b88b-ffefa719d930 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:44.525185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fea60ad-e719-4bff-b88b-ffefa719d930 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:44.526068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fea60ad-e719-4bff-b88b-ffefa719d930 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:44.526697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fea60ad-e719-4bff-b88b-ffefa719d930 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:44.577919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-8fea60ad-e719-4bff-b88b-ffefa719d930 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lazy-loading 'flavor' on Instance uuid b00ee0c9-6348-4a38-a096-53fcbded92c7 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:44.646941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8fea60ad-e719-4bff-b88b-ffefa719d930 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Going to try to live migrate instance to n-h2-839401-11 {{(pid=122361) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:28:46.283952 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-084d0fb7-c0dc-4ab5-bbc2-ec7e3ac2a020 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 6.478740 Aug 29 15:28:46.285522 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 489/996] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:39 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 6481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:46.290687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3999dad6-0950-4fa3-8f0a-c4609470812a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:46.291616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3999dad6-0950-4fa3-8f0a-c4609470812a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:46.293904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:46.300863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3999dad6-0950-4fa3-8f0a-c4609470812a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:46.301798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3999dad6-0950-4fa3-8f0a-c4609470812a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:46.302539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3999dad6-0950-4fa3-8f0a-c4609470812a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:46.303488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3999dad6-0950-4fa3-8f0a-c4609470812a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:46.304272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3999dad6-0950-4fa3-8f0a-c4609470812a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:46.304908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3999dad6-0950-4fa3-8f0a-c4609470812a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:46.579924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3999dad6-0950-4fa3-8f0a-c4609470812a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:46.592568 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3999dad6-0950-4fa3-8f0a-c4609470812a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1391 microversion: 2.1 time: 0.305270 Aug 29 15:28:46.606155 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 490/997] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:46 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1391 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:46.611727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1644848705", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "26d82d80-e2bf-4b2e-bd4a-38c04c1b6f6c"}], "security_groups": [{"name": "tempest-securitygroup--997042928"}], "key_name": "tempest-keypair-1134045687", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:46.795805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] validate_networks() for [('26d82d80-e2bf-4b2e-bd4a-38c04c1b6f6c', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:28:47.371744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:28:47.375481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:28:47.376081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:28:47.376611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:28:47.377243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:28:47.393943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:47.394880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:47.395605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:47.396566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:47.397317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:47.397957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:47.416470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Getting quotas for project ef5a2735bd95451ab466c5560cbe28fe. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:47.424740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Getting quotas for user 9011569d41804e27a53fe5831988a88a and project ef5a2735bd95451ab466c5560cbe28fe. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:47.445946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:28:47.449059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:28:47.524227 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-db834ed7-b1fc-4968-829d-e3b62dd49b80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 0.916580 Aug 29 15:28:47.525602 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 491/998] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:28:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:28:47.531446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-82683a9d-455e-4f7c-8443-f611d8929cde tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:47.532405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-82683a9d-455e-4f7c-8443-f611d8929cde tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:47.539597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82683a9d-455e-4f7c-8443-f611d8929cde tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:47.540484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82683a9d-455e-4f7c-8443-f611d8929cde tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:47.541426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82683a9d-455e-4f7c-8443-f611d8929cde tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:47.542371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82683a9d-455e-4f7c-8443-f611d8929cde tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:47.543134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82683a9d-455e-4f7c-8443-f611d8929cde tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:47.543763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82683a9d-455e-4f7c-8443-f611d8929cde tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:47.643501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-82683a9d-455e-4f7c-8443-f611d8929cde tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:47.659305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-82683a9d-455e-4f7c-8443-f611d8929cde tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:47.661055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-82683a9d-455e-4f7c-8443-f611d8929cde tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:47.673936 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-82683a9d-455e-4f7c-8443-f611d8929cde tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1453 microversion: 2.75 time: 0.146945 Aug 29 15:28:47.675504 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 492/999] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:47 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:47.686361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3737a6c1-5843-4f1e-9dcb-1acf8ae5e145 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:47.687019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3737a6c1-5843-4f1e-9dcb-1acf8ae5e145 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:47.698341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3737a6c1-5843-4f1e-9dcb-1acf8ae5e145 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:47.698839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3737a6c1-5843-4f1e-9dcb-1acf8ae5e145 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:47.699281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3737a6c1-5843-4f1e-9dcb-1acf8ae5e145 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:47.699986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3737a6c1-5843-4f1e-9dcb-1acf8ae5e145 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:47.703365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3737a6c1-5843-4f1e-9dcb-1acf8ae5e145 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:47.706094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3737a6c1-5843-4f1e-9dcb-1acf8ae5e145 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:48.023071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3737a6c1-5843-4f1e-9dcb-1acf8ae5e145 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:48.038751 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3737a6c1-5843-4f1e-9dcb-1acf8ae5e145 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1316 microversion: 2.1 time: 0.361861 Aug 29 15:28:48.040117 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 493/1000] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:47 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:48.045344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-47a9c7e6-ebb8-42e0-b104-3eea66715f9d req-d1fe2597-7324-42c7-85c2-77142f8852f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c480235-81a3-46b9-9ea6-520b329f53ea", "tag": "eea42a7e-66fa-41cc-a051-b6c158f38c7c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:48.056542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-47a9c7e6-ebb8-42e0-b104-3eea66715f9d req-d1fe2597-7324-42c7-85c2-77142f8852f6 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:48.057276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-47a9c7e6-ebb8-42e0-b104-3eea66715f9d req-d1fe2597-7324-42c7-85c2-77142f8852f6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:48.057870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-47a9c7e6-ebb8-42e0-b104-3eea66715f9d req-d1fe2597-7324-42c7-85c2-77142f8852f6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:48.074872 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-47a9c7e6-ebb8-42e0-b104-3eea66715f9d req-d1fe2597-7324-42c7-85c2-77142f8852f6 service nova] Creating event network-changed:eea42a7e-66fa-41cc-a051-b6c158f38c7c for instance 6c480235-81a3-46b9-9ea6-520b329f53ea on n-h2-839401-11 Aug 29 15:28:48.081540 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-47a9c7e6-ebb8-42e0-b104-3eea66715f9d req-d1fe2597-7324-42c7-85c2-77142f8852f6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040003 Aug 29 15:28:48.083550 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 494/1001] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:48.509789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d719abf0-b300-431a-bb26-2680fe498ff2 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Action: 'create', calling method: .version_select at 0x7fc42bc9b310>, body: {"keypair": {"name": "tempest-keypair-309886493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLK/kOg34C0u2DzGcAofGvExD7EhPMHL4rJTK4a+jt6NAmn9sSsQRjXnCyr+yCkIJ7ZfL+SZ3MpPUgncdndivuwYOnw2MvjjRWtDA11xVTBcVWrpIpNBzR4HIwm1kpDjhw=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:48.572704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-d719abf0-b300-431a-bb26-2680fe498ff2 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Getting quotas for project a6d0bc73ee9d4bf1b0e7bf868e2aecea. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:48.610467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-d719abf0-b300-431a-bb26-2680fe498ff2 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Getting quotas for user d929ec7ad45747078b9f28392e133c5b and project a6d0bc73ee9d4bf1b0e7bf868e2aecea. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:48.704840 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d719abf0-b300-431a-bb26-2680fe498ff2 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.615435 Aug 29 15:28:48.707053 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 495/1002] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:28:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:48.730602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-14652ddd-4999-4cd3-a578-9572a1995f31 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bc241f0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:48.818699 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-14652ddd-4999-4cd3-a578-9572a1995f31 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 0.107972 Aug 29 15:28:48.819784 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 496/1003] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:48 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:48.838255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d031d386-1443-4bc9-a1e2-51fd669f9256 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:48.839245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d031d386-1443-4bc9-a1e2-51fd669f9256 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:48.867269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d031d386-1443-4bc9-a1e2-51fd669f9256 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:48.868087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d031d386-1443-4bc9-a1e2-51fd669f9256 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:48.868730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d031d386-1443-4bc9-a1e2-51fd669f9256 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:48.870005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d031d386-1443-4bc9-a1e2-51fd669f9256 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:48.870636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d031d386-1443-4bc9-a1e2-51fd669f9256 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:48.871229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d031d386-1443-4bc9-a1e2-51fd669f9256 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:49.009368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d031d386-1443-4bc9-a1e2-51fd669f9256 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:49.020423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d031d386-1443-4bc9-a1e2-51fd669f9256 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:49.026393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d031d386-1443-4bc9-a1e2-51fd669f9256 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:49.033959 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d031d386-1443-4bc9-a1e2-51fd669f9256 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1338 microversion: 2.25 time: 0.199802 Aug 29 15:28:49.036403 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 497/1004] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:48 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1338 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:49.064133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-49ceb671-0574-4ab6-ba3c-0242ba1dcd4f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:49.064606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-49ceb671-0574-4ab6-ba3c-0242ba1dcd4f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:49.076441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49ceb671-0574-4ab6-ba3c-0242ba1dcd4f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:49.078627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49ceb671-0574-4ab6-ba3c-0242ba1dcd4f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:49.084160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49ceb671-0574-4ab6-ba3c-0242ba1dcd4f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:49.087711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49ceb671-0574-4ab6-ba3c-0242ba1dcd4f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:49.088440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49ceb671-0574-4ab6-ba3c-0242ba1dcd4f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:49.089045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49ceb671-0574-4ab6-ba3c-0242ba1dcd4f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:49.411934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-49ceb671-0574-4ab6-ba3c-0242ba1dcd4f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:49.422563 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-49ceb671-0574-4ab6-ba3c-0242ba1dcd4f tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1391 microversion: 2.1 time: 0.384815 Aug 29 15:28:49.437244 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 498/1005] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:49 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1391 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:49.442936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a1ab17e6-5867-4843-ad24-ef31e7c5b8a6 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:49.443591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a1ab17e6-5867-4843-ad24-ef31e7c5b8a6 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:49.450922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ab17e6-5867-4843-ad24-ef31e7c5b8a6 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:49.451412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ab17e6-5867-4843-ad24-ef31e7c5b8a6 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:49.452361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ab17e6-5867-4843-ad24-ef31e7c5b8a6 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:49.453101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ab17e6-5867-4843-ad24-ef31e7c5b8a6 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:49.453568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ab17e6-5867-4843-ad24-ef31e7c5b8a6 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:49.453994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ab17e6-5867-4843-ad24-ef31e7c5b8a6 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:49.535193 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8fea60ad-e719-4bff-b88b-ffefa719d930 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7/action" status: 202 len: 0 microversion: 2.1 time: 5.053269 Aug 29 15:28:49.536159 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 508/1006] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:28:44 2022] POST /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7/action => generated 0 bytes in 5055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:28:49.541049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-13fff33b-c8e1-4403-a59e-b087cf2abe0f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:49.541692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-13fff33b-c8e1-4403-a59e-b087cf2abe0f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:49.554597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a1ab17e6-5867-4843-ad24-ef31e7c5b8a6 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:49.565792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-13fff33b-c8e1-4403-a59e-b087cf2abe0f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:49.570183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-13fff33b-c8e1-4403-a59e-b087cf2abe0f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:49.571622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-13fff33b-c8e1-4403-a59e-b087cf2abe0f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:49.574143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-13fff33b-c8e1-4403-a59e-b087cf2abe0f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:49.575419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-13fff33b-c8e1-4403-a59e-b087cf2abe0f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:49.576537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-13fff33b-c8e1-4403-a59e-b087cf2abe0f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:49.586952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a1ab17e6-5867-4843-ad24-ef31e7c5b8a6 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:49.591622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a1ab17e6-5867-4843-ad24-ef31e7c5b8a6 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:49.613619 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a1ab17e6-5867-4843-ad24-ef31e7c5b8a6 tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1438 microversion: 2.75 time: 0.175097 Aug 29 15:28:49.614221 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 499/1007] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:49 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1438 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:49.641160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-83fd956f-1664-4e45-b1aa-2e558affe4af tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:49.646936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-83fd956f-1664-4e45-b1aa-2e558affe4af tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:49.665367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83fd956f-1664-4e45-b1aa-2e558affe4af tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:49.669270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83fd956f-1664-4e45-b1aa-2e558affe4af tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:49.671921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83fd956f-1664-4e45-b1aa-2e558affe4af tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:49.675959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83fd956f-1664-4e45-b1aa-2e558affe4af tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:49.676822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83fd956f-1664-4e45-b1aa-2e558affe4af tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:49.685714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83fd956f-1664-4e45-b1aa-2e558affe4af tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:50.009200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-83fd956f-1664-4e45-b1aa-2e558affe4af tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:50.009787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-13fff33b-c8e1-4403-a59e-b087cf2abe0f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:50.037977 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-83fd956f-1664-4e45-b1aa-2e558affe4af tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.416410 Aug 29 15:28:50.038498 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-13fff33b-c8e1-4403-a59e-b087cf2abe0f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1316 microversion: 2.1 time: 0.500682 Aug 29 15:28:50.041753 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 500/1008] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:49 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:50.053207 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 509/1009] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:49 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:50.058693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-08bc697d-3874-4a55-955e-7d7bf9581953 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42ba45a60>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:50.124289 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-08bc697d-3874-4a55-955e-7d7bf9581953 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 0.069897 Aug 29 15:28:50.137032 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 510/1010] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:50 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:50.148715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4a668cb9-ad1d-47d9-9d1a-9bea2b6cbbb6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:50.149615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4a668cb9-ad1d-47d9-9d1a-9bea2b6cbbb6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:50.158093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a668cb9-ad1d-47d9-9d1a-9bea2b6cbbb6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:50.158961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a668cb9-ad1d-47d9-9d1a-9bea2b6cbbb6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:50.159566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a668cb9-ad1d-47d9-9d1a-9bea2b6cbbb6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:50.160442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a668cb9-ad1d-47d9-9d1a-9bea2b6cbbb6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:50.161123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a668cb9-ad1d-47d9-9d1a-9bea2b6cbbb6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:50.161698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a668cb9-ad1d-47d9-9d1a-9bea2b6cbbb6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:50.194261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:50.240350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:50.243566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:50.255247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:50.255766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:50.256414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:50.257171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:50.257641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:50.258073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:50.268939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:50.354869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4a668cb9-ad1d-47d9-9d1a-9bea2b6cbbb6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:50.364611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=14 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:50.383872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4a668cb9-ad1d-47d9-9d1a-9bea2b6cbbb6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:50.390277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4a668cb9-ad1d-47d9-9d1a-9bea2b6cbbb6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:50.394753 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4a668cb9-ad1d-47d9-9d1a-9bea2b6cbbb6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1344 microversion: 2.25 time: 0.252914 Aug 29 15:28:50.401331 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 511/1011] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:50 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1344 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:50.436458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:28:50.438632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:28:50.445672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-69964fd7-25a1-426a-bfd4-4e26c4a1261c tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:50.447909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-69964fd7-25a1-426a-bfd4-4e26c4a1261c tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:50.461034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:28:50.462601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:28:50.464197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:28:50.469775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69964fd7-25a1-426a-bfd4-4e26c4a1261c tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:50.471359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69964fd7-25a1-426a-bfd4-4e26c4a1261c tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:50.471822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69964fd7-25a1-426a-bfd4-4e26c4a1261c tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:50.472620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69964fd7-25a1-426a-bfd4-4e26c4a1261c tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:50.473111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69964fd7-25a1-426a-bfd4-4e26c4a1261c tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:50.480096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69964fd7-25a1-426a-bfd4-4e26c4a1261c tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:50.635832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:50.645822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:50.646784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:50.647450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:50.648380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:50.649044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:50.649774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:51.032940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:51.098753 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-64f3a349-a905-4e3c-bb2a-5c56b08b47fc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0/action" status: 202 len: 1944 microversion: 2.75 time: 1.055500 Aug 29 15:28:51.101355 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 501/1012] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 15:28:50 2022] POST /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0/action => generated 1944 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 15:28:51.116110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-56751a21-2937-4674-9b5f-32135263ffd6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:51.120230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-56751a21-2937-4674-9b5f-32135263ffd6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:51.131083 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56751a21-2937-4674-9b5f-32135263ffd6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:51.139874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56751a21-2937-4674-9b5f-32135263ffd6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:51.140431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56751a21-2937-4674-9b5f-32135263ffd6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:51.141221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56751a21-2937-4674-9b5f-32135263ffd6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:51.141691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56751a21-2937-4674-9b5f-32135263ffd6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:51.145142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56751a21-2937-4674-9b5f-32135263ffd6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:51.260632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-69964fd7-25a1-426a-bfd4-4e26c4a1261c tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:51.271902 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-69964fd7-25a1-426a-bfd4-4e26c4a1261c tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1391 microversion: 2.1 time: 0.831406 Aug 29 15:28:51.276337 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 512/1013] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:50 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1391 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:51.281445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-122bd6cd-b1b2-4d8b-8b54-7bc3f7b3cce2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:51.282063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-122bd6cd-b1b2-4d8b-8b54-7bc3f7b3cce2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:51.297695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-122bd6cd-b1b2-4d8b-8b54-7bc3f7b3cce2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:51.301794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-122bd6cd-b1b2-4d8b-8b54-7bc3f7b3cce2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:51.302435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-122bd6cd-b1b2-4d8b-8b54-7bc3f7b3cce2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:51.303425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-122bd6cd-b1b2-4d8b-8b54-7bc3f7b3cce2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:51.304046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-122bd6cd-b1b2-4d8b-8b54-7bc3f7b3cce2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:51.307033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-122bd6cd-b1b2-4d8b-8b54-7bc3f7b3cce2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:51.451382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-56751a21-2937-4674-9b5f-32135263ffd6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:51.465041 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-56751a21-2937-4674-9b5f-32135263ffd6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.361892 Aug 29 15:28:51.465643 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 502/1014] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:51 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:51.487354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-87776dd2-636d-46dc-859a-722b9ccaa1db tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:51.487982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-87776dd2-636d-46dc-859a-722b9ccaa1db tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:51.495223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87776dd2-636d-46dc-859a-722b9ccaa1db tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:51.495690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87776dd2-636d-46dc-859a-722b9ccaa1db tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:51.496120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87776dd2-636d-46dc-859a-722b9ccaa1db tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:51.496977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87776dd2-636d-46dc-859a-722b9ccaa1db tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:51.497452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87776dd2-636d-46dc-859a-722b9ccaa1db tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:51.497909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87776dd2-636d-46dc-859a-722b9ccaa1db tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:51.692973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-87776dd2-636d-46dc-859a-722b9ccaa1db tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:51.734718 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-87776dd2-636d-46dc-859a-722b9ccaa1db tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.264693 Aug 29 15:28:51.737546 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 503/1015] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:51 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:51.747129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e82459d7-c334-41f6-b205-335b1dde8cd5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bdc7160>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:51.805578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-122bd6cd-b1b2-4d8b-8b54-7bc3f7b3cce2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:51.817581 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-122bd6cd-b1b2-4d8b-8b54-7bc3f7b3cce2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1316 microversion: 2.1 time: 0.540043 Aug 29 15:28:51.818152 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 513/1016] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:51 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1316 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:51.822671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ce81c9b0-647a-414f-9ad8-b58592773f92 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:51.822984 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e82459d7-c334-41f6-b205-335b1dde8cd5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 0.082673 Aug 29 15:28:51.823295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ce81c9b0-647a-414f-9ad8-b58592773f92 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:51.831769 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 504/1017] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:51 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:51.839623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-8e1e8c77-a8ea-4ef4-a828-b01165b6d0be req-2bd2e1ec-4e53-4d9e-a7d9-76f1af44198e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846c548e-ff1e-48f9-ac29-a5c464d824f5", "name": "network-vif-plugged", "status": "completed", "tag": "ced95222-d171-4206-b2e5-08be8cf02bfb"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:51.841583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce81c9b0-647a-414f-9ad8-b58592773f92 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:51.842082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce81c9b0-647a-414f-9ad8-b58592773f92 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:51.848801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce81c9b0-647a-414f-9ad8-b58592773f92 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:51.849853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce81c9b0-647a-414f-9ad8-b58592773f92 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:51.850552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce81c9b0-647a-414f-9ad8-b58592773f92 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:51.851201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce81c9b0-647a-414f-9ad8-b58592773f92 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:51.857916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8e1e8c77-a8ea-4ef4-a828-b01165b6d0be req-2bd2e1ec-4e53-4d9e-a7d9-76f1af44198e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:51.858416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8e1e8c77-a8ea-4ef4-a828-b01165b6d0be req-2bd2e1ec-4e53-4d9e-a7d9-76f1af44198e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:51.859334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8e1e8c77-a8ea-4ef4-a828-b01165b6d0be req-2bd2e1ec-4e53-4d9e-a7d9-76f1af44198e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:51.880773 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-8e1e8c77-a8ea-4ef4-a828-b01165b6d0be req-2bd2e1ec-4e53-4d9e-a7d9-76f1af44198e service nova] Creating event network-vif-plugged:ced95222-d171-4206-b2e5-08be8cf02bfb for instance 846c548e-ff1e-48f9-ac29-a5c464d824f5 on n-h1-839401-11 Aug 29 15:28:51.900637 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-8e1e8c77-a8ea-4ef4-a828-b01165b6d0be req-2bd2e1ec-4e53-4d9e-a7d9-76f1af44198e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066227 Aug 29 15:28:51.901897 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 505/1018] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:52.038400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ce81c9b0-647a-414f-9ad8-b58592773f92 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:52.056889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ce81c9b0-647a-414f-9ad8-b58592773f92 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:52.060612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ce81c9b0-647a-414f-9ad8-b58592773f92 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:52.062320 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ce81c9b0-647a-414f-9ad8-b58592773f92 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1344 microversion: 2.25 time: 0.242978 Aug 29 15:28:52.083711 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 514/1019] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:51 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1344 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:52.296064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a242b59c-d816-4c45-b7df-549873ade160 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:52.297036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a242b59c-d816-4c45-b7df-549873ade160 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:52.313678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a242b59c-d816-4c45-b7df-549873ade160 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:52.315265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a242b59c-d816-4c45-b7df-549873ade160 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:52.318574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a242b59c-d816-4c45-b7df-549873ade160 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:52.319885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a242b59c-d816-4c45-b7df-549873ade160 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:52.320622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a242b59c-d816-4c45-b7df-549873ade160 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:52.323500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a242b59c-d816-4c45-b7df-549873ade160 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:52.487679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b93986d2-9b35-43aa-89a6-849e9b3a1486 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:52.492008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b93986d2-9b35-43aa-89a6-849e9b3a1486 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:52.504041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b93986d2-9b35-43aa-89a6-849e9b3a1486 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:52.505140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b93986d2-9b35-43aa-89a6-849e9b3a1486 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:52.506389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b93986d2-9b35-43aa-89a6-849e9b3a1486 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:52.509907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b93986d2-9b35-43aa-89a6-849e9b3a1486 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:52.519958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b93986d2-9b35-43aa-89a6-849e9b3a1486 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:52.521221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b93986d2-9b35-43aa-89a6-849e9b3a1486 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:53.104849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b93986d2-9b35-43aa-89a6-849e9b3a1486 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:53.136922 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b93986d2-9b35-43aa-89a6-849e9b3a1486 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.652467 Aug 29 15:28:53.140122 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 515/1020] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:52 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:53.160032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f2493c3a-be17-430d-9f5a-269b0d8062e4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:53.162277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f2493c3a-be17-430d-9f5a-269b0d8062e4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:53.183507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2493c3a-be17-430d-9f5a-269b0d8062e4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:53.184274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2493c3a-be17-430d-9f5a-269b0d8062e4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:53.184881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2493c3a-be17-430d-9f5a-269b0d8062e4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:53.185788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2493c3a-be17-430d-9f5a-269b0d8062e4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:53.186392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2493c3a-be17-430d-9f5a-269b0d8062e4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:53.190754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2493c3a-be17-430d-9f5a-269b0d8062e4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:53.465385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-f2493c3a-be17-430d-9f5a-269b0d8062e4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:53.494537 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f2493c3a-be17-430d-9f5a-269b0d8062e4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.349451 Aug 29 15:28:53.513657 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 516/1021] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:53 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:53.522166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5bc45ca1-f619-4e3c-a57a-2773cf72d0d4 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bb87dc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:53.570561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a242b59c-d816-4c45-b7df-549873ade160 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:53.623617 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a242b59c-d816-4c45-b7df-549873ade160 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1391 microversion: 2.1 time: 1.333980 Aug 29 15:28:53.628857 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 506/1022] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:52 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1391 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:53.647271 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5bc45ca1-f619-4e3c-a57a-2773cf72d0d4 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 0.129654 Aug 29 15:28:53.655081 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 517/1023] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:53 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:53.661810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6339cea2-4844-413f-bcf6-736c4ce005ad tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:53.664231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6339cea2-4844-413f-bcf6-736c4ce005ad tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:53.678678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-69487d5a-1e92-4219-a6b9-75926c5d464b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:53.683603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-69487d5a-1e92-4219-a6b9-75926c5d464b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:53.706262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6339cea2-4844-413f-bcf6-736c4ce005ad tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:53.707629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6339cea2-4844-413f-bcf6-736c4ce005ad tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:53.708829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6339cea2-4844-413f-bcf6-736c4ce005ad tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:53.711229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6339cea2-4844-413f-bcf6-736c4ce005ad tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:53.715834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6339cea2-4844-413f-bcf6-736c4ce005ad tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:53.716558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6339cea2-4844-413f-bcf6-736c4ce005ad tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:53.717898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69487d5a-1e92-4219-a6b9-75926c5d464b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:53.721278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69487d5a-1e92-4219-a6b9-75926c5d464b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:53.723193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69487d5a-1e92-4219-a6b9-75926c5d464b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:53.729401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69487d5a-1e92-4219-a6b9-75926c5d464b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:53.731033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69487d5a-1e92-4219-a6b9-75926c5d464b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:53.731888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69487d5a-1e92-4219-a6b9-75926c5d464b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:54.065234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6339cea2-4844-413f-bcf6-736c4ce005ad tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:54.075006 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6339cea2-4844-413f-bcf6-736c4ce005ad tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1316 microversion: 2.1 time: 0.441624 Aug 29 15:28:54.082068 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 507/1024] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:53 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:54.088976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-142763878", "imageRef": "88349cee-d348-4cb1-a930-51cfa0cf0918", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "66e5be31-5339-49ea-81cb-37e41e5b68c5"}], "security_groups": [{"name": "tempest-securitygroup--805958681"}], "key_name": "tempest-keypair-309886493", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:54.174732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-69487d5a-1e92-4219-a6b9-75926c5d464b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:54.188396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-69487d5a-1e92-4219-a6b9-75926c5d464b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:54.190139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-69487d5a-1e92-4219-a6b9-75926c5d464b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:54.191647 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-69487d5a-1e92-4219-a6b9-75926c5d464b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1411 microversion: 2.25 time: 0.531301 Aug 29 15:28:54.192462 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 518/1025] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:53 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1411 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:54.213881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b9e9f2c1-a6b0-44d6-9a9d-7a03d3087a27 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:54.214507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b9e9f2c1-a6b0-44d6-9a9d-7a03d3087a27 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:54.220908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9e9f2c1-a6b0-44d6-9a9d-7a03d3087a27 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:54.221448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9e9f2c1-a6b0-44d6-9a9d-7a03d3087a27 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:54.223145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9e9f2c1-a6b0-44d6-9a9d-7a03d3087a27 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:54.223145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9e9f2c1-a6b0-44d6-9a9d-7a03d3087a27 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:54.223145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9e9f2c1-a6b0-44d6-9a9d-7a03d3087a27 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:54.223439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9e9f2c1-a6b0-44d6-9a9d-7a03d3087a27 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:54.494261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] validate_networks() for [('66e5be31-5339-49ea-81cb-37e41e5b68c5', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:28:54.792829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b9e9f2c1-a6b0-44d6-9a9d-7a03d3087a27 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:54.811090 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b9e9f2c1-a6b0-44d6-9a9d-7a03d3087a27 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.603474 Aug 29 15:28:54.814051 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 519/1026] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:54 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:54.853230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-89d61c69-1ee6-48df-983a-1f80215e2f1f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:54.856611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-89d61c69-1ee6-48df-983a-1f80215e2f1f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:54.874375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89d61c69-1ee6-48df-983a-1f80215e2f1f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:54.877099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89d61c69-1ee6-48df-983a-1f80215e2f1f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:54.878290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89d61c69-1ee6-48df-983a-1f80215e2f1f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:54.880380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89d61c69-1ee6-48df-983a-1f80215e2f1f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:54.880914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89d61c69-1ee6-48df-983a-1f80215e2f1f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:54.884501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89d61c69-1ee6-48df-983a-1f80215e2f1f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:55.138389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-89d61c69-1ee6-48df-983a-1f80215e2f1f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:55.169208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:55.189608 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-89d61c69-1ee6-48df-983a-1f80215e2f1f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.361388 Aug 29 15:28:55.189951 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 520/1027] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:54 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:55.202720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a4040f77-ffd3-4d17-8dbb-7fa25befc731 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:55.203343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a4040f77-ffd3-4d17-8dbb-7fa25befc731 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:55.222761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4040f77-ffd3-4d17-8dbb-7fa25befc731 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:55.223261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4040f77-ffd3-4d17-8dbb-7fa25befc731 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:55.224269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4040f77-ffd3-4d17-8dbb-7fa25befc731 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:55.224992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4040f77-ffd3-4d17-8dbb-7fa25befc731 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:55.225556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4040f77-ffd3-4d17-8dbb-7fa25befc731 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:55.226363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4040f77-ffd3-4d17-8dbb-7fa25befc731 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:55.271557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:28:55.272696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:28:55.273482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:28:55.274099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:28:55.274716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:28:55.294460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:55.295263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:55.295916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:55.296965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:55.297673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:55.298346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:55.330547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Getting quotas for project a6d0bc73ee9d4bf1b0e7bf868e2aecea. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:55.337171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Getting quotas for user d929ec7ad45747078b9f28392e133c5b and project a6d0bc73ee9d4bf1b0e7bf868e2aecea. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:55.365321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:28:55.368179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='88349cee-d348-4cb1-a930-51cfa0cf0918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:28:55.430322 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4041c98c-9815-4538-892f-12b737bec11d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.346275 Aug 29 15:28:55.440115 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 508/1028] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:28:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:28:55.451590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-19b14db8-bf0a-4139-bd74-bf133e613a59 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bbfb5e0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:55.516271 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-19b14db8-bf0a-4139-bd74-bf133e613a59 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 0.069515 Aug 29 15:28:55.517001 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 509/1029] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:55 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:55.594180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d0afb61a-8b01-4356-9e7e-214b80f02e10 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'create', calling method: .version_select at 0x7fc42bc1ae50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1129326170", "description": "tempest-description-569765315"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:55.621434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a4040f77-ffd3-4d17-8dbb-7fa25befc731 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:55.634376 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a4040f77-ffd3-4d17-8dbb-7fa25befc731 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1391 microversion: 2.1 time: 0.443399 Aug 29 15:28:55.645447 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 521/1030] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:55 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1391 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:55.663742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5eca65b7-a905-44c4-bb86-e731da6b8fd1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:55.667381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5eca65b7-a905-44c4-bb86-e731da6b8fd1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:55.684513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eca65b7-a905-44c4-bb86-e731da6b8fd1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:55.685410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eca65b7-a905-44c4-bb86-e731da6b8fd1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:55.686050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eca65b7-a905-44c4-bb86-e731da6b8fd1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:55.686992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eca65b7-a905-44c4-bb86-e731da6b8fd1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:55.687632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eca65b7-a905-44c4-bb86-e731da6b8fd1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:55.688253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eca65b7-a905-44c4-bb86-e731da6b8fd1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:55.869171 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d0afb61a-8b01-4356-9e7e-214b80f02e10 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.350599 Aug 29 15:28:55.870477 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 510/1031] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:28:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:55.875604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-221e0595-99f1-4781-8fee-d18bf72340f1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:55.876303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-221e0595-99f1-4781-8fee-d18bf72340f1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:55.898336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-221e0595-99f1-4781-8fee-d18bf72340f1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:55.899140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-221e0595-99f1-4781-8fee-d18bf72340f1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:55.899835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-221e0595-99f1-4781-8fee-d18bf72340f1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:55.900808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-221e0595-99f1-4781-8fee-d18bf72340f1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:55.903276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-221e0595-99f1-4781-8fee-d18bf72340f1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:55.909812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-221e0595-99f1-4781-8fee-d18bf72340f1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:56.135449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-221e0595-99f1-4781-8fee-d18bf72340f1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:56.147882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-221e0595-99f1-4781-8fee-d18bf72340f1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:56.151436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-221e0595-99f1-4781-8fee-d18bf72340f1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:56.152839 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-221e0595-99f1-4781-8fee-d18bf72340f1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1411 microversion: 2.25 time: 0.281317 Aug 29 15:28:56.153825 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 511/1032] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:55 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1411 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:56.160056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1f8bce0d-83bb-4bff-9785-027609feff24 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:56.160977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1f8bce0d-83bb-4bff-9785-027609feff24 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:56.224099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1f8bce0d-83bb-4bff-9785-027609feff24 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:56.245052 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1f8bce0d-83bb-4bff-9785-027609feff24 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1244 microversion: 2.1 time: 0.084508 Aug 29 15:28:56.246477 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 512/1033] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:56 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:56.252826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-39496336-ea54-4c4c-b40a-3ed4b51a84b8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:56.253826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-39496336-ea54-4c4c-b40a-3ed4b51a84b8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:56.264579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39496336-ea54-4c4c-b40a-3ed4b51a84b8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:56.267876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39496336-ea54-4c4c-b40a-3ed4b51a84b8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:56.268482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39496336-ea54-4c4c-b40a-3ed4b51a84b8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:56.269567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39496336-ea54-4c4c-b40a-3ed4b51a84b8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:56.272325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39496336-ea54-4c4c-b40a-3ed4b51a84b8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:56.272899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39496336-ea54-4c4c-b40a-3ed4b51a84b8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:56.558178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5eca65b7-a905-44c4-bb86-e731da6b8fd1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:56.567827 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5eca65b7-a905-44c4-bb86-e731da6b8fd1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1466 microversion: 2.1 time: 0.921153 Aug 29 15:28:56.573897 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 522/1034] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:55 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1466 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:56.579791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-84d37501-1ef8-486f-ac1a-8c5a0caf1597 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'create', calling method: .version_select at 0x7fc42bb87d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1988973423", "description": "tempest-description-1310166995"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:56.667479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-39496336-ea54-4c4c-b40a-3ed4b51a84b8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:56.680312 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-39496336-ea54-4c4c-b40a-3ed4b51a84b8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.432155 Aug 29 15:28:56.681283 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 513/1035] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:56 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:56.687988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-7db4e0b4-66fc-4d7f-a9cc-bd7798d3daf6 req-f192da5c-40ef-41f2-a170-f775058cde5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982d1df4-7b96-4fbf-8ec2-61752962955d", "tag": "d8c016af-2dfc-466a-9191-b6fedaf0ee01"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:56.707051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7db4e0b4-66fc-4d7f-a9cc-bd7798d3daf6 req-f192da5c-40ef-41f2-a170-f775058cde5d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:56.709062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7db4e0b4-66fc-4d7f-a9cc-bd7798d3daf6 req-f192da5c-40ef-41f2-a170-f775058cde5d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:56.710777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7db4e0b4-66fc-4d7f-a9cc-bd7798d3daf6 req-f192da5c-40ef-41f2-a170-f775058cde5d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:56.730282 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-7db4e0b4-66fc-4d7f-a9cc-bd7798d3daf6 req-f192da5c-40ef-41f2-a170-f775058cde5d service nova] Creating event network-changed:d8c016af-2dfc-466a-9191-b6fedaf0ee01 for instance 982d1df4-7b96-4fbf-8ec2-61752962955d on n-h1-839401-11 Aug 29 15:28:56.750800 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-7db4e0b4-66fc-4d7f-a9cc-bd7798d3daf6 req-f192da5c-40ef-41f2-a170-f775058cde5d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055269 Aug 29 15:28:56.757036 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 514/1036] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:56.762529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-55c6a467-a4b1-4122-8488-ca4b8527a8dd tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:56.763241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-55c6a467-a4b1-4122-8488-ca4b8527a8dd tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:56.783342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55c6a467-a4b1-4122-8488-ca4b8527a8dd tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:56.783830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55c6a467-a4b1-4122-8488-ca4b8527a8dd tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:56.784272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55c6a467-a4b1-4122-8488-ca4b8527a8dd tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:56.784995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55c6a467-a4b1-4122-8488-ca4b8527a8dd tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:56.785487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55c6a467-a4b1-4122-8488-ca4b8527a8dd tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:56.785912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55c6a467-a4b1-4122-8488-ca4b8527a8dd tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:56.980307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-55c6a467-a4b1-4122-8488-ca4b8527a8dd tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:57.019024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:57.021671 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-55c6a467-a4b1-4122-8488-ca4b8527a8dd tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.263166 Aug 29 15:28:57.023432 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 515/1037] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:56 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:57.051402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0a6c78c9-cbaf-423a-ada4-d1eec91eb6c9 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bbe14c0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:57.173532 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0a6c78c9-cbaf-423a-ada4-d1eec91eb6c9 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1427 microversion: 2.1 time: 0.145818 Aug 29 15:28:57.176931 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 516/1038] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:57 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1427 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:57.192925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e6c4c98d-1ec5-42f0-992d-05ebdb67bd49 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:57.193954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e6c4c98d-1ec5-42f0-992d-05ebdb67bd49 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:57.209484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6c4c98d-1ec5-42f0-992d-05ebdb67bd49 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:57.210391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6c4c98d-1ec5-42f0-992d-05ebdb67bd49 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:57.231871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6c4c98d-1ec5-42f0-992d-05ebdb67bd49 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:57.234031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6c4c98d-1ec5-42f0-992d-05ebdb67bd49 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:57.236153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6c4c98d-1ec5-42f0-992d-05ebdb67bd49 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:57.239058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6c4c98d-1ec5-42f0-992d-05ebdb67bd49 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:57.444891 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e6c4c98d-1ec5-42f0-992d-05ebdb67bd49 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1619 microversion: 2.1 time: 0.261856 Aug 29 15:28:57.445631 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 517/1039] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:57 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1619 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:57.498974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-419159f0-d3f9-4087-b3ce-18d00ea70e3a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:57.500496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-419159f0-d3f9-4087-b3ce-18d00ea70e3a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:57.511318 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-84d37501-1ef8-486f-ac1a-8c5a0caf1597 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.936025 Aug 29 15:28:57.512175 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 523/1040] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:28:56 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:57.515713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-419159f0-d3f9-4087-b3ce-18d00ea70e3a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:57.516236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-419159f0-d3f9-4087-b3ce-18d00ea70e3a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:57.516673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-419159f0-d3f9-4087-b3ce-18d00ea70e3a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:57.522846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-419159f0-d3f9-4087-b3ce-18d00ea70e3a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:57.523660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-419159f0-d3f9-4087-b3ce-18d00ea70e3a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:57.524296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-419159f0-d3f9-4087-b3ce-18d00ea70e3a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:57.526995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ce6f01cc-b502-4214-b8c1-23306fa1e6e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:57.530532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ce6f01cc-b502-4214-b8c1-23306fa1e6e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:57.555008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce6f01cc-b502-4214-b8c1-23306fa1e6e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:57.555419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce6f01cc-b502-4214-b8c1-23306fa1e6e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:57.555863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce6f01cc-b502-4214-b8c1-23306fa1e6e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:57.556583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce6f01cc-b502-4214-b8c1-23306fa1e6e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:57.557038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce6f01cc-b502-4214-b8c1-23306fa1e6e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:57.557497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce6f01cc-b502-4214-b8c1-23306fa1e6e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:57.863184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-419159f0-d3f9-4087-b3ce-18d00ea70e3a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:57.889281 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-419159f0-d3f9-4087-b3ce-18d00ea70e3a tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1391 microversion: 2.1 time: 0.417090 Aug 29 15:28:57.890514 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 518/1041] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:57 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1391 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:57.895692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-915d4af5-92bc-412d-8bd9-b6442dbd383f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:57.898018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-915d4af5-92bc-412d-8bd9-b6442dbd383f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:57.906169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-915d4af5-92bc-412d-8bd9-b6442dbd383f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:57.906892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-915d4af5-92bc-412d-8bd9-b6442dbd383f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:57.907471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-915d4af5-92bc-412d-8bd9-b6442dbd383f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:57.908415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-915d4af5-92bc-412d-8bd9-b6442dbd383f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:57.909183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-915d4af5-92bc-412d-8bd9-b6442dbd383f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:57.910644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-915d4af5-92bc-412d-8bd9-b6442dbd383f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:58.039751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-915d4af5-92bc-412d-8bd9-b6442dbd383f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:58.049076 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-915d4af5-92bc-412d-8bd9-b6442dbd383f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1296 microversion: 2.1 time: 0.157238 Aug 29 15:28:58.051971 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 519/1042] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:57 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1296 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:58.066352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1675455044", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "7559a0d2-fc12-4800-88b8-6f0c0da3a2ed"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:58.139344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ce6f01cc-b502-4214-b8c1-23306fa1e6e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:58.169590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ce6f01cc-b502-4214-b8c1-23306fa1e6e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:58.177840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ce6f01cc-b502-4214-b8c1-23306fa1e6e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:58.183830 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ce6f01cc-b502-4214-b8c1-23306fa1e6e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1411 microversion: 2.25 time: 0.667358 Aug 29 15:28:58.207072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] validate_networks() for [('7559a0d2-fc12-4800-88b8-6f0c0da3a2ed', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:28:58.215486 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 524/1043] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:57 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1411 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:58.236703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b0718ce7-0cb8-4e4d-a9d0-cca53abf6c61 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:58.237702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b0718ce7-0cb8-4e4d-a9d0-cca53abf6c61 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:58.270662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0718ce7-0cb8-4e4d-a9d0-cca53abf6c61 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:58.271492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0718ce7-0cb8-4e4d-a9d0-cca53abf6c61 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:58.272077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0718ce7-0cb8-4e4d-a9d0-cca53abf6c61 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:58.272967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0718ce7-0cb8-4e4d-a9d0-cca53abf6c61 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:58.273737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0718ce7-0cb8-4e4d-a9d0-cca53abf6c61 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:58.274314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0718ce7-0cb8-4e4d-a9d0-cca53abf6c61 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:58.564263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b0718ce7-0cb8-4e4d-a9d0-cca53abf6c61 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:58.572578 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b0718ce7-0cb8-4e4d-a9d0-cca53abf6c61 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.355987 Aug 29 15:28:58.587657 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 525/1044] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:58 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:58.587657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2131564779", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["06e1bd29-189f-45ae-8cfe-ec70a91cf5c1"]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:58.675168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:28:58.849195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:28:58.849692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:28:58.850074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:28:58.850480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:28:58.853100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:28:58.863195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:58.863695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:58.864567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:58.864871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:58.867851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:58.868112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:58.899380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Getting quotas for project 7939dc6e747744dab4a60e547c6d9191. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:58.907664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Getting quotas for user 26faf4e7544842ad9dc66370ccba54fc and project 7939dc6e747744dab4a60e547c6d9191. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:58.922095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:28:58.924573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:28:58.985952 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-215afe14-a820-4632-b624-b044aa7bbcc9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928478 Aug 29 15:28:58.997145 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 520/1045] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:28:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:28:58.997145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d135c8c6-fbdc-4379-858e-d1d137eeb16a tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:58.999858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d135c8c6-fbdc-4379-858e-d1d137eeb16a tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:59.007975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d135c8c6-fbdc-4379-858e-d1d137eeb16a tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.009425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d135c8c6-fbdc-4379-858e-d1d137eeb16a tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.010350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d135c8c6-fbdc-4379-858e-d1d137eeb16a tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.011250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d135c8c6-fbdc-4379-858e-d1d137eeb16a tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.011871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d135c8c6-fbdc-4379-858e-d1d137eeb16a tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.012498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d135c8c6-fbdc-4379-858e-d1d137eeb16a tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.082930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:28:59.083351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:28:59.083819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:28:59.084228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:28:59.084634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:28:59.094125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-d135c8c6-fbdc-4379-858e-d1d137eeb16a tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:28:59.097829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:59.101389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.102254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.102903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.103827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.104472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.105113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.128040 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d135c8c6-fbdc-4379-858e-d1d137eeb16a tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.133351 Aug 29 15:28:59.134184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:28:59.138169 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 521/1046] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:58 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:59.145683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-635a4c2e-0fb5-425a-be54-fa7b8abe7ef6 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bbfb9d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:59.148192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:28:59.187023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:28:59.189549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:28:59.208955 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-635a4c2e-0fb5-425a-be54-fa7b8abe7ef6 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1436 microversion: 2.1 time: 0.069196 Aug 29 15:28:59.210129 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 522/1047] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:59 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1436 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:59.216963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-3847fcf9-d8b1-4ae8-87aa-eeb8a3099ec3 req-bee0e97c-1ab7-42f8-8708-334f08923b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b00ee0c9-6348-4a38-a096-53fcbded92c7", "name": "network-vif-unplugged", "status": "completed", "tag": "fc2e3960-31a2-4784-b5a4-edc91e5a8f77"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:59.229663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3847fcf9-d8b1-4ae8-87aa-eeb8a3099ec3 req-bee0e97c-1ab7-42f8-8708-334f08923b55 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.230490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3847fcf9-d8b1-4ae8-87aa-eeb8a3099ec3 req-bee0e97c-1ab7-42f8-8708-334f08923b55 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.231424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3847fcf9-d8b1-4ae8-87aa-eeb8a3099ec3 req-bee0e97c-1ab7-42f8-8708-334f08923b55 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.247645 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-3847fcf9-d8b1-4ae8-87aa-eeb8a3099ec3 req-bee0e97c-1ab7-42f8-8708-334f08923b55 service nova] Creating event network-vif-unplugged:fc2e3960-31a2-4784-b5a4-edc91e5a8f77 for instance b00ee0c9-6348-4a38-a096-53fcbded92c7 on n-h1-839401-11 Aug 29 15:28:59.253219 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-3847fcf9-d8b1-4ae8-87aa-eeb8a3099ec3 req-bee0e97c-1ab7-42f8-8708-334f08923b55 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041282 Aug 29 15:28:59.254152 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 523/1048] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:59.259365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-de01980f-eaba-45c2-a19f-8e65b6dc3a66 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:59.260267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-de01980f-eaba-45c2-a19f-8e65b6dc3a66 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:59.267889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de01980f-eaba-45c2-a19f-8e65b6dc3a66 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.268447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de01980f-eaba-45c2-a19f-8e65b6dc3a66 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.268995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de01980f-eaba-45c2-a19f-8e65b6dc3a66 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.269868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de01980f-eaba-45c2-a19f-8e65b6dc3a66 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.270499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de01980f-eaba-45c2-a19f-8e65b6dc3a66 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.271096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de01980f-eaba-45c2-a19f-8e65b6dc3a66 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.290328 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4377e565-a117-4c12-9a67-01af934ee89b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712227 Aug 29 15:28:59.293075 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 526/1049] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:28:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:28:59.298184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-427b7e2f-4a8e-44e6-a303-ea87167ba28a tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:59.314554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-427b7e2f-4a8e-44e6-a303-ea87167ba28a tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:59.386955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-427b7e2f-4a8e-44e6-a303-ea87167ba28a tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:59.395600 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-427b7e2f-4a8e-44e6-a303-ea87167ba28a tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1216 microversion: 2.1 time: 0.100638 Aug 29 15:28:59.405252 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 527/1050] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:59 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1216 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:59.405252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1ee91d66-1a5d-4f0e-aef2-c4458dc44874 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:59.405252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1ee91d66-1a5d-4f0e-aef2-c4458dc44874 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:59.409497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ee91d66-1a5d-4f0e-aef2-c4458dc44874 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.410018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ee91d66-1a5d-4f0e-aef2-c4458dc44874 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.410471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ee91d66-1a5d-4f0e-aef2-c4458dc44874 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.411195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ee91d66-1a5d-4f0e-aef2-c4458dc44874 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.411763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ee91d66-1a5d-4f0e-aef2-c4458dc44874 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.412202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ee91d66-1a5d-4f0e-aef2-c4458dc44874 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.498195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-de01980f-eaba-45c2-a19f-8e65b6dc3a66 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:59.510938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1ee91d66-1a5d-4f0e-aef2-c4458dc44874 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:59.511815 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-de01980f-eaba-45c2-a19f-8e65b6dc3a66 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1391 microversion: 2.1 time: 0.255952 Aug 29 15:28:59.513300 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 524/1051] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:59 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1391 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:59.520659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1e620059-a40a-4a87-8f7b-93970f22e736 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:59.521831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1e620059-a40a-4a87-8f7b-93970f22e736 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:59.531005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e620059-a40a-4a87-8f7b-93970f22e736 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.531800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e620059-a40a-4a87-8f7b-93970f22e736 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.532991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e620059-a40a-4a87-8f7b-93970f22e736 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.533851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e620059-a40a-4a87-8f7b-93970f22e736 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.534365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e620059-a40a-4a87-8f7b-93970f22e736 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.534948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e620059-a40a-4a87-8f7b-93970f22e736 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.537157 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1ee91d66-1a5d-4f0e-aef2-c4458dc44874 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1302 microversion: 2.1 time: 0.139485 Aug 29 15:28:59.538125 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 528/1052] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:59 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1302 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:59.555607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a0dfe0b-24e0-4202-aada-323714dbe061 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc430150430>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:59.623126 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5a0dfe0b-24e0-4202-aada-323714dbe061 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 200 len: 1436 microversion: 2.1 time: 0.083947 Aug 29 15:28:59.633508 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 529/1053] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:28:59 2022] GET /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 1436 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:59.638986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-02e1a30e-c9cf-4419-8391-bb687d4a92f2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:59.639880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-02e1a30e-c9cf-4419-8391-bb687d4a92f2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:59.725403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-02e1a30e-c9cf-4419-8391-bb687d4a92f2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:59.734758 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-02e1a30e-c9cf-4419-8391-bb687d4a92f2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1217 microversion: 2.1 time: 0.099505 Aug 29 15:28:59.735403 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 530/1054] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:59 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:59.740426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fa643fca-e66b-4a60-8f3b-0e44ce3b32c6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:59.741040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fa643fca-e66b-4a60-8f3b-0e44ce3b32c6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:59.752931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa643fca-e66b-4a60-8f3b-0e44ce3b32c6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.753521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa643fca-e66b-4a60-8f3b-0e44ce3b32c6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.754190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa643fca-e66b-4a60-8f3b-0e44ce3b32c6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.755118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa643fca-e66b-4a60-8f3b-0e44ce3b32c6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.755822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa643fca-e66b-4a60-8f3b-0e44ce3b32c6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.756282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa643fca-e66b-4a60-8f3b-0e44ce3b32c6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.780793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1e620059-a40a-4a87-8f7b-93970f22e736 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:59.790100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1e620059-a40a-4a87-8f7b-93970f22e736 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:59.792058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1e620059-a40a-4a87-8f7b-93970f22e736 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:59.793580 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1e620059-a40a-4a87-8f7b-93970f22e736 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1411 microversion: 2.25 time: 0.278400 Aug 29 15:28:59.816967 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 525/1055] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:28:59 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1411 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:28:59.822001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a0bf723f-0c49-42cb-9491-eb4275fa947c tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:59.822908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a0bf723f-0c49-42cb-9491-eb4275fa947c tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:28:59.839064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0bf723f-0c49-42cb-9491-eb4275fa947c tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.839554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0bf723f-0c49-42cb-9491-eb4275fa947c tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.845011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0bf723f-0c49-42cb-9491-eb4275fa947c tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.845799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0bf723f-0c49-42cb-9491-eb4275fa947c tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:28:59.846289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0bf723f-0c49-42cb-9491-eb4275fa947c tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:28:59.846724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0bf723f-0c49-42cb-9491-eb4275fa947c tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:28:59.945481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fa643fca-e66b-4a60-8f3b-0e44ce3b32c6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:28:59.963582 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fa643fca-e66b-4a60-8f3b-0e44ce3b32c6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.226688 Aug 29 15:28:59.964691 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 531/1056] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:59 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:00.049411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a0bf723f-0c49-42cb-9491-eb4275fa947c tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:00.059091 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a0bf723f-0c49-42cb-9491-eb4275fa947c tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1466 microversion: 2.1 time: 0.240603 Aug 29 15:29:00.059712 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 526/1057] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:28:59 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1466 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:00.080948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-acc38cb6-a5f1-4c8d-92c2-3bbc7b3108b8 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42bbda700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:00.154993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9f2d277e-2032-4c0e-89e0-7c49e0d1c46c tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:00.155594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9f2d277e-2032-4c0e-89e0-7c49e0d1c46c tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:00.163410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f2d277e-2032-4c0e-89e0-7c49e0d1c46c tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:00.165248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f2d277e-2032-4c0e-89e0-7c49e0d1c46c tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:00.166185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f2d277e-2032-4c0e-89e0-7c49e0d1c46c tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:00.167260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f2d277e-2032-4c0e-89e0-7c49e0d1c46c tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:00.170278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f2d277e-2032-4c0e-89e0-7c49e0d1c46c tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:00.172490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f2d277e-2032-4c0e-89e0-7c49e0d1c46c tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:00.265030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-9f2d277e-2032-4c0e-89e0-7c49e0d1c46c tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:00.290978 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9f2d277e-2032-4c0e-89e0-7c49e0d1c46c tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.140186 Aug 29 15:29:00.292243 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 527/1058] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:00 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:29:00.417834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-67faa1dd-e266-46d3-9aae-df50c1d5ca9c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:00.419094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-67faa1dd-e266-46d3-9aae-df50c1d5ca9c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:00.427375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67faa1dd-e266-46d3-9aae-df50c1d5ca9c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:00.428208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67faa1dd-e266-46d3-9aae-df50c1d5ca9c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:00.429440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67faa1dd-e266-46d3-9aae-df50c1d5ca9c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:00.430411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67faa1dd-e266-46d3-9aae-df50c1d5ca9c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:00.431091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67faa1dd-e266-46d3-9aae-df50c1d5ca9c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:00.432022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67faa1dd-e266-46d3-9aae-df50c1d5ca9c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:00.524799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-67faa1dd-e266-46d3-9aae-df50c1d5ca9c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:00.534207 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-67faa1dd-e266-46d3-9aae-df50c1d5ca9c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1268 microversion: 2.1 time: 0.120916 Aug 29 15:29:00.545172 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 528/1059] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:00 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1268 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:00.545172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-801f9c2e-ca53-44a8-bd23-85594e60d7b2 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:00.545172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-801f9c2e-ca53-44a8-bd23-85594e60d7b2 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:00.558396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-801f9c2e-ca53-44a8-bd23-85594e60d7b2 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:00.559116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-801f9c2e-ca53-44a8-bd23-85594e60d7b2 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:00.559714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-801f9c2e-ca53-44a8-bd23-85594e60d7b2 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:00.560916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-801f9c2e-ca53-44a8-bd23-85594e60d7b2 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:00.562007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-801f9c2e-ca53-44a8-bd23-85594e60d7b2 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:00.562754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-801f9c2e-ca53-44a8-bd23-85594e60d7b2 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:00.728037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-801f9c2e-ca53-44a8-bd23-85594e60d7b2 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:00.738342 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-801f9c2e-ca53-44a8-bd23-85594e60d7b2 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1391 microversion: 2.1 time: 0.201975 Aug 29 15:29:00.738934 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 529/1060] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:00 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1391 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:00.744229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-21083445-161d-433a-a7e4-f7395f488d9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:00.744830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-21083445-161d-433a-a7e4-f7395f488d9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:00.752020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21083445-161d-433a-a7e4-f7395f488d9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:00.753217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21083445-161d-433a-a7e4-f7395f488d9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:00.753885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21083445-161d-433a-a7e4-f7395f488d9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:00.754895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21083445-161d-433a-a7e4-f7395f488d9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:00.755535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21083445-161d-433a-a7e4-f7395f488d9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:00.756117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21083445-161d-433a-a7e4-f7395f488d9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:00.826687 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-acc38cb6-a5f1-4c8d-92c2-3bbc7b3108b8 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "DELETE /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a" status: 204 len: 0 microversion: 2.1 time: 0.749735 Aug 29 15:29:00.827534 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 532/1061] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:00 2022] DELETE /compute/v2.1/images/be48756c-6f7a-469d-ab9c-73670ee3c57a => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:29:00.834575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b8e3b243-0a15-457e-a928-65563e0e3451 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:00.835602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b8e3b243-0a15-457e-a928-65563e0e3451 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:00.835941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-21083445-161d-433a-a7e4-f7395f488d9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:00.843993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8e3b243-0a15-457e-a928-65563e0e3451 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:00.844800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8e3b243-0a15-457e-a928-65563e0e3451 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:00.845380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8e3b243-0a15-457e-a928-65563e0e3451 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:00.846166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8e3b243-0a15-457e-a928-65563e0e3451 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:00.846700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8e3b243-0a15-457e-a928-65563e0e3451 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:00.847189 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-21083445-161d-433a-a7e4-f7395f488d9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1302 microversion: 2.1 time: 0.106995 Aug 29 15:29:00.847312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8e3b243-0a15-457e-a928-65563e0e3451 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:00.848424 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 530/1062] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:00 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1302 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:00.854967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-10776ea8-2e3e-454a-828d-ce43136cac59 req-fdc78a96-7f23-490d-9d16-ec6e4d11e3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c480235-81a3-46b9-9ea6-520b329f53ea", "name": "network-vif-plugged", "status": "completed", "tag": "eea42a7e-66fa-41cc-a051-b6c158f38c7c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:00.868013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-10776ea8-2e3e-454a-828d-ce43136cac59 req-fdc78a96-7f23-490d-9d16-ec6e4d11e3b3 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:00.868942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-10776ea8-2e3e-454a-828d-ce43136cac59 req-fdc78a96-7f23-490d-9d16-ec6e4d11e3b3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:00.869593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-10776ea8-2e3e-454a-828d-ce43136cac59 req-fdc78a96-7f23-490d-9d16-ec6e4d11e3b3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:00.886840 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-10776ea8-2e3e-454a-828d-ce43136cac59 req-fdc78a96-7f23-490d-9d16-ec6e4d11e3b3 service nova] Creating event network-vif-plugged:eea42a7e-66fa-41cc-a051-b6c158f38c7c for instance 6c480235-81a3-46b9-9ea6-520b329f53ea on n-h2-839401-11 Aug 29 15:29:00.892219 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-10776ea8-2e3e-454a-828d-ce43136cac59 req-fdc78a96-7f23-490d-9d16-ec6e4d11e3b3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041313 Aug 29 15:29:00.892842 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 531/1063] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:00.898170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6fb0d234-3d6c-4e24-aa59-4ac4973b24f9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:00.898832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6fb0d234-3d6c-4e24-aa59-4ac4973b24f9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:00.921778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fb0d234-3d6c-4e24-aa59-4ac4973b24f9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:00.922317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fb0d234-3d6c-4e24-aa59-4ac4973b24f9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:00.922769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fb0d234-3d6c-4e24-aa59-4ac4973b24f9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:00.923575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fb0d234-3d6c-4e24-aa59-4ac4973b24f9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:00.924064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fb0d234-3d6c-4e24-aa59-4ac4973b24f9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:00.924492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fb0d234-3d6c-4e24-aa59-4ac4973b24f9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:00.931531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b8e3b243-0a15-457e-a928-65563e0e3451 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:00.940282 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b8e3b243-0a15-457e-a928-65563e0e3451 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1221 microversion: 2.1 time: 0.111613 Aug 29 15:29:00.945880 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 533/1064] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:00 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1221 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:00.960633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-713050da-51b2-47f3-a432-72cd91b24625 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '.version_select at 0x7fc42ba2f430>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:01.064658 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-713050da-51b2-47f3-a432-72cd91b24625 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] HTTP exception thrown: Image not found. Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-713050da-51b2-47f3-a432-72cd91b24625 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Request method failure captured: Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b HTTP/1.1 Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNrU3pY8KEJeQ70V4Ew9UiAh-quHtjqVb-e-SqU-d9sNmeVy-bASVP11bcHjm1fQVMPxxGZYKInsaJOCSZK7Ho5GXKCMPjIIZTOM9IUPhzpxAevgUGvEJ1KtA9D88GZouhkSJrrnUx5vAo72Dp6hv34vbSYa6W2NhXV6f6U2jwkahaE Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: a902f071321a4216b4d17078181a61c6 Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesOneServerTestJSON-363047811 Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:29:01.094757 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:29:01.096313 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a902f071321a4216b4d17078181a61c6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a902f071321a4216b4d17078181a61c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a902f071321a4216b4d17078181a61c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a902f071321a4216b4d17078181a61c6"}]}] Aug 29 15:29:01.096313 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesOneServerTestJSON-363047811 Aug 29 15:29:01.096313 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: a902f071321a4216b4d17078181a61c6 Aug 29 15:29:01.096313 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-363047811 Aug 29 15:29:01.096313 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesOneServerTestJSON-363047811-project Aug 29 15:29:01.096313 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:29:01.096313 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:29:01.096313 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 72442d50b3f74cb6acdfba7eeebe2274 Aug 29 15:29:01.096313 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesOneServerTestJSON-363047811-project Aug 29 15:29:01.096313 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:29:01.096313 n-d-839401-11 devstack@n-api.service[122361]: exception: Image not found. Aug 29 15:29:01.096313 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'aacaee8d-8bbc-4153-928d-a6ddb42e4b4b'} Aug 29 15:29:01.096313 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image aacaee8d-8bbc-4153-928d-a6ddb42e4b4b to delete Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:01.097295 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aacaee8d-8bbc-4153-928d-a6ddb42e4b4b could not be found. Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:01.098494 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:01.101817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:29:01.101817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:29:01.101817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:29:01.101817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:01.101817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:01.101817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:01.101817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:01.101817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:01.101817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:01.101817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:01.101817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:01.101817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:29:01.101817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:01.101817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-713050da-51b2-47f3-a432-72cd91b24625 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Returning 404 to user: Image not found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:01.101817 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-713050da-51b2-47f3-a432-72cd91b24625 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "DELETE /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b" status: 404 len: 62 microversion: 2.1 time: 0.149457 Aug 29 15:29:01.103216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6fb0d234-3d6c-4e24-aa59-4ac4973b24f9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:01.103707 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 534/1065] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:00 2022] DELETE /compute/v2.1/images/aacaee8d-8bbc-4153-928d-a6ddb42e4b4b => generated 62 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:29:01.106516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ee578574-d48f-4898-a8f3-1948b2f1f24e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:01.107330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ee578574-d48f-4898-a8f3-1948b2f1f24e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:01.110382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6fb0d234-3d6c-4e24-aa59-4ac4973b24f9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:01.112845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6fb0d234-3d6c-4e24-aa59-4ac4973b24f9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:01.114380 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6fb0d234-3d6c-4e24-aa59-4ac4973b24f9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1411 microversion: 2.25 time: 0.220188 Aug 29 15:29:01.125184 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 532/1066] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:00 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1411 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:01.125184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-09362c0b-8df0-409c-9dc4-ecb2a45518a5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:01.125184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-09362c0b-8df0-409c-9dc4-ecb2a45518a5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:01.128542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee578574-d48f-4898-a8f3-1948b2f1f24e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.129833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee578574-d48f-4898-a8f3-1948b2f1f24e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.131562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee578574-d48f-4898-a8f3-1948b2f1f24e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.133452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee578574-d48f-4898-a8f3-1948b2f1f24e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.133970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee578574-d48f-4898-a8f3-1948b2f1f24e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.134548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09362c0b-8df0-409c-9dc4-ecb2a45518a5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.134839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee578574-d48f-4898-a8f3-1948b2f1f24e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.135038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09362c0b-8df0-409c-9dc4-ecb2a45518a5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.135534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09362c0b-8df0-409c-9dc4-ecb2a45518a5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.136241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09362c0b-8df0-409c-9dc4-ecb2a45518a5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.136702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09362c0b-8df0-409c-9dc4-ecb2a45518a5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.137139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09362c0b-8df0-409c-9dc4-ecb2a45518a5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.176860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-09362c0b-8df0-409c-9dc4-ecb2a45518a5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:29:01.256855 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-09362c0b-8df0-409c-9dc4-ecb2a45518a5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "DELETE /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 204 len: 0 microversion: 2.1 time: 0.139977 Aug 29 15:29:01.260629 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 533/1067] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:29:01 2022] DELETE /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:29:01.266253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-668c1b84-ce1b-4179-b335-e159ad0efda3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:01.267042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-668c1b84-ce1b-4179-b335-e159ad0efda3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:01.273292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-668c1b84-ce1b-4179-b335-e159ad0efda3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.274028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-668c1b84-ce1b-4179-b335-e159ad0efda3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.274445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-668c1b84-ce1b-4179-b335-e159ad0efda3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.275171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-668c1b84-ce1b-4179-b335-e159ad0efda3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.275648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-668c1b84-ce1b-4179-b335-e159ad0efda3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.276071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-668c1b84-ce1b-4179-b335-e159ad0efda3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.336604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ee578574-d48f-4898-a8f3-1948b2f1f24e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:01.345021 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ee578574-d48f-4898-a8f3-1948b2f1f24e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.246782 Aug 29 15:29:01.345640 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 535/1068] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:01 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:01.350389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-eb486086-5840-47db-a5cc-72ac68c21fac req-710ec81a-9064-4fbe-99ef-ed75468f7880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b00ee0c9-6348-4a38-a096-53fcbded92c7", "tag": "fc2e3960-31a2-4784-b5a4-edc91e5a8f77"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:01.361100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-eb486086-5840-47db-a5cc-72ac68c21fac req-710ec81a-9064-4fbe-99ef-ed75468f7880 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.361685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-eb486086-5840-47db-a5cc-72ac68c21fac req-710ec81a-9064-4fbe-99ef-ed75468f7880 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.362192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-eb486086-5840-47db-a5cc-72ac68c21fac req-710ec81a-9064-4fbe-99ef-ed75468f7880 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.373985 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-eb486086-5840-47db-a5cc-72ac68c21fac req-710ec81a-9064-4fbe-99ef-ed75468f7880 service nova] Creating event network-changed:fc2e3960-31a2-4784-b5a4-edc91e5a8f77 for instance b00ee0c9-6348-4a38-a096-53fcbded92c7 on n-h1-839401-11 Aug 29 15:29:01.379211 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-eb486086-5840-47db-a5cc-72ac68c21fac req-710ec81a-9064-4fbe-99ef-ed75468f7880 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032339 Aug 29 15:29:01.379915 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 536/1069] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:01.385604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f1afba30-3048-4756-a28f-2a95f5d1cf5e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:01.386383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f1afba30-3048-4756-a28f-2a95f5d1cf5e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:01.392678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1afba30-3048-4756-a28f-2a95f5d1cf5e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.393204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1afba30-3048-4756-a28f-2a95f5d1cf5e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.393641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1afba30-3048-4756-a28f-2a95f5d1cf5e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.394340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1afba30-3048-4756-a28f-2a95f5d1cf5e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.394799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1afba30-3048-4756-a28f-2a95f5d1cf5e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.395560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1afba30-3048-4756-a28f-2a95f5d1cf5e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.453318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-668c1b84-ce1b-4179-b335-e159ad0efda3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:01.461532 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-668c1b84-ce1b-4179-b335-e159ad0efda3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1472 microversion: 2.1 time: 0.199577 Aug 29 15:29:01.462434 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 534/1070] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:01 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1472 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:01.485743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-f1afba30-3048-4756-a28f-2a95f5d1cf5e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:01.502986 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f1afba30-3048-4756-a28f-2a95f5d1cf5e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.121812 Aug 29 15:29:01.503576 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 537/1071] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:01 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:01.555878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-34bc64a5-4eef-49f2-80e9-5de608237b85 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:01.556487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-34bc64a5-4eef-49f2-80e9-5de608237b85 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:01.562632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34bc64a5-4eef-49f2-80e9-5de608237b85 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.563117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34bc64a5-4eef-49f2-80e9-5de608237b85 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.563551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34bc64a5-4eef-49f2-80e9-5de608237b85 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.564240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34bc64a5-4eef-49f2-80e9-5de608237b85 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.564695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34bc64a5-4eef-49f2-80e9-5de608237b85 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.565154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34bc64a5-4eef-49f2-80e9-5de608237b85 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.716749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-34bc64a5-4eef-49f2-80e9-5de608237b85 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:01.725637 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-34bc64a5-4eef-49f2-80e9-5de608237b85 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1274 microversion: 2.1 time: 0.173584 Aug 29 15:29:01.729416 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 535/1072] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:01 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1274 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:01.760522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f80cb1c-8071-41ce-aee0-d1e2907e75c1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:01.762131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9f80cb1c-8071-41ce-aee0-d1e2907e75c1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:01.777590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f80cb1c-8071-41ce-aee0-d1e2907e75c1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.778570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f80cb1c-8071-41ce-aee0-d1e2907e75c1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.779686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f80cb1c-8071-41ce-aee0-d1e2907e75c1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.782143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f80cb1c-8071-41ce-aee0-d1e2907e75c1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.783570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f80cb1c-8071-41ce-aee0-d1e2907e75c1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.784828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f80cb1c-8071-41ce-aee0-d1e2907e75c1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.869147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-69c37775-ecae-47f6-887b-e270257e8e13 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:01.870602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-69c37775-ecae-47f6-887b-e270257e8e13 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:01.884426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69c37775-ecae-47f6-887b-e270257e8e13 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.886010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69c37775-ecae-47f6-887b-e270257e8e13 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.887387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69c37775-ecae-47f6-887b-e270257e8e13 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.889043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69c37775-ecae-47f6-887b-e270257e8e13 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:01.891772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69c37775-ecae-47f6-887b-e270257e8e13 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:01.892910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69c37775-ecae-47f6-887b-e270257e8e13 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:01.991029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9f80cb1c-8071-41ce-aee0-d1e2907e75c1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:02.008491 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9f80cb1c-8071-41ce-aee0-d1e2907e75c1 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1391 microversion: 2.1 time: 0.252295 Aug 29 15:29:02.011018 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 538/1073] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:01 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1391 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:02.026079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-42b71ae0-6a25-4d41-b220-ae3e28d72fb5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:02.027910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-42b71ae0-6a25-4d41-b220-ae3e28d72fb5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:02.050151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42b71ae0-6a25-4d41-b220-ae3e28d72fb5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:02.050914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42b71ae0-6a25-4d41-b220-ae3e28d72fb5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:02.051514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42b71ae0-6a25-4d41-b220-ae3e28d72fb5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:02.052393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42b71ae0-6a25-4d41-b220-ae3e28d72fb5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:02.053677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42b71ae0-6a25-4d41-b220-ae3e28d72fb5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:02.054909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42b71ae0-6a25-4d41-b220-ae3e28d72fb5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:02.112878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-69c37775-ecae-47f6-887b-e270257e8e13 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:02.128519 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-69c37775-ecae-47f6-887b-e270257e8e13 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1302 microversion: 2.1 time: 0.264203 Aug 29 15:29:02.129353 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 536/1074] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:01 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1302 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:02.138135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a2ac4764-1882-4240-acf2-e16b256c4ae4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:02.139134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a2ac4764-1882-4240-acf2-e16b256c4ae4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:02.148866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2ac4764-1882-4240-acf2-e16b256c4ae4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:02.149892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2ac4764-1882-4240-acf2-e16b256c4ae4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:02.150638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2ac4764-1882-4240-acf2-e16b256c4ae4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:02.152525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2ac4764-1882-4240-acf2-e16b256c4ae4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:02.152525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2ac4764-1882-4240-acf2-e16b256c4ae4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:02.153572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2ac4764-1882-4240-acf2-e16b256c4ae4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:02.185309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-42b71ae0-6a25-4d41-b220-ae3e28d72fb5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:02.200586 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-42b71ae0-6a25-4d41-b220-ae3e28d72fb5 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1213 microversion: 2.1 time: 0.187840 Aug 29 15:29:02.202974 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 539/1075] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:02 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1213 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:02.365846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-48d19933-a270-4527-b320-34f2ab594b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:02.366600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-48d19933-a270-4527-b320-34f2ab594b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:02.371001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:02.377260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48d19933-a270-4527-b320-34f2ab594b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:02.377870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48d19933-a270-4527-b320-34f2ab594b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:02.383882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48d19933-a270-4527-b320-34f2ab594b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:02.386170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48d19933-a270-4527-b320-34f2ab594b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:02.386797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48d19933-a270-4527-b320-34f2ab594b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:02.387247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48d19933-a270-4527-b320-34f2ab594b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:02.652096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a2ac4764-1882-4240-acf2-e16b256c4ae4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:02.667316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a2ac4764-1882-4240-acf2-e16b256c4ae4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:02.669232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a2ac4764-1882-4240-acf2-e16b256c4ae4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:02.676415 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a2ac4764-1882-4240-acf2-e16b256c4ae4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1411 microversion: 2.25 time: 0.542756 Aug 29 15:29:02.677621 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 537/1076] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:02 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1411 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:29:02.708657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-27fb82e2-b506-4af5-962e-4e03827a0ef3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:02.709439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-27fb82e2-b506-4af5-962e-4e03827a0ef3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:02.721900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27fb82e2-b506-4af5-962e-4e03827a0ef3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:02.722382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27fb82e2-b506-4af5-962e-4e03827a0ef3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:02.722813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27fb82e2-b506-4af5-962e-4e03827a0ef3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:02.723512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27fb82e2-b506-4af5-962e-4e03827a0ef3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:02.723960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27fb82e2-b506-4af5-962e-4e03827a0ef3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:02.724380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27fb82e2-b506-4af5-962e-4e03827a0ef3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.141627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-48d19933-a270-4527-b320-34f2ab594b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:03.152511 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-48d19933-a270-4527-b320-34f2ab594b7d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.790592 Aug 29 15:29:03.153760 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 540/1077] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:02 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:03.159197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8d36e804-f954-4227-83fc-0033b2db7e96 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:03.160884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8d36e804-f954-4227-83fc-0033b2db7e96 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:03.167919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d36e804-f954-4227-83fc-0033b2db7e96 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.168602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d36e804-f954-4227-83fc-0033b2db7e96 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.169581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d36e804-f954-4227-83fc-0033b2db7e96 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.171503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d36e804-f954-4227-83fc-0033b2db7e96 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.172796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d36e804-f954-4227-83fc-0033b2db7e96 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.174136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d36e804-f954-4227-83fc-0033b2db7e96 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.218067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-27fb82e2-b506-4af5-962e-4e03827a0ef3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:03.223141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:03.240193 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-27fb82e2-b506-4af5-962e-4e03827a0ef3 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1472 microversion: 2.1 time: 0.560460 Aug 29 15:29:03.249138 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 538/1078] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:02 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1472 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:03.251397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-55fd20b5-67f5-4457-b054-3be152a5ef16 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:03.252048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-55fd20b5-67f5-4457-b054-3be152a5ef16 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:03.265196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55fd20b5-67f5-4457-b054-3be152a5ef16 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.265779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55fd20b5-67f5-4457-b054-3be152a5ef16 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.266288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55fd20b5-67f5-4457-b054-3be152a5ef16 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.267118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55fd20b5-67f5-4457-b054-3be152a5ef16 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.267639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55fd20b5-67f5-4457-b054-3be152a5ef16 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.268179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55fd20b5-67f5-4457-b054-3be152a5ef16 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.279837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-8d36e804-f954-4227-83fc-0033b2db7e96 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:03.313478 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8d36e804-f954-4227-83fc-0033b2db7e96 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.158094 Aug 29 15:29:03.329108 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 541/1079] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:03 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:03.329108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f56f2d78-cbe7-405f-b73f-231c85fbda21 req-4191e2cd-ac2b-41ed-913f-d3d7e84fbd10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d3d180-599f-4c45-a0ea-53f2180484d5", "name": "network-vif-unplugged", "status": "completed", "tag": "a173d34f-0b58-4d2d-91dc-183ed4b4d4a6"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:03.329108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f56f2d78-cbe7-405f-b73f-231c85fbda21 req-4191e2cd-ac2b-41ed-913f-d3d7e84fbd10 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.332186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f56f2d78-cbe7-405f-b73f-231c85fbda21 req-4191e2cd-ac2b-41ed-913f-d3d7e84fbd10 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.332186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f56f2d78-cbe7-405f-b73f-231c85fbda21 req-4191e2cd-ac2b-41ed-913f-d3d7e84fbd10 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.342403 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f56f2d78-cbe7-405f-b73f-231c85fbda21 req-4191e2cd-ac2b-41ed-913f-d3d7e84fbd10 service nova] Creating event network-vif-unplugged:a173d34f-0b58-4d2d-91dc-183ed4b4d4a6 for instance 45d3d180-599f-4c45-a0ea-53f2180484d5 on n-h2-839401-11 Aug 29 15:29:03.347940 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f56f2d78-cbe7-405f-b73f-231c85fbda21 req-4191e2cd-ac2b-41ed-913f-d3d7e84fbd10 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032403 Aug 29 15:29:03.348795 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 542/1080] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:03.353860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b91ab311-dc2a-48e6-aee0-c235336d529d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:03.354645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b91ab311-dc2a-48e6-aee0-c235336d529d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:03.361506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b91ab311-dc2a-48e6-aee0-c235336d529d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.362069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b91ab311-dc2a-48e6-aee0-c235336d529d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.362642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b91ab311-dc2a-48e6-aee0-c235336d529d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.363483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b91ab311-dc2a-48e6-aee0-c235336d529d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.364023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b91ab311-dc2a-48e6-aee0-c235336d529d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.364526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b91ab311-dc2a-48e6-aee0-c235336d529d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.423007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-55fd20b5-67f5-4457-b054-3be152a5ef16 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:03.432302 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-55fd20b5-67f5-4457-b054-3be152a5ef16 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1316 microversion: 2.1 time: 0.189353 Aug 29 15:29:03.433211 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 539/1081] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:03 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:03.438193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a8be329d-b5fb-4433-a9d3-f95913f97057 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:03.439149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a8be329d-b5fb-4433-a9d3-f95913f97057 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:03.449160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8be329d-b5fb-4433-a9d3-f95913f97057 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.449722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8be329d-b5fb-4433-a9d3-f95913f97057 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.450178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8be329d-b5fb-4433-a9d3-f95913f97057 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.450909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8be329d-b5fb-4433-a9d3-f95913f97057 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.451374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8be329d-b5fb-4433-a9d3-f95913f97057 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.451802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8be329d-b5fb-4433-a9d3-f95913f97057 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.525435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b91ab311-dc2a-48e6-aee0-c235336d529d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:03.540160 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b91ab311-dc2a-48e6-aee0-c235336d529d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1391 microversion: 2.1 time: 0.190161 Aug 29 15:29:03.541136 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 543/1082] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:03 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1391 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:03.546287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c009bd5d-d5da-424e-af98-969fc0ded20c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:03.549854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c009bd5d-d5da-424e-af98-969fc0ded20c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:03.560810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c009bd5d-d5da-424e-af98-969fc0ded20c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.561487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c009bd5d-d5da-424e-af98-969fc0ded20c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.561936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c009bd5d-d5da-424e-af98-969fc0ded20c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.566141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c009bd5d-d5da-424e-af98-969fc0ded20c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.566141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c009bd5d-d5da-424e-af98-969fc0ded20c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.566141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c009bd5d-d5da-424e-af98-969fc0ded20c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.642509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a8be329d-b5fb-4433-a9d3-f95913f97057 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:03.648580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c009bd5d-d5da-424e-af98-969fc0ded20c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:03.656474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:03.659096 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c009bd5d-d5da-424e-af98-969fc0ded20c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1213 microversion: 2.1 time: 0.116602 Aug 29 15:29:03.659844 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 544/1083] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:03 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1213 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:03.675092 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a8be329d-b5fb-4433-a9d3-f95913f97057 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.240520 Aug 29 15:29:03.681424 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 540/1084] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:03 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:03.705001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2f0c4242-8e68-49c0-b9e9-b8436656a662 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:03.706259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2f0c4242-8e68-49c0-b9e9-b8436656a662 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:03.714690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f0c4242-8e68-49c0-b9e9-b8436656a662 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.715603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f0c4242-8e68-49c0-b9e9-b8436656a662 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.716493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f0c4242-8e68-49c0-b9e9-b8436656a662 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.718578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f0c4242-8e68-49c0-b9e9-b8436656a662 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:03.720985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f0c4242-8e68-49c0-b9e9-b8436656a662 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:03.725684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f0c4242-8e68-49c0-b9e9-b8436656a662 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:03.959009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2f0c4242-8e68-49c0-b9e9-b8436656a662 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:03.968734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2f0c4242-8e68-49c0-b9e9-b8436656a662 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:03.970318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2f0c4242-8e68-49c0-b9e9-b8436656a662 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:03.971447 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2f0c4242-8e68-49c0-b9e9-b8436656a662 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1411 microversion: 2.25 time: 0.272059 Aug 29 15:29:03.972220 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 545/1085] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:03 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1411 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:04.182759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ce92d59a-90c9-4a2f-b3ee-1b5eca755acc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:04.186721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ce92d59a-90c9-4a2f-b3ee-1b5eca755acc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:04.200596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce92d59a-90c9-4a2f-b3ee-1b5eca755acc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.201117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce92d59a-90c9-4a2f-b3ee-1b5eca755acc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.201559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce92d59a-90c9-4a2f-b3ee-1b5eca755acc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.202274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce92d59a-90c9-4a2f-b3ee-1b5eca755acc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.202731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce92d59a-90c9-4a2f-b3ee-1b5eca755acc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.203157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce92d59a-90c9-4a2f-b3ee-1b5eca755acc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.262787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e5be08ab-0c36-4ac4-9fbd-dac99a787206 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:04.263674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e5be08ab-0c36-4ac4-9fbd-dac99a787206 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:04.275268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5be08ab-0c36-4ac4-9fbd-dac99a787206 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.275917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5be08ab-0c36-4ac4-9fbd-dac99a787206 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.276371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5be08ab-0c36-4ac4-9fbd-dac99a787206 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.277156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5be08ab-0c36-4ac4-9fbd-dac99a787206 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.277630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5be08ab-0c36-4ac4-9fbd-dac99a787206 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.278174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5be08ab-0c36-4ac4-9fbd-dac99a787206 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.453806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ce92d59a-90c9-4a2f-b3ee-1b5eca755acc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:04.471324 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ce92d59a-90c9-4a2f-b3ee-1b5eca755acc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.301319 Aug 29 15:29:04.473141 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 541/1086] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:04 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:04.505044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-91176029-0144-4881-90ca-a25dcdfc524e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:04.506007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-91176029-0144-4881-90ca-a25dcdfc524e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:04.512573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91176029-0144-4881-90ca-a25dcdfc524e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.513059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91176029-0144-4881-90ca-a25dcdfc524e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.513666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91176029-0144-4881-90ca-a25dcdfc524e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.514381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91176029-0144-4881-90ca-a25dcdfc524e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.514977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91176029-0144-4881-90ca-a25dcdfc524e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.515398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91176029-0144-4881-90ca-a25dcdfc524e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.575653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e5be08ab-0c36-4ac4-9fbd-dac99a787206 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:04.583651 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e5be08ab-0c36-4ac4-9fbd-dac99a787206 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1472 microversion: 2.1 time: 0.325394 Aug 29 15:29:04.592860 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 546/1087] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:04 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1472 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:04.597945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-38aabc69-1049-4986-9603-52d602a84112 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:04.598624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-38aabc69-1049-4986-9603-52d602a84112 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:04.604738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38aabc69-1049-4986-9603-52d602a84112 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.605286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38aabc69-1049-4986-9603-52d602a84112 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.605729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38aabc69-1049-4986-9603-52d602a84112 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.606443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38aabc69-1049-4986-9603-52d602a84112 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.606906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38aabc69-1049-4986-9603-52d602a84112 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.607337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38aabc69-1049-4986-9603-52d602a84112 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.642479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-91176029-0144-4881-90ca-a25dcdfc524e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:04.661259 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-91176029-0144-4881-90ca-a25dcdfc524e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.186454 Aug 29 15:29:04.666942 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 542/1088] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:04 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:04.672027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5187612a-6632-4d0f-9d58-4e7b7ec74c2d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:04.672796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5187612a-6632-4d0f-9d58-4e7b7ec74c2d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:04.686678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5187612a-6632-4d0f-9d58-4e7b7ec74c2d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.687305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5187612a-6632-4d0f-9d58-4e7b7ec74c2d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.687778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5187612a-6632-4d0f-9d58-4e7b7ec74c2d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.688514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5187612a-6632-4d0f-9d58-4e7b7ec74c2d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.689067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5187612a-6632-4d0f-9d58-4e7b7ec74c2d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.689518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5187612a-6632-4d0f-9d58-4e7b7ec74c2d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.892928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-38aabc69-1049-4986-9603-52d602a84112 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:04.906198 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-38aabc69-1049-4986-9603-52d602a84112 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1316 microversion: 2.1 time: 0.311925 Aug 29 15:29:04.921161 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 547/1089] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:04 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:04.921161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5c02da4b-30df-4751-a342-b193c3bea3b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:04.921161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5c02da4b-30df-4751-a342-b193c3bea3b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:04.924377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c02da4b-30df-4751-a342-b193c3bea3b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.924954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c02da4b-30df-4751-a342-b193c3bea3b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.925564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c02da4b-30df-4751-a342-b193c3bea3b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.926408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c02da4b-30df-4751-a342-b193c3bea3b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.926944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c02da4b-30df-4751-a342-b193c3bea3b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.927376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c02da4b-30df-4751-a342-b193c3bea3b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.932895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5187612a-6632-4d0f-9d58-4e7b7ec74c2d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:04.942322 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5187612a-6632-4d0f-9d58-4e7b7ec74c2d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1391 microversion: 2.1 time: 0.273932 Aug 29 15:29:04.942917 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 543/1090] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:04 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1391 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:04.960767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c2c7c4ce-6509-4a90-bbef-fffed17287ee tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:04.961426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c2c7c4ce-6509-4a90-bbef-fffed17287ee tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:04.968133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2c7c4ce-6509-4a90-bbef-fffed17287ee tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.968619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2c7c4ce-6509-4a90-bbef-fffed17287ee tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.969071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2c7c4ce-6509-4a90-bbef-fffed17287ee tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:04.969829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2c7c4ce-6509-4a90-bbef-fffed17287ee tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:04.970346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2c7c4ce-6509-4a90-bbef-fffed17287ee tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:04.970767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2c7c4ce-6509-4a90-bbef-fffed17287ee tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:05.033227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5c02da4b-30df-4751-a342-b193c3bea3b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:05.047789 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5c02da4b-30df-4751-a342-b193c3bea3b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1213 microversion: 2.1 time: 0.136466 Aug 29 15:29:05.048447 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 548/1091] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:04 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1213 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:05.054742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-98f9fbc1-3000-4284-9f2c-4b73e4b272de req-665858aa-6d85-4dfa-835d-c004addf00a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bf2f2e5-da5a-47bc-920c-d105a88b2847", "tag": "868a1bf9-0936-4b9a-a3ed-373847b74389"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:05.068168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-98f9fbc1-3000-4284-9f2c-4b73e4b272de req-665858aa-6d85-4dfa-835d-c004addf00a2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:05.068662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-98f9fbc1-3000-4284-9f2c-4b73e4b272de req-665858aa-6d85-4dfa-835d-c004addf00a2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:05.069160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-98f9fbc1-3000-4284-9f2c-4b73e4b272de req-665858aa-6d85-4dfa-835d-c004addf00a2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:05.081786 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-98f9fbc1-3000-4284-9f2c-4b73e4b272de req-665858aa-6d85-4dfa-835d-c004addf00a2 service nova] Creating event network-changed:868a1bf9-0936-4b9a-a3ed-373847b74389 for instance 8bf2f2e5-da5a-47bc-920c-d105a88b2847 on n-h2-839401-11 Aug 29 15:29:05.086974 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-98f9fbc1-3000-4284-9f2c-4b73e4b272de req-665858aa-6d85-4dfa-835d-c004addf00a2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037356 Aug 29 15:29:05.087619 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 549/1092] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:05.092966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d9b2905f-7cc1-4387-a3c3-21b7f13a2450 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:05.093782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d9b2905f-7cc1-4387-a3c3-21b7f13a2450 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:05.100355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9b2905f-7cc1-4387-a3c3-21b7f13a2450 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:05.100858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9b2905f-7cc1-4387-a3c3-21b7f13a2450 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:05.101330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9b2905f-7cc1-4387-a3c3-21b7f13a2450 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:05.102050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9b2905f-7cc1-4387-a3c3-21b7f13a2450 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:05.102510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9b2905f-7cc1-4387-a3c3-21b7f13a2450 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:05.102950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9b2905f-7cc1-4387-a3c3-21b7f13a2450 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:05.167953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c2c7c4ce-6509-4a90-bbef-fffed17287ee tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:05.191936 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c2c7c4ce-6509-4a90-bbef-fffed17287ee tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.234967 Aug 29 15:29:05.193254 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 544/1093] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:04 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:05.292264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d9b2905f-7cc1-4387-a3c3-21b7f13a2450 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:05.301896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d9b2905f-7cc1-4387-a3c3-21b7f13a2450 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:05.303697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d9b2905f-7cc1-4387-a3c3-21b7f13a2450 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:05.305041 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d9b2905f-7cc1-4387-a3c3-21b7f13a2450 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1411 microversion: 2.25 time: 0.216213 Aug 29 15:29:05.305757 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 550/1094] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:05 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1411 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:05.493114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a11240a-68ce-4b88-9010-f65ba7f154b7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:05.493789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9a11240a-68ce-4b88-9010-f65ba7f154b7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:05.500956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a11240a-68ce-4b88-9010-f65ba7f154b7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:05.501868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a11240a-68ce-4b88-9010-f65ba7f154b7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:05.502489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a11240a-68ce-4b88-9010-f65ba7f154b7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:05.503347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a11240a-68ce-4b88-9010-f65ba7f154b7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:05.503998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a11240a-68ce-4b88-9010-f65ba7f154b7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:05.504424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a11240a-68ce-4b88-9010-f65ba7f154b7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:05.605893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a13b772b-06ba-4c37-8479-720b65aa63e5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:05.606568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a13b772b-06ba-4c37-8479-720b65aa63e5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:05.615258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a13b772b-06ba-4c37-8479-720b65aa63e5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:05.617154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a13b772b-06ba-4c37-8479-720b65aa63e5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:05.617154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a13b772b-06ba-4c37-8479-720b65aa63e5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:05.617396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a13b772b-06ba-4c37-8479-720b65aa63e5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:05.617796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a13b772b-06ba-4c37-8479-720b65aa63e5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:05.618228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a13b772b-06ba-4c37-8479-720b65aa63e5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:05.672738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9a11240a-68ce-4b88-9010-f65ba7f154b7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:05.681644 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a11240a-68ce-4b88-9010-f65ba7f154b7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.192478 Aug 29 15:29:05.685859 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 545/1095] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:05 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:05.689608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-efae7878-a802-4186-ba13-57c4190561a3 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:05.690211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-efae7878-a802-4186-ba13-57c4190561a3 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:05.703884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efae7878-a802-4186-ba13-57c4190561a3 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:05.704767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efae7878-a802-4186-ba13-57c4190561a3 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:05.705462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efae7878-a802-4186-ba13-57c4190561a3 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:05.706570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efae7878-a802-4186-ba13-57c4190561a3 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:05.707248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efae7878-a802-4186-ba13-57c4190561a3 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:05.707892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efae7878-a802-4186-ba13-57c4190561a3 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:05.799393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-efae7878-a802-4186-ba13-57c4190561a3 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:05.818807 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-efae7878-a802-4186-ba13-57c4190561a3 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.133369 Aug 29 15:29:05.819706 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 546/1096] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:05 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:05.847814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a13b772b-06ba-4c37-8479-720b65aa63e5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:05.865769 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a13b772b-06ba-4c37-8479-720b65aa63e5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1472 microversion: 2.1 time: 0.265780 Aug 29 15:29:05.880244 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 551/1097] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:05 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1472 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:05.934736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a91449b-03c8-4317-92d0-7a788128fbfd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:05.936004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9a91449b-03c8-4317-92d0-7a788128fbfd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:05.960614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a91449b-03c8-4317-92d0-7a788128fbfd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:05.961396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a91449b-03c8-4317-92d0-7a788128fbfd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:05.962035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a91449b-03c8-4317-92d0-7a788128fbfd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:05.962929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a91449b-03c8-4317-92d0-7a788128fbfd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:05.963396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a91449b-03c8-4317-92d0-7a788128fbfd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:05.963825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a91449b-03c8-4317-92d0-7a788128fbfd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:05.969557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8ea11dd6-4cdf-4129-a12b-5d4b6639920b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:05.970622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8ea11dd6-4cdf-4129-a12b-5d4b6639920b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:05.980708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ea11dd6-4cdf-4129-a12b-5d4b6639920b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:05.980708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ea11dd6-4cdf-4129-a12b-5d4b6639920b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:05.980708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ea11dd6-4cdf-4129-a12b-5d4b6639920b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:06.001511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ea11dd6-4cdf-4129-a12b-5d4b6639920b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:06.002346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ea11dd6-4cdf-4129-a12b-5d4b6639920b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:06.003804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ea11dd6-4cdf-4129-a12b-5d4b6639920b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:06.237353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9a91449b-03c8-4317-92d0-7a788128fbfd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:06.252915 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a91449b-03c8-4317-92d0-7a788128fbfd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1316 microversion: 2.1 time: 0.321953 Aug 29 15:29:06.259535 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 547/1098] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:05 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:06.276738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3c97c0da-fb44-4454-afd8-77a86f0ba499 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:06.286788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3c97c0da-fb44-4454-afd8-77a86f0ba499 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:06.294865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c97c0da-fb44-4454-afd8-77a86f0ba499 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:06.295598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c97c0da-fb44-4454-afd8-77a86f0ba499 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:06.296221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c97c0da-fb44-4454-afd8-77a86f0ba499 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:06.297019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c97c0da-fb44-4454-afd8-77a86f0ba499 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:06.297604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c97c0da-fb44-4454-afd8-77a86f0ba499 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:06.298155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c97c0da-fb44-4454-afd8-77a86f0ba499 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:06.404136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8ea11dd6-4cdf-4129-a12b-5d4b6639920b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:06.413728 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8ea11dd6-4cdf-4129-a12b-5d4b6639920b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1589 microversion: 2.1 time: 0.454261 Aug 29 15:29:06.416571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3c97c0da-fb44-4454-afd8-77a86f0ba499 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:06.418292 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 552/1099] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:05 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1589 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:06.429503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c599ea5-8a61-49b2-8d80-ea0f8fdd2f05 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:06.430384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6c599ea5-8a61-49b2-8d80-ea0f8fdd2f05 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:06.434262 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3c97c0da-fb44-4454-afd8-77a86f0ba499 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1213 microversion: 2.1 time: 0.173455 Aug 29 15:29:06.440932 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 548/1100] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:06 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:06.449202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d756a8e-4b13-440b-a3f0-ea3166ecc5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:06.451924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c599ea5-8a61-49b2-8d80-ea0f8fdd2f05 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:06.457261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c599ea5-8a61-49b2-8d80-ea0f8fdd2f05 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:06.457882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c599ea5-8a61-49b2-8d80-ea0f8fdd2f05 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:06.458857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2d756a8e-4b13-440b-a3f0-ea3166ecc5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:06.459678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c599ea5-8a61-49b2-8d80-ea0f8fdd2f05 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:06.460284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c599ea5-8a61-49b2-8d80-ea0f8fdd2f05 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:06.462784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c599ea5-8a61-49b2-8d80-ea0f8fdd2f05 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:06.475063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d756a8e-4b13-440b-a3f0-ea3166ecc5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:06.476592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d756a8e-4b13-440b-a3f0-ea3166ecc5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:06.477740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d756a8e-4b13-440b-a3f0-ea3166ecc5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:06.479583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d756a8e-4b13-440b-a3f0-ea3166ecc5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:06.481378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d756a8e-4b13-440b-a3f0-ea3166ecc5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:06.481893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d756a8e-4b13-440b-a3f0-ea3166ecc5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:06.790571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d756a8e-4b13-440b-a3f0-ea3166ecc5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:06.819567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d756a8e-4b13-440b-a3f0-ea3166ecc5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:06.823055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d756a8e-4b13-440b-a3f0-ea3166ecc5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:06.824651 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d756a8e-4b13-440b-a3f0-ea3166ecc5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1411 microversion: 2.25 time: 0.381128 Aug 29 15:29:06.825878 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 549/1101] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:06 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1411 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:06.843696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-71245d54-a1ff-4243-90d7-8c6d60f6e8ea req-664bed30-0152-4626-b4c9-b5f047c5c9be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982d1df4-7b96-4fbf-8ec2-61752962955d", "name": "network-vif-plugged", "status": "completed", "tag": "d8c016af-2dfc-466a-9191-b6fedaf0ee01"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:06.854806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-71245d54-a1ff-4243-90d7-8c6d60f6e8ea req-664bed30-0152-4626-b4c9-b5f047c5c9be service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:06.855517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-71245d54-a1ff-4243-90d7-8c6d60f6e8ea req-664bed30-0152-4626-b4c9-b5f047c5c9be service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:06.856108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-71245d54-a1ff-4243-90d7-8c6d60f6e8ea req-664bed30-0152-4626-b4c9-b5f047c5c9be service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:06.879685 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-71245d54-a1ff-4243-90d7-8c6d60f6e8ea req-664bed30-0152-4626-b4c9-b5f047c5c9be service nova] Creating event network-vif-plugged:d8c016af-2dfc-466a-9191-b6fedaf0ee01 for instance 982d1df4-7b96-4fbf-8ec2-61752962955d on n-h1-839401-11 Aug 29 15:29:06.897377 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-71245d54-a1ff-4243-90d7-8c6d60f6e8ea req-664bed30-0152-4626-b4c9-b5f047c5c9be service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069184 Aug 29 15:29:06.903507 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 550/1102] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:06.911743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-556da7bd-c268-4c23-a0fe-7e84828fab9b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:06.913009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-556da7bd-c268-4c23-a0fe-7e84828fab9b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:06.922284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-556da7bd-c268-4c23-a0fe-7e84828fab9b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:06.923305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-556da7bd-c268-4c23-a0fe-7e84828fab9b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:06.923923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-556da7bd-c268-4c23-a0fe-7e84828fab9b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:06.924827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-556da7bd-c268-4c23-a0fe-7e84828fab9b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:06.925718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-556da7bd-c268-4c23-a0fe-7e84828fab9b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:06.926484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-556da7bd-c268-4c23-a0fe-7e84828fab9b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.046514 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-556da7bd-c268-4c23-a0fe-7e84828fab9b tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140455 Aug 29 15:29:07.047327 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 551/1103] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:29:06 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:07.052298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98879793-540b-407e-895b-2f7fb6929901 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:07.052911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-98879793-540b-407e-895b-2f7fb6929901 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:07.062946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98879793-540b-407e-895b-2f7fb6929901 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.077458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98879793-540b-407e-895b-2f7fb6929901 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.078425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98879793-540b-407e-895b-2f7fb6929901 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.079207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98879793-540b-407e-895b-2f7fb6929901 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.079718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98879793-540b-407e-895b-2f7fb6929901 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.080186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98879793-540b-407e-895b-2f7fb6929901 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.189388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6c599ea5-8a61-49b2-8d80-ea0f8fdd2f05 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:07.197337 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6c599ea5-8a61-49b2-8d80-ea0f8fdd2f05 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.777961 Aug 29 15:29:07.197918 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 553/1104] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:06 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:07.203416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-29cde0fa-9042-4560-9fd9-14349c92b444 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:07.204236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-29cde0fa-9042-4560-9fd9-14349c92b444 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:07.210348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29cde0fa-9042-4560-9fd9-14349c92b444 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.210921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29cde0fa-9042-4560-9fd9-14349c92b444 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.211548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29cde0fa-9042-4560-9fd9-14349c92b444 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.212265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29cde0fa-9042-4560-9fd9-14349c92b444 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.212732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29cde0fa-9042-4560-9fd9-14349c92b444 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.213297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29cde0fa-9042-4560-9fd9-14349c92b444 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.301856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-29cde0fa-9042-4560-9fd9-14349c92b444 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:07.322237 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-29cde0fa-9042-4560-9fd9-14349c92b444 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.123140 Aug 29 15:29:07.324790 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 554/1105] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:07 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:07.329728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0193c148-5abc-4432-b10c-e4b241656c91 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:07.330872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0193c148-5abc-4432-b10c-e4b241656c91 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:07.347610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0193c148-5abc-4432-b10c-e4b241656c91 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.348103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0193c148-5abc-4432-b10c-e4b241656c91 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.348539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0193c148-5abc-4432-b10c-e4b241656c91 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.349273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0193c148-5abc-4432-b10c-e4b241656c91 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.349733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0193c148-5abc-4432-b10c-e4b241656c91 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.350155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0193c148-5abc-4432-b10c-e4b241656c91 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.375367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-98879793-540b-407e-895b-2f7fb6929901 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:07.385189 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-98879793-540b-407e-895b-2f7fb6929901 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.336648 Aug 29 15:29:07.394337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0193c148-5abc-4432-b10c-e4b241656c91 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.394964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0193c148-5abc-4432-b10c-e4b241656c91 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.395503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0193c148-5abc-4432-b10c-e4b241656c91 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.396079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-0193c148-5abc-4432-b10c-e4b241656c91 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lazy-loading 'fault' on Instance uuid 45d3d180-599f-4c45-a0ea-53f2180484d5 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:07.400145 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 552/1106] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:07 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:07.405576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-dff51d47-9cfe-462f-bb0a-73ebbf668b69 req-79798c1a-2607-4258-9293-06fdaf91d715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d3d180-599f-4c45-a0ea-53f2180484d5", "name": "network-vif-deleted", "tag": "a173d34f-0b58-4d2d-91dc-183ed4b4d4a6"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:07.411761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:07.416116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dff51d47-9cfe-462f-bb0a-73ebbf668b69 req-79798c1a-2607-4258-9293-06fdaf91d715 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.416604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dff51d47-9cfe-462f-bb0a-73ebbf668b69 req-79798c1a-2607-4258-9293-06fdaf91d715 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.417037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dff51d47-9cfe-462f-bb0a-73ebbf668b69 req-79798c1a-2607-4258-9293-06fdaf91d715 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.431000 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-dff51d47-9cfe-462f-bb0a-73ebbf668b69 req-79798c1a-2607-4258-9293-06fdaf91d715 service nova] Creating event network-vif-deleted:a173d34f-0b58-4d2d-91dc-183ed4b4d4a6 for instance 45d3d180-599f-4c45-a0ea-53f2180484d5 on n-h2-839401-11 Aug 29 15:29:07.439599 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-dff51d47-9cfe-462f-bb0a-73ebbf668b69 req-79798c1a-2607-4258-9293-06fdaf91d715 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037948 Aug 29 15:29:07.440582 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 553/1107] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:07.445966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b461b570-12fe-4e1f-bf9b-5cb99f5a1e9e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:07.446677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b461b570-12fe-4e1f-bf9b-5cb99f5a1e9e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:07.454900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b461b570-12fe-4e1f-bf9b-5cb99f5a1e9e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.455415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b461b570-12fe-4e1f-bf9b-5cb99f5a1e9e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.456122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b461b570-12fe-4e1f-bf9b-5cb99f5a1e9e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.456872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b461b570-12fe-4e1f-bf9b-5cb99f5a1e9e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.457366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b461b570-12fe-4e1f-bf9b-5cb99f5a1e9e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.457812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b461b570-12fe-4e1f-bf9b-5cb99f5a1e9e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.466771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0193c148-5abc-4432-b10c-e4b241656c91 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:07.477481 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0193c148-5abc-4432-b10c-e4b241656c91 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1306 microversion: 2.1 time: 0.151356 Aug 29 15:29:07.478849 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 555/1108] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:07 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1306 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:07.490019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-15382ffe-790c-495e-a59d-7672e16a2f7d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:07.490879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-15382ffe-790c-495e-a59d-7672e16a2f7d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:07.502492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15382ffe-790c-495e-a59d-7672e16a2f7d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.503397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15382ffe-790c-495e-a59d-7672e16a2f7d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.504089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15382ffe-790c-495e-a59d-7672e16a2f7d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.505112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15382ffe-790c-495e-a59d-7672e16a2f7d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.505731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15382ffe-790c-495e-a59d-7672e16a2f7d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.506312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15382ffe-790c-495e-a59d-7672e16a2f7d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.577681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-15382ffe-790c-495e-a59d-7672e16a2f7d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:07.586489 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-15382ffe-790c-495e-a59d-7672e16a2f7d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1213 microversion: 2.1 time: 0.102401 Aug 29 15:29:07.599320 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 556/1109] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:07 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:07.848470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9fe1996f-02b4-40bc-ac6b-c0af4266d7ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:07.849205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9fe1996f-02b4-40bc-ac6b-c0af4266d7ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:07.856635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fe1996f-02b4-40bc-ac6b-c0af4266d7ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.857256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fe1996f-02b4-40bc-ac6b-c0af4266d7ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.857885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fe1996f-02b4-40bc-ac6b-c0af4266d7ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:07.858812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fe1996f-02b4-40bc-ac6b-c0af4266d7ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:07.859332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fe1996f-02b4-40bc-ac6b-c0af4266d7ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:07.860175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fe1996f-02b4-40bc-ac6b-c0af4266d7ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.016166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9fe1996f-02b4-40bc-ac6b-c0af4266d7ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:08.025011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9fe1996f-02b4-40bc-ac6b-c0af4266d7ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:08.026629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9fe1996f-02b4-40bc-ac6b-c0af4266d7ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:08.027630 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9fe1996f-02b4-40bc-ac6b-c0af4266d7ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1411 microversion: 2.25 time: 0.183575 Aug 29 15:29:08.028396 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 557/1110] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:07 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1411 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:08.034364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b461b570-12fe-4e1f-bf9b-5cb99f5a1e9e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:08.047010 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b461b570-12fe-4e1f-bf9b-5cb99f5a1e9e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1316 microversion: 2.1 time: 0.604358 Aug 29 15:29:08.048567 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 554/1111] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:07 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1316 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:08.218561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-03ab90e5-7b2c-43f4-960d-e28816f94a19 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:08.219567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-03ab90e5-7b2c-43f4-960d-e28816f94a19 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:08.225929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03ab90e5-7b2c-43f4-960d-e28816f94a19 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.226520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03ab90e5-7b2c-43f4-960d-e28816f94a19 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.227027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03ab90e5-7b2c-43f4-960d-e28816f94a19 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.227786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03ab90e5-7b2c-43f4-960d-e28816f94a19 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.228303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03ab90e5-7b2c-43f4-960d-e28816f94a19 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.228922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03ab90e5-7b2c-43f4-960d-e28816f94a19 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.350909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dde096d3-0792-40c5-95ee-665638ad6c47 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:08.351526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dde096d3-0792-40c5-95ee-665638ad6c47 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:08.358253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde096d3-0792-40c5-95ee-665638ad6c47 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.358769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde096d3-0792-40c5-95ee-665638ad6c47 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.359198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde096d3-0792-40c5-95ee-665638ad6c47 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.359913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde096d3-0792-40c5-95ee-665638ad6c47 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.361334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde096d3-0792-40c5-95ee-665638ad6c47 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.361784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde096d3-0792-40c5-95ee-665638ad6c47 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.368160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-03ab90e5-7b2c-43f4-960d-e28816f94a19 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:08.376684 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-03ab90e5-7b2c-43f4-960d-e28816f94a19 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.162171 Aug 29 15:29:08.377568 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 558/1112] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:08 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:08.408419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-64aa8255-077e-4b94-807e-b0a4eae0a52a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:08.409447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-64aa8255-077e-4b94-807e-b0a4eae0a52a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:08.421291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64aa8255-077e-4b94-807e-b0a4eae0a52a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.430420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64aa8255-077e-4b94-807e-b0a4eae0a52a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.430806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64aa8255-077e-4b94-807e-b0a4eae0a52a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.431893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64aa8255-077e-4b94-807e-b0a4eae0a52a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.432382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64aa8255-077e-4b94-807e-b0a4eae0a52a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.432808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64aa8255-077e-4b94-807e-b0a4eae0a52a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.464945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-dde096d3-0792-40c5-95ee-665638ad6c47 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:08.506709 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dde096d3-0792-40c5-95ee-665638ad6c47 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.159916 Aug 29 15:29:08.521770 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 555/1113] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:08 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:29:08.530392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-54066fb5-513b-45bf-a95d-e2ef52579f12 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:08.531282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-54066fb5-513b-45bf-a95d-e2ef52579f12 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:08.539390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54066fb5-513b-45bf-a95d-e2ef52579f12 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.539890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54066fb5-513b-45bf-a95d-e2ef52579f12 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.540334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54066fb5-513b-45bf-a95d-e2ef52579f12 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.541043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54066fb5-513b-45bf-a95d-e2ef52579f12 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.541525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54066fb5-513b-45bf-a95d-e2ef52579f12 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.544633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54066fb5-513b-45bf-a95d-e2ef52579f12 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.564363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:08.599172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54066fb5-513b-45bf-a95d-e2ef52579f12 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.599912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54066fb5-513b-45bf-a95d-e2ef52579f12 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.600535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54066fb5-513b-45bf-a95d-e2ef52579f12 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.600992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-54066fb5-513b-45bf-a95d-e2ef52579f12 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lazy-loading 'fault' on Instance uuid 45d3d180-599f-4c45-a0ea-53f2180484d5 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:08.619708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-64aa8255-077e-4b94-807e-b0a4eae0a52a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:08.628149 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-64aa8255-077e-4b94-807e-b0a4eae0a52a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.224313 Aug 29 15:29:08.628729 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 559/1114] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:08 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:08.634005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2c2fd207-0b8f-4dc7-ba97-8b5f212311e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:08.634738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2c2fd207-0b8f-4dc7-ba97-8b5f212311e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:08.641326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c2fd207-0b8f-4dc7-ba97-8b5f212311e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.641845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c2fd207-0b8f-4dc7-ba97-8b5f212311e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.642312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c2fd207-0b8f-4dc7-ba97-8b5f212311e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.643034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c2fd207-0b8f-4dc7-ba97-8b5f212311e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.643517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c2fd207-0b8f-4dc7-ba97-8b5f212311e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.643968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c2fd207-0b8f-4dc7-ba97-8b5f212311e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.660209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-54066fb5-513b-45bf-a95d-e2ef52579f12 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:08.678246 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-54066fb5-513b-45bf-a95d-e2ef52579f12 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1306 microversion: 2.1 time: 0.154981 Aug 29 15:29:08.681287 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 556/1115] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:08 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1306 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:08.748551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2c2fd207-0b8f-4dc7-ba97-8b5f212311e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:08.758710 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2c2fd207-0b8f-4dc7-ba97-8b5f212311e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1213 microversion: 2.1 time: 0.128199 Aug 29 15:29:08.771419 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 560/1116] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:08 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:08.829531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-20a934c9-7ed3-461e-b713-7437c85b5e51 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:08.830192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-20a934c9-7ed3-461e-b713-7437c85b5e51 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:08.837425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-339e179e-4913-43fe-a251-9feb96b6e0f6 req-598f2ea4-9318-494e-a5ff-c0189068ad35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c480235-81a3-46b9-9ea6-520b329f53ea", "tag": "eea42a7e-66fa-41cc-a051-b6c158f38c7c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:08.844181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20a934c9-7ed3-461e-b713-7437c85b5e51 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.845066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20a934c9-7ed3-461e-b713-7437c85b5e51 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.845737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20a934c9-7ed3-461e-b713-7437c85b5e51 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.846656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20a934c9-7ed3-461e-b713-7437c85b5e51 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.847267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20a934c9-7ed3-461e-b713-7437c85b5e51 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.847858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20a934c9-7ed3-461e-b713-7437c85b5e51 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.860293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-339e179e-4913-43fe-a251-9feb96b6e0f6 req-598f2ea4-9318-494e-a5ff-c0189068ad35 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:08.860962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-339e179e-4913-43fe-a251-9feb96b6e0f6 req-598f2ea4-9318-494e-a5ff-c0189068ad35 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:08.861486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-339e179e-4913-43fe-a251-9feb96b6e0f6 req-598f2ea4-9318-494e-a5ff-c0189068ad35 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:08.873991 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-339e179e-4913-43fe-a251-9feb96b6e0f6 req-598f2ea4-9318-494e-a5ff-c0189068ad35 service nova] Creating event network-changed:eea42a7e-66fa-41cc-a051-b6c158f38c7c for instance 6c480235-81a3-46b9-9ea6-520b329f53ea on n-h2-839401-11 Aug 29 15:29:08.879786 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-339e179e-4913-43fe-a251-9feb96b6e0f6 req-598f2ea4-9318-494e-a5ff-c0189068ad35 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049995 Aug 29 15:29:08.881469 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 561/1117] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:29:08.886076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:08.916052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=24 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:09.016738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-20a934c9-7ed3-461e-b713-7437c85b5e51 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:09.026560 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-20a934c9-7ed3-461e-b713-7437c85b5e51 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1589 microversion: 2.1 time: 0.201645 Aug 29 15:29:09.028419 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 557/1118] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:08 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1589 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:09.053676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-33072ac6-2cc5-4c7e-aca0-5f292828b268 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:09.054406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-33072ac6-2cc5-4c7e-aca0-5f292828b268 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:09.061358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-33072ac6-2cc5-4c7e-aca0-5f292828b268 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.061952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-33072ac6-2cc5-4c7e-aca0-5f292828b268 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.069353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e0210718-15f5-4e0c-aa0d-9a52ab86ba99 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:09.070003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-33072ac6-2cc5-4c7e-aca0-5f292828b268 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.070926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e0210718-15f5-4e0c-aa0d-9a52ab86ba99 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:09.072280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-33072ac6-2cc5-4c7e-aca0-5f292828b268 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.072769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-33072ac6-2cc5-4c7e-aca0-5f292828b268 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.073250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-33072ac6-2cc5-4c7e-aca0-5f292828b268 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.081125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:09.092428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0210718-15f5-4e0c-aa0d-9a52ab86ba99 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.092942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0210718-15f5-4e0c-aa0d-9a52ab86ba99 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.093493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0210718-15f5-4e0c-aa0d-9a52ab86ba99 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.094299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0210718-15f5-4e0c-aa0d-9a52ab86ba99 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.094812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0210718-15f5-4e0c-aa0d-9a52ab86ba99 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.095273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0210718-15f5-4e0c-aa0d-9a52ab86ba99 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.117652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:09.263534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-33072ac6-2cc5-4c7e-aca0-5f292828b268 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:09.273133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-33072ac6-2cc5-4c7e-aca0-5f292828b268 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:09.274822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-33072ac6-2cc5-4c7e-aca0-5f292828b268 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:09.276082 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-33072ac6-2cc5-4c7e-aca0-5f292828b268 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1411 microversion: 2.25 time: 0.227501 Aug 29 15:29:09.289142 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 562/1119] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:09 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1411 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:09.289528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e0210718-15f5-4e0c-aa0d-9a52ab86ba99 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:09.295888 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e0210718-15f5-4e0c-aa0d-9a52ab86ba99 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1316 microversion: 2.1 time: 0.230732 Aug 29 15:29:09.296469 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 558/1120] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:09 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:09.398872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a2d4351e-fcb0-426a-baf4-76c46fdd8df9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:09.399618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a2d4351e-fcb0-426a-baf4-76c46fdd8df9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:09.407281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2d4351e-fcb0-426a-baf4-76c46fdd8df9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.407860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2d4351e-fcb0-426a-baf4-76c46fdd8df9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.408335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2d4351e-fcb0-426a-baf4-76c46fdd8df9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.409056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2d4351e-fcb0-426a-baf4-76c46fdd8df9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.409541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2d4351e-fcb0-426a-baf4-76c46fdd8df9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.409970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2d4351e-fcb0-426a-baf4-76c46fdd8df9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.538068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-83578508-f505-4d9b-9cf8-88b41d23ce97 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:09.539385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-83578508-f505-4d9b-9cf8-88b41d23ce97 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:09.559835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83578508-f505-4d9b-9cf8-88b41d23ce97 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.564783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83578508-f505-4d9b-9cf8-88b41d23ce97 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.565274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83578508-f505-4d9b-9cf8-88b41d23ce97 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.566253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83578508-f505-4d9b-9cf8-88b41d23ce97 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.566881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83578508-f505-4d9b-9cf8-88b41d23ce97 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.567479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83578508-f505-4d9b-9cf8-88b41d23ce97 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.591899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a2d4351e-fcb0-426a-baf4-76c46fdd8df9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:09.602676 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a2d4351e-fcb0-426a-baf4-76c46fdd8df9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.207859 Aug 29 15:29:09.613718 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 563/1121] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:09 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:09.649772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7ecb6a3c-99ac-4546-ac1e-ad8cd52762e8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:09.651070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7ecb6a3c-99ac-4546-ac1e-ad8cd52762e8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:09.656664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-83578508-f505-4d9b-9cf8-88b41d23ce97 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:09.658218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ecb6a3c-99ac-4546-ac1e-ad8cd52762e8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.658898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ecb6a3c-99ac-4546-ac1e-ad8cd52762e8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.659502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ecb6a3c-99ac-4546-ac1e-ad8cd52762e8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.660392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ecb6a3c-99ac-4546-ac1e-ad8cd52762e8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.661150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ecb6a3c-99ac-4546-ac1e-ad8cd52762e8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.661774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ecb6a3c-99ac-4546-ac1e-ad8cd52762e8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.677385 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-83578508-f505-4d9b-9cf8-88b41d23ce97 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.144122 Aug 29 15:29:09.697117 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 559/1122] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:09 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:09.706544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b587f986-0887-4fe7-a09b-55dfca67a00a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:09.707170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b587f986-0887-4fe7-a09b-55dfca67a00a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:09.714264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b587f986-0887-4fe7-a09b-55dfca67a00a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.714840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b587f986-0887-4fe7-a09b-55dfca67a00a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.715412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b587f986-0887-4fe7-a09b-55dfca67a00a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.716530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b587f986-0887-4fe7-a09b-55dfca67a00a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.717179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b587f986-0887-4fe7-a09b-55dfca67a00a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.717770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b587f986-0887-4fe7-a09b-55dfca67a00a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.730965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=10 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:09.753585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b587f986-0887-4fe7-a09b-55dfca67a00a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.754542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b587f986-0887-4fe7-a09b-55dfca67a00a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.755156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b587f986-0887-4fe7-a09b-55dfca67a00a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.755781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-b587f986-0887-4fe7-a09b-55dfca67a00a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lazy-loading 'fault' on Instance uuid 45d3d180-599f-4c45-a0ea-53f2180484d5 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:09.862279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b587f986-0887-4fe7-a09b-55dfca67a00a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:09.872398 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b587f986-0887-4fe7-a09b-55dfca67a00a tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1306 microversion: 2.1 time: 0.174126 Aug 29 15:29:09.874745 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 560/1123] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:09 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1306 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:09.889880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-09c7d05c-a2e5-4fec-acdc-d2637f713a18 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:09.890830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-09c7d05c-a2e5-4fec-acdc-d2637f713a18 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:09.905560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7ecb6a3c-99ac-4546-ac1e-ad8cd52762e8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:09.907137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09c7d05c-a2e5-4fec-acdc-d2637f713a18 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.907689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09c7d05c-a2e5-4fec-acdc-d2637f713a18 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.908145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09c7d05c-a2e5-4fec-acdc-d2637f713a18 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.908853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09c7d05c-a2e5-4fec-acdc-d2637f713a18 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:09.909859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09c7d05c-a2e5-4fec-acdc-d2637f713a18 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:09.909859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09c7d05c-a2e5-4fec-acdc-d2637f713a18 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:09.914440 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7ecb6a3c-99ac-4546-ac1e-ad8cd52762e8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.269500 Aug 29 15:29:09.915941 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 564/1124] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:09 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:09.991343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-09c7d05c-a2e5-4fec-acdc-d2637f713a18 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:10.000050 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-09c7d05c-a2e5-4fec-acdc-d2637f713a18 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1213 microversion: 2.1 time: 0.121845 Aug 29 15:29:10.001304 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 561/1125] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:09 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:10.300653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-450be562-e39b-4683-817b-1b7b2763f696 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:10.301543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-450be562-e39b-4683-817b-1b7b2763f696 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:10.318536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a463fd24-96d4-4f1b-8b91-b94668a13d90 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:10.320353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a463fd24-96d4-4f1b-8b91-b94668a13d90 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:10.328390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a463fd24-96d4-4f1b-8b91-b94668a13d90 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:10.331546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a463fd24-96d4-4f1b-8b91-b94668a13d90 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:10.332383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a463fd24-96d4-4f1b-8b91-b94668a13d90 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:10.333116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-450be562-e39b-4683-817b-1b7b2763f696 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:10.333626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-450be562-e39b-4683-817b-1b7b2763f696 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:10.333990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a463fd24-96d4-4f1b-8b91-b94668a13d90 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:10.334106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-450be562-e39b-4683-817b-1b7b2763f696 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:10.334770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-450be562-e39b-4683-817b-1b7b2763f696 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:10.335174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a463fd24-96d4-4f1b-8b91-b94668a13d90 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:10.335968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a463fd24-96d4-4f1b-8b91-b94668a13d90 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:10.339888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-450be562-e39b-4683-817b-1b7b2763f696 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:10.340734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-450be562-e39b-4683-817b-1b7b2763f696 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:10.594624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a463fd24-96d4-4f1b-8b91-b94668a13d90 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:10.605604 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a463fd24-96d4-4f1b-8b91-b94668a13d90 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1316 microversion: 2.1 time: 0.291855 Aug 29 15:29:10.607125 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 562/1126] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:10 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:10.623879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e9e3076a-5816-457f-a0a0-1f69456bbbff tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:10.624873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e9e3076a-5816-457f-a0a0-1f69456bbbff tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:10.635717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9e3076a-5816-457f-a0a0-1f69456bbbff tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:10.636624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9e3076a-5816-457f-a0a0-1f69456bbbff tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:10.637350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9e3076a-5816-457f-a0a0-1f69456bbbff tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:10.639282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9e3076a-5816-457f-a0a0-1f69456bbbff tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:10.641670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9e3076a-5816-457f-a0a0-1f69456bbbff tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:10.643071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9e3076a-5816-457f-a0a0-1f69456bbbff tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:10.995226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e9e3076a-5816-457f-a0a0-1f69456bbbff tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:11.011364 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e9e3076a-5816-457f-a0a0-1f69456bbbff tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.390398 Aug 29 15:29:11.013230 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 563/1127] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:10 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:11.020363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1cf518ce-e60d-470d-8357-cd678642f73e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:11.021579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1cf518ce-e60d-470d-8357-cd678642f73e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:11.029909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cf518ce-e60d-470d-8357-cd678642f73e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.034020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cf518ce-e60d-470d-8357-cd678642f73e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.036566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cf518ce-e60d-470d-8357-cd678642f73e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.036566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cf518ce-e60d-470d-8357-cd678642f73e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.036566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cf518ce-e60d-470d-8357-cd678642f73e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.036566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cf518ce-e60d-470d-8357-cd678642f73e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.155718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-1cf518ce-e60d-470d-8357-cd678642f73e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:11.180287 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1cf518ce-e60d-470d-8357-cd678642f73e tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.165374 Aug 29 15:29:11.193147 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 564/1128] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:11 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:11.193147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ce96da0a-12cb-47e0-b31b-c1fd9b8ab873 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:11.193147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ce96da0a-12cb-47e0-b31b-c1fd9b8ab873 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:11.194100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce96da0a-12cb-47e0-b31b-c1fd9b8ab873 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.194609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce96da0a-12cb-47e0-b31b-c1fd9b8ab873 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.195041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce96da0a-12cb-47e0-b31b-c1fd9b8ab873 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.195968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce96da0a-12cb-47e0-b31b-c1fd9b8ab873 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.196174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce96da0a-12cb-47e0-b31b-c1fd9b8ab873 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.196590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce96da0a-12cb-47e0-b31b-c1fd9b8ab873 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.243311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce96da0a-12cb-47e0-b31b-c1fd9b8ab873 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.243824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce96da0a-12cb-47e0-b31b-c1fd9b8ab873 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.244374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce96da0a-12cb-47e0-b31b-c1fd9b8ab873 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.244832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-ce96da0a-12cb-47e0-b31b-c1fd9b8ab873 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lazy-loading 'fault' on Instance uuid 45d3d180-599f-4c45-a0ea-53f2180484d5 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:11.301577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ce96da0a-12cb-47e0-b31b-c1fd9b8ab873 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72442d50b3f74cb6acdfba7eeebe2274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a902f071321a4216b4d17078181a61c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:11.311285 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ce96da0a-12cb-47e0-b31b-c1fd9b8ab873 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 200 len: 1306 microversion: 2.1 time: 0.128640 Aug 29 15:29:11.312156 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 565/1129] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:11 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 1306 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:11.316697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-61e25220-388e-4382-b680-2c015585bfdc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:11.317314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-61e25220-388e-4382-b680-2c015585bfdc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:11.324480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61e25220-388e-4382-b680-2c015585bfdc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.325217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61e25220-388e-4382-b680-2c015585bfdc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.325682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61e25220-388e-4382-b680-2c015585bfdc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.326324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61e25220-388e-4382-b680-2c015585bfdc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.326775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61e25220-388e-4382-b680-2c015585bfdc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.327183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61e25220-388e-4382-b680-2c015585bfdc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.358740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-450be562-e39b-4683-817b-1b7b2763f696 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:11.367496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-450be562-e39b-4683-817b-1b7b2763f696 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:11.381103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-450be562-e39b-4683-817b-1b7b2763f696 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:11.383024 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-450be562-e39b-4683-817b-1b7b2763f696 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1411 microversion: 2.25 time: 1.087324 Aug 29 15:29:11.387043 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 565/1130] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:10 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1411 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:11.409960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dc6affc6-0f07-4f4e-97eb-65b44601155e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:11.410476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dc6affc6-0f07-4f4e-97eb-65b44601155e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:11.428192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc6affc6-0f07-4f4e-97eb-65b44601155e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.433947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc6affc6-0f07-4f4e-97eb-65b44601155e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.434440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc6affc6-0f07-4f4e-97eb-65b44601155e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.435232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc6affc6-0f07-4f4e-97eb-65b44601155e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.436868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc6affc6-0f07-4f4e-97eb-65b44601155e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.437370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc6affc6-0f07-4f4e-97eb-65b44601155e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.550325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-61e25220-388e-4382-b680-2c015585bfdc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:11.560218 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-61e25220-388e-4382-b680-2c015585bfdc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.247006 Aug 29 15:29:11.561119 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 566/1131] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:11 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:11.587780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dc6affc6-0f07-4f4e-97eb-65b44601155e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:11.596550 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dc6affc6-0f07-4f4e-97eb-65b44601155e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1213 microversion: 2.1 time: 0.207441 Aug 29 15:29:11.609754 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 566/1132] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:11 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1213 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:11.637666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9459f4f9-315c-406a-9394-4725a396a0d9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:11.637666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9459f4f9-315c-406a-9394-4725a396a0d9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:11.637666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9459f4f9-315c-406a-9394-4725a396a0d9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.637666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9459f4f9-315c-406a-9394-4725a396a0d9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.641777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9459f4f9-315c-406a-9394-4725a396a0d9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.642770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9459f4f9-315c-406a-9394-4725a396a0d9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:11.643424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9459f4f9-315c-406a-9394-4725a396a0d9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:11.643957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9459f4f9-315c-406a-9394-4725a396a0d9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:11.976470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9459f4f9-315c-406a-9394-4725a396a0d9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:11.988505 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9459f4f9-315c-406a-9394-4725a396a0d9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1316 microversion: 2.1 time: 0.365878 Aug 29 15:29:12.001443 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 567/1133] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:11 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:12.048623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-48503195-1b9c-4cbe-9737-6abc005800ae tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:12.050369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-48503195-1b9c-4cbe-9737-6abc005800ae tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:12.057980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48503195-1b9c-4cbe-9737-6abc005800ae tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.058578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48503195-1b9c-4cbe-9737-6abc005800ae tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.059084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48503195-1b9c-4cbe-9737-6abc005800ae tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.059966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48503195-1b9c-4cbe-9737-6abc005800ae tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.060421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48503195-1b9c-4cbe-9737-6abc005800ae tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.060851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48503195-1b9c-4cbe-9737-6abc005800ae tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.286471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-52832744-aa87-4f21-a12d-1ee1a58b3a72 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:12.287173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-52832744-aa87-4f21-a12d-1ee1a58b3a72 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:12.294489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52832744-aa87-4f21-a12d-1ee1a58b3a72 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.295057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52832744-aa87-4f21-a12d-1ee1a58b3a72 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.295508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52832744-aa87-4f21-a12d-1ee1a58b3a72 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.296263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52832744-aa87-4f21-a12d-1ee1a58b3a72 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.296820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52832744-aa87-4f21-a12d-1ee1a58b3a72 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.297370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52832744-aa87-4f21-a12d-1ee1a58b3a72 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.373712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-52832744-aa87-4f21-a12d-1ee1a58b3a72 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:12.393039 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-52832744-aa87-4f21-a12d-1ee1a58b3a72 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.110398 Aug 29 15:29:12.405385 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 568/1134] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:12 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:12.410932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6fa8f82b-fe85-4313-b07f-77548a2406b5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:12.411684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6fa8f82b-fe85-4313-b07f-77548a2406b5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] [instance: 45d3d180-599f-4c45-a0ea-53f2180484d5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:12.417890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fa8f82b-fe85-4313-b07f-77548a2406b5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.418372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fa8f82b-fe85-4313-b07f-77548a2406b5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.418828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fa8f82b-fe85-4313-b07f-77548a2406b5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.419534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fa8f82b-fe85-4313-b07f-77548a2406b5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.420030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fa8f82b-fe85-4313-b07f-77548a2406b5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.420471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fa8f82b-fe85-4313-b07f-77548a2406b5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.434964 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-6fa8f82b-fe85-4313-b07f-77548a2406b5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] HTTP exception thrown: Instance 45d3d180-599f-4c45-a0ea-53f2180484d5 could not be found. Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6fa8f82b-fe85-4313-b07f-77548a2406b5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Request method failure captured: Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 HTTP/1.1 Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNrU3pY8KEJeQ70V4Ew9UiAh-quHtjqVb-e-SqU-d9sNmeVy-bASVP11bcHjm1fQVMPxxGZYKInsaJOCSZK7Ho5GXKCMPjIIZTOM9IUPhzpxAevgUGvEJ1KtA9D88GZouhkSJrrnUx5vAo72Dp6hv34vbSYa6W2NhXV6f6U2jwkahaE Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: a902f071321a4216b4d17078181a61c6 Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesOneServerTestJSON-363047811 Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:29:12.436743 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:29:12.438517 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a902f071321a4216b4d17078181a61c6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a902f071321a4216b4d17078181a61c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a902f071321a4216b4d17078181a61c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a902f071321a4216b4d17078181a61c6"}]}] Aug 29 15:29:12.438517 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesOneServerTestJSON-363047811 Aug 29 15:29:12.438517 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: a902f071321a4216b4d17078181a61c6 Aug 29 15:29:12.438517 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-363047811 Aug 29 15:29:12.438517 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesOneServerTestJSON-363047811-project Aug 29 15:29:12.438517 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:29:12.438517 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:29:12.438517 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 72442d50b3f74cb6acdfba7eeebe2274 Aug 29 15:29:12.438517 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesOneServerTestJSON-363047811-project Aug 29 15:29:12.438517 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:29:12.438517 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 45d3d180-599f-4c45-a0ea-53f2180484d5 could not be found. Aug 29 15:29:12.438517 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '45d3d180-599f-4c45-a0ea-53f2180484d5'} Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d3d180-599f-4c45-a0ea-53f2180484d5 could not be found. Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:12.442709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d3d180-599f-4c45-a0ea-53f2180484d5 could not be found. Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d3d180-599f-4c45-a0ea-53f2180484d5 could not be found. Aug 29 15:29:12.445314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:12.446911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6fa8f82b-fe85-4313-b07f-77548a2406b5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] Returning 404 to user: Instance 45d3d180-599f-4c45-a0ea-53f2180484d5 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:12.446911 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6fa8f82b-fe85-4313-b07f-77548a2406b5 tempest-ImagesOneServerTestJSON-363047811 tempest-ImagesOneServerTestJSON-363047811-project] 10.222.0.62 "GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5" status: 404 len: 111 microversion: 2.1 time: 0.043472 Aug 29 15:29:12.446911 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 569/1135] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:12 2022] GET /compute/v2.1/servers/45d3d180-599f-4c45-a0ea-53f2180484d5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:12.446911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1331adf1-5bc5-441c-9efa-76ef03d0aa87 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:12.446911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1331adf1-5bc5-441c-9efa-76ef03d0aa87 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:12.451221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1331adf1-5bc5-441c-9efa-76ef03d0aa87 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.451720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1331adf1-5bc5-441c-9efa-76ef03d0aa87 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.452507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1331adf1-5bc5-441c-9efa-76ef03d0aa87 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.453280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1331adf1-5bc5-441c-9efa-76ef03d0aa87 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.453740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1331adf1-5bc5-441c-9efa-76ef03d0aa87 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.454230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1331adf1-5bc5-441c-9efa-76ef03d0aa87 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.488685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-48503195-1b9c-4cbe-9737-6abc005800ae tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:12.499462 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-48503195-1b9c-4cbe-9737-6abc005800ae tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.458113 Aug 29 15:29:12.501121 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 567/1136] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:12 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:12.583678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-848fa780-8c56-4aa3-bb4f-adfb4ee1cd55 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:12.584566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-848fa780-8c56-4aa3-bb4f-adfb4ee1cd55 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:12.591459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-848fa780-8c56-4aa3-bb4f-adfb4ee1cd55 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.592214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-848fa780-8c56-4aa3-bb4f-adfb4ee1cd55 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.592874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-848fa780-8c56-4aa3-bb4f-adfb4ee1cd55 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.594143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-848fa780-8c56-4aa3-bb4f-adfb4ee1cd55 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.595001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-848fa780-8c56-4aa3-bb4f-adfb4ee1cd55 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.595860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-848fa780-8c56-4aa3-bb4f-adfb4ee1cd55 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.604868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1331adf1-5bc5-441c-9efa-76ef03d0aa87 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:12.615435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1331adf1-5bc5-441c-9efa-76ef03d0aa87 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:12.617352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1331adf1-5bc5-441c-9efa-76ef03d0aa87 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:12.618492 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1331adf1-5bc5-441c-9efa-76ef03d0aa87 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1411 microversion: 2.25 time: 0.178523 Aug 29 15:29:12.629140 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 570/1137] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:12 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1411 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:12.629140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-559efad6-0efa-4003-a97f-55e02a23260d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:12.629140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-559efad6-0efa-4003-a97f-55e02a23260d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:12.641300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-559efad6-0efa-4003-a97f-55e02a23260d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.641838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-559efad6-0efa-4003-a97f-55e02a23260d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.642291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-559efad6-0efa-4003-a97f-55e02a23260d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.643032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-559efad6-0efa-4003-a97f-55e02a23260d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:12.643498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-559efad6-0efa-4003-a97f-55e02a23260d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:12.644163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-559efad6-0efa-4003-a97f-55e02a23260d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:12.664988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:12.741635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-559efad6-0efa-4003-a97f-55e02a23260d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:12.751784 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-559efad6-0efa-4003-a97f-55e02a23260d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1213 microversion: 2.1 time: 0.129349 Aug 29 15:29:12.752702 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 571/1138] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:12 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1213 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:12.825794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-848fa780-8c56-4aa3-bb4f-adfb4ee1cd55 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:12.837780 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-848fa780-8c56-4aa3-bb4f-adfb4ee1cd55 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.258057 Aug 29 15:29:12.838492 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 568/1139] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:12 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:13.010656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6fb7313f-c91e-406a-a9ec-a6e734d3bbb4 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:13.011534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6fb7313f-c91e-406a-a9ec-a6e734d3bbb4 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:13.018030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fb7313f-c91e-406a-a9ec-a6e734d3bbb4 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.018739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fb7313f-c91e-406a-a9ec-a6e734d3bbb4 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.019155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fb7313f-c91e-406a-a9ec-a6e734d3bbb4 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.020048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fb7313f-c91e-406a-a9ec-a6e734d3bbb4 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.020701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fb7313f-c91e-406a-a9ec-a6e734d3bbb4 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.021110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fb7313f-c91e-406a-a9ec-a6e734d3bbb4 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.166830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6fb7313f-c91e-406a-a9ec-a6e734d3bbb4 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:13.175081 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6fb7313f-c91e-406a-a9ec-a6e734d3bbb4 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1316 microversion: 2.1 time: 0.168436 Aug 29 15:29:13.177128 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 572/1140] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:13 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:13.422194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-17db1e17-bd8f-4172-8558-91a834fcc9da tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:13.425905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-697fefd5-bb4d-45ce-b707-d62f3fe297c8 req-8d8a131f-d368-4606-84c0-f8483820dc67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf2f2e5-da5a-47bc-920c-d105a88b2847", "name": "network-vif-plugged", "status": "completed", "tag": "868a1bf9-0936-4b9a-a3ed-373847b74389"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:13.427056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-17db1e17-bd8f-4172-8558-91a834fcc9da tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:13.444833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17db1e17-bd8f-4172-8558-91a834fcc9da tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.445482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17db1e17-bd8f-4172-8558-91a834fcc9da tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.445999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17db1e17-bd8f-4172-8558-91a834fcc9da tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.446742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17db1e17-bd8f-4172-8558-91a834fcc9da tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.447202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17db1e17-bd8f-4172-8558-91a834fcc9da tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.452479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-697fefd5-bb4d-45ce-b707-d62f3fe297c8 req-8d8a131f-d368-4606-84c0-f8483820dc67 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.452920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-697fefd5-bb4d-45ce-b707-d62f3fe297c8 req-8d8a131f-d368-4606-84c0-f8483820dc67 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.453379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-697fefd5-bb4d-45ce-b707-d62f3fe297c8 req-8d8a131f-d368-4606-84c0-f8483820dc67 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.455413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17db1e17-bd8f-4172-8558-91a834fcc9da tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.477204 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-697fefd5-bb4d-45ce-b707-d62f3fe297c8 req-8d8a131f-d368-4606-84c0-f8483820dc67 service nova] Creating event network-vif-plugged:868a1bf9-0936-4b9a-a3ed-373847b74389 for instance 8bf2f2e5-da5a-47bc-920c-d105a88b2847 on n-h2-839401-11 Aug 29 15:29:13.482280 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-697fefd5-bb4d-45ce-b707-d62f3fe297c8 req-8d8a131f-d368-4606-84c0-f8483820dc67 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065027 Aug 29 15:29:13.482947 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 573/1141] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:13.521236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-de81fe37-d61f-47a7-ada1-803c0f2da910 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:13.521930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-de81fe37-d61f-47a7-ada1-803c0f2da910 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:13.528212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de81fe37-d61f-47a7-ada1-803c0f2da910 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.528687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de81fe37-d61f-47a7-ada1-803c0f2da910 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.529134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de81fe37-d61f-47a7-ada1-803c0f2da910 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.530140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de81fe37-d61f-47a7-ada1-803c0f2da910 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.530590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de81fe37-d61f-47a7-ada1-803c0f2da910 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.531006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de81fe37-d61f-47a7-ada1-803c0f2da910 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.542539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-17db1e17-bd8f-4172-8558-91a834fcc9da tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:13.562815 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-17db1e17-bd8f-4172-8558-91a834fcc9da tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.147588 Aug 29 15:29:13.573553 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 569/1142] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:13 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:13.642401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3e25f067-2424-4f39-8716-9d5b8746d73a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:13.643022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3e25f067-2424-4f39-8716-9d5b8746d73a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:13.650384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e25f067-2424-4f39-8716-9d5b8746d73a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.650885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e25f067-2424-4f39-8716-9d5b8746d73a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.651329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e25f067-2424-4f39-8716-9d5b8746d73a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.652037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e25f067-2424-4f39-8716-9d5b8746d73a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.653300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e25f067-2424-4f39-8716-9d5b8746d73a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.653741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e25f067-2424-4f39-8716-9d5b8746d73a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.693420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-de81fe37-d61f-47a7-ada1-803c0f2da910 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:13.701881 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-de81fe37-d61f-47a7-ada1-803c0f2da910 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.185023 Aug 29 15:29:13.702743 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 574/1143] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:13 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:13.772958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4c3c2e98-e0b5-44a0-8017-977839aa70fb tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:13.773869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4c3c2e98-e0b5-44a0-8017-977839aa70fb tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:13.781407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c3c2e98-e0b5-44a0-8017-977839aa70fb tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.782058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c3c2e98-e0b5-44a0-8017-977839aa70fb tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.782501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c3c2e98-e0b5-44a0-8017-977839aa70fb tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.783300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c3c2e98-e0b5-44a0-8017-977839aa70fb tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.783759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c3c2e98-e0b5-44a0-8017-977839aa70fb tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.784183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c3c2e98-e0b5-44a0-8017-977839aa70fb tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.833398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3e25f067-2424-4f39-8716-9d5b8746d73a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:13.843923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3e25f067-2424-4f39-8716-9d5b8746d73a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:13.845696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3e25f067-2424-4f39-8716-9d5b8746d73a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:13.846984 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3e25f067-2424-4f39-8716-9d5b8746d73a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1411 microversion: 2.25 time: 0.208967 Aug 29 15:29:13.851373 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 570/1144] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:13 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1411 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:13.855389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4c3c2e98-e0b5-44a0-8017-977839aa70fb tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:13.859193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c23a19b1-5463-4d4e-8a50-afb016e29e98 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:13.859995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c23a19b1-5463-4d4e-8a50-afb016e29e98 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:13.864839 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4c3c2e98-e0b5-44a0-8017-977839aa70fb tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1213 microversion: 2.1 time: 0.096374 Aug 29 15:29:13.865664 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 575/1145] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:13 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:13.866833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c23a19b1-5463-4d4e-8a50-afb016e29e98 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.867329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c23a19b1-5463-4d4e-8a50-afb016e29e98 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.867769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c23a19b1-5463-4d4e-8a50-afb016e29e98 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:13.868508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c23a19b1-5463-4d4e-8a50-afb016e29e98 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:13.868965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c23a19b1-5463-4d4e-8a50-afb016e29e98 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:13.869436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c23a19b1-5463-4d4e-8a50-afb016e29e98 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.009304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c23a19b1-5463-4d4e-8a50-afb016e29e98 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:14.017374 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c23a19b1-5463-4d4e-8a50-afb016e29e98 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.162218 Aug 29 15:29:14.017946 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 571/1146] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:13 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:14.049910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8d5f744c-f1b4-4f1e-9e7a-788a5790c743 tempest-ListImageFiltersNegativeTestJSON-1110318991 tempest-ListImageFiltersNegativeTestJSON-1110318991-project] Calling method '.version_select at 0x7fc42b858820>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:14.071006 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-8d5f744c-f1b4-4f1e-9e7a-788a5790c743 tempest-ListImageFiltersNegativeTestJSON-1110318991 tempest-ListImageFiltersNegativeTestJSON-1110318991-project] HTTP exception thrown: Image not found. Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8d5f744c-f1b4-4f1e-9e7a-788a5790c743 tempest-ListImageFiltersNegativeTestJSON-1110318991 tempest-ListImageFiltersNegativeTestJSON-1110318991-project] Request method failure captured: Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/images/7163e412-5896-4633-895d-253a9bfb32c9 HTTP/1.1 Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNtJGrBK8Rxoo83qOYYPFE6XGsA_7sCw-7ZjG85rMzRF5UzFDWHQZ94UXo0KgAUdm-SN5vgBLdotsZbXU-ijOHRIaMj-14742C6eSQg1UEuTAAH77sb_GMZMsEqgyVOkYK-io9zh96UyoxkKugHBAmm1_ovgcexawiOZgeXFbEVVWXc Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 51bbe5f4282e45658b6d89b7c8ad041f Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1110318991 Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:29:14.073229 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:29:14.074817 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_51bbe5f4282e45658b6d89b7c8ad041f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/51bbe5f4282e45658b6d89b7c8ad041f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51bbe5f4282e45658b6d89b7c8ad041f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51bbe5f4282e45658b6d89b7c8ad041f"}]}] Aug 29 15:29:14.074817 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1110318991 Aug 29 15:29:14.074817 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 51bbe5f4282e45658b6d89b7c8ad041f Aug 29 15:29:14.074817 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1110318991 Aug 29 15:29:14.074817 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ListImageFiltersNegativeTestJSON-1110318991-project Aug 29 15:29:14.074817 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:29:14.074817 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:29:14.074817 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: be3ffe2391ba41e1bb57a172c7ebb799 Aug 29 15:29:14.074817 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1110318991-project Aug 29 15:29:14.074817 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:29:14.074817 n-d-839401-11 devstack@n-api.service[122360]: exception: Image not found. Aug 29 15:29:14.074817 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7163e412-5896-4633-895d-253a9bfb32c9'} Aug 29 15:29:14.074817 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:29:14.075821 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7163e412-5896-4633-895d-253a9bfb32c9 Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:29:14.077110 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7163e412-5896-4633-895d-253a9bfb32c9 could not be found. Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:29:14.078315 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:29:14.079518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:14.079518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:14.079518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 15:29:14.079518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:29:14.079518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:29:14.079518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:14.079518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:14.079518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:14.079518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:14.079518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:14.079518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:14.079518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:14.079518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:14.079518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:29:14.079518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:14.079518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8d5f744c-f1b4-4f1e-9e7a-788a5790c743 tempest-ListImageFiltersNegativeTestJSON-1110318991 tempest-ListImageFiltersNegativeTestJSON-1110318991-project] Returning 404 to user: Image not found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:14.080713 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8d5f744c-f1b4-4f1e-9e7a-788a5790c743 tempest-ListImageFiltersNegativeTestJSON-1110318991 tempest-ListImageFiltersNegativeTestJSON-1110318991-project] 10.222.0.62 "GET /compute/v2.1/images/7163e412-5896-4633-895d-253a9bfb32c9" status: 404 len: 62 microversion: 2.1 time: 0.142704 Aug 29 15:29:14.080713 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 576/1147] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:29:13 2022] GET /compute/v2.1/images/7163e412-5896-4633-895d-253a9bfb32c9 => generated 62 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:29:14.195677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-854873ea-42cd-4710-bc92-909774f445b8 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:14.196362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-854873ea-42cd-4710-bc92-909774f445b8 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:14.202735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-854873ea-42cd-4710-bc92-909774f445b8 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.203295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-854873ea-42cd-4710-bc92-909774f445b8 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.203792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-854873ea-42cd-4710-bc92-909774f445b8 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.204694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-854873ea-42cd-4710-bc92-909774f445b8 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.205346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-854873ea-42cd-4710-bc92-909774f445b8 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.205843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-854873ea-42cd-4710-bc92-909774f445b8 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.339556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-854873ea-42cd-4710-bc92-909774f445b8 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:14.347812 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-854873ea-42cd-4710-bc92-909774f445b8 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1316 microversion: 2.1 time: 0.156388 Aug 29 15:29:14.348401 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 572/1148] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:14 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:14.590841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f95e282d-66db-42fb-be9e-87dc4298d396 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:14.593270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f95e282d-66db-42fb-be9e-87dc4298d396 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:14.600758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f95e282d-66db-42fb-be9e-87dc4298d396 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.601286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f95e282d-66db-42fb-be9e-87dc4298d396 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.601722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f95e282d-66db-42fb-be9e-87dc4298d396 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.602410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f95e282d-66db-42fb-be9e-87dc4298d396 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.602857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f95e282d-66db-42fb-be9e-87dc4298d396 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.603279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f95e282d-66db-42fb-be9e-87dc4298d396 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.674710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-f95e282d-66db-42fb-be9e-87dc4298d396 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:14.692332 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f95e282d-66db-42fb-be9e-87dc4298d396 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.108004 Aug 29 15:29:14.693053 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 577/1149] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:14 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:14.722600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0d2bcbf6-68d4-43d1-b7a3-9073c1a94948 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:14.723435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0d2bcbf6-68d4-43d1-b7a3-9073c1a94948 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:14.741483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d2bcbf6-68d4-43d1-b7a3-9073c1a94948 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.741973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d2bcbf6-68d4-43d1-b7a3-9073c1a94948 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.742406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d2bcbf6-68d4-43d1-b7a3-9073c1a94948 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.743144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d2bcbf6-68d4-43d1-b7a3-9073c1a94948 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.743598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d2bcbf6-68d4-43d1-b7a3-9073c1a94948 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.746829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d2bcbf6-68d4-43d1-b7a3-9073c1a94948 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.872339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d8b3114f-a465-4085-999a-aaed2f099e97 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:14.873008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d8b3114f-a465-4085-999a-aaed2f099e97 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:14.880472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8b3114f-a465-4085-999a-aaed2f099e97 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.880472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8b3114f-a465-4085-999a-aaed2f099e97 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.880472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8b3114f-a465-4085-999a-aaed2f099e97 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.883596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0d2bcbf6-68d4-43d1-b7a3-9073c1a94948 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:14.887496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8b3114f-a465-4085-999a-aaed2f099e97 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.887984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8b3114f-a465-4085-999a-aaed2f099e97 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.888601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8b3114f-a465-4085-999a-aaed2f099e97 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.893601 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0d2bcbf6-68d4-43d1-b7a3-9073c1a94948 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.175292 Aug 29 15:29:14.894209 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 573/1150] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:14 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:14.902065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-abce11e7-7a42-44fa-b68a-d9d351fcd21b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:14.902686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-abce11e7-7a42-44fa-b68a-d9d351fcd21b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:14.910748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abce11e7-7a42-44fa-b68a-d9d351fcd21b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.911352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abce11e7-7a42-44fa-b68a-d9d351fcd21b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.911787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abce11e7-7a42-44fa-b68a-d9d351fcd21b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.912488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abce11e7-7a42-44fa-b68a-d9d351fcd21b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:14.912942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abce11e7-7a42-44fa-b68a-d9d351fcd21b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:14.913616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abce11e7-7a42-44fa-b68a-d9d351fcd21b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:14.979591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-abce11e7-7a42-44fa-b68a-d9d351fcd21b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:14.987668 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-abce11e7-7a42-44fa-b68a-d9d351fcd21b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1213 microversion: 2.1 time: 0.092311 Aug 29 15:29:15.000438 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 574/1151] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:14 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:15.025751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d8b3114f-a465-4085-999a-aaed2f099e97 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:15.034512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d8b3114f-a465-4085-999a-aaed2f099e97 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:15.035961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d8b3114f-a465-4085-999a-aaed2f099e97 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:15.037714 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d8b3114f-a465-4085-999a-aaed2f099e97 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1411 microversion: 2.25 time: 0.169214 Aug 29 15:29:15.038930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f234609e-f041-4571-a160-3708ad51b83f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:15.039568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f234609e-f041-4571-a160-3708ad51b83f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:15.039819 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 578/1152] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:14 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1411 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:15.053318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f234609e-f041-4571-a160-3708ad51b83f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:15.053318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f234609e-f041-4571-a160-3708ad51b83f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:15.053318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f234609e-f041-4571-a160-3708ad51b83f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:15.053318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f234609e-f041-4571-a160-3708ad51b83f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:15.053804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f234609e-f041-4571-a160-3708ad51b83f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:15.053804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f234609e-f041-4571-a160-3708ad51b83f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:15.182705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f234609e-f041-4571-a160-3708ad51b83f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:15.190594 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f234609e-f041-4571-a160-3708ad51b83f tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.155938 Aug 29 15:29:15.191133 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 575/1153] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:15 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:15.367804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6bcb89c9-24ea-4d60-b535-25f7ae9fcf62 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:15.368548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6bcb89c9-24ea-4d60-b535-25f7ae9fcf62 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:15.374677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bcb89c9-24ea-4d60-b535-25f7ae9fcf62 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:15.377872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bcb89c9-24ea-4d60-b535-25f7ae9fcf62 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:15.378349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bcb89c9-24ea-4d60-b535-25f7ae9fcf62 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:15.379082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bcb89c9-24ea-4d60-b535-25f7ae9fcf62 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:15.379546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bcb89c9-24ea-4d60-b535-25f7ae9fcf62 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:15.379949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bcb89c9-24ea-4d60-b535-25f7ae9fcf62 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:15.723450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-63872671-ef9f-485e-abfc-85afeb7b44bf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:15.729201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-63872671-ef9f-485e-abfc-85afeb7b44bf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:15.741815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63872671-ef9f-485e-abfc-85afeb7b44bf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:15.743580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63872671-ef9f-485e-abfc-85afeb7b44bf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:15.744939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63872671-ef9f-485e-abfc-85afeb7b44bf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:15.747806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63872671-ef9f-485e-abfc-85afeb7b44bf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:15.748687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63872671-ef9f-485e-abfc-85afeb7b44bf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:15.751065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63872671-ef9f-485e-abfc-85afeb7b44bf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:15.932448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-63872671-ef9f-485e-abfc-85afeb7b44bf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:15.934828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6bcb89c9-24ea-4d60-b535-25f7ae9fcf62 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:15.953222 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6bcb89c9-24ea-4d60-b535-25f7ae9fcf62 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1316 microversion: 2.1 time: 0.589159 Aug 29 15:29:15.954438 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 579/1154] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:15 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:15.963450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-670dc256-77c1-4c57-b684-2a533306913e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:15.964407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-670dc256-77c1-4c57-b684-2a533306913e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:15.965499 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-63872671-ef9f-485e-abfc-85afeb7b44bf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.251675 Aug 29 15:29:15.981963 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 576/1155] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:15 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:29:15.998138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-670dc256-77c1-4c57-b684-2a533306913e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.000679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-670dc256-77c1-4c57-b684-2a533306913e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.002515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-670dc256-77c1-4c57-b684-2a533306913e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.006839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-670dc256-77c1-4c57-b684-2a533306913e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.007893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-387ee96b-85e6-44c4-b6ce-cb58ad81d077 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:16.008495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-387ee96b-85e6-44c4-b6ce-cb58ad81d077 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:16.009687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-670dc256-77c1-4c57-b684-2a533306913e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.010925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-670dc256-77c1-4c57-b684-2a533306913e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.015093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-387ee96b-85e6-44c4-b6ce-cb58ad81d077 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.015855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-387ee96b-85e6-44c4-b6ce-cb58ad81d077 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.016564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-387ee96b-85e6-44c4-b6ce-cb58ad81d077 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.017651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-387ee96b-85e6-44c4-b6ce-cb58ad81d077 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.018262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-387ee96b-85e6-44c4-b6ce-cb58ad81d077 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.018835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-387ee96b-85e6-44c4-b6ce-cb58ad81d077 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.416343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-387ee96b-85e6-44c4-b6ce-cb58ad81d077 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:16.425771 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-387ee96b-85e6-44c4-b6ce-cb58ad81d077 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1213 microversion: 2.1 time: 0.421650 Aug 29 15:29:16.427368 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 577/1156] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:16 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1213 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:16.432941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-072da779-a52c-4ced-be15-37d2a251c4c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:16.433877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-072da779-a52c-4ced-be15-37d2a251c4c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:16.444338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-072da779-a52c-4ced-be15-37d2a251c4c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.445141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-072da779-a52c-4ced-be15-37d2a251c4c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.445735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-072da779-a52c-4ced-be15-37d2a251c4c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.446997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-072da779-a52c-4ced-be15-37d2a251c4c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.447717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-072da779-a52c-4ced-be15-37d2a251c4c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.448293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-072da779-a52c-4ced-be15-37d2a251c4c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.451899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:16.567820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-670dc256-77c1-4c57-b684-2a533306913e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:16.576347 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-670dc256-77c1-4c57-b684-2a533306913e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.620250 Aug 29 15:29:16.577280 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 580/1157] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:15 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:16.584300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-30eb0cac-2502-486b-ac41-427dd0047fd7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:16.585013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-30eb0cac-2502-486b-ac41-427dd0047fd7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:16.593473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30eb0cac-2502-486b-ac41-427dd0047fd7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.594325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30eb0cac-2502-486b-ac41-427dd0047fd7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.594953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30eb0cac-2502-486b-ac41-427dd0047fd7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.595765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30eb0cac-2502-486b-ac41-427dd0047fd7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.596325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30eb0cac-2502-486b-ac41-427dd0047fd7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.596824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30eb0cac-2502-486b-ac41-427dd0047fd7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.811958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-072da779-a52c-4ced-be15-37d2a251c4c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:16.822822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-072da779-a52c-4ced-be15-37d2a251c4c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:16.824381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-072da779-a52c-4ced-be15-37d2a251c4c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:16.826075 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-072da779-a52c-4ced-be15-37d2a251c4c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1411 microversion: 2.25 time: 0.397617 Aug 29 15:29:16.827479 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 578/1158] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:16 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1411 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:16.845599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-30eb0cac-2502-486b-ac41-427dd0047fd7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:16.851598 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-30eb0cac-2502-486b-ac41-427dd0047fd7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.272978 Aug 29 15:29:16.852576 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 581/1159] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:16 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:16.927621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-6d54279f-f3e8-4483-b293-b44cbd72f60e req-3829cadf-ff1e-4d13-be42-e5ee2ff1ac4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32bc300a-b702-4755-b0c2-f0004d7d5016", "tag": "717cefd6-7122-4105-860c-3001547d3901"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:16.939601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6d54279f-f3e8-4483-b293-b44cbd72f60e req-3829cadf-ff1e-4d13-be42-e5ee2ff1ac4f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.940508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6d54279f-f3e8-4483-b293-b44cbd72f60e req-3829cadf-ff1e-4d13-be42-e5ee2ff1ac4f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.941296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6d54279f-f3e8-4483-b293-b44cbd72f60e req-3829cadf-ff1e-4d13-be42-e5ee2ff1ac4f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.954473 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-6d54279f-f3e8-4483-b293-b44cbd72f60e req-3829cadf-ff1e-4d13-be42-e5ee2ff1ac4f service nova] Creating event network-changed:717cefd6-7122-4105-860c-3001547d3901 for instance 32bc300a-b702-4755-b0c2-f0004d7d5016 on n-h1-839401-11 Aug 29 15:29:16.959472 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-6d54279f-f3e8-4483-b293-b44cbd72f60e req-3829cadf-ff1e-4d13-be42-e5ee2ff1ac4f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036413 Aug 29 15:29:16.960083 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 579/1160] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:29:16.973319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-036b8d6a-55b9-4358-9db8-df61f0e87026 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:16.974522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-036b8d6a-55b9-4358-9db8-df61f0e87026 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:16.980579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-036b8d6a-55b9-4358-9db8-df61f0e87026 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.981063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-036b8d6a-55b9-4358-9db8-df61f0e87026 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.981536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-036b8d6a-55b9-4358-9db8-df61f0e87026 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.982235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-036b8d6a-55b9-4358-9db8-df61f0e87026 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:16.982694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-036b8d6a-55b9-4358-9db8-df61f0e87026 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:16.983122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-036b8d6a-55b9-4358-9db8-df61f0e87026 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:16.993097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bbd0a623-f7f1-43dc-ae5f-b984b2dd5ddf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:16.993819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bbd0a623-f7f1-43dc-ae5f-b984b2dd5ddf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:17.001530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbd0a623-f7f1-43dc-ae5f-b984b2dd5ddf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.002338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbd0a623-f7f1-43dc-ae5f-b984b2dd5ddf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.003009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbd0a623-f7f1-43dc-ae5f-b984b2dd5ddf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.004027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbd0a623-f7f1-43dc-ae5f-b984b2dd5ddf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.004712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbd0a623-f7f1-43dc-ae5f-b984b2dd5ddf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.005392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbd0a623-f7f1-43dc-ae5f-b984b2dd5ddf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.087805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-bbd0a623-f7f1-43dc-ae5f-b984b2dd5ddf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:17.106784 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bbd0a623-f7f1-43dc-ae5f-b984b2dd5ddf tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.118240 Aug 29 15:29:17.107411 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 580/1161] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:16 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:17.218823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-036b8d6a-55b9-4358-9db8-df61f0e87026 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:17.234652 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-036b8d6a-55b9-4358-9db8-df61f0e87026 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1503 microversion: 2.1 time: 0.265319 Aug 29 15:29:17.235245 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 582/1162] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:16 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:17.256286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-96dbe474-0e43-4fcb-a3e7-430265561c4e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1129326170"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:17.256856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-96dbe474-0e43-4fcb-a3e7-430265561c4e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:17.264704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96dbe474-0e43-4fcb-a3e7-430265561c4e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.265230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96dbe474-0e43-4fcb-a3e7-430265561c4e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.265665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96dbe474-0e43-4fcb-a3e7-430265561c4e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.266376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96dbe474-0e43-4fcb-a3e7-430265561c4e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.266815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96dbe474-0e43-4fcb-a3e7-430265561c4e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.267336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96dbe474-0e43-4fcb-a3e7-430265561c4e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.428891 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.network.security_group_api [None req-96dbe474-0e43-4fcb-a3e7-430265561c4e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Adding security group 304bb24c-0421-4066-9ce6-21d051f6f050 to port 868a1bf9-0936-4b9a-a3ed-373847b74389 Aug 29 15:29:17.449420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-416d9e90-99e8-4661-98cd-88b884d748b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:17.450047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-416d9e90-99e8-4661-98cd-88b884d748b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:17.457555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-416d9e90-99e8-4661-98cd-88b884d748b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.458177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-416d9e90-99e8-4661-98cd-88b884d748b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.458611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-416d9e90-99e8-4661-98cd-88b884d748b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.459353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-416d9e90-99e8-4661-98cd-88b884d748b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.459841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-416d9e90-99e8-4661-98cd-88b884d748b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.460312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-416d9e90-99e8-4661-98cd-88b884d748b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.539118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-416d9e90-99e8-4661-98cd-88b884d748b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:17.547468 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-416d9e90-99e8-4661-98cd-88b884d748b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1213 microversion: 2.1 time: 0.101961 Aug 29 15:29:17.548632 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 583/1163] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:17 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:17.601192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-99cb84dc-49f9-416d-8945-f9c8ef06a049 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:17.601761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-99cb84dc-49f9-416d-8945-f9c8ef06a049 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:17.609563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99cb84dc-49f9-416d-8945-f9c8ef06a049 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.610152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99cb84dc-49f9-416d-8945-f9c8ef06a049 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.610645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99cb84dc-49f9-416d-8945-f9c8ef06a049 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.611620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99cb84dc-49f9-416d-8945-f9c8ef06a049 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.612269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99cb84dc-49f9-416d-8945-f9c8ef06a049 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.612686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99cb84dc-49f9-416d-8945-f9c8ef06a049 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.858447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-99cb84dc-49f9-416d-8945-f9c8ef06a049 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:17.868065 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-99cb84dc-49f9-416d-8945-f9c8ef06a049 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.271780 Aug 29 15:29:17.874020 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 584/1164] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:17 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:17.879368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-42410f39-6d36-48e1-9b98-c2cfa4d4ce95 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:17.882464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-42410f39-6d36-48e1-9b98-c2cfa4d4ce95 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:17.899177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42410f39-6d36-48e1-9b98-c2cfa4d4ce95 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.900280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42410f39-6d36-48e1-9b98-c2cfa4d4ce95 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.902971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42410f39-6d36-48e1-9b98-c2cfa4d4ce95 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:17.903896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42410f39-6d36-48e1-9b98-c2cfa4d4ce95 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:17.904870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42410f39-6d36-48e1-9b98-c2cfa4d4ce95 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:17.905966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42410f39-6d36-48e1-9b98-c2cfa4d4ce95 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.160721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-42410f39-6d36-48e1-9b98-c2cfa4d4ce95 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:18.174223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-42410f39-6d36-48e1-9b98-c2cfa4d4ce95 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:18.178394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-42410f39-6d36-48e1-9b98-c2cfa4d4ce95 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:18.179627 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-42410f39-6d36-48e1-9b98-c2cfa4d4ce95 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1608 microversion: 2.25 time: 0.304484 Aug 29 15:29:18.180195 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 585/1165] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:17 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1608 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:18.198400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9b82b8d0-3657-42df-8d22-808cbff4a52d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:18.199054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9b82b8d0-3657-42df-8d22-808cbff4a52d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:18.214120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b82b8d0-3657-42df-8d22-808cbff4a52d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.214655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b82b8d0-3657-42df-8d22-808cbff4a52d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.215155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b82b8d0-3657-42df-8d22-808cbff4a52d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.216276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b82b8d0-3657-42df-8d22-808cbff4a52d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.217405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b82b8d0-3657-42df-8d22-808cbff4a52d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.217994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b82b8d0-3657-42df-8d22-808cbff4a52d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.392124 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-96dbe474-0e43-4fcb-a3e7-430265561c4e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "POST /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847/action" status: 202 len: 0 microversion: 2.1 time: 1.139945 Aug 29 15:29:18.393988 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 581/1166] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:29:17 2022] POST /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847/action => generated 0 bytes in 1142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:29:18.402876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bc8d6386-f650-4cd0-a0ac-c29534e18d38 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:18.404024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bc8d6386-f650-4cd0-a0ac-c29534e18d38 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:18.428229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc8d6386-f650-4cd0-a0ac-c29534e18d38 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.445677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc8d6386-f650-4cd0-a0ac-c29534e18d38 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.446790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc8d6386-f650-4cd0-a0ac-c29534e18d38 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.451693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc8d6386-f650-4cd0-a0ac-c29534e18d38 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.452735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc8d6386-f650-4cd0-a0ac-c29534e18d38 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.454739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc8d6386-f650-4cd0-a0ac-c29534e18d38 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.617035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-bc8d6386-f650-4cd0-a0ac-c29534e18d38 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:18.619023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9b82b8d0-3657-42df-8d22-808cbff4a52d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:18.628929 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9b82b8d0-3657-42df-8d22-808cbff4a52d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.440856 Aug 29 15:29:18.629934 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 586/1167] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:18 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:18.647572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3e3cb10c-8f80-411f-af0c-622593abfe5a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:18.647572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3e3cb10c-8f80-411f-af0c-622593abfe5a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:18.653171 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bc8d6386-f650-4cd0-a0ac-c29534e18d38 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.257702 Aug 29 15:29:18.654682 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 582/1168] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:18 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:18.666861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e3cb10c-8f80-411f-af0c-622593abfe5a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.667131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e3cb10c-8f80-411f-af0c-622593abfe5a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.667459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e3cb10c-8f80-411f-af0c-622593abfe5a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.668200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e3cb10c-8f80-411f-af0c-622593abfe5a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.668769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e3cb10c-8f80-411f-af0c-622593abfe5a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.675817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e3cb10c-8f80-411f-af0c-622593abfe5a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.676082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eeb5dbc7-d2f6-42a0-a326-d4c1bbad20bc tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1988973423"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:18.676859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eeb5dbc7-d2f6-42a0-a326-d4c1bbad20bc tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:18.691139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:18.693268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeb5dbc7-d2f6-42a0-a326-d4c1bbad20bc tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.694042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeb5dbc7-d2f6-42a0-a326-d4c1bbad20bc tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.694714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeb5dbc7-d2f6-42a0-a326-d4c1bbad20bc tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.695658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeb5dbc7-d2f6-42a0-a326-d4c1bbad20bc tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.696265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeb5dbc7-d2f6-42a0-a326-d4c1bbad20bc tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.696976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeb5dbc7-d2f6-42a0-a326-d4c1bbad20bc tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.772348 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3e3cb10c-8f80-411f-af0c-622593abfe5a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.141651 Aug 29 15:29:18.772949 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 587/1169] 10.222.0.62 () {60 vars in 1316 bytes} [Mon Aug 29 15:29:18 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:29:18.778165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c105e46f-5a15-4bff-9204-0828207d1ea5 req-a5478b0b-0590-408d-8581-2ae63f7fe63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bf2f2e5-da5a-47bc-920c-d105a88b2847", "tag": "868a1bf9-0936-4b9a-a3ed-373847b74389"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:18.789664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c105e46f-5a15-4bff-9204-0828207d1ea5 req-a5478b0b-0590-408d-8581-2ae63f7fe63f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.790135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c105e46f-5a15-4bff-9204-0828207d1ea5 req-a5478b0b-0590-408d-8581-2ae63f7fe63f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.790901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c105e46f-5a15-4bff-9204-0828207d1ea5 req-a5478b0b-0590-408d-8581-2ae63f7fe63f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.803500 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c105e46f-5a15-4bff-9204-0828207d1ea5 req-a5478b0b-0590-408d-8581-2ae63f7fe63f service nova] Creating event network-changed:868a1bf9-0936-4b9a-a3ed-373847b74389 for instance 8bf2f2e5-da5a-47bc-920c-d105a88b2847 on n-h2-839401-11 Aug 29 15:29:18.813909 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c105e46f-5a15-4bff-9204-0828207d1ea5 req-a5478b0b-0590-408d-8581-2ae63f7fe63f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036299 Aug 29 15:29:18.814994 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 588/1170] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:18.821452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4d0aed63-2aa8-4a8b-8b49-0d268bfb7f85 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:18.822375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4d0aed63-2aa8-4a8b-8b49-0d268bfb7f85 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:18.831010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d0aed63-2aa8-4a8b-8b49-0d268bfb7f85 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.832039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d0aed63-2aa8-4a8b-8b49-0d268bfb7f85 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.832706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d0aed63-2aa8-4a8b-8b49-0d268bfb7f85 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:18.844667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d0aed63-2aa8-4a8b-8b49-0d268bfb7f85 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:18.845575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d0aed63-2aa8-4a8b-8b49-0d268bfb7f85 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:18.846226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d0aed63-2aa8-4a8b-8b49-0d268bfb7f85 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:19.015638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4d0aed63-2aa8-4a8b-8b49-0d268bfb7f85 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:19.030623 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4d0aed63-2aa8-4a8b-8b49-0d268bfb7f85 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1269 microversion: 2.1 time: 0.213353 Aug 29 15:29:19.052537 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 589/1171] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:18 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1269 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:19.059710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4a5faf8f-05d5-4243-b128-9fbc90f3213e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:19.060365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4a5faf8f-05d5-4243-b128-9fbc90f3213e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:19.081509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a5faf8f-05d5-4243-b128-9fbc90f3213e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:19.082018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a5faf8f-05d5-4243-b128-9fbc90f3213e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:19.082458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a5faf8f-05d5-4243-b128-9fbc90f3213e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:19.083174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a5faf8f-05d5-4243-b128-9fbc90f3213e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:19.083637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a5faf8f-05d5-4243-b128-9fbc90f3213e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:19.084064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a5faf8f-05d5-4243-b128-9fbc90f3213e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:19.155013 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.network.security_group_api [None req-eeb5dbc7-d2f6-42a0-a326-d4c1bbad20bc tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Adding security group ccfea317-b3e9-4b77-a205-5c0dc82f88cf to port 868a1bf9-0936-4b9a-a3ed-373847b74389 Aug 29 15:29:19.158540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:19.673005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4a5faf8f-05d5-4243-b128-9fbc90f3213e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:19.690737 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4a5faf8f-05d5-4243-b128-9fbc90f3213e tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.639579 Aug 29 15:29:19.691127 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 590/1172] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:19 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:19.708466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65d9b4bc-78ac-4584-abf8-46723eef7b68 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:19.709134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-65d9b4bc-78ac-4584-abf8-46723eef7b68 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:19.715954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65d9b4bc-78ac-4584-abf8-46723eef7b68 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:19.715954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65d9b4bc-78ac-4584-abf8-46723eef7b68 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:19.716365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65d9b4bc-78ac-4584-abf8-46723eef7b68 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:19.717303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65d9b4bc-78ac-4584-abf8-46723eef7b68 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:19.717761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65d9b4bc-78ac-4584-abf8-46723eef7b68 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:19.718178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65d9b4bc-78ac-4584-abf8-46723eef7b68 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:20.096722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-65d9b4bc-78ac-4584-abf8-46723eef7b68 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:20.107144 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-65d9b4bc-78ac-4584-abf8-46723eef7b68 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.402497 Aug 29 15:29:20.108079 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 591/1173] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:19 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:20.113210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1b2e083b-9cd3-481e-942e-c6fb8236d932 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:20.114313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1b2e083b-9cd3-481e-942e-c6fb8236d932 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:20.123802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b2e083b-9cd3-481e-942e-c6fb8236d932 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:20.124373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b2e083b-9cd3-481e-942e-c6fb8236d932 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:20.124904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b2e083b-9cd3-481e-942e-c6fb8236d932 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:20.125706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b2e083b-9cd3-481e-942e-c6fb8236d932 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:20.126225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b2e083b-9cd3-481e-942e-c6fb8236d932 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:20.126883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b2e083b-9cd3-481e-942e-c6fb8236d932 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:20.241533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-1b2e083b-9cd3-481e-942e-c6fb8236d932 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:20.261943 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1b2e083b-9cd3-481e-942e-c6fb8236d932 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.152591 Aug 29 15:29:20.263061 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 592/1174] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:20 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:20.283504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d38e6d9-4e4d-4841-ba6e-1ed04e41924a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:20.284440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9d38e6d9-4e4d-4841-ba6e-1ed04e41924a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:20.292604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d38e6d9-4e4d-4841-ba6e-1ed04e41924a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:20.293613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d38e6d9-4e4d-4841-ba6e-1ed04e41924a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:20.294308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d38e6d9-4e4d-4841-ba6e-1ed04e41924a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:20.295231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d38e6d9-4e4d-4841-ba6e-1ed04e41924a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:20.297451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d38e6d9-4e4d-4841-ba6e-1ed04e41924a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:20.298329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d38e6d9-4e4d-4841-ba6e-1ed04e41924a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:20.408121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9d38e6d9-4e4d-4841-ba6e-1ed04e41924a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:20.423849 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d38e6d9-4e4d-4841-ba6e-1ed04e41924a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1275 microversion: 2.1 time: 0.158619 Aug 29 15:29:20.426669 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 593/1175] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:20 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1275 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:20.711908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3c2d401a-185e-4c30-80f8-69499c2190af tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:20.713621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3c2d401a-185e-4c30-80f8-69499c2190af tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:20.720955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c2d401a-185e-4c30-80f8-69499c2190af tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:20.721559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c2d401a-185e-4c30-80f8-69499c2190af tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:20.721969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c2d401a-185e-4c30-80f8-69499c2190af tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:20.722947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c2d401a-185e-4c30-80f8-69499c2190af tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:20.723567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c2d401a-185e-4c30-80f8-69499c2190af tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:20.724185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c2d401a-185e-4c30-80f8-69499c2190af tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:21.029161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3c2d401a-185e-4c30-80f8-69499c2190af tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:21.038116 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3c2d401a-185e-4c30-80f8-69499c2190af tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.330342 Aug 29 15:29:21.039591 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 594/1176] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:20 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:21.128532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-29c5f68b-ebd3-4c95-b013-d96d7b94617e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:21.130064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-29c5f68b-ebd3-4c95-b013-d96d7b94617e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:21.134821 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eeb5dbc7-d2f6-42a0-a326-d4c1bbad20bc tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "POST /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847/action" status: 202 len: 0 microversion: 2.1 time: 2.478763 Aug 29 15:29:21.139097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:21.141379 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 583/1177] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:29:18 2022] POST /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847/action => generated 0 bytes in 2486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:29:21.143262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c5f68b-ebd3-4c95-b013-d96d7b94617e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:21.144915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c5f68b-ebd3-4c95-b013-d96d7b94617e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:21.145945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c5f68b-ebd3-4c95-b013-d96d7b94617e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:21.148241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c5f68b-ebd3-4c95-b013-d96d7b94617e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:21.148911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6b948850-1cfe-4001-935b-99a76a503ec9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:21.149642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c5f68b-ebd3-4c95-b013-d96d7b94617e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:21.149792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6b948850-1cfe-4001-935b-99a76a503ec9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:21.150256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c5f68b-ebd3-4c95-b013-d96d7b94617e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:21.159219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b948850-1cfe-4001-935b-99a76a503ec9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:21.160054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b948850-1cfe-4001-935b-99a76a503ec9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:21.160663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b948850-1cfe-4001-935b-99a76a503ec9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:21.161782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b948850-1cfe-4001-935b-99a76a503ec9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:21.162611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b948850-1cfe-4001-935b-99a76a503ec9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:21.163193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b948850-1cfe-4001-935b-99a76a503ec9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:21.456326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-29c5f68b-ebd3-4c95-b013-d96d7b94617e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:21.465739 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-29c5f68b-ebd3-4c95-b013-d96d7b94617e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1502 microversion: 2.1 time: 0.341665 Aug 29 15:29:21.466330 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 595/1178] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:21 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1502 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:21.478570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-d0c6a775-f6a4-4610-b3e6-c9922b32bfe3 req-41b41a92-e457-401c-b3bf-1d332921dccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bf2f2e5-da5a-47bc-920c-d105a88b2847", "tag": "868a1bf9-0936-4b9a-a3ed-373847b74389"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:21.498354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d0c6a775-f6a4-4610-b3e6-c9922b32bfe3 req-41b41a92-e457-401c-b3bf-1d332921dccd service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:21.503994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d0c6a775-f6a4-4610-b3e6-c9922b32bfe3 req-41b41a92-e457-401c-b3bf-1d332921dccd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:21.506247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d0c6a775-f6a4-4610-b3e6-c9922b32bfe3 req-41b41a92-e457-401c-b3bf-1d332921dccd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:21.546115 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-d0c6a775-f6a4-4610-b3e6-c9922b32bfe3 req-41b41a92-e457-401c-b3bf-1d332921dccd service nova] Creating event network-changed:868a1bf9-0936-4b9a-a3ed-373847b74389 for instance 8bf2f2e5-da5a-47bc-920c-d105a88b2847 on n-h2-839401-11 Aug 29 15:29:21.552175 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-d0c6a775-f6a4-4610-b3e6-c9922b32bfe3 req-41b41a92-e457-401c-b3bf-1d332921dccd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081116 Aug 29 15:29:21.552811 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 596/1179] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:21.560012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e76ee0df-13ee-4678-bdd8-9872b958c09f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:21.567718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e76ee0df-13ee-4678-bdd8-9872b958c09f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:21.584018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e76ee0df-13ee-4678-bdd8-9872b958c09f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:21.586774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e76ee0df-13ee-4678-bdd8-9872b958c09f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:21.587487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e76ee0df-13ee-4678-bdd8-9872b958c09f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:21.590229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e76ee0df-13ee-4678-bdd8-9872b958c09f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:21.593231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e76ee0df-13ee-4678-bdd8-9872b958c09f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:21.593686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e76ee0df-13ee-4678-bdd8-9872b958c09f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:21.612228 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6b948850-1cfe-4001-935b-99a76a503ec9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.468691 Aug 29 15:29:21.612848 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 584/1180] 10.222.0.62 () {58 vars in 1293 bytes} [Mon Aug 29 15:29:21 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847/os-security-groups => generated 1158 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:21.628659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3a198236-0c33-4020-a31b-a18b7d5f5f5f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:21.631272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3a198236-0c33-4020-a31b-a18b7d5f5f5f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:21.649988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a198236-0c33-4020-a31b-a18b7d5f5f5f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:21.652228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a198236-0c33-4020-a31b-a18b7d5f5f5f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:21.652920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a198236-0c33-4020-a31b-a18b7d5f5f5f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:21.653911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a198236-0c33-4020-a31b-a18b7d5f5f5f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:21.655144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a198236-0c33-4020-a31b-a18b7d5f5f5f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:21.656154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a198236-0c33-4020-a31b-a18b7d5f5f5f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:21.761833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-e76ee0df-13ee-4678-bdd8-9872b958c09f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:21.786133 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e76ee0df-13ee-4678-bdd8-9872b958c09f tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.230054 Aug 29 15:29:21.801525 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 597/1181] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:21 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:21.809643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-80984e2c-9b81-4358-a3cc-8b6c5be1298d req-c68f3599-e359-47f5-9f43-3dddad392e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982d1df4-7b96-4fbf-8ec2-61752962955d", "tag": "d8c016af-2dfc-466a-9191-b6fedaf0ee01"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:21.819561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-80984e2c-9b81-4358-a3cc-8b6c5be1298d req-c68f3599-e359-47f5-9f43-3dddad392e82 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:21.820285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-80984e2c-9b81-4358-a3cc-8b6c5be1298d req-c68f3599-e359-47f5-9f43-3dddad392e82 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:21.820854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-80984e2c-9b81-4358-a3cc-8b6c5be1298d req-c68f3599-e359-47f5-9f43-3dddad392e82 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:21.832440 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-80984e2c-9b81-4358-a3cc-8b6c5be1298d req-c68f3599-e359-47f5-9f43-3dddad392e82 service nova] Creating event network-changed:d8c016af-2dfc-466a-9191-b6fedaf0ee01 for instance 982d1df4-7b96-4fbf-8ec2-61752962955d on n-h1-839401-11 Aug 29 15:29:21.838016 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-80984e2c-9b81-4358-a3cc-8b6c5be1298d req-c68f3599-e359-47f5-9f43-3dddad392e82 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035157 Aug 29 15:29:21.839145 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 598/1182] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:21.845508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eda6314e-2562-48ce-97dd-c97309534b59 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'create', calling method: .version_select at 0x7fc42b806280>, body: {"security_group": {"name": " tempest-securitygroup -241648754 ", "description": "tempest-description-561115068"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:22.141713 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eda6314e-2562-48ce-97dd-c97309534b59 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.300492 Aug 29 15:29:22.152856 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 599/1183] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:29:21 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:22.161470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-afe2e71e-d57b-418f-ac40-c89893c4012a tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:22.164179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-afe2e71e-d57b-418f-ac40-c89893c4012a tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:22.172601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afe2e71e-d57b-418f-ac40-c89893c4012a tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:22.174109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afe2e71e-d57b-418f-ac40-c89893c4012a tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:22.174731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afe2e71e-d57b-418f-ac40-c89893c4012a tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:22.176305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afe2e71e-d57b-418f-ac40-c89893c4012a tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:22.177187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afe2e71e-d57b-418f-ac40-c89893c4012a tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:22.178489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afe2e71e-d57b-418f-ac40-c89893c4012a tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:22.207391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3a198236-0c33-4020-a31b-a18b7d5f5f5f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:22.219028 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3a198236-0c33-4020-a31b-a18b7d5f5f5f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1317 microversion: 2.1 time: 0.597267 Aug 29 15:29:22.226169 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 585/1184] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:21 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1317 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:22.244852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e1fdd3f9-5dfb-4288-a6a2-2073057bdb37 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42ba2f040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:22.347762 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e1fdd3f9-5dfb-4288-a6a2-2073057bdb37 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/os-security-groups/e992aee0-2fea-4518-adbe-824c1a73a0c4" status: 200 len: 222 microversion: 2.1 time: 0.120491 Aug 29 15:29:22.348598 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 586/1185] 10.222.0.62 () {58 vars in 1269 bytes} [Mon Aug 29 15:29:22 2022] GET /compute/v2.1/os-security-groups/e992aee0-2fea-4518-adbe-824c1a73a0c4 => generated 222 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:22.360518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7fd1a297-7989-4c63-afd5-1fdb5994ad7d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42b989ee0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:22.516837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-afe2e71e-d57b-418f-ac40-c89893c4012a tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:22.525847 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-afe2e71e-d57b-418f-ac40-c89893c4012a tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.371358 Aug 29 15:29:22.530876 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 600/1186] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:22 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:22.544002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bfe0a959-d263-4efe-b388-4ddff7dd531a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:22.544897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bfe0a959-d263-4efe-b388-4ddff7dd531a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:22.557745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfe0a959-d263-4efe-b388-4ddff7dd531a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:22.560710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfe0a959-d263-4efe-b388-4ddff7dd531a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:22.561389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfe0a959-d263-4efe-b388-4ddff7dd531a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:22.562290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfe0a959-d263-4efe-b388-4ddff7dd531a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:22.564909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfe0a959-d263-4efe-b388-4ddff7dd531a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:22.565604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfe0a959-d263-4efe-b388-4ddff7dd531a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:22.844482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bfe0a959-d263-4efe-b388-4ddff7dd531a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:22.853572 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bfe0a959-d263-4efe-b388-4ddff7dd531a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1477 microversion: 2.1 time: 0.320860 Aug 29 15:29:22.854170 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 601/1187] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:22 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1477 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:22.879558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ef2ce6d-4a4a-4152-8c3b-11154d2e1fe2 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:22.880090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ef2ce6d-4a4a-4152-8c3b-11154d2e1fe2 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:22.897464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef2ce6d-4a4a-4152-8c3b-11154d2e1fe2 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:22.897958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef2ce6d-4a4a-4152-8c3b-11154d2e1fe2 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:22.898397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef2ce6d-4a4a-4152-8c3b-11154d2e1fe2 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:22.901511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef2ce6d-4a4a-4152-8c3b-11154d2e1fe2 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:22.901511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef2ce6d-4a4a-4152-8c3b-11154d2e1fe2 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:22.901511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef2ce6d-4a4a-4152-8c3b-11154d2e1fe2 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:22.930590 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7fd1a297-7989-4c63-afd5-1fdb5994ad7d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/e992aee0-2fea-4518-adbe-824c1a73a0c4" status: 202 len: 0 microversion: 2.1 time: 0.573692 Aug 29 15:29:22.931424 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 587/1188] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:29:22 2022] DELETE /compute/v2.1/os-security-groups/e992aee0-2fea-4518-adbe-824c1a73a0c4 => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:29:22.939818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0807bc82-6252-48df-a605-01ea66817336 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '.version_select at 0x7fc42b9b55e0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:22.943814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0807bc82-6252-48df-a605-01ea66817336 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:22.949889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0807bc82-6252-48df-a605-01ea66817336 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:22.950621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0807bc82-6252-48df-a605-01ea66817336 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:22.975368 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0807bc82-6252-48df-a605-01ea66817336 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.039141 Aug 29 15:29:22.976792 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 588/1189] 10.222.0.62 () {58 vars in 1143 bytes} [Mon Aug 29 15:29:22 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:22.986305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-433d8362-87cf-4a19-a1ae-a052631cbb9f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42bac20d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:23.058368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG neutronclient.v2_0.client [None req-433d8362-87cf-4a19-a1ae-a052631cbb9f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e992aee0-2fea-4518-adbe-824c1a73a0c4 does not exist", "detail": ""}} {{(pid=122361) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:29:23.058552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-5ef2ce6d-4a4a-4152-8c3b-11154d2e1fe2 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:23.059377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.security_group_api [None req-433d8362-87cf-4a19-a1ae-a052631cbb9f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Neutron security group e992aee0-2fea-4518-adbe-824c1a73a0c4 not found {{(pid=122361) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:29:23.060156 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-433d8362-87cf-4a19-a1ae-a052631cbb9f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] HTTP exception thrown: Security group e992aee0-2fea-4518-adbe-824c1a73a0c4 does not exist Aug 29 15:29:23.060156 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-c084c079-fdaa-4a26-98ce-b275c19f68b6'] Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-433d8362-87cf-4a19-a1ae-a052631cbb9f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Request method failure captured: Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-security-groups/e992aee0-2fea-4518-adbe-824c1a73a0c4 HTTP/1.1 Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNs2hOo7JBpZiQzvnNgHrIm1J9RGZ5UC6DpjgyVQYeerhSnofzxX7RAKfvmzU9UJlAY5oOh27yY87PJp21A-ORXMZr-RsqgruzLi4v_3gHlsQS4FiqFdaSIS_JF0QEF93l7efzdx0gUJW4VXji92y_AvcDUPtCPmksBIQOtHDvXg1bU Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:29:23.065772 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:29:23.067334 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7939dc6e747744dab4a60e547c6d9191", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}] Aug 29 15:29:23.067334 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:29:23.067334 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:29:23.067334 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:29:23.067334 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:29:23.067334 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:29:23.067334 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:29:23.067334 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 26faf4e7544842ad9dc66370ccba54fc Aug 29 15:29:23.067334 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:29:23.067334 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:29:23.067334 n-d-839401-11 devstack@n-api.service[122361]: exception: Security group e992aee0-2fea-4518-adbe-824c1a73a0c4 does not exist Aug 29 15:29:23.067334 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-c084c079-fdaa-4a26-98ce-b275c19f68b6'] Aug 29 15:29:23.067334 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'e992aee0-2fea-4518-adbe-824c1a73a0c4'} Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:23.068175 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e992aee0-2fea-4518-adbe-824c1a73a0c4 does not exist Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c084c079-fdaa-4a26-98ce-b275c19f68b6'] Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:29:23.069428 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e992aee0-2fea-4518-adbe-824c1a73a0c4 does not exist Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c084c079-fdaa-4a26-98ce-b275c19f68b6'] Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e992aee0-2fea-4518-adbe-824c1a73a0c4 does not exist Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c084c079-fdaa-4a26-98ce-b275c19f68b6'] Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:23.075312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:23.079658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:23.079658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:23.079658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:23.079658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:23.079658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e992aee0-2fea-4518-adbe-824c1a73a0c4 does not exist Aug 29 15:29:23.079658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c084c079-fdaa-4a26-98ce-b275c19f68b6'] Aug 29 15:29:23.079658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:23.084230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-433d8362-87cf-4a19-a1ae-a052631cbb9f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Returning 404 to user: Security group e992aee0-2fea-4518-adbe-824c1a73a0c4 does not exist Aug 29 15:29:23.084230 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-c084c079-fdaa-4a26-98ce-b275c19f68b6'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:23.086097 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-433d8362-87cf-4a19-a1ae-a052631cbb9f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/os-security-groups/e992aee0-2fea-4518-adbe-824c1a73a0c4" status: 404 len: 194 microversion: 2.1 time: 0.107945 Aug 29 15:29:23.089309 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 589/1190] 10.222.0.62 () {58 vars in 1269 bytes} [Mon Aug 29 15:29:22 2022] GET /compute/v2.1/os-security-groups/e992aee0-2fea-4518-adbe-824c1a73a0c4 => generated 194 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:23.093460 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ef2ce6d-4a4a-4152-8c3b-11154d2e1fe2 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.221617 Aug 29 15:29:23.095762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5b9f1123-e705-43c3-b3b4-78a01db59f14 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:23.096622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5b9f1123-e705-43c3-b3b4-78a01db59f14 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:23.108907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b9f1123-e705-43c3-b3b4-78a01db59f14 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:23.109865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b9f1123-e705-43c3-b3b4-78a01db59f14 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:23.111906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b9f1123-e705-43c3-b3b4-78a01db59f14 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:23.113568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b9f1123-e705-43c3-b3b4-78a01db59f14 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:23.113980 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 602/1191] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:22 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:23.114905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b9f1123-e705-43c3-b3b4-78a01db59f14 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:23.115562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b9f1123-e705-43c3-b3b4-78a01db59f14 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:23.122282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9db74d84-5b39-49a5-9b87-1c84529c0d6d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'create', calling method: .version_select at 0x7fc42bc0a9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1296308081", "description": "tempest-description-1964363631"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:23.403429 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5b9f1123-e705-43c3-b3b4-78a01db59f14 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1630 microversion: 2.1 time: 0.312242 Aug 29 15:29:23.405057 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 590/1192] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:23 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1630 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:23.410448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2488bad7-1fdf-43fa-8740-43ec304db48e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:23.411094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2488bad7-1fdf-43fa-8740-43ec304db48e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:23.421762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2488bad7-1fdf-43fa-8740-43ec304db48e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:23.423167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2488bad7-1fdf-43fa-8740-43ec304db48e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:23.423897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2488bad7-1fdf-43fa-8740-43ec304db48e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:23.424670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2488bad7-1fdf-43fa-8740-43ec304db48e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:23.425217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2488bad7-1fdf-43fa-8740-43ec304db48e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:23.425832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2488bad7-1fdf-43fa-8740-43ec304db48e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:23.729065 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9db74d84-5b39-49a5-9b87-1c84529c0d6d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.613569 Aug 29 15:29:23.730342 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 603/1193] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:29:23 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:23.736353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b29edc54-7a17-44d8-a65d-12808100d49a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Action: 'create', calling method: .version_select at 0x7fc42b802310>, body: {"keypair": {"name": "tempest-keypair-245590058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiyOpam/Tad9xiAfiLjziQmeGFLkagoVGVAKkGKiUwRe8ODx2yxjl971zFGxANVoai/iDZl402FLm4rU707A+tGCh9AAIcZ4KoyXN+q/UjQOaJmLzaY7nRFAubI/oPijg=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:23.764882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-b29edc54-7a17-44d8-a65d-12808100d49a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Getting quotas for project 31544ac2992c46aa8fecdff53a43ae42. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:29:23.787998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-b29edc54-7a17-44d8-a65d-12808100d49a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Getting quotas for user 498e44c8a15f451ba8ff39eff4156075 and project 31544ac2992c46aa8fecdff53a43ae42. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:29:23.848761 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b29edc54-7a17-44d8-a65d-12808100d49a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116875 Aug 29 15:29:23.855917 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 604/1194] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:29:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:23.860407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7cd26893-0da4-4bc5-b000-49ef27ca1010 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:23.861127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7cd26893-0da4-4bc5-b000-49ef27ca1010 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:23.877178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7cd26893-0da4-4bc5-b000-49ef27ca1010 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:23.877682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7cd26893-0da4-4bc5-b000-49ef27ca1010 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:23.878122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7cd26893-0da4-4bc5-b000-49ef27ca1010 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:23.881208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7cd26893-0da4-4bc5-b000-49ef27ca1010 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:23.881716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7cd26893-0da4-4bc5-b000-49ef27ca1010 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:23.882162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7cd26893-0da4-4bc5-b000-49ef27ca1010 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:24.082915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2488bad7-1fdf-43fa-8740-43ec304db48e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:24.100835 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2488bad7-1fdf-43fa-8740-43ec304db48e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1317 microversion: 2.1 time: 0.692480 Aug 29 15:29:24.102629 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 591/1195] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:23 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1317 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:24.120308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-84e2eddc-4d7a-49eb-988d-f40e97a3870b tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'create', calling method: .version_select at 0x7fc42ba6f670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1551685007", "description": "tempest-description-791791547"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:24.405743 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-84e2eddc-4d7a-49eb-988d-f40e97a3870b tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.300147 Aug 29 15:29:24.407936 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 592/1196] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:29:24 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:24.417759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a8ca5fb4-d740-45ba-b0bb-9f1b7a26e4fe tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:24.420917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a8ca5fb4-d740-45ba-b0bb-9f1b7a26e4fe tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:24.430600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8ca5fb4-d740-45ba-b0bb-9f1b7a26e4fe tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:24.431456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8ca5fb4-d740-45ba-b0bb-9f1b7a26e4fe tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:24.432183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8ca5fb4-d740-45ba-b0bb-9f1b7a26e4fe tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:24.433695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8ca5fb4-d740-45ba-b0bb-9f1b7a26e4fe tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:24.434359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8ca5fb4-d740-45ba-b0bb-9f1b7a26e4fe tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:24.435046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8ca5fb4-d740-45ba-b0bb-9f1b7a26e4fe tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:24.482339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7cd26893-0da4-4bc5-b000-49ef27ca1010 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:24.491054 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7cd26893-0da4-4bc5-b000-49ef27ca1010 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.639725 Aug 29 15:29:24.505896 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 605/1197] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:23 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:24.517607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a79799fc-0c29-4274-b3d5-31ea7afcc8f7 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'create', calling method: .version_select at 0x7fc42b80a700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-496955678", "description": "tempest-description-1229709132"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:24.545016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-a8ca5fb4-d740-45ba-b0bb-9f1b7a26e4fe tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:24.565304 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a8ca5fb4-d740-45ba-b0bb-9f1b7a26e4fe tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.155976 Aug 29 15:29:24.566602 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 593/1198] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:24 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:25.131843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a4b5530a-6728-40fe-9290-929161e17366 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:25.133223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a4b5530a-6728-40fe-9290-929161e17366 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:25.147671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4b5530a-6728-40fe-9290-929161e17366 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:25.148459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4b5530a-6728-40fe-9290-929161e17366 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:25.149364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4b5530a-6728-40fe-9290-929161e17366 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:25.152012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4b5530a-6728-40fe-9290-929161e17366 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:25.152815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4b5530a-6728-40fe-9290-929161e17366 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:25.154222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4b5530a-6728-40fe-9290-929161e17366 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:25.409169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a4b5530a-6728-40fe-9290-929161e17366 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:25.419076 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a4b5530a-6728-40fe-9290-929161e17366 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1317 microversion: 2.1 time: 0.296336 Aug 29 15:29:25.420135 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 594/1199] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:25 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:25.512320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c3ffd845-1198-42f3-8e66-51daaf8cf151 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:25.513770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c3ffd845-1198-42f3-8e66-51daaf8cf151 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:25.523977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3ffd845-1198-42f3-8e66-51daaf8cf151 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:25.524687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3ffd845-1198-42f3-8e66-51daaf8cf151 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:25.525385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3ffd845-1198-42f3-8e66-51daaf8cf151 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:25.526915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3ffd845-1198-42f3-8e66-51daaf8cf151 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:25.528001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3ffd845-1198-42f3-8e66-51daaf8cf151 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:25.528773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3ffd845-1198-42f3-8e66-51daaf8cf151 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:25.558963 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a79799fc-0c29-4274-b3d5-31ea7afcc8f7 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.051856 Aug 29 15:29:25.560224 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 606/1200] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:29:24 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:25.578729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c16855eb-4dce-4ed1-8f46-dbca5e3421b7 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42b8020d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:25.829846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c3ffd845-1198-42f3-8e66-51daaf8cf151 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:25.858241 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c3ffd845-1198-42f3-8e66-51daaf8cf151 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.350019 Aug 29 15:29:25.860883 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 595/1201] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:25 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:25.871739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fbf0866b-9e01-4f0e-846f-4b70a7bc44cc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:25.872565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fbf0866b-9e01-4f0e-846f-4b70a7bc44cc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:25.902605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbf0866b-9e01-4f0e-846f-4b70a7bc44cc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:25.903507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbf0866b-9e01-4f0e-846f-4b70a7bc44cc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:25.903974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbf0866b-9e01-4f0e-846f-4b70a7bc44cc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:25.905365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbf0866b-9e01-4f0e-846f-4b70a7bc44cc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:25.906175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbf0866b-9e01-4f0e-846f-4b70a7bc44cc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:25.906752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbf0866b-9e01-4f0e-846f-4b70a7bc44cc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:26.050421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-fbf0866b-9e01-4f0e-846f-4b70a7bc44cc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:26.068681 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fbf0866b-9e01-4f0e-846f-4b70a7bc44cc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1931 microversion: 2.75 time: 0.205144 Aug 29 15:29:26.069676 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 596/1202] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:25 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1931 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:26.079146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-cdc87e1a-a647-4d2f-b6a5-202bf2026808 req-0f8105d9-c60e-4d35-b6bf-5bed92701b60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d34cb9-694e-4941-b163-9d1b0f44c8ae", "tag": "b0874f9c-2ae8-46b9-8878-f08b7073e1c7"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:26.094940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cdc87e1a-a647-4d2f-b6a5-202bf2026808 req-0f8105d9-c60e-4d35-b6bf-5bed92701b60 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:26.095724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cdc87e1a-a647-4d2f-b6a5-202bf2026808 req-0f8105d9-c60e-4d35-b6bf-5bed92701b60 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:26.096539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cdc87e1a-a647-4d2f-b6a5-202bf2026808 req-0f8105d9-c60e-4d35-b6bf-5bed92701b60 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:26.109892 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-cdc87e1a-a647-4d2f-b6a5-202bf2026808 req-0f8105d9-c60e-4d35-b6bf-5bed92701b60 service nova] Creating event network-changed:b0874f9c-2ae8-46b9-8878-f08b7073e1c7 for instance d6d34cb9-694e-4941-b163-9d1b0f44c8ae on n-h1-839401-11 Aug 29 15:29:26.114460 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-cdc87e1a-a647-4d2f-b6a5-202bf2026808 req-0f8105d9-c60e-4d35-b6bf-5bed92701b60 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040152 Aug 29 15:29:26.115443 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 597/1203] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:26.365804 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c16855eb-4dce-4ed1-8f46-dbca5e3421b7 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.792932 Aug 29 15:29:26.367041 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 607/1204] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 15:29:25 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:26.381585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-58997153-8096-41f1-8b07-79753f401769 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42b989a60>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:26.448653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2820385b-6319-4c3e-b086-39614f6e969a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:26.450133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2820385b-6319-4c3e-b086-39614f6e969a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:26.466123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2820385b-6319-4c3e-b086-39614f6e969a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:26.468712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2820385b-6319-4c3e-b086-39614f6e969a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:26.470399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2820385b-6319-4c3e-b086-39614f6e969a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:26.473400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2820385b-6319-4c3e-b086-39614f6e969a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:26.474674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2820385b-6319-4c3e-b086-39614f6e969a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:26.476049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2820385b-6319-4c3e-b086-39614f6e969a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:26.819202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2820385b-6319-4c3e-b086-39614f6e969a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:26.835803 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2820385b-6319-4c3e-b086-39614f6e969a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1317 microversion: 2.1 time: 0.395382 Aug 29 15:29:26.841624 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 608/1205] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:26 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:26.880337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6c95fa87-022c-4b1d-a69c-6ce4de00ad9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:26.881420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6c95fa87-022c-4b1d-a69c-6ce4de00ad9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:26.889363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c95fa87-022c-4b1d-a69c-6ce4de00ad9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:26.890388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c95fa87-022c-4b1d-a69c-6ce4de00ad9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:26.891355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c95fa87-022c-4b1d-a69c-6ce4de00ad9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:26.892977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c95fa87-022c-4b1d-a69c-6ce4de00ad9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:26.893939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c95fa87-022c-4b1d-a69c-6ce4de00ad9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:26.894837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c95fa87-022c-4b1d-a69c-6ce4de00ad9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:26.941203 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-58997153-8096-41f1-8b07-79753f401769 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/64d7e9e7-d93d-4788-87cd-2b5ec5a23c87" status: 202 len: 0 microversion: 2.1 time: 0.564314 Aug 29 15:29:26.943670 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 598/1206] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:29:26 2022] DELETE /compute/v2.1/os-security-groups/64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:29:26.959859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-31ef7c7e-67e2-4678-832a-d54b8a180547 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc4301fa700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:26.996786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG neutronclient.v2_0.client [None req-31ef7c7e-67e2-4678-832a-d54b8a180547 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 does not exist", "detail": ""}} {{(pid=122361) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:29:26.997722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.security_group_api [None req-31ef7c7e-67e2-4678-832a-d54b8a180547 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Neutron security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 not found {{(pid=122361) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:29:26.998410 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-31ef7c7e-67e2-4678-832a-d54b8a180547 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] HTTP exception thrown: Security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 does not exist Aug 29 15:29:26.998410 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-7ed39dd3-48c0-4ae7-aac8-5ed80e051071'] Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-31ef7c7e-67e2-4678-832a-d54b8a180547 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Request method failure captured: Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-security-groups/64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 HTTP/1.1 Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNs2hOo7JBpZiQzvnNgHrIm1J9RGZ5UC6DpjgyVQYeerhSnofzxX7RAKfvmzU9UJlAY5oOh27yY87PJp21A-ORXMZr-RsqgruzLi4v_3gHlsQS4FiqFdaSIS_JF0QEF93l7efzdx0gUJW4VXji92y_AvcDUPtCPmksBIQOtHDvXg1bU Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:29:27.000883 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:29:27.002543 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7939dc6e747744dab4a60e547c6d9191", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}] Aug 29 15:29:27.002543 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:29:27.002543 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:29:27.002543 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:29:27.002543 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:29:27.002543 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:29:27.002543 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:29:27.002543 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 26faf4e7544842ad9dc66370ccba54fc Aug 29 15:29:27.002543 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:29:27.002543 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:29:27.002543 n-d-839401-11 devstack@n-api.service[122361]: exception: Security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 does not exist Aug 29 15:29:27.002543 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-7ed39dd3-48c0-4ae7-aac8-5ed80e051071'] Aug 29 15:29:27.002543 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '64d7e9e7-d93d-4788-87cd-2b5ec5a23c87'} Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.003357 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 does not exist Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ed39dd3-48c0-4ae7-aac8-5ed80e051071'] Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:29:27.004527 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 does not exist Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ed39dd3-48c0-4ae7-aac8-5ed80e051071'] Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 does not exist Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ed39dd3-48c0-4ae7-aac8-5ed80e051071'] Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.005833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.008097 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:27.008097 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:27.008097 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:27.008097 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:27.008097 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 does not exist Aug 29 15:29:27.008097 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ed39dd3-48c0-4ae7-aac8-5ed80e051071'] Aug 29 15:29:27.008097 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.010199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-31ef7c7e-67e2-4678-832a-d54b8a180547 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Returning 404 to user: Security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 does not exist Aug 29 15:29:27.010199 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-7ed39dd3-48c0-4ae7-aac8-5ed80e051071'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:27.011353 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-31ef7c7e-67e2-4678-832a-d54b8a180547 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/os-security-groups/64d7e9e7-d93d-4788-87cd-2b5ec5a23c87" status: 404 len: 194 microversion: 2.1 time: 0.062725 Aug 29 15:29:27.012470 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 599/1207] 10.222.0.62 () {58 vars in 1269 bytes} [Mon Aug 29 15:29:26 2022] GET /compute/v2.1/os-security-groups/64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 => generated 194 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:27.020863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-794e5606-4602-46d5-976d-b15d0ab0959f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42bc6f310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:27.106505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6c95fa87-022c-4b1d-a69c-6ce4de00ad9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:27.114993 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6c95fa87-022c-4b1d-a69c-6ce4de00ad9c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.238946 Aug 29 15:29:27.123048 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 609/1208] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:26 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:27.240112 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-794e5606-4602-46d5-976d-b15d0ab0959f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/c9264a17-512e-4f3f-9c17-75602b68233a" status: 202 len: 0 microversion: 2.1 time: 0.223677 Aug 29 15:29:27.241467 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 600/1209] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:29:27 2022] DELETE /compute/v2.1/os-security-groups/c9264a17-512e-4f3f-9c17-75602b68233a => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:29:27.249576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9ef98bd2-3a8b-4495-845a-2bdbb1d67679 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:27.250633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9ef98bd2-3a8b-4495-845a-2bdbb1d67679 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:27.255056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1470d282-41b8-4c6b-930c-bfcf385ab13f tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Calling method '.version_select at 0x7fc4305a00d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:27.265223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ef98bd2-3a8b-4495-845a-2bdbb1d67679 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:27.265829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ef98bd2-3a8b-4495-845a-2bdbb1d67679 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:27.266343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ef98bd2-3a8b-4495-845a-2bdbb1d67679 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:27.267170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ef98bd2-3a8b-4495-845a-2bdbb1d67679 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:27.267840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ef98bd2-3a8b-4495-845a-2bdbb1d67679 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:27.268500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ef98bd2-3a8b-4495-845a-2bdbb1d67679 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:27.285945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG neutronclient.v2_0.client [None req-1470d282-41b8-4c6b-930c-bfcf385ab13f tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e218a16a-6d4a-4632-8018-d0d8f8b3670a does not exist", "detail": ""}} {{(pid=122360) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:29:27.286565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.security_group_api [None req-1470d282-41b8-4c6b-930c-bfcf385ab13f tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Neutron security group e218a16a-6d4a-4632-8018-d0d8f8b3670a not found {{(pid=122360) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:29:27.287096 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-1470d282-41b8-4c6b-930c-bfcf385ab13f tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] HTTP exception thrown: Security group e218a16a-6d4a-4632-8018-d0d8f8b3670a does not exist Aug 29 15:29:27.287096 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-2f86e90a-a659-4e66-ae22-f626bdf59e23'] Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1470d282-41b8-4c6b-930c-bfcf385ab13f tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Request method failure captured: Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/os-security-groups/e218a16a-6d4a-4632-8018-d0d8f8b3670a HTTP/1.1 Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNtWdd0_Tl4Hkl2ZnAKMOyXYnsTGnYfe8HoDY_zw9k6UacyAP22Xsj2Jre4vIdtalDim2i5JP3d7i09Ivzo4Og5pyGTXyaJLqKuzVMzbXase0SiL2dnbdub1VvMYJXVpuCWLAyq27nHJMl0Yw0zKbeJiQ-YpHeyxUjLbn2J5FdtsdCE Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 9f3901f849e74126b71bf403e0676643 Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2122039598 Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:29:27.289711 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:29:27.291127 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9f3901f849e74126b71bf403e0676643", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9f3901f849e74126b71bf403e0676643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9f3901f849e74126b71bf403e0676643"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9f3901f849e74126b71bf403e0676643"}]}] Aug 29 15:29:27.291127 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2122039598 Aug 29 15:29:27.291127 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 9f3901f849e74126b71bf403e0676643 Aug 29 15:29:27.291127 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2122039598 Aug 29 15:29:27.291127 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-SecurityGroupsNegativeTestJSON-2122039598-project Aug 29 15:29:27.291127 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:29:27.291127 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:29:27.291127 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 3625df4f40ee45a99cfec46ee1e52c17 Aug 29 15:29:27.291127 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2122039598-project Aug 29 15:29:27.291127 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:29:27.291127 n-d-839401-11 devstack@n-api.service[122360]: exception: Security group e218a16a-6d4a-4632-8018-d0d8f8b3670a does not exist Aug 29 15:29:27.291127 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-2f86e90a-a659-4e66-ae22-f626bdf59e23'] Aug 29 15:29:27.291127 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'e218a16a-6d4a-4632-8018-d0d8f8b3670a'} Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.291987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e218a16a-6d4a-4632-8018-d0d8f8b3670a does not exist Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f86e90a-a659-4e66-ae22-f626bdf59e23'] Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:29:27.293831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e218a16a-6d4a-4632-8018-d0d8f8b3670a does not exist Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f86e90a-a659-4e66-ae22-f626bdf59e23'] Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e218a16a-6d4a-4632-8018-d0d8f8b3670a does not exist Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f86e90a-a659-4e66-ae22-f626bdf59e23'] Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.295227 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.297669 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:27.297669 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:27.297669 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:27.297669 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:27.297669 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e218a16a-6d4a-4632-8018-d0d8f8b3670a does not exist Aug 29 15:29:27.297669 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f86e90a-a659-4e66-ae22-f626bdf59e23'] Aug 29 15:29:27.297669 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.297669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1470d282-41b8-4c6b-930c-bfcf385ab13f tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Returning 404 to user: Security group e218a16a-6d4a-4632-8018-d0d8f8b3670a does not exist Aug 29 15:29:27.297669 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-2f86e90a-a659-4e66-ae22-f626bdf59e23'] {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:27.297669 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1470d282-41b8-4c6b-930c-bfcf385ab13f tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/e218a16a-6d4a-4632-8018-d0d8f8b3670a" status: 404 len: 194 microversion: 2.1 time: 0.166825 Aug 29 15:29:27.298962 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 610/1210] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:29:27 2022] DELETE /compute/v2.1/os-security-groups/e218a16a-6d4a-4632-8018-d0d8f8b3670a => generated 194 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:27.302959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1863736710", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "7ead68ac-9b85-4a15-900a-c59cae425b9c"}], "security_groups": [{"name": "tempest-securitygroup--242360982"}], "key_name": "tempest-keypair-245590058", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:27.349685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-9ef98bd2-3a8b-4495-845a-2bdbb1d67679 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:27.367098 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9ef98bd2-3a8b-4495-845a-2bdbb1d67679 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1937 microversion: 2.75 time: 0.124137 Aug 29 15:29:27.367884 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 601/1211] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:27 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1937 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:27.372383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-30078dde-adb0-4303-bbfd-6ce170d3b624 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42bbda700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:27.402883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG neutronclient.v2_0.client [None req-30078dde-adb0-4303-bbfd-6ce170d3b624 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c9264a17-512e-4f3f-9c17-75602b68233a does not exist", "detail": ""}} {{(pid=122361) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:29:27.403734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.security_group_api [None req-30078dde-adb0-4303-bbfd-6ce170d3b624 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Neutron security group c9264a17-512e-4f3f-9c17-75602b68233a not found {{(pid=122361) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:29:27.404783 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-30078dde-adb0-4303-bbfd-6ce170d3b624 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] HTTP exception thrown: Security group c9264a17-512e-4f3f-9c17-75602b68233a does not exist Aug 29 15:29:27.404783 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-738c2a78-5a35-4f7a-8dc9-357f4a647cde'] Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-30078dde-adb0-4303-bbfd-6ce170d3b624 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Request method failure captured: Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-security-groups/c9264a17-512e-4f3f-9c17-75602b68233a HTTP/1.1 Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNs2hOo7JBpZiQzvnNgHrIm1J9RGZ5UC6DpjgyVQYeerhSnofzxX7RAKfvmzU9UJlAY5oOh27yY87PJp21A-ORXMZr-RsqgruzLi4v_3gHlsQS4FiqFdaSIS_JF0QEF93l7efzdx0gUJW4VXji92y_AvcDUPtCPmksBIQOtHDvXg1bU Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:29:27.407428 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:29:27.408842 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7939dc6e747744dab4a60e547c6d9191", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}] Aug 29 15:29:27.408842 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:29:27.408842 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:29:27.408842 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:29:27.408842 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:29:27.408842 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:29:27.408842 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:29:27.408842 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 26faf4e7544842ad9dc66370ccba54fc Aug 29 15:29:27.408842 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:29:27.408842 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:29:27.408842 n-d-839401-11 devstack@n-api.service[122361]: exception: Security group c9264a17-512e-4f3f-9c17-75602b68233a does not exist Aug 29 15:29:27.408842 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-738c2a78-5a35-4f7a-8dc9-357f4a647cde'] Aug 29 15:29:27.408842 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'c9264a17-512e-4f3f-9c17-75602b68233a'} Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.409749 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c9264a17-512e-4f3f-9c17-75602b68233a does not exist Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-738c2a78-5a35-4f7a-8dc9-357f4a647cde'] Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:29:27.410869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c9264a17-512e-4f3f-9c17-75602b68233a does not exist Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-738c2a78-5a35-4f7a-8dc9-357f4a647cde'] Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c9264a17-512e-4f3f-9c17-75602b68233a does not exist Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-738c2a78-5a35-4f7a-8dc9-357f4a647cde'] Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.413504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.416160 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:27.416160 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:27.416160 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:27.416160 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:27.416160 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c9264a17-512e-4f3f-9c17-75602b68233a does not exist Aug 29 15:29:27.416160 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-738c2a78-5a35-4f7a-8dc9-357f4a647cde'] Aug 29 15:29:27.416160 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.416160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-30078dde-adb0-4303-bbfd-6ce170d3b624 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Returning 404 to user: Security group c9264a17-512e-4f3f-9c17-75602b68233a does not exist Aug 29 15:29:27.416160 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-738c2a78-5a35-4f7a-8dc9-357f4a647cde'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:27.416160 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-30078dde-adb0-4303-bbfd-6ce170d3b624 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/os-security-groups/c9264a17-512e-4f3f-9c17-75602b68233a" status: 404 len: 194 microversion: 2.1 time: 0.042039 Aug 29 15:29:27.416160 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 602/1212] 10.222.0.62 () {58 vars in 1269 bytes} [Mon Aug 29 15:29:27 2022] GET /compute/v2.1/os-security-groups/c9264a17-512e-4f3f-9c17-75602b68233a => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:27.418977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] validate_networks() for [('7ead68ac-9b85-4a15-900a-c59cae425b9c', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:29:27.422198 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-827dbd90-068e-43f7-ba4d-e1e08da8c65b tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004544 Aug 29 15:29:27.422613 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 603/1213] 10.222.0.62 () {58 vars in 1164 bytes} [Mon Aug 29 15:29:27 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 15:29:27.427309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7fe840f4-12cd-4e13-85d4-7c15b22d7a0c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42b94d940>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:27.620755 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7fe840f4-12cd-4e13-85d4-7c15b22d7a0c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/ace6b282-b3d4-4d21-a0fc-6630dfe36276" status: 202 len: 0 microversion: 2.1 time: 0.196813 Aug 29 15:29:27.622497 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 604/1214] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:29:27 2022] DELETE /compute/v2.1/os-security-groups/ace6b282-b3d4-4d21-a0fc-6630dfe36276 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:29:27.629198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-72e0f448-0a2a-4619-9942-f61b38692275 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Calling method '.version_select at 0x7fc42b989af0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:27.803551 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-72e0f448-0a2a-4619-9942-f61b38692275 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] 10.222.0.62 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.179766 Aug 29 15:29:27.804357 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 605/1215] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 15:29:27 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:27.809536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c96957b2-268a-4bb8-ba19-3ef5a9062e40 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42b9a1310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:27.836028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG neutronclient.v2_0.client [None req-c96957b2-268a-4bb8-ba19-3ef5a9062e40 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 does not exist", "detail": ""}} {{(pid=122361) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:29:27.836768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.security_group_api [None req-c96957b2-268a-4bb8-ba19-3ef5a9062e40 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Neutron security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 not found {{(pid=122361) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:29:27.837523 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-c96957b2-268a-4bb8-ba19-3ef5a9062e40 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] HTTP exception thrown: Security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 does not exist Aug 29 15:29:27.837523 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-d3cc3f9d-8445-4120-bf83-cf65186796fd'] Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c96957b2-268a-4bb8-ba19-3ef5a9062e40 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Request method failure captured: Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-security-groups/ace6b282-b3d4-4d21-a0fc-6630dfe36276 HTTP/1.1 Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNs2hOo7JBpZiQzvnNgHrIm1J9RGZ5UC6DpjgyVQYeerhSnofzxX7RAKfvmzU9UJlAY5oOh27yY87PJp21A-ORXMZr-RsqgruzLi4v_3gHlsQS4FiqFdaSIS_JF0QEF93l7efzdx0gUJW4VXji92y_AvcDUPtCPmksBIQOtHDvXg1bU Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:29:27.840064 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:29:27.841637 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7939dc6e747744dab4a60e547c6d9191", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}] Aug 29 15:29:27.841637 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:29:27.841637 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:29:27.841637 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:29:27.841637 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:29:27.841637 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:29:27.841637 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:29:27.841637 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 26faf4e7544842ad9dc66370ccba54fc Aug 29 15:29:27.841637 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:29:27.841637 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:29:27.841637 n-d-839401-11 devstack@n-api.service[122361]: exception: Security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 does not exist Aug 29 15:29:27.841637 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-d3cc3f9d-8445-4120-bf83-cf65186796fd'] Aug 29 15:29:27.841637 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'ace6b282-b3d4-4d21-a0fc-6630dfe36276'} Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.842628 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 does not exist Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3cc3f9d-8445-4120-bf83-cf65186796fd'] Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:29:27.843779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 does not exist Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3cc3f9d-8445-4120-bf83-cf65186796fd'] Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 does not exist Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3cc3f9d-8445-4120-bf83-cf65186796fd'] Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.844863 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.846294 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:27.846294 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:27.846294 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:27.846294 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:27.846294 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 does not exist Aug 29 15:29:27.846294 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3cc3f9d-8445-4120-bf83-cf65186796fd'] Aug 29 15:29:27.846294 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.847914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c96957b2-268a-4bb8-ba19-3ef5a9062e40 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Returning 404 to user: Security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 does not exist Aug 29 15:29:27.847914 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-d3cc3f9d-8445-4120-bf83-cf65186796fd'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:27.849038 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c96957b2-268a-4bb8-ba19-3ef5a9062e40 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/os-security-groups/ace6b282-b3d4-4d21-a0fc-6630dfe36276" status: 404 len: 194 microversion: 2.1 time: 0.043986 Aug 29 15:29:27.853221 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 606/1216] 10.222.0.62 () {58 vars in 1269 bytes} [Mon Aug 29 15:29:27 2022] GET /compute/v2.1/os-security-groups/ace6b282-b3d4-4d21-a0fc-6630dfe36276 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:27.856679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:29:27.857240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:29:27.857597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:29:27.858007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:29:27.858424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:29:27.859718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9af92fe3-58c9-4915-b04b-599f1ddc6039 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Calling method '.version_select at 0x7fc42ba6f430>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:27.869347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:27.869854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:27.870299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:27.871055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:27.871574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:27.871940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:27.891587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Getting quotas for project 31544ac2992c46aa8fecdff53a43ae42. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:29:27.897426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Getting quotas for user 498e44c8a15f451ba8ff39eff4156075 and project 31544ac2992c46aa8fecdff53a43ae42. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:29:27.911465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:29:27.914015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:29:27.964883 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-25475fdf-34ef-4876-910a-919c4e38a112 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.665744 Aug 29 15:29:27.971799 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 611/1217] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:29:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:29:27.976700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-77f920a0-ce6a-4996-9b02-0a1d89c6c0c7 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc4305a0af0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:27.989854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG neutronclient.v2_0.client [None req-9af92fe3-58c9-4915-b04b-599f1ddc6039 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122361) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:29:27.992777 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-9af92fe3-58c9-4915-b04b-599f1ddc6039 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 29 15:29:27.992777 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-045e80aa-c055-4b0a-bff5-263721c45c57'] Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9af92fe3-58c9-4915-b04b-599f1ddc6039 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Request method failure captured: Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/os-security-groups/89e8a89e-8b66-459a-8cfe-cab73cbba535 HTTP/1.1 Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNtWdd0_Tl4Hkl2ZnAKMOyXYnsTGnYfe8HoDY_zw9k6UacyAP22Xsj2Jre4vIdtalDim2i5JP3d7i09Ivzo4Og5pyGTXyaJLqKuzVMzbXase0SiL2dnbdub1VvMYJXVpuCWLAyq27nHJMl0Yw0zKbeJiQ-YpHeyxUjLbn2J5FdtsdCE Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 9f3901f849e74126b71bf403e0676643 Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2122039598 Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:29:27.994760 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:29:27.996074 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9f3901f849e74126b71bf403e0676643", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9f3901f849e74126b71bf403e0676643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9f3901f849e74126b71bf403e0676643"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9f3901f849e74126b71bf403e0676643"}]}] Aug 29 15:29:27.996074 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2122039598 Aug 29 15:29:27.996074 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 9f3901f849e74126b71bf403e0676643 Aug 29 15:29:27.996074 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2122039598 Aug 29 15:29:27.996074 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-SecurityGroupsNegativeTestJSON-2122039598-project Aug 29 15:29:27.996074 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:29:27.996074 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:29:27.996074 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 3625df4f40ee45a99cfec46ee1e52c17 Aug 29 15:29:27.996074 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2122039598-project Aug 29 15:29:27.996074 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:29:27.996074 n-d-839401-11 devstack@n-api.service[122361]: exception: Insufficient rights for removing default security group. Aug 29 15:29:27.996074 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-045e80aa-c055-4b0a-bff5-263721c45c57'] Aug 29 15:29:27.996074 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '89e8a89e-8b66-459a-8cfe-cab73cbba535'} Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.997598 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-045e80aa-c055-4b0a-bff5-263721c45c57'] Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 29 15:29:27.998820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-045e80aa-c055-4b0a-bff5-263721c45c57'] Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-045e80aa-c055-4b0a-bff5-263721c45c57'] Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:28.000062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:28.001427 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:28.001427 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:28.001427 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:28.001427 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 29 15:29:28.001427 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-045e80aa-c055-4b0a-bff5-263721c45c57'] Aug 29 15:29:28.001427 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.001427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9af92fe3-58c9-4915-b04b-599f1ddc6039 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 29 15:29:28.001427 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-045e80aa-c055-4b0a-bff5-263721c45c57'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:28.001427 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9af92fe3-58c9-4915-b04b-599f1ddc6039 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/89e8a89e-8b66-459a-8cfe-cab73cbba535" status: 400 len: 182 microversion: 2.1 time: 0.142090 Aug 29 15:29:28.001427 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 607/1218] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:29:27 2022] DELETE /compute/v2.1/os-security-groups/89e8a89e-8b66-459a-8cfe-cab73cbba535 => generated 182 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:29:28.004311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-52275c21-786c-4a3e-b523-c101866d6701 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:28.004311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-52275c21-786c-4a3e-b523-c101866d6701 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:28.012318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52275c21-786c-4a3e-b523-c101866d6701 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:28.012969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52275c21-786c-4a3e-b523-c101866d6701 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:28.013788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52275c21-786c-4a3e-b523-c101866d6701 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:28.014673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52275c21-786c-4a3e-b523-c101866d6701 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:28.015294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52275c21-786c-4a3e-b523-c101866d6701 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:28.016041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52275c21-786c-4a3e-b523-c101866d6701 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:28.198996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-52275c21-786c-4a3e-b523-c101866d6701 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:28.209644 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-52275c21-786c-4a3e-b523-c101866d6701 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1317 microversion: 2.1 time: 0.211210 Aug 29 15:29:28.223657 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 608/1219] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:27 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:28.223657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-c6dc4903-4ce0-40ef-97bf-5aaebfcebf28 req-1c2f61dc-2be4-47ab-a966-51c5a1d4ae49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32bc300a-b702-4755-b0c2-f0004d7d5016", "name": "network-vif-plugged", "status": "completed", "tag": "717cefd6-7122-4105-860c-3001547d3901"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:28.231722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c6dc4903-4ce0-40ef-97bf-5aaebfcebf28 req-1c2f61dc-2be4-47ab-a966-51c5a1d4ae49 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:28.232312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c6dc4903-4ce0-40ef-97bf-5aaebfcebf28 req-1c2f61dc-2be4-47ab-a966-51c5a1d4ae49 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:28.232837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c6dc4903-4ce0-40ef-97bf-5aaebfcebf28 req-1c2f61dc-2be4-47ab-a966-51c5a1d4ae49 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:28.237449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:28.251709 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-c6dc4903-4ce0-40ef-97bf-5aaebfcebf28 req-1c2f61dc-2be4-47ab-a966-51c5a1d4ae49 service nova] Creating event network-vif-plugged:717cefd6-7122-4105-860c-3001547d3901 for instance 32bc300a-b702-4755-b0c2-f0004d7d5016 on n-h1-839401-11 Aug 29 15:29:28.262820 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-c6dc4903-4ce0-40ef-97bf-5aaebfcebf28 req-1c2f61dc-2be4-47ab-a966-51c5a1d4ae49 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051021 Aug 29 15:29:28.264038 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 609/1220] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:28.270495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d2a5ec52-38ee-4103-8a56-cc0899d515a9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:28.271192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d2a5ec52-38ee-4103-8a56-cc0899d515a9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:28.286572 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-77f920a0-ce6a-4996-9b02-0a1d89c6c0c7 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.313543 Aug 29 15:29:28.287714 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 612/1221] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 15:29:27 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:28.297958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4974760e-30e4-44c6-9b1d-994aefd0cea5 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Calling method '.version_select at 0x7fc42b8764c0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:28.348667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d2a5ec52-38ee-4103-8a56-cc0899d515a9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:28.352664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG neutronclient.v2_0.client [None req-4974760e-30e4-44c6-9b1d-994aefd0cea5 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 74062a9f-9d76-4361-9a59-a560d08b4b2a does not exist", "detail": ""}} {{(pid=122360) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:29:28.353510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.security_group_api [None req-4974760e-30e4-44c6-9b1d-994aefd0cea5 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Neutron security group 74062a9f-9d76-4361-9a59-a560d08b4b2a not found {{(pid=122360) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:29:28.355028 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-4974760e-30e4-44c6-9b1d-994aefd0cea5 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] HTTP exception thrown: Security group 74062a9f-9d76-4361-9a59-a560d08b4b2a does not exist Aug 29 15:29:28.355028 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-52004b40-c116-4c87-8c99-8bfd99bfe784'] Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4974760e-30e4-44c6-9b1d-994aefd0cea5 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Request method failure captured: Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/os-security-groups/74062a9f-9d76-4361-9a59-a560d08b4b2a HTTP/1.1 Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNtWdd0_Tl4Hkl2ZnAKMOyXYnsTGnYfe8HoDY_zw9k6UacyAP22Xsj2Jre4vIdtalDim2i5JP3d7i09Ivzo4Og5pyGTXyaJLqKuzVMzbXase0SiL2dnbdub1VvMYJXVpuCWLAyq27nHJMl0Yw0zKbeJiQ-YpHeyxUjLbn2J5FdtsdCE Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 9f3901f849e74126b71bf403e0676643 Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2122039598 Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:29:28.357505 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:29:28.359179 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9f3901f849e74126b71bf403e0676643", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9f3901f849e74126b71bf403e0676643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9f3901f849e74126b71bf403e0676643"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9f3901f849e74126b71bf403e0676643"}]}] Aug 29 15:29:28.359179 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2122039598 Aug 29 15:29:28.359179 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 9f3901f849e74126b71bf403e0676643 Aug 29 15:29:28.359179 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2122039598 Aug 29 15:29:28.359179 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-SecurityGroupsNegativeTestJSON-2122039598-project Aug 29 15:29:28.359179 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:29:28.359179 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:29:28.359179 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 3625df4f40ee45a99cfec46ee1e52c17 Aug 29 15:29:28.359179 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2122039598-project Aug 29 15:29:28.359179 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:29:28.359179 n-d-839401-11 devstack@n-api.service[122360]: exception: Security group 74062a9f-9d76-4361-9a59-a560d08b4b2a does not exist Aug 29 15:29:28.359179 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-52004b40-c116-4c87-8c99-8bfd99bfe784'] Aug 29 15:29:28.359179 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '74062a9f-9d76-4361-9a59-a560d08b4b2a'} Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:28.360084 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 74062a9f-9d76-4361-9a59-a560d08b4b2a does not exist Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52004b40-c116-4c87-8c99-8bfd99bfe784'] Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:29:28.361413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 74062a9f-9d76-4361-9a59-a560d08b4b2a does not exist Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52004b40-c116-4c87-8c99-8bfd99bfe784'] Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 74062a9f-9d76-4361-9a59-a560d08b4b2a does not exist Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52004b40-c116-4c87-8c99-8bfd99bfe784'] Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.362517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:28.365309 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:28.365309 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:28.365309 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:28.365309 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:28.365309 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 74062a9f-9d76-4361-9a59-a560d08b4b2a does not exist Aug 29 15:29:28.365309 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52004b40-c116-4c87-8c99-8bfd99bfe784'] Aug 29 15:29:28.365309 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.365792 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d2a5ec52-38ee-4103-8a56-cc0899d515a9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1234 microversion: 2.1 time: 0.091594 Aug 29 15:29:28.365792 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 610/1222] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:28 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1234 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:28.366899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4974760e-30e4-44c6-9b1d-994aefd0cea5 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Returning 404 to user: Security group 74062a9f-9d76-4361-9a59-a560d08b4b2a does not exist Aug 29 15:29:28.366899 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-52004b40-c116-4c87-8c99-8bfd99bfe784'] {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:28.367070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a2212219-b9bc-491e-a96c-49787ed7b092 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:28.367520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a2212219-b9bc-491e-a96c-49787ed7b092 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:28.368308 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4974760e-30e4-44c6-9b1d-994aefd0cea5 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] 10.222.0.62 "GET /compute/v2.1/os-security-groups/74062a9f-9d76-4361-9a59-a560d08b4b2a" status: 404 len: 194 microversion: 2.1 time: 0.079442 Aug 29 15:29:28.369012 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 613/1223] 10.222.0.62 () {58 vars in 1269 bytes} [Mon Aug 29 15:29:28 2022] GET /compute/v2.1/os-security-groups/74062a9f-9d76-4361-9a59-a560d08b4b2a => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:28.377932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2212219-b9bc-491e-a96c-49787ed7b092 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:28.378432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2212219-b9bc-491e-a96c-49787ed7b092 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:28.378941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2212219-b9bc-491e-a96c-49787ed7b092 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:28.379369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1ab28cb1-f450-441e-aa40-7bdfe4b74076 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'create', calling method: .version_select at 0x7fc42b8623a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-369648798", "description": "tempest-description-727423733"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:28.379666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2212219-b9bc-491e-a96c-49787ed7b092 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:28.382145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2212219-b9bc-491e-a96c-49787ed7b092 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:28.382592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2212219-b9bc-491e-a96c-49787ed7b092 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:28.554283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a2212219-b9bc-491e-a96c-49787ed7b092 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:28.566074 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a2212219-b9bc-491e-a96c-49787ed7b092 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.202360 Aug 29 15:29:28.568151 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 611/1224] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:28 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:28.573933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e7a3f294-bb50-4a3e-805e-0bc14f051227 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Action: 'update', calling method: .version_select at 0x7fc42b9a1550>, body: {"security_group": {"name": "tempest-sg-257793212", "description": "tempest-description-731922449"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:28.598356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG neutronclient.v2_0.client [None req-e7a3f294-bb50-4a3e-805e-0bc14f051227 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c057e460-c71c-4acc-93a8-3f66f3af9d3f does not exist", "detail": ""}} {{(pid=122361) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:29:28.599503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.security_group_api [None req-e7a3f294-bb50-4a3e-805e-0bc14f051227 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Neutron security group c057e460-c71c-4acc-93a8-3f66f3af9d3f not found {{(pid=122361) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:29:28.600303 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-e7a3f294-bb50-4a3e-805e-0bc14f051227 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] HTTP exception thrown: Security group c057e460-c71c-4acc-93a8-3f66f3af9d3f does not exist Aug 29 15:29:28.600303 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-914e047e-309e-4061-9e25-41ecec51c89c'] Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e7a3f294-bb50-4a3e-805e-0bc14f051227 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Request method failure captured: Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: request: PUT /compute/v2.1/os-security-groups/c057e460-c71c-4acc-93a8-3f66f3af9d3f HTTP/1.1 Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 100 Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNtWdd0_Tl4Hkl2ZnAKMOyXYnsTGnYfe8HoDY_zw9k6UacyAP22Xsj2Jre4vIdtalDim2i5JP3d7i09Ivzo4Og5pyGTXyaJLqKuzVMzbXase0SiL2dnbdub1VvMYJXVpuCWLAyq27nHJMl0Yw0zKbeJiQ-YpHeyxUjLbn2J5FdtsdCE Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 9f3901f849e74126b71bf403e0676643 Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2122039598 Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:29:28.604110 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:29:28.605547 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9f3901f849e74126b71bf403e0676643", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9f3901f849e74126b71bf403e0676643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9f3901f849e74126b71bf403e0676643"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9f3901f849e74126b71bf403e0676643"}]}] Aug 29 15:29:28.605547 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2122039598 Aug 29 15:29:28.605547 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 9f3901f849e74126b71bf403e0676643 Aug 29 15:29:28.605547 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2122039598 Aug 29 15:29:28.605547 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-SecurityGroupsNegativeTestJSON-2122039598-project Aug 29 15:29:28.605547 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:29:28.605547 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:29:28.605547 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 3625df4f40ee45a99cfec46ee1e52c17 Aug 29 15:29:28.605547 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2122039598-project Aug 29 15:29:28.605547 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:29:28.605547 n-d-839401-11 devstack@n-api.service[122361]: {"security_group": {"name": "tempest-sg-257793212", "description": "tempest-description-731922449"}} Aug 29 15:29:28.605547 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:29:28.605547 n-d-839401-11 devstack@n-api.service[122361]: exception: Security group c057e460-c71c-4acc-93a8-3f66f3af9d3f does not exist Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-914e047e-309e-4061-9e25-41ecec51c89c'] Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'c057e460-c71c-4acc-93a8-3f66f3af9d3f', 'body': {'security_group': {'name': 'tempest-sg-257793212', 'description': 'tempest-description-731922449'}}} Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:29:28.606385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c057e460-c71c-4acc-93a8-3f66f3af9d3f does not exist Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-914e047e-309e-4061-9e25-41ecec51c89c'] Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:29:28.607483 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c057e460-c71c-4acc-93a8-3f66f3af9d3f does not exist Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-914e047e-309e-4061-9e25-41ecec51c89c'] Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c057e460-c71c-4acc-93a8-3f66f3af9d3f does not exist Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-914e047e-309e-4061-9e25-41ecec51c89c'] Aug 29 15:29:28.611246 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.613773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:28.613773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.613773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:28.613773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:28.613773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:28.613773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:28.613773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:28.613773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c057e460-c71c-4acc-93a8-3f66f3af9d3f does not exist Aug 29 15:29:28.613773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-914e047e-309e-4061-9e25-41ecec51c89c'] Aug 29 15:29:28.613773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:28.617055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e7a3f294-bb50-4a3e-805e-0bc14f051227 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] Returning 404 to user: Security group c057e460-c71c-4acc-93a8-3f66f3af9d3f does not exist Aug 29 15:29:28.617055 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-914e047e-309e-4061-9e25-41ecec51c89c'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:28.618334 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e7a3f294-bb50-4a3e-805e-0bc14f051227 tempest-SecurityGroupsNegativeTestJSON-2122039598 tempest-SecurityGroupsNegativeTestJSON-2122039598-project] 10.222.0.62 "PUT /compute/v2.1/os-security-groups/c057e460-c71c-4acc-93a8-3f66f3af9d3f" status: 404 len: 194 microversion: 2.1 time: 0.048926 Aug 29 15:29:28.632173 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1ab28cb1-f450-441e-aa40-7bdfe4b74076 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.252573 Aug 29 15:29:28.632173 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 614/1225] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:29:28 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:28.632173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eb4f52e1-9a0f-4647-88d8-2aa148f0d1b4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:28.632173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eb4f52e1-9a0f-4647-88d8-2aa148f0d1b4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:28.633888 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 612/1226] 10.222.0.62 () {60 vars in 1290 bytes} [Mon Aug 29 15:29:28 2022] PUT /compute/v2.1/os-security-groups/c057e460-c71c-4acc-93a8-3f66f3af9d3f => generated 194 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:28.639090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-de4e5fba-4c66-438c-8079-b2dfbd7727fb tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'create', calling method: .version_select at 0x7fc42ba6fdc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-143731727", "description": "tempest-description-912074992"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:28.650259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb4f52e1-9a0f-4647-88d8-2aa148f0d1b4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:28.650767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb4f52e1-9a0f-4647-88d8-2aa148f0d1b4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:28.651212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb4f52e1-9a0f-4647-88d8-2aa148f0d1b4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:28.651938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb4f52e1-9a0f-4647-88d8-2aa148f0d1b4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:28.652388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb4f52e1-9a0f-4647-88d8-2aa148f0d1b4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:28.652816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb4f52e1-9a0f-4647-88d8-2aa148f0d1b4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:28.739650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-eb4f52e1-9a0f-4647-88d8-2aa148f0d1b4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:28.758498 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eb4f52e1-9a0f-4647-88d8-2aa148f0d1b4 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1937 microversion: 2.75 time: 0.133714 Aug 29 15:29:28.769155 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 615/1227] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:28 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1937 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:29.003860 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-de4e5fba-4c66-438c-8079-b2dfbd7727fb tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.368597 Aug 29 15:29:29.017204 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 613/1228] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:29:28 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:29.118106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1630854629", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "7559a0d2-fc12-4800-88b8-6f0c0da3a2ed"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:29.176364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] validate_networks() for [('7559a0d2-fc12-4800-88b8-6f0c0da3a2ed', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:29:29.231653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4fd7730a-6547-4760-a7d6-13e5ab2a82e9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:29.232934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4fd7730a-6547-4760-a7d6-13e5ab2a82e9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:29.240680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fd7730a-6547-4760-a7d6-13e5ab2a82e9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.246235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fd7730a-6547-4760-a7d6-13e5ab2a82e9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.246707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fd7730a-6547-4760-a7d6-13e5ab2a82e9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:29.247492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fd7730a-6547-4760-a7d6-13e5ab2a82e9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.247975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fd7730a-6547-4760-a7d6-13e5ab2a82e9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.248401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fd7730a-6547-4760-a7d6-13e5ab2a82e9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:29.481372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4fd7730a-6547-4760-a7d6-13e5ab2a82e9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:29.492749 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4fd7730a-6547-4760-a7d6-13e5ab2a82e9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1317 microversion: 2.1 time: 0.264523 Aug 29 15:29:29.494107 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 614/1229] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:29 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:29.508430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1ddf430d-90a0-4e12-b369-f52a4fad025b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:29.509588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1ddf430d-90a0-4e12-b369-f52a4fad025b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:29.517936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ddf430d-90a0-4e12-b369-f52a4fad025b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.518799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ddf430d-90a0-4e12-b369-f52a4fad025b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.519699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ddf430d-90a0-4e12-b369-f52a4fad025b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:29.520794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ddf430d-90a0-4e12-b369-f52a4fad025b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.521739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ddf430d-90a0-4e12-b369-f52a4fad025b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.522566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ddf430d-90a0-4e12-b369-f52a4fad025b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:29.604999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:29:29.605774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:29:29.606306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:29:29.606776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:29:29.607246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:29:29.615319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1ddf430d-90a0-4e12-b369-f52a4fad025b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:29.620988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.621721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.622186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:29.622949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.623413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.623829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:29.624827 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1ddf430d-90a0-4e12-b369-f52a4fad025b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1238 microversion: 2.1 time: 0.128960 Aug 29 15:29:29.625460 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 615/1230] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:29 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1238 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:29.632732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d4477760-f6b5-4456-aac1-981813b4a01c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:29.633637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d4477760-f6b5-4456-aac1-981813b4a01c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:29.640865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4477760-f6b5-4456-aac1-981813b4a01c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.641603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4477760-f6b5-4456-aac1-981813b4a01c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.642176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4477760-f6b5-4456-aac1-981813b4a01c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:29.643054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4477760-f6b5-4456-aac1-981813b4a01c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.644024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4477760-f6b5-4456-aac1-981813b4a01c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.644788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4477760-f6b5-4456-aac1-981813b4a01c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:29.659031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Getting quotas for project 7939dc6e747744dab4a60e547c6d9191. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:29:29.665057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Getting quotas for user 26faf4e7544842ad9dc66370ccba54fc and project 7939dc6e747744dab4a60e547c6d9191. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:29:29.680495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:29:29.683526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:29:29.734251 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-79cbd85b-a90b-4688-9ec5-27d4db3b5087 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620100 Aug 29 15:29:29.735747 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 616/1231] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:29:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:29:29.757102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2242ab7f-dd92-43b2-97a0-9e372b535d2e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:29.758241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2242ab7f-dd92-43b2-97a0-9e372b535d2e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:29.855101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2242ab7f-dd92-43b2-97a0-9e372b535d2e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:29.864706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d4477760-f6b5-4456-aac1-981813b4a01c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:29.876654 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d4477760-f6b5-4456-aac1-981813b4a01c tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.249902 Aug 29 15:29:29.877383 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 616/1232] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:29 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:29.884559 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2242ab7f-dd92-43b2-97a0-9e372b535d2e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1216 microversion: 2.1 time: 0.141975 Aug 29 15:29:29.886698 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 617/1233] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:29 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1216 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:29.887505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-171207af-ad3f-4039-b9a2-22022dfbb1ee tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:29.888129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-171207af-ad3f-4039-b9a2-22022dfbb1ee tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:29.897612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-171207af-ad3f-4039-b9a2-22022dfbb1ee tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.898387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-171207af-ad3f-4039-b9a2-22022dfbb1ee tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.905117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-171207af-ad3f-4039-b9a2-22022dfbb1ee tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:29.906810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-171207af-ad3f-4039-b9a2-22022dfbb1ee tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:29.907325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-171207af-ad3f-4039-b9a2-22022dfbb1ee tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:29.907804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-171207af-ad3f-4039-b9a2-22022dfbb1ee tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:30.014447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-171207af-ad3f-4039-b9a2-22022dfbb1ee tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:30.053822 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-171207af-ad3f-4039-b9a2-22022dfbb1ee tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1937 microversion: 2.75 time: 0.174267 Aug 29 15:29:30.055057 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 617/1234] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:29 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1937 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:30.514178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e7b5a48e-42f4-4061-94b7-38484bf4a3a6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:30.514983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e7b5a48e-42f4-4061-94b7-38484bf4a3a6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:30.522133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7b5a48e-42f4-4061-94b7-38484bf4a3a6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:30.522997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7b5a48e-42f4-4061-94b7-38484bf4a3a6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:30.523440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7b5a48e-42f4-4061-94b7-38484bf4a3a6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:30.524427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7b5a48e-42f4-4061-94b7-38484bf4a3a6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:30.524894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7b5a48e-42f4-4061-94b7-38484bf4a3a6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:30.525523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7b5a48e-42f4-4061-94b7-38484bf4a3a6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:30.546481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:30.647447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5f87e544-e6a7-498c-86f3-d90090964a3d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:30.648426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5f87e544-e6a7-498c-86f3-d90090964a3d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:30.656003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f87e544-e6a7-498c-86f3-d90090964a3d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:30.656513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f87e544-e6a7-498c-86f3-d90090964a3d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:30.657016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f87e544-e6a7-498c-86f3-d90090964a3d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:30.657966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f87e544-e6a7-498c-86f3-d90090964a3d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:30.658436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f87e544-e6a7-498c-86f3-d90090964a3d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:30.658946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f87e544-e6a7-498c-86f3-d90090964a3d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:30.736639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e7b5a48e-42f4-4061-94b7-38484bf4a3a6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:30.746356 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e7b5a48e-42f4-4061-94b7-38484bf4a3a6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1317 microversion: 2.1 time: 0.235941 Aug 29 15:29:30.753358 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 618/1235] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:30 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:30.912235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aab0faef-bc3f-4dcd-a6b3-255853cf641d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:30.912771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aab0faef-bc3f-4dcd-a6b3-255853cf641d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:30.920368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aab0faef-bc3f-4dcd-a6b3-255853cf641d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:30.920951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aab0faef-bc3f-4dcd-a6b3-255853cf641d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:30.921415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aab0faef-bc3f-4dcd-a6b3-255853cf641d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:30.922131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aab0faef-bc3f-4dcd-a6b3-255853cf641d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:30.922590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aab0faef-bc3f-4dcd-a6b3-255853cf641d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:30.923019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aab0faef-bc3f-4dcd-a6b3-255853cf641d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:31.036319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5f87e544-e6a7-498c-86f3-d90090964a3d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:31.045712 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5f87e544-e6a7-498c-86f3-d90090964a3d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1286 microversion: 2.1 time: 0.403460 Aug 29 15:29:31.046314 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 618/1236] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:30 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1286 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:31.057352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0e7c0267-cdad-43b9-b516-00f4ac3d654e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:31.059019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0e7c0267-cdad-43b9-b516-00f4ac3d654e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:31.066699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e7c0267-cdad-43b9-b516-00f4ac3d654e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:31.067499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e7c0267-cdad-43b9-b516-00f4ac3d654e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:31.068408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e7c0267-cdad-43b9-b516-00f4ac3d654e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:31.069395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e7c0267-cdad-43b9-b516-00f4ac3d654e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:31.070661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e7c0267-cdad-43b9-b516-00f4ac3d654e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:31.071312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e7c0267-cdad-43b9-b516-00f4ac3d654e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:31.162602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0e7c0267-cdad-43b9-b516-00f4ac3d654e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:31.172931 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0e7c0267-cdad-43b9-b516-00f4ac3d654e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1212 microversion: 2.1 time: 0.125211 Aug 29 15:29:31.174504 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 619/1237] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:31 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1212 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:31.177437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aab0faef-bc3f-4dcd-a6b3-255853cf641d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:31.180152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0fee84b4-8e86-4a3f-8c0f-5b3bfb5965dc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:31.180960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0fee84b4-8e86-4a3f-8c0f-5b3bfb5965dc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:31.187399 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aab0faef-bc3f-4dcd-a6b3-255853cf641d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1369 microversion: 2.1 time: 0.279288 Aug 29 15:29:31.188646 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 619/1238] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:30 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1369 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:31.189426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fee84b4-8e86-4a3f-8c0f-5b3bfb5965dc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:31.190149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fee84b4-8e86-4a3f-8c0f-5b3bfb5965dc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:31.190846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fee84b4-8e86-4a3f-8c0f-5b3bfb5965dc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:31.191791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fee84b4-8e86-4a3f-8c0f-5b3bfb5965dc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:31.193072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fee84b4-8e86-4a3f-8c0f-5b3bfb5965dc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:31.193752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fee84b4-8e86-4a3f-8c0f-5b3bfb5965dc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:31.268046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-0fee84b4-8e86-4a3f-8c0f-5b3bfb5965dc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:31.285913 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0fee84b4-8e86-4a3f-8c0f-5b3bfb5965dc tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1937 microversion: 2.75 time: 0.110029 Aug 29 15:29:31.286521 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 620/1239] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:31 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1937 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:31.767104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b591722f-7d4d-4a00-ae49-15838fb6d614 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:31.769499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b591722f-7d4d-4a00-ae49-15838fb6d614 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:31.776815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b591722f-7d4d-4a00-ae49-15838fb6d614 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:31.781108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b591722f-7d4d-4a00-ae49-15838fb6d614 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:31.782261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b591722f-7d4d-4a00-ae49-15838fb6d614 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:31.783070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b591722f-7d4d-4a00-ae49-15838fb6d614 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:31.783548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b591722f-7d4d-4a00-ae49-15838fb6d614 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:31.784150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b591722f-7d4d-4a00-ae49-15838fb6d614 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.025692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b591722f-7d4d-4a00-ae49-15838fb6d614 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:32.035405 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b591722f-7d4d-4a00-ae49-15838fb6d614 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1317 microversion: 2.1 time: 0.271987 Aug 29 15:29:32.049781 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 620/1240] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:31 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:32.069392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c7b59eec-b60a-4c8a-91a6-dcd15ff373c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:32.070997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c7b59eec-b60a-4c8a-91a6-dcd15ff373c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:32.079815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7b59eec-b60a-4c8a-91a6-dcd15ff373c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.080346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7b59eec-b60a-4c8a-91a6-dcd15ff373c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.080787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7b59eec-b60a-4c8a-91a6-dcd15ff373c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.081526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7b59eec-b60a-4c8a-91a6-dcd15ff373c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.081983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7b59eec-b60a-4c8a-91a6-dcd15ff373c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.082404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7b59eec-b60a-4c8a-91a6-dcd15ff373c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.162967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c7b59eec-b60a-4c8a-91a6-dcd15ff373c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:32.171047 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c7b59eec-b60a-4c8a-91a6-dcd15ff373c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1286 microversion: 2.1 time: 0.106882 Aug 29 15:29:32.171647 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 621/1241] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:32 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:32.194347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7ff060f1-18e1-4eae-b572-1ed8113fa7f5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:32.195340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7ff060f1-18e1-4eae-b572-1ed8113fa7f5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:32.205841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ff060f1-18e1-4eae-b572-1ed8113fa7f5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.206440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ff060f1-18e1-4eae-b572-1ed8113fa7f5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.206931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ff060f1-18e1-4eae-b572-1ed8113fa7f5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.207705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ff060f1-18e1-4eae-b572-1ed8113fa7f5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.208223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ff060f1-18e1-4eae-b572-1ed8113fa7f5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.208323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d8c63608-25ef-4656-87b6-fd9e46cf50a0 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:32.208736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ff060f1-18e1-4eae-b572-1ed8113fa7f5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.208937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d8c63608-25ef-4656-87b6-fd9e46cf50a0 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:32.215921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8c63608-25ef-4656-87b6-fd9e46cf50a0 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.216412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8c63608-25ef-4656-87b6-fd9e46cf50a0 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.216848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8c63608-25ef-4656-87b6-fd9e46cf50a0 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.217774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8c63608-25ef-4656-87b6-fd9e46cf50a0 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.218382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8c63608-25ef-4656-87b6-fd9e46cf50a0 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.218803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8c63608-25ef-4656-87b6-fd9e46cf50a0 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.384857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7ff060f1-18e1-4eae-b572-1ed8113fa7f5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:32.398654 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7ff060f1-18e1-4eae-b572-1ed8113fa7f5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1268 microversion: 2.1 time: 0.207849 Aug 29 15:29:32.418853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d8c63608-25ef-4656-87b6-fd9e46cf50a0 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:32.419559 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 621/1242] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:32 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1268 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:32.440406 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d8c63608-25ef-4656-87b6-fd9e46cf50a0 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1556 microversion: 2.1 time: 0.236090 Aug 29 15:29:32.441413 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 622/1243] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:32 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1556 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:32.457737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-978a1d27-ed8b-46ed-a3dc-f1d4adbaa892 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:32.459883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-978a1d27-ed8b-46ed-a3dc-f1d4adbaa892 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:32.463365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f63a8fa9-f99b-4520-be43-b7fe3f9005d7 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:32.463866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f63a8fa9-f99b-4520-be43-b7fe3f9005d7 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:32.471341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f63a8fa9-f99b-4520-be43-b7fe3f9005d7 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.471902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f63a8fa9-f99b-4520-be43-b7fe3f9005d7 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.472345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f63a8fa9-f99b-4520-be43-b7fe3f9005d7 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.473063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f63a8fa9-f99b-4520-be43-b7fe3f9005d7 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.473561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f63a8fa9-f99b-4520-be43-b7fe3f9005d7 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.473980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f63a8fa9-f99b-4520-be43-b7fe3f9005d7 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.481401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-978a1d27-ed8b-46ed-a3dc-f1d4adbaa892 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.482797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-978a1d27-ed8b-46ed-a3dc-f1d4adbaa892 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.483732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-978a1d27-ed8b-46ed-a3dc-f1d4adbaa892 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.484824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-978a1d27-ed8b-46ed-a3dc-f1d4adbaa892 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.485581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-978a1d27-ed8b-46ed-a3dc-f1d4adbaa892 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.486348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-978a1d27-ed8b-46ed-a3dc-f1d4adbaa892 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.625305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-978a1d27-ed8b-46ed-a3dc-f1d4adbaa892 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] Lazy-loading 'services' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:32.626603 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f63a8fa9-f99b-4520-be43-b7fe3f9005d7 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.165559 Aug 29 15:29:32.628815 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 623/1244] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:29:32 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:32.669781 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-978a1d27-ed8b-46ed-a3dc-f1d4adbaa892 tempest-ServersAdmin275Test-111821521 tempest-ServersAdmin275Test-111821521-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1922 microversion: 2.75 time: 0.248940 Aug 29 15:29:32.670636 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 622/1245] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:32 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1922 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:32.706307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fe553ba6-104d-47e8-a878-c34202f610be tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:32.706773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fe553ba6-104d-47e8-a878-c34202f610be tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:32.716188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe553ba6-104d-47e8-a878-c34202f610be tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.716693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe553ba6-104d-47e8-a878-c34202f610be tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.717402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe553ba6-104d-47e8-a878-c34202f610be tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.718643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe553ba6-104d-47e8-a878-c34202f610be tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.719455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe553ba6-104d-47e8-a878-c34202f610be tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.720045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe553ba6-104d-47e8-a878-c34202f610be tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.753491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fe553ba6-104d-47e8-a878-c34202f610be tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:29:32.858255 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fe553ba6-104d-47e8-a878-c34202f610be tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "DELETE /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 204 len: 0 microversion: 2.75 time: 0.160066 Aug 29 15:29:32.859302 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 624/1246] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:29:32 2022] DELETE /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:29:32.867838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-40d1c760-99f6-4d2f-b884-24469969dece tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:32.868442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-40d1c760-99f6-4d2f-b884-24469969dece tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:32.888916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40d1c760-99f6-4d2f-b884-24469969dece tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.889652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40d1c760-99f6-4d2f-b884-24469969dece tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.890408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40d1c760-99f6-4d2f-b884-24469969dece tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:32.897024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40d1c760-99f6-4d2f-b884-24469969dece tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:32.901403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40d1c760-99f6-4d2f-b884-24469969dece tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:32.902087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40d1c760-99f6-4d2f-b884-24469969dece tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:33.039282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-40d1c760-99f6-4d2f-b884-24469969dece tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:33.057199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e5586831-e3ac-4c63-925a-fd304bcdbe58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:33.057927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e5586831-e3ac-4c63-925a-fd304bcdbe58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:33.058529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-40d1c760-99f6-4d2f-b884-24469969dece tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:33.064701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-40d1c760-99f6-4d2f-b884-24469969dece tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:33.077349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5586831-e3ac-4c63-925a-fd304bcdbe58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:33.077961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5586831-e3ac-4c63-925a-fd304bcdbe58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:33.078272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5586831-e3ac-4c63-925a-fd304bcdbe58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:33.078548 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-40d1c760-99f6-4d2f-b884-24469969dece tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1444 microversion: 2.75 time: 0.214432 Aug 29 15:29:33.078991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5586831-e3ac-4c63-925a-fd304bcdbe58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:33.079452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5586831-e3ac-4c63-925a-fd304bcdbe58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:33.079937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5586831-e3ac-4c63-925a-fd304bcdbe58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:33.082752 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 623/1247] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:32 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1444 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:33.194728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-77309384-d87e-4a62-a52b-279063605714 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:33.195818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-77309384-d87e-4a62-a52b-279063605714 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:33.204218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77309384-d87e-4a62-a52b-279063605714 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:33.205295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77309384-d87e-4a62-a52b-279063605714 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:33.206059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77309384-d87e-4a62-a52b-279063605714 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:33.206970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77309384-d87e-4a62-a52b-279063605714 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:33.207626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77309384-d87e-4a62-a52b-279063605714 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:33.208245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77309384-d87e-4a62-a52b-279063605714 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:33.315064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-77309384-d87e-4a62-a52b-279063605714 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:33.328700 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-77309384-d87e-4a62-a52b-279063605714 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1294 microversion: 2.1 time: 0.139377 Aug 29 15:29:33.330088 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 624/1248] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:33 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1294 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:33.426643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1b049ebb-3efe-4969-9775-4e4d890eccca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:33.427301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1b049ebb-3efe-4969-9775-4e4d890eccca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:33.434116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b049ebb-3efe-4969-9775-4e4d890eccca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:33.434617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b049ebb-3efe-4969-9775-4e4d890eccca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:33.435066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b049ebb-3efe-4969-9775-4e4d890eccca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:33.435784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b049ebb-3efe-4969-9775-4e4d890eccca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:33.436255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b049ebb-3efe-4969-9775-4e4d890eccca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:33.436682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b049ebb-3efe-4969-9775-4e4d890eccca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:33.459355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e5586831-e3ac-4c63-925a-fd304bcdbe58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:33.478153 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e5586831-e3ac-4c63-925a-fd304bcdbe58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1317 microversion: 2.1 time: 0.418395 Aug 29 15:29:33.492677 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 625/1249] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:33 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:33.523059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1b049ebb-3efe-4969-9775-4e4d890eccca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:33.532503 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1b049ebb-3efe-4969-9775-4e4d890eccca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1268 microversion: 2.1 time: 0.109804 Aug 29 15:29:33.533550 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 625/1250] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:33 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1268 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:34.027675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-065716b9-5554-4368-ae61-42859ba2dc11 req-6667532b-1d8b-484c-85f4-1216eb2371b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32bc300a-b702-4755-b0c2-f0004d7d5016", "tag": "717cefd6-7122-4105-860c-3001547d3901"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:34.042075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-065716b9-5554-4368-ae61-42859ba2dc11 req-6667532b-1d8b-484c-85f4-1216eb2371b5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:34.042830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-065716b9-5554-4368-ae61-42859ba2dc11 req-6667532b-1d8b-484c-85f4-1216eb2371b5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:34.044089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-065716b9-5554-4368-ae61-42859ba2dc11 req-6667532b-1d8b-484c-85f4-1216eb2371b5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:34.060808 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-065716b9-5554-4368-ae61-42859ba2dc11 req-6667532b-1d8b-484c-85f4-1216eb2371b5 service nova] Creating event network-changed:717cefd6-7122-4105-860c-3001547d3901 for instance 32bc300a-b702-4755-b0c2-f0004d7d5016 on n-h1-839401-11 Aug 29 15:29:34.068729 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-065716b9-5554-4368-ae61-42859ba2dc11 req-6667532b-1d8b-484c-85f4-1216eb2371b5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045356 Aug 29 15:29:34.069833 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 626/1251] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:34.107249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d9cdf16b-4fa2-489a-b993-33aa6f6e352b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:34.108278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d9cdf16b-4fa2-489a-b993-33aa6f6e352b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:34.127078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9cdf16b-4fa2-489a-b993-33aa6f6e352b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:34.128216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9cdf16b-4fa2-489a-b993-33aa6f6e352b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:34.128773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9cdf16b-4fa2-489a-b993-33aa6f6e352b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:34.129632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9cdf16b-4fa2-489a-b993-33aa6f6e352b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:34.130212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9cdf16b-4fa2-489a-b993-33aa6f6e352b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:34.130863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9cdf16b-4fa2-489a-b993-33aa6f6e352b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:34.223807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-2f32318c-9781-422f-b739-0d8c34c802c5 req-6acebbbd-bd5e-46bb-9a41-65fb51aa7966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d34cb9-694e-4941-b163-9d1b0f44c8ae", "name": "network-vif-plugged", "status": "completed", "tag": "b0874f9c-2ae8-46b9-8878-f08b7073e1c7"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:34.271750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d9cdf16b-4fa2-489a-b993-33aa6f6e352b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:34.272135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2f32318c-9781-422f-b739-0d8c34c802c5 req-6acebbbd-bd5e-46bb-9a41-65fb51aa7966 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:34.272957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2f32318c-9781-422f-b739-0d8c34c802c5 req-6acebbbd-bd5e-46bb-9a41-65fb51aa7966 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:34.274171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2f32318c-9781-422f-b739-0d8c34c802c5 req-6acebbbd-bd5e-46bb-9a41-65fb51aa7966 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:34.282787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d9cdf16b-4fa2-489a-b993-33aa6f6e352b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:34.290748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d9cdf16b-4fa2-489a-b993-33aa6f6e352b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:34.312030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:34.315380 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d9cdf16b-4fa2-489a-b993-33aa6f6e352b tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1444 microversion: 2.75 time: 0.213663 Aug 29 15:29:34.320998 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-2f32318c-9781-422f-b739-0d8c34c802c5 req-6acebbbd-bd5e-46bb-9a41-65fb51aa7966 service nova] Creating event network-vif-plugged:b0874f9c-2ae8-46b9-8878-f08b7073e1c7 for instance d6d34cb9-694e-4941-b163-9d1b0f44c8ae on n-h1-839401-11 Aug 29 15:29:34.322102 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 626/1252] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:34 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1444 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:34.335894 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-2f32318c-9781-422f-b739-0d8c34c802c5 req-6acebbbd-bd5e-46bb-9a41-65fb51aa7966 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135813 Aug 29 15:29:34.340380 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 627/1253] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:34.350176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1fcd80d9-c7da-4112-b2b6-7130aa6ac619 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:34.351340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1fcd80d9-c7da-4112-b2b6-7130aa6ac619 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:34.359172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fcd80d9-c7da-4112-b2b6-7130aa6ac619 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:34.359857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fcd80d9-c7da-4112-b2b6-7130aa6ac619 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:34.360482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fcd80d9-c7da-4112-b2b6-7130aa6ac619 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:34.361792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fcd80d9-c7da-4112-b2b6-7130aa6ac619 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:34.362497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fcd80d9-c7da-4112-b2b6-7130aa6ac619 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:34.363138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fcd80d9-c7da-4112-b2b6-7130aa6ac619 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:34.464603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1fcd80d9-c7da-4112-b2b6-7130aa6ac619 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:34.473489 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1fcd80d9-c7da-4112-b2b6-7130aa6ac619 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1292 microversion: 2.1 time: 0.127001 Aug 29 15:29:34.474084 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 627/1254] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:34 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1292 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:34.500947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6aedfe31-13ea-4b64-ac59-bace1596f217 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:34.501972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6aedfe31-13ea-4b64-ac59-bace1596f217 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:34.515492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aedfe31-13ea-4b64-ac59-bace1596f217 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:34.520281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aedfe31-13ea-4b64-ac59-bace1596f217 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:34.520281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aedfe31-13ea-4b64-ac59-bace1596f217 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:34.521293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aedfe31-13ea-4b64-ac59-bace1596f217 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:34.523901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aedfe31-13ea-4b64-ac59-bace1596f217 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:34.524406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aedfe31-13ea-4b64-ac59-bace1596f217 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:34.554927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8d27db83-a81f-4538-94ca-73c08d9428e3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:34.555616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8d27db83-a81f-4538-94ca-73c08d9428e3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:34.568723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d27db83-a81f-4538-94ca-73c08d9428e3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:34.569262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d27db83-a81f-4538-94ca-73c08d9428e3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:34.570126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d27db83-a81f-4538-94ca-73c08d9428e3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:34.571016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d27db83-a81f-4538-94ca-73c08d9428e3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:34.571643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d27db83-a81f-4538-94ca-73c08d9428e3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:34.572228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d27db83-a81f-4538-94ca-73c08d9428e3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:34.725834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8d27db83-a81f-4538-94ca-73c08d9428e3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:34.739652 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8d27db83-a81f-4538-94ca-73c08d9428e3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1274 microversion: 2.1 time: 0.189268 Aug 29 15:29:34.757165 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 628/1255] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:34 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1274 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:34.952776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6aedfe31-13ea-4b64-ac59-bace1596f217 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:34.957604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:34.966325 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6aedfe31-13ea-4b64-ac59-bace1596f217 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1317 microversion: 2.1 time: 0.470435 Aug 29 15:29:34.967857 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 628/1256] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:34 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:35.346911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-901e1c3e-dd65-4970-9b29-8197ca219bff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:35.347519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-901e1c3e-dd65-4970-9b29-8197ca219bff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:35.355842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-901e1c3e-dd65-4970-9b29-8197ca219bff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:35.356501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-901e1c3e-dd65-4970-9b29-8197ca219bff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:35.356936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-901e1c3e-dd65-4970-9b29-8197ca219bff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:35.357673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-901e1c3e-dd65-4970-9b29-8197ca219bff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:35.358269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-901e1c3e-dd65-4970-9b29-8197ca219bff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:35.358856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-901e1c3e-dd65-4970-9b29-8197ca219bff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:35.447337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-901e1c3e-dd65-4970-9b29-8197ca219bff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:35.460361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-901e1c3e-dd65-4970-9b29-8197ca219bff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:35.462659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-901e1c3e-dd65-4970-9b29-8197ca219bff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:35.468923 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-901e1c3e-dd65-4970-9b29-8197ca219bff tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1444 microversion: 2.75 time: 0.126009 Aug 29 15:29:35.470794 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 629/1257] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:35 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1444 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:35.502525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d370e640-7a2f-4046-94dc-eeca1dafa3bf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:35.504042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d370e640-7a2f-4046-94dc-eeca1dafa3bf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:35.514547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d370e640-7a2f-4046-94dc-eeca1dafa3bf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:35.516118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d370e640-7a2f-4046-94dc-eeca1dafa3bf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:35.516753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d370e640-7a2f-4046-94dc-eeca1dafa3bf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:35.518097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d370e640-7a2f-4046-94dc-eeca1dafa3bf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:35.518762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d370e640-7a2f-4046-94dc-eeca1dafa3bf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:35.519510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d370e640-7a2f-4046-94dc-eeca1dafa3bf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:35.766669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b8afe1e7-07ce-4a1a-9c52-83493a71cd93 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:35.767726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b8afe1e7-07ce-4a1a-9c52-83493a71cd93 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:35.806079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8afe1e7-07ce-4a1a-9c52-83493a71cd93 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:35.806746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8afe1e7-07ce-4a1a-9c52-83493a71cd93 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:35.807235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8afe1e7-07ce-4a1a-9c52-83493a71cd93 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:35.808854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8afe1e7-07ce-4a1a-9c52-83493a71cd93 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:35.810701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8afe1e7-07ce-4a1a-9c52-83493a71cd93 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:35.811533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8afe1e7-07ce-4a1a-9c52-83493a71cd93 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:35.926754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d370e640-7a2f-4046-94dc-eeca1dafa3bf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:35.939263 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d370e640-7a2f-4046-94dc-eeca1dafa3bf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1359 microversion: 2.1 time: 0.446903 Aug 29 15:29:35.941143 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 629/1258] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:35 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1359 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:35.988611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-af13ec29-5b8d-4939-815c-dbe0eb613540 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:35.989733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-af13ec29-5b8d-4939-815c-dbe0eb613540 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:36.009475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af13ec29-5b8d-4939-815c-dbe0eb613540 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:36.011405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af13ec29-5b8d-4939-815c-dbe0eb613540 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:36.012817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af13ec29-5b8d-4939-815c-dbe0eb613540 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:36.023186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af13ec29-5b8d-4939-815c-dbe0eb613540 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:36.024114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af13ec29-5b8d-4939-815c-dbe0eb613540 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:36.024857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af13ec29-5b8d-4939-815c-dbe0eb613540 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:36.143720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b8afe1e7-07ce-4a1a-9c52-83493a71cd93 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:36.152942 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b8afe1e7-07ce-4a1a-9c52-83493a71cd93 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1316 microversion: 2.1 time: 0.391797 Aug 29 15:29:36.153584 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 630/1259] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:35 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1316 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:36.499038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b0e7ba66-2247-4190-b7ad-11b120ff521a tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:36.500065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b0e7ba66-2247-4190-b7ad-11b120ff521a tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:36.508912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0e7ba66-2247-4190-b7ad-11b120ff521a tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:36.509872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0e7ba66-2247-4190-b7ad-11b120ff521a tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:36.510465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0e7ba66-2247-4190-b7ad-11b120ff521a tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:36.511576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0e7ba66-2247-4190-b7ad-11b120ff521a tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:36.512426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0e7ba66-2247-4190-b7ad-11b120ff521a tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:36.513103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0e7ba66-2247-4190-b7ad-11b120ff521a tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:36.515120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-af13ec29-5b8d-4939-815c-dbe0eb613540 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:36.526926 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-af13ec29-5b8d-4939-815c-dbe0eb613540 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1317 microversion: 2.1 time: 0.542584 Aug 29 15:29:36.537181 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 630/1260] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:35 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:36.579627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0e7ba66-2247-4190-b7ad-11b120ff521a tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:36.580127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0e7ba66-2247-4190-b7ad-11b120ff521a tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:36.580560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0e7ba66-2247-4190-b7ad-11b120ff521a tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:36.581007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-b0e7ba66-2247-4190-b7ad-11b120ff521a tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lazy-loading 'fault' on Instance uuid 986c5d3c-def1-471f-967a-130d901e58d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:29:36.630854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b0e7ba66-2247-4190-b7ad-11b120ff521a tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:36.640997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b0e7ba66-2247-4190-b7ad-11b120ff521a tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:36.642533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b0e7ba66-2247-4190-b7ad-11b120ff521a tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '912df97993a14b4a8918e1e22d4bbca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b6d0ad7c834a5b9ea5aef3bd540f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:36.651983 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b0e7ba66-2247-4190-b7ad-11b120ff521a tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 200 len: 1449 microversion: 2.75 time: 0.157212 Aug 29 15:29:36.652883 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 631/1261] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:36 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:29:36.963819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5d2a26fa-db93-4f47-a353-54eecaa2cf06 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:36.964658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5d2a26fa-db93-4f47-a353-54eecaa2cf06 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:36.970987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d2a26fa-db93-4f47-a353-54eecaa2cf06 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:36.971515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d2a26fa-db93-4f47-a353-54eecaa2cf06 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:36.971950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d2a26fa-db93-4f47-a353-54eecaa2cf06 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:36.972645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d2a26fa-db93-4f47-a353-54eecaa2cf06 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:36.973114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d2a26fa-db93-4f47-a353-54eecaa2cf06 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:36.973545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d2a26fa-db93-4f47-a353-54eecaa2cf06 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:37.177893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a6f34eb1-8a04-4426-ad4f-4ede8728e4c5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:37.179189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a6f34eb1-8a04-4426-ad4f-4ede8728e4c5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:37.187024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6f34eb1-8a04-4426-ad4f-4ede8728e4c5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:37.188030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6f34eb1-8a04-4426-ad4f-4ede8728e4c5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:37.190089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6f34eb1-8a04-4426-ad4f-4ede8728e4c5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:37.190883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6f34eb1-8a04-4426-ad4f-4ede8728e4c5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:37.191677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6f34eb1-8a04-4426-ad4f-4ede8728e4c5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:37.192269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6f34eb1-8a04-4426-ad4f-4ede8728e4c5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:37.332104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a6f34eb1-8a04-4426-ad4f-4ede8728e4c5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:37.340108 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a6f34eb1-8a04-4426-ad4f-4ede8728e4c5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1316 microversion: 2.1 time: 0.168366 Aug 29 15:29:37.340697 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 632/1262] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:37 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:37.551794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4088866d-29a9-406d-9a82-cf01347b3c34 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:37.552417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4088866d-29a9-406d-9a82-cf01347b3c34 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:37.560326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4088866d-29a9-406d-9a82-cf01347b3c34 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:37.560927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4088866d-29a9-406d-9a82-cf01347b3c34 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:37.561424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4088866d-29a9-406d-9a82-cf01347b3c34 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:37.562217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4088866d-29a9-406d-9a82-cf01347b3c34 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:37.562738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4088866d-29a9-406d-9a82-cf01347b3c34 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:37.563221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4088866d-29a9-406d-9a82-cf01347b3c34 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:37.653851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5d2a26fa-db93-4f47-a353-54eecaa2cf06 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:37.662885 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5d2a26fa-db93-4f47-a353-54eecaa2cf06 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1359 microversion: 2.1 time: 0.703245 Aug 29 15:29:37.663630 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 631/1263] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:36 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1359 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:37.685450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ef745264-c296-490f-bf57-dee1eeb2611d tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:37.686218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ef745264-c296-490f-bf57-dee1eeb2611d tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] [instance: 986c5d3c-def1-471f-967a-130d901e58d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:37.692907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef745264-c296-490f-bf57-dee1eeb2611d tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:37.693484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef745264-c296-490f-bf57-dee1eeb2611d tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:37.694206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef745264-c296-490f-bf57-dee1eeb2611d tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:37.694996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef745264-c296-490f-bf57-dee1eeb2611d tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:37.695532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef745264-c296-490f-bf57-dee1eeb2611d tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:37.696212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef745264-c296-490f-bf57-dee1eeb2611d tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:37.712415 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-ef745264-c296-490f-bf57-dee1eeb2611d tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] HTTP exception thrown: Instance 986c5d3c-def1-471f-967a-130d901e58d0 could not be found. Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ef745264-c296-490f-bf57-dee1eeb2611d tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Request method failure captured: Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 HTTP/1.1 Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNr5jnA2GpZTwEHEdvDuG-LZsmC5n9vpyoyTV5crPjM2L561VOKdF2l6NhTbaiHTcvl9LdqYG9pXBlYIv9LUj3-NPrL0KnlOY2W-2UjHDmg1Me6HB8a8hkzruVq0d50DUj3Wa4mUiaJHz_zY4wK4-ee3CaM_7IUBcZpWOrg8MtgZQKM Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.75 Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 19b6d0ad7c834a5b9ea5aef3bd540f99 Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersAdmin275Test-1756107965 Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:29:37.714530 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:29:37.716468 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_19b6d0ad7c834a5b9ea5aef3bd540f99", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/19b6d0ad7c834a5b9ea5aef3bd540f99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19b6d0ad7c834a5b9ea5aef3bd540f99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19b6d0ad7c834a5b9ea5aef3bd540f99"}]}] Aug 29 15:29:37.716468 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersAdmin275Test-1756107965 Aug 29 15:29:37.716468 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 19b6d0ad7c834a5b9ea5aef3bd540f99 Aug 29 15:29:37.716468 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersAdmin275Test-1756107965 Aug 29 15:29:37.716468 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersAdmin275Test-1756107965-project Aug 29 15:29:37.716468 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:29:37.716468 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:29:37.716468 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 912df97993a14b4a8918e1e22d4bbca1 Aug 29 15:29:37.716468 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersAdmin275Test-1756107965-project Aug 29 15:29:37.716468 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:29:37.716468 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 986c5d3c-def1-471f-967a-130d901e58d0 could not be found. Aug 29 15:29:37.716468 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '986c5d3c-def1-471f-967a-130d901e58d0'} Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986c5d3c-def1-471f-967a-130d901e58d0 could not be found. Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:37.718005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986c5d3c-def1-471f-967a-130d901e58d0 could not be found. Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986c5d3c-def1-471f-967a-130d901e58d0 could not be found. Aug 29 15:29:37.719697 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:37.721485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ef745264-c296-490f-bf57-dee1eeb2611d tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] Returning 404 to user: Instance 986c5d3c-def1-471f-967a-130d901e58d0 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:37.721485 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ef745264-c296-490f-bf57-dee1eeb2611d tempest-ServersAdmin275Test-1756107965 tempest-ServersAdmin275Test-1756107965-project] 10.222.0.62 "GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0" status: 404 len: 111 microversion: 2.75 time: 0.037821 Aug 29 15:29:37.721485 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 632/1264] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:29:37 2022] GET /compute/v2.1/servers/986c5d3c-def1-471f-967a-130d901e58d0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:29:37.728287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4088866d-29a9-406d-9a82-cf01347b3c34 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:37.740721 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4088866d-29a9-406d-9a82-cf01347b3c34 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1467 microversion: 2.1 time: 0.193204 Aug 29 15:29:37.758328 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 633/1265] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:37 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1467 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:37.762933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f595e072-e2cb-4588-85fd-999a2b62b068 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:37.763575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f595e072-e2cb-4588-85fd-999a2b62b068 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:37.770240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f595e072-e2cb-4588-85fd-999a2b62b068 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:37.770589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f595e072-e2cb-4588-85fd-999a2b62b068 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:37.771334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f595e072-e2cb-4588-85fd-999a2b62b068 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:37.772192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f595e072-e2cb-4588-85fd-999a2b62b068 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:37.772803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f595e072-e2cb-4588-85fd-999a2b62b068 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:37.773505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f595e072-e2cb-4588-85fd-999a2b62b068 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:37.875209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-5904fdd2-7221-4cdb-bba7-3131a7e8b3d4 req-f216c099-177d-4f6b-8b8a-74a26ee4d2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a3c2ae-98a2-4e37-96ef-3e787faf0d11", "tag": "7a9162b3-e31e-4ebc-b3c4-b04ef19e4065"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:37.899439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5904fdd2-7221-4cdb-bba7-3131a7e8b3d4 req-f216c099-177d-4f6b-8b8a-74a26ee4d2c8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:37.900544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5904fdd2-7221-4cdb-bba7-3131a7e8b3d4 req-f216c099-177d-4f6b-8b8a-74a26ee4d2c8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:37.902605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5904fdd2-7221-4cdb-bba7-3131a7e8b3d4 req-f216c099-177d-4f6b-8b8a-74a26ee4d2c8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:37.929654 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-5904fdd2-7221-4cdb-bba7-3131a7e8b3d4 req-f216c099-177d-4f6b-8b8a-74a26ee4d2c8 service nova] Creating event network-changed:7a9162b3-e31e-4ebc-b3c4-b04ef19e4065 for instance 51a3c2ae-98a2-4e37-96ef-3e787faf0d11 on n-h2-839401-11 Aug 29 15:29:37.938621 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-5904fdd2-7221-4cdb-bba7-3131a7e8b3d4 req-f216c099-177d-4f6b-8b8a-74a26ee4d2c8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067651 Aug 29 15:29:37.939917 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 634/1266] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:29:38.265559 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f595e072-e2cb-4588-85fd-999a2b62b068 tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1620 microversion: 2.1 time: 0.507666 Aug 29 15:29:38.266159 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 633/1267] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:37 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1620 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:38.364615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2db5fd05-9456-4842-b4e2-c7e93a7e9949 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:38.366028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2db5fd05-9456-4842-b4e2-c7e93a7e9949 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:38.382680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2db5fd05-9456-4842-b4e2-c7e93a7e9949 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:38.383662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2db5fd05-9456-4842-b4e2-c7e93a7e9949 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:38.386316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2db5fd05-9456-4842-b4e2-c7e93a7e9949 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:38.388471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2db5fd05-9456-4842-b4e2-c7e93a7e9949 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:38.391329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2db5fd05-9456-4842-b4e2-c7e93a7e9949 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:38.394655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2db5fd05-9456-4842-b4e2-c7e93a7e9949 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:38.404922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:38.435942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-99209593", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "06e1bd29-189f-45ae-8cfe-ec70a91cf5c1"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:38.448413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:38.529795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:29:39.050670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2db5fd05-9456-4842-b4e2-c7e93a7e9949 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:39.059513 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2db5fd05-9456-4842-b4e2-c7e93a7e9949 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1316 microversion: 2.1 time: 0.701101 Aug 29 15:29:39.060107 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 635/1268] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:38 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1316 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:39.074588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-54cfd3d2-466b-41ff-8cc4-e547638b9732 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:39.075204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-54cfd3d2-466b-41ff-8cc4-e547638b9732 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:39.083319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54cfd3d2-466b-41ff-8cc4-e547638b9732 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:39.084040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54cfd3d2-466b-41ff-8cc4-e547638b9732 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:39.084642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54cfd3d2-466b-41ff-8cc4-e547638b9732 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:39.085572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54cfd3d2-466b-41ff-8cc4-e547638b9732 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:39.086202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54cfd3d2-466b-41ff-8cc4-e547638b9732 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:39.086780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54cfd3d2-466b-41ff-8cc4-e547638b9732 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:39.148582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:29:39.149661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:29:39.150589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:29:39.151321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:29:39.152043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:29:39.180589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:39.181120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:39.181554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:39.182270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:39.186045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:39.187661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:39.211231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for project 0393aa9c32934da4a9f478c563135bbb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:29:39.231996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Getting quotas for user e80b373b91434aae8f358839628f3072 and project 0393aa9c32934da4a9f478c563135bbb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:29:39.255302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:29:39.262312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:29:39.274887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:39.318015 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e394c100-6e16-4371-9820-a5e8111da661 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886078 Aug 29 15:29:39.318678 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 634/1269] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:29:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:29:39.330533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-058da281-ac27-4f4a-8dc9-2351eca3da33 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:39.331829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-058da281-ac27-4f4a-8dc9-2351eca3da33 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:39.451306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-058da281-ac27-4f4a-8dc9-2351eca3da33 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:39.456119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-54cfd3d2-466b-41ff-8cc4-e547638b9732 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:39.459305 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-058da281-ac27-4f4a-8dc9-2351eca3da33 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1215 microversion: 2.1 time: 0.133364 Aug 29 15:29:39.476249 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 635/1270] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:39 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1215 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:39.488506 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-54cfd3d2-466b-41ff-8cc4-e547638b9732 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1359 microversion: 2.1 time: 0.421745 Aug 29 15:29:39.491094 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 636/1271] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:39 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1359 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:39.959149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-20b324b4-bf16-4d96-a9c2-d095181faba3 req-2ce8aa8d-2f7e-442e-9614-3612b04a30e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ca5680-b383-4baa-870c-eb239ad4947a", "tag": "3c9370c4-4b98-4fb2-9f3b-4b45269eb266"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:39.971753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-20b324b4-bf16-4d96-a9c2-d095181faba3 req-2ce8aa8d-2f7e-442e-9614-3612b04a30e3 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:39.972606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-20b324b4-bf16-4d96-a9c2-d095181faba3 req-2ce8aa8d-2f7e-442e-9614-3612b04a30e3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:39.973331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-20b324b4-bf16-4d96-a9c2-d095181faba3 req-2ce8aa8d-2f7e-442e-9614-3612b04a30e3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:39.989214 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-20b324b4-bf16-4d96-a9c2-d095181faba3 req-2ce8aa8d-2f7e-442e-9614-3612b04a30e3 service nova] Creating event network-changed:3c9370c4-4b98-4fb2-9f3b-4b45269eb266 for instance a1ca5680-b383-4baa-870c-eb239ad4947a on n-h2-839401-11 Aug 29 15:29:39.995381 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-20b324b4-bf16-4d96-a9c2-d095181faba3 req-2ce8aa8d-2f7e-442e-9614-3612b04a30e3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039872 Aug 29 15:29:39.997136 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 636/1272] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:40.081520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-87d3b9aa-d408-49a6-9f3e-de149ff9ef9d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:40.082912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-87d3b9aa-d408-49a6-9f3e-de149ff9ef9d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:40.086360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:40.087682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=18 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:40.093849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87d3b9aa-d408-49a6-9f3e-de149ff9ef9d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:40.094357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87d3b9aa-d408-49a6-9f3e-de149ff9ef9d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:40.094810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87d3b9aa-d408-49a6-9f3e-de149ff9ef9d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:40.095679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87d3b9aa-d408-49a6-9f3e-de149ff9ef9d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:40.096136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87d3b9aa-d408-49a6-9f3e-de149ff9ef9d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:40.096651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87d3b9aa-d408-49a6-9f3e-de149ff9ef9d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:40.431016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-87d3b9aa-d408-49a6-9f3e-de149ff9ef9d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:40.442182 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-87d3b9aa-d408-49a6-9f3e-de149ff9ef9d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1316 microversion: 2.1 time: 0.364662 Aug 29 15:29:40.443073 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 637/1273] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:40 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:40.485052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b4f6977a-ac7c-46ec-8d65-87bb41fba6ee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:40.486105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b4f6977a-ac7c-46ec-8d65-87bb41fba6ee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:40.498264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4f6977a-ac7c-46ec-8d65-87bb41fba6ee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:40.498601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4f6977a-ac7c-46ec-8d65-87bb41fba6ee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:40.499045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4f6977a-ac7c-46ec-8d65-87bb41fba6ee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:40.499828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4f6977a-ac7c-46ec-8d65-87bb41fba6ee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:40.500275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4f6977a-ac7c-46ec-8d65-87bb41fba6ee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:40.500884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4f6977a-ac7c-46ec-8d65-87bb41fba6ee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:40.512571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-76fb7423-a92f-42ce-8afd-cf86c42b8db8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:40.513782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-76fb7423-a92f-42ce-8afd-cf86c42b8db8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:40.524878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76fb7423-a92f-42ce-8afd-cf86c42b8db8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:40.526621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76fb7423-a92f-42ce-8afd-cf86c42b8db8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:40.527072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76fb7423-a92f-42ce-8afd-cf86c42b8db8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:40.527811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76fb7423-a92f-42ce-8afd-cf86c42b8db8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:40.528264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76fb7423-a92f-42ce-8afd-cf86c42b8db8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:40.528695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76fb7423-a92f-42ce-8afd-cf86c42b8db8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:40.681599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b4f6977a-ac7c-46ec-8d65-87bb41fba6ee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:40.693501 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b4f6977a-ac7c-46ec-8d65-87bb41fba6ee tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1219 microversion: 2.1 time: 0.212291 Aug 29 15:29:40.706596 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 637/1274] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:40 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1219 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:40.854430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-76fb7423-a92f-42ce-8afd-cf86c42b8db8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:40.865912 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-76fb7423-a92f-42ce-8afd-cf86c42b8db8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1359 microversion: 2.1 time: 0.358208 Aug 29 15:29:40.866491 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 638/1275] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:40 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1359 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:41.465447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fd2e0d0f-b196-46d3-8d20-b7723f56cf02 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:41.466419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fd2e0d0f-b196-46d3-8d20-b7723f56cf02 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:41.475134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd2e0d0f-b196-46d3-8d20-b7723f56cf02 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:41.475671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd2e0d0f-b196-46d3-8d20-b7723f56cf02 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:41.476108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd2e0d0f-b196-46d3-8d20-b7723f56cf02 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:41.476861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd2e0d0f-b196-46d3-8d20-b7723f56cf02 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:41.477351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd2e0d0f-b196-46d3-8d20-b7723f56cf02 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:41.477834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd2e0d0f-b196-46d3-8d20-b7723f56cf02 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:41.635605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fd2e0d0f-b196-46d3-8d20-b7723f56cf02 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:41.644639 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fd2e0d0f-b196-46d3-8d20-b7723f56cf02 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1316 microversion: 2.1 time: 0.184779 Aug 29 15:29:41.649584 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 638/1276] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:41 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:41.714196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6498fb22-dcc5-425d-be5b-c60ce85863da tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:41.714811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6498fb22-dcc5-425d-be5b-c60ce85863da tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:41.721543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6498fb22-dcc5-425d-be5b-c60ce85863da tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:41.722029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6498fb22-dcc5-425d-be5b-c60ce85863da tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:41.722462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6498fb22-dcc5-425d-be5b-c60ce85863da tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:41.723164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6498fb22-dcc5-425d-be5b-c60ce85863da tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:41.723616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6498fb22-dcc5-425d-be5b-c60ce85863da tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:41.724034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6498fb22-dcc5-425d-be5b-c60ce85863da tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:41.829709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6498fb22-dcc5-425d-be5b-c60ce85863da tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:41.838186 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6498fb22-dcc5-425d-be5b-c60ce85863da tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1219 microversion: 2.1 time: 0.127754 Aug 29 15:29:41.839161 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 639/1277] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:41 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:41.893302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-61fb3c2a-9f5a-4cfa-aeb8-b2fd1b87d6c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:41.894961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-61fb3c2a-9f5a-4cfa-aeb8-b2fd1b87d6c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:41.903341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61fb3c2a-9f5a-4cfa-aeb8-b2fd1b87d6c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:41.903997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61fb3c2a-9f5a-4cfa-aeb8-b2fd1b87d6c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:41.906147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61fb3c2a-9f5a-4cfa-aeb8-b2fd1b87d6c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:41.906933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61fb3c2a-9f5a-4cfa-aeb8-b2fd1b87d6c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:41.907399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61fb3c2a-9f5a-4cfa-aeb8-b2fd1b87d6c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:41.907880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61fb3c2a-9f5a-4cfa-aeb8-b2fd1b87d6c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.099268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-61fb3c2a-9f5a-4cfa-aeb8-b2fd1b87d6c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:42.113570 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-61fb3c2a-9f5a-4cfa-aeb8-b2fd1b87d6c1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1359 microversion: 2.1 time: 0.227664 Aug 29 15:29:42.114429 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 639/1278] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:41 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:42.620407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f97b18b6-bb74-4e0f-a0be-6628234c1c8a tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:42.626110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f97b18b6-bb74-4e0f-a0be-6628234c1c8a tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.626625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f97b18b6-bb74-4e0f-a0be-6628234c1c8a tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.627074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f97b18b6-bb74-4e0f-a0be-6628234c1c8a tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.627873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f97b18b6-bb74-4e0f-a0be-6628234c1c8a tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.628509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f97b18b6-bb74-4e0f-a0be-6628234c1c8a tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.628980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f97b18b6-bb74-4e0f-a0be-6628234c1c8a tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.657019 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f97b18b6-bb74-4e0f-a0be-6628234c1c8a tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.173549 Aug 29 15:29:42.658053 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 640/1279] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:29:42 2022] GET /compute/v2.1/os-services => generated 949 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:42.666440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bab9fc2b-7543-416e-9ed5-1c7beca079ce tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:42.667134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bab9fc2b-7543-416e-9ed5-1c7beca079ce tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:42.678238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-358ec82b-bac4-46ac-91a4-b2def989fa05 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:42.683914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bab9fc2b-7543-416e-9ed5-1c7beca079ce tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.684647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bab9fc2b-7543-416e-9ed5-1c7beca079ce tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.685440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bab9fc2b-7543-416e-9ed5-1c7beca079ce tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.685576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-358ec82b-bac4-46ac-91a4-b2def989fa05 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.686189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-358ec82b-bac4-46ac-91a4-b2def989fa05 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.686845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-358ec82b-bac4-46ac-91a4-b2def989fa05 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.687687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bab9fc2b-7543-416e-9ed5-1c7beca079ce tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.687818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-358ec82b-bac4-46ac-91a4-b2def989fa05 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.688447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bab9fc2b-7543-416e-9ed5-1c7beca079ce tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.688689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-358ec82b-bac4-46ac-91a4-b2def989fa05 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.689232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-358ec82b-bac4-46ac-91a4-b2def989fa05 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.689577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bab9fc2b-7543-416e-9ed5-1c7beca079ce tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.723256 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-358ec82b-bac4-46ac-91a4-b2def989fa05 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.052284 Aug 29 15:29:42.724111 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 641/1280] 10.222.0.62 () {58 vars in 1170 bytes} [Mon Aug 29 15:29:42 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:42.738977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-622266cb-377c-4175-9a57-358c9ba6f351 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:42.747431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-622266cb-377c-4175-9a57-358c9ba6f351 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.748344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-622266cb-377c-4175-9a57-358c9ba6f351 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.748982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-622266cb-377c-4175-9a57-358c9ba6f351 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.750335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-622266cb-377c-4175-9a57-358c9ba6f351 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.750979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-622266cb-377c-4175-9a57-358c9ba6f351 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.751881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-622266cb-377c-4175-9a57-358c9ba6f351 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.813665 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-622266cb-377c-4175-9a57-358c9ba6f351 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.080284 Aug 29 15:29:42.814651 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 642/1281] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:29:42 2022] GET /compute/v2.1/os-services => generated 949 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:29:42.827827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-568871fa-c379-4345-b79d-b5ee852922ca tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:42.833673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-568871fa-c379-4345-b79d-b5ee852922ca tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.836971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-568871fa-c379-4345-b79d-b5ee852922ca tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.838662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-568871fa-c379-4345-b79d-b5ee852922ca tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.840304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-568871fa-c379-4345-b79d-b5ee852922ca tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.843181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-568871fa-c379-4345-b79d-b5ee852922ca tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.843883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-568871fa-c379-4345-b79d-b5ee852922ca tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.899896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bab9fc2b-7543-416e-9ed5-1c7beca079ce tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:42.909321 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bab9fc2b-7543-416e-9ed5-1c7beca079ce tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1316 microversion: 2.1 time: 0.247074 Aug 29 15:29:42.913297 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 640/1282] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:42 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:42.914590 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-568871fa-c379-4345-b79d-b5ee852922ca tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?host=n-d-839401-11&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.090307 Aug 29 15:29:42.919835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9fb047d3-e2a0-4d8d-ac1b-8094c7c90686 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:42.920066 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 643/1283] 10.222.0.62 () {58 vars in 1196 bytes} [Mon Aug 29 15:29:42 2022] GET /compute/v2.1/os-services?host=n-d-839401-11&binary=xxx => generated 16 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:29:42.921120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9fb047d3-e2a0-4d8d-ac1b-8094c7c90686 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:42.929908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-61c109ac-6e4e-4391-a441-43f464699070 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:42.939058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fb047d3-e2a0-4d8d-ac1b-8094c7c90686 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.939571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fb047d3-e2a0-4d8d-ac1b-8094c7c90686 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.940007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fb047d3-e2a0-4d8d-ac1b-8094c7c90686 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.940731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fb047d3-e2a0-4d8d-ac1b-8094c7c90686 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.943327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61c109ac-6e4e-4391-a441-43f464699070 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.945153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61c109ac-6e4e-4391-a441-43f464699070 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.946093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fb047d3-e2a0-4d8d-ac1b-8094c7c90686 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.946568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61c109ac-6e4e-4391-a441-43f464699070 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.946708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fb047d3-e2a0-4d8d-ac1b-8094c7c90686 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.947408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61c109ac-6e4e-4391-a441-43f464699070 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:42.947854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61c109ac-6e4e-4391-a441-43f464699070 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:42.948292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61c109ac-6e4e-4391-a441-43f464699070 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:42.991613 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-61c109ac-6e4e-4391-a441-43f464699070 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.067725 Aug 29 15:29:42.992436 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 644/1284] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:29:42 2022] GET /compute/v2.1/os-services => generated 949 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:29:43.017905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7d65d710-f58f-4f04-9a0b-42389c3296c1 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:43.022609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d65d710-f58f-4f04-9a0b-42389c3296c1 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:43.023325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d65d710-f58f-4f04-9a0b-42389c3296c1 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:43.023933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d65d710-f58f-4f04-9a0b-42389c3296c1 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:43.024875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d65d710-f58f-4f04-9a0b-42389c3296c1 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:43.025776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d65d710-f58f-4f04-9a0b-42389c3296c1 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:43.026381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d65d710-f58f-4f04-9a0b-42389c3296c1 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:43.037476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9fb047d3-e2a0-4d8d-ac1b-8094c7c90686 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:43.049007 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9fb047d3-e2a0-4d8d-ac1b-8094c7c90686 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1267 microversion: 2.1 time: 0.133806 Aug 29 15:29:43.062158 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 641/1285] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:42 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:43.076290 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7d65d710-f58f-4f04-9a0b-42389c3296c1 tempest-ServicesAdminNegativeTestJSON-1544152944 tempest-ServicesAdminNegativeTestJSON-1544152944-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.062916 Aug 29 15:29:43.081141 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 645/1286] 10.222.0.62 () {58 vars in 1198 bytes} [Mon Aug 29 15:29:43 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:29:43.145717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9e1500fa-702e-4532-b8a3-a8688c887b82 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:43.145717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9e1500fa-702e-4532-b8a3-a8688c887b82 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:43.151696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e1500fa-702e-4532-b8a3-a8688c887b82 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:43.152193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e1500fa-702e-4532-b8a3-a8688c887b82 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:43.152868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e1500fa-702e-4532-b8a3-a8688c887b82 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:43.156385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e1500fa-702e-4532-b8a3-a8688c887b82 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:43.157074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e1500fa-702e-4532-b8a3-a8688c887b82 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:43.157759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e1500fa-702e-4532-b8a3-a8688c887b82 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:43.250712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eca41606-0d4b-4298-9903-c3b71c1d42dc tempest-ServicesAdminNegativeTestJSON-1198185317 tempest-ServicesAdminNegativeTestJSON-1198185317-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:43.254497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eca41606-0d4b-4298-9903-c3b71c1d42dc tempest-ServicesAdminNegativeTestJSON-1198185317 tempest-ServicesAdminNegativeTestJSON-1198185317-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '9b5f7b5693f84c3393626018f86645be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa82ffd2a0564d199fb72352129ceac2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eca41606-0d4b-4298-9903-c3b71c1d42dc tempest-ServicesAdminNegativeTestJSON-1198185317 tempest-ServicesAdminNegativeTestJSON-1198185317-project] Request method failure captured: Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNtlrRGRIydr2KQJ23fA5uw8Piyc9tihxTvCPEkn_fWaQ0RN6np60GShFpvmiZX5s7wF2g-E5uTBFha1EJWmN44oGs0wjODIcpgwUnCUymDtAShzqyRQKfoacKB8hn5F688H3ImNZU6Ov9pGOQgLtlForRpxDqjdv1xizjF3xDH53Xo Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: aa82ffd2a0564d199fb72352129ceac2 Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1198185317 Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:29:43.256560 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:29:43.258014 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_aa82ffd2a0564d199fb72352129ceac2", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/aa82ffd2a0564d199fb72352129ceac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/aa82ffd2a0564d199fb72352129ceac2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/aa82ffd2a0564d199fb72352129ceac2"}]}] Aug 29 15:29:43.258014 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1198185317 Aug 29 15:29:43.258014 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: aa82ffd2a0564d199fb72352129ceac2 Aug 29 15:29:43.258014 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1198185317 Aug 29 15:29:43.258014 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServicesAdminNegativeTestJSON-1198185317-project Aug 29 15:29:43.258014 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:29:43.258014 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:29:43.258014 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 9b5f7b5693f84c3393626018f86645be Aug 29 15:29:43.258014 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1198185317-project Aug 29 15:29:43.258014 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:29:43.258014 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:29:43.258014 n-d-839401-11 devstack@n-api.service[122361]: action_args: {} Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:29:43.258956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:29:43.260189 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:29:43.261651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eca41606-0d4b-4298-9903-c3b71c1d42dc tempest-ServicesAdminNegativeTestJSON-1198185317 tempest-ServicesAdminNegativeTestJSON-1198185317-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:43.261651 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eca41606-0d4b-4298-9903-c3b71c1d42dc tempest-ServicesAdminNegativeTestJSON-1198185317 tempest-ServicesAdminNegativeTestJSON-1198185317-project] 10.222.0.62 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.172557 Aug 29 15:29:43.263035 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 642/1287] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:29:43 2022] GET /compute/v2.1/os-services => generated 112 bytes in 178 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:29:43.575902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e1500fa-702e-4532-b8a3-a8688c887b82 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:43.592835 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9e1500fa-702e-4532-b8a3-a8688c887b82 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1359 microversion: 2.1 time: 0.458781 Aug 29 15:29:43.606613 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 646/1288] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:43 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1359 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:43.797597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3614dd34-848a-42b4-a840-3bfd7310b793 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Action: 'create', calling method: .version_select at 0x7fc42b9a1670>, body: {"keypair": {"name": "tempest-keypair-1523356171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyjSFq8JuFcsCxnHH1zAxpgUJ/d884bpQ7Ow/1dl8lk9IiJl8+goKKnlDkzbgs+VmfrCRv88G1q6b7WQ+o+KynsfyTc2GGcDDl8leR0fh/MVFtHpG7Rf+QO5WVFbRO/gA=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:43.816087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-3614dd34-848a-42b4-a840-3bfd7310b793 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Getting quotas for project 1a18044ba17142cf9c1cfeb4720e76db. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:29:43.821472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-3614dd34-848a-42b4-a840-3bfd7310b793 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Getting quotas for user 7c6197c2073645fc91ae65d4d42c18ac and project 1a18044ba17142cf9c1cfeb4720e76db. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:29:43.870714 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3614dd34-848a-42b4-a840-3bfd7310b793 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.214041 Aug 29 15:29:43.871603 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 643/1289] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:29:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:43.931295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7d6dc8d2-4f96-428d-a631-520a3fe0c856 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:43.933285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7d6dc8d2-4f96-428d-a631-520a3fe0c856 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:43.941846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d6dc8d2-4f96-428d-a631-520a3fe0c856 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:43.942717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d6dc8d2-4f96-428d-a631-520a3fe0c856 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:43.943807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d6dc8d2-4f96-428d-a631-520a3fe0c856 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:43.944796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d6dc8d2-4f96-428d-a631-520a3fe0c856 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:43.945542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d6dc8d2-4f96-428d-a631-520a3fe0c856 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:43.946063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d6dc8d2-4f96-428d-a631-520a3fe0c856 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:44.071324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-01b5d0f4-cdc7-4e97-aa46-8298dc1514f8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:44.072175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-01b5d0f4-cdc7-4e97-aa46-8298dc1514f8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:44.081305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01b5d0f4-cdc7-4e97-aa46-8298dc1514f8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:44.081988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01b5d0f4-cdc7-4e97-aa46-8298dc1514f8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:44.082812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01b5d0f4-cdc7-4e97-aa46-8298dc1514f8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:44.084388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01b5d0f4-cdc7-4e97-aa46-8298dc1514f8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:44.085447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01b5d0f4-cdc7-4e97-aa46-8298dc1514f8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:44.086129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01b5d0f4-cdc7-4e97-aa46-8298dc1514f8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:44.151382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7d6dc8d2-4f96-428d-a631-520a3fe0c856 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:44.165494 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7d6dc8d2-4f96-428d-a631-520a3fe0c856 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1316 microversion: 2.1 time: 0.236681 Aug 29 15:29:44.166220 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 647/1290] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:43 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:44.175742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-01b5d0f4-cdc7-4e97-aa46-8298dc1514f8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:44.184753 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-01b5d0f4-cdc7-4e97-aa46-8298dc1514f8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1267 microversion: 2.1 time: 0.117633 Aug 29 15:29:44.185991 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 644/1291] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:44 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1267 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:44.623311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1133dd11-18d4-4b6f-82d0-f84f620d6256 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:44.623969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1133dd11-18d4-4b6f-82d0-f84f620d6256 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:44.632177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1133dd11-18d4-4b6f-82d0-f84f620d6256 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:44.632778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1133dd11-18d4-4b6f-82d0-f84f620d6256 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:44.633499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1133dd11-18d4-4b6f-82d0-f84f620d6256 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:44.634429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1133dd11-18d4-4b6f-82d0-f84f620d6256 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:44.635120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1133dd11-18d4-4b6f-82d0-f84f620d6256 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:44.635842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1133dd11-18d4-4b6f-82d0-f84f620d6256 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:44.927998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1133dd11-18d4-4b6f-82d0-f84f620d6256 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:44.936148 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1133dd11-18d4-4b6f-82d0-f84f620d6256 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1359 microversion: 2.1 time: 0.324459 Aug 29 15:29:44.950243 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 648/1292] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:44 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1359 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:45.188126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f7f2cd50-32e8-43f5-8fd9-fac53cc2c87f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:45.189645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f7f2cd50-32e8-43f5-8fd9-fac53cc2c87f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:45.206813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b77fd078-251c-40d6-a86f-d03dcd2cae6b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:45.207527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b77fd078-251c-40d6-a86f-d03dcd2cae6b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:45.212985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7f2cd50-32e8-43f5-8fd9-fac53cc2c87f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:45.214122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7f2cd50-32e8-43f5-8fd9-fac53cc2c87f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:45.216361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7f2cd50-32e8-43f5-8fd9-fac53cc2c87f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:45.217358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7f2cd50-32e8-43f5-8fd9-fac53cc2c87f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:45.218645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7f2cd50-32e8-43f5-8fd9-fac53cc2c87f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:45.220477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b77fd078-251c-40d6-a86f-d03dcd2cae6b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:45.221306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7f2cd50-32e8-43f5-8fd9-fac53cc2c87f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:45.223939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b77fd078-251c-40d6-a86f-d03dcd2cae6b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:45.224865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b77fd078-251c-40d6-a86f-d03dcd2cae6b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:45.225833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b77fd078-251c-40d6-a86f-d03dcd2cae6b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:45.238869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b77fd078-251c-40d6-a86f-d03dcd2cae6b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:45.240715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b77fd078-251c-40d6-a86f-d03dcd2cae6b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:45.451227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b77fd078-251c-40d6-a86f-d03dcd2cae6b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:45.461923 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b77fd078-251c-40d6-a86f-d03dcd2cae6b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1267 microversion: 2.1 time: 0.259599 Aug 29 15:29:45.462737 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 649/1293] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:45 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:45.779895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1922765270", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e44e12df-9c7e-4702-a8c8-c23880e767fa"}], "security_groups": [{"name": "tempest-securitygroup--1919849043"}], "key_name": "tempest-keypair-1523356171", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:45.810465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f7f2cd50-32e8-43f5-8fd9-fac53cc2c87f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:45.818264 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f7f2cd50-32e8-43f5-8fd9-fac53cc2c87f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1316 microversion: 2.1 time: 0.636239 Aug 29 15:29:45.818849 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 645/1294] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:45 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1316 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:45.927531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] validate_networks() for [('e44e12df-9c7e-4702-a8c8-c23880e767fa', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:29:45.957408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-02fda6c7-13c7-4db0-893d-00883172d889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:45.958029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-02fda6c7-13c7-4db0-893d-00883172d889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:45.972970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02fda6c7-13c7-4db0-893d-00883172d889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:45.973643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02fda6c7-13c7-4db0-893d-00883172d889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:45.973934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02fda6c7-13c7-4db0-893d-00883172d889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:45.974639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02fda6c7-13c7-4db0-893d-00883172d889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:45.975106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02fda6c7-13c7-4db0-893d-00883172d889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:45.975524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02fda6c7-13c7-4db0-893d-00883172d889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.399635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-02fda6c7-13c7-4db0-893d-00883172d889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:46.411669 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-02fda6c7-13c7-4db0-893d-00883172d889 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1359 microversion: 2.1 time: 0.458148 Aug 29 15:29:46.412528 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 646/1295] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:45 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1359 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:46.483423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8d2abaa4-cb53-41af-bbe1-17936c1da25d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:46.484394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8d2abaa4-cb53-41af-bbe1-17936c1da25d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:46.490786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d2abaa4-cb53-41af-bbe1-17936c1da25d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.491558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d2abaa4-cb53-41af-bbe1-17936c1da25d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.492210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d2abaa4-cb53-41af-bbe1-17936c1da25d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.493167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d2abaa4-cb53-41af-bbe1-17936c1da25d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.493823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d2abaa4-cb53-41af-bbe1-17936c1da25d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.494450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d2abaa4-cb53-41af-bbe1-17936c1da25d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.649572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Getting quotas for project 1a18044ba17142cf9c1cfeb4720e76db. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:29:46.658179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Getting quotas for user 7c6197c2073645fc91ae65d4d42c18ac and project 1a18044ba17142cf9c1cfeb4720e76db. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:29:46.672846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:29:46.673679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:29:46.674355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:29:46.675537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:29:46.676176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:29:46.691676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.691889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8d2abaa4-cb53-41af-bbe1-17936c1da25d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:46.692326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.692879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.693756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.694303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.694859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.700770 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8d2abaa4-cb53-41af-bbe1-17936c1da25d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1273 microversion: 2.1 time: 0.221228 Aug 29 15:29:46.715417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Getting quotas for project 1a18044ba17142cf9c1cfeb4720e76db. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:29:46.718328 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 647/1296] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:46 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:46.722175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Getting quotas for user 7c6197c2073645fc91ae65d4d42c18ac and project 1a18044ba17142cf9c1cfeb4720e76db. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:29:46.733344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-baf81e8f-0b78-4bed-8219-f768eef52cc3 req-2ad50e2b-0490-40d1-b8bd-e44f093d86fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a3c2ae-98a2-4e37-96ef-3e787faf0d11", "name": "network-vif-plugged", "status": "completed", "tag": "7a9162b3-e31e-4ebc-b3c4-b04ef19e4065"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:46.745618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:29:46.751636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:29:46.756442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-baf81e8f-0b78-4bed-8219-f768eef52cc3 req-2ad50e2b-0490-40d1-b8bd-e44f093d86fb service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.756934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-baf81e8f-0b78-4bed-8219-f768eef52cc3 req-2ad50e2b-0490-40d1-b8bd-e44f093d86fb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.757410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-baf81e8f-0b78-4bed-8219-f768eef52cc3 req-2ad50e2b-0490-40d1-b8bd-e44f093d86fb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.793036 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-baf81e8f-0b78-4bed-8219-f768eef52cc3 req-2ad50e2b-0490-40d1-b8bd-e44f093d86fb service nova] Creating event network-vif-plugged:7a9162b3-e31e-4ebc-b3c4-b04ef19e4065 for instance 51a3c2ae-98a2-4e37-96ef-3e787faf0d11 on n-h2-839401-11 Aug 29 15:29:46.807159 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-baf81e8f-0b78-4bed-8219-f768eef52cc3 req-2ad50e2b-0490-40d1-b8bd-e44f093d86fb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087428 Aug 29 15:29:46.808274 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 648/1297] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:46.840324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-621e7d7a-92e1-4fef-b164-1a660ee1ee30 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:46.841403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-621e7d7a-92e1-4fef-b164-1a660ee1ee30 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:46.857592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-621e7d7a-92e1-4fef-b164-1a660ee1ee30 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.858096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-621e7d7a-92e1-4fef-b164-1a660ee1ee30 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.858536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-621e7d7a-92e1-4fef-b164-1a660ee1ee30 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.859279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-621e7d7a-92e1-4fef-b164-1a660ee1ee30 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:46.859742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-621e7d7a-92e1-4fef-b164-1a660ee1ee30 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:46.860169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-621e7d7a-92e1-4fef-b164-1a660ee1ee30 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:46.911467 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f96f5a97-81af-4598-8849-c8aaa960e2fb tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.137161 Aug 29 15:29:46.918273 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 650/1298] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:29:45 2022] POST /compute/v2.1/servers => generated 407 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:29:46.923969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0c1b63e2-f7ab-4baf-bb38-88004dd0f7d4 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:46.924812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0c1b63e2-f7ab-4baf-bb38-88004dd0f7d4 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:47.017577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0c1b63e2-f7ab-4baf-bb38-88004dd0f7d4 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:47.024880 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0c1b63e2-f7ab-4baf-bb38-88004dd0f7d4 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1270 microversion: 2.1 time: 0.105177 Aug 29 15:29:47.026022 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 651/1299] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:46 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:47.433028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4dee3167-f2ff-41bb-a96f-d4bb4da96750 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:47.433841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4dee3167-f2ff-41bb-a96f-d4bb4da96750 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:47.442218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4dee3167-f2ff-41bb-a96f-d4bb4da96750 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:47.442909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4dee3167-f2ff-41bb-a96f-d4bb4da96750 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:47.445023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4dee3167-f2ff-41bb-a96f-d4bb4da96750 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:47.446072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4dee3167-f2ff-41bb-a96f-d4bb4da96750 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:47.447001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4dee3167-f2ff-41bb-a96f-d4bb4da96750 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:47.447700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4dee3167-f2ff-41bb-a96f-d4bb4da96750 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:47.555283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-621e7d7a-92e1-4fef-b164-1a660ee1ee30 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:47.563414 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-621e7d7a-92e1-4fef-b164-1a660ee1ee30 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1316 microversion: 2.1 time: 0.727617 Aug 29 15:29:47.577493 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 649/1300] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:46 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1316 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:47.620025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4dee3167-f2ff-41bb-a96f-d4bb4da96750 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:47.629948 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4dee3167-f2ff-41bb-a96f-d4bb4da96750 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1359 microversion: 2.1 time: 0.201239 Aug 29 15:29:47.630991 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 652/1301] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:47 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:47.729611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cb215b6a-d74d-4ede-9451-bd06e0ca61c6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:47.730696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cb215b6a-d74d-4ede-9451-bd06e0ca61c6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:47.743020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb215b6a-d74d-4ede-9451-bd06e0ca61c6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:47.743589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb215b6a-d74d-4ede-9451-bd06e0ca61c6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:47.744065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb215b6a-d74d-4ede-9451-bd06e0ca61c6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:47.744949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb215b6a-d74d-4ede-9451-bd06e0ca61c6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:47.745434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb215b6a-d74d-4ede-9451-bd06e0ca61c6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:47.746000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb215b6a-d74d-4ede-9451-bd06e0ca61c6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:47.879010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cb215b6a-d74d-4ede-9451-bd06e0ca61c6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:47.894960 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cb215b6a-d74d-4ede-9451-bd06e0ca61c6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1273 microversion: 2.1 time: 0.172189 Aug 29 15:29:47.896429 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 650/1302] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:47 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:48.055884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-932c9b32-503b-4fac-9327-a9fb7e42a46e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:48.058048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-932c9b32-503b-4fac-9327-a9fb7e42a46e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:48.072023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-932c9b32-503b-4fac-9327-a9fb7e42a46e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:48.076272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-932c9b32-503b-4fac-9327-a9fb7e42a46e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:48.077611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-932c9b32-503b-4fac-9327-a9fb7e42a46e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:48.080002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-932c9b32-503b-4fac-9327-a9fb7e42a46e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:48.080759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-932c9b32-503b-4fac-9327-a9fb7e42a46e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:48.081804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-932c9b32-503b-4fac-9327-a9fb7e42a46e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:48.187588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-932c9b32-503b-4fac-9327-a9fb7e42a46e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:48.214184 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-932c9b32-503b-4fac-9327-a9fb7e42a46e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1322 microversion: 2.1 time: 0.170804 Aug 29 15:29:48.219468 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 653/1303] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:48 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:48.588154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-83296c69-8d8a-4e5a-9a8d-2506e79e4701 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:48.589703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-83296c69-8d8a-4e5a-9a8d-2506e79e4701 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:48.603198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83296c69-8d8a-4e5a-9a8d-2506e79e4701 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:48.604683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83296c69-8d8a-4e5a-9a8d-2506e79e4701 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:48.605760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83296c69-8d8a-4e5a-9a8d-2506e79e4701 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:48.606951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83296c69-8d8a-4e5a-9a8d-2506e79e4701 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:48.608202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83296c69-8d8a-4e5a-9a8d-2506e79e4701 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:48.611720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83296c69-8d8a-4e5a-9a8d-2506e79e4701 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:48.648238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:48.659708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d3be3e7d-631e-44c0-bc7f-8e8b274cddb8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:48.660755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d3be3e7d-631e-44c0-bc7f-8e8b274cddb8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:48.665776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:48.685231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3be3e7d-631e-44c0-bc7f-8e8b274cddb8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:48.688089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3be3e7d-631e-44c0-bc7f-8e8b274cddb8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:48.690487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3be3e7d-631e-44c0-bc7f-8e8b274cddb8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:48.694714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3be3e7d-631e-44c0-bc7f-8e8b274cddb8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:48.696658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3be3e7d-631e-44c0-bc7f-8e8b274cddb8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:48.698616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3be3e7d-631e-44c0-bc7f-8e8b274cddb8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:48.999093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d3be3e7d-631e-44c0-bc7f-8e8b274cddb8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:49.007507 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d3be3e7d-631e-44c0-bc7f-8e8b274cddb8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1359 microversion: 2.1 time: 0.354199 Aug 29 15:29:49.008097 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 654/1304] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:48 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1359 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:49.015403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3d47c7bc-6e89-4aa4-9c1a-154553332326 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:49.016278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3d47c7bc-6e89-4aa4-9c1a-154553332326 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:49.022652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d47c7bc-6e89-4aa4-9c1a-154553332326 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:49.023458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d47c7bc-6e89-4aa4-9c1a-154553332326 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:49.024138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d47c7bc-6e89-4aa4-9c1a-154553332326 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:49.025062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d47c7bc-6e89-4aa4-9c1a-154553332326 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:49.025761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d47c7bc-6e89-4aa4-9c1a-154553332326 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:49.026401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d47c7bc-6e89-4aa4-9c1a-154553332326 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:49.157063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-83296c69-8d8a-4e5a-9a8d-2506e79e4701 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:49.169074 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-83296c69-8d8a-4e5a-9a8d-2506e79e4701 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1316 microversion: 2.1 time: 0.587694 Aug 29 15:29:49.188973 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 651/1305] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:48 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1316 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:49.263914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3d47c7bc-6e89-4aa4-9c1a-154553332326 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:49.266585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8f257726-1e3e-4699-a6ee-b7a8b296f1da tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:49.269737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8f257726-1e3e-4699-a6ee-b7a8b296f1da tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:49.272815 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3d47c7bc-6e89-4aa4-9c1a-154553332326 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1315 microversion: 2.1 time: 0.263258 Aug 29 15:29:49.276224 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 655/1306] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:49 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:49.279243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:49.296185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f257726-1e3e-4699-a6ee-b7a8b296f1da tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:49.296765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f257726-1e3e-4699-a6ee-b7a8b296f1da tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:49.297511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f257726-1e3e-4699-a6ee-b7a8b296f1da tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:49.298233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f257726-1e3e-4699-a6ee-b7a8b296f1da tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:49.298731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f257726-1e3e-4699-a6ee-b7a8b296f1da tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:49.299161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f257726-1e3e-4699-a6ee-b7a8b296f1da tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:49.456260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8f257726-1e3e-4699-a6ee-b7a8b296f1da tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:49.466886 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8f257726-1e3e-4699-a6ee-b7a8b296f1da tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1328 microversion: 2.1 time: 0.229447 Aug 29 15:29:49.468477 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 652/1307] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:49 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1328 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:50.028144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e3864b85-b863-439d-b56c-1686b0ca05a8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:50.030085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e3864b85-b863-439d-b56c-1686b0ca05a8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:50.038074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3864b85-b863-439d-b56c-1686b0ca05a8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.038729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3864b85-b863-439d-b56c-1686b0ca05a8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.039417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3864b85-b863-439d-b56c-1686b0ca05a8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.040387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3864b85-b863-439d-b56c-1686b0ca05a8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.041068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3864b85-b863-439d-b56c-1686b0ca05a8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.041921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3864b85-b863-439d-b56c-1686b0ca05a8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.194431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-91704844-24f5-4683-8649-f38fefa6dd7f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:50.195943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-91704844-24f5-4683-8649-f38fefa6dd7f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:50.203400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91704844-24f5-4683-8649-f38fefa6dd7f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.204249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91704844-24f5-4683-8649-f38fefa6dd7f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.204972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91704844-24f5-4683-8649-f38fefa6dd7f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.205987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91704844-24f5-4683-8649-f38fefa6dd7f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.206663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91704844-24f5-4683-8649-f38fefa6dd7f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.207705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91704844-24f5-4683-8649-f38fefa6dd7f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.371698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e3864b85-b863-439d-b56c-1686b0ca05a8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:50.381540 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e3864b85-b863-439d-b56c-1686b0ca05a8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1542 microversion: 2.1 time: 0.357168 Aug 29 15:29:50.382811 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 656/1308] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:50 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1542 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:50.396537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a9aa36f7-9bcc-4d3f-882e-c7084ba1ee3a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:50.398314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a9aa36f7-9bcc-4d3f-882e-c7084ba1ee3a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:50.408458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9aa36f7-9bcc-4d3f-882e-c7084ba1ee3a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.409875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9aa36f7-9bcc-4d3f-882e-c7084ba1ee3a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.410553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9aa36f7-9bcc-4d3f-882e-c7084ba1ee3a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.411592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9aa36f7-9bcc-4d3f-882e-c7084ba1ee3a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.412308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9aa36f7-9bcc-4d3f-882e-c7084ba1ee3a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.413152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9aa36f7-9bcc-4d3f-882e-c7084ba1ee3a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.435360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:50.629146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a9aa36f7-9bcc-4d3f-882e-c7084ba1ee3a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:50.648190 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a9aa36f7-9bcc-4d3f-882e-c7084ba1ee3a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1315 microversion: 2.1 time: 0.263881 Aug 29 15:29:50.661641 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 657/1309] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:50 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:50.667330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-d4d49f2f-57d2-464d-b0c3-d2dac948b163 req-8346d35a-9e21-4236-97b0-8218ef333eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68e77b01-ee59-43f4-8ed6-9bc6606d9db1", "tag": "c93b7b7a-173b-4010-8d8f-2de7666f52d1"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:50.677645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d4d49f2f-57d2-464d-b0c3-d2dac948b163 req-8346d35a-9e21-4236-97b0-8218ef333eb2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.678326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d4d49f2f-57d2-464d-b0c3-d2dac948b163 req-8346d35a-9e21-4236-97b0-8218ef333eb2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.678966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d4d49f2f-57d2-464d-b0c3-d2dac948b163 req-8346d35a-9e21-4236-97b0-8218ef333eb2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.691128 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-d4d49f2f-57d2-464d-b0c3-d2dac948b163 req-8346d35a-9e21-4236-97b0-8218ef333eb2 service nova] Creating event network-changed:c93b7b7a-173b-4010-8d8f-2de7666f52d1 for instance 68e77b01-ee59-43f4-8ed6-9bc6606d9db1 on n-h2-839401-11 Aug 29 15:29:50.697130 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-d4d49f2f-57d2-464d-b0c3-d2dac948b163 req-8346d35a-9e21-4236-97b0-8218ef333eb2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033877 Aug 29 15:29:50.698516 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 658/1310] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:50.705706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ee45f2bf-5b55-4a5f-8f06-37b2a0aaa560 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:50.706592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ee45f2bf-5b55-4a5f-8f06-37b2a0aaa560 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:50.714244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee45f2bf-5b55-4a5f-8f06-37b2a0aaa560 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.715159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee45f2bf-5b55-4a5f-8f06-37b2a0aaa560 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.716067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee45f2bf-5b55-4a5f-8f06-37b2a0aaa560 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.717002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee45f2bf-5b55-4a5f-8f06-37b2a0aaa560 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.717781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee45f2bf-5b55-4a5f-8f06-37b2a0aaa560 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.719150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee45f2bf-5b55-4a5f-8f06-37b2a0aaa560 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.770229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-91704844-24f5-4683-8649-f38fefa6dd7f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:50.795210 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-91704844-24f5-4683-8649-f38fefa6dd7f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1316 microversion: 2.1 time: 0.602943 Aug 29 15:29:50.796302 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 653/1311] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:50 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1316 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:50.815431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fb65d0f7-6b23-4b63-9f0a-13734c34e4d4 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:50.816055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fb65d0f7-6b23-4b63-9f0a-13734c34e4d4 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:50.831251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb65d0f7-6b23-4b63-9f0a-13734c34e4d4 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.831746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb65d0f7-6b23-4b63-9f0a-13734c34e4d4 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.832220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb65d0f7-6b23-4b63-9f0a-13734c34e4d4 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.834693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb65d0f7-6b23-4b63-9f0a-13734c34e4d4 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:50.835380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb65d0f7-6b23-4b63-9f0a-13734c34e4d4 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:50.836002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb65d0f7-6b23-4b63-9f0a-13734c34e4d4 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:50.917709 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ee45f2bf-5b55-4a5f-8f06-37b2a0aaa560 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.215323 Aug 29 15:29:50.918810 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 659/1312] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:29:50 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:51.181490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e8842e45-ff59-4b5e-b941-850ecd023412 req-20e7f0b3-30c6-48ba-bfd1-29735c5d0d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "312f21b0-5005-4a49-891e-6a09bb993fc6", "tag": "6bbe9b1d-ce94-404d-a6ef-83f0a17cf5f3"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:51.193386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e8842e45-ff59-4b5e-b941-850ecd023412 req-20e7f0b3-30c6-48ba-bfd1-29735c5d0d19 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:51.193789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e8842e45-ff59-4b5e-b941-850ecd023412 req-20e7f0b3-30c6-48ba-bfd1-29735c5d0d19 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:51.194209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e8842e45-ff59-4b5e-b941-850ecd023412 req-20e7f0b3-30c6-48ba-bfd1-29735c5d0d19 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:51.211218 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e8842e45-ff59-4b5e-b941-850ecd023412 req-20e7f0b3-30c6-48ba-bfd1-29735c5d0d19 service nova] Creating event network-changed:6bbe9b1d-ce94-404d-a6ef-83f0a17cf5f3 for instance 312f21b0-5005-4a49-891e-6a09bb993fc6 on n-h1-839401-11 Aug 29 15:29:51.219779 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e8842e45-ff59-4b5e-b941-850ecd023412 req-20e7f0b3-30c6-48ba-bfd1-29735c5d0d19 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041855 Aug 29 15:29:51.220594 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 660/1313] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:29:51.243309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fb65d0f7-6b23-4b63-9f0a-13734c34e4d4 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:51.254120 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fb65d0f7-6b23-4b63-9f0a-13734c34e4d4 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1396 microversion: 2.1 time: 0.450646 Aug 29 15:29:51.254870 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 654/1314] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:50 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1396 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:51.675505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-45473834-9231-4d77-bdf1-db390be918d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:51.676831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-45473834-9231-4d77-bdf1-db390be918d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:51.686329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45473834-9231-4d77-bdf1-db390be918d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:51.687018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45473834-9231-4d77-bdf1-db390be918d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:51.687618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45473834-9231-4d77-bdf1-db390be918d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:51.688508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45473834-9231-4d77-bdf1-db390be918d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:51.689746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45473834-9231-4d77-bdf1-db390be918d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:51.690329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45473834-9231-4d77-bdf1-db390be918d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:51.823321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1c62bd85-9fb5-4008-b842-b465c11cc662 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:51.824058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1c62bd85-9fb5-4008-b842-b465c11cc662 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:51.834300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c62bd85-9fb5-4008-b842-b465c11cc662 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:51.835425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c62bd85-9fb5-4008-b842-b465c11cc662 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:51.836291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c62bd85-9fb5-4008-b842-b465c11cc662 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:51.837135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c62bd85-9fb5-4008-b842-b465c11cc662 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:51.838038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c62bd85-9fb5-4008-b842-b465c11cc662 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:51.838790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c62bd85-9fb5-4008-b842-b465c11cc662 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:52.009478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-45473834-9231-4d77-bdf1-db390be918d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:52.018867 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-45473834-9231-4d77-bdf1-db390be918d1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1315 microversion: 2.1 time: 0.348383 Aug 29 15:29:52.019697 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 661/1315] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:51 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:52.048553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1c62bd85-9fb5-4008-b842-b465c11cc662 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:52.059698 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1c62bd85-9fb5-4008-b842-b465c11cc662 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1316 microversion: 2.1 time: 0.246406 Aug 29 15:29:52.060689 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 655/1316] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:51 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:52.275300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e8c3d5b6-8acb-4e42-bf83-251e02cc67e2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:52.276287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e8c3d5b6-8acb-4e42-bf83-251e02cc67e2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:52.296283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8c3d5b6-8acb-4e42-bf83-251e02cc67e2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:52.296917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8c3d5b6-8acb-4e42-bf83-251e02cc67e2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:52.297402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8c3d5b6-8acb-4e42-bf83-251e02cc67e2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:52.304085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8c3d5b6-8acb-4e42-bf83-251e02cc67e2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:52.304743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8c3d5b6-8acb-4e42-bf83-251e02cc67e2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:52.305235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8c3d5b6-8acb-4e42-bf83-251e02cc67e2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:52.640907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e8c3d5b6-8acb-4e42-bf83-251e02cc67e2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:52.658030 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e8c3d5b6-8acb-4e42-bf83-251e02cc67e2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1396 microversion: 2.1 time: 0.386610 Aug 29 15:29:52.663845 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 662/1317] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:52 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1396 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:53.039822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8e35c818-0cee-4d09-9212-9f0dae9144b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:53.040440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8e35c818-0cee-4d09-9212-9f0dae9144b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:53.047052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e35c818-0cee-4d09-9212-9f0dae9144b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:53.047819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e35c818-0cee-4d09-9212-9f0dae9144b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:53.048463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e35c818-0cee-4d09-9212-9f0dae9144b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:53.049358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e35c818-0cee-4d09-9212-9f0dae9144b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:53.049975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e35c818-0cee-4d09-9212-9f0dae9144b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:53.050561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e35c818-0cee-4d09-9212-9f0dae9144b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:53.082823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1fee2a43-0ab5-4425-bdb1-558a0ae88fa3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:53.084024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1fee2a43-0ab5-4425-bdb1-558a0ae88fa3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:53.104243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fee2a43-0ab5-4425-bdb1-558a0ae88fa3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:53.105863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fee2a43-0ab5-4425-bdb1-558a0ae88fa3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:53.106516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fee2a43-0ab5-4425-bdb1-558a0ae88fa3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:53.107793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fee2a43-0ab5-4425-bdb1-558a0ae88fa3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:53.108412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fee2a43-0ab5-4425-bdb1-558a0ae88fa3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:53.109000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fee2a43-0ab5-4425-bdb1-558a0ae88fa3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:53.295446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1fee2a43-0ab5-4425-bdb1-558a0ae88fa3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:53.305704 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1fee2a43-0ab5-4425-bdb1-558a0ae88fa3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1316 microversion: 2.1 time: 0.226949 Aug 29 15:29:53.306642 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 663/1318] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:53 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1316 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:53.322130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-cc7349dd-9d6f-4451-a0f6-95f77eaa5a3c req-a79be406-c2fc-4fc5-9dd6-e7575a7ee9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a3c2ae-98a2-4e37-96ef-3e787faf0d11", "tag": "7a9162b3-e31e-4ebc-b3c4-b04ef19e4065"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:53.347295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cc7349dd-9d6f-4451-a0f6-95f77eaa5a3c req-a79be406-c2fc-4fc5-9dd6-e7575a7ee9b2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:53.348347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cc7349dd-9d6f-4451-a0f6-95f77eaa5a3c req-a79be406-c2fc-4fc5-9dd6-e7575a7ee9b2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:53.349139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cc7349dd-9d6f-4451-a0f6-95f77eaa5a3c req-a79be406-c2fc-4fc5-9dd6-e7575a7ee9b2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:53.369628 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-cc7349dd-9d6f-4451-a0f6-95f77eaa5a3c req-a79be406-c2fc-4fc5-9dd6-e7575a7ee9b2 service nova] Creating event network-changed:7a9162b3-e31e-4ebc-b3c4-b04ef19e4065 for instance 51a3c2ae-98a2-4e37-96ef-3e787faf0d11 on n-h2-839401-11 Aug 29 15:29:53.380430 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-cc7349dd-9d6f-4451-a0f6-95f77eaa5a3c req-a79be406-c2fc-4fc5-9dd6-e7575a7ee9b2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072211 Aug 29 15:29:53.381273 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 664/1319] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:53.400356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8e35c818-0cee-4d09-9212-9f0dae9144b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:53.418679 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8e35c818-0cee-4d09-9212-9f0dae9144b9 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1315 microversion: 2.1 time: 0.382580 Aug 29 15:29:53.419603 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 656/1320] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:53 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:53.454927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-fb03678f-f9d1-475d-9c37-4713e21dac88 req-b9f1f189-92a9-40e6-b398-61148021a9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ca5680-b383-4baa-870c-eb239ad4947a", "name": "network-vif-plugged", "status": "completed", "tag": "3c9370c4-4b98-4fb2-9f3b-4b45269eb266"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:53.473667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fb03678f-f9d1-475d-9c37-4713e21dac88 req-b9f1f189-92a9-40e6-b398-61148021a9e0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:53.476187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fb03678f-f9d1-475d-9c37-4713e21dac88 req-b9f1f189-92a9-40e6-b398-61148021a9e0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:53.476842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fb03678f-f9d1-475d-9c37-4713e21dac88 req-b9f1f189-92a9-40e6-b398-61148021a9e0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:53.497709 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-fb03678f-f9d1-475d-9c37-4713e21dac88 req-b9f1f189-92a9-40e6-b398-61148021a9e0 service nova] Creating event network-vif-plugged:3c9370c4-4b98-4fb2-9f3b-4b45269eb266 for instance a1ca5680-b383-4baa-870c-eb239ad4947a on n-h2-839401-11 Aug 29 15:29:53.507293 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-fb03678f-f9d1-475d-9c37-4713e21dac88 req-b9f1f189-92a9-40e6-b398-61148021a9e0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056555 Aug 29 15:29:53.508483 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 665/1321] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:53.686520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1035c187-d53c-4fd3-92db-b89bf2ca7fc8 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:53.687797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1035c187-d53c-4fd3-92db-b89bf2ca7fc8 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:53.698225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1035c187-d53c-4fd3-92db-b89bf2ca7fc8 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:53.699803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1035c187-d53c-4fd3-92db-b89bf2ca7fc8 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:53.700301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1035c187-d53c-4fd3-92db-b89bf2ca7fc8 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:53.702053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1035c187-d53c-4fd3-92db-b89bf2ca7fc8 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:53.702708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1035c187-d53c-4fd3-92db-b89bf2ca7fc8 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:53.703301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1035c187-d53c-4fd3-92db-b89bf2ca7fc8 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:53.833641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:53.983567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1035c187-d53c-4fd3-92db-b89bf2ca7fc8 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:53.993967 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1035c187-d53c-4fd3-92db-b89bf2ca7fc8 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1396 microversion: 2.1 time: 0.313802 Aug 29 15:29:53.995070 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 657/1322] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:53 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1396 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:54.339939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ee4cc419-c877-41b2-8cc5-d0b646386ff0 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:54.340779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ee4cc419-c877-41b2-8cc5-d0b646386ff0 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:54.354379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4cc419-c877-41b2-8cc5-d0b646386ff0 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:54.355579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4cc419-c877-41b2-8cc5-d0b646386ff0 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:54.356209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4cc419-c877-41b2-8cc5-d0b646386ff0 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:54.367637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4cc419-c877-41b2-8cc5-d0b646386ff0 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:54.368838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4cc419-c877-41b2-8cc5-d0b646386ff0 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:54.369514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4cc419-c877-41b2-8cc5-d0b646386ff0 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:54.441558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6d8c4c19-7a87-468f-9fc6-2015d2299eec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:54.442371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6d8c4c19-7a87-468f-9fc6-2015d2299eec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:54.451934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d8c4c19-7a87-468f-9fc6-2015d2299eec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:54.452429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d8c4c19-7a87-468f-9fc6-2015d2299eec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:54.457522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d8c4c19-7a87-468f-9fc6-2015d2299eec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:54.458331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d8c4c19-7a87-468f-9fc6-2015d2299eec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:54.458817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d8c4c19-7a87-468f-9fc6-2015d2299eec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:54.459254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d8c4c19-7a87-468f-9fc6-2015d2299eec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:54.569691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ee4cc419-c877-41b2-8cc5-d0b646386ff0 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:54.578773 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ee4cc419-c877-41b2-8cc5-d0b646386ff0 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1316 microversion: 2.1 time: 0.251516 Aug 29 15:29:54.580116 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 666/1323] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:54 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:54.753806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2014978559", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "09630ca2-45d5-438d-9a4e-d0e239ea63e6"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:54.826004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] validate_networks() for [('09630ca2-45d5-438d-9a4e-d0e239ea63e6', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:29:54.936563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6d8c4c19-7a87-468f-9fc6-2015d2299eec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:54.968537 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6d8c4c19-7a87-468f-9fc6-2015d2299eec tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1315 microversion: 2.1 time: 0.530691 Aug 29 15:29:54.977263 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 658/1324] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:54 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:55.022118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a9391c90-3225-4256-b18d-16fa933f0162 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:55.022724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a9391c90-3225-4256-b18d-16fa933f0162 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:55.029691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9391c90-3225-4256-b18d-16fa933f0162 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:55.030196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9391c90-3225-4256-b18d-16fa933f0162 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:55.030802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9391c90-3225-4256-b18d-16fa933f0162 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:55.031513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9391c90-3225-4256-b18d-16fa933f0162 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:55.032139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9391c90-3225-4256-b18d-16fa933f0162 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:55.032564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9391c90-3225-4256-b18d-16fa933f0162 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:55.185311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a9391c90-3225-4256-b18d-16fa933f0162 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:55.194801 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a9391c90-3225-4256-b18d-16fa933f0162 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1396 microversion: 2.1 time: 0.176147 Aug 29 15:29:55.201772 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 659/1325] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:55 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1396 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:55.304665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:29:55.305182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:29:55.305659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:29:55.306089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:29:55.306679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:29:55.316053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:55.316786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:55.317266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:55.317993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:55.318445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:55.318871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:55.336572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Getting quotas for project 0de1e6e8040d4d5f9ff87142c3c436bb. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:29:55.342776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Getting quotas for user 9e11d7d908bf432d80589193031172c2 and project 0de1e6e8040d4d5f9ff87142c3c436bb. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:29:55.357473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:29:55.362732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:29:55.415272 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ad127c3f-e7ae-4e9c-ab62-01bbb78fa1d3 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.833812 Aug 29 15:29:55.416092 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 667/1326] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:29:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:29:55.426857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea7df997-4559-44c1-91fa-41e3c7430e24 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:55.427470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ea7df997-4559-44c1-91fa-41e3c7430e24 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:55.587923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ea7df997-4559-44c1-91fa-41e3c7430e24 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:55.598059 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ea7df997-4559-44c1-91fa-41e3c7430e24 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1224 microversion: 2.1 time: 0.175002 Aug 29 15:29:55.607776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ab1ea407-c543-40a2-83cf-47fb121d730d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:55.607776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ab1ea407-c543-40a2-83cf-47fb121d730d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:55.609507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab1ea407-c543-40a2-83cf-47fb121d730d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:55.610211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab1ea407-c543-40a2-83cf-47fb121d730d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:55.610874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab1ea407-c543-40a2-83cf-47fb121d730d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:55.611757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab1ea407-c543-40a2-83cf-47fb121d730d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:55.612368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab1ea407-c543-40a2-83cf-47fb121d730d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:55.612973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab1ea407-c543-40a2-83cf-47fb121d730d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:55.614589 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 660/1327] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:55 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1224 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:55.884504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ab1ea407-c543-40a2-83cf-47fb121d730d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:55.906924 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ab1ea407-c543-40a2-83cf-47fb121d730d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1316 microversion: 2.1 time: 0.310371 Aug 29 15:29:55.908378 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 668/1328] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:55 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:55.992591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4cb50181-af26-49f0-8ba8-ed73aa4ca130 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:55.993797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4cb50181-af26-49f0-8ba8-ed73aa4ca130 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:56.000887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cb50181-af26-49f0-8ba8-ed73aa4ca130 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:56.001430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cb50181-af26-49f0-8ba8-ed73aa4ca130 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:56.001899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cb50181-af26-49f0-8ba8-ed73aa4ca130 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:56.002656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cb50181-af26-49f0-8ba8-ed73aa4ca130 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:56.003147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cb50181-af26-49f0-8ba8-ed73aa4ca130 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:56.003722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cb50181-af26-49f0-8ba8-ed73aa4ca130 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:56.217137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bc2b8501-c244-4bde-9843-41fc5a9d9ce3 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:56.217137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bc2b8501-c244-4bde-9843-41fc5a9d9ce3 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:56.235039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc2b8501-c244-4bde-9843-41fc5a9d9ce3 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:56.238250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc2b8501-c244-4bde-9843-41fc5a9d9ce3 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:56.238894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc2b8501-c244-4bde-9843-41fc5a9d9ce3 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:56.239803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc2b8501-c244-4bde-9843-41fc5a9d9ce3 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:56.241251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc2b8501-c244-4bde-9843-41fc5a9d9ce3 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:56.249771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc2b8501-c244-4bde-9843-41fc5a9d9ce3 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:56.401363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4cb50181-af26-49f0-8ba8-ed73aa4ca130 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:56.414972 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4cb50181-af26-49f0-8ba8-ed73aa4ca130 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1315 microversion: 2.1 time: 0.428241 Aug 29 15:29:56.417934 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 661/1329] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:55 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:56.514913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bc2b8501-c244-4bde-9843-41fc5a9d9ce3 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:56.523595 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bc2b8501-c244-4bde-9843-41fc5a9d9ce3 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1396 microversion: 2.1 time: 0.311463 Aug 29 15:29:56.524727 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 669/1330] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:56 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1396 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:56.620112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bf06ed8b-adf2-49c7-b060-2d08db3d5f68 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:56.620721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bf06ed8b-adf2-49c7-b060-2d08db3d5f68 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:56.627088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf06ed8b-adf2-49c7-b060-2d08db3d5f68 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:56.627574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf06ed8b-adf2-49c7-b060-2d08db3d5f68 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:56.628009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf06ed8b-adf2-49c7-b060-2d08db3d5f68 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:56.628714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf06ed8b-adf2-49c7-b060-2d08db3d5f68 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:56.629221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf06ed8b-adf2-49c7-b060-2d08db3d5f68 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:56.629646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf06ed8b-adf2-49c7-b060-2d08db3d5f68 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:56.712053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bf06ed8b-adf2-49c7-b060-2d08db3d5f68 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:56.721740 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bf06ed8b-adf2-49c7-b060-2d08db3d5f68 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1276 microversion: 2.1 time: 0.105394 Aug 29 15:29:56.722330 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 662/1331] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:56 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1276 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:56.928454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d3373a05-c48b-4e30-96b5-8f465c29dc8f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:56.928975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d3373a05-c48b-4e30-96b5-8f465c29dc8f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:56.935439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3373a05-c48b-4e30-96b5-8f465c29dc8f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:56.935915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3373a05-c48b-4e30-96b5-8f465c29dc8f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:56.936343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3373a05-c48b-4e30-96b5-8f465c29dc8f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:56.937030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3373a05-c48b-4e30-96b5-8f465c29dc8f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:56.937525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3373a05-c48b-4e30-96b5-8f465c29dc8f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:56.937943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3373a05-c48b-4e30-96b5-8f465c29dc8f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:57.080268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d3373a05-c48b-4e30-96b5-8f465c29dc8f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:57.088495 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d3373a05-c48b-4e30-96b5-8f465c29dc8f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1502 microversion: 2.1 time: 0.164130 Aug 29 15:29:57.089058 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 670/1332] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:56 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:57.109330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1f116091-acd9-4f02-8e59-43e6689923d3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-369648798"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:57.109872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1f116091-acd9-4f02-8e59-43e6689923d3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:57.116976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f116091-acd9-4f02-8e59-43e6689923d3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:57.117544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f116091-acd9-4f02-8e59-43e6689923d3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:57.118212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f116091-acd9-4f02-8e59-43e6689923d3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:57.130161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f116091-acd9-4f02-8e59-43e6689923d3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:57.130675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f116091-acd9-4f02-8e59-43e6689923d3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:57.131125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f116091-acd9-4f02-8e59-43e6689923d3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:57.289279 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.network.security_group_api [None req-1f116091-acd9-4f02-8e59-43e6689923d3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Adding security group 499ede52-296f-47d4-9588-096560e4d973 to port 3c9370c4-4b98-4fb2-9f3b-4b45269eb266 Aug 29 15:29:57.440155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-60b38b83-00dc-4a1c-84e5-2b643d82dc08 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:57.441196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-60b38b83-00dc-4a1c-84e5-2b643d82dc08 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:57.452732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60b38b83-00dc-4a1c-84e5-2b643d82dc08 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:57.453742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60b38b83-00dc-4a1c-84e5-2b643d82dc08 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:57.454431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60b38b83-00dc-4a1c-84e5-2b643d82dc08 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:57.455720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60b38b83-00dc-4a1c-84e5-2b643d82dc08 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:57.456418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60b38b83-00dc-4a1c-84e5-2b643d82dc08 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:57.457944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60b38b83-00dc-4a1c-84e5-2b643d82dc08 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:57.706933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-60b38b83-00dc-4a1c-84e5-2b643d82dc08 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:57.709012 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1f116091-acd9-4f02-8e59-43e6689923d3 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "POST /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a/action" status: 202 len: 0 microversion: 2.1 time: 0.603746 Aug 29 15:29:57.710243 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 663/1333] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:29:57 2022] POST /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:29:57.720971 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-60b38b83-00dc-4a1c-84e5-2b643d82dc08 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1315 microversion: 2.1 time: 0.285297 Aug 29 15:29:57.721704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-85f56ef8-def0-4611-acc8-48472ce41010 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:57.722321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-85f56ef8-def0-4611-acc8-48472ce41010 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:57.723088 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 671/1334] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:57 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:57.731190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-65c3ecb3-b87e-4d67-bdb6-7fd9b64e1787 req-e4d4916d-10bd-430c-afe4-9a77c48ee9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e77b01-ee59-43f4-8ed6-9bc6606d9db1", "name": "network-vif-plugged", "status": "completed", "tag": "c93b7b7a-173b-4010-8d8f-2de7666f52d1"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:57.746593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85f56ef8-def0-4611-acc8-48472ce41010 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:57.747108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-65c3ecb3-b87e-4d67-bdb6-7fd9b64e1787 req-e4d4916d-10bd-430c-afe4-9a77c48ee9ed service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:57.747542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85f56ef8-def0-4611-acc8-48472ce41010 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:57.748141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85f56ef8-def0-4611-acc8-48472ce41010 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:57.748476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-65c3ecb3-b87e-4d67-bdb6-7fd9b64e1787 req-e4d4916d-10bd-430c-afe4-9a77c48ee9ed service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:57.748983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-65c3ecb3-b87e-4d67-bdb6-7fd9b64e1787 req-e4d4916d-10bd-430c-afe4-9a77c48ee9ed service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:57.749410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85f56ef8-def0-4611-acc8-48472ce41010 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:57.750037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85f56ef8-def0-4611-acc8-48472ce41010 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:57.750616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85f56ef8-def0-4611-acc8-48472ce41010 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:57.770651 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-65c3ecb3-b87e-4d67-bdb6-7fd9b64e1787 req-e4d4916d-10bd-430c-afe4-9a77c48ee9ed service nova] Creating event network-vif-plugged:c93b7b7a-173b-4010-8d8f-2de7666f52d1 for instance 68e77b01-ee59-43f4-8ed6-9bc6606d9db1 on n-h2-839401-11 Aug 29 15:29:57.779884 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-65c3ecb3-b87e-4d67-bdb6-7fd9b64e1787 req-e4d4916d-10bd-430c-afe4-9a77c48ee9ed service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052574 Aug 29 15:29:57.781026 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 672/1335] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:57.786996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-faf2c79f-194a-499c-b0b3-af1f71067291 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42b7a6940>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:57.983377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-85f56ef8-def0-4611-acc8-48472ce41010 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:57.999792 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-85f56ef8-def0-4611-acc8-48472ce41010 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1396 microversion: 2.1 time: 0.285681 Aug 29 15:29:58.000554 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 664/1336] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:57 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1396 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:58.013715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG neutronclient.v2_0.client [None req-faf2c79f-194a-499c-b0b3-af1f71067291 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 499ede52-296f-47d4-9588-096560e4d973 in use.", "detail": ""}} {{(pid=122360) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:29:58.014416 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-faf2c79f-194a-499c-b0b3-af1f71067291 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] HTTP exception thrown: Security Group 499ede52-296f-47d4-9588-096560e4d973 in use. Aug 29 15:29:58.014416 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-ef299de4-a509-4d89-8107-d9412e0b1221'] Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-faf2c79f-194a-499c-b0b3-af1f71067291 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Request method failure captured: Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/os-security-groups/499ede52-296f-47d4-9588-096560e4d973 HTTP/1.1 Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNs2hOo7JBpZiQzvnNgHrIm1J9RGZ5UC6DpjgyVQYeerhSnofzxX7RAKfvmzU9UJlAY5oOh27yY87PJp21A-ORXMZr-RsqgruzLi4v_3gHlsQS4FiqFdaSIS_JF0QEF93l7efzdx0gUJW4VXji92y_AvcDUPtCPmksBIQOtHDvXg1bU Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:29:58.016656 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:29:58.018375 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7939dc6e747744dab4a60e547c6d9191", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}] Aug 29 15:29:58.018375 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:29:58.018375 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:29:58.018375 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:29:58.018375 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:29:58.018375 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:29:58.018375 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:29:58.018375 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 26faf4e7544842ad9dc66370ccba54fc Aug 29 15:29:58.018375 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:29:58.018375 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:29:58.018375 n-d-839401-11 devstack@n-api.service[122360]: exception: Security Group 499ede52-296f-47d4-9588-096560e4d973 in use. Aug 29 15:29:58.018375 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-ef299de4-a509-4d89-8107-d9412e0b1221'] Aug 29 15:29:58.018375 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '499ede52-296f-47d4-9588-096560e4d973'} Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:58.019530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 499ede52-296f-47d4-9588-096560e4d973 in use. Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef299de4-a509-4d89-8107-d9412e0b1221'] Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 499ede52-296f-47d4-9588-096560e4d973 in use. Aug 29 15:29:58.021007 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef299de4-a509-4d89-8107-d9412e0b1221'] Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 499ede52-296f-47d4-9588-096560e4d973 in use. Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef299de4-a509-4d89-8107-d9412e0b1221'] Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:58.022715 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:58.024314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:58.024314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:58.024314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:58.024314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 499ede52-296f-47d4-9588-096560e4d973 in use. Aug 29 15:29:58.024314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef299de4-a509-4d89-8107-d9412e0b1221'] Aug 29 15:29:58.024314 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:29:58.027830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-2b5ba6d4-3b61-42da-bb8f-12cc4b6a18af req-d6037af1-ef86-4756-92d6-d2157e040f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ca5680-b383-4baa-870c-eb239ad4947a", "tag": "3c9370c4-4b98-4fb2-9f3b-4b45269eb266"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:58.027999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-faf2c79f-194a-499c-b0b3-af1f71067291 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Returning 400 to user: Security Group 499ede52-296f-47d4-9588-096560e4d973 in use. Aug 29 15:29:58.027999 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-ef299de4-a509-4d89-8107-d9412e0b1221'] {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:58.027999 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-faf2c79f-194a-499c-b0b3-af1f71067291 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/499ede52-296f-47d4-9588-096560e4d973" status: 400 len: 185 microversion: 2.1 time: 0.243890 Aug 29 15:29:58.027999 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 673/1337] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:29:57 2022] DELETE /compute/v2.1/os-security-groups/499ede52-296f-47d4-9588-096560e4d973 => generated 185 bytes in 245 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:29:58.034085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4b50fc26-c762-4169-a127-af7c788125ef tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:58.038028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4b50fc26-c762-4169-a127-af7c788125ef tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:58.051856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b50fc26-c762-4169-a127-af7c788125ef tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:58.054454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b50fc26-c762-4169-a127-af7c788125ef tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:58.057005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b50fc26-c762-4169-a127-af7c788125ef tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:58.057970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b50fc26-c762-4169-a127-af7c788125ef tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:58.058604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b50fc26-c762-4169-a127-af7c788125ef tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:58.059978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2b5ba6d4-3b61-42da-bb8f-12cc4b6a18af req-d6037af1-ef86-4756-92d6-d2157e040f16 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:58.060468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2b5ba6d4-3b61-42da-bb8f-12cc4b6a18af req-d6037af1-ef86-4756-92d6-d2157e040f16 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:58.060824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b50fc26-c762-4169-a127-af7c788125ef tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:58.062733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2b5ba6d4-3b61-42da-bb8f-12cc4b6a18af req-d6037af1-ef86-4756-92d6-d2157e040f16 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:58.088841 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-2b5ba6d4-3b61-42da-bb8f-12cc4b6a18af req-d6037af1-ef86-4756-92d6-d2157e040f16 service nova] Creating event network-changed:3c9370c4-4b98-4fb2-9f3b-4b45269eb266 for instance a1ca5680-b383-4baa-870c-eb239ad4947a on n-h2-839401-11 Aug 29 15:29:58.104199 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-2b5ba6d4-3b61-42da-bb8f-12cc4b6a18af req-d6037af1-ef86-4756-92d6-d2157e040f16 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101501 Aug 29 15:29:58.106680 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 665/1338] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:58.128755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2a719a11-4abb-4762-b8ee-5c8549942603 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:58.133047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2a719a11-4abb-4762-b8ee-5c8549942603 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:58.164569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a719a11-4abb-4762-b8ee-5c8549942603 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:58.165970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a719a11-4abb-4762-b8ee-5c8549942603 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:58.170027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a719a11-4abb-4762-b8ee-5c8549942603 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:58.170896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a719a11-4abb-4762-b8ee-5c8549942603 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:58.171442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a719a11-4abb-4762-b8ee-5c8549942603 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:58.177025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a719a11-4abb-4762-b8ee-5c8549942603 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:58.184237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4b50fc26-c762-4169-a127-af7c788125ef tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:58.199902 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4b50fc26-c762-4169-a127-af7c788125ef tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1282 microversion: 2.1 time: 0.170295 Aug 29 15:29:58.201593 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 674/1339] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:58 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1282 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:58.327733 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2a719a11-4abb-4762-b8ee-5c8549942603 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "POST /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a/action" status: 202 len: 0 microversion: 2.1 time: 0.219502 Aug 29 15:29:58.331231 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 666/1340] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:29:58 2022] POST /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:29:58.339651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eaa5c385-3f45-4285-b3dc-f2ca6e697c6c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:58.340276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eaa5c385-3f45-4285-b3dc-f2ca6e697c6c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:58.368228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaa5c385-3f45-4285-b3dc-f2ca6e697c6c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:58.368976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaa5c385-3f45-4285-b3dc-f2ca6e697c6c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:58.370198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaa5c385-3f45-4285-b3dc-f2ca6e697c6c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:58.370948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaa5c385-3f45-4285-b3dc-f2ca6e697c6c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:58.371414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaa5c385-3f45-4285-b3dc-f2ca6e697c6c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:58.374029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaa5c385-3f45-4285-b3dc-f2ca6e697c6c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:58.724593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eaa5c385-3f45-4285-b3dc-f2ca6e697c6c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:58.737868 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eaa5c385-3f45-4285-b3dc-f2ca6e697c6c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1572 microversion: 2.1 time: 0.405116 Aug 29 15:29:58.738769 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 675/1341] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:58 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1572 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:58.745223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f25e86a-e9a2-4686-8508-0e692a59b702 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:58.746594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9f25e86a-e9a2-4686-8508-0e692a59b702 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:58.753255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f25e86a-e9a2-4686-8508-0e692a59b702 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:58.754063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f25e86a-e9a2-4686-8508-0e692a59b702 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:58.754742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f25e86a-e9a2-4686-8508-0e692a59b702 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:58.755678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f25e86a-e9a2-4686-8508-0e692a59b702 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:58.756342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f25e86a-e9a2-4686-8508-0e692a59b702 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:58.757225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f25e86a-e9a2-4686-8508-0e692a59b702 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:58.927324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9f25e86a-e9a2-4686-8508-0e692a59b702 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:58.935888 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9f25e86a-e9a2-4686-8508-0e692a59b702 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1315 microversion: 2.1 time: 0.195280 Aug 29 15:29:58.937018 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 667/1342] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:58 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:59.023931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-96b4240e-6624-4b2f-809d-a266ec93c502 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:59.025100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-96b4240e-6624-4b2f-809d-a266ec93c502 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:59.035127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96b4240e-6624-4b2f-809d-a266ec93c502 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.036357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96b4240e-6624-4b2f-809d-a266ec93c502 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.038428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96b4240e-6624-4b2f-809d-a266ec93c502 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:59.040119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96b4240e-6624-4b2f-809d-a266ec93c502 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.041153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96b4240e-6624-4b2f-809d-a266ec93c502 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.041750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96b4240e-6624-4b2f-809d-a266ec93c502 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:59.227407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7570d127-787b-487d-a9e1-0230276d3048 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:59.228447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7570d127-787b-487d-a9e1-0230276d3048 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:59.244652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7570d127-787b-487d-a9e1-0230276d3048 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.245284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7570d127-787b-487d-a9e1-0230276d3048 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.245798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7570d127-787b-487d-a9e1-0230276d3048 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:59.246904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7570d127-787b-487d-a9e1-0230276d3048 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.248020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7570d127-787b-487d-a9e1-0230276d3048 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.248523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7570d127-787b-487d-a9e1-0230276d3048 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:59.280472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-96b4240e-6624-4b2f-809d-a266ec93c502 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:59.297771 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-96b4240e-6624-4b2f-809d-a266ec93c502 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1396 microversion: 2.1 time: 0.277711 Aug 29 15:29:59.298411 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 676/1343] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:59 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1396 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:59.303147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-9ce7624d-6dea-4a96-96d9-97c52532f15a req-fc64fc27-a004-436a-823e-82389a88a221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61f2bf94-d2e3-42ec-8808-86ee2560ae1b", "tag": "aaa3b81c-6e47-4e3d-b0f5-cdda263f206d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:59.312916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9ce7624d-6dea-4a96-96d9-97c52532f15a req-fc64fc27-a004-436a-823e-82389a88a221 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.313646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9ce7624d-6dea-4a96-96d9-97c52532f15a req-fc64fc27-a004-436a-823e-82389a88a221 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.314262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9ce7624d-6dea-4a96-96d9-97c52532f15a req-fc64fc27-a004-436a-823e-82389a88a221 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:59.330677 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-9ce7624d-6dea-4a96-96d9-97c52532f15a req-fc64fc27-a004-436a-823e-82389a88a221 service nova] Creating event network-changed:aaa3b81c-6e47-4e3d-b0f5-cdda263f206d for instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b on n-h1-839401-11 Aug 29 15:29:59.336635 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-9ce7624d-6dea-4a96-96d9-97c52532f15a req-fc64fc27-a004-436a-823e-82389a88a221 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036736 Aug 29 15:29:59.337861 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 677/1344] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:59.488595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7570d127-787b-487d-a9e1-0230276d3048 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:59.491070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:59.498093 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7570d127-787b-487d-a9e1-0230276d3048 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1324 microversion: 2.1 time: 0.276333 Aug 29 15:29:59.499019 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 668/1345] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:59 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1324 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:59.761695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e8847345-faab-4736-9f9f-3e475c6cb73c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:59.762398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e8847345-faab-4736-9f9f-3e475c6cb73c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:59.770446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8847345-faab-4736-9f9f-3e475c6cb73c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.780771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8847345-faab-4736-9f9f-3e475c6cb73c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.783212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8847345-faab-4736-9f9f-3e475c6cb73c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:59.783759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8847345-faab-4736-9f9f-3e475c6cb73c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.784159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8847345-faab-4736-9f9f-3e475c6cb73c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.784658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8847345-faab-4736-9f9f-3e475c6cb73c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:59.934193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e8847345-faab-4736-9f9f-3e475c6cb73c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:29:59.942168 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e8847345-faab-4736-9f9f-3e475c6cb73c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1572 microversion: 2.1 time: 0.185920 Aug 29 15:29:59.942752 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 678/1346] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:59 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1572 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:59.958548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7b052984-7222-4c73-9037-2fb367ec01b7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:59.959161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7b052984-7222-4c73-9037-2fb367ec01b7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:29:59.967362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b052984-7222-4c73-9037-2fb367ec01b7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.968002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b052984-7222-4c73-9037-2fb367ec01b7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.968573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b052984-7222-4c73-9037-2fb367ec01b7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:29:59.969440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b052984-7222-4c73-9037-2fb367ec01b7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:29:59.970001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b052984-7222-4c73-9037-2fb367ec01b7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:29:59.970680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b052984-7222-4c73-9037-2fb367ec01b7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.323388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-740684e6-4bba-42a1-a8aa-1cad20c4524b tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:00.324055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-740684e6-4bba-42a1-a8aa-1cad20c4524b tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:00.331381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-740684e6-4bba-42a1-a8aa-1cad20c4524b tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.333896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-740684e6-4bba-42a1-a8aa-1cad20c4524b tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.334624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-740684e6-4bba-42a1-a8aa-1cad20c4524b tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.336046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-740684e6-4bba-42a1-a8aa-1cad20c4524b tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.336531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-740684e6-4bba-42a1-a8aa-1cad20c4524b tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.336967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-740684e6-4bba-42a1-a8aa-1cad20c4524b tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.535531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7b052984-7222-4c73-9037-2fb367ec01b7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:00.559057 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7b052984-7222-4c73-9037-2fb367ec01b7 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1465 microversion: 2.1 time: 0.604750 Aug 29 15:30:00.560453 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 669/1347] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:29:59 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1465 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:00.574065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cd2886ba-6c3d-4fd1-ace1-20029d7f52ad tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:00.574937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cd2886ba-6c3d-4fd1-ace1-20029d7f52ad tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:00.590932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd2886ba-6c3d-4fd1-ace1-20029d7f52ad tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.591452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-740684e6-4bba-42a1-a8aa-1cad20c4524b tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:00.591894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd2886ba-6c3d-4fd1-ace1-20029d7f52ad tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.592499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd2886ba-6c3d-4fd1-ace1-20029d7f52ad tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.596036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd2886ba-6c3d-4fd1-ace1-20029d7f52ad tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.596695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd2886ba-6c3d-4fd1-ace1-20029d7f52ad tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.597324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd2886ba-6c3d-4fd1-ace1-20029d7f52ad tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.604831 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-740684e6-4bba-42a1-a8aa-1cad20c4524b tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1396 microversion: 2.1 time: 0.290020 Aug 29 15:30:00.612356 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 679/1348] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:00 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1396 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:00.620146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1d50b909-8a01-4c55-bab6-85a2f7f1f33b tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:00.620146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1d50b909-8a01-4c55-bab6-85a2f7f1f33b tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:00.626707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d50b909-8a01-4c55-bab6-85a2f7f1f33b tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.627201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d50b909-8a01-4c55-bab6-85a2f7f1f33b tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.627835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d50b909-8a01-4c55-bab6-85a2f7f1f33b tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.628547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d50b909-8a01-4c55-bab6-85a2f7f1f33b tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.628999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d50b909-8a01-4c55-bab6-85a2f7f1f33b tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.629542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d50b909-8a01-4c55-bab6-85a2f7f1f33b tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.633980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:00.818666 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1d50b909-8a01-4c55-bab6-85a2f7f1f33b tempest-ServersOnMultiNodesTest-1384805599 tempest-ServersOnMultiNodesTest-1384805599-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1618 microversion: 2.1 time: 0.211582 Aug 29 15:30:00.819581 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 680/1349] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:00 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1618 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:00.843391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cb7c6300-87ca-4d52-87bb-5b3c6fbe83c8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:00.843899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cb7c6300-87ca-4d52-87bb-5b3c6fbe83c8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:00.854640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb7c6300-87ca-4d52-87bb-5b3c6fbe83c8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.855413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb7c6300-87ca-4d52-87bb-5b3c6fbe83c8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.856003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb7c6300-87ca-4d52-87bb-5b3c6fbe83c8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.857273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb7c6300-87ca-4d52-87bb-5b3c6fbe83c8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.858092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb7c6300-87ca-4d52-87bb-5b3c6fbe83c8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.858677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb7c6300-87ca-4d52-87bb-5b3c6fbe83c8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.867000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cd2886ba-6c3d-4fd1-ace1-20029d7f52ad tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:00.896300 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cd2886ba-6c3d-4fd1-ace1-20029d7f52ad tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1324 microversion: 2.1 time: 0.333626 Aug 29 15:30:00.912688 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 670/1350] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:00 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1324 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:00.912688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d029c753-aadc-4a40-b73b-14826247262a req-6d5e9530-9dd4-4f88-a64e-f0338347a316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "312f21b0-5005-4a49-891e-6a09bb993fc6", "name": "network-vif-plugged", "status": "completed", "tag": "6bbe9b1d-ce94-404d-a6ef-83f0a17cf5f3"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:00.918518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cb7c6300-87ca-4d52-87bb-5b3c6fbe83c8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:00.926299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d029c753-aadc-4a40-b73b-14826247262a req-6d5e9530-9dd4-4f88-a64e-f0338347a316 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.926811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d029c753-aadc-4a40-b73b-14826247262a req-6d5e9530-9dd4-4f88-a64e-f0338347a316 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.927249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d029c753-aadc-4a40-b73b-14826247262a req-6d5e9530-9dd4-4f88-a64e-f0338347a316 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.946998 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d029c753-aadc-4a40-b73b-14826247262a req-6d5e9530-9dd4-4f88-a64e-f0338347a316 service nova] Creating event network-vif-plugged:6bbe9b1d-ce94-404d-a6ef-83f0a17cf5f3 for instance 312f21b0-5005-4a49-891e-6a09bb993fc6 on n-h1-839401-11 Aug 29 15:30:00.953359 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d029c753-aadc-4a40-b73b-14826247262a req-6d5e9530-9dd4-4f88-a64e-f0338347a316 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050822 Aug 29 15:30:00.954047 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 671/1351] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:00.970624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-015c3c28-e7d9-48d1-bf8f-a5e8e32c248c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:00.972776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-015c3c28-e7d9-48d1-bf8f-a5e8e32c248c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:00.981662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-015c3c28-e7d9-48d1-bf8f-a5e8e32c248c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.982193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-015c3c28-e7d9-48d1-bf8f-a5e8e32c248c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.982637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-015c3c28-e7d9-48d1-bf8f-a5e8e32c248c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:00.983402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-015c3c28-e7d9-48d1-bf8f-a5e8e32c248c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:00.983851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-015c3c28-e7d9-48d1-bf8f-a5e8e32c248c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:00.984278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-015c3c28-e7d9-48d1-bf8f-a5e8e32c248c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:01.029246 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cb7c6300-87ca-4d52-87bb-5b3c6fbe83c8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "DELETE /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 204 len: 0 microversion: 2.1 time: 0.190610 Aug 29 15:30:01.030150 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 681/1352] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:00 2022] DELETE /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:01.038774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5863af0d-4de3-419f-8e16-a71208ff1067 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:01.039492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5863af0d-4de3-419f-8e16-a71208ff1067 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:01.045486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5863af0d-4de3-419f-8e16-a71208ff1067 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:01.045963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5863af0d-4de3-419f-8e16-a71208ff1067 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:01.046393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5863af0d-4de3-419f-8e16-a71208ff1067 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:01.047087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5863af0d-4de3-419f-8e16-a71208ff1067 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:01.047506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5863af0d-4de3-419f-8e16-a71208ff1067 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:01.047919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5863af0d-4de3-419f-8e16-a71208ff1067 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:01.159880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-015c3c28-e7d9-48d1-bf8f-a5e8e32c248c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:01.167735 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-015c3c28-e7d9-48d1-bf8f-a5e8e32c248c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1572 microversion: 2.1 time: 0.204484 Aug 29 15:30:01.168329 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 672/1353] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:00 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1572 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:01.184017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5863af0d-4de3-419f-8e16-a71208ff1067 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:01.191909 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5863af0d-4de3-419f-8e16-a71208ff1067 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1471 microversion: 2.1 time: 0.157379 Aug 29 15:30:01.192511 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 682/1354] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:01 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:01.627688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0a03da83-40bf-465b-90ab-b3c3f53c515f tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:01.628301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0a03da83-40bf-465b-90ab-b3c3f53c515f tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:01.634908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a03da83-40bf-465b-90ab-b3c3f53c515f tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:01.635402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a03da83-40bf-465b-90ab-b3c3f53c515f tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:01.635842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a03da83-40bf-465b-90ab-b3c3f53c515f tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:01.636530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a03da83-40bf-465b-90ab-b3c3f53c515f tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:01.636987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a03da83-40bf-465b-90ab-b3c3f53c515f tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:01.637472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a03da83-40bf-465b-90ab-b3c3f53c515f tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:01.770088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0a03da83-40bf-465b-90ab-b3c3f53c515f tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:01.781818 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0a03da83-40bf-465b-90ab-b3c3f53c515f tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1396 microversion: 2.1 time: 0.157734 Aug 29 15:30:01.782587 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 673/1355] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:01 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1396 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:01.925042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d8651197-4db9-4836-8bb0-722a2f059aff tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:01.925952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d8651197-4db9-4836-8bb0-722a2f059aff tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:01.938391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8651197-4db9-4836-8bb0-722a2f059aff tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:01.939543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8651197-4db9-4836-8bb0-722a2f059aff tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:01.939987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8651197-4db9-4836-8bb0-722a2f059aff tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:01.940684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8651197-4db9-4836-8bb0-722a2f059aff tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:01.941144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8651197-4db9-4836-8bb0-722a2f059aff tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:01.941593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8651197-4db9-4836-8bb0-722a2f059aff tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:02.092661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d8651197-4db9-4836-8bb0-722a2f059aff tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:02.100991 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d8651197-4db9-4836-8bb0-722a2f059aff tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1324 microversion: 2.1 time: 0.182701 Aug 29 15:30:02.101611 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 683/1356] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:01 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1324 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:02.191873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fed290b7-b9a3-4ab8-84d7-c44927dfc54e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:02.192701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fed290b7-b9a3-4ab8-84d7-c44927dfc54e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:02.203979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fed290b7-b9a3-4ab8-84d7-c44927dfc54e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:02.204912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fed290b7-b9a3-4ab8-84d7-c44927dfc54e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:02.205412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fed290b7-b9a3-4ab8-84d7-c44927dfc54e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:02.206114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fed290b7-b9a3-4ab8-84d7-c44927dfc54e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:02.206578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fed290b7-b9a3-4ab8-84d7-c44927dfc54e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:02.207010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fed290b7-b9a3-4ab8-84d7-c44927dfc54e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:02.212603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ae70554c-c27f-4c6e-8445-f189f5205bb3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:02.213426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ae70554c-c27f-4c6e-8445-f189f5205bb3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:02.219791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae70554c-c27f-4c6e-8445-f189f5205bb3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:02.220292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae70554c-c27f-4c6e-8445-f189f5205bb3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:02.220725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae70554c-c27f-4c6e-8445-f189f5205bb3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:02.221715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae70554c-c27f-4c6e-8445-f189f5205bb3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:02.221894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae70554c-c27f-4c6e-8445-f189f5205bb3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:02.222351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae70554c-c27f-4c6e-8445-f189f5205bb3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:02.364512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ae70554c-c27f-4c6e-8445-f189f5205bb3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:02.376628 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ae70554c-c27f-4c6e-8445-f189f5205bb3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1471 microversion: 2.1 time: 0.167168 Aug 29 15:30:02.377404 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 684/1357] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:02 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:02.427484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fed290b7-b9a3-4ab8-84d7-c44927dfc54e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:02.435330 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fed290b7-b9a3-4ab8-84d7-c44927dfc54e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1572 microversion: 2.1 time: 0.250127 Aug 29 15:30:02.449320 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 674/1358] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:02 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1572 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:02.803346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-37b2cc40-5d1d-4c8b-934c-806d27172032 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:02.803980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-37b2cc40-5d1d-4c8b-934c-806d27172032 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:02.810361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37b2cc40-5d1d-4c8b-934c-806d27172032 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:02.810849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37b2cc40-5d1d-4c8b-934c-806d27172032 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:02.811289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37b2cc40-5d1d-4c8b-934c-806d27172032 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:02.811982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37b2cc40-5d1d-4c8b-934c-806d27172032 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:02.812441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37b2cc40-5d1d-4c8b-934c-806d27172032 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:02.812890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37b2cc40-5d1d-4c8b-934c-806d27172032 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:03.015234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-37b2cc40-5d1d-4c8b-934c-806d27172032 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:03.024316 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-37b2cc40-5d1d-4c8b-934c-806d27172032 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1396 microversion: 2.1 time: 0.224849 Aug 29 15:30:03.024876 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 685/1359] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:02 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1396 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:03.123158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8e5ea9e3-91ff-476b-94b6-7e4cd743a43c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:03.123977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8e5ea9e3-91ff-476b-94b6-7e4cd743a43c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:03.130371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5ea9e3-91ff-476b-94b6-7e4cd743a43c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:03.131164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5ea9e3-91ff-476b-94b6-7e4cd743a43c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:03.131733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5ea9e3-91ff-476b-94b6-7e4cd743a43c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:03.132668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5ea9e3-91ff-476b-94b6-7e4cd743a43c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:03.133509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5ea9e3-91ff-476b-94b6-7e4cd743a43c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:03.134162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5ea9e3-91ff-476b-94b6-7e4cd743a43c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:03.358985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8e5ea9e3-91ff-476b-94b6-7e4cd743a43c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:03.367375 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8e5ea9e3-91ff-476b-94b6-7e4cd743a43c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1324 microversion: 2.1 time: 0.249350 Aug 29 15:30:03.368041 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 675/1360] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:03 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1324 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:03.397909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d724ad32-ee82-419a-a28b-c9b64f24e73e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:03.398546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d724ad32-ee82-419a-a28b-c9b64f24e73e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:03.405168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d724ad32-ee82-419a-a28b-c9b64f24e73e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:03.405651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d724ad32-ee82-419a-a28b-c9b64f24e73e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:03.406079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d724ad32-ee82-419a-a28b-c9b64f24e73e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:03.406758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d724ad32-ee82-419a-a28b-c9b64f24e73e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:03.407208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d724ad32-ee82-419a-a28b-c9b64f24e73e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:03.407611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d724ad32-ee82-419a-a28b-c9b64f24e73e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:03.457606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1d678942-3c3d-4caf-b8cb-ce0dad9c5d0e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:03.458197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1d678942-3c3d-4caf-b8cb-ce0dad9c5d0e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:03.465031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d678942-3c3d-4caf-b8cb-ce0dad9c5d0e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:03.465578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d678942-3c3d-4caf-b8cb-ce0dad9c5d0e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:03.466064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d678942-3c3d-4caf-b8cb-ce0dad9c5d0e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:03.466691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d678942-3c3d-4caf-b8cb-ce0dad9c5d0e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:03.467136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d678942-3c3d-4caf-b8cb-ce0dad9c5d0e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:03.467651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d678942-3c3d-4caf-b8cb-ce0dad9c5d0e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:03.478610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d724ad32-ee82-419a-a28b-c9b64f24e73e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:03.514499 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d724ad32-ee82-419a-a28b-c9b64f24e73e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1429 microversion: 2.1 time: 0.119979 Aug 29 15:30:03.515761 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 686/1361] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:03 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1429 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:03.587328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c2ac57aa-19e9-40c8-a4fe-d05b2413064c req-db9b8dac-bfc3-4624-ac6a-a9b8f1c3b874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e77b01-ee59-43f4-8ed6-9bc6606d9db1", "name": "network-vif-deleted", "tag": "c93b7b7a-173b-4010-8d8f-2de7666f52d1"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:03.597233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c2ac57aa-19e9-40c8-a4fe-d05b2413064c req-db9b8dac-bfc3-4624-ac6a-a9b8f1c3b874 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:03.598102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c2ac57aa-19e9-40c8-a4fe-d05b2413064c req-db9b8dac-bfc3-4624-ac6a-a9b8f1c3b874 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:03.598755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c2ac57aa-19e9-40c8-a4fe-d05b2413064c req-db9b8dac-bfc3-4624-ac6a-a9b8f1c3b874 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:03.611217 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c2ac57aa-19e9-40c8-a4fe-d05b2413064c req-db9b8dac-bfc3-4624-ac6a-a9b8f1c3b874 service nova] Creating event network-vif-deleted:c93b7b7a-173b-4010-8d8f-2de7666f52d1 for instance 68e77b01-ee59-43f4-8ed6-9bc6606d9db1 on n-h2-839401-11 Aug 29 15:30:03.636069 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c2ac57aa-19e9-40c8-a4fe-d05b2413064c req-db9b8dac-bfc3-4624-ac6a-a9b8f1c3b874 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052177 Aug 29 15:30:03.637066 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 687/1362] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:30:03.768450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1d678942-3c3d-4caf-b8cb-ce0dad9c5d0e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:03.778605 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1d678942-3c3d-4caf-b8cb-ce0dad9c5d0e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1577 microversion: 2.1 time: 0.324636 Aug 29 15:30:03.779123 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 676/1363] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:03 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1577 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:04.047698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-83206aac-9090-474d-9d82-a5959db931ab tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:04.048679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-83206aac-9090-474d-9d82-a5959db931ab tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:04.055420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83206aac-9090-474d-9d82-a5959db931ab tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:04.055898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83206aac-9090-474d-9d82-a5959db931ab tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:04.056335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83206aac-9090-474d-9d82-a5959db931ab tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:04.057329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83206aac-9090-474d-9d82-a5959db931ab tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:04.057805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83206aac-9090-474d-9d82-a5959db931ab tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:04.058688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83206aac-9090-474d-9d82-a5959db931ab tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:04.198928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-83206aac-9090-474d-9d82-a5959db931ab tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:04.208255 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-83206aac-9090-474d-9d82-a5959db931ab tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1396 microversion: 2.1 time: 0.165970 Aug 29 15:30:04.208862 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 688/1364] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:04 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1396 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:04.390850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b3ec236a-95bb-4dc7-9b99-cfd3c61ba2af tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:04.392115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b3ec236a-95bb-4dc7-9b99-cfd3c61ba2af tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:04.397479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:04.401904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3ec236a-95bb-4dc7-9b99-cfd3c61ba2af tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:04.402400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3ec236a-95bb-4dc7-9b99-cfd3c61ba2af tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:04.402836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3ec236a-95bb-4dc7-9b99-cfd3c61ba2af tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:04.403545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3ec236a-95bb-4dc7-9b99-cfd3c61ba2af tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:04.404179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3ec236a-95bb-4dc7-9b99-cfd3c61ba2af tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:04.404891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3ec236a-95bb-4dc7-9b99-cfd3c61ba2af tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:04.537100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b3f0feb2-8019-4391-a585-a2d84d040f0b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:04.538080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b3f0feb2-8019-4391-a585-a2d84d040f0b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:04.545934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3f0feb2-8019-4391-a585-a2d84d040f0b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:04.546680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3f0feb2-8019-4391-a585-a2d84d040f0b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:04.547123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3f0feb2-8019-4391-a585-a2d84d040f0b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:04.547834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3f0feb2-8019-4391-a585-a2d84d040f0b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:04.548532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3f0feb2-8019-4391-a585-a2d84d040f0b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:04.549162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3f0feb2-8019-4391-a585-a2d84d040f0b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:04.582305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3f0feb2-8019-4391-a585-a2d84d040f0b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:04.583072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3f0feb2-8019-4391-a585-a2d84d040f0b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:04.583506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3f0feb2-8019-4391-a585-a2d84d040f0b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:04.584124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-b3f0feb2-8019-4391-a585-a2d84d040f0b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lazy-loading 'fault' on Instance uuid 68e77b01-ee59-43f4-8ed6-9bc6606d9db1 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:30:04.639272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b3f0feb2-8019-4391-a585-a2d84d040f0b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:04.645241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b3ec236a-95bb-4dc7-9b99-cfd3c61ba2af tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:04.647657 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b3f0feb2-8019-4391-a585-a2d84d040f0b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 200 len: 1305 microversion: 2.1 time: 0.114834 Aug 29 15:30:04.648545 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 689/1365] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:04 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:04.656019 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b3ec236a-95bb-4dc7-9b99-cfd3c61ba2af tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1324 microversion: 2.1 time: 0.270736 Aug 29 15:30:04.669852 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 677/1366] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:04 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1324 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:04.800613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-171b0183-93a8-4498-aeba-5c603348a76d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:04.800730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-171b0183-93a8-4498-aeba-5c603348a76d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:04.807979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-171b0183-93a8-4498-aeba-5c603348a76d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:04.808756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-171b0183-93a8-4498-aeba-5c603348a76d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:04.809389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-171b0183-93a8-4498-aeba-5c603348a76d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:04.810357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-171b0183-93a8-4498-aeba-5c603348a76d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:04.810732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-171b0183-93a8-4498-aeba-5c603348a76d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:04.811167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-171b0183-93a8-4498-aeba-5c603348a76d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:04.956136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-171b0183-93a8-4498-aeba-5c603348a76d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:04.964983 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-171b0183-93a8-4498-aeba-5c603348a76d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1570 microversion: 2.1 time: 0.169008 Aug 29 15:30:04.965593 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 690/1367] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:04 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:04.986114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a50b30c2-e184-44bb-9fc9-fcf50d87c83a tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-143731727"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:04.986659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a50b30c2-e184-44bb-9fc9-fcf50d87c83a tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:04.992914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a50b30c2-e184-44bb-9fc9-fcf50d87c83a tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:04.993446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a50b30c2-e184-44bb-9fc9-fcf50d87c83a tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:04.993889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a50b30c2-e184-44bb-9fc9-fcf50d87c83a tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:04.994602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a50b30c2-e184-44bb-9fc9-fcf50d87c83a tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:04.995071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a50b30c2-e184-44bb-9fc9-fcf50d87c83a tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:04.995498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a50b30c2-e184-44bb-9fc9-fcf50d87c83a tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.132335 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.network.security_group_api [None req-a50b30c2-e184-44bb-9fc9-fcf50d87c83a tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Adding security group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 to port 3c9370c4-4b98-4fb2-9f3b-4b45269eb266 Aug 29 15:30:05.229758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aabdb01f-de92-4810-ba6d-27a64426cfe2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:05.230393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aabdb01f-de92-4810-ba6d-27a64426cfe2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:05.237734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aabdb01f-de92-4810-ba6d-27a64426cfe2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.238227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aabdb01f-de92-4810-ba6d-27a64426cfe2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.238664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aabdb01f-de92-4810-ba6d-27a64426cfe2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.239338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aabdb01f-de92-4810-ba6d-27a64426cfe2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.239793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aabdb01f-de92-4810-ba6d-27a64426cfe2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.240219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aabdb01f-de92-4810-ba6d-27a64426cfe2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.330113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=16 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:05.352341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=18 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:05.379191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aabdb01f-de92-4810-ba6d-27a64426cfe2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:05.387562 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aabdb01f-de92-4810-ba6d-27a64426cfe2 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1577 microversion: 2.1 time: 0.161859 Aug 29 15:30:05.388191 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 691/1368] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:05 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:05.408230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-99edcf1c-045d-4be3-b8ae-e4a81efb0730 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:05.408724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-99edcf1c-045d-4be3-b8ae-e4a81efb0730 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:05.415253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99edcf1c-045d-4be3-b8ae-e4a81efb0730 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.415740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99edcf1c-045d-4be3-b8ae-e4a81efb0730 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.416182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99edcf1c-045d-4be3-b8ae-e4a81efb0730 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.416907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99edcf1c-045d-4be3-b8ae-e4a81efb0730 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.417431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99edcf1c-045d-4be3-b8ae-e4a81efb0730 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.417828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99edcf1c-045d-4be3-b8ae-e4a81efb0730 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.489427 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a50b30c2-e184-44bb-9fc9-fcf50d87c83a tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "POST /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a/action" status: 202 len: 0 microversion: 2.1 time: 0.507445 Aug 29 15:30:05.490130 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 678/1369] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:30:04 2022] POST /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:30:05.498428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a5f1b841-0e1b-4558-82d2-540d6ac22809 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42b92a310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:05.520409 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-99edcf1c-045d-4be3-b8ae-e4a81efb0730 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116319 Aug 29 15:30:05.521925 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 692/1370] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:30:05 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:05.595491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:05.663736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG neutronclient.v2_0.client [None req-a5f1b841-0e1b-4558-82d2-540d6ac22809 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 in use.", "detail": ""}} {{(pid=122361) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:30:05.664465 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-a5f1b841-0e1b-4558-82d2-540d6ac22809 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] HTTP exception thrown: Security Group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 in use. Aug 29 15:30:05.664465 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-9b9e1b86-6ad6-4c2e-931c-51d59bfdb491'] Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a5f1b841-0e1b-4558-82d2-540d6ac22809 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Request method failure captured: Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/os-security-groups/7279f9cf-58f8-4553-ba63-76dcaa67c0b1 HTTP/1.1 Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNs2hOo7JBpZiQzvnNgHrIm1J9RGZ5UC6DpjgyVQYeerhSnofzxX7RAKfvmzU9UJlAY5oOh27yY87PJp21A-ORXMZr-RsqgruzLi4v_3gHlsQS4FiqFdaSIS_JF0QEF93l7efzdx0gUJW4VXji92y_AvcDUPtCPmksBIQOtHDvXg1bU Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:30:05.667496 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:30:05.669065 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7939dc6e747744dab4a60e547c6d9191", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}] Aug 29 15:30:05.669065 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:05.669065 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:05.669065 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:05.669065 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:05.669065 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:30:05.669065 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:30:05.669065 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 26faf4e7544842ad9dc66370ccba54fc Aug 29 15:30:05.669065 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:05.669065 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:30:05.669065 n-d-839401-11 devstack@n-api.service[122361]: exception: Security Group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 in use. Aug 29 15:30:05.669065 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-9b9e1b86-6ad6-4c2e-931c-51d59bfdb491'] Aug 29 15:30:05.669065 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '7279f9cf-58f8-4553-ba63-76dcaa67c0b1'} Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:05.669975 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 in use. Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b9e1b86-6ad6-4c2e-931c-51d59bfdb491'] Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 in use. Aug 29 15:30:05.671329 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b9e1b86-6ad6-4c2e-931c-51d59bfdb491'] Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 in use. Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b9e1b86-6ad6-4c2e-931c-51d59bfdb491'] Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:05.674002 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:05.675735 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:05.675735 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:05.675735 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:05.675735 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 in use. Aug 29 15:30:05.675735 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b9e1b86-6ad6-4c2e-931c-51d59bfdb491'] Aug 29 15:30:05.675735 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:05.676231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-168ad9b8-b758-4fa0-a95a-3d44671bafa3 req-db6747d5-50ad-4883-8fe8-7e6b111d757d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1ca5680-b383-4baa-870c-eb239ad4947a", "tag": "3c9370c4-4b98-4fb2-9f3b-4b45269eb266"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:05.678003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a5f1b841-0e1b-4558-82d2-540d6ac22809 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Returning 400 to user: Security Group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 in use. Aug 29 15:30:05.678003 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-9b9e1b86-6ad6-4c2e-931c-51d59bfdb491'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:05.679160 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a5f1b841-0e1b-4558-82d2-540d6ac22809 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/7279f9cf-58f8-4553-ba63-76dcaa67c0b1" status: 400 len: 185 microversion: 2.1 time: 0.184614 Aug 29 15:30:05.679920 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 679/1371] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:05 2022] DELETE /compute/v2.1/os-security-groups/7279f9cf-58f8-4553-ba63-76dcaa67c0b1 => generated 185 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:30:05.680346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-168ad9b8-b758-4fa0-a95a-3d44671bafa3 req-db6747d5-50ad-4883-8fe8-7e6b111d757d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.680923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-168ad9b8-b758-4fa0-a95a-3d44671bafa3 req-db6747d5-50ad-4883-8fe8-7e6b111d757d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.681479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-168ad9b8-b758-4fa0-a95a-3d44671bafa3 req-db6747d5-50ad-4883-8fe8-7e6b111d757d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.687589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-974c9164-cd04-4e95-91ed-467835f339a1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:05.688477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-974c9164-cd04-4e95-91ed-467835f339a1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 68e77b01-ee59-43f4-8ed6-9bc6606d9db1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:05.695227 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-168ad9b8-b758-4fa0-a95a-3d44671bafa3 req-db6747d5-50ad-4883-8fe8-7e6b111d757d service nova] Creating event network-changed:3c9370c4-4b98-4fb2-9f3b-4b45269eb266 for instance a1ca5680-b383-4baa-870c-eb239ad4947a on n-h2-839401-11 Aug 29 15:30:05.697949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-974c9164-cd04-4e95-91ed-467835f339a1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.698709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-974c9164-cd04-4e95-91ed-467835f339a1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.699415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-974c9164-cd04-4e95-91ed-467835f339a1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.700161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-974c9164-cd04-4e95-91ed-467835f339a1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.700705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-974c9164-cd04-4e95-91ed-467835f339a1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.701239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-974c9164-cd04-4e95-91ed-467835f339a1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.702197 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-168ad9b8-b758-4fa0-a95a-3d44671bafa3 req-db6747d5-50ad-4883-8fe8-7e6b111d757d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038349 Aug 29 15:30:05.703441 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 693/1372] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:05.710678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c7560097-b33c-4dfe-b0a1-7e1199896b8d tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:05.712834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c7560097-b33c-4dfe-b0a1-7e1199896b8d tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:05.723230 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-974c9164-cd04-4e95-91ed-467835f339a1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] HTTP exception thrown: Instance 68e77b01-ee59-43f4-8ed6-9bc6606d9db1 could not be found. Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-974c9164-cd04-4e95-91ed-467835f339a1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Request method failure captured: Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 HTTP/1.1 Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNq0SJhI6ZUIRmnOodOt6ZcdThYB9l8hYe4x4UllXPkHKPbAG8XVvri1KtBrX7MZL6KxBneImUArYkpbtZog11x5uckGA6wz1ssepiosILg7S6-6SNa16IzeDtUVlQRc-OU8qelXOTLPaJvoplhrmvFb-m8a6TRO6xvQ_5_T5UY5kag Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 0393aa9c32934da4a9f478c563135bbb Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:30:05.727974 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:30:05.729782 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0393aa9c32934da4a9f478c563135bbb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0393aa9c32934da4a9f478c563135bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0393aa9c32934da4a9f478c563135bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0393aa9c32934da4a9f478c563135bbb"}]}] Aug 29 15:30:05.729782 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:05.729782 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 0393aa9c32934da4a9f478c563135bbb Aug 29 15:30:05.729782 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:05.729782 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersOnMultiNodesTest-900863548-project Aug 29 15:30:05.729782 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:30:05.729782 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:30:05.729782 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e80b373b91434aae8f358839628f3072 Aug 29 15:30:05.729782 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersOnMultiNodesTest-900863548-project Aug 29 15:30:05.729782 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:30:05.729782 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 68e77b01-ee59-43f4-8ed6-9bc6606d9db1 could not be found. Aug 29 15:30:05.729782 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '68e77b01-ee59-43f4-8ed6-9bc6606d9db1'} Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68e77b01-ee59-43f4-8ed6-9bc6606d9db1 could not be found. Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:05.730722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68e77b01-ee59-43f4-8ed6-9bc6606d9db1 could not be found. Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68e77b01-ee59-43f4-8ed6-9bc6606d9db1 could not be found. Aug 29 15:30:05.732098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:05.734076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-974c9164-cd04-4e95-91ed-467835f339a1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Returning 404 to user: Instance 68e77b01-ee59-43f4-8ed6-9bc6606d9db1 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:05.735148 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-974c9164-cd04-4e95-91ed-467835f339a1 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1" status: 404 len: 111 microversion: 2.1 time: 0.052539 Aug 29 15:30:05.735580 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 680/1373] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:05 2022] GET /compute/v2.1/servers/68e77b01-ee59-43f4-8ed6-9bc6606d9db1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:05.742336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:05.745305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c3c1bcd6-efe8-40d3-8803-a91a4683e543 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:05.746056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c3c1bcd6-efe8-40d3-8803-a91a4683e543 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:05.754877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3c1bcd6-efe8-40d3-8803-a91a4683e543 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.755878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3c1bcd6-efe8-40d3-8803-a91a4683e543 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.756513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3c1bcd6-efe8-40d3-8803-a91a4683e543 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.757521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3c1bcd6-efe8-40d3-8803-a91a4683e543 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.758157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3c1bcd6-efe8-40d3-8803-a91a4683e543 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.759299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3c1bcd6-efe8-40d3-8803-a91a4683e543 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.760189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7560097-b33c-4dfe-b0a1-7e1199896b8d tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.764651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7560097-b33c-4dfe-b0a1-7e1199896b8d tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.772215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7560097-b33c-4dfe-b0a1-7e1199896b8d tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.774493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7560097-b33c-4dfe-b0a1-7e1199896b8d tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.802890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c3c1bcd6-efe8-40d3-8803-a91a4683e543 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:05.804888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7560097-b33c-4dfe-b0a1-7e1199896b8d tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.809286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7560097-b33c-4dfe-b0a1-7e1199896b8d tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.949240 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c3c1bcd6-efe8-40d3-8803-a91a4683e543 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 204 len: 0 microversion: 2.1 time: 0.212190 Aug 29 15:30:05.950446 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 681/1374] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:05 2022] DELETE /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:05.959174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-85476cc0-569a-4765-a4cb-7d0ff3abfe21 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:05.960009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-85476cc0-569a-4765-a4cb-7d0ff3abfe21 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:05.970671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85476cc0-569a-4765-a4cb-7d0ff3abfe21 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.971487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85476cc0-569a-4765-a4cb-7d0ff3abfe21 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.972194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85476cc0-569a-4765-a4cb-7d0ff3abfe21 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:05.973247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85476cc0-569a-4765-a4cb-7d0ff3abfe21 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:05.974681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85476cc0-569a-4765-a4cb-7d0ff3abfe21 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:05.975864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85476cc0-569a-4765-a4cb-7d0ff3abfe21 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:06.012651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-85476cc0-569a-4765-a4cb-7d0ff3abfe21 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:06.162362 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-85476cc0-569a-4765-a4cb-7d0ff3abfe21 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 204 len: 0 microversion: 2.1 time: 0.210098 Aug 29 15:30:06.163571 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 682/1375] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:05 2022] DELETE /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:06.182444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c93a939e-7aa7-452e-9f6a-3251eb0d0ba1 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:06.183159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c93a939e-7aa7-452e-9f6a-3251eb0d0ba1 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:06.189454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c93a939e-7aa7-452e-9f6a-3251eb0d0ba1 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:06.190001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c93a939e-7aa7-452e-9f6a-3251eb0d0ba1 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:06.190378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c93a939e-7aa7-452e-9f6a-3251eb0d0ba1 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:06.191083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c93a939e-7aa7-452e-9f6a-3251eb0d0ba1 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:06.191554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c93a939e-7aa7-452e-9f6a-3251eb0d0ba1 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:06.191965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c93a939e-7aa7-452e-9f6a-3251eb0d0ba1 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:06.386093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c7560097-b33c-4dfe-b0a1-7e1199896b8d tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:06.395880 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c7560097-b33c-4dfe-b0a1-7e1199896b8d tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1324 microversion: 2.1 time: 0.691008 Aug 29 15:30:06.396505 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 694/1376] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:05 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1324 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:06.397713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c93a939e-7aa7-452e-9f6a-3251eb0d0ba1 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:06.401542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8ef2c656-c057-4c6c-ae05-cc820b2b10c0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:06.402320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8ef2c656-c057-4c6c-ae05-cc820b2b10c0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:06.410028 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c93a939e-7aa7-452e-9f6a-3251eb0d0ba1 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1644 microversion: 2.1 time: 0.232388 Aug 29 15:30:06.410212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ef2c656-c057-4c6c-ae05-cc820b2b10c0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:06.410605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ef2c656-c057-4c6c-ae05-cc820b2b10c0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:06.411035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ef2c656-c057-4c6c-ae05-cc820b2b10c0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:06.411255 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 683/1377] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:06 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1644 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:06.412355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ef2c656-c057-4c6c-ae05-cc820b2b10c0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:06.412882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ef2c656-c057-4c6c-ae05-cc820b2b10c0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:06.413349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ef2c656-c057-4c6c-ae05-cc820b2b10c0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:06.733491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8ef2c656-c057-4c6c-ae05-cc820b2b10c0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:06.745241 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8ef2c656-c057-4c6c-ae05-cc820b2b10c0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1473 microversion: 2.1 time: 0.347492 Aug 29 15:30:06.746558 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 695/1378] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:06 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1473 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:07.216964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4e81da68-ed55-4e6b-b391-e80aa1435a60 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:07.217919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4e81da68-ed55-4e6b-b391-e80aa1435a60 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:07.219433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-8122b9fc-6373-4718-a027-bf9d2bec1c8b req-e3c710f5-855a-4c4c-8e8e-cbd6f812b091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "312f21b0-5005-4a49-891e-6a09bb993fc6", "tag": "6bbe9b1d-ce94-404d-a6ef-83f0a17cf5f3"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:07.224277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e81da68-ed55-4e6b-b391-e80aa1435a60 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:07.224841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e81da68-ed55-4e6b-b391-e80aa1435a60 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:07.225346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e81da68-ed55-4e6b-b391-e80aa1435a60 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:07.226130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e81da68-ed55-4e6b-b391-e80aa1435a60 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:07.226656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e81da68-ed55-4e6b-b391-e80aa1435a60 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:07.227146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e81da68-ed55-4e6b-b391-e80aa1435a60 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:07.229795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8122b9fc-6373-4718-a027-bf9d2bec1c8b req-e3c710f5-855a-4c4c-8e8e-cbd6f812b091 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:07.230586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8122b9fc-6373-4718-a027-bf9d2bec1c8b req-e3c710f5-855a-4c4c-8e8e-cbd6f812b091 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:07.231019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8122b9fc-6373-4718-a027-bf9d2bec1c8b req-e3c710f5-855a-4c4c-8e8e-cbd6f812b091 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:07.242757 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-8122b9fc-6373-4718-a027-bf9d2bec1c8b req-e3c710f5-855a-4c4c-8e8e-cbd6f812b091 service nova] Creating event network-changed:6bbe9b1d-ce94-404d-a6ef-83f0a17cf5f3 for instance 312f21b0-5005-4a49-891e-6a09bb993fc6 on n-h1-839401-11 Aug 29 15:30:07.251351 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-8122b9fc-6373-4718-a027-bf9d2bec1c8b req-e3c710f5-855a-4c4c-8e8e-cbd6f812b091 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035816 Aug 29 15:30:07.252111 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 696/1379] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:07.422142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8ed18c35-5e60-476e-a78d-bc77f76832a5 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:07.423461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8ed18c35-5e60-476e-a78d-bc77f76832a5 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:07.431424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ed18c35-5e60-476e-a78d-bc77f76832a5 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:07.431932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ed18c35-5e60-476e-a78d-bc77f76832a5 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:07.432365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ed18c35-5e60-476e-a78d-bc77f76832a5 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:07.433378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ed18c35-5e60-476e-a78d-bc77f76832a5 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:07.433841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ed18c35-5e60-476e-a78d-bc77f76832a5 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:07.436768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ed18c35-5e60-476e-a78d-bc77f76832a5 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:07.442472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:07.456318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4e81da68-ed55-4e6b-b391-e80aa1435a60 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:07.459877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:07.471452 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4e81da68-ed55-4e6b-b391-e80aa1435a60 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1577 microversion: 2.1 time: 0.258365 Aug 29 15:30:07.472202 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 684/1380] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:07 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1577 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:07.498067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-06f28005-bd6d-4ed1-b2d4-f9070efa06be tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:07.498745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-06f28005-bd6d-4ed1-b2d4-f9070efa06be tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:07.507401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06f28005-bd6d-4ed1-b2d4-f9070efa06be tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:07.507901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06f28005-bd6d-4ed1-b2d4-f9070efa06be tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:07.508382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06f28005-bd6d-4ed1-b2d4-f9070efa06be tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:07.509341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06f28005-bd6d-4ed1-b2d4-f9070efa06be tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:07.509795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06f28005-bd6d-4ed1-b2d4-f9070efa06be tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:07.510217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06f28005-bd6d-4ed1-b2d4-f9070efa06be tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:07.602965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8ed18c35-5e60-476e-a78d-bc77f76832a5 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:07.623646 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8ed18c35-5e60-476e-a78d-bc77f76832a5 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1324 microversion: 2.1 time: 0.209029 Aug 29 15:30:07.624504 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 697/1381] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:07 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1324 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:07.685713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-06f28005-bd6d-4ed1-b2d4-f9070efa06be tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:07.693720 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-06f28005-bd6d-4ed1-b2d4-f9070efa06be tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1644 microversion: 2.1 time: 0.206778 Aug 29 15:30:07.694325 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 685/1382] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:07 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1644 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:07.767183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0bcc0a0e-3710-4efd-8f7f-3a724409fef6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:07.767846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0bcc0a0e-3710-4efd-8f7f-3a724409fef6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:07.776466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bcc0a0e-3710-4efd-8f7f-3a724409fef6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:07.778070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bcc0a0e-3710-4efd-8f7f-3a724409fef6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:07.778659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bcc0a0e-3710-4efd-8f7f-3a724409fef6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:07.779836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bcc0a0e-3710-4efd-8f7f-3a724409fef6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:07.780354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bcc0a0e-3710-4efd-8f7f-3a724409fef6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:07.780779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bcc0a0e-3710-4efd-8f7f-3a724409fef6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:07.935522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0bcc0a0e-3710-4efd-8f7f-3a724409fef6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:07.944565 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0bcc0a0e-3710-4efd-8f7f-3a724409fef6 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1473 microversion: 2.1 time: 0.181632 Aug 29 15:30:07.945469 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 698/1383] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:07 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1473 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:08.645029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7fbba2f8-d18d-4c6b-b360-6918b92452e4 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:08.645697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7fbba2f8-d18d-4c6b-b360-6918b92452e4 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:08.658155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fbba2f8-d18d-4c6b-b360-6918b92452e4 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:08.660265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fbba2f8-d18d-4c6b-b360-6918b92452e4 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:08.662425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fbba2f8-d18d-4c6b-b360-6918b92452e4 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:08.666539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fbba2f8-d18d-4c6b-b360-6918b92452e4 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:08.670835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fbba2f8-d18d-4c6b-b360-6918b92452e4 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:08.671456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fbba2f8-d18d-4c6b-b360-6918b92452e4 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:08.715411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fd5fa476-61af-4d9c-a692-a03db697265b tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:08.716033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fd5fa476-61af-4d9c-a692-a03db697265b tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:08.727100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd5fa476-61af-4d9c-a692-a03db697265b tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:08.727579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd5fa476-61af-4d9c-a692-a03db697265b tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:08.728021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd5fa476-61af-4d9c-a692-a03db697265b tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:08.728738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd5fa476-61af-4d9c-a692-a03db697265b tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:08.729230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd5fa476-61af-4d9c-a692-a03db697265b tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:08.729655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd5fa476-61af-4d9c-a692-a03db697265b tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:09.018680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd5fa476-61af-4d9c-a692-a03db697265b tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:09.027654 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fd5fa476-61af-4d9c-a692-a03db697265b tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1644 microversion: 2.1 time: 0.316138 Aug 29 15:30:09.028966 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 699/1384] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:08 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1644 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:09.035775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-69843ca2-0163-4922-aa8b-9cbf17523865 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:09.036492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-69843ca2-0163-4922-aa8b-9cbf17523865 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:09.043890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69843ca2-0163-4922-aa8b-9cbf17523865 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:09.044594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69843ca2-0163-4922-aa8b-9cbf17523865 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:09.045184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69843ca2-0163-4922-aa8b-9cbf17523865 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:09.050183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69843ca2-0163-4922-aa8b-9cbf17523865 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:09.051068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69843ca2-0163-4922-aa8b-9cbf17523865 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:09.051833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69843ca2-0163-4922-aa8b-9cbf17523865 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:09.090869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69843ca2-0163-4922-aa8b-9cbf17523865 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:09.091473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69843ca2-0163-4922-aa8b-9cbf17523865 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:09.092171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69843ca2-0163-4922-aa8b-9cbf17523865 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:09.092640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-69843ca2-0163-4922-aa8b-9cbf17523865 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lazy-loading 'fault' on Instance uuid d6d34cb9-694e-4941-b163-9d1b0f44c8ae {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:30:09.134481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7fbba2f8-d18d-4c6b-b360-6918b92452e4 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:09.143875 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7fbba2f8-d18d-4c6b-b360-6918b92452e4 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1324 microversion: 2.1 time: 0.502707 Aug 29 15:30:09.157487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-69843ca2-0163-4922-aa8b-9cbf17523865 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:09.160759 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-69843ca2-0163-4922-aa8b-9cbf17523865 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 200 len: 1307 microversion: 2.1 time: 0.128636 Aug 29 15:30:09.161287 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 686/1386] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:08 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1324 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:09.161434 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 700/1386] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:09 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 1307 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:09.269175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-64b34126-803b-43fc-afb7-0ce6d7d0af74 req-cee1cf4e-5b69-4131-8b43-0eaa304d119a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d34cb9-694e-4941-b163-9d1b0f44c8ae", "name": "network-vif-deleted", "tag": "b0874f9c-2ae8-46b9-8878-f08b7073e1c7"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:09.280522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-64b34126-803b-43fc-afb7-0ce6d7d0af74 req-cee1cf4e-5b69-4131-8b43-0eaa304d119a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:09.281429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-64b34126-803b-43fc-afb7-0ce6d7d0af74 req-cee1cf4e-5b69-4131-8b43-0eaa304d119a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:09.282046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-64b34126-803b-43fc-afb7-0ce6d7d0af74 req-cee1cf4e-5b69-4131-8b43-0eaa304d119a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:09.294670 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-64b34126-803b-43fc-afb7-0ce6d7d0af74 req-cee1cf4e-5b69-4131-8b43-0eaa304d119a service nova] Creating event network-vif-deleted:b0874f9c-2ae8-46b9-8878-f08b7073e1c7 for instance d6d34cb9-694e-4941-b163-9d1b0f44c8ae on n-h1-839401-11 Aug 29 15:30:09.299703 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-64b34126-803b-43fc-afb7-0ce6d7d0af74 req-cee1cf4e-5b69-4131-8b43-0eaa304d119a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035228 Aug 29 15:30:09.300653 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 701/1387] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:09.516190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-c84b9ae5-9e48-42d6-8dc7-2997831a671a req-7f700650-5e8a-46b8-994a-15bbbaaaef00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1ca5680-b383-4baa-870c-eb239ad4947a", "name": "network-vif-deleted", "tag": "3c9370c4-4b98-4fb2-9f3b-4b45269eb266"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:09.532742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c84b9ae5-9e48-42d6-8dc7-2997831a671a req-7f700650-5e8a-46b8-994a-15bbbaaaef00 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:09.533697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c84b9ae5-9e48-42d6-8dc7-2997831a671a req-7f700650-5e8a-46b8-994a-15bbbaaaef00 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:09.534505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c84b9ae5-9e48-42d6-8dc7-2997831a671a req-7f700650-5e8a-46b8-994a-15bbbaaaef00 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:09.544153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a1ea0dec-d7e0-41e1-9061-aee16bda44fa req-c184e22d-0cfc-4882-9773-08e459757579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61f2bf94-d2e3-42ec-8808-86ee2560ae1b", "name": "network-vif-plugged", "status": "completed", "tag": "aaa3b81c-6e47-4e3d-b0f5-cdda263f206d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:09.548263 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-c84b9ae5-9e48-42d6-8dc7-2997831a671a req-7f700650-5e8a-46b8-994a-15bbbaaaef00 service nova] Creating event network-vif-deleted:3c9370c4-4b98-4fb2-9f3b-4b45269eb266 for instance a1ca5680-b383-4baa-870c-eb239ad4947a on n-h2-839401-11 Aug 29 15:30:09.555019 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-c84b9ae5-9e48-42d6-8dc7-2997831a671a req-7f700650-5e8a-46b8-994a-15bbbaaaef00 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127753 Aug 29 15:30:09.556313 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 687/1388] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:09.557625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a1ea0dec-d7e0-41e1-9061-aee16bda44fa req-c184e22d-0cfc-4882-9773-08e459757579 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:09.558119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a1ea0dec-d7e0-41e1-9061-aee16bda44fa req-c184e22d-0cfc-4882-9773-08e459757579 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:09.558550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a1ea0dec-d7e0-41e1-9061-aee16bda44fa req-c184e22d-0cfc-4882-9773-08e459757579 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:09.580968 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a1ea0dec-d7e0-41e1-9061-aee16bda44fa req-c184e22d-0cfc-4882-9773-08e459757579 service nova] Creating event network-vif-plugged:aaa3b81c-6e47-4e3d-b0f5-cdda263f206d for instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b on n-h1-839401-11 Aug 29 15:30:09.591561 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a1ea0dec-d7e0-41e1-9061-aee16bda44fa req-c184e22d-0cfc-4882-9773-08e459757579 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052262 Aug 29 15:30:09.592709 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 702/1389] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:10.051675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4138c370-a0be-4beb-86c8-543db7562094 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:10.052383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4138c370-a0be-4beb-86c8-543db7562094 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:10.059270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4138c370-a0be-4beb-86c8-543db7562094 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.059770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4138c370-a0be-4beb-86c8-543db7562094 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.060191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4138c370-a0be-4beb-86c8-543db7562094 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.061114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4138c370-a0be-4beb-86c8-543db7562094 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.061436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4138c370-a0be-4beb-86c8-543db7562094 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.061865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4138c370-a0be-4beb-86c8-543db7562094 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.096734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4138c370-a0be-4beb-86c8-543db7562094 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.097281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4138c370-a0be-4beb-86c8-543db7562094 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.097720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4138c370-a0be-4beb-86c8-543db7562094 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.098170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-4138c370-a0be-4beb-86c8-543db7562094 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lazy-loading 'fault' on Instance uuid a1ca5680-b383-4baa-870c-eb239ad4947a {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:30:10.141662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4138c370-a0be-4beb-86c8-543db7562094 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:10.149737 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4138c370-a0be-4beb-86c8-543db7562094 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 200 len: 1306 microversion: 2.1 time: 0.102985 Aug 29 15:30:10.150531 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 688/1390] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:10 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:10.172688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a918ef97-467a-45ff-9a5f-50528f6ec218 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:10.173645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a918ef97-467a-45ff-9a5f-50528f6ec218 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:10.180461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-46d74a65-c92a-44d5-ac76-c14f70a9a336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:10.180993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-46d74a65-c92a-44d5-ac76-c14f70a9a336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: d6d34cb9-694e-4941-b163-9d1b0f44c8ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:10.181273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a918ef97-467a-45ff-9a5f-50528f6ec218 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.182380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a918ef97-467a-45ff-9a5f-50528f6ec218 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.182380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a918ef97-467a-45ff-9a5f-50528f6ec218 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.183326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a918ef97-467a-45ff-9a5f-50528f6ec218 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.183924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a918ef97-467a-45ff-9a5f-50528f6ec218 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.184612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a918ef97-467a-45ff-9a5f-50528f6ec218 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.196504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46d74a65-c92a-44d5-ac76-c14f70a9a336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.197010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46d74a65-c92a-44d5-ac76-c14f70a9a336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.198144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46d74a65-c92a-44d5-ac76-c14f70a9a336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.198894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46d74a65-c92a-44d5-ac76-c14f70a9a336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.199363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46d74a65-c92a-44d5-ac76-c14f70a9a336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.199793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46d74a65-c92a-44d5-ac76-c14f70a9a336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.215850 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-46d74a65-c92a-44d5-ac76-c14f70a9a336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] HTTP exception thrown: Instance d6d34cb9-694e-4941-b163-9d1b0f44c8ae could not be found. Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-46d74a65-c92a-44d5-ac76-c14f70a9a336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Request method failure captured: Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae HTTP/1.1 Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNq0SJhI6ZUIRmnOodOt6ZcdThYB9l8hYe4x4UllXPkHKPbAG8XVvri1KtBrX7MZL6KxBneImUArYkpbtZog11x5uckGA6wz1ssepiosILg7S6-6SNa16IzeDtUVlQRc-OU8qelXOTLPaJvoplhrmvFb-m8a6TRO6xvQ_5_T5UY5kag Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 0393aa9c32934da4a9f478c563135bbb Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:30:10.228747 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:30:10.230529 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0393aa9c32934da4a9f478c563135bbb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0393aa9c32934da4a9f478c563135bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0393aa9c32934da4a9f478c563135bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0393aa9c32934da4a9f478c563135bbb"}]}] Aug 29 15:30:10.230529 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:10.230529 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 0393aa9c32934da4a9f478c563135bbb Aug 29 15:30:10.230529 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:10.230529 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersOnMultiNodesTest-900863548-project Aug 29 15:30:10.230529 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:30:10.230529 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:30:10.230529 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e80b373b91434aae8f358839628f3072 Aug 29 15:30:10.230529 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersOnMultiNodesTest-900863548-project Aug 29 15:30:10.230529 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:30:10.230529 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance d6d34cb9-694e-4941-b163-9d1b0f44c8ae could not be found. Aug 29 15:30:10.230529 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'd6d34cb9-694e-4941-b163-9d1b0f44c8ae'} Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6d34cb9-694e-4941-b163-9d1b0f44c8ae could not be found. Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:10.231475 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6d34cb9-694e-4941-b163-9d1b0f44c8ae could not be found. Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6d34cb9-694e-4941-b163-9d1b0f44c8ae could not be found. Aug 29 15:30:10.234796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:10.237232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-46d74a65-c92a-44d5-ac76-c14f70a9a336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Returning 404 to user: Instance d6d34cb9-694e-4941-b163-9d1b0f44c8ae could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:10.237232 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-46d74a65-c92a-44d5-ac76-c14f70a9a336 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae" status: 404 len: 111 microversion: 2.1 time: 0.055729 Aug 29 15:30:10.238182 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 689/1391] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:10 2022] GET /compute/v2.1/servers/d6d34cb9-694e-4941-b163-9d1b0f44c8ae => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:10.249743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7cea142a-11e3-4491-bca9-c27b87c310b2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:10.250335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7cea142a-11e3-4491-bca9-c27b87c310b2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:10.263141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cea142a-11e3-4491-bca9-c27b87c310b2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.263694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cea142a-11e3-4491-bca9-c27b87c310b2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.264212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cea142a-11e3-4491-bca9-c27b87c310b2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.265014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cea142a-11e3-4491-bca9-c27b87c310b2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.265753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cea142a-11e3-4491-bca9-c27b87c310b2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.266261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cea142a-11e3-4491-bca9-c27b87c310b2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.304726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7cea142a-11e3-4491-bca9-c27b87c310b2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:10.345362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a918ef97-467a-45ff-9a5f-50528f6ec218 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:10.354422 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a918ef97-467a-45ff-9a5f-50528f6ec218 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1324 microversion: 2.1 time: 0.188419 Aug 29 15:30:10.355341 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 703/1392] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:10 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1324 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:10.412304 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7cea142a-11e3-4491-bca9-c27b87c310b2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "DELETE /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 204 len: 0 microversion: 2.1 time: 0.172801 Aug 29 15:30:10.413283 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 690/1393] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:10 2022] DELETE /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:10.421556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a48d9cb8-e832-466f-b3f1-fc06b1deb717 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:10.422290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a48d9cb8-e832-466f-b3f1-fc06b1deb717 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:10.428688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a48d9cb8-e832-466f-b3f1-fc06b1deb717 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.429214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a48d9cb8-e832-466f-b3f1-fc06b1deb717 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.429989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a48d9cb8-e832-466f-b3f1-fc06b1deb717 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.430978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a48d9cb8-e832-466f-b3f1-fc06b1deb717 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:10.431378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a48d9cb8-e832-466f-b3f1-fc06b1deb717 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:10.431813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a48d9cb8-e832-466f-b3f1-fc06b1deb717 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:10.580015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a48d9cb8-e832-466f-b3f1-fc06b1deb717 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:10.588494 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a48d9cb8-e832-466f-b3f1-fc06b1deb717 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1472 microversion: 2.1 time: 0.170610 Aug 29 15:30:10.589132 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 704/1394] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:10 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:11.175351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-401ef89d-dfb0-4356-9778-f2e34a10fab5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:11.176757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-401ef89d-dfb0-4356-9778-f2e34a10fab5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:11.183042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-401ef89d-dfb0-4356-9778-f2e34a10fab5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:11.183606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-401ef89d-dfb0-4356-9778-f2e34a10fab5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:11.184487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-401ef89d-dfb0-4356-9778-f2e34a10fab5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:11.185376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-401ef89d-dfb0-4356-9778-f2e34a10fab5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:11.185899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-401ef89d-dfb0-4356-9778-f2e34a10fab5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:11.186389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-401ef89d-dfb0-4356-9778-f2e34a10fab5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:11.202392 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-401ef89d-dfb0-4356-9778-f2e34a10fab5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] HTTP exception thrown: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-401ef89d-dfb0-4356-9778-f2e34a10fab5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Request method failure captured: Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a HTTP/1.1 Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNs2hOo7JBpZiQzvnNgHrIm1J9RGZ5UC6DpjgyVQYeerhSnofzxX7RAKfvmzU9UJlAY5oOh27yY87PJp21A-ORXMZr-RsqgruzLi4v_3gHlsQS4FiqFdaSIS_JF0QEF93l7efzdx0gUJW4VXji92y_AvcDUPtCPmksBIQOtHDvXg1bU Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:30:11.204090 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:30:11.205871 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7939dc6e747744dab4a60e547c6d9191", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}] Aug 29 15:30:11.205871 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:11.205871 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:11.205871 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:11.205871 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:11.205871 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:30:11.205871 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:30:11.205871 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 26faf4e7544842ad9dc66370ccba54fc Aug 29 15:30:11.205871 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:11.205871 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:30:11.205871 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. Aug 29 15:30:11.205871 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'a1ca5680-b383-4baa-870c-eb239ad4947a'} Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:11.206796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. Aug 29 15:30:11.208332 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:11.209772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-401ef89d-dfb0-4356-9778-f2e34a10fab5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Returning 404 to user: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:11.209772 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-401ef89d-dfb0-4356-9778-f2e34a10fab5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 404 len: 111 microversion: 2.1 time: 0.037484 Aug 29 15:30:11.210774 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 691/1395] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:11 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:11.219302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1846f7dd-5a17-49bd-a710-ed8be915e9d9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42b7dbc10>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:11.377319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-193eaf52-be9b-47af-8db8-369c5f2aabeb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:11.379007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-193eaf52-be9b-47af-8db8-369c5f2aabeb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:11.387727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-193eaf52-be9b-47af-8db8-369c5f2aabeb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:11.388411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-193eaf52-be9b-47af-8db8-369c5f2aabeb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:11.389172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-193eaf52-be9b-47af-8db8-369c5f2aabeb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:11.390523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-193eaf52-be9b-47af-8db8-369c5f2aabeb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:11.391355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-193eaf52-be9b-47af-8db8-369c5f2aabeb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:11.392054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-193eaf52-be9b-47af-8db8-369c5f2aabeb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:11.417604 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1846f7dd-5a17-49bd-a710-ed8be915e9d9 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/499ede52-296f-47d4-9588-096560e4d973" status: 202 len: 0 microversion: 2.1 time: 0.204198 Aug 29 15:30:11.419559 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 705/1396] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:11 2022] DELETE /compute/v2.1/os-security-groups/499ede52-296f-47d4-9588-096560e4d973 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:30:11.430689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3cbbec87-93a0-4cf3-b975-665497b619d2 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42b7ade50>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:11.700118 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3cbbec87-93a0-4cf3-b975-665497b619d2 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/7279f9cf-58f8-4553-ba63-76dcaa67c0b1" status: 202 len: 0 microversion: 2.1 time: 0.275660 Aug 29 15:30:11.701654 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 706/1397] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:11 2022] DELETE /compute/v2.1/os-security-groups/7279f9cf-58f8-4553-ba63-76dcaa67c0b1 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:30:11.708077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-42557076-e30b-411b-af6f-0810997ecf2b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:11.709368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-42557076-e30b-411b-af6f-0810997ecf2b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:11.721525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42557076-e30b-411b-af6f-0810997ecf2b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:11.722434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42557076-e30b-411b-af6f-0810997ecf2b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:11.723300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42557076-e30b-411b-af6f-0810997ecf2b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:11.724558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42557076-e30b-411b-af6f-0810997ecf2b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:11.726216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42557076-e30b-411b-af6f-0810997ecf2b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:11.727466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42557076-e30b-411b-af6f-0810997ecf2b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:11.885963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-42557076-e30b-411b-af6f-0810997ecf2b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:11.891088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-193eaf52-be9b-47af-8db8-369c5f2aabeb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:11.894693 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-42557076-e30b-411b-af6f-0810997ecf2b tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1472 microversion: 2.1 time: 0.191889 Aug 29 15:30:11.895481 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 707/1398] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:11 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:11.900976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-50a63148-85b8-480a-9e60-9a70f36d0c5d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'create', calling method: .version_select at 0x7fc42b7834c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1338881696", "description": "tempest-description-1146208043"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:11.911881 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-193eaf52-be9b-47af-8db8-369c5f2aabeb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1324 microversion: 2.1 time: 0.539944 Aug 29 15:30:11.912874 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 692/1399] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:11 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1324 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:12.046014 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-50a63148-85b8-480a-9e60-9a70f36d0c5d tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.149465 Aug 29 15:30:12.057335 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 708/1400] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:30:11 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:12.062920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2f6449e0-b3a6-4bde-82c6-c815fcc2a19f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Action: 'update', calling method: .version_select at 0x7fc42b92a310>, body: {"security_group": {"name": "tempest-sg-hth-1635770643", "description": "tempest-description-hth-1989419642"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:12.204320 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2f6449e0-b3a6-4bde-82c6-c815fcc2a19f tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "PUT /compute/v2.1/os-security-groups/18a7472f-ef26-4af0-bbd2-f8b0bac88035" status: 200 len: 218 microversion: 2.1 time: 0.147472 Aug 29 15:30:12.205849 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 693/1401] 10.222.0.62 () {60 vars in 1290 bytes} [Mon Aug 29 15:30:12 2022] PUT /compute/v2.1/os-security-groups/18a7472f-ef26-4af0-bbd2-f8b0bac88035 => generated 218 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:12.219693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aa94b8db-ac13-4715-bdfe-2ee1608ba398 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42b786670>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:12.275380 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aa94b8db-ac13-4715-bdfe-2ee1608ba398 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/os-security-groups/18a7472f-ef26-4af0-bbd2-f8b0bac88035" status: 200 len: 218 microversion: 2.1 time: 0.059945 Aug 29 15:30:12.276131 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 709/1402] 10.222.0.62 () {58 vars in 1269 bytes} [Mon Aug 29 15:30:12 2022] GET /compute/v2.1/os-security-groups/18a7472f-ef26-4af0-bbd2-f8b0bac88035 => generated 218 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:12.289629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-678c949c-be20-44e7-aa68-879654b79baa tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42ba6f280>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:12.472944 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-678c949c-be20-44e7-aa68-879654b79baa tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/18a7472f-ef26-4af0-bbd2-f8b0bac88035" status: 202 len: 0 microversion: 2.1 time: 0.183348 Aug 29 15:30:12.473551 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 694/1403] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:12 2022] DELETE /compute/v2.1/os-security-groups/18a7472f-ef26-4af0-bbd2-f8b0bac88035 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:30:12.478001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-447fa29b-4076-42ae-a77b-f456642a6716 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:12.478492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-447fa29b-4076-42ae-a77b-f456642a6716 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:12.485351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-447fa29b-4076-42ae-a77b-f456642a6716 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.485828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-447fa29b-4076-42ae-a77b-f456642a6716 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.486571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-447fa29b-4076-42ae-a77b-f456642a6716 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:12.487309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-447fa29b-4076-42ae-a77b-f456642a6716 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.487722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-447fa29b-4076-42ae-a77b-f456642a6716 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.488328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-447fa29b-4076-42ae-a77b-f456642a6716 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:12.503023 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-447fa29b-4076-42ae-a77b-f456642a6716 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] HTTP exception thrown: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-447fa29b-4076-42ae-a77b-f456642a6716 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Request method failure captured: Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a HTTP/1.1 Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNs2hOo7JBpZiQzvnNgHrIm1J9RGZ5UC6DpjgyVQYeerhSnofzxX7RAKfvmzU9UJlAY5oOh27yY87PJp21A-ORXMZr-RsqgruzLi4v_3gHlsQS4FiqFdaSIS_JF0QEF93l7efzdx0gUJW4VXji92y_AvcDUPtCPmksBIQOtHDvXg1bU Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:30:12.505158 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:30:12.506809 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7939dc6e747744dab4a60e547c6d9191", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}] Aug 29 15:30:12.506809 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.506809 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:12.506809 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.506809 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:12.506809 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:30:12.506809 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:30:12.506809 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 26faf4e7544842ad9dc66370ccba54fc Aug 29 15:30:12.506809 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:12.506809 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:30:12.506809 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. Aug 29 15:30:12.506809 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'a1ca5680-b383-4baa-870c-eb239ad4947a'} Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:12.507781 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. Aug 29 15:30:12.509343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.510916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-447fa29b-4076-42ae-a77b-f456642a6716 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Returning 404 to user: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:12.510916 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-447fa29b-4076-42ae-a77b-f456642a6716 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 404 len: 111 microversion: 2.1 time: 0.032507 Aug 29 15:30:12.510916 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 710/1404] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:12 2022] DELETE /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:30:12.516886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a29fe394-c901-4517-ab6a-485f7220ffec tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:12.517657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a29fe394-c901-4517-ab6a-485f7220ffec tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: a1ca5680-b383-4baa-870c-eb239ad4947a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:12.524618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a29fe394-c901-4517-ab6a-485f7220ffec tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.525407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a29fe394-c901-4517-ab6a-485f7220ffec tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.526036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a29fe394-c901-4517-ab6a-485f7220ffec tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:12.526872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a29fe394-c901-4517-ab6a-485f7220ffec tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.527493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a29fe394-c901-4517-ab6a-485f7220ffec tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.528105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a29fe394-c901-4517-ab6a-485f7220ffec tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:12.547019 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-a29fe394-c901-4517-ab6a-485f7220ffec tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] HTTP exception thrown: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a29fe394-c901-4517-ab6a-485f7220ffec tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Request method failure captured: Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a HTTP/1.1 Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNs2hOo7JBpZiQzvnNgHrIm1J9RGZ5UC6DpjgyVQYeerhSnofzxX7RAKfvmzU9UJlAY5oOh27yY87PJp21A-ORXMZr-RsqgruzLi4v_3gHlsQS4FiqFdaSIS_JF0QEF93l7efzdx0gUJW4VXji92y_AvcDUPtCPmksBIQOtHDvXg1bU Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:30:12.548570 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:30:12.550354 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7939dc6e747744dab4a60e547c6d9191", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}] Aug 29 15:30:12.550354 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.550354 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:12.550354 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.550354 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:12.550354 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:30:12.550354 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:30:12.550354 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 26faf4e7544842ad9dc66370ccba54fc Aug 29 15:30:12.550354 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:12.550354 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:30:12.550354 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. Aug 29 15:30:12.550354 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'a1ca5680-b383-4baa-870c-eb239ad4947a'} Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:12.551274 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. Aug 29 15:30:12.552529 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.553994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a29fe394-c901-4517-ab6a-485f7220ffec tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Returning 404 to user: Instance a1ca5680-b383-4baa-870c-eb239ad4947a could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:12.553994 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a29fe394-c901-4517-ab6a-485f7220ffec tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a" status: 404 len: 111 microversion: 2.1 time: 0.037159 Aug 29 15:30:12.553994 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 695/1405] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:12 2022] GET /compute/v2.1/servers/a1ca5680-b383-4baa-870c-eb239ad4947a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:12.564230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-47c58be5-2184-46e2-ab9a-6d09ec7c3601 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42b783b80>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:12.590475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG neutronclient.v2_0.client [None req-47c58be5-2184-46e2-ab9a-6d09ec7c3601 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 does not exist", "detail": ""}} {{(pid=122360) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:30:12.591077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.security_group_api [None req-47c58be5-2184-46e2-ab9a-6d09ec7c3601 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Neutron security group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 not found {{(pid=122360) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:30:12.591597 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-47c58be5-2184-46e2-ab9a-6d09ec7c3601 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] HTTP exception thrown: Security group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 does not exist Aug 29 15:30:12.591597 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-cd436b7b-04ea-410f-8bc4-a2e27dd3bfab'] Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-47c58be5-2184-46e2-ab9a-6d09ec7c3601 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Request method failure captured: Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/os-security-groups/7279f9cf-58f8-4553-ba63-76dcaa67c0b1 HTTP/1.1 Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNs2hOo7JBpZiQzvnNgHrIm1J9RGZ5UC6DpjgyVQYeerhSnofzxX7RAKfvmzU9UJlAY5oOh27yY87PJp21A-ORXMZr-RsqgruzLi4v_3gHlsQS4FiqFdaSIS_JF0QEF93l7efzdx0gUJW4VXji92y_AvcDUPtCPmksBIQOtHDvXg1bU Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:30:12.593472 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:30:12.595103 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7939dc6e747744dab4a60e547c6d9191", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}] Aug 29 15:30:12.595103 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.595103 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:12.595103 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.595103 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:12.595103 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:30:12.595103 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:30:12.595103 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 26faf4e7544842ad9dc66370ccba54fc Aug 29 15:30:12.595103 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:12.595103 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:30:12.595103 n-d-839401-11 devstack@n-api.service[122360]: exception: Security group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 does not exist Aug 29 15:30:12.595103 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-cd436b7b-04ea-410f-8bc4-a2e27dd3bfab'] Aug 29 15:30:12.595103 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7279f9cf-58f8-4553-ba63-76dcaa67c0b1'} Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.596152 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 does not exist Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd436b7b-04ea-410f-8bc4-a2e27dd3bfab'] Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:30:12.597645 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 does not exist Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd436b7b-04ea-410f-8bc4-a2e27dd3bfab'] Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 does not exist Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd436b7b-04ea-410f-8bc4-a2e27dd3bfab'] Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.599005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.600604 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:12.600604 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:12.600604 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:12.600604 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:12.600604 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 does not exist Aug 29 15:30:12.600604 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd436b7b-04ea-410f-8bc4-a2e27dd3bfab'] Aug 29 15:30:12.600604 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.602791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-47c58be5-2184-46e2-ab9a-6d09ec7c3601 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Returning 404 to user: Security group 7279f9cf-58f8-4553-ba63-76dcaa67c0b1 does not exist Aug 29 15:30:12.602791 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-cd436b7b-04ea-410f-8bc4-a2e27dd3bfab'] {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:12.603712 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-47c58be5-2184-46e2-ab9a-6d09ec7c3601 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/7279f9cf-58f8-4553-ba63-76dcaa67c0b1" status: 404 len: 194 microversion: 2.1 time: 0.046984 Aug 29 15:30:12.604264 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 711/1406] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:12 2022] DELETE /compute/v2.1/os-security-groups/7279f9cf-58f8-4553-ba63-76dcaa67c0b1 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:12.612700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-71d8d76e-c517-4541-b59b-b37c9ea7e225 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42b8cc9d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:12.639001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG neutronclient.v2_0.client [None req-71d8d76e-c517-4541-b59b-b37c9ea7e225 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 499ede52-296f-47d4-9588-096560e4d973 does not exist", "detail": ""}} {{(pid=122361) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:30:12.639607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.security_group_api [None req-71d8d76e-c517-4541-b59b-b37c9ea7e225 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Neutron security group 499ede52-296f-47d4-9588-096560e4d973 not found {{(pid=122361) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:30:12.640161 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-71d8d76e-c517-4541-b59b-b37c9ea7e225 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] HTTP exception thrown: Security group 499ede52-296f-47d4-9588-096560e4d973 does not exist Aug 29 15:30:12.640161 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-add0160a-68f7-4eac-9dd9-4a68c2e2a72f'] Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-71d8d76e-c517-4541-b59b-b37c9ea7e225 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Request method failure captured: Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/os-security-groups/499ede52-296f-47d4-9588-096560e4d973 HTTP/1.1 Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNs2hOo7JBpZiQzvnNgHrIm1J9RGZ5UC6DpjgyVQYeerhSnofzxX7RAKfvmzU9UJlAY5oOh27yY87PJp21A-ORXMZr-RsqgruzLi4v_3gHlsQS4FiqFdaSIS_JF0QEF93l7efzdx0gUJW4VXji92y_AvcDUPtCPmksBIQOtHDvXg1bU Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:30:12.642062 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:30:12.643720 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7939dc6e747744dab4a60e547c6d9191", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}] Aug 29 15:30:12.643720 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.643720 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:12.643720 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.643720 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:12.643720 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:30:12.643720 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:30:12.643720 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 26faf4e7544842ad9dc66370ccba54fc Aug 29 15:30:12.643720 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:12.643720 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:30:12.643720 n-d-839401-11 devstack@n-api.service[122361]: exception: Security group 499ede52-296f-47d4-9588-096560e4d973 does not exist Aug 29 15:30:12.643720 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-add0160a-68f7-4eac-9dd9-4a68c2e2a72f'] Aug 29 15:30:12.643720 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '499ede52-296f-47d4-9588-096560e4d973'} Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.644751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 499ede52-296f-47d4-9588-096560e4d973 does not exist Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-add0160a-68f7-4eac-9dd9-4a68c2e2a72f'] Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:30:12.648690 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 499ede52-296f-47d4-9588-096560e4d973 does not exist Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-add0160a-68f7-4eac-9dd9-4a68c2e2a72f'] Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 499ede52-296f-47d4-9588-096560e4d973 does not exist Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-add0160a-68f7-4eac-9dd9-4a68c2e2a72f'] Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.650093 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.651662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:12.651662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:12.651662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:12.651662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:12.651662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 499ede52-296f-47d4-9588-096560e4d973 does not exist Aug 29 15:30:12.651662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-add0160a-68f7-4eac-9dd9-4a68c2e2a72f'] Aug 29 15:30:12.651662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.651662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-71d8d76e-c517-4541-b59b-b37c9ea7e225 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Returning 404 to user: Security group 499ede52-296f-47d4-9588-096560e4d973 does not exist Aug 29 15:30:12.651662 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-add0160a-68f7-4eac-9dd9-4a68c2e2a72f'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:12.651662 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-71d8d76e-c517-4541-b59b-b37c9ea7e225 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/499ede52-296f-47d4-9588-096560e4d973" status: 404 len: 194 microversion: 2.1 time: 0.034996 Aug 29 15:30:12.651662 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 696/1407] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:12 2022] DELETE /compute/v2.1/os-security-groups/499ede52-296f-47d4-9588-096560e4d973 => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:12.653507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c150b0b-8644-41e1-bbca-b4f3df32e0dd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42b7db430>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:12.676637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG neutronclient.v2_0.client [None req-5c150b0b-8644-41e1-bbca-b4f3df32e0dd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 does not exist", "detail": ""}} {{(pid=122360) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:30:12.677287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.security_group_api [None req-5c150b0b-8644-41e1-bbca-b4f3df32e0dd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Neutron security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 not found {{(pid=122360) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:30:12.677808 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-5c150b0b-8644-41e1-bbca-b4f3df32e0dd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] HTTP exception thrown: Security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 does not exist Aug 29 15:30:12.677808 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-5f69b4fe-7db0-45c1-8944-4294137c0233'] Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c150b0b-8644-41e1-bbca-b4f3df32e0dd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Request method failure captured: Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/os-security-groups/ace6b282-b3d4-4d21-a0fc-6630dfe36276 HTTP/1.1 Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNs2hOo7JBpZiQzvnNgHrIm1J9RGZ5UC6DpjgyVQYeerhSnofzxX7RAKfvmzU9UJlAY5oOh27yY87PJp21A-ORXMZr-RsqgruzLi4v_3gHlsQS4FiqFdaSIS_JF0QEF93l7efzdx0gUJW4VXji92y_AvcDUPtCPmksBIQOtHDvXg1bU Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:30:12.679666 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:30:12.681411 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7939dc6e747744dab4a60e547c6d9191", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}] Aug 29 15:30:12.681411 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.681411 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:12.681411 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.681411 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:12.681411 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:30:12.681411 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:30:12.681411 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 26faf4e7544842ad9dc66370ccba54fc Aug 29 15:30:12.681411 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:12.681411 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:30:12.681411 n-d-839401-11 devstack@n-api.service[122360]: exception: Security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 does not exist Aug 29 15:30:12.681411 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-5f69b4fe-7db0-45c1-8944-4294137c0233'] Aug 29 15:30:12.681411 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'ace6b282-b3d4-4d21-a0fc-6630dfe36276'} Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.682342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 does not exist Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f69b4fe-7db0-45c1-8944-4294137c0233'] Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:30:12.683542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 does not exist Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f69b4fe-7db0-45c1-8944-4294137c0233'] Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 does not exist Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f69b4fe-7db0-45c1-8944-4294137c0233'] Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.685448 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.687839 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:12.687839 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:12.687839 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:12.687839 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:12.687839 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 does not exist Aug 29 15:30:12.687839 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f69b4fe-7db0-45c1-8944-4294137c0233'] Aug 29 15:30:12.687839 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.687839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c150b0b-8644-41e1-bbca-b4f3df32e0dd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Returning 404 to user: Security group ace6b282-b3d4-4d21-a0fc-6630dfe36276 does not exist Aug 29 15:30:12.687839 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-5f69b4fe-7db0-45c1-8944-4294137c0233'] {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:12.687839 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5c150b0b-8644-41e1-bbca-b4f3df32e0dd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/ace6b282-b3d4-4d21-a0fc-6630dfe36276" status: 404 len: 194 microversion: 2.1 time: 0.033328 Aug 29 15:30:12.687839 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 712/1408] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:12 2022] DELETE /compute/v2.1/os-security-groups/ace6b282-b3d4-4d21-a0fc-6630dfe36276 => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:12.691193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b44e24cf-b9a1-4a77-82db-91fe9f84b7ca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42baa7670>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:12.720188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG neutronclient.v2_0.client [None req-b44e24cf-b9a1-4a77-82db-91fe9f84b7ca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c9264a17-512e-4f3f-9c17-75602b68233a does not exist", "detail": ""}} {{(pid=122361) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:30:12.720824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.security_group_api [None req-b44e24cf-b9a1-4a77-82db-91fe9f84b7ca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Neutron security group c9264a17-512e-4f3f-9c17-75602b68233a not found {{(pid=122361) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:30:12.721505 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-b44e24cf-b9a1-4a77-82db-91fe9f84b7ca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] HTTP exception thrown: Security group c9264a17-512e-4f3f-9c17-75602b68233a does not exist Aug 29 15:30:12.721505 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-42b53215-afc7-4c15-abfb-be4216af5f52'] Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b44e24cf-b9a1-4a77-82db-91fe9f84b7ca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Request method failure captured: Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/os-security-groups/c9264a17-512e-4f3f-9c17-75602b68233a HTTP/1.1 Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNs2hOo7JBpZiQzvnNgHrIm1J9RGZ5UC6DpjgyVQYeerhSnofzxX7RAKfvmzU9UJlAY5oOh27yY87PJp21A-ORXMZr-RsqgruzLi4v_3gHlsQS4FiqFdaSIS_JF0QEF93l7efzdx0gUJW4VXji92y_AvcDUPtCPmksBIQOtHDvXg1bU Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:30:12.723415 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:30:12.724864 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7939dc6e747744dab4a60e547c6d9191", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}] Aug 29 15:30:12.724864 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.724864 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:12.724864 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.724864 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:12.724864 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:30:12.724864 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:30:12.724864 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 26faf4e7544842ad9dc66370ccba54fc Aug 29 15:30:12.724864 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:12.724864 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:30:12.724864 n-d-839401-11 devstack@n-api.service[122361]: exception: Security group c9264a17-512e-4f3f-9c17-75602b68233a does not exist Aug 29 15:30:12.724864 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-42b53215-afc7-4c15-abfb-be4216af5f52'] Aug 29 15:30:12.724864 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'c9264a17-512e-4f3f-9c17-75602b68233a'} Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.725894 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c9264a17-512e-4f3f-9c17-75602b68233a does not exist Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42b53215-afc7-4c15-abfb-be4216af5f52'] Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:30:12.727293 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c9264a17-512e-4f3f-9c17-75602b68233a does not exist Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42b53215-afc7-4c15-abfb-be4216af5f52'] Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c9264a17-512e-4f3f-9c17-75602b68233a does not exist Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42b53215-afc7-4c15-abfb-be4216af5f52'] Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.728587 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.731185 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:12.731185 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:12.731185 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:12.731185 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:12.731185 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c9264a17-512e-4f3f-9c17-75602b68233a does not exist Aug 29 15:30:12.731185 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42b53215-afc7-4c15-abfb-be4216af5f52'] Aug 29 15:30:12.731185 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.731185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b44e24cf-b9a1-4a77-82db-91fe9f84b7ca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Returning 404 to user: Security group c9264a17-512e-4f3f-9c17-75602b68233a does not exist Aug 29 15:30:12.731185 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-42b53215-afc7-4c15-abfb-be4216af5f52'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:12.731185 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b44e24cf-b9a1-4a77-82db-91fe9f84b7ca tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/c9264a17-512e-4f3f-9c17-75602b68233a" status: 404 len: 194 microversion: 2.1 time: 0.037590 Aug 29 15:30:12.731185 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 697/1409] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:12 2022] DELETE /compute/v2.1/os-security-groups/c9264a17-512e-4f3f-9c17-75602b68233a => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:12.736165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f859f0de-cf2a-482f-aff6-f6746fe287e5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42b7838b0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:12.760486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG neutronclient.v2_0.client [None req-f859f0de-cf2a-482f-aff6-f6746fe287e5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 does not exist", "detail": ""}} {{(pid=122360) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:30:12.761104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.security_group_api [None req-f859f0de-cf2a-482f-aff6-f6746fe287e5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Neutron security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 not found {{(pid=122360) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:30:12.761614 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-f859f0de-cf2a-482f-aff6-f6746fe287e5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] HTTP exception thrown: Security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 does not exist Aug 29 15:30:12.761614 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-9fabb401-62fe-47b1-96da-7b4ab64a9350'] Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f859f0de-cf2a-482f-aff6-f6746fe287e5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Request method failure captured: Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/os-security-groups/64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 HTTP/1.1 Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNs2hOo7JBpZiQzvnNgHrIm1J9RGZ5UC6DpjgyVQYeerhSnofzxX7RAKfvmzU9UJlAY5oOh27yY87PJp21A-ORXMZr-RsqgruzLi4v_3gHlsQS4FiqFdaSIS_JF0QEF93l7efzdx0gUJW4VXji92y_AvcDUPtCPmksBIQOtHDvXg1bU Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:30:12.763414 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:30:12.765023 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7939dc6e747744dab4a60e547c6d9191", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}] Aug 29 15:30:12.765023 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.765023 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:12.765023 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.765023 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:12.765023 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:30:12.765023 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:30:12.765023 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 26faf4e7544842ad9dc66370ccba54fc Aug 29 15:30:12.765023 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:12.765023 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:30:12.765023 n-d-839401-11 devstack@n-api.service[122360]: exception: Security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 does not exist Aug 29 15:30:12.765023 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-9fabb401-62fe-47b1-96da-7b4ab64a9350'] Aug 29 15:30:12.765023 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '64d7e9e7-d93d-4788-87cd-2b5ec5a23c87'} Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.769020 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 does not exist Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fabb401-62fe-47b1-96da-7b4ab64a9350'] Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:30:12.770276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 does not exist Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fabb401-62fe-47b1-96da-7b4ab64a9350'] Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 does not exist Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fabb401-62fe-47b1-96da-7b4ab64a9350'] Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.771562 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.772921 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:12.772921 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:12.772921 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:12.772921 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:12.772921 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 does not exist Aug 29 15:30:12.772921 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fabb401-62fe-47b1-96da-7b4ab64a9350'] Aug 29 15:30:12.772921 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.772921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f859f0de-cf2a-482f-aff6-f6746fe287e5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Returning 404 to user: Security group 64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 does not exist Aug 29 15:30:12.772921 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-9fabb401-62fe-47b1-96da-7b4ab64a9350'] {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:12.772921 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f859f0de-cf2a-482f-aff6-f6746fe287e5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/64d7e9e7-d93d-4788-87cd-2b5ec5a23c87" status: 404 len: 194 microversion: 2.1 time: 0.034685 Aug 29 15:30:12.772921 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 713/1410] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:12 2022] DELETE /compute/v2.1/os-security-groups/64d7e9e7-d93d-4788-87cd-2b5ec5a23c87 => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:12.778925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a1d728a7-4d5e-491f-9e0d-3b225ca42317 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42ba6f0d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:12.801828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG neutronclient.v2_0.client [None req-a1d728a7-4d5e-491f-9e0d-3b225ca42317 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e992aee0-2fea-4518-adbe-824c1a73a0c4 does not exist", "detail": ""}} {{(pid=122361) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:30:12.802394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.security_group_api [None req-a1d728a7-4d5e-491f-9e0d-3b225ca42317 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Neutron security group e992aee0-2fea-4518-adbe-824c1a73a0c4 not found {{(pid=122361) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:30:12.802909 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-a1d728a7-4d5e-491f-9e0d-3b225ca42317 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] HTTP exception thrown: Security group e992aee0-2fea-4518-adbe-824c1a73a0c4 does not exist Aug 29 15:30:12.802909 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-00b74bd5-842a-422b-a61f-f33367906bb0'] Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a1d728a7-4d5e-491f-9e0d-3b225ca42317 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Request method failure captured: Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/os-security-groups/e992aee0-2fea-4518-adbe-824c1a73a0c4 HTTP/1.1 Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNs2hOo7JBpZiQzvnNgHrIm1J9RGZ5UC6DpjgyVQYeerhSnofzxX7RAKfvmzU9UJlAY5oOh27yY87PJp21A-ORXMZr-RsqgruzLi4v_3gHlsQS4FiqFdaSIS_JF0QEF93l7efzdx0gUJW4VXji92y_AvcDUPtCPmksBIQOtHDvXg1bU Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:30:12.804716 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:30:12.806139 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7939dc6e747744dab4a60e547c6d9191", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}] Aug 29 15:30:12.806139 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.806139 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:12.806139 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:12.806139 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:12.806139 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:30:12.806139 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:30:12.806139 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 26faf4e7544842ad9dc66370ccba54fc Aug 29 15:30:12.806139 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:12.806139 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:30:12.806139 n-d-839401-11 devstack@n-api.service[122361]: exception: Security group e992aee0-2fea-4518-adbe-824c1a73a0c4 does not exist Aug 29 15:30:12.806139 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-00b74bd5-842a-422b-a61f-f33367906bb0'] Aug 29 15:30:12.806139 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'e992aee0-2fea-4518-adbe-824c1a73a0c4'} Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.807079 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e992aee0-2fea-4518-adbe-824c1a73a0c4 does not exist Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00b74bd5-842a-422b-a61f-f33367906bb0'] Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:30:12.810010 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e992aee0-2fea-4518-adbe-824c1a73a0c4 does not exist Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00b74bd5-842a-422b-a61f-f33367906bb0'] Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e992aee0-2fea-4518-adbe-824c1a73a0c4 does not exist Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00b74bd5-842a-422b-a61f-f33367906bb0'] Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.811467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:12.813169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:12.813169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:12.813169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:12.813169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:12.813169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e992aee0-2fea-4518-adbe-824c1a73a0c4 does not exist Aug 29 15:30:12.813169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00b74bd5-842a-422b-a61f-f33367906bb0'] Aug 29 15:30:12.813169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:12.813169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a1d728a7-4d5e-491f-9e0d-3b225ca42317 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Returning 404 to user: Security group e992aee0-2fea-4518-adbe-824c1a73a0c4 does not exist Aug 29 15:30:12.813169 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-00b74bd5-842a-422b-a61f-f33367906bb0'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:12.813169 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a1d728a7-4d5e-491f-9e0d-3b225ca42317 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/e992aee0-2fea-4518-adbe-824c1a73a0c4" status: 404 len: 194 microversion: 2.1 time: 0.031362 Aug 29 15:30:12.813169 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 698/1411] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:12 2022] DELETE /compute/v2.1/os-security-groups/e992aee0-2fea-4518-adbe-824c1a73a0c4 => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:12.822473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d4748fbf-afbd-4189-883a-47fceb0c5c76 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:12.822966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d4748fbf-afbd-4189-883a-47fceb0c5c76 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:12.831867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4748fbf-afbd-4189-883a-47fceb0c5c76 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.832387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4748fbf-afbd-4189-883a-47fceb0c5c76 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.832815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4748fbf-afbd-4189-883a-47fceb0c5c76 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:12.833541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4748fbf-afbd-4189-883a-47fceb0c5c76 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.834202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4748fbf-afbd-4189-883a-47fceb0c5c76 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.834806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4748fbf-afbd-4189-883a-47fceb0c5c76 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:12.860534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d4748fbf-afbd-4189-883a-47fceb0c5c76 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:12.923707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-38e06d2f-191e-44f1-b835-b23e620ad94f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:12.924367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-38e06d2f-191e-44f1-b835-b23e620ad94f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:12.932515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e06d2f-191e-44f1-b835-b23e620ad94f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.933454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e06d2f-191e-44f1-b835-b23e620ad94f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.934134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e06d2f-191e-44f1-b835-b23e620ad94f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:12.935062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e06d2f-191e-44f1-b835-b23e620ad94f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.935780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e06d2f-191e-44f1-b835-b23e620ad94f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.936427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e06d2f-191e-44f1-b835-b23e620ad94f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:12.948717 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d4748fbf-afbd-4189-883a-47fceb0c5c76 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 204 len: 0 microversion: 2.1 time: 0.130013 Aug 29 15:30:12.952770 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 714/1412] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:12 2022] DELETE /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:12.961939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-de1dfd0c-ea14-4782-85b9-2bc8d018afa0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:12.962639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-de1dfd0c-ea14-4782-85b9-2bc8d018afa0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:12.968895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de1dfd0c-ea14-4782-85b9-2bc8d018afa0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.969418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de1dfd0c-ea14-4782-85b9-2bc8d018afa0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.969856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de1dfd0c-ea14-4782-85b9-2bc8d018afa0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:12.970616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de1dfd0c-ea14-4782-85b9-2bc8d018afa0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:12.971074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de1dfd0c-ea14-4782-85b9-2bc8d018afa0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:12.971498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de1dfd0c-ea14-4782-85b9-2bc8d018afa0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:13.108720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-de1dfd0c-ea14-4782-85b9-2bc8d018afa0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:13.116816 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-de1dfd0c-ea14-4782-85b9-2bc8d018afa0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1520 microversion: 2.1 time: 0.164067 Aug 29 15:30:13.117408 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 715/1413] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:12 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:13.133167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0cf494ec-1564-4e61-b269-4cf28b91f618 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:13.133167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0cf494ec-1564-4e61-b269-4cf28b91f618 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:13.133167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cf494ec-1564-4e61-b269-4cf28b91f618 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:13.133167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cf494ec-1564-4e61-b269-4cf28b91f618 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:13.133575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cf494ec-1564-4e61-b269-4cf28b91f618 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:13.133575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cf494ec-1564-4e61-b269-4cf28b91f618 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:13.133575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cf494ec-1564-4e61-b269-4cf28b91f618 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:13.133575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cf494ec-1564-4e61-b269-4cf28b91f618 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:13.185840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-38e06d2f-191e-44f1-b835-b23e620ad94f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:13.194888 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-38e06d2f-191e-44f1-b835-b23e620ad94f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1472 microversion: 2.1 time: 0.278345 Aug 29 15:30:13.195996 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 699/1414] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:12 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1472 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:13.201181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eb555f77-7f06-4041-8e59-aaa8beeeb3c7 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Action: 'create', calling method: .version_select at 0x7fc42bb87d30>, body: {"pool": null} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:13.296802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0cf494ec-1564-4e61-b269-4cf28b91f618 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:13.305118 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0cf494ec-1564-4e61-b269-4cf28b91f618 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1647 microversion: 2.1 time: 0.186662 Aug 29 15:30:13.305968 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 716/1415] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:13 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1647 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:13.586355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-21340aa7-e18d-42c5-98e8-9d8fb04ed054 req-90acb63d-9a05-4b91-a742-e5341d66ff31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846c548e-ff1e-48f9-ac29-a5c464d824f5", "name": "network-vif-deleted", "tag": "ced95222-d171-4206-b2e5-08be8cf02bfb"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:13.596661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-21340aa7-e18d-42c5-98e8-9d8fb04ed054 req-90acb63d-9a05-4b91-a742-e5341d66ff31 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:13.597157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-21340aa7-e18d-42c5-98e8-9d8fb04ed054 req-90acb63d-9a05-4b91-a742-e5341d66ff31 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:13.597619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-21340aa7-e18d-42c5-98e8-9d8fb04ed054 req-90acb63d-9a05-4b91-a742-e5341d66ff31 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:13.609543 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-21340aa7-e18d-42c5-98e8-9d8fb04ed054 req-90acb63d-9a05-4b91-a742-e5341d66ff31 service nova] Creating event network-vif-deleted:ced95222-d171-4206-b2e5-08be8cf02bfb for instance 846c548e-ff1e-48f9-ac29-a5c464d824f5 on n-h1-839401-11 Aug 29 15:30:13.618863 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-21340aa7-e18d-42c5-98e8-9d8fb04ed054 req-90acb63d-9a05-4b91-a742-e5341d66ff31 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036059 Aug 29 15:30:13.619464 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 717/1416] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:30:14.218172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f2dc14cd-c8f5-4675-a72a-1a9481e2fe8d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:14.219008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f2dc14cd-c8f5-4675-a72a-1a9481e2fe8d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:14.226209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2dc14cd-c8f5-4675-a72a-1a9481e2fe8d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:14.226726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2dc14cd-c8f5-4675-a72a-1a9481e2fe8d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:14.227393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2dc14cd-c8f5-4675-a72a-1a9481e2fe8d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:14.228129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2dc14cd-c8f5-4675-a72a-1a9481e2fe8d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:14.228742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2dc14cd-c8f5-4675-a72a-1a9481e2fe8d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:14.230630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2dc14cd-c8f5-4675-a72a-1a9481e2fe8d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:14.266138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2dc14cd-c8f5-4675-a72a-1a9481e2fe8d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:14.266616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2dc14cd-c8f5-4675-a72a-1a9481e2fe8d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:14.267047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2dc14cd-c8f5-4675-a72a-1a9481e2fe8d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:14.267536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-f2dc14cd-c8f5-4675-a72a-1a9481e2fe8d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lazy-loading 'fault' on Instance uuid 846c548e-ff1e-48f9-ac29-a5c464d824f5 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:30:14.308733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f2dc14cd-c8f5-4675-a72a-1a9481e2fe8d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:14.319409 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f2dc14cd-c8f5-4675-a72a-1a9481e2fe8d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 200 len: 1306 microversion: 2.1 time: 0.105406 Aug 29 15:30:14.321170 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 718/1417] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:14 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 1306 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:14.338388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-78a38d3e-4ec1-490a-8bc9-316c6cb9bd0c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:14.339029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-78a38d3e-4ec1-490a-8bc9-316c6cb9bd0c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:14.345667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a38d3e-4ec1-490a-8bc9-316c6cb9bd0c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:14.346177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a38d3e-4ec1-490a-8bc9-316c6cb9bd0c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:14.346569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a38d3e-4ec1-490a-8bc9-316c6cb9bd0c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:14.347512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a38d3e-4ec1-490a-8bc9-316c6cb9bd0c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:14.347908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a38d3e-4ec1-490a-8bc9-316c6cb9bd0c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:14.348327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a38d3e-4ec1-490a-8bc9-316c6cb9bd0c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:14.513846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-78a38d3e-4ec1-490a-8bc9-316c6cb9bd0c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:14.532852 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eb555f77-7f06-4041-8e59-aaa8beeeb3c7 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.335499 Aug 29 15:30:14.534268 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 700/1418] 10.222.0.62 () {60 vars in 1170 bytes} [Mon Aug 29 15:30:13 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:14.537268 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-78a38d3e-4ec1-490a-8bc9-316c6cb9bd0c tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1647 microversion: 2.1 time: 0.202646 Aug 29 15:30:14.538417 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 719/1419] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:14 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1647 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:14.588304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-376910749", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "09630ca2-45d5-438d-9a4e-d0e239ea63e6"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:14.641480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] validate_networks() for [('09630ca2-45d5-438d-9a4e-d0e239ea63e6', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:30:15.216311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:30:15.216726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:30:15.217228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:30:15.217607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:30:15.218035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:30:15.227513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.228116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.228767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.229540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.229984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.230399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.247766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Getting quotas for project 0de1e6e8040d4d5f9ff87142c3c436bb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:30:15.253784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Getting quotas for user 9e11d7d908bf432d80589193031172c2 and project 0de1e6e8040d4d5f9ff87142c3c436bb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:30:15.266593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:30:15.268904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:30:15.316507 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-60020158-57fe-4a04-86d7-39d4cf3b9b9a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732060 Aug 29 15:30:15.323189 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 701/1420] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:30:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:30:15.328622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-04d72e70-2449-4c33-b996-7b283369d7e0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:15.329453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-04d72e70-2449-4c33-b996-7b283369d7e0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:15.341540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5ba04f30-8474-40d4-bfff-3c55d4d14da2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:15.342239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5ba04f30-8474-40d4-bfff-3c55d4d14da2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 846c548e-ff1e-48f9-ac29-a5c464d824f5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:15.348500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ba04f30-8474-40d4-bfff-3c55d4d14da2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.349063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ba04f30-8474-40d4-bfff-3c55d4d14da2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.349590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ba04f30-8474-40d4-bfff-3c55d4d14da2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.350490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ba04f30-8474-40d4-bfff-3c55d4d14da2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.351009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ba04f30-8474-40d4-bfff-3c55d4d14da2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.351495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ba04f30-8474-40d4-bfff-3c55d4d14da2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.371550 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-5ba04f30-8474-40d4-bfff-3c55d4d14da2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] HTTP exception thrown: Instance 846c548e-ff1e-48f9-ac29-a5c464d824f5 could not be found. Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5ba04f30-8474-40d4-bfff-3c55d4d14da2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Request method failure captured: Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 HTTP/1.1 Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNq0SJhI6ZUIRmnOodOt6ZcdThYB9l8hYe4x4UllXPkHKPbAG8XVvri1KtBrX7MZL6KxBneImUArYkpbtZog11x5uckGA6wz1ssepiosILg7S6-6SNa16IzeDtUVlQRc-OU8qelXOTLPaJvoplhrmvFb-m8a6TRO6xvQ_5_T5UY5kag Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 0393aa9c32934da4a9f478c563135bbb Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:30:15.373592 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:30:15.375187 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0393aa9c32934da4a9f478c563135bbb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0393aa9c32934da4a9f478c563135bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0393aa9c32934da4a9f478c563135bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0393aa9c32934da4a9f478c563135bbb"}]}] Aug 29 15:30:15.375187 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:15.375187 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 0393aa9c32934da4a9f478c563135bbb Aug 29 15:30:15.375187 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:15.375187 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersOnMultiNodesTest-900863548-project Aug 29 15:30:15.375187 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:30:15.375187 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:30:15.375187 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e80b373b91434aae8f358839628f3072 Aug 29 15:30:15.375187 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersOnMultiNodesTest-900863548-project Aug 29 15:30:15.375187 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:30:15.375187 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 846c548e-ff1e-48f9-ac29-a5c464d824f5 could not be found. Aug 29 15:30:15.375187 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '846c548e-ff1e-48f9-ac29-a5c464d824f5'} Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846c548e-ff1e-48f9-ac29-a5c464d824f5 could not be found. Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:15.376006 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846c548e-ff1e-48f9-ac29-a5c464d824f5 could not be found. Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846c548e-ff1e-48f9-ac29-a5c464d824f5 could not be found. Aug 29 15:30:15.377630 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:15.379030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5ba04f30-8474-40d4-bfff-3c55d4d14da2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Returning 404 to user: Instance 846c548e-ff1e-48f9-ac29-a5c464d824f5 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:15.379030 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5ba04f30-8474-40d4-bfff-3c55d4d14da2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5" status: 404 len: 111 microversion: 2.1 time: 0.038581 Aug 29 15:30:15.379030 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 702/1421] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:15 2022] GET /compute/v2.1/servers/846c548e-ff1e-48f9-ac29-a5c464d824f5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:30:15.385016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5f62e442-a731-49db-b7f5-16b6e1b7201a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:15.385591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5f62e442-a731-49db-b7f5-16b6e1b7201a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 340bdcfa-c954-4f51-941a-c4324800f6d8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:15.393659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f62e442-a731-49db-b7f5-16b6e1b7201a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.394326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f62e442-a731-49db-b7f5-16b6e1b7201a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.395022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f62e442-a731-49db-b7f5-16b6e1b7201a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.395902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f62e442-a731-49db-b7f5-16b6e1b7201a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.396497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f62e442-a731-49db-b7f5-16b6e1b7201a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.397079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f62e442-a731-49db-b7f5-16b6e1b7201a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.428462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5f62e442-a731-49db-b7f5-16b6e1b7201a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 340bdcfa-c954-4f51-941a-c4324800f6d8] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:15.430682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-04d72e70-2449-4c33-b996-7b283369d7e0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:15.440513 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-04d72e70-2449-4c33-b996-7b283369d7e0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 200 len: 1223 microversion: 2.1 time: 0.116044 Aug 29 15:30:15.442974 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 720/1422] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:15 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 1223 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:15.562893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-74a22ddc-aeff-442b-85c1-fcd5b35dbfdd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:15.563270 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5f62e442-a731-49db-b7f5-16b6e1b7201a tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "DELETE /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8" status: 204 len: 0 microversion: 2.1 time: 0.183417 Aug 29 15:30:15.564048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-74a22ddc-aeff-442b-85c1-fcd5b35dbfdd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:15.565279 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 703/1423] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:15 2022] DELETE /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:30:15.578001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a22bf54-444c-4eb3-95ef-f467d6224c92 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:15.579011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74a22ddc-aeff-442b-85c1-fcd5b35dbfdd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.579526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a22bf54-444c-4eb3-95ef-f467d6224c92 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:15.579867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74a22ddc-aeff-442b-85c1-fcd5b35dbfdd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.580652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74a22ddc-aeff-442b-85c1-fcd5b35dbfdd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.581673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74a22ddc-aeff-442b-85c1-fcd5b35dbfdd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.582396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74a22ddc-aeff-442b-85c1-fcd5b35dbfdd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.583305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74a22ddc-aeff-442b-85c1-fcd5b35dbfdd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.590822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a22bf54-444c-4eb3-95ef-f467d6224c92 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.593354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a22bf54-444c-4eb3-95ef-f467d6224c92 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.594245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a22bf54-444c-4eb3-95ef-f467d6224c92 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.596556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a22bf54-444c-4eb3-95ef-f467d6224c92 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.597597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a22bf54-444c-4eb3-95ef-f467d6224c92 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.598563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a22bf54-444c-4eb3-95ef-f467d6224c92 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.648872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a22bf54-444c-4eb3-95ef-f467d6224c92 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:15.679698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-74a22ddc-aeff-442b-85c1-fcd5b35dbfdd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:15.688312 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-74a22ddc-aeff-442b-85c1-fcd5b35dbfdd tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1301 microversion: 2.1 time: 0.131218 Aug 29 15:30:15.693241 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 721/1424] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:15 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1301 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:15.697466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-ddb68ed7-b45a-493f-acbf-5eedb126c3bd req-79c93bea-cee0-4158-96d8-3d945775815b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf2f2e5-da5a-47bc-920c-d105a88b2847", "name": "network-vif-deleted", "tag": "868a1bf9-0936-4b9a-a3ed-373847b74389"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:15.709373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ddb68ed7-b45a-493f-acbf-5eedb126c3bd req-79c93bea-cee0-4158-96d8-3d945775815b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.710086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ddb68ed7-b45a-493f-acbf-5eedb126c3bd req-79c93bea-cee0-4158-96d8-3d945775815b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.710732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ddb68ed7-b45a-493f-acbf-5eedb126c3bd req-79c93bea-cee0-4158-96d8-3d945775815b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.715620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:15.724141 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-ddb68ed7-b45a-493f-acbf-5eedb126c3bd req-79c93bea-cee0-4158-96d8-3d945775815b service nova] Creating event network-vif-deleted:868a1bf9-0936-4b9a-a3ed-373847b74389 for instance 8bf2f2e5-da5a-47bc-920c-d105a88b2847 on n-h2-839401-11 Aug 29 15:30:15.730787 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-ddb68ed7-b45a-493f-acbf-5eedb126c3bd req-79c93bea-cee0-4158-96d8-3d945775815b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039955 Aug 29 15:30:15.731624 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 722/1425] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:15.748536 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5a22bf54-444c-4eb3-95ef-f467d6224c92 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "DELETE /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 204 len: 0 microversion: 2.1 time: 0.179739 Aug 29 15:30:15.749160 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 704/1426] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:15 2022] DELETE /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:30:15.757947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-29e1b4e5-ad19-4c4f-a94a-51994c116c52 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:15.758661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-29e1b4e5-ad19-4c4f-a94a-51994c116c52 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 340bdcfa-c954-4f51-941a-c4324800f6d8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:15.765931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29e1b4e5-ad19-4c4f-a94a-51994c116c52 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.766353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29e1b4e5-ad19-4c4f-a94a-51994c116c52 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.766774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29e1b4e5-ad19-4c4f-a94a-51994c116c52 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.767539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29e1b4e5-ad19-4c4f-a94a-51994c116c52 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:15.768025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29e1b4e5-ad19-4c4f-a94a-51994c116c52 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:15.768422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29e1b4e5-ad19-4c4f-a94a-51994c116c52 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:15.931129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-29e1b4e5-ad19-4c4f-a94a-51994c116c52 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:15.940520 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-29e1b4e5-ad19-4c4f-a94a-51994c116c52 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8" status: 200 len: 1473 microversion: 2.1 time: 0.186728 Aug 29 15:30:15.941145 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 723/1427] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:15 2022] GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8 => generated 1473 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:16.465394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2eccf3b3-fbdb-4ee0-bf27-e6a456cc5636 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:16.466253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2eccf3b3-fbdb-4ee0-bf27-e6a456cc5636 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:16.474500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eccf3b3-fbdb-4ee0-bf27-e6a456cc5636 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:16.475103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eccf3b3-fbdb-4ee0-bf27-e6a456cc5636 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:16.475650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eccf3b3-fbdb-4ee0-bf27-e6a456cc5636 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:16.476521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eccf3b3-fbdb-4ee0-bf27-e6a456cc5636 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:16.477116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eccf3b3-fbdb-4ee0-bf27-e6a456cc5636 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:16.477653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eccf3b3-fbdb-4ee0-bf27-e6a456cc5636 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:16.543638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2eccf3b3-fbdb-4ee0-bf27-e6a456cc5636 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:16.551705 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2eccf3b3-fbdb-4ee0-bf27-e6a456cc5636 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 200 len: 1227 microversion: 2.1 time: 0.091726 Aug 29 15:30:16.552304 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 705/1428] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:16 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 1227 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:16.711064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-10ba7234-8f03-476d-90ea-0cc94e14ede5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:16.711648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-10ba7234-8f03-476d-90ea-0cc94e14ede5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:16.718919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10ba7234-8f03-476d-90ea-0cc94e14ede5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:16.719401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10ba7234-8f03-476d-90ea-0cc94e14ede5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:16.719835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10ba7234-8f03-476d-90ea-0cc94e14ede5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:16.720570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10ba7234-8f03-476d-90ea-0cc94e14ede5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:16.721025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10ba7234-8f03-476d-90ea-0cc94e14ede5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:16.721489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10ba7234-8f03-476d-90ea-0cc94e14ede5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:16.785412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-10ba7234-8f03-476d-90ea-0cc94e14ede5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:16.794608 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-10ba7234-8f03-476d-90ea-0cc94e14ede5 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1301 microversion: 2.1 time: 0.087154 Aug 29 15:30:16.795129 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 724/1429] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:16 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1301 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:16.963434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5beca1ba-1df2-477d-86da-b7764ade3018 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:16.964049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5beca1ba-1df2-477d-86da-b7764ade3018 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 340bdcfa-c954-4f51-941a-c4324800f6d8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:16.970271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5beca1ba-1df2-477d-86da-b7764ade3018 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:16.970807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5beca1ba-1df2-477d-86da-b7764ade3018 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:16.971251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5beca1ba-1df2-477d-86da-b7764ade3018 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:16.971952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5beca1ba-1df2-477d-86da-b7764ade3018 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:16.972414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5beca1ba-1df2-477d-86da-b7764ade3018 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:16.972845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5beca1ba-1df2-477d-86da-b7764ade3018 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:16.975556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:17.127588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5beca1ba-1df2-477d-86da-b7764ade3018 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:17.135687 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5beca1ba-1df2-477d-86da-b7764ade3018 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8" status: 200 len: 1473 microversion: 2.1 time: 0.176418 Aug 29 15:30:17.136265 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 706/1430] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:16 2022] GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8 => generated 1473 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:17.572181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3a020f5f-4a5d-48c3-ab19-7da1293f9409 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:17.572797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3a020f5f-4a5d-48c3-ab19-7da1293f9409 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:17.579363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a020f5f-4a5d-48c3-ab19-7da1293f9409 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:17.579853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a020f5f-4a5d-48c3-ab19-7da1293f9409 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:17.580289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a020f5f-4a5d-48c3-ab19-7da1293f9409 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:17.581049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a020f5f-4a5d-48c3-ab19-7da1293f9409 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:17.581487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a020f5f-4a5d-48c3-ab19-7da1293f9409 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:17.581914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a020f5f-4a5d-48c3-ab19-7da1293f9409 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:17.648775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3a020f5f-4a5d-48c3-ab19-7da1293f9409 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:17.658558 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3a020f5f-4a5d-48c3-ab19-7da1293f9409 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 200 len: 1275 microversion: 2.1 time: 0.090301 Aug 29 15:30:17.659110 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 725/1431] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:17 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 1275 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:17.820115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-55606058-6fab-4426-8944-589c4e541b8e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:17.820831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-55606058-6fab-4426-8944-589c4e541b8e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:17.837867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55606058-6fab-4426-8944-589c4e541b8e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:17.838483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55606058-6fab-4426-8944-589c4e541b8e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:17.839074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55606058-6fab-4426-8944-589c4e541b8e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:17.839886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55606058-6fab-4426-8944-589c4e541b8e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:17.848313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55606058-6fab-4426-8944-589c4e541b8e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:17.848799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55606058-6fab-4426-8944-589c4e541b8e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:17.900243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55606058-6fab-4426-8944-589c4e541b8e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:17.900733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55606058-6fab-4426-8944-589c4e541b8e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:17.901376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55606058-6fab-4426-8944-589c4e541b8e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:17.902585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-55606058-6fab-4426-8944-589c4e541b8e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lazy-loading 'fault' on Instance uuid 8bf2f2e5-da5a-47bc-920c-d105a88b2847 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:30:17.983078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-55606058-6fab-4426-8944-589c4e541b8e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26faf4e7544842ad9dc66370ccba54fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7939dc6e747744dab4a60e547c6d9191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:17.991632 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-55606058-6fab-4426-8944-589c4e541b8e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 200 len: 1306 microversion: 2.1 time: 0.176426 Aug 29 15:30:17.992221 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 707/1432] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:17 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 1306 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:18.156914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a4594a26-ed7b-4a96-9bb8-fd979b28c0d2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:18.157565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a4594a26-ed7b-4a96-9bb8-fd979b28c0d2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 340bdcfa-c954-4f51-941a-c4324800f6d8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:18.164915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4594a26-ed7b-4a96-9bb8-fd979b28c0d2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:18.165469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4594a26-ed7b-4a96-9bb8-fd979b28c0d2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:18.165917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4594a26-ed7b-4a96-9bb8-fd979b28c0d2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:18.166654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4594a26-ed7b-4a96-9bb8-fd979b28c0d2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:18.167109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4594a26-ed7b-4a96-9bb8-fd979b28c0d2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:18.167528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4594a26-ed7b-4a96-9bb8-fd979b28c0d2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:18.310874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a4594a26-ed7b-4a96-9bb8-fd979b28c0d2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:18.319514 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a4594a26-ed7b-4a96-9bb8-fd979b28c0d2 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8" status: 200 len: 1473 microversion: 2.1 time: 0.167202 Aug 29 15:30:18.320514 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 726/1433] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:18 2022] GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8 => generated 1473 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:18.680783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2fa12b05-17f1-467f-9406-25c84495262c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:18.681868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2fa12b05-17f1-467f-9406-25c84495262c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:18.690803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fa12b05-17f1-467f-9406-25c84495262c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:18.691767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fa12b05-17f1-467f-9406-25c84495262c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:18.692366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fa12b05-17f1-467f-9406-25c84495262c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:18.693133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fa12b05-17f1-467f-9406-25c84495262c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:18.693758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fa12b05-17f1-467f-9406-25c84495262c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:18.694190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fa12b05-17f1-467f-9406-25c84495262c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:18.766330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-1c5b2282-c69a-42f1-a975-2f4ae7b0877e req-ae821807-1b72-443a-a408-d2354c88a07f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "789a7b2e-44e3-453f-9ee3-0656d92773f6", "name": "network-vif-deleted", "tag": "b927a394-a17e-4e31-89a0-4093856ef8a5"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:18.776175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1c5b2282-c69a-42f1-a975-2f4ae7b0877e req-ae821807-1b72-443a-a408-d2354c88a07f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:18.776954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1c5b2282-c69a-42f1-a975-2f4ae7b0877e req-ae821807-1b72-443a-a408-d2354c88a07f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:18.777570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1c5b2282-c69a-42f1-a975-2f4ae7b0877e req-ae821807-1b72-443a-a408-d2354c88a07f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:18.795245 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-1c5b2282-c69a-42f1-a975-2f4ae7b0877e req-ae821807-1b72-443a-a408-d2354c88a07f service nova] Creating event network-vif-deleted:b927a394-a17e-4e31-89a0-4093856ef8a5 for instance 789a7b2e-44e3-453f-9ee3-0656d92773f6 on n-h1-839401-11 Aug 29 15:30:18.800321 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-1c5b2282-c69a-42f1-a975-2f4ae7b0877e req-ae821807-1b72-443a-a408-d2354c88a07f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037753 Aug 29 15:30:18.800939 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 727/1434] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:18.840527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2fa12b05-17f1-467f-9406-25c84495262c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:18.863837 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2fa12b05-17f1-467f-9406-25c84495262c tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 200 len: 1281 microversion: 2.1 time: 0.187591 Aug 29 15:30:18.865145 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 708/1435] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:18 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 1281 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:19.012220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7e59e5f1-5440-4ae9-8e14-8df8a0b5528e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:19.012919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7e59e5f1-5440-4ae9-8e14-8df8a0b5528e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] [instance: 8bf2f2e5-da5a-47bc-920c-d105a88b2847] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:19.021304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e59e5f1-5440-4ae9-8e14-8df8a0b5528e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:19.021715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e59e5f1-5440-4ae9-8e14-8df8a0b5528e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:19.022149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e59e5f1-5440-4ae9-8e14-8df8a0b5528e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:19.022888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e59e5f1-5440-4ae9-8e14-8df8a0b5528e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:19.023360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e59e5f1-5440-4ae9-8e14-8df8a0b5528e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:19.031368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e59e5f1-5440-4ae9-8e14-8df8a0b5528e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:19.055647 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-7e59e5f1-5440-4ae9-8e14-8df8a0b5528e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] HTTP exception thrown: Instance 8bf2f2e5-da5a-47bc-920c-d105a88b2847 could not be found. Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7e59e5f1-5440-4ae9-8e14-8df8a0b5528e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Request method failure captured: Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 HTTP/1.1 Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNs2hOo7JBpZiQzvnNgHrIm1J9RGZ5UC6DpjgyVQYeerhSnofzxX7RAKfvmzU9UJlAY5oOh27yY87PJp21A-ORXMZr-RsqgruzLi4v_3gHlsQS4FiqFdaSIS_JF0QEF93l7efzdx0gUJW4VXji92y_AvcDUPtCPmksBIQOtHDvXg1bU Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:30:19.057351 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:30:19.059021 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7939dc6e747744dab4a60e547c6d9191", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7939dc6e747744dab4a60e547c6d9191"}]}] Aug 29 15:30:19.059021 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:19.059021 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 7939dc6e747744dab4a60e547c6d9191 Aug 29 15:30:19.059021 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1493646533 Aug 29 15:30:19.059021 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:19.059021 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:30:19.059021 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:30:19.059021 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 26faf4e7544842ad9dc66370ccba54fc Aug 29 15:30:19.059021 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-SecurityGroupsTestJSON-1493646533-project Aug 29 15:30:19.059021 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:30:19.059021 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 8bf2f2e5-da5a-47bc-920c-d105a88b2847 could not be found. Aug 29 15:30:19.059021 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '8bf2f2e5-da5a-47bc-920c-d105a88b2847'} Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bf2f2e5-da5a-47bc-920c-d105a88b2847 could not be found. Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:19.059993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bf2f2e5-da5a-47bc-920c-d105a88b2847 could not be found. Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bf2f2e5-da5a-47bc-920c-d105a88b2847 could not be found. Aug 29 15:30:19.061572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:19.062978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7e59e5f1-5440-4ae9-8e14-8df8a0b5528e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Returning 404 to user: Instance 8bf2f2e5-da5a-47bc-920c-d105a88b2847 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:19.065124 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7e59e5f1-5440-4ae9-8e14-8df8a0b5528e tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847" status: 404 len: 111 microversion: 2.1 time: 0.050807 Aug 29 15:30:19.065679 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 728/1436] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:19 2022] GET /compute/v2.1/servers/8bf2f2e5-da5a-47bc-920c-d105a88b2847 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:19.074280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a1ecb2ed-d9aa-41d0-bc39-edde8ccedb29 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42b989940>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:19.340914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fb3a72ea-d979-4dc0-8938-7c16b4ef8066 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:19.342503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fb3a72ea-d979-4dc0-8938-7c16b4ef8066 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 340bdcfa-c954-4f51-941a-c4324800f6d8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:19.352352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb3a72ea-d979-4dc0-8938-7c16b4ef8066 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:19.353333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb3a72ea-d979-4dc0-8938-7c16b4ef8066 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:19.353922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb3a72ea-d979-4dc0-8938-7c16b4ef8066 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:19.362435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb3a72ea-d979-4dc0-8938-7c16b4ef8066 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:19.365128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb3a72ea-d979-4dc0-8938-7c16b4ef8066 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:19.369174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb3a72ea-d979-4dc0-8938-7c16b4ef8066 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:19.427080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb3a72ea-d979-4dc0-8938-7c16b4ef8066 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:19.427664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb3a72ea-d979-4dc0-8938-7c16b4ef8066 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:19.429612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb3a72ea-d979-4dc0-8938-7c16b4ef8066 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:19.430542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-fb3a72ea-d979-4dc0-8938-7c16b4ef8066 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lazy-loading 'fault' on Instance uuid 340bdcfa-c954-4f51-941a-c4324800f6d8 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:30:19.478479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fb3a72ea-d979-4dc0-8938-7c16b4ef8066 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:19.488193 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fb3a72ea-d979-4dc0-8938-7c16b4ef8066 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8" status: 200 len: 1308 microversion: 2.1 time: 0.152303 Aug 29 15:30:19.494037 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 729/1437] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:19 2022] GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8 => generated 1308 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:19.514877 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a1ecb2ed-d9aa-41d0-bc39-edde8ccedb29 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/ccfea317-b3e9-4b77-a205-5c0dc82f88cf" status: 202 len: 0 microversion: 2.1 time: 0.444578 Aug 29 15:30:19.515479 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 709/1438] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:19 2022] DELETE /compute/v2.1/os-security-groups/ccfea317-b3e9-4b77-a205-5c0dc82f88cf => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:30:19.523976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-09208354-f427-433c-8485-c8e6975e3d88 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] Calling method '.version_select at 0x7fc42b786ca0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:19.781121 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-09208354-f427-433c-8485-c8e6975e3d88 tempest-SecurityGroupsTestJSON-1493646533 tempest-SecurityGroupsTestJSON-1493646533-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/304bb24c-0421-4066-9ce6-21d051f6f050" status: 202 len: 0 microversion: 2.1 time: 0.261057 Aug 29 15:30:19.796062 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 730/1439] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:30:19 2022] DELETE /compute/v2.1/os-security-groups/304bb24c-0421-4066-9ce6-21d051f6f050 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:30:19.890523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f9e7ae64-5c28-41ed-9cc5-4ae54f5ae437 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:19.891138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f9e7ae64-5c28-41ed-9cc5-4ae54f5ae437 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:19.898496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9e7ae64-5c28-41ed-9cc5-4ae54f5ae437 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:19.899309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9e7ae64-5c28-41ed-9cc5-4ae54f5ae437 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:19.900101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9e7ae64-5c28-41ed-9cc5-4ae54f5ae437 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:19.901737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9e7ae64-5c28-41ed-9cc5-4ae54f5ae437 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:19.904877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9e7ae64-5c28-41ed-9cc5-4ae54f5ae437 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:19.909096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9e7ae64-5c28-41ed-9cc5-4ae54f5ae437 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:20.482411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f9e7ae64-5c28-41ed-9cc5-4ae54f5ae437 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:20.490374 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f9e7ae64-5c28-41ed-9cc5-4ae54f5ae437 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 200 len: 1323 microversion: 2.1 time: 0.609177 Aug 29 15:30:20.491357 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 710/1440] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:19 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 1323 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:20.509859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-613de34f-3f68-4284-965f-21d59c380c93 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:20.510464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-613de34f-3f68-4284-965f-21d59c380c93 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 340bdcfa-c954-4f51-941a-c4324800f6d8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:20.516701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-613de34f-3f68-4284-965f-21d59c380c93 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:20.517463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-613de34f-3f68-4284-965f-21d59c380c93 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:20.518053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-613de34f-3f68-4284-965f-21d59c380c93 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:20.518930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-613de34f-3f68-4284-965f-21d59c380c93 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:20.519536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-613de34f-3f68-4284-965f-21d59c380c93 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:20.520110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-613de34f-3f68-4284-965f-21d59c380c93 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:20.538109 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-613de34f-3f68-4284-965f-21d59c380c93 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] HTTP exception thrown: Instance 340bdcfa-c954-4f51-941a-c4324800f6d8 could not be found. Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-613de34f-3f68-4284-965f-21d59c380c93 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Request method failure captured: Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8 HTTP/1.1 Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNq0SJhI6ZUIRmnOodOt6ZcdThYB9l8hYe4x4UllXPkHKPbAG8XVvri1KtBrX7MZL6KxBneImUArYkpbtZog11x5uckGA6wz1ssepiosILg7S6-6SNa16IzeDtUVlQRc-OU8qelXOTLPaJvoplhrmvFb-m8a6TRO6xvQ_5_T5UY5kag Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 0393aa9c32934da4a9f478c563135bbb Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:30:20.540075 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:30:20.541808 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0393aa9c32934da4a9f478c563135bbb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0393aa9c32934da4a9f478c563135bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0393aa9c32934da4a9f478c563135bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0393aa9c32934da4a9f478c563135bbb"}]}] Aug 29 15:30:20.541808 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:20.541808 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 0393aa9c32934da4a9f478c563135bbb Aug 29 15:30:20.541808 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:20.541808 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersOnMultiNodesTest-900863548-project Aug 29 15:30:20.541808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:30:20.541808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:30:20.541808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e80b373b91434aae8f358839628f3072 Aug 29 15:30:20.541808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersOnMultiNodesTest-900863548-project Aug 29 15:30:20.541808 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:30:20.541808 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 340bdcfa-c954-4f51-941a-c4324800f6d8 could not be found. Aug 29 15:30:20.541808 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '340bdcfa-c954-4f51-941a-c4324800f6d8'} Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 340bdcfa-c954-4f51-941a-c4324800f6d8 could not be found. Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:20.542759 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 340bdcfa-c954-4f51-941a-c4324800f6d8 could not be found. Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 340bdcfa-c954-4f51-941a-c4324800f6d8 could not be found. Aug 29 15:30:20.544248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:20.547973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-613de34f-3f68-4284-965f-21d59c380c93 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Returning 404 to user: Instance 340bdcfa-c954-4f51-941a-c4324800f6d8 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:20.549077 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-613de34f-3f68-4284-965f-21d59c380c93 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8" status: 404 len: 111 microversion: 2.1 time: 0.044010 Aug 29 15:30:20.550173 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 731/1441] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:20 2022] GET /compute/v2.1/servers/340bdcfa-c954-4f51-941a-c4324800f6d8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:20.558350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eca69a08-5907-41b2-a59c-baf164530261 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:20.558991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eca69a08-5907-41b2-a59c-baf164530261 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 789a7b2e-44e3-453f-9ee3-0656d92773f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:20.562249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=5,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:20.567053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca69a08-5907-41b2-a59c-baf164530261 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:20.567749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca69a08-5907-41b2-a59c-baf164530261 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:20.568342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca69a08-5907-41b2-a59c-baf164530261 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:20.569329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca69a08-5907-41b2-a59c-baf164530261 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:20.569790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca69a08-5907-41b2-a59c-baf164530261 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:20.570395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca69a08-5907-41b2-a59c-baf164530261 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:20.587421 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-eca69a08-5907-41b2-a59c-baf164530261 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] HTTP exception thrown: Instance 789a7b2e-44e3-453f-9ee3-0656d92773f6 could not be found. Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eca69a08-5907-41b2-a59c-baf164530261 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Request method failure captured: Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 HTTP/1.1 Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNq0SJhI6ZUIRmnOodOt6ZcdThYB9l8hYe4x4UllXPkHKPbAG8XVvri1KtBrX7MZL6KxBneImUArYkpbtZog11x5uckGA6wz1ssepiosILg7S6-6SNa16IzeDtUVlQRc-OU8qelXOTLPaJvoplhrmvFb-m8a6TRO6xvQ_5_T5UY5kag Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 0393aa9c32934da4a9f478c563135bbb Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:30:20.589414 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:30:20.591057 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0393aa9c32934da4a9f478c563135bbb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0393aa9c32934da4a9f478c563135bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0393aa9c32934da4a9f478c563135bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0393aa9c32934da4a9f478c563135bbb"}]}] Aug 29 15:30:20.591057 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:20.591057 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 0393aa9c32934da4a9f478c563135bbb Aug 29 15:30:20.591057 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:20.591057 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersOnMultiNodesTest-900863548-project Aug 29 15:30:20.591057 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:30:20.591057 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:30:20.591057 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e80b373b91434aae8f358839628f3072 Aug 29 15:30:20.591057 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersOnMultiNodesTest-900863548-project Aug 29 15:30:20.591057 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:30:20.591057 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 789a7b2e-44e3-453f-9ee3-0656d92773f6 could not be found. Aug 29 15:30:20.591057 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '789a7b2e-44e3-453f-9ee3-0656d92773f6'} Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 789a7b2e-44e3-453f-9ee3-0656d92773f6 could not be found. Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:20.591984 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 789a7b2e-44e3-453f-9ee3-0656d92773f6 could not be found. Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 789a7b2e-44e3-453f-9ee3-0656d92773f6 could not be found. Aug 29 15:30:20.593511 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:20.596214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eca69a08-5907-41b2-a59c-baf164530261 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Returning 404 to user: Instance 789a7b2e-44e3-453f-9ee3-0656d92773f6 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:20.597280 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eca69a08-5907-41b2-a59c-baf164530261 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6" status: 404 len: 111 microversion: 2.1 time: 0.043033 Aug 29 15:30:20.601560 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 711/1442] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:20 2022] GET /compute/v2.1/servers/789a7b2e-44e3-453f-9ee3-0656d92773f6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:20.606365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9f04ed91-0b85-452a-ba7d-b02f85ac770e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:20.648255 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9f04ed91-0b85-452a-ba7d-b02f85ac770e tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "DELETE /compute/v2.1/os-server-groups/01e17389-4ffc-405a-88d9-6586c585fcb9" status: 204 len: 0 microversion: 2.1 time: 0.045472 Aug 29 15:30:20.652633 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 732/1443] 10.222.0.62 () {58 vars in 1266 bytes} [Mon Aug 29 15:30:20 2022] DELETE /compute/v2.1/os-server-groups/01e17389-4ffc-405a-88d9-6586c585fcb9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:30:20.665358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8d560bb3-a994-4226-aaf1-9b9a7d7b21e0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:20.665975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8d560bb3-a994-4226-aaf1-9b9a7d7b21e0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 039c62b6-55e7-4b8a-bf96-c079addd6fe6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:20.675023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d560bb3-a994-4226-aaf1-9b9a7d7b21e0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:20.675540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d560bb3-a994-4226-aaf1-9b9a7d7b21e0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:20.675991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d560bb3-a994-4226-aaf1-9b9a7d7b21e0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:20.677462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d560bb3-a994-4226-aaf1-9b9a7d7b21e0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:20.678432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d560bb3-a994-4226-aaf1-9b9a7d7b21e0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:20.678912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d560bb3-a994-4226-aaf1-9b9a7d7b21e0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:20.707962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8d560bb3-a994-4226-aaf1-9b9a7d7b21e0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 039c62b6-55e7-4b8a-bf96-c079addd6fe6] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:20.805775 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8d560bb3-a994-4226-aaf1-9b9a7d7b21e0 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "DELETE /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6" status: 204 len: 0 microversion: 2.1 time: 0.151213 Aug 29 15:30:20.807272 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 712/1444] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:20 2022] DELETE /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:20.816374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-90445cbe-b91f-4820-8ccb-b3eb78bbcf02 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:20.817111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-90445cbe-b91f-4820-8ccb-b3eb78bbcf02 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:20.824216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90445cbe-b91f-4820-8ccb-b3eb78bbcf02 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:20.824711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90445cbe-b91f-4820-8ccb-b3eb78bbcf02 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:20.825705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90445cbe-b91f-4820-8ccb-b3eb78bbcf02 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:20.825891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90445cbe-b91f-4820-8ccb-b3eb78bbcf02 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:20.826345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90445cbe-b91f-4820-8ccb-b3eb78bbcf02 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:20.826775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90445cbe-b91f-4820-8ccb-b3eb78bbcf02 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:20.836842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-5cc42e85-e655-4b96-8acb-9103e4f7d2e7 req-587b074b-d112-4971-8320-32be15acaaa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340bdcfa-c954-4f51-941a-c4324800f6d8", "name": "network-vif-deleted", "tag": "641712b3-932e-44d2-85a3-694a0a38de21"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:20.849592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5cc42e85-e655-4b96-8acb-9103e4f7d2e7 req-587b074b-d112-4971-8320-32be15acaaa9 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:20.849743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5cc42e85-e655-4b96-8acb-9103e4f7d2e7 req-587b074b-d112-4971-8320-32be15acaaa9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:20.850182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5cc42e85-e655-4b96-8acb-9103e4f7d2e7 req-587b074b-d112-4971-8320-32be15acaaa9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:20.866731 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5cc42e85-e655-4b96-8acb-9103e4f7d2e7 req-587b074b-d112-4971-8320-32be15acaaa9 service nova] Creating event network-vif-deleted:641712b3-932e-44d2-85a3-694a0a38de21 for instance 340bdcfa-c954-4f51-941a-c4324800f6d8 on n-h2-839401-11 Aug 29 15:30:20.872632 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-5cc42e85-e655-4b96-8acb-9103e4f7d2e7 req-587b074b-d112-4971-8320-32be15acaaa9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041268 Aug 29 15:30:20.873738 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 713/1445] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:20.895078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-90445cbe-b91f-4820-8ccb-b3eb78bbcf02 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:21.011280 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-90445cbe-b91f-4820-8ccb-b3eb78bbcf02 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 204 len: 0 microversion: 2.1 time: 0.199627 Aug 29 15:30:21.012241 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 733/1446] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:20 2022] DELETE /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:30:21.021146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-83b64e4f-28f2-482f-9486-c3d575836690 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:21.022061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-83b64e4f-28f2-482f-9486-c3d575836690 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 039c62b6-55e7-4b8a-bf96-c079addd6fe6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:21.032470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83b64e4f-28f2-482f-9486-c3d575836690 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:21.033304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83b64e4f-28f2-482f-9486-c3d575836690 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:21.034271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83b64e4f-28f2-482f-9486-c3d575836690 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:21.035188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83b64e4f-28f2-482f-9486-c3d575836690 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:21.035814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83b64e4f-28f2-482f-9486-c3d575836690 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:21.036540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83b64e4f-28f2-482f-9486-c3d575836690 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:21.264038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-83b64e4f-28f2-482f-9486-c3d575836690 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:21.272551 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-83b64e4f-28f2-482f-9486-c3d575836690 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6" status: 200 len: 1475 microversion: 2.1 time: 0.255691 Aug 29 15:30:21.273432 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 714/1447] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:21 2022] GET /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6 => generated 1475 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:21.512406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-39d8c6db-47ee-42b9-aa5d-e847e4e74abc tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:21.513811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-39d8c6db-47ee-42b9-aa5d-e847e4e74abc tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:21.521346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39d8c6db-47ee-42b9-aa5d-e847e4e74abc tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:21.521831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39d8c6db-47ee-42b9-aa5d-e847e4e74abc tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:21.522266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39d8c6db-47ee-42b9-aa5d-e847e4e74abc tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:21.523014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39d8c6db-47ee-42b9-aa5d-e847e4e74abc tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:21.523469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39d8c6db-47ee-42b9-aa5d-e847e4e74abc tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:21.523892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39d8c6db-47ee-42b9-aa5d-e847e4e74abc tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:21.788649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-39d8c6db-47ee-42b9-aa5d-e847e4e74abc tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:21.796910 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-39d8c6db-47ee-42b9-aa5d-e847e4e74abc tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 200 len: 1323 microversion: 2.1 time: 0.288848 Aug 29 15:30:21.797928 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 734/1448] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:21 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:22.294634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-95b8e092-a959-4801-8bf5-c52cd6f8bd58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:22.295251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-95b8e092-a959-4801-8bf5-c52cd6f8bd58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 039c62b6-55e7-4b8a-bf96-c079addd6fe6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:22.302489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95b8e092-a959-4801-8bf5-c52cd6f8bd58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:22.303258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95b8e092-a959-4801-8bf5-c52cd6f8bd58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:22.303697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95b8e092-a959-4801-8bf5-c52cd6f8bd58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:22.304400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95b8e092-a959-4801-8bf5-c52cd6f8bd58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:22.304910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95b8e092-a959-4801-8bf5-c52cd6f8bd58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:22.305386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95b8e092-a959-4801-8bf5-c52cd6f8bd58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:22.595950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-95b8e092-a959-4801-8bf5-c52cd6f8bd58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:22.607890 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-95b8e092-a959-4801-8bf5-c52cd6f8bd58 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6" status: 200 len: 1475 microversion: 2.1 time: 0.317365 Aug 29 15:30:22.608345 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 715/1449] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:22 2022] GET /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6 => generated 1475 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:22.818311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d8c9cfb-d0ce-4077-8cab-318cd29173d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:22.819033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9d8c9cfb-d0ce-4077-8cab-318cd29173d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:22.826257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d8c9cfb-d0ce-4077-8cab-318cd29173d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:22.826818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d8c9cfb-d0ce-4077-8cab-318cd29173d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:22.827315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d8c9cfb-d0ce-4077-8cab-318cd29173d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:22.828188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d8c9cfb-d0ce-4077-8cab-318cd29173d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:22.828627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d8c9cfb-d0ce-4077-8cab-318cd29173d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:22.829045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d8c9cfb-d0ce-4077-8cab-318cd29173d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:22.891906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-05922f05-0b48-4a3c-b207-8dae9c9b43db req-39b81f9a-ca4d-4b18-acc8-92f7fa000957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67cc023-9c10-4758-80f6-56a5ce0622cb", "tag": "0097cd11-b308-47ff-8ccd-e99bd00b674b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:22.910600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-05922f05-0b48-4a3c-b207-8dae9c9b43db req-39b81f9a-ca4d-4b18-acc8-92f7fa000957 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:22.911389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-05922f05-0b48-4a3c-b207-8dae9c9b43db req-39b81f9a-ca4d-4b18-acc8-92f7fa000957 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:22.912209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-05922f05-0b48-4a3c-b207-8dae9c9b43db req-39b81f9a-ca4d-4b18-acc8-92f7fa000957 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:22.926929 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-05922f05-0b48-4a3c-b207-8dae9c9b43db req-39b81f9a-ca4d-4b18-acc8-92f7fa000957 service nova] Creating event network-changed:0097cd11-b308-47ff-8ccd-e99bd00b674b for instance f67cc023-9c10-4758-80f6-56a5ce0622cb on n-h2-839401-11 Aug 29 15:30:22.932376 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-05922f05-0b48-4a3c-b207-8dae9c9b43db req-39b81f9a-ca4d-4b18-acc8-92f7fa000957 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045186 Aug 29 15:30:22.933479 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 716/1450] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:22.985612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9d8c9cfb-d0ce-4077-8cab-318cd29173d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:22.994714 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d8c9cfb-d0ce-4077-8cab-318cd29173d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 200 len: 1323 microversion: 2.1 time: 0.180572 Aug 29 15:30:22.995598 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 735/1451] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:22 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 1323 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:23.628441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-61df3397-d140-457e-934a-a71ede15dae4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:23.629160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-61df3397-d140-457e-934a-a71ede15dae4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 039c62b6-55e7-4b8a-bf96-c079addd6fe6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:23.638749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61df3397-d140-457e-934a-a71ede15dae4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:23.639477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61df3397-d140-457e-934a-a71ede15dae4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:23.640172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61df3397-d140-457e-934a-a71ede15dae4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:23.640859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61df3397-d140-457e-934a-a71ede15dae4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:23.641342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61df3397-d140-457e-934a-a71ede15dae4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:23.641768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61df3397-d140-457e-934a-a71ede15dae4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:23.876126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-61df3397-d140-457e-934a-a71ede15dae4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:23.884740 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-61df3397-d140-457e-934a-a71ede15dae4 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6" status: 200 len: 1475 microversion: 2.1 time: 0.260637 Aug 29 15:30:23.885464 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 717/1452] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:23 2022] GET /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6 => generated 1475 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:24.016262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8a620999-c8c4-4cd7-bd86-c00005e45e07 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:24.026136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8a620999-c8c4-4cd7-bd86-c00005e45e07 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:24.037992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a620999-c8c4-4cd7-bd86-c00005e45e07 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:24.038760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a620999-c8c4-4cd7-bd86-c00005e45e07 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:24.039361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a620999-c8c4-4cd7-bd86-c00005e45e07 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:24.040270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a620999-c8c4-4cd7-bd86-c00005e45e07 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:24.040909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a620999-c8c4-4cd7-bd86-c00005e45e07 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:24.041602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a620999-c8c4-4cd7-bd86-c00005e45e07 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:24.475371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8a620999-c8c4-4cd7-bd86-c00005e45e07 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:24.484827 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8a620999-c8c4-4cd7-bd86-c00005e45e07 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 200 len: 1323 microversion: 2.1 time: 0.472880 Aug 29 15:30:24.501387 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 736/1453] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:24 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 1323 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:24.893691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-69f0510b-c046-4dbe-9a6c-adf33bbe2837 req-b852c979-44b9-419e-becc-1fba104ba951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3056427-5687-4dbf-93e9-a257b3ec51cf", "name": "network-vif-deleted", "tag": "82913e05-d281-471d-920c-eef2d54c9c67"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:24.905878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-69f0510b-c046-4dbe-9a6c-adf33bbe2837 req-b852c979-44b9-419e-becc-1fba104ba951 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:24.906669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-69f0510b-c046-4dbe-9a6c-adf33bbe2837 req-b852c979-44b9-419e-becc-1fba104ba951 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:24.907322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-69f0510b-c046-4dbe-9a6c-adf33bbe2837 req-b852c979-44b9-419e-becc-1fba104ba951 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:24.910373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e41d1728-30c9-4f3b-90af-ff39eb5d4ae3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:24.912495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e41d1728-30c9-4f3b-90af-ff39eb5d4ae3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 039c62b6-55e7-4b8a-bf96-c079addd6fe6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:24.919731 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-69f0510b-c046-4dbe-9a6c-adf33bbe2837 req-b852c979-44b9-419e-becc-1fba104ba951 service nova] Creating event network-vif-deleted:82913e05-d281-471d-920c-eef2d54c9c67 for instance a3056427-5687-4dbf-93e9-a257b3ec51cf on n-h1-839401-11 Aug 29 15:30:24.923045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e41d1728-30c9-4f3b-90af-ff39eb5d4ae3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:24.925243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e41d1728-30c9-4f3b-90af-ff39eb5d4ae3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:24.925871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e41d1728-30c9-4f3b-90af-ff39eb5d4ae3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:24.926049 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-69f0510b-c046-4dbe-9a6c-adf33bbe2837 req-b852c979-44b9-419e-becc-1fba104ba951 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035872 Aug 29 15:30:24.927669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e41d1728-30c9-4f3b-90af-ff39eb5d4ae3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:24.929885 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 718/1454] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:24.930328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e41d1728-30c9-4f3b-90af-ff39eb5d4ae3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:24.931000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e41d1728-30c9-4f3b-90af-ff39eb5d4ae3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:24.957129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-7ebebe11-ace2-400e-92fa-b3806deba0bf req-2f09a0c8-5812-4d91-9e6f-bd52669eaa74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039c62b6-55e7-4b8a-bf96-c079addd6fe6", "name": "network-vif-deleted", "tag": "482320d1-9c00-4266-9780-97bd22da1637"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:24.973589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7ebebe11-ace2-400e-92fa-b3806deba0bf req-2f09a0c8-5812-4d91-9e6f-bd52669eaa74 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:24.977744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7ebebe11-ace2-400e-92fa-b3806deba0bf req-2f09a0c8-5812-4d91-9e6f-bd52669eaa74 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:24.978286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7ebebe11-ace2-400e-92fa-b3806deba0bf req-2f09a0c8-5812-4d91-9e6f-bd52669eaa74 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:24.990289 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-7ebebe11-ace2-400e-92fa-b3806deba0bf req-2f09a0c8-5812-4d91-9e6f-bd52669eaa74 service nova] Creating event network-vif-deleted:482320d1-9c00-4266-9780-97bd22da1637 for instance 039c62b6-55e7-4b8a-bf96-c079addd6fe6 on n-h1-839401-11 Aug 29 15:30:24.995898 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-7ebebe11-ace2-400e-92fa-b3806deba0bf req-2f09a0c8-5812-4d91-9e6f-bd52669eaa74 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042884 Aug 29 15:30:24.997243 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 719/1455] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:25.183531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e41d1728-30c9-4f3b-90af-ff39eb5d4ae3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:25.184051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e41d1728-30c9-4f3b-90af-ff39eb5d4ae3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:25.184496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e41d1728-30c9-4f3b-90af-ff39eb5d4ae3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:25.184957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-e41d1728-30c9-4f3b-90af-ff39eb5d4ae3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lazy-loading 'fault' on Instance uuid 039c62b6-55e7-4b8a-bf96-c079addd6fe6 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:30:25.242309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e41d1728-30c9-4f3b-90af-ff39eb5d4ae3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:25.258368 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e41d1728-30c9-4f3b-90af-ff39eb5d4ae3 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6" status: 200 len: 1309 microversion: 2.1 time: 0.356926 Aug 29 15:30:25.259615 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 737/1456] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:24 2022] GET /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6 => generated 1309 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:25.504818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:25.510810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:25.515739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-49d420af-82eb-4774-85ba-b6e01671c8da tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:25.520058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-49d420af-82eb-4774-85ba-b6e01671c8da tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:25.527433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49d420af-82eb-4774-85ba-b6e01671c8da tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:25.527914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49d420af-82eb-4774-85ba-b6e01671c8da tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:25.528350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49d420af-82eb-4774-85ba-b6e01671c8da tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:25.529016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49d420af-82eb-4774-85ba-b6e01671c8da tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:25.534999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49d420af-82eb-4774-85ba-b6e01671c8da tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:25.536254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49d420af-82eb-4774-85ba-b6e01671c8da tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:25.774480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-49d420af-82eb-4774-85ba-b6e01671c8da tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:25.782691 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-49d420af-82eb-4774-85ba-b6e01671c8da tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 200 len: 1323 microversion: 2.1 time: 0.278825 Aug 29 15:30:25.783353 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 720/1457] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:25 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 1323 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:26.279511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-707699c7-61c7-417e-8b04-995db39ed403 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:26.281158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-707699c7-61c7-417e-8b04-995db39ed403 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 039c62b6-55e7-4b8a-bf96-c079addd6fe6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:26.283286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:26.284990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:26.290912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-707699c7-61c7-417e-8b04-995db39ed403 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.291518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-707699c7-61c7-417e-8b04-995db39ed403 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.291948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-707699c7-61c7-417e-8b04-995db39ed403 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.292647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-707699c7-61c7-417e-8b04-995db39ed403 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.293137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-707699c7-61c7-417e-8b04-995db39ed403 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.293547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-707699c7-61c7-417e-8b04-995db39ed403 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.309815 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-707699c7-61c7-417e-8b04-995db39ed403 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] HTTP exception thrown: Instance 039c62b6-55e7-4b8a-bf96-c079addd6fe6 could not be found. Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-707699c7-61c7-417e-8b04-995db39ed403 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Request method failure captured: Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6 HTTP/1.1 Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNq0SJhI6ZUIRmnOodOt6ZcdThYB9l8hYe4x4UllXPkHKPbAG8XVvri1KtBrX7MZL6KxBneImUArYkpbtZog11x5uckGA6wz1ssepiosILg7S6-6SNa16IzeDtUVlQRc-OU8qelXOTLPaJvoplhrmvFb-m8a6TRO6xvQ_5_T5UY5kag Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 0393aa9c32934da4a9f478c563135bbb Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:30:26.311878 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:30:26.313398 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0393aa9c32934da4a9f478c563135bbb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0393aa9c32934da4a9f478c563135bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0393aa9c32934da4a9f478c563135bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0393aa9c32934da4a9f478c563135bbb"}]}] Aug 29 15:30:26.313398 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:26.313398 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 0393aa9c32934da4a9f478c563135bbb Aug 29 15:30:26.313398 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:26.313398 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersOnMultiNodesTest-900863548-project Aug 29 15:30:26.313398 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:30:26.313398 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:30:26.313398 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e80b373b91434aae8f358839628f3072 Aug 29 15:30:26.313398 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersOnMultiNodesTest-900863548-project Aug 29 15:30:26.313398 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:30:26.313398 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 039c62b6-55e7-4b8a-bf96-c079addd6fe6 could not be found. Aug 29 15:30:26.313398 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '039c62b6-55e7-4b8a-bf96-c079addd6fe6'} Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039c62b6-55e7-4b8a-bf96-c079addd6fe6 could not be found. Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:26.314172 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039c62b6-55e7-4b8a-bf96-c079addd6fe6 could not be found. Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039c62b6-55e7-4b8a-bf96-c079addd6fe6 could not be found. Aug 29 15:30:26.316357 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:26.318152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-707699c7-61c7-417e-8b04-995db39ed403 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Returning 404 to user: Instance 039c62b6-55e7-4b8a-bf96-c079addd6fe6 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:26.318152 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-707699c7-61c7-417e-8b04-995db39ed403 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6" status: 404 len: 111 microversion: 2.1 time: 0.037946 Aug 29 15:30:26.318152 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 738/1458] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:26 2022] GET /compute/v2.1/servers/039c62b6-55e7-4b8a-bf96-c079addd6fe6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:26.322849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f0e8561-4732-4393-984e-17dbabad652d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:26.323586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9f0e8561-4732-4393-984e-17dbabad652d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: a3056427-5687-4dbf-93e9-a257b3ec51cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:26.332580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f0e8561-4732-4393-984e-17dbabad652d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.333308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f0e8561-4732-4393-984e-17dbabad652d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.334434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f0e8561-4732-4393-984e-17dbabad652d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.335377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f0e8561-4732-4393-984e-17dbabad652d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.336785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f0e8561-4732-4393-984e-17dbabad652d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.337404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f0e8561-4732-4393-984e-17dbabad652d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.353176 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-9f0e8561-4732-4393-984e-17dbabad652d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] HTTP exception thrown: Instance a3056427-5687-4dbf-93e9-a257b3ec51cf could not be found. Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f0e8561-4732-4393-984e-17dbabad652d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Request method failure captured: Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf HTTP/1.1 Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNq0SJhI6ZUIRmnOodOt6ZcdThYB9l8hYe4x4UllXPkHKPbAG8XVvri1KtBrX7MZL6KxBneImUArYkpbtZog11x5uckGA6wz1ssepiosILg7S6-6SNa16IzeDtUVlQRc-OU8qelXOTLPaJvoplhrmvFb-m8a6TRO6xvQ_5_T5UY5kag Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 0393aa9c32934da4a9f478c563135bbb Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:30:26.354880 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:30:26.356268 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0393aa9c32934da4a9f478c563135bbb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0393aa9c32934da4a9f478c563135bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0393aa9c32934da4a9f478c563135bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0393aa9c32934da4a9f478c563135bbb"}]}] Aug 29 15:30:26.356268 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:26.356268 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 0393aa9c32934da4a9f478c563135bbb Aug 29 15:30:26.356268 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:26.356268 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersOnMultiNodesTest-900863548-project Aug 29 15:30:26.356268 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:30:26.356268 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:30:26.356268 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e80b373b91434aae8f358839628f3072 Aug 29 15:30:26.356268 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersOnMultiNodesTest-900863548-project Aug 29 15:30:26.356268 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:30:26.356268 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance a3056427-5687-4dbf-93e9-a257b3ec51cf could not be found. Aug 29 15:30:26.356268 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'a3056427-5687-4dbf-93e9-a257b3ec51cf'} Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3056427-5687-4dbf-93e9-a257b3ec51cf could not be found. Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:26.357300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3056427-5687-4dbf-93e9-a257b3ec51cf could not be found. Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3056427-5687-4dbf-93e9-a257b3ec51cf could not be found. Aug 29 15:30:26.358813 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:26.359947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f0e8561-4732-4393-984e-17dbabad652d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Returning 404 to user: Instance a3056427-5687-4dbf-93e9-a257b3ec51cf could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:26.359947 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9f0e8561-4732-4393-984e-17dbabad652d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf" status: 404 len: 111 microversion: 2.1 time: 0.037978 Aug 29 15:30:26.359947 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 721/1459] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:26 2022] GET /compute/v2.1/servers/a3056427-5687-4dbf-93e9-a257b3ec51cf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:26.365055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-438af182-1daf-4640-97f4-05563b3a09e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:26.394346 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-438af182-1daf-4640-97f4-05563b3a09e8 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "DELETE /compute/v2.1/os-server-groups/c566e375-8caf-4447-b72d-a55ae9c852fc" status: 204 len: 0 microversion: 2.1 time: 0.032859 Aug 29 15:30:26.395113 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 739/1460] 10.222.0.62 () {58 vars in 1266 bytes} [Mon Aug 29 15:30:26 2022] DELETE /compute/v2.1/os-server-groups/c566e375-8caf-4447-b72d-a55ae9c852fc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:26.403286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1949063f-8394-45b9-8d54-65d33ddcaffd tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:26.403797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1949063f-8394-45b9-8d54-65d33ddcaffd tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:26.410038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1949063f-8394-45b9-8d54-65d33ddcaffd tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.410524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1949063f-8394-45b9-8d54-65d33ddcaffd tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.410958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1949063f-8394-45b9-8d54-65d33ddcaffd tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.411657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1949063f-8394-45b9-8d54-65d33ddcaffd tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.412292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1949063f-8394-45b9-8d54-65d33ddcaffd tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.412889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1949063f-8394-45b9-8d54-65d33ddcaffd tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.440485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1949063f-8394-45b9-8d54-65d33ddcaffd tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:26.525912 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1949063f-8394-45b9-8d54-65d33ddcaffd tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "DELETE /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 204 len: 0 microversion: 2.1 time: 0.126194 Aug 29 15:30:26.530862 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 722/1461] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:26 2022] DELETE /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:26.535934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-452dad24-1aee-410b-a8cc-c0fef8acff09 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:26.536565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-452dad24-1aee-410b-a8cc-c0fef8acff09 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:26.547487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-452dad24-1aee-410b-a8cc-c0fef8acff09 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.548245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-452dad24-1aee-410b-a8cc-c0fef8acff09 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.548911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-452dad24-1aee-410b-a8cc-c0fef8acff09 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.549674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-452dad24-1aee-410b-a8cc-c0fef8acff09 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.550134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-452dad24-1aee-410b-a8cc-c0fef8acff09 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.550569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-452dad24-1aee-410b-a8cc-c0fef8acff09 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.767696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-452dad24-1aee-410b-a8cc-c0fef8acff09 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:26.781611 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-452dad24-1aee-410b-a8cc-c0fef8acff09 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1472 microversion: 2.1 time: 0.249712 Aug 29 15:30:26.782696 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 740/1462] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:26 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1472 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:26.805976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-796aa004-1990-49bb-8e76-18fbe4d2a0f8 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:26.806960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-796aa004-1990-49bb-8e76-18fbe4d2a0f8 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:26.814024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-796aa004-1990-49bb-8e76-18fbe4d2a0f8 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.814905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-796aa004-1990-49bb-8e76-18fbe4d2a0f8 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.815369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-796aa004-1990-49bb-8e76-18fbe4d2a0f8 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:26.816453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-796aa004-1990-49bb-8e76-18fbe4d2a0f8 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:26.816918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-796aa004-1990-49bb-8e76-18fbe4d2a0f8 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:26.817646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-796aa004-1990-49bb-8e76-18fbe4d2a0f8 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:27.034117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-796aa004-1990-49bb-8e76-18fbe4d2a0f8 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:27.046657 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-796aa004-1990-49bb-8e76-18fbe4d2a0f8 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 200 len: 1323 microversion: 2.1 time: 0.244684 Aug 29 15:30:27.048209 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 723/1463] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:26 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 1323 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:27.808876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65f63838-80c6-44ba-8e59-c3c5c345c162 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:27.810484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-65f63838-80c6-44ba-8e59-c3c5c345c162 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:27.819198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f63838-80c6-44ba-8e59-c3c5c345c162 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:27.819926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f63838-80c6-44ba-8e59-c3c5c345c162 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:27.820609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f63838-80c6-44ba-8e59-c3c5c345c162 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:27.821433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f63838-80c6-44ba-8e59-c3c5c345c162 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:27.822147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f63838-80c6-44ba-8e59-c3c5c345c162 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:27.823289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f63838-80c6-44ba-8e59-c3c5c345c162 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:28.050614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-65f63838-80c6-44ba-8e59-c3c5c345c162 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:28.065417 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-65f63838-80c6-44ba-8e59-c3c5c345c162 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1472 microversion: 2.1 time: 0.267030 Aug 29 15:30:28.066327 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 741/1464] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:27 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1472 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:28.070477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d8e1b120-8e7d-41fb-ae5b-b2111768acdb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:28.071842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d8e1b120-8e7d-41fb-ae5b-b2111768acdb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:28.081107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8e1b120-8e7d-41fb-ae5b-b2111768acdb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:28.082126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8e1b120-8e7d-41fb-ae5b-b2111768acdb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:28.082796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8e1b120-8e7d-41fb-ae5b-b2111768acdb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:28.085381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8e1b120-8e7d-41fb-ae5b-b2111768acdb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:28.086307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8e1b120-8e7d-41fb-ae5b-b2111768acdb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:28.086977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8e1b120-8e7d-41fb-ae5b-b2111768acdb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:28.138020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:28.382408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d8e1b120-8e7d-41fb-ae5b-b2111768acdb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:28.400256 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d8e1b120-8e7d-41fb-ae5b-b2111768acdb tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 200 len: 1323 microversion: 2.1 time: 0.336091 Aug 29 15:30:28.403008 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 724/1465] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:28 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 1323 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:29.092247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5f947f3c-7416-46fe-9e64-8172be7d845f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:29.093671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5f947f3c-7416-46fe-9e64-8172be7d845f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:29.110394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f947f3c-7416-46fe-9e64-8172be7d845f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:29.110921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f947f3c-7416-46fe-9e64-8172be7d845f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:29.111384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f947f3c-7416-46fe-9e64-8172be7d845f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:29.113974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f947f3c-7416-46fe-9e64-8172be7d845f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:29.115432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f947f3c-7416-46fe-9e64-8172be7d845f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:29.116026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f947f3c-7416-46fe-9e64-8172be7d845f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:29.156879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-bd72c2e6-d7de-4106-9b45-56f6b10f169c req-76b042a8-fdad-4a37-863c-16d9b99cd362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67cc023-9c10-4758-80f6-56a5ce0622cb", "name": "network-vif-plugged", "status": "completed", "tag": "0097cd11-b308-47ff-8ccd-e99bd00b674b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:29.174840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-bd72c2e6-d7de-4106-9b45-56f6b10f169c req-76b042a8-fdad-4a37-863c-16d9b99cd362 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:29.175524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-bd72c2e6-d7de-4106-9b45-56f6b10f169c req-76b042a8-fdad-4a37-863c-16d9b99cd362 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:29.176166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-bd72c2e6-d7de-4106-9b45-56f6b10f169c req-76b042a8-fdad-4a37-863c-16d9b99cd362 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:29.190049 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-bd72c2e6-d7de-4106-9b45-56f6b10f169c req-76b042a8-fdad-4a37-863c-16d9b99cd362 service nova] Creating event network-vif-plugged:0097cd11-b308-47ff-8ccd-e99bd00b674b for instance f67cc023-9c10-4758-80f6-56a5ce0622cb on n-h2-839401-11 Aug 29 15:30:29.196193 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-bd72c2e6-d7de-4106-9b45-56f6b10f169c req-76b042a8-fdad-4a37-863c-16d9b99cd362 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.269480 Aug 29 15:30:29.196807 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 742/1466] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:29.424676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-814cba90-3d2c-4028-807c-e53fb3b34d2f tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:29.425986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-814cba90-3d2c-4028-807c-e53fb3b34d2f tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:29.443268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-814cba90-3d2c-4028-807c-e53fb3b34d2f tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:29.446640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-814cba90-3d2c-4028-807c-e53fb3b34d2f tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:29.447384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-814cba90-3d2c-4028-807c-e53fb3b34d2f tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:29.448374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-814cba90-3d2c-4028-807c-e53fb3b34d2f tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:29.449155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-814cba90-3d2c-4028-807c-e53fb3b34d2f tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:29.449821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-814cba90-3d2c-4028-807c-e53fb3b34d2f tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:29.482862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:29.490418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5f947f3c-7416-46fe-9e64-8172be7d845f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:29.507024 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5f947f3c-7416-46fe-9e64-8172be7d845f tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1472 microversion: 2.1 time: 0.422989 Aug 29 15:30:29.507636 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 725/1467] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:29 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1472 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:29.663165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-814cba90-3d2c-4028-807c-e53fb3b34d2f tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:29.674063 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-814cba90-3d2c-4028-807c-e53fb3b34d2f tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 200 len: 1323 microversion: 2.1 time: 0.253940 Aug 29 15:30:29.674643 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 743/1468] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:29 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 1323 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:29.954579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-48e03d18-ec2f-4bbf-8b56-af6cbde0569f req-36276779-003b-4e46-a73e-fcc9f43d3250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e1bd29-189f-45ae-8cfe-ec70a91cf5c1", "name": "network-vif-deleted", "tag": "bbeff5e6-3289-4102-a95e-bc912e6e924d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:29.972721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-48e03d18-ec2f-4bbf-8b56-af6cbde0569f req-36276779-003b-4e46-a73e-fcc9f43d3250 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:29.977650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-48e03d18-ec2f-4bbf-8b56-af6cbde0569f req-36276779-003b-4e46-a73e-fcc9f43d3250 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:29.978118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-48e03d18-ec2f-4bbf-8b56-af6cbde0569f req-36276779-003b-4e46-a73e-fcc9f43d3250 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:29.994729 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-48e03d18-ec2f-4bbf-8b56-af6cbde0569f req-36276779-003b-4e46-a73e-fcc9f43d3250 service nova] Creating event network-vif-deleted:bbeff5e6-3289-4102-a95e-bc912e6e924d for instance 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 on n-h2-839401-11 Aug 29 15:30:30.011210 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-48e03d18-ec2f-4bbf-8b56-af6cbde0569f req-36276779-003b-4e46-a73e-fcc9f43d3250 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060382 Aug 29 15:30:30.012105 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 726/1469] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:30.532681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a95cf969-b0f0-484e-9043-6a6f9a321e6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:30.534296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a95cf969-b0f0-484e-9043-6a6f9a321e6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:30.542853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a95cf969-b0f0-484e-9043-6a6f9a321e6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:30.543549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a95cf969-b0f0-484e-9043-6a6f9a321e6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:30.544180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a95cf969-b0f0-484e-9043-6a6f9a321e6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:30.545273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a95cf969-b0f0-484e-9043-6a6f9a321e6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:30.545933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a95cf969-b0f0-484e-9043-6a6f9a321e6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:30.546836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a95cf969-b0f0-484e-9043-6a6f9a321e6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:30.626904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a95cf969-b0f0-484e-9043-6a6f9a321e6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:30.638714 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a95cf969-b0f0-484e-9043-6a6f9a321e6d tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1301 microversion: 2.1 time: 0.110389 Aug 29 15:30:30.651559 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 744/1470] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:30 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1301 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:30.707793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9c6879ab-4571-488a-ae75-1ce6f3c60afa tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:30.709345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9c6879ab-4571-488a-ae75-1ce6f3c60afa tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:30.718464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6879ab-4571-488a-ae75-1ce6f3c60afa tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:30.719046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6879ab-4571-488a-ae75-1ce6f3c60afa tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:30.719676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6879ab-4571-488a-ae75-1ce6f3c60afa tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:30.720712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6879ab-4571-488a-ae75-1ce6f3c60afa tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:30.722259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6879ab-4571-488a-ae75-1ce6f3c60afa tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:30.722858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6879ab-4571-488a-ae75-1ce6f3c60afa tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:30.984719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9c6879ab-4571-488a-ae75-1ce6f3c60afa tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:30.998042 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9c6879ab-4571-488a-ae75-1ce6f3c60afa tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 200 len: 1323 microversion: 2.1 time: 0.298961 Aug 29 15:30:31.000035 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 727/1471] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:30 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 1323 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:31.227471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1080114154", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "cb3199df-483a-4605-86c6-a5d65679d5da"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:31.288538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] validate_networks() for [('cb3199df-483a-4605-86c6-a5d65679d5da', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:30:31.661251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dc562aaf-8441-41a7-85ab-7bd16eb5b947 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:31.662138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dc562aaf-8441-41a7-85ab-7bd16eb5b947 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:31.687464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc562aaf-8441-41a7-85ab-7bd16eb5b947 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:31.687967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc562aaf-8441-41a7-85ab-7bd16eb5b947 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:31.688409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc562aaf-8441-41a7-85ab-7bd16eb5b947 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:31.689213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc562aaf-8441-41a7-85ab-7bd16eb5b947 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:31.691305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc562aaf-8441-41a7-85ab-7bd16eb5b947 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:31.692592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc562aaf-8441-41a7-85ab-7bd16eb5b947 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:31.736757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc562aaf-8441-41a7-85ab-7bd16eb5b947 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:31.738000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc562aaf-8441-41a7-85ab-7bd16eb5b947 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:31.738404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc562aaf-8441-41a7-85ab-7bd16eb5b947 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:31.739038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-dc562aaf-8441-41a7-85ab-7bd16eb5b947 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lazy-loading 'fault' on Instance uuid 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:30:31.751270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:30:31.752042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:30:31.752820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:30:31.753652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:30:31.754333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:30:31.769264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:31.769755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:31.770187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:31.772950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:31.774662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:31.775111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:31.797846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dc562aaf-8441-41a7-85ab-7bd16eb5b947 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e80b373b91434aae8f358839628f3072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0393aa9c32934da4a9f478c563135bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:31.802064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Getting quotas for project bbbc9e55a8f24d70a82b79243b0fa9e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:30:31.807041 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dc562aaf-8441-41a7-85ab-7bd16eb5b947 tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 200 len: 1306 microversion: 2.1 time: 0.150729 Aug 29 15:30:31.807658 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 728/1472] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:31 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 1306 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:31.810082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Getting quotas for user 8dbbadfdb27047dd9237f4a1d311867e and project bbbc9e55a8f24d70a82b79243b0fa9e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:30:31.826971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:30:31.829472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:30:31.886394 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d6f78d5d-21ef-46a0-83d7-8cea7046a6ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719856 Aug 29 15:30:31.887159 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 745/1473] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:30:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:30:31.898467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-25fb7ca4-cc83-4c8e-8b24-910fdd9694ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:31.901124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-25fb7ca4-cc83-4c8e-8b24-910fdd9694ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:31.968513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-25fb7ca4-cc83-4c8e-8b24-910fdd9694ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:31.976305 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-25fb7ca4-cc83-4c8e-8b24-910fdd9694ca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 200 len: 1215 microversion: 2.1 time: 0.081857 Aug 29 15:30:31.977879 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 729/1474] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:31 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:32.032404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c598d601-ec48-4a79-ac1c-b318a9d45c16 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:32.033049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c598d601-ec48-4a79-ac1c-b318a9d45c16 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:32.043536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c598d601-ec48-4a79-ac1c-b318a9d45c16 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:32.043673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c598d601-ec48-4a79-ac1c-b318a9d45c16 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:32.044217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c598d601-ec48-4a79-ac1c-b318a9d45c16 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:32.045246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c598d601-ec48-4a79-ac1c-b318a9d45c16 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:32.046064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c598d601-ec48-4a79-ac1c-b318a9d45c16 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:32.046713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c598d601-ec48-4a79-ac1c-b318a9d45c16 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:32.265931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c598d601-ec48-4a79-ac1c-b318a9d45c16 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:32.281311 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c598d601-ec48-4a79-ac1c-b318a9d45c16 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 200 len: 1518 microversion: 2.1 time: 0.256058 Aug 29 15:30:32.283797 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 746/1475] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:32 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 1518 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:32.307262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a6ced9b-6574-4ea1-b7fc-fe4edaaccb2b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Action: 'action', calling method: .version_select at 0x7fc4314fd280>, body: {"addFloatingIp": {"address": "172.25.2.47"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:32.309974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a6ced9b-6574-4ea1-b7fc-fe4edaaccb2b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:32.320488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a6ced9b-6574-4ea1-b7fc-fe4edaaccb2b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:32.321580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a6ced9b-6574-4ea1-b7fc-fe4edaaccb2b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:32.322933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a6ced9b-6574-4ea1-b7fc-fe4edaaccb2b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:32.323899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a6ced9b-6574-4ea1-b7fc-fe4edaaccb2b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:32.324781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a6ced9b-6574-4ea1-b7fc-fe4edaaccb2b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:32.326300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a6ced9b-6574-4ea1-b7fc-fe4edaaccb2b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:32.421925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a6ced9b-6574-4ea1-b7fc-fe4edaaccb2b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "refresh_cache-61f2bf94-d2e3-42ec-8808-86ee2560ae1b" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:30:32.422380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a6ced9b-6574-4ea1-b7fc-fe4edaaccb2b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquired lock "refresh_cache-61f2bf94-d2e3-42ec-8808-86ee2560ae1b" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:30:32.832026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bce65d61-9a04-43fd-ad3f-5cded0cb1e9c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:32.835312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bce65d61-9a04-43fd-ad3f-5cded0cb1e9c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] [instance: 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:32.843364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bce65d61-9a04-43fd-ad3f-5cded0cb1e9c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:32.844225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bce65d61-9a04-43fd-ad3f-5cded0cb1e9c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:32.844903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bce65d61-9a04-43fd-ad3f-5cded0cb1e9c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:32.847824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bce65d61-9a04-43fd-ad3f-5cded0cb1e9c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:32.848375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bce65d61-9a04-43fd-ad3f-5cded0cb1e9c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:32.848877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bce65d61-9a04-43fd-ad3f-5cded0cb1e9c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:32.895975 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-bce65d61-9a04-43fd-ad3f-5cded0cb1e9c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] HTTP exception thrown: Instance 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 could not be found. Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bce65d61-9a04-43fd-ad3f-5cded0cb1e9c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Request method failure captured: Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 HTTP/1.1 Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNq0SJhI6ZUIRmnOodOt6ZcdThYB9l8hYe4x4UllXPkHKPbAG8XVvri1KtBrX7MZL6KxBneImUArYkpbtZog11x5uckGA6wz1ssepiosILg7S6-6SNa16IzeDtUVlQRc-OU8qelXOTLPaJvoplhrmvFb-m8a6TRO6xvQ_5_T5UY5kag Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 0393aa9c32934da4a9f478c563135bbb Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:30:32.898217 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:30:32.899769 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0393aa9c32934da4a9f478c563135bbb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0393aa9c32934da4a9f478c563135bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0393aa9c32934da4a9f478c563135bbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0393aa9c32934da4a9f478c563135bbb"}]}] Aug 29 15:30:32.899769 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:32.899769 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 0393aa9c32934da4a9f478c563135bbb Aug 29 15:30:32.899769 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-900863548 Aug 29 15:30:32.899769 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersOnMultiNodesTest-900863548-project Aug 29 15:30:32.899769 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:30:32.899769 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:30:32.899769 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e80b373b91434aae8f358839628f3072 Aug 29 15:30:32.899769 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersOnMultiNodesTest-900863548-project Aug 29 15:30:32.899769 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:30:32.899769 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 could not be found. Aug 29 15:30:32.899769 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '06e1bd29-189f-45ae-8cfe-ec70a91cf5c1'} Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 could not be found. Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:32.900574 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 could not be found. Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 could not be found. Aug 29 15:30:32.901898 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:32.905931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bce65d61-9a04-43fd-ad3f-5cded0cb1e9c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] Returning 404 to user: Instance 06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:32.907539 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bce65d61-9a04-43fd-ad3f-5cded0cb1e9c tempest-ServersOnMultiNodesTest-900863548 tempest-ServersOnMultiNodesTest-900863548-project] 10.222.0.62 "GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1" status: 404 len: 111 microversion: 2.1 time: 0.083516 Aug 29 15:30:32.908626 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 747/1476] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:32 2022] GET /compute/v2.1/servers/06e1bd29-189f-45ae-8cfe-ec70a91cf5c1 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:30:33.010821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7e403613-b668-471a-b982-2e5a03a7f810 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:33.012041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7e403613-b668-471a-b982-2e5a03a7f810 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:33.024385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e403613-b668-471a-b982-2e5a03a7f810 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:33.025517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e403613-b668-471a-b982-2e5a03a7f810 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:33.026535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e403613-b668-471a-b982-2e5a03a7f810 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:33.027974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e403613-b668-471a-b982-2e5a03a7f810 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:33.029505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e403613-b668-471a-b982-2e5a03a7f810 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:33.030813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e403613-b668-471a-b982-2e5a03a7f810 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:33.177235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7e403613-b668-471a-b982-2e5a03a7f810 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:33.187279 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7e403613-b668-471a-b982-2e5a03a7f810 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 200 len: 1267 microversion: 2.1 time: 0.192693 Aug 29 15:30:33.188313 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 748/1477] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:32 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:34.211149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8ddddc4b-c5ad-4ae1-b1db-61c4a267e7af tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:34.211860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8ddddc4b-c5ad-4ae1-b1db-61c4a267e7af tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:34.223052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ddddc4b-c5ad-4ae1-b1db-61c4a267e7af tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:34.223517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ddddc4b-c5ad-4ae1-b1db-61c4a267e7af tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:34.223958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ddddc4b-c5ad-4ae1-b1db-61c4a267e7af tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:34.224673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ddddc4b-c5ad-4ae1-b1db-61c4a267e7af tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:34.244753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ddddc4b-c5ad-4ae1-b1db-61c4a267e7af tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:34.245734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ddddc4b-c5ad-4ae1-b1db-61c4a267e7af tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:34.464344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8ddddc4b-c5ad-4ae1-b1db-61c4a267e7af tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:34.482593 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8ddddc4b-c5ad-4ae1-b1db-61c4a267e7af tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 200 len: 1273 microversion: 2.1 time: 0.275320 Aug 29 15:30:34.484390 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 749/1478] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:34 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:34.890117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-5a6ced9b-6574-4ea1-b7fc-fe4edaaccb2b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Building network info cache for instance {{(pid=122361) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:30:34.897435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-857cfbdb-3f14-4e16-a81b-bd3460ade3cb req-459b5d9e-4f38-4bf8-8793-3e67dc8b1164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61f2bf94-d2e3-42ec-8808-86ee2560ae1b", "tag": "aaa3b81c-6e47-4e3d-b0f5-cdda263f206d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:34.930457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-857cfbdb-3f14-4e16-a81b-bd3460ade3cb req-459b5d9e-4f38-4bf8-8793-3e67dc8b1164 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:34.930959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-857cfbdb-3f14-4e16-a81b-bd3460ade3cb req-459b5d9e-4f38-4bf8-8793-3e67dc8b1164 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:34.931374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-857cfbdb-3f14-4e16-a81b-bd3460ade3cb req-459b5d9e-4f38-4bf8-8793-3e67dc8b1164 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:34.966079 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-857cfbdb-3f14-4e16-a81b-bd3460ade3cb req-459b5d9e-4f38-4bf8-8793-3e67dc8b1164 service nova] Creating event network-changed:aaa3b81c-6e47-4e3d-b0f5-cdda263f206d for instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b on n-h1-839401-11 Aug 29 15:30:34.978684 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-857cfbdb-3f14-4e16-a81b-bd3460ade3cb req-459b5d9e-4f38-4bf8-8793-3e67dc8b1164 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084616 Aug 29 15:30:34.980749 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 750/1479] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:30:35.534032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-33879219-55a8-41ee-b138-89355d4b7747 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:35.534765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-33879219-55a8-41ee-b138-89355d4b7747 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:35.548765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33879219-55a8-41ee-b138-89355d4b7747 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:35.549559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33879219-55a8-41ee-b138-89355d4b7747 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:35.555039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33879219-55a8-41ee-b138-89355d4b7747 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:35.557627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33879219-55a8-41ee-b138-89355d4b7747 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:35.560030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33879219-55a8-41ee-b138-89355d4b7747 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:35.560837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33879219-55a8-41ee-b138-89355d4b7747 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:35.915407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-33879219-55a8-41ee-b138-89355d4b7747 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:35.931300 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-33879219-55a8-41ee-b138-89355d4b7747 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 200 len: 1315 microversion: 2.1 time: 0.422891 Aug 29 15:30:35.932944 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 751/1480] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:35 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:36.318242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-5a6ced9b-6574-4ea1-b7fc-fe4edaaccb2b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Updating instance_info_cache with network_info: [{"id": "aaa3b81c-6e47-4e3d-b0f5-cdda263f206d", "address": "fa:16:3e:47:d7:bc", "network": {"id": "09630ca2-45d5-438d-9a4e-d0e239ea63e6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-338998950-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0de1e6e8040d4d5f9ff87142c3c436bb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapaaa3b81c-6e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122361) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:30:36.336788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a6ced9b-6574-4ea1-b7fc-fe4edaaccb2b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Releasing lock "refresh_cache-61f2bf94-d2e3-42ec-8808-86ee2560ae1b" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:30:36.337781 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5a6ced9b-6574-4ea1-b7fc-fe4edaaccb2b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "POST /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b/action" status: 202 len: 0 microversion: 2.1 time: 4.035159 Aug 29 15:30:36.341212 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 730/1481] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:30:32 2022] POST /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b/action => generated 0 bytes in 4043 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:30:36.354513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Action: 'action', calling method: .version_select at 0x7fc431594f70>, body: {"addFloatingIp": {"address": "172.25.2.47"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:36.360024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:36.373260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:36.374254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:36.377332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:36.378285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:36.384008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:36.385659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:36.504913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "refresh_cache-f67cc023-9c10-4758-80f6-56a5ce0622cb" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:30:36.506775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquired lock "refresh_cache-f67cc023-9c10-4758-80f6-56a5ce0622cb" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:30:36.955099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-50d156ce-e17f-474e-9e2c-cb1344fdcbf1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:36.956057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-50d156ce-e17f-474e-9e2c-cb1344fdcbf1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:36.967496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d156ce-e17f-474e-9e2c-cb1344fdcbf1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:36.968320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d156ce-e17f-474e-9e2c-cb1344fdcbf1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:36.968827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d156ce-e17f-474e-9e2c-cb1344fdcbf1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:36.969655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d156ce-e17f-474e-9e2c-cb1344fdcbf1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:36.970301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d156ce-e17f-474e-9e2c-cb1344fdcbf1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:36.970973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d156ce-e17f-474e-9e2c-cb1344fdcbf1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:37.160389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-50d156ce-e17f-474e-9e2c-cb1344fdcbf1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:37.170997 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-50d156ce-e17f-474e-9e2c-cb1344fdcbf1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 200 len: 1315 microversion: 2.1 time: 0.222697 Aug 29 15:30:37.172328 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 731/1482] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:36 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:37.193786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-0a242a29-f197-4999-9db5-2aaaa295ea99 req-6624f2bf-0a58-4731-8f65-44fe9c42f9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59e1efd-a5b5-44ad-98ce-33999d052840", "tag": "349b2044-7866-4493-8b00-50061ba7fbb9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:37.204956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0a242a29-f197-4999-9db5-2aaaa295ea99 req-6624f2bf-0a58-4731-8f65-44fe9c42f9e6 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:37.206982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0a242a29-f197-4999-9db5-2aaaa295ea99 req-6624f2bf-0a58-4731-8f65-44fe9c42f9e6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:37.207428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0a242a29-f197-4999-9db5-2aaaa295ea99 req-6624f2bf-0a58-4731-8f65-44fe9c42f9e6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:37.225111 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-0a242a29-f197-4999-9db5-2aaaa295ea99 req-6624f2bf-0a58-4731-8f65-44fe9c42f9e6 service nova] Creating event network-changed:349b2044-7866-4493-8b00-50061ba7fbb9 for instance f59e1efd-a5b5-44ad-98ce-33999d052840 on n-h1-839401-11 Aug 29 15:30:37.230453 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-0a242a29-f197-4999-9db5-2aaaa295ea99 req-6624f2bf-0a58-4731-8f65-44fe9c42f9e6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043018 Aug 29 15:30:37.231970 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 732/1483] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:37.763484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-558791847", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:37.836165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:30:38.071698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:30:38.072118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:30:38.072810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:30:38.073418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:30:38.074099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:30:38.083459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.084274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.084881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.085775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.086376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.087162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.108128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Getting quotas for project 2e08c38460fb4aef88dae8bbeb622d14. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:30:38.114075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Getting quotas for user bc6360eed8b2471b9cc3b2166960a07a and project 2e08c38460fb4aef88dae8bbeb622d14. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:30:38.126427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:30:38.129166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:30:38.197420 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d219835a-7ba4-4f5b-a9b7-57dbc9e704a9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583092 Aug 29 15:30:38.203809 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 733/1484] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:30:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:30:38.203809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a6c4e23b-83fe-4c10-aac7-05e63e9f9697 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:38.204752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a6c4e23b-83fe-4c10-aac7-05e63e9f9697 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:38.216075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6c4e23b-83fe-4c10-aac7-05e63e9f9697 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.227613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6c4e23b-83fe-4c10-aac7-05e63e9f9697 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.241746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6c4e23b-83fe-4c10-aac7-05e63e9f9697 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.242516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6c4e23b-83fe-4c10-aac7-05e63e9f9697 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.242998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6c4e23b-83fe-4c10-aac7-05e63e9f9697 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.243429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6c4e23b-83fe-4c10-aac7-05e63e9f9697 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.423206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a6c4e23b-83fe-4c10-aac7-05e63e9f9697 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:38.433200 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a6c4e23b-83fe-4c10-aac7-05e63e9f9697 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 200 len: 1315 microversion: 2.1 time: 0.233406 Aug 29 15:30:38.434676 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 734/1485] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:38 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:38.441576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3d596355-1392-4369-b5f8-a55a86a3d4fc tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:38.442425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3d596355-1392-4369-b5f8-a55a86a3d4fc tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:38.498379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3d596355-1392-4369-b5f8-a55a86a3d4fc tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:38.506502 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3d596355-1392-4369-b5f8-a55a86a3d4fc tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1213 microversion: 2.1 time: 0.070499 Aug 29 15:30:38.508044 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 735/1486] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:38 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:38.512707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-71aeb693-f16a-4771-a6b6-934b5d79f2f6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:38.513348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-71aeb693-f16a-4771-a6b6-934b5d79f2f6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:38.520561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71aeb693-f16a-4771-a6b6-934b5d79f2f6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.521275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71aeb693-f16a-4771-a6b6-934b5d79f2f6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.521791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71aeb693-f16a-4771-a6b6-934b5d79f2f6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.522613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71aeb693-f16a-4771-a6b6-934b5d79f2f6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.523231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71aeb693-f16a-4771-a6b6-934b5d79f2f6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.523747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71aeb693-f16a-4771-a6b6-934b5d79f2f6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.559595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-71aeb693-f16a-4771-a6b6-934b5d79f2f6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:38.678316 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-71aeb693-f16a-4771-a6b6-934b5d79f2f6 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 204 len: 0 microversion: 2.1 time: 0.167899 Aug 29 15:30:38.681183 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 736/1487] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:38 2022] DELETE /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:38.695907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-99c52675-609a-4b94-9f69-59f2d699a8a3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:38.697015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-99c52675-609a-4b94-9f69-59f2d699a8a3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:38.703787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99c52675-609a-4b94-9f69-59f2d699a8a3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.704526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99c52675-609a-4b94-9f69-59f2d699a8a3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.705248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99c52675-609a-4b94-9f69-59f2d699a8a3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.706169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99c52675-609a-4b94-9f69-59f2d699a8a3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:38.706992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99c52675-609a-4b94-9f69-59f2d699a8a3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:38.707633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99c52675-609a-4b94-9f69-59f2d699a8a3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:38.983425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-99c52675-609a-4b94-9f69-59f2d699a8a3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:39.019663 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-99c52675-609a-4b94-9f69-59f2d699a8a3 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1713 microversion: 2.1 time: 0.325625 Aug 29 15:30:39.022759 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 737/1488] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:38 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1713 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:39.253874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b23786db-d5a9-40a2-8de6-6f7952a6f477 req-6009d601-30bf-4519-aed0-8da98bc985c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61f2bf94-d2e3-42ec-8808-86ee2560ae1b", "tag": "aaa3b81c-6e47-4e3d-b0f5-cdda263f206d"}, {"name": "network-changed", "server_uuid": "f67cc023-9c10-4758-80f6-56a5ce0622cb", "tag": "0097cd11-b308-47ff-8ccd-e99bd00b674b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:39.257953 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.network.neutron [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] re-assign floating IP 172.25.2.47 from instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b Aug 29 15:30:39.265959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b23786db-d5a9-40a2-8de6-6f7952a6f477 req-6009d601-30bf-4519-aed0-8da98bc985c8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.266688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b23786db-d5a9-40a2-8de6-6f7952a6f477 req-6009d601-30bf-4519-aed0-8da98bc985c8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.267341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b23786db-d5a9-40a2-8de6-6f7952a6f477 req-6009d601-30bf-4519-aed0-8da98bc985c8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.280760 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b23786db-d5a9-40a2-8de6-6f7952a6f477 req-6009d601-30bf-4519-aed0-8da98bc985c8 service nova] Creating event network-changed:aaa3b81c-6e47-4e3d-b0f5-cdda263f206d for instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b on n-h1-839401-11 Aug 29 15:30:39.281382 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b23786db-d5a9-40a2-8de6-6f7952a6f477 req-6009d601-30bf-4519-aed0-8da98bc985c8 service nova] Creating event network-changed:0097cd11-b308-47ff-8ccd-e99bd00b674b for instance f67cc023-9c10-4758-80f6-56a5ce0622cb on n-h2-839401-11 Aug 29 15:30:39.289947 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b23786db-d5a9-40a2-8de6-6f7952a6f477 req-6009d601-30bf-4519-aed0-8da98bc985c8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039830 Aug 29 15:30:39.291050 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 738/1489] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:39.302416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Building network info cache for instance {{(pid=122360) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:30:39.475406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-db2ad0d4-0c7a-4a4f-a2cc-c31fda6ef094 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:39.477118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-db2ad0d4-0c7a-4a4f-a2cc-c31fda6ef094 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:39.502213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db2ad0d4-0c7a-4a4f-a2cc-c31fda6ef094 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.502771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db2ad0d4-0c7a-4a4f-a2cc-c31fda6ef094 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.505345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db2ad0d4-0c7a-4a4f-a2cc-c31fda6ef094 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.507990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db2ad0d4-0c7a-4a4f-a2cc-c31fda6ef094 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.509734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db2ad0d4-0c7a-4a4f-a2cc-c31fda6ef094 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.510676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db2ad0d4-0c7a-4a4f-a2cc-c31fda6ef094 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.679864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-db2ad0d4-0c7a-4a4f-a2cc-c31fda6ef094 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:39.687944 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-db2ad0d4-0c7a-4a4f-a2cc-c31fda6ef094 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 200 len: 1315 microversion: 2.1 time: 0.232011 Aug 29 15:30:39.688611 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 739/1490] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:39 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:39.695259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bde6b52e-6f27-4ab5-9568-fc23997e0836 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:39.696330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bde6b52e-6f27-4ab5-9568-fc23997e0836 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:39.702636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bde6b52e-6f27-4ab5-9568-fc23997e0836 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.703125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bde6b52e-6f27-4ab5-9568-fc23997e0836 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.703562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bde6b52e-6f27-4ab5-9568-fc23997e0836 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.704260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bde6b52e-6f27-4ab5-9568-fc23997e0836 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:39.704740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bde6b52e-6f27-4ab5-9568-fc23997e0836 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:39.705229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bde6b52e-6f27-4ab5-9568-fc23997e0836 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:39.770774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bde6b52e-6f27-4ab5-9568-fc23997e0836 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:39.779172 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bde6b52e-6f27-4ab5-9568-fc23997e0836 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1217 microversion: 2.1 time: 0.089202 Aug 29 15:30:39.780075 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 740/1491] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:39 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:39.861325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Updating instance_info_cache with network_info: [{"id": "aaa3b81c-6e47-4e3d-b0f5-cdda263f206d", "address": "fa:16:3e:47:d7:bc", "network": {"id": "09630ca2-45d5-438d-9a4e-d0e239ea63e6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-338998950-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0de1e6e8040d4d5f9ff87142c3c436bb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapaaa3b81c-6e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122360) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:30:39.875814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Building network info cache for instance {{(pid=122360) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:30:40.043087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8caa0094-b7a6-41e3-b99d-86865a168d27 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:40.044007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8caa0094-b7a6-41e3-b99d-86865a168d27 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:40.051634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8caa0094-b7a6-41e3-b99d-86865a168d27 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:40.052347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8caa0094-b7a6-41e3-b99d-86865a168d27 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:40.052994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8caa0094-b7a6-41e3-b99d-86865a168d27 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:40.054121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8caa0094-b7a6-41e3-b99d-86865a168d27 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:40.054685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8caa0094-b7a6-41e3-b99d-86865a168d27 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:40.055632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8caa0094-b7a6-41e3-b99d-86865a168d27 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:40.315450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8caa0094-b7a6-41e3-b99d-86865a168d27 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:40.328165 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8caa0094-b7a6-41e3-b99d-86865a168d27 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1713 microversion: 2.1 time: 0.288967 Aug 29 15:30:40.345119 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 741/1492] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:40 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1713 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:40.469902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Updating instance_info_cache with network_info: [{"id": "0097cd11-b308-47ff-8ccd-e99bd00b674b", "address": "fa:16:3e:69:28:2a", "network": {"id": "09630ca2-45d5-438d-9a4e-d0e239ea63e6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-338998950-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0de1e6e8040d4d5f9ff87142c3c436bb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0097cd11-b3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122360) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:30:40.481862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Releasing lock "refresh_cache-f67cc023-9c10-4758-80f6-56a5ce0622cb" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:30:40.482812 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0653b65f-012f-4f17-b263-5f71f3a3af20 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "POST /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb/action" status: 202 len: 0 microversion: 2.1 time: 4.136959 Aug 29 15:30:40.483523 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 752/1493] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:30:36 2022] POST /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb/action => generated 0 bytes in 4138 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:30:40.492000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-54f0c7af-ad53-429b-9566-6463dc7476d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Action: 'action', calling method: .version_select at 0x7fc4314fd310>, body: {"removeFloatingIp": {"address": "172.25.2.47"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:40.644130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-54f0c7af-ad53-429b-9566-6463dc7476d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:40.649420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:40.659744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54f0c7af-ad53-429b-9566-6463dc7476d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:40.660240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54f0c7af-ad53-429b-9566-6463dc7476d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:40.660680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54f0c7af-ad53-429b-9566-6463dc7476d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:40.662810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54f0c7af-ad53-429b-9566-6463dc7476d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:40.666039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54f0c7af-ad53-429b-9566-6463dc7476d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:40.666039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54f0c7af-ad53-429b-9566-6463dc7476d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:40.690432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:40.713724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f3f9603e-84a6-472c-87bb-386a4ace8816 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:40.714548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f3f9603e-84a6-472c-87bb-386a4ace8816 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:40.729819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3f9603e-84a6-472c-87bb-386a4ace8816 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:40.730836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3f9603e-84a6-472c-87bb-386a4ace8816 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:40.731577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3f9603e-84a6-472c-87bb-386a4ace8816 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:40.732538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3f9603e-84a6-472c-87bb-386a4ace8816 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:40.733550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3f9603e-84a6-472c-87bb-386a4ace8816 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:40.735866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3f9603e-84a6-472c-87bb-386a4ace8816 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:40.990213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f3f9603e-84a6-472c-87bb-386a4ace8816 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:41.000217 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f3f9603e-84a6-472c-87bb-386a4ace8816 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 200 len: 1315 microversion: 2.1 time: 0.292388 Aug 29 15:30:41.001409 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 753/1494] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:40 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:41.010349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-440e0381-cd35-4739-9a13-bba7b1c22264 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:41.015808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-440e0381-cd35-4739-9a13-bba7b1c22264 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:41.025371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-440e0381-cd35-4739-9a13-bba7b1c22264 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:41.027246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-440e0381-cd35-4739-9a13-bba7b1c22264 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:41.027863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-440e0381-cd35-4739-9a13-bba7b1c22264 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:41.028793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-440e0381-cd35-4739-9a13-bba7b1c22264 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:41.029458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-440e0381-cd35-4739-9a13-bba7b1c22264 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:41.030492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-440e0381-cd35-4739-9a13-bba7b1c22264 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:41.145673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-440e0381-cd35-4739-9a13-bba7b1c22264 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:41.166057 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-440e0381-cd35-4739-9a13-bba7b1c22264 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1265 microversion: 2.1 time: 0.163180 Aug 29 15:30:41.166689 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 754/1495] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:41 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:41.338769 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-54f0c7af-ad53-429b-9566-6463dc7476d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] HTTP exception thrown: Floating IP 172.25.2.47 is not associated with instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b. Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-54f0c7af-ad53-429b-9566-6463dc7476d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Request method failure captured: Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b/action HTTP/1.1 Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 48 Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNtyXZ4UWcpT1PGTtzBGpSuJ_orK6w7fBjKyN-qzAj13qjyEaRs46OUa5uGuf783E3a9quG7r2pIM6KB4NEeURwigatViAivi253UqsiaNE7-zh3kTEVIa1fwtopuNYfvEzrw2MH-68rklRH3QKRVRP1zKFkHsFfZS_7tutpo6YT8NU Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 0de1e6e8040d4d5f9ff87142c3c436bb Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1422716330 Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:30:41.341070 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:30:41.342876 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0de1e6e8040d4d5f9ff87142c3c436bb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0de1e6e8040d4d5f9ff87142c3c436bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0de1e6e8040d4d5f9ff87142c3c436bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0de1e6e8040d4d5f9ff87142c3c436bb"}]}] Aug 29 15:30:41.342876 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1422716330 Aug 29 15:30:41.342876 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 0de1e6e8040d4d5f9ff87142c3c436bb Aug 29 15:30:41.342876 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1422716330 Aug 29 15:30:41.342876 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-FloatingIPsAssociationTestJSON-1422716330-project Aug 29 15:30:41.342876 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:30:41.342876 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:30:41.342876 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 9e11d7d908bf432d80589193031172c2 Aug 29 15:30:41.342876 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1422716330-project Aug 29 15:30:41.342876 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:30:41.342876 n-d-839401-11 devstack@n-api.service[122361]: {"removeFloatingIp": {"address": "172.25.2.47"}} Aug 29 15:30:41.342876 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:30:41.342876 n-d-839401-11 devstack@n-api.service[122361]: exception: Floating IP 172.25.2.47 is not associated with instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b. Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '61f2bf94-d2e3-42ec-8808-86ee2560ae1b', 'body': {'removeFloatingIp': {'address': '172.25.2.47'}}} Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.47 is not associated with instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b. Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:41.344033 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:41.345753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:41.345753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:41.345753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:41.345753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:41.345753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.47 is not associated with instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b. Aug 29 15:30:41.345753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:41.348317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-54f0c7af-ad53-429b-9566-6463dc7476d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Returning 409 to user: Floating IP 172.25.2.47 is not associated with instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:41.349321 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-54f0c7af-ad53-429b-9566-6463dc7476d2 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "POST /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b/action" status: 409 len: 145 microversion: 2.1 time: 0.861222 Aug 29 15:30:41.350085 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 742/1496] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:30:40 2022] POST /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b/action => generated 145 bytes in 863 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:30:41.358908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-efcdc155-951c-44c2-aa4f-d06fce589492 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Action: 'action', calling method: .version_select at 0x7fc431594670>, body: {"removeFloatingIp": {"address": "172.25.2.47"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:41.363659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b6d4b0c4-dcde-4df8-b0d7-a2e9c7caf9cf tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:41.364490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b6d4b0c4-dcde-4df8-b0d7-a2e9c7caf9cf tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:41.373046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6d4b0c4-dcde-4df8-b0d7-a2e9c7caf9cf tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:41.373999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6d4b0c4-dcde-4df8-b0d7-a2e9c7caf9cf tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:41.374655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6d4b0c4-dcde-4df8-b0d7-a2e9c7caf9cf tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:41.375971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6d4b0c4-dcde-4df8-b0d7-a2e9c7caf9cf tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:41.376928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6d4b0c4-dcde-4df8-b0d7-a2e9c7caf9cf tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:41.378022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6d4b0c4-dcde-4df8-b0d7-a2e9c7caf9cf tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:41.581296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-efcdc155-951c-44c2-aa4f-d06fce589492 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:41.588229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efcdc155-951c-44c2-aa4f-d06fce589492 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:41.589152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efcdc155-951c-44c2-aa4f-d06fce589492 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:41.589667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efcdc155-951c-44c2-aa4f-d06fce589492 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:41.590644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efcdc155-951c-44c2-aa4f-d06fce589492 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:41.591140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efcdc155-951c-44c2-aa4f-d06fce589492 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:41.591565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efcdc155-951c-44c2-aa4f-d06fce589492 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:41.788007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:41.815199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efcdc155-951c-44c2-aa4f-d06fce589492 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "refresh_cache-f67cc023-9c10-4758-80f6-56a5ce0622cb" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:30:41.815694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efcdc155-951c-44c2-aa4f-d06fce589492 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquired lock "refresh_cache-f67cc023-9c10-4758-80f6-56a5ce0622cb" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:30:41.819683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:42.003194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b6d4b0c4-dcde-4df8-b0d7-a2e9c7caf9cf tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:42.011866 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b6d4b0c4-dcde-4df8-b0d7-a2e9c7caf9cf tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1713 microversion: 2.1 time: 0.652604 Aug 29 15:30:42.012330 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 743/1497] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:41 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1713 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:42.021677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3e0a29ab-a345-4f4d-a992-eb0c1fcce968 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:42.022612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3e0a29ab-a345-4f4d-a992-eb0c1fcce968 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:42.030931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e0a29ab-a345-4f4d-a992-eb0c1fcce968 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:42.031862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e0a29ab-a345-4f4d-a992-eb0c1fcce968 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:42.032523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e0a29ab-a345-4f4d-a992-eb0c1fcce968 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:42.033316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e0a29ab-a345-4f4d-a992-eb0c1fcce968 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:42.033954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e0a29ab-a345-4f4d-a992-eb0c1fcce968 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:42.034571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e0a29ab-a345-4f4d-a992-eb0c1fcce968 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:42.815938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-efcdc155-951c-44c2-aa4f-d06fce589492 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Building network info cache for instance {{(pid=122360) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:30:42.838457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3e0a29ab-a345-4f4d-a992-eb0c1fcce968 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:42.852172 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3e0a29ab-a345-4f4d-a992-eb0c1fcce968 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 200 len: 1315 microversion: 2.1 time: 0.834517 Aug 29 15:30:42.853406 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 744/1498] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:42 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 1315 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:42.859156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ef978b1c-0952-4d65-9437-c9791c2f6fb5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:42.860037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ef978b1c-0952-4d65-9437-c9791c2f6fb5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:42.874962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef978b1c-0952-4d65-9437-c9791c2f6fb5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:42.875833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef978b1c-0952-4d65-9437-c9791c2f6fb5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:42.876484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef978b1c-0952-4d65-9437-c9791c2f6fb5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:42.877968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef978b1c-0952-4d65-9437-c9791c2f6fb5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:42.879118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef978b1c-0952-4d65-9437-c9791c2f6fb5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:42.879483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef978b1c-0952-4d65-9437-c9791c2f6fb5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:42.972194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ef978b1c-0952-4d65-9437-c9791c2f6fb5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:42.990535 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ef978b1c-0952-4d65-9437-c9791c2f6fb5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1271 microversion: 2.1 time: 0.133151 Aug 29 15:30:43.001161 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 745/1499] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:42 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:43.025707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-7ff0c0f7-6e35-4188-9d1a-7b1a2488d8fd req-7737166c-b356-4c15-b5eb-fe0aa0ab2ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67cc023-9c10-4758-80f6-56a5ce0622cb", "tag": "0097cd11-b308-47ff-8ccd-e99bd00b674b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:43.042699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7ff0c0f7-6e35-4188-9d1a-7b1a2488d8fd req-7737166c-b356-4c15-b5eb-fe0aa0ab2ed9 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:43.047661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7ff0c0f7-6e35-4188-9d1a-7b1a2488d8fd req-7737166c-b356-4c15-b5eb-fe0aa0ab2ed9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:43.048350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7ff0c0f7-6e35-4188-9d1a-7b1a2488d8fd req-7737166c-b356-4c15-b5eb-fe0aa0ab2ed9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:43.073701 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-7ff0c0f7-6e35-4188-9d1a-7b1a2488d8fd req-7737166c-b356-4c15-b5eb-fe0aa0ab2ed9 service nova] Creating event network-changed:0097cd11-b308-47ff-8ccd-e99bd00b674b for instance f67cc023-9c10-4758-80f6-56a5ce0622cb on n-h2-839401-11 Aug 29 15:30:43.083629 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-7ff0c0f7-6e35-4188-9d1a-7b1a2488d8fd req-7737166c-b356-4c15-b5eb-fe0aa0ab2ed9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080700 Aug 29 15:30:43.084574 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 746/1500] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:43.089924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c3866ae4-a51a-4d6b-b1ad-edce33aa6166 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:43.090619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c3866ae4-a51a-4d6b-b1ad-edce33aa6166 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:43.104306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3866ae4-a51a-4d6b-b1ad-edce33aa6166 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:43.105239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3866ae4-a51a-4d6b-b1ad-edce33aa6166 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:43.105959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3866ae4-a51a-4d6b-b1ad-edce33aa6166 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:43.107477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3866ae4-a51a-4d6b-b1ad-edce33aa6166 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:43.108269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3866ae4-a51a-4d6b-b1ad-edce33aa6166 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:43.109216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3866ae4-a51a-4d6b-b1ad-edce33aa6166 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:43.288004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c3866ae4-a51a-4d6b-b1ad-edce33aa6166 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:43.318584 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c3866ae4-a51a-4d6b-b1ad-edce33aa6166 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1645 microversion: 2.1 time: 0.231471 Aug 29 15:30:43.319270 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 747/1501] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:43 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1645 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:43.487659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-efcdc155-951c-44c2-aa4f-d06fce589492 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Updating instance_info_cache with network_info: [{"id": "0097cd11-b308-47ff-8ccd-e99bd00b674b", "address": "fa:16:3e:69:28:2a", "network": {"id": "09630ca2-45d5-438d-9a4e-d0e239ea63e6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-338998950-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0de1e6e8040d4d5f9ff87142c3c436bb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0097cd11-b3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122360) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:30:43.500946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efcdc155-951c-44c2-aa4f-d06fce589492 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Releasing lock "refresh_cache-f67cc023-9c10-4758-80f6-56a5ce0622cb" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:30:43.502231 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-efcdc155-951c-44c2-aa4f-d06fce589492 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "POST /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb/action" status: 202 len: 0 microversion: 2.1 time: 2.147554 Aug 29 15:30:43.506555 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 755/1502] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:30:41 2022] POST /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb/action => generated 0 bytes in 2152 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:30:43.513317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c167992e-246e-4379-8514-c68717f3d4a0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:43.513607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c167992e-246e-4379-8514-c68717f3d4a0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:43.519795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c167992e-246e-4379-8514-c68717f3d4a0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:43.520289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c167992e-246e-4379-8514-c68717f3d4a0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:43.520720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c167992e-246e-4379-8514-c68717f3d4a0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:43.521461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c167992e-246e-4379-8514-c68717f3d4a0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:43.521970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c167992e-246e-4379-8514-c68717f3d4a0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:43.522400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c167992e-246e-4379-8514-c68717f3d4a0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:43.553255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c167992e-246e-4379-8514-c68717f3d4a0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:43.670215 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c167992e-246e-4379-8514-c68717f3d4a0 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 204 len: 0 microversion: 2.1 time: 0.162212 Aug 29 15:30:43.675899 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 748/1503] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:43 2022] DELETE /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:43.683784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-354f5994-376a-4aad-af72-e89e8be15768 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.47"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:43.688792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-354f5994-376a-4aad-af72-e89e8be15768 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:43.698288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-354f5994-376a-4aad-af72-e89e8be15768 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:43.699132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-354f5994-376a-4aad-af72-e89e8be15768 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:43.699992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-354f5994-376a-4aad-af72-e89e8be15768 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:43.700940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-354f5994-376a-4aad-af72-e89e8be15768 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:43.701603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-354f5994-376a-4aad-af72-e89e8be15768 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:43.702201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-354f5994-376a-4aad-af72-e89e8be15768 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:43.735070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-354f5994-376a-4aad-af72-e89e8be15768 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "refresh_cache-61f2bf94-d2e3-42ec-8808-86ee2560ae1b" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:30:43.735765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-354f5994-376a-4aad-af72-e89e8be15768 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquired lock "refresh_cache-61f2bf94-d2e3-42ec-8808-86ee2560ae1b" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:30:43.874574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2eba33c5-1a2c-4b4d-84cd-3454031079cb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:43.875882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2eba33c5-1a2c-4b4d-84cd-3454031079cb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:43.882593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eba33c5-1a2c-4b4d-84cd-3454031079cb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:43.883335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eba33c5-1a2c-4b4d-84cd-3454031079cb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:43.883944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eba33c5-1a2c-4b4d-84cd-3454031079cb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:43.884861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eba33c5-1a2c-4b4d-84cd-3454031079cb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:43.885346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eba33c5-1a2c-4b4d-84cd-3454031079cb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:43.885935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eba33c5-1a2c-4b4d-84cd-3454031079cb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:44.154511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2eba33c5-1a2c-4b4d-84cd-3454031079cb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:44.170177 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2eba33c5-1a2c-4b4d-84cd-3454031079cb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 200 len: 1315 microversion: 2.1 time: 0.299993 Aug 29 15:30:44.171196 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 749/1504] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:43 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:44.178136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-7d976b71-c784-4149-bc7a-2a36eaaa9dd4 req-c26fc165-7278-4fc5-883c-401d54b05bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c480235-81a3-46b9-9ea6-520b329f53ea", "name": "network-vif-deleted", "tag": "eea42a7e-66fa-41cc-a051-b6c158f38c7c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:44.200908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7d976b71-c784-4149-bc7a-2a36eaaa9dd4 req-c26fc165-7278-4fc5-883c-401d54b05bde service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:44.209225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7d976b71-c784-4149-bc7a-2a36eaaa9dd4 req-c26fc165-7278-4fc5-883c-401d54b05bde service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:44.209683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7d976b71-c784-4149-bc7a-2a36eaaa9dd4 req-c26fc165-7278-4fc5-883c-401d54b05bde service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:44.244079 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-7d976b71-c784-4149-bc7a-2a36eaaa9dd4 req-c26fc165-7278-4fc5-883c-401d54b05bde service nova] Creating event network-vif-deleted:eea42a7e-66fa-41cc-a051-b6c158f38c7c for instance 6c480235-81a3-46b9-9ea6-520b329f53ea on n-h2-839401-11 Aug 29 15:30:44.255727 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-7d976b71-c784-4149-bc7a-2a36eaaa9dd4 req-c26fc165-7278-4fc5-883c-401d54b05bde service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081623 Aug 29 15:30:44.260009 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 750/1505] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:44.270139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cb40ec51-27de-4400-a8dc-382785b1a92f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:44.271144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cb40ec51-27de-4400-a8dc-382785b1a92f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:44.280428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb40ec51-27de-4400-a8dc-382785b1a92f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:44.281335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb40ec51-27de-4400-a8dc-382785b1a92f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:44.281987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb40ec51-27de-4400-a8dc-382785b1a92f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:44.284501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb40ec51-27de-4400-a8dc-382785b1a92f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:44.285254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb40ec51-27de-4400-a8dc-382785b1a92f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:44.285991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb40ec51-27de-4400-a8dc-382785b1a92f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:44.514357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cb40ec51-27de-4400-a8dc-382785b1a92f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:44.524914 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cb40ec51-27de-4400-a8dc-382785b1a92f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1313 microversion: 2.1 time: 0.262680 Aug 29 15:30:44.537140 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 751/1506] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:44 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:44.537140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8cabd7e9-052b-4029-b11b-c6f0d089044d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:44.537140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8cabd7e9-052b-4029-b11b-c6f0d089044d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:44.539519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cabd7e9-052b-4029-b11b-c6f0d089044d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:44.541189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cabd7e9-052b-4029-b11b-c6f0d089044d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:44.541189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cabd7e9-052b-4029-b11b-c6f0d089044d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:44.541428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cabd7e9-052b-4029-b11b-c6f0d089044d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:44.541772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cabd7e9-052b-4029-b11b-c6f0d089044d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:44.542196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cabd7e9-052b-4029-b11b-c6f0d089044d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:44.615637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8cabd7e9-052b-4029-b11b-c6f0d089044d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:44.626485 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8cabd7e9-052b-4029-b11b-c6f0d089044d tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1645 microversion: 2.1 time: 0.099309 Aug 29 15:30:44.628038 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 752/1507] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:44 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1645 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:44.775529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-4946d219-ab7b-4c27-98a2-e7a71425d49d req-ead0cd37-0d9e-4660-ba9c-8d85d08c1b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59e1efd-a5b5-44ad-98ce-33999d052840", "name": "network-vif-plugged", "status": "completed", "tag": "349b2044-7866-4493-8b00-50061ba7fbb9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:44.789117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4946d219-ab7b-4c27-98a2-e7a71425d49d req-ead0cd37-0d9e-4660-ba9c-8d85d08c1b40 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:44.789611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4946d219-ab7b-4c27-98a2-e7a71425d49d req-ead0cd37-0d9e-4660-ba9c-8d85d08c1b40 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:44.790041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4946d219-ab7b-4c27-98a2-e7a71425d49d req-ead0cd37-0d9e-4660-ba9c-8d85d08c1b40 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:44.811162 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-4946d219-ab7b-4c27-98a2-e7a71425d49d req-ead0cd37-0d9e-4660-ba9c-8d85d08c1b40 service nova] Creating event network-vif-plugged:349b2044-7866-4493-8b00-50061ba7fbb9 for instance f59e1efd-a5b5-44ad-98ce-33999d052840 on n-h1-839401-11 Aug 29 15:30:44.816700 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-4946d219-ab7b-4c27-98a2-e7a71425d49d req-ead0cd37-0d9e-4660-ba9c-8d85d08c1b40 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044923 Aug 29 15:30:44.818877 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 753/1508] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:45.091061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-354f5994-376a-4aad-af72-e89e8be15768 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Building network info cache for instance {{(pid=122360) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:30:45.127896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-7ba80a6e-7c38-4a95-9b0f-887b7ddb05e0 req-7107490a-0b9b-415f-bcd4-80254f0b73fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61f2bf94-d2e3-42ec-8808-86ee2560ae1b", "tag": "aaa3b81c-6e47-4e3d-b0f5-cdda263f206d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:45.154406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7ba80a6e-7c38-4a95-9b0f-887b7ddb05e0 req-7107490a-0b9b-415f-bcd4-80254f0b73fb service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:45.158802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7ba80a6e-7c38-4a95-9b0f-887b7ddb05e0 req-7107490a-0b9b-415f-bcd4-80254f0b73fb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:45.159803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7ba80a6e-7c38-4a95-9b0f-887b7ddb05e0 req-7107490a-0b9b-415f-bcd4-80254f0b73fb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:45.188104 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-7ba80a6e-7c38-4a95-9b0f-887b7ddb05e0 req-7107490a-0b9b-415f-bcd4-80254f0b73fb service nova] Creating event network-changed:aaa3b81c-6e47-4e3d-b0f5-cdda263f206d for instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b on n-h1-839401-11 Aug 29 15:30:45.197342 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-7ba80a6e-7c38-4a95-9b0f-887b7ddb05e0 req-7107490a-0b9b-415f-bcd4-80254f0b73fb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073972 Aug 29 15:30:45.200493 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 754/1509] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:30:45.223044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b1fb8878-a389-4ff7-a16c-a07179e35c18 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:45.226696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b1fb8878-a389-4ff7-a16c-a07179e35c18 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:45.239970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1fb8878-a389-4ff7-a16c-a07179e35c18 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:45.241320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1fb8878-a389-4ff7-a16c-a07179e35c18 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:45.242226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1fb8878-a389-4ff7-a16c-a07179e35c18 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:45.244640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1fb8878-a389-4ff7-a16c-a07179e35c18 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:45.245577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1fb8878-a389-4ff7-a16c-a07179e35c18 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:45.246240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1fb8878-a389-4ff7-a16c-a07179e35c18 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:45.689275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b1fb8878-a389-4ff7-a16c-a07179e35c18 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:45.698954 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b1fb8878-a389-4ff7-a16c-a07179e35c18 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 200 len: 1315 microversion: 2.1 time: 0.497078 Aug 29 15:30:45.699543 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 755/1510] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:45 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:45.712124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-56bca3f0-b304-4db2-a193-67f3ba2186d9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:45.712124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-56bca3f0-b304-4db2-a193-67f3ba2186d9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:45.712124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56bca3f0-b304-4db2-a193-67f3ba2186d9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:45.712124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56bca3f0-b304-4db2-a193-67f3ba2186d9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:45.712730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56bca3f0-b304-4db2-a193-67f3ba2186d9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:45.713215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56bca3f0-b304-4db2-a193-67f3ba2186d9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:45.713693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56bca3f0-b304-4db2-a193-67f3ba2186d9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:45.714122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56bca3f0-b304-4db2-a193-67f3ba2186d9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:45.751233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-354f5994-376a-4aad-af72-e89e8be15768 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Updating instance_info_cache with network_info: [{"id": "aaa3b81c-6e47-4e3d-b0f5-cdda263f206d", "address": "fa:16:3e:47:d7:bc", "network": {"id": "09630ca2-45d5-438d-9a4e-d0e239ea63e6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-338998950-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0de1e6e8040d4d5f9ff87142c3c436bb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapaaa3b81c-6e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122360) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:30:45.769426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-354f5994-376a-4aad-af72-e89e8be15768 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Releasing lock "refresh_cache-61f2bf94-d2e3-42ec-8808-86ee2560ae1b" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:30:45.770630 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-354f5994-376a-4aad-af72-e89e8be15768 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "POST /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b/action" status: 202 len: 0 microversion: 2.1 time: 2.092808 Aug 29 15:30:45.771784 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 756/1511] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:30:43 2022] POST /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b/action => generated 0 bytes in 2095 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:30:45.777011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-11736b5a-acc7-48f7-a5c1-1ed1b5e2b863 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:45.777908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-11736b5a-acc7-48f7-a5c1-1ed1b5e2b863 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:45.784855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11736b5a-acc7-48f7-a5c1-1ed1b5e2b863 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:45.785812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11736b5a-acc7-48f7-a5c1-1ed1b5e2b863 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:45.786458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11736b5a-acc7-48f7-a5c1-1ed1b5e2b863 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:45.787468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11736b5a-acc7-48f7-a5c1-1ed1b5e2b863 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:45.788152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11736b5a-acc7-48f7-a5c1-1ed1b5e2b863 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:45.788914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11736b5a-acc7-48f7-a5c1-1ed1b5e2b863 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:45.834805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11736b5a-acc7-48f7-a5c1-1ed1b5e2b863 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:45.835637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11736b5a-acc7-48f7-a5c1-1ed1b5e2b863 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:45.836330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11736b5a-acc7-48f7-a5c1-1ed1b5e2b863 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:45.837145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-11736b5a-acc7-48f7-a5c1-1ed1b5e2b863 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lazy-loading 'fault' on Instance uuid 6c480235-81a3-46b9-9ea6-520b329f53ea {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:30:45.889264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-11736b5a-acc7-48f7-a5c1-1ed1b5e2b863 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36b9be537be45d88b1a7ef3543f26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be837968b7df43d89c7fc806a7387b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:45.892829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=4,nova_cell1:RELEASE=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:45.919435 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-11736b5a-acc7-48f7-a5c1-1ed1b5e2b863 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 200 len: 1355 microversion: 2.1 time: 0.146214 Aug 29 15:30:45.920158 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 757/1512] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:45 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 1355 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:45.926193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a0d3f8f0-923c-4977-8d2e-daa7355ead5f tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '.version_select at 0x7fc42b72c160>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:46.113959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-56bca3f0-b304-4db2-a193-67f3ba2186d9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:46.125758 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-56bca3f0-b304-4db2-a193-67f3ba2186d9 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1313 microversion: 2.1 time: 0.425024 Aug 29 15:30:46.126614 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 756/1513] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:45 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:46.129031 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a0d3f8f0-923c-4977-8d2e-daa7355ead5f tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/os-floating-ips/d88c9670-07e3-4c59-806e-25e57709cc29" status: 200 len: 184 microversion: 2.1 time: 0.207473 Aug 29 15:30:46.129725 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 758/1514] 10.222.0.62 () {58 vars in 1260 bytes} [Mon Aug 29 15:30:45 2022] GET /compute/v2.1/os-floating-ips/d88c9670-07e3-4c59-806e-25e57709cc29 => generated 184 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:46.142180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8e9627cb-f127-45a2-a527-74d559165f00 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.47"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:46.720634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b5a967ca-e6c2-48ac-83f3-87f204ca347a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:46.722194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b5a967ca-e6c2-48ac-83f3-87f204ca347a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:46.730057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5a967ca-e6c2-48ac-83f3-87f204ca347a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:46.730926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5a967ca-e6c2-48ac-83f3-87f204ca347a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:46.731823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5a967ca-e6c2-48ac-83f3-87f204ca347a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:46.732755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5a967ca-e6c2-48ac-83f3-87f204ca347a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:46.733441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5a967ca-e6c2-48ac-83f3-87f204ca347a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:46.734256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5a967ca-e6c2-48ac-83f3-87f204ca347a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:46.831339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8e9627cb-f127-45a2-a527-74d559165f00 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:46.837897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e9627cb-f127-45a2-a527-74d559165f00 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:46.838669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e9627cb-f127-45a2-a527-74d559165f00 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:46.839332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e9627cb-f127-45a2-a527-74d559165f00 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:46.848518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e9627cb-f127-45a2-a527-74d559165f00 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:46.849362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e9627cb-f127-45a2-a527-74d559165f00 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:46.850036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e9627cb-f127-45a2-a527-74d559165f00 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:46.905468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b5a967ca-e6c2-48ac-83f3-87f204ca347a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:46.913420 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b5a967ca-e6c2-48ac-83f3-87f204ca347a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 200 len: 1315 microversion: 2.1 time: 0.198045 Aug 29 15:30:46.914005 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 759/1515] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:46 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:46.935612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-8742efa0-4716-44fd-bcfb-f7462497d087 req-b015a5ac-f16f-46d0-97c9-758318bbdc17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89820ad0-4c75-4291-b1ef-b40cd2f1d9f6", "tag": "20649f66-01ca-4dbb-9a25-66dd9909aaba"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:46.947296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8742efa0-4716-44fd-bcfb-f7462497d087 req-b015a5ac-f16f-46d0-97c9-758318bbdc17 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:46.947707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8742efa0-4716-44fd-bcfb-f7462497d087 req-b015a5ac-f16f-46d0-97c9-758318bbdc17 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:46.948138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8742efa0-4716-44fd-bcfb-f7462497d087 req-b015a5ac-f16f-46d0-97c9-758318bbdc17 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:46.959573 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-8742efa0-4716-44fd-bcfb-f7462497d087 req-b015a5ac-f16f-46d0-97c9-758318bbdc17 service nova] Creating event network-changed:20649f66-01ca-4dbb-9a25-66dd9909aaba for instance 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 on n-h2-839401-11 Aug 29 15:30:46.964598 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-8742efa0-4716-44fd-bcfb-f7462497d087 req-b015a5ac-f16f-46d0-97c9-758318bbdc17 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033434 Aug 29 15:30:46.965230 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 760/1516] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:30:46.970177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-345d31b1-d9e1-48ee-b256-49c393157693 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:46.970922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-345d31b1-d9e1-48ee-b256-49c393157693 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:46.977978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-345d31b1-d9e1-48ee-b256-49c393157693 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:46.978472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-345d31b1-d9e1-48ee-b256-49c393157693 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:46.979011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-345d31b1-d9e1-48ee-b256-49c393157693 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:46.979572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-345d31b1-d9e1-48ee-b256-49c393157693 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:46.980204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-345d31b1-d9e1-48ee-b256-49c393157693 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:46.980610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-345d31b1-d9e1-48ee-b256-49c393157693 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:46.997537 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-345d31b1-d9e1-48ee-b256-49c393157693 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] HTTP exception thrown: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-345d31b1-d9e1-48ee-b256-49c393157693 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Request method failure captured: Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea HTTP/1.1 Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqQO8lVvOVNOH_xaGkL3hL_IZzI3guIuiIajKvZxm1qXaqWpkehw61luZwZxZhNycCQ9fiCHIa5Hr02BRP8jisDYUkkueEn6s1u7MNGWSne-LrVXj5LYlK-JQEa81-BD5P5odsm-BLFofm0CCvdQy6S86f5PdFCa7vL6zrop8SSmsI Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: be837968b7df43d89c7fc806a7387b18 Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:30:46.999516 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:30:47.001232 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_be837968b7df43d89c7fc806a7387b18", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/be837968b7df43d89c7fc806a7387b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/be837968b7df43d89c7fc806a7387b18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/be837968b7df43d89c7fc806a7387b18"}]}] Aug 29 15:30:47.001232 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:47.001232 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: be837968b7df43d89c7fc806a7387b18 Aug 29 15:30:47.001232 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:47.001232 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersWithSpecificFlavorTestJSON-812008571-project Aug 29 15:30:47.001232 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:30:47.001232 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:30:47.001232 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e36b9be537be45d88b1a7ef3543f26b4 Aug 29 15:30:47.001232 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571-project Aug 29 15:30:47.001232 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:30:47.001232 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. Aug 29 15:30:47.001232 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '6c480235-81a3-46b9-9ea6-520b329f53ea'} Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:47.002323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. Aug 29 15:30:47.003966 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:47.006302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-345d31b1-d9e1-48ee-b256-49c393157693 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Returning 404 to user: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:47.006302 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-345d31b1-d9e1-48ee-b256-49c393157693 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 404 len: 111 microversion: 2.1 time: 0.034720 Aug 29 15:30:47.006302 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 761/1517] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:46 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:47.013521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a63e155-2b1b-4b4f-9e11-09296ef6c2e4 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:47.014112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9a63e155-2b1b-4b4f-9e11-09296ef6c2e4 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:47.020865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a63e155-2b1b-4b4f-9e11-09296ef6c2e4 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:47.021358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a63e155-2b1b-4b4f-9e11-09296ef6c2e4 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:47.021797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a63e155-2b1b-4b4f-9e11-09296ef6c2e4 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:47.022737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a63e155-2b1b-4b4f-9e11-09296ef6c2e4 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:47.023197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a63e155-2b1b-4b4f-9e11-09296ef6c2e4 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:47.024008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a63e155-2b1b-4b4f-9e11-09296ef6c2e4 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:47.040450 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-9a63e155-2b1b-4b4f-9e11-09296ef6c2e4 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] HTTP exception thrown: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a63e155-2b1b-4b4f-9e11-09296ef6c2e4 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Request method failure captured: Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df HTTP/1.1 Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqQO8lVvOVNOH_xaGkL3hL_IZzI3guIuiIajKvZxm1qXaqWpkehw61luZwZxZhNycCQ9fiCHIa5Hr02BRP8jisDYUkkueEn6s1u7MNGWSne-LrVXj5LYlK-JQEa81-BD5P5odsm-BLFofm0CCvdQy6S86f5PdFCa7vL6zrop8SSmsI Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: be837968b7df43d89c7fc806a7387b18 Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:30:47.042067 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:30:47.043827 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_be837968b7df43d89c7fc806a7387b18", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/be837968b7df43d89c7fc806a7387b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/be837968b7df43d89c7fc806a7387b18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/be837968b7df43d89c7fc806a7387b18"}]}] Aug 29 15:30:47.043827 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:47.043827 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: be837968b7df43d89c7fc806a7387b18 Aug 29 15:30:47.043827 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:47.043827 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersWithSpecificFlavorTestJSON-812008571-project Aug 29 15:30:47.043827 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:30:47.043827 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:30:47.043827 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e36b9be537be45d88b1a7ef3543f26b4 Aug 29 15:30:47.043827 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571-project Aug 29 15:30:47.043827 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:30:47.043827 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:47.043827 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b7f44b5e-bcae-4e95-a11a-c781e6cf06df'} Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:47.048023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:47.049726 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:47.051143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a63e155-2b1b-4b4f-9e11-09296ef6c2e4 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Returning 404 to user: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:47.051143 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a63e155-2b1b-4b4f-9e11-09296ef6c2e4 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 404 len: 111 microversion: 2.1 time: 0.033842 Aug 29 15:30:47.051143 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 762/1518] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:47 2022] DELETE /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:30:47.052627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a1e5a406-6d5f-4636-9ea2-8e8b64c4b419 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:47.053287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a1e5a406-6d5f-4636-9ea2-8e8b64c4b419 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:47.059546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1e5a406-6d5f-4636-9ea2-8e8b64c4b419 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:47.060021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1e5a406-6d5f-4636-9ea2-8e8b64c4b419 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:47.060459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1e5a406-6d5f-4636-9ea2-8e8b64c4b419 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:47.061167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1e5a406-6d5f-4636-9ea2-8e8b64c4b419 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:47.061644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1e5a406-6d5f-4636-9ea2-8e8b64c4b419 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:47.062040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1e5a406-6d5f-4636-9ea2-8e8b64c4b419 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:47.076400 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-a1e5a406-6d5f-4636-9ea2-8e8b64c4b419 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] HTTP exception thrown: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a1e5a406-6d5f-4636-9ea2-8e8b64c4b419 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Request method failure captured: Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df HTTP/1.1 Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqQO8lVvOVNOH_xaGkL3hL_IZzI3guIuiIajKvZxm1qXaqWpkehw61luZwZxZhNycCQ9fiCHIa5Hr02BRP8jisDYUkkueEn6s1u7MNGWSne-LrVXj5LYlK-JQEa81-BD5P5odsm-BLFofm0CCvdQy6S86f5PdFCa7vL6zrop8SSmsI Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: be837968b7df43d89c7fc806a7387b18 Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:30:47.077992 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:30:47.079672 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_be837968b7df43d89c7fc806a7387b18", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/be837968b7df43d89c7fc806a7387b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/be837968b7df43d89c7fc806a7387b18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/be837968b7df43d89c7fc806a7387b18"}]}] Aug 29 15:30:47.079672 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:47.079672 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: be837968b7df43d89c7fc806a7387b18 Aug 29 15:30:47.079672 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:47.079672 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersWithSpecificFlavorTestJSON-812008571-project Aug 29 15:30:47.079672 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:30:47.079672 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:30:47.079672 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e36b9be537be45d88b1a7ef3543f26b4 Aug 29 15:30:47.079672 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571-project Aug 29 15:30:47.079672 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:30:47.079672 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:47.079672 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b7f44b5e-bcae-4e95-a11a-c781e6cf06df'} Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:47.083885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:47.085310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:47.086646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a1e5a406-6d5f-4636-9ea2-8e8b64c4b419 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Returning 404 to user: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:47.086646 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a1e5a406-6d5f-4636-9ea2-8e8b64c4b419 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 404 len: 111 microversion: 2.1 time: 0.031079 Aug 29 15:30:47.086646 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 763/1519] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:47 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:30:47.088797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a5a5dcd5-9b45-48a3-985f-7d303bbd7ea8 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '.version_select at 0x7fc430525ca0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:47.111290 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a5a5dcd5-9b45-48a3-985f-7d303bbd7ea8 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081306532" status: 202 len: 0 microversion: 2.1 time: 0.026321 Aug 29 15:30:47.112365 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 764/1520] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 15:30:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081306532 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:30:47.148632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-29c1203d-bbeb-4e37-a500-b859a5b34f9b tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:47.149584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-29c1203d-bbeb-4e37-a500-b859a5b34f9b tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:47.160027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c1203d-bbeb-4e37-a500-b859a5b34f9b tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:47.160499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c1203d-bbeb-4e37-a500-b859a5b34f9b tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:47.160985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c1203d-bbeb-4e37-a500-b859a5b34f9b tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:47.161971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c1203d-bbeb-4e37-a500-b859a5b34f9b tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:47.162457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c1203d-bbeb-4e37-a500-b859a5b34f9b tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:47.162896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c1203d-bbeb-4e37-a500-b859a5b34f9b tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:47.367245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-29c1203d-bbeb-4e37-a500-b859a5b34f9b tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:47.379058 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-29c1203d-bbeb-4e37-a500-b859a5b34f9b tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1313 microversion: 2.1 time: 0.234327 Aug 29 15:30:47.393479 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 765/1521] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:47 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:47.586149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e9627cb-f127-45a2-a527-74d559165f00 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "refresh_cache-61f2bf94-d2e3-42ec-8808-86ee2560ae1b" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:30:47.587791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e9627cb-f127-45a2-a527-74d559165f00 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquired lock "refresh_cache-61f2bf94-d2e3-42ec-8808-86ee2560ae1b" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:30:47.877108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e2724ccd-2abc-48e5-a7fd-0d933dd81faf tempest-ServersWithSpecificFlavorTestJSON-343320010 tempest-ServersWithSpecificFlavorTestJSON-343320010-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:47.899088 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e2724ccd-2abc-48e5-a7fd-0d933dd81faf tempest-ServersWithSpecificFlavorTestJSON-343320010 tempest-ServersWithSpecificFlavorTestJSON-343320010-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/2112833216" status: 202 len: 0 microversion: 2.1 time: 0.026301 Aug 29 15:30:47.899706 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 766/1522] 10.222.0.62 () {58 vars in 1161 bytes} [Mon Aug 29 15:30:47 2022] DELETE /compute/v2.1/flavors/2112833216 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:30:47.908982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6d78b191-10a1-4565-b998-090f936c63df tempest-ServersWithSpecificFlavorTestJSON-343320010 tempest-ServersWithSpecificFlavorTestJSON-343320010-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:47.932272 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6d78b191-10a1-4565-b998-090f936c63df tempest-ServersWithSpecificFlavorTestJSON-343320010 tempest-ServersWithSpecificFlavorTestJSON-343320010-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.027576 Aug 29 15:30:47.932995 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 767/1523] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:30:47 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:47.951592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e29aca76-324e-4f62-a239-583dc3441c2b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:47.952228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e29aca76-324e-4f62-a239-583dc3441c2b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:47.959037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e29aca76-324e-4f62-a239-583dc3441c2b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:47.959995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e29aca76-324e-4f62-a239-583dc3441c2b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:47.961002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e29aca76-324e-4f62-a239-583dc3441c2b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:47.961941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e29aca76-324e-4f62-a239-583dc3441c2b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:47.962713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e29aca76-324e-4f62-a239-583dc3441c2b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:47.963150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e29aca76-324e-4f62-a239-583dc3441c2b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.096299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:48.123906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e29aca76-324e-4f62-a239-583dc3441c2b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:48.132865 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e29aca76-324e-4f62-a239-583dc3441c2b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 200 len: 1501 microversion: 2.1 time: 0.186465 Aug 29 15:30:48.133468 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 768/1524] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:47 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 1501 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:48.138106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5aadead9-ab7e-4545-a841-388110672b7c tempest-ServersWithSpecificFlavorTestJSON-343320010 tempest-ServersWithSpecificFlavorTestJSON-343320010-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:48.157603 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5aadead9-ab7e-4545-a841-388110672b7c tempest-ServersWithSpecificFlavorTestJSON-343320010 tempest-ServersWithSpecificFlavorTestJSON-343320010-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/1821141378" status: 202 len: 0 microversion: 2.1 time: 0.023009 Aug 29 15:30:48.158621 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 769/1525] 10.222.0.62 () {58 vars in 1161 bytes} [Mon Aug 29 15:30:48 2022] DELETE /compute/v2.1/flavors/1821141378 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:30:48.164114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c2525c8-ecda-4807-ace0-bd814d3d598f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:48.164598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5c2525c8-ecda-4807-ace0-bd814d3d598f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:48.170670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c2525c8-ecda-4807-ace0-bd814d3d598f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:48.171161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c2525c8-ecda-4807-ace0-bd814d3d598f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:48.171586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c2525c8-ecda-4807-ace0-bd814d3d598f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.172288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c2525c8-ecda-4807-ace0-bd814d3d598f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:48.172764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c2525c8-ecda-4807-ace0-bd814d3d598f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:48.173212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c2525c8-ecda-4807-ace0-bd814d3d598f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.201679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5c2525c8-ecda-4807-ace0-bd814d3d598f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:48.280473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=10,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:48.294504 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5c2525c8-ecda-4807-ace0-bd814d3d598f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 204 len: 0 microversion: 2.1 time: 0.134806 Aug 29 15:30:48.298948 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 770/1526] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:48 2022] DELETE /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:48.301840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ce70c49a-6365-4c3a-954d-8047cd93fe59 tempest-ServersWithSpecificFlavorTestJSON-343320010 tempest-ServersWithSpecificFlavorTestJSON-343320010-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:48.324327 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ce70c49a-6365-4c3a-954d-8047cd93fe59 tempest-ServersWithSpecificFlavorTestJSON-343320010 tempest-ServersWithSpecificFlavorTestJSON-343320010-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027056 Aug 29 15:30:48.324907 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 771/1527] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:30:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:48.329411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-30abb7d3-fc1a-484c-bdab-a09167fdf1f2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:48.330138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-30abb7d3-fc1a-484c-bdab-a09167fdf1f2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:48.338418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30abb7d3-fc1a-484c-bdab-a09167fdf1f2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:48.338418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30abb7d3-fc1a-484c-bdab-a09167fdf1f2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:48.338418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30abb7d3-fc1a-484c-bdab-a09167fdf1f2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.338418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30abb7d3-fc1a-484c-bdab-a09167fdf1f2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:48.338832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30abb7d3-fc1a-484c-bdab-a09167fdf1f2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:48.338832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30abb7d3-fc1a-484c-bdab-a09167fdf1f2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.489759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-30abb7d3-fc1a-484c-bdab-a09167fdf1f2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:48.500959 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-30abb7d3-fc1a-484c-bdab-a09167fdf1f2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 200 len: 1507 microversion: 2.1 time: 0.174982 Aug 29 15:30:48.501880 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 772/1528] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:48 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:48.505973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=10 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:48.507597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-36b03cbc-467e-43bb-9aaa-20bf1e64f375 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:48.508400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-36b03cbc-467e-43bb-9aaa-20bf1e64f375 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:48.515147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36b03cbc-467e-43bb-9aaa-20bf1e64f375 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:48.515715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36b03cbc-467e-43bb-9aaa-20bf1e64f375 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:48.516201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36b03cbc-467e-43bb-9aaa-20bf1e64f375 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.517356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36b03cbc-467e-43bb-9aaa-20bf1e64f375 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:48.518130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36b03cbc-467e-43bb-9aaa-20bf1e64f375 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:48.518677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36b03cbc-467e-43bb-9aaa-20bf1e64f375 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.537326 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-36b03cbc-467e-43bb-9aaa-20bf1e64f375 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] HTTP exception thrown: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-36b03cbc-467e-43bb-9aaa-20bf1e64f375 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Request method failure captured: Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea HTTP/1.1 Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqQO8lVvOVNOH_xaGkL3hL_IZzI3guIuiIajKvZxm1qXaqWpkehw61luZwZxZhNycCQ9fiCHIa5Hr02BRP8jisDYUkkueEn6s1u7MNGWSne-LrVXj5LYlK-JQEa81-BD5P5odsm-BLFofm0CCvdQy6S86f5PdFCa7vL6zrop8SSmsI Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: be837968b7df43d89c7fc806a7387b18 Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:30:48.539144 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:30:48.540808 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_be837968b7df43d89c7fc806a7387b18", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/be837968b7df43d89c7fc806a7387b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/be837968b7df43d89c7fc806a7387b18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/be837968b7df43d89c7fc806a7387b18"}]}] Aug 29 15:30:48.540808 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:48.540808 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: be837968b7df43d89c7fc806a7387b18 Aug 29 15:30:48.540808 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:48.540808 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersWithSpecificFlavorTestJSON-812008571-project Aug 29 15:30:48.540808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:30:48.540808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:30:48.540808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e36b9be537be45d88b1a7ef3543f26b4 Aug 29 15:30:48.540808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571-project Aug 29 15:30:48.540808 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:30:48.540808 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. Aug 29 15:30:48.540808 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '6c480235-81a3-46b9-9ea6-520b329f53ea'} Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:48.541768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. Aug 29 15:30:48.543252 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.544793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-36b03cbc-467e-43bb-9aaa-20bf1e64f375 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Returning 404 to user: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:48.544793 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-36b03cbc-467e-43bb-9aaa-20bf1e64f375 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 404 len: 111 microversion: 2.1 time: 0.037457 Aug 29 15:30:48.544793 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 773/1529] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:48 2022] DELETE /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:48.545692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65bf7df6-3dd4-472e-ab80-77141d34109a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:48.546424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-65bf7df6-3dd4-472e-ab80-77141d34109a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:48.554632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65bf7df6-3dd4-472e-ab80-77141d34109a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:48.555422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65bf7df6-3dd4-472e-ab80-77141d34109a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:48.556229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65bf7df6-3dd4-472e-ab80-77141d34109a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.556955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65bf7df6-3dd4-472e-ab80-77141d34109a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:48.557725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65bf7df6-3dd4-472e-ab80-77141d34109a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:48.558479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65bf7df6-3dd4-472e-ab80-77141d34109a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.683509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-8e9627cb-f127-45a2-a527-74d559165f00 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Building network info cache for instance {{(pid=122361) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:30:48.699124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-65bf7df6-3dd4-472e-ab80-77141d34109a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:48.708014 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-65bf7df6-3dd4-472e-ab80-77141d34109a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1313 microversion: 2.1 time: 0.165841 Aug 29 15:30:48.708741 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 774/1530] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:48 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:48.713854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-918869b5-6d1f-446f-8c88-ee6740a578ec tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:48.714724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-918869b5-6d1f-446f-8c88-ee6740a578ec tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: 6c480235-81a3-46b9-9ea6-520b329f53ea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:48.720982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-918869b5-6d1f-446f-8c88-ee6740a578ec tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:48.721804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-918869b5-6d1f-446f-8c88-ee6740a578ec tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:48.722503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-918869b5-6d1f-446f-8c88-ee6740a578ec tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.723436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-918869b5-6d1f-446f-8c88-ee6740a578ec tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:48.723960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-918869b5-6d1f-446f-8c88-ee6740a578ec tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:48.724441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-918869b5-6d1f-446f-8c88-ee6740a578ec tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.743907 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-918869b5-6d1f-446f-8c88-ee6740a578ec tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] HTTP exception thrown: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-918869b5-6d1f-446f-8c88-ee6740a578ec tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Request method failure captured: Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea HTTP/1.1 Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqQO8lVvOVNOH_xaGkL3hL_IZzI3guIuiIajKvZxm1qXaqWpkehw61luZwZxZhNycCQ9fiCHIa5Hr02BRP8jisDYUkkueEn6s1u7MNGWSne-LrVXj5LYlK-JQEa81-BD5P5odsm-BLFofm0CCvdQy6S86f5PdFCa7vL6zrop8SSmsI Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: be837968b7df43d89c7fc806a7387b18 Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:30:48.745625 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:30:48.747325 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_be837968b7df43d89c7fc806a7387b18", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/be837968b7df43d89c7fc806a7387b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/be837968b7df43d89c7fc806a7387b18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/be837968b7df43d89c7fc806a7387b18"}]}] Aug 29 15:30:48.747325 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:48.747325 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: be837968b7df43d89c7fc806a7387b18 Aug 29 15:30:48.747325 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:48.747325 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersWithSpecificFlavorTestJSON-812008571-project Aug 29 15:30:48.747325 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:30:48.747325 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:30:48.747325 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e36b9be537be45d88b1a7ef3543f26b4 Aug 29 15:30:48.747325 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571-project Aug 29 15:30:48.747325 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:30:48.747325 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. Aug 29 15:30:48.747325 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '6c480235-81a3-46b9-9ea6-520b329f53ea'} Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:48.748339 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. Aug 29 15:30:48.749899 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.751286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-918869b5-6d1f-446f-8c88-ee6740a578ec tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Returning 404 to user: Instance 6c480235-81a3-46b9-9ea6-520b329f53ea could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:48.751286 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-918869b5-6d1f-446f-8c88-ee6740a578ec tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea" status: 404 len: 111 microversion: 2.1 time: 0.038949 Aug 29 15:30:48.752718 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 775/1531] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:48 2022] GET /compute/v2.1/servers/6c480235-81a3-46b9-9ea6-520b329f53ea => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:48.758089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ca2e010c-15eb-471b-832b-62fdca8b4439 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:48.758089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ca2e010c-15eb-471b-832b-62fdca8b4439 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:48.766862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca2e010c-15eb-471b-832b-62fdca8b4439 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:48.769413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca2e010c-15eb-471b-832b-62fdca8b4439 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:48.770077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca2e010c-15eb-471b-832b-62fdca8b4439 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.771362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca2e010c-15eb-471b-832b-62fdca8b4439 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:48.771362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca2e010c-15eb-471b-832b-62fdca8b4439 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:48.771951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca2e010c-15eb-471b-832b-62fdca8b4439 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.787549 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-ca2e010c-15eb-471b-832b-62fdca8b4439 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] HTTP exception thrown: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ca2e010c-15eb-471b-832b-62fdca8b4439 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Request method failure captured: Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df HTTP/1.1 Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqQO8lVvOVNOH_xaGkL3hL_IZzI3guIuiIajKvZxm1qXaqWpkehw61luZwZxZhNycCQ9fiCHIa5Hr02BRP8jisDYUkkueEn6s1u7MNGWSne-LrVXj5LYlK-JQEa81-BD5P5odsm-BLFofm0CCvdQy6S86f5PdFCa7vL6zrop8SSmsI Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: be837968b7df43d89c7fc806a7387b18 Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:30:48.789236 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:30:48.790936 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_be837968b7df43d89c7fc806a7387b18", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/be837968b7df43d89c7fc806a7387b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/be837968b7df43d89c7fc806a7387b18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/be837968b7df43d89c7fc806a7387b18"}]}] Aug 29 15:30:48.790936 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:48.790936 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: be837968b7df43d89c7fc806a7387b18 Aug 29 15:30:48.790936 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:48.790936 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersWithSpecificFlavorTestJSON-812008571-project Aug 29 15:30:48.790936 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:30:48.790936 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:30:48.790936 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e36b9be537be45d88b1a7ef3543f26b4 Aug 29 15:30:48.790936 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571-project Aug 29 15:30:48.790936 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:30:48.790936 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:48.790936 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b7f44b5e-bcae-4e95-a11a-c781e6cf06df'} Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:48.792018 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:48.793518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.794897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ca2e010c-15eb-471b-832b-62fdca8b4439 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Returning 404 to user: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:48.794897 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ca2e010c-15eb-471b-832b-62fdca8b4439 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 404 len: 111 microversion: 2.1 time: 0.037703 Aug 29 15:30:48.794897 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 776/1532] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:48 2022] DELETE /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:48.802362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-09664f6d-410e-4598-9738-610213748118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:48.803056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-09664f6d-410e-4598-9738-610213748118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] [instance: b7f44b5e-bcae-4e95-a11a-c781e6cf06df] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:48.810930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09664f6d-410e-4598-9738-610213748118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:48.811478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09664f6d-410e-4598-9738-610213748118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:48.811909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09664f6d-410e-4598-9738-610213748118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.812660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09664f6d-410e-4598-9738-610213748118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:48.813133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09664f6d-410e-4598-9738-610213748118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:48.813624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09664f6d-410e-4598-9738-610213748118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:48.829583 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-09664f6d-410e-4598-9738-610213748118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] HTTP exception thrown: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-09664f6d-410e-4598-9738-610213748118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Request method failure captured: Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df HTTP/1.1 Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqQO8lVvOVNOH_xaGkL3hL_IZzI3guIuiIajKvZxm1qXaqWpkehw61luZwZxZhNycCQ9fiCHIa5Hr02BRP8jisDYUkkueEn6s1u7MNGWSne-LrVXj5LYlK-JQEa81-BD5P5odsm-BLFofm0CCvdQy6S86f5PdFCa7vL6zrop8SSmsI Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: be837968b7df43d89c7fc806a7387b18 Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:30:48.831326 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:30:48.832782 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_be837968b7df43d89c7fc806a7387b18", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/be837968b7df43d89c7fc806a7387b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/be837968b7df43d89c7fc806a7387b18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/be837968b7df43d89c7fc806a7387b18"}]}] Aug 29 15:30:48.832782 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:48.832782 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: be837968b7df43d89c7fc806a7387b18 Aug 29 15:30:48.832782 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571 Aug 29 15:30:48.832782 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersWithSpecificFlavorTestJSON-812008571-project Aug 29 15:30:48.832782 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:30:48.832782 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:30:48.832782 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e36b9be537be45d88b1a7ef3543f26b4 Aug 29 15:30:48.832782 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-812008571-project Aug 29 15:30:48.832782 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:30:48.832782 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:48.832782 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b7f44b5e-bcae-4e95-a11a-c781e6cf06df'} Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:48.834413 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. Aug 29 15:30:48.835999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:48.838762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-09664f6d-410e-4598-9738-610213748118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] Returning 404 to user: Instance b7f44b5e-bcae-4e95-a11a-c781e6cf06df could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:48.838762 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-09664f6d-410e-4598-9738-610213748118 tempest-ServersWithSpecificFlavorTestJSON-812008571 tempest-ServersWithSpecificFlavorTestJSON-812008571-project] 10.222.0.62 "GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df" status: 404 len: 111 microversion: 2.1 time: 0.035014 Aug 29 15:30:48.838762 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 777/1533] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:48 2022] GET /compute/v2.1/servers/b7f44b5e-bcae-4e95-a11a-c781e6cf06df => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:30:49.000878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-b4029b01-a00d-4d66-82e0-71365c8df45b req-9396db48-e03c-4e48-84b3-c258b333c5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67cc023-9c10-4758-80f6-56a5ce0622cb", "name": "network-vif-deleted", "tag": "0097cd11-b308-47ff-8ccd-e99bd00b674b"}, {"name": "network-changed", "server_uuid": "61f2bf94-d2e3-42ec-8808-86ee2560ae1b", "tag": "aaa3b81c-6e47-4e3d-b0f5-cdda263f206d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:49.013115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b4029b01-a00d-4d66-82e0-71365c8df45b req-9396db48-e03c-4e48-84b3-c258b333c5ec service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:49.013970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b4029b01-a00d-4d66-82e0-71365c8df45b req-9396db48-e03c-4e48-84b3-c258b333c5ec service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:49.014732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b4029b01-a00d-4d66-82e0-71365c8df45b req-9396db48-e03c-4e48-84b3-c258b333c5ec service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:49.036311 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-b4029b01-a00d-4d66-82e0-71365c8df45b req-9396db48-e03c-4e48-84b3-c258b333c5ec service nova] Creating event network-vif-deleted:0097cd11-b308-47ff-8ccd-e99bd00b674b for instance f67cc023-9c10-4758-80f6-56a5ce0622cb on n-h2-839401-11 Aug 29 15:30:49.043798 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-b4029b01-a00d-4d66-82e0-71365c8df45b req-9396db48-e03c-4e48-84b3-c258b333c5ec service nova] Creating event network-changed:aaa3b81c-6e47-4e3d-b0f5-cdda263f206d for instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b on n-h1-839401-11 Aug 29 15:30:49.053145 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-b4029b01-a00d-4d66-82e0-71365c8df45b req-9396db48-e03c-4e48-84b3-c258b333c5ec service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.060210 Aug 29 15:30:49.054425 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 778/1534] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:30:49.251267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-8e9627cb-f127-45a2-a527-74d559165f00 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Updating instance_info_cache with network_info: [{"id": "aaa3b81c-6e47-4e3d-b0f5-cdda263f206d", "address": "fa:16:3e:47:d7:bc", "network": {"id": "09630ca2-45d5-438d-9a4e-d0e239ea63e6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-338998950-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0de1e6e8040d4d5f9ff87142c3c436bb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapaaa3b81c-6e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122361) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:30:49.267226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e9627cb-f127-45a2-a527-74d559165f00 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Releasing lock "refresh_cache-61f2bf94-d2e3-42ec-8808-86ee2560ae1b" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:30:49.268439 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8e9627cb-f127-45a2-a527-74d559165f00 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "POST /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b/action" status: 202 len: 0 microversion: 2.1 time: 3.130680 Aug 29 15:30:49.269780 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 757/1535] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:30:46 2022] POST /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b/action => generated 0 bytes in 3132 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:30:49.280435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c405c906-9353-40fb-bf9e-7b97d5611df1 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:49.282630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c405c906-9353-40fb-bf9e-7b97d5611df1 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:49.291204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c405c906-9353-40fb-bf9e-7b97d5611df1 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:49.291905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c405c906-9353-40fb-bf9e-7b97d5611df1 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:49.292403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c405c906-9353-40fb-bf9e-7b97d5611df1 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:49.293390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c405c906-9353-40fb-bf9e-7b97d5611df1 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:49.293944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c405c906-9353-40fb-bf9e-7b97d5611df1 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:49.294439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c405c906-9353-40fb-bf9e-7b97d5611df1 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:49.324178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c405c906-9353-40fb-bf9e-7b97d5611df1 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:49.415620 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c405c906-9353-40fb-bf9e-7b97d5611df1 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 204 len: 0 microversion: 2.1 time: 0.140629 Aug 29 15:30:49.416263 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 779/1536] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:49 2022] DELETE /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:49.424948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f8ff1f11-948b-48ed-8197-6d0b09a7029a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:49.425755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f8ff1f11-948b-48ed-8197-6d0b09a7029a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:49.431816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8ff1f11-948b-48ed-8197-6d0b09a7029a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:49.432298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8ff1f11-948b-48ed-8197-6d0b09a7029a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:49.432725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8ff1f11-948b-48ed-8197-6d0b09a7029a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:49.433447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8ff1f11-948b-48ed-8197-6d0b09a7029a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:49.433895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8ff1f11-948b-48ed-8197-6d0b09a7029a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:49.434313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8ff1f11-948b-48ed-8197-6d0b09a7029a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:49.466254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8ff1f11-948b-48ed-8197-6d0b09a7029a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:49.466858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8ff1f11-948b-48ed-8197-6d0b09a7029a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:49.467484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8ff1f11-948b-48ed-8197-6d0b09a7029a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:49.467937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-f8ff1f11-948b-48ed-8197-6d0b09a7029a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lazy-loading 'fault' on Instance uuid f67cc023-9c10-4758-80f6-56a5ce0622cb {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:30:49.511218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f8ff1f11-948b-48ed-8197-6d0b09a7029a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:49.519369 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f8ff1f11-948b-48ed-8197-6d0b09a7029a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 200 len: 1319 microversion: 2.1 time: 0.098354 Aug 29 15:30:49.520187 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 758/1537] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:49 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 1319 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:49.527953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-897bf054-b2ec-4e98-ba09-0d441ca84a68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:49.528659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-897bf054-b2ec-4e98-ba09-0d441ca84a68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:49.535482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-897bf054-b2ec-4e98-ba09-0d441ca84a68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:49.535971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-897bf054-b2ec-4e98-ba09-0d441ca84a68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:49.536404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-897bf054-b2ec-4e98-ba09-0d441ca84a68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:49.537121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-897bf054-b2ec-4e98-ba09-0d441ca84a68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:49.537601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-897bf054-b2ec-4e98-ba09-0d441ca84a68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:49.538028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-897bf054-b2ec-4e98-ba09-0d441ca84a68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:49.729370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4cc51fe6-f8f3-4542-93c9-9b1ff01be09a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:49.731411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4cc51fe6-f8f3-4542-93c9-9b1ff01be09a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:49.738112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cc51fe6-f8f3-4542-93c9-9b1ff01be09a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:49.738854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cc51fe6-f8f3-4542-93c9-9b1ff01be09a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:49.739449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cc51fe6-f8f3-4542-93c9-9b1ff01be09a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:49.740342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cc51fe6-f8f3-4542-93c9-9b1ff01be09a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:49.740952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cc51fe6-f8f3-4542-93c9-9b1ff01be09a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:49.741763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cc51fe6-f8f3-4542-93c9-9b1ff01be09a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:49.762283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:49.820210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-897bf054-b2ec-4e98-ba09-0d441ca84a68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:49.828318 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-897bf054-b2ec-4e98-ba09-0d441ca84a68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 200 len: 1507 microversion: 2.1 time: 0.305077 Aug 29 15:30:49.828909 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 780/1538] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:49 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:49.899065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4cc51fe6-f8f3-4542-93c9-9b1ff01be09a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:49.908192 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4cc51fe6-f8f3-4542-93c9-9b1ff01be09a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1313 microversion: 2.1 time: 0.184043 Aug 29 15:30:49.909066 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 759/1539] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:49 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:50.540692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9b367b2c-af77-4f4c-8fce-e404d409da4a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:50.541545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9b367b2c-af77-4f4c-8fce-e404d409da4a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:50.549544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b367b2c-af77-4f4c-8fce-e404d409da4a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:50.550444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b367b2c-af77-4f4c-8fce-e404d409da4a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:50.551080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b367b2c-af77-4f4c-8fce-e404d409da4a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:50.552623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b367b2c-af77-4f4c-8fce-e404d409da4a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:50.553644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b367b2c-af77-4f4c-8fce-e404d409da4a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:50.554121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b367b2c-af77-4f4c-8fce-e404d409da4a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:50.589210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b367b2c-af77-4f4c-8fce-e404d409da4a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:50.589443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b367b2c-af77-4f4c-8fce-e404d409da4a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:50.589926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b367b2c-af77-4f4c-8fce-e404d409da4a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:50.590567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-9b367b2c-af77-4f4c-8fce-e404d409da4a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lazy-loading 'fault' on Instance uuid f67cc023-9c10-4758-80f6-56a5ce0622cb {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:30:50.678093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9b367b2c-af77-4f4c-8fce-e404d409da4a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:50.686646 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9b367b2c-af77-4f4c-8fce-e404d409da4a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 200 len: 1319 microversion: 2.1 time: 0.150092 Aug 29 15:30:50.687350 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 781/1540] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:50 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:50.851842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f0c841ba-3486-4c23-ba68-5e965579d567 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:50.853112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f0c841ba-3486-4c23-ba68-5e965579d567 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:50.860333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0c841ba-3486-4c23-ba68-5e965579d567 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:50.860928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0c841ba-3486-4c23-ba68-5e965579d567 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:50.861568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0c841ba-3486-4c23-ba68-5e965579d567 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:50.862512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0c841ba-3486-4c23-ba68-5e965579d567 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:50.863202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0c841ba-3486-4c23-ba68-5e965579d567 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:50.863738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0c841ba-3486-4c23-ba68-5e965579d567 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:50.927831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a9475cda-d7d2-429f-8960-1caf1d1739c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:50.928922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a9475cda-d7d2-429f-8960-1caf1d1739c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:50.936360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9475cda-d7d2-429f-8960-1caf1d1739c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:50.937562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9475cda-d7d2-429f-8960-1caf1d1739c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:50.938092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9475cda-d7d2-429f-8960-1caf1d1739c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:50.939033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9475cda-d7d2-429f-8960-1caf1d1739c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:50.939592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9475cda-d7d2-429f-8960-1caf1d1739c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:50.940210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9475cda-d7d2-429f-8960-1caf1d1739c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:51.002944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f0c841ba-3486-4c23-ba68-5e965579d567 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:51.011788 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f0c841ba-3486-4c23-ba68-5e965579d567 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 200 len: 1465 microversion: 2.1 time: 0.163841 Aug 29 15:30:51.013020 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 760/1541] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:50 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 1465 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:51.056926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-993b8437-3c7f-4cce-b35f-238710663896 req-bb96bbb0-c531-455b-a987-4ea3fbe1f9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59e1efd-a5b5-44ad-98ce-33999d052840", "name": "network-vif-deleted", "tag": "349b2044-7866-4493-8b00-50061ba7fbb9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:51.073575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-993b8437-3c7f-4cce-b35f-238710663896 req-bb96bbb0-c531-455b-a987-4ea3fbe1f9c6 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:51.075490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-993b8437-3c7f-4cce-b35f-238710663896 req-bb96bbb0-c531-455b-a987-4ea3fbe1f9c6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:51.076211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-993b8437-3c7f-4cce-b35f-238710663896 req-bb96bbb0-c531-455b-a987-4ea3fbe1f9c6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:51.098926 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-993b8437-3c7f-4cce-b35f-238710663896 req-bb96bbb0-c531-455b-a987-4ea3fbe1f9c6 service nova] Creating event network-vif-deleted:349b2044-7866-4493-8b00-50061ba7fbb9 for instance f59e1efd-a5b5-44ad-98ce-33999d052840 on n-h1-839401-11 Aug 29 15:30:51.112958 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-993b8437-3c7f-4cce-b35f-238710663896 req-bb96bbb0-c531-455b-a987-4ea3fbe1f9c6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057768 Aug 29 15:30:51.115450 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 761/1542] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:30:51.235743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a9475cda-d7d2-429f-8960-1caf1d1739c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:51.246932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:51.249857 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a9475cda-d7d2-429f-8960-1caf1d1739c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1313 microversion: 2.1 time: 0.325906 Aug 29 15:30:51.251339 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 782/1543] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:50 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:51.574328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-60d86d43-7167-4139-911b-27850ef42ba2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:51.575042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-60d86d43-7167-4139-911b-27850ef42ba2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:51.581616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60d86d43-7167-4139-911b-27850ef42ba2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:51.582319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60d86d43-7167-4139-911b-27850ef42ba2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:51.583030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60d86d43-7167-4139-911b-27850ef42ba2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:51.583895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60d86d43-7167-4139-911b-27850ef42ba2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:51.584500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60d86d43-7167-4139-911b-27850ef42ba2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:51.585124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60d86d43-7167-4139-911b-27850ef42ba2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:51.707698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-29bcfbd8-f850-406c-8aff-6fac5e5c77ba tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:51.709130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-29bcfbd8-f850-406c-8aff-6fac5e5c77ba tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: f67cc023-9c10-4758-80f6-56a5ce0622cb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:51.717514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29bcfbd8-f850-406c-8aff-6fac5e5c77ba tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:51.718411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29bcfbd8-f850-406c-8aff-6fac5e5c77ba tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:51.719119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29bcfbd8-f850-406c-8aff-6fac5e5c77ba tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:51.720104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29bcfbd8-f850-406c-8aff-6fac5e5c77ba tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:51.720773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29bcfbd8-f850-406c-8aff-6fac5e5c77ba tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:51.721471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29bcfbd8-f850-406c-8aff-6fac5e5c77ba tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:51.740215 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-29bcfbd8-f850-406c-8aff-6fac5e5c77ba tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] HTTP exception thrown: Instance f67cc023-9c10-4758-80f6-56a5ce0622cb could not be found. Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-29bcfbd8-f850-406c-8aff-6fac5e5c77ba tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Request method failure captured: Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb HTTP/1.1 Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNtyXZ4UWcpT1PGTtzBGpSuJ_orK6w7fBjKyN-qzAj13qjyEaRs46OUa5uGuf783E3a9quG7r2pIM6KB4NEeURwigatViAivi253UqsiaNE7-zh3kTEVIa1fwtopuNYfvEzrw2MH-68rklRH3QKRVRP1zKFkHsFfZS_7tutpo6YT8NU Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 0de1e6e8040d4d5f9ff87142c3c436bb Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1422716330 Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:30:51.742038 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:30:51.743497 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0de1e6e8040d4d5f9ff87142c3c436bb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0de1e6e8040d4d5f9ff87142c3c436bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0de1e6e8040d4d5f9ff87142c3c436bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0de1e6e8040d4d5f9ff87142c3c436bb"}]}] Aug 29 15:30:51.743497 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1422716330 Aug 29 15:30:51.743497 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 0de1e6e8040d4d5f9ff87142c3c436bb Aug 29 15:30:51.743497 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1422716330 Aug 29 15:30:51.743497 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-FloatingIPsAssociationTestJSON-1422716330-project Aug 29 15:30:51.743497 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:30:51.743497 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:30:51.743497 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 9e11d7d908bf432d80589193031172c2 Aug 29 15:30:51.743497 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1422716330-project Aug 29 15:30:51.743497 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:30:51.743497 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance f67cc023-9c10-4758-80f6-56a5ce0622cb could not be found. Aug 29 15:30:51.743497 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'f67cc023-9c10-4758-80f6-56a5ce0622cb'} Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67cc023-9c10-4758-80f6-56a5ce0622cb could not be found. Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:51.744459 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67cc023-9c10-4758-80f6-56a5ce0622cb could not be found. Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67cc023-9c10-4758-80f6-56a5ce0622cb could not be found. Aug 29 15:30:51.745815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:30:51.749010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-29bcfbd8-f850-406c-8aff-6fac5e5c77ba tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Returning 404 to user: Instance f67cc023-9c10-4758-80f6-56a5ce0622cb could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:51.751254 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-29bcfbd8-f850-406c-8aff-6fac5e5c77ba tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb" status: 404 len: 111 microversion: 2.1 time: 0.047117 Aug 29 15:30:51.752647 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 783/1544] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:51 2022] GET /compute/v2.1/servers/f67cc023-9c10-4758-80f6-56a5ce0622cb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:30:51.773424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-79354e92-126c-449b-99db-110b192cd4a4 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '.version_select at 0x7fc42b7e5af0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:52.025214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-60d86d43-7167-4139-911b-27850ef42ba2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'services' on Instance uuid 982d1df4-7b96-4fbf-8ec2-61752962955d {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:30:52.043253 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-60d86d43-7167-4139-911b-27850ef42ba2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 2348 microversion: 2.25 time: 0.473151 Aug 29 15:30:52.061845 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 762/1545] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:30:51 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 2348 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:30:52.069514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5fbb3953-29ec-41f8-a4d9-a220c06b127e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:52.070166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5fbb3953-29ec-41f8-a4d9-a220c06b127e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:52.077535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fbb3953-29ec-41f8-a4d9-a220c06b127e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:52.078394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fbb3953-29ec-41f8-a4d9-a220c06b127e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:52.078847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fbb3953-29ec-41f8-a4d9-a220c06b127e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:52.079627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fbb3953-29ec-41f8-a4d9-a220c06b127e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:52.080152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fbb3953-29ec-41f8-a4d9-a220c06b127e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:52.081176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fbb3953-29ec-41f8-a4d9-a220c06b127e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:52.100830 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-5fbb3953-29ec-41f8-a4d9-a220c06b127e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5fbb3953-29ec-41f8-a4d9-a220c06b127e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 HTTP/1.1 Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:30:52.102912 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:30:52.104535 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:30:52.104535 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:30:52.104535 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:30:52.104535 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:30:52.104535 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:30:52.104535 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:30:52.104535 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:30:52.104535 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:30:52.104535 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:30:52.104535 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:30:52.104535 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. Aug 29 15:30:52.104535 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'f59e1efd-a5b5-44ad-98ce-33999d052840'} Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:52.105596 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. Aug 29 15:30:52.107152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:52.108597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5fbb3953-29ec-41f8-a4d9-a220c06b127e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:52.108597 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5fbb3953-29ec-41f8-a4d9-a220c06b127e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 404 len: 111 microversion: 2.1 time: 0.044336 Aug 29 15:30:52.109134 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 763/1546] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:52 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:52.119860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eb8eef4b-d077-4ba0-a60f-68fdbf885adf tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:52.123754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb8eef4b-d077-4ba0-a60f-68fdbf885adf tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:52.124239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb8eef4b-d077-4ba0-a60f-68fdbf885adf tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:52.124673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb8eef4b-d077-4ba0-a60f-68fdbf885adf tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:52.125460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb8eef4b-d077-4ba0-a60f-68fdbf885adf tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:52.125914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb8eef4b-d077-4ba0-a60f-68fdbf885adf tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:52.126336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb8eef4b-d077-4ba0-a60f-68fdbf885adf tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:52.155683 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eb8eef4b-d077-4ba0-a60f-68fdbf885adf tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.045274 Aug 29 15:30:52.163756 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 764/1547] 10.222.0.62 () {60 vars in 1217 bytes} [Mon Aug 29 15:30:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:30:52.231433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-427458458", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "cb3199df-483a-4605-86c6-a5d65679d5da"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:52.287650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] validate_networks() for [('cb3199df-483a-4605-86c6-a5d65679d5da', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:30:52.779673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:30:52.780455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:30:52.780969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:30:52.781418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:30:52.782521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:30:52.813039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:52.813682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:52.814123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:52.814932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:52.815394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:52.815822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:52.836926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Getting quotas for project bbbc9e55a8f24d70a82b79243b0fa9e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:30:52.846053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Getting quotas for user 8dbbadfdb27047dd9237f4a1d311867e and project bbbc9e55a8f24d70a82b79243b0fa9e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:30:52.861913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:30:52.865240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:30:52.921944 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c97cc69b-8983-4612-8d52-34ca08c9f592 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.694221 Aug 29 15:30:52.928791 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 765/1548] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:30:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:30:52.933992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-75894d76-4560-4fc8-9fe5-7f7ba142733a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:52.934633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-75894d76-4560-4fc8-9fe5-7f7ba142733a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:52.943185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75894d76-4560-4fc8-9fe5-7f7ba142733a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:52.943684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75894d76-4560-4fc8-9fe5-7f7ba142733a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:52.944194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75894d76-4560-4fc8-9fe5-7f7ba142733a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:52.944842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75894d76-4560-4fc8-9fe5-7f7ba142733a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:52.945344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75894d76-4560-4fc8-9fe5-7f7ba142733a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:52.945773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75894d76-4560-4fc8-9fe5-7f7ba142733a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:53.208800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-75894d76-4560-4fc8-9fe5-7f7ba142733a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:53.242619 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-75894d76-4560-4fc8-9fe5-7f7ba142733a tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1313 microversion: 2.1 time: 0.312481 Aug 29 15:30:53.244921 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 766/1549] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:52 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:53.249693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-69afc249-355f-4da7-9d92-0202ddc1418f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:53.250474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-69afc249-355f-4da7-9d92-0202ddc1418f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:53.328244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-69afc249-355f-4da7-9d92-0202ddc1418f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:53.338206 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-69afc249-355f-4da7-9d92-0202ddc1418f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1214 microversion: 2.1 time: 0.091873 Aug 29 15:30:53.352273 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 767/1550] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:53 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:53.529524 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-79354e92-126c-449b-99db-110b192cd4a4 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "DELETE /compute/v2.1/os-floating-ips/d88c9670-07e3-4c59-806e-25e57709cc29" status: 202 len: 0 microversion: 2.1 time: 1.758421 Aug 29 15:30:53.531820 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 784/1551] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:30:51 2022] DELETE /compute/v2.1/os-floating-ips/d88c9670-07e3-4c59-806e-25e57709cc29 => generated 0 bytes in 1775 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:30:53.546563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-987936a2-31f9-496f-af43-d933e8dd8690 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:53.551320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-987936a2-31f9-496f-af43-d933e8dd8690 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:53.563012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-987936a2-31f9-496f-af43-d933e8dd8690 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:53.566780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-987936a2-31f9-496f-af43-d933e8dd8690 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:53.567248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-987936a2-31f9-496f-af43-d933e8dd8690 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:53.567991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-987936a2-31f9-496f-af43-d933e8dd8690 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:53.569114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-987936a2-31f9-496f-af43-d933e8dd8690 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:53.570175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-987936a2-31f9-496f-af43-d933e8dd8690 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:53.603279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-987936a2-31f9-496f-af43-d933e8dd8690 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:53.722070 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-987936a2-31f9-496f-af43-d933e8dd8690 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "DELETE /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 204 len: 0 microversion: 2.1 time: 0.185762 Aug 29 15:30:53.723602 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 768/1552] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:53 2022] DELETE /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:53.735312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7dd02b8c-68e1-49e3-9af7-3b6c2222e797 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:53.736440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7dd02b8c-68e1-49e3-9af7-3b6c2222e797 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:53.757825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dd02b8c-68e1-49e3-9af7-3b6c2222e797 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:53.758447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dd02b8c-68e1-49e3-9af7-3b6c2222e797 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:53.758984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dd02b8c-68e1-49e3-9af7-3b6c2222e797 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:53.759808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dd02b8c-68e1-49e3-9af7-3b6c2222e797 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:53.760388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dd02b8c-68e1-49e3-9af7-3b6c2222e797 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:53.760929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dd02b8c-68e1-49e3-9af7-3b6c2222e797 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:53.943995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7dd02b8c-68e1-49e3-9af7-3b6c2222e797 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:53.955005 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7dd02b8c-68e1-49e3-9af7-3b6c2222e797 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1526 microversion: 2.1 time: 0.227094 Aug 29 15:30:53.956150 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 785/1553] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:53 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1526 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:54.268812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2c920ee8-51a1-47a9-a541-0c86c4359620 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:54.270375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2c920ee8-51a1-47a9-a541-0c86c4359620 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:54.277247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c920ee8-51a1-47a9-a541-0c86c4359620 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:54.277965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c920ee8-51a1-47a9-a541-0c86c4359620 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:54.278576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c920ee8-51a1-47a9-a541-0c86c4359620 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:54.279434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c920ee8-51a1-47a9-a541-0c86c4359620 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:54.280593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c920ee8-51a1-47a9-a541-0c86c4359620 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:54.281376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c920ee8-51a1-47a9-a541-0c86c4359620 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:54.370743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-266a5e54-1fb0-4ba3-ad36-083e1b39c050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:54.372642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-266a5e54-1fb0-4ba3-ad36-083e1b39c050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:54.388379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-266a5e54-1fb0-4ba3-ad36-083e1b39c050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:54.389184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-266a5e54-1fb0-4ba3-ad36-083e1b39c050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:54.389806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-266a5e54-1fb0-4ba3-ad36-083e1b39c050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:54.390718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-266a5e54-1fb0-4ba3-ad36-083e1b39c050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:54.392563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-266a5e54-1fb0-4ba3-ad36-083e1b39c050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:54.396461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-266a5e54-1fb0-4ba3-ad36-083e1b39c050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:54.425125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2c920ee8-51a1-47a9-a541-0c86c4359620 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:54.438218 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2c920ee8-51a1-47a9-a541-0c86c4359620 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1313 microversion: 2.1 time: 0.174253 Aug 29 15:30:54.440593 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 769/1554] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:54 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:54.528927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-266a5e54-1fb0-4ba3-ad36-083e1b39c050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:54.544679 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-266a5e54-1fb0-4ba3-ad36-083e1b39c050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1266 microversion: 2.1 time: 0.187828 Aug 29 15:30:54.560824 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 786/1555] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:54 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:54.882627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d1bd42b0-9706-4d3c-adba-fdee5b814896 req-f9128da9-839c-4573-b053-5dbe6947f8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89820ad0-4c75-4291-b1ef-b40cd2f1d9f6", "name": "network-vif-plugged", "status": "completed", "tag": "20649f66-01ca-4dbb-9a25-66dd9909aaba"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:54.900465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d1bd42b0-9706-4d3c-adba-fdee5b814896 req-f9128da9-839c-4573-b053-5dbe6947f8b8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:54.900999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d1bd42b0-9706-4d3c-adba-fdee5b814896 req-f9128da9-839c-4573-b053-5dbe6947f8b8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:54.908596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d1bd42b0-9706-4d3c-adba-fdee5b814896 req-f9128da9-839c-4573-b053-5dbe6947f8b8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:54.915304 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d1bd42b0-9706-4d3c-adba-fdee5b814896 req-f9128da9-839c-4573-b053-5dbe6947f8b8 service nova] Creating event network-vif-plugged:20649f66-01ca-4dbb-9a25-66dd9909aaba for instance 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 on n-h2-839401-11 Aug 29 15:30:54.920997 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d1bd42b0-9706-4d3c-adba-fdee5b814896 req-f9128da9-839c-4573-b053-5dbe6947f8b8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043526 Aug 29 15:30:54.922029 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 770/1556] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:54.978461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4604f467-ebb3-49a3-a20c-bc646867c24b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:54.979301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4604f467-ebb3-49a3-a20c-bc646867c24b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:54.990449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4604f467-ebb3-49a3-a20c-bc646867c24b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:54.991327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4604f467-ebb3-49a3-a20c-bc646867c24b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:54.992168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4604f467-ebb3-49a3-a20c-bc646867c24b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:54.994370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4604f467-ebb3-49a3-a20c-bc646867c24b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:54.995190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4604f467-ebb3-49a3-a20c-bc646867c24b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:54.995654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4604f467-ebb3-49a3-a20c-bc646867c24b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:55.288557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4604f467-ebb3-49a3-a20c-bc646867c24b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:55.296750 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4604f467-ebb3-49a3-a20c-bc646867c24b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1526 microversion: 2.1 time: 0.323667 Aug 29 15:30:55.297467 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 787/1557] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:54 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1526 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:55.396177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f2479335-14fa-43ba-9e94-21f2a44b975b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13cb34f6-5aad-42bb-8f40-776dca182a21", "device": "/dev/xvdb"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:55.400572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f2479335-14fa-43ba-9e94-21f2a44b975b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:55.409746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2479335-14fa-43ba-9e94-21f2a44b975b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:55.410528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2479335-14fa-43ba-9e94-21f2a44b975b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:55.410965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2479335-14fa-43ba-9e94-21f2a44b975b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:55.412374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2479335-14fa-43ba-9e94-21f2a44b975b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:55.412904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2479335-14fa-43ba-9e94-21f2a44b975b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:55.414416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f2479335-14fa-43ba-9e94-21f2a44b975b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:55.460647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-66d80f32-d2b9-4e39-85b9-79bbb4c9b7cb tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:55.461599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-66d80f32-d2b9-4e39-85b9-79bbb4c9b7cb tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:55.471509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66d80f32-d2b9-4e39-85b9-79bbb4c9b7cb tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:55.472214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66d80f32-d2b9-4e39-85b9-79bbb4c9b7cb tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:55.472647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66d80f32-d2b9-4e39-85b9-79bbb4c9b7cb tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:55.473373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66d80f32-d2b9-4e39-85b9-79bbb4c9b7cb tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:55.473830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66d80f32-d2b9-4e39-85b9-79bbb4c9b7cb tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:55.474249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66d80f32-d2b9-4e39-85b9-79bbb4c9b7cb tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:55.721667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-66d80f32-d2b9-4e39-85b9-79bbb4c9b7cb tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:55.729770 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-66d80f32-d2b9-4e39-85b9-79bbb4c9b7cb tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1313 microversion: 2.1 time: 0.274218 Aug 29 15:30:55.742318 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 788/1558] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:55 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:55.767354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f551e66d-aacc-4890-a198-685484fc12f3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:55.768868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f551e66d-aacc-4890-a198-685484fc12f3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:55.797412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f551e66d-aacc-4890-a198-685484fc12f3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:55.798174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f551e66d-aacc-4890-a198-685484fc12f3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:55.799337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f551e66d-aacc-4890-a198-685484fc12f3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:55.800246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f551e66d-aacc-4890-a198-685484fc12f3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:55.800875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f551e66d-aacc-4890-a198-685484fc12f3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:55.801760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f551e66d-aacc-4890-a198-685484fc12f3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:55.872129 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f2479335-14fa-43ba-9e94-21f2a44b975b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "POST /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.481008 Aug 29 15:30:55.873410 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 771/1559] 10.222.0.62 () {62 vars in 1364 bytes} [Mon Aug 29 15:30:55 2022] POST /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments => generated 194 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:30:56.093215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f551e66d-aacc-4890-a198-685484fc12f3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:56.102744 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f551e66d-aacc-4890-a198-685484fc12f3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1314 microversion: 2.1 time: 0.344134 Aug 29 15:30:56.103309 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 789/1560] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:55 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:56.319624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a51c6bb-9536-4a06-84a5-46ebfbc94d15 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:56.320333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a51c6bb-9536-4a06-84a5-46ebfbc94d15 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:56.334390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a51c6bb-9536-4a06-84a5-46ebfbc94d15 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:56.334861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a51c6bb-9536-4a06-84a5-46ebfbc94d15 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:56.335523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a51c6bb-9536-4a06-84a5-46ebfbc94d15 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:56.339826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a51c6bb-9536-4a06-84a5-46ebfbc94d15 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:56.340439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a51c6bb-9536-4a06-84a5-46ebfbc94d15 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:56.340853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a51c6bb-9536-4a06-84a5-46ebfbc94d15 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:56.592879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5a51c6bb-9536-4a06-84a5-46ebfbc94d15 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:56.601913 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5a51c6bb-9536-4a06-84a5-46ebfbc94d15 tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1526 microversion: 2.1 time: 0.286743 Aug 29 15:30:56.602503 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 772/1561] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:56 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1526 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:56.752142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5daa18dc-8c20-45af-abc5-4873991e4437 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:56.753615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5daa18dc-8c20-45af-abc5-4873991e4437 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:56.759994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5daa18dc-8c20-45af-abc5-4873991e4437 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:56.760606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5daa18dc-8c20-45af-abc5-4873991e4437 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:56.761300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5daa18dc-8c20-45af-abc5-4873991e4437 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:56.762267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5daa18dc-8c20-45af-abc5-4873991e4437 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:56.762938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5daa18dc-8c20-45af-abc5-4873991e4437 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:56.763713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5daa18dc-8c20-45af-abc5-4873991e4437 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:57.071047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-3da0da78-774e-4f60-9e5a-5d0223b2022f req-cc57f4fb-9fa1-4710-9312-e27a62054bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61f2bf94-d2e3-42ec-8808-86ee2560ae1b", "name": "network-vif-deleted", "tag": "aaa3b81c-6e47-4e3d-b0f5-cdda263f206d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:57.086561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3da0da78-774e-4f60-9e5a-5d0223b2022f req-cc57f4fb-9fa1-4710-9312-e27a62054bc5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:57.092628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3da0da78-774e-4f60-9e5a-5d0223b2022f req-cc57f4fb-9fa1-4710-9312-e27a62054bc5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:57.093457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3da0da78-774e-4f60-9e5a-5d0223b2022f req-cc57f4fb-9fa1-4710-9312-e27a62054bc5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:57.109420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5daa18dc-8c20-45af-abc5-4873991e4437 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:57.124903 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5daa18dc-8c20-45af-abc5-4873991e4437 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1313 microversion: 2.1 time: 0.376689 Aug 29 15:30:57.126338 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 790/1562] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:56 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:57.128119 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-3da0da78-774e-4f60-9e5a-5d0223b2022f req-cc57f4fb-9fa1-4710-9312-e27a62054bc5 service nova] Creating event network-vif-deleted:aaa3b81c-6e47-4e3d-b0f5-cdda263f206d for instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b on n-h1-839401-11 Aug 29 15:30:57.133162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-589e7143-8c16-4898-adbe-99ddfdfbf010 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:57.133789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-589e7143-8c16-4898-adbe-99ddfdfbf010 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:57.138961 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-3da0da78-774e-4f60-9e5a-5d0223b2022f req-cc57f4fb-9fa1-4710-9312-e27a62054bc5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072268 Aug 29 15:30:57.141743 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 773/1563] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:30:57.148673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-589e7143-8c16-4898-adbe-99ddfdfbf010 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:57.149209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-589e7143-8c16-4898-adbe-99ddfdfbf010 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:57.149646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-589e7143-8c16-4898-adbe-99ddfdfbf010 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:57.150347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-589e7143-8c16-4898-adbe-99ddfdfbf010 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:57.156793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-589e7143-8c16-4898-adbe-99ddfdfbf010 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:57.159837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-589e7143-8c16-4898-adbe-99ddfdfbf010 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:57.365995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-eb6bbd60-216a-4eab-bdbf-09b9aef0b34e req-bb0135ee-2892-4965-a0ce-ac8d3c3d7bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16758bc6-5ab1-42fc-8f6f-fe955bf6f83c", "tag": "5de881b9-0307-4808-a213-0975ed993a7b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:30:57.392546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-eb6bbd60-216a-4eab-bdbf-09b9aef0b34e req-bb0135ee-2892-4965-a0ce-ac8d3c3d7bb6 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:57.393528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-eb6bbd60-216a-4eab-bdbf-09b9aef0b34e req-bb0135ee-2892-4965-a0ce-ac8d3c3d7bb6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:57.394230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-eb6bbd60-216a-4eab-bdbf-09b9aef0b34e req-bb0135ee-2892-4965-a0ce-ac8d3c3d7bb6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:57.423410 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-eb6bbd60-216a-4eab-bdbf-09b9aef0b34e req-bb0135ee-2892-4965-a0ce-ac8d3c3d7bb6 service nova] Creating event network-changed:5de881b9-0307-4808-a213-0975ed993a7b for instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c on n-h2-839401-11 Aug 29 15:30:57.436429 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-eb6bbd60-216a-4eab-bdbf-09b9aef0b34e req-bb0135ee-2892-4965-a0ce-ac8d3c3d7bb6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075592 Aug 29 15:30:57.437675 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 774/1564] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:30:57.623653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a63252f7-0064-4394-94f4-657c17ea840b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:57.625113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a63252f7-0064-4394-94f4-657c17ea840b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:57.635869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a63252f7-0064-4394-94f4-657c17ea840b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:57.639276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a63252f7-0064-4394-94f4-657c17ea840b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:57.639994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a63252f7-0064-4394-94f4-657c17ea840b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:57.642763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a63252f7-0064-4394-94f4-657c17ea840b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:57.653554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a63252f7-0064-4394-94f4-657c17ea840b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:57.654416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a63252f7-0064-4394-94f4-657c17ea840b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:57.707302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:57.721061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a63252f7-0064-4394-94f4-657c17ea840b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:57.723884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a63252f7-0064-4394-94f4-657c17ea840b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:57.725462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a63252f7-0064-4394-94f4-657c17ea840b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:57.726626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-a63252f7-0064-4394-94f4-657c17ea840b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lazy-loading 'fault' on Instance uuid 61f2bf94-d2e3-42ec-8808-86ee2560ae1b {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:30:57.899282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-589e7143-8c16-4898-adbe-99ddfdfbf010 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:57.910331 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-589e7143-8c16-4898-adbe-99ddfdfbf010 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1314 microversion: 2.1 time: 0.782839 Aug 29 15:30:57.912153 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 791/1565] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:57 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:57.957219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a63252f7-0064-4394-94f4-657c17ea840b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e11d7d908bf432d80589193031172c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de1e6e8040d4d5f9ff87142c3c436bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:57.970661 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a63252f7-0064-4394-94f4-657c17ea840b tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 200 len: 1314 microversion: 2.1 time: 0.349235 Aug 29 15:30:57.985366 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 775/1566] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:57 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:30:58.153339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5e5a8e34-1849-493e-b7b7-92255c7072c0 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:58.154278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5e5a8e34-1849-493e-b7b7-92255c7072c0 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:58.162705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e5a8e34-1849-493e-b7b7-92255c7072c0 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:58.163398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e5a8e34-1849-493e-b7b7-92255c7072c0 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:58.164063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e5a8e34-1849-493e-b7b7-92255c7072c0 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:58.164962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e5a8e34-1849-493e-b7b7-92255c7072c0 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:58.165664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e5a8e34-1849-493e-b7b7-92255c7072c0 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:58.166307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e5a8e34-1849-493e-b7b7-92255c7072c0 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:58.408520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e5a8e34-1849-493e-b7b7-92255c7072c0 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:58.416776 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5e5a8e34-1849-493e-b7b7-92255c7072c0 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1463 microversion: 2.1 time: 0.267435 Aug 29 15:30:58.417622 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 792/1567] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:58 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1463 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:58.487528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8f867427-2198-4e93-925b-0801e24b06ae tempest-TenantUsagesTestJSON-1544590926 tempest-TenantUsagesTestJSON-1544590926-project-admin] Calling method '.version_select at 0x7fc42b7b21f0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:58.497524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f867427-2198-4e93-925b-0801e24b06ae tempest-TenantUsagesTestJSON-1544590926 tempest-TenantUsagesTestJSON-1544590926-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:58.498076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f867427-2198-4e93-925b-0801e24b06ae tempest-TenantUsagesTestJSON-1544590926 tempest-TenantUsagesTestJSON-1544590926-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:58.498584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f867427-2198-4e93-925b-0801e24b06ae tempest-TenantUsagesTestJSON-1544590926 tempest-TenantUsagesTestJSON-1544590926-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:58.514987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f867427-2198-4e93-925b-0801e24b06ae tempest-TenantUsagesTestJSON-1544590926 tempest-TenantUsagesTestJSON-1544590926-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:58.515746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f867427-2198-4e93-925b-0801e24b06ae tempest-TenantUsagesTestJSON-1544590926 tempest-TenantUsagesTestJSON-1544590926-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:58.516168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f867427-2198-4e93-925b-0801e24b06ae tempest-TenantUsagesTestJSON-1544590926 tempest-TenantUsagesTestJSON-1544590926-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:58.534472 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8f867427-2198-4e93-925b-0801e24b06ae tempest-TenantUsagesTestJSON-1544590926 tempest-TenantUsagesTestJSON-1544590926-project-admin] 10.222.0.62 "GET /compute/v2.1/os-simple-tenant-usage/2e08c38460fb4aef88dae8bbeb622d14?start=2022-08-28T15%3A30%3A58.430417&end=2022-08-30T15%3A30%3A58.430417" status: 200 len: 694 microversion: 2.1 time: 0.100245 Aug 29 15:30:58.535387 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 776/1568] 10.222.0.62 () {58 vars in 1412 bytes} [Mon Aug 29 15:30:58 2022] GET /compute/v2.1/os-simple-tenant-usage/2e08c38460fb4aef88dae8bbeb622d14?start=2022-08-28T15%3A30%3A58.430417&end=2022-08-30T15%3A30%3A58.430417 => generated 694 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:58.549218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-affa6fc5-3365-430e-af5b-3575b027f5e5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '.version_select at 0x7fc42b7e5550>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:58.560204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-affa6fc5-3365-430e-af5b-3575b027f5e5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:58.560693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-affa6fc5-3365-430e-af5b-3575b027f5e5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:58.561159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-affa6fc5-3365-430e-af5b-3575b027f5e5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:58.588007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-affa6fc5-3365-430e-af5b-3575b027f5e5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:58.588504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-affa6fc5-3365-430e-af5b-3575b027f5e5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:58.588942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-affa6fc5-3365-430e-af5b-3575b027f5e5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:58.608355 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-affa6fc5-3365-430e-af5b-3575b027f5e5 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/os-simple-tenant-usage/2e08c38460fb4aef88dae8bbeb622d14?start=2022-08-28T15%3A30%3A58.430417&end=2022-08-30T15%3A30%3A58.430417" status: 200 len: 694 microversion: 2.1 time: 0.063054 Aug 29 15:30:58.618480 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 793/1569] 10.222.0.62 () {58 vars in 1412 bytes} [Mon Aug 29 15:30:58 2022] GET /compute/v2.1/os-simple-tenant-usage/2e08c38460fb4aef88dae8bbeb622d14?start=2022-08-28T15%3A30%3A58.430417&end=2022-08-30T15%3A30%3A58.430417 => generated 694 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:58.633530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0a65a131-fa71-4137-a860-e349d31cea45 tempest-TenantUsagesTestJSON-1544590926 tempest-TenantUsagesTestJSON-1544590926-project-admin] Calling method '.version_select at 0x7fc42b7b2dc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:58.656111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a65a131-fa71-4137-a860-e349d31cea45 tempest-TenantUsagesTestJSON-1544590926 tempest-TenantUsagesTestJSON-1544590926-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:58.656595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a65a131-fa71-4137-a860-e349d31cea45 tempest-TenantUsagesTestJSON-1544590926 tempest-TenantUsagesTestJSON-1544590926-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:58.657027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a65a131-fa71-4137-a860-e349d31cea45 tempest-TenantUsagesTestJSON-1544590926 tempest-TenantUsagesTestJSON-1544590926-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:58.679517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a65a131-fa71-4137-a860-e349d31cea45 tempest-TenantUsagesTestJSON-1544590926 tempest-TenantUsagesTestJSON-1544590926-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:58.680484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a65a131-fa71-4137-a860-e349d31cea45 tempest-TenantUsagesTestJSON-1544590926 tempest-TenantUsagesTestJSON-1544590926-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:58.681351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a65a131-fa71-4137-a860-e349d31cea45 tempest-TenantUsagesTestJSON-1544590926 tempest-TenantUsagesTestJSON-1544590926-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:58.768387 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0a65a131-fa71-4137-a860-e349d31cea45 tempest-TenantUsagesTestJSON-1544590926 tempest-TenantUsagesTestJSON-1544590926-project-admin] 10.222.0.62 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T15%3A30%3A58.430417&end=2022-08-30T15%3A30%3A58.430417&detailed=1" status: 200 len: 19122 microversion: 2.1 time: 0.148526 Aug 29 15:30:58.785393 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 777/1570] 10.222.0.62 () {58 vars in 1335 bytes} [Mon Aug 29 15:30:58 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T15%3A30%3A58.430417&end=2022-08-30T15%3A30%3A58.430417&detailed=1 => generated 19122 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:30:58.800523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec5e0693-a31e-4edd-a844-f960a3dee7e7 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:58.801495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ec5e0693-a31e-4edd-a844-f960a3dee7e7 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:58.816393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec5e0693-a31e-4edd-a844-f960a3dee7e7 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:58.816393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec5e0693-a31e-4edd-a844-f960a3dee7e7 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:58.816790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec5e0693-a31e-4edd-a844-f960a3dee7e7 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:58.817543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec5e0693-a31e-4edd-a844-f960a3dee7e7 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:58.817992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec5e0693-a31e-4edd-a844-f960a3dee7e7 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:58.818420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec5e0693-a31e-4edd-a844-f960a3dee7e7 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:58.868400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ec5e0693-a31e-4edd-a844-f960a3dee7e7 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:30:58.934097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3deb5a01-383a-4007-acbb-da2ce2aa1ca2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:58.935212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3deb5a01-383a-4007-acbb-da2ce2aa1ca2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:58.949364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3deb5a01-383a-4007-acbb-da2ce2aa1ca2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:58.951124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3deb5a01-383a-4007-acbb-da2ce2aa1ca2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:58.951674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3deb5a01-383a-4007-acbb-da2ce2aa1ca2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:58.953044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3deb5a01-383a-4007-acbb-da2ce2aa1ca2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:58.954846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3deb5a01-383a-4007-acbb-da2ce2aa1ca2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:58.956178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3deb5a01-383a-4007-acbb-da2ce2aa1ca2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:58.966921 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ec5e0693-a31e-4edd-a844-f960a3dee7e7 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "DELETE /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 204 len: 0 microversion: 2.1 time: 0.172160 Aug 29 15:30:58.970621 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 794/1571] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:30:58 2022] DELETE /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:30:58.976929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d713628b-d1b6-4905-aea9-a2df4728a079 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:58.978415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d713628b-d1b6-4905-aea9-a2df4728a079 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:58.986607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d713628b-d1b6-4905-aea9-a2df4728a079 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:58.988221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d713628b-d1b6-4905-aea9-a2df4728a079 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:58.988888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d713628b-d1b6-4905-aea9-a2df4728a079 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:58.990367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d713628b-d1b6-4905-aea9-a2df4728a079 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:58.991055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d713628b-d1b6-4905-aea9-a2df4728a079 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:58.991681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d713628b-d1b6-4905-aea9-a2df4728a079 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:59.174793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3deb5a01-383a-4007-acbb-da2ce2aa1ca2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:59.185730 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3deb5a01-383a-4007-acbb-da2ce2aa1ca2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1314 microversion: 2.1 time: 0.258341 Aug 29 15:30:59.186324 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 778/1572] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:58 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:59.190805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-29fd58d9-5052-4f70-8112-a133347a385a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:59.191410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-29fd58d9-5052-4f70-8112-a133347a385a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] [instance: 61f2bf94-d2e3-42ec-8808-86ee2560ae1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:30:59.215174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29fd58d9-5052-4f70-8112-a133347a385a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:59.215984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29fd58d9-5052-4f70-8112-a133347a385a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:59.216618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29fd58d9-5052-4f70-8112-a133347a385a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:59.217703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29fd58d9-5052-4f70-8112-a133347a385a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:30:59.218354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29fd58d9-5052-4f70-8112-a133347a385a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:30:59.219651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29fd58d9-5052-4f70-8112-a133347a385a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:30:59.235668 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-29fd58d9-5052-4f70-8112-a133347a385a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] HTTP exception thrown: Instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b could not be found. Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-29fd58d9-5052-4f70-8112-a133347a385a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Request method failure captured: Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b HTTP/1.1 Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNtyXZ4UWcpT1PGTtzBGpSuJ_orK6w7fBjKyN-qzAj13qjyEaRs46OUa5uGuf783E3a9quG7r2pIM6KB4NEeURwigatViAivi253UqsiaNE7-zh3kTEVIa1fwtopuNYfvEzrw2MH-68rklRH3QKRVRP1zKFkHsFfZS_7tutpo6YT8NU Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 0de1e6e8040d4d5f9ff87142c3c436bb Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1422716330 Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:30:59.237898 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:30:59.239734 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0de1e6e8040d4d5f9ff87142c3c436bb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0de1e6e8040d4d5f9ff87142c3c436bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0de1e6e8040d4d5f9ff87142c3c436bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0de1e6e8040d4d5f9ff87142c3c436bb"}]}] Aug 29 15:30:59.239734 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1422716330 Aug 29 15:30:59.239734 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 0de1e6e8040d4d5f9ff87142c3c436bb Aug 29 15:30:59.239734 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1422716330 Aug 29 15:30:59.239734 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-FloatingIPsAssociationTestJSON-1422716330-project Aug 29 15:30:59.239734 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:30:59.239734 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:30:59.239734 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 9e11d7d908bf432d80589193031172c2 Aug 29 15:30:59.239734 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1422716330-project Aug 29 15:30:59.239734 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:30:59.239734 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b could not be found. Aug 29 15:30:59.239734 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '61f2bf94-d2e3-42ec-8808-86ee2560ae1b'} Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b could not be found. Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:30:59.240715 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b could not be found. Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b could not be found. Aug 29 15:30:59.244075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:30:59.247849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-29fd58d9-5052-4f70-8112-a133347a385a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] Returning 404 to user: Instance 61f2bf94-d2e3-42ec-8808-86ee2560ae1b could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:30:59.249218 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-29fd58d9-5052-4f70-8112-a133347a385a tempest-FloatingIPsAssociationTestJSON-1422716330 tempest-FloatingIPsAssociationTestJSON-1422716330-project] 10.222.0.62 "GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b" status: 404 len: 111 microversion: 2.1 time: 0.061961 Aug 29 15:30:59.249999 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 779/1573] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:59 2022] GET /compute/v2.1/servers/61f2bf94-d2e3-42ec-8808-86ee2560ae1b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:30:59.251667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d713628b-d1b6-4905-aea9-a2df4728a079 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:30:59.262646 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d713628b-d1b6-4905-aea9-a2df4728a079 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1469 microversion: 2.1 time: 0.290109 Aug 29 15:30:59.263330 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 795/1574] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:30:58 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1469 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:00.206212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8ae84e46-ba48-46a7-875e-bc5daecfd7b0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:00.207416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8ae84e46-ba48-46a7-875e-bc5daecfd7b0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:00.214257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ae84e46-ba48-46a7-875e-bc5daecfd7b0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:00.214949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ae84e46-ba48-46a7-875e-bc5daecfd7b0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:00.215371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ae84e46-ba48-46a7-875e-bc5daecfd7b0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:00.216245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ae84e46-ba48-46a7-875e-bc5daecfd7b0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:00.216855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ae84e46-ba48-46a7-875e-bc5daecfd7b0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:00.217942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ae84e46-ba48-46a7-875e-bc5daecfd7b0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:00.222793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:00.285117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2ad44352-b737-435e-a2ef-f588edad4476 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:00.286355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2ad44352-b737-435e-a2ef-f588edad4476 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:00.303559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ad44352-b737-435e-a2ef-f588edad4476 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:00.304076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ad44352-b737-435e-a2ef-f588edad4476 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:00.304526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ad44352-b737-435e-a2ef-f588edad4476 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:00.305286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ad44352-b737-435e-a2ef-f588edad4476 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:00.308129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ad44352-b737-435e-a2ef-f588edad4476 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:00.308611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ad44352-b737-435e-a2ef-f588edad4476 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:00.515034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8ae84e46-ba48-46a7-875e-bc5daecfd7b0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:00.538901 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8ae84e46-ba48-46a7-875e-bc5daecfd7b0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1314 microversion: 2.1 time: 0.336404 Aug 29 15:31:00.542471 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 780/1575] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:00 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:00.663840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2ad44352-b737-435e-a2ef-f588edad4476 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:00.673718 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2ad44352-b737-435e-a2ef-f588edad4476 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1469 microversion: 2.1 time: 0.393286 Aug 29 15:31:00.674776 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 796/1576] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:00 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1469 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:01.564241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fb7d1408-6463-4c35-8f0e-b4268b158ca7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:01.564969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fb7d1408-6463-4c35-8f0e-b4268b158ca7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:01.583562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb7d1408-6463-4c35-8f0e-b4268b158ca7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:01.584262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb7d1408-6463-4c35-8f0e-b4268b158ca7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:01.584892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb7d1408-6463-4c35-8f0e-b4268b158ca7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:01.585951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb7d1408-6463-4c35-8f0e-b4268b158ca7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:01.586412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb7d1408-6463-4c35-8f0e-b4268b158ca7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:01.586840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb7d1408-6463-4c35-8f0e-b4268b158ca7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:01.695788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e998fdaa-77ca-4e24-9405-e224e0d48369 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:01.697117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e998fdaa-77ca-4e24-9405-e224e0d48369 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:01.708443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e998fdaa-77ca-4e24-9405-e224e0d48369 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:01.711487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e998fdaa-77ca-4e24-9405-e224e0d48369 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:01.711921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e998fdaa-77ca-4e24-9405-e224e0d48369 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:01.714216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e998fdaa-77ca-4e24-9405-e224e0d48369 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:01.715472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e998fdaa-77ca-4e24-9405-e224e0d48369 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:01.715948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e998fdaa-77ca-4e24-9405-e224e0d48369 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:01.936771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fb7d1408-6463-4c35-8f0e-b4268b158ca7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:01.945013 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fb7d1408-6463-4c35-8f0e-b4268b158ca7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1314 microversion: 2.1 time: 0.385813 Aug 29 15:31:01.957157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e998fdaa-77ca-4e24-9405-e224e0d48369 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:01.957355 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 781/1577] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:01 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:01.966970 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e998fdaa-77ca-4e24-9405-e224e0d48369 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1469 microversion: 2.1 time: 0.275602 Aug 29 15:31:01.995781 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 797/1578] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:01 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1469 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:02.974451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-923cce09-2618-4eb3-b780-5b6d0b63bd67 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:02.975987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-923cce09-2618-4eb3-b780-5b6d0b63bd67 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:02.989412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-923cce09-2618-4eb3-b780-5b6d0b63bd67 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:02.989942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-923cce09-2618-4eb3-b780-5b6d0b63bd67 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:02.990397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-923cce09-2618-4eb3-b780-5b6d0b63bd67 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:02.991296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-923cce09-2618-4eb3-b780-5b6d0b63bd67 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:02.991763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-923cce09-2618-4eb3-b780-5b6d0b63bd67 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:02.992211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-923cce09-2618-4eb3-b780-5b6d0b63bd67 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:03.142747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b80c4025-b00c-4b24-bd21-4ef92cada3f2 tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] Action: 'create', calling method: .version_select at 0x7fc42b745550>, body: {"keypair": {"name": "tempest-keypair-1750819176", "type": "ssh", "user_id": "3410f34501aa49a8b2e264cca0042f79", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBET4n50Mqglpee3D0Y9jAPULQSmkPtrNs9MueHxTNVUbT6vS8YTrsWJsb9vFtYGgBd37azaoW25Vmc4h85o6buSQrw4rk9WNSNhdFhGbd1N7LdOHahitAxfEwjZohbqsVQ=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:03.185232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-b80c4025-b00c-4b24-bd21-4ef92cada3f2 tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] Getting quotas for project b942b92e00e54fa2b152d78160a916c6. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:03.193295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-b80c4025-b00c-4b24-bd21-4ef92cada3f2 tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] Getting quotas for user ac7146b2a6074022a4edfd1eb8b82e0d and project b942b92e00e54fa2b152d78160a916c6. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:03.226604 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b80c4025-b00c-4b24-bd21-4ef92cada3f2 tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.385071 Aug 29 15:31:03.228139 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 782/1579] 10.222.0.62 () {62 vars in 1200 bytes} [Mon Aug 29 15:31:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 387 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:31:03.234634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-134cb2b3-53a4-4814-982f-f4b06ffe689f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:03.235250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-134cb2b3-53a4-4814-982f-f4b06ffe689f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:03.241346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-923cce09-2618-4eb3-b780-5b6d0b63bd67 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:03.242590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-134cb2b3-53a4-4814-982f-f4b06ffe689f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:03.243244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-134cb2b3-53a4-4814-982f-f4b06ffe689f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:03.243695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-134cb2b3-53a4-4814-982f-f4b06ffe689f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:03.244697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-134cb2b3-53a4-4814-982f-f4b06ffe689f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:03.245196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-134cb2b3-53a4-4814-982f-f4b06ffe689f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:03.245821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-134cb2b3-53a4-4814-982f-f4b06ffe689f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:03.254580 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-923cce09-2618-4eb3-b780-5b6d0b63bd67 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1314 microversion: 2.1 time: 0.283998 Aug 29 15:31:03.255239 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 798/1580] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:02 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:03.271943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fb20046c-8861-4e80-ab75-9a633dce729b tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] Action: 'create', calling method: .version_select at 0x7fc42bbc48b0>, body: {"keypair": {"name": "tempest-keypair-1924538757", "type": "ssh", "user_id": "3410f34501aa49a8b2e264cca0042f79", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1RO9KUJSMp0g7jhwu37wI5MbordBGngB2GdNyy68Tz6Y4qPSGmpNv9emUHTaYTofzZ/ogQ6UVtbAAqCvQAfreaqcKpVKj/XTLo0VP9G2rnvSeuTdLbOcCGnxf5UglqWw=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:03.297904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-fb20046c-8861-4e80-ab75-9a633dce729b tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] Getting quotas for project b942b92e00e54fa2b152d78160a916c6. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:03.304554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-fb20046c-8861-4e80-ab75-9a633dce729b tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] Getting quotas for user ac7146b2a6074022a4edfd1eb8b82e0d and project b942b92e00e54fa2b152d78160a916c6. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:03.331117 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fb20046c-8861-4e80-ab75-9a633dce729b tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.074767 Aug 29 15:31:03.331893 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 799/1581] 10.222.0.62 () {62 vars in 1200 bytes} [Mon Aug 29 15:31:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:31:03.344943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fbfca73c-784d-4071-8a34-4934cdf05afc tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] Calling method '.version_select at 0x7fc42bcdbd30>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:03.354562 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fbfca73c-784d-4071-8a34-4934cdf05afc tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] 10.222.0.62 "GET /compute/v2.1/os-keypairs/tempest-keypair-1750819176?user_id=3410f34501aa49a8b2e264cca0042f79" status: 200 len: 512 microversion: 2.10 time: 0.013455 Aug 29 15:31:03.355451 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 800/1582] 10.222.0.62 () {60 vars in 1340 bytes} [Mon Aug 29 15:31:03 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1750819176?user_id=3410f34501aa49a8b2e264cca0042f79 => generated 512 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:31:03.370426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e6a282fd-8349-497c-9a29-f3ba5799dbde tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] Action: 'create', calling method: .version_select at 0x7fc42bcdbdc0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1515697570", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHT03yxC1/cDd3IvMb/G4elNXnqxY2HOQlCOHJhfqJq9OC+w8zNB8jnYCPxxw4E8RAYgFZshDSqJ/dC1y8Bnftkq6/y4Gwd1pJc7x9rDBfAbgsbm1v9KQqQDoaqQlLa1g=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:03.387155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-e6a282fd-8349-497c-9a29-f3ba5799dbde tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] Getting quotas for project b942b92e00e54fa2b152d78160a916c6. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:03.392246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-e6a282fd-8349-497c-9a29-f3ba5799dbde tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] Getting quotas for user ac7146b2a6074022a4edfd1eb8b82e0d and project b942b92e00e54fa2b152d78160a916c6. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:03.420496 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e6a282fd-8349-497c-9a29-f3ba5799dbde tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.054348 Aug 29 15:31:03.421028 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 801/1583] 10.222.0.62 () {62 vars in 1200 bytes} [Mon Aug 29 15:31:03 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:31:03.431407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cebcd27a-1727-40fa-94da-6cfe861a3ffc tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] Calling method '.version_select at 0x7fc42bc240d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:03.435564 n-d-839401-11 devstack@n-api.service[122360]: WARNING oslo_db.sqlalchemy.utils [None req-cebcd27a-1727-40fa-94da-6cfe861a3ffc tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:31:03.444929 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cebcd27a-1727-40fa-94da-6cfe861a3ffc tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] 10.222.0.62 "GET /compute/v2.1/os-keypairs?user_id=3410f34501aa49a8b2e264cca0042f79" status: 200 len: 726 microversion: 2.10 time: 0.017269 Aug 29 15:31:03.445554 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 802/1584] 10.222.0.62 () {60 vars in 1259 bytes} [Mon Aug 29 15:31:03 2022] GET /compute/v2.1/os-keypairs?user_id=3410f34501aa49a8b2e264cca0042f79 => generated 726 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:31:03.456160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-59adb011-b452-4656-8e6c-88c65d86e9e2 tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] Calling method '.version_select at 0x7fc42bcb2430>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:03.464214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:03.481186 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-59adb011-b452-4656-8e6c-88c65d86e9e2 tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1515697570" status: 204 len: 0 microversion: 2.10 time: 0.028335 Aug 29 15:31:03.482132 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 803/1585] 10.222.0.62 () {60 vars in 1325 bytes} [Mon Aug 29 15:31:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1515697570 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 15:31:03.492294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4556970e-2304-4b18-99f5-7f3d1d62c744 tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] Calling method '.version_select at 0x7fc42bbc4ee0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:03.515726 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4556970e-2304-4b18-99f5-7f3d1d62c744 tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1924538757?user_id=3410f34501aa49a8b2e264cca0042f79" status: 204 len: 0 microversion: 2.10 time: 0.028236 Aug 29 15:31:03.520548 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 804/1586] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:31:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1924538757?user_id=3410f34501aa49a8b2e264cca0042f79 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 15:31:03.526150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8e8521b5-e37a-43f0-bd7a-fdecd2718429 tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] Calling method '.version_select at 0x7fc4305a05e0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:03.572641 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8e8521b5-e37a-43f0-bd7a-fdecd2718429 tempest-KeyPairsV210TestJSON-237943656 tempest-KeyPairsV210TestJSON-237943656-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1750819176?user_id=3410f34501aa49a8b2e264cca0042f79" status: 204 len: 0 microversion: 2.10 time: 0.050346 Aug 29 15:31:03.576580 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 805/1587] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:31:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1750819176?user_id=3410f34501aa49a8b2e264cca0042f79 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:31:03.651601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-134cb2b3-53a4-4814-982f-f4b06ffe689f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:03.666271 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-134cb2b3-53a4-4814-982f-f4b06ffe689f tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1469 microversion: 2.1 time: 0.436447 Aug 29 15:31:03.674441 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 783/1588] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:03 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1469 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:03.778859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-eeedc197-23b7-4af9-9292-c96cfa22fcf6 req-360e70c9-1bf9-4976-b988-a07740952b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89820ad0-4c75-4291-b1ef-b40cd2f1d9f6", "name": "network-vif-deleted", "tag": "20649f66-01ca-4dbb-9a25-66dd9909aaba"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:03.801610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-eeedc197-23b7-4af9-9292-c96cfa22fcf6 req-360e70c9-1bf9-4976-b988-a07740952b00 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:03.802985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-eeedc197-23b7-4af9-9292-c96cfa22fcf6 req-360e70c9-1bf9-4976-b988-a07740952b00 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:03.803736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-eeedc197-23b7-4af9-9292-c96cfa22fcf6 req-360e70c9-1bf9-4976-b988-a07740952b00 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:03.823782 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-eeedc197-23b7-4af9-9292-c96cfa22fcf6 req-360e70c9-1bf9-4976-b988-a07740952b00 service nova] Creating event network-vif-deleted:20649f66-01ca-4dbb-9a25-66dd9909aaba for instance 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 on n-h2-839401-11 Aug 29 15:31:03.829505 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-eeedc197-23b7-4af9-9292-c96cfa22fcf6 req-360e70c9-1bf9-4976-b988-a07740952b00 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055201 Aug 29 15:31:03.833807 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 806/1589] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:04.281824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0397a296-a8b9-4481-b9db-b1787acd829c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:04.282788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0397a296-a8b9-4481-b9db-b1787acd829c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:04.301612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0397a296-a8b9-4481-b9db-b1787acd829c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:04.302535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0397a296-a8b9-4481-b9db-b1787acd829c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:04.302987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0397a296-a8b9-4481-b9db-b1787acd829c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:04.303711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0397a296-a8b9-4481-b9db-b1787acd829c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:04.304168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0397a296-a8b9-4481-b9db-b1787acd829c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:04.310045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0397a296-a8b9-4481-b9db-b1787acd829c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:04.559600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0397a296-a8b9-4481-b9db-b1787acd829c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:04.572465 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0397a296-a8b9-4481-b9db-b1787acd829c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1314 microversion: 2.1 time: 0.297481 Aug 29 15:31:04.578452 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 784/1590] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:04 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:04.688658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-760afa21-bf9d-42b2-aa3f-53ab6405e6a4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:04.689625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-760afa21-bf9d-42b2-aa3f-53ab6405e6a4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:04.707998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-760afa21-bf9d-42b2-aa3f-53ab6405e6a4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:04.713047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-760afa21-bf9d-42b2-aa3f-53ab6405e6a4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:04.716170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-760afa21-bf9d-42b2-aa3f-53ab6405e6a4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:04.718055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-760afa21-bf9d-42b2-aa3f-53ab6405e6a4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:04.720900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-760afa21-bf9d-42b2-aa3f-53ab6405e6a4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:04.726776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-760afa21-bf9d-42b2-aa3f-53ab6405e6a4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:04.846272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-bb98813e-84b2-4991-8f87-4a98fd69f75c req-154ee61b-3459-483b-8692-0fc1788ac9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16758bc6-5ab1-42fc-8f6f-fe955bf6f83c", "name": "network-vif-plugged", "status": "completed", "tag": "5de881b9-0307-4808-a213-0975ed993a7b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:04.848067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-760afa21-bf9d-42b2-aa3f-53ab6405e6a4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:04.849496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-760afa21-bf9d-42b2-aa3f-53ab6405e6a4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:04.851227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-760afa21-bf9d-42b2-aa3f-53ab6405e6a4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:04.852188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-760afa21-bf9d-42b2-aa3f-53ab6405e6a4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lazy-loading 'fault' on Instance uuid 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:04.861107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:04.899882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-bb98813e-84b2-4991-8f87-4a98fd69f75c req-154ee61b-3459-483b-8692-0fc1788ac9e7 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:04.900562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-bb98813e-84b2-4991-8f87-4a98fd69f75c req-154ee61b-3459-483b-8692-0fc1788ac9e7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:04.901785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-bb98813e-84b2-4991-8f87-4a98fd69f75c req-154ee61b-3459-483b-8692-0fc1788ac9e7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:04.938608 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-bb98813e-84b2-4991-8f87-4a98fd69f75c req-154ee61b-3459-483b-8692-0fc1788ac9e7 service nova] Creating event network-vif-plugged:5de881b9-0307-4808-a213-0975ed993a7b for instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c on n-h2-839401-11 Aug 29 15:31:04.951861 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-bb98813e-84b2-4991-8f87-4a98fd69f75c req-154ee61b-3459-483b-8692-0fc1788ac9e7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110781 Aug 29 15:31:04.955250 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 785/1591] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:05.009604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-760afa21-bf9d-42b2-aa3f-53ab6405e6a4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6360eed8b2471b9cc3b2166960a07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e08c38460fb4aef88dae8bbeb622d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:05.029122 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-760afa21-bf9d-42b2-aa3f-53ab6405e6a4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 200 len: 1303 microversion: 2.1 time: 0.345142 Aug 29 15:31:05.042434 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 807/1592] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:04 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 1303 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:05.601058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-98d5de4f-487e-40b5-a79b-2599360c303a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:05.603614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-98d5de4f-487e-40b5-a79b-2599360c303a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:05.642248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98d5de4f-487e-40b5-a79b-2599360c303a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:05.643912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98d5de4f-487e-40b5-a79b-2599360c303a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:05.647617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98d5de4f-487e-40b5-a79b-2599360c303a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:05.666718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98d5de4f-487e-40b5-a79b-2599360c303a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:05.667249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98d5de4f-487e-40b5-a79b-2599360c303a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:05.669438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98d5de4f-487e-40b5-a79b-2599360c303a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:05.948158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-98d5de4f-487e-40b5-a79b-2599360c303a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:05.957002 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-98d5de4f-487e-40b5-a79b-2599360c303a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1314 microversion: 2.1 time: 0.361253 Aug 29 15:31:05.966846 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 786/1593] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:05 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:06.056411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-db210cdc-4803-47d6-9a2b-eb2a147499c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:06.057071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-db210cdc-4803-47d6-9a2b-eb2a147499c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] [instance: 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:06.064439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db210cdc-4803-47d6-9a2b-eb2a147499c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:06.064935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db210cdc-4803-47d6-9a2b-eb2a147499c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:06.065934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db210cdc-4803-47d6-9a2b-eb2a147499c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:06.066860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db210cdc-4803-47d6-9a2b-eb2a147499c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:06.067495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db210cdc-4803-47d6-9a2b-eb2a147499c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:06.068247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db210cdc-4803-47d6-9a2b-eb2a147499c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:06.083911 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-db210cdc-4803-47d6-9a2b-eb2a147499c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] HTTP exception thrown: Instance 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 could not be found. Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-db210cdc-4803-47d6-9a2b-eb2a147499c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Request method failure captured: Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 HTTP/1.1 Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNuc2AVdJQ994IJZuIWzAL-0KeBibAJeqX-SWxDkdrx8eAeTbNcGlIQKOQtfwQOC6HkrGScKVkitcTfJub9F_YF3L0s6em4_H6iDLPhvMKqfbrWR6J8Er6y_VCy7nF0jkDd_4djHClQnIpi2oKbAy9WLNTq_6AaqCiXGjjhA5EA4Wy8 Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 2e08c38460fb4aef88dae8bbeb622d14 Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TenantUsagesTestJSON-1161906315 Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:31:06.085821 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:31:06.087622 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2e08c38460fb4aef88dae8bbeb622d14", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2e08c38460fb4aef88dae8bbeb622d14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2e08c38460fb4aef88dae8bbeb622d14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2e08c38460fb4aef88dae8bbeb622d14"}]}] Aug 29 15:31:06.087622 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TenantUsagesTestJSON-1161906315 Aug 29 15:31:06.087622 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 2e08c38460fb4aef88dae8bbeb622d14 Aug 29 15:31:06.087622 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1161906315 Aug 29 15:31:06.087622 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TenantUsagesTestJSON-1161906315-project Aug 29 15:31:06.087622 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:31:06.087622 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:31:06.087622 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: bc6360eed8b2471b9cc3b2166960a07a Aug 29 15:31:06.087622 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TenantUsagesTestJSON-1161906315-project Aug 29 15:31:06.087622 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:31:06.087622 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 could not be found. Aug 29 15:31:06.087622 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '89820ad0-4c75-4291-b1ef-b40cd2f1d9f6'} Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 could not be found. Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:06.088693 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 could not be found. Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 could not be found. Aug 29 15:31:06.090390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:06.092634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-db210cdc-4803-47d6-9a2b-eb2a147499c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] Returning 404 to user: Instance 89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:06.093762 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-db210cdc-4803-47d6-9a2b-eb2a147499c4 tempest-TenantUsagesTestJSON-1161906315 tempest-TenantUsagesTestJSON-1161906315-project] 10.222.0.62 "GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6" status: 404 len: 111 microversion: 2.1 time: 0.042056 Aug 29 15:31:06.097979 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 808/1594] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:06 2022] GET /compute/v2.1/servers/89820ad0-4c75-4291-b1ef-b40cd2f1d9f6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:31:06.290183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e3ec8aac-9f77-4a5c-80bf-3febb1edbce5 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9de1846a-7b4e-4efe-b43f-1e0b71796d8d"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:06.292673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e3ec8aac-9f77-4a5c-80bf-3febb1edbce5 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:06.309870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3ec8aac-9f77-4a5c-80bf-3febb1edbce5 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:06.310376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3ec8aac-9f77-4a5c-80bf-3febb1edbce5 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:06.310813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3ec8aac-9f77-4a5c-80bf-3febb1edbce5 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:06.318140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3ec8aac-9f77-4a5c-80bf-3febb1edbce5 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:06.320500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3ec8aac-9f77-4a5c-80bf-3febb1edbce5 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:06.321029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3ec8aac-9f77-4a5c-80bf-3febb1edbce5 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:06.784986 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e3ec8aac-9f77-4a5c-80bf-3febb1edbce5 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "POST /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.506788 Aug 29 15:31:06.786037 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 787/1595] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 15:31:06 2022] POST /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016/os-volume_attachments => generated 194 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:06.988834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ccd713eb-6f6c-403d-a078-e008959a1b02 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:06.989440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ccd713eb-6f6c-403d-a078-e008959a1b02 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:06.998796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccd713eb-6f6c-403d-a078-e008959a1b02 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:07.000783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccd713eb-6f6c-403d-a078-e008959a1b02 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:07.001562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccd713eb-6f6c-403d-a078-e008959a1b02 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:07.004868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccd713eb-6f6c-403d-a078-e008959a1b02 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:07.005837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccd713eb-6f6c-403d-a078-e008959a1b02 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:07.008475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccd713eb-6f6c-403d-a078-e008959a1b02 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:07.239065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ccd713eb-6f6c-403d-a078-e008959a1b02 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:07.248142 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ccd713eb-6f6c-403d-a078-e008959a1b02 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1501 microversion: 2.1 time: 0.265414 Aug 29 15:31:07.261973 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 809/1596] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:06 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1501 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:08.226794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ce5b7e86-a439-4108-bf17-c46a2cd1ab77 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Calling method '.version_select at 0x7fc42b6daaf0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:08.253814 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-ce5b7e86-a439-4108-bf17-c46a2cd1ab77 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] HTTP exception thrown: Image not found. Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ce5b7e86-a439-4108-bf17-c46a2cd1ab77 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Request method failure captured: Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/images/9feef3c8-6120-4b82-8856-a928a20eddf1/metadata/os_distro HTTP/1.1 Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNu71rrW56Ww5BqkrZcT4sb5ZQJUuBst-QqEcKUFnELtgQvLm1bOTwOMxA0mMU0vTnf88P80GLjPXVm6JuFf5QwITmscFo5tfsgazX-khMveg2WEd8SOtJMWpdguIwt168TjHyoV5eA6QVdWEvsDVxQOOrDWP9lly3XVYQNV-bn2Q4I Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 8ef07a8348bb41c596b0f5862149c297 Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:31:08.269779 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:31:08.271590 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8ef07a8348bb41c596b0f5862149c297", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8ef07a8348bb41c596b0f5862149c297"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8ef07a8348bb41c596b0f5862149c297"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8ef07a8348bb41c596b0f5862149c297"}]}] Aug 29 15:31:08.271590 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.271590 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 8ef07a8348bb41c596b0f5862149c297 Aug 29 15:31:08.271590 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.271590 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesMetadataNegativeTestJSON-199055655-project Aug 29 15:31:08.271590 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:31:08.271590 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:31:08.271590 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 29512a3a7a7a4d76a99dc7f17621a498 Aug 29 15:31:08.271590 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-199055655-project Aug 29 15:31:08.271590 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:31:08.271590 n-d-839401-11 devstack@n-api.service[122361]: exception: Image not found. Aug 29 15:31:08.271590 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'image_id': '9feef3c8-6120-4b82-8856-a928a20eddf1', 'id': 'os_distro'} Aug 29 15:31:08.271590 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:31:08.272983 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9feef3c8-6120-4b82-8856-a928a20eddf1 Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:31:08.274713 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9feef3c8-6120-4b82-8856-a928a20eddf1 could not be found. Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:31:08.278521 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.280898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ce5b7e86-a439-4108-bf17-c46a2cd1ab77 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Returning 404 to user: Image not found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:08.287302 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ce5b7e86-a439-4108-bf17-c46a2cd1ab77 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] 10.222.0.62 "DELETE /compute/v2.1/images/9feef3c8-6120-4b82-8856-a928a20eddf1/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.474057 Aug 29 15:31:08.287302 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 788/1597] 10.222.0.62 () {58 vars in 1293 bytes} [Mon Aug 29 15:31:07 2022] DELETE /compute/v2.1/images/9feef3c8-6120-4b82-8856-a928a20eddf1/metadata/os_distro => generated 62 bytes in 485 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:31:08.288208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a20aca5e-783a-4b5a-8a4c-4c7a4281c507 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Calling method '.version_select at 0x7fc4300e2c10>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:08.336941 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-a20aca5e-783a-4b5a-8a4c-4c7a4281c507 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] HTTP exception thrown: Image not found. Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a20aca5e-783a-4b5a-8a4c-4c7a4281c507 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Request method failure captured: Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/images/53ce8c5b-dfca-4015-a684-2429f922f3ac/metadata/os_version HTTP/1.1 Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNu71rrW56Ww5BqkrZcT4sb5ZQJUuBst-QqEcKUFnELtgQvLm1bOTwOMxA0mMU0vTnf88P80GLjPXVm6JuFf5QwITmscFo5tfsgazX-khMveg2WEd8SOtJMWpdguIwt168TjHyoV5eA6QVdWEvsDVxQOOrDWP9lly3XVYQNV-bn2Q4I Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 8ef07a8348bb41c596b0f5862149c297 Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:31:08.340212 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:31:08.341685 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8ef07a8348bb41c596b0f5862149c297", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8ef07a8348bb41c596b0f5862149c297"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8ef07a8348bb41c596b0f5862149c297"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8ef07a8348bb41c596b0f5862149c297"}]}] Aug 29 15:31:08.341685 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.341685 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 8ef07a8348bb41c596b0f5862149c297 Aug 29 15:31:08.341685 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.341685 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesMetadataNegativeTestJSON-199055655-project Aug 29 15:31:08.341685 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:31:08.341685 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:31:08.341685 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 29512a3a7a7a4d76a99dc7f17621a498 Aug 29 15:31:08.341685 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-199055655-project Aug 29 15:31:08.341685 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:31:08.341685 n-d-839401-11 devstack@n-api.service[122360]: exception: Image not found. Aug 29 15:31:08.341685 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'image_id': '53ce8c5b-dfca-4015-a684-2429f922f3ac', 'id': 'os_version'} Aug 29 15:31:08.341685 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:31:08.343296 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 53ce8c5b-dfca-4015-a684-2429f922f3ac Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:31:08.344537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 53ce8c5b-dfca-4015-a684-2429f922f3ac could not be found. Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:31:08.346629 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.348707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a20aca5e-783a-4b5a-8a4c-4c7a4281c507 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Returning 404 to user: Image not found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:08.350721 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a20aca5e-783a-4b5a-8a4c-4c7a4281c507 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] 10.222.0.62 "GET /compute/v2.1/images/53ce8c5b-dfca-4015-a684-2429f922f3ac/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.063370 Aug 29 15:31:08.350721 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 810/1598] 10.222.0.62 () {58 vars in 1293 bytes} [Mon Aug 29 15:31:08 2022] GET /compute/v2.1/images/53ce8c5b-dfca-4015-a684-2429f922f3ac/metadata/os_version => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:31:08.355693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6ccda0c7-c5f5-4913-b63d-3b79cb0ffd13 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Calling method '.version_select at 0x7fc42bafdaf0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:08.387550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f51b6c13-340f-417e-aaeb-47fbb6302773 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:08.388195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f51b6c13-340f-417e-aaeb-47fbb6302773 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:08.396684 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-6ccda0c7-c5f5-4913-b63d-3b79cb0ffd13 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] HTTP exception thrown: Image not found. Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6ccda0c7-c5f5-4913-b63d-3b79cb0ffd13 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Request method failure captured: Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/images/b75c7016-a22c-4785-8fea-2ed22cae05a4/metadata HTTP/1.1 Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNu71rrW56Ww5BqkrZcT4sb5ZQJUuBst-QqEcKUFnELtgQvLm1bOTwOMxA0mMU0vTnf88P80GLjPXVm6JuFf5QwITmscFo5tfsgazX-khMveg2WEd8SOtJMWpdguIwt168TjHyoV5eA6QVdWEvsDVxQOOrDWP9lly3XVYQNV-bn2Q4I Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 8ef07a8348bb41c596b0f5862149c297 Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:31:08.407988 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:31:08.409566 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8ef07a8348bb41c596b0f5862149c297", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8ef07a8348bb41c596b0f5862149c297"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8ef07a8348bb41c596b0f5862149c297"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8ef07a8348bb41c596b0f5862149c297"}]}] Aug 29 15:31:08.409566 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.409566 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 8ef07a8348bb41c596b0f5862149c297 Aug 29 15:31:08.409566 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.409566 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesMetadataNegativeTestJSON-199055655-project Aug 29 15:31:08.409566 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:31:08.409566 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:31:08.409566 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 29512a3a7a7a4d76a99dc7f17621a498 Aug 29 15:31:08.409566 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-199055655-project Aug 29 15:31:08.409566 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:31:08.409566 n-d-839401-11 devstack@n-api.service[122361]: exception: Image not found. Aug 29 15:31:08.409566 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'image_id': 'b75c7016-a22c-4785-8fea-2ed22cae05a4'} Aug 29 15:31:08.409566 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:31:08.410467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b75c7016-a22c-4785-8fea-2ed22cae05a4 Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:31:08.412180 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b75c7016-a22c-4785-8fea-2ed22cae05a4 could not be found. Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:31:08.414699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.417814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6ccda0c7-c5f5-4913-b63d-3b79cb0ffd13 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Returning 404 to user: Image not found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:08.421553 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6ccda0c7-c5f5-4913-b63d-3b79cb0ffd13 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] 10.222.0.62 "GET /compute/v2.1/images/b75c7016-a22c-4785-8fea-2ed22cae05a4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.059541 Aug 29 15:31:08.421553 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 789/1599] 10.222.0.62 () {58 vars in 1260 bytes} [Mon Aug 29 15:31:08 2022] GET /compute/v2.1/images/b75c7016-a22c-4785-8fea-2ed22cae05a4/metadata => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:31:08.421889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f51b6c13-340f-417e-aaeb-47fbb6302773 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:08.421889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f51b6c13-340f-417e-aaeb-47fbb6302773 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:08.421889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f51b6c13-340f-417e-aaeb-47fbb6302773 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:08.421889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f51b6c13-340f-417e-aaeb-47fbb6302773 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:08.422568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f51b6c13-340f-417e-aaeb-47fbb6302773 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:08.422568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f51b6c13-340f-417e-aaeb-47fbb6302773 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:08.426751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f823f39a-9807-4b5c-a6d7-f41389276d68 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Action: 'update_all', calling method: .version_select at 0x7fc42b6c8af0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:08.457185 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-f823f39a-9807-4b5c-a6d7-f41389276d68 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] HTTP exception thrown: Image not found. Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f823f39a-9807-4b5c-a6d7-f41389276d68 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Request method failure captured: Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: request: PUT /compute/v2.1/images/62371914-6bd2-4c32-97a6-66831de12e9f/metadata HTTP/1.1 Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 57 Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNu71rrW56Ww5BqkrZcT4sb5ZQJUuBst-QqEcKUFnELtgQvLm1bOTwOMxA0mMU0vTnf88P80GLjPXVm6JuFf5QwITmscFo5tfsgazX-khMveg2WEd8SOtJMWpdguIwt168TjHyoV5eA6QVdWEvsDVxQOOrDWP9lly3XVYQNV-bn2Q4I Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 8ef07a8348bb41c596b0f5862149c297 Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:31:08.460244 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:31:08.461870 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8ef07a8348bb41c596b0f5862149c297", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8ef07a8348bb41c596b0f5862149c297"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8ef07a8348bb41c596b0f5862149c297"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8ef07a8348bb41c596b0f5862149c297"}]}] Aug 29 15:31:08.461870 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.461870 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 8ef07a8348bb41c596b0f5862149c297 Aug 29 15:31:08.461870 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.461870 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesMetadataNegativeTestJSON-199055655-project Aug 29 15:31:08.461870 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:31:08.461870 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:31:08.461870 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 29512a3a7a7a4d76a99dc7f17621a498 Aug 29 15:31:08.461870 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-199055655-project Aug 29 15:31:08.461870 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:31:08.461870 n-d-839401-11 devstack@n-api.service[122361]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 29 15:31:08.461870 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:31:08.461870 n-d-839401-11 devstack@n-api.service[122361]: exception: Image not found. Aug 29 15:31:08.461870 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'image_id': '62371914-6bd2-4c32-97a6-66831de12e9f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:31:08.462855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 62371914-6bd2-4c32-97a6-66831de12e9f Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:31:08.465238 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 62371914-6bd2-4c32-97a6-66831de12e9f could not be found. Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:08.468829 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:31:08.471658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.476188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f823f39a-9807-4b5c-a6d7-f41389276d68 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Returning 404 to user: Image not found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:08.476188 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f823f39a-9807-4b5c-a6d7-f41389276d68 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] 10.222.0.62 "PUT /compute/v2.1/images/62371914-6bd2-4c32-97a6-66831de12e9f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.040558 Aug 29 15:31:08.476188 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 790/1600] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:31:08 2022] PUT /compute/v2.1/images/62371914-6bd2-4c32-97a6-66831de12e9f/metadata => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:31:08.476188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d116a7d9-28b0-43e9-92f9-117c0127f4c5 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Action: 'update', calling method: .version_select at 0x7fc42b6c8280>, body: {"meta": {"os_distro": "alt"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:08.513129 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-d116a7d9-28b0-43e9-92f9-117c0127f4c5 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] HTTP exception thrown: Image not found. Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d116a7d9-28b0-43e9-92f9-117c0127f4c5 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Request method failure captured: Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: request: PUT /compute/v2.1/images/c3cbd6cc-b845-4014-97ca-694c6d514253/metadata/os_distro HTTP/1.1 Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 30 Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNu71rrW56Ww5BqkrZcT4sb5ZQJUuBst-QqEcKUFnELtgQvLm1bOTwOMxA0mMU0vTnf88P80GLjPXVm6JuFf5QwITmscFo5tfsgazX-khMveg2WEd8SOtJMWpdguIwt168TjHyoV5eA6QVdWEvsDVxQOOrDWP9lly3XVYQNV-bn2Q4I Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 8ef07a8348bb41c596b0f5862149c297 Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:31:08.514805 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:31:08.516670 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8ef07a8348bb41c596b0f5862149c297", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8ef07a8348bb41c596b0f5862149c297"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8ef07a8348bb41c596b0f5862149c297"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8ef07a8348bb41c596b0f5862149c297"}]}] Aug 29 15:31:08.516670 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.516670 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 8ef07a8348bb41c596b0f5862149c297 Aug 29 15:31:08.516670 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.516670 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesMetadataNegativeTestJSON-199055655-project Aug 29 15:31:08.516670 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:31:08.516670 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:31:08.516670 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 29512a3a7a7a4d76a99dc7f17621a498 Aug 29 15:31:08.516670 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-199055655-project Aug 29 15:31:08.516670 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:31:08.516670 n-d-839401-11 devstack@n-api.service[122361]: {"meta": {"os_distro": "alt"}} Aug 29 15:31:08.516670 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:31:08.516670 n-d-839401-11 devstack@n-api.service[122361]: exception: Image not found. Aug 29 15:31:08.516670 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'image_id': 'c3cbd6cc-b845-4014-97ca-694c6d514253', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:31:08.517734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c3cbd6cc-b845-4014-97ca-694c6d514253 Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:31:08.519433 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c3cbd6cc-b845-4014-97ca-694c6d514253 could not be found. Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:08.520723 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:31:08.524682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.527784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d116a7d9-28b0-43e9-92f9-117c0127f4c5 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Returning 404 to user: Image not found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:08.529282 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d116a7d9-28b0-43e9-92f9-117c0127f4c5 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] 10.222.0.62 "PUT /compute/v2.1/images/c3cbd6cc-b845-4014-97ca-694c6d514253/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.058531 Aug 29 15:31:08.530768 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 791/1601] 10.222.0.62 () {60 vars in 1310 bytes} [Mon Aug 29 15:31:08 2022] PUT /compute/v2.1/images/c3cbd6cc-b845-4014-97ca-694c6d514253/metadata/os_distro => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:31:08.542232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aff0b6a1-4bcc-473a-b5a4-fe8e52638f95 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Action: 'create', calling method: .version_select at 0x7fc42b745940>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:08.575854 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-aff0b6a1-4bcc-473a-b5a4-fe8e52638f95 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] HTTP exception thrown: Image not found. Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aff0b6a1-4bcc-473a-b5a4-fe8e52638f95 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Request method failure captured: Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/images/37b207cb-ab29-4258-83bf-216c4232b058/metadata HTTP/1.1 Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 57 Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNu71rrW56Ww5BqkrZcT4sb5ZQJUuBst-QqEcKUFnELtgQvLm1bOTwOMxA0mMU0vTnf88P80GLjPXVm6JuFf5QwITmscFo5tfsgazX-khMveg2WEd8SOtJMWpdguIwt168TjHyoV5eA6QVdWEvsDVxQOOrDWP9lly3XVYQNV-bn2Q4I Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 8ef07a8348bb41c596b0f5862149c297 Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:31:08.578633 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:31:08.580202 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8ef07a8348bb41c596b0f5862149c297", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8ef07a8348bb41c596b0f5862149c297"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8ef07a8348bb41c596b0f5862149c297"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8ef07a8348bb41c596b0f5862149c297"}]}] Aug 29 15:31:08.580202 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.580202 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 8ef07a8348bb41c596b0f5862149c297 Aug 29 15:31:08.580202 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-199055655 Aug 29 15:31:08.580202 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesMetadataNegativeTestJSON-199055655-project Aug 29 15:31:08.580202 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:31:08.580202 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:31:08.580202 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 29512a3a7a7a4d76a99dc7f17621a498 Aug 29 15:31:08.580202 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-199055655-project Aug 29 15:31:08.580202 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:31:08.580202 n-d-839401-11 devstack@n-api.service[122361]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 29 15:31:08.580202 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:31:08.580202 n-d-839401-11 devstack@n-api.service[122361]: exception: Image not found. Aug 29 15:31:08.580202 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'image_id': '37b207cb-ab29-4258-83bf-216c4232b058', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:31:08.581546 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 37b207cb-ab29-4258-83bf-216c4232b058 Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:31:08.582850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 37b207cb-ab29-4258-83bf-216c4232b058 could not be found. Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:08.584931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:31:08.586603 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:08.588858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:08.590479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aff0b6a1-4bcc-473a-b5a4-fe8e52638f95 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] Returning 404 to user: Image not found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:08.592248 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aff0b6a1-4bcc-473a-b5a4-fe8e52638f95 tempest-ImagesMetadataNegativeTestJSON-199055655 tempest-ImagesMetadataNegativeTestJSON-199055655-project] 10.222.0.62 "POST /compute/v2.1/images/37b207cb-ab29-4258-83bf-216c4232b058/metadata" status: 404 len: 62 microversion: 2.1 time: 0.053806 Aug 29 15:31:08.594354 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 792/1602] 10.222.0.62 () {60 vars in 1281 bytes} [Mon Aug 29 15:31:08 2022] POST /compute/v2.1/images/37b207cb-ab29-4258-83bf-216c4232b058/metadata => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:31:08.657612 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f51b6c13-340f-417e-aaeb-47fbb6302773 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1813 microversion: 2.1 time: 0.276901 Aug 29 15:31:08.658761 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 811/1603] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:08 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1813 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:08.674623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=8 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:08.678924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2bcb5cdf-b4ca-4015-bd0d-b27cf64d4e5c tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:08.683254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bcb5cdf-b4ca-4015-bd0d-b27cf64d4e5c tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:08.683773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bcb5cdf-b4ca-4015-bd0d-b27cf64d4e5c tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:08.684251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bcb5cdf-b4ca-4015-bd0d-b27cf64d4e5c tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:08.684994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bcb5cdf-b4ca-4015-bd0d-b27cf64d4e5c tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:08.685544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bcb5cdf-b4ca-4015-bd0d-b27cf64d4e5c tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:08.685965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bcb5cdf-b4ca-4015-bd0d-b27cf64d4e5c tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:08.715327 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2bcb5cdf-b4ca-4015-bd0d-b27cf64d4e5c tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.041405 Aug 29 15:31:08.723544 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 793/1604] 10.222.0.62 () {58 vars in 1176 bytes} [Mon Aug 29 15:31:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:09.685079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-98759898-2dec-4e8f-896b-0c059687a23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00bf3bd4-659e-45df-8985-d2f5cb41f595"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:09.688741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-98759898-2dec-4e8f-896b-0c059687a23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:09.704892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98759898-2dec-4e8f-896b-0c059687a23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:09.707211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98759898-2dec-4e8f-896b-0c059687a23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:09.709907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98759898-2dec-4e8f-896b-0c059687a23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:09.712461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98759898-2dec-4e8f-896b-0c059687a23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:09.713883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98759898-2dec-4e8f-896b-0c059687a23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:09.715082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98759898-2dec-4e8f-896b-0c059687a23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:09.931947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-710376068", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:10.034661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] validate_networks() for None {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:31:10.251137 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-98759898-2dec-4e8f-896b-0c059687a23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "POST /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.571294 Aug 29 15:31:10.272148 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 794/1605] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 15:31:09 2022] POST /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c/os-volume_attachments => generated 194 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:10.567186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-66ed9148-c3d3-4195-9954-32134a60935b tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:10.568113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-66ed9148-c3d3-4195-9954-32134a60935b tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:10.576215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66ed9148-c3d3-4195-9954-32134a60935b tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:10.577009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66ed9148-c3d3-4195-9954-32134a60935b tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:10.577688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66ed9148-c3d3-4195-9954-32134a60935b tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:10.578622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66ed9148-c3d3-4195-9954-32134a60935b tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:10.579260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66ed9148-c3d3-4195-9954-32134a60935b tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:10.579943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66ed9148-c3d3-4195-9954-32134a60935b tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:10.759687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-66ed9148-c3d3-4195-9954-32134a60935b tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'services' on Instance uuid 982d1df4-7b96-4fbf-8ec2-61752962955d {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:10.783240 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-66ed9148-c3d3-4195-9954-32134a60935b tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 2426 microversion: 2.25 time: 0.223067 Aug 29 15:31:10.785351 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 795/1606] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:10 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 2426 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:31:10.796114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:31:10.797180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:31:10.798804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:31:10.799742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:31:10.800552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:31:10.809556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-afb92bff-72a7-4a1b-955d-eb52919df0b2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-839401-11", "block_migration": "auto"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:10.812456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-afb92bff-72a7-4a1b-955d-eb52919df0b2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:10.823398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:10.823637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb92bff-72a7-4a1b-955d-eb52919df0b2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:10.823890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:10.824349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb92bff-72a7-4a1b-955d-eb52919df0b2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:10.826067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:10.826338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb92bff-72a7-4a1b-955d-eb52919df0b2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:10.827731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb92bff-72a7-4a1b-955d-eb52919df0b2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:10.829360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb92bff-72a7-4a1b-955d-eb52919df0b2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:10.831459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb92bff-72a7-4a1b-955d-eb52919df0b2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:10.834712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:10.837914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:10.838652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:10.894329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Getting quotas for project cac390dda11d4f38983e1478de0dbde1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:10.902159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Getting quotas for user e57b95d059f74c7a894903b5a8f933df and project cac390dda11d4f38983e1478de0dbde1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:10.910474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-afb92bff-72a7-4a1b-955d-eb52919df0b2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'flavor' on Instance uuid 982d1df4-7b96-4fbf-8ec2-61752962955d {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:10.917723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:31:10.920906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:31:10.941951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-afb92bff-72a7-4a1b-955d-eb52919df0b2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Going to try to live migrate instance to n-h2-839401-11 {{(pid=122361) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:31:11.099507 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-69f0ac9d-9102-4aaa-8c10-f9b96f5dc3e1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.623972 Aug 29 15:31:11.108074 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 812/1607] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:31:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:31:11.125701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4349abb8-560e-40b6-9220-25d201295c67 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:11.128957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4349abb8-560e-40b6-9220-25d201295c67 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:11.324846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4349abb8-560e-40b6-9220-25d201295c67 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:11.344173 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4349abb8-560e-40b6-9220-25d201295c67 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1212 microversion: 2.1 time: 0.220167 Aug 29 15:31:11.360727 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 813/1608] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:11 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1212 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:11.791517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d02cdad6-724a-4ce2-bcf8-fe4f17a6e1fd tempest-AbsoluteLimitsNegativeTestJSON-1987247638 tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project] Calling method '.version_select at 0x7fc42b70b3a0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:11.816311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d02cdad6-724a-4ce2-bcf8-fe4f17a6e1fd tempest-AbsoluteLimitsNegativeTestJSON-1987247638 tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:11.825373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d02cdad6-724a-4ce2-bcf8-fe4f17a6e1fd tempest-AbsoluteLimitsNegativeTestJSON-1987247638 tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:11.826139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d02cdad6-724a-4ce2-bcf8-fe4f17a6e1fd tempest-AbsoluteLimitsNegativeTestJSON-1987247638 tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:11.837661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d02cdad6-724a-4ce2-bcf8-fe4f17a6e1fd tempest-AbsoluteLimitsNegativeTestJSON-1987247638 tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:11.848154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d02cdad6-724a-4ce2-bcf8-fe4f17a6e1fd tempest-AbsoluteLimitsNegativeTestJSON-1987247638 tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:11.850498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d02cdad6-724a-4ce2-bcf8-fe4f17a6e1fd tempest-AbsoluteLimitsNegativeTestJSON-1987247638 tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:11.917833 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d02cdad6-724a-4ce2-bcf8-fe4f17a6e1fd tempest-AbsoluteLimitsNegativeTestJSON-1987247638 tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project] 10.222.0.62 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.420718 Aug 29 15:31:11.921760 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 814/1609] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 15:31:11 2022] GET /compute/v2.1/limits => generated 511 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:12.047668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-df307dd7-7d1d-4f2d-bd25-c34fb9cbaf73 tempest-AbsoluteLimitsNegativeTestJSON-1987247638 tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1160544404", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:12.190546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-df307dd7-7d1d-4f2d-bd25-c34fb9cbaf73 tempest-AbsoluteLimitsNegativeTestJSON-1987247638 tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project] validate_networks() for None {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:31:12.601336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-df307dd7-7d1d-4f2d-bd25-c34fb9cbaf73 tempest-AbsoluteLimitsNegativeTestJSON-1987247638 tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project] Getting quotas for project 7a860442b0a94610b0966f898762c2ca. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:12.608149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-df307dd7-7d1d-4f2d-bd25-c34fb9cbaf73 tempest-AbsoluteLimitsNegativeTestJSON-1987247638 tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project] Getting quotas for user b25aa6e50a3c4ee3881fc651c4eb25ff and project 7a860442b0a94610b0966f898762c2ca. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:12.625524 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-df307dd7-7d1d-4f2d-bd25-c34fb9cbaf73 tempest-AbsoluteLimitsNegativeTestJSON-1987247638 tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-df307dd7-7d1d-4f2d-bd25-c34fb9cbaf73 tempest-AbsoluteLimitsNegativeTestJSON-1987247638 tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project] Request method failure captured: Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 1752 Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNu_bM5LkOTzlqGWP8fxpWNn7_EJ5y_Isojy3sqFICBegr4ClWbDuRNmQfKDE-HgdPo0z2s4UvzhLs2m_i_N6pudgaco1yBtBkW_lyzOp9p_EOsOhsWSETi7NbJciMLiv8i4mcgwMtf8hmcuwjg-4B9O-uAhFHgU66QjngatCpukQiA Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 7a860442b0a94610b0966f898762c2ca Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1987247638 Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7a860442b0a94610b0966f898762c2ca", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7a860442b0a94610b0966f898762c2ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7a860442b0a94610b0966f898762c2ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7a860442b0a94610b0966f898762c2ca"}]}] Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1987247638 Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 7a860442b0a94610b0966f898762c2ca Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1987247638 Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b25aa6e50a3c4ee3881fc651c4eb25ff Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1160544404", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:31:12.665828 n-d-839401-11 devstack@n-api.service[122360]: exception: Maximum number of metadata items exceeds 128 Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1160544404', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:31:12.669220 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:31:12.673228 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:31:12.673228 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:31:12.673228 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 15:31:12.673228 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 15:31:12.673228 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 29 15:31:12.673228 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:12.673228 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:12.673228 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:12.673228 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:12.673228 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:12.673228 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:12.673228 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:12.673228 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:12.673228 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 29 15:31:12.673228 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:12.674687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-df307dd7-7d1d-4f2d-bd25-c34fb9cbaf73 tempest-AbsoluteLimitsNegativeTestJSON-1987247638 tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:12.676029 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-df307dd7-7d1d-4f2d-bd25-c34fb9cbaf73 tempest-AbsoluteLimitsNegativeTestJSON-1987247638 tempest-AbsoluteLimitsNegativeTestJSON-1987247638-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.635833 Aug 29 15:31:12.676855 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 815/1610] 10.222.0.62 () {60 vars in 1148 bytes} [Mon Aug 29 15:31:12 2022] POST /compute/v2.1/servers => generated 87 bytes in 638 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:31:12.694251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a674461-9d78-4027-8fb5-e2f03d739175 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:12.703839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9a674461-9d78-4027-8fb5-e2f03d739175 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:12.723389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a674461-9d78-4027-8fb5-e2f03d739175 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:12.728142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a674461-9d78-4027-8fb5-e2f03d739175 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:12.743389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a674461-9d78-4027-8fb5-e2f03d739175 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:12.744377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a674461-9d78-4027-8fb5-e2f03d739175 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:12.744930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a674461-9d78-4027-8fb5-e2f03d739175 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:12.745415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a674461-9d78-4027-8fb5-e2f03d739175 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:12.954287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9a674461-9d78-4027-8fb5-e2f03d739175 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:12.965349 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a674461-9d78-4027-8fb5-e2f03d739175 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1208 microversion: 2.1 time: 0.286718 Aug 29 15:31:12.965966 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 816/1611] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:12 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1208 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:13.203063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:13.264129 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-afb92bff-72a7-4a1b-955d-eb52919df0b2 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/action" status: 202 len: 0 microversion: 2.25 time: 2.458647 Aug 29 15:31:13.265527 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 796/1612] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 15:31:10 2022] POST /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/action => generated 0 bytes in 2461 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:31:13.275752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a084740b-3e88-4bb3-9c7f-84d4d175338b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:13.276680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a084740b-3e88-4bb3-9c7f-84d4d175338b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:13.290853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a084740b-3e88-4bb3-9c7f-84d4d175338b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:13.291365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a084740b-3e88-4bb3-9c7f-84d4d175338b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:13.292858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a084740b-3e88-4bb3-9c7f-84d4d175338b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:13.294503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a084740b-3e88-4bb3-9c7f-84d4d175338b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:13.294999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a084740b-3e88-4bb3-9c7f-84d4d175338b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:13.295442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a084740b-3e88-4bb3-9c7f-84d4d175338b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:13.724964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a084740b-3e88-4bb3-9c7f-84d4d175338b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:13.747444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a084740b-3e88-4bb3-9c7f-84d4d175338b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:13.749373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a084740b-3e88-4bb3-9c7f-84d4d175338b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:13.753737 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a084740b-3e88-4bb3-9c7f-84d4d175338b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.482034 Aug 29 15:31:13.760712 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 817/1613] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:13 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:13.987183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-899d02fc-31f6-43f9-a1c3-3427c2f2dedb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:13.987876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-899d02fc-31f6-43f9-a1c3-3427c2f2dedb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:14.000258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-899d02fc-31f6-43f9-a1c3-3427c2f2dedb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:14.000904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-899d02fc-31f6-43f9-a1c3-3427c2f2dedb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:14.004157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-899d02fc-31f6-43f9-a1c3-3427c2f2dedb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:14.005539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-899d02fc-31f6-43f9-a1c3-3427c2f2dedb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:14.006405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-899d02fc-31f6-43f9-a1c3-3427c2f2dedb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:14.009891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-899d02fc-31f6-43f9-a1c3-3427c2f2dedb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:14.154119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-899d02fc-31f6-43f9-a1c3-3427c2f2dedb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:14.171538 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-899d02fc-31f6-43f9-a1c3-3427c2f2dedb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1270 microversion: 2.1 time: 0.188182 Aug 29 15:31:14.172371 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 797/1614] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:13 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1270 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:14.789744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c706ece8-0fbc-4436-96ef-12574c1f73c9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:14.791907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c706ece8-0fbc-4436-96ef-12574c1f73c9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:14.810523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c706ece8-0fbc-4436-96ef-12574c1f73c9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:14.817647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c706ece8-0fbc-4436-96ef-12574c1f73c9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:14.818370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c706ece8-0fbc-4436-96ef-12574c1f73c9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:14.819533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c706ece8-0fbc-4436-96ef-12574c1f73c9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:14.820558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c706ece8-0fbc-4436-96ef-12574c1f73c9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:14.821458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c706ece8-0fbc-4436-96ef-12574c1f73c9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:15.194390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ca6273f0-10e9-4260-960a-d239dd72d362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:15.195401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ca6273f0-10e9-4260-960a-d239dd72d362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:15.207041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca6273f0-10e9-4260-960a-d239dd72d362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:15.209677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca6273f0-10e9-4260-960a-d239dd72d362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:15.210450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca6273f0-10e9-4260-960a-d239dd72d362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:15.212397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca6273f0-10e9-4260-960a-d239dd72d362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:15.213814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca6273f0-10e9-4260-960a-d239dd72d362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:15.214427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca6273f0-10e9-4260-960a-d239dd72d362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:15.298810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c706ece8-0fbc-4436-96ef-12574c1f73c9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:15.312241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c706ece8-0fbc-4436-96ef-12574c1f73c9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:15.314003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c706ece8-0fbc-4436-96ef-12574c1f73c9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:15.315345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ca6273f0-10e9-4260-960a-d239dd72d362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:15.316116 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c706ece8-0fbc-4436-96ef-12574c1f73c9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.532446 Aug 29 15:31:15.329630 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 818/1615] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:14 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:15.337852 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ca6273f0-10e9-4260-960a-d239dd72d362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1270 microversion: 2.1 time: 0.147725 Aug 29 15:31:15.340160 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 798/1616] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:15 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:15.798393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ca721cc-3c84-4363-9ca3-d91b33d27d6d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2b84825-7bbd-4166-af15-623dc682d688", "device": "/dev/xvdb"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:15.801532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ca721cc-3c84-4363-9ca3-d91b33d27d6d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:15.815913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ca721cc-3c84-4363-9ca3-d91b33d27d6d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:15.818780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ca721cc-3c84-4363-9ca3-d91b33d27d6d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:15.819419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ca721cc-3c84-4363-9ca3-d91b33d27d6d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:15.826055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ca721cc-3c84-4363-9ca3-d91b33d27d6d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:15.832498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ca721cc-3c84-4363-9ca3-d91b33d27d6d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:15.833264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ca721cc-3c84-4363-9ca3-d91b33d27d6d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:16.342262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1b8806af-6123-4985-b752-de3f7c0d880f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:16.343092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1b8806af-6123-4985-b752-de3f7c0d880f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:16.357922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b8806af-6123-4985-b752-de3f7c0d880f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:16.358630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b8806af-6123-4985-b752-de3f7c0d880f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:16.362023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b8806af-6123-4985-b752-de3f7c0d880f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:16.362884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b8806af-6123-4985-b752-de3f7c0d880f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:16.363890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b8806af-6123-4985-b752-de3f7c0d880f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:16.365649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b8806af-6123-4985-b752-de3f7c0d880f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:16.376494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:16.650757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1b8806af-6123-4985-b752-de3f7c0d880f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:16.666289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1b8806af-6123-4985-b752-de3f7c0d880f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:16.674074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1b8806af-6123-4985-b752-de3f7c0d880f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:16.677129 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1b8806af-6123-4985-b752-de3f7c0d880f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.339978 Aug 29 15:31:16.678802 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 799/1617] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:16 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:16.684320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2c17422a-63ed-488a-bb80-e2b28f39d3dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:16.687740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2c17422a-63ed-488a-bb80-e2b28f39d3dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:16.705800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c17422a-63ed-488a-bb80-e2b28f39d3dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:16.708051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c17422a-63ed-488a-bb80-e2b28f39d3dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:16.708600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c17422a-63ed-488a-bb80-e2b28f39d3dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:16.710178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c17422a-63ed-488a-bb80-e2b28f39d3dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:16.712464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c17422a-63ed-488a-bb80-e2b28f39d3dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:16.713167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c17422a-63ed-488a-bb80-e2b28f39d3dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:17.375241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2c17422a-63ed-488a-bb80-e2b28f39d3dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:17.388652 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2c17422a-63ed-488a-bb80-e2b28f39d3dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1312 microversion: 2.1 time: 0.706255 Aug 29 15:31:17.389719 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 800/1618] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:16 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1312 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:17.702854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3b1ee1bc-753b-45fe-af34-29ab3115e0c4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:17.703615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3b1ee1bc-753b-45fe-af34-29ab3115e0c4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:17.717621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b1ee1bc-753b-45fe-af34-29ab3115e0c4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:17.718115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b1ee1bc-753b-45fe-af34-29ab3115e0c4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:17.718544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b1ee1bc-753b-45fe-af34-29ab3115e0c4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:17.719274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b1ee1bc-753b-45fe-af34-29ab3115e0c4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:17.719723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b1ee1bc-753b-45fe-af34-29ab3115e0c4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:17.720158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b1ee1bc-753b-45fe-af34-29ab3115e0c4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:18.386346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3b1ee1bc-753b-45fe-af34-29ab3115e0c4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:18.404076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3b1ee1bc-753b-45fe-af34-29ab3115e0c4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:18.405957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3b1ee1bc-753b-45fe-af34-29ab3115e0c4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:18.407285 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3b1ee1bc-753b-45fe-af34-29ab3115e0c4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.709236 Aug 29 15:31:18.409907 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 801/1619] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:17 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:18.414929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-835a26c1-3891-43d7-9cfe-c33afbf903d5 req-41750917-9366-48b7-9618-bbe09a5839ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab2a8c5-99e8-428d-99e2-3c62d1d86e3e", "tag": "da67ee23-a789-4121-8fed-92df23ce0b7e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:18.465781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-835a26c1-3891-43d7-9cfe-c33afbf903d5 req-41750917-9366-48b7-9618-bbe09a5839ed service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:18.466347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-835a26c1-3891-43d7-9cfe-c33afbf903d5 req-41750917-9366-48b7-9618-bbe09a5839ed service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:18.466779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-835a26c1-3891-43d7-9cfe-c33afbf903d5 req-41750917-9366-48b7-9618-bbe09a5839ed service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:18.494379 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-835a26c1-3891-43d7-9cfe-c33afbf903d5 req-41750917-9366-48b7-9618-bbe09a5839ed service nova] Creating event network-changed:da67ee23-a789-4121-8fed-92df23ce0b7e for instance dab2a8c5-99e8-428d-99e2-3c62d1d86e3e on n-h1-839401-11 Aug 29 15:31:18.506375 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-835a26c1-3891-43d7-9cfe-c33afbf903d5 req-41750917-9366-48b7-9618-bbe09a5839ed service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095016 Aug 29 15:31:18.509255 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 802/1620] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:18.522260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d97edc10-7cfa-4027-9050-2430bbe97df6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:18.523016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d97edc10-7cfa-4027-9050-2430bbe97df6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:18.544490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d97edc10-7cfa-4027-9050-2430bbe97df6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:18.545006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d97edc10-7cfa-4027-9050-2430bbe97df6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:18.545489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d97edc10-7cfa-4027-9050-2430bbe97df6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:18.546325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d97edc10-7cfa-4027-9050-2430bbe97df6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:18.546703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d97edc10-7cfa-4027-9050-2430bbe97df6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:18.547134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d97edc10-7cfa-4027-9050-2430bbe97df6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:18.698679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:19.260569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d97edc10-7cfa-4027-9050-2430bbe97df6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:19.274154 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d97edc10-7cfa-4027-9050-2430bbe97df6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1312 microversion: 2.1 time: 0.760621 Aug 29 15:31:19.300179 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 803/1621] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:18 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1312 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:19.436630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0285c2b8-a162-4a42-93a6-baee3f83fc85 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:19.437516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0285c2b8-a162-4a42-93a6-baee3f83fc85 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:19.459225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0285c2b8-a162-4a42-93a6-baee3f83fc85 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:19.459733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0285c2b8-a162-4a42-93a6-baee3f83fc85 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:19.460176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0285c2b8-a162-4a42-93a6-baee3f83fc85 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:19.460942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0285c2b8-a162-4a42-93a6-baee3f83fc85 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:19.461455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0285c2b8-a162-4a42-93a6-baee3f83fc85 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:19.462012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0285c2b8-a162-4a42-93a6-baee3f83fc85 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:19.678893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0285c2b8-a162-4a42-93a6-baee3f83fc85 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:19.692530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0285c2b8-a162-4a42-93a6-baee3f83fc85 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:19.694026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0285c2b8-a162-4a42-93a6-baee3f83fc85 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:19.695475 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0285c2b8-a162-4a42-93a6-baee3f83fc85 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.263258 Aug 29 15:31:19.714456 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 804/1622] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:19 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:20.301346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2c737f9d-3eea-4786-92d6-0dd0f43795c1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:20.302007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2c737f9d-3eea-4786-92d6-0dd0f43795c1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:20.316930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c737f9d-3eea-4786-92d6-0dd0f43795c1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:20.317361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c737f9d-3eea-4786-92d6-0dd0f43795c1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:20.317809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c737f9d-3eea-4786-92d6-0dd0f43795c1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:20.318537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c737f9d-3eea-4786-92d6-0dd0f43795c1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:20.318991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c737f9d-3eea-4786-92d6-0dd0f43795c1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:20.319416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c737f9d-3eea-4786-92d6-0dd0f43795c1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:20.780224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2c737f9d-3eea-4786-92d6-0dd0f43795c1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:20.801335 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2c737f9d-3eea-4786-92d6-0dd0f43795c1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1312 microversion: 2.1 time: 0.497678 Aug 29 15:31:20.804739 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 805/1623] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:20 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1312 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:20.828988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dcf0f1d1-d3b2-44cb-b00c-9db6fca63cd0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:20.830122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dcf0f1d1-d3b2-44cb-b00c-9db6fca63cd0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:20.858170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcf0f1d1-d3b2-44cb-b00c-9db6fca63cd0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:20.866279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcf0f1d1-d3b2-44cb-b00c-9db6fca63cd0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:20.866942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcf0f1d1-d3b2-44cb-b00c-9db6fca63cd0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:20.869676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcf0f1d1-d3b2-44cb-b00c-9db6fca63cd0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:20.870423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcf0f1d1-d3b2-44cb-b00c-9db6fca63cd0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:20.874325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcf0f1d1-d3b2-44cb-b00c-9db6fca63cd0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:21.202604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dcf0f1d1-d3b2-44cb-b00c-9db6fca63cd0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:21.228137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dcf0f1d1-d3b2-44cb-b00c-9db6fca63cd0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:21.232076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dcf0f1d1-d3b2-44cb-b00c-9db6fca63cd0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:21.235233 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dcf0f1d1-d3b2-44cb-b00c-9db6fca63cd0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.428572 Aug 29 15:31:21.236618 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 806/1624] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:20 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:21.446414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-62573421", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "fb38e4e2-e5fa-4622-ae76-9ce047f30c96"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:21.549550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] validate_networks() for [('fb38e4e2-e5fa-4622-ae76-9ce047f30c96', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:31:21.881211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:22.169908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:31:22.170922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:31:22.171978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:31:22.173230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:31:22.174378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:31:22.187522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:22.188286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:22.188952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:22.190767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:22.191451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:22.192236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:22.257541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Getting quotas for project 8b5ee0b05e5343d1a2a82a4b7dc75b68. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:22.272822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Getting quotas for user 3762d107bcf144dd8ad7a8d5fb636bf5 and project 8b5ee0b05e5343d1a2a82a4b7dc75b68. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:22.315279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:31:22.319715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:31:22.465370 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f959e3d8-ae04-4c52-8f54-63086daf0315 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.226578 Aug 29 15:31:22.466130 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 807/1625] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:31:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:31:22.480738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bf1b080f-b2f8-4b09-ad81-d386d528e511 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:22.481854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bf1b080f-b2f8-4b09-ad81-d386d528e511 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:22.499566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf1b080f-b2f8-4b09-ad81-d386d528e511 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:22.501510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf1b080f-b2f8-4b09-ad81-d386d528e511 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:22.502925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf1b080f-b2f8-4b09-ad81-d386d528e511 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:22.503612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf1b080f-b2f8-4b09-ad81-d386d528e511 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:22.504051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf1b080f-b2f8-4b09-ad81-d386d528e511 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:22.504498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf1b080f-b2f8-4b09-ad81-d386d528e511 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:22.616861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=22 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:23.314123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bf1b080f-b2f8-4b09-ad81-d386d528e511 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:23.326746 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bf1b080f-b2f8-4b09-ad81-d386d528e511 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1312 microversion: 2.1 time: 0.857659 Aug 29 15:31:23.330235 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 808/1626] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:22 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1312 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:23.353196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7384829a-f151-46ea-b4a6-95ffbfb0a5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:23.354051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7384829a-f151-46ea-b4a6-95ffbfb0a5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:23.367199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7384829a-f151-46ea-b4a6-95ffbfb0a5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:23.371247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7384829a-f151-46ea-b4a6-95ffbfb0a5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:23.371883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7384829a-f151-46ea-b4a6-95ffbfb0a5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:23.372940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7384829a-f151-46ea-b4a6-95ffbfb0a5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:23.373567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7384829a-f151-46ea-b4a6-95ffbfb0a5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:23.374282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7384829a-f151-46ea-b4a6-95ffbfb0a5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:23.678775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7384829a-f151-46ea-b4a6-95ffbfb0a5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:23.695223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7384829a-f151-46ea-b4a6-95ffbfb0a5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:23.697263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7384829a-f151-46ea-b4a6-95ffbfb0a5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:23.698837 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7384829a-f151-46ea-b4a6-95ffbfb0a5e7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.366820 Aug 29 15:31:23.699985 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 809/1627] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:23 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:23.704975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-03d4761f-c5ca-4d9b-b0f1-c25cfb21e60d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:23.706241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-03d4761f-c5ca-4d9b-b0f1-c25cfb21e60d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:23.713077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d4761f-c5ca-4d9b-b0f1-c25cfb21e60d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:23.713830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d4761f-c5ca-4d9b-b0f1-c25cfb21e60d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:23.714450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d4761f-c5ca-4d9b-b0f1-c25cfb21e60d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:23.715533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d4761f-c5ca-4d9b-b0f1-c25cfb21e60d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:23.716164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d4761f-c5ca-4d9b-b0f1-c25cfb21e60d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:23.717522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d4761f-c5ca-4d9b-b0f1-c25cfb21e60d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:23.793860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-03d4761f-c5ca-4d9b-b0f1-c25cfb21e60d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:23.805451 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-03d4761f-c5ca-4d9b-b0f1-c25cfb21e60d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1211 microversion: 2.1 time: 0.104120 Aug 29 15:31:23.806662 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 810/1628] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:23 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1211 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:24.355097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4781756d-91f8-4d14-9876-659d8181e656 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:24.355844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4781756d-91f8-4d14-9876-659d8181e656 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:24.364318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4781756d-91f8-4d14-9876-659d8181e656 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:24.365415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4781756d-91f8-4d14-9876-659d8181e656 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:24.365933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4781756d-91f8-4d14-9876-659d8181e656 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:24.367862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4781756d-91f8-4d14-9876-659d8181e656 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:24.368388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4781756d-91f8-4d14-9876-659d8181e656 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:24.369710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4781756d-91f8-4d14-9876-659d8181e656 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:24.700357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4781756d-91f8-4d14-9876-659d8181e656 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:24.710177 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4781756d-91f8-4d14-9876-659d8181e656 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1312 microversion: 2.1 time: 0.363850 Aug 29 15:31:24.714602 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 811/1629] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:24 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1312 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:24.742056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-17a72193-d1fb-4fe4-9e5f-13039cef5ce4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:24.753797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-17a72193-d1fb-4fe4-9e5f-13039cef5ce4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:24.779840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a72193-d1fb-4fe4-9e5f-13039cef5ce4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:24.781053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a72193-d1fb-4fe4-9e5f-13039cef5ce4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:24.785551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a72193-d1fb-4fe4-9e5f-13039cef5ce4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:24.786723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a72193-d1fb-4fe4-9e5f-13039cef5ce4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:24.787486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a72193-d1fb-4fe4-9e5f-13039cef5ce4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:24.788999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a72193-d1fb-4fe4-9e5f-13039cef5ce4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:25.328173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-17a72193-d1fb-4fe4-9e5f-13039cef5ce4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:25.352115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-17a72193-d1fb-4fe4-9e5f-13039cef5ce4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:25.358078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-17a72193-d1fb-4fe4-9e5f-13039cef5ce4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:25.365388 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-17a72193-d1fb-4fe4-9e5f-13039cef5ce4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.634084 Aug 29 15:31:25.367077 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 812/1630] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:24 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:25.375146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-90321679-6a83-4ebe-95b5-c7d4f7f1a40d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:25.379068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-90321679-6a83-4ebe-95b5-c7d4f7f1a40d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:25.396635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90321679-6a83-4ebe-95b5-c7d4f7f1a40d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:25.397381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90321679-6a83-4ebe-95b5-c7d4f7f1a40d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:25.398065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90321679-6a83-4ebe-95b5-c7d4f7f1a40d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:25.399618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90321679-6a83-4ebe-95b5-c7d4f7f1a40d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:25.400277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90321679-6a83-4ebe-95b5-c7d4f7f1a40d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:25.400836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90321679-6a83-4ebe-95b5-c7d4f7f1a40d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:25.531152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-90321679-6a83-4ebe-95b5-c7d4f7f1a40d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:25.544311 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-90321679-6a83-4ebe-95b5-c7d4f7f1a40d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1273 microversion: 2.1 time: 0.176126 Aug 29 15:31:25.549508 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 813/1631] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:25 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:25.627382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-423155cd-56d8-4964-87f1-d68f8580df5a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Action: 'create', calling method: .version_select at 0x7fc42b8954c0>, body: {"keypair": {"name": "tempest-keypair-1491875179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs0LY4p91kZFEsNUserG5CCfAwURRVaQbADF6wkCwg8I6q28IynYMrsM5hwUXZCN/CQ0d9x8D2vynWuX+aUNOIl7AlOJ3lVVD3/PpPziFP2TRJLnD6qlD0WpZVw6/v8HA=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:25.648219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-423155cd-56d8-4964-87f1-d68f8580df5a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Getting quotas for project 03b8d7e70d3244c2ac9866de54967460. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:25.652989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:25.657642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-423155cd-56d8-4964-87f1-d68f8580df5a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Getting quotas for user 966abbb1d63042469c45b784b6c7b5c7 and project 03b8d7e70d3244c2ac9866de54967460. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:25.695345 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-423155cd-56d8-4964-87f1-d68f8580df5a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.144711 Aug 29 15:31:25.696344 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 814/1632] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:31:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:25.739473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-50e6b0b7-5dc7-4c15-be23-12c84b6aa04c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:25.740587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-50e6b0b7-5dc7-4c15-be23-12c84b6aa04c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:25.759947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50e6b0b7-5dc7-4c15-be23-12c84b6aa04c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:25.761019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50e6b0b7-5dc7-4c15-be23-12c84b6aa04c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:25.761757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50e6b0b7-5dc7-4c15-be23-12c84b6aa04c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:25.762688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50e6b0b7-5dc7-4c15-be23-12c84b6aa04c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:25.763337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50e6b0b7-5dc7-4c15-be23-12c84b6aa04c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:25.765274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50e6b0b7-5dc7-4c15-be23-12c84b6aa04c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:25.811049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:25.876983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=42 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:26.067103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-50e6b0b7-5dc7-4c15-be23-12c84b6aa04c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:26.078585 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-50e6b0b7-5dc7-4c15-be23-12c84b6aa04c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1312 microversion: 2.1 time: 0.347237 Aug 29 15:31:26.091036 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 815/1633] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:25 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1312 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:26.390163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6b237762-6cb9-4386-880f-f55adf199a13 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:26.390771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6b237762-6cb9-4386-880f-f55adf199a13 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:26.406538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b237762-6cb9-4386-880f-f55adf199a13 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:26.407039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b237762-6cb9-4386-880f-f55adf199a13 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:26.407468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b237762-6cb9-4386-880f-f55adf199a13 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:26.408274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b237762-6cb9-4386-880f-f55adf199a13 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:26.408694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b237762-6cb9-4386-880f-f55adf199a13 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:26.413562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b237762-6cb9-4386-880f-f55adf199a13 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:26.987099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6b237762-6cb9-4386-880f-f55adf199a13 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:26.998793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6b237762-6cb9-4386-880f-f55adf199a13 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:27.003868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6b237762-6cb9-4386-880f-f55adf199a13 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:27.005495 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6b237762-6cb9-4386-880f-f55adf199a13 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.619338 Aug 29 15:31:27.009060 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 816/1634] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:26 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:27.025927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-da70cd64-9a72-4f17-b2f0-e1c20d07eada tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:27.026729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-da70cd64-9a72-4f17-b2f0-e1c20d07eada tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:27.034894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da70cd64-9a72-4f17-b2f0-e1c20d07eada tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:27.038916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da70cd64-9a72-4f17-b2f0-e1c20d07eada tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:27.041151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da70cd64-9a72-4f17-b2f0-e1c20d07eada tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:27.043897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da70cd64-9a72-4f17-b2f0-e1c20d07eada tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:27.044667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da70cd64-9a72-4f17-b2f0-e1c20d07eada tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:27.047626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da70cd64-9a72-4f17-b2f0-e1c20d07eada tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:27.367529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-da70cd64-9a72-4f17-b2f0-e1c20d07eada tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:27.380197 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-da70cd64-9a72-4f17-b2f0-e1c20d07eada tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1315 microversion: 2.1 time: 0.369287 Aug 29 15:31:27.381124 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 817/1635] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:27 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:27.407199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e6282b4b-caba-48ec-af58-9f8fa30c33b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:27.409018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e6282b4b-caba-48ec-af58-9f8fa30c33b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:27.427264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6282b4b-caba-48ec-af58-9f8fa30c33b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:27.428034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6282b4b-caba-48ec-af58-9f8fa30c33b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:27.428662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6282b4b-caba-48ec-af58-9f8fa30c33b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:27.432234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6282b4b-caba-48ec-af58-9f8fa30c33b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:27.432914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6282b4b-caba-48ec-af58-9f8fa30c33b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:27.433599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6282b4b-caba-48ec-af58-9f8fa30c33b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:27.463195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:27.809569 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ca721cc-3c84-4363-9ca3-d91b33d27d6d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "POST /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.015063 Aug 29 15:31:27.815674 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 819/1636] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 15:31:15 2022] POST /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments => generated 194 bytes in 12022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:27.822951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-3aba5a8a-b3c1-4f53-9aa3-b0c676f8d382 req-602706ed-16d3-4ef3-9f81-2dcca5c5d4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab2a8c5-99e8-428d-99e2-3c62d1d86e3e", "name": "network-vif-plugged", "status": "completed", "tag": "da67ee23-a789-4121-8fed-92df23ce0b7e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:27.843653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3aba5a8a-b3c1-4f53-9aa3-b0c676f8d382 req-602706ed-16d3-4ef3-9f81-2dcca5c5d4d9 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:27.847251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3aba5a8a-b3c1-4f53-9aa3-b0c676f8d382 req-602706ed-16d3-4ef3-9f81-2dcca5c5d4d9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:27.848042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3aba5a8a-b3c1-4f53-9aa3-b0c676f8d382 req-602706ed-16d3-4ef3-9f81-2dcca5c5d4d9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:27.879866 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-3aba5a8a-b3c1-4f53-9aa3-b0c676f8d382 req-602706ed-16d3-4ef3-9f81-2dcca5c5d4d9 service nova] Creating event network-vif-plugged:da67ee23-a789-4121-8fed-92df23ce0b7e for instance dab2a8c5-99e8-428d-99e2-3c62d1d86e3e on n-h1-839401-11 Aug 29 15:31:27.886892 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-3aba5a8a-b3c1-4f53-9aa3-b0c676f8d382 req-602706ed-16d3-4ef3-9f81-2dcca5c5d4d9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069500 Aug 29 15:31:27.889780 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 820/1637] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:28.031356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fd3e9c44-aecf-415c-acf4-d676761f5c33 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:28.032393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fd3e9c44-aecf-415c-acf4-d676761f5c33 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:28.042523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd3e9c44-aecf-415c-acf4-d676761f5c33 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:28.050376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd3e9c44-aecf-415c-acf4-d676761f5c33 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:28.050893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd3e9c44-aecf-415c-acf4-d676761f5c33 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:28.051663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd3e9c44-aecf-415c-acf4-d676761f5c33 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:28.052174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd3e9c44-aecf-415c-acf4-d676761f5c33 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:28.052602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd3e9c44-aecf-415c-acf4-d676761f5c33 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:28.088223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e6282b4b-caba-48ec-af58-9f8fa30c33b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:28.102004 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e6282b4b-caba-48ec-af58-9f8fa30c33b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1312 microversion: 2.1 time: 0.706040 Aug 29 15:31:28.104870 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 818/1638] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:27 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1312 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:28.301997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-70494ae2-114a-4ff0-af88-76045020a656 req-f3c6a531-5d10-4068-b04c-080a2e31b5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f33bc5f4-a9f5-4613-96d2-a48cf1b729fb", "tag": "bd19f4e3-2c35-46bf-832b-06072a8da6d5"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:28.332077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-70494ae2-114a-4ff0-af88-76045020a656 req-f3c6a531-5d10-4068-b04c-080a2e31b5a6 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:28.332598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-70494ae2-114a-4ff0-af88-76045020a656 req-f3c6a531-5d10-4068-b04c-080a2e31b5a6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:28.333034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-70494ae2-114a-4ff0-af88-76045020a656 req-f3c6a531-5d10-4068-b04c-080a2e31b5a6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:28.367652 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-70494ae2-114a-4ff0-af88-76045020a656 req-f3c6a531-5d10-4068-b04c-080a2e31b5a6 service nova] Creating event network-changed:bd19f4e3-2c35-46bf-832b-06072a8da6d5 for instance f33bc5f4-a9f5-4613-96d2-a48cf1b729fb on n-h2-839401-11 Aug 29 15:31:28.382986 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-70494ae2-114a-4ff0-af88-76045020a656 req-f3c6a531-5d10-4068-b04c-080a2e31b5a6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085767 Aug 29 15:31:28.383915 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 819/1639] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:31:28.409640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-768df538-bdc5-41a8-87fc-b533b0813935 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:28.410603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-768df538-bdc5-41a8-87fc-b533b0813935 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:28.425977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-768df538-bdc5-41a8-87fc-b533b0813935 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:28.426486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-768df538-bdc5-41a8-87fc-b533b0813935 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:28.426950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-768df538-bdc5-41a8-87fc-b533b0813935 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:28.429727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-768df538-bdc5-41a8-87fc-b533b0813935 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:28.432823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-768df538-bdc5-41a8-87fc-b533b0813935 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:28.433651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-768df538-bdc5-41a8-87fc-b533b0813935 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:28.456978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd3e9c44-aecf-415c-acf4-d676761f5c33 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:28.467557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd3e9c44-aecf-415c-acf4-d676761f5c33 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:28.475095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd3e9c44-aecf-415c-acf4-d676761f5c33 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:28.476630 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fd3e9c44-aecf-415c-acf4-d676761f5c33 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.449927 Aug 29 15:31:28.477784 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 821/1640] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:28 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:31:28.953519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-768df538-bdc5-41a8-87fc-b533b0813935 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:28.976681 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-768df538-bdc5-41a8-87fc-b533b0813935 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1315 microversion: 2.1 time: 0.572443 Aug 29 15:31:28.978159 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 820/1641] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:28 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:29.124223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d7a575eb-eaa5-4cc2-8722-3dde5a7d24d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:29.125566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d7a575eb-eaa5-4cc2-8722-3dde5a7d24d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:29.134650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7a575eb-eaa5-4cc2-8722-3dde5a7d24d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:29.135370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7a575eb-eaa5-4cc2-8722-3dde5a7d24d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:29.136002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7a575eb-eaa5-4cc2-8722-3dde5a7d24d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:29.136887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7a575eb-eaa5-4cc2-8722-3dde5a7d24d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:29.137531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7a575eb-eaa5-4cc2-8722-3dde5a7d24d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:29.139345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7a575eb-eaa5-4cc2-8722-3dde5a7d24d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:29.310457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d7a575eb-eaa5-4cc2-8722-3dde5a7d24d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:29.324584 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d7a575eb-eaa5-4cc2-8722-3dde5a7d24d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1312 microversion: 2.1 time: 0.204303 Aug 29 15:31:29.325401 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 822/1642] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:29 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1312 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:29.501451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-feebf2e8-50de-4c7b-87eb-8797e584663b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:29.502546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-feebf2e8-50de-4c7b-87eb-8797e584663b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:29.509496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-feebf2e8-50de-4c7b-87eb-8797e584663b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:29.510411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-feebf2e8-50de-4c7b-87eb-8797e584663b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:29.511044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-feebf2e8-50de-4c7b-87eb-8797e584663b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:29.513339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-feebf2e8-50de-4c7b-87eb-8797e584663b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:29.513816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-feebf2e8-50de-4c7b-87eb-8797e584663b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:29.514236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-feebf2e8-50de-4c7b-87eb-8797e584663b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:29.680632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-feebf2e8-50de-4c7b-87eb-8797e584663b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:29.690261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-feebf2e8-50de-4c7b-87eb-8797e584663b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:29.692100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-feebf2e8-50de-4c7b-87eb-8797e584663b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:29.694243 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-feebf2e8-50de-4c7b-87eb-8797e584663b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.197978 Aug 29 15:31:29.695020 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 821/1643] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:29 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:29.997649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9e87a76d-b297-4cb8-aabc-3dbda24191ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:29.998660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9e87a76d-b297-4cb8-aabc-3dbda24191ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:30.004996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e87a76d-b297-4cb8-aabc-3dbda24191ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:30.005771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e87a76d-b297-4cb8-aabc-3dbda24191ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:30.006279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e87a76d-b297-4cb8-aabc-3dbda24191ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:30.007053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e87a76d-b297-4cb8-aabc-3dbda24191ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:30.007577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e87a76d-b297-4cb8-aabc-3dbda24191ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:30.008073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e87a76d-b297-4cb8-aabc-3dbda24191ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:30.202870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e87a76d-b297-4cb8-aabc-3dbda24191ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:30.213910 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9e87a76d-b297-4cb8-aabc-3dbda24191ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1315 microversion: 2.1 time: 0.219994 Aug 29 15:31:30.226974 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 823/1644] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:29 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:30.350549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-342eff10-cf23-4668-96f3-1ddfe861682e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:30.352916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-342eff10-cf23-4668-96f3-1ddfe861682e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:30.362402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-342eff10-cf23-4668-96f3-1ddfe861682e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:30.363373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-342eff10-cf23-4668-96f3-1ddfe861682e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:30.364400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-342eff10-cf23-4668-96f3-1ddfe861682e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:30.379352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-342eff10-cf23-4668-96f3-1ddfe861682e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:30.380070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-342eff10-cf23-4668-96f3-1ddfe861682e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:30.380709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-342eff10-cf23-4668-96f3-1ddfe861682e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:30.435790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e1de2611-95a9-472e-8a94-3f308a53ff2b tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:30.438148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e1de2611-95a9-472e-8a94-3f308a53ff2b tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:30.445177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1de2611-95a9-472e-8a94-3f308a53ff2b tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:30.445680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1de2611-95a9-472e-8a94-3f308a53ff2b tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:30.446115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1de2611-95a9-472e-8a94-3f308a53ff2b tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:30.446820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1de2611-95a9-472e-8a94-3f308a53ff2b tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:30.447264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1de2611-95a9-472e-8a94-3f308a53ff2b tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:30.447822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1de2611-95a9-472e-8a94-3f308a53ff2b tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:30.482913 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e1de2611-95a9-472e-8a94-3f308a53ff2b tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051073 Aug 29 15:31:30.483731 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 824/1645] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:31:30 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:31:30.496178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c776c5b6-ebfa-429c-b306-4c3215a4d60f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:30.496755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c776c5b6-ebfa-429c-b306-4c3215a4d60f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:30.504470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c776c5b6-ebfa-429c-b306-4c3215a4d60f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:30.505036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c776c5b6-ebfa-429c-b306-4c3215a4d60f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:30.505728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c776c5b6-ebfa-429c-b306-4c3215a4d60f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:30.506500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c776c5b6-ebfa-429c-b306-4c3215a4d60f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:30.507021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c776c5b6-ebfa-429c-b306-4c3215a4d60f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:30.507525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c776c5b6-ebfa-429c-b306-4c3215a4d60f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:30.623334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-342eff10-cf23-4668-96f3-1ddfe861682e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:30.632840 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-342eff10-cf23-4668-96f3-1ddfe861682e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1462 microversion: 2.1 time: 0.286923 Aug 29 15:31:30.649831 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 822/1646] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:30 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1462 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:30.698736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-c776c5b6-ebfa-429c-b306-4c3215a4d60f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lazy-loading 'services' on Instance uuid 32bc300a-b702-4755-b0c2-f0004d7d5016 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:30.842335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8ed993eb-07d4-4eb6-b8b4-abd0d1863839 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:30.843221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8ed993eb-07d4-4eb6-b8b4-abd0d1863839 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:30.853606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ed993eb-07d4-4eb6-b8b4-abd0d1863839 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:30.854820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ed993eb-07d4-4eb6-b8b4-abd0d1863839 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:30.855444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ed993eb-07d4-4eb6-b8b4-abd0d1863839 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:30.856381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ed993eb-07d4-4eb6-b8b4-abd0d1863839 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:30.857007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ed993eb-07d4-4eb6-b8b4-abd0d1863839 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:30.857762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ed993eb-07d4-4eb6-b8b4-abd0d1863839 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:30.907908 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c776c5b6-ebfa-429c-b306-4c3215a4d60f tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "DELETE /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016/os-volume_attachments/9de1846a-7b4e-4efe-b43f-1e0b71796d8d" status: 202 len: 0 microversion: 2.1 time: 0.417398 Aug 29 15:31:30.908873 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 825/1647] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 15:31:30 2022] DELETE /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016/os-volume_attachments/9de1846a-7b4e-4efe-b43f-1e0b71796d8d => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:31:30.922999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2088a564-4738-4bf6-a7e2-7e007d244154 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:30.924113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2088a564-4738-4bf6-a7e2-7e007d244154 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:30.941751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2088a564-4738-4bf6-a7e2-7e007d244154 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:30.944778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2088a564-4738-4bf6-a7e2-7e007d244154 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:30.945599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2088a564-4738-4bf6-a7e2-7e007d244154 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:30.947699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2088a564-4738-4bf6-a7e2-7e007d244154 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:30.950224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2088a564-4738-4bf6-a7e2-7e007d244154 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:30.950834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2088a564-4738-4bf6-a7e2-7e007d244154 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:31.241151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2088a564-4738-4bf6-a7e2-7e007d244154 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:31.252685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2088a564-4738-4bf6-a7e2-7e007d244154 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:31.254762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2088a564-4738-4bf6-a7e2-7e007d244154 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:31.256755 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2088a564-4738-4bf6-a7e2-7e007d244154 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.346339 Aug 29 15:31:31.257803 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 826/1648] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:30 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:31.262858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-648d858b-d03f-4b88-b005-c15cfdabc861 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:31.265526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-648d858b-d03f-4b88-b005-c15cfdabc861 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:31.273450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-648d858b-d03f-4b88-b005-c15cfdabc861 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:31.274282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-648d858b-d03f-4b88-b005-c15cfdabc861 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:31.275020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-648d858b-d03f-4b88-b005-c15cfdabc861 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:31.288791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-648d858b-d03f-4b88-b005-c15cfdabc861 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:31.290486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-648d858b-d03f-4b88-b005-c15cfdabc861 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:31.292157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-648d858b-d03f-4b88-b005-c15cfdabc861 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:31.309166 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8ed993eb-07d4-4eb6-b8b4-abd0d1863839 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1615 microversion: 2.1 time: 0.657238 Aug 29 15:31:31.310613 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 823/1649] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:30 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1615 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:31.339287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7c7ba2ee-4f73-4eb8-bdee-420b751108b2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:31.340279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7c7ba2ee-4f73-4eb8-bdee-420b751108b2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:31.355104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c7ba2ee-4f73-4eb8-bdee-420b751108b2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:31.357880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c7ba2ee-4f73-4eb8-bdee-420b751108b2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:31.360893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c7ba2ee-4f73-4eb8-bdee-420b751108b2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:31.362000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c7ba2ee-4f73-4eb8-bdee-420b751108b2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:31.362689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c7ba2ee-4f73-4eb8-bdee-420b751108b2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:31.364758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c7ba2ee-4f73-4eb8-bdee-420b751108b2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:31.432629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7c7ba2ee-4f73-4eb8-bdee-420b751108b2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c6120724d1ad4272a1507ebc11cbf895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094265a4efd8497ca10efe66cb7a434d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:31.437127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7c7ba2ee-4f73-4eb8-bdee-420b751108b2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] flavor_id is None. Assuming migration. {{(pid=122361) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 15:31:31.438239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7c7ba2ee-4f73-4eb8-bdee-420b751108b2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122361) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 15:31:31.518066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-648d858b-d03f-4b88-b005-c15cfdabc861 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:31.528338 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-648d858b-d03f-4b88-b005-c15cfdabc861 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1315 microversion: 2.1 time: 0.268971 Aug 29 15:31:31.529249 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 827/1650] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:31 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:31.908409 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7c7ba2ee-4f73-4eb8-bdee-420b751108b2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e/action" status: 202 len: 0 microversion: 2.1 time: 0.577964 Aug 29 15:31:31.909836 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 824/1651] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:31:31 2022] POST /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:31:31.918566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-05492562-faf0-4ed8-874a-444a4cd74b2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:31.919187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-05492562-faf0-4ed8-874a-444a4cd74b2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:31.926361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05492562-faf0-4ed8-874a-444a4cd74b2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:31.927168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05492562-faf0-4ed8-874a-444a4cd74b2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:31.928062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05492562-faf0-4ed8-874a-444a4cd74b2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:31.928965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05492562-faf0-4ed8-874a-444a4cd74b2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:31.929619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05492562-faf0-4ed8-874a-444a4cd74b2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:31.930209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05492562-faf0-4ed8-874a-444a4cd74b2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:32.107346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-05492562-faf0-4ed8-874a-444a4cd74b2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:32.117908 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-05492562-faf0-4ed8-874a-444a4cd74b2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1471 microversion: 2.1 time: 0.203194 Aug 29 15:31:32.118787 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 828/1652] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:31 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1471 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:32.278401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:32.285817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-453eae36-4fe2-4e15-8f6f-c2c1cb7ef47b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:32.286670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-453eae36-4fe2-4e15-8f6f-c2c1cb7ef47b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:32.294757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-453eae36-4fe2-4e15-8f6f-c2c1cb7ef47b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:32.295571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-453eae36-4fe2-4e15-8f6f-c2c1cb7ef47b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:32.296189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-453eae36-4fe2-4e15-8f6f-c2c1cb7ef47b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:32.296909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-453eae36-4fe2-4e15-8f6f-c2c1cb7ef47b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:32.297675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-453eae36-4fe2-4e15-8f6f-c2c1cb7ef47b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:32.298371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-453eae36-4fe2-4e15-8f6f-c2c1cb7ef47b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:32.554002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f67a34b8-0523-4ae6-8820-86edc6397ac6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:32.554702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f67a34b8-0523-4ae6-8820-86edc6397ac6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:32.561532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f67a34b8-0523-4ae6-8820-86edc6397ac6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:32.562538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f67a34b8-0523-4ae6-8820-86edc6397ac6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:32.563315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f67a34b8-0523-4ae6-8820-86edc6397ac6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:32.564187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f67a34b8-0523-4ae6-8820-86edc6397ac6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:32.564844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f67a34b8-0523-4ae6-8820-86edc6397ac6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:32.570356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f67a34b8-0523-4ae6-8820-86edc6397ac6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:32.574035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-453eae36-4fe2-4e15-8f6f-c2c1cb7ef47b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:32.584805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-453eae36-4fe2-4e15-8f6f-c2c1cb7ef47b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:32.586333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-453eae36-4fe2-4e15-8f6f-c2c1cb7ef47b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:32.589788 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-453eae36-4fe2-4e15-8f6f-c2c1cb7ef47b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.312748 Aug 29 15:31:32.603973 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 825/1653] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:32 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:32.886076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f67a34b8-0523-4ae6-8820-86edc6397ac6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:32.895216 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f67a34b8-0523-4ae6-8820-86edc6397ac6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1315 microversion: 2.1 time: 0.346934 Aug 29 15:31:32.896221 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 829/1654] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:32 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:33.141006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-48237783-a226-4fb4-bc16-437d5db96005 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:33.141617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-48237783-a226-4fb4-bc16-437d5db96005 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:33.151881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48237783-a226-4fb4-bc16-437d5db96005 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:33.152665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48237783-a226-4fb4-bc16-437d5db96005 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:33.153310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48237783-a226-4fb4-bc16-437d5db96005 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:33.154303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48237783-a226-4fb4-bc16-437d5db96005 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:33.155529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48237783-a226-4fb4-bc16-437d5db96005 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:33.156127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48237783-a226-4fb4-bc16-437d5db96005 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:33.318876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-48237783-a226-4fb4-bc16-437d5db96005 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:33.328916 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-48237783-a226-4fb4-bc16-437d5db96005 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1471 microversion: 2.1 time: 0.192987 Aug 29 15:31:33.339786 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 826/1655] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:33 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1471 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:33.619424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-11ca7781-c502-4d01-8a84-58da3024a0a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:33.620058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-11ca7781-c502-4d01-8a84-58da3024a0a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:33.630851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11ca7781-c502-4d01-8a84-58da3024a0a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:33.631901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11ca7781-c502-4d01-8a84-58da3024a0a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:33.632532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11ca7781-c502-4d01-8a84-58da3024a0a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:33.633641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11ca7781-c502-4d01-8a84-58da3024a0a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:33.634285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11ca7781-c502-4d01-8a84-58da3024a0a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:33.634899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11ca7781-c502-4d01-8a84-58da3024a0a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:33.806360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-11ca7781-c502-4d01-8a84-58da3024a0a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:33.817676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-11ca7781-c502-4d01-8a84-58da3024a0a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:33.818986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-11ca7781-c502-4d01-8a84-58da3024a0a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:33.819713 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-11ca7781-c502-4d01-8a84-58da3024a0a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.205753 Aug 29 15:31:33.820248 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 830/1656] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:33 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:33.918308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ecceaf69-d5c7-4319-b968-7da443533f5d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:33.919079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ecceaf69-d5c7-4319-b968-7da443533f5d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:33.926983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecceaf69-d5c7-4319-b968-7da443533f5d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:33.927635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecceaf69-d5c7-4319-b968-7da443533f5d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:33.928160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecceaf69-d5c7-4319-b968-7da443533f5d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:33.929126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecceaf69-d5c7-4319-b968-7da443533f5d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:33.929789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecceaf69-d5c7-4319-b968-7da443533f5d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:33.930284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecceaf69-d5c7-4319-b968-7da443533f5d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:34.076654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ecceaf69-d5c7-4319-b968-7da443533f5d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:34.087093 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ecceaf69-d5c7-4319-b968-7da443533f5d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1315 microversion: 2.1 time: 0.173356 Aug 29 15:31:34.087735 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 827/1657] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:33 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:34.352845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5a0dd9a2-979a-4238-934e-54ed7566e421 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:34.353790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5a0dd9a2-979a-4238-934e-54ed7566e421 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:34.361474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a0dd9a2-979a-4238-934e-54ed7566e421 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:34.362178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a0dd9a2-979a-4238-934e-54ed7566e421 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:34.363058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a0dd9a2-979a-4238-934e-54ed7566e421 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:34.366235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a0dd9a2-979a-4238-934e-54ed7566e421 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:34.367330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a0dd9a2-979a-4238-934e-54ed7566e421 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:34.368183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a0dd9a2-979a-4238-934e-54ed7566e421 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:34.535737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5a0dd9a2-979a-4238-934e-54ed7566e421 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:34.544846 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5a0dd9a2-979a-4238-934e-54ed7566e421 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1471 microversion: 2.1 time: 0.196901 Aug 29 15:31:34.545479 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 831/1658] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:34 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:34.844984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5c0f6280-2f6c-4c3a-a3ac-5e511e92144c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:34.845703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5c0f6280-2f6c-4c3a-a3ac-5e511e92144c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:34.856702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c0f6280-2f6c-4c3a-a3ac-5e511e92144c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:34.890478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c0f6280-2f6c-4c3a-a3ac-5e511e92144c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:34.890478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c0f6280-2f6c-4c3a-a3ac-5e511e92144c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:34.890478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c0f6280-2f6c-4c3a-a3ac-5e511e92144c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:34.890478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c0f6280-2f6c-4c3a-a3ac-5e511e92144c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:34.890478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c0f6280-2f6c-4c3a-a3ac-5e511e92144c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:35.109311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-22fe19bd-45cd-417e-a1ed-4b9bf5b701b5 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:35.111791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-22fe19bd-45cd-417e-a1ed-4b9bf5b701b5 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:35.133108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22fe19bd-45cd-417e-a1ed-4b9bf5b701b5 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:35.137820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22fe19bd-45cd-417e-a1ed-4b9bf5b701b5 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:35.138479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22fe19bd-45cd-417e-a1ed-4b9bf5b701b5 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:35.139548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22fe19bd-45cd-417e-a1ed-4b9bf5b701b5 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:35.140185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22fe19bd-45cd-417e-a1ed-4b9bf5b701b5 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:35.140808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22fe19bd-45cd-417e-a1ed-4b9bf5b701b5 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:35.165965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5c0f6280-2f6c-4c3a-a3ac-5e511e92144c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:35.192011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5c0f6280-2f6c-4c3a-a3ac-5e511e92144c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:35.196386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5c0f6280-2f6c-4c3a-a3ac-5e511e92144c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:35.204903 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5c0f6280-2f6c-4c3a-a3ac-5e511e92144c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.360138 Aug 29 15:31:35.205935 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 828/1659] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:34 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:35.223168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d4dc1bf9-9d40-4f86-b5e4-f544bc250263 req-5942655a-18a9-4eff-b7ba-2db40d0acabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f33bc5f4-a9f5-4613-96d2-a48cf1b729fb", "name": "network-vif-plugged", "status": "completed", "tag": "bd19f4e3-2c35-46bf-832b-06072a8da6d5"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:35.247825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d4dc1bf9-9d40-4f86-b5e4-f544bc250263 req-5942655a-18a9-4eff-b7ba-2db40d0acabf service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:35.248635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d4dc1bf9-9d40-4f86-b5e4-f544bc250263 req-5942655a-18a9-4eff-b7ba-2db40d0acabf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:35.252459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d4dc1bf9-9d40-4f86-b5e4-f544bc250263 req-5942655a-18a9-4eff-b7ba-2db40d0acabf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:35.266757 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d4dc1bf9-9d40-4f86-b5e4-f544bc250263 req-5942655a-18a9-4eff-b7ba-2db40d0acabf service nova] Creating event network-vif-plugged:bd19f4e3-2c35-46bf-832b-06072a8da6d5 for instance f33bc5f4-a9f5-4613-96d2-a48cf1b729fb on n-h2-839401-11 Aug 29 15:31:35.272577 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d4dc1bf9-9d40-4f86-b5e4-f544bc250263 req-5942655a-18a9-4eff-b7ba-2db40d0acabf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057444 Aug 29 15:31:35.273993 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 829/1660] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:35.361116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-22fe19bd-45cd-417e-a1ed-4b9bf5b701b5 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:35.371852 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-22fe19bd-45cd-417e-a1ed-4b9bf5b701b5 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1315 microversion: 2.1 time: 0.267501 Aug 29 15:31:35.372595 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 832/1661] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:35 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:35.567093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-abb7aab6-d411-43a2-a87c-ac1281004455 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:35.567869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-abb7aab6-d411-43a2-a87c-ac1281004455 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:35.574774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abb7aab6-d411-43a2-a87c-ac1281004455 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:35.575262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abb7aab6-d411-43a2-a87c-ac1281004455 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:35.576037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abb7aab6-d411-43a2-a87c-ac1281004455 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:35.576929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abb7aab6-d411-43a2-a87c-ac1281004455 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:35.577625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abb7aab6-d411-43a2-a87c-ac1281004455 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:35.578300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abb7aab6-d411-43a2-a87c-ac1281004455 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:35.667545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=10 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:35.805439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-abb7aab6-d411-43a2-a87c-ac1281004455 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:35.817818 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-abb7aab6-d411-43a2-a87c-ac1281004455 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1471 microversion: 2.1 time: 0.254731 Aug 29 15:31:35.818769 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 830/1662] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:35 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:36.230648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85680c30-c28a-4e55-88df-60dfbb80652c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:36.231907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-85680c30-c28a-4e55-88df-60dfbb80652c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:36.240517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85680c30-c28a-4e55-88df-60dfbb80652c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:36.241271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85680c30-c28a-4e55-88df-60dfbb80652c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:36.241691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85680c30-c28a-4e55-88df-60dfbb80652c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:36.242566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85680c30-c28a-4e55-88df-60dfbb80652c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:36.243186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85680c30-c28a-4e55-88df-60dfbb80652c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:36.243893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85680c30-c28a-4e55-88df-60dfbb80652c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:36.392604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-053056ff-30dd-4bae-b474-a99ceb0b0445 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:36.393763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-053056ff-30dd-4bae-b474-a99ceb0b0445 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:36.401432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-85680c30-c28a-4e55-88df-60dfbb80652c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:36.402377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-053056ff-30dd-4bae-b474-a99ceb0b0445 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:36.403317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-053056ff-30dd-4bae-b474-a99ceb0b0445 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:36.404237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-053056ff-30dd-4bae-b474-a99ceb0b0445 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:36.407534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-053056ff-30dd-4bae-b474-a99ceb0b0445 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:36.408618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-053056ff-30dd-4bae-b474-a99ceb0b0445 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:36.409112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-053056ff-30dd-4bae-b474-a99ceb0b0445 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:36.412427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-85680c30-c28a-4e55-88df-60dfbb80652c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:36.414672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-85680c30-c28a-4e55-88df-60dfbb80652c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:36.415087 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85680c30-c28a-4e55-88df-60dfbb80652c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.190217 Aug 29 15:31:36.416089 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 833/1663] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:36 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:36.562473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-053056ff-30dd-4bae-b474-a99ceb0b0445 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:36.570787 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-053056ff-30dd-4bae-b474-a99ceb0b0445 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1315 microversion: 2.1 time: 0.182857 Aug 29 15:31:36.571559 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 831/1664] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:36 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:36.841862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1146f54a-226b-4804-ae40-10113c34ad1e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:36.842778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1146f54a-226b-4804-ae40-10113c34ad1e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:36.850213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1146f54a-226b-4804-ae40-10113c34ad1e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:36.851053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1146f54a-226b-4804-ae40-10113c34ad1e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:36.851745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1146f54a-226b-4804-ae40-10113c34ad1e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:36.852453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1146f54a-226b-4804-ae40-10113c34ad1e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:36.852908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1146f54a-226b-4804-ae40-10113c34ad1e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:36.853368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1146f54a-226b-4804-ae40-10113c34ad1e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:36.997014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1146f54a-226b-4804-ae40-10113c34ad1e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:37.001108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:37.007396 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1146f54a-226b-4804-ae40-10113c34ad1e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.172529 Aug 29 15:31:37.008169 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 834/1665] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:36 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:37.442229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-612ff609-e208-442b-b763-3c133ff8a789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:37.445272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-612ff609-e208-442b-b763-3c133ff8a789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:37.455818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-612ff609-e208-442b-b763-3c133ff8a789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:37.456847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-612ff609-e208-442b-b763-3c133ff8a789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:37.457609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-612ff609-e208-442b-b763-3c133ff8a789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:37.458426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-612ff609-e208-442b-b763-3c133ff8a789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:37.458985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-612ff609-e208-442b-b763-3c133ff8a789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:37.460187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-612ff609-e208-442b-b763-3c133ff8a789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:37.602297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d733c133-68fc-48d4-9b03-5a3bf2182546 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:37.602297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d733c133-68fc-48d4-9b03-5a3bf2182546 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:37.608787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d733c133-68fc-48d4-9b03-5a3bf2182546 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:37.609366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d733c133-68fc-48d4-9b03-5a3bf2182546 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:37.609781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d733c133-68fc-48d4-9b03-5a3bf2182546 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:37.610509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d733c133-68fc-48d4-9b03-5a3bf2182546 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:37.610986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d733c133-68fc-48d4-9b03-5a3bf2182546 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:37.611466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d733c133-68fc-48d4-9b03-5a3bf2182546 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:37.657527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-612ff609-e208-442b-b763-3c133ff8a789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:37.669134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-612ff609-e208-442b-b763-3c133ff8a789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:37.670171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-612ff609-e208-442b-b763-3c133ff8a789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:37.671462 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-612ff609-e208-442b-b763-3c133ff8a789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.236619 Aug 29 15:31:37.672480 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 832/1666] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:37 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:37.677876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f00a2b12-e984-4162-bf5f-78a10904b24d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:37.680213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f00a2b12-e984-4162-bf5f-78a10904b24d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:37.703677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f00a2b12-e984-4162-bf5f-78a10904b24d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:37.704631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f00a2b12-e984-4162-bf5f-78a10904b24d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:37.705748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f00a2b12-e984-4162-bf5f-78a10904b24d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:37.707132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f00a2b12-e984-4162-bf5f-78a10904b24d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:37.707763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f00a2b12-e984-4162-bf5f-78a10904b24d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:37.708607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f00a2b12-e984-4162-bf5f-78a10904b24d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:37.752697 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f00a2b12-e984-4162-bf5f-78a10904b24d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078691 Aug 29 15:31:37.753838 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 833/1667] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:31:37 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:31:37.810614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d733c133-68fc-48d4-9b03-5a3bf2182546 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:37.819479 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d733c133-68fc-48d4-9b03-5a3bf2182546 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1315 microversion: 2.1 time: 0.231775 Aug 29 15:31:37.821276 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 835/1668] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:37 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:37.940471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-35a7d145-a2cd-4c86-be93-3318ccd59cec tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:37.942728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-35a7d145-a2cd-4c86-be93-3318ccd59cec tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:37.948989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35a7d145-a2cd-4c86-be93-3318ccd59cec tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:37.949556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35a7d145-a2cd-4c86-be93-3318ccd59cec tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:37.949986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35a7d145-a2cd-4c86-be93-3318ccd59cec tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:37.950730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35a7d145-a2cd-4c86-be93-3318ccd59cec tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:37.951187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35a7d145-a2cd-4c86-be93-3318ccd59cec tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:37.951618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35a7d145-a2cd-4c86-be93-3318ccd59cec tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:37.968701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:37.989120 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-35a7d145-a2cd-4c86-be93-3318ccd59cec tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052948 Aug 29 15:31:37.989912 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 834/1669] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:31:37 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:31:38.029728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ed26b47-5bb9-411d-b514-49453976c430 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:38.031238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ed26b47-5bb9-411d-b514-49453976c430 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:38.039019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ed26b47-5bb9-411d-b514-49453976c430 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.039745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ed26b47-5bb9-411d-b514-49453976c430 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.040420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ed26b47-5bb9-411d-b514-49453976c430 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.041357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ed26b47-5bb9-411d-b514-49453976c430 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.042062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ed26b47-5bb9-411d-b514-49453976c430 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.042777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ed26b47-5bb9-411d-b514-49453976c430 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.068802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-66e957b6-707c-4a41-9cf1-b8f2adcc8537 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:38.071887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-66e957b6-707c-4a41-9cf1-b8f2adcc8537 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:38.081961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66e957b6-707c-4a41-9cf1-b8f2adcc8537 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.082713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66e957b6-707c-4a41-9cf1-b8f2adcc8537 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.083469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66e957b6-707c-4a41-9cf1-b8f2adcc8537 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.084909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66e957b6-707c-4a41-9cf1-b8f2adcc8537 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.085544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66e957b6-707c-4a41-9cf1-b8f2adcc8537 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.086125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66e957b6-707c-4a41-9cf1-b8f2adcc8537 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.148540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-66e957b6-707c-4a41-9cf1-b8f2adcc8537 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:31:38.222078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5ed26b47-5bb9-411d-b514-49453976c430 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:38.231954 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ed26b47-5bb9-411d-b514-49453976c430 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.205725 Aug 29 15:31:38.233191 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 836/1670] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:38 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:38.238354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ad8e6840-cda4-4846-94c9-452b7d7c1421 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:38.245857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ad8e6840-cda4-4846-94c9-452b7d7c1421 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:38.262651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ad8e6840-cda4-4846-94c9-452b7d7c1421 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Searching by: {'deleted': False, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:31:38.272740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad8e6840-cda4-4846-94c9-452b7d7c1421 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.273284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad8e6840-cda4-4846-94c9-452b7d7c1421 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.273446 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-66e957b6-707c-4a41-9cf1-b8f2adcc8537 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "DELETE /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 204 len: 0 microversion: 2.1 time: 0.208366 Aug 29 15:31:38.273906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad8e6840-cda4-4846-94c9-452b7d7c1421 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.274689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad8e6840-cda4-4846-94c9-452b7d7c1421 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.275306 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 835/1671] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:31:38 2022] DELETE /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:31:38.275877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad8e6840-cda4-4846-94c9-452b7d7c1421 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.276526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad8e6840-cda4-4846-94c9-452b7d7c1421 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.284197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5196c146-e079-4392-8d3d-f1c4a8aac1ca tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:38.285198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5196c146-e079-4392-8d3d-f1c4a8aac1ca tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:38.292692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5196c146-e079-4392-8d3d-f1c4a8aac1ca tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.295065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5196c146-e079-4392-8d3d-f1c4a8aac1ca tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.295065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5196c146-e079-4392-8d3d-f1c4a8aac1ca tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.295065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5196c146-e079-4392-8d3d-f1c4a8aac1ca tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.295065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5196c146-e079-4392-8d3d-f1c4a8aac1ca tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.295538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5196c146-e079-4392-8d3d-f1c4a8aac1ca tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.311842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-ad8e6840-cda4-4846-94c9-452b7d7c1421 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:31:38.356656 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ad8e6840-cda4-4846-94c9-452b7d7c1421 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.121829 Aug 29 15:31:38.361451 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 837/1672] 10.222.0.62 () {58 vars in 1125 bytes} [Mon Aug 29 15:31:38 2022] GET /compute/v2.1/servers => generated 334 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:38.370524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-51a7ba41-2af9-480b-83e3-e1b518faaf7e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:38.375510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-51a7ba41-2af9-480b-83e3-e1b518faaf7e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:38.376472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-51a7ba41-2af9-480b-83e3-e1b518faaf7e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Searching by: {'deleted': False, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:31:38.382432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51a7ba41-2af9-480b-83e3-e1b518faaf7e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.382900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51a7ba41-2af9-480b-83e3-e1b518faaf7e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.383484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51a7ba41-2af9-480b-83e3-e1b518faaf7e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.384204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51a7ba41-2af9-480b-83e3-e1b518faaf7e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.384920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51a7ba41-2af9-480b-83e3-e1b518faaf7e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.385682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51a7ba41-2af9-480b-83e3-e1b518faaf7e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.496037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-51a7ba41-2af9-480b-83e3-e1b518faaf7e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:31:38.530895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5196c146-e079-4392-8d3d-f1c4a8aac1ca tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:38.555313 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5196c146-e079-4392-8d3d-f1c4a8aac1ca tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1681 microversion: 2.1 time: 0.275607 Aug 29 15:31:38.570943 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 836/1673] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:38 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1681 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:38.597822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-51a7ba41-2af9-480b-83e3-e1b518faaf7e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:38.606654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51a7ba41-2af9-480b-83e3-e1b518faaf7e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.607277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51a7ba41-2af9-480b-83e3-e1b518faaf7e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.607503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51a7ba41-2af9-480b-83e3-e1b518faaf7e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.697971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-17d0a6f6-fa84-44cf-bd3a-f530465f51a1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:38.698357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-17d0a6f6-fa84-44cf-bd3a-f530465f51a1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:38.708555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17d0a6f6-fa84-44cf-bd3a-f530465f51a1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.709048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17d0a6f6-fa84-44cf-bd3a-f530465f51a1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.709505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17d0a6f6-fa84-44cf-bd3a-f530465f51a1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.710212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17d0a6f6-fa84-44cf-bd3a-f530465f51a1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.710661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17d0a6f6-fa84-44cf-bd3a-f530465f51a1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.711078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17d0a6f6-fa84-44cf-bd3a-f530465f51a1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.866544 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-51a7ba41-2af9-480b-83e3-e1b518faaf7e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.500268 Aug 29 15:31:38.868180 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 838/1674] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:31:38 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:38.873520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-33eedd7c-1b51-4d00-aee0-e72a08bc8a43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:38.874206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-33eedd7c-1b51-4d00-aee0-e72a08bc8a43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:38.882639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33eedd7c-1b51-4d00-aee0-e72a08bc8a43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.883199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33eedd7c-1b51-4d00-aee0-e72a08bc8a43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.883867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33eedd7c-1b51-4d00-aee0-e72a08bc8a43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.884831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33eedd7c-1b51-4d00-aee0-e72a08bc8a43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:38.885633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33eedd7c-1b51-4d00-aee0-e72a08bc8a43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:38.887758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33eedd7c-1b51-4d00-aee0-e72a08bc8a43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:38.946871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-33eedd7c-1b51-4d00-aee0-e72a08bc8a43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:31:39.060304 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-33eedd7c-1b51-4d00-aee0-e72a08bc8a43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "DELETE /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 204 len: 0 microversion: 2.1 time: 0.190621 Aug 29 15:31:39.062990 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 839/1675] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:31:38 2022] DELETE /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:31:39.065008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-17d0a6f6-fa84-44cf-bd3a-f530465f51a1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:39.071452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-16ed5243-ade1-47ec-9539-897d54296484 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:39.072150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-16ed5243-ade1-47ec-9539-897d54296484 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:39.076904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-17d0a6f6-fa84-44cf-bd3a-f530465f51a1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:39.079882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ed5243-ade1-47ec-9539-897d54296484 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.080477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ed5243-ade1-47ec-9539-897d54296484 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.080897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ed5243-ade1-47ec-9539-897d54296484 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.081628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ed5243-ade1-47ec-9539-897d54296484 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.081759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-17d0a6f6-fa84-44cf-bd3a-f530465f51a1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:39.082075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ed5243-ade1-47ec-9539-897d54296484 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.082492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ed5243-ade1-47ec-9539-897d54296484 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.085216 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-17d0a6f6-fa84-44cf-bd3a-f530465f51a1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.391940 Aug 29 15:31:39.085937 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 837/1676] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:38 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:31:39.093559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4c3d4f22-a50b-4927-8bb7-3e968f178a1b tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:39.103359 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4c3d4f22-a50b-4927-8bb7-3e968f178a1b tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015367 Aug 29 15:31:39.111781 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 838/1677] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:31:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:39.118391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e575fa04-3038-4f59-87d7-e0ba6740878c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:39.118391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e575fa04-3038-4f59-87d7-e0ba6740878c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:39.125255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e575fa04-3038-4f59-87d7-e0ba6740878c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.125796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e575fa04-3038-4f59-87d7-e0ba6740878c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.126243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e575fa04-3038-4f59-87d7-e0ba6740878c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.127637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e575fa04-3038-4f59-87d7-e0ba6740878c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.128105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e575fa04-3038-4f59-87d7-e0ba6740878c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.128538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e575fa04-3038-4f59-87d7-e0ba6740878c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.286586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-16ed5243-ade1-47ec-9539-897d54296484 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:39.304179 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-16ed5243-ade1-47ec-9539-897d54296484 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1503 microversion: 2.1 time: 0.237114 Aug 29 15:31:39.307674 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 840/1678] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:39 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:39.314747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a823da3-0716-49b9-801a-ac8a06e3b324 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:39.315547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9a823da3-0716-49b9-801a-ac8a06e3b324 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:39.323306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a823da3-0716-49b9-801a-ac8a06e3b324 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.323944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a823da3-0716-49b9-801a-ac8a06e3b324 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.324806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a823da3-0716-49b9-801a-ac8a06e3b324 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.325649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a823da3-0716-49b9-801a-ac8a06e3b324 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.327263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a823da3-0716-49b9-801a-ac8a06e3b324 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.327410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a823da3-0716-49b9-801a-ac8a06e3b324 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.445114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e575fa04-3038-4f59-87d7-e0ba6740878c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:39.463158 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e575fa04-3038-4f59-87d7-e0ba6740878c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1553 microversion: 2.1 time: 0.349615 Aug 29 15:31:39.476883 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 839/1679] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:39 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1553 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:39.482151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-fe21a9f3-d263-4b8c-bb47-1d5601195bb0 req-1fe25fe1-bdc4-44c2-bef4-47f1e1c3d9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982d1df4-7b96-4fbf-8ec2-61752962955d", "name": "network-vif-unplugged", "status": "completed", "tag": "d8c016af-2dfc-466a-9191-b6fedaf0ee01"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:39.491851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fe21a9f3-d263-4b8c-bb47-1d5601195bb0 req-1fe25fe1-bdc4-44c2-bef4-47f1e1c3d9b0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.492623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fe21a9f3-d263-4b8c-bb47-1d5601195bb0 req-1fe25fe1-bdc4-44c2-bef4-47f1e1c3d9b0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.493351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fe21a9f3-d263-4b8c-bb47-1d5601195bb0 req-1fe25fe1-bdc4-44c2-bef4-47f1e1c3d9b0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.507590 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-fe21a9f3-d263-4b8c-bb47-1d5601195bb0 req-1fe25fe1-bdc4-44c2-bef4-47f1e1c3d9b0 service nova] Creating event network-vif-unplugged:d8c016af-2dfc-466a-9191-b6fedaf0ee01 for instance 982d1df4-7b96-4fbf-8ec2-61752962955d on n-h1-839401-11 Aug 29 15:31:39.512911 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-fe21a9f3-d263-4b8c-bb47-1d5601195bb0 req-1fe25fe1-bdc4-44c2-bef4-47f1e1c3d9b0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034445 Aug 29 15:31:39.514064 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 840/1680] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:39.519417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9a823da3-0716-49b9-801a-ac8a06e3b324 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:39.520603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9b897687-85cd-4568-a2c2-4cfd71a21e5b tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:39.521572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9b897687-85cd-4568-a2c2-4cfd71a21e5b tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:39.528684 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a823da3-0716-49b9-801a-ac8a06e3b324 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.219646 Aug 29 15:31:39.531098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b897687-85cd-4568-a2c2-4cfd71a21e5b tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.531739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b897687-85cd-4568-a2c2-4cfd71a21e5b tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.531884 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 841/1681] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:39 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:39.532481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b897687-85cd-4568-a2c2-4cfd71a21e5b tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.533289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b897687-85cd-4568-a2c2-4cfd71a21e5b tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.533931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b897687-85cd-4568-a2c2-4cfd71a21e5b tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.534530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b897687-85cd-4568-a2c2-4cfd71a21e5b tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.537238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7a9b0693-ab1e-4455-bc3e-38371bdd48fc tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:39.537834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7a9b0693-ab1e-4455-bc3e-38371bdd48fc tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:39.544158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a9b0693-ab1e-4455-bc3e-38371bdd48fc tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.544766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a9b0693-ab1e-4455-bc3e-38371bdd48fc tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.545452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a9b0693-ab1e-4455-bc3e-38371bdd48fc tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.546429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a9b0693-ab1e-4455-bc3e-38371bdd48fc tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.546984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a9b0693-ab1e-4455-bc3e-38371bdd48fc tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.547525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a9b0693-ab1e-4455-bc3e-38371bdd48fc tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.577523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9b897687-85cd-4568-a2c2-4cfd71a21e5b tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:39.578533 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9b897687-85cd-4568-a2c2-4cfd71a21e5b tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb/os-instance-actions/req-f959e3d8-ae04-4c52-8f54-63086daf0315" status: 200 len: 313 microversion: 2.1 time: 0.063193 Aug 29 15:31:39.581269 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 841/1682] 10.222.0.62 () {58 vars in 1419 bytes} [Mon Aug 29 15:31:39 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb/os-instance-actions/req-f959e3d8-ae04-4c52-8f54-63086daf0315 => generated 313 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:39.581418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7a9b0693-ab1e-4455-bc3e-38371bdd48fc tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:31:39.591572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5de36d71-bef7-4cc8-be64-90a740c18614 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:39.592217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5de36d71-bef7-4cc8-be64-90a740c18614 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:39.598802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5de36d71-bef7-4cc8-be64-90a740c18614 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.599306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5de36d71-bef7-4cc8-be64-90a740c18614 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.599751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5de36d71-bef7-4cc8-be64-90a740c18614 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.600474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5de36d71-bef7-4cc8-be64-90a740c18614 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.600937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5de36d71-bef7-4cc8-be64-90a740c18614 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.601414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5de36d71-bef7-4cc8-be64-90a740c18614 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.688875 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7a9b0693-ab1e-4455-bc3e-38371bdd48fc tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "DELETE /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 204 len: 0 microversion: 2.1 time: 0.155450 Aug 29 15:31:39.689982 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 842/1683] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:31:39 2022] DELETE /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:31:39.698215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-88c2e49d-d943-470f-b06e-1db105f1c46c tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:39.700954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-88c2e49d-d943-470f-b06e-1db105f1c46c tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:39.708346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88c2e49d-d943-470f-b06e-1db105f1c46c tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.709115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88c2e49d-d943-470f-b06e-1db105f1c46c tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.709566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88c2e49d-d943-470f-b06e-1db105f1c46c tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.710299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88c2e49d-d943-470f-b06e-1db105f1c46c tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.710757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88c2e49d-d943-470f-b06e-1db105f1c46c tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.711455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88c2e49d-d943-470f-b06e-1db105f1c46c tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.799590 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-88c2e49d-d943-470f-b06e-1db105f1c46c tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "POST /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb/action" status: 202 len: 0 microversion: 2.1 time: 0.108180 Aug 29 15:31:39.800778 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 843/1684] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:31:39 2022] POST /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:31:39.806711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d0b5acc6-cd03-4830-b37d-c15fae0329a1 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:39.807555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d0b5acc6-cd03-4830-b37d-c15fae0329a1 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:39.814800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0b5acc6-cd03-4830-b37d-c15fae0329a1 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.815427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0b5acc6-cd03-4830-b37d-c15fae0329a1 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.815976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0b5acc6-cd03-4830-b37d-c15fae0329a1 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:39.816776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0b5acc6-cd03-4830-b37d-c15fae0329a1 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:39.817349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0b5acc6-cd03-4830-b37d-c15fae0329a1 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:39.817847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0b5acc6-cd03-4830-b37d-c15fae0329a1 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:40.061272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d0b5acc6-cd03-4830-b37d-c15fae0329a1 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:40.071062 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d0b5acc6-cd03-4830-b37d-c15fae0329a1 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1702 microversion: 2.1 time: 0.267424 Aug 29 15:31:40.071062 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 844/1685] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:39 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1702 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:40.075848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f879226c-22cd-4e53-9174-3de4b46d0a1d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:40.076803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f879226c-22cd-4e53-9174-3de4b46d0a1d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:40.083672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f879226c-22cd-4e53-9174-3de4b46d0a1d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:40.084284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f879226c-22cd-4e53-9174-3de4b46d0a1d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:40.084806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f879226c-22cd-4e53-9174-3de4b46d0a1d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:40.085823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f879226c-22cd-4e53-9174-3de4b46d0a1d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:40.086423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f879226c-22cd-4e53-9174-3de4b46d0a1d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:40.086943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f879226c-22cd-4e53-9174-3de4b46d0a1d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:40.169388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5de36d71-bef7-4cc8-be64-90a740c18614 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:40.207480 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5de36d71-bef7-4cc8-be64-90a740c18614 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1681 microversion: 2.1 time: 0.626704 Aug 29 15:31:40.209789 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 842/1686] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:39 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1681 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:40.221287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-650bb94e-9dde-406e-8019-31d90dff3ba8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:40.229107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-650bb94e-9dde-406e-8019-31d90dff3ba8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:40.243617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-650bb94e-9dde-406e-8019-31d90dff3ba8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:40.244630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-650bb94e-9dde-406e-8019-31d90dff3ba8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:40.245272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-650bb94e-9dde-406e-8019-31d90dff3ba8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:40.246286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-650bb94e-9dde-406e-8019-31d90dff3ba8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:40.246918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-650bb94e-9dde-406e-8019-31d90dff3ba8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:40.247522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-650bb94e-9dde-406e-8019-31d90dff3ba8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:40.257560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f879226c-22cd-4e53-9174-3de4b46d0a1d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:40.268338 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f879226c-22cd-4e53-9174-3de4b46d0a1d tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1505 microversion: 2.1 time: 0.196944 Aug 29 15:31:40.269519 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 845/1687] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:40 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1505 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:40.438205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-650bb94e-9dde-406e-8019-31d90dff3ba8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:40.447974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-650bb94e-9dde-406e-8019-31d90dff3ba8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:40.449464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-650bb94e-9dde-406e-8019-31d90dff3ba8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:40.450641 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-650bb94e-9dde-406e-8019-31d90dff3ba8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.238675 Aug 29 15:31:40.451400 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 843/1688] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:40 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:40.483976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4a810f39-7157-4020-b7fb-652cb8599beb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:40.484518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4a810f39-7157-4020-b7fb-652cb8599beb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:40.492339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a810f39-7157-4020-b7fb-652cb8599beb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:40.492831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a810f39-7157-4020-b7fb-652cb8599beb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:40.493312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a810f39-7157-4020-b7fb-652cb8599beb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:40.494023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a810f39-7157-4020-b7fb-652cb8599beb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:40.494484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a810f39-7157-4020-b7fb-652cb8599beb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:40.494906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a810f39-7157-4020-b7fb-652cb8599beb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:40.500904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:40.553065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-90414385-7946-4e4f-9560-5b614d3f584d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:40.554313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-90414385-7946-4e4f-9560-5b614d3f584d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:40.584643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90414385-7946-4e4f-9560-5b614d3f584d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:40.586716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90414385-7946-4e4f-9560-5b614d3f584d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:40.596277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90414385-7946-4e4f-9560-5b614d3f584d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:40.597372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90414385-7946-4e4f-9560-5b614d3f584d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:40.598584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90414385-7946-4e4f-9560-5b614d3f584d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:40.599499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90414385-7946-4e4f-9560-5b614d3f584d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:40.763721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4a810f39-7157-4020-b7fb-652cb8599beb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:40.778341 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4a810f39-7157-4020-b7fb-652cb8599beb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1553 microversion: 2.1 time: 0.298307 Aug 29 15:31:40.779624 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 846/1689] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:40 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1553 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:40.911321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-90414385-7946-4e4f-9560-5b614d3f584d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:40.922895 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-90414385-7946-4e4f-9560-5b614d3f584d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.374878 Aug 29 15:31:40.923908 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 844/1690] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:40 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:41.092185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0ddb60e2-f38e-432e-9ec6-3ba0b5d78b55 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:41.092880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0ddb60e2-f38e-432e-9ec6-3ba0b5d78b55 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:41.100702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ddb60e2-f38e-432e-9ec6-3ba0b5d78b55 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.101234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ddb60e2-f38e-432e-9ec6-3ba0b5d78b55 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.101698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ddb60e2-f38e-432e-9ec6-3ba0b5d78b55 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.102453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ddb60e2-f38e-432e-9ec6-3ba0b5d78b55 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.102903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ddb60e2-f38e-432e-9ec6-3ba0b5d78b55 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.103325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ddb60e2-f38e-432e-9ec6-3ba0b5d78b55 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.234463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d4ae6e99-8cb9-4c56-a820-45b7e3bc826d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:41.235598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d4ae6e99-8cb9-4c56-a820-45b7e3bc826d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:41.242445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4ae6e99-8cb9-4c56-a820-45b7e3bc826d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.243287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4ae6e99-8cb9-4c56-a820-45b7e3bc826d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.243917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4ae6e99-8cb9-4c56-a820-45b7e3bc826d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.245739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4ae6e99-8cb9-4c56-a820-45b7e3bc826d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.245889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0ddb60e2-f38e-432e-9ec6-3ba0b5d78b55 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:41.246582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4ae6e99-8cb9-4c56-a820-45b7e3bc826d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.247624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4ae6e99-8cb9-4c56-a820-45b7e3bc826d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.256845 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0ddb60e2-f38e-432e-9ec6-3ba0b5d78b55 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1702 microversion: 2.1 time: 0.168720 Aug 29 15:31:41.258249 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 847/1691] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:41 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1702 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:41.291995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-977ef5af-f75d-40d2-ae96-769b682d57db tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:41.292762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-977ef5af-f75d-40d2-ae96-769b682d57db tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:41.299457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-977ef5af-f75d-40d2-ae96-769b682d57db tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.300036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-977ef5af-f75d-40d2-ae96-769b682d57db tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.300468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-977ef5af-f75d-40d2-ae96-769b682d57db tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.301201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-977ef5af-f75d-40d2-ae96-769b682d57db tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.301657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-977ef5af-f75d-40d2-ae96-769b682d57db tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.302086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-977ef5af-f75d-40d2-ae96-769b682d57db tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.462481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-977ef5af-f75d-40d2-ae96-769b682d57db tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:41.473463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d4ae6e99-8cb9-4c56-a820-45b7e3bc826d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:41.482412 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d4ae6e99-8cb9-4c56-a820-45b7e3bc826d tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1681 microversion: 2.1 time: 0.252075 Aug 29 15:31:41.485469 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-977ef5af-f75d-40d2-ae96-769b682d57db tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1505 microversion: 2.1 time: 0.197333 Aug 29 15:31:41.486347 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 845/1692] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:41 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1681 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:41.493135 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 848/1693] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:41 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1505 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:41.493345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f160c12c-b847-4ea1-aff1-f0d53597c915 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:41.493345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f160c12c-b847-4ea1-aff1-f0d53597c915 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:41.500383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f160c12c-b847-4ea1-aff1-f0d53597c915 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.500954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f160c12c-b847-4ea1-aff1-f0d53597c915 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.501608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f160c12c-b847-4ea1-aff1-f0d53597c915 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.502322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f160c12c-b847-4ea1-aff1-f0d53597c915 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.502866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f160c12c-b847-4ea1-aff1-f0d53597c915 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.503352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f160c12c-b847-4ea1-aff1-f0d53597c915 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.531996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-f762d4ce-6ac2-4dec-aad8-5086685ba33b req-9bc7178e-2287-455c-9edb-d1184d8afd9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982d1df4-7b96-4fbf-8ec2-61752962955d", "tag": "d8c016af-2dfc-466a-9191-b6fedaf0ee01"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:41.550868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f762d4ce-6ac2-4dec-aad8-5086685ba33b req-9bc7178e-2287-455c-9edb-d1184d8afd9d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.551471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f762d4ce-6ac2-4dec-aad8-5086685ba33b req-9bc7178e-2287-455c-9edb-d1184d8afd9d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.551975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f762d4ce-6ac2-4dec-aad8-5086685ba33b req-9bc7178e-2287-455c-9edb-d1184d8afd9d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.571022 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-f762d4ce-6ac2-4dec-aad8-5086685ba33b req-9bc7178e-2287-455c-9edb-d1184d8afd9d service nova] Creating event network-changed:d8c016af-2dfc-466a-9191-b6fedaf0ee01 for instance 982d1df4-7b96-4fbf-8ec2-61752962955d on n-h1-839401-11 Aug 29 15:31:41.577074 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-f762d4ce-6ac2-4dec-aad8-5086685ba33b req-9bc7178e-2287-455c-9edb-d1184d8afd9d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049340 Aug 29 15:31:41.578018 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 849/1694] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:31:41.806427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24334606-a23c-4a43-a3fe-106979beecad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:41.807243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-24334606-a23c-4a43-a3fe-106979beecad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:41.817217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24334606-a23c-4a43-a3fe-106979beecad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.818629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24334606-a23c-4a43-a3fe-106979beecad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.820363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24334606-a23c-4a43-a3fe-106979beecad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.822210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24334606-a23c-4a43-a3fe-106979beecad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.823484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24334606-a23c-4a43-a3fe-106979beecad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.824261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24334606-a23c-4a43-a3fe-106979beecad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.883212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f160c12c-b847-4ea1-aff1-f0d53597c915 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:41.913916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f160c12c-b847-4ea1-aff1-f0d53597c915 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:41.919464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f160c12c-b847-4ea1-aff1-f0d53597c915 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:41.926643 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f160c12c-b847-4ea1-aff1-f0d53597c915 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.439044 Aug 29 15:31:41.938610 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 846/1695] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:41 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:41.954922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3b39dbb5-9fc7-4f8a-b59a-70322fe98654 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:41.955679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3b39dbb5-9fc7-4f8a-b59a-70322fe98654 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:41.963552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b39dbb5-9fc7-4f8a-b59a-70322fe98654 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.965003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b39dbb5-9fc7-4f8a-b59a-70322fe98654 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.965742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b39dbb5-9fc7-4f8a-b59a-70322fe98654 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:41.966500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b39dbb5-9fc7-4f8a-b59a-70322fe98654 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:41.967142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b39dbb5-9fc7-4f8a-b59a-70322fe98654 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:41.967732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b39dbb5-9fc7-4f8a-b59a-70322fe98654 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:42.370438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3b39dbb5-9fc7-4f8a-b59a-70322fe98654 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:42.388000 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3b39dbb5-9fc7-4f8a-b59a-70322fe98654 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.445517 Aug 29 15:31:42.391169 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 847/1696] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:41 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:42.397195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a7e6098c-1a4e-452c-929d-a0e0b5ea3483 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:42.398189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a7e6098c-1a4e-452c-929d-a0e0b5ea3483 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:42.415108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7e6098c-1a4e-452c-929d-a0e0b5ea3483 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:42.416449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7e6098c-1a4e-452c-929d-a0e0b5ea3483 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:42.417381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7e6098c-1a4e-452c-929d-a0e0b5ea3483 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:42.418244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7e6098c-1a4e-452c-929d-a0e0b5ea3483 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:42.419072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7e6098c-1a4e-452c-929d-a0e0b5ea3483 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:42.419642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7e6098c-1a4e-452c-929d-a0e0b5ea3483 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:42.438933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-24334606-a23c-4a43-a3fe-106979beecad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:42.451309 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-24334606-a23c-4a43-a3fe-106979beecad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1553 microversion: 2.1 time: 0.654900 Aug 29 15:31:42.452484 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 850/1697] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:41 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1553 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:42.511549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-39ec769a-0e53-47f9-95a0-cb0075e86604 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:42.512516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-39ec769a-0e53-47f9-95a0-cb0075e86604 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:42.518840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39ec769a-0e53-47f9-95a0-cb0075e86604 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:42.519630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39ec769a-0e53-47f9-95a0-cb0075e86604 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:42.520428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39ec769a-0e53-47f9-95a0-cb0075e86604 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:42.521175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39ec769a-0e53-47f9-95a0-cb0075e86604 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:42.521277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39ec769a-0e53-47f9-95a0-cb0075e86604 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:42.521656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39ec769a-0e53-47f9-95a0-cb0075e86604 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:42.844429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a7e6098c-1a4e-452c-929d-a0e0b5ea3483 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:42.856910 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a7e6098c-1a4e-452c-929d-a0e0b5ea3483 tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1702 microversion: 2.1 time: 0.463052 Aug 29 15:31:42.862238 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 848/1698] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:42 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1702 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:42.879300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3ab09062-4e99-4a9f-9e07-2ac425c009d6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:42.880814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3ab09062-4e99-4a9f-9e07-2ac425c009d6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:42.889277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ab09062-4e99-4a9f-9e07-2ac425c009d6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:42.890584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ab09062-4e99-4a9f-9e07-2ac425c009d6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:42.891075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ab09062-4e99-4a9f-9e07-2ac425c009d6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:42.891994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ab09062-4e99-4a9f-9e07-2ac425c009d6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:42.892889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ab09062-4e99-4a9f-9e07-2ac425c009d6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:42.893564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ab09062-4e99-4a9f-9e07-2ac425c009d6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.051356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-39ec769a-0e53-47f9-95a0-cb0075e86604 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:43.064481 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-39ec769a-0e53-47f9-95a0-cb0075e86604 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1681 microversion: 2.1 time: 0.554817 Aug 29 15:31:43.068223 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 851/1699] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:42 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1681 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:43.078539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6498c8ca-d5ca-48a5-ad44-aeba776045ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:43.080005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6498c8ca-d5ca-48a5-ad44-aeba776045ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:43.119207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6498c8ca-d5ca-48a5-ad44-aeba776045ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.119761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6498c8ca-d5ca-48a5-ad44-aeba776045ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.120210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6498c8ca-d5ca-48a5-ad44-aeba776045ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.120945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6498c8ca-d5ca-48a5-ad44-aeba776045ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.121430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6498c8ca-d5ca-48a5-ad44-aeba776045ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.121859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6498c8ca-d5ca-48a5-ad44-aeba776045ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.160853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3ab09062-4e99-4a9f-9e07-2ac425c009d6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:43.171230 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3ab09062-4e99-4a9f-9e07-2ac425c009d6 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1503 microversion: 2.1 time: 0.307620 Aug 29 15:31:43.172913 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 849/1700] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:42 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:43.197275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b283b93f-a9fb-4ff6-b34f-c32a3213d3ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '.version_select at 0x7fc42b8955e0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:43.197867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b283b93f-a9fb-4ff6-b34f-c32a3213d3ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:43.208900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b283b93f-a9fb-4ff6-b34f-c32a3213d3ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.211332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b283b93f-a9fb-4ff6-b34f-c32a3213d3ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.212086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b283b93f-a9fb-4ff6-b34f-c32a3213d3ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.213061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b283b93f-a9fb-4ff6-b34f-c32a3213d3ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.214611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b283b93f-a9fb-4ff6-b34f-c32a3213d3ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.215256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b283b93f-a9fb-4ff6-b34f-c32a3213d3ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.268574 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b283b93f-a9fb-4ff6-b34f-c32a3213d3ec tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.075753 Aug 29 15:31:43.269813 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 850/1701] 10.222.0.62 () {58 vars in 1296 bytes} [Mon Aug 29 15:31:43 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb/os-instance-actions => generated 611 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:31:43.295819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0d424422-8604-4ec2-9d36-b31fc279b298 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:43.296628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0d424422-8604-4ec2-9d36-b31fc279b298 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:43.315371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d424422-8604-4ec2-9d36-b31fc279b298 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.315932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d424422-8604-4ec2-9d36-b31fc279b298 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.316427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d424422-8604-4ec2-9d36-b31fc279b298 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.317284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d424422-8604-4ec2-9d36-b31fc279b298 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.317754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d424422-8604-4ec2-9d36-b31fc279b298 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.318272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d424422-8604-4ec2-9d36-b31fc279b298 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.326800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:43.366532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0d424422-8604-4ec2-9d36-b31fc279b298 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:31:43.503377 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0d424422-8604-4ec2-9d36-b31fc279b298 tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 204 len: 0 microversion: 2.1 time: 0.224715 Aug 29 15:31:43.504266 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 851/1702] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:31:43 2022] DELETE /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:31:43.517944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-205a19ec-6cd5-49c8-acf4-14310ac31640 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:43.518687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-205a19ec-6cd5-49c8-acf4-14310ac31640 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:43.542359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-205a19ec-6cd5-49c8-acf4-14310ac31640 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.543074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-205a19ec-6cd5-49c8-acf4-14310ac31640 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.543522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-205a19ec-6cd5-49c8-acf4-14310ac31640 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.544347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-205a19ec-6cd5-49c8-acf4-14310ac31640 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.545331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-205a19ec-6cd5-49c8-acf4-14310ac31640 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.545797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-205a19ec-6cd5-49c8-acf4-14310ac31640 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.840349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-205a19ec-6cd5-49c8-acf4-14310ac31640 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:43.851532 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-205a19ec-6cd5-49c8-acf4-14310ac31640 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.343248 Aug 29 15:31:43.869110 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 852/1703] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:43 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:43.869110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8e5b2b2b-fcee-4786-877c-d0e9b03451bf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:43.869110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8e5b2b2b-fcee-4786-877c-d0e9b03451bf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:43.890425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5b2b2b-fcee-4786-877c-d0e9b03451bf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.891189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5b2b2b-fcee-4786-877c-d0e9b03451bf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.891473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5b2b2b-fcee-4786-877c-d0e9b03451bf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:43.892168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5b2b2b-fcee-4786-877c-d0e9b03451bf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:43.892692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5b2b2b-fcee-4786-877c-d0e9b03451bf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:43.893137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5b2b2b-fcee-4786-877c-d0e9b03451bf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:44.007734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6498c8ca-d5ca-48a5-ad44-aeba776045ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:44.028480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8e5b2b2b-fcee-4786-877c-d0e9b03451bf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:44.051393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6498c8ca-d5ca-48a5-ad44-aeba776045ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:44.054094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6498c8ca-d5ca-48a5-ad44-aeba776045ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:44.055037 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8e5b2b2b-fcee-4786-877c-d0e9b03451bf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1345 microversion: 2.1 time: 0.196380 Aug 29 15:31:44.055646 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 853/1704] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:43 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1345 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:44.061979 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6498c8ca-d5ca-48a5-ad44-aeba776045ac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.987118 Aug 29 15:31:44.068636 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 852/1705] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:43 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:44.074398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c01db735-997a-454f-9adf-f91e0d654bda tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:44.075015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c01db735-997a-454f-9adf-f91e0d654bda tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:44.079376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:44.087473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01db735-997a-454f-9adf-f91e0d654bda tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:44.087973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01db735-997a-454f-9adf-f91e0d654bda tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:44.092540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-1b657147-c0b1-4364-966b-e7b85b9a9c68 req-891f539c-c2cd-4285-96a4-cbc8e33a977e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16758bc6-5ab1-42fc-8f6f-fe955bf6f83c", "name": "network-vif-deleted", "tag": "5de881b9-0307-4808-a213-0975ed993a7b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:44.094482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01db735-997a-454f-9adf-f91e0d654bda tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:44.095270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01db735-997a-454f-9adf-f91e0d654bda tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:44.095905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01db735-997a-454f-9adf-f91e0d654bda tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:44.097771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01db735-997a-454f-9adf-f91e0d654bda tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:44.128647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1b657147-c0b1-4364-966b-e7b85b9a9c68 req-891f539c-c2cd-4285-96a4-cbc8e33a977e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:44.130669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1b657147-c0b1-4364-966b-e7b85b9a9c68 req-891f539c-c2cd-4285-96a4-cbc8e33a977e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:44.133354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1b657147-c0b1-4364-966b-e7b85b9a9c68 req-891f539c-c2cd-4285-96a4-cbc8e33a977e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:44.157968 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-1b657147-c0b1-4364-966b-e7b85b9a9c68 req-891f539c-c2cd-4285-96a4-cbc8e33a977e service nova] Creating event network-vif-deleted:5de881b9-0307-4808-a213-0975ed993a7b for instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c on n-h2-839401-11 Aug 29 15:31:44.164215 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-1b657147-c0b1-4364-966b-e7b85b9a9c68 req-891f539c-c2cd-4285-96a4-cbc8e33a977e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093550 Aug 29 15:31:44.165143 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 853/1706] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:44.184308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-08dd3767-d441-49fc-92d8-8de0720a532c tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:44.185880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-08dd3767-d441-49fc-92d8-8de0720a532c tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:44.198834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08dd3767-d441-49fc-92d8-8de0720a532c tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:44.199246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08dd3767-d441-49fc-92d8-8de0720a532c tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:44.201278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08dd3767-d441-49fc-92d8-8de0720a532c tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:44.202192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08dd3767-d441-49fc-92d8-8de0720a532c tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:44.202671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08dd3767-d441-49fc-92d8-8de0720a532c tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:44.218092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08dd3767-d441-49fc-92d8-8de0720a532c tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:44.340965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08dd3767-d441-49fc-92d8-8de0720a532c tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:44.341489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08dd3767-d441-49fc-92d8-8de0720a532c tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:44.342022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08dd3767-d441-49fc-92d8-8de0720a532c tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:44.342372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-08dd3767-d441-49fc-92d8-8de0720a532c tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lazy-loading 'fault' on Instance uuid 312f21b0-5005-4a49-891e-6a09bb993fc6 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:44.440627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-08dd3767-d441-49fc-92d8-8de0720a532c tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6197c2073645fc91ae65d4d42c18ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a18044ba17142cf9c1cfeb4720e76db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:44.454665 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-08dd3767-d441-49fc-92d8-8de0720a532c tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 200 len: 1360 microversion: 2.1 time: 0.288101 Aug 29 15:31:44.457313 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 854/1707] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:44 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 1360 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:44.462839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c44cf821-26e0-4fca-9141-9405e2114ecb tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:44.463836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c44cf821-26e0-4fca-9141-9405e2114ecb tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:44.472679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c44cf821-26e0-4fca-9141-9405e2114ecb tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:44.473464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c44cf821-26e0-4fca-9141-9405e2114ecb tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:44.474283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c44cf821-26e0-4fca-9141-9405e2114ecb tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:44.475131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c44cf821-26e0-4fca-9141-9405e2114ecb tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:44.475724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c44cf821-26e0-4fca-9141-9405e2114ecb tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:44.476298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c44cf821-26e0-4fca-9141-9405e2114ecb tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:44.496573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c01db735-997a-454f-9adf-f91e0d654bda tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:44.505389 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c01db735-997a-454f-9adf-f91e0d654bda tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1509 microversion: 2.1 time: 0.438460 Aug 29 15:31:44.513478 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 854/1708] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:44 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1509 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:44.568109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c44cf821-26e0-4fca-9141-9405e2114ecb tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:44.579817 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c44cf821-26e0-4fca-9141-9405e2114ecb tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1614 microversion: 2.1 time: 0.120880 Aug 29 15:31:44.582031 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 855/1709] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:44 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1614 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:44.890097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1482c755-ea63-4453-82cf-0c27861ce911 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:44.891026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1482c755-ea63-4453-82cf-0c27861ce911 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:44.918203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1482c755-ea63-4453-82cf-0c27861ce911 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:44.918856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1482c755-ea63-4453-82cf-0c27861ce911 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:44.919382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1482c755-ea63-4453-82cf-0c27861ce911 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:44.921830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1482c755-ea63-4453-82cf-0c27861ce911 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:44.922407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1482c755-ea63-4453-82cf-0c27861ce911 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:44.927170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1482c755-ea63-4453-82cf-0c27861ce911 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.086096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f93ebb32-1101-407b-bf3c-eb6ef507186c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:45.087893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f93ebb32-1101-407b-bf3c-eb6ef507186c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:45.109860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f93ebb32-1101-407b-bf3c-eb6ef507186c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.121936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f93ebb32-1101-407b-bf3c-eb6ef507186c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.130329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f93ebb32-1101-407b-bf3c-eb6ef507186c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.133535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f93ebb32-1101-407b-bf3c-eb6ef507186c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.137310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f93ebb32-1101-407b-bf3c-eb6ef507186c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.140557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f93ebb32-1101-407b-bf3c-eb6ef507186c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.273952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f93ebb32-1101-407b-bf3c-eb6ef507186c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:45.296556 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f93ebb32-1101-407b-bf3c-eb6ef507186c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1345 microversion: 2.1 time: 0.219550 Aug 29 15:31:45.311355 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 856/1710] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:45 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1345 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:45.318594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-8b59715b-f514-4add-8d37-b2f7489c47d1 req-dd1f9320-1abf-4fa1-919a-fadbcf415fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32bc300a-b702-4755-b0c2-f0004d7d5016", "name": "network-vif-deleted", "tag": "717cefd6-7122-4105-860c-3001547d3901"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:45.328207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1482c755-ea63-4453-82cf-0c27861ce911 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:45.341196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8b59715b-f514-4add-8d37-b2f7489c47d1 req-dd1f9320-1abf-4fa1-919a-fadbcf415fdf service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.343207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8b59715b-f514-4add-8d37-b2f7489c47d1 req-dd1f9320-1abf-4fa1-919a-fadbcf415fdf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.343357 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1482c755-ea63-4453-82cf-0c27861ce911 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.469293 Aug 29 15:31:45.343971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8b59715b-f514-4add-8d37-b2f7489c47d1 req-dd1f9320-1abf-4fa1-919a-fadbcf415fdf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.363483 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 855/1711] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:44 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:45.366751 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-8b59715b-f514-4add-8d37-b2f7489c47d1 req-dd1f9320-1abf-4fa1-919a-fadbcf415fdf service nova] Creating event network-vif-deleted:717cefd6-7122-4105-860c-3001547d3901 for instance 32bc300a-b702-4755-b0c2-f0004d7d5016 on n-h1-839401-11 Aug 29 15:31:45.370727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2e38c71a-f216-452a-8733-d587e2606ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:45.378536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2e38c71a-f216-452a-8733-d587e2606ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:45.387242 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-8b59715b-f514-4add-8d37-b2f7489c47d1 req-dd1f9320-1abf-4fa1-919a-fadbcf415fdf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074203 Aug 29 15:31:45.390541 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 857/1712] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:45.398977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e38c71a-f216-452a-8733-d587e2606ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.399473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e38c71a-f216-452a-8733-d587e2606ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.399914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e38c71a-f216-452a-8733-d587e2606ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.400626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e38c71a-f216-452a-8733-d587e2606ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.401334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e38c71a-f216-452a-8733-d587e2606ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.401967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e38c71a-f216-452a-8733-d587e2606ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.480090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e37f9969-4e41-49e3-8b92-74efa83bc51e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:45.480982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e37f9969-4e41-49e3-8b92-74efa83bc51e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] [instance: 312f21b0-5005-4a49-891e-6a09bb993fc6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:45.514203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e37f9969-4e41-49e3-8b92-74efa83bc51e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.517589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e37f9969-4e41-49e3-8b92-74efa83bc51e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.519611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e37f9969-4e41-49e3-8b92-74efa83bc51e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.520552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e37f9969-4e41-49e3-8b92-74efa83bc51e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.521016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e37f9969-4e41-49e3-8b92-74efa83bc51e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.521472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e37f9969-4e41-49e3-8b92-74efa83bc51e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.562972 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-e37f9969-4e41-49e3-8b92-74efa83bc51e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] HTTP exception thrown: Instance 312f21b0-5005-4a49-891e-6a09bb993fc6 could not be found. Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e37f9969-4e41-49e3-8b92-74efa83bc51e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Request method failure captured: Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 HTTP/1.1 Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNtni6cqhLgkEMIDJ8Ipndzii8x5LE-oH5PwD-egq2lwLAumCqMw8F_RhJKdcZe0zRWGFFkf5B6kAXK4MQs-B2BAONE2Q-thpSKcS9LQXl5VgtxzwEUoifkZIZETHQglgIkaYQIufvIvvMfnCNY664vJfapFnafGUERz8pgceBy3cv0 Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 1a18044ba17142cf9c1cfeb4720e76db Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestJSON-1339790309 Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a18044ba17142cf9c1cfeb4720e76db", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a18044ba17142cf9c1cfeb4720e76db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a18044ba17142cf9c1cfeb4720e76db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a18044ba17142cf9c1cfeb4720e76db"}]}] Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestJSON-1339790309 Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 1a18044ba17142cf9c1cfeb4720e76db Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestJSON-1339790309 Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestJSON-1339790309-project Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 7c6197c2073645fc91ae65d4d42c18ac Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestJSON-1339790309-project Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 312f21b0-5005-4a49-891e-6a09bb993fc6 could not be found. Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '312f21b0-5005-4a49-891e-6a09bb993fc6'} Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 312f21b0-5005-4a49-891e-6a09bb993fc6 could not be found. Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 312f21b0-5005-4a49-891e-6a09bb993fc6 could not be found. Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:45.564660 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:45.569648 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:45.569648 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:45.569648 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:45.569648 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:45.569648 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:45.569648 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 312f21b0-5005-4a49-891e-6a09bb993fc6 could not be found. Aug 29 15:31:45.569648 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:45.570411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e37f9969-4e41-49e3-8b92-74efa83bc51e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Returning 404 to user: Instance 312f21b0-5005-4a49-891e-6a09bb993fc6 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:45.571294 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e37f9969-4e41-49e3-8b92-74efa83bc51e tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6" status: 404 len: 111 microversion: 2.1 time: 0.095670 Aug 29 15:31:45.572041 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 858/1713] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:45 2022] GET /compute/v2.1/servers/312f21b0-5005-4a49-891e-6a09bb993fc6 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:31:45.600129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f8335f6a-516e-4f94-8f50-1c42f27f26fe tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:45.600640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f8335f6a-516e-4f94-8f50-1c42f27f26fe tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:45.621152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8335f6a-516e-4f94-8f50-1c42f27f26fe tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.621741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8335f6a-516e-4f94-8f50-1c42f27f26fe tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.622197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8335f6a-516e-4f94-8f50-1c42f27f26fe tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.629025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8335f6a-516e-4f94-8f50-1c42f27f26fe tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:45.629534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8335f6a-516e-4f94-8f50-1c42f27f26fe tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:45.629983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8335f6a-516e-4f94-8f50-1c42f27f26fe tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:45.816227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2e38c71a-f216-452a-8733-d587e2606ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:45.837204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2e38c71a-f216-452a-8733-d587e2606ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:45.838868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2e38c71a-f216-452a-8733-d587e2606ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:45.843712 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2e38c71a-f216-452a-8733-d587e2606ae8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.475599 Aug 29 15:31:45.844394 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 856/1714] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:45 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:45.880014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb6112ff-2950-47d4-9c49-9f5b06e002da tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] Calling method '.version_select at 0x7fc42b94d700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:45.958670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f8335f6a-516e-4f94-8f50-1c42f27f26fe tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:45.963963 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bb6112ff-2950-47d4-9c49-9f5b06e002da tempest-ServersTestJSON-1339790309 tempest-ServersTestJSON-1339790309-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523356171" status: 202 len: 0 microversion: 2.1 time: 0.099067 Aug 29 15:31:45.971817 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 857/1715] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 15:31:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523356171 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:31:45.978892 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f8335f6a-516e-4f94-8f50-1c42f27f26fe tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1509 microversion: 2.1 time: 0.396470 Aug 29 15:31:45.984743 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 859/1716] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:45 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1509 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:45.985415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6097276d-4ebe-405e-8808-0c9eb6c69855 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:45.986487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6097276d-4ebe-405e-8808-0c9eb6c69855 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:46.010841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6097276d-4ebe-405e-8808-0c9eb6c69855 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.017753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6097276d-4ebe-405e-8808-0c9eb6c69855 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.018561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6097276d-4ebe-405e-8808-0c9eb6c69855 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:46.020377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6097276d-4ebe-405e-8808-0c9eb6c69855 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.021821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6097276d-4ebe-405e-8808-0c9eb6c69855 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.024269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6097276d-4ebe-405e-8808-0c9eb6c69855 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:46.111058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6097276d-4ebe-405e-8808-0c9eb6c69855 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.115991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6097276d-4ebe-405e-8808-0c9eb6c69855 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.129140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6097276d-4ebe-405e-8808-0c9eb6c69855 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:46.130240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-6097276d-4ebe-405e-8808-0c9eb6c69855 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lazy-loading 'fault' on Instance uuid 32bc300a-b702-4755-b0c2-f0004d7d5016 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:46.198727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6097276d-4ebe-405e-8808-0c9eb6c69855 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd929ec7ad45747078b9f28392e133c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d0bc73ee9d4bf1b0e7bf868e2aecea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:46.213393 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6097276d-4ebe-405e-8808-0c9eb6c69855 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 200 len: 1330 microversion: 2.1 time: 0.237766 Aug 29 15:31:46.229374 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 858/1717] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:45 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 1330 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:46.262411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-33e22821-93d3-46c3-82ad-37440ec07a3b req-cbf4e671-eb28-4559-bfe1-fe0d9ca00bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "312f21b0-5005-4a49-891e-6a09bb993fc6", "name": "network-vif-deleted", "tag": "6bbe9b1d-ce94-404d-a6ef-83f0a17cf5f3"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:46.283483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-33e22821-93d3-46c3-82ad-37440ec07a3b req-cbf4e671-eb28-4559-bfe1-fe0d9ca00bd0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.285558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-33e22821-93d3-46c3-82ad-37440ec07a3b req-cbf4e671-eb28-4559-bfe1-fe0d9ca00bd0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.291514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-33e22821-93d3-46c3-82ad-37440ec07a3b req-cbf4e671-eb28-4559-bfe1-fe0d9ca00bd0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:46.325065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c1a30828-3783-4187-a0ee-6a477c138745 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:46.325738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c1a30828-3783-4187-a0ee-6a477c138745 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:46.335202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a30828-3783-4187-a0ee-6a477c138745 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.335682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a30828-3783-4187-a0ee-6a477c138745 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.336121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a30828-3783-4187-a0ee-6a477c138745 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:46.336832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a30828-3783-4187-a0ee-6a477c138745 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.337596 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-33e22821-93d3-46c3-82ad-37440ec07a3b req-cbf4e671-eb28-4559-bfe1-fe0d9ca00bd0 service nova] Creating event network-vif-deleted:6bbe9b1d-ce94-404d-a6ef-83f0a17cf5f3 for instance 312f21b0-5005-4a49-891e-6a09bb993fc6 on n-h1-839401-11 Aug 29 15:31:46.343257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a30828-3783-4187-a0ee-6a477c138745 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.348128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a30828-3783-4187-a0ee-6a477c138745 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:46.350239 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-33e22821-93d3-46c3-82ad-37440ec07a3b req-cbf4e671-eb28-4559-bfe1-fe0d9ca00bd0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093087 Aug 29 15:31:46.356316 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 860/1718] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:46.371558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7f241cc1-9d6e-4c95-8057-8371137f7946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:46.385362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7f241cc1-9d6e-4c95-8057-8371137f7946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:46.399631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:46.402211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f241cc1-9d6e-4c95-8057-8371137f7946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.409589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f241cc1-9d6e-4c95-8057-8371137f7946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.411448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f241cc1-9d6e-4c95-8057-8371137f7946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:46.412525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f241cc1-9d6e-4c95-8057-8371137f7946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.413194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f241cc1-9d6e-4c95-8057-8371137f7946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.413794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f241cc1-9d6e-4c95-8057-8371137f7946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:46.613445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c1a30828-3783-4187-a0ee-6a477c138745 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:46.622468 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c1a30828-3783-4187-a0ee-6a477c138745 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1345 microversion: 2.1 time: 0.305293 Aug 29 15:31:46.623078 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 859/1719] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:46 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1345 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:46.766030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7f241cc1-9d6e-4c95-8057-8371137f7946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:46.777551 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7f241cc1-9d6e-4c95-8057-8371137f7946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.410215 Aug 29 15:31:46.778158 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 861/1720] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:46 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:46.830635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-58de6b7e-4a10-48b0-a62d-23d8d4f150e2 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:46.831253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-58de6b7e-4a10-48b0-a62d-23d8d4f150e2 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:46.856105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58de6b7e-4a10-48b0-a62d-23d8d4f150e2 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.856786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58de6b7e-4a10-48b0-a62d-23d8d4f150e2 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.857287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58de6b7e-4a10-48b0-a62d-23d8d4f150e2 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:46.858036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58de6b7e-4a10-48b0-a62d-23d8d4f150e2 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.858518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58de6b7e-4a10-48b0-a62d-23d8d4f150e2 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.858947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58de6b7e-4a10-48b0-a62d-23d8d4f150e2 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:46.871469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9e0562e4-34b8-49ba-a932-5c85978bc7e1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:46.872085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9e0562e4-34b8-49ba-a932-5c85978bc7e1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:46.886658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0562e4-34b8-49ba-a932-5c85978bc7e1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.887153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0562e4-34b8-49ba-a932-5c85978bc7e1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.887598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0562e4-34b8-49ba-a932-5c85978bc7e1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:46.888294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0562e4-34b8-49ba-a932-5c85978bc7e1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:46.888748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0562e4-34b8-49ba-a932-5c85978bc7e1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:46.889208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0562e4-34b8-49ba-a932-5c85978bc7e1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.144191 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-58de6b7e-4a10-48b0-a62d-23d8d4f150e2 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1859 microversion: 2.1 time: 0.317342 Aug 29 15:31:47.146430 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 860/1721] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:46 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1859 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:47.167605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e0b228c1-452d-4183-8a0b-0b6a21762b1f tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:47.168145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e0b228c1-452d-4183-8a0b-0b6a21762b1f tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:47.196034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0b228c1-452d-4183-8a0b-0b6a21762b1f tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.205987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0b228c1-452d-4183-8a0b-0b6a21762b1f tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.206756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0b228c1-452d-4183-8a0b-0b6a21762b1f tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.207720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0b228c1-452d-4183-8a0b-0b6a21762b1f tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.208336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0b228c1-452d-4183-8a0b-0b6a21762b1f tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.208929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0b228c1-452d-4183-8a0b-0b6a21762b1f tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.270777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e0562e4-34b8-49ba-a932-5c85978bc7e1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:47.284508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e0562e4-34b8-49ba-a932-5c85978bc7e1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:47.294187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e0562e4-34b8-49ba-a932-5c85978bc7e1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:47.307017 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9e0562e4-34b8-49ba-a932-5c85978bc7e1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.438275 Aug 29 15:31:47.308735 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 862/1722] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:46 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:31:47.320194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-967c7b0c-3bbd-4438-9c42-daf5b5a2f983 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-839401-11", "block_migration": true, "disk_over_commit": false}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:47.326830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-967c7b0c-3bbd-4438-9c42-daf5b5a2f983 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:47.335606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e0b228c1-452d-4183-8a0b-0b6a21762b1f tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3762d107bcf144dd8ad7a8d5fb636bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5ee0b05e5343d1a2a82a4b7dc75b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:47.343340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-967c7b0c-3bbd-4438-9c42-daf5b5a2f983 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.345070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-967c7b0c-3bbd-4438-9c42-daf5b5a2f983 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.346034 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e0b228c1-452d-4183-8a0b-0b6a21762b1f tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 200 len: 1300 microversion: 2.1 time: 0.180182 Aug 29 15:31:47.346676 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 861/1723] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:47 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 1300 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:47.348867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-967c7b0c-3bbd-4438-9c42-daf5b5a2f983 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.350110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-967c7b0c-3bbd-4438-9c42-daf5b5a2f983 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.350811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-967c7b0c-3bbd-4438-9c42-daf5b5a2f983 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.351483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-967c7b0c-3bbd-4438-9c42-daf5b5a2f983 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.362375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f96daad0-c11b-4b67-82bf-b0909c29a4f9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:47.362908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f96daad0-c11b-4b67-82bf-b0909c29a4f9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:47.375019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f96daad0-c11b-4b67-82bf-b0909c29a4f9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.375515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f96daad0-c11b-4b67-82bf-b0909c29a4f9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.375949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f96daad0-c11b-4b67-82bf-b0909c29a4f9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.376643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f96daad0-c11b-4b67-82bf-b0909c29a4f9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.377337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f96daad0-c11b-4b67-82bf-b0909c29a4f9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.377928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f96daad0-c11b-4b67-82bf-b0909c29a4f9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.409137 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-f96daad0-c11b-4b67-82bf-b0909c29a4f9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] HTTP exception thrown: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f96daad0-c11b-4b67-82bf-b0909c29a4f9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Request method failure captured: Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 HTTP/1.1 Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNr2zWSc8mCNe1YeHT5q7G-RyrAZFHvXZkMUpKjtUCeRi9b4h6uvHR9nCnot5zQRaLwZOSJcnqwE2kRPg60dgcUjzKqHW2AvC0ZlRucqmucGSbXAXab31xpigHUj-G6RvTjGomsoA3R4OAHOVwEgEcIinlPJtN7t52PH3qyBeSoJJ_k Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: a6d0bc73ee9d4bf1b0e7bf868e2aecea Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-67603444 Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a6d0bc73ee9d4bf1b0e7bf868e2aecea", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a6d0bc73ee9d4bf1b0e7bf868e2aecea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a6d0bc73ee9d4bf1b0e7bf868e2aecea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a6d0bc73ee9d4bf1b0e7bf868e2aecea"}]}] Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-67603444 Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: a6d0bc73ee9d4bf1b0e7bf868e2aecea Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-67603444 Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachSCSIVolumeTestJSON-67603444-project Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: d929ec7ad45747078b9f28392e133c5b Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-67603444-project Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '32bc300a-b702-4755-b0c2-f0004d7d5016'} Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:47.415407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:47.420956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:47.420956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:47.420956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:47.420956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:47.420956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:47.420956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. Aug 29 15:31:47.420956 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:47.420956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f96daad0-c11b-4b67-82bf-b0909c29a4f9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Returning 404 to user: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:47.420956 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f96daad0-c11b-4b67-82bf-b0909c29a4f9 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 404 len: 111 microversion: 2.1 time: 0.059566 Aug 29 15:31:47.422638 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 862/1724] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:47 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:31:47.428091 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c4c7ec7d-8216-4d49-963e-347ee1c974bd tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '.version_select at 0x7fc42b6a00d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:47.441293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-967c7b0c-3bbd-4438-9c42-daf5b5a2f983 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lazy-loading 'flavor' on Instance uuid 51a3c2ae-98a2-4e37-96ef-3e787faf0d11 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:47.461146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-967c7b0c-3bbd-4438-9c42-daf5b5a2f983 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Going to try to live migrate instance to n-h1-839401-11 {{(pid=122360) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:31:47.469022 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c4c7ec7d-8216-4d49-963e-347ee1c974bd tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-309886493" status: 202 len: 0 microversion: 2.1 time: 0.044970 Aug 29 15:31:47.470908 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 863/1725] 10.222.0.62 () {58 vars in 1218 bytes} [Mon Aug 29 15:31:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-309886493 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:31:47.552320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:47.643957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-85b32615-6066-4f47-a681-43ff566d5693 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:47.644694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-85b32615-6066-4f47-a681-43ff566d5693 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:47.668465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85b32615-6066-4f47-a681-43ff566d5693 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.668976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85b32615-6066-4f47-a681-43ff566d5693 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.669452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85b32615-6066-4f47-a681-43ff566d5693 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.670171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85b32615-6066-4f47-a681-43ff566d5693 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.670623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85b32615-6066-4f47-a681-43ff566d5693 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.671044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85b32615-6066-4f47-a681-43ff566d5693 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.751237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-85b32615-6066-4f47-a681-43ff566d5693 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:47.760380 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-85b32615-6066-4f47-a681-43ff566d5693 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1345 microversion: 2.1 time: 0.121060 Aug 29 15:31:47.760962 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 864/1726] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:47 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:47.799192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5988de8d-8014-4d9c-bfa3-a3f1c6cb9b3e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:47.800242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5988de8d-8014-4d9c-bfa3-a3f1c6cb9b3e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:47.810673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5988de8d-8014-4d9c-bfa3-a3f1c6cb9b3e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.812785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5988de8d-8014-4d9c-bfa3-a3f1c6cb9b3e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.814566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5988de8d-8014-4d9c-bfa3-a3f1c6cb9b3e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:47.817692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5988de8d-8014-4d9c-bfa3-a3f1c6cb9b3e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:47.818362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5988de8d-8014-4d9c-bfa3-a3f1c6cb9b3e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:47.818901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5988de8d-8014-4d9c-bfa3-a3f1c6cb9b3e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:48.373463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5988de8d-8014-4d9c-bfa3-a3f1c6cb9b3e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:48.383660 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5988de8d-8014-4d9c-bfa3-a3f1c6cb9b3e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.588499 Aug 29 15:31:48.384249 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 865/1727] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:47 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:48.409857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bfd3c1a1-58fc-47af-8cdd-1fea5589ecfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:48.410922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bfd3c1a1-58fc-47af-8cdd-1fea5589ecfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:48.418331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bfd3c1a1-58fc-47af-8cdd-1fea5589ecfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:48.418905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:48.419777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bfd3c1a1-58fc-47af-8cdd-1fea5589ecfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:48.420644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bfd3c1a1-58fc-47af-8cdd-1fea5589ecfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:48.421788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bfd3c1a1-58fc-47af-8cdd-1fea5589ecfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:48.422798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bfd3c1a1-58fc-47af-8cdd-1fea5589ecfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:48.423470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bfd3c1a1-58fc-47af-8cdd-1fea5589ecfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:48.596997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:48.738461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bfd3c1a1-58fc-47af-8cdd-1fea5589ecfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:48.750431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bfd3c1a1-58fc-47af-8cdd-1fea5589ecfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:48.756034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bfd3c1a1-58fc-47af-8cdd-1fea5589ecfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:48.757407 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bfd3c1a1-58fc-47af-8cdd-1fea5589ecfb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.353371 Aug 29 15:31:48.757998 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 866/1728] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:48 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:48.773218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-74f44cf8-176a-4d3e-9826-5eb7a48c7efb tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:48.774105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-74f44cf8-176a-4d3e-9826-5eb7a48c7efb tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] [instance: f33bc5f4-a9f5-4613-96d2-a48cf1b729fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:48.786505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74f44cf8-176a-4d3e-9826-5eb7a48c7efb tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:48.787012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74f44cf8-176a-4d3e-9826-5eb7a48c7efb tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:48.787456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74f44cf8-176a-4d3e-9826-5eb7a48c7efb tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:48.788183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74f44cf8-176a-4d3e-9826-5eb7a48c7efb tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:48.788648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74f44cf8-176a-4d3e-9826-5eb7a48c7efb tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:48.789104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74f44cf8-176a-4d3e-9826-5eb7a48c7efb tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:48.836206 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-74f44cf8-176a-4d3e-9826-5eb7a48c7efb tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] HTTP exception thrown: Instance f33bc5f4-a9f5-4613-96d2-a48cf1b729fb could not be found. Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-74f44cf8-176a-4d3e-9826-5eb7a48c7efb tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Request method failure captured: Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb HTTP/1.1 Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNvJ8RrH4G5T0bP9jR_XHFmVBAnPveABCsXnsEvjgdSm9JxGPBFUqo2rWVQvwnO-1Qpe1uDPaTQA8yg7L0pNuK1szZhH8yqXUpPXYE0ZTT-NfyACfS1kuQzAflblys8DfyX7hkMVpTbggtjZ3fyN21oVUkUiLeA14jkeZfZd3aU_zIs Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 8b5ee0b05e5343d1a2a82a4b7dc75b68 Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-InstanceActionsTestJSON-1420700771 Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8b5ee0b05e5343d1a2a82a4b7dc75b68", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8b5ee0b05e5343d1a2a82a4b7dc75b68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8b5ee0b05e5343d1a2a82a4b7dc75b68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8b5ee0b05e5343d1a2a82a4b7dc75b68"}]}] Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-InstanceActionsTestJSON-1420700771 Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 8b5ee0b05e5343d1a2a82a4b7dc75b68 Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1420700771 Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-InstanceActionsTestJSON-1420700771-project Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 3762d107bcf144dd8ad7a8d5fb636bf5 Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-InstanceActionsTestJSON-1420700771-project Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance f33bc5f4-a9f5-4613-96d2-a48cf1b729fb could not be found. Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'f33bc5f4-a9f5-4613-96d2-a48cf1b729fb'} Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f33bc5f4-a9f5-4613-96d2-a48cf1b729fb could not be found. Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f33bc5f4-a9f5-4613-96d2-a48cf1b729fb could not be found. Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:48.843450 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:48.848166 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:48.848166 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:48.848166 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:48.848166 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:48.848166 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:48.848166 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f33bc5f4-a9f5-4613-96d2-a48cf1b729fb could not be found. Aug 29 15:31:48.848166 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:48.850514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-74f44cf8-176a-4d3e-9826-5eb7a48c7efb tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] Returning 404 to user: Instance f33bc5f4-a9f5-4613-96d2-a48cf1b729fb could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:48.853917 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-74f44cf8-176a-4d3e-9826-5eb7a48c7efb tempest-InstanceActionsTestJSON-1420700771 tempest-InstanceActionsTestJSON-1420700771-project] 10.222.0.62 "GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb" status: 404 len: 111 microversion: 2.1 time: 0.093094 Aug 29 15:31:48.855566 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 867/1729] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:48 2022] GET /compute/v2.1/servers/f33bc5f4-a9f5-4613-96d2-a48cf1b729fb => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:31:48.880408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-a4547261-325e-4b98-b746-4ccb40633dfd req-e1ba1267-757c-4702-9f88-41755994851e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f33bc5f4-a9f5-4613-96d2-a48cf1b729fb", "name": "network-vif-deleted", "tag": "bd19f4e3-2c35-46bf-832b-06072a8da6d5"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:48.894936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a4547261-325e-4b98-b746-4ccb40633dfd req-e1ba1267-757c-4702-9f88-41755994851e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:48.895775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a4547261-325e-4b98-b746-4ccb40633dfd req-e1ba1267-757c-4702-9f88-41755994851e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:48.896590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a4547261-325e-4b98-b746-4ccb40633dfd req-e1ba1267-757c-4702-9f88-41755994851e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:48.914426 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-a4547261-325e-4b98-b746-4ccb40633dfd req-e1ba1267-757c-4702-9f88-41755994851e service nova] Creating event network-vif-deleted:bd19f4e3-2c35-46bf-832b-06072a8da6d5 for instance f33bc5f4-a9f5-4613-96d2-a48cf1b729fb on n-h2-839401-11 Aug 29 15:31:48.926037 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-a4547261-325e-4b98-b746-4ccb40633dfd req-e1ba1267-757c-4702-9f88-41755994851e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068908 Aug 29 15:31:48.927928 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 868/1730] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:31:48.936015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f94cc5a0-347d-48a0-b2b5-b663199105d6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:48.936780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f94cc5a0-347d-48a0-b2b5-b663199105d6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:48.961762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f94cc5a0-347d-48a0-b2b5-b663199105d6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:48.966501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f94cc5a0-347d-48a0-b2b5-b663199105d6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:48.968527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f94cc5a0-347d-48a0-b2b5-b663199105d6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:48.973465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f94cc5a0-347d-48a0-b2b5-b663199105d6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:48.974012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f94cc5a0-347d-48a0-b2b5-b663199105d6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:48.974433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f94cc5a0-347d-48a0-b2b5-b663199105d6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:49.149033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f94cc5a0-347d-48a0-b2b5-b663199105d6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:49.151436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:49.163099 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f94cc5a0-347d-48a0-b2b5-b663199105d6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1345 microversion: 2.1 time: 0.232417 Aug 29 15:31:49.167652 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 869/1731] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:48 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1345 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:49.405784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7c0d03f5-3180-4c1f-98ef-948bc30e4904 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:49.406858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7c0d03f5-3180-4c1f-98ef-948bc30e4904 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:49.424001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c0d03f5-3180-4c1f-98ef-948bc30e4904 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:49.424746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c0d03f5-3180-4c1f-98ef-948bc30e4904 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:49.425252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c0d03f5-3180-4c1f-98ef-948bc30e4904 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:49.427360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c0d03f5-3180-4c1f-98ef-948bc30e4904 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:49.427871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c0d03f5-3180-4c1f-98ef-948bc30e4904 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:49.428312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c0d03f5-3180-4c1f-98ef-948bc30e4904 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:49.748440 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-967c7b0c-3bbd-4438-9c42-daf5b5a2f983 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/action" status: 202 len: 0 microversion: 2.1 time: 2.437916 Aug 29 15:31:49.753247 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 863/1732] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:31:47 2022] POST /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/action => generated 0 bytes in 2441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:31:49.772356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d40ca024-2533-4d17-8b03-b4a87e6d7d09 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:49.772990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d40ca024-2533-4d17-8b03-b4a87e6d7d09 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:49.813781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d40ca024-2533-4d17-8b03-b4a87e6d7d09 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:49.814304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d40ca024-2533-4d17-8b03-b4a87e6d7d09 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:49.814835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d40ca024-2533-4d17-8b03-b4a87e6d7d09 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:49.815585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d40ca024-2533-4d17-8b03-b4a87e6d7d09 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:49.816055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d40ca024-2533-4d17-8b03-b4a87e6d7d09 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:49.816489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d40ca024-2533-4d17-8b03-b4a87e6d7d09 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:49.847968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7c0d03f5-3180-4c1f-98ef-948bc30e4904 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:49.868002 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7c0d03f5-3180-4c1f-98ef-948bc30e4904 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.467462 Aug 29 15:31:49.868929 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 870/1733] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:49 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:49.882765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1b2ea835-3cbc-4156-879d-298cdc21b59e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:49.883869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1b2ea835-3cbc-4156-879d-298cdc21b59e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:49.894185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b2ea835-3cbc-4156-879d-298cdc21b59e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:49.894971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b2ea835-3cbc-4156-879d-298cdc21b59e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:49.895692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b2ea835-3cbc-4156-879d-298cdc21b59e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:49.897391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b2ea835-3cbc-4156-879d-298cdc21b59e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:49.898110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b2ea835-3cbc-4156-879d-298cdc21b59e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:49.899268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b2ea835-3cbc-4156-879d-298cdc21b59e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:50.219733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1b2ea835-3cbc-4156-879d-298cdc21b59e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:50.234484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1b2ea835-3cbc-4156-879d-298cdc21b59e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:50.236384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1b2ea835-3cbc-4156-879d-298cdc21b59e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:50.237764 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1b2ea835-3cbc-4156-879d-298cdc21b59e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.359517 Aug 29 15:31:50.238492 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 871/1734] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:49 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:50.259081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-24f427c4-6ff3-4b2e-8b19-b2b9b81d915d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:50.260040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-24f427c4-6ff3-4b2e-8b19-b2b9b81d915d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:50.267346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24f427c4-6ff3-4b2e-8b19-b2b9b81d915d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:50.268210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24f427c4-6ff3-4b2e-8b19-b2b9b81d915d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:50.269215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24f427c4-6ff3-4b2e-8b19-b2b9b81d915d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:50.270357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24f427c4-6ff3-4b2e-8b19-b2b9b81d915d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:50.271266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24f427c4-6ff3-4b2e-8b19-b2b9b81d915d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:50.272246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24f427c4-6ff3-4b2e-8b19-b2b9b81d915d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:50.356305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-24f427c4-6ff3-4b2e-8b19-b2b9b81d915d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:50.368495 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-24f427c4-6ff3-4b2e-8b19-b2b9b81d915d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1345 microversion: 2.1 time: 0.128693 Aug 29 15:31:50.383024 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 872/1735] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:50 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1345 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:50.896126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ac69a414-8f6d-4922-aa3e-f9ddfff2232a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:50.898189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ac69a414-8f6d-4922-aa3e-f9ddfff2232a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:50.912235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac69a414-8f6d-4922-aa3e-f9ddfff2232a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:50.916083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac69a414-8f6d-4922-aa3e-f9ddfff2232a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:50.917386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac69a414-8f6d-4922-aa3e-f9ddfff2232a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:50.920396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac69a414-8f6d-4922-aa3e-f9ddfff2232a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:50.921926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac69a414-8f6d-4922-aa3e-f9ddfff2232a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:50.924131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac69a414-8f6d-4922-aa3e-f9ddfff2232a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:50.993268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d40ca024-2533-4d17-8b03-b4a87e6d7d09 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:51.014346 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d40ca024-2533-4d17-8b03-b4a87e6d7d09 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 1.249084 Aug 29 15:31:51.014985 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 864/1736] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:49 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:51.264268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d66cad74-6267-4f2e-999c-5122db01bf59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:51.264899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d66cad74-6267-4f2e-999c-5122db01bf59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:51.277775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d66cad74-6267-4f2e-999c-5122db01bf59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:51.278472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d66cad74-6267-4f2e-999c-5122db01bf59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:51.282769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d66cad74-6267-4f2e-999c-5122db01bf59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:51.283754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d66cad74-6267-4f2e-999c-5122db01bf59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:51.284245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d66cad74-6267-4f2e-999c-5122db01bf59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:51.284695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d66cad74-6267-4f2e-999c-5122db01bf59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:51.581753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ac69a414-8f6d-4922-aa3e-f9ddfff2232a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:51.596244 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ac69a414-8f6d-4922-aa3e-f9ddfff2232a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.704797 Aug 29 15:31:51.598668 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 873/1737] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:50 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:51.618193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-090e3144-bb9c-42f6-aa9e-b9606945ce4d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:51.622230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-090e3144-bb9c-42f6-aa9e-b9606945ce4d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:51.640166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-090e3144-bb9c-42f6-aa9e-b9606945ce4d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:51.640951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-090e3144-bb9c-42f6-aa9e-b9606945ce4d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:51.641606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-090e3144-bb9c-42f6-aa9e-b9606945ce4d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:51.643534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-090e3144-bb9c-42f6-aa9e-b9606945ce4d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:51.645554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-090e3144-bb9c-42f6-aa9e-b9606945ce4d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:51.646358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-090e3144-bb9c-42f6-aa9e-b9606945ce4d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:51.720979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-090e3144-bb9c-42f6-aa9e-b9606945ce4d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:51.721800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-090e3144-bb9c-42f6-aa9e-b9606945ce4d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:51.722409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-090e3144-bb9c-42f6-aa9e-b9606945ce4d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:51.723192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-090e3144-bb9c-42f6-aa9e-b9606945ce4d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lazy-loading 'fault' on Instance uuid 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:51.832299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-090e3144-bb9c-42f6-aa9e-b9606945ce4d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:51.845706 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-090e3144-bb9c-42f6-aa9e-b9606945ce4d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 200 len: 1304 microversion: 2.1 time: 0.245612 Aug 29 15:31:51.847108 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 874/1738] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:51 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 1304 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:51.950178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d66cad74-6267-4f2e-999c-5122db01bf59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:51.960561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d66cad74-6267-4f2e-999c-5122db01bf59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:51.968958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d66cad74-6267-4f2e-999c-5122db01bf59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:51.971019 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d66cad74-6267-4f2e-999c-5122db01bf59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.711466 Aug 29 15:31:51.981838 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 865/1739] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:51 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:52.039887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-83d854f9-26e5-4fc2-a2c5-9202bed33e29 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:52.040505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-83d854f9-26e5-4fc2-a2c5-9202bed33e29 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:52.058293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83d854f9-26e5-4fc2-a2c5-9202bed33e29 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:52.058791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83d854f9-26e5-4fc2-a2c5-9202bed33e29 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:52.083567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83d854f9-26e5-4fc2-a2c5-9202bed33e29 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:52.083567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83d854f9-26e5-4fc2-a2c5-9202bed33e29 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:52.083567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83d854f9-26e5-4fc2-a2c5-9202bed33e29 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:52.083567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83d854f9-26e5-4fc2-a2c5-9202bed33e29 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:52.409679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-83d854f9-26e5-4fc2-a2c5-9202bed33e29 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:52.427713 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-83d854f9-26e5-4fc2-a2c5-9202bed33e29 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 0.395398 Aug 29 15:31:52.441151 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 875/1740] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:52 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:52.618402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-df92ca15-2223-4593-9056-3a3ab5e7ee24 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:52.619015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-df92ca15-2223-4593-9056-3a3ab5e7ee24 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:52.628415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df92ca15-2223-4593-9056-3a3ab5e7ee24 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:52.632626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df92ca15-2223-4593-9056-3a3ab5e7ee24 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:52.634011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df92ca15-2223-4593-9056-3a3ab5e7ee24 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:52.637243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df92ca15-2223-4593-9056-3a3ab5e7ee24 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:52.637955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df92ca15-2223-4593-9056-3a3ab5e7ee24 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:52.638579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df92ca15-2223-4593-9056-3a3ab5e7ee24 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:52.867405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c67aecc4-d8c5-4da6-b3a0-92be14fafb42 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:52.868288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c67aecc4-d8c5-4da6-b3a0-92be14fafb42 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:52.878064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c67aecc4-d8c5-4da6-b3a0-92be14fafb42 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:52.878958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c67aecc4-d8c5-4da6-b3a0-92be14fafb42 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:52.882547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c67aecc4-d8c5-4da6-b3a0-92be14fafb42 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:52.883482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c67aecc4-d8c5-4da6-b3a0-92be14fafb42 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:52.884112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c67aecc4-d8c5-4da6-b3a0-92be14fafb42 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:52.884754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c67aecc4-d8c5-4da6-b3a0-92be14fafb42 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:52.932120 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-c67aecc4-d8c5-4da6-b3a0-92be14fafb42 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c67aecc4-d8c5-4da6-b3a0-92be14fafb42 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c HTTP/1.1 Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '16758bc6-5ab1-42fc-8f6f-fe955bf6f83c'} Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:52.934473 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:52.940438 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:52.940438 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:52.940438 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:52.940438 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:52.940438 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:52.940438 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:31:52.940438 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:52.944244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c67aecc4-d8c5-4da6-b3a0-92be14fafb42 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:52.952241 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c67aecc4-d8c5-4da6-b3a0-92be14fafb42 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 404 len: 111 microversion: 2.1 time: 0.082290 Aug 29 15:31:52.953943 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 876/1741] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:52 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:31:53.004770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-20d1cc29-69b0-4533-af00-98c824719690 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:53.005533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-20d1cc29-69b0-4533-af00-98c824719690 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:53.017070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20d1cc29-69b0-4533-af00-98c824719690 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:53.017791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20d1cc29-69b0-4533-af00-98c824719690 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:53.018310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20d1cc29-69b0-4533-af00-98c824719690 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:53.019155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20d1cc29-69b0-4533-af00-98c824719690 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:53.019697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20d1cc29-69b0-4533-af00-98c824719690 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:53.020159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20d1cc29-69b0-4533-af00-98c824719690 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:53.087538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-df92ca15-2223-4593-9056-3a3ab5e7ee24 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:53.100936 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-df92ca15-2223-4593-9056-3a3ab5e7ee24 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.486120 Aug 29 15:31:53.101516 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 866/1742] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:52 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:53.454586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f1f79b7b-636a-4be8-a796-33b2e55d28a2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:53.456466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f1f79b7b-636a-4be8-a796-33b2e55d28a2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:53.484818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1f79b7b-636a-4be8-a796-33b2e55d28a2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:53.495838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1f79b7b-636a-4be8-a796-33b2e55d28a2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:53.500350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1f79b7b-636a-4be8-a796-33b2e55d28a2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:53.508768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1f79b7b-636a-4be8-a796-33b2e55d28a2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:53.517418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1f79b7b-636a-4be8-a796-33b2e55d28a2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:53.519410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1f79b7b-636a-4be8-a796-33b2e55d28a2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:53.680127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-20d1cc29-69b0-4533-af00-98c824719690 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:53.705293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-20d1cc29-69b0-4533-af00-98c824719690 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:53.720098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-20d1cc29-69b0-4533-af00-98c824719690 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:53.721498 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-20d1cc29-69b0-4533-af00-98c824719690 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.724087 Aug 29 15:31:53.733152 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 877/1743] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:52 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:54.067306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-540811f2-0c40-49fe-9b23-d253e8857a73 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:54.069913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-540811f2-0c40-49fe-9b23-d253e8857a73 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:54.084102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-540811f2-0c40-49fe-9b23-d253e8857a73 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:54.084605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-540811f2-0c40-49fe-9b23-d253e8857a73 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:54.085062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-540811f2-0c40-49fe-9b23-d253e8857a73 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:54.085811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-540811f2-0c40-49fe-9b23-d253e8857a73 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:54.088037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-540811f2-0c40-49fe-9b23-d253e8857a73 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:54.094972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-540811f2-0c40-49fe-9b23-d253e8857a73 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:54.147576 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-540811f2-0c40-49fe-9b23-d253e8857a73 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-540811f2-0c40-49fe-9b23-d253e8857a73 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c/os-volume_attachments HTTP/1.1 Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'server_id': '16758bc6-5ab1-42fc-8f6f-fe955bf6f83c'} Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:31:54.163933 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:31:54.168926 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:31:54.168926 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:54.168926 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:54.168926 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:54.168926 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:54.168926 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:54.168926 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:54.168926 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:54.168926 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:54.168926 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:31:54.168926 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:54.168926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-540811f2-0c40-49fe-9b23-d253e8857a73 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:54.168926 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-540811f2-0c40-49fe-9b23-d253e8857a73 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.103147 Aug 29 15:31:54.168926 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 878/1744] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:31:54 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c/os-volume_attachments => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:31:54.180290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b72ddef6-7ee9-423a-832a-5771372662b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:54.181189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b72ddef6-7ee9-423a-832a-5771372662b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:54.196271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b72ddef6-7ee9-423a-832a-5771372662b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:54.196782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b72ddef6-7ee9-423a-832a-5771372662b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:54.205681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b72ddef6-7ee9-423a-832a-5771372662b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:54.206504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b72ddef6-7ee9-423a-832a-5771372662b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:54.207001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b72ddef6-7ee9-423a-832a-5771372662b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:54.207449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b72ddef6-7ee9-423a-832a-5771372662b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:54.419843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f1f79b7b-636a-4be8-a796-33b2e55d28a2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:54.435101 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f1f79b7b-636a-4be8-a796-33b2e55d28a2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 0.989726 Aug 29 15:31:54.436496 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 867/1745] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:53 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:54.516960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-576252278", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "cb3199df-483a-4605-86c6-a5d65679d5da"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:54.604219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] validate_networks() for [('cb3199df-483a-4605-86c6-a5d65679d5da', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:31:54.682701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b72ddef6-7ee9-423a-832a-5771372662b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:54.706720 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b72ddef6-7ee9-423a-832a-5771372662b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.528299 Aug 29 15:31:54.708610 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 879/1746] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:54 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:54.749491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-462b9242-3faa-4869-8f98-46e4d2bec00a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:54.750123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-462b9242-3faa-4869-8f98-46e4d2bec00a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:54.780714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-462b9242-3faa-4869-8f98-46e4d2bec00a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:54.786691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-462b9242-3faa-4869-8f98-46e4d2bec00a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:54.792490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-462b9242-3faa-4869-8f98-46e4d2bec00a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:54.793614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-462b9242-3faa-4869-8f98-46e4d2bec00a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:54.794158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-462b9242-3faa-4869-8f98-46e4d2bec00a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:54.794692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-462b9242-3faa-4869-8f98-46e4d2bec00a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:55.315533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-462b9242-3faa-4869-8f98-46e4d2bec00a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:55.325773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-462b9242-3faa-4869-8f98-46e4d2bec00a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:55.340858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-462b9242-3faa-4869-8f98-46e4d2bec00a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:55.344336 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-462b9242-3faa-4869-8f98-46e4d2bec00a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.600463 Aug 29 15:31:55.351383 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 880/1747] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:54 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:31:55.458151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-48586399-76f8-4f4a-a567-fa3497c40508 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:55.459091 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-48586399-76f8-4f4a-a567-fa3497c40508 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:55.471851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48586399-76f8-4f4a-a567-fa3497c40508 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:55.472655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48586399-76f8-4f4a-a567-fa3497c40508 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:55.473302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48586399-76f8-4f4a-a567-fa3497c40508 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:55.474292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48586399-76f8-4f4a-a567-fa3497c40508 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:55.476261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48586399-76f8-4f4a-a567-fa3497c40508 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:55.477465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48586399-76f8-4f4a-a567-fa3497c40508 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:55.776759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-48586399-76f8-4f4a-a567-fa3497c40508 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:55.790380 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-48586399-76f8-4f4a-a567-fa3497c40508 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 0.336180 Aug 29 15:31:55.820848 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 881/1748] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:55 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:31:55.836049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9bbf1baa-f5c7-43d7-a4cd-567f9e94661f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:55.841922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9bbf1baa-f5c7-43d7-a4cd-567f9e94661f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:55.861543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bbf1baa-f5c7-43d7-a4cd-567f9e94661f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:55.865612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bbf1baa-f5c7-43d7-a4cd-567f9e94661f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:55.866509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bbf1baa-f5c7-43d7-a4cd-567f9e94661f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:55.867712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bbf1baa-f5c7-43d7-a4cd-567f9e94661f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:55.868446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bbf1baa-f5c7-43d7-a4cd-567f9e94661f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:55.875092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bbf1baa-f5c7-43d7-a4cd-567f9e94661f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:56.141384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9bbf1baa-f5c7-43d7-a4cd-567f9e94661f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:56.158104 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9bbf1baa-f5c7-43d7-a4cd-567f9e94661f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.331790 Aug 29 15:31:56.158857 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 882/1749] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:55 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:56.168911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-788938650", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "bd45c5b3-8d21-4f20-b7a7-8fee21c42bbe"}], "security_groups": [{"name": "tempest-securitygroup--1580802336"}], "key_name": "tempest-keypair-1491875179", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "dc1ae604-0d9d-47fe-82bb-21d6a4fa6fa2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:31:56.396817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] validate_networks() for [('bd45c5b3-8d21-4f20-b7a7-8fee21c42bbe', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:31:57.102920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Getting quotas for project 03b8d7e70d3244c2ac9866de54967460. Resources: dict_keys(['metadata_items']) {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:57.115118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Getting quotas for user 966abbb1d63042469c45b784b6c7b5c7 and project 03b8d7e70d3244c2ac9866de54967460. Resources: dict_keys(['metadata_items']) {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:57.131406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:31:57.132098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:31:57.132800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:31:57.133486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:31:57.134145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:31:57.149890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.150662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.151341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.154611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.157777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.165317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.234964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Getting quotas for project 03b8d7e70d3244c2ac9866de54967460. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:57.249951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Getting quotas for user 966abbb1d63042469c45b784b6c7b5c7 and project 03b8d7e70d3244c2ac9866de54967460. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:57.316236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:31:57.316647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:31:57.317114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:31:57.317808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:31:57.317918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:31:57.330177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.331583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.332274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.333302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.334004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.334895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.341407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:31:57.343877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dc1ae604-0d9d-47fe-82bb-21d6a4fa6fa2',volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:31:57.369990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Getting quotas for project bbbc9e55a8f24d70a82b79243b0fa9e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:31:57.375871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Getting quotas for user 8dbbadfdb27047dd9237f4a1d311867e and project bbbc9e55a8f24d70a82b79243b0fa9e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:31:57.389696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:31:57.392023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 02663235-8b3c-44ab-adab-2cc0d57541bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:31:57.477009 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ef2ded8d-8f1f-4ada-be49-bb3a8b81e40b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.964418 Aug 29 15:31:57.482069 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 868/1750] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:31:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:31:57.492833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dbd7a487-9453-4343-9c15-84d4705b7c28 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:57.499012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dbd7a487-9453-4343-9c15-84d4705b7c28 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:57.508206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbd7a487-9453-4343-9c15-84d4705b7c28 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.511992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbd7a487-9453-4343-9c15-84d4705b7c28 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.512703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbd7a487-9453-4343-9c15-84d4705b7c28 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.514676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbd7a487-9453-4343-9c15-84d4705b7c28 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.515354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbd7a487-9453-4343-9c15-84d4705b7c28 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.517551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbd7a487-9453-4343-9c15-84d4705b7c28 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.648523 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-811e02ba-58ee-4f29-86bc-eb776396406b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.488498 Aug 29 15:31:57.655542 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 883/1751] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:31:56 2022] POST /compute/v2.1/servers => generated 407 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:31:57.661314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-03779061-2349-421e-8aab-6008bc9402b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:57.662446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-03779061-2349-421e-8aab-6008bc9402b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:57.669592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03779061-2349-421e-8aab-6008bc9402b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.670294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03779061-2349-421e-8aab-6008bc9402b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.670884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03779061-2349-421e-8aab-6008bc9402b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.671961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03779061-2349-421e-8aab-6008bc9402b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:57.672827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03779061-2349-421e-8aab-6008bc9402b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:57.673533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03779061-2349-421e-8aab-6008bc9402b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:57.977809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-03779061-2349-421e-8aab-6008bc9402b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:57.992544 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-03779061-2349-421e-8aab-6008bc9402b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 0.335730 Aug 29 15:31:57.996436 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 884/1752] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:57 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:58.014761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-61242660-bfd2-43b0-b5e6-9cbb44129d17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:58.016526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-61242660-bfd2-43b0-b5e6-9cbb44129d17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:58.041241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61242660-bfd2-43b0-b5e6-9cbb44129d17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:58.042209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61242660-bfd2-43b0-b5e6-9cbb44129d17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:58.044003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61242660-bfd2-43b0-b5e6-9cbb44129d17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:58.046717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61242660-bfd2-43b0-b5e6-9cbb44129d17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:58.048808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61242660-bfd2-43b0-b5e6-9cbb44129d17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:58.050636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61242660-bfd2-43b0-b5e6-9cbb44129d17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:58.121480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dbd7a487-9453-4343-9c15-84d4705b7c28 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:58.135612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dbd7a487-9453-4343-9c15-84d4705b7c28 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:58.141933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dbd7a487-9453-4343-9c15-84d4705b7c28 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:58.143483 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dbd7a487-9453-4343-9c15-84d4705b7c28 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.659244 Aug 29 15:31:58.158599 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 869/1753] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:57 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:31:58.176219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3d0f643a-6f50-4e90-8fae-c75299143cdd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:58.177293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3d0f643a-6f50-4e90-8fae-c75299143cdd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 02663235-8b3c-44ab-adab-2cc0d57541bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:58.522896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3d0f643a-6f50-4e90-8fae-c75299143cdd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:58.530742 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3d0f643a-6f50-4e90-8fae-c75299143cdd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/02663235-8b3c-44ab-adab-2cc0d57541bf" status: 200 len: 1214 microversion: 2.1 time: 0.363444 Aug 29 15:31:58.535256 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 870/1754] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:58 2022] GET /compute/v2.1/servers/02663235-8b3c-44ab-adab-2cc0d57541bf => generated 1214 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:58.542565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5e206239-3789-465b-ad83-6418681b90fc tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:58.543514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5e206239-3789-465b-ad83-6418681b90fc tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:58.703861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-61242660-bfd2-43b0-b5e6-9cbb44129d17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:58.717966 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-61242660-bfd2-43b0-b5e6-9cbb44129d17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.720284 Aug 29 15:31:58.719469 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 885/1755] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:57 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:58.728623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-00f7e353-ba1c-4e21-96e3-e6573e949dc4 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:58.740258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-00f7e353-ba1c-4e21-96e3-e6573e949dc4 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:58.753751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00f7e353-ba1c-4e21-96e3-e6573e949dc4 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:58.758271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00f7e353-ba1c-4e21-96e3-e6573e949dc4 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:58.758931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00f7e353-ba1c-4e21-96e3-e6573e949dc4 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:58.759881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00f7e353-ba1c-4e21-96e3-e6573e949dc4 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:58.760515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00f7e353-ba1c-4e21-96e3-e6573e949dc4 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:58.767664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00f7e353-ba1c-4e21-96e3-e6573e949dc4 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:58.788934 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-00f7e353-ba1c-4e21-96e3-e6573e949dc4 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] HTTP exception thrown: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. Aug 29 15:31:58.794764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e206239-3789-465b-ad83-6418681b90fc tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-00f7e353-ba1c-4e21-96e3-e6573e949dc4 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Request method failure captured: Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 HTTP/1.1 Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNr2zWSc8mCNe1YeHT5q7G-RyrAZFHvXZkMUpKjtUCeRi9b4h6uvHR9nCnot5zQRaLwZOSJcnqwE2kRPg60dgcUjzKqHW2AvC0ZlRucqmucGSbXAXab31xpigHUj-G6RvTjGomsoA3R4OAHOVwEgEcIinlPJtN7t52PH3qyBeSoJJ_k Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: a6d0bc73ee9d4bf1b0e7bf868e2aecea Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-67603444 Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a6d0bc73ee9d4bf1b0e7bf868e2aecea", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a6d0bc73ee9d4bf1b0e7bf868e2aecea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a6d0bc73ee9d4bf1b0e7bf868e2aecea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a6d0bc73ee9d4bf1b0e7bf868e2aecea"}]}] Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-67603444 Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: a6d0bc73ee9d4bf1b0e7bf868e2aecea Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-67603444 Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachSCSIVolumeTestJSON-67603444-project Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: d929ec7ad45747078b9f28392e133c5b Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-67603444-project Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '32bc300a-b702-4755-b0c2-f0004d7d5016'} Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:31:58.806430 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:31:58.811658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. Aug 29 15:31:58.811658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:58.811658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:58.811658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:58.811658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:58.811658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:58.811658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:58.811658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:58.811658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:58.811658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. Aug 29 15:31:58.811658 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:31:58.811658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-00f7e353-ba1c-4e21-96e3-e6573e949dc4 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Returning 404 to user: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:58.817480 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-00f7e353-ba1c-4e21-96e3-e6573e949dc4 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "DELETE /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 404 len: 111 microversion: 2.1 time: 0.092318 Aug 29 15:31:58.818323 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 886/1756] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:31:58 2022] DELETE /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:31:58.826427 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5e206239-3789-465b-ad83-6418681b90fc tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1121 microversion: 2.1 time: 0.289406 Aug 29 15:31:58.827046 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 871/1757] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:58 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1121 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:58.846524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:58.847425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 02663235-8b3c-44ab-adab-2cc0d57541bf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:58.857591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ab0bb4fa-2379-4fa3-b458-3950216014c2 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:58.875887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:58.876659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ab0bb4fa-2379-4fa3-b458-3950216014c2 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] [instance: 32bc300a-b702-4755-b0c2-f0004d7d5016] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:58.883479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:58.885681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:58.886760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:58.889479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:58.889898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab0bb4fa-2379-4fa3-b458-3950216014c2 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:58.890320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:58.890453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab0bb4fa-2379-4fa3-b458-3950216014c2 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:58.890835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab0bb4fa-2379-4fa3-b458-3950216014c2 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:58.891550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab0bb4fa-2379-4fa3-b458-3950216014c2 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:58.894175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab0bb4fa-2379-4fa3-b458-3950216014c2 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:58.895441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab0bb4fa-2379-4fa3-b458-3950216014c2 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:58.983158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 02663235-8b3c-44ab-adab-2cc0d57541bf] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:31:59.000517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:59.007383 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-ab0bb4fa-2379-4fa3-b458-3950216014c2 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] HTTP exception thrown: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ab0bb4fa-2379-4fa3-b458-3950216014c2 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Request method failure captured: Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 HTTP/1.1 Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNr2zWSc8mCNe1YeHT5q7G-RyrAZFHvXZkMUpKjtUCeRi9b4h6uvHR9nCnot5zQRaLwZOSJcnqwE2kRPg60dgcUjzKqHW2AvC0ZlRucqmucGSbXAXab31xpigHUj-G6RvTjGomsoA3R4OAHOVwEgEcIinlPJtN7t52PH3qyBeSoJJ_k Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: a6d0bc73ee9d4bf1b0e7bf868e2aecea Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-67603444 Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a6d0bc73ee9d4bf1b0e7bf868e2aecea", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a6d0bc73ee9d4bf1b0e7bf868e2aecea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a6d0bc73ee9d4bf1b0e7bf868e2aecea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a6d0bc73ee9d4bf1b0e7bf868e2aecea"}]}] Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-67603444 Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: a6d0bc73ee9d4bf1b0e7bf868e2aecea Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-67603444 Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AttachSCSIVolumeTestJSON-67603444-project Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: d929ec7ad45747078b9f28392e133c5b Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-67603444-project Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '32bc300a-b702-4755-b0c2-f0004d7d5016'} Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:31:59.014229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:59.019649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:31:59.019649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:31:59.019649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:31:59.019649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:31:59.019649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:31:59.019649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. Aug 29 15:31:59.019649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:31:59.019649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ab0bb4fa-2379-4fa3-b458-3950216014c2 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] Returning 404 to user: Instance 32bc300a-b702-4755-b0c2-f0004d7d5016 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:31:59.020511 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ab0bb4fa-2379-4fa3-b458-3950216014c2 tempest-AttachSCSIVolumeTestJSON-67603444 tempest-AttachSCSIVolumeTestJSON-67603444-project] 10.222.0.62 "GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016" status: 404 len: 111 microversion: 2.1 time: 0.176539 Aug 29 15:31:59.023219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:59.023912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:59.024519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:59.036153 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 872/1758] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:58 2022] GET /compute/v2.1/servers/32bc300a-b702-4755-b0c2-f0004d7d5016 => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:31:59.052439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d9d7e417-7bbb-4d79-b919-12b7c3cae410 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:59.054636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d9d7e417-7bbb-4d79-b919-12b7c3cae410 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:59.081690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9d7e417-7bbb-4d79-b919-12b7c3cae410 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:59.082371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9d7e417-7bbb-4d79-b919-12b7c3cae410 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:59.084657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9d7e417-7bbb-4d79-b919-12b7c3cae410 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:59.088311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9d7e417-7bbb-4d79-b919-12b7c3cae410 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:59.088910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9d7e417-7bbb-4d79-b919-12b7c3cae410 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:59.089388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9d7e417-7bbb-4d79-b919-12b7c3cae410 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:59.204674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lazy-loading 'flavor' on Instance uuid 02663235-8b3c-44ab-adab-2cc0d57541bf {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:59.310167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lazy-loading 'system_metadata' on Instance uuid 02663235-8b3c-44ab-adab-2cc0d57541bf {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:59.467526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:31:59.473961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lazy-loading 'metadata' on Instance uuid 02663235-8b3c-44ab-adab-2cc0d57541bf {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:31:59.530902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d9d7e417-7bbb-4d79-b919-12b7c3cae410 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:59.556175 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d9d7e417-7bbb-4d79-b919-12b7c3cae410 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 0.521066 Aug 29 15:31:59.558810 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 873/1759] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:59 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:31:59.579217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b34af6f-ed91-4479-8694-35e016cdfbeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:59.583367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6b34af6f-ed91-4479-8694-35e016cdfbeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:59.602289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b34af6f-ed91-4479-8694-35e016cdfbeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:59.604055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b34af6f-ed91-4479-8694-35e016cdfbeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:59.604737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b34af6f-ed91-4479-8694-35e016cdfbeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:59.605828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b34af6f-ed91-4479-8694-35e016cdfbeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:59.606453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b34af6f-ed91-4479-8694-35e016cdfbeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:59.607067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b34af6f-ed91-4479-8694-35e016cdfbeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:59.841118 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.scheduler.client.report [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Deleted allocations for instance 02663235-8b3c-44ab-adab-2cc0d57541bf Aug 29 15:31:59.864557 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-50546d76-cbc5-4627-b8d6-901d6ee9f24a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "DELETE /compute/v2.1/servers/02663235-8b3c-44ab-adab-2cc0d57541bf" status: 204 len: 0 microversion: 2.1 time: 1.042188 Aug 29 15:31:59.865923 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 887/1760] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:31:58 2022] DELETE /compute/v2.1/servers/02663235-8b3c-44ab-adab-2cc0d57541bf => generated 0 bytes in 1047 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:31:59.873159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ca76336e-643e-4068-9ed1-6217066d08b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:31:59.874101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ca76336e-643e-4068-9ed1-6217066d08b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:31:59.883819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca76336e-643e-4068-9ed1-6217066d08b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:59.884611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca76336e-643e-4068-9ed1-6217066d08b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:59.885245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca76336e-643e-4068-9ed1-6217066d08b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:59.886499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca76336e-643e-4068-9ed1-6217066d08b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:31:59.887325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca76336e-643e-4068-9ed1-6217066d08b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:31:59.887926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca76336e-643e-4068-9ed1-6217066d08b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:31:59.977386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b34af6f-ed91-4479-8694-35e016cdfbeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:59.996130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b34af6f-ed91-4479-8694-35e016cdfbeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:31:59.999330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b34af6f-ed91-4479-8694-35e016cdfbeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:00.005913 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6b34af6f-ed91-4479-8694-35e016cdfbeb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.444932 Aug 29 15:32:00.006692 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 874/1761] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:31:59 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:00.029407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bf8ed710-8b3d-4c42-9998-b2c7e1a37198 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:00.030717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bf8ed710-8b3d-4c42-9998-b2c7e1a37198 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:00.043748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf8ed710-8b3d-4c42-9998-b2c7e1a37198 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:00.044347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf8ed710-8b3d-4c42-9998-b2c7e1a37198 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:00.046215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf8ed710-8b3d-4c42-9998-b2c7e1a37198 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:00.050106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf8ed710-8b3d-4c42-9998-b2c7e1a37198 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:00.051022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf8ed710-8b3d-4c42-9998-b2c7e1a37198 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:00.051630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf8ed710-8b3d-4c42-9998-b2c7e1a37198 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:00.209211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bf8ed710-8b3d-4c42-9998-b2c7e1a37198 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:00.220284 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bf8ed710-8b3d-4c42-9998-b2c7e1a37198 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1219 microversion: 2.1 time: 0.212367 Aug 29 15:32:00.221329 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 875/1762] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:00 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1219 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:00.245927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f9b22ced-9685-4b2d-8538-522080ff3c50 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:00.247126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f9b22ced-9685-4b2d-8538-522080ff3c50 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 02663235-8b3c-44ab-adab-2cc0d57541bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:00.254045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f9b22ced-9685-4b2d-8538-522080ff3c50 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:00.255506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f9b22ced-9685-4b2d-8538-522080ff3c50 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:00.256247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f9b22ced-9685-4b2d-8538-522080ff3c50 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:00.257177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f9b22ced-9685-4b2d-8538-522080ff3c50 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:00.257800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f9b22ced-9685-4b2d-8538-522080ff3c50 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:00.258406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f9b22ced-9685-4b2d-8538-522080ff3c50 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:00.290930 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-f9b22ced-9685-4b2d-8538-522080ff3c50 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f9b22ced-9685-4b2d-8538-522080ff3c50 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/02663235-8b3c-44ab-adab-2cc0d57541bf HTTP/1.1 Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '02663235-8b3c-44ab-adab-2cc0d57541bf'} Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:00.292807 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:32:00.298975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:00.298975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:00.298975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:00.298975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:32:00.298975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:32:00.298975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. Aug 29 15:32:00.298975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:32:00.306160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f9b22ced-9685-4b2d-8538-522080ff3c50 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:32:00.307301 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f9b22ced-9685-4b2d-8538-522080ff3c50 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/02663235-8b3c-44ab-adab-2cc0d57541bf" status: 404 len: 111 microversion: 2.1 time: 0.076191 Aug 29 15:32:00.308381 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 876/1763] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:00 2022] GET /compute/v2.1/servers/02663235-8b3c-44ab-adab-2cc0d57541bf => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:32:00.462844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ca76336e-643e-4068-9ed1-6217066d08b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:00.477718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-145518212", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "cb3199df-483a-4605-86c6-a5d65679d5da"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:00.483777 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ca76336e-643e-4068-9ed1-6217066d08b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.616086 Aug 29 15:32:00.484373 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 888/1764] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:31:59 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:00.545179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] validate_networks() for [('cb3199df-483a-4605-86c6-a5d65679d5da', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:32:00.915746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-853777a1-d48c-45a5-9525-c2d9d15e3354 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:00.917056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-853777a1-d48c-45a5-9525-c2d9d15e3354 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:00.940136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-853777a1-d48c-45a5-9525-c2d9d15e3354 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:00.941039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-853777a1-d48c-45a5-9525-c2d9d15e3354 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:00.941793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-853777a1-d48c-45a5-9525-c2d9d15e3354 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:00.942761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-853777a1-d48c-45a5-9525-c2d9d15e3354 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:00.943511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-853777a1-d48c-45a5-9525-c2d9d15e3354 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:00.944282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-853777a1-d48c-45a5-9525-c2d9d15e3354 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:01.257485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:32:01.257761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:32:01.258224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:32:01.259237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:32:01.259677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:32:01.279428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:01.281195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:01.281937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:01.284337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:01.287587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:01.290095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:01.339433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Getting quotas for project bbbc9e55a8f24d70a82b79243b0fa9e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:01.348797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Getting quotas for user 8dbbadfdb27047dd9237f4a1d311867e and project bbbc9e55a8f24d70a82b79243b0fa9e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:01.380211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:32:01.382652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:32:01.515807 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e34b7da2-3bf9-4548-b43a-d38e65ad55ef tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.038327 Aug 29 15:32:01.517190 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 877/1765] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:32:01.537481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2a9ca1c3-e8e2-4e6d-8e38-ffd91c18ab31 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:01.540970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2a9ca1c3-e8e2-4e6d-8e38-ffd91c18ab31 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:01.556515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a9ca1c3-e8e2-4e6d-8e38-ffd91c18ab31 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:01.560135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a9ca1c3-e8e2-4e6d-8e38-ffd91c18ab31 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:01.562249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a9ca1c3-e8e2-4e6d-8e38-ffd91c18ab31 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:01.563621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a9ca1c3-e8e2-4e6d-8e38-ffd91c18ab31 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:01.567616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a9ca1c3-e8e2-4e6d-8e38-ffd91c18ab31 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:01.568333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a9ca1c3-e8e2-4e6d-8e38-ffd91c18ab31 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:01.810471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2a9ca1c3-e8e2-4e6d-8e38-ffd91c18ab31 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:01.820132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2a9ca1c3-e8e2-4e6d-8e38-ffd91c18ab31 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:01.821605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2a9ca1c3-e8e2-4e6d-8e38-ffd91c18ab31 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:01.822962 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2a9ca1c3-e8e2-4e6d-8e38-ffd91c18ab31 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1815 microversion: 2.25 time: 0.300558 Aug 29 15:32:01.865016 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 878/1766] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:01 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1815 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:01.884632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-28032400-11b8-4c68-b84e-56c501d0ae53 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:01.885380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-28032400-11b8-4c68-b84e-56c501d0ae53 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:01.893895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28032400-11b8-4c68-b84e-56c501d0ae53 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:01.895728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28032400-11b8-4c68-b84e-56c501d0ae53 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:01.896585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28032400-11b8-4c68-b84e-56c501d0ae53 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:01.898511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28032400-11b8-4c68-b84e-56c501d0ae53 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:01.899080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28032400-11b8-4c68-b84e-56c501d0ae53 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:01.899707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28032400-11b8-4c68-b84e-56c501d0ae53 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:01.995581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-28032400-11b8-4c68-b84e-56c501d0ae53 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:02.005466 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-28032400-11b8-4c68-b84e-56c501d0ae53 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1237 microversion: 2.1 time: 0.139216 Aug 29 15:32:02.019088 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 879/1767] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:01 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1237 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:02.029500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ce8ae9ce-ab67-4c6e-93e6-f0c6b0ccd90f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:02.030770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ce8ae9ce-ab67-4c6e-93e6-f0c6b0ccd90f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:02.045627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce8ae9ce-ab67-4c6e-93e6-f0c6b0ccd90f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:02.046135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce8ae9ce-ab67-4c6e-93e6-f0c6b0ccd90f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:02.048230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce8ae9ce-ab67-4c6e-93e6-f0c6b0ccd90f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:02.050091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce8ae9ce-ab67-4c6e-93e6-f0c6b0ccd90f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:02.050295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce8ae9ce-ab67-4c6e-93e6-f0c6b0ccd90f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:02.052906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce8ae9ce-ab67-4c6e-93e6-f0c6b0ccd90f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:02.247330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-853777a1-d48c-45a5-9525-c2d9d15e3354 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:02.279764 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-853777a1-d48c-45a5-9525-c2d9d15e3354 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 1.703178 Aug 29 15:32:02.285371 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 889/1768] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:00 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:02.308609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0e16f794-7c6a-49d4-83b1-25624fc16d03 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:02.311062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0e16f794-7c6a-49d4-83b1-25624fc16d03 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:02.458135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ce8ae9ce-ab67-4c6e-93e6-f0c6b0ccd90f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:02.466347 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ce8ae9ce-ab67-4c6e-93e6-f0c6b0ccd90f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.445739 Aug 29 15:32:02.467488 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 880/1769] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:02 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:02.554402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0e16f794-7c6a-49d4-83b1-25624fc16d03 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:02.566263 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0e16f794-7c6a-49d4-83b1-25624fc16d03 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1214 microversion: 2.1 time: 0.276691 Aug 29 15:32:02.566893 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 890/1770] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:02 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1214 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:02.850806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-18058d42-b14f-4b7b-8044-23eb0ed09e32 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:02.851443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-18058d42-b14f-4b7b-8044-23eb0ed09e32 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:02.870789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18058d42-b14f-4b7b-8044-23eb0ed09e32 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:02.871288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18058d42-b14f-4b7b-8044-23eb0ed09e32 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:02.871724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18058d42-b14f-4b7b-8044-23eb0ed09e32 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:02.872440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18058d42-b14f-4b7b-8044-23eb0ed09e32 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:02.872892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18058d42-b14f-4b7b-8044-23eb0ed09e32 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:02.873343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18058d42-b14f-4b7b-8044-23eb0ed09e32 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.033349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-125902b4-a34a-48e4-8628-4dc6ba98253c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:03.034024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-125902b4-a34a-48e4-8628-4dc6ba98253c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:03.044740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125902b4-a34a-48e4-8628-4dc6ba98253c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.045357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125902b4-a34a-48e4-8628-4dc6ba98253c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.045803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125902b4-a34a-48e4-8628-4dc6ba98253c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.046529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125902b4-a34a-48e4-8628-4dc6ba98253c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.046999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125902b4-a34a-48e4-8628-4dc6ba98253c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.047434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125902b4-a34a-48e4-8628-4dc6ba98253c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.172576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-18058d42-b14f-4b7b-8044-23eb0ed09e32 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:03.182594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-18058d42-b14f-4b7b-8044-23eb0ed09e32 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:03.184029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-18058d42-b14f-4b7b-8044-23eb0ed09e32 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:03.193373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-125902b4-a34a-48e4-8628-4dc6ba98253c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:03.195783 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-18058d42-b14f-4b7b-8044-23eb0ed09e32 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1805 microversion: 2.25 time: 0.338684 Aug 29 15:32:03.205961 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-125902b4-a34a-48e4-8628-4dc6ba98253c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1237 microversion: 2.1 time: 0.179689 Aug 29 15:32:03.214829 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 881/1771] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:02 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1805 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:03.219225 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 891/1772] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:03 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1237 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:03.220168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d63c32a-fd94-41c8-b7c4-1a8c29ba82cc tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '.version_select at 0x7fc42b5bb3a0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:03.234378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d63c32a-fd94-41c8-b7c4-1a8c29ba82cc tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.235575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d63c32a-fd94-41c8-b7c4-1a8c29ba82cc tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.236762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d63c32a-fd94-41c8-b7c4-1a8c29ba82cc tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.271911 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d63c32a-fd94-41c8-b7c4-1a8c29ba82cc tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/os-migrations" status: 200 len: 3478 microversion: 2.25 time: 0.054386 Aug 29 15:32:03.273811 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 882/1773] 10.222.0.62 () {60 vars in 1184 bytes} [Mon Aug 29 15:32:03 2022] GET /compute/v2.1/os-migrations => generated 3478 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:03.292379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d2e8cc5a-bd6b-4fe9-9237-fa923d958022 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:03.294492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d2e8cc5a-bd6b-4fe9-9237-fa923d958022 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:03.307740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-087df905-ee94-494c-81e3-63212c5a0ffb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:03.310159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-087df905-ee94-494c-81e3-63212c5a0ffb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:03.327262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2e8cc5a-bd6b-4fe9-9237-fa923d958022 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.327791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2e8cc5a-bd6b-4fe9-9237-fa923d958022 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.329059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-087df905-ee94-494c-81e3-63212c5a0ffb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.330516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-087df905-ee94-494c-81e3-63212c5a0ffb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.330911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2e8cc5a-bd6b-4fe9-9237-fa923d958022 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.332837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2e8cc5a-bd6b-4fe9-9237-fa923d958022 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.333914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-087df905-ee94-494c-81e3-63212c5a0ffb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.339172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2e8cc5a-bd6b-4fe9-9237-fa923d958022 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.339728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-087df905-ee94-494c-81e3-63212c5a0ffb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.340498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-087df905-ee94-494c-81e3-63212c5a0ffb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.343128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2e8cc5a-bd6b-4fe9-9237-fa923d958022 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.344454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-087df905-ee94-494c-81e3-63212c5a0ffb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.861697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-087df905-ee94-494c-81e3-63212c5a0ffb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:03.873594 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-087df905-ee94-494c-81e3-63212c5a0ffb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 0.571572 Aug 29 15:32:03.888174 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 883/1774] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:03 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:03.888914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-20846b60-d00c-4b2e-90ab-8dc33788d21f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:03.889572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-20846b60-d00c-4b2e-90ab-8dc33788d21f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:03.893222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-d2e8cc5a-bd6b-4fe9-9237-fa923d958022 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'services' on Instance uuid 982d1df4-7b96-4fbf-8ec2-61752962955d {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:03.905568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20846b60-d00c-4b2e-90ab-8dc33788d21f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.906082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20846b60-d00c-4b2e-90ab-8dc33788d21f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.906549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20846b60-d00c-4b2e-90ab-8dc33788d21f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.911381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20846b60-d00c-4b2e-90ab-8dc33788d21f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.911859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20846b60-d00c-4b2e-90ab-8dc33788d21f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.912282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20846b60-d00c-4b2e-90ab-8dc33788d21f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.926152 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d2e8cc5a-bd6b-4fe9-9237-fa923d958022 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 2426 microversion: 2.25 time: 0.638763 Aug 29 15:32:03.947765 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 892/1775] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:03 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 2426 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:03.953238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-17f91a4f-31f1-4208-b41b-d23229e06708 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:03.953860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-17f91a4f-31f1-4208-b41b-d23229e06708 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:03.965988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17f91a4f-31f1-4208-b41b-d23229e06708 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.966492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17f91a4f-31f1-4208-b41b-d23229e06708 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.966938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17f91a4f-31f1-4208-b41b-d23229e06708 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:03.969648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17f91a4f-31f1-4208-b41b-d23229e06708 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:03.970144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17f91a4f-31f1-4208-b41b-d23229e06708 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:03.970590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17f91a4f-31f1-4208-b41b-d23229e06708 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:04.362720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-17f91a4f-31f1-4208-b41b-d23229e06708 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:04.372393 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-17f91a4f-31f1-4208-b41b-d23229e06708 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1210 microversion: 2.1 time: 0.423328 Aug 29 15:32:04.377926 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 893/1776] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:03 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1210 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:04.391679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c8212389-8087-43ce-920b-dcb1654c1e4c tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:04.392592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c8212389-8087-43ce-920b-dcb1654c1e4c tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:04.403225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8212389-8087-43ce-920b-dcb1654c1e4c tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:04.403910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8212389-8087-43ce-920b-dcb1654c1e4c tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:04.406429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8212389-8087-43ce-920b-dcb1654c1e4c tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:04.409748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8212389-8087-43ce-920b-dcb1654c1e4c tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:04.412178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8212389-8087-43ce-920b-dcb1654c1e4c tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:04.413266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-20846b60-d00c-4b2e-90ab-8dc33788d21f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:04.413731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8212389-8087-43ce-920b-dcb1654c1e4c tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:04.430908 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-20846b60-d00c-4b2e-90ab-8dc33788d21f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1476 microversion: 2.1 time: 0.551074 Aug 29 15:32:04.464418 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 884/1777] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:03 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1476 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:04.471556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a7813b5e-bbef-4caf-b75d-d7cf1b8ddedf tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:04.472176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a7813b5e-bbef-4caf-b75d-d7cf1b8ddedf tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:04.500667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7813b5e-bbef-4caf-b75d-d7cf1b8ddedf tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:04.502003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7813b5e-bbef-4caf-b75d-d7cf1b8ddedf tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:04.503141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7813b5e-bbef-4caf-b75d-d7cf1b8ddedf tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:04.504477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7813b5e-bbef-4caf-b75d-d7cf1b8ddedf tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:04.511234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7813b5e-bbef-4caf-b75d-d7cf1b8ddedf tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:04.515880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7813b5e-bbef-4caf-b75d-d7cf1b8ddedf tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:04.707924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a7813b5e-bbef-4caf-b75d-d7cf1b8ddedf tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:04.712655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:04.730741 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a7813b5e-bbef-4caf-b75d-d7cf1b8ddedf tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1237 microversion: 2.1 time: 0.261664 Aug 29 15:32:04.732025 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 885/1778] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:04 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1237 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:04.895719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7061c245-164b-4174-af3d-0301b8a61dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:04.897127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7061c245-164b-4174-af3d-0301b8a61dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:04.917502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7061c245-164b-4174-af3d-0301b8a61dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:04.919933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7061c245-164b-4174-af3d-0301b8a61dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:04.920797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7061c245-164b-4174-af3d-0301b8a61dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:04.924066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7061c245-164b-4174-af3d-0301b8a61dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:04.924835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7061c245-164b-4174-af3d-0301b8a61dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:04.925550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7061c245-164b-4174-af3d-0301b8a61dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.258135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7061c245-164b-4174-af3d-0301b8a61dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:05.282303 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7061c245-164b-4174-af3d-0301b8a61dc8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 0.390644 Aug 29 15:32:05.284895 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 886/1779] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:04 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:05.376488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-c8212389-8087-43ce-920b-dcb1654c1e4c tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'services' on Instance uuid 982d1df4-7b96-4fbf-8ec2-61752962955d {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:05.400402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c1a838f5-b6a5-4c6b-af61-b7c933cbe249 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:05.407413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c1a838f5-b6a5-4c6b-af61-b7c933cbe249 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:05.416265 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c8212389-8087-43ce-920b-dcb1654c1e4c tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 2426 microversion: 2.25 time: 1.035580 Aug 29 15:32:05.420031 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 894/1780] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:04 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 2426 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:05.447371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1a838f5-b6a5-4c6b-af61-b7c933cbe249 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.448110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1a838f5-b6a5-4c6b-af61-b7c933cbe249 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.451293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1a838f5-b6a5-4c6b-af61-b7c933cbe249 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.452415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1a838f5-b6a5-4c6b-af61-b7c933cbe249 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.456270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1a838f5-b6a5-4c6b-af61-b7c933cbe249 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.466359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1a838f5-b6a5-4c6b-af61-b7c933cbe249 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.473330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-60adc8be-1062-4a6c-933a-a804a80e6b14 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:05.474406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-60adc8be-1062-4a6c-933a-a804a80e6b14 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:05.486183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60adc8be-1062-4a6c-933a-a804a80e6b14 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.491545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60adc8be-1062-4a6c-933a-a804a80e6b14 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.492280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60adc8be-1062-4a6c-933a-a804a80e6b14 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.493516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60adc8be-1062-4a6c-933a-a804a80e6b14 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.494376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60adc8be-1062-4a6c-933a-a804a80e6b14 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.495061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60adc8be-1062-4a6c-933a-a804a80e6b14 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.739607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c1a838f5-b6a5-4c6b-af61-b7c933cbe249 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:05.764223 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c1a838f5-b6a5-4c6b-af61-b7c933cbe249 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1266 microversion: 2.1 time: 0.364298 Aug 29 15:32:05.765644 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 887/1781] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:05 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1266 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:05.771252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fa2c6df1-60b2-4694-afd6-008155f9c184 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:05.772018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fa2c6df1-60b2-4694-afd6-008155f9c184 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:05.783024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa2c6df1-60b2-4694-afd6-008155f9c184 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.785814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa2c6df1-60b2-4694-afd6-008155f9c184 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.786514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa2c6df1-60b2-4694-afd6-008155f9c184 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:05.787479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa2c6df1-60b2-4694-afd6-008155f9c184 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:05.788422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa2c6df1-60b2-4694-afd6-008155f9c184 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:05.789052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa2c6df1-60b2-4694-afd6-008155f9c184 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:06.010170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-fa2c6df1-60b2-4694-afd6-008155f9c184 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lazy-loading 'services' on Instance uuid 982d1df4-7b96-4fbf-8ec2-61752962955d {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:06.155650 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fa2c6df1-60b2-4694-afd6-008155f9c184 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "DELETE /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments/13cb34f6-5aad-42bb-8f40-776dca182a21" status: 202 len: 0 microversion: 2.25 time: 0.385234 Aug 29 15:32:06.157901 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 888/1782] 10.222.0.62 () {60 vars in 1457 bytes} [Mon Aug 29 15:32:05 2022] DELETE /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments/13cb34f6-5aad-42bb-8f40-776dca182a21 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:06.162424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-60adc8be-1062-4a6c-933a-a804a80e6b14 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:06.172750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fba224f3-6ef9-46bd-a830-211273343609 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:06.174043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fba224f3-6ef9-46bd-a830-211273343609 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:06.175032 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-60adc8be-1062-4a6c-933a-a804a80e6b14 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1475 microversion: 2.1 time: 0.706610 Aug 29 15:32:06.191085 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 895/1783] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:05 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1475 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:06.197903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ac02a369-c208-46aa-a3a4-90db9ea68459 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:06.200368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ac02a369-c208-46aa-a3a4-90db9ea68459 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:06.210269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac02a369-c208-46aa-a3a4-90db9ea68459 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:06.214898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac02a369-c208-46aa-a3a4-90db9ea68459 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:06.215710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac02a369-c208-46aa-a3a4-90db9ea68459 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:06.216550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fba224f3-6ef9-46bd-a830-211273343609 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:06.216991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac02a369-c208-46aa-a3a4-90db9ea68459 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:06.217715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac02a369-c208-46aa-a3a4-90db9ea68459 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:06.218405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac02a369-c208-46aa-a3a4-90db9ea68459 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:06.219654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fba224f3-6ef9-46bd-a830-211273343609 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:06.220110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fba224f3-6ef9-46bd-a830-211273343609 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:06.220972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fba224f3-6ef9-46bd-a830-211273343609 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:06.221496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fba224f3-6ef9-46bd-a830-211273343609 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:06.221932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fba224f3-6ef9-46bd-a830-211273343609 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:06.299615 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ac02a369-c208-46aa-a3a4-90db9ea68459 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.120476 Aug 29 15:32:06.300998 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 896/1784] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:32:06 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:32:06.312149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-93d05f7e-d155-46f0-bbfa-caaac5fb0c77 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:06.314902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-93d05f7e-d155-46f0-bbfa-caaac5fb0c77 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:06.331861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93d05f7e-d155-46f0-bbfa-caaac5fb0c77 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:06.332820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93d05f7e-d155-46f0-bbfa-caaac5fb0c77 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:06.336020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93d05f7e-d155-46f0-bbfa-caaac5fb0c77 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:06.337131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93d05f7e-d155-46f0-bbfa-caaac5fb0c77 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:06.337886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93d05f7e-d155-46f0-bbfa-caaac5fb0c77 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:06.338539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93d05f7e-d155-46f0-bbfa-caaac5fb0c77 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:07.196306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:07.269422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fba224f3-6ef9-46bd-a830-211273343609 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:07.278567 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fba224f3-6ef9-46bd-a830-211273343609 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1305 microversion: 2.1 time: 1.117958 Aug 29 15:32:07.293477 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 889/1785] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:06 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1305 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:07.299198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98212a4d-5528-4e44-ab2e-6a35c7863088 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:07.300127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-98212a4d-5528-4e44-ab2e-6a35c7863088 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:07.310645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98212a4d-5528-4e44-ab2e-6a35c7863088 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:07.311364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98212a4d-5528-4e44-ab2e-6a35c7863088 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:07.318560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98212a4d-5528-4e44-ab2e-6a35c7863088 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:07.320775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98212a4d-5528-4e44-ab2e-6a35c7863088 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:07.321486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98212a4d-5528-4e44-ab2e-6a35c7863088 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:07.322083 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98212a4d-5528-4e44-ab2e-6a35c7863088 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:07.449992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-93d05f7e-d155-46f0-bbfa-caaac5fb0c77 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:07.462144 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-93d05f7e-d155-46f0-bbfa-caaac5fb0c77 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 1.154588 Aug 29 15:32:07.489965 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 897/1786] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:06 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:07.496505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d630bc1c-4bf4-455a-8f2f-0fa99560f2b5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:07.498095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d630bc1c-4bf4-455a-8f2f-0fa99560f2b5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:07.506703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d630bc1c-4bf4-455a-8f2f-0fa99560f2b5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:07.507626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d630bc1c-4bf4-455a-8f2f-0fa99560f2b5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:07.508852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d630bc1c-4bf4-455a-8f2f-0fa99560f2b5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:07.527510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d630bc1c-4bf4-455a-8f2f-0fa99560f2b5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:07.532585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d630bc1c-4bf4-455a-8f2f-0fa99560f2b5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:07.533989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d630bc1c-4bf4-455a-8f2f-0fa99560f2b5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:07.576806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-98212a4d-5528-4e44-ab2e-6a35c7863088 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:07.589628 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-98212a4d-5528-4e44-ab2e-6a35c7863088 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1272 microversion: 2.1 time: 0.294587 Aug 29 15:32:07.590894 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 890/1787] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:07 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1272 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:07.601176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d05f153-1aa5-451b-96e5-1e632a356df7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:07.603811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2d05f153-1aa5-451b-96e5-1e632a356df7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:07.619401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d05f153-1aa5-451b-96e5-1e632a356df7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:07.622205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d05f153-1aa5-451b-96e5-1e632a356df7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:07.622982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d05f153-1aa5-451b-96e5-1e632a356df7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:07.623981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d05f153-1aa5-451b-96e5-1e632a356df7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:07.637913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d05f153-1aa5-451b-96e5-1e632a356df7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:07.638756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d05f153-1aa5-451b-96e5-1e632a356df7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:07.698440 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d05f153-1aa5-451b-96e5-1e632a356df7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106154 Aug 29 15:32:07.699042 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 891/1788] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:32:07 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:32:07.986095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-4e0b97ce-71bd-4db7-b0b1-54e4746a2213 req-ab5f2c73-50bd-4b44-bfb4-7d358403c5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a3c2ae-98a2-4e37-96ef-3e787faf0d11", "name": "network-vif-unplugged", "status": "completed", "tag": "7a9162b3-e31e-4ebc-b3c4-b04ef19e4065"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:08.005341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4e0b97ce-71bd-4db7-b0b1-54e4746a2213 req-ab5f2c73-50bd-4b44-bfb4-7d358403c5c8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:08.012543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4e0b97ce-71bd-4db7-b0b1-54e4746a2213 req-ab5f2c73-50bd-4b44-bfb4-7d358403c5c8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:08.013000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4e0b97ce-71bd-4db7-b0b1-54e4746a2213 req-ab5f2c73-50bd-4b44-bfb4-7d358403c5c8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:08.043316 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-4e0b97ce-71bd-4db7-b0b1-54e4746a2213 req-ab5f2c73-50bd-4b44-bfb4-7d358403c5c8 service nova] Creating event network-vif-unplugged:7a9162b3-e31e-4ebc-b3c4-b04ef19e4065 for instance 51a3c2ae-98a2-4e37-96ef-3e787faf0d11 on n-h2-839401-11 Aug 29 15:32:08.071509 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-4e0b97ce-71bd-4db7-b0b1-54e4746a2213 req-ab5f2c73-50bd-4b44-bfb4-7d358403c5c8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.371205 Aug 29 15:32:08.072129 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 892/1789] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:08.307732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1d64a593-f7ad-4f7f-8bbd-aeacca19a7db tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:08.308344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1d64a593-f7ad-4f7f-8bbd-aeacca19a7db tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:08.321965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d64a593-f7ad-4f7f-8bbd-aeacca19a7db tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:08.324351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d64a593-f7ad-4f7f-8bbd-aeacca19a7db tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:08.325879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d64a593-f7ad-4f7f-8bbd-aeacca19a7db tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:08.328439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d64a593-f7ad-4f7f-8bbd-aeacca19a7db tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:08.329644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d64a593-f7ad-4f7f-8bbd-aeacca19a7db tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:08.331894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d64a593-f7ad-4f7f-8bbd-aeacca19a7db tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:08.529569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d630bc1c-4bf4-455a-8f2f-0fa99560f2b5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:08.539292 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d630bc1c-4bf4-455a-8f2f-0fa99560f2b5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1475 microversion: 2.1 time: 1.047634 Aug 29 15:32:08.550103 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 898/1790] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:07 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1475 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:08.556274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9ee418ee-79b3-41f3-bab8-bb6ba4a569bd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:08.557261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9ee418ee-79b3-41f3-bab8-bb6ba4a569bd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:08.570075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ee418ee-79b3-41f3-bab8-bb6ba4a569bd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:08.571116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ee418ee-79b3-41f3-bab8-bb6ba4a569bd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:08.571886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ee418ee-79b3-41f3-bab8-bb6ba4a569bd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:08.572863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ee418ee-79b3-41f3-bab8-bb6ba4a569bd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:08.575511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ee418ee-79b3-41f3-bab8-bb6ba4a569bd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:08.576220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ee418ee-79b3-41f3-bab8-bb6ba4a569bd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.083146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1d64a593-f7ad-4f7f-8bbd-aeacca19a7db tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:09.095988 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1d64a593-f7ad-4f7f-8bbd-aeacca19a7db tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1305 microversion: 2.1 time: 0.789074 Aug 29 15:32:09.096648 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 893/1791] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:08 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1305 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:09.120259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e8f25417-69c7-4528-a371-4b31153f7978 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:09.121162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e8f25417-69c7-4528-a371-4b31153f7978 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:09.136223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8f25417-69c7-4528-a371-4b31153f7978 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:09.137140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8f25417-69c7-4528-a371-4b31153f7978 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:09.138498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8f25417-69c7-4528-a371-4b31153f7978 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.140702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8f25417-69c7-4528-a371-4b31153f7978 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:09.142051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8f25417-69c7-4528-a371-4b31153f7978 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:09.142734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8f25417-69c7-4528-a371-4b31153f7978 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.279955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e8f25417-69c7-4528-a371-4b31153f7978 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:09.293125 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e8f25417-69c7-4528-a371-4b31153f7978 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1272 microversion: 2.1 time: 0.179601 Aug 29 15:32:09.294090 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 894/1792] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:09 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1272 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:09.309871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-37baaba4-21d3-4383-85f1-a3ba4c7213ff req-adb50182-23f5-455f-8e65-535f002f7a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab2a8c5-99e8-428d-99e2-3c62d1d86e3e", "name": "network-vif-unplugged", "status": "completed", "tag": "da67ee23-a789-4121-8fed-92df23ce0b7e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:09.326600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:09.334183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-37baaba4-21d3-4383-85f1-a3ba4c7213ff req-adb50182-23f5-455f-8e65-535f002f7a71 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:09.334982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-37baaba4-21d3-4383-85f1-a3ba4c7213ff req-adb50182-23f5-455f-8e65-535f002f7a71 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:09.335648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-37baaba4-21d3-4383-85f1-a3ba4c7213ff req-adb50182-23f5-455f-8e65-535f002f7a71 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.369525 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-37baaba4-21d3-4383-85f1-a3ba4c7213ff req-adb50182-23f5-455f-8e65-535f002f7a71 service nova] Creating event network-vif-unplugged:da67ee23-a789-4121-8fed-92df23ce0b7e for instance dab2a8c5-99e8-428d-99e2-3c62d1d86e3e on n-h2-839401-11 Aug 29 15:32:09.422019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-37baaba4-21d3-4383-85f1-a3ba4c7213ff req-adb50182-23f5-455f-8e65-535f002f7a71 service nova] Instance dab2a8c5-99e8-428d-99e2-3c62d1d86e3e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:32:09.440494 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-37baaba4-21d3-4383-85f1-a3ba4c7213ff req-adb50182-23f5-455f-8e65-535f002f7a71 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143877 Aug 29 15:32:09.441707 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 895/1793] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:09.448021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-258a56db-7cd3-409b-b609-7861c1d504ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:09.450795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-258a56db-7cd3-409b-b609-7861c1d504ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:09.458010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-258a56db-7cd3-409b-b609-7861c1d504ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:09.458900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-258a56db-7cd3-409b-b609-7861c1d504ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:09.459523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-258a56db-7cd3-409b-b609-7861c1d504ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.460564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-258a56db-7cd3-409b-b609-7861c1d504ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:09.461244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-258a56db-7cd3-409b-b609-7861c1d504ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:09.462200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-258a56db-7cd3-409b-b609-7861c1d504ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.470600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9ee418ee-79b3-41f3-bab8-bb6ba4a569bd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:09.483921 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9ee418ee-79b3-41f3-bab8-bb6ba4a569bd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 0.932362 Aug 29 15:32:09.497211 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 899/1794] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:08 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:09.563591 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-258a56db-7cd3-409b-b609-7861c1d504ed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119437 Aug 29 15:32:09.564525 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 896/1795] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:32:09 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:32:09.574820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b5cf92e3-1e26-453f-95a1-e56356a4ace9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:09.575553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b5cf92e3-1e26-453f-95a1-e56356a4ace9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:09.591408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5cf92e3-1e26-453f-95a1-e56356a4ace9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:09.596453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5cf92e3-1e26-453f-95a1-e56356a4ace9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:09.597357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5cf92e3-1e26-453f-95a1-e56356a4ace9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:09.600925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5cf92e3-1e26-453f-95a1-e56356a4ace9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:09.601563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5cf92e3-1e26-453f-95a1-e56356a4ace9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:09.602163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5cf92e3-1e26-453f-95a1-e56356a4ace9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:10.125817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d61ef899-bebf-4d0f-8984-33da2714a811 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:10.127608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d61ef899-bebf-4d0f-8984-33da2714a811 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:10.148495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d61ef899-bebf-4d0f-8984-33da2714a811 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:10.149222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d61ef899-bebf-4d0f-8984-33da2714a811 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:10.149777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d61ef899-bebf-4d0f-8984-33da2714a811 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:10.150632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d61ef899-bebf-4d0f-8984-33da2714a811 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:10.152453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d61ef899-bebf-4d0f-8984-33da2714a811 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:10.154698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d61ef899-bebf-4d0f-8984-33da2714a811 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:10.674614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d61ef899-bebf-4d0f-8984-33da2714a811 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:10.685061 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d61ef899-bebf-4d0f-8984-33da2714a811 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1305 microversion: 2.1 time: 0.567634 Aug 29 15:32:10.706553 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 897/1796] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:10 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1305 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:10.711520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-0bf0c98c-e946-48a0-998a-e2a850f4cf13 req-08d6ff9e-0a8b-46f6-ae90-75b2da64ccfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a3c2ae-98a2-4e37-96ef-3e787faf0d11", "tag": "7a9162b3-e31e-4ebc-b3c4-b04ef19e4065"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:10.744769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0bf0c98c-e946-48a0-998a-e2a850f4cf13 req-08d6ff9e-0a8b-46f6-ae90-75b2da64ccfe service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:10.746216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0bf0c98c-e946-48a0-998a-e2a850f4cf13 req-08d6ff9e-0a8b-46f6-ae90-75b2da64ccfe service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:10.747363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0bf0c98c-e946-48a0-998a-e2a850f4cf13 req-08d6ff9e-0a8b-46f6-ae90-75b2da64ccfe service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:10.770432 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-0bf0c98c-e946-48a0-998a-e2a850f4cf13 req-08d6ff9e-0a8b-46f6-ae90-75b2da64ccfe service nova] Creating event network-changed:7a9162b3-e31e-4ebc-b3c4-b04ef19e4065 for instance 51a3c2ae-98a2-4e37-96ef-3e787faf0d11 on n-h2-839401-11 Aug 29 15:32:10.784374 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-0bf0c98c-e946-48a0-998a-e2a850f4cf13 req-08d6ff9e-0a8b-46f6-ae90-75b2da64ccfe service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076106 Aug 29 15:32:10.785571 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 898/1797] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:10.791521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2565adf3-2df6-43df-9ca4-1874efe7b7fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:10.800477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2565adf3-2df6-43df-9ca4-1874efe7b7fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:10.821053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2565adf3-2df6-43df-9ca4-1874efe7b7fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:10.825847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2565adf3-2df6-43df-9ca4-1874efe7b7fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:10.826554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2565adf3-2df6-43df-9ca4-1874efe7b7fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:10.827977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2565adf3-2df6-43df-9ca4-1874efe7b7fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:10.829767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2565adf3-2df6-43df-9ca4-1874efe7b7fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:10.830546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2565adf3-2df6-43df-9ca4-1874efe7b7fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:11.305434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:11.370720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=16 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:12.142822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b5cf92e3-1e26-453f-95a1-e56356a4ace9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:12.158306 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b5cf92e3-1e26-453f-95a1-e56356a4ace9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1475 microversion: 2.1 time: 2.582474 Aug 29 15:32:12.172343 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 900/1798] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:09 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1475 bytes in 2589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:12.176225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ca39f8a6-6c80-4c07-bb1d-1a051d843368 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:12.178884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ca39f8a6-6c80-4c07-bb1d-1a051d843368 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:12.198193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca39f8a6-6c80-4c07-bb1d-1a051d843368 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:12.198821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca39f8a6-6c80-4c07-bb1d-1a051d843368 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:12.199553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca39f8a6-6c80-4c07-bb1d-1a051d843368 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.203878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2565adf3-2df6-43df-9ca4-1874efe7b7fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:12.213397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca39f8a6-6c80-4c07-bb1d-1a051d843368 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:12.214472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca39f8a6-6c80-4c07-bb1d-1a051d843368 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:12.216779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca39f8a6-6c80-4c07-bb1d-1a051d843368 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.218138 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2565adf3-2df6-43df-9ca4-1874efe7b7fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1314 microversion: 2.1 time: 1.428428 Aug 29 15:32:12.222990 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 899/1799] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:10 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1314 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:12.238176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d99b3d86-a388-4e40-9c78-0d319b21dd80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:12.249811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d99b3d86-a388-4e40-9c78-0d319b21dd80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:12.279780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d99b3d86-a388-4e40-9c78-0d319b21dd80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:12.284904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d99b3d86-a388-4e40-9c78-0d319b21dd80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:12.296163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d99b3d86-a388-4e40-9c78-0d319b21dd80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.302307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d99b3d86-a388-4e40-9c78-0d319b21dd80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:12.302876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d99b3d86-a388-4e40-9c78-0d319b21dd80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:12.303330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d99b3d86-a388-4e40-9c78-0d319b21dd80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.312017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:12.400451 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d99b3d86-a388-4e40-9c78-0d319b21dd80 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.176265 Aug 29 15:32:12.401495 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 900/1800] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:32:12 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:32:12.412476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-19663940-0143-41fc-a81b-2dae337ffb03 req-8b98853a-ad2d-4467-9ddb-c3c1d9d99539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab2a8c5-99e8-428d-99e2-3c62d1d86e3e", "tag": "da67ee23-a789-4121-8fed-92df23ce0b7e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:12.443922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-19663940-0143-41fc-a81b-2dae337ffb03 req-8b98853a-ad2d-4467-9ddb-c3c1d9d99539 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:12.444679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-19663940-0143-41fc-a81b-2dae337ffb03 req-8b98853a-ad2d-4467-9ddb-c3c1d9d99539 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:12.445715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-19663940-0143-41fc-a81b-2dae337ffb03 req-8b98853a-ad2d-4467-9ddb-c3c1d9d99539 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.466925 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-19663940-0143-41fc-a81b-2dae337ffb03 req-8b98853a-ad2d-4467-9ddb-c3c1d9d99539 service nova] Creating event network-changed:da67ee23-a789-4121-8fed-92df23ce0b7e for instance dab2a8c5-99e8-428d-99e2-3c62d1d86e3e on n-h2-839401-11 Aug 29 15:32:12.483110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-19663940-0143-41fc-a81b-2dae337ffb03 req-8b98853a-ad2d-4467-9ddb-c3c1d9d99539 service nova] Instance dab2a8c5-99e8-428d-99e2-3c62d1d86e3e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:32:12.501384 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-19663940-0143-41fc-a81b-2dae337ffb03 req-8b98853a-ad2d-4467-9ddb-c3c1d9d99539 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097926 Aug 29 15:32:12.502465 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 901/1801] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:12.512075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-725cbc08-1dd6-4403-8ec5-dd5343e3e4d0 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:12.514452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-725cbc08-1dd6-4403-8ec5-dd5343e3e4d0 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:12.531408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-725cbc08-1dd6-4403-8ec5-dd5343e3e4d0 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:12.533191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-725cbc08-1dd6-4403-8ec5-dd5343e3e4d0 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:12.533996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-725cbc08-1dd6-4403-8ec5-dd5343e3e4d0 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.535013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-725cbc08-1dd6-4403-8ec5-dd5343e3e4d0 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:12.536214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-725cbc08-1dd6-4403-8ec5-dd5343e3e4d0 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:12.536903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-725cbc08-1dd6-4403-8ec5-dd5343e3e4d0 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:12.564078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:13.424540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ca39f8a6-6c80-4c07-bb1d-1a051d843368 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:13.434525 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ca39f8a6-6c80-4c07-bb1d-1a051d843368 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 1.272578 Aug 29 15:32:13.444737 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 901/1802] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:12 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:13.449943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9a48d15d-0afb-490d-9d23-63a0de728172 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:13.450648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9a48d15d-0afb-490d-9d23-63a0de728172 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:13.465893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a48d15d-0afb-490d-9d23-63a0de728172 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:13.466496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a48d15d-0afb-490d-9d23-63a0de728172 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:13.467001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a48d15d-0afb-490d-9d23-63a0de728172 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:13.467786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a48d15d-0afb-490d-9d23-63a0de728172 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:13.469050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a48d15d-0afb-490d-9d23-63a0de728172 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:13.469577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a48d15d-0afb-490d-9d23-63a0de728172 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:13.675630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-725cbc08-1dd6-4403-8ec5-dd5343e3e4d0 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:13.693367 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-725cbc08-1dd6-4403-8ec5-dd5343e3e4d0 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1293 microversion: 2.1 time: 1.188193 Aug 29 15:32:13.696548 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 902/1803] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:12 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1293 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:13.706005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-49a712eb-b4a7-4505-b671-92bda4784e29 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:13.711141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-49a712eb-b4a7-4505-b671-92bda4784e29 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:13.725240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49a712eb-b4a7-4505-b671-92bda4784e29 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:13.726002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49a712eb-b4a7-4505-b671-92bda4784e29 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:13.726666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49a712eb-b4a7-4505-b671-92bda4784e29 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:13.727651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49a712eb-b4a7-4505-b671-92bda4784e29 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:13.728350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49a712eb-b4a7-4505-b671-92bda4784e29 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:13.729007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49a712eb-b4a7-4505-b671-92bda4784e29 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.217785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-49a712eb-b4a7-4505-b671-92bda4784e29 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:14.221584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:14.226912 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-49a712eb-b4a7-4505-b671-92bda4784e29 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1314 microversion: 2.1 time: 0.528951 Aug 29 15:32:14.227509 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 903/1804] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:13 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:14.242368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b20e8081-52b9-437e-9875-3f19fa137980 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:14.244944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b20e8081-52b9-437e-9875-3f19fa137980 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:14.252392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b20e8081-52b9-437e-9875-3f19fa137980 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.253068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b20e8081-52b9-437e-9875-3f19fa137980 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.253704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b20e8081-52b9-437e-9875-3f19fa137980 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.254905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b20e8081-52b9-437e-9875-3f19fa137980 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.255561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b20e8081-52b9-437e-9875-3f19fa137980 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.256163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b20e8081-52b9-437e-9875-3f19fa137980 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.307395 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b20e8081-52b9-437e-9875-3f19fa137980 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.068928 Aug 29 15:32:14.308770 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 904/1805] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:32:14 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:32:14.313674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-05ed30e7-2333-47da-b0e8-f2c63c377689 req-0d4d7620-7af1-4455-98eb-d66dddaead26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5035af0-406d-4c78-90b3-a679558859bd", "tag": "13353edf-9cd3-40e7-9b02-a707b2d5bddd"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:14.324850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-05ed30e7-2333-47da-b0e8-f2c63c377689 req-0d4d7620-7af1-4455-98eb-d66dddaead26 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.326009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-05ed30e7-2333-47da-b0e8-f2c63c377689 req-0d4d7620-7af1-4455-98eb-d66dddaead26 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.326750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-05ed30e7-2333-47da-b0e8-f2c63c377689 req-0d4d7620-7af1-4455-98eb-d66dddaead26 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.346415 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-05ed30e7-2333-47da-b0e8-f2c63c377689 req-0d4d7620-7af1-4455-98eb-d66dddaead26 service nova] Creating event network-changed:13353edf-9cd3-40e7-9b02-a707b2d5bddd for instance c5035af0-406d-4c78-90b3-a679558859bd on n-h1-839401-11 Aug 29 15:32:14.359929 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-05ed30e7-2333-47da-b0e8-f2c63c377689 req-0d4d7620-7af1-4455-98eb-d66dddaead26 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048881 Aug 29 15:32:14.363027 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 905/1806] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:14.469956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-43a59718-c1b9-4989-b996-283a462a62b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:14.471884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-43a59718-c1b9-4989-b996-283a462a62b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:14.507717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43a59718-c1b9-4989-b996-283a462a62b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.508888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43a59718-c1b9-4989-b996-283a462a62b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.509953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43a59718-c1b9-4989-b996-283a462a62b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.511004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43a59718-c1b9-4989-b996-283a462a62b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.511871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43a59718-c1b9-4989-b996-283a462a62b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.512555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43a59718-c1b9-4989-b996-283a462a62b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.616112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9a48d15d-0afb-490d-9d23-63a0de728172 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:14.631934 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9a48d15d-0afb-490d-9d23-63a0de728172 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1475 microversion: 2.1 time: 1.185895 Aug 29 15:32:14.632850 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 902/1807] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:13 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1475 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:14.637792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-7f2aacf4-886b-474b-87a5-2b6ebe741a86 req-9c5757bd-63b4-4657-a0e3-a20b96c587ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e044d38-7a82-4cb6-8e91-fcbdca201a08", "tag": "76c803a9-7e99-4e7e-86e4-8d82b4fa6dde"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:14.647949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7f2aacf4-886b-474b-87a5-2b6ebe741a86 req-9c5757bd-63b4-4657-a0e3-a20b96c587ec service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.648858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7f2aacf4-886b-474b-87a5-2b6ebe741a86 req-9c5757bd-63b4-4657-a0e3-a20b96c587ec service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.649514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7f2aacf4-886b-474b-87a5-2b6ebe741a86 req-9c5757bd-63b4-4657-a0e3-a20b96c587ec service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.674385 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-7f2aacf4-886b-474b-87a5-2b6ebe741a86 req-9c5757bd-63b4-4657-a0e3-a20b96c587ec service nova] Creating event network-changed:76c803a9-7e99-4e7e-86e4-8d82b4fa6dde for instance 7e044d38-7a82-4cb6-8e91-fcbdca201a08 on n-h2-839401-11 Aug 29 15:32:14.689314 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-7f2aacf4-886b-474b-87a5-2b6ebe741a86 req-9c5757bd-63b4-4657-a0e3-a20b96c587ec service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054904 Aug 29 15:32:14.689995 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 903/1808] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:14.739504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bd302482-7a09-4c7f-a009-f4f5cd4621ac tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:14.741411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bd302482-7a09-4c7f-a009-f4f5cd4621ac tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:14.752054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd302482-7a09-4c7f-a009-f4f5cd4621ac tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.752872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd302482-7a09-4c7f-a009-f4f5cd4621ac tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.753605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd302482-7a09-4c7f-a009-f4f5cd4621ac tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:14.754583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd302482-7a09-4c7f-a009-f4f5cd4621ac tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:14.757454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd302482-7a09-4c7f-a009-f4f5cd4621ac tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:14.758879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd302482-7a09-4c7f-a009-f4f5cd4621ac tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.086110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-43a59718-c1b9-4989-b996-283a462a62b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:15.110100 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-43a59718-c1b9-4989-b996-283a462a62b1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 0.644476 Aug 29 15:32:15.114308 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 906/1809] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:14 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:15.249125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b0398d37-0ba0-4e81-9abf-743b06e94d43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:15.250220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b0398d37-0ba0-4e81-9abf-743b06e94d43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:15.268555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0398d37-0ba0-4e81-9abf-743b06e94d43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.293116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0398d37-0ba0-4e81-9abf-743b06e94d43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.303489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0398d37-0ba0-4e81-9abf-743b06e94d43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.304246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0398d37-0ba0-4e81-9abf-743b06e94d43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.304939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0398d37-0ba0-4e81-9abf-743b06e94d43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.305560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0398d37-0ba0-4e81-9abf-743b06e94d43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.685310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bd302482-7a09-4c7f-a009-f4f5cd4621ac tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:15.716409 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bd302482-7a09-4c7f-a009-f4f5cd4621ac tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1293 microversion: 2.1 time: 1.002160 Aug 29 15:32:15.716630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b0398d37-0ba0-4e81-9abf-743b06e94d43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:15.718079 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 904/1810] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:14 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1293 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:15.728798 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b0398d37-0ba0-4e81-9abf-743b06e94d43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1314 microversion: 2.1 time: 0.484269 Aug 29 15:32:15.729889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d9bed189-5e8e-4205-8085-c78c389f4428 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:15.731573 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 907/1811] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:15 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:15.734875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d9bed189-5e8e-4205-8085-c78c389f4428 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:15.739580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aefe7b65-bfe3-4e19-854f-844f7c006b81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:15.741962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aefe7b65-bfe3-4e19-854f-844f7c006b81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:15.745230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9bed189-5e8e-4205-8085-c78c389f4428 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.746238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9bed189-5e8e-4205-8085-c78c389f4428 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.747147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9bed189-5e8e-4205-8085-c78c389f4428 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.748097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9bed189-5e8e-4205-8085-c78c389f4428 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.748781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9bed189-5e8e-4205-8085-c78c389f4428 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.749504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9bed189-5e8e-4205-8085-c78c389f4428 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.754907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aefe7b65-bfe3-4e19-854f-844f7c006b81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.755398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aefe7b65-bfe3-4e19-854f-844f7c006b81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.755835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aefe7b65-bfe3-4e19-854f-844f7c006b81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.756525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aefe7b65-bfe3-4e19-854f-844f7c006b81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:15.759298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aefe7b65-bfe3-4e19-854f-844f7c006b81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:15.761255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aefe7b65-bfe3-4e19-854f-844f7c006b81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:15.795594 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d9bed189-5e8e-4205-8085-c78c389f4428 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075373 Aug 29 15:32:15.797002 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 905/1812] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:32:15 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:32:16.135887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-63f52398-fbfd-4a89-b3df-6f908986df66 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:16.136516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-63f52398-fbfd-4a89-b3df-6f908986df66 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:16.150056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63f52398-fbfd-4a89-b3df-6f908986df66 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:16.152449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63f52398-fbfd-4a89-b3df-6f908986df66 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:16.154488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63f52398-fbfd-4a89-b3df-6f908986df66 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:16.157455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63f52398-fbfd-4a89-b3df-6f908986df66 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:16.160813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63f52398-fbfd-4a89-b3df-6f908986df66 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:16.161451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63f52398-fbfd-4a89-b3df-6f908986df66 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:16.229410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aefe7b65-bfe3-4e19-854f-844f7c006b81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:16.239237 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aefe7b65-bfe3-4e19-854f-844f7c006b81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1475 microversion: 2.1 time: 0.506579 Aug 29 15:32:16.240439 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 908/1813] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:15 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1475 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:16.326932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85538d15-7814-4f1d-acb9-bda1045b6c3e tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Action: 'create', calling method: .version_select at 0x7fc433c6a550>, body: {"keypair": {"name": "tempest-keypair-1815473144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIvgzuxpckoPFWyvgcM+wb3stk1aPLEMBySsIh3nsi/20EehQ7PSbITG2Crt7BMOAkR9NMXi6HMDbCPlF6wtUwenIkjIRaLr8Uth8/xg8oWLygU2eK4FYCPTyNl1M6YRA=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:16.362741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-85538d15-7814-4f1d-acb9-bda1045b6c3e tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Getting quotas for project 96dd481c3ca94886a7c2fb32f10daec2. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:16.387186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-85538d15-7814-4f1d-acb9-bda1045b6c3e tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Getting quotas for user 740f4dfad6284ccfb489d614ca14306e and project 96dd481c3ca94886a7c2fb32f10daec2. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:16.460657 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85538d15-7814-4f1d-acb9-bda1045b6c3e tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.218237 Aug 29 15:32:16.461361 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 909/1814] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:32:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:16.559429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-63f52398-fbfd-4a89-b3df-6f908986df66 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:16.568931 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-63f52398-fbfd-4a89-b3df-6f908986df66 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 0.437455 Aug 29 15:32:16.576190 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 906/1815] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:16 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:16.739141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-279e24f6-1594-495f-8609-7b4dd6044413 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:16.739589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-279e24f6-1594-495f-8609-7b4dd6044413 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:16.755096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-279e24f6-1594-495f-8609-7b4dd6044413 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:16.755851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-279e24f6-1594-495f-8609-7b4dd6044413 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:16.756504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-279e24f6-1594-495f-8609-7b4dd6044413 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:16.758945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fe6d8acc-c1e5-413d-9005-5f3a051bd8a9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:16.759590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fe6d8acc-c1e5-413d-9005-5f3a051bd8a9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:16.760467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-279e24f6-1594-495f-8609-7b4dd6044413 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:16.761445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-279e24f6-1594-495f-8609-7b4dd6044413 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:16.762065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-279e24f6-1594-495f-8609-7b4dd6044413 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:16.769725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6d8acc-c1e5-413d-9005-5f3a051bd8a9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:16.771385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6d8acc-c1e5-413d-9005-5f3a051bd8a9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:16.771826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6d8acc-c1e5-413d-9005-5f3a051bd8a9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:16.776613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6d8acc-c1e5-413d-9005-5f3a051bd8a9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:16.777184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6d8acc-c1e5-413d-9005-5f3a051bd8a9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:16.777731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6d8acc-c1e5-413d-9005-5f3a051bd8a9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:17.137760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-279e24f6-1594-495f-8609-7b4dd6044413 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:17.148901 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-279e24f6-1594-495f-8609-7b4dd6044413 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1293 microversion: 2.1 time: 0.414165 Aug 29 15:32:17.151269 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 910/1816] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:16 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1293 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:17.162169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-29d8cc08-dcc7-4c13-97f5-015d1d1d3251 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:17.173677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-29d8cc08-dcc7-4c13-97f5-015d1d1d3251 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:17.194992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29d8cc08-dcc7-4c13-97f5-015d1d1d3251 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:17.195932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29d8cc08-dcc7-4c13-97f5-015d1d1d3251 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:17.196570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29d8cc08-dcc7-4c13-97f5-015d1d1d3251 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:17.197798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29d8cc08-dcc7-4c13-97f5-015d1d1d3251 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:17.198605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29d8cc08-dcc7-4c13-97f5-015d1d1d3251 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:17.199923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29d8cc08-dcc7-4c13-97f5-015d1d1d3251 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:17.305584 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-29d8cc08-dcc7-4c13-97f5-015d1d1d3251 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.152534 Aug 29 15:32:17.306311 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 911/1817] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:32:17 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:17.318777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-370809ee-ebba-4258-b5c7-3c1c05bc25bf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:17.319426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-370809ee-ebba-4258-b5c7-3c1c05bc25bf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:17.341005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-370809ee-ebba-4258-b5c7-3c1c05bc25bf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:17.341875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-370809ee-ebba-4258-b5c7-3c1c05bc25bf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:17.342509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-370809ee-ebba-4258-b5c7-3c1c05bc25bf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:17.343521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-370809ee-ebba-4258-b5c7-3c1c05bc25bf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:17.346754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-370809ee-ebba-4258-b5c7-3c1c05bc25bf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:17.347443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-370809ee-ebba-4258-b5c7-3c1c05bc25bf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:17.626160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fe6d8acc-c1e5-413d-9005-5f3a051bd8a9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:17.638812 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fe6d8acc-c1e5-413d-9005-5f3a051bd8a9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1314 microversion: 2.1 time: 0.884009 Aug 29 15:32:17.639520 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 907/1818] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:16 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1314 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:17.650325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-592f9287-741d-45d8-815a-d51d617fae92 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:17.652089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-592f9287-741d-45d8-815a-d51d617fae92 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:17.671474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-592f9287-741d-45d8-815a-d51d617fae92 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:17.675392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-592f9287-741d-45d8-815a-d51d617fae92 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:17.676031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-592f9287-741d-45d8-815a-d51d617fae92 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:17.676945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-592f9287-741d-45d8-815a-d51d617fae92 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:17.679771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-592f9287-741d-45d8-815a-d51d617fae92 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:17.682273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-592f9287-741d-45d8-815a-d51d617fae92 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:18.149132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-592f9287-741d-45d8-815a-d51d617fae92 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:18.166751 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-592f9287-741d-45d8-815a-d51d617fae92 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 0.521768 Aug 29 15:32:18.181130 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 908/1819] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:17 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:18.187823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1e8c0756-f867-43a3-b8b9-2d29211c5dc3 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:18.188590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1e8c0756-f867-43a3-b8b9-2d29211c5dc3 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:18.201230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e8c0756-f867-43a3-b8b9-2d29211c5dc3 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:18.201762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e8c0756-f867-43a3-b8b9-2d29211c5dc3 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:18.202233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e8c0756-f867-43a3-b8b9-2d29211c5dc3 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:18.204994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e8c0756-f867-43a3-b8b9-2d29211c5dc3 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:18.205600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e8c0756-f867-43a3-b8b9-2d29211c5dc3 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:18.208261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e8c0756-f867-43a3-b8b9-2d29211c5dc3 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:18.571876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-370809ee-ebba-4258-b5c7-3c1c05bc25bf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:18.587628 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-370809ee-ebba-4258-b5c7-3c1c05bc25bf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1473 microversion: 2.1 time: 1.278729 Aug 29 15:32:18.588617 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 912/1820] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:17 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1473 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:18.590427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1e8c0756-f867-43a3-b8b9-2d29211c5dc3 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:18.603579 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1e8c0756-f867-43a3-b8b9-2d29211c5dc3 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1293 microversion: 2.1 time: 0.430963 Aug 29 15:32:18.604983 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 909/1821] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:18 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1293 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:18.660710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fcfbbc70-2717-4cc1-bfd1-9487dc3f4851 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:18.662714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fcfbbc70-2717-4cc1-bfd1-9487dc3f4851 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:18.670197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcfbbc70-2717-4cc1-bfd1-9487dc3f4851 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:18.671126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcfbbc70-2717-4cc1-bfd1-9487dc3f4851 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:18.671876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcfbbc70-2717-4cc1-bfd1-9487dc3f4851 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:18.672769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcfbbc70-2717-4cc1-bfd1-9487dc3f4851 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:18.673438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcfbbc70-2717-4cc1-bfd1-9487dc3f4851 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:18.674175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcfbbc70-2717-4cc1-bfd1-9487dc3f4851 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:19.111454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fcfbbc70-2717-4cc1-bfd1-9487dc3f4851 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:19.143815 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fcfbbc70-2717-4cc1-bfd1-9487dc3f4851 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1314 microversion: 2.1 time: 0.482128 Aug 29 15:32:19.162943 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 913/1822] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:18 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:19.195347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3885b0cb-601c-4ed9-8b9b-27388bf3e819 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:19.196705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3885b0cb-601c-4ed9-8b9b-27388bf3e819 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:19.204989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3885b0cb-601c-4ed9-8b9b-27388bf3e819 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:19.205795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3885b0cb-601c-4ed9-8b9b-27388bf3e819 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:19.206329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3885b0cb-601c-4ed9-8b9b-27388bf3e819 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:19.207179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3885b0cb-601c-4ed9-8b9b-27388bf3e819 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:19.207742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3885b0cb-601c-4ed9-8b9b-27388bf3e819 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:19.208282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3885b0cb-601c-4ed9-8b9b-27388bf3e819 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:19.611836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-993a8609-cf24-4ab7-b05a-00c72e5643e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:19.618277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-993a8609-cf24-4ab7-b05a-00c72e5643e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:19.629202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-993a8609-cf24-4ab7-b05a-00c72e5643e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:19.629992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-993a8609-cf24-4ab7-b05a-00c72e5643e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:19.630602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-993a8609-cf24-4ab7-b05a-00c72e5643e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:19.631474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-993a8609-cf24-4ab7-b05a-00c72e5643e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:19.633582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-993a8609-cf24-4ab7-b05a-00c72e5643e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:19.634198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-993a8609-cf24-4ab7-b05a-00c72e5643e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:19.848842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-993a8609-cf24-4ab7-b05a-00c72e5643e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:19.860478 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-993a8609-cf24-4ab7-b05a-00c72e5643e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1473 microversion: 2.1 time: 0.252638 Aug 29 15:32:19.879101 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 914/1823] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:19 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1473 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:19.886234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f53a45b1-7eb5-4b3e-8215-b715940dc574 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:19.888356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f53a45b1-7eb5-4b3e-8215-b715940dc574 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:19.898163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f53a45b1-7eb5-4b3e-8215-b715940dc574 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:19.898994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f53a45b1-7eb5-4b3e-8215-b715940dc574 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:19.899657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f53a45b1-7eb5-4b3e-8215-b715940dc574 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:19.900890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f53a45b1-7eb5-4b3e-8215-b715940dc574 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:19.901652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f53a45b1-7eb5-4b3e-8215-b715940dc574 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:19.903380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f53a45b1-7eb5-4b3e-8215-b715940dc574 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:20.149995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f53a45b1-7eb5-4b3e-8215-b715940dc574 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:20.159513 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f53a45b1-7eb5-4b3e-8215-b715940dc574 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1293 microversion: 2.1 time: 0.278735 Aug 29 15:32:20.160373 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 915/1824] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:19 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1293 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:20.175145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4e4d84c7-a895-4a0e-882b-2baff2e1954e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:20.176312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4e4d84c7-a895-4a0e-882b-2baff2e1954e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:20.193591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e4d84c7-a895-4a0e-882b-2baff2e1954e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:20.194781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e4d84c7-a895-4a0e-882b-2baff2e1954e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:20.200227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e4d84c7-a895-4a0e-882b-2baff2e1954e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:20.202540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e4d84c7-a895-4a0e-882b-2baff2e1954e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:20.203432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e4d84c7-a895-4a0e-882b-2baff2e1954e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:20.204164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e4d84c7-a895-4a0e-882b-2baff2e1954e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:20.360447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3885b0cb-601c-4ed9-8b9b-27388bf3e819 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:20.400000 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3885b0cb-601c-4ed9-8b9b-27388bf3e819 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 1.207121 Aug 29 15:32:20.402624 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 910/1825] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:19 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:20.582371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4e4d84c7-a895-4a0e-882b-2baff2e1954e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:20.599567 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4e4d84c7-a895-4a0e-882b-2baff2e1954e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1314 microversion: 2.1 time: 0.429849 Aug 29 15:32:20.600948 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 916/1826] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:20 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:20.884457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5d52c9c5-0622-4664-b0de-f0c19483a3ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:20.885354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5d52c9c5-0622-4664-b0de-f0c19483a3ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:20.899243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d52c9c5-0622-4664-b0de-f0c19483a3ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:20.899920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d52c9c5-0622-4664-b0de-f0c19483a3ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:20.900486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d52c9c5-0622-4664-b0de-f0c19483a3ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:20.906361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d52c9c5-0622-4664-b0de-f0c19483a3ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:20.907224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d52c9c5-0622-4664-b0de-f0c19483a3ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:20.907906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d52c9c5-0622-4664-b0de-f0c19483a3ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.182986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1f7836ea-ea6c-41d7-8b7a-fabe8a35e8f1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:21.183632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1f7836ea-ea6c-41d7-8b7a-fabe8a35e8f1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:21.200360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f7836ea-ea6c-41d7-8b7a-fabe8a35e8f1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.203439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f7836ea-ea6c-41d7-8b7a-fabe8a35e8f1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.203883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f7836ea-ea6c-41d7-8b7a-fabe8a35e8f1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.213882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f7836ea-ea6c-41d7-8b7a-fabe8a35e8f1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.216626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f7836ea-ea6c-41d7-8b7a-fabe8a35e8f1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.217195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f7836ea-ea6c-41d7-8b7a-fabe8a35e8f1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.408826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1f7836ea-ea6c-41d7-8b7a-fabe8a35e8f1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:21.421829 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1f7836ea-ea6c-41d7-8b7a-fabe8a35e8f1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1293 microversion: 2.1 time: 0.242881 Aug 29 15:32:21.433646 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 917/1827] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:21 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1293 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:21.442447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f98bc174-798b-4985-9a5b-cc1652686153 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:21.444086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f98bc174-798b-4985-9a5b-cc1652686153 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:21.463270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f98bc174-798b-4985-9a5b-cc1652686153 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.465659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f98bc174-798b-4985-9a5b-cc1652686153 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.468315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f98bc174-798b-4985-9a5b-cc1652686153 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.469383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f98bc174-798b-4985-9a5b-cc1652686153 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.470175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f98bc174-798b-4985-9a5b-cc1652686153 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.471429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f98bc174-798b-4985-9a5b-cc1652686153 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.707520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f98bc174-798b-4985-9a5b-cc1652686153 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:21.716497 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f98bc174-798b-4985-9a5b-cc1652686153 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 0.281085 Aug 29 15:32:21.730061 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 918/1828] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:21 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:21.735750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ca3f3086-203d-47be-a994-7418342bc81b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:21.736908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ca3f3086-203d-47be-a994-7418342bc81b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:21.743999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca3f3086-203d-47be-a994-7418342bc81b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.744966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca3f3086-203d-47be-a994-7418342bc81b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.745614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca3f3086-203d-47be-a994-7418342bc81b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.746494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca3f3086-203d-47be-a994-7418342bc81b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.747133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca3f3086-203d-47be-a994-7418342bc81b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.747708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca3f3086-203d-47be-a994-7418342bc81b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.916406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ca3f3086-203d-47be-a994-7418342bc81b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:21.926414 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ca3f3086-203d-47be-a994-7418342bc81b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1314 microversion: 2.1 time: 0.193024 Aug 29 15:32:21.942396 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 919/1829] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:21 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:21.947921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-1a39fa5b-bd36-4b65-8981-cf536b7d517a req-14a22bd8-5e21-4e6d-9dd2-d3124b6882f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5035af0-406d-4c78-90b3-a679558859bd", "name": "network-vif-plugged", "status": "completed", "tag": "13353edf-9cd3-40e7-9b02-a707b2d5bddd"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:21.959616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1a39fa5b-bd36-4b65-8981-cf536b7d517a req-14a22bd8-5e21-4e6d-9dd2-d3124b6882f1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:21.960400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1a39fa5b-bd36-4b65-8981-cf536b7d517a req-14a22bd8-5e21-4e6d-9dd2-d3124b6882f1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:21.960994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1a39fa5b-bd36-4b65-8981-cf536b7d517a req-14a22bd8-5e21-4e6d-9dd2-d3124b6882f1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:21.975603 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-1a39fa5b-bd36-4b65-8981-cf536b7d517a req-14a22bd8-5e21-4e6d-9dd2-d3124b6882f1 service nova] Creating event network-vif-plugged:13353edf-9cd3-40e7-9b02-a707b2d5bddd for instance c5035af0-406d-4c78-90b3-a679558859bd on n-h1-839401-11 Aug 29 15:32:21.983820 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-1a39fa5b-bd36-4b65-8981-cf536b7d517a req-14a22bd8-5e21-4e6d-9dd2-d3124b6882f1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039235 Aug 29 15:32:21.985355 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 920/1830] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:22.452356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-16695b5c-5295-4d40-aaa6-7d90d67ad257 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:22.455083 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-16695b5c-5295-4d40-aaa6-7d90d67ad257 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:22.472328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5d52c9c5-0622-4664-b0de-f0c19483a3ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:22.507414 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5d52c9c5-0622-4664-b0de-f0c19483a3ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1473 microversion: 2.1 time: 1.627455 Aug 29 15:32:22.512267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16695b5c-5295-4d40-aaa6-7d90d67ad257 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:22.515899 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 911/1831] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:20 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1473 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:22.516760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16695b5c-5295-4d40-aaa6-7d90d67ad257 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:22.518147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16695b5c-5295-4d40-aaa6-7d90d67ad257 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:22.521290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16695b5c-5295-4d40-aaa6-7d90d67ad257 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:22.521981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16695b5c-5295-4d40-aaa6-7d90d67ad257 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:22.523402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16695b5c-5295-4d40-aaa6-7d90d67ad257 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:22.746392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-64ccdc42-4b45-4256-8a55-653062e47165 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:22.747072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-64ccdc42-4b45-4256-8a55-653062e47165 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:22.766364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64ccdc42-4b45-4256-8a55-653062e47165 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:22.766865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64ccdc42-4b45-4256-8a55-653062e47165 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:22.767310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64ccdc42-4b45-4256-8a55-653062e47165 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:22.788944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64ccdc42-4b45-4256-8a55-653062e47165 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:22.790277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64ccdc42-4b45-4256-8a55-653062e47165 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:22.791359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64ccdc42-4b45-4256-8a55-653062e47165 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:22.912452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-16695b5c-5295-4d40-aaa6-7d90d67ad257 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:22.924536 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-16695b5c-5295-4d40-aaa6-7d90d67ad257 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1293 microversion: 2.1 time: 0.480779 Aug 29 15:32:22.937774 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 921/1832] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:22 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1293 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:22.959075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-db809cbf-2ff4-4c88-bc27-4e2168da19df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:22.959951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-db809cbf-2ff4-4c88-bc27-4e2168da19df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:22.967949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db809cbf-2ff4-4c88-bc27-4e2168da19df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:22.968843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db809cbf-2ff4-4c88-bc27-4e2168da19df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:22.969486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db809cbf-2ff4-4c88-bc27-4e2168da19df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:22.970508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db809cbf-2ff4-4c88-bc27-4e2168da19df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:22.971944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db809cbf-2ff4-4c88-bc27-4e2168da19df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:22.972550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db809cbf-2ff4-4c88-bc27-4e2168da19df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:23.168036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-db809cbf-2ff4-4c88-bc27-4e2168da19df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:23.179789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:23.188125 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-db809cbf-2ff4-4c88-bc27-4e2168da19df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1314 microversion: 2.1 time: 0.234986 Aug 29 15:32:23.201386 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 922/1833] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:22 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:23.401937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-64ccdc42-4b45-4256-8a55-653062e47165 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:23.417019 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-64ccdc42-4b45-4256-8a55-653062e47165 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 0.683062 Aug 29 15:32:23.434940 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 912/1834] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:22 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:23.539257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1279d246-1cc6-406e-9677-72f8a835684c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:23.541659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1279d246-1cc6-406e-9677-72f8a835684c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:23.559380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1279d246-1cc6-406e-9677-72f8a835684c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:23.560564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1279d246-1cc6-406e-9677-72f8a835684c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:23.561234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1279d246-1cc6-406e-9677-72f8a835684c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:23.562808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1279d246-1cc6-406e-9677-72f8a835684c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:23.563760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1279d246-1cc6-406e-9677-72f8a835684c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:23.564391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1279d246-1cc6-406e-9677-72f8a835684c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:23.765382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1279d246-1cc6-406e-9677-72f8a835684c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:23.775943 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1279d246-1cc6-406e-9677-72f8a835684c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1470 microversion: 2.1 time: 0.241416 Aug 29 15:32:23.777132 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 923/1835] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:23 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1470 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:23.798600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0ed34ed4-e6e2-488e-b81c-78cf45008876 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:23.799929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0ed34ed4-e6e2-488e-b81c-78cf45008876 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:23.807588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ed34ed4-e6e2-488e-b81c-78cf45008876 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:23.808087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ed34ed4-e6e2-488e-b81c-78cf45008876 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:23.808529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ed34ed4-e6e2-488e-b81c-78cf45008876 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:23.809406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ed34ed4-e6e2-488e-b81c-78cf45008876 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:23.809722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ed34ed4-e6e2-488e-b81c-78cf45008876 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:23.810143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ed34ed4-e6e2-488e-b81c-78cf45008876 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:23.908893 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0ed34ed4-e6e2-488e-b81c-78cf45008876 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "POST /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e/action" status: 204 len: 0 microversion: 2.1 time: 0.114585 Aug 29 15:32:23.913858 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 913/1836] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:32:23 2022] POST /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e/action => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:23.919429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d4bd8070-8302-4eee-bbbe-233698c7ce73 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:23.920170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d4bd8070-8302-4eee-bbbe-233698c7ce73 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:23.926883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4bd8070-8302-4eee-bbbe-233698c7ce73 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:23.927537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4bd8070-8302-4eee-bbbe-233698c7ce73 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:23.928149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4bd8070-8302-4eee-bbbe-233698c7ce73 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:23.928926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4bd8070-8302-4eee-bbbe-233698c7ce73 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:23.929726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4bd8070-8302-4eee-bbbe-233698c7ce73 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:23.930246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4bd8070-8302-4eee-bbbe-233698c7ce73 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:23.947938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f15e226b-5c70-4857-8e6d-268f960e256c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:23.948570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f15e226b-5c70-4857-8e6d-268f960e256c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:23.972707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f15e226b-5c70-4857-8e6d-268f960e256c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:23.973817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f15e226b-5c70-4857-8e6d-268f960e256c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:23.976449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f15e226b-5c70-4857-8e6d-268f960e256c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:23.977703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f15e226b-5c70-4857-8e6d-268f960e256c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:23.978627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f15e226b-5c70-4857-8e6d-268f960e256c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:23.981863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f15e226b-5c70-4857-8e6d-268f960e256c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:24.167356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d4bd8070-8302-4eee-bbbe-233698c7ce73 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:24.177168 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d4bd8070-8302-4eee-bbbe-233698c7ce73 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1470 microversion: 2.1 time: 0.261845 Aug 29 15:32:24.191468 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 924/1837] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:23 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1470 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:24.212156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-596aa56a-e03e-4cc4-8314-193c65fa8306 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:24.212691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-596aa56a-e03e-4cc4-8314-193c65fa8306 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:24.219153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-596aa56a-e03e-4cc4-8314-193c65fa8306 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:24.219641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-596aa56a-e03e-4cc4-8314-193c65fa8306 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:24.220074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-596aa56a-e03e-4cc4-8314-193c65fa8306 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:24.220820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-596aa56a-e03e-4cc4-8314-193c65fa8306 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:24.221303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-596aa56a-e03e-4cc4-8314-193c65fa8306 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:24.221894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-596aa56a-e03e-4cc4-8314-193c65fa8306 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:24.403657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-596aa56a-e03e-4cc4-8314-193c65fa8306 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:24.417742 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-596aa56a-e03e-4cc4-8314-193c65fa8306 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1500 microversion: 2.1 time: 0.210434 Aug 29 15:32:24.418952 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 925/1838] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:24 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1500 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:24.439558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-026ac5e7-6937-4965-b86b-3cf774ebba06 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:24.440136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-026ac5e7-6937-4965-b86b-3cf774ebba06 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:24.446956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-026ac5e7-6937-4965-b86b-3cf774ebba06 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:24.447445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-026ac5e7-6937-4965-b86b-3cf774ebba06 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:24.448516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-026ac5e7-6937-4965-b86b-3cf774ebba06 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:24.448643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-026ac5e7-6937-4965-b86b-3cf774ebba06 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:24.449036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-026ac5e7-6937-4965-b86b-3cf774ebba06 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:24.449521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-026ac5e7-6937-4965-b86b-3cf774ebba06 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:24.529870 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-026ac5e7-6937-4965-b86b-3cf774ebba06 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "POST /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd/action" status: 202 len: 0 microversion: 2.1 time: 0.094688 Aug 29 15:32:24.535672 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 926/1839] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:32:24 2022] POST /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:32:24.541836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-afd628dd-7c23-4c72-8a4d-1023ed06da0d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:24.543342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-afd628dd-7c23-4c72-8a4d-1023ed06da0d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:24.550159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afd628dd-7c23-4c72-8a4d-1023ed06da0d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:24.550875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afd628dd-7c23-4c72-8a4d-1023ed06da0d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:24.551472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afd628dd-7c23-4c72-8a4d-1023ed06da0d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:24.552365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afd628dd-7c23-4c72-8a4d-1023ed06da0d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:24.552983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afd628dd-7c23-4c72-8a4d-1023ed06da0d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:24.553780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afd628dd-7c23-4c72-8a4d-1023ed06da0d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:24.830891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-afd628dd-7c23-4c72-8a4d-1023ed06da0d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:24.840016 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-afd628dd-7c23-4c72-8a4d-1023ed06da0d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 0.302542 Aug 29 15:32:24.852481 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 927/1840] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:24 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:24.862337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d408a012-e0ee-4d6c-afd2-1375f87a8607 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:24.865238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d408a012-e0ee-4d6c-afd2-1375f87a8607 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:24.879771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d408a012-e0ee-4d6c-afd2-1375f87a8607 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:24.880576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d408a012-e0ee-4d6c-afd2-1375f87a8607 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:24.881722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d408a012-e0ee-4d6c-afd2-1375f87a8607 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:24.897496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d408a012-e0ee-4d6c-afd2-1375f87a8607 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:24.900407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d408a012-e0ee-4d6c-afd2-1375f87a8607 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:24.903161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d408a012-e0ee-4d6c-afd2-1375f87a8607 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:24.939093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f15e226b-5c70-4857-8e6d-268f960e256c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:24.955654 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f15e226b-5c70-4857-8e6d-268f960e256c tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1293 microversion: 2.1 time: 1.014324 Aug 29 15:32:24.959827 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 914/1841] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:23 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1293 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:25.027967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-c6b49305-af15-490c-9930-82fbc8b6ea23 req-428c6e83-7af8-415f-9073-d2cc5e83c1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab2a8c5-99e8-428d-99e2-3c62d1d86e3e", "name": "network-vif-plugged", "status": "completed", "tag": "da67ee23-a789-4121-8fed-92df23ce0b7e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:25.048024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c6b49305-af15-490c-9930-82fbc8b6ea23 req-428c6e83-7af8-415f-9073-d2cc5e83c1cf service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:25.048522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c6b49305-af15-490c-9930-82fbc8b6ea23 req-428c6e83-7af8-415f-9073-d2cc5e83c1cf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:25.050795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c6b49305-af15-490c-9930-82fbc8b6ea23 req-428c6e83-7af8-415f-9073-d2cc5e83c1cf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:25.085570 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-c6b49305-af15-490c-9930-82fbc8b6ea23 req-428c6e83-7af8-415f-9073-d2cc5e83c1cf service nova] Creating event network-vif-plugged:da67ee23-a789-4121-8fed-92df23ce0b7e for instance dab2a8c5-99e8-428d-99e2-3c62d1d86e3e on n-h2-839401-11 Aug 29 15:32:25.099167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-c6b49305-af15-490c-9930-82fbc8b6ea23 req-428c6e83-7af8-415f-9073-d2cc5e83c1cf service nova] Instance dab2a8c5-99e8-428d-99e2-3c62d1d86e3e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:32:25.125551 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-c6b49305-af15-490c-9930-82fbc8b6ea23 req-428c6e83-7af8-415f-9073-d2cc5e83c1cf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099948 Aug 29 15:32:25.129250 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 915/1842] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:25.143599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-924326473", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f1727993-2004-4ad1-bf15-fcb1e1ccbb85"}], "security_groups": [{"name": "tempest-securitygroup--695158011"}], "key_name": "tempest-keypair-1815473144", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:25.221444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d408a012-e0ee-4d6c-afd2-1375f87a8607 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:25.232533 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d408a012-e0ee-4d6c-afd2-1375f87a8607 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1485 microversion: 2.1 time: 0.378423 Aug 29 15:32:25.251736 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 928/1843] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:24 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1485 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:25.257539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fd37ac57-3d92-417e-9699-3d97f0ec847b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:25.258190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fd37ac57-3d92-417e-9699-3d97f0ec847b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:25.265264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd37ac57-3d92-417e-9699-3d97f0ec847b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:25.265751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd37ac57-3d92-417e-9699-3d97f0ec847b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:25.266186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd37ac57-3d92-417e-9699-3d97f0ec847b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:25.266891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd37ac57-3d92-417e-9699-3d97f0ec847b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:25.267346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd37ac57-3d92-417e-9699-3d97f0ec847b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:25.267811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd37ac57-3d92-417e-9699-3d97f0ec847b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:25.430349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] validate_networks() for [('f1727993-2004-4ad1-bf15-fcb1e1ccbb85', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:32:25.491139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd37ac57-3d92-417e-9699-3d97f0ec847b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:25.507865 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fd37ac57-3d92-417e-9699-3d97f0ec847b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1470 microversion: 2.1 time: 0.254538 Aug 29 15:32:25.508502 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 929/1844] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:25 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1470 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:25.525265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c657d57f-6240-400a-9dc8-680067ee70dd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:25.525771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c657d57f-6240-400a-9dc8-680067ee70dd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:25.533632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c657d57f-6240-400a-9dc8-680067ee70dd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:25.534134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c657d57f-6240-400a-9dc8-680067ee70dd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:25.534571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c657d57f-6240-400a-9dc8-680067ee70dd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:25.535300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c657d57f-6240-400a-9dc8-680067ee70dd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:25.535760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c657d57f-6240-400a-9dc8-680067ee70dd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:25.536254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c657d57f-6240-400a-9dc8-680067ee70dd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:25.571954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c657d57f-6240-400a-9dc8-680067ee70dd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:32:25.778186 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c657d57f-6240-400a-9dc8-680067ee70dd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 204 len: 0 microversion: 2.1 time: 0.252853 Aug 29 15:32:25.782990 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 930/1845] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:32:25 2022] DELETE /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:25.794598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cd811630-7814-46a7-926d-720417aeed0a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:25.795777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cd811630-7814-46a7-926d-720417aeed0a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:25.808834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd811630-7814-46a7-926d-720417aeed0a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:25.809878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd811630-7814-46a7-926d-720417aeed0a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:25.810552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd811630-7814-46a7-926d-720417aeed0a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:25.811539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd811630-7814-46a7-926d-720417aeed0a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:25.812263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd811630-7814-46a7-926d-720417aeed0a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:25.812915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd811630-7814-46a7-926d-720417aeed0a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:26.135833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cd811630-7814-46a7-926d-720417aeed0a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:26.145170 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cd811630-7814-46a7-926d-720417aeed0a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1491 microversion: 2.1 time: 0.357305 Aug 29 15:32:26.145772 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 931/1846] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:25 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1491 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:26.150688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f8a80545-1d46-4700-b782-b9a81f604ae0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:26.151471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f8a80545-1d46-4700-b782-b9a81f604ae0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:26.174843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8a80545-1d46-4700-b782-b9a81f604ae0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:26.175363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8a80545-1d46-4700-b782-b9a81f604ae0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:26.175801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8a80545-1d46-4700-b782-b9a81f604ae0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:26.176536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8a80545-1d46-4700-b782-b9a81f604ae0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:26.176984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8a80545-1d46-4700-b782-b9a81f604ae0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:26.177433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8a80545-1d46-4700-b782-b9a81f604ae0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:26.422322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f8a80545-1d46-4700-b782-b9a81f604ae0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:26.433478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:26.442980 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f8a80545-1d46-4700-b782-b9a81f604ae0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 0.296080 Aug 29 15:32:26.448053 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 932/1847] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:26 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:26.465468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-493f3d84-c26d-47a1-8b9d-499247ae1910 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:26.466111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-493f3d84-c26d-47a1-8b9d-499247ae1910 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:26.472748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-493f3d84-c26d-47a1-8b9d-499247ae1910 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:26.473294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-493f3d84-c26d-47a1-8b9d-499247ae1910 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:26.473725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-493f3d84-c26d-47a1-8b9d-499247ae1910 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:26.474458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-493f3d84-c26d-47a1-8b9d-499247ae1910 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:26.474923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-493f3d84-c26d-47a1-8b9d-499247ae1910 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:26.475323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-493f3d84-c26d-47a1-8b9d-499247ae1910 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:26.726871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-493f3d84-c26d-47a1-8b9d-499247ae1910 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:26.740438 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-493f3d84-c26d-47a1-8b9d-499247ae1910 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1293 microversion: 2.1 time: 0.290311 Aug 29 15:32:26.741981 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 933/1848] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:26 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1293 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:26.747990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a4502eea-21d0-4035-8d00-c90cf428fa59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:26.748834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a4502eea-21d0-4035-8d00-c90cf428fa59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:26.759429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4502eea-21d0-4035-8d00-c90cf428fa59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:26.760313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4502eea-21d0-4035-8d00-c90cf428fa59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:26.761547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4502eea-21d0-4035-8d00-c90cf428fa59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:26.762442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4502eea-21d0-4035-8d00-c90cf428fa59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:26.763059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4502eea-21d0-4035-8d00-c90cf428fa59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:26.764808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4502eea-21d0-4035-8d00-c90cf428fa59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:27.015217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Getting quotas for project 96dd481c3ca94886a7c2fb32f10daec2. Resources: dict_keys(['metadata_items']) {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:27.027556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Getting quotas for user 740f4dfad6284ccfb489d614ca14306e and project 96dd481c3ca94886a7c2fb32f10daec2. Resources: dict_keys(['metadata_items']) {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:27.051300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:32:27.052174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:32:27.053467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:32:27.054047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:32:27.054649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:32:27.064666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:27.065766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:27.066402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:27.067492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:27.068285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:27.068879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:27.092123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Getting quotas for project 96dd481c3ca94886a7c2fb32f10daec2. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:27.100342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Getting quotas for user 740f4dfad6284ccfb489d614ca14306e and project 96dd481c3ca94886a7c2fb32f10daec2. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:27.165689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:32:27.176335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:32:27.300428 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-62448ff5-3661-4e8b-bb3c-07fd715fef07 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.165554 Aug 29 15:32:27.310433 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 916/1849] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:25 2022] POST /compute/v2.1/servers => generated 408 bytes in 2179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:32:27.452723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1198181246", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "43d3f5a8-2f45-41a3-b49c-be7a4eeb8c1b"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:27.482154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a4502eea-21d0-4035-8d00-c90cf428fa59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:27.492894 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a4502eea-21d0-4035-8d00-c90cf428fa59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1470 microversion: 2.1 time: 0.749598 Aug 29 15:32:27.494549 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 934/1850] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:26 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1470 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:27.499641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-72ad685d-895d-44ee-afc9-890cff0abb54 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:27.500568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-72ad685d-895d-44ee-afc9-890cff0abb54 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:27.507658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72ad685d-895d-44ee-afc9-890cff0abb54 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:27.508464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72ad685d-895d-44ee-afc9-890cff0abb54 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:27.509177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72ad685d-895d-44ee-afc9-890cff0abb54 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:27.510494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72ad685d-895d-44ee-afc9-890cff0abb54 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:27.511187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72ad685d-895d-44ee-afc9-890cff0abb54 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:27.511850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72ad685d-895d-44ee-afc9-890cff0abb54 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:27.569515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] validate_networks() for [('43d3f5a8-2f45-41a3-b49c-be7a4eeb8c1b', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:32:28.484392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-72ad685d-895d-44ee-afc9-890cff0abb54 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:28.492776 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-72ad685d-895d-44ee-afc9-890cff0abb54 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1491 microversion: 2.1 time: 0.996834 Aug 29 15:32:28.493434 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 935/1851] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:27 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1491 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:28.527009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6221c70d-d144-4b52-bd62-54506a46209d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:28.534905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6221c70d-d144-4b52-bd62-54506a46209d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:28.559076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6221c70d-d144-4b52-bd62-54506a46209d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:28.569571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6221c70d-d144-4b52-bd62-54506a46209d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:28.577329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6221c70d-d144-4b52-bd62-54506a46209d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:28.579185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6221c70d-d144-4b52-bd62-54506a46209d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:28.580536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6221c70d-d144-4b52-bd62-54506a46209d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:28.581594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6221c70d-d144-4b52-bd62-54506a46209d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:28.754436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6221c70d-d144-4b52-bd62-54506a46209d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:28.759539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:28.766971 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6221c70d-d144-4b52-bd62-54506a46209d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1281 microversion: 2.1 time: 0.271111 Aug 29 15:32:28.768460 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 936/1852] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:28 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1281 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:28.786315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-22af8741-00d1-458a-ad47-e0f5616f98e1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:28.786951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-22af8741-00d1-458a-ad47-e0f5616f98e1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:28.800752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:28.804534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22af8741-00d1-458a-ad47-e0f5616f98e1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:28.808172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22af8741-00d1-458a-ad47-e0f5616f98e1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:28.808933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22af8741-00d1-458a-ad47-e0f5616f98e1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:28.810841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22af8741-00d1-458a-ad47-e0f5616f98e1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:28.814024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22af8741-00d1-458a-ad47-e0f5616f98e1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:28.814772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22af8741-00d1-458a-ad47-e0f5616f98e1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:28.941393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:32:28.941874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:32:28.942284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:32:28.942803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:32:28.943218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:32:28.960977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:28.963766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:28.965616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:28.966715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:28.967421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:28.968096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:28.993848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Getting quotas for project ff781836de994bafa6e09c8d663af7f3. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:28.996738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:29.002946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Getting quotas for user f87bfb07b9f249dfb746b82db543fb02 and project ff781836de994bafa6e09c8d663af7f3. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:29.023791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:32:29.026426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:32:29.114638 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-edb8519e-dc28-43d0-a953-7df50cd12116 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.802231 Aug 29 15:32:29.117755 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 917/1853] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:32:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:32:29.130305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-38588978-d2d3-43ea-8174-a4534afb3d27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.131172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-38588978-d2d3-43ea-8174-a4534afb3d27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:29.145099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38588978-d2d3-43ea-8174-a4534afb3d27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:29.158048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38588978-d2d3-43ea-8174-a4534afb3d27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:29.158576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38588978-d2d3-43ea-8174-a4534afb3d27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:29.162122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38588978-d2d3-43ea-8174-a4534afb3d27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:29.162692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38588978-d2d3-43ea-8174-a4534afb3d27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:29.163084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38588978-d2d3-43ea-8174-a4534afb3d27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:29.505244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-38588978-d2d3-43ea-8174-a4534afb3d27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:29.517313 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-38588978-d2d3-43ea-8174-a4534afb3d27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1293 microversion: 2.1 time: 0.398207 Aug 29 15:32:29.520822 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 918/1854] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:29 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1293 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:29.534194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e9197353-576c-442d-aa02-02327913c64a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:29.534815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e9197353-576c-442d-aa02-02327913c64a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:29.543246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9197353-576c-442d-aa02-02327913c64a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:29.544106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9197353-576c-442d-aa02-02327913c64a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:29.544780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9197353-576c-442d-aa02-02327913c64a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:29.545757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9197353-576c-442d-aa02-02327913c64a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:29.546489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9197353-576c-442d-aa02-02327913c64a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:29.547158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9197353-576c-442d-aa02-02327913c64a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:29.579654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:30.113239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-22af8741-00d1-458a-ad47-e0f5616f98e1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:30.126533 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-22af8741-00d1-458a-ad47-e0f5616f98e1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1716 microversion: 2.1 time: 1.356002 Aug 29 15:32:30.133930 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 937/1855] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:28 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1716 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:30.139781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0e55511b-c352-4018-90fe-369249768ffa tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:30.170342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0e55511b-c352-4018-90fe-369249768ffa tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:30.183238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e55511b-c352-4018-90fe-369249768ffa tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.187353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e55511b-c352-4018-90fe-369249768ffa tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.188708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e55511b-c352-4018-90fe-369249768ffa tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.205788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e55511b-c352-4018-90fe-369249768ffa tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.205788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e55511b-c352-4018-90fe-369249768ffa tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.210446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e55511b-c352-4018-90fe-369249768ffa tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.499479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0e55511b-c352-4018-90fe-369249768ffa tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:30.531423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0e55511b-c352-4018-90fe-369249768ffa tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:30.537122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0e55511b-c352-4018-90fe-369249768ffa tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:30.538923 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0e55511b-c352-4018-90fe-369249768ffa tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1263 microversion: 2.21 time: 0.403365 Aug 29 15:32:30.549176 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 938/1856] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:30 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1263 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:30.584381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aa5f3cce-f411-4161-8364-d044abf7691e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:30.589159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aa5f3cce-f411-4161-8364-d044abf7691e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:30.610521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa5f3cce-f411-4161-8364-d044abf7691e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.611208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa5f3cce-f411-4161-8364-d044abf7691e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.612027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa5f3cce-f411-4161-8364-d044abf7691e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.613765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa5f3cce-f411-4161-8364-d044abf7691e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.616884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa5f3cce-f411-4161-8364-d044abf7691e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.617959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa5f3cce-f411-4161-8364-d044abf7691e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.672419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa5f3cce-f411-4161-8364-d044abf7691e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.674109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa5f3cce-f411-4161-8364-d044abf7691e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.676211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa5f3cce-f411-4161-8364-d044abf7691e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.677157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-aa5f3cce-f411-4161-8364-d044abf7691e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lazy-loading 'fault' on Instance uuid c5035af0-406d-4c78-90b3-a679558859bd {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:30.750356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e9197353-576c-442d-aa02-02327913c64a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:30.782653 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e9197353-576c-442d-aa02-02327913c64a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1462 microversion: 2.1 time: 1.240454 Aug 29 15:32:30.786541 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 919/1857] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:29 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1462 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:30.834190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-976bcc49-d5dc-4e6a-9527-f224d4c99744 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:30.837399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-976bcc49-d5dc-4e6a-9527-f224d4c99744 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:30.863598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-976bcc49-d5dc-4e6a-9527-f224d4c99744 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.876222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-976bcc49-d5dc-4e6a-9527-f224d4c99744 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.876840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-976bcc49-d5dc-4e6a-9527-f224d4c99744 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.882311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-976bcc49-d5dc-4e6a-9527-f224d4c99744 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.882644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-976bcc49-d5dc-4e6a-9527-f224d4c99744 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.891181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-976bcc49-d5dc-4e6a-9527-f224d4c99744 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.904218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aa5f3cce-f411-4161-8364-d044abf7691e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:30.915985 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aa5f3cce-f411-4161-8364-d044abf7691e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 200 len: 1304 microversion: 2.1 time: 0.365610 Aug 29 15:32:30.916615 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 939/1858] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:30 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 1304 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:30.928044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-683aa3cb-1634-46a6-9a08-281736302f6b req-6101bdac-ccda-4c57-aa4a-bfb130e1e47f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5035af0-406d-4c78-90b3-a679558859bd", "name": "network-vif-deleted", "tag": "13353edf-9cd3-40e7-9b02-a707b2d5bddd"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:30.945138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-683aa3cb-1634-46a6-9a08-281736302f6b req-6101bdac-ccda-4c57-aa4a-bfb130e1e47f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.945941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-683aa3cb-1634-46a6-9a08-281736302f6b req-6101bdac-ccda-4c57-aa4a-bfb130e1e47f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.946639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-683aa3cb-1634-46a6-9a08-281736302f6b req-6101bdac-ccda-4c57-aa4a-bfb130e1e47f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.970161 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-683aa3cb-1634-46a6-9a08-281736302f6b req-6101bdac-ccda-4c57-aa4a-bfb130e1e47f service nova] Creating event network-vif-deleted:13353edf-9cd3-40e7-9b02-a707b2d5bddd for instance c5035af0-406d-4c78-90b3-a679558859bd on n-h1-839401-11 Aug 29 15:32:30.976203 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-683aa3cb-1634-46a6-9a08-281736302f6b req-6101bdac-ccda-4c57-aa4a-bfb130e1e47f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056906 Aug 29 15:32:30.977794 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 940/1859] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:30.984997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-da3e012a-e509-42a1-b646-d4442011bb66 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:30.985995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-da3e012a-e509-42a1-b646-d4442011bb66 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:30.994457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da3e012a-e509-42a1-b646-d4442011bb66 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.995559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da3e012a-e509-42a1-b646-d4442011bb66 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.996301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da3e012a-e509-42a1-b646-d4442011bb66 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:30.997551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da3e012a-e509-42a1-b646-d4442011bb66 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:30.998535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da3e012a-e509-42a1-b646-d4442011bb66 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:30.999695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da3e012a-e509-42a1-b646-d4442011bb66 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:31.042361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-976bcc49-d5dc-4e6a-9527-f224d4c99744 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:31.063871 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-976bcc49-d5dc-4e6a-9527-f224d4c99744 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1335 microversion: 2.1 time: 0.272431 Aug 29 15:32:31.086817 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 920/1860] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:30 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1335 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:31.108301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b2bfa894-f999-4729-a5fb-e39754f2107c tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:31.112888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b2bfa894-f999-4729-a5fb-e39754f2107c tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:31.128953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2bfa894-f999-4729-a5fb-e39754f2107c tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:31.130716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2bfa894-f999-4729-a5fb-e39754f2107c tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:31.131427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2bfa894-f999-4729-a5fb-e39754f2107c tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:31.132394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2bfa894-f999-4729-a5fb-e39754f2107c tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:31.133129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2bfa894-f999-4729-a5fb-e39754f2107c tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:31.133781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2bfa894-f999-4729-a5fb-e39754f2107c tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:31.424310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-da3e012a-e509-42a1-b646-d4442011bb66 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:31.440354 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-da3e012a-e509-42a1-b646-d4442011bb66 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1293 microversion: 2.1 time: 0.459573 Aug 29 15:32:31.441807 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 941/1861] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:30 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1293 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:31.449048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-4ec517dc-c898-465d-b100-82a0c3afb647 req-88123d42-eeab-4843-943d-6cb49b990e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e044d38-7a82-4cb6-8e91-fcbdca201a08", "name": "network-vif-plugged", "status": "completed", "tag": "76c803a9-7e99-4e7e-86e4-8d82b4fa6dde"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:31.481841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4ec517dc-c898-465d-b100-82a0c3afb647 req-88123d42-eeab-4843-943d-6cb49b990e76 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:31.482662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4ec517dc-c898-465d-b100-82a0c3afb647 req-88123d42-eeab-4843-943d-6cb49b990e76 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:31.483284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4ec517dc-c898-465d-b100-82a0c3afb647 req-88123d42-eeab-4843-943d-6cb49b990e76 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:31.524513 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-4ec517dc-c898-465d-b100-82a0c3afb647 req-88123d42-eeab-4843-943d-6cb49b990e76 service nova] Creating event network-vif-plugged:76c803a9-7e99-4e7e-86e4-8d82b4fa6dde for instance 7e044d38-7a82-4cb6-8e91-fcbdca201a08 on n-h2-839401-11 Aug 29 15:32:31.538733 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-4ec517dc-c898-465d-b100-82a0c3afb647 req-88123d42-eeab-4843-943d-6cb49b990e76 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094858 Aug 29 15:32:31.540154 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 942/1862] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:31.565274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5615c5f3-47f9-4931-b0fd-7e1c271bdeab tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:31.567175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5615c5f3-47f9-4931-b0fd-7e1c271bdeab tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:31.606203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5615c5f3-47f9-4931-b0fd-7e1c271bdeab tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:31.607676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5615c5f3-47f9-4931-b0fd-7e1c271bdeab tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:31.609342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5615c5f3-47f9-4931-b0fd-7e1c271bdeab tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:31.612210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5615c5f3-47f9-4931-b0fd-7e1c271bdeab tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:31.612986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5615c5f3-47f9-4931-b0fd-7e1c271bdeab tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:31.614629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5615c5f3-47f9-4931-b0fd-7e1c271bdeab tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:31.676964 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b2bfa894-f999-4729-a5fb-e39754f2107c tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1615 microversion: 2.1 time: 0.585379 Aug 29 15:32:31.687661 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 921/1863] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:31 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1615 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:31.697336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0a162420-965d-4840-833e-c56b4cf3f438 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:31.698505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0a162420-965d-4840-833e-c56b4cf3f438 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:31.724512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a162420-965d-4840-833e-c56b4cf3f438 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:31.725298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a162420-965d-4840-833e-c56b4cf3f438 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:31.726090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a162420-965d-4840-833e-c56b4cf3f438 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:31.727465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a162420-965d-4840-833e-c56b4cf3f438 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:31.728680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a162420-965d-4840-833e-c56b4cf3f438 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:31.729465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a162420-965d-4840-833e-c56b4cf3f438 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:32.034623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0a162420-965d-4840-833e-c56b4cf3f438 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:32.050638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0a162420-965d-4840-833e-c56b4cf3f438 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:32.054249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0a162420-965d-4840-833e-c56b4cf3f438 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:32.062886 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0a162420-965d-4840-833e-c56b4cf3f438 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1311 microversion: 2.21 time: 0.372047 Aug 29 15:32:32.078527 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 922/1864] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:31 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1311 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:32.086851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6385ffca-e980-47fe-a32f-f09f70afe709 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Calling method '.version_select at 0x7fc42baa7040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:32.100191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6385ffca-e980-47fe-a32f-f09f70afe709 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:32.101577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6385ffca-e980-47fe-a32f-f09f70afe709 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:32.102230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6385ffca-e980-47fe-a32f-f09f70afe709 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:32.130950 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6385ffca-e980-47fe-a32f-f09f70afe709 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] 10.222.0.62 "GET /compute/v2.1/os-migrations" status: 200 len: 2739 microversion: 2.1 time: 0.038992 Aug 29 15:32:32.132074 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 923/1865] 10.222.0.62 () {58 vars in 1143 bytes} [Mon Aug 29 15:32:32 2022] GET /compute/v2.1/os-migrations => generated 2739 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:32.142690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c7a76c29-9474-4a70-9867-6846f8b44f46 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:32.149064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c7a76c29-9474-4a70-9867-6846f8b44f46 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:32.174463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7a76c29-9474-4a70-9867-6846f8b44f46 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:32.177858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7a76c29-9474-4a70-9867-6846f8b44f46 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:32.179111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7a76c29-9474-4a70-9867-6846f8b44f46 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:32.180183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7a76c29-9474-4a70-9867-6846f8b44f46 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:32.183728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7a76c29-9474-4a70-9867-6846f8b44f46 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:32.184975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7a76c29-9474-4a70-9867-6846f8b44f46 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:32.228342 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-c7a76c29-9474-4a70-9867-6846f8b44f46 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c7a76c29-9474-4a70-9867-6846f8b44f46 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd HTTP/1.1 Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'c5035af0-406d-4c78-90b3-a679558859bd'} Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:32:32.233753 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:32:32.240763 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:32:32.240763 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:32:32.240763 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:32:32.240763 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:32:32.240763 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:32:32.240763 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. Aug 29 15:32:32.240763 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:32:32.240763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c7a76c29-9474-4a70-9867-6846f8b44f46 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:32:32.244067 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c7a76c29-9474-4a70-9867-6846f8b44f46 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 404 len: 111 microversion: 2.1 time: 0.105544 Aug 29 15:32:32.245437 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 924/1866] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:32 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:32:32.250556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8853aec5-0d68-48d8-9f9a-3ccc1e4cced9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:32.251521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8853aec5-0d68-48d8-9f9a-3ccc1e4cced9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:32.258410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8853aec5-0d68-48d8-9f9a-3ccc1e4cced9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:32.259238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8853aec5-0d68-48d8-9f9a-3ccc1e4cced9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:32.259915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8853aec5-0d68-48d8-9f9a-3ccc1e4cced9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:32.260848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8853aec5-0d68-48d8-9f9a-3ccc1e4cced9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:32.261598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8853aec5-0d68-48d8-9f9a-3ccc1e4cced9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:32.262398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8853aec5-0d68-48d8-9f9a-3ccc1e4cced9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:32.429603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5615c5f3-47f9-4931-b0fd-7e1c271bdeab tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:32.445842 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5615c5f3-47f9-4931-b0fd-7e1c271bdeab tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1706 microversion: 2.1 time: 0.903614 Aug 29 15:32:32.461364 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 943/1867] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:31 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1706 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:32.482270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-638307520", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:32.611916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] validate_networks() for None {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:32:32.910716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8853aec5-0d68-48d8-9f9a-3ccc1e4cced9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:32.921756 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8853aec5-0d68-48d8-9f9a-3ccc1e4cced9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1402 microversion: 2.1 time: 0.674900 Aug 29 15:32:32.935725 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 925/1868] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:32 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1402 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:32.941658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-de2fff01-b66c-4eb0-8c7f-0277c9bf1fb8 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:32.942561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-de2fff01-b66c-4eb0-8c7f-0277c9bf1fb8 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:32.950210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de2fff01-b66c-4eb0-8c7f-0277c9bf1fb8 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:32.950719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de2fff01-b66c-4eb0-8c7f-0277c9bf1fb8 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:32.951164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de2fff01-b66c-4eb0-8c7f-0277c9bf1fb8 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:32.955478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de2fff01-b66c-4eb0-8c7f-0277c9bf1fb8 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:32.955478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de2fff01-b66c-4eb0-8c7f-0277c9bf1fb8 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:32.955478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de2fff01-b66c-4eb0-8c7f-0277c9bf1fb8 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:33.271150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:32:33.272061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:32:33.272741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:32:33.273353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:32:33.273894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:32:33.303922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:33.315073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:33.324093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:33.325938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:33.327681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:33.329625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:33.394716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-de2fff01-b66c-4eb0-8c7f-0277c9bf1fb8 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:33.406272 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-de2fff01-b66c-4eb0-8c7f-0277c9bf1fb8 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1293 microversion: 2.1 time: 0.469020 Aug 29 15:32:33.409991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Getting quotas for project cac390dda11d4f38983e1478de0dbde1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:33.411669 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 926/1869] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:32 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1293 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:33.426882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1e34ba88-5a25-441b-9f8c-ddf35dd2770f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '.version_select at 0x7fc42b6c80d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:33.433880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e34ba88-5a25-441b-9f8c-ddf35dd2770f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:33.436821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e34ba88-5a25-441b-9f8c-ddf35dd2770f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:33.437526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e34ba88-5a25-441b-9f8c-ddf35dd2770f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:33.462224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Getting quotas for user e57b95d059f74c7a894903b5a8f933df and project cac390dda11d4f38983e1478de0dbde1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:33.475939 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1e34ba88-5a25-441b-9f8c-ddf35dd2770f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/os-migrations" status: 200 len: 2739 microversion: 2.1 time: 0.055246 Aug 29 15:32:33.477368 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 927/1870] 10.222.0.62 () {58 vars in 1143 bytes} [Mon Aug 29 15:32:33 2022] GET /compute/v2.1/os-migrations => generated 2739 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:33.496494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1571561096", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "cb3199df-483a-4605-86c6-a5d65679d5da"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:33.512884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:32:33.531161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:32:33.594733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] validate_networks() for [('cb3199df-483a-4605-86c6-a5d65679d5da', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:32:33.635241 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-19ac6d91-cac7-4404-8c4f-4be896f15102 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171199 Aug 29 15:32:33.637900 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 944/1871] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:32:33.646399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b63e275f-b113-41f9-9964-7def7d7ada2c tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:33.647281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b63e275f-b113-41f9-9964-7def7d7ada2c tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:33.679330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b63e275f-b113-41f9-9964-7def7d7ada2c tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:33.680270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b63e275f-b113-41f9-9964-7def7d7ada2c tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:33.680930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b63e275f-b113-41f9-9964-7def7d7ada2c tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:33.681935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b63e275f-b113-41f9-9964-7def7d7ada2c tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:33.682564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b63e275f-b113-41f9-9964-7def7d7ada2c tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:33.683183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b63e275f-b113-41f9-9964-7def7d7ada2c tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:33.828755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b63e275f-b113-41f9-9964-7def7d7ada2c tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:33.846942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b63e275f-b113-41f9-9964-7def7d7ada2c tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:33.867838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b63e275f-b113-41f9-9964-7def7d7ada2c tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:33.869059 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b63e275f-b113-41f9-9964-7def7d7ada2c tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1317 microversion: 2.21 time: 0.229949 Aug 29 15:32:33.875693 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 945/1872] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:33 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:33.893426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-07e45cd3-e4a3-4c63-8b5e-29e2789dd56f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:33.899515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-07e45cd3-e4a3-4c63-8b5e-29e2789dd56f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:33.925875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07e45cd3-e4a3-4c63-8b5e-29e2789dd56f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:33.928585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07e45cd3-e4a3-4c63-8b5e-29e2789dd56f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:33.929360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07e45cd3-e4a3-4c63-8b5e-29e2789dd56f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:33.939131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07e45cd3-e4a3-4c63-8b5e-29e2789dd56f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:33.939716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07e45cd3-e4a3-4c63-8b5e-29e2789dd56f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:33.940828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07e45cd3-e4a3-4c63-8b5e-29e2789dd56f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:34.526190 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-07e45cd3-e4a3-4c63-8b5e-29e2789dd56f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1859 microversion: 2.1 time: 0.644695 Aug 29 15:32:34.563800 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 946/1873] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:33 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1859 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:34.575629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9882924e-1a8a-4da5-a765-001eabfb0fcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:34.578386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9882924e-1a8a-4da5-a765-001eabfb0fcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:34.589595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9882924e-1a8a-4da5-a765-001eabfb0fcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:34.590189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9882924e-1a8a-4da5-a765-001eabfb0fcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:34.590631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9882924e-1a8a-4da5-a765-001eabfb0fcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:34.591709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9882924e-1a8a-4da5-a765-001eabfb0fcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:34.592370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9882924e-1a8a-4da5-a765-001eabfb0fcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:34.592854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9882924e-1a8a-4da5-a765-001eabfb0fcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:34.757311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9882924e-1a8a-4da5-a765-001eabfb0fcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:34.799609 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9882924e-1a8a-4da5-a765-001eabfb0fcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1216 microversion: 2.1 time: 0.233634 Aug 29 15:32:34.803133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:32:34.803669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:32:34.805525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:32:34.805965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:32:34.808098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:32:34.820638 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 947/1874] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:34 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1216 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:34.828985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-740fdff5-4432-49b3-9558-a9f501b80f23 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:34.829670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-740fdff5-4432-49b3-9558-a9f501b80f23 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:34.833181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:34.833703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:34.834194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:34.836142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:34.836617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:34.837111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:34.841590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-740fdff5-4432-49b3-9558-a9f501b80f23 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:34.844060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-740fdff5-4432-49b3-9558-a9f501b80f23 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:34.846503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-740fdff5-4432-49b3-9558-a9f501b80f23 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:34.851559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-740fdff5-4432-49b3-9558-a9f501b80f23 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:34.854421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-740fdff5-4432-49b3-9558-a9f501b80f23 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:34.856714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-740fdff5-4432-49b3-9558-a9f501b80f23 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:34.886168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Getting quotas for project bbbc9e55a8f24d70a82b79243b0fa9e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:34.900375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Getting quotas for user 8dbbadfdb27047dd9237f4a1d311867e and project bbbc9e55a8f24d70a82b79243b0fa9e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:34.927818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:32:34.930303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:32:35.001729 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-af623088-78af-4142-8f27-5f26f45e33e2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.522811 Aug 29 15:32:35.002866 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 928/1875] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:32:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:32:35.008860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c3baf37c-c565-4d3b-a46c-2ac4de5e73be tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:35.010286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c3baf37c-c565-4d3b-a46c-2ac4de5e73be tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:35.019814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3baf37c-c565-4d3b-a46c-2ac4de5e73be tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.023618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3baf37c-c565-4d3b-a46c-2ac4de5e73be tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.025065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3baf37c-c565-4d3b-a46c-2ac4de5e73be tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:35.026071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3baf37c-c565-4d3b-a46c-2ac4de5e73be tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.027585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3baf37c-c565-4d3b-a46c-2ac4de5e73be tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.029558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3baf37c-c565-4d3b-a46c-2ac4de5e73be tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:35.337490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-740fdff5-4432-49b3-9558-a9f501b80f23 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:35.346353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c3baf37c-c565-4d3b-a46c-2ac4de5e73be tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:35.348347 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-740fdff5-4432-49b3-9558-a9f501b80f23 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1402 microversion: 2.1 time: 0.525745 Aug 29 15:32:35.350085 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 948/1876] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:34 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1402 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:35.355665 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c3baf37c-c565-4d3b-a46c-2ac4de5e73be tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1293 microversion: 2.1 time: 0.351224 Aug 29 15:32:35.356263 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 929/1877] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:35 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1293 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:35.359465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a635b96a-736e-4248-9de4-35b881aca3fb tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:35.361266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a635b96a-736e-4248-9de4-35b881aca3fb tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:35.368274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d4ab0d5f-5c79-4567-b187-9adedb819a28 req-6d7e3c0f-4a18-40c2-939c-64e733c52b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b402c3ad-5b4f-46c8-85c4-22988e175bf3", "tag": "d9c36bd7-ba6d-45a9-a314-4837dd1f32e0"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:35.382405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a635b96a-736e-4248-9de4-35b881aca3fb tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.386663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a635b96a-736e-4248-9de4-35b881aca3fb tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.387377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a635b96a-736e-4248-9de4-35b881aca3fb tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:35.390195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a635b96a-736e-4248-9de4-35b881aca3fb tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.390780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a635b96a-736e-4248-9de4-35b881aca3fb tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.393464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d4ab0d5f-5c79-4567-b187-9adedb819a28 req-6d7e3c0f-4a18-40c2-939c-64e733c52b36 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.394064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d4ab0d5f-5c79-4567-b187-9adedb819a28 req-6d7e3c0f-4a18-40c2-939c-64e733c52b36 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.394508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d4ab0d5f-5c79-4567-b187-9adedb819a28 req-6d7e3c0f-4a18-40c2-939c-64e733c52b36 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:35.399848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a635b96a-736e-4248-9de4-35b881aca3fb tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:35.412238 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d4ab0d5f-5c79-4567-b187-9adedb819a28 req-6d7e3c0f-4a18-40c2-939c-64e733c52b36 service nova] Creating event network-changed:d9c36bd7-ba6d-45a9-a314-4837dd1f32e0 for instance b402c3ad-5b4f-46c8-85c4-22988e175bf3 on n-h1-839401-11 Aug 29 15:32:35.421945 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d4ab0d5f-5c79-4567-b187-9adedb819a28 req-6d7e3c0f-4a18-40c2-939c-64e733c52b36 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061821 Aug 29 15:32:35.424610 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 930/1878] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:35.441059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1a0fe57c-1009-4e7c-a714-79161b51d20a tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:35.442030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1a0fe57c-1009-4e7c-a714-79161b51d20a tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:35.459925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a0fe57c-1009-4e7c-a714-79161b51d20a tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.460782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a0fe57c-1009-4e7c-a714-79161b51d20a tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.461918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a0fe57c-1009-4e7c-a714-79161b51d20a tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:35.463057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a0fe57c-1009-4e7c-a714-79161b51d20a tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.465702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a0fe57c-1009-4e7c-a714-79161b51d20a tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.467561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a0fe57c-1009-4e7c-a714-79161b51d20a tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:35.745830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1a0fe57c-1009-4e7c-a714-79161b51d20a tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:35.774507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1a0fe57c-1009-4e7c-a714-79161b51d20a tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:35.774736 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a635b96a-736e-4248-9de4-35b881aca3fb tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1859 microversion: 2.1 time: 0.421341 Aug 29 15:32:35.778218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1a0fe57c-1009-4e7c-a714-79161b51d20a tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:35.782388 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1a0fe57c-1009-4e7c-a714-79161b51d20a tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1359 microversion: 2.21 time: 0.351043 Aug 29 15:32:35.793743 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 949/1879] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:35 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1859 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:35.798630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1a5504fd-14a8-4185-87fa-ab374a723c1c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:35.800034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1a5504fd-14a8-4185-87fa-ab374a723c1c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:35.803281 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 931/1880] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:35 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1359 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:35.824634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a5504fd-14a8-4185-87fa-ab374a723c1c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.837076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a5504fd-14a8-4185-87fa-ab374a723c1c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.838779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a5504fd-14a8-4185-87fa-ab374a723c1c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:35.841498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a5504fd-14a8-4185-87fa-ab374a723c1c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:35.843862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a5504fd-14a8-4185-87fa-ab374a723c1c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:35.844707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a5504fd-14a8-4185-87fa-ab374a723c1c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.005239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1a5504fd-14a8-4185-87fa-ab374a723c1c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:36.021642 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1a5504fd-14a8-4185-87fa-ab374a723c1c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1219 microversion: 2.1 time: 0.225590 Aug 29 15:32:36.022734 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 950/1881] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:35 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1219 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:36.028247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c7cb8bf8-9ca5-4ff8-9fcc-cfe6f7be15ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.031371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c7cb8bf8-9ca5-4ff8-9fcc-cfe6f7be15ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:36.040511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7cb8bf8-9ca5-4ff8-9fcc-cfe6f7be15ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.041308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7cb8bf8-9ca5-4ff8-9fcc-cfe6f7be15ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.042567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7cb8bf8-9ca5-4ff8-9fcc-cfe6f7be15ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.043989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7cb8bf8-9ca5-4ff8-9fcc-cfe6f7be15ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.044949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7cb8bf8-9ca5-4ff8-9fcc-cfe6f7be15ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.045678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7cb8bf8-9ca5-4ff8-9fcc-cfe6f7be15ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.091947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f92e38cc-6f3e-4617-aa91-4e32a89c9dd0 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.102963 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f92e38cc-6f3e-4617-aa91-4e32a89c9dd0 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.295861 Aug 29 15:32:36.113298 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 932/1882] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:32:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:36.126416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-37e0a6e9-ab44-480a-87e0-e0dfdcab7677 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.126919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-37e0a6e9-ab44-480a-87e0-e0dfdcab7677 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:36.137909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37e0a6e9-ab44-480a-87e0-e0dfdcab7677 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.138410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37e0a6e9-ab44-480a-87e0-e0dfdcab7677 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.139089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37e0a6e9-ab44-480a-87e0-e0dfdcab7677 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.141160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37e0a6e9-ab44-480a-87e0-e0dfdcab7677 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.142145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37e0a6e9-ab44-480a-87e0-e0dfdcab7677 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.143005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37e0a6e9-ab44-480a-87e0-e0dfdcab7677 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.272385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c7cb8bf8-9ca5-4ff8-9fcc-cfe6f7be15ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:36.282794 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c7cb8bf8-9ca5-4ff8-9fcc-cfe6f7be15ab tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1272 microversion: 2.1 time: 0.258166 Aug 29 15:32:36.283640 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 951/1883] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:36.290199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-62107ce9-5aff-4791-b2e9-397b4925729d tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.296493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-37e0a6e9-ab44-480a-87e0-e0dfdcab7677 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lazy-loading 'services' on Instance uuid 51a3c2ae-98a2-4e37-96ef-3e787faf0d11 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:36.321503 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-62107ce9-5aff-4791-b2e9-397b4925729d tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.036660 Aug 29 15:32:36.323498 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 952/1884] 10.222.0.62 () {58 vars in 1125 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:36.340499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-939f7469-3f08-4b42-a5c9-05ac6c858d39 req-360b1817-a5a2-4f3f-9a09-ea1ab6188dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bbdc361-13d8-424e-95d7-7ce315b15b02", "tag": "ba4a48da-edec-40fa-8a22-de3d316b9b9e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:36.354098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-939f7469-3f08-4b42-a5c9-05ac6c858d39 req-360b1817-a5a2-4f3f-9a09-ea1ab6188dba service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.354593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-939f7469-3f08-4b42-a5c9-05ac6c858d39 req-360b1817-a5a2-4f3f-9a09-ea1ab6188dba service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.355254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-939f7469-3f08-4b42-a5c9-05ac6c858d39 req-360b1817-a5a2-4f3f-9a09-ea1ab6188dba service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.370816 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-939f7469-3f08-4b42-a5c9-05ac6c858d39 req-360b1817-a5a2-4f3f-9a09-ea1ab6188dba service nova] Creating event network-changed:ba4a48da-edec-40fa-8a22-de3d316b9b9e for instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 on n-h1-839401-11 Aug 29 15:32:36.376442 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-939f7469-3f08-4b42-a5c9-05ac6c858d39 req-360b1817-a5a2-4f3f-9a09-ea1ab6188dba service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051591 Aug 29 15:32:36.377321 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 953/1885] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:36.382826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aae1a06c-691f-43e0-b4f4-66a0fa83bb69 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.391889 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aae1a06c-691f-43e0-b4f4-66a0fa83bb69 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013271 Aug 29 15:32:36.392703 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 954/1886] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:36.400701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a31225d3-0b38-4f88-bbde-719b63588693 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.402392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a31225d3-0b38-4f88-bbde-719b63588693 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:36.411483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a31225d3-0b38-4f88-bbde-719b63588693 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.412259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a31225d3-0b38-4f88-bbde-719b63588693 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.412726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a31225d3-0b38-4f88-bbde-719b63588693 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.413692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a31225d3-0b38-4f88-bbde-719b63588693 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.414424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a31225d3-0b38-4f88-bbde-719b63588693 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.414976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a31225d3-0b38-4f88-bbde-719b63588693 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.440693 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-37e0a6e9-ab44-480a-87e0-e0dfdcab7677 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "DELETE /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments/c2b84825-7bbd-4166-af15-623dc682d688" status: 202 len: 0 microversion: 2.1 time: 0.317744 Aug 29 15:32:36.441422 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 933/1887] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 15:32:36 2022] DELETE /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments/c2b84825-7bbd-4166-af15-623dc682d688 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:36.447349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aaa87b9e-0d41-4c53-8734-9723e413c6e6 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.448346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aaa87b9e-0d41-4c53-8734-9723e413c6e6 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:36.459148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aaa87b9e-0d41-4c53-8734-9723e413c6e6 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.459646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aaa87b9e-0d41-4c53-8734-9723e413c6e6 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.460131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aaa87b9e-0d41-4c53-8734-9723e413c6e6 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.461562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aaa87b9e-0d41-4c53-8734-9723e413c6e6 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.462705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aaa87b9e-0d41-4c53-8734-9723e413c6e6 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.463534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aaa87b9e-0d41-4c53-8734-9723e413c6e6 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.632947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aaa87b9e-0d41-4c53-8734-9723e413c6e6 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:36.638546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a31225d3-0b38-4f88-bbde-719b63588693 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:36.647980 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aaa87b9e-0d41-4c53-8734-9723e413c6e6 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1484 microversion: 2.1 time: 0.204887 Aug 29 15:32:36.648854 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 934/1888] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1484 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:36.656333 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a31225d3-0b38-4f88-bbde-719b63588693 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1402 microversion: 2.1 time: 0.255071 Aug 29 15:32:36.657269 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 955/1889] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1402 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:36.660221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ac304cdc-0492-4c34-bf1d-1e2ac9554f06 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.662291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9f8439d6-0278-486d-a6a9-e996c9cedc6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.664728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9f8439d6-0278-486d-a6a9-e996c9cedc6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:36.670014 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ac304cdc-0492-4c34-bf1d-1e2ac9554f06 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019691 Aug 29 15:32:36.670620 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 935/1890] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:36.672968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f8439d6-0278-486d-a6a9-e996c9cedc6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.674309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f8439d6-0278-486d-a6a9-e996c9cedc6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.674748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f8439d6-0278-486d-a6a9-e996c9cedc6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.675455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f8439d6-0278-486d-a6a9-e996c9cedc6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.675775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-232f8d31-211c-4a5a-b48f-07cfd7eb8da2 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.675904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f8439d6-0278-486d-a6a9-e996c9cedc6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.676348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f8439d6-0278-486d-a6a9-e996c9cedc6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.676491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-232f8d31-211c-4a5a-b48f-07cfd7eb8da2 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:36.682693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-232f8d31-211c-4a5a-b48f-07cfd7eb8da2 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.683185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-232f8d31-211c-4a5a-b48f-07cfd7eb8da2 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.683623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-232f8d31-211c-4a5a-b48f-07cfd7eb8da2 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.684356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-232f8d31-211c-4a5a-b48f-07cfd7eb8da2 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.684816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-232f8d31-211c-4a5a-b48f-07cfd7eb8da2 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.685286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-232f8d31-211c-4a5a-b48f-07cfd7eb8da2 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.716739 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9f8439d6-0278-486d-a6a9-e996c9cedc6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058203 Aug 29 15:32:36.718111 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 956/1891] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:36.724261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b61dd07e-f3e1-487a-b505-6afffcdf84b5 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.752188 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b61dd07e-f3e1-487a-b505-6afffcdf84b5 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.032673 Aug 29 15:32:36.753138 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 957/1892] 10.222.0.62 () {58 vars in 1165 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:36.770163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5e1ecda1-aa04-4397-a9f0-c7947a6a0f62 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.778520 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5e1ecda1-aa04-4397-a9f0-c7947a6a0f62 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013142 Aug 29 15:32:36.784256 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-232f8d31-211c-4a5a-b48f-07cfd7eb8da2 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112314 Aug 29 15:32:36.784861 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 936/1893] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:36.786148 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 958/1894] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:32:36.792957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7efa3914-0c07-4dbc-8b49-de039c3fa5b9 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.808851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f65a4524-5810-41d8-92f4-638b83a6ffea tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.810051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f65a4524-5810-41d8-92f4-638b83a6ffea tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:36.820732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65a4524-5810-41d8-92f4-638b83a6ffea tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.821731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65a4524-5810-41d8-92f4-638b83a6ffea tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.822468 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7efa3914-0c07-4dbc-8b49-de039c3fa5b9 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.035102 Aug 29 15:32:36.823179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65a4524-5810-41d8-92f4-638b83a6ffea tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.823391 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 937/1895] 10.222.0.62 () {58 vars in 1169 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:36.824521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65a4524-5810-41d8-92f4-638b83a6ffea tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:36.825472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65a4524-5810-41d8-92f4-638b83a6ffea tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:36.826433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65a4524-5810-41d8-92f4-638b83a6ffea tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:36.838915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-512a3be2-83c1-468a-a44c-be20c7c64450 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.861178 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-512a3be2-83c1-468a-a44c-be20c7c64450 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.026325 Aug 29 15:32:36.862439 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 938/1896] 10.222.0.62 () {58 vars in 1161 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:32:36.879212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c8294302-7a4b-4059-99a1-f284105d019c tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.889321 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c8294302-7a4b-4059-99a1-f284105d019c tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017736 Aug 29 15:32:36.889978 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 939/1897] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:32:36.904503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-55f07a3f-1a93-4c82-8d49-4a3ccb941e56 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.962292 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-55f07a3f-1a93-4c82-8d49-4a3ccb941e56 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.061495 Aug 29 15:32:36.973868 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 940/1898] 10.222.0.62 () {58 vars in 1167 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:36.980502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1b63daa5-9e16-4706-9b93-392de3f88d40 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:36.991565 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1b63daa5-9e16-4706-9b93-392de3f88d40 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015591 Aug 29 15:32:36.992591 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 941/1899] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:37.004407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea6ffe8c-a2ab-4d4c-8376-6b1635e48086 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.018964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f65a4524-5810-41d8-92f4-638b83a6ffea tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:37.022557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:37.028078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f65a4524-5810-41d8-92f4-638b83a6ffea tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:37.029898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f65a4524-5810-41d8-92f4-638b83a6ffea tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:37.031416 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f65a4524-5810-41d8-92f4-638b83a6ffea tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1359 microversion: 2.21 time: 0.227427 Aug 29 15:32:37.043560 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 959/1900] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:32:37.044521 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ea6ffe8c-a2ab-4d4c-8376-6b1635e48086 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.043095 Aug 29 15:32:37.044521 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 942/1901] 10.222.0.62 () {58 vars in 1144 bytes} [Mon Aug 29 15:32:36 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:37.060264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4d501ff3-ae1e-434d-9a9a-c4ec3fd2b133 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.061408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6cba13df-dee9-4f17-b1a5-559eae33387d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.062031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6cba13df-dee9-4f17-b1a5-559eae33387d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:37.068768 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4d501ff3-ae1e-434d-9a9a-c4ec3fd2b133 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012602 Aug 29 15:32:37.072447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cba13df-dee9-4f17-b1a5-559eae33387d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:37.073656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cba13df-dee9-4f17-b1a5-559eae33387d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:37.074361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cba13df-dee9-4f17-b1a5-559eae33387d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:37.075318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cba13df-dee9-4f17-b1a5-559eae33387d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:37.075771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cba13df-dee9-4f17-b1a5-559eae33387d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:37.076431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cba13df-dee9-4f17-b1a5-559eae33387d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:37.077172 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 943/1902] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:37.085758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6d9b1ce4-193b-47d3-b48c-a22451e794ca tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.102621 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6d9b1ce4-193b-47d3-b48c-a22451e794ca tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.024277 Aug 29 15:32:37.117636 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 944/1903] 10.222.0.62 () {58 vars in 1148 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:37.123370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-337ae85b-4673-46ba-8df2-3ac81bbe8a24 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.140580 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-337ae85b-4673-46ba-8df2-3ac81bbe8a24 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.020985 Aug 29 15:32:37.141113 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 945/1904] 10.222.0.62 () {58 vars in 1140 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:37.149481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6cba13df-dee9-4f17-b1a5-559eae33387d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:37.153268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5f668164-17c9-4dd5-9924-d63f12fe7ef2 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.161247 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6cba13df-dee9-4f17-b1a5-559eae33387d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1211 microversion: 2.1 time: 0.107637 Aug 29 15:32:37.162365 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 960/1905] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:37.163703 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5f668164-17c9-4dd5-9924-d63f12fe7ef2 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014364 Aug 29 15:32:37.165134 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 946/1906] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:32:37.177942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c8d8338d-f058-439e-b4e5-2a20aeb52175 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.217985 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c8d8338d-f058-439e-b4e5-2a20aeb52175 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.045390 Aug 29 15:32:37.218588 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 961/1907] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:37.234334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0a96b725-20df-451e-8ff8-ea288ed7cd13 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.256556 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0a96b725-20df-451e-8ff8-ea288ed7cd13 tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026188 Aug 29 15:32:37.269644 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 947/1908] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:37.275805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7fddc64c-a22b-49b7-9df6-6e7c0d1958ce tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.285076 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7fddc64c-a22b-49b7-9df6-6e7c0d1958ce tempest-FlavorsV2TestJSON-1912552408 tempest-FlavorsV2TestJSON-1912552408-project] 10.222.0.62 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013755 Aug 29 15:32:37.285876 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 962/1909] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:32:37.305960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-798fbea0-85c6-48c2-be8a-4b8408618449 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.306595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-798fbea0-85c6-48c2-be8a-4b8408618449 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:37.314632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-798fbea0-85c6-48c2-be8a-4b8408618449 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:37.315241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-798fbea0-85c6-48c2-be8a-4b8408618449 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:37.315599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-798fbea0-85c6-48c2-be8a-4b8408618449 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:37.316306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-798fbea0-85c6-48c2-be8a-4b8408618449 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:37.316762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-798fbea0-85c6-48c2-be8a-4b8408618449 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:37.317201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-798fbea0-85c6-48c2-be8a-4b8408618449 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:37.396218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-798fbea0-85c6-48c2-be8a-4b8408618449 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:37.407971 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-798fbea0-85c6-48c2-be8a-4b8408618449 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1282 microversion: 2.1 time: 0.105822 Aug 29 15:32:37.409233 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 948/1910] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1282 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:37.679670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-282e3267-3900-4b53-a288-28d6408f845b tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.680442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-282e3267-3900-4b53-a288-28d6408f845b tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:37.689384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-282e3267-3900-4b53-a288-28d6408f845b tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:37.690806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-282e3267-3900-4b53-a288-28d6408f845b tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:37.691408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-282e3267-3900-4b53-a288-28d6408f845b tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:37.692289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-282e3267-3900-4b53-a288-28d6408f845b tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:37.692753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-282e3267-3900-4b53-a288-28d6408f845b tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:37.693315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-282e3267-3900-4b53-a288-28d6408f845b tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:37.729797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7071e2f3-5149-4dfe-bbf7-051ca0c00dc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:37.732088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7071e2f3-5149-4dfe-bbf7-051ca0c00dc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:37.743029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7071e2f3-5149-4dfe-bbf7-051ca0c00dc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:37.747068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7071e2f3-5149-4dfe-bbf7-051ca0c00dc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:37.747598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7071e2f3-5149-4dfe-bbf7-051ca0c00dc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:37.748663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7071e2f3-5149-4dfe-bbf7-051ca0c00dc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:37.750789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7071e2f3-5149-4dfe-bbf7-051ca0c00dc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:37.751312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7071e2f3-5149-4dfe-bbf7-051ca0c00dc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:37.790857 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7071e2f3-5149-4dfe-bbf7-051ca0c00dc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064580 Aug 29 15:32:37.790857 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 949/1911] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:32:37.919032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-282e3267-3900-4b53-a288-28d6408f845b tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:37.935604 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-282e3267-3900-4b53-a288-28d6408f845b tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1402 microversion: 2.1 time: 0.261427 Aug 29 15:32:37.938633 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 963/1912] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:37 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1402 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:38.057759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-88d7d861-9ee2-4c88-b26d-ff5ab8b5e487 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:38.059077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-88d7d861-9ee2-4c88-b26d-ff5ab8b5e487 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:38.065826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d7d861-9ee2-4c88-b26d-ff5ab8b5e487 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.066637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d7d861-9ee2-4c88-b26d-ff5ab8b5e487 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.067249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d7d861-9ee2-4c88-b26d-ff5ab8b5e487 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.068150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d7d861-9ee2-4c88-b26d-ff5ab8b5e487 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.068781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d7d861-9ee2-4c88-b26d-ff5ab8b5e487 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.069445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d7d861-9ee2-4c88-b26d-ff5ab8b5e487 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.185744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f8d6c78e-46fd-4510-a186-82695373ef21 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:38.185744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f8d6c78e-46fd-4510-a186-82695373ef21 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:38.192396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8d6c78e-46fd-4510-a186-82695373ef21 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.192886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8d6c78e-46fd-4510-a186-82695373ef21 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.193346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8d6c78e-46fd-4510-a186-82695373ef21 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.194217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8d6c78e-46fd-4510-a186-82695373ef21 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.194671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8d6c78e-46fd-4510-a186-82695373ef21 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.195089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8d6c78e-46fd-4510-a186-82695373ef21 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.288108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f8d6c78e-46fd-4510-a186-82695373ef21 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:38.300202 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f8d6c78e-46fd-4510-a186-82695373ef21 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1211 microversion: 2.1 time: 0.120005 Aug 29 15:32:38.300798 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 964/1913] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:38 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1211 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:38.430354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-003d6610-b44a-4f7e-a9c6-16f9f09319f8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:38.431054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-003d6610-b44a-4f7e-a9c6-16f9f09319f8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:38.439782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-003d6610-b44a-4f7e-a9c6-16f9f09319f8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.440563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-003d6610-b44a-4f7e-a9c6-16f9f09319f8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.441967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-003d6610-b44a-4f7e-a9c6-16f9f09319f8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.443296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-003d6610-b44a-4f7e-a9c6-16f9f09319f8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.459976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-003d6610-b44a-4f7e-a9c6-16f9f09319f8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.468224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-003d6610-b44a-4f7e-a9c6-16f9f09319f8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.657683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-88d7d861-9ee2-4c88-b26d-ff5ab8b5e487 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:38.671836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-88d7d861-9ee2-4c88-b26d-ff5ab8b5e487 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:38.675424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-88d7d861-9ee2-4c88-b26d-ff5ab8b5e487 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:38.676585 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-88d7d861-9ee2-4c88-b26d-ff5ab8b5e487 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1359 microversion: 2.21 time: 0.622974 Aug 29 15:32:38.693252 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 950/1914] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:38 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1359 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:32:38.704737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a0fcf464-2a20-430c-ac18-638e0e15e0c4 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:38.705483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a0fcf464-2a20-430c-ac18-638e0e15e0c4 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:38.742377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0fcf464-2a20-430c-ac18-638e0e15e0c4 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.742892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0fcf464-2a20-430c-ac18-638e0e15e0c4 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.743338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0fcf464-2a20-430c-ac18-638e0e15e0c4 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.746285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0fcf464-2a20-430c-ac18-638e0e15e0c4 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.746807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0fcf464-2a20-430c-ac18-638e0e15e0c4 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.747249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0fcf464-2a20-430c-ac18-638e0e15e0c4 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.857761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-003d6610-b44a-4f7e-a9c6-16f9f09319f8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:38.873925 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-003d6610-b44a-4f7e-a9c6-16f9f09319f8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1282 microversion: 2.1 time: 0.442301 Aug 29 15:32:38.874958 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 965/1915] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:38 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1282 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:38.890321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-424689ad-02d3-4f19-bada-ebe392c7c76d req-15ee2b57-b7fd-4ea8-8f17-6f73fea7e28a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e044d38-7a82-4cb6-8e91-fcbdca201a08", "tag": "76c803a9-7e99-4e7e-86e4-8d82b4fa6dde"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:38.914324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-424689ad-02d3-4f19-bada-ebe392c7c76d req-15ee2b57-b7fd-4ea8-8f17-6f73fea7e28a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.915115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-424689ad-02d3-4f19-bada-ebe392c7c76d req-15ee2b57-b7fd-4ea8-8f17-6f73fea7e28a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.915794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-424689ad-02d3-4f19-bada-ebe392c7c76d req-15ee2b57-b7fd-4ea8-8f17-6f73fea7e28a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.942879 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-424689ad-02d3-4f19-bada-ebe392c7c76d req-15ee2b57-b7fd-4ea8-8f17-6f73fea7e28a service nova] Creating event network-changed:76c803a9-7e99-4e7e-86e4-8d82b4fa6dde for instance 7e044d38-7a82-4cb6-8e91-fcbdca201a08 on n-h2-839401-11 Aug 29 15:32:38.955375 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-424689ad-02d3-4f19-bada-ebe392c7c76d req-15ee2b57-b7fd-4ea8-8f17-6f73fea7e28a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077527 Aug 29 15:32:38.958274 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 966/1916] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:38.970022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3c83876f-341e-4220-926c-b181dcf16737 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:38.974674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3c83876f-341e-4220-926c-b181dcf16737 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:38.989881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c83876f-341e-4220-926c-b181dcf16737 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.990383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c83876f-341e-4220-926c-b181dcf16737 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.990827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c83876f-341e-4220-926c-b181dcf16737 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:38.991557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c83876f-341e-4220-926c-b181dcf16737 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:38.992016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c83876f-341e-4220-926c-b181dcf16737 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:38.992445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c83876f-341e-4220-926c-b181dcf16737 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:39.101597 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3c83876f-341e-4220-926c-b181dcf16737 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141802 Aug 29 15:32:39.109283 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 967/1917] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:32:38 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:39.122520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-262453d5-30fd-4229-a4ad-ee7675551452 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:39.125344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-262453d5-30fd-4229-a4ad-ee7675551452 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:39.140314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-262453d5-30fd-4229-a4ad-ee7675551452 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.141586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-262453d5-30fd-4229-a4ad-ee7675551452 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.144385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-262453d5-30fd-4229-a4ad-ee7675551452 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:39.145630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-262453d5-30fd-4229-a4ad-ee7675551452 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.146333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-262453d5-30fd-4229-a4ad-ee7675551452 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.148658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-262453d5-30fd-4229-a4ad-ee7675551452 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:39.397579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a0fcf464-2a20-430c-ac18-638e0e15e0c4 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:39.406349 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a0fcf464-2a20-430c-ac18-638e0e15e0c4 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1484 microversion: 2.1 time: 0.710051 Aug 29 15:32:39.406950 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 951/1918] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:38 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1484 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:39.429906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7626a5fa-d704-4ae4-960e-23b3386fdbbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:39.431617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7626a5fa-d704-4ae4-960e-23b3386fdbbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:39.447204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7626a5fa-d704-4ae4-960e-23b3386fdbbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.447996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7626a5fa-d704-4ae4-960e-23b3386fdbbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.448647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7626a5fa-d704-4ae4-960e-23b3386fdbbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:39.449585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7626a5fa-d704-4ae4-960e-23b3386fdbbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.450427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7626a5fa-d704-4ae4-960e-23b3386fdbbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.452254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7626a5fa-d704-4ae4-960e-23b3386fdbbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:39.463599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:39.601910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7626a5fa-d704-4ae4-960e-23b3386fdbbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:39.611058 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7626a5fa-d704-4ae4-960e-23b3386fdbbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1267 microversion: 2.1 time: 0.201504 Aug 29 15:32:39.619213 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 952/1919] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:39 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:39.718811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d607b6a9-ab38-47da-9307-c541aee1291b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:39.719673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d607b6a9-ab38-47da-9307-c541aee1291b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:39.742175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d607b6a9-ab38-47da-9307-c541aee1291b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.745434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d607b6a9-ab38-47da-9307-c541aee1291b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.746145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d607b6a9-ab38-47da-9307-c541aee1291b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:39.747117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d607b6a9-ab38-47da-9307-c541aee1291b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:39.747791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d607b6a9-ab38-47da-9307-c541aee1291b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:39.749872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d607b6a9-ab38-47da-9307-c541aee1291b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:40.559125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d607b6a9-ab38-47da-9307-c541aee1291b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:40.573138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-262453d5-30fd-4229-a4ad-ee7675551452 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:40.586814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d607b6a9-ab38-47da-9307-c541aee1291b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:40.588609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d607b6a9-ab38-47da-9307-c541aee1291b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:40.589548 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-262453d5-30fd-4229-a4ad-ee7675551452 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1402 microversion: 2.1 time: 1.477063 Aug 29 15:32:40.590473 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d607b6a9-ab38-47da-9307-c541aee1291b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1359 microversion: 2.21 time: 0.875895 Aug 29 15:32:40.591546 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 953/1920] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:39 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1359 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:32:40.595721 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 968/1921] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:39 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1402 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:40.626028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-21344563-6814-4daa-a2c1-87c7b81ab403 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:40.627832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-21344563-6814-4daa-a2c1-87c7b81ab403 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:40.649561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21344563-6814-4daa-a2c1-87c7b81ab403 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:40.660942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21344563-6814-4daa-a2c1-87c7b81ab403 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:40.661590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21344563-6814-4daa-a2c1-87c7b81ab403 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:40.663165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21344563-6814-4daa-a2c1-87c7b81ab403 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:40.663907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21344563-6814-4daa-a2c1-87c7b81ab403 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:40.664552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21344563-6814-4daa-a2c1-87c7b81ab403 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:41.016947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4077507f-038e-40a9-9014-7a74917ef398 tempest-ListImagesTestJSON-811587036 tempest-ListImagesTestJSON-811587036-project] Calling method '.version_select at 0x7fc42b7b2310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:41.105763 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4077507f-038e-40a9-9014-7a74917ef398 tempest-ListImagesTestJSON-811587036 tempest-ListImagesTestJSON-811587036-project] 10.222.0.62 "GET /compute/v2.1/images/2c042d4c-e5f7-47c3-ac9e-1fb093df192c" status: 200 len: 784 microversion: 2.1 time: 0.512903 Aug 29 15:32:41.106386 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 954/1922] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:32:40 2022] GET /compute/v2.1/images/2c042d4c-e5f7-47c3-ac9e-1fb093df192c => generated 784 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:41.121843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-50336ee9-01a1-49f0-b259-d67ca12a49d2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:41.129173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-50336ee9-01a1-49f0-b259-d67ca12a49d2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:41.152004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50336ee9-01a1-49f0-b259-d67ca12a49d2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:41.152563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50336ee9-01a1-49f0-b259-d67ca12a49d2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:41.153319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50336ee9-01a1-49f0-b259-d67ca12a49d2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:41.154876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50336ee9-01a1-49f0-b259-d67ca12a49d2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:41.158570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50336ee9-01a1-49f0-b259-d67ca12a49d2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:41.159285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50336ee9-01a1-49f0-b259-d67ca12a49d2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:41.162477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-21344563-6814-4daa-a2c1-87c7b81ab403 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:41.176127 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-21344563-6814-4daa-a2c1-87c7b81ab403 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1312 microversion: 2.1 time: 0.565728 Aug 29 15:32:41.177056 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 969/1923] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:40 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1312 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:41.181895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0c1c78fc-364e-444d-83a3-8557694548a2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:41.182503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0c1c78fc-364e-444d-83a3-8557694548a2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:41.202777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c1c78fc-364e-444d-83a3-8557694548a2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:41.203272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c1c78fc-364e-444d-83a3-8557694548a2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:41.213297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c1c78fc-364e-444d-83a3-8557694548a2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:41.214556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c1c78fc-364e-444d-83a3-8557694548a2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:41.215060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c1c78fc-364e-444d-83a3-8557694548a2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:41.215506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c1c78fc-364e-444d-83a3-8557694548a2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:41.231007 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-50336ee9-01a1-49f0-b259-d67ca12a49d2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123518 Aug 29 15:32:41.236149 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 955/1924] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:32:41 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:41.248581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-691e3906-6cd2-41fb-a2ce-2f89495e7875 tempest-ListImagesTestJSON-811587036 tempest-ListImagesTestJSON-811587036-project] Calling method '.version_select at 0x7fc42b6da820>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:41.319605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0c1c78fc-364e-444d-83a3-8557694548a2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:41.344070 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0c1c78fc-364e-444d-83a3-8557694548a2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1273 microversion: 2.1 time: 0.165817 Aug 29 15:32:41.346264 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 970/1925] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:41 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1273 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:41.365622 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-691e3906-6cd2-41fb-a2ce-2f89495e7875 tempest-ListImagesTestJSON-811587036 tempest-ListImagesTestJSON-811587036-project] 10.222.0.62 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.126765 Aug 29 15:32:41.366826 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 956/1926] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 29 15:32:41 2022] GET /compute/v2.1/images => generated 445 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:41.379819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c0cf4bc8-0efc-4178-95f4-1ad33c0c81ae tempest-ListImagesTestJSON-811587036 tempest-ListImagesTestJSON-811587036-project] Calling method '.version_select at 0x7fc433c38700>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:41.437133 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c0cf4bc8-0efc-4178-95f4-1ad33c0c81ae tempest-ListImagesTestJSON-811587036 tempest-ListImagesTestJSON-811587036-project] 10.222.0.62 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.061711 Aug 29 15:32:41.441859 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 971/1927] 10.222.0.62 () {58 vars in 1143 bytes} [Mon Aug 29 15:32:41 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:41.616144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-353784b0-4cb9-4012-9ba8-797494889be8 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:41.624008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8168f0d9-5fad-4a81-9a3a-587a39a02bcf tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:41.624658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8168f0d9-5fad-4a81-9a3a-587a39a02bcf tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:41.625287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-353784b0-4cb9-4012-9ba8-797494889be8 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:41.642945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-353784b0-4cb9-4012-9ba8-797494889be8 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:41.644790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8168f0d9-5fad-4a81-9a3a-587a39a02bcf tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:41.646207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8168f0d9-5fad-4a81-9a3a-587a39a02bcf tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:41.646979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-353784b0-4cb9-4012-9ba8-797494889be8 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:41.648512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8168f0d9-5fad-4a81-9a3a-587a39a02bcf tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:41.649141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-353784b0-4cb9-4012-9ba8-797494889be8 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:41.652416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8168f0d9-5fad-4a81-9a3a-587a39a02bcf tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:41.653458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-353784b0-4cb9-4012-9ba8-797494889be8 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:41.654097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8168f0d9-5fad-4a81-9a3a-587a39a02bcf tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:41.654722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-353784b0-4cb9-4012-9ba8-797494889be8 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:41.655642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8168f0d9-5fad-4a81-9a3a-587a39a02bcf tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:41.656225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-353784b0-4cb9-4012-9ba8-797494889be8 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:42.235133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-353784b0-4cb9-4012-9ba8-797494889be8 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:42.250944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-353784b0-4cb9-4012-9ba8-797494889be8 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:42.255084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-353784b0-4cb9-4012-9ba8-797494889be8 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:42.258442 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-353784b0-4cb9-4012-9ba8-797494889be8 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1359 microversion: 2.21 time: 0.646396 Aug 29 15:32:42.285281 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 957/1928] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:41 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1359 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:42.291568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-292a5024-abc2-452c-81e1-fa43457713a6 req-dfc20568-d1ac-4c9f-a7cf-9d0be40b050c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11592c2a-43a5-492f-a40a-64ae99efa92e", "tag": "b8190072-2f76-41df-9404-7f44a26edb8c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:42.296550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8168f0d9-5fad-4a81-9a3a-587a39a02bcf tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:42.310374 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8168f0d9-5fad-4a81-9a3a-587a39a02bcf tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1402 microversion: 2.1 time: 0.688870 Aug 29 15:32:42.312485 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 972/1929] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:41 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1402 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:42.332896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3794c723-726c-4c71-bb96-4bf54c5c7e5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:42.334317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3794c723-726c-4c71-bb96-4bf54c5c7e5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:42.342317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3794c723-726c-4c71-bb96-4bf54c5c7e5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:42.343041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3794c723-726c-4c71-bb96-4bf54c5c7e5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:42.343935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3794c723-726c-4c71-bb96-4bf54c5c7e5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:42.344832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3794c723-726c-4c71-bb96-4bf54c5c7e5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:42.345653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3794c723-726c-4c71-bb96-4bf54c5c7e5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:42.346378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3794c723-726c-4c71-bb96-4bf54c5c7e5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:42.365338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-292a5024-abc2-452c-81e1-fa43457713a6 req-dfc20568-d1ac-4c9f-a7cf-9d0be40b050c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:42.367476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-292a5024-abc2-452c-81e1-fa43457713a6 req-dfc20568-d1ac-4c9f-a7cf-9d0be40b050c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:42.368012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-292a5024-abc2-452c-81e1-fa43457713a6 req-dfc20568-d1ac-4c9f-a7cf-9d0be40b050c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:42.394456 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-292a5024-abc2-452c-81e1-fa43457713a6 req-dfc20568-d1ac-4c9f-a7cf-9d0be40b050c service nova] Creating event network-changed:b8190072-2f76-41df-9404-7f44a26edb8c for instance 11592c2a-43a5-492f-a40a-64ae99efa92e on n-h1-839401-11 Aug 29 15:32:42.422589 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-292a5024-abc2-452c-81e1-fa43457713a6 req-dfc20568-d1ac-4c9f-a7cf-9d0be40b050c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131676 Aug 29 15:32:42.424155 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 958/1930] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:42.442069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-52d9e0d0-0915-4aec-b962-89584e1d5b76 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:42.451771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-52d9e0d0-0915-4aec-b962-89584e1d5b76 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:42.478166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52d9e0d0-0915-4aec-b962-89584e1d5b76 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:42.479734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52d9e0d0-0915-4aec-b962-89584e1d5b76 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:42.481941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52d9e0d0-0915-4aec-b962-89584e1d5b76 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:42.483778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52d9e0d0-0915-4aec-b962-89584e1d5b76 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:42.488123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52d9e0d0-0915-4aec-b962-89584e1d5b76 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:42.489817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52d9e0d0-0915-4aec-b962-89584e1d5b76 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:42.586132 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-52d9e0d0-0915-4aec-b962-89584e1d5b76 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160395 Aug 29 15:32:42.596689 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 959/1931] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:32:42 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:42.601848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-837c1adc-2711-4016-b21d-b76d91af5f39 req-253e7bc3-2122-41bd-9b05-cc2b99168d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b402c3ad-5b4f-46c8-85c4-22988e175bf3", "name": "network-vif-plugged", "status": "completed", "tag": "d9c36bd7-ba6d-45a9-a314-4837dd1f32e0"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:42.626124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:42.634076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-837c1adc-2711-4016-b21d-b76d91af5f39 req-253e7bc3-2122-41bd-9b05-cc2b99168d28 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:42.634741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-837c1adc-2711-4016-b21d-b76d91af5f39 req-253e7bc3-2122-41bd-9b05-cc2b99168d28 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:42.637805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-837c1adc-2711-4016-b21d-b76d91af5f39 req-253e7bc3-2122-41bd-9b05-cc2b99168d28 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:42.668837 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-837c1adc-2711-4016-b21d-b76d91af5f39 req-253e7bc3-2122-41bd-9b05-cc2b99168d28 service nova] Creating event network-vif-plugged:d9c36bd7-ba6d-45a9-a314-4837dd1f32e0 for instance b402c3ad-5b4f-46c8-85c4-22988e175bf3 on n-h1-839401-11 Aug 29 15:32:42.692690 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-837c1adc-2711-4016-b21d-b76d91af5f39 req-253e7bc3-2122-41bd-9b05-cc2b99168d28 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090862 Aug 29 15:32:42.697525 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 960/1932] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:42.711453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-66890395-2209-4050-8b53-735e910a7da3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:42.712158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-66890395-2209-4050-8b53-735e910a7da3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:42.740054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66890395-2209-4050-8b53-735e910a7da3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:42.741543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66890395-2209-4050-8b53-735e910a7da3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:42.746498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3794c723-726c-4c71-bb96-4bf54c5c7e5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:42.752184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66890395-2209-4050-8b53-735e910a7da3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:42.758150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66890395-2209-4050-8b53-735e910a7da3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:42.758856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66890395-2209-4050-8b53-735e910a7da3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:42.759470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66890395-2209-4050-8b53-735e910a7da3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:42.759929 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3794c723-726c-4c71-bb96-4bf54c5c7e5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1312 microversion: 2.1 time: 0.430982 Aug 29 15:32:42.764270 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 973/1933] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:42 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1312 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:43.025869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-66890395-2209-4050-8b53-735e910a7da3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:43.037132 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-66890395-2209-4050-8b53-735e910a7da3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1315 microversion: 2.1 time: 0.338169 Aug 29 15:32:43.037868 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 961/1934] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:42 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:43.288268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-21382b2a-cfd8-4450-bfd9-440211982daf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:43.288990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-21382b2a-cfd8-4450-bfd9-440211982daf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:43.296296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21382b2a-cfd8-4450-bfd9-440211982daf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:43.297447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21382b2a-cfd8-4450-bfd9-440211982daf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:43.298792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21382b2a-cfd8-4450-bfd9-440211982daf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:43.299569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21382b2a-cfd8-4450-bfd9-440211982daf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:43.300027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21382b2a-cfd8-4450-bfd9-440211982daf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:43.300456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21382b2a-cfd8-4450-bfd9-440211982daf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:43.335949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ed382dc0-a7b5-442c-ba84-609fe4acdab2 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:43.336839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ed382dc0-a7b5-442c-ba84-609fe4acdab2 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:43.343887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed382dc0-a7b5-442c-ba84-609fe4acdab2 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:43.344649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed382dc0-a7b5-442c-ba84-609fe4acdab2 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:43.345301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed382dc0-a7b5-442c-ba84-609fe4acdab2 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:43.346264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed382dc0-a7b5-442c-ba84-609fe4acdab2 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:43.346894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed382dc0-a7b5-442c-ba84-609fe4acdab2 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:43.347487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed382dc0-a7b5-442c-ba84-609fe4acdab2 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:43.361267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:43.481128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:43.656852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ed382dc0-a7b5-442c-ba84-609fe4acdab2 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:43.670292 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ed382dc0-a7b5-442c-ba84-609fe4acdab2 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1402 microversion: 2.1 time: 0.335993 Aug 29 15:32:43.672233 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 962/1935] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:43 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1402 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:43.686277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c91beb10-fef0-4188-bbeb-21f12fb68250 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:43.689190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c91beb10-fef0-4188-bbeb-21f12fb68250 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:43.697617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c91beb10-fef0-4188-bbeb-21f12fb68250 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:43.702893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c91beb10-fef0-4188-bbeb-21f12fb68250 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:43.703635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c91beb10-fef0-4188-bbeb-21f12fb68250 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:43.709221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c91beb10-fef0-4188-bbeb-21f12fb68250 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:43.710002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c91beb10-fef0-4188-bbeb-21f12fb68250 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:43.710950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c91beb10-fef0-4188-bbeb-21f12fb68250 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:43.779973 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c91beb10-fef0-4188-bbeb-21f12fb68250 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105058 Aug 29 15:32:43.786861 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 963/1936] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:32:43 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:43.798156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3a96c940-9962-4d7b-9158-b5661473d2c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:43.799610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3a96c940-9962-4d7b-9158-b5661473d2c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:43.806315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a96c940-9962-4d7b-9158-b5661473d2c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:43.806932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a96c940-9962-4d7b-9158-b5661473d2c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:43.807379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a96c940-9962-4d7b-9158-b5661473d2c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:43.808363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a96c940-9962-4d7b-9158-b5661473d2c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:43.808854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a96c940-9962-4d7b-9158-b5661473d2c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:43.809443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a96c940-9962-4d7b-9158-b5661473d2c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:43.895075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-21382b2a-cfd8-4450-bfd9-440211982daf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:43.912842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-21382b2a-cfd8-4450-bfd9-440211982daf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:43.914336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-21382b2a-cfd8-4450-bfd9-440211982daf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:43.928586 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-21382b2a-cfd8-4450-bfd9-440211982daf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1359 microversion: 2.21 time: 0.644881 Aug 29 15:32:43.930004 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 974/1937] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:43 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1359 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:44.000945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3a96c940-9962-4d7b-9158-b5661473d2c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:44.024114 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3a96c940-9962-4d7b-9158-b5661473d2c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1312 microversion: 2.1 time: 0.235837 Aug 29 15:32:44.025350 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 964/1938] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:43 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1312 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:44.065303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ed2b3eeb-72d9-4090-860c-1db1f69c4ea9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:44.066031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ed2b3eeb-72d9-4090-860c-1db1f69c4ea9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:44.073631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed2b3eeb-72d9-4090-860c-1db1f69c4ea9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:44.074251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed2b3eeb-72d9-4090-860c-1db1f69c4ea9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:44.074815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed2b3eeb-72d9-4090-860c-1db1f69c4ea9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:44.075624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed2b3eeb-72d9-4090-860c-1db1f69c4ea9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:44.076182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed2b3eeb-72d9-4090-860c-1db1f69c4ea9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:44.076832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed2b3eeb-72d9-4090-860c-1db1f69c4ea9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:44.234046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ed2b3eeb-72d9-4090-860c-1db1f69c4ea9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:44.243163 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ed2b3eeb-72d9-4090-860c-1db1f69c4ea9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1315 microversion: 2.1 time: 0.188895 Aug 29 15:32:44.257932 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 975/1939] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:44 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:44.334511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7824260b-dd12-4cfc-b6f7-79b02c3c81d7 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Action: 'create', calling method: .version_select at 0x7fc42bcba0d0>, body: {"keypair": {"name": "tempest-keypair-2024792865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCm+gcJAxVERcJP2zp30SMfjEjUYuLRUItMn5AC+IThNKG99OWM+/9nlS47g2NDDsMfI3sZNbKNLUkkeTiffIdp30aWBGAt8uGNtKkjddsuKHTbg+kroX7GfrwOqfy8yA=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:44.363371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-7824260b-dd12-4cfc-b6f7-79b02c3c81d7 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Getting quotas for project 31b6c56c90e6488aa856711fdf9b4fb6. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:44.369217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-7824260b-dd12-4cfc-b6f7-79b02c3c81d7 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Getting quotas for user 12f8c32f14bc4f6abb9ab19de52ff832 and project 31b6c56c90e6488aa856711fdf9b4fb6. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:44.398918 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7824260b-dd12-4cfc-b6f7-79b02c3c81d7 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.196091 Aug 29 15:32:44.400511 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 965/1940] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:32:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:32:44.414547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a89f5cb-3588-40c5-af7c-b891e933d5c1 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Calling method '.version_select at 0x7fc433bc3160>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:44.426864 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a89f5cb-3588-40c5-af7c-b891e933d5c1 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] 10.222.0.62 "GET /compute/v2.1/os-keypairs/tempest-keypair-2024792865" status: 200 len: 498 microversion: 2.1 time: 0.016109 Aug 29 15:32:44.434669 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 976/1941] 10.222.0.62 () {58 vars in 1218 bytes} [Mon Aug 29 15:32:44 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2024792865 => generated 498 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:44.440466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5741db34-32c8-49ca-9cfd-6aa7d3874335 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Calling method '.version_select at 0x7fc433aaa9d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:44.481444 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5741db34-32c8-49ca-9cfd-6aa7d3874335 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024792865" status: 202 len: 0 microversion: 2.1 time: 0.043535 Aug 29 15:32:44.481921 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 966/1942] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 15:32:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024792865 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:44.497699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e03ba6b6-1753-4967-91a2-2c06ebd667c6 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Action: 'create', calling method: .version_select at 0x7fc433b8ab80>, body: {"keypair": {"name": "tempest-keypair-1760692037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtRj5G1sgh6lK1fRKwjdnHt/dpJj6fqS/fa5lQ/lH95a4yxAt2JrfFW+Sk418lwcZNmx9bvM4CfTTy6Ow/vQnfuXJBe1pq8mi3WTRJ2yxwcPVsfnW90djVV5U/Kg0/SGw=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:44.522316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-e03ba6b6-1753-4967-91a2-2c06ebd667c6 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Getting quotas for project 31b6c56c90e6488aa856711fdf9b4fb6. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:44.530803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-e03ba6b6-1753-4967-91a2-2c06ebd667c6 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Getting quotas for user 12f8c32f14bc4f6abb9ab19de52ff832 and project 31b6c56c90e6488aa856711fdf9b4fb6. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:44.533441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:44.566424 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e03ba6b6-1753-4967-91a2-2c06ebd667c6 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074633 Aug 29 15:32:44.567054 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 977/1943] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:32:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:44.581281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-804dce66-a9cf-407f-ab5d-2e4ed7541a90 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Calling method '.version_select at 0x7fc433ab4e50>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:44.636130 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-804dce66-a9cf-407f-ab5d-2e4ed7541a90 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1760692037" status: 202 len: 0 microversion: 2.1 time: 0.060812 Aug 29 15:32:44.638279 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 967/1944] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 15:32:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1760692037 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:44.648592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24825048-23c5-4d68-bfb0-a2d47b172cea tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Action: 'create', calling method: .version_select at 0x7fc433ba1e50>, body: {"keypair": {"name": "tempest-keypair-522438077", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:44.684825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-24825048-23c5-4d68-bfb0-a2d47b172cea tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Getting quotas for project 31b6c56c90e6488aa856711fdf9b4fb6. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:44.695893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4c7d550d-7eb0-4230-bab7-97ac35847747 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:44.697845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4c7d550d-7eb0-4230-bab7-97ac35847747 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:44.698803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-24825048-23c5-4d68-bfb0-a2d47b172cea tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Getting quotas for user 12f8c32f14bc4f6abb9ab19de52ff832 and project 31b6c56c90e6488aa856711fdf9b4fb6. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:44.726498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c7d550d-7eb0-4230-bab7-97ac35847747 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:44.729803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c7d550d-7eb0-4230-bab7-97ac35847747 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:44.730677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c7d550d-7eb0-4230-bab7-97ac35847747 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:44.731916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c7d550d-7eb0-4230-bab7-97ac35847747 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:44.738225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c7d550d-7eb0-4230-bab7-97ac35847747 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:44.743221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c7d550d-7eb0-4230-bab7-97ac35847747 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:44.754620 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-24825048-23c5-4d68-bfb0-a2d47b172cea tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.109499 Aug 29 15:32:44.756912 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 978/1945] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:32:44 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:44.771878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-412cdf7b-aec4-4242-b3ef-3f799abfadb6 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Calling method '.version_select at 0x7fc433ba3d30>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:44.807240 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-412cdf7b-aec4-4242-b3ef-3f799abfadb6 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-522438077" status: 202 len: 0 microversion: 2.1 time: 0.040327 Aug 29 15:32:44.808918 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 979/1946] 10.222.0.62 () {58 vars in 1218 bytes} [Mon Aug 29 15:32:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-522438077 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:44.824325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5bef720b-0103-4a06-ac8f-aca90ab56798 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:44.828098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5bef720b-0103-4a06-ac8f-aca90ab56798 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:44.839624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bef720b-0103-4a06-ac8f-aca90ab56798 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:44.841288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bef720b-0103-4a06-ac8f-aca90ab56798 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:44.842047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bef720b-0103-4a06-ac8f-aca90ab56798 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:44.843099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bef720b-0103-4a06-ac8f-aca90ab56798 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:44.843768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bef720b-0103-4a06-ac8f-aca90ab56798 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:44.844455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bef720b-0103-4a06-ac8f-aca90ab56798 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:44.861778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:44.931658 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5bef720b-0103-4a06-ac8f-aca90ab56798 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120308 Aug 29 15:32:44.936809 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 980/1947] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:32:44 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:44.963983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bb878e42-ad08-4a5d-8c6d-23e4b4bca84a tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Action: 'create', calling method: .version_select at 0x7fc433bc3820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1293886547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmhAeX0BS3XH3A+jNYFEEgX+WpO0wVjF54tB6mFMMARXtxD0EG8lY197FtxQaMqExBtcuMNkOOS8oIm4WIHqLRDpFct+bGoknFZVQPsHQbX2tAMMcFa8cNKD7J6+BVGPw=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:44.983359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-bb878e42-ad08-4a5d-8c6d-23e4b4bca84a tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Getting quotas for project 31b6c56c90e6488aa856711fdf9b4fb6. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:44.989540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-bb878e42-ad08-4a5d-8c6d-23e4b4bca84a tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Getting quotas for user 12f8c32f14bc4f6abb9ab19de52ff832 and project 31b6c56c90e6488aa856711fdf9b4fb6. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:45.019025 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bb878e42-ad08-4a5d-8c6d-23e4b4bca84a tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.075869 Aug 29 15:32:45.019788 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 981/1948] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:32:44 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:45.028772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fb539987-1c2f-4e99-9425-ebd574bcb0b4 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:45.029581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fb539987-1c2f-4e99-9425-ebd574bcb0b4 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:45.043467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb539987-1c2f-4e99-9425-ebd574bcb0b4 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:45.044767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb539987-1c2f-4e99-9425-ebd574bcb0b4 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:45.045284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb539987-1c2f-4e99-9425-ebd574bcb0b4 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:45.048907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb539987-1c2f-4e99-9425-ebd574bcb0b4 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:45.049986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb539987-1c2f-4e99-9425-ebd574bcb0b4 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:45.050481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb539987-1c2f-4e99-9425-ebd574bcb0b4 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:45.238886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4c7d550d-7eb0-4230-bab7-97ac35847747 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:45.250716 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4c7d550d-7eb0-4230-bab7-97ac35847747 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1402 microversion: 2.1 time: 0.562131 Aug 29 15:32:45.268404 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 968/1949] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:44 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1402 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:45.275624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2dc6fa72-7c73-4abc-be35-933ea49a34da tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Action: 'create', calling method: .version_select at 0x7fc42b7b8700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1820679580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENVMVqx4o5wss3f4uKuDeDog9muTw13jL7KHZWQJdKGyNCOgEmM0h5d6Ye9PGwbhG704DX6FNw+sW4y2UYxEzT2tazpEL/cmoOqF4OnRlQurix3yE9NdyTWA7pGuOuafA=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:45.295948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-2dc6fa72-7c73-4abc-be35-933ea49a34da tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Getting quotas for project 31b6c56c90e6488aa856711fdf9b4fb6. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:45.302383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-2dc6fa72-7c73-4abc-be35-933ea49a34da tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Getting quotas for user 12f8c32f14bc4f6abb9ab19de52ff832 and project 31b6c56c90e6488aa856711fdf9b4fb6. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:45.331582 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2dc6fa72-7c73-4abc-be35-933ea49a34da tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.061804 Aug 29 15:32:45.333131 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 969/1950] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:32:45 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:45.340554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eca3ed3b-ce40-470d-a3d7-0957fed9be2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:45.342144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eca3ed3b-ce40-470d-a3d7-0957fed9be2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:45.344932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fb539987-1c2f-4e99-9425-ebd574bcb0b4 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:45.353225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca3ed3b-ce40-470d-a3d7-0957fed9be2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:45.354048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca3ed3b-ce40-470d-a3d7-0957fed9be2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:45.355130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca3ed3b-ce40-470d-a3d7-0957fed9be2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:45.355826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fb539987-1c2f-4e99-9425-ebd574bcb0b4 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:45.356848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca3ed3b-ce40-470d-a3d7-0957fed9be2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:45.357407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fb539987-1c2f-4e99-9425-ebd574bcb0b4 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:45.357828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca3ed3b-ce40-470d-a3d7-0957fed9be2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:45.358478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca3ed3b-ce40-470d-a3d7-0957fed9be2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:45.365467 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fb539987-1c2f-4e99-9425-ebd574bcb0b4 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1359 microversion: 2.21 time: 0.342821 Aug 29 15:32:45.376337 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 982/1951] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:45 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1359 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:45.383874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a3e01878-482e-4307-8eba-fbc4aec7791a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:45.383874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a3e01878-482e-4307-8eba-fbc4aec7791a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:45.388703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3e01878-482e-4307-8eba-fbc4aec7791a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:45.389216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3e01878-482e-4307-8eba-fbc4aec7791a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:45.389654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3e01878-482e-4307-8eba-fbc4aec7791a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:45.390360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3e01878-482e-4307-8eba-fbc4aec7791a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:45.390813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3e01878-482e-4307-8eba-fbc4aec7791a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:45.391235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3e01878-482e-4307-8eba-fbc4aec7791a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:45.635964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eca3ed3b-ce40-470d-a3d7-0957fed9be2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:45.643172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a3e01878-482e-4307-8eba-fbc4aec7791a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:45.647492 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eca3ed3b-ce40-470d-a3d7-0957fed9be2a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1312 microversion: 2.1 time: 0.312733 Aug 29 15:32:45.648191 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 970/1952] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:45 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1312 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:45.666293 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a3e01878-482e-4307-8eba-fbc4aec7791a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1315 microversion: 2.1 time: 0.298414 Aug 29 15:32:45.668503 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 983/1953] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:45 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:45.677691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c3ebc32e-c922-44c9-a7e7-ab3da7e3ed2c tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Action: 'create', calling method: .version_select at 0x7fc42bcba0d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-256616340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEx6QyeCmYrneES2jLJTfv+48zrMeCFRjGqaomNDNOrAea+tbKqqHNUeTLB23HeION5Rcwvv+KPxhhBPK7QHvrzmGKBL2+AvEx1tNR7mkBR83Mzs5/h6cRX9cY0QCHV4pg=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:45.695861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-c3ebc32e-c922-44c9-a7e7-ab3da7e3ed2c tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Getting quotas for project 31b6c56c90e6488aa856711fdf9b4fb6. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:45.702388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-c3ebc32e-c922-44c9-a7e7-ab3da7e3ed2c tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Getting quotas for user 12f8c32f14bc4f6abb9ab19de52ff832 and project 31b6c56c90e6488aa856711fdf9b4fb6. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:45.735237 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c3ebc32e-c922-44c9-a7e7-ab3da7e3ed2c tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.062905 Aug 29 15:32:45.738690 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 971/1954] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:32:45 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:45.747339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1739eb46-0ccd-4445-bd47-47300a9f29c5 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Calling method '.version_select at 0x7fc42b5bb940>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:45.751851 n-d-839401-11 devstack@n-api.service[122360]: WARNING oslo_db.sqlalchemy.utils [None req-1739eb46-0ccd-4445-bd47-47300a9f29c5 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:32:45.768120 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1739eb46-0ccd-4445-bd47-47300a9f29c5 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] 10.222.0.62 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.014163 Aug 29 15:32:45.769495 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 984/1955] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:32:45 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:45.780146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2a169417-bce3-4fec-803c-59bb7dc7c525 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Calling method '.version_select at 0x7fc42b7b8790>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:45.804620 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2a169417-bce3-4fec-803c-59bb7dc7c525 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-256616340" status: 202 len: 0 microversion: 2.1 time: 0.026923 Aug 29 15:32:45.809526 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 972/1956] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:32:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-256616340 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:45.815217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-daa1391d-6c20-4f7c-ac23-63d3bbfb0b96 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Calling method '.version_select at 0x7fc433ba11f0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:45.854511 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-daa1391d-6c20-4f7c-ac23-63d3bbfb0b96 tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1820679580" status: 202 len: 0 microversion: 2.1 time: 0.043907 Aug 29 15:32:45.856018 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 985/1957] 10.222.0.62 () {58 vars in 1278 bytes} [Mon Aug 29 15:32:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1820679580 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:45.865610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a5199f1f-6f95-40a4-b96e-fd238e3b72ff tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] Calling method '.version_select at 0x7fc433aa6ee0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:45.876955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-d3b108db-cae0-43b2-9613-8621daff5ed0 req-b1541263-f481-4436-9ac0-d0024d15e12f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2", "tag": "7e55b383-cc6f-43f7-94eb-352846be645f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:45.887859 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a5199f1f-6f95-40a4-b96e-fd238e3b72ff tempest-KeyPairsV2TestJSON-812783196 tempest-KeyPairsV2TestJSON-812783196-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1293886547" status: 202 len: 0 microversion: 2.1 time: 0.026837 Aug 29 15:32:45.889189 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 973/1958] 10.222.0.62 () {58 vars in 1278 bytes} [Mon Aug 29 15:32:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1293886547 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:45.923706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d3b108db-cae0-43b2-9613-8621daff5ed0 req-b1541263-f481-4436-9ac0-d0024d15e12f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:45.924567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d3b108db-cae0-43b2-9613-8621daff5ed0 req-b1541263-f481-4436-9ac0-d0024d15e12f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:45.925202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d3b108db-cae0-43b2-9613-8621daff5ed0 req-b1541263-f481-4436-9ac0-d0024d15e12f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:45.939275 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-d3b108db-cae0-43b2-9613-8621daff5ed0 req-b1541263-f481-4436-9ac0-d0024d15e12f service nova] Creating event network-changed:7e55b383-cc6f-43f7-94eb-352846be645f for instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 on n-h1-839401-11 Aug 29 15:32:45.946384 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-d3b108db-cae0-43b2-9613-8621daff5ed0 req-b1541263-f481-4436-9ac0-d0024d15e12f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072725 Aug 29 15:32:45.947230 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 986/1959] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:45.951563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a2960de6-c2a8-4b61-8476-4e80320230be tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:45.954127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a2960de6-c2a8-4b61-8476-4e80320230be tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:45.962348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2960de6-c2a8-4b61-8476-4e80320230be tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:45.962841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2960de6-c2a8-4b61-8476-4e80320230be tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:45.963282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2960de6-c2a8-4b61-8476-4e80320230be tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:45.964018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2960de6-c2a8-4b61-8476-4e80320230be tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:45.964494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2960de6-c2a8-4b61-8476-4e80320230be tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:45.964927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2960de6-c2a8-4b61-8476-4e80320230be tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:46.003317 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a2960de6-c2a8-4b61-8476-4e80320230be tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059114 Aug 29 15:32:46.004204 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 974/1960] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:32:45 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:32:46.283840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e2d18adf-356e-4d66-ac89-b1f49b7df143 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:46.284550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e2d18adf-356e-4d66-ac89-b1f49b7df143 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:46.309696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2d18adf-356e-4d66-ac89-b1f49b7df143 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:46.310191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2d18adf-356e-4d66-ac89-b1f49b7df143 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:46.310620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2d18adf-356e-4d66-ac89-b1f49b7df143 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:46.320683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2d18adf-356e-4d66-ac89-b1f49b7df143 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:46.321319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2d18adf-356e-4d66-ac89-b1f49b7df143 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:46.321835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2d18adf-356e-4d66-ac89-b1f49b7df143 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:46.391950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0c36ceb1-3d28-46c2-91a1-e733b5c9f8bc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:46.393351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0c36ceb1-3d28-46c2-91a1-e733b5c9f8bc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:46.405140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c36ceb1-3d28-46c2-91a1-e733b5c9f8bc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:46.411289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c36ceb1-3d28-46c2-91a1-e733b5c9f8bc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:46.411857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c36ceb1-3d28-46c2-91a1-e733b5c9f8bc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:46.413011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c36ceb1-3d28-46c2-91a1-e733b5c9f8bc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:46.413558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c36ceb1-3d28-46c2-91a1-e733b5c9f8bc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:46.414003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c36ceb1-3d28-46c2-91a1-e733b5c9f8bc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:46.589486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e2d18adf-356e-4d66-ac89-b1f49b7df143 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:46.595562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:46.603844 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e2d18adf-356e-4d66-ac89-b1f49b7df143 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1402 microversion: 2.1 time: 0.329424 Aug 29 15:32:46.606481 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 987/1961] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:46 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1402 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:46.669164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-94db42a2-9940-4f31-89ef-36c99317054b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:46.670202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-94db42a2-9940-4f31-89ef-36c99317054b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:46.684372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94db42a2-9940-4f31-89ef-36c99317054b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:46.685293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94db42a2-9940-4f31-89ef-36c99317054b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:46.685739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94db42a2-9940-4f31-89ef-36c99317054b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:46.687018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94db42a2-9940-4f31-89ef-36c99317054b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:46.687490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94db42a2-9940-4f31-89ef-36c99317054b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:46.689455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94db42a2-9940-4f31-89ef-36c99317054b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:46.717823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0c36ceb1-3d28-46c2-91a1-e733b5c9f8bc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:46.728430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0c36ceb1-3d28-46c2-91a1-e733b5c9f8bc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:46.729922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0c36ceb1-3d28-46c2-91a1-e733b5c9f8bc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:46.735246 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0c36ceb1-3d28-46c2-91a1-e733b5c9f8bc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1359 microversion: 2.21 time: 0.348126 Aug 29 15:32:46.736871 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 975/1962] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:46 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1359 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:32:46.741955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-29c3b3f2-f0ae-4ae6-96ac-e5b6cd87a243 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:46.742699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-29c3b3f2-f0ae-4ae6-96ac-e5b6cd87a243 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:46.749319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29c3b3f2-f0ae-4ae6-96ac-e5b6cd87a243 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:46.749972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29c3b3f2-f0ae-4ae6-96ac-e5b6cd87a243 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:46.750409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29c3b3f2-f0ae-4ae6-96ac-e5b6cd87a243 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:46.751106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29c3b3f2-f0ae-4ae6-96ac-e5b6cd87a243 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:46.751833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29c3b3f2-f0ae-4ae6-96ac-e5b6cd87a243 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:46.752410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29c3b3f2-f0ae-4ae6-96ac-e5b6cd87a243 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:46.894335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-94db42a2-9940-4f31-89ef-36c99317054b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:46.899226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-29c3b3f2-f0ae-4ae6-96ac-e5b6cd87a243 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:46.910562 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-29c3b3f2-f0ae-4ae6-96ac-e5b6cd87a243 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1315 microversion: 2.1 time: 0.172579 Aug 29 15:32:46.910941 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-94db42a2-9940-4f31-89ef-36c99317054b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1312 microversion: 2.1 time: 0.246533 Aug 29 15:32:46.913130 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 976/1963] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:46 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:46.924265 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 988/1964] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:46 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1312 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:32:47.015987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-54d85e25-d3fd-4682-b214-b04cdfc2e113 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:47.018924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-54d85e25-d3fd-4682-b214-b04cdfc2e113 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:47.025946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54d85e25-d3fd-4682-b214-b04cdfc2e113 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:47.026684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54d85e25-d3fd-4682-b214-b04cdfc2e113 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:47.027129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54d85e25-d3fd-4682-b214-b04cdfc2e113 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:47.027837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54d85e25-d3fd-4682-b214-b04cdfc2e113 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:47.028573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54d85e25-d3fd-4682-b214-b04cdfc2e113 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:47.029075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54d85e25-d3fd-4682-b214-b04cdfc2e113 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:47.061422 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-54d85e25-d3fd-4682-b214-b04cdfc2e113 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049272 Aug 29 15:32:47.067827 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 977/1965] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:32:47 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:32:47.283589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-676106321", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "26d82d80-e2bf-4b2e-bd4a-38c04c1b6f6c"}], "block_device_mapping_v2": [{"uuid": "a19288c9-faa5-4e53-8a5e-e412b6e48a9a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:47.365919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] validate_networks() for [('26d82d80-e2bf-4b2e-bd4a-38c04c1b6f6c', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:32:47.629004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-92b0622d-8733-49fb-b2dd-61d3e326f2e3 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:47.630248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-92b0622d-8733-49fb-b2dd-61d3e326f2e3 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:47.638962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92b0622d-8733-49fb-b2dd-61d3e326f2e3 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:47.639959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92b0622d-8733-49fb-b2dd-61d3e326f2e3 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:47.640902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92b0622d-8733-49fb-b2dd-61d3e326f2e3 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:47.642405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92b0622d-8733-49fb-b2dd-61d3e326f2e3 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:47.643297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92b0622d-8733-49fb-b2dd-61d3e326f2e3 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:47.644030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92b0622d-8733-49fb-b2dd-61d3e326f2e3 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:47.903724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-92b0622d-8733-49fb-b2dd-61d3e326f2e3 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:47.917169 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-92b0622d-8733-49fb-b2dd-61d3e326f2e3 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1590 microversion: 2.1 time: 0.292997 Aug 29 15:32:47.931038 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 978/1966] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:47 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1590 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:47.942189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:32:47.942766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-71b35c36-ac63-46b1-9876-f1dee0c671da tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:47.942978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:32:47.943567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:32:47.944037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-71b35c36-ac63-46b1-9876-f1dee0c671da tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:47.944352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:32:47.944770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:32:47.952404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71b35c36-ac63-46b1-9876-f1dee0c671da tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:47.953166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71b35c36-ac63-46b1-9876-f1dee0c671da tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:47.953759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71b35c36-ac63-46b1-9876-f1dee0c671da tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:47.954624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71b35c36-ac63-46b1-9876-f1dee0c671da tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:47.955847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71b35c36-ac63-46b1-9876-f1dee0c671da tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:47.956527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71b35c36-ac63-46b1-9876-f1dee0c671da tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:47.960442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:47.960918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:47.961205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:47.962021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:47.962954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:47.963443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:47.964118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:47.988355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Getting quotas for project ef5a2735bd95451ab466c5560cbe28fe. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:47.995011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Getting quotas for user 9011569d41804e27a53fe5831988a88a and project ef5a2735bd95451ab466c5560cbe28fe. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:48.093434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:32:48.095887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a19288c9-faa5-4e53-8a5e-e412b6e48a9a',volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:32:48.133071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-71b35c36-ac63-46b1-9876-f1dee0c671da tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:48.144655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-71b35c36-ac63-46b1-9876-f1dee0c671da tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:48.148777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-71b35c36-ac63-46b1-9876-f1dee0c671da tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:48.150880 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-71b35c36-ac63-46b1-9876-f1dee0c671da tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1359 microversion: 2.21 time: 0.217618 Aug 29 15:32:48.152753 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 979/1967] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:47 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:48.158516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bbc1e61b-01fa-45a6-bb8a-6f73da142847 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:48.159161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bbc1e61b-01fa-45a6-bb8a-6f73da142847 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:48.165844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbc1e61b-01fa-45a6-bb8a-6f73da142847 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:48.166409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbc1e61b-01fa-45a6-bb8a-6f73da142847 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:48.166994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbc1e61b-01fa-45a6-bb8a-6f73da142847 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:48.168281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbc1e61b-01fa-45a6-bb8a-6f73da142847 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:48.168745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbc1e61b-01fa-45a6-bb8a-6f73da142847 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:48.169667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbc1e61b-01fa-45a6-bb8a-6f73da142847 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:48.318090 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-063e8f34-28b2-4983-b243-9cd829974694 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.037940 Aug 29 15:32:48.321316 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 989/1968] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:32:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:32:48.331383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4d7400e1-0d81-4fce-acf5-cb9baf5f1f35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:48.333044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4d7400e1-0d81-4fce-acf5-cb9baf5f1f35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:48.345226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d7400e1-0d81-4fce-acf5-cb9baf5f1f35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:48.350316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d7400e1-0d81-4fce-acf5-cb9baf5f1f35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:48.350918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d7400e1-0d81-4fce-acf5-cb9baf5f1f35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:48.351770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d7400e1-0d81-4fce-acf5-cb9baf5f1f35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:48.352245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d7400e1-0d81-4fce-acf5-cb9baf5f1f35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:48.352787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d7400e1-0d81-4fce-acf5-cb9baf5f1f35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:48.366390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bbc1e61b-01fa-45a6-bb8a-6f73da142847 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:48.375359 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bbc1e61b-01fa-45a6-bb8a-6f73da142847 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1312 microversion: 2.1 time: 0.222098 Aug 29 15:32:48.377441 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 980/1969] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:48 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1312 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:48.393920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d4b3dc88-e214-4114-9091-b0ad097391e6 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:48.394522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d4b3dc88-e214-4114-9091-b0ad097391e6 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:48.403103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4b3dc88-e214-4114-9091-b0ad097391e6 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:48.403696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4b3dc88-e214-4114-9091-b0ad097391e6 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:48.404457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4b3dc88-e214-4114-9091-b0ad097391e6 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:48.405931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4b3dc88-e214-4114-9091-b0ad097391e6 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:48.407173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4b3dc88-e214-4114-9091-b0ad097391e6 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:48.408089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4b3dc88-e214-4114-9091-b0ad097391e6 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:48.518330 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d4b3dc88-e214-4114-9091-b0ad097391e6 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.139495 Aug 29 15:32:48.519306 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 981/1970] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:32:48 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:48.549824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4d7400e1-0d81-4fce-acf5-cb9baf5f1f35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:48.564222 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4d7400e1-0d81-4fce-acf5-cb9baf5f1f35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1315 microversion: 2.1 time: 0.238955 Aug 29 15:32:48.564900 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 990/1971] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:48 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:48.572029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-7ace2446-6b18-4d49-81a0-ec5912588d06 req-3c64cb4d-2a80-4f97-8179-9a53809b9956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bbdc361-13d8-424e-95d7-7ce315b15b02", "name": "network-vif-plugged", "status": "completed", "tag": "ba4a48da-edec-40fa-8a22-de3d316b9b9e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:48.589423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7ace2446-6b18-4d49-81a0-ec5912588d06 req-3c64cb4d-2a80-4f97-8179-9a53809b9956 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:48.589902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7ace2446-6b18-4d49-81a0-ec5912588d06 req-3c64cb4d-2a80-4f97-8179-9a53809b9956 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:48.591422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7ace2446-6b18-4d49-81a0-ec5912588d06 req-3c64cb4d-2a80-4f97-8179-9a53809b9956 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:48.622074 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-7ace2446-6b18-4d49-81a0-ec5912588d06 req-3c64cb4d-2a80-4f97-8179-9a53809b9956 service nova] Creating event network-vif-plugged:ba4a48da-edec-40fa-8a22-de3d316b9b9e for instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 on n-h1-839401-11 Aug 29 15:32:48.636366 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-7ace2446-6b18-4d49-81a0-ec5912588d06 req-3c64cb4d-2a80-4f97-8179-9a53809b9956 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069037 Aug 29 15:32:48.637830 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 991/1972] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:48.650736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9f1b6970-9a4b-4b81-a61b-332d99b8e641 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:48.652535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9f1b6970-9a4b-4b81-a61b-332d99b8e641 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:48.732731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2146ef19-79e4-4d75-9bc6-6c916cfaf8ca tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Action: 'create', calling method: .version_select at 0x7fc433aaa3a0>, body: {"keypair": {"name": "tempest-keypair-1716518737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeDlkT0hhB8td+uKdwnSCiUy66GF8Ueh9oU6aRPnGXRk1P1iriKd9u1Va9rq22CpZJ8VeyjgEOQ7ePj3T3MnVAYCrqqBnraaPitMfUt42h5K39H9jqWqBKJsBWenEsTnQ=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:48.749696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-2146ef19-79e4-4d75-9bc6-6c916cfaf8ca tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:48.755335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-2146ef19-79e4-4d75-9bc6-6c916cfaf8ca tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for user 1ce1036a3dd9475eabf55696ebe7d2e8 and project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:48.776204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9f1b6970-9a4b-4b81-a61b-332d99b8e641 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:48.789563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9f1b6970-9a4b-4b81-a61b-332d99b8e641 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:48.791981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9f1b6970-9a4b-4b81-a61b-332d99b8e641 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:48.793585 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9f1b6970-9a4b-4b81-a61b-332d99b8e641 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1103 microversion: 2.25 time: 0.151470 Aug 29 15:32:48.798861 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2146ef19-79e4-4d75-9bc6-6c916cfaf8ca tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.278039 Aug 29 15:32:48.800228 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 992/1973] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:48 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1103 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:48.800682 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 982/1974] 10.222.0.62 () {62 vars in 1199 bytes} [Mon Aug 29 15:32:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 281 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:32:48.811419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0c814826-ba6e-4ad8-be12-8030090e8ebe tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Calling method '.version_select at 0x7fc433bc3f70>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:48.824086 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0c814826-ba6e-4ad8-be12-8030090e8ebe tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "GET /compute/v2.1/os-keypairs/tempest-keypair-1716518737" status: 200 len: 513 microversion: 2.2 time: 0.017170 Aug 29 15:32:48.825284 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 993/1975] 10.222.0.62 () {60 vars in 1258 bytes} [Mon Aug 29 15:32:48 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1716518737 => generated 513 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:48.838882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3dd9713b-833d-4bdc-9811-9ef4998d72a2 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Calling method '.version_select at 0x7fc433a52b80>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:48.866066 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3dd9713b-833d-4bdc-9811-9ef4998d72a2 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1716518737" status: 204 len: 0 microversion: 2.2 time: 0.032272 Aug 29 15:32:48.869499 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 983/1976] 10.222.0.62 () {60 vars in 1261 bytes} [Mon Aug 29 15:32:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1716518737 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:48.881793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2c167b6f-a23d-480e-b468-cca911041d96 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Action: 'create', calling method: .version_select at 0x7fc433c04820>, body: {"keypair": {"name": "tempest-keypair-520635135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVaEBtbZZcnutTuIxiZor+pY1XrWHIKW91tKIc1IF9xMjcp8slnv8YCvGMkG7IYPqnaa+Kg6UhklKpU+kv/HGaPrbjLb1dZ+TPNe+Qey64M+Fwmb2TOHE5/ZN/R7Zr8+g=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:48.913550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-2c167b6f-a23d-480e-b468-cca911041d96 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:48.921663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-2c167b6f-a23d-480e-b468-cca911041d96 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for user 1ce1036a3dd9475eabf55696ebe7d2e8 and project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:48.962058 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2c167b6f-a23d-480e-b468-cca911041d96 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.085886 Aug 29 15:32:48.962830 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 994/1977] 10.222.0.62 () {62 vars in 1199 bytes} [Mon Aug 29 15:32:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:32:48.974527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-61425c25-e698-4b74-8cb8-24affe1c02d7 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Calling method '.version_select at 0x7fc433aa6f70>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:48.988872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:49.001065 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-61425c25-e698-4b74-8cb8-24affe1c02d7 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-520635135" status: 204 len: 0 microversion: 2.2 time: 0.030799 Aug 29 15:32:49.002000 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 984/1978] 10.222.0.62 () {60 vars in 1258 bytes} [Mon Aug 29 15:32:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-520635135 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:32:49.013945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6a5d3edf-3daf-4ce2-81f6-804a7d450c68 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Action: 'create', calling method: .version_select at 0x7fc433b51f70>, body: {"keypair": {"name": "tempest-keypair-1739810680", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:49.063710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-6a5d3edf-3daf-4ce2-81f6-804a7d450c68 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:49.070087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-6a5d3edf-3daf-4ce2-81f6-804a7d450c68 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for user 1ce1036a3dd9475eabf55696ebe7d2e8 and project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:49.090576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:49.106172 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6a5d3edf-3daf-4ce2-81f6-804a7d450c68 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.097631 Aug 29 15:32:49.107412 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 995/1979] 10.222.0.62 () {62 vars in 1199 bytes} [Mon Aug 29 15:32:49 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:32:49.118795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c9d249d1-9fd1-47d9-bec5-475321f8f5d9 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Calling method '.version_select at 0x7fc433aaa550>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:49.163393 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c9d249d1-9fd1-47d9-bec5-475321f8f5d9 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1739810680" status: 204 len: 0 microversion: 2.2 time: 0.045375 Aug 29 15:32:49.164432 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 985/1980] 10.222.0.62 () {60 vars in 1261 bytes} [Mon Aug 29 15:32:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1739810680 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:49.177651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-73f0c7f9-58cf-4963-ad54-530ed9c5d4cf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:49.178606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-73f0c7f9-58cf-4963-ad54-530ed9c5d4cf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:49.178826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2fd9536e-3f47-4a3e-a083-e92cb84187e9 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Action: 'create', calling method: .version_select at 0x7fc433a8e4c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2088433159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+rQxe8OkKDBeM4C8B9civYD0pGpfsSyLKEojyh9eVoqry0fceni9Gwvj4h+hhB7W25Rx7o7bMaAPQPaxQjXgi9NuNkcRwtUcxvpcuq43XuwgAKykPEyMSezKNanRqM6w=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:49.194382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73f0c7f9-58cf-4963-ad54-530ed9c5d4cf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:49.195290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73f0c7f9-58cf-4963-ad54-530ed9c5d4cf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:49.195736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73f0c7f9-58cf-4963-ad54-530ed9c5d4cf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:49.196484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73f0c7f9-58cf-4963-ad54-530ed9c5d4cf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:49.196955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73f0c7f9-58cf-4963-ad54-530ed9c5d4cf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:49.209673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73f0c7f9-58cf-4963-ad54-530ed9c5d4cf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:49.227349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-2fd9536e-3f47-4a3e-a083-e92cb84187e9 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:49.233663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-2fd9536e-3f47-4a3e-a083-e92cb84187e9 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for user 1ce1036a3dd9475eabf55696ebe7d2e8 and project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:49.267904 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2fd9536e-3f47-4a3e-a083-e92cb84187e9 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.094117 Aug 29 15:32:49.275985 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 986/1981] 10.222.0.62 () {62 vars in 1199 bytes} [Mon Aug 29 15:32:49 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:32:49.282742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6d480696-7047-454b-bd69-5c75d86ebe5c tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Action: 'create', calling method: .version_select at 0x7fc433a8e9d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1395415560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4w+zc1MkP9lY5sL0qFBKENg1n/Aan44hM662soCnKTKrZ7Pe3PuwRE9dXsfAN3failo/FJo9lXlS8leYjgMfOYMSfFViWmWPUOf1mJsDPgj20FYU+G6ssuwy8SNqp3fg=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:49.305169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-6d480696-7047-454b-bd69-5c75d86ebe5c tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:49.311366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-6d480696-7047-454b-bd69-5c75d86ebe5c tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for user 1ce1036a3dd9475eabf55696ebe7d2e8 and project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:49.349123 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6d480696-7047-454b-bd69-5c75d86ebe5c tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.071420 Aug 29 15:32:49.353143 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 987/1982] 10.222.0.62 () {62 vars in 1199 bytes} [Mon Aug 29 15:32:49 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:32:49.363735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2596db9a-15af-4722-9b10-4a56238f0c0b tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Action: 'create', calling method: .version_select at 0x7fc433aaa8b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-665847250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4cmnnzUNSTPpaojjSB/X5zpcbmfP1v3mbfgnWVhoYVf9iZNw/AxdAtGD4R+nGL7wNxCG6m2fclEyUZhUVcrSmDNz1Z6u73L4+SzEyy0bjrr5hGib44nKeO07bMKPEvgA=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:49.384853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-2596db9a-15af-4722-9b10-4a56238f0c0b tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:49.392597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-2596db9a-15af-4722-9b10-4a56238f0c0b tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for user 1ce1036a3dd9475eabf55696ebe7d2e8 and project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:49.440414 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2596db9a-15af-4722-9b10-4a56238f0c0b tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.081164 Aug 29 15:32:49.441137 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 988/1983] 10.222.0.62 () {62 vars in 1199 bytes} [Mon Aug 29 15:32:49 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 29 15:32:49.457939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8bda19e8-46c6-4651-8b61-9f14f2cc394a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:49.458586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8bda19e8-46c6-4651-8b61-9f14f2cc394a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:49.465819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8bda19e8-46c6-4651-8b61-9f14f2cc394a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:49.466303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8bda19e8-46c6-4651-8b61-9f14f2cc394a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:49.466742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8bda19e8-46c6-4651-8b61-9f14f2cc394a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:49.468065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8bda19e8-46c6-4651-8b61-9f14f2cc394a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:49.469533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8bda19e8-46c6-4651-8b61-9f14f2cc394a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:49.469676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8bda19e8-46c6-4651-8b61-9f14f2cc394a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:49.496973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-73f0c7f9-58cf-4963-ad54-530ed9c5d4cf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:49.507621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-73f0c7f9-58cf-4963-ad54-530ed9c5d4cf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:49.512336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-73f0c7f9-58cf-4963-ad54-530ed9c5d4cf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:49.512336 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-73f0c7f9-58cf-4963-ad54-530ed9c5d4cf tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1359 microversion: 2.21 time: 0.338408 Aug 29 15:32:49.512336 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 996/1984] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:49 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1359 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:49.525649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-daa2925c-81d9-451c-9c7e-e320c9ff354f tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Calling method '.version_select at 0x7fc433ba1d30>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:49.530898 n-d-839401-11 devstack@n-api.service[122360]: WARNING oslo_db.sqlalchemy.utils [None req-daa2925c-81d9-451c-9c7e-e320c9ff354f tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:32:49.536662 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-daa2925c-81d9-451c-9c7e-e320c9ff354f tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.023158 Aug 29 15:32:49.537279 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 997/1985] 10.222.0.62 () {60 vars in 1177 bytes} [Mon Aug 29 15:32:49 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:49.548254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-80683927-251b-4690-a11d-e9cbb1b061d4 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Calling method '.version_select at 0x7fc433b6b550>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:49.572552 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-80683927-251b-4690-a11d-e9cbb1b061d4 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-665847250" status: 204 len: 0 microversion: 2.2 time: 0.028027 Aug 29 15:32:49.573240 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 998/1986] 10.222.0.62 () {60 vars in 1318 bytes} [Mon Aug 29 15:32:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-665847250 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:32:49.585060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dabb14d7-393e-4f47-a17e-2096c40237d8 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Calling method '.version_select at 0x7fc433b8ab80>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:49.610290 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dabb14d7-393e-4f47-a17e-2096c40237d8 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1395415560" status: 204 len: 0 microversion: 2.2 time: 0.031270 Aug 29 15:32:49.611846 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 999/1987] 10.222.0.62 () {60 vars in 1321 bytes} [Mon Aug 29 15:32:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1395415560 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:49.617719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-436ef0be-ac0c-4b55-a32f-2f73182ccc98 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:49.618414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-436ef0be-ac0c-4b55-a32f-2f73182ccc98 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:49.625131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-436ef0be-ac0c-4b55-a32f-2f73182ccc98 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:49.625959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-436ef0be-ac0c-4b55-a32f-2f73182ccc98 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:49.626461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-436ef0be-ac0c-4b55-a32f-2f73182ccc98 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:49.627271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-436ef0be-ac0c-4b55-a32f-2f73182ccc98 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:49.627799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-436ef0be-ac0c-4b55-a32f-2f73182ccc98 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:49.628364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-436ef0be-ac0c-4b55-a32f-2f73182ccc98 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:49.784188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-436ef0be-ac0c-4b55-a32f-2f73182ccc98 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:49.788211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8bda19e8-46c6-4651-8b61-9f14f2cc394a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:49.795089 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-436ef0be-ac0c-4b55-a32f-2f73182ccc98 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1315 microversion: 2.1 time: 0.181809 Aug 29 15:32:49.798351 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1000/1988] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:49 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:49.800436 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8bda19e8-46c6-4651-8b61-9f14f2cc394a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1312 microversion: 2.1 time: 0.358217 Aug 29 15:32:49.802018 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 989/1989] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:49 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1312 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:49.814949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8f2cab84-07ac-4b91-bc6a-40034f439b38 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Calling method '.version_select at 0x7fc433c38e50>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:49.826601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e5007baa-eb5b-4173-ad53-350b4ca1657f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:49.827433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e5007baa-eb5b-4173-ad53-350b4ca1657f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:49.851950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5007baa-eb5b-4173-ad53-350b4ca1657f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:49.852730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5007baa-eb5b-4173-ad53-350b4ca1657f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:49.856491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5007baa-eb5b-4173-ad53-350b4ca1657f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:49.859154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5007baa-eb5b-4173-ad53-350b4ca1657f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:49.859869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5007baa-eb5b-4173-ad53-350b4ca1657f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:49.861993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5007baa-eb5b-4173-ad53-350b4ca1657f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:49.863089 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8f2cab84-07ac-4b91-bc6a-40034f439b38 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2088433159" status: 204 len: 0 microversion: 2.2 time: 0.062522 Aug 29 15:32:49.866497 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1001/1990] 10.222.0.62 () {60 vars in 1321 bytes} [Mon Aug 29 15:32:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2088433159 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:49.878885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e06cc052-4843-4b1f-bd80-c8c45ed83410 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Action: 'create', calling method: .version_select at 0x7fc433bc3ca0>, body: {"keypair": {"name": "tempest-keypair-286530116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuYy5QttRHPobhpSz9N5pT0Ry2fxOI3rhztVhB8iIB9tCtlHRjl7f0RTIU3tvURExEtxFRLl6ZqEfzteP2s71Z42yKV6NB0q+JxxsIWBi8eMk+thQsAJVH9kPHOnEhYBA=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:49.903685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-e06cc052-4843-4b1f-bd80-c8c45ed83410 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:49.910801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-e06cc052-4843-4b1f-bd80-c8c45ed83410 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for user 1ce1036a3dd9475eabf55696ebe7d2e8 and project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:49.945390 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e06cc052-4843-4b1f-bd80-c8c45ed83410 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.070954 Aug 29 15:32:49.946521 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1002/1991] 10.222.0.62 () {62 vars in 1199 bytes} [Mon Aug 29 15:32:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:32:49.959460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a14c2158-45f1-438c-974c-7840e9ac222e tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Calling method '.version_select at 0x7fc433c04f70>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:49.967959 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a14c2158-45f1-438c-974c-7840e9ac222e tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "GET /compute/v2.1/os-keypairs/tempest-keypair-286530116" status: 200 len: 512 microversion: 2.2 time: 0.012608 Aug 29 15:32:49.968668 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1003/1992] 10.222.0.62 () {60 vars in 1255 bytes} [Mon Aug 29 15:32:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-286530116 => generated 512 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:32:49.977000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e5007baa-eb5b-4173-ad53-350b4ca1657f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:49.991030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e5007baa-eb5b-4173-ad53-350b4ca1657f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:49.994064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7ff38a90-cae9-4058-8ac4-7dc0a1afa34b tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Calling method '.version_select at 0x7fc433b51040>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:49.995015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e5007baa-eb5b-4173-ad53-350b4ca1657f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:49.996259 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e5007baa-eb5b-4173-ad53-350b4ca1657f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1232 microversion: 2.25 time: 0.175282 Aug 29 15:32:49.998828 n-d-839401-11 devstack@n-api.service[122360]: WARNING oslo_db.sqlalchemy.utils [None req-7ff38a90-cae9-4058-8ac4-7dc0a1afa34b tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:32:50.001510 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 990/1993] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:49 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1232 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:32:50.016653 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7ff38a90-cae9-4058-8ac4-7dc0a1afa34b tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.034783 Aug 29 15:32:50.017792 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1004/1994] 10.222.0.62 () {60 vars in 1177 bytes} [Mon Aug 29 15:32:49 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:50.028542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7263d85c-b961-4d51-8847-52639dde9ab8 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Calling method '.version_select at 0x7fc42b6da700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:50.056546 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7263d85c-b961-4d51-8847-52639dde9ab8 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-286530116" status: 204 len: 0 microversion: 2.2 time: 0.031836 Aug 29 15:32:50.059417 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 991/1995] 10.222.0.62 () {60 vars in 1258 bytes} [Mon Aug 29 15:32:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-286530116 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:50.069689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6d0ae64c-5d91-4c6b-96cb-17fc0572a448 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Action: 'create', calling method: .version_select at 0x7fc433b6c3a0>, body: {"keypair": {"name": "tempest-keypair-51108183", "type": "x509"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:50.090347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-6d0ae64c-5d91-4c6b-96cb-17fc0572a448 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:50.098245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-6d0ae64c-5d91-4c6b-96cb-17fc0572a448 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for user 1ce1036a3dd9475eabf55696ebe7d2e8 and project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:50.123333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.processutils [None req-6d0ae64c-5d91-4c6b-96cb-17fc0572a448 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpplshph27/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpplshph27/temp.key -subj /CN=1ce1036a3dd9475eabf55696ebe7d2e8 -extensions v3_req_client {{(pid=122360) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 29 15:32:50.524361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.processutils [None req-6d0ae64c-5d91-4c6b-96cb-17fc0572a448 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpplshph27/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpplshph27/temp.key -subj /CN=1ce1036a3dd9475eabf55696ebe7d2e8 -extensions v3_req_client" returned: 0 in 0.400s {{(pid=122360) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 29 15:32:50.525843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.processutils [None req-6d0ae64c-5d91-4c6b-96cb-17fc0572a448 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpplshph27/temp.key -password pass: {{(pid=122360) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 29 15:32:50.535393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a4806486-5d5c-478a-aa84-2b911de54488 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:50.537166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a4806486-5d5c-478a-aa84-2b911de54488 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:50.571051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4806486-5d5c-478a-aa84-2b911de54488 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:50.572425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4806486-5d5c-478a-aa84-2b911de54488 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:50.573920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4806486-5d5c-478a-aa84-2b911de54488 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:50.576507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.processutils [None req-6d0ae64c-5d91-4c6b-96cb-17fc0572a448 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpplshph27/temp.key -password pass:" returned: 0 in 0.050s {{(pid=122360) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 29 15:32:50.582222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4806486-5d5c-478a-aa84-2b911de54488 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:50.585537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4806486-5d5c-478a-aa84-2b911de54488 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:50.585537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4806486-5d5c-478a-aa84-2b911de54488 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:50.644213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-6d0ae64c-5d91-4c6b-96cb-17fc0572a448 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:32:50.652451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-6d0ae64c-5d91-4c6b-96cb-17fc0572a448 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Getting quotas for user 1ce1036a3dd9475eabf55696ebe7d2e8 and project c7b0be5c9e2649d692e3cbab54af54cb. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:32:50.674655 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6d0ae64c-5d91-4c6b-96cb-17fc0572a448 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 4691 microversion: 2.2 time: 0.609029 Aug 29 15:32:50.680777 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1005/1996] 10.222.0.62 () {62 vars in 1198 bytes} [Mon Aug 29 15:32:50 2022] POST /compute/v2.1/os-keypairs => generated 4691 bytes in 611 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:50.688372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-99db38b7-0bbb-43af-a214-61cbf168d37d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:50.689304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-99db38b7-0bbb-43af-a214-61cbf168d37d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:50.698179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99db38b7-0bbb-43af-a214-61cbf168d37d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:50.698718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99db38b7-0bbb-43af-a214-61cbf168d37d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:50.699331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99db38b7-0bbb-43af-a214-61cbf168d37d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:50.700423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99db38b7-0bbb-43af-a214-61cbf168d37d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:50.700986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99db38b7-0bbb-43af-a214-61cbf168d37d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:50.701517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99db38b7-0bbb-43af-a214-61cbf168d37d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:50.830459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a4806486-5d5c-478a-aa84-2b911de54488 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:50.842051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a4806486-5d5c-478a-aa84-2b911de54488 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:50.844064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a4806486-5d5c-478a-aa84-2b911de54488 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:50.845677 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a4806486-5d5c-478a-aa84-2b911de54488 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1359 microversion: 2.21 time: 0.316256 Aug 29 15:32:50.858651 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 992/1997] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:50 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1359 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:32:50.867515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-8fa21fcf-e10a-4d5f-9883-76f67930cbc2 req-9020ef20-48c5-4af0-aa36-06a194a8251c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b402c3ad-5b4f-46c8-85c4-22988e175bf3", "tag": "d9c36bd7-ba6d-45a9-a314-4837dd1f32e0"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:50.880056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8fa21fcf-e10a-4d5f-9883-76f67930cbc2 req-9020ef20-48c5-4af0-aa36-06a194a8251c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:50.880918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8fa21fcf-e10a-4d5f-9883-76f67930cbc2 req-9020ef20-48c5-4af0-aa36-06a194a8251c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:50.881603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8fa21fcf-e10a-4d5f-9883-76f67930cbc2 req-9020ef20-48c5-4af0-aa36-06a194a8251c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:50.896681 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-8fa21fcf-e10a-4d5f-9883-76f67930cbc2 req-9020ef20-48c5-4af0-aa36-06a194a8251c service nova] Creating event network-changed:d9c36bd7-ba6d-45a9-a314-4837dd1f32e0 for instance b402c3ad-5b4f-46c8-85c4-22988e175bf3 on n-h1-839401-11 Aug 29 15:32:50.904897 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-8fa21fcf-e10a-4d5f-9883-76f67930cbc2 req-9020ef20-48c5-4af0-aa36-06a194a8251c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044498 Aug 29 15:32:50.912833 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 993/1998] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:50.943861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8160c2b5-c7fb-444c-bff0-87c2207adea1 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Calling method '.version_select at 0x7fc42b754790>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:50.996053 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8160c2b5-c7fb-444c-bff0-87c2207adea1 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "GET /compute/v2.1/os-keypairs/tempest-keypair-51108183" status: 200 len: 1532 microversion: 2.2 time: 0.076975 Aug 29 15:32:51.006376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-99db38b7-0bbb-43af-a214-61cbf168d37d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:51.014572 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 994/1999] 10.222.0.62 () {60 vars in 1252 bytes} [Mon Aug 29 15:32:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-51108183 => generated 1532 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:51.027145 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-99db38b7-0bbb-43af-a214-61cbf168d37d tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1590 microversion: 2.1 time: 0.349869 Aug 29 15:32:51.032467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2b59fd0c-34f1-4c18-aa7f-4da6902534aa tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:51.048690 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1006/2000] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:50 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1590 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:51.051417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2b59fd0c-34f1-4c18-aa7f-4da6902534aa tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:51.063420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4e879a94-0921-4ee6-9843-df6bb4cab508 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:51.066526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4e879a94-0921-4ee6-9843-df6bb4cab508 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:51.070527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b59fd0c-34f1-4c18-aa7f-4da6902534aa tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:51.074914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b59fd0c-34f1-4c18-aa7f-4da6902534aa tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:51.075556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b59fd0c-34f1-4c18-aa7f-4da6902534aa tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:51.076522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b59fd0c-34f1-4c18-aa7f-4da6902534aa tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:51.077686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b59fd0c-34f1-4c18-aa7f-4da6902534aa tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:51.079277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b59fd0c-34f1-4c18-aa7f-4da6902534aa tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:51.084891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e879a94-0921-4ee6-9843-df6bb4cab508 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:51.089189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e879a94-0921-4ee6-9843-df6bb4cab508 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:51.089878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e879a94-0921-4ee6-9843-df6bb4cab508 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:51.090787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e879a94-0921-4ee6-9843-df6bb4cab508 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:51.095548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e879a94-0921-4ee6-9843-df6bb4cab508 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:51.096657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e879a94-0921-4ee6-9843-df6bb4cab508 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:51.403028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4e879a94-0921-4ee6-9843-df6bb4cab508 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:51.419219 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4e879a94-0921-4ee6-9843-df6bb4cab508 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1312 microversion: 2.1 time: 0.369077 Aug 29 15:32:51.422187 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1007/2001] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:51 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1312 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:51.434080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a4f2ec8-576a-4ff4-8223-f5d968986cee tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:51.439911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9a4f2ec8-576a-4ff4-8223-f5d968986cee tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:51.458122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a4f2ec8-576a-4ff4-8223-f5d968986cee tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:51.459224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a4f2ec8-576a-4ff4-8223-f5d968986cee tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:51.459854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a4f2ec8-576a-4ff4-8223-f5d968986cee tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:51.460988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a4f2ec8-576a-4ff4-8223-f5d968986cee tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:51.462918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a4f2ec8-576a-4ff4-8223-f5d968986cee tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:51.467486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a4f2ec8-576a-4ff4-8223-f5d968986cee tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:51.508052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2b59fd0c-34f1-4c18-aa7f-4da6902534aa tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:51.517632 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2b59fd0c-34f1-4c18-aa7f-4da6902534aa tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1315 microversion: 2.1 time: 0.501101 Aug 29 15:32:51.534878 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 995/2002] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:51 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:51.540432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-98e2ec5e-b4bc-47f9-99d7-42ef90fb15c7 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Calling method '.version_select at 0x7fc42b6c89d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:51.545404 n-d-839401-11 devstack@n-api.service[122361]: WARNING oslo_db.sqlalchemy.utils [None req-98e2ec5e-b4bc-47f9-99d7-42ef90fb15c7 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:32:51.553028 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-98e2ec5e-b4bc-47f9-99d7-42ef90fb15c7 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "GET /compute/v2.1/os-keypairs" status: 200 len: 1389 microversion: 2.2 time: 0.016649 Aug 29 15:32:51.554089 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 996/2003] 10.222.0.62 () {60 vars in 1177 bytes} [Mon Aug 29 15:32:51 2022] GET /compute/v2.1/os-keypairs => generated 1389 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:51.566066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7dca1570-4df3-4f0d-ad81-55424348ada9 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] Calling method '.version_select at 0x7fc433a8e9d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:51.585818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9a4f2ec8-576a-4ff4-8223-f5d968986cee tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:51.592966 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7dca1570-4df3-4f0d-ad81-55424348ada9 tempest-KeyPairsV22TestJSON-1076213039 tempest-KeyPairsV22TestJSON-1076213039-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-51108183" status: 204 len: 0 microversion: 2.2 time: 0.031389 Aug 29 15:32:51.596146 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 997/2004] 10.222.0.62 () {60 vars in 1255 bytes} [Mon Aug 29 15:32:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-51108183 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:32:51.606513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9a4f2ec8-576a-4ff4-8223-f5d968986cee tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:51.608984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9a4f2ec8-576a-4ff4-8223-f5d968986cee tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:51.611224 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a4f2ec8-576a-4ff4-8223-f5d968986cee tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1240 microversion: 2.25 time: 0.185785 Aug 29 15:32:51.612335 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1008/2005] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:51 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1240 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:51.873401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f41d80a6-7510-4590-9a25-e3250648bba1 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:51.874148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f41d80a6-7510-4590-9a25-e3250648bba1 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:51.881674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f41d80a6-7510-4590-9a25-e3250648bba1 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:51.882176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f41d80a6-7510-4590-9a25-e3250648bba1 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:51.882611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f41d80a6-7510-4590-9a25-e3250648bba1 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:51.883315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f41d80a6-7510-4590-9a25-e3250648bba1 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:51.883763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f41d80a6-7510-4590-9a25-e3250648bba1 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:51.884182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f41d80a6-7510-4590-9a25-e3250648bba1 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.079912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f41d80a6-7510-4590-9a25-e3250648bba1 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:52.092346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f41d80a6-7510-4590-9a25-e3250648bba1 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:52.094491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f41d80a6-7510-4590-9a25-e3250648bba1 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:52.098062 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f41d80a6-7510-4590-9a25-e3250648bba1 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1552 microversion: 2.21 time: 0.229807 Aug 29 15:32:52.099706 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 998/2006] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:51 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1552 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:52.127514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-37241ae5-d78a-4d45-8796-01d96e9736cc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:52.128034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-37241ae5-d78a-4d45-8796-01d96e9736cc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:52.135375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37241ae5-d78a-4d45-8796-01d96e9736cc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.136162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37241ae5-d78a-4d45-8796-01d96e9736cc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.136900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37241ae5-d78a-4d45-8796-01d96e9736cc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.137801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37241ae5-d78a-4d45-8796-01d96e9736cc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.138440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37241ae5-d78a-4d45-8796-01d96e9736cc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.139108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37241ae5-d78a-4d45-8796-01d96e9736cc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.188695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-37241ae5-d78a-4d45-8796-01d96e9736cc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:32:52.368226 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-37241ae5-d78a-4d45-8796-01d96e9736cc tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 204 len: 0 microversion: 2.21 time: 0.246124 Aug 29 15:32:52.369426 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1009/2007] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:32:52 2022] DELETE /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:32:52.381388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8cebc2de-1673-49dc-8850-6fac6e66cd01 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:52.382651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8cebc2de-1673-49dc-8850-6fac6e66cd01 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:52.397913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cebc2de-1673-49dc-8850-6fac6e66cd01 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.397913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cebc2de-1673-49dc-8850-6fac6e66cd01 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.398504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cebc2de-1673-49dc-8850-6fac6e66cd01 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.400357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cebc2de-1673-49dc-8850-6fac6e66cd01 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.400850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cebc2de-1673-49dc-8850-6fac6e66cd01 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.401325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cebc2de-1673-49dc-8850-6fac6e66cd01 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.450557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7cb19140-8232-4cd9-a377-1d0a43621148 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:52.451382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7cb19140-8232-4cd9-a377-1d0a43621148 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:52.465540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7cb19140-8232-4cd9-a377-1d0a43621148 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.466030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7cb19140-8232-4cd9-a377-1d0a43621148 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.466484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7cb19140-8232-4cd9-a377-1d0a43621148 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.467196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7cb19140-8232-4cd9-a377-1d0a43621148 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.467661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7cb19140-8232-4cd9-a377-1d0a43621148 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.468086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7cb19140-8232-4cd9-a377-1d0a43621148 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.699655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7cb19140-8232-4cd9-a377-1d0a43621148 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:52.708578 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7cb19140-8232-4cd9-a377-1d0a43621148 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1312 microversion: 2.1 time: 0.268021 Aug 29 15:32:52.709184 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1010/2008] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:52 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1312 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:52.715109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7df6a8c3-f619-4e37-98df-d462f8492485 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:52.715751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7df6a8c3-f619-4e37-98df-d462f8492485 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:52.718540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8cebc2de-1673-49dc-8850-6fac6e66cd01 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:52.738215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df6a8c3-f619-4e37-98df-d462f8492485 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.744490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df6a8c3-f619-4e37-98df-d462f8492485 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.745623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8cebc2de-1673-49dc-8850-6fac6e66cd01 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:52.746719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df6a8c3-f619-4e37-98df-d462f8492485 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.749773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df6a8c3-f619-4e37-98df-d462f8492485 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.750772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df6a8c3-f619-4e37-98df-d462f8492485 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.751798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8cebc2de-1673-49dc-8850-6fac6e66cd01 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:52.754616 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8cebc2de-1673-49dc-8850-6fac6e66cd01 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1558 microversion: 2.21 time: 0.380188 Aug 29 15:32:52.754909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df6a8c3-f619-4e37-98df-d462f8492485 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.757775 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 999/2009] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:52 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1558 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:52.774847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-35e60efd-823d-4347-aefd-011747738e1a req-c421cf17-3948-404b-a8cf-4226803f3070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11592c2a-43a5-492f-a40a-64ae99efa92e", "name": "network-vif-plugged", "status": "completed", "tag": "b8190072-2f76-41df-9404-7f44a26edb8c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:52.788024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-35e60efd-823d-4347-aefd-011747738e1a req-c421cf17-3948-404b-a8cf-4226803f3070 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.789984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-35e60efd-823d-4347-aefd-011747738e1a req-c421cf17-3948-404b-a8cf-4226803f3070 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.791630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-35e60efd-823d-4347-aefd-011747738e1a req-c421cf17-3948-404b-a8cf-4226803f3070 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.810323 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-35e60efd-823d-4347-aefd-011747738e1a req-c421cf17-3948-404b-a8cf-4226803f3070 service nova] Creating event network-vif-plugged:b8190072-2f76-41df-9404-7f44a26edb8c for instance 11592c2a-43a5-492f-a40a-64ae99efa92e on n-h1-839401-11 Aug 29 15:32:52.816457 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-35e60efd-823d-4347-aefd-011747738e1a req-c421cf17-3948-404b-a8cf-4226803f3070 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048903 Aug 29 15:32:52.817767 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1000/2010] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:52.826036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2b74cc10-57cb-4c9d-a0cb-6baebbabf111 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:52.827462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2b74cc10-57cb-4c9d-a0cb-6baebbabf111 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:52.848813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b74cc10-57cb-4c9d-a0cb-6baebbabf111 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.849517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b74cc10-57cb-4c9d-a0cb-6baebbabf111 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.850213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b74cc10-57cb-4c9d-a0cb-6baebbabf111 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.851397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b74cc10-57cb-4c9d-a0cb-6baebbabf111 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:52.851894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b74cc10-57cb-4c9d-a0cb-6baebbabf111 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:52.852324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b74cc10-57cb-4c9d-a0cb-6baebbabf111 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:52.966149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2b74cc10-57cb-4c9d-a0cb-6baebbabf111 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:52.976631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2b74cc10-57cb-4c9d-a0cb-6baebbabf111 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:52.977696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2b74cc10-57cb-4c9d-a0cb-6baebbabf111 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:52.978871 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2b74cc10-57cb-4c9d-a0cb-6baebbabf111 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1240 microversion: 2.25 time: 0.159825 Aug 29 15:32:52.979749 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1001/2011] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:52 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1240 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:52.996910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7df6a8c3-f619-4e37-98df-d462f8492485 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:53.009942 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7df6a8c3-f619-4e37-98df-d462f8492485 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1315 microversion: 2.1 time: 0.299630 Aug 29 15:32:53.010944 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1011/2012] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:52 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:53.731542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b0b5ce30-53a4-447f-9ae2-8892bb4dfc3c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:53.732461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b0b5ce30-53a4-447f-9ae2-8892bb4dfc3c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:53.744168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0b5ce30-53a4-447f-9ae2-8892bb4dfc3c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:53.744677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0b5ce30-53a4-447f-9ae2-8892bb4dfc3c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:53.747408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0b5ce30-53a4-447f-9ae2-8892bb4dfc3c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:53.747925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0b5ce30-53a4-447f-9ae2-8892bb4dfc3c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:53.749841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0b5ce30-53a4-447f-9ae2-8892bb4dfc3c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:53.752586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0b5ce30-53a4-447f-9ae2-8892bb4dfc3c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:53.797323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9e0b5e6f-0240-47c8-bb36-0fe982ff8302 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:53.798671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9e0b5e6f-0240-47c8-bb36-0fe982ff8302 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:53.808759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0b5e6f-0240-47c8-bb36-0fe982ff8302 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:53.809342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0b5e6f-0240-47c8-bb36-0fe982ff8302 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:53.809787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0b5e6f-0240-47c8-bb36-0fe982ff8302 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:53.810500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0b5e6f-0240-47c8-bb36-0fe982ff8302 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:53.810982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0b5e6f-0240-47c8-bb36-0fe982ff8302 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:53.811371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0b5e6f-0240-47c8-bb36-0fe982ff8302 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:53.951883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b0b5ce30-53a4-447f-9ae2-8892bb4dfc3c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:53.961956 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b0b5ce30-53a4-447f-9ae2-8892bb4dfc3c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1312 microversion: 2.1 time: 0.235031 Aug 29 15:32:53.962590 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1002/2013] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:53 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1312 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:54.003729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c04be555-d177-49c5-a109-9dd4ffae2bdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:54.007078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c04be555-d177-49c5-a109-9dd4ffae2bdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:54.014604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c04be555-d177-49c5-a109-9dd4ffae2bdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:54.015669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c04be555-d177-49c5-a109-9dd4ffae2bdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:54.016732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c04be555-d177-49c5-a109-9dd4ffae2bdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:54.018187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c04be555-d177-49c5-a109-9dd4ffae2bdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:54.018993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c04be555-d177-49c5-a109-9dd4ffae2bdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:54.019587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c04be555-d177-49c5-a109-9dd4ffae2bdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:54.040449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e0b5e6f-0240-47c8-bb36-0fe982ff8302 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:54.049234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e0b5e6f-0240-47c8-bb36-0fe982ff8302 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:54.050847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e0b5e6f-0240-47c8-bb36-0fe982ff8302 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:54.052169 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9e0b5e6f-0240-47c8-bb36-0fe982ff8302 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1558 microversion: 2.21 time: 0.258952 Aug 29 15:32:54.056763 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1012/2014] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:53 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1558 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:54.061629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-857b27c0-6175-4c9d-ba57-2f469e810fb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:54.062241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-857b27c0-6175-4c9d-ba57-2f469e810fb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:54.069958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-857b27c0-6175-4c9d-ba57-2f469e810fb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:54.070842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-857b27c0-6175-4c9d-ba57-2f469e810fb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:54.071308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-857b27c0-6175-4c9d-ba57-2f469e810fb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:54.072189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-857b27c0-6175-4c9d-ba57-2f469e810fb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:54.072666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-857b27c0-6175-4c9d-ba57-2f469e810fb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:54.073300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-857b27c0-6175-4c9d-ba57-2f469e810fb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:54.096935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c04be555-d177-49c5-a109-9dd4ffae2bdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:54.106557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c04be555-d177-49c5-a109-9dd4ffae2bdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:54.108281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c04be555-d177-49c5-a109-9dd4ffae2bdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:54.109466 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c04be555-d177-49c5-a109-9dd4ffae2bdd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1240 microversion: 2.25 time: 0.109904 Aug 29 15:32:54.110807 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1003/2015] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:53 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1240 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:32:54.330514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-857b27c0-6175-4c9d-ba57-2f469e810fb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:54.339393 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-857b27c0-6175-4c9d-ba57-2f469e810fb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1315 microversion: 2.1 time: 0.281412 Aug 29 15:32:54.340346 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1013/2016] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:54 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:54.982993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cf4e5f94-3452-4353-b9c8-74a54734674d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:54.983783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cf4e5f94-3452-4353-b9c8-74a54734674d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:54.998348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf4e5f94-3452-4353-b9c8-74a54734674d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:54.999695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf4e5f94-3452-4353-b9c8-74a54734674d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:55.001013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf4e5f94-3452-4353-b9c8-74a54734674d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:55.002907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf4e5f94-3452-4353-b9c8-74a54734674d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:55.005119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf4e5f94-3452-4353-b9c8-74a54734674d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:55.007119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf4e5f94-3452-4353-b9c8-74a54734674d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:55.075141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5eedbd2d-bcdd-40d8-8b18-bbae5fed0a6b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:55.075761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5eedbd2d-bcdd-40d8-8b18-bbae5fed0a6b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:55.092112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5eedbd2d-bcdd-40d8-8b18-bbae5fed0a6b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:55.092617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5eedbd2d-bcdd-40d8-8b18-bbae5fed0a6b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:55.093050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5eedbd2d-bcdd-40d8-8b18-bbae5fed0a6b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:55.102054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5eedbd2d-bcdd-40d8-8b18-bbae5fed0a6b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:55.102543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5eedbd2d-bcdd-40d8-8b18-bbae5fed0a6b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:55.102990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5eedbd2d-bcdd-40d8-8b18-bbae5fed0a6b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:55.376626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5eedbd2d-bcdd-40d8-8b18-bbae5fed0a6b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:55.389677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5eedbd2d-bcdd-40d8-8b18-bbae5fed0a6b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:55.394069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5eedbd2d-bcdd-40d8-8b18-bbae5fed0a6b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:55.395323 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5eedbd2d-bcdd-40d8-8b18-bbae5fed0a6b tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1558 microversion: 2.21 time: 0.324276 Aug 29 15:32:55.396150 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1014/2017] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:55 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1558 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:55.420622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1ce293be-04af-4179-b563-36add6cf6bcb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:55.421392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1ce293be-04af-4179-b563-36add6cf6bcb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:55.438817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ce293be-04af-4179-b563-36add6cf6bcb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:55.439305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ce293be-04af-4179-b563-36add6cf6bcb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:55.439772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ce293be-04af-4179-b563-36add6cf6bcb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:55.440579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ce293be-04af-4179-b563-36add6cf6bcb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:55.440942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ce293be-04af-4179-b563-36add6cf6bcb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:55.441908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ce293be-04af-4179-b563-36add6cf6bcb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:55.571476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1ce293be-04af-4179-b563-36add6cf6bcb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:55.584554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1ce293be-04af-4179-b563-36add6cf6bcb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:55.590448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1ce293be-04af-4179-b563-36add6cf6bcb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:55.591636 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1ce293be-04af-4179-b563-36add6cf6bcb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1250 microversion: 2.25 time: 0.176533 Aug 29 15:32:55.605613 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1015/2018] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:55 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1250 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:55.613831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-35ecfd7b-83ec-4dee-90f7-81b7d217b464 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:55.614448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-35ecfd7b-83ec-4dee-90f7-81b7d217b464 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:55.621719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ecfd7b-83ec-4dee-90f7-81b7d217b464 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:55.622257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ecfd7b-83ec-4dee-90f7-81b7d217b464 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:55.623201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ecfd7b-83ec-4dee-90f7-81b7d217b464 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:55.623450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ecfd7b-83ec-4dee-90f7-81b7d217b464 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:55.623921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ecfd7b-83ec-4dee-90f7-81b7d217b464 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:55.624328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ecfd7b-83ec-4dee-90f7-81b7d217b464 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:55.633280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:55.908782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cf4e5f94-3452-4353-b9c8-74a54734674d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:55.927449 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cf4e5f94-3452-4353-b9c8-74a54734674d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1312 microversion: 2.1 time: 0.948422 Aug 29 15:32:55.946802 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1004/2019] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:54 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1312 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:56.041886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-35ecfd7b-83ec-4dee-90f7-81b7d217b464 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:56.060300 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-35ecfd7b-83ec-4dee-90f7-81b7d217b464 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1315 microversion: 2.1 time: 0.453087 Aug 29 15:32:56.061542 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1016/2020] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:55 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:56.425241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ba14bbaf-50f7-41e3-ba1e-7fc484316473 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:56.427887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ba14bbaf-50f7-41e3-ba1e-7fc484316473 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:56.458562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba14bbaf-50f7-41e3-ba1e-7fc484316473 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:56.460494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba14bbaf-50f7-41e3-ba1e-7fc484316473 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:56.467187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba14bbaf-50f7-41e3-ba1e-7fc484316473 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:56.470830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba14bbaf-50f7-41e3-ba1e-7fc484316473 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:56.471840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba14bbaf-50f7-41e3-ba1e-7fc484316473 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:56.481210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba14bbaf-50f7-41e3-ba1e-7fc484316473 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:56.618969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-852a57e5-48a8-4e1b-a5f0-72934dca14b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:56.619638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-852a57e5-48a8-4e1b-a5f0-72934dca14b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:56.629959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852a57e5-48a8-4e1b-a5f0-72934dca14b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:56.630450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852a57e5-48a8-4e1b-a5f0-72934dca14b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:56.631989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852a57e5-48a8-4e1b-a5f0-72934dca14b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:56.632936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852a57e5-48a8-4e1b-a5f0-72934dca14b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:56.643502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852a57e5-48a8-4e1b-a5f0-72934dca14b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:56.644022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852a57e5-48a8-4e1b-a5f0-72934dca14b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:57.039054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-852a57e5-48a8-4e1b-a5f0-72934dca14b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:57.049251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-852a57e5-48a8-4e1b-a5f0-72934dca14b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:57.055288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-852a57e5-48a8-4e1b-a5f0-72934dca14b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:57.073836 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-852a57e5-48a8-4e1b-a5f0-72934dca14b3 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1292 microversion: 2.25 time: 0.460036 Aug 29 15:32:57.077196 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1017/2021] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:56 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1292 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:57.086032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1689e8fe-4e97-43a7-9f68-8db7a77e81fb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:57.086670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1689e8fe-4e97-43a7-9f68-8db7a77e81fb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:57.124384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1689e8fe-4e97-43a7-9f68-8db7a77e81fb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:57.124877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1689e8fe-4e97-43a7-9f68-8db7a77e81fb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:57.125540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1689e8fe-4e97-43a7-9f68-8db7a77e81fb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:57.126443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1689e8fe-4e97-43a7-9f68-8db7a77e81fb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:57.134222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1689e8fe-4e97-43a7-9f68-8db7a77e81fb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:57.134222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1689e8fe-4e97-43a7-9f68-8db7a77e81fb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:57.683804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ba14bbaf-50f7-41e3-ba1e-7fc484316473 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:57.708147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ba14bbaf-50f7-41e3-ba1e-7fc484316473 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:57.710847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ba14bbaf-50f7-41e3-ba1e-7fc484316473 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:57.712686 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ba14bbaf-50f7-41e3-ba1e-7fc484316473 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1558 microversion: 2.21 time: 1.293789 Aug 29 15:32:57.714601 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1005/2022] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:56 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1558 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:32:57.748142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-913b2512-bd54-4176-b1d4-cc0295fdc34a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:57.767673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-913b2512-bd54-4176-b1d4-cc0295fdc34a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:57.792472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-913b2512-bd54-4176-b1d4-cc0295fdc34a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:57.794515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-913b2512-bd54-4176-b1d4-cc0295fdc34a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:57.795162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-913b2512-bd54-4176-b1d4-cc0295fdc34a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:57.797779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-913b2512-bd54-4176-b1d4-cc0295fdc34a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:57.798792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-913b2512-bd54-4176-b1d4-cc0295fdc34a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:57.799975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-913b2512-bd54-4176-b1d4-cc0295fdc34a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:57.973431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:58.053757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1689e8fe-4e97-43a7-9f68-8db7a77e81fb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:58.071662 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1689e8fe-4e97-43a7-9f68-8db7a77e81fb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1312 microversion: 2.1 time: 0.993288 Aug 29 15:32:58.072287 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1018/2023] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:57 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1312 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:58.101643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a346c6fe-402c-48b3-8072-e2a22bdd673b req-06e2721e-97ef-4295-b08b-a9c2f2cd9849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2", "name": "network-vif-plugged", "status": "completed", "tag": "7e55b383-cc6f-43f7-94eb-352846be645f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:58.149472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a346c6fe-402c-48b3-8072-e2a22bdd673b req-06e2721e-97ef-4295-b08b-a9c2f2cd9849 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:58.155005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a346c6fe-402c-48b3-8072-e2a22bdd673b req-06e2721e-97ef-4295-b08b-a9c2f2cd9849 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:58.160927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a346c6fe-402c-48b3-8072-e2a22bdd673b req-06e2721e-97ef-4295-b08b-a9c2f2cd9849 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:58.247320 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a346c6fe-402c-48b3-8072-e2a22bdd673b req-06e2721e-97ef-4295-b08b-a9c2f2cd9849 service nova] Creating event network-vif-plugged:7e55b383-cc6f-43f7-94eb-352846be645f for instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 on n-h1-839401-11 Aug 29 15:32:58.255362 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a346c6fe-402c-48b3-8072-e2a22bdd673b req-06e2721e-97ef-4295-b08b-a9c2f2cd9849 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174752 Aug 29 15:32:58.256010 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1019/2024] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:58.266130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-81d7606f-e45a-4f9b-a702-5cefc7246cd5 req-182f4a79-cf71-4605-b7ba-bc6634981c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bbdc361-13d8-424e-95d7-7ce315b15b02", "name": "network-vif-deleted", "tag": "ba4a48da-edec-40fa-8a22-de3d316b9b9e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:58.285070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-81d7606f-e45a-4f9b-a702-5cefc7246cd5 req-182f4a79-cf71-4605-b7ba-bc6634981c0c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:58.286230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-81d7606f-e45a-4f9b-a702-5cefc7246cd5 req-182f4a79-cf71-4605-b7ba-bc6634981c0c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:58.287643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-81d7606f-e45a-4f9b-a702-5cefc7246cd5 req-182f4a79-cf71-4605-b7ba-bc6634981c0c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:58.317300 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-81d7606f-e45a-4f9b-a702-5cefc7246cd5 req-182f4a79-cf71-4605-b7ba-bc6634981c0c service nova] Creating event network-vif-deleted:ba4a48da-edec-40fa-8a22-de3d316b9b9e for instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 on n-h1-839401-11 Aug 29 15:32:58.351266 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-81d7606f-e45a-4f9b-a702-5cefc7246cd5 req-182f4a79-cf71-4605-b7ba-bc6634981c0c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089343 Aug 29 15:32:58.353298 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1020/2025] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:32:58.362145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-87bf0309-6d4f-4cec-8e4b-0b23f2ed4f3f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:58.363457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-87bf0309-6d4f-4cec-8e4b-0b23f2ed4f3f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:58.411600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87bf0309-6d4f-4cec-8e4b-0b23f2ed4f3f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:58.413344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87bf0309-6d4f-4cec-8e4b-0b23f2ed4f3f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:58.420245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87bf0309-6d4f-4cec-8e4b-0b23f2ed4f3f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:58.422697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87bf0309-6d4f-4cec-8e4b-0b23f2ed4f3f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:58.425892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87bf0309-6d4f-4cec-8e4b-0b23f2ed4f3f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:58.427457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87bf0309-6d4f-4cec-8e4b-0b23f2ed4f3f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:58.966600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-87bf0309-6d4f-4cec-8e4b-0b23f2ed4f3f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:58.977001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-87bf0309-6d4f-4cec-8e4b-0b23f2ed4f3f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:58.980129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-87bf0309-6d4f-4cec-8e4b-0b23f2ed4f3f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:58.991926 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-87bf0309-6d4f-4cec-8e4b-0b23f2ed4f3f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1292 microversion: 2.25 time: 0.636928 Aug 29 15:32:58.992888 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1021/2026] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:58 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1292 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:59.000783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c2c5dba4-99c2-4932-9772-bd37955b3c89 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:59.001972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c2c5dba4-99c2-4932-9772-bd37955b3c89 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:59.008842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2c5dba4-99c2-4932-9772-bd37955b3c89 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:59.009807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2c5dba4-99c2-4932-9772-bd37955b3c89 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:59.011841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2c5dba4-99c2-4932-9772-bd37955b3c89 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:59.015786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2c5dba4-99c2-4932-9772-bd37955b3c89 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:59.016680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2c5dba4-99c2-4932-9772-bd37955b3c89 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:59.017397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2c5dba4-99c2-4932-9772-bd37955b3c89 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:59.060311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-913b2512-bd54-4176-b1d4-cc0295fdc34a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:59.074468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2c5dba4-99c2-4932-9772-bd37955b3c89 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:59.075233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2c5dba4-99c2-4932-9772-bd37955b3c89 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:59.076014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2c5dba4-99c2-4932-9772-bd37955b3c89 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:59.077057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-c2c5dba4-99c2-4932-9772-bd37955b3c89 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lazy-loading 'fault' on Instance uuid 8bbdc361-13d8-424e-95d7-7ce315b15b02 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:32:59.083511 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-913b2512-bd54-4176-b1d4-cc0295fdc34a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1315 microversion: 2.1 time: 1.367459 Aug 29 15:32:59.084158 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1006/2027] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:57 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1315 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:59.124670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-09caec57-4762-49d1-9b05-5eb83efc8601 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:59.129960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-09caec57-4762-49d1-9b05-5eb83efc8601 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:59.148224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09caec57-4762-49d1-9b05-5eb83efc8601 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:59.156176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09caec57-4762-49d1-9b05-5eb83efc8601 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:59.157540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09caec57-4762-49d1-9b05-5eb83efc8601 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:59.159958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09caec57-4762-49d1-9b05-5eb83efc8601 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:59.162059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09caec57-4762-49d1-9b05-5eb83efc8601 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:59.163279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09caec57-4762-49d1-9b05-5eb83efc8601 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:59.210069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c2c5dba4-99c2-4932-9772-bd37955b3c89 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:59.223627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c2c5dba4-99c2-4932-9772-bd37955b3c89 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:59.225820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c2c5dba4-99c2-4932-9772-bd37955b3c89 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f87bfb07b9f249dfb746b82db543fb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff781836de994bafa6e09c8d663af7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:59.227839 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c2c5dba4-99c2-4932-9772-bd37955b3c89 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 200 len: 1349 microversion: 2.21 time: 0.233298 Aug 29 15:32:59.240277 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1022/2028] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:32:58 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 1349 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:32:59.402854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=50 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:59.494754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-09caec57-4762-49d1-9b05-5eb83efc8601 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:59.506536 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-09caec57-4762-49d1-9b05-5eb83efc8601 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1462 microversion: 2.1 time: 0.401303 Aug 29 15:32:59.507412 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1007/2029] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:59 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1462 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:32:59.528518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-03a54bea-af1b-41ba-b2ed-a8a91e20bbda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:32:59.531588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-03a54bea-af1b-41ba-b2ed-a8a91e20bbda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:59.535408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:32:59.540207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03a54bea-af1b-41ba-b2ed-a8a91e20bbda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:59.541118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03a54bea-af1b-41ba-b2ed-a8a91e20bbda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:59.541752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03a54bea-af1b-41ba-b2ed-a8a91e20bbda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:59.542683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03a54bea-af1b-41ba-b2ed-a8a91e20bbda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:59.543321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03a54bea-af1b-41ba-b2ed-a8a91e20bbda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:59.543916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03a54bea-af1b-41ba-b2ed-a8a91e20bbda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:59.662860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-03a54bea-af1b-41ba-b2ed-a8a91e20bbda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:32:59.670790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-03a54bea-af1b-41ba-b2ed-a8a91e20bbda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Old instance type m1.heat2, new instance type m1.heat {{(pid=122360) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 15:32:59.679985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-03a54bea-af1b-41ba-b2ed-a8a91e20bbda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:32:59.680421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-03a54bea-af1b-41ba-b2ed-a8a91e20bbda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:32:59.681009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-03a54bea-af1b-41ba-b2ed-a8a91e20bbda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:32:59.681447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-03a54bea-af1b-41ba-b2ed-a8a91e20bbda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:32:59.681918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-03a54bea-af1b-41ba-b2ed-a8a91e20bbda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:32:59.873685 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-03a54bea-af1b-41ba-b2ed-a8a91e20bbda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "POST /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e/action" status: 202 len: 0 microversion: 2.1 time: 0.348365 Aug 29 15:32:59.884776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e599f549-9857-48c8-b89d-e40763a9c788 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:32:59.885464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e599f549-9857-48c8-b89d-e40763a9c788 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:32:59.890470 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1023/2030] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:32:59 2022] POST /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:32:59.894340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e599f549-9857-48c8-b89d-e40763a9c788 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:59.894888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e599f549-9857-48c8-b89d-e40763a9c788 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:59.895344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e599f549-9857-48c8-b89d-e40763a9c788 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:59.896169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e599f549-9857-48c8-b89d-e40763a9c788 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:32:59.896634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e599f549-9857-48c8-b89d-e40763a9c788 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:32:59.897072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e599f549-9857-48c8-b89d-e40763a9c788 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:32:59.916805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:00.016595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c50c9f72-506a-48ee-b47d-25261a5636ab tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:00.017359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c50c9f72-506a-48ee-b47d-25261a5636ab tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:00.024116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c50c9f72-506a-48ee-b47d-25261a5636ab tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:00.024995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c50c9f72-506a-48ee-b47d-25261a5636ab tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:00.025736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c50c9f72-506a-48ee-b47d-25261a5636ab tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:00.026739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c50c9f72-506a-48ee-b47d-25261a5636ab tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:00.027863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c50c9f72-506a-48ee-b47d-25261a5636ab tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:00.028601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c50c9f72-506a-48ee-b47d-25261a5636ab tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:00.427285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c50c9f72-506a-48ee-b47d-25261a5636ab tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:00.440633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c50c9f72-506a-48ee-b47d-25261a5636ab tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:00.443313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c50c9f72-506a-48ee-b47d-25261a5636ab tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:00.450532 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c50c9f72-506a-48ee-b47d-25261a5636ab tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1292 microversion: 2.25 time: 0.433146 Aug 29 15:33:00.455367 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1024/2031] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:00 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1292 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:33:00.465235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c7eb1ed7-e6c4-4cbb-9250-116fd60c8883 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:00.465867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c7eb1ed7-e6c4-4cbb-9250-116fd60c8883 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:00.482721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7eb1ed7-e6c4-4cbb-9250-116fd60c8883 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:00.483236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7eb1ed7-e6c4-4cbb-9250-116fd60c8883 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:00.483677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7eb1ed7-e6c4-4cbb-9250-116fd60c8883 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:00.484401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7eb1ed7-e6c4-4cbb-9250-116fd60c8883 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:00.484857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7eb1ed7-e6c4-4cbb-9250-116fd60c8883 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:00.487171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7eb1ed7-e6c4-4cbb-9250-116fd60c8883 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:00.556205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e599f549-9857-48c8-b89d-e40763a9c788 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:00.569399 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e599f549-9857-48c8-b89d-e40763a9c788 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1471 microversion: 2.1 time: 0.687714 Aug 29 15:33:00.573134 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1008/2032] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:32:59 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1471 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:00.589053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-834a9de0-0761-4d46-babb-120f78efdb10 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:00.589712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-834a9de0-0761-4d46-babb-120f78efdb10 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:00.607108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-834a9de0-0761-4d46-babb-120f78efdb10 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:00.607620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-834a9de0-0761-4d46-babb-120f78efdb10 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:00.610975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-834a9de0-0761-4d46-babb-120f78efdb10 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:00.612030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-834a9de0-0761-4d46-babb-120f78efdb10 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:00.612669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-834a9de0-0761-4d46-babb-120f78efdb10 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:00.615953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-834a9de0-0761-4d46-babb-120f78efdb10 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:00.658328 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-834a9de0-0761-4d46-babb-120f78efdb10 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] HTTP exception thrown: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-834a9de0-0761-4d46-babb-120f78efdb10 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Request method failure captured: Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 HTTP/1.1 Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNwKefxbVd0fCSOk49bNq3IQz-Q_ZyOURoh8cenozzLJ7UpVj0hI77BDcl8VacHvIlbnne1jcwwJuBAJyCwwQdNn_1enuzJccrGW2cqFCbHiedsIVUqr9bZClQ94tO_czN5JtVXNRqnVg_BL__AQC2B8kRTr7RWA4qBOsgalKpaxAIE Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.21 Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: ff781836de994bafa6e09c8d663af7f3 Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-InstanceActionsV221TestJSON-397703734 Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ff781836de994bafa6e09c8d663af7f3", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ff781836de994bafa6e09c8d663af7f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff781836de994bafa6e09c8d663af7f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff781836de994bafa6e09c8d663af7f3"}]}] Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-InstanceActionsV221TestJSON-397703734 Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: ff781836de994bafa6e09c8d663af7f3 Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-397703734 Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-InstanceActionsV221TestJSON-397703734-project Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: f87bfb07b9f249dfb746b82db543fb02 Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-InstanceActionsV221TestJSON-397703734-project Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '8bbdc361-13d8-424e-95d7-7ce315b15b02'} Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:33:00.660129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:00.667170 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:33:00.667170 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:00.667170 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:00.667170 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:00.667170 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:33:00.667170 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:33:00.667170 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. Aug 29 15:33:00.667170 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:33:00.667170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-834a9de0-0761-4d46-babb-120f78efdb10 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Returning 404 to user: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:33:00.667170 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-834a9de0-0761-4d46-babb-120f78efdb10 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 404 len: 111 microversion: 2.21 time: 0.084640 Aug 29 15:33:00.667170 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1009/2033] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:00 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:33:00.668443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=40 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:00.681882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-993309c9-0f0a-4f87-b05f-48ce3a04baff req-a392f91a-51d5-4dc2-96c7-8d824aa53c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc", "tag": "8d13372d-483a-4d92-9792-82a84a9eb8eb"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:00.703007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-993309c9-0f0a-4f87-b05f-48ce3a04baff req-a392f91a-51d5-4dc2-96c7-8d824aa53c72 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:00.703776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-993309c9-0f0a-4f87-b05f-48ce3a04baff req-a392f91a-51d5-4dc2-96c7-8d824aa53c72 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:00.704215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-993309c9-0f0a-4f87-b05f-48ce3a04baff req-a392f91a-51d5-4dc2-96c7-8d824aa53c72 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:00.741581 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-993309c9-0f0a-4f87-b05f-48ce3a04baff req-a392f91a-51d5-4dc2-96c7-8d824aa53c72 service nova] Creating event network-changed:8d13372d-483a-4d92-9792-82a84a9eb8eb for instance d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc on n-h1-839401-11 Aug 29 15:33:00.752756 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-993309c9-0f0a-4f87-b05f-48ce3a04baff req-a392f91a-51d5-4dc2-96c7-8d824aa53c72 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083358 Aug 29 15:33:00.762520 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1010/2034] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:00.775202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a63bca82-4ddc-4371-92cc-7d8f5932d4a6 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '.version_select at 0x7fc433aaa820>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:00.780024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a63bca82-4ddc-4371-92cc-7d8f5932d4a6 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:00.800231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a63bca82-4ddc-4371-92cc-7d8f5932d4a6 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:00.800745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a63bca82-4ddc-4371-92cc-7d8f5932d4a6 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:00.801221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a63bca82-4ddc-4371-92cc-7d8f5932d4a6 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:00.807117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a63bca82-4ddc-4371-92cc-7d8f5932d4a6 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:00.807743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a63bca82-4ddc-4371-92cc-7d8f5932d4a6 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:00.808203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a63bca82-4ddc-4371-92cc-7d8f5932d4a6 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:00.953583 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a63bca82-4ddc-4371-92cc-7d8f5932d4a6 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.187939 Aug 29 15:33:00.967266 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1011/2035] 10.222.0.62 () {60 vars in 1337 bytes} [Mon Aug 29 15:33:00 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02/os-instance-actions => generated 611 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:33:00.986835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6f1aa946-320b-44d9-ab7c-7d3bc644cb8d tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:00.986835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6f1aa946-320b-44d9-ab7c-7d3bc644cb8d tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:01.021209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f1aa946-320b-44d9-ab7c-7d3bc644cb8d tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:01.022109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f1aa946-320b-44d9-ab7c-7d3bc644cb8d tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:01.022902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f1aa946-320b-44d9-ab7c-7d3bc644cb8d tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:01.029262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c7eb1ed7-e6c4-4cbb-9250-116fd60c8883 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:01.033743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f1aa946-320b-44d9-ab7c-7d3bc644cb8d tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:01.034289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f1aa946-320b-44d9-ab7c-7d3bc644cb8d tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:01.034761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f1aa946-320b-44d9-ab7c-7d3bc644cb8d tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:01.044094 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c7eb1ed7-e6c4-4cbb-9250-116fd60c8883 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1315 microversion: 2.1 time: 0.587124 Aug 29 15:33:01.045955 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1025/2036] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:00 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:01.091068 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-6f1aa946-320b-44d9-ab7c-7d3bc644cb8d tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] HTTP exception thrown: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6f1aa946-320b-44d9-ab7c-7d3bc644cb8d tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Request method failure captured: Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 HTTP/1.1 Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNwKefxbVd0fCSOk49bNq3IQz-Q_ZyOURoh8cenozzLJ7UpVj0hI77BDcl8VacHvIlbnne1jcwwJuBAJyCwwQdNn_1enuzJccrGW2cqFCbHiedsIVUqr9bZClQ94tO_czN5JtVXNRqnVg_BL__AQC2B8kRTr7RWA4qBOsgalKpaxAIE Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.21 Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: ff781836de994bafa6e09c8d663af7f3 Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-InstanceActionsV221TestJSON-397703734 Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ff781836de994bafa6e09c8d663af7f3", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ff781836de994bafa6e09c8d663af7f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff781836de994bafa6e09c8d663af7f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff781836de994bafa6e09c8d663af7f3"}]}] Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-InstanceActionsV221TestJSON-397703734 Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: ff781836de994bafa6e09c8d663af7f3 Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-397703734 Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-InstanceActionsV221TestJSON-397703734-project Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: f87bfb07b9f249dfb746b82db543fb02 Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-InstanceActionsV221TestJSON-397703734-project Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '8bbdc361-13d8-424e-95d7-7ce315b15b02'} Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:33:01.092850 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:33:01.099387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. Aug 29 15:33:01.099387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:33:01.099387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:01.099387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:33:01.099387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:01.099387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:01.099387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:01.099387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:33:01.099387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:33:01.099387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. Aug 29 15:33:01.099387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:33:01.099387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6f1aa946-320b-44d9-ab7c-7d3bc644cb8d tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Returning 404 to user: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:33:01.113588 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6f1aa946-320b-44d9-ab7c-7d3bc644cb8d tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 404 len: 111 microversion: 2.21 time: 0.124056 Aug 29 15:33:01.114299 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1012/2037] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:33:00 2022] DELETE /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:33:01.124357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e4e6125d-21bb-4bc1-8aad-ecaf37715d63 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:01.125107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e4e6125d-21bb-4bc1-8aad-ecaf37715d63 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] [instance: 8bbdc361-13d8-424e-95d7-7ce315b15b02] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:01.140062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4e6125d-21bb-4bc1-8aad-ecaf37715d63 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:01.140958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4e6125d-21bb-4bc1-8aad-ecaf37715d63 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:01.141641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4e6125d-21bb-4bc1-8aad-ecaf37715d63 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:01.145474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4e6125d-21bb-4bc1-8aad-ecaf37715d63 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:01.146600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4e6125d-21bb-4bc1-8aad-ecaf37715d63 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:01.147323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4e6125d-21bb-4bc1-8aad-ecaf37715d63 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:01.187637 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-e4e6125d-21bb-4bc1-8aad-ecaf37715d63 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] HTTP exception thrown: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e4e6125d-21bb-4bc1-8aad-ecaf37715d63 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Request method failure captured: Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 HTTP/1.1 Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNwKefxbVd0fCSOk49bNq3IQz-Q_ZyOURoh8cenozzLJ7UpVj0hI77BDcl8VacHvIlbnne1jcwwJuBAJyCwwQdNn_1enuzJccrGW2cqFCbHiedsIVUqr9bZClQ94tO_czN5JtVXNRqnVg_BL__AQC2B8kRTr7RWA4qBOsgalKpaxAIE Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-Openstack-Nova-Api-Version: 2.21 Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: ff781836de994bafa6e09c8d663af7f3 Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-InstanceActionsV221TestJSON-397703734 Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ff781836de994bafa6e09c8d663af7f3", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ff781836de994bafa6e09c8d663af7f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff781836de994bafa6e09c8d663af7f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff781836de994bafa6e09c8d663af7f3"}]}] Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-InstanceActionsV221TestJSON-397703734 Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: ff781836de994bafa6e09c8d663af7f3 Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-397703734 Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-InstanceActionsV221TestJSON-397703734-project Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: f87bfb07b9f249dfb746b82db543fb02 Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-InstanceActionsV221TestJSON-397703734-project Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '8bbdc361-13d8-424e-95d7-7ce315b15b02'} Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:33:01.190302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:01.195387 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:33:01.195387 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:01.195387 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:01.195387 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:01.195387 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:33:01.195387 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:33:01.195387 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. Aug 29 15:33:01.195387 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:33:01.200818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e4e6125d-21bb-4bc1-8aad-ecaf37715d63 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] Returning 404 to user: Instance 8bbdc361-13d8-424e-95d7-7ce315b15b02 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:33:01.202009 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e4e6125d-21bb-4bc1-8aad-ecaf37715d63 tempest-InstanceActionsV221TestJSON-397703734 tempest-InstanceActionsV221TestJSON-397703734-project] 10.222.0.62 "GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02" status: 404 len: 111 microversion: 2.21 time: 0.083293 Aug 29 15:33:01.205985 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1026/2038] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:01 2022] GET /compute/v2.1/servers/8bbdc361-13d8-424e-95d7-7ce315b15b02 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:33:01.492223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-de299a52-03e5-4b2a-8383-2a8f4db73cde tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:01.494107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-de299a52-03e5-4b2a-8383-2a8f4db73cde tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:01.506846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de299a52-03e5-4b2a-8383-2a8f4db73cde tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:01.507790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de299a52-03e5-4b2a-8383-2a8f4db73cde tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:01.508613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de299a52-03e5-4b2a-8383-2a8f4db73cde tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:01.509616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de299a52-03e5-4b2a-8383-2a8f4db73cde tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:01.511261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de299a52-03e5-4b2a-8383-2a8f4db73cde tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:01.511880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de299a52-03e5-4b2a-8383-2a8f4db73cde tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:01.593793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-83e20f75-8681-4ee9-bc71-8819b6cdc9ba tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:01.594860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-83e20f75-8681-4ee9-bc71-8819b6cdc9ba tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:01.605137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e20f75-8681-4ee9-bc71-8819b6cdc9ba tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:01.608753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e20f75-8681-4ee9-bc71-8819b6cdc9ba tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:01.613525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e20f75-8681-4ee9-bc71-8819b6cdc9ba tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:01.614599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e20f75-8681-4ee9-bc71-8819b6cdc9ba tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:01.615358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e20f75-8681-4ee9-bc71-8819b6cdc9ba tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:01.616066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e20f75-8681-4ee9-bc71-8819b6cdc9ba tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:01.893622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-de299a52-03e5-4b2a-8383-2a8f4db73cde tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:01.903807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-de299a52-03e5-4b2a-8383-2a8f4db73cde tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:01.911275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-de299a52-03e5-4b2a-8383-2a8f4db73cde tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:01.914860 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-de299a52-03e5-4b2a-8383-2a8f4db73cde tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1292 microversion: 2.25 time: 0.439377 Aug 29 15:33:01.915597 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1013/2039] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:01 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1292 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:02.070795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1e354ec0-192b-4377-99c0-a622cb0f24a5 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:02.072135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1e354ec0-192b-4377-99c0-a622cb0f24a5 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:02.092675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e354ec0-192b-4377-99c0-a622cb0f24a5 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:02.094846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e354ec0-192b-4377-99c0-a622cb0f24a5 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:02.096284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e354ec0-192b-4377-99c0-a622cb0f24a5 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:02.101286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e354ec0-192b-4377-99c0-a622cb0f24a5 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:02.101600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e354ec0-192b-4377-99c0-a622cb0f24a5 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:02.102049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e354ec0-192b-4377-99c0-a622cb0f24a5 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:02.687086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1e354ec0-192b-4377-99c0-a622cb0f24a5 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:02.710948 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1e354ec0-192b-4377-99c0-a622cb0f24a5 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1501 microversion: 2.1 time: 0.645735 Aug 29 15:33:02.715450 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1014/2040] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:02 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1501 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:02.740342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d3e10470-c0c6-477c-a65c-a213c496cc95 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:02.742322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d3e10470-c0c6-477c-a65c-a213c496cc95 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:02.760209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3e10470-c0c6-477c-a65c-a213c496cc95 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:02.760708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3e10470-c0c6-477c-a65c-a213c496cc95 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:02.761180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3e10470-c0c6-477c-a65c-a213c496cc95 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:02.761905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3e10470-c0c6-477c-a65c-a213c496cc95 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:02.762363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3e10470-c0c6-477c-a65c-a213c496cc95 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:02.766781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3e10470-c0c6-477c-a65c-a213c496cc95 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:02.839834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-d3e10470-c0c6-477c-a65c-a213c496cc95 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lazy-loading 'flavor' on Instance uuid 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:33:03.262064 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d3e10470-c0c6-477c-a65c-a213c496cc95 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "POST /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2/action" status: 202 len: 0 microversion: 2.1 time: 0.531220 Aug 29 15:33:03.273419 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1015/2041] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:33:02 2022] POST /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:03.308208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1a14e958-b984-47df-bb12-f1c8fdad9720 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:03.312718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1a14e958-b984-47df-bb12-f1c8fdad9720 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:03.334934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:03.343095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a14e958-b984-47df-bb12-f1c8fdad9720 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:03.343621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a14e958-b984-47df-bb12-f1c8fdad9720 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:03.344098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a14e958-b984-47df-bb12-f1c8fdad9720 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:03.346276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-83e20f75-8681-4ee9-bc71-8819b6cdc9ba tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:03.353489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a14e958-b984-47df-bb12-f1c8fdad9720 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:03.358648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a14e958-b984-47df-bb12-f1c8fdad9720 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:03.359600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a14e958-b984-47df-bb12-f1c8fdad9720 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:03.384705 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-83e20f75-8681-4ee9-bc71-8819b6cdc9ba tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1471 microversion: 2.1 time: 1.795168 Aug 29 15:33:03.397217 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1027/2042] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:01 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1471 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:03.397217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-172f3b90-ef39-4b30-9592-6773e42748f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:03.397217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-172f3b90-ef39-4b30-9592-6773e42748f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:03.406110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-172f3b90-ef39-4b30-9592-6773e42748f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:03.406625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-172f3b90-ef39-4b30-9592-6773e42748f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:03.407126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-172f3b90-ef39-4b30-9592-6773e42748f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:03.408162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-172f3b90-ef39-4b30-9592-6773e42748f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:03.418189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-172f3b90-ef39-4b30-9592-6773e42748f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:03.427114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-172f3b90-ef39-4b30-9592-6773e42748f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:03.860976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-172f3b90-ef39-4b30-9592-6773e42748f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:03.874665 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-172f3b90-ef39-4b30-9592-6773e42748f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.487370 Aug 29 15:33:03.878060 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1028/2043] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:03 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:04.094757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1a14e958-b984-47df-bb12-f1c8fdad9720 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:04.117717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1a14e958-b984-47df-bb12-f1c8fdad9720 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:04.121998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1a14e958-b984-47df-bb12-f1c8fdad9720 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:04.130804 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1a14e958-b984-47df-bb12-f1c8fdad9720 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1292 microversion: 2.25 time: 0.848786 Aug 29 15:33:04.148277 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1016/2044] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:03 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1292 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:04.414024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f54ed0c0-835c-495b-ad69-62e391600902 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:04.417320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f54ed0c0-835c-495b-ad69-62e391600902 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:04.432063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f54ed0c0-835c-495b-ad69-62e391600902 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:04.432977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f54ed0c0-835c-495b-ad69-62e391600902 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:04.446237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f54ed0c0-835c-495b-ad69-62e391600902 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:04.450014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f54ed0c0-835c-495b-ad69-62e391600902 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:04.455126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f54ed0c0-835c-495b-ad69-62e391600902 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:04.457662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f54ed0c0-835c-495b-ad69-62e391600902 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:04.880420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e903a54e-9f54-458d-a833-cf38cd43072c tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Action: 'create', calling method: .version_select at 0x7fc433a20160>, body: {"keypair": {"name": "tempest-keypair-217128555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrS2xRoFAhFdGDVNaCDFkZ+Nbqpl+GZCPPNiR8yajt5ZSuxeaAOyPrLcVpvdRfsXq2F0AX9NebcWCCcQZVGPIzPjwuBgFnCpsJG23nFtWid0iS3RLwFNvokVmOXPksXXA=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:04.924119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-e903a54e-9f54-458d-a833-cf38cd43072c tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Getting quotas for project 30f4b87127094af08ec1bed30151e67c. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:33:04.943274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-e903a54e-9f54-458d-a833-cf38cd43072c tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Getting quotas for user fec0d7efc0874edd84d5ae2508f926f4 and project 30f4b87127094af08ec1bed30151e67c. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:33:04.991334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f54ed0c0-835c-495b-ad69-62e391600902 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:05.001670 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f54ed0c0-835c-495b-ad69-62e391600902 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1471 microversion: 2.1 time: 0.594023 Aug 29 15:33:05.009515 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e903a54e-9f54-458d-a833-cf38cd43072c tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.258098 Aug 29 15:33:05.023898 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1029/2046] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:04 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1471 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:05.024339 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1017/2046] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:33:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:33:05.056874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f2cbf7c8-8770-490c-9f15-070cf594f23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:05.061842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f2cbf7c8-8770-490c-9f15-070cf594f23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:05.083621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2cbf7c8-8770-490c-9f15-070cf594f23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:05.084154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2cbf7c8-8770-490c-9f15-070cf594f23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:05.084635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2cbf7c8-8770-490c-9f15-070cf594f23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:05.085463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2cbf7c8-8770-490c-9f15-070cf594f23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:05.085921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2cbf7c8-8770-490c-9f15-070cf594f23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:05.088146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2cbf7c8-8770-490c-9f15-070cf594f23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:05.156777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0eaa80aa-9403-4d49-b62d-685399243da6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:05.157850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0eaa80aa-9403-4d49-b62d-685399243da6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:05.169503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eaa80aa-9403-4d49-b62d-685399243da6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:05.174976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eaa80aa-9403-4d49-b62d-685399243da6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:05.177762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eaa80aa-9403-4d49-b62d-685399243da6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:05.178832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eaa80aa-9403-4d49-b62d-685399243da6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:05.183163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eaa80aa-9403-4d49-b62d-685399243da6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:05.184916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eaa80aa-9403-4d49-b62d-685399243da6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:05.952081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0eaa80aa-9403-4d49-b62d-685399243da6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:05.965475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0eaa80aa-9403-4d49-b62d-685399243da6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:05.967555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0eaa80aa-9403-4d49-b62d-685399243da6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:05.970584 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0eaa80aa-9403-4d49-b62d-685399243da6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1292 microversion: 2.25 time: 0.817646 Aug 29 15:33:05.971887 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1018/2047] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:05 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1292 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:33:05.999140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f2cbf7c8-8770-490c-9f15-070cf594f23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:06.008942 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f2cbf7c8-8770-490c-9f15-070cf594f23a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.983992 Aug 29 15:33:06.017562 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1030/2048] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:05 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:06.025338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eeabd687-6622-44a6-8861-36de34807333 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:06.025961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eeabd687-6622-44a6-8861-36de34807333 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:06.037824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeabd687-6622-44a6-8861-36de34807333 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:06.038668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeabd687-6622-44a6-8861-36de34807333 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:06.046399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeabd687-6622-44a6-8861-36de34807333 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:06.047443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeabd687-6622-44a6-8861-36de34807333 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:06.048051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeabd687-6622-44a6-8861-36de34807333 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:06.048564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeabd687-6622-44a6-8861-36de34807333 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:06.239482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eeabd687-6622-44a6-8861-36de34807333 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:06.249179 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eeabd687-6622-44a6-8861-36de34807333 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1471 microversion: 2.1 time: 0.228909 Aug 29 15:33:06.252291 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1019/2049] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:06 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1471 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:06.995474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-649663cc-b629-4e65-833b-d5b04e4ffa49 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:06.995998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-649663cc-b629-4e65-833b-d5b04e4ffa49 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:07.007471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-649663cc-b629-4e65-833b-d5b04e4ffa49 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:07.009843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-649663cc-b629-4e65-833b-d5b04e4ffa49 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:07.010753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-649663cc-b629-4e65-833b-d5b04e4ffa49 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:07.012732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-649663cc-b629-4e65-833b-d5b04e4ffa49 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:07.013609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-649663cc-b629-4e65-833b-d5b04e4ffa49 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:07.015424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-649663cc-b629-4e65-833b-d5b04e4ffa49 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:07.032332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c285aea-6495-4356-b637-4f900c6b4b81 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:07.033723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6c285aea-6495-4356-b637-4f900c6b4b81 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:07.057140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c285aea-6495-4356-b637-4f900c6b4b81 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:07.058077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c285aea-6495-4356-b637-4f900c6b4b81 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:07.058702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c285aea-6495-4356-b637-4f900c6b4b81 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:07.059678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c285aea-6495-4356-b637-4f900c6b4b81 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:07.060346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c285aea-6495-4356-b637-4f900c6b4b81 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:07.061035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c285aea-6495-4356-b637-4f900c6b4b81 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:07.352718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-649663cc-b629-4e65-833b-d5b04e4ffa49 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:07.362282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-649663cc-b629-4e65-833b-d5b04e4ffa49 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:07.363727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-649663cc-b629-4e65-833b-d5b04e4ffa49 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:07.377746 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-649663cc-b629-4e65-833b-d5b04e4ffa49 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1280 microversion: 2.25 time: 0.373790 Aug 29 15:33:07.384768 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1031/2050] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:06 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1280 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:07.406454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-15b9342f-9fe5-4e08-bab2-27214dc3df85 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:07.407877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-15b9342f-9fe5-4e08-bab2-27214dc3df85 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:07.428024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15b9342f-9fe5-4e08-bab2-27214dc3df85 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:07.430587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15b9342f-9fe5-4e08-bab2-27214dc3df85 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:07.431251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15b9342f-9fe5-4e08-bab2-27214dc3df85 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:07.435249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15b9342f-9fe5-4e08-bab2-27214dc3df85 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:07.435928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15b9342f-9fe5-4e08-bab2-27214dc3df85 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:07.438652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15b9342f-9fe5-4e08-bab2-27214dc3df85 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:07.798989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6c285aea-6495-4356-b637-4f900c6b4b81 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:07.809810 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6c285aea-6495-4356-b637-4f900c6b4b81 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.781770 Aug 29 15:33:07.829794 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1020/2051] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:07 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:07.951572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-15b9342f-9fe5-4e08-bab2-27214dc3df85 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:07.967976 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-15b9342f-9fe5-4e08-bab2-27214dc3df85 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1471 microversion: 2.1 time: 0.581301 Aug 29 15:33:07.968962 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1032/2052] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:07 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1471 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:08.150725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "7e5ab8d8-8a2b-49f6-b107-836976652528"}], "security_groups": [{"name": "tempest-securitygroup--2113004896"}], "key_name": "tempest-keypair-217128555", "user_data": "}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:08.414080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-48b21c8e-4d0e-49ac-ba3d-91dffbbe7f2f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:08.414877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-48b21c8e-4d0e-49ac-ba3d-91dffbbe7f2f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:08.422791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48b21c8e-4d0e-49ac-ba3d-91dffbbe7f2f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:08.427499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48b21c8e-4d0e-49ac-ba3d-91dffbbe7f2f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:08.428030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48b21c8e-4d0e-49ac-ba3d-91dffbbe7f2f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:08.428799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48b21c8e-4d0e-49ac-ba3d-91dffbbe7f2f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:08.429315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48b21c8e-4d0e-49ac-ba3d-91dffbbe7f2f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:08.429745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48b21c8e-4d0e-49ac-ba3d-91dffbbe7f2f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:08.440521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:08.510429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] validate_networks() for [('7e5ab8d8-8a2b-49f6-b107-836976652528', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:33:08.635065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-48b21c8e-4d0e-49ac-ba3d-91dffbbe7f2f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:08.661335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-48b21c8e-4d0e-49ac-ba3d-91dffbbe7f2f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:08.664101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-48b21c8e-4d0e-49ac-ba3d-91dffbbe7f2f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:08.666093 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-48b21c8e-4d0e-49ac-ba3d-91dffbbe7f2f tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1280 microversion: 2.25 time: 0.257235 Aug 29 15:33:08.682092 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1033/2053] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:08 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1280 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:08.846396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f01e67da-242b-4e34-b617-91699b5193ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:08.847632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f01e67da-242b-4e34-b617-91699b5193ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:08.863125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f01e67da-242b-4e34-b617-91699b5193ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:08.864188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f01e67da-242b-4e34-b617-91699b5193ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:08.865576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f01e67da-242b-4e34-b617-91699b5193ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:08.866511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f01e67da-242b-4e34-b617-91699b5193ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:08.867152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f01e67da-242b-4e34-b617-91699b5193ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:08.867779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f01e67da-242b-4e34-b617-91699b5193ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:09.140634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f01e67da-242b-4e34-b617-91699b5193ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:09.155054 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f01e67da-242b-4e34-b617-91699b5193ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.315992 Aug 29 15:33:09.157037 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1034/2054] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:08 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:09.166325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e66935e4-b4d3-491c-8678-7bcfad233b1f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:09.169640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e66935e4-b4d3-491c-8678-7bcfad233b1f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:09.185147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e66935e4-b4d3-491c-8678-7bcfad233b1f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:09.191588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e66935e4-b4d3-491c-8678-7bcfad233b1f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:09.193861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e66935e4-b4d3-491c-8678-7bcfad233b1f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:09.194881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e66935e4-b4d3-491c-8678-7bcfad233b1f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:09.196783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e66935e4-b4d3-491c-8678-7bcfad233b1f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:09.197534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e66935e4-b4d3-491c-8678-7bcfad233b1f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:10.035947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e66935e4-b4d3-491c-8678-7bcfad233b1f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:10.045762 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e66935e4-b4d3-491c-8678-7bcfad233b1f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.885986 Aug 29 15:33:10.047463 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1035/2055] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:09 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:10.052870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-08f222cc-df31-4c99-8343-0ddf2fb49748 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:10.053835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-08f222cc-df31-4c99-8343-0ddf2fb49748 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:10.062219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08f222cc-df31-4c99-8343-0ddf2fb49748 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:10.063489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08f222cc-df31-4c99-8343-0ddf2fb49748 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:10.064416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08f222cc-df31-4c99-8343-0ddf2fb49748 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:10.065596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08f222cc-df31-4c99-8343-0ddf2fb49748 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:10.066231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08f222cc-df31-4c99-8343-0ddf2fb49748 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:10.066831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08f222cc-df31-4c99-8343-0ddf2fb49748 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:10.229631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:33:10.230413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:33:10.230785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:33:10.231530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:33:10.232000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:33:10.255230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:10.258977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:10.259708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:10.260847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:10.262808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:10.263443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:10.306978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Getting quotas for project 30f4b87127094af08ec1bed30151e67c. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:33:10.312976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-08f222cc-df31-4c99-8343-0ddf2fb49748 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:10.315897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Getting quotas for user fec0d7efc0874edd84d5ae2508f926f4 and project 30f4b87127094af08ec1bed30151e67c. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:33:10.328970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-08f222cc-df31-4c99-8343-0ddf2fb49748 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:10.330192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:33:10.332790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-08f222cc-df31-4c99-8343-0ddf2fb49748 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:10.333181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:33:10.337263 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-08f222cc-df31-4c99-8343-0ddf2fb49748 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1280 microversion: 2.25 time: 0.288141 Aug 29 15:33:10.339922 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1036/2056] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:10 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1280 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:10.355530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dd3a3337-ec0a-4a8f-9ec4-1604d0f09413 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:10.358785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dd3a3337-ec0a-4a8f-9ec4-1604d0f09413 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:10.375338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd3a3337-ec0a-4a8f-9ec4-1604d0f09413 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:10.376965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd3a3337-ec0a-4a8f-9ec4-1604d0f09413 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:10.379276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd3a3337-ec0a-4a8f-9ec4-1604d0f09413 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:10.381690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd3a3337-ec0a-4a8f-9ec4-1604d0f09413 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:10.384135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd3a3337-ec0a-4a8f-9ec4-1604d0f09413 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:10.385691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd3a3337-ec0a-4a8f-9ec4-1604d0f09413 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:10.413229 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1ef38991-38da-44d4-b5ea-d51647f0bf92 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.266986 Aug 29 15:33:10.418381 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1021/2057] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:33:08 2022] POST /compute/v2.1/servers => generated 409 bytes in 2273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:33:10.429930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ce117e56-47cc-48a9-9455-dbd9013a019a tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:10.430796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ce117e56-47cc-48a9-9455-dbd9013a019a tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:10.714562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dd3a3337-ec0a-4a8f-9ec4-1604d0f09413 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:10.726325 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dd3a3337-ec0a-4a8f-9ec4-1604d0f09413 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.383976 Aug 29 15:33:10.727157 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1037/2058] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:10 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:10.886407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ce117e56-47cc-48a9-9455-dbd9013a019a tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:10.902808 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ce117e56-47cc-48a9-9455-dbd9013a019a tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1225 microversion: 2.1 time: 0.477547 Aug 29 15:33:10.907807 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1022/2059] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:10 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1225 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:11.070389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-42369659-9c8b-444e-9269-737b81a38e59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:11.071515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-42369659-9c8b-444e-9269-737b81a38e59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:11.094796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42369659-9c8b-444e-9269-737b81a38e59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:11.095686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42369659-9c8b-444e-9269-737b81a38e59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:11.096542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42369659-9c8b-444e-9269-737b81a38e59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:11.097627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42369659-9c8b-444e-9269-737b81a38e59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:11.099247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42369659-9c8b-444e-9269-737b81a38e59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:11.102355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42369659-9c8b-444e-9269-737b81a38e59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:11.357722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-42369659-9c8b-444e-9269-737b81a38e59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:11.367781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-800c89d9-f3a2-47f4-a462-5fbe0c2a2ee8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:11.371024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-800c89d9-f3a2-47f4-a462-5fbe0c2a2ee8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:11.384123 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-42369659-9c8b-444e-9269-737b81a38e59 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.317071 Aug 29 15:33:11.387142 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1038/2060] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:11 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:11.387707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-800c89d9-f3a2-47f4-a462-5fbe0c2a2ee8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:11.388680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-800c89d9-f3a2-47f4-a462-5fbe0c2a2ee8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:11.389465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-800c89d9-f3a2-47f4-a462-5fbe0c2a2ee8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:11.390508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-800c89d9-f3a2-47f4-a462-5fbe0c2a2ee8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:11.391207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-800c89d9-f3a2-47f4-a462-5fbe0c2a2ee8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:11.391990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-800c89d9-f3a2-47f4-a462-5fbe0c2a2ee8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:11.677923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-800c89d9-f3a2-47f4-a462-5fbe0c2a2ee8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:11.691906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-800c89d9-f3a2-47f4-a462-5fbe0c2a2ee8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:11.693417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-800c89d9-f3a2-47f4-a462-5fbe0c2a2ee8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:11.700146 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-800c89d9-f3a2-47f4-a462-5fbe0c2a2ee8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1280 microversion: 2.25 time: 0.331279 Aug 29 15:33:11.700794 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1023/2061] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:11 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1280 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:33:11.750838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f251733a-f799-4c38-a0eb-daefe72aaed1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:11.753747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f251733a-f799-4c38-a0eb-daefe72aaed1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:11.760853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f251733a-f799-4c38-a0eb-daefe72aaed1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:11.761543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f251733a-f799-4c38-a0eb-daefe72aaed1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:11.762177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f251733a-f799-4c38-a0eb-daefe72aaed1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:11.763053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f251733a-f799-4c38-a0eb-daefe72aaed1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:11.763669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f251733a-f799-4c38-a0eb-daefe72aaed1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:11.764363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f251733a-f799-4c38-a0eb-daefe72aaed1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:11.927834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7ca088d5-9ce8-4a8a-a2b7-4ab13473c390 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:11.928750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7ca088d5-9ce8-4a8a-a2b7-4ab13473c390 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:11.940299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ca088d5-9ce8-4a8a-a2b7-4ab13473c390 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:11.941936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ca088d5-9ce8-4a8a-a2b7-4ab13473c390 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:11.943006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ca088d5-9ce8-4a8a-a2b7-4ab13473c390 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:11.947268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ca088d5-9ce8-4a8a-a2b7-4ab13473c390 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:11.947833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ca088d5-9ce8-4a8a-a2b7-4ab13473c390 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:11.949526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ca088d5-9ce8-4a8a-a2b7-4ab13473c390 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:11.990511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f251733a-f799-4c38-a0eb-daefe72aaed1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:12.010451 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f251733a-f799-4c38-a0eb-daefe72aaed1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.263918 Aug 29 15:33:12.011343 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1039/2062] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:11 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:12.128625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7ca088d5-9ce8-4a8a-a2b7-4ab13473c390 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:12.149605 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7ca088d5-9ce8-4a8a-a2b7-4ab13473c390 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1277 microversion: 2.1 time: 0.225798 Aug 29 15:33:12.169071 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1024/2063] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:11 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1277 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:12.406965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-15b39b35-aad1-401c-b1e9-00ebbec96c03 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:12.407476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-15b39b35-aad1-401c-b1e9-00ebbec96c03 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:12.417433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15b39b35-aad1-401c-b1e9-00ebbec96c03 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:12.418018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15b39b35-aad1-401c-b1e9-00ebbec96c03 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:12.418528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15b39b35-aad1-401c-b1e9-00ebbec96c03 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:12.419462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15b39b35-aad1-401c-b1e9-00ebbec96c03 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:12.420117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15b39b35-aad1-401c-b1e9-00ebbec96c03 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:12.420540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15b39b35-aad1-401c-b1e9-00ebbec96c03 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:12.604605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-15b39b35-aad1-401c-b1e9-00ebbec96c03 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:12.612644 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-15b39b35-aad1-401c-b1e9-00ebbec96c03 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.210091 Aug 29 15:33:12.615734 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1040/2064] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:12 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:12.725142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bf846ebb-8b4e-4892-8244-e469c90609a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:12.726042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bf846ebb-8b4e-4892-8244-e469c90609a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:12.733861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf846ebb-8b4e-4892-8244-e469c90609a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:12.734621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf846ebb-8b4e-4892-8244-e469c90609a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:12.735261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf846ebb-8b4e-4892-8244-e469c90609a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:12.736168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf846ebb-8b4e-4892-8244-e469c90609a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:12.736854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf846ebb-8b4e-4892-8244-e469c90609a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:12.737516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf846ebb-8b4e-4892-8244-e469c90609a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:12.900398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bf846ebb-8b4e-4892-8244-e469c90609a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:12.910252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bf846ebb-8b4e-4892-8244-e469c90609a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:12.912014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bf846ebb-8b4e-4892-8244-e469c90609a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:12.913497 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bf846ebb-8b4e-4892-8244-e469c90609a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1280 microversion: 2.25 time: 0.192639 Aug 29 15:33:12.914533 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1025/2065] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:12 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1280 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:13.031239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-83c6f117-bdc5-48ab-85a1-6ecbce825f8e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:13.031859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-83c6f117-bdc5-48ab-85a1-6ecbce825f8e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:13.042077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83c6f117-bdc5-48ab-85a1-6ecbce825f8e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:13.044217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83c6f117-bdc5-48ab-85a1-6ecbce825f8e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:13.045619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83c6f117-bdc5-48ab-85a1-6ecbce825f8e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:13.046788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83c6f117-bdc5-48ab-85a1-6ecbce825f8e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:13.054063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83c6f117-bdc5-48ab-85a1-6ecbce825f8e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:13.054878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83c6f117-bdc5-48ab-85a1-6ecbce825f8e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:13.180306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dcdfcb24-905b-49c0-8ccc-2ad93c9c4ead tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:13.186747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dcdfcb24-905b-49c0-8ccc-2ad93c9c4ead tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:13.203227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcdfcb24-905b-49c0-8ccc-2ad93c9c4ead tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:13.204134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcdfcb24-905b-49c0-8ccc-2ad93c9c4ead tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:13.204795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcdfcb24-905b-49c0-8ccc-2ad93c9c4ead tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:13.205841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcdfcb24-905b-49c0-8ccc-2ad93c9c4ead tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:13.206613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcdfcb24-905b-49c0-8ccc-2ad93c9c4ead tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:13.207544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcdfcb24-905b-49c0-8ccc-2ad93c9c4ead tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:13.305900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dcdfcb24-905b-49c0-8ccc-2ad93c9c4ead tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:13.323762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-83c6f117-bdc5-48ab-85a1-6ecbce825f8e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:13.327024 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dcdfcb24-905b-49c0-8ccc-2ad93c9c4ead tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1283 microversion: 2.1 time: 0.154818 Aug 29 15:33:13.332847 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1026/2066] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:13 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1283 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:13.353926 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-83c6f117-bdc5-48ab-85a1-6ecbce825f8e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.326375 Aug 29 15:33:13.364786 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1041/2067] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:13 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:13.645238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5717a115-7df1-43c9-b617-0c1ab2364f90 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:13.646494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5717a115-7df1-43c9-b617-0c1ab2364f90 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:13.654396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5717a115-7df1-43c9-b617-0c1ab2364f90 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:13.655301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5717a115-7df1-43c9-b617-0c1ab2364f90 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:13.656207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5717a115-7df1-43c9-b617-0c1ab2364f90 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:13.656963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5717a115-7df1-43c9-b617-0c1ab2364f90 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:13.657455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5717a115-7df1-43c9-b617-0c1ab2364f90 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:13.657943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5717a115-7df1-43c9-b617-0c1ab2364f90 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:13.922297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5717a115-7df1-43c9-b617-0c1ab2364f90 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:13.930625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:13.934387 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5717a115-7df1-43c9-b617-0c1ab2364f90 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.299028 Aug 29 15:33:13.934980 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1027/2068] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:13 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:13.936388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f4643999-1e6c-44bf-bf2f-ed90c144a083 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:13.937020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f4643999-1e6c-44bf-bf2f-ed90c144a083 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:13.947075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4643999-1e6c-44bf-bf2f-ed90c144a083 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:13.947555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4643999-1e6c-44bf-bf2f-ed90c144a083 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:13.948010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4643999-1e6c-44bf-bf2f-ed90c144a083 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:13.950504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4643999-1e6c-44bf-bf2f-ed90c144a083 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:13.951109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4643999-1e6c-44bf-bf2f-ed90c144a083 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:13.964448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4643999-1e6c-44bf-bf2f-ed90c144a083 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:14.280401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f4643999-1e6c-44bf-bf2f-ed90c144a083 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:14.294847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f4643999-1e6c-44bf-bf2f-ed90c144a083 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:14.298991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f4643999-1e6c-44bf-bf2f-ed90c144a083 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:14.301893 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f4643999-1e6c-44bf-bf2f-ed90c144a083 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1280 microversion: 2.25 time: 0.368807 Aug 29 15:33:14.316256 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1042/2069] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:13 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1280 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:14.351987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e63faa9b-ad1a-4083-9b6a-45f54d3ded8a tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:14.352675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e63faa9b-ad1a-4083-9b6a-45f54d3ded8a tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:14.366206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e63faa9b-ad1a-4083-9b6a-45f54d3ded8a tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:14.370580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e63faa9b-ad1a-4083-9b6a-45f54d3ded8a tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:14.373660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e63faa9b-ad1a-4083-9b6a-45f54d3ded8a tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:14.374608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e63faa9b-ad1a-4083-9b6a-45f54d3ded8a tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:14.375239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e63faa9b-ad1a-4083-9b6a-45f54d3ded8a tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:14.375977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e63faa9b-ad1a-4083-9b6a-45f54d3ded8a tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:14.610858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-671223453", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "8362a329-0fbf-4c50-a81c-494d6cb849ef"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:14.722106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] validate_networks() for [('8362a329-0fbf-4c50-a81c-494d6cb849ef', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:33:14.741938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e63faa9b-ad1a-4083-9b6a-45f54d3ded8a tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:14.750869 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e63faa9b-ad1a-4083-9b6a-45f54d3ded8a tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1351 microversion: 2.1 time: 0.402914 Aug 29 15:33:14.773290 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1028/2070] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:14 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1351 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:14.781170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2c4b8f13-a0bb-46cb-ae87-b31b41dff51b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:14.782165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2c4b8f13-a0bb-46cb-ae87-b31b41dff51b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:14.788561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c4b8f13-a0bb-46cb-ae87-b31b41dff51b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:14.789420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c4b8f13-a0bb-46cb-ae87-b31b41dff51b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:14.790081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c4b8f13-a0bb-46cb-ae87-b31b41dff51b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:14.791030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c4b8f13-a0bb-46cb-ae87-b31b41dff51b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:14.791734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c4b8f13-a0bb-46cb-ae87-b31b41dff51b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:14.792491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c4b8f13-a0bb-46cb-ae87-b31b41dff51b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:15.221323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2c4b8f13-a0bb-46cb-ae87-b31b41dff51b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:15.234300 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2c4b8f13-a0bb-46cb-ae87-b31b41dff51b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.457060 Aug 29 15:33:15.235183 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1029/2071] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:14 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:15.240504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-82413999-e83a-41da-857a-1b9af250fce6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:15.241126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-82413999-e83a-41da-857a-1b9af250fce6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:15.247788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82413999-e83a-41da-857a-1b9af250fce6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:15.248653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82413999-e83a-41da-857a-1b9af250fce6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:15.249704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82413999-e83a-41da-857a-1b9af250fce6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:15.250727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82413999-e83a-41da-857a-1b9af250fce6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:15.251355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82413999-e83a-41da-857a-1b9af250fce6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:15.251964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82413999-e83a-41da-857a-1b9af250fce6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:15.279207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:33:15.279859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:33:15.281122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:33:15.281548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:33:15.281962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:33:15.294337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:15.295142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:15.295805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:15.296570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:15.297021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:15.297473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:15.315880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Getting quotas for project 448ade75da744a0fa52b64221fabfc21. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:33:15.323344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Getting quotas for user 8430472729074bdbb6fc9bf8a0506e66 and project 448ade75da744a0fa52b64221fabfc21. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:33:15.339893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:33:15.342313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:33:15.420898 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-954b3a6c-bc19-4f0f-bec5-c17a74c61d75 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.048254 Aug 29 15:33:15.426882 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1043/2072] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:33:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:33:15.449226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b254bfa3-a392-4208-81c2-c8c9a0cecbac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:15.451592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b254bfa3-a392-4208-81c2-c8c9a0cecbac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:15.473864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b254bfa3-a392-4208-81c2-c8c9a0cecbac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:15.474368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b254bfa3-a392-4208-81c2-c8c9a0cecbac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:15.475028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b254bfa3-a392-4208-81c2-c8c9a0cecbac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:15.478170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b254bfa3-a392-4208-81c2-c8c9a0cecbac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:15.478670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b254bfa3-a392-4208-81c2-c8c9a0cecbac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:15.479120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b254bfa3-a392-4208-81c2-c8c9a0cecbac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:15.664958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b254bfa3-a392-4208-81c2-c8c9a0cecbac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:15.676436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b254bfa3-a392-4208-81c2-c8c9a0cecbac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:15.678099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b254bfa3-a392-4208-81c2-c8c9a0cecbac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:15.679257 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b254bfa3-a392-4208-81c2-c8c9a0cecbac tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1280 microversion: 2.25 time: 0.250049 Aug 29 15:33:15.680144 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1044/2073] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:15 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1280 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:15.684859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1312853233", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "8362a329-0fbf-4c50-a81c-494d6cb849ef"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:15.757032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] validate_networks() for [('8362a329-0fbf-4c50-a81c-494d6cb849ef', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:33:15.784572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-82413999-e83a-41da-857a-1b9af250fce6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:15.796968 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-82413999-e83a-41da-857a-1b9af250fce6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.560492 Aug 29 15:33:15.798360 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1030/2074] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:15 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:15.804576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-840305045", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "7ead68ac-9b85-4a15-900a-c59cae425b9c"}], "block_device_mapping_v2": [{"uuid": "5a993100-5201-4b6a-ac0e-b37a7edb139f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:15.933680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] validate_networks() for [('7ead68ac-9b85-4a15-900a-c59cae425b9c', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:33:16.274128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:33:16.274888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:33:16.275595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:33:16.276006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:33:16.276610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:33:16.288147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.288942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.289992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.290750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.291227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.291806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.316148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Getting quotas for project 448ade75da744a0fa52b64221fabfc21. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:33:16.321461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Getting quotas for user 8430472729074bdbb6fc9bf8a0506e66 and project 448ade75da744a0fa52b64221fabfc21. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:33:16.335480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:33:16.338194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: d624c852-fdae-4a2b-bd07-3d751e56c170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:33:16.392962 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-392f7939-ba03-47f4-8e70-e0a8d17c5948 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711403 Aug 29 15:33:16.394304 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1045/2075] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:33:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:33:16.414325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4eeb4594-c05f-4c8c-8648-685f0ced3207 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:16.417387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4eeb4594-c05f-4c8c-8648-685f0ced3207 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:16.428279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4eeb4594-c05f-4c8c-8648-685f0ced3207 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.429874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4eeb4594-c05f-4c8c-8648-685f0ced3207 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.430535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4eeb4594-c05f-4c8c-8648-685f0ced3207 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.431429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4eeb4594-c05f-4c8c-8648-685f0ced3207 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.432164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4eeb4594-c05f-4c8c-8648-685f0ced3207 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.441840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4eeb4594-c05f-4c8c-8648-685f0ced3207 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.653344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4eeb4594-c05f-4c8c-8648-685f0ced3207 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:16.667152 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4eeb4594-c05f-4c8c-8648-685f0ced3207 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1351 microversion: 2.1 time: 0.271502 Aug 29 15:33:16.669850 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1046/2076] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:16 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1351 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:16.681118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-6002937a-5b4a-4c19-b80f-d38a563ad658 req-c26c7560-4f4c-4fdd-883c-21d4def7a8fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6135fb3a-980d-4e8a-ad76-4908f4f53a0a", "tag": "c70a93be-38b6-4ac7-89fb-2c06e79c39b9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:16.702668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6002937a-5b4a-4c19-b80f-d38a563ad658 req-c26c7560-4f4c-4fdd-883c-21d4def7a8fb service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.703511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6002937a-5b4a-4c19-b80f-d38a563ad658 req-c26c7560-4f4c-4fdd-883c-21d4def7a8fb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.704182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6002937a-5b4a-4c19-b80f-d38a563ad658 req-c26c7560-4f4c-4fdd-883c-21d4def7a8fb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.735447 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-6002937a-5b4a-4c19-b80f-d38a563ad658 req-c26c7560-4f4c-4fdd-883c-21d4def7a8fb service nova] Creating event network-changed:c70a93be-38b6-4ac7-89fb-2c06e79c39b9 for instance 6135fb3a-980d-4e8a-ad76-4908f4f53a0a on n-h2-839401-11 Aug 29 15:33:16.751629 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-6002937a-5b4a-4c19-b80f-d38a563ad658 req-c26c7560-4f4c-4fdd-883c-21d4def7a8fb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079283 Aug 29 15:33:16.753786 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1047/2077] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:16.763110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-632981d1-2a77-468c-bdf7-0962c7b1df30 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:16.764118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-632981d1-2a77-468c-bdf7-0962c7b1df30 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:16.771343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-632981d1-2a77-468c-bdf7-0962c7b1df30 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.772119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-632981d1-2a77-468c-bdf7-0962c7b1df30 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.772743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-632981d1-2a77-468c-bdf7-0962c7b1df30 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.773688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-632981d1-2a77-468c-bdf7-0962c7b1df30 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.774325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-632981d1-2a77-468c-bdf7-0962c7b1df30 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.774922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-632981d1-2a77-468c-bdf7-0962c7b1df30 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.899068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:33:16.899566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:33:16.899980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:33:16.900504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:33:16.900921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:33:16.924300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.924799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.925461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.926392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:16.927219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:16.927816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:16.960198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-632981d1-2a77-468c-bdf7-0962c7b1df30 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:16.971918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Getting quotas for project 31544ac2992c46aa8fecdff53a43ae42. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:33:16.972608 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-632981d1-2a77-468c-bdf7-0962c7b1df30 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.213212 Aug 29 15:33:16.973398 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1048/2078] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:16 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:16.980392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-750057694", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "451", "networks": [{"uuid": "8362a329-0fbf-4c50-a81c-494d6cb849ef"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:17.004066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Getting quotas for user 498e44c8a15f451ba8ff39eff4156075 and project 31544ac2992c46aa8fecdff53a43ae42. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:33:17.078352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] validate_networks() for [('8362a329-0fbf-4c50-a81c-494d6cb849ef', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:33:17.130773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:33:17.133783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a993100-5201-4b6a-ac0e-b37a7edb139f',volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:33:17.380743 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b1ebb0bc-1fcb-4aa3-a69a-71f49b12b97a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.580644 Aug 29 15:33:17.381748 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1031/2079] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:33:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:33:17.387046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4cdacbb3-d24f-41e7-a586-593e659db657 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:17.388056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4cdacbb3-d24f-41e7-a586-593e659db657 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:17.396105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cdacbb3-d24f-41e7-a586-593e659db657 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:17.397016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cdacbb3-d24f-41e7-a586-593e659db657 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:17.397774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cdacbb3-d24f-41e7-a586-593e659db657 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:17.398957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cdacbb3-d24f-41e7-a586-593e659db657 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:17.399937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cdacbb3-d24f-41e7-a586-593e659db657 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:17.400636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cdacbb3-d24f-41e7-a586-593e659db657 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:17.685415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4cdacbb3-d24f-41e7-a586-593e659db657 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:17.700124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4cdacbb3-d24f-41e7-a586-593e659db657 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:17.701795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4cdacbb3-d24f-41e7-a586-593e659db657 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:17.702940 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4cdacbb3-d24f-41e7-a586-593e659db657 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1280 microversion: 2.25 time: 0.319819 Aug 29 15:33:17.733498 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1032/2080] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:17 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1280 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:17.738956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-08adea5f-55fd-4ff4-8319-481b660d74e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:17.739848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-08adea5f-55fd-4ff4-8319-481b660d74e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:17.748518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:33:17.749038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:33:17.749475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:33:17.749886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:33:17.750307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:33:17.760492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:17.760979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:17.761354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08adea5f-55fd-4ff4-8319-481b660d74e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:17.761493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:17.761880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08adea5f-55fd-4ff4-8319-481b660d74e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:17.762189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:17.762312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08adea5f-55fd-4ff4-8319-481b660d74e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:17.762641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:17.763017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08adea5f-55fd-4ff4-8319-481b660d74e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:17.763128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:17.763477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08adea5f-55fd-4ff4-8319-481b660d74e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:17.763905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08adea5f-55fd-4ff4-8319-481b660d74e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:17.782947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Getting quotas for project 448ade75da744a0fa52b64221fabfc21. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:33:17.789496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Getting quotas for user 8430472729074bdbb6fc9bf8a0506e66 and project 448ade75da744a0fa52b64221fabfc21. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:33:17.802949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:33:17.805334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:33:17.872845 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e23a3cf5-df46-4f88-bc91-6274d43d406f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897479 Aug 29 15:33:17.873821 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1049/2081] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:33:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:33:17.884620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-b9c66baa-2d3d-40f6-93cb-8a9acf405a73 req-8d6eb541-c7f6-4c35-9637-876011cc8bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc", "name": "network-vif-plugged", "status": "completed", "tag": "8d13372d-483a-4d92-9792-82a84a9eb8eb"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:17.910285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:17.912456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b9c66baa-2d3d-40f6-93cb-8a9acf405a73 req-8d6eb541-c7f6-4c35-9637-876011cc8bf0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:17.912939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b9c66baa-2d3d-40f6-93cb-8a9acf405a73 req-8d6eb541-c7f6-4c35-9637-876011cc8bf0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:17.913579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b9c66baa-2d3d-40f6-93cb-8a9acf405a73 req-8d6eb541-c7f6-4c35-9637-876011cc8bf0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:17.928148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-08adea5f-55fd-4ff4-8319-481b660d74e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:17.930032 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-b9c66baa-2d3d-40f6-93cb-8a9acf405a73 req-8d6eb541-c7f6-4c35-9637-876011cc8bf0 service nova] Creating event network-vif-plugged:8d13372d-483a-4d92-9792-82a84a9eb8eb for instance d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc on n-h1-839401-11 Aug 29 15:33:17.935693 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-b9c66baa-2d3d-40f6-93cb-8a9acf405a73 req-8d6eb541-c7f6-4c35-9637-876011cc8bf0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060472 Aug 29 15:33:17.936373 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1050/2082] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:17.950246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2ffea888-4b77-496d-a514-a2da7acfd9cc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:17.951136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2ffea888-4b77-496d-a514-a2da7acfd9cc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:17.951653 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-08adea5f-55fd-4ff4-8319-481b660d74e5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.216099 Aug 29 15:33:17.964988 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1033/2083] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:17 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:17.964988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8781334d-3580-4f6e-afbd-3848357ff134 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:17.964988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8781334d-3580-4f6e-afbd-3848357ff134 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:17.969270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8781334d-3580-4f6e-afbd-3848357ff134 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:17.969759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8781334d-3580-4f6e-afbd-3848357ff134 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:17.970416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8781334d-3580-4f6e-afbd-3848357ff134 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:17.971618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8781334d-3580-4f6e-afbd-3848357ff134 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:17.972293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8781334d-3580-4f6e-afbd-3848357ff134 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:17.972923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8781334d-3580-4f6e-afbd-3848357ff134 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:18.040671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2ffea888-4b77-496d-a514-a2da7acfd9cc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:18.050656 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2ffea888-4b77-496d-a514-a2da7acfd9cc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1052 microversion: 2.1 time: 0.108317 Aug 29 15:33:18.053358 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1051/2084] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:17 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1052 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:18.061808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7ef837e3-d18b-4d63-a2d5-d4707e31d1dd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:18.063047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7ef837e3-d18b-4d63-a2d5-d4707e31d1dd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:18.141115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7ef837e3-d18b-4d63-a2d5-d4707e31d1dd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:18.159771 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7ef837e3-d18b-4d63-a2d5-d4707e31d1dd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1220 microversion: 2.1 time: 0.096493 Aug 29 15:33:18.171398 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1052/2085] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:18 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:18.180298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aec81e66-9ae4-489c-bedc-d6119b2015f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:18.180949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aec81e66-9ae4-489c-bedc-d6119b2015f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:18.187705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec81e66-9ae4-489c-bedc-d6119b2015f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:18.188597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec81e66-9ae4-489c-bedc-d6119b2015f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:18.189285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec81e66-9ae4-489c-bedc-d6119b2015f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:18.190424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec81e66-9ae4-489c-bedc-d6119b2015f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:18.191410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec81e66-9ae4-489c-bedc-d6119b2015f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:18.192064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec81e66-9ae4-489c-bedc-d6119b2015f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:18.225405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8781334d-3580-4f6e-afbd-3848357ff134 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:18.237553 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8781334d-3580-4f6e-afbd-3848357ff134 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1351 microversion: 2.1 time: 0.283423 Aug 29 15:33:18.239562 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1034/2086] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:17 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1351 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:18.351716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aec81e66-9ae4-489c-bedc-d6119b2015f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:18.360891 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aec81e66-9ae4-489c-bedc-d6119b2015f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.187785 Aug 29 15:33:18.374820 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1053/2087] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:18 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:18.726644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b1628b78-707f-414c-87c0-85d67b548153 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:18.727399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b1628b78-707f-414c-87c0-85d67b548153 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:18.734213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1628b78-707f-414c-87c0-85d67b548153 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:18.734691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1628b78-707f-414c-87c0-85d67b548153 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:18.735136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1628b78-707f-414c-87c0-85d67b548153 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:18.735839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1628b78-707f-414c-87c0-85d67b548153 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:18.736301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1628b78-707f-414c-87c0-85d67b548153 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:18.736726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1628b78-707f-414c-87c0-85d67b548153 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:18.891398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b1628b78-707f-414c-87c0-85d67b548153 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:18.899761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b1628b78-707f-414c-87c0-85d67b548153 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:18.901251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b1628b78-707f-414c-87c0-85d67b548153 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:18.902394 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b1628b78-707f-414c-87c0-85d67b548153 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1280 microversion: 2.25 time: 0.180068 Aug 29 15:33:18.902962 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1035/2088] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:18 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1280 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:18.974152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec5f5418-2a84-4221-9ca2-17c11065670a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:18.974761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ec5f5418-2a84-4221-9ca2-17c11065670a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:18.982009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec5f5418-2a84-4221-9ca2-17c11065670a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:18.982427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec5f5418-2a84-4221-9ca2-17c11065670a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:18.982864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec5f5418-2a84-4221-9ca2-17c11065670a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:18.983561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec5f5418-2a84-4221-9ca2-17c11065670a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:18.984019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec5f5418-2a84-4221-9ca2-17c11065670a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:18.984434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec5f5418-2a84-4221-9ca2-17c11065670a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:19.075835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fe933448-5a62-4b4e-aec7-642c7559a144 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:19.076936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fe933448-5a62-4b4e-aec7-642c7559a144 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:19.084691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe933448-5a62-4b4e-aec7-642c7559a144 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:19.085339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe933448-5a62-4b4e-aec7-642c7559a144 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:19.085844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe933448-5a62-4b4e-aec7-642c7559a144 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:19.086744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe933448-5a62-4b4e-aec7-642c7559a144 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:19.087267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe933448-5a62-4b4e-aec7-642c7559a144 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:19.087768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe933448-5a62-4b4e-aec7-642c7559a144 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:19.131872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ec5f5418-2a84-4221-9ca2-17c11065670a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:19.142181 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ec5f5418-2a84-4221-9ca2-17c11065670a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.172796 Aug 29 15:33:19.143037 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1054/2089] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:18 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:19.158163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fe933448-5a62-4b4e-aec7-642c7559a144 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:19.166838 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fe933448-5a62-4b4e-aec7-642c7559a144 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1150 microversion: 2.1 time: 0.096654 Aug 29 15:33:19.167432 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1036/2090] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:19 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1150 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:19.183972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2f250be7-301a-44f6-8b65-ac454619caef tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:19.184611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2f250be7-301a-44f6-8b65-ac454619caef tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:19.190784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f250be7-301a-44f6-8b65-ac454619caef tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:19.191264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f250be7-301a-44f6-8b65-ac454619caef tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:19.191695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f250be7-301a-44f6-8b65-ac454619caef tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:19.192389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f250be7-301a-44f6-8b65-ac454619caef tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:19.192856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f250be7-301a-44f6-8b65-ac454619caef tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:19.193293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f250be7-301a-44f6-8b65-ac454619caef tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:19.197493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:19.258114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2f250be7-301a-44f6-8b65-ac454619caef tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:19.260542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5cd1bb6a-5024-4829-a663-81148e73c7dd tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:19.261257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5cd1bb6a-5024-4829-a663-81148e73c7dd tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:19.267547 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2f250be7-301a-44f6-8b65-ac454619caef tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1224 microversion: 2.1 time: 0.087565 Aug 29 15:33:19.268141 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1055/2091] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:19 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:19.271332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cd1bb6a-5024-4829-a663-81148e73c7dd tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:19.272051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cd1bb6a-5024-4829-a663-81148e73c7dd tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:19.272645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cd1bb6a-5024-4829-a663-81148e73c7dd tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:19.273603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cd1bb6a-5024-4829-a663-81148e73c7dd tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:19.274214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cd1bb6a-5024-4829-a663-81148e73c7dd tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:19.275376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cd1bb6a-5024-4829-a663-81148e73c7dd tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:19.382620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e781f8bf-2577-4f88-9d5b-e3790f6767c6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:19.383227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e781f8bf-2577-4f88-9d5b-e3790f6767c6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:19.389784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e781f8bf-2577-4f88-9d5b-e3790f6767c6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:19.390274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e781f8bf-2577-4f88-9d5b-e3790f6767c6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:19.390726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e781f8bf-2577-4f88-9d5b-e3790f6767c6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:19.391586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e781f8bf-2577-4f88-9d5b-e3790f6767c6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:19.392051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e781f8bf-2577-4f88-9d5b-e3790f6767c6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:19.392482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e781f8bf-2577-4f88-9d5b-e3790f6767c6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:19.413449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5cd1bb6a-5024-4829-a663-81148e73c7dd tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:19.421903 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5cd1bb6a-5024-4829-a663-81148e73c7dd tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1351 microversion: 2.1 time: 0.165632 Aug 29 15:33:19.422512 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1037/2092] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:19 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1351 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:19.550228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e781f8bf-2577-4f88-9d5b-e3790f6767c6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:19.559408 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e781f8bf-2577-4f88-9d5b-e3790f6767c6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.180942 Aug 29 15:33:19.567761 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1056/2093] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:19 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:19.926185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4972cec3-0f2a-4d70-aa79-c945cd63b708 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:19.926801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4972cec3-0f2a-4d70-aa79-c945cd63b708 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:19.933738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4972cec3-0f2a-4d70-aa79-c945cd63b708 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:19.934237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4972cec3-0f2a-4d70-aa79-c945cd63b708 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:19.934674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4972cec3-0f2a-4d70-aa79-c945cd63b708 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:19.935381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4972cec3-0f2a-4d70-aa79-c945cd63b708 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:19.935833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4972cec3-0f2a-4d70-aa79-c945cd63b708 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:19.936261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4972cec3-0f2a-4d70-aa79-c945cd63b708 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:20.079136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4972cec3-0f2a-4d70-aa79-c945cd63b708 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:20.087487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4972cec3-0f2a-4d70-aa79-c945cd63b708 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:20.088932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4972cec3-0f2a-4d70-aa79-c945cd63b708 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:20.090106 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4972cec3-0f2a-4d70-aa79-c945cd63b708 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1280 microversion: 2.25 time: 0.168199 Aug 29 15:33:20.090673 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1038/2094] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:19 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1280 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:20.165049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-252e2106-2ad8-4c1e-983f-f2f936893b67 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:20.165937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-252e2106-2ad8-4c1e-983f-f2f936893b67 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:20.173922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-252e2106-2ad8-4c1e-983f-f2f936893b67 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:20.174731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-252e2106-2ad8-4c1e-983f-f2f936893b67 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:20.175592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-252e2106-2ad8-4c1e-983f-f2f936893b67 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:20.176741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-252e2106-2ad8-4c1e-983f-f2f936893b67 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:20.177528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-252e2106-2ad8-4c1e-983f-f2f936893b67 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:20.177941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-252e2106-2ad8-4c1e-983f-f2f936893b67 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:20.188076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-32df3663-cd04-46cb-a0a8-9f6476598ebb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:20.189228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-32df3663-cd04-46cb-a0a8-9f6476598ebb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:20.197456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32df3663-cd04-46cb-a0a8-9f6476598ebb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:20.198376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32df3663-cd04-46cb-a0a8-9f6476598ebb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:20.199067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32df3663-cd04-46cb-a0a8-9f6476598ebb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:20.200005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32df3663-cd04-46cb-a0a8-9f6476598ebb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:20.200697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32df3663-cd04-46cb-a0a8-9f6476598ebb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:20.201409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32df3663-cd04-46cb-a0a8-9f6476598ebb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:20.266868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-32df3663-cd04-46cb-a0a8-9f6476598ebb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:20.274973 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-32df3663-cd04-46cb-a0a8-9f6476598ebb tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1150 microversion: 2.1 time: 0.091063 Aug 29 15:33:20.275560 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1039/2095] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:20 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1150 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:20.288301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3e84a86b-0bdc-4c8e-81d2-4c64b21a86fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:20.288913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3e84a86b-0bdc-4c8e-81d2-4c64b21a86fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:20.294962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e84a86b-0bdc-4c8e-81d2-4c64b21a86fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:20.295605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e84a86b-0bdc-4c8e-81d2-4c64b21a86fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:20.296043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e84a86b-0bdc-4c8e-81d2-4c64b21a86fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:20.296867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e84a86b-0bdc-4c8e-81d2-4c64b21a86fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:20.297354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e84a86b-0bdc-4c8e-81d2-4c64b21a86fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:20.297806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e84a86b-0bdc-4c8e-81d2-4c64b21a86fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:20.336140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-252e2106-2ad8-4c1e-983f-f2f936893b67 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:20.346332 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-252e2106-2ad8-4c1e-983f-f2f936893b67 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.185568 Aug 29 15:33:20.346949 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1057/2096] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:20 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:20.362951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3e84a86b-0bdc-4c8e-81d2-4c64b21a86fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:20.371458 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3e84a86b-0bdc-4c8e-81d2-4c64b21a86fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1224 microversion: 2.1 time: 0.087468 Aug 29 15:33:20.372069 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1040/2097] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:20 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:20.443778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-57bde15a-eb45-413f-a28f-209d319c8e05 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:20.444702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-57bde15a-eb45-413f-a28f-209d319c8e05 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:20.451272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57bde15a-eb45-413f-a28f-209d319c8e05 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:20.451856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57bde15a-eb45-413f-a28f-209d319c8e05 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:20.452559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57bde15a-eb45-413f-a28f-209d319c8e05 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:20.453540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57bde15a-eb45-413f-a28f-209d319c8e05 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:20.454001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57bde15a-eb45-413f-a28f-209d319c8e05 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:20.455250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57bde15a-eb45-413f-a28f-209d319c8e05 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:20.581849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-162e9b40-d790-4399-ab7b-521152640845 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:20.582800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-162e9b40-d790-4399-ab7b-521152640845 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:20.595005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-162e9b40-d790-4399-ab7b-521152640845 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:20.597865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-162e9b40-d790-4399-ab7b-521152640845 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:20.599472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-162e9b40-d790-4399-ab7b-521152640845 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:20.600722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-162e9b40-d790-4399-ab7b-521152640845 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:20.603634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-162e9b40-d790-4399-ab7b-521152640845 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:20.604286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-162e9b40-d790-4399-ab7b-521152640845 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:20.691616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-57bde15a-eb45-413f-a28f-209d319c8e05 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:20.712157 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-57bde15a-eb45-413f-a28f-209d319c8e05 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1351 microversion: 2.1 time: 0.272720 Aug 29 15:33:20.713387 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1058/2098] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:20 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1351 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:21.123853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b464af6e-b61a-4106-8f08-a0941d0b051e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:21.125985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b464af6e-b61a-4106-8f08-a0941d0b051e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:21.138360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b464af6e-b61a-4106-8f08-a0941d0b051e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:21.139415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b464af6e-b61a-4106-8f08-a0941d0b051e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:21.140738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b464af6e-b61a-4106-8f08-a0941d0b051e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:21.141774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b464af6e-b61a-4106-8f08-a0941d0b051e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:21.146672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b464af6e-b61a-4106-8f08-a0941d0b051e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:21.147675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b464af6e-b61a-4106-8f08-a0941d0b051e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:21.266782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-162e9b40-d790-4399-ab7b-521152640845 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:21.278846 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-162e9b40-d790-4399-ab7b-521152640845 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.701581 Aug 29 15:33:21.282798 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1041/2099] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:20 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:21.300666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a38a1e5a-e0df-4431-8de5-b7c2261da413 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:21.301950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a38a1e5a-e0df-4431-8de5-b7c2261da413 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:21.320734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38a1e5a-e0df-4431-8de5-b7c2261da413 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:21.321279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38a1e5a-e0df-4431-8de5-b7c2261da413 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:21.324593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38a1e5a-e0df-4431-8de5-b7c2261da413 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:21.325472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38a1e5a-e0df-4431-8de5-b7c2261da413 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:21.325943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38a1e5a-e0df-4431-8de5-b7c2261da413 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:21.328581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38a1e5a-e0df-4431-8de5-b7c2261da413 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:21.427541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b464af6e-b61a-4106-8f08-a0941d0b051e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:21.439868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b464af6e-b61a-4106-8f08-a0941d0b051e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:21.442636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b464af6e-b61a-4106-8f08-a0941d0b051e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:21.444775 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b464af6e-b61a-4106-8f08-a0941d0b051e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1476 microversion: 2.25 time: 0.325242 Aug 29 15:33:21.466489 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1059/2100] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:21 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1476 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:21.474157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a1956edd-813e-4767-a46f-6742345ebc4c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:21.475103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a1956edd-813e-4767-a46f-6742345ebc4c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:21.482890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1956edd-813e-4767-a46f-6742345ebc4c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:21.483382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1956edd-813e-4767-a46f-6742345ebc4c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:21.483818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1956edd-813e-4767-a46f-6742345ebc4c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:21.484534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1956edd-813e-4767-a46f-6742345ebc4c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:21.485205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1956edd-813e-4767-a46f-6742345ebc4c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:21.485799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1956edd-813e-4767-a46f-6742345ebc4c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:21.497181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a38a1e5a-e0df-4431-8de5-b7c2261da413 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:21.506356 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a38a1e5a-e0df-4431-8de5-b7c2261da413 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1168 microversion: 2.1 time: 0.213754 Aug 29 15:33:21.506967 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1042/2101] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:21 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1168 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:21.526108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-568717a9-7182-4bfb-b5a5-a69a7b6088e6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:21.526897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-568717a9-7182-4bfb-b5a5-a69a7b6088e6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:21.534354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-568717a9-7182-4bfb-b5a5-a69a7b6088e6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:21.534980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-568717a9-7182-4bfb-b5a5-a69a7b6088e6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:21.535540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-568717a9-7182-4bfb-b5a5-a69a7b6088e6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:21.536443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-568717a9-7182-4bfb-b5a5-a69a7b6088e6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:21.537028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-568717a9-7182-4bfb-b5a5-a69a7b6088e6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:21.537597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-568717a9-7182-4bfb-b5a5-a69a7b6088e6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:21.632108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-568717a9-7182-4bfb-b5a5-a69a7b6088e6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:21.641611 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-568717a9-7182-4bfb-b5a5-a69a7b6088e6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1272 microversion: 2.1 time: 0.119199 Aug 29 15:33:21.655281 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1043/2102] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:21 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1272 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:21.660739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7dda6733-2e81-41eb-97d2-9e7441c5429d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:21.661623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7dda6733-2e81-41eb-97d2-9e7441c5429d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:21.668235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dda6733-2e81-41eb-97d2-9e7441c5429d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:21.669035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dda6733-2e81-41eb-97d2-9e7441c5429d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:21.669710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dda6733-2e81-41eb-97d2-9e7441c5429d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:21.670607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dda6733-2e81-41eb-97d2-9e7441c5429d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:21.671234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dda6733-2e81-41eb-97d2-9e7441c5429d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:21.671962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dda6733-2e81-41eb-97d2-9e7441c5429d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:21.807099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a1956edd-813e-4767-a46f-6742345ebc4c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:21.823993 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a1956edd-813e-4767-a46f-6742345ebc4c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.355044 Aug 29 15:33:21.842734 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1060/2103] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:21 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:21.854420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b56b7917-9b23-48cd-ac31-db9b9087d115 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:21.855469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b56b7917-9b23-48cd-ac31-db9b9087d115 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:21.865472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b56b7917-9b23-48cd-ac31-db9b9087d115 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:21.866386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b56b7917-9b23-48cd-ac31-db9b9087d115 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:21.867075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b56b7917-9b23-48cd-ac31-db9b9087d115 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:21.868164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b56b7917-9b23-48cd-ac31-db9b9087d115 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:21.868915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b56b7917-9b23-48cd-ac31-db9b9087d115 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:21.870303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b56b7917-9b23-48cd-ac31-db9b9087d115 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.099752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-7dda6733-2e81-41eb-97d2-9e7441c5429d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'services' on Instance uuid d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:33:22.104232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:22.134131 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7dda6733-2e81-41eb-97d2-9e7441c5429d tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1970 microversion: 2.25 time: 0.476992 Aug 29 15:33:22.134766 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1044/2104] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:21 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1970 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:22.158495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8ddb11de-eaf2-4b71-8584-adb4e5ec80d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:22.159156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8ddb11de-eaf2-4b71-8584-adb4e5ec80d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:22.161270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:22.175252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ddb11de-eaf2-4b71-8584-adb4e5ec80d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.175846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ddb11de-eaf2-4b71-8584-adb4e5ec80d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.176287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ddb11de-eaf2-4b71-8584-adb4e5ec80d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.177030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ddb11de-eaf2-4b71-8584-adb4e5ec80d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.177586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ddb11de-eaf2-4b71-8584-adb4e5ec80d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.177945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ddb11de-eaf2-4b71-8584-adb4e5ec80d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.298474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b56b7917-9b23-48cd-ac31-db9b9087d115 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:22.310637 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b56b7917-9b23-48cd-ac31-db9b9087d115 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1351 microversion: 2.1 time: 0.465460 Aug 29 15:33:22.312801 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1061/2105] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:21 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1351 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:22.319579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c96dbcb3-dcd4-4c8d-a97f-83c163923678 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:22.320661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c96dbcb3-dcd4-4c8d-a97f-83c163923678 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:22.329143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c96dbcb3-dcd4-4c8d-a97f-83c163923678 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.329813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c96dbcb3-dcd4-4c8d-a97f-83c163923678 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.330904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c96dbcb3-dcd4-4c8d-a97f-83c163923678 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.331932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c96dbcb3-dcd4-4c8d-a97f-83c163923678 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.332512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c96dbcb3-dcd4-4c8d-a97f-83c163923678 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.333064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c96dbcb3-dcd4-4c8d-a97f-83c163923678 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.625450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c96dbcb3-dcd4-4c8d-a97f-83c163923678 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:22.636941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-8ddb11de-eaf2-4b71-8584-adb4e5ec80d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'services' on Instance uuid d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:33:22.652924 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c96dbcb3-dcd4-4c8d-a97f-83c163923678 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.335601 Aug 29 15:33:22.654774 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1062/2106] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:22 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:22.667834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85c7c50e-6748-440f-ba3e-9d325a21770e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:22.668460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-85c7c50e-6748-440f-ba3e-9d325a21770e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:22.682011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85c7c50e-6748-440f-ba3e-9d325a21770e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.682677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85c7c50e-6748-440f-ba3e-9d325a21770e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.683131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85c7c50e-6748-440f-ba3e-9d325a21770e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.683872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85c7c50e-6748-440f-ba3e-9d325a21770e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.684332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85c7c50e-6748-440f-ba3e-9d325a21770e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.684755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85c7c50e-6748-440f-ba3e-9d325a21770e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.685588 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8ddb11de-eaf2-4b71-8584-adb4e5ec80d8 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1970 microversion: 2.25 time: 0.531669 Aug 29 15:33:22.686284 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1045/2107] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:22 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1970 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:22.691531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-05efdb08-cbd5-4715-b72b-99d63ab7e84d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:22.699745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-05efdb08-cbd5-4715-b72b-99d63ab7e84d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:22.706718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05efdb08-cbd5-4715-b72b-99d63ab7e84d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.707525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05efdb08-cbd5-4715-b72b-99d63ab7e84d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.709482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05efdb08-cbd5-4715-b72b-99d63ab7e84d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.710261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05efdb08-cbd5-4715-b72b-99d63ab7e84d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.710823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05efdb08-cbd5-4715-b72b-99d63ab7e84d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.711250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05efdb08-cbd5-4715-b72b-99d63ab7e84d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.858583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-05efdb08-cbd5-4715-b72b-99d63ab7e84d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:22.866957 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-05efdb08-cbd5-4715-b72b-99d63ab7e84d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1278 microversion: 2.1 time: 0.179388 Aug 29 15:33:22.868483 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1046/2108] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:22 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:22.873726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c4ac7cb7-0c06-4bd6-b894-b156bf88c924 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:22.878106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4ac7cb7-0c06-4bd6-b894-b156bf88c924 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.878817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4ac7cb7-0c06-4bd6-b894-b156bf88c924 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.887136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4ac7cb7-0c06-4bd6-b894-b156bf88c924 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.888259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4ac7cb7-0c06-4bd6-b894-b156bf88c924 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.888911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4ac7cb7-0c06-4bd6-b894-b156bf88c924 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.889558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4ac7cb7-0c06-4bd6-b894-b156bf88c924 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.918209 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c4ac7cb7-0c06-4bd6-b894-b156bf88c924 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.048350 Aug 29 15:33:22.919457 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1047/2109] 10.222.0.62 () {60 vars in 1217 bytes} [Mon Aug 29 15:33:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:33:22.924355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a5237c5d-7a46-44c9-a421-e9b15fc304d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:22.925196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a5237c5d-7a46-44c9-a421-e9b15fc304d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:22.931947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5237c5d-7a46-44c9-a421-e9b15fc304d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.932926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5237c5d-7a46-44c9-a421-e9b15fc304d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.933566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5237c5d-7a46-44c9-a421-e9b15fc304d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:22.934433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5237c5d-7a46-44c9-a421-e9b15fc304d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:22.935046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5237c5d-7a46-44c9-a421-e9b15fc304d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:22.935994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5237c5d-7a46-44c9-a421-e9b15fc304d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.161823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-85c7c50e-6748-440f-ba3e-9d325a21770e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:23.172159 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85c7c50e-6748-440f-ba3e-9d325a21770e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1210 microversion: 2.1 time: 0.516239 Aug 29 15:33:23.189334 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1063/2110] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:22 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1210 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:23.196091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c8d290a8-e301-4592-95b6-23a160b4a76a tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-839401-11", "block_migration": "auto"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:23.201922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c8d290a8-e301-4592-95b6-23a160b4a76a tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:23.219552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8d290a8-e301-4592-95b6-23a160b4a76a tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.222355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8d290a8-e301-4592-95b6-23a160b4a76a tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.224852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8d290a8-e301-4592-95b6-23a160b4a76a tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.225936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8d290a8-e301-4592-95b6-23a160b4a76a tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.226422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8d290a8-e301-4592-95b6-23a160b4a76a tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.226997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8d290a8-e301-4592-95b6-23a160b4a76a tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.283302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-c8d290a8-e301-4592-95b6-23a160b4a76a tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'flavor' on Instance uuid d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:33:23.308486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c8d290a8-e301-4592-95b6-23a160b4a76a tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Going to try to live migrate instance to n-h2-839401-11 {{(pid=122360) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:33:23.419999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a5237c5d-7a46-44c9-a421-e9b15fc304d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:23.433037 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a5237c5d-7a46-44c9-a421-e9b15fc304d7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.511258 Aug 29 15:33:23.436394 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1048/2111] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:22 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:23.447669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9733900f-ffd7-495d-905a-aa8b282b85c9 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:23.449314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9733900f-ffd7-495d-905a-aa8b282b85c9 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:23.463231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9733900f-ffd7-495d-905a-aa8b282b85c9 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.467420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9733900f-ffd7-495d-905a-aa8b282b85c9 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.467989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9733900f-ffd7-495d-905a-aa8b282b85c9 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.469794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9733900f-ffd7-495d-905a-aa8b282b85c9 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.471586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9733900f-ffd7-495d-905a-aa8b282b85c9 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.481456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9733900f-ffd7-495d-905a-aa8b282b85c9 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.822027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9733900f-ffd7-495d-905a-aa8b282b85c9 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:23.837579 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9733900f-ffd7-495d-905a-aa8b282b85c9 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1351 microversion: 2.1 time: 0.399516 Aug 29 15:33:23.838245 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1049/2112] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:23 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1351 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:23.856687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-857d2a84-f049-4586-b43b-80a071e1e73e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:23.861534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-857d2a84-f049-4586-b43b-80a071e1e73e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:23.877929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-857d2a84-f049-4586-b43b-80a071e1e73e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.878823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-857d2a84-f049-4586-b43b-80a071e1e73e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.879581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-857d2a84-f049-4586-b43b-80a071e1e73e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:23.880502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-857d2a84-f049-4586-b43b-80a071e1e73e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:23.881153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-857d2a84-f049-4586-b43b-80a071e1e73e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:23.881775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-857d2a84-f049-4586-b43b-80a071e1e73e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:24.598514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-857d2a84-f049-4586-b43b-80a071e1e73e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:24.612955 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-857d2a84-f049-4586-b43b-80a071e1e73e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.760145 Aug 29 15:33:24.613683 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1050/2113] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:23 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:24.623097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-28c43f5f-0861-4c9c-bc54-b163f33cbbf8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:24.624027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-28c43f5f-0861-4c9c-bc54-b163f33cbbf8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:24.645069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28c43f5f-0861-4c9c-bc54-b163f33cbbf8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:24.646765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28c43f5f-0861-4c9c-bc54-b163f33cbbf8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:24.648894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28c43f5f-0861-4c9c-bc54-b163f33cbbf8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:24.649894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28c43f5f-0861-4c9c-bc54-b163f33cbbf8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:24.651770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28c43f5f-0861-4c9c-bc54-b163f33cbbf8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:24.653660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28c43f5f-0861-4c9c-bc54-b163f33cbbf8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:25.095195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-28c43f5f-0861-4c9c-bc54-b163f33cbbf8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:25.118766 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-28c43f5f-0861-4c9c-bc54-b163f33cbbf8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1278 microversion: 2.1 time: 0.501764 Aug 29 15:33:25.121364 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1051/2114] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:24 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1278 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:25.135867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-4d77177f-3c3b-4873-9920-15589e808bb7 req-47cca46f-09ae-45fb-9d63-99f50b3270af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8", "tag": "7384f0e5-3cc6-41d9-b8ee-6ab5e6937bc9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:25.153212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4d77177f-3c3b-4873-9920-15589e808bb7 req-47cca46f-09ae-45fb-9d63-99f50b3270af service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:25.153749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4d77177f-3c3b-4873-9920-15589e808bb7 req-47cca46f-09ae-45fb-9d63-99f50b3270af service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:25.154309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4d77177f-3c3b-4873-9920-15589e808bb7 req-47cca46f-09ae-45fb-9d63-99f50b3270af service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:25.169144 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-4d77177f-3c3b-4873-9920-15589e808bb7 req-47cca46f-09ae-45fb-9d63-99f50b3270af service nova] Creating event network-changed:7384f0e5-3cc6-41d9-b8ee-6ab5e6937bc9 for instance 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 on n-h1-839401-11 Aug 29 15:33:25.175298 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-4d77177f-3c3b-4873-9920-15589e808bb7 req-47cca46f-09ae-45fb-9d63-99f50b3270af service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052598 Aug 29 15:33:25.177230 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1052/2115] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:25.183759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b993bcf0-5aa5-4461-90d4-bd8c537e1a31 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:25.189941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b993bcf0-5aa5-4461-90d4-bd8c537e1a31 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:25.190907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b993bcf0-5aa5-4461-90d4-bd8c537e1a31 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Searching by: {'deleted': False, 'project_id': '03b8d7e70d3244c2ac9866de54967460'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:33:25.200201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b993bcf0-5aa5-4461-90d4-bd8c537e1a31 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:25.201000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b993bcf0-5aa5-4461-90d4-bd8c537e1a31 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:25.201932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b993bcf0-5aa5-4461-90d4-bd8c537e1a31 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:25.202906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b993bcf0-5aa5-4461-90d4-bd8c537e1a31 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:25.203534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b993bcf0-5aa5-4461-90d4-bd8c537e1a31 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:25.204284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b993bcf0-5aa5-4461-90d4-bd8c537e1a31 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:25.237957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-b993bcf0-5aa5-4461-90d4-bd8c537e1a31 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:33:25.276501 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b993bcf0-5aa5-4461-90d4-bd8c537e1a31 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.097325 Aug 29 15:33:25.277807 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1053/2116] 10.222.0.62 () {58 vars in 1125 bytes} [Mon Aug 29 15:33:25 2022] GET /compute/v2.1/servers => generated 343 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:25.283826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-c589eecd-1cff-41c3-8c55-9af8db66fb28 req-d67b9e8b-3d21-440f-a53d-71aabbec2153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6135fb3a-980d-4e8a-ad76-4908f4f53a0a", "name": "network-vif-plugged", "status": "completed", "tag": "c70a93be-38b6-4ac7-89fb-2c06e79c39b9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:25.294643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c589eecd-1cff-41c3-8c55-9af8db66fb28 req-d67b9e8b-3d21-440f-a53d-71aabbec2153 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:25.295379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c589eecd-1cff-41c3-8c55-9af8db66fb28 req-d67b9e8b-3d21-440f-a53d-71aabbec2153 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:25.296024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c589eecd-1cff-41c3-8c55-9af8db66fb28 req-d67b9e8b-3d21-440f-a53d-71aabbec2153 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:25.314926 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-c589eecd-1cff-41c3-8c55-9af8db66fb28 req-d67b9e8b-3d21-440f-a53d-71aabbec2153 service nova] Creating event network-vif-plugged:c70a93be-38b6-4ac7-89fb-2c06e79c39b9 for instance 6135fb3a-980d-4e8a-ad76-4908f4f53a0a on n-h2-839401-11 Aug 29 15:33:25.321275 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-c589eecd-1cff-41c3-8c55-9af8db66fb28 req-d67b9e8b-3d21-440f-a53d-71aabbec2153 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041816 Aug 29 15:33:25.322612 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1054/2117] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:25.329770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-37f29399-3bd8-45e0-ae8d-0ad73ac978e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:25.330759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-37f29399-3bd8-45e0-ae8d-0ad73ac978e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:25.338030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37f29399-3bd8-45e0-ae8d-0ad73ac978e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:25.338759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37f29399-3bd8-45e0-ae8d-0ad73ac978e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:25.339358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37f29399-3bd8-45e0-ae8d-0ad73ac978e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:25.340262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37f29399-3bd8-45e0-ae8d-0ad73ac978e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:25.340879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37f29399-3bd8-45e0-ae8d-0ad73ac978e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:25.341498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37f29399-3bd8-45e0-ae8d-0ad73ac978e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:25.876647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-37f29399-3bd8-45e0-ae8d-0ad73ac978e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:25.885756 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-37f29399-3bd8-45e0-ae8d-0ad73ac978e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1210 microversion: 2.1 time: 0.561612 Aug 29 15:33:25.886446 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1055/2118] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:25 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1210 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:25.891326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e32af161-2597-4bbd-9617-fe63999f219a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:25.892120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e32af161-2597-4bbd-9617-fe63999f219a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:25.903524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e32af161-2597-4bbd-9617-fe63999f219a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:25.904529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e32af161-2597-4bbd-9617-fe63999f219a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:25.906096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e32af161-2597-4bbd-9617-fe63999f219a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:25.907065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e32af161-2597-4bbd-9617-fe63999f219a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:25.907743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e32af161-2597-4bbd-9617-fe63999f219a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:25.908833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e32af161-2597-4bbd-9617-fe63999f219a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:26.335870 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c8d290a8-e301-4592-95b6-23a160b4a76a tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc/action" status: 202 len: 0 microversion: 2.25 time: 3.143282 Aug 29 15:33:26.336670 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1064/2119] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 15:33:23 2022] POST /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc/action => generated 0 bytes in 3147 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:33:26.343363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f29bd175-182e-4329-aab7-8e58ce4c2ae3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:26.344707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f29bd175-182e-4329-aab7-8e58ce4c2ae3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:26.354042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f29bd175-182e-4329-aab7-8e58ce4c2ae3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:26.354508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f29bd175-182e-4329-aab7-8e58ce4c2ae3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:26.363599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f29bd175-182e-4329-aab7-8e58ce4c2ae3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:26.368737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f29bd175-182e-4329-aab7-8e58ce4c2ae3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:26.369401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f29bd175-182e-4329-aab7-8e58ce4c2ae3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:26.369959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f29bd175-182e-4329-aab7-8e58ce4c2ae3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:26.444147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e32af161-2597-4bbd-9617-fe63999f219a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:26.452865 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e32af161-2597-4bbd-9617-fe63999f219a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.565053 Aug 29 15:33:26.466909 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1056/2120] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:25 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:26.466909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3d2a7423-224f-41d9-9431-3697cffa4214 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:26.469917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3d2a7423-224f-41d9-9431-3697cffa4214 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:26.470818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3d2a7423-224f-41d9-9431-3697cffa4214 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Searching by: {'deleted': False, 'project_id': '03b8d7e70d3244c2ac9866de54967460'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:33:26.478662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d2a7423-224f-41d9-9431-3697cffa4214 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:26.479173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d2a7423-224f-41d9-9431-3697cffa4214 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:26.479626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d2a7423-224f-41d9-9431-3697cffa4214 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:26.480413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d2a7423-224f-41d9-9431-3697cffa4214 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:26.480874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d2a7423-224f-41d9-9431-3697cffa4214 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:26.481337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d2a7423-224f-41d9-9431-3697cffa4214 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:26.595711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f29bd175-182e-4329-aab7-8e58ce4c2ae3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:26.597541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-3d2a7423-224f-41d9-9431-3697cffa4214 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:33:26.604787 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f29bd175-182e-4329-aab7-8e58ce4c2ae3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1351 microversion: 2.1 time: 0.266742 Aug 29 15:33:26.606289 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1065/2121] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:26 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1351 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:26.612036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9b6716cb-5e7b-43c3-bb48-6f90c2b75ba7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:26.613284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9b6716cb-5e7b-43c3-bb48-6f90c2b75ba7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:26.620980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b6716cb-5e7b-43c3-bb48-6f90c2b75ba7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:26.621702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b6716cb-5e7b-43c3-bb48-6f90c2b75ba7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:26.622267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b6716cb-5e7b-43c3-bb48-6f90c2b75ba7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:26.623717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b6716cb-5e7b-43c3-bb48-6f90c2b75ba7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:26.624787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b6716cb-5e7b-43c3-bb48-6f90c2b75ba7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:26.625746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b6716cb-5e7b-43c3-bb48-6f90c2b75ba7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:26.680332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3d2a7423-224f-41d9-9431-3697cffa4214 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:26.695173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d2a7423-224f-41d9-9431-3697cffa4214 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:26.695947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d2a7423-224f-41d9-9431-3697cffa4214 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:26.696585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d2a7423-224f-41d9-9431-3697cffa4214 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:26.785026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9b6716cb-5e7b-43c3-bb48-6f90c2b75ba7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:26.793972 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9b6716cb-5e7b-43c3-bb48-6f90c2b75ba7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.186145 Aug 29 15:33:26.794911 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1066/2122] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:26 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:26.800412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-25e8ff0a-d584-4d02-bdee-f2bc09a8401d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:26.801354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-25e8ff0a-d584-4d02-bdee-f2bc09a8401d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:26.807804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25e8ff0a-d584-4d02-bdee-f2bc09a8401d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:26.809447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25e8ff0a-d584-4d02-bdee-f2bc09a8401d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:26.810053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25e8ff0a-d584-4d02-bdee-f2bc09a8401d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:26.810861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25e8ff0a-d584-4d02-bdee-f2bc09a8401d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:26.811427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25e8ff0a-d584-4d02-bdee-f2bc09a8401d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:26.811944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25e8ff0a-d584-4d02-bdee-f2bc09a8401d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:26.963768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-25e8ff0a-d584-4d02-bdee-f2bc09a8401d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:26.973674 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-25e8ff0a-d584-4d02-bdee-f2bc09a8401d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.176256 Aug 29 15:33:26.974930 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1067/2123] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:26 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:26.979908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2c999a5c-89eb-4f20-b312-4edbf5d21b37 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:26.980795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2c999a5c-89eb-4f20-b312-4edbf5d21b37 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:26.991681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c999a5c-89eb-4f20-b312-4edbf5d21b37 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:26.992169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c999a5c-89eb-4f20-b312-4edbf5d21b37 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:26.992656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c999a5c-89eb-4f20-b312-4edbf5d21b37 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:26.993477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c999a5c-89eb-4f20-b312-4edbf5d21b37 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:26.993937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c999a5c-89eb-4f20-b312-4edbf5d21b37 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:26.994755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c999a5c-89eb-4f20-b312-4edbf5d21b37 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:27.045338 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3d2a7423-224f-41d9-9431-3697cffa4214 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.590723 Aug 29 15:33:27.045960 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1057/2124] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:33:26 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:27.067042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c542a98d-6614-4e06-b233-dd7791b53ea2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:27.067675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c542a98d-6614-4e06-b233-dd7791b53ea2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:27.084718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c542a98d-6614-4e06-b233-dd7791b53ea2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:27.085249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c542a98d-6614-4e06-b233-dd7791b53ea2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:27.085684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c542a98d-6614-4e06-b233-dd7791b53ea2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:27.086619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c542a98d-6614-4e06-b233-dd7791b53ea2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:27.087241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c542a98d-6614-4e06-b233-dd7791b53ea2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:27.087830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c542a98d-6614-4e06-b233-dd7791b53ea2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:27.160468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2c999a5c-89eb-4f20-b312-4edbf5d21b37 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:27.172159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2c999a5c-89eb-4f20-b312-4edbf5d21b37 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:27.174957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2c999a5c-89eb-4f20-b312-4edbf5d21b37 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:27.176267 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2c999a5c-89eb-4f20-b312-4edbf5d21b37 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.200208 Aug 29 15:33:27.177139 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1068/2125] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:26 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:27.183639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-8da7b920-515a-408a-bcfd-84d2f22feeda req-1a07b3dd-5ab3-4ad5-94b2-c6f9d3204902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0e77d46-8629-4bc8-b216-6cdc3e8f0543", "tag": "61f6ec7a-d0af-4057-9f18-4aa7a116a44b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:27.193942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8da7b920-515a-408a-bcfd-84d2f22feeda req-1a07b3dd-5ab3-4ad5-94b2-c6f9d3204902 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:27.195245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8da7b920-515a-408a-bcfd-84d2f22feeda req-1a07b3dd-5ab3-4ad5-94b2-c6f9d3204902 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:27.198928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8da7b920-515a-408a-bcfd-84d2f22feeda req-1a07b3dd-5ab3-4ad5-94b2-c6f9d3204902 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:27.216011 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-8da7b920-515a-408a-bcfd-84d2f22feeda req-1a07b3dd-5ab3-4ad5-94b2-c6f9d3204902 service nova] Creating event network-changed:61f6ec7a-d0af-4057-9f18-4aa7a116a44b for instance f0e77d46-8629-4bc8-b216-6cdc3e8f0543 on n-h2-839401-11 Aug 29 15:33:27.223965 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-8da7b920-515a-408a-bcfd-84d2f22feeda req-1a07b3dd-5ab3-4ad5-94b2-c6f9d3204902 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045726 Aug 29 15:33:27.225691 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1069/2126] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:27.231187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b81b7ebe-7a9e-40d5-a29a-356ac8161e0f tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:27.242513 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b81b7ebe-7a9e-40d5-a29a-356ac8161e0f tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015552 Aug 29 15:33:27.243396 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1070/2127] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:33:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:27.475555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-db570cb2-a9e0-4dca-ac75-a98f7b10de99 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:27.477015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-db570cb2-a9e0-4dca-ac75-a98f7b10de99 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:27.485011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db570cb2-a9e0-4dca-ac75-a98f7b10de99 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:27.485640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db570cb2-a9e0-4dca-ac75-a98f7b10de99 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:27.486436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db570cb2-a9e0-4dca-ac75-a98f7b10de99 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:27.487989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db570cb2-a9e0-4dca-ac75-a98f7b10de99 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:27.488582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db570cb2-a9e0-4dca-ac75-a98f7b10de99 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:27.489025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db570cb2-a9e0-4dca-ac75-a98f7b10de99 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:27.512730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:27.586985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c542a98d-6614-4e06-b233-dd7791b53ea2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:27.599870 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c542a98d-6614-4e06-b233-dd7791b53ea2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1210 microversion: 2.1 time: 0.540825 Aug 29 15:33:27.643728 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1058/2128] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:27 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1210 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:27.655317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ebd73b11-9313-412f-af1e-0ddbf82595a3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:27.657846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ebd73b11-9313-412f-af1e-0ddbf82595a3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:27.668391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebd73b11-9313-412f-af1e-0ddbf82595a3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:27.669689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebd73b11-9313-412f-af1e-0ddbf82595a3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:27.670385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebd73b11-9313-412f-af1e-0ddbf82595a3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:27.672059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebd73b11-9313-412f-af1e-0ddbf82595a3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:27.672743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebd73b11-9313-412f-af1e-0ddbf82595a3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:27.673249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebd73b11-9313-412f-af1e-0ddbf82595a3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:27.691355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-db570cb2-a9e0-4dca-ac75-a98f7b10de99 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:27.701926 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-db570cb2-a9e0-4dca-ac75-a98f7b10de99 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.231624 Aug 29 15:33:27.703309 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1071/2129] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:27 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:27.708289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e59119b0-7502-4784-9050-fccca5296e5f tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:27.709152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e59119b0-7502-4784-9050-fccca5296e5f tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:27.716203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e59119b0-7502-4784-9050-fccca5296e5f tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:27.717005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e59119b0-7502-4784-9050-fccca5296e5f tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:27.717594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e59119b0-7502-4784-9050-fccca5296e5f tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:27.718191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e59119b0-7502-4784-9050-fccca5296e5f tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:27.718647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e59119b0-7502-4784-9050-fccca5296e5f tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:27.719182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e59119b0-7502-4784-9050-fccca5296e5f tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:27.752838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e59119b0-7502-4784-9050-fccca5296e5f tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:33:27.771792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:27.861340 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e59119b0-7502-4784-9050-fccca5296e5f tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 204 len: 0 microversion: 2.1 time: 0.156442 Aug 29 15:33:27.862639 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1072/2130] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:33:27 2022] DELETE /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:33:27.870963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-74ca7141-38f8-43c1-96c4-dd00a74d7a53 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:27.871650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-74ca7141-38f8-43c1-96c4-dd00a74d7a53 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:27.888001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74ca7141-38f8-43c1-96c4-dd00a74d7a53 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:27.888559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74ca7141-38f8-43c1-96c4-dd00a74d7a53 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:27.890306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74ca7141-38f8-43c1-96c4-dd00a74d7a53 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:27.891443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74ca7141-38f8-43c1-96c4-dd00a74d7a53 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:27.892087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74ca7141-38f8-43c1-96c4-dd00a74d7a53 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:27.893022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74ca7141-38f8-43c1-96c4-dd00a74d7a53 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:28.050771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-74ca7141-38f8-43c1-96c4-dd00a74d7a53 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:28.059036 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-74ca7141-38f8-43c1-96c4-dd00a74d7a53 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.194857 Aug 29 15:33:28.059771 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1073/2131] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:27 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:28.068219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7e8eb88b-6c47-47d1-ba30-f5bfa599cb48 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:28.068952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7e8eb88b-6c47-47d1-ba30-f5bfa599cb48 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:28.075924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e8eb88b-6c47-47d1-ba30-f5bfa599cb48 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:28.076487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e8eb88b-6c47-47d1-ba30-f5bfa599cb48 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:28.077012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e8eb88b-6c47-47d1-ba30-f5bfa599cb48 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:28.077757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e8eb88b-6c47-47d1-ba30-f5bfa599cb48 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:28.078384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e8eb88b-6c47-47d1-ba30-f5bfa599cb48 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:28.078808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e8eb88b-6c47-47d1-ba30-f5bfa599cb48 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:28.112631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ebd73b11-9313-412f-af1e-0ddbf82595a3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:28.121353 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ebd73b11-9313-412f-af1e-0ddbf82595a3 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1351 microversion: 2.1 time: 0.475744 Aug 29 15:33:28.129701 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1059/2132] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:27 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1351 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:28.136821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8939e4b5-ecb4-447d-a171-a73490ee897f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:28.137588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8939e4b5-ecb4-447d-a171-a73490ee897f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:28.144560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8939e4b5-ecb4-447d-a171-a73490ee897f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:28.145065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8939e4b5-ecb4-447d-a171-a73490ee897f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:28.145819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8939e4b5-ecb4-447d-a171-a73490ee897f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:28.146783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8939e4b5-ecb4-447d-a171-a73490ee897f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:28.147236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8939e4b5-ecb4-447d-a171-a73490ee897f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:28.147656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8939e4b5-ecb4-447d-a171-a73490ee897f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:28.149699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=22 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:28.223915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7e8eb88b-6c47-47d1-ba30-f5bfa599cb48 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:28.233342 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7e8eb88b-6c47-47d1-ba30-f5bfa599cb48 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1609 microversion: 2.1 time: 0.169052 Aug 29 15:33:28.233950 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1074/2133] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:28 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1609 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:28.248345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d4b0f96b-31a0-455d-834c-4204e87cd311 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:28.249122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d4b0f96b-31a0-455d-834c-4204e87cd311 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:28.255371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4b0f96b-31a0-455d-834c-4204e87cd311 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:28.255855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4b0f96b-31a0-455d-834c-4204e87cd311 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:28.256291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4b0f96b-31a0-455d-834c-4204e87cd311 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:28.256986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4b0f96b-31a0-455d-834c-4204e87cd311 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:28.257472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4b0f96b-31a0-455d-834c-4204e87cd311 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:28.257900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4b0f96b-31a0-455d-834c-4204e87cd311 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:28.283390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8939e4b5-ecb4-447d-a171-a73490ee897f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:28.291438 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8939e4b5-ecb4-447d-a171-a73490ee897f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.160101 Aug 29 15:33:28.292026 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1060/2134] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:28 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:28.394437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d4b0f96b-31a0-455d-834c-4204e87cd311 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:28.403340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d4b0f96b-31a0-455d-834c-4204e87cd311 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:28.404795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d4b0f96b-31a0-455d-834c-4204e87cd311 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:28.406360 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d4b0f96b-31a0-455d-834c-4204e87cd311 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.161999 Aug 29 15:33:28.406936 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1075/2135] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:28 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:28.653140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9211871c-8901-4e61-a7c4-9267bd5fc390 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:28.654027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9211871c-8901-4e61-a7c4-9267bd5fc390 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:28.665915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9211871c-8901-4e61-a7c4-9267bd5fc390 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:28.666727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9211871c-8901-4e61-a7c4-9267bd5fc390 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:28.667434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9211871c-8901-4e61-a7c4-9267bd5fc390 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:28.668639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9211871c-8901-4e61-a7c4-9267bd5fc390 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:28.669458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9211871c-8901-4e61-a7c4-9267bd5fc390 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:28.670161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9211871c-8901-4e61-a7c4-9267bd5fc390 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:28.728376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1335898f-93f8-43b1-bc62-28cbdc5570e6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:28.729019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1335898f-93f8-43b1-bc62-28cbdc5570e6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:28.736413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1335898f-93f8-43b1-bc62-28cbdc5570e6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:28.736937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1335898f-93f8-43b1-bc62-28cbdc5570e6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:28.737405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1335898f-93f8-43b1-bc62-28cbdc5570e6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:28.738141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1335898f-93f8-43b1-bc62-28cbdc5570e6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:28.738579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1335898f-93f8-43b1-bc62-28cbdc5570e6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:28.739009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1335898f-93f8-43b1-bc62-28cbdc5570e6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:28.812162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9211871c-8901-4e61-a7c4-9267bd5fc390 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:28.820502 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9211871c-8901-4e61-a7c4-9267bd5fc390 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1198 microversion: 2.1 time: 0.174210 Aug 29 15:33:28.821116 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1061/2136] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:28 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1198 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:28.874615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1335898f-93f8-43b1-bc62-28cbdc5570e6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:28.883220 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1335898f-93f8-43b1-bc62-28cbdc5570e6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.159096 Aug 29 15:33:28.883813 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1076/2137] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:28 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:29.084537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d763eef1-9552-493c-b6b9-0955c5f19234 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:29.085448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d763eef1-9552-493c-b6b9-0955c5f19234 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:29.091870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d763eef1-9552-493c-b6b9-0955c5f19234 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.092376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d763eef1-9552-493c-b6b9-0955c5f19234 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.092817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d763eef1-9552-493c-b6b9-0955c5f19234 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.093556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d763eef1-9552-493c-b6b9-0955c5f19234 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.094053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d763eef1-9552-493c-b6b9-0955c5f19234 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.094596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d763eef1-9552-493c-b6b9-0955c5f19234 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.097573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:29.141679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-37ad149c-4bd4-452d-a374-effe8706cd30 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:29.142298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-37ad149c-4bd4-452d-a374-effe8706cd30 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:29.148974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37ad149c-4bd4-452d-a374-effe8706cd30 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.149558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37ad149c-4bd4-452d-a374-effe8706cd30 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.150012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37ad149c-4bd4-452d-a374-effe8706cd30 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.150721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37ad149c-4bd4-452d-a374-effe8706cd30 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.151227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37ad149c-4bd4-452d-a374-effe8706cd30 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.151639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37ad149c-4bd4-452d-a374-effe8706cd30 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.231020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d763eef1-9552-493c-b6b9-0955c5f19234 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:29.239531 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d763eef1-9552-493c-b6b9-0955c5f19234 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.159762 Aug 29 15:33:29.240261 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1062/2138] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:29 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:29.250175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-e6c52294-9038-4e80-94ba-c6ac743e2d10 req-fe3499cd-98fc-4b87-aed6-b34d14da9669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d624c852-fdae-4a2b-bd07-3d751e56c170", "tag": "803fd968-9041-42a9-a133-91672dd13b1a"}, {"name": "network-changed", "server_uuid": "a2add301-a12d-453d-89dd-12fe794e589c", "tag": "7dee5476-02f7-423b-895e-8e40ac13a042"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:29.260736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e6c52294-9038-4e80-94ba-c6ac743e2d10 req-fe3499cd-98fc-4b87-aed6-b34d14da9669 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.261264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e6c52294-9038-4e80-94ba-c6ac743e2d10 req-fe3499cd-98fc-4b87-aed6-b34d14da9669 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.261708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e6c52294-9038-4e80-94ba-c6ac743e2d10 req-fe3499cd-98fc-4b87-aed6-b34d14da9669 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.275984 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-e6c52294-9038-4e80-94ba-c6ac743e2d10 req-fe3499cd-98fc-4b87-aed6-b34d14da9669 service nova] Creating event network-changed:803fd968-9041-42a9-a133-91672dd13b1a for instance d624c852-fdae-4a2b-bd07-3d751e56c170 on n-h1-839401-11 Aug 29 15:33:29.276494 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-e6c52294-9038-4e80-94ba-c6ac743e2d10 req-fe3499cd-98fc-4b87-aed6-b34d14da9669 service nova] Creating event network-changed:7dee5476-02f7-423b-895e-8e40ac13a042 for instance a2add301-a12d-453d-89dd-12fe794e589c on n-h2-839401-11 Aug 29 15:33:29.284878 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-e6c52294-9038-4e80-94ba-c6ac743e2d10 req-fe3499cd-98fc-4b87-aed6-b34d14da9669 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038262 Aug 29 15:33:29.285882 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1063/2139] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:29.289484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-37ad149c-4bd4-452d-a374-effe8706cd30 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:29.290833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fa91f7e6-ecd9-4a12-98cf-91696da048d1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:29.291561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fa91f7e6-ecd9-4a12-98cf-91696da048d1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:29.297712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa91f7e6-ecd9-4a12-98cf-91696da048d1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.297912 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-37ad149c-4bd4-452d-a374-effe8706cd30 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1540 microversion: 2.1 time: 0.159995 Aug 29 15:33:29.298189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa91f7e6-ecd9-4a12-98cf-91696da048d1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.298357 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1077/2140] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:29 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1540 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:29.298605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa91f7e6-ecd9-4a12-98cf-91696da048d1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.299368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa91f7e6-ecd9-4a12-98cf-91696da048d1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.299827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa91f7e6-ecd9-4a12-98cf-91696da048d1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.300258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa91f7e6-ecd9-4a12-98cf-91696da048d1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.311602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6e9a7fb6-66ff-42b4-83d7-080248728de9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:29.312233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6e9a7fb6-66ff-42b4-83d7-080248728de9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:29.318477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9a7fb6-66ff-42b4-83d7-080248728de9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.318985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9a7fb6-66ff-42b4-83d7-080248728de9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.319433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9a7fb6-66ff-42b4-83d7-080248728de9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.320160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9a7fb6-66ff-42b4-83d7-080248728de9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.320610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9a7fb6-66ff-42b4-83d7-080248728de9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.321058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9a7fb6-66ff-42b4-83d7-080248728de9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.451919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fa91f7e6-ecd9-4a12-98cf-91696da048d1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:29.462710 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fa91f7e6-ecd9-4a12-98cf-91696da048d1 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1609 microversion: 2.1 time: 0.175702 Aug 29 15:33:29.463353 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1064/2141] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:29 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1609 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:29.471352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6e9a7fb6-66ff-42b4-83d7-080248728de9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:29.473346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5e4ba97e-1262-4c6d-8e10-4f35eae04c25 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:29.474417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5e4ba97e-1262-4c6d-8e10-4f35eae04c25 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:29.484891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e4ba97e-1262-4c6d-8e10-4f35eae04c25 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.485993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e4ba97e-1262-4c6d-8e10-4f35eae04c25 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.487077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e4ba97e-1262-4c6d-8e10-4f35eae04c25 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.487758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e4ba97e-1262-4c6d-8e10-4f35eae04c25 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.487880 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6e9a7fb6-66ff-42b4-83d7-080248728de9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.179925 Aug 29 15:33:29.488225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e4ba97e-1262-4c6d-8e10-4f35eae04c25 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.488471 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1078/2142] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:29 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:29.488665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e4ba97e-1262-4c6d-8e10-4f35eae04c25 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.493713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-76ba3011-c8af-4157-909c-21b2957cf1a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:29.494570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-76ba3011-c8af-4157-909c-21b2957cf1a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:29.500910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76ba3011-c8af-4157-909c-21b2957cf1a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.501445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76ba3011-c8af-4157-909c-21b2957cf1a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.501889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76ba3011-c8af-4157-909c-21b2957cf1a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.502700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76ba3011-c8af-4157-909c-21b2957cf1a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.503165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76ba3011-c8af-4157-909c-21b2957cf1a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.503595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76ba3011-c8af-4157-909c-21b2957cf1a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.642410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-76ba3011-c8af-4157-909c-21b2957cf1a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:29.651417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-76ba3011-c8af-4157-909c-21b2957cf1a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:29.652865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-76ba3011-c8af-4157-909c-21b2957cf1a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:29.654094 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-76ba3011-c8af-4157-909c-21b2957cf1a2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.164674 Aug 29 15:33:29.654671 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1079/2143] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:29 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:29.842484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85ffacd8-cd47-4fa8-8d4e-1d0dfe9d3d16 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:29.843124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-85ffacd8-cd47-4fa8-8d4e-1d0dfe9d3d16 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:29.851247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85ffacd8-cd47-4fa8-8d4e-1d0dfe9d3d16 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.851846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85ffacd8-cd47-4fa8-8d4e-1d0dfe9d3d16 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.852338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85ffacd8-cd47-4fa8-8d4e-1d0dfe9d3d16 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.853378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85ffacd8-cd47-4fa8-8d4e-1d0dfe9d3d16 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:29.854065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85ffacd8-cd47-4fa8-8d4e-1d0dfe9d3d16 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:29.854503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85ffacd8-cd47-4fa8-8d4e-1d0dfe9d3d16 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:29.994295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-85ffacd8-cd47-4fa8-8d4e-1d0dfe9d3d16 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:30.002617 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85ffacd8-cd47-4fa8-8d4e-1d0dfe9d3d16 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1198 microversion: 2.1 time: 0.164420 Aug 29 15:33:30.003244 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1080/2144] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:29 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1198 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:30.008079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5b384515-15b4-4f45-9e50-8d7bcd9b48b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:30.008912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5b384515-15b4-4f45-9e50-8d7bcd9b48b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:30.015239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b384515-15b4-4f45-9e50-8d7bcd9b48b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:30.015747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b384515-15b4-4f45-9e50-8d7bcd9b48b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:30.016283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b384515-15b4-4f45-9e50-8d7bcd9b48b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:30.017016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b384515-15b4-4f45-9e50-8d7bcd9b48b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:30.017512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b384515-15b4-4f45-9e50-8d7bcd9b48b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:30.017938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b384515-15b4-4f45-9e50-8d7bcd9b48b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:30.021349 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5e4ba97e-1262-4c6d-8e10-4f35eae04c25 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.554861 Aug 29 15:33:30.023305 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1065/2145] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:33:29 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a/os-interface => generated 284 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:30.260460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d0813cb6-747c-492f-a4d8-3b6f63c0bc36 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:30.261108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d0813cb6-747c-492f-a4d8-3b6f63c0bc36 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:30.269761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0813cb6-747c-492f-a4d8-3b6f63c0bc36 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:30.269761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0813cb6-747c-492f-a4d8-3b6f63c0bc36 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:30.270104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0813cb6-747c-492f-a4d8-3b6f63c0bc36 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:30.270752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0813cb6-747c-492f-a4d8-3b6f63c0bc36 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:30.271210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0813cb6-747c-492f-a4d8-3b6f63c0bc36 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:30.271656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0813cb6-747c-492f-a4d8-3b6f63c0bc36 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:30.317930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5b384515-15b4-4f45-9e50-8d7bcd9b48b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:30.326282 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5b384515-15b4-4f45-9e50-8d7bcd9b48b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.321930 Aug 29 15:33:30.336453 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1081/2146] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:30 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:30.490807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f320e25c-85f7-4a25-a0e5-38734ba7a238 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:30.491624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f320e25c-85f7-4a25-a0e5-38734ba7a238 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:30.500271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f320e25c-85f7-4a25-a0e5-38734ba7a238 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:30.500770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f320e25c-85f7-4a25-a0e5-38734ba7a238 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:30.501467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f320e25c-85f7-4a25-a0e5-38734ba7a238 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:30.502199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f320e25c-85f7-4a25-a0e5-38734ba7a238 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:30.502756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f320e25c-85f7-4a25-a0e5-38734ba7a238 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:30.505304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f320e25c-85f7-4a25-a0e5-38734ba7a238 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:30.793900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d0813cb6-747c-492f-a4d8-3b6f63c0bc36 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:30.802325 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d0813cb6-747c-492f-a4d8-3b6f63c0bc36 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.546188 Aug 29 15:33:30.802889 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1066/2147] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:30 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:30.818372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1d83d992-4b02-4fe2-aefe-934e827ebbf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:30.819243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1d83d992-4b02-4fe2-aefe-934e827ebbf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:30.825980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d83d992-4b02-4fe2-aefe-934e827ebbf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:30.827245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d83d992-4b02-4fe2-aefe-934e827ebbf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:30.828139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d83d992-4b02-4fe2-aefe-934e827ebbf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:30.829041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d83d992-4b02-4fe2-aefe-934e827ebbf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:30.829685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d83d992-4b02-4fe2-aefe-934e827ebbf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:30.830271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d83d992-4b02-4fe2-aefe-934e827ebbf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:30.961007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f320e25c-85f7-4a25-a0e5-38734ba7a238 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:30.970881 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f320e25c-85f7-4a25-a0e5-38734ba7a238 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1609 microversion: 2.1 time: 0.484228 Aug 29 15:33:30.971919 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1082/2148] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:30 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1609 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:30.977010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-652a3617-f566-4be8-9026-67d601d85175 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:30.977938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-652a3617-f566-4be8-9026-67d601d85175 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:30.984730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-652a3617-f566-4be8-9026-67d601d85175 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:30.985653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-652a3617-f566-4be8-9026-67d601d85175 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:30.986314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-652a3617-f566-4be8-9026-67d601d85175 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:30.987418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-652a3617-f566-4be8-9026-67d601d85175 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:30.988134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-652a3617-f566-4be8-9026-67d601d85175 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:30.988759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-652a3617-f566-4be8-9026-67d601d85175 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:31.250401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-652a3617-f566-4be8-9026-67d601d85175 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:31.261993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-652a3617-f566-4be8-9026-67d601d85175 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:31.263661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-652a3617-f566-4be8-9026-67d601d85175 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:31.265158 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-652a3617-f566-4be8-9026-67d601d85175 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.291867 Aug 29 15:33:31.275629 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1083/2149] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:30 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:31.275629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4e94b822-e072-4166-8e5c-b6d202d0e37e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:31.275629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4e94b822-e072-4166-8e5c-b6d202d0e37e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:31.282958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e94b822-e072-4166-8e5c-b6d202d0e37e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:31.282958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e94b822-e072-4166-8e5c-b6d202d0e37e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:31.282958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e94b822-e072-4166-8e5c-b6d202d0e37e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:31.282958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e94b822-e072-4166-8e5c-b6d202d0e37e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:31.282958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e94b822-e072-4166-8e5c-b6d202d0e37e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:31.282958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e94b822-e072-4166-8e5c-b6d202d0e37e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:31.303833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1d83d992-4b02-4fe2-aefe-934e827ebbf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:31.316341 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1d83d992-4b02-4fe2-aefe-934e827ebbf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.506101 Aug 29 15:33:31.316968 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1067/2150] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:30 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:31.348125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-18a9e699-3b10-4b01-95b0-7c548d10a42d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:31.348733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-18a9e699-3b10-4b01-95b0-7c548d10a42d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:31.355182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18a9e699-3b10-4b01-95b0-7c548d10a42d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:31.355747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18a9e699-3b10-4b01-95b0-7c548d10a42d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:31.356230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18a9e699-3b10-4b01-95b0-7c548d10a42d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:31.356999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18a9e699-3b10-4b01-95b0-7c548d10a42d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:31.357483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18a9e699-3b10-4b01-95b0-7c548d10a42d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:31.358138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18a9e699-3b10-4b01-95b0-7c548d10a42d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:31.510302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4e94b822-e072-4166-8e5c-b6d202d0e37e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:31.528223 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4e94b822-e072-4166-8e5c-b6d202d0e37e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1198 microversion: 2.1 time: 0.261108 Aug 29 15:33:31.529105 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1084/2151] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:31 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1198 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:31.595508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-18a9e699-3b10-4b01-95b0-7c548d10a42d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:31.604920 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-18a9e699-3b10-4b01-95b0-7c548d10a42d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.260796 Aug 29 15:33:31.605925 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1068/2152] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:31 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:31.669914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-ea0c28cd-efe5-443a-9d3c-23c065b40953 req-0a22c152-600a-4e55-bd6d-2133a62adec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6135fb3a-980d-4e8a-ad76-4908f4f53a0a", "tag": "c70a93be-38b6-4ac7-89fb-2c06e79c39b9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:31.679434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ea0c28cd-efe5-443a-9d3c-23c065b40953 req-0a22c152-600a-4e55-bd6d-2133a62adec9 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:31.679914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ea0c28cd-efe5-443a-9d3c-23c065b40953 req-0a22c152-600a-4e55-bd6d-2133a62adec9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:31.680345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ea0c28cd-efe5-443a-9d3c-23c065b40953 req-0a22c152-600a-4e55-bd6d-2133a62adec9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:31.691881 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-ea0c28cd-efe5-443a-9d3c-23c065b40953 req-0a22c152-600a-4e55-bd6d-2133a62adec9 service nova] Creating event network-changed:c70a93be-38b6-4ac7-89fb-2c06e79c39b9 for instance 6135fb3a-980d-4e8a-ad76-4908f4f53a0a on n-h2-839401-11 Aug 29 15:33:31.697789 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-ea0c28cd-efe5-443a-9d3c-23c065b40953 req-0a22c152-600a-4e55-bd6d-2133a62adec9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032094 Aug 29 15:33:31.698754 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1085/2153] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:31.824666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a989be8-6a1b-4268-bca5-25b98c131716 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:31.825429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a989be8-6a1b-4268-bca5-25b98c131716 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:31.832918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a989be8-6a1b-4268-bca5-25b98c131716 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:31.833755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a989be8-6a1b-4268-bca5-25b98c131716 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:31.834503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a989be8-6a1b-4268-bca5-25b98c131716 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:31.835486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a989be8-6a1b-4268-bca5-25b98c131716 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:31.836108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a989be8-6a1b-4268-bca5-25b98c131716 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:31.836703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a989be8-6a1b-4268-bca5-25b98c131716 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:31.994011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0961498f-32cf-4714-89fa-df78ada5c81a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:31.994805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0961498f-32cf-4714-89fa-df78ada5c81a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:32.002057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0961498f-32cf-4714-89fa-df78ada5c81a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:32.002594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0961498f-32cf-4714-89fa-df78ada5c81a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:32.003033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0961498f-32cf-4714-89fa-df78ada5c81a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:32.003730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0961498f-32cf-4714-89fa-df78ada5c81a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:32.004186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0961498f-32cf-4714-89fa-df78ada5c81a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:32.004603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0961498f-32cf-4714-89fa-df78ada5c81a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:32.068182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5a989be8-6a1b-4268-bca5-25b98c131716 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:32.085873 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5a989be8-6a1b-4268-bca5-25b98c131716 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.265708 Aug 29 15:33:32.086467 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1069/2154] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:31 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:32.100717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0961498f-32cf-4714-89fa-df78ada5c81a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:32.110257 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0961498f-32cf-4714-89fa-df78ada5c81a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1541 microversion: 2.1 time: 0.121563 Aug 29 15:33:32.110986 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1086/2155] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:31 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1541 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:32.158290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-e86f6620-4233-4b13-8fbf-c32bf4fb0da7 req-ea7e5201-1caf-44a1-9eef-527e5346a784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e044d38-7a82-4cb6-8e91-fcbdca201a08", "name": "network-vif-deleted", "tag": "76c803a9-7e99-4e7e-86e4-8d82b4fa6dde"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:32.174144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e86f6620-4233-4b13-8fbf-c32bf4fb0da7 req-ea7e5201-1caf-44a1-9eef-527e5346a784 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:32.175077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e86f6620-4233-4b13-8fbf-c32bf4fb0da7 req-ea7e5201-1caf-44a1-9eef-527e5346a784 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:32.175684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e86f6620-4233-4b13-8fbf-c32bf4fb0da7 req-ea7e5201-1caf-44a1-9eef-527e5346a784 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:32.193187 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-e86f6620-4233-4b13-8fbf-c32bf4fb0da7 req-ea7e5201-1caf-44a1-9eef-527e5346a784 service nova] Creating event network-vif-deleted:76c803a9-7e99-4e7e-86e4-8d82b4fa6dde for instance 7e044d38-7a82-4cb6-8e91-fcbdca201a08 on n-h2-839401-11 Aug 29 15:33:32.198768 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-e86f6620-4233-4b13-8fbf-c32bf4fb0da7 req-ea7e5201-1caf-44a1-9eef-527e5346a784 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044500 Aug 29 15:33:32.200129 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1070/2156] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:32.292077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ae489fd2-aef9-4977-9053-eae0df13e6f5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:32.292892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ae489fd2-aef9-4977-9053-eae0df13e6f5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:32.299759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae489fd2-aef9-4977-9053-eae0df13e6f5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:32.300316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae489fd2-aef9-4977-9053-eae0df13e6f5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:32.300914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae489fd2-aef9-4977-9053-eae0df13e6f5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:32.302102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae489fd2-aef9-4977-9053-eae0df13e6f5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:32.302600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae489fd2-aef9-4977-9053-eae0df13e6f5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:32.303182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae489fd2-aef9-4977-9053-eae0df13e6f5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:32.308382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:32.340553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9cc84b51-0be6-466f-ab0d-0b53e87f03b6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:32.342327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9cc84b51-0be6-466f-ab0d-0b53e87f03b6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:32.349778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9cc84b51-0be6-466f-ab0d-0b53e87f03b6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:32.350539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9cc84b51-0be6-466f-ab0d-0b53e87f03b6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:32.351170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9cc84b51-0be6-466f-ab0d-0b53e87f03b6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:32.352351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9cc84b51-0be6-466f-ab0d-0b53e87f03b6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:32.352835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9cc84b51-0be6-466f-ab0d-0b53e87f03b6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:32.353355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9cc84b51-0be6-466f-ab0d-0b53e87f03b6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:32.470353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ae489fd2-aef9-4977-9053-eae0df13e6f5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:32.480286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ae489fd2-aef9-4977-9053-eae0df13e6f5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:32.482456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ae489fd2-aef9-4977-9053-eae0df13e6f5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:32.483886 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ae489fd2-aef9-4977-9053-eae0df13e6f5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.196657 Aug 29 15:33:32.485027 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1087/2157] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:32 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:32.509123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9cc84b51-0be6-466f-ab0d-0b53e87f03b6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:32.517567 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9cc84b51-0be6-466f-ab0d-0b53e87f03b6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.182552 Aug 29 15:33:32.518334 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1071/2158] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:32 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:32.550525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-99294efd-dfc1-417b-a19a-1473223acdf0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:32.551273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-99294efd-dfc1-417b-a19a-1473223acdf0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:32.557959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99294efd-dfc1-417b-a19a-1473223acdf0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:32.558623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99294efd-dfc1-417b-a19a-1473223acdf0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:32.559185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99294efd-dfc1-417b-a19a-1473223acdf0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:32.559973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99294efd-dfc1-417b-a19a-1473223acdf0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:32.560521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99294efd-dfc1-417b-a19a-1473223acdf0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:32.561012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99294efd-dfc1-417b-a19a-1473223acdf0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:32.628519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-75ed4c3d-a50d-4305-a639-c41355089232 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:32.629835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-75ed4c3d-a50d-4305-a639-c41355089232 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:32.638756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75ed4c3d-a50d-4305-a639-c41355089232 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:32.639809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75ed4c3d-a50d-4305-a639-c41355089232 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:32.640428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75ed4c3d-a50d-4305-a639-c41355089232 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:32.641406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75ed4c3d-a50d-4305-a639-c41355089232 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:32.642492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75ed4c3d-a50d-4305-a639-c41355089232 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:32.642492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75ed4c3d-a50d-4305-a639-c41355089232 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:32.721514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-99294efd-dfc1-417b-a19a-1473223acdf0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:32.730480 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-99294efd-dfc1-417b-a19a-1473223acdf0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1198 microversion: 2.1 time: 0.184581 Aug 29 15:33:32.731835 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1088/2159] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:32 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1198 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:32.815773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-75ed4c3d-a50d-4305-a639-c41355089232 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:32.824322 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-75ed4c3d-a50d-4305-a639-c41355089232 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.201418 Aug 29 15:33:32.825328 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1072/2160] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:32 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:33.107579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-35ab4266-a47a-4a32-93c3-cf4dbaf7729e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:33.108674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-35ab4266-a47a-4a32-93c3-cf4dbaf7729e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:33.119108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ab4266-a47a-4a32-93c3-cf4dbaf7729e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.119698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ab4266-a47a-4a32-93c3-cf4dbaf7729e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.120263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ab4266-a47a-4a32-93c3-cf4dbaf7729e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.120956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ab4266-a47a-4a32-93c3-cf4dbaf7729e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.121669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ab4266-a47a-4a32-93c3-cf4dbaf7729e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.122309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ab4266-a47a-4a32-93c3-cf4dbaf7729e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.131337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ff1ac1d6-0b72-456a-a23f-fe06b2c0192e tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:33.132304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ff1ac1d6-0b72-456a-a23f-fe06b2c0192e tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:33.139374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff1ac1d6-0b72-456a-a23f-fe06b2c0192e tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.140235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff1ac1d6-0b72-456a-a23f-fe06b2c0192e tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.140943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff1ac1d6-0b72-456a-a23f-fe06b2c0192e tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.142170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff1ac1d6-0b72-456a-a23f-fe06b2c0192e tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.143009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff1ac1d6-0b72-456a-a23f-fe06b2c0192e tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.143787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff1ac1d6-0b72-456a-a23f-fe06b2c0192e tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.255741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ff1ac1d6-0b72-456a-a23f-fe06b2c0192e tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:33.277481 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ff1ac1d6-0b72-456a-a23f-fe06b2c0192e tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1541 microversion: 2.1 time: 0.149697 Aug 29 15:33:33.290223 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1073/2161] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:33 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1541 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:33.290923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-35ab4266-a47a-4a32-93c3-cf4dbaf7729e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:33.299794 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-35ab4266-a47a-4a32-93c3-cf4dbaf7729e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.196398 Aug 29 15:33:33.311001 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1089/2162] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:33 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:33.507968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7e297e6e-bf0d-4ed3-a5fd-5bf971eae451 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:33.508644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7e297e6e-bf0d-4ed3-a5fd-5bf971eae451 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:33.515489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e297e6e-bf0d-4ed3-a5fd-5bf971eae451 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.516053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e297e6e-bf0d-4ed3-a5fd-5bf971eae451 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.516441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e297e6e-bf0d-4ed3-a5fd-5bf971eae451 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.517260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e297e6e-bf0d-4ed3-a5fd-5bf971eae451 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.517708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e297e6e-bf0d-4ed3-a5fd-5bf971eae451 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.518158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e297e6e-bf0d-4ed3-a5fd-5bf971eae451 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.541018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d9607dd7-ae7d-4539-a380-f9c611d84ca7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:33.541863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d9607dd7-ae7d-4539-a380-f9c611d84ca7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:33.549442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9607dd7-ae7d-4539-a380-f9c611d84ca7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.550452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9607dd7-ae7d-4539-a380-f9c611d84ca7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.551019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9607dd7-ae7d-4539-a380-f9c611d84ca7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.551842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9607dd7-ae7d-4539-a380-f9c611d84ca7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.552557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9607dd7-ae7d-4539-a380-f9c611d84ca7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.553074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9607dd7-ae7d-4539-a380-f9c611d84ca7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.681814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7e297e6e-bf0d-4ed3-a5fd-5bf971eae451 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:33.690301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7e297e6e-bf0d-4ed3-a5fd-5bf971eae451 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:33.692109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7e297e6e-bf0d-4ed3-a5fd-5bf971eae451 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:33.693391 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7e297e6e-bf0d-4ed3-a5fd-5bf971eae451 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.189944 Aug 29 15:33:33.693997 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1074/2163] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:33 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:33.697573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d9607dd7-ae7d-4539-a380-f9c611d84ca7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:33.705856 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d9607dd7-ae7d-4539-a380-f9c611d84ca7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.170016 Aug 29 15:33:33.706752 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1090/2164] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:33 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:33.752211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-69c4171b-e806-4459-8f96-46f1fea5be53 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:33.752846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-69c4171b-e806-4459-8f96-46f1fea5be53 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:33.759281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69c4171b-e806-4459-8f96-46f1fea5be53 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.759771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69c4171b-e806-4459-8f96-46f1fea5be53 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.760248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69c4171b-e806-4459-8f96-46f1fea5be53 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.761000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69c4171b-e806-4459-8f96-46f1fea5be53 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.761571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69c4171b-e806-4459-8f96-46f1fea5be53 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.761994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69c4171b-e806-4459-8f96-46f1fea5be53 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.846988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65354b4e-9a6d-4116-800b-5fe1fe4d2428 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:33.847734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-65354b4e-9a6d-4116-800b-5fe1fe4d2428 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:33.854713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65354b4e-9a6d-4116-800b-5fe1fe4d2428 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.855164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65354b4e-9a6d-4116-800b-5fe1fe4d2428 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.855578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65354b4e-9a6d-4116-800b-5fe1fe4d2428 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.856333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65354b4e-9a6d-4116-800b-5fe1fe4d2428 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:33.856808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65354b4e-9a6d-4116-800b-5fe1fe4d2428 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:33.857262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65354b4e-9a6d-4116-800b-5fe1fe4d2428 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:33.986936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-69c4171b-e806-4459-8f96-46f1fea5be53 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:34.000084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-65354b4e-9a6d-4116-800b-5fe1fe4d2428 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:34.006086 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-69c4171b-e806-4459-8f96-46f1fea5be53 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1198 microversion: 2.1 time: 0.257913 Aug 29 15:33:34.006910 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1075/2165] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:33 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1198 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:34.011588 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-65354b4e-9a6d-4116-800b-5fe1fe4d2428 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.168782 Aug 29 15:33:34.012269 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1091/2166] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:33 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:34.303624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-30d6de6b-8e29-4fd4-b997-f694a5f83a41 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:34.304262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-30d6de6b-8e29-4fd4-b997-f694a5f83a41 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:34.311499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30d6de6b-8e29-4fd4-b997-f694a5f83a41 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:34.311951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30d6de6b-8e29-4fd4-b997-f694a5f83a41 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:34.312386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30d6de6b-8e29-4fd4-b997-f694a5f83a41 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:34.313106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30d6de6b-8e29-4fd4-b997-f694a5f83a41 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:34.313574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30d6de6b-8e29-4fd4-b997-f694a5f83a41 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:34.313994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30d6de6b-8e29-4fd4-b997-f694a5f83a41 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:34.321906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8de904e5-234a-4d58-ab0e-f85e95870273 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:34.322571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8de904e5-234a-4d58-ab0e-f85e95870273 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:34.330326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8de904e5-234a-4d58-ab0e-f85e95870273 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:34.330957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8de904e5-234a-4d58-ab0e-f85e95870273 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:34.331457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8de904e5-234a-4d58-ab0e-f85e95870273 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:34.332206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8de904e5-234a-4d58-ab0e-f85e95870273 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:34.332687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8de904e5-234a-4d58-ab0e-f85e95870273 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:34.333131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8de904e5-234a-4d58-ab0e-f85e95870273 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:34.414146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-30d6de6b-8e29-4fd4-b997-f694a5f83a41 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:34.414146 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-30d6de6b-8e29-4fd4-b997-f694a5f83a41 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1541 microversion: 2.1 time: 0.090245 Aug 29 15:33:34.414146 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1076/2167] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:34 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1541 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:34.486715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8de904e5-234a-4d58-ab0e-f85e95870273 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:34.495089 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8de904e5-234a-4d58-ab0e-f85e95870273 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1507 microversion: 2.1 time: 0.177803 Aug 29 15:33:34.495651 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1092/2168] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:34 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:34.718123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-07ee8e84-d42d-4451-84eb-6c0e697ac984 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:34.718739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-07ee8e84-d42d-4451-84eb-6c0e697ac984 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:34.726738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07ee8e84-d42d-4451-84eb-6c0e697ac984 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:34.727610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dc279449-55e9-4bd0-9818-d6dde21ac1ac tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:34.727852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07ee8e84-d42d-4451-84eb-6c0e697ac984 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:34.728403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07ee8e84-d42d-4451-84eb-6c0e697ac984 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:34.728836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dc279449-55e9-4bd0-9818-d6dde21ac1ac tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:34.729545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07ee8e84-d42d-4451-84eb-6c0e697ac984 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:34.731484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07ee8e84-d42d-4451-84eb-6c0e697ac984 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:34.732099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07ee8e84-d42d-4451-84eb-6c0e697ac984 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:34.736500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc279449-55e9-4bd0-9818-d6dde21ac1ac tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:34.737215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc279449-55e9-4bd0-9818-d6dde21ac1ac tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:34.737941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc279449-55e9-4bd0-9818-d6dde21ac1ac tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:34.738938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc279449-55e9-4bd0-9818-d6dde21ac1ac tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:34.739582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc279449-55e9-4bd0-9818-d6dde21ac1ac tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:34.740163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc279449-55e9-4bd0-9818-d6dde21ac1ac tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:35.027048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dc279449-55e9-4bd0-9818-d6dde21ac1ac tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:35.031212 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dc279449-55e9-4bd0-9818-d6dde21ac1ac tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.307177 Aug 29 15:33:35.045929 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1093/2169] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:34 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:35.054571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-458d5d9b-8f0a-4701-8274-4c389c481bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:35.055209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-458d5d9b-8f0a-4701-8274-4c389c481bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:35.061383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:35.062858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-458d5d9b-8f0a-4701-8274-4c389c481bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:35.063360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-458d5d9b-8f0a-4701-8274-4c389c481bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:35.063837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-458d5d9b-8f0a-4701-8274-4c389c481bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:35.064655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-458d5d9b-8f0a-4701-8274-4c389c481bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:35.065140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-458d5d9b-8f0a-4701-8274-4c389c481bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:35.065756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-458d5d9b-8f0a-4701-8274-4c389c481bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:35.281363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-458d5d9b-8f0a-4701-8274-4c389c481bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:35.294192 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-458d5d9b-8f0a-4701-8274-4c389c481bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1198 microversion: 2.1 time: 0.246938 Aug 29 15:33:35.309171 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1094/2170] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:35 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1198 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:35.315709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9074eff7-9911-4527-94ab-0f25a5807059 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:35.316564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9074eff7-9911-4527-94ab-0f25a5807059 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:35.323775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9074eff7-9911-4527-94ab-0f25a5807059 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:35.324922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9074eff7-9911-4527-94ab-0f25a5807059 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:35.325573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9074eff7-9911-4527-94ab-0f25a5807059 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:35.326435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9074eff7-9911-4527-94ab-0f25a5807059 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:35.327064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9074eff7-9911-4527-94ab-0f25a5807059 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:35.327663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9074eff7-9911-4527-94ab-0f25a5807059 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:35.498035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9074eff7-9911-4527-94ab-0f25a5807059 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:35.508018 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9074eff7-9911-4527-94ab-0f25a5807059 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.197419 Aug 29 15:33:35.512585 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1095/2171] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:35 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:35.518042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f2ce54a6-52e9-48a6-8b5f-3a7d8cc37e7a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:35.518829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f2ce54a6-52e9-48a6-8b5f-3a7d8cc37e7a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:35.525998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2ce54a6-52e9-48a6-8b5f-3a7d8cc37e7a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:35.526703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2ce54a6-52e9-48a6-8b5f-3a7d8cc37e7a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:35.527283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2ce54a6-52e9-48a6-8b5f-3a7d8cc37e7a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:35.528148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2ce54a6-52e9-48a6-8b5f-3a7d8cc37e7a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:35.528736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2ce54a6-52e9-48a6-8b5f-3a7d8cc37e7a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:35.529361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2ce54a6-52e9-48a6-8b5f-3a7d8cc37e7a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:35.598620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f2ce54a6-52e9-48a6-8b5f-3a7d8cc37e7a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:35.609283 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f2ce54a6-52e9-48a6-8b5f-3a7d8cc37e7a tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1252 microversion: 2.1 time: 0.095321 Aug 29 15:33:35.610069 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1096/2172] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:35 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1252 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:35.625977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-80bb5484-96c6-4aae-b607-fe336554b2e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:35.626799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-80bb5484-96c6-4aae-b607-fe336554b2e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:35.634573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80bb5484-96c6-4aae-b607-fe336554b2e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:35.635792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80bb5484-96c6-4aae-b607-fe336554b2e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:35.636387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80bb5484-96c6-4aae-b607-fe336554b2e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:35.637357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80bb5484-96c6-4aae-b607-fe336554b2e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:35.637970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80bb5484-96c6-4aae-b607-fe336554b2e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:35.638536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80bb5484-96c6-4aae-b607-fe336554b2e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:35.708619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-07ee8e84-d42d-4451-84eb-6c0e697ac984 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:35.719550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-07ee8e84-d42d-4451-84eb-6c0e697ac984 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:35.721975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-07ee8e84-d42d-4451-84eb-6c0e697ac984 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:35.723421 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-07ee8e84-d42d-4451-84eb-6c0e697ac984 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 1.009451 Aug 29 15:33:35.724686 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1077/2173] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:34 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:35.817032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-80bb5484-96c6-4aae-b607-fe336554b2e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:35.833379 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-80bb5484-96c6-4aae-b607-fe336554b2e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1528 microversion: 2.1 time: 0.213711 Aug 29 15:33:35.834109 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1097/2174] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:35 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1528 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:36.058557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c7c03537-2263-4a23-b419-6cb8bb445d32 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:36.059186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c7c03537-2263-4a23-b419-6cb8bb445d32 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:36.065574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c03537-2263-4a23-b419-6cb8bb445d32 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.066312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c03537-2263-4a23-b419-6cb8bb445d32 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.066759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c03537-2263-4a23-b419-6cb8bb445d32 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.067469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c03537-2263-4a23-b419-6cb8bb445d32 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.068079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c03537-2263-4a23-b419-6cb8bb445d32 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.068513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c03537-2263-4a23-b419-6cb8bb445d32 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.316732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2818e93a-dab8-4811-962a-f6f2021e28ed tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:36.317524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2818e93a-dab8-4811-962a-f6f2021e28ed tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:36.324975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2818e93a-dab8-4811-962a-f6f2021e28ed tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.325667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2818e93a-dab8-4811-962a-f6f2021e28ed tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.325934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2818e93a-dab8-4811-962a-f6f2021e28ed tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.326925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2818e93a-dab8-4811-962a-f6f2021e28ed tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.327485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2818e93a-dab8-4811-962a-f6f2021e28ed tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.327915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2818e93a-dab8-4811-962a-f6f2021e28ed tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.440463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c7c03537-2263-4a23-b419-6cb8bb445d32 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:36.451534 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c7c03537-2263-4a23-b419-6cb8bb445d32 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.396680 Aug 29 15:33:36.452664 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1078/2175] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:36 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:36.502136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2818e93a-dab8-4811-962a-f6f2021e28ed tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:36.511314 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2818e93a-dab8-4811-962a-f6f2021e28ed tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1198 microversion: 2.1 time: 0.199213 Aug 29 15:33:36.517936 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1098/2176] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:36 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1198 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:36.536901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d05c3a1e-fbfc-4655-aa64-649feecf6c9e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:36.537690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d05c3a1e-fbfc-4655-aa64-649feecf6c9e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:36.539915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=10 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:36.545713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05c3a1e-fbfc-4655-aa64-649feecf6c9e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.546189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05c3a1e-fbfc-4655-aa64-649feecf6c9e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.546616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05c3a1e-fbfc-4655-aa64-649feecf6c9e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.547336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05c3a1e-fbfc-4655-aa64-649feecf6c9e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.547786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05c3a1e-fbfc-4655-aa64-649feecf6c9e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.548209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05c3a1e-fbfc-4655-aa64-649feecf6c9e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.630454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1d6ce219-78b7-4554-9b72-e93c54544e27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:36.631330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1d6ce219-78b7-4554-9b72-e93c54544e27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:36.646501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d6ce219-78b7-4554-9b72-e93c54544e27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.647356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d6ce219-78b7-4554-9b72-e93c54544e27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.647941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d6ce219-78b7-4554-9b72-e93c54544e27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.648807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d6ce219-78b7-4554-9b72-e93c54544e27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.650223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d6ce219-78b7-4554-9b72-e93c54544e27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.650942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d6ce219-78b7-4554-9b72-e93c54544e27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.677544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=20 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:36.697176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d05c3a1e-fbfc-4655-aa64-649feecf6c9e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:36.709021 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d05c3a1e-fbfc-4655-aa64-649feecf6c9e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.176202 Aug 29 15:33:36.710274 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1079/2177] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:36 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:36.734611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1d6ce219-78b7-4554-9b72-e93c54544e27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:36.744220 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1d6ce219-78b7-4554-9b72-e93c54544e27 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1252 microversion: 2.1 time: 0.118057 Aug 29 15:33:36.745232 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1099/2178] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:36 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1252 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:36.747577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6cbefcee-8791-4800-9bbf-fbd187bcc164 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:36.748257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6cbefcee-8791-4800-9bbf-fbd187bcc164 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:36.754499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6cbefcee-8791-4800-9bbf-fbd187bcc164 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.755189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6cbefcee-8791-4800-9bbf-fbd187bcc164 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.755624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6cbefcee-8791-4800-9bbf-fbd187bcc164 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.756398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6cbefcee-8791-4800-9bbf-fbd187bcc164 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.756946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6cbefcee-8791-4800-9bbf-fbd187bcc164 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.757608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6cbefcee-8791-4800-9bbf-fbd187bcc164 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.774075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:36.857374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cbec776f-50b8-4baa-9881-c3c5259c2628 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:36.858147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cbec776f-50b8-4baa-9881-c3c5259c2628 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:36.865507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbec776f-50b8-4baa-9881-c3c5259c2628 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.866104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbec776f-50b8-4baa-9881-c3c5259c2628 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.866614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbec776f-50b8-4baa-9881-c3c5259c2628 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.867415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbec776f-50b8-4baa-9881-c3c5259c2628 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:36.867963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbec776f-50b8-4baa-9881-c3c5259c2628 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:36.868460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbec776f-50b8-4baa-9881-c3c5259c2628 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:36.906407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6cbefcee-8791-4800-9bbf-fbd187bcc164 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:36.922028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6cbefcee-8791-4800-9bbf-fbd187bcc164 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:36.923437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6cbefcee-8791-4800-9bbf-fbd187bcc164 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:36.924606 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6cbefcee-8791-4800-9bbf-fbd187bcc164 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.181825 Aug 29 15:33:36.925266 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1080/2179] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:36 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:33:37.031861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cbec776f-50b8-4baa-9881-c3c5259c2628 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:37.040262 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cbec776f-50b8-4baa-9881-c3c5259c2628 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1528 microversion: 2.1 time: 0.186972 Aug 29 15:33:37.065299 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1100/2180] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:36 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1528 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:37.469882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-ae1c6a08-757d-4136-a3c4-e02ff2c55984 req-78fce9eb-b5ed-4aed-b78f-bc99776a9109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d624c852-fdae-4a2b-bd07-3d751e56c170", "name": "network-vif-plugged", "status": "completed", "tag": "803fd968-9041-42a9-a133-91672dd13b1a"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:37.475594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-680b7a8d-89ca-4b8b-85dc-bae8b1b7661f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:37.476574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-680b7a8d-89ca-4b8b-85dc-bae8b1b7661f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:37.484731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-680b7a8d-89ca-4b8b-85dc-bae8b1b7661f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:37.485843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-680b7a8d-89ca-4b8b-85dc-bae8b1b7661f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:37.486652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-680b7a8d-89ca-4b8b-85dc-bae8b1b7661f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:37.487650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-680b7a8d-89ca-4b8b-85dc-bae8b1b7661f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:37.488528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-680b7a8d-89ca-4b8b-85dc-bae8b1b7661f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:37.489297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-680b7a8d-89ca-4b8b-85dc-bae8b1b7661f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:37.490322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ae1c6a08-757d-4136-a3c4-e02ff2c55984 req-78fce9eb-b5ed-4aed-b78f-bc99776a9109 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:37.491340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ae1c6a08-757d-4136-a3c4-e02ff2c55984 req-78fce9eb-b5ed-4aed-b78f-bc99776a9109 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:37.491994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ae1c6a08-757d-4136-a3c4-e02ff2c55984 req-78fce9eb-b5ed-4aed-b78f-bc99776a9109 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:37.516978 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-ae1c6a08-757d-4136-a3c4-e02ff2c55984 req-78fce9eb-b5ed-4aed-b78f-bc99776a9109 service nova] Creating event network-vif-plugged:803fd968-9041-42a9-a133-91672dd13b1a for instance d624c852-fdae-4a2b-bd07-3d751e56c170 on n-h1-839401-11 Aug 29 15:33:37.523694 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-ae1c6a08-757d-4136-a3c4-e02ff2c55984 req-78fce9eb-b5ed-4aed-b78f-bc99776a9109 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059094 Aug 29 15:33:37.524650 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1081/2181] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:37.534090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eb615893-3df7-4758-acff-bc698edade34 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:37.535160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eb615893-3df7-4758-acff-bc698edade34 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:37.542508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb615893-3df7-4758-acff-bc698edade34 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:37.543090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb615893-3df7-4758-acff-bc698edade34 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:37.543697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb615893-3df7-4758-acff-bc698edade34 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:37.545508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb615893-3df7-4758-acff-bc698edade34 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:37.546000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb615893-3df7-4758-acff-bc698edade34 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:37.546435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb615893-3df7-4758-acff-bc698edade34 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:37.703775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-680b7a8d-89ca-4b8b-85dc-bae8b1b7661f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:37.715427 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-680b7a8d-89ca-4b8b-85dc-bae8b1b7661f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.244678 Aug 29 15:33:37.716713 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1101/2182] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:37 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:37.733166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8c7212b6-1a14-45d9-ac5b-4a051f95e11b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:37.737654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8c7212b6-1a14-45d9-ac5b-4a051f95e11b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:37.738993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eb615893-3df7-4758-acff-bc698edade34 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:37.746171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c7212b6-1a14-45d9-ac5b-4a051f95e11b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:37.746660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c7212b6-1a14-45d9-ac5b-4a051f95e11b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:37.747091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c7212b6-1a14-45d9-ac5b-4a051f95e11b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:37.748781 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eb615893-3df7-4758-acff-bc698edade34 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1198 microversion: 2.1 time: 0.220297 Aug 29 15:33:37.758204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c7212b6-1a14-45d9-ac5b-4a051f95e11b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:37.758204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c7212b6-1a14-45d9-ac5b-4a051f95e11b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:37.758204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c7212b6-1a14-45d9-ac5b-4a051f95e11b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:37.761992 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1082/2183] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:37 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1198 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:37.767147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7ccc60ad-fc3f-4dac-905e-3a8fc447ce78 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:37.780201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7ccc60ad-fc3f-4dac-905e-3a8fc447ce78 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:37.788570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ccc60ad-fc3f-4dac-905e-3a8fc447ce78 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:37.789611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ccc60ad-fc3f-4dac-905e-3a8fc447ce78 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:37.790182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ccc60ad-fc3f-4dac-905e-3a8fc447ce78 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:37.791027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ccc60ad-fc3f-4dac-905e-3a8fc447ce78 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:37.791616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ccc60ad-fc3f-4dac-905e-3a8fc447ce78 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:37.798257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ccc60ad-fc3f-4dac-905e-3a8fc447ce78 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:37.888365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7ccc60ad-fc3f-4dac-905e-3a8fc447ce78 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:37.897949 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7ccc60ad-fc3f-4dac-905e-3a8fc447ce78 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1252 microversion: 2.1 time: 0.134584 Aug 29 15:33:37.899467 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1083/2184] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:37 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1252 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:37.947880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fba3f63a-4a0e-43d6-8a35-c15480e3d821 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:37.948912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fba3f63a-4a0e-43d6-8a35-c15480e3d821 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:37.955143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fba3f63a-4a0e-43d6-8a35-c15480e3d821 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:37.955638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fba3f63a-4a0e-43d6-8a35-c15480e3d821 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:37.956071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fba3f63a-4a0e-43d6-8a35-c15480e3d821 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:37.956876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fba3f63a-4a0e-43d6-8a35-c15480e3d821 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:37.957360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fba3f63a-4a0e-43d6-8a35-c15480e3d821 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:37.957789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fba3f63a-4a0e-43d6-8a35-c15480e3d821 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:37.962491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8c7212b6-1a14-45d9-ac5b-4a051f95e11b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:37.971547 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8c7212b6-1a14-45d9-ac5b-4a051f95e11b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.243720 Aug 29 15:33:37.972425 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1102/2185] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:37 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:38.073141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b4776470-6114-4ceb-aeaf-0283956fd05c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:38.073765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b4776470-6114-4ceb-aeaf-0283956fd05c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:38.079917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4776470-6114-4ceb-aeaf-0283956fd05c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:38.080436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4776470-6114-4ceb-aeaf-0283956fd05c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:38.080880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4776470-6114-4ceb-aeaf-0283956fd05c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:38.081681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4776470-6114-4ceb-aeaf-0283956fd05c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:38.082391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4776470-6114-4ceb-aeaf-0283956fd05c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:38.082827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4776470-6114-4ceb-aeaf-0283956fd05c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:38.093258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fba3f63a-4a0e-43d6-8a35-c15480e3d821 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:38.102354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fba3f63a-4a0e-43d6-8a35-c15480e3d821 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:38.103921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fba3f63a-4a0e-43d6-8a35-c15480e3d821 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:38.105415 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fba3f63a-4a0e-43d6-8a35-c15480e3d821 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.161823 Aug 29 15:33:38.106120 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1084/2186] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:37 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:33:38.225745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b4776470-6114-4ceb-aeaf-0283956fd05c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:38.229413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:38.236046 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b4776470-6114-4ceb-aeaf-0283956fd05c tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1528 microversion: 2.1 time: 0.166796 Aug 29 15:33:38.236046 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1103/2187] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:38 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1528 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:38.736217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-21777982-ce0b-4dc9-ac40-0be30dc8c8ce tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:38.736841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-21777982-ce0b-4dc9-ac40-0be30dc8c8ce tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:38.744779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21777982-ce0b-4dc9-ac40-0be30dc8c8ce tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:38.745322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21777982-ce0b-4dc9-ac40-0be30dc8c8ce tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:38.745765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21777982-ce0b-4dc9-ac40-0be30dc8c8ce tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:38.746479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21777982-ce0b-4dc9-ac40-0be30dc8c8ce tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:38.746937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21777982-ce0b-4dc9-ac40-0be30dc8c8ce tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:38.747365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21777982-ce0b-4dc9-ac40-0be30dc8c8ce tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:38.772416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e7cc8913-b919-4218-8138-c7b37659ea15 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:38.773033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e7cc8913-b919-4218-8138-c7b37659ea15 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:38.781524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7cc8913-b919-4218-8138-c7b37659ea15 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:38.782109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7cc8913-b919-4218-8138-c7b37659ea15 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:38.782621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7cc8913-b919-4218-8138-c7b37659ea15 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:38.783428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7cc8913-b919-4218-8138-c7b37659ea15 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:38.783989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7cc8913-b919-4218-8138-c7b37659ea15 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:38.784741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7cc8913-b919-4218-8138-c7b37659ea15 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:38.902172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-21777982-ce0b-4dc9-ac40-0be30dc8c8ce tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:38.911869 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-21777982-ce0b-4dc9-ac40-0be30dc8c8ce tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.179767 Aug 29 15:33:38.912731 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1085/2188] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:38 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:38.930327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-58f7b717-0ca0-4813-8e26-f4df470e4ade tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:38.930937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-58f7b717-0ca0-4813-8e26-f4df470e4ade tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:38.938020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58f7b717-0ca0-4813-8e26-f4df470e4ade tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:38.938514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58f7b717-0ca0-4813-8e26-f4df470e4ade tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:38.938958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58f7b717-0ca0-4813-8e26-f4df470e4ade tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:38.941924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58f7b717-0ca0-4813-8e26-f4df470e4ade tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:38.942218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e7cc8913-b919-4218-8138-c7b37659ea15 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:38.942461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58f7b717-0ca0-4813-8e26-f4df470e4ade tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:38.942902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58f7b717-0ca0-4813-8e26-f4df470e4ade tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:38.950396 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e7cc8913-b919-4218-8138-c7b37659ea15 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1198 microversion: 2.1 time: 0.182121 Aug 29 15:33:38.953736 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1104/2189] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:38 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1198 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:38.993518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-154fdb3c-d53b-4915-94f6-8d84628969b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:38.994370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-154fdb3c-d53b-4915-94f6-8d84628969b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:39.000652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154fdb3c-d53b-4915-94f6-8d84628969b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:39.001323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154fdb3c-d53b-4915-94f6-8d84628969b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:39.001767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154fdb3c-d53b-4915-94f6-8d84628969b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:39.002489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154fdb3c-d53b-4915-94f6-8d84628969b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:39.002994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154fdb3c-d53b-4915-94f6-8d84628969b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:39.003518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154fdb3c-d53b-4915-94f6-8d84628969b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:39.008461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-58f7b717-0ca0-4813-8e26-f4df470e4ade tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:39.017634 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-58f7b717-0ca0-4813-8e26-f4df470e4ade tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1252 microversion: 2.1 time: 0.091906 Aug 29 15:33:39.025360 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1086/2190] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:38 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1252 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:39.132498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d342a5d3-1e57-4184-b927-b7992714abbd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:39.133492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d342a5d3-1e57-4184-b927-b7992714abbd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:39.142854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d342a5d3-1e57-4184-b927-b7992714abbd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:39.144019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d342a5d3-1e57-4184-b927-b7992714abbd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:39.145254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d342a5d3-1e57-4184-b927-b7992714abbd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:39.146366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d342a5d3-1e57-4184-b927-b7992714abbd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:39.147021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d342a5d3-1e57-4184-b927-b7992714abbd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:39.147976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d342a5d3-1e57-4184-b927-b7992714abbd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:39.156892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-154fdb3c-d53b-4915-94f6-8d84628969b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:39.167209 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-154fdb3c-d53b-4915-94f6-8d84628969b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.177843 Aug 29 15:33:39.178629 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1105/2191] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:38 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:39.258362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ce77d599-c7c0-4b4c-90cb-e656c42cadbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:39.259965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ce77d599-c7c0-4b4c-90cb-e656c42cadbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:39.269884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce77d599-c7c0-4b4c-90cb-e656c42cadbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:39.271243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce77d599-c7c0-4b4c-90cb-e656c42cadbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:39.272084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce77d599-c7c0-4b4c-90cb-e656c42cadbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:39.273207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce77d599-c7c0-4b4c-90cb-e656c42cadbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:39.273876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce77d599-c7c0-4b4c-90cb-e656c42cadbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:39.274895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce77d599-c7c0-4b4c-90cb-e656c42cadbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:39.292937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d342a5d3-1e57-4184-b927-b7992714abbd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:39.303047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d342a5d3-1e57-4184-b927-b7992714abbd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:39.304778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d342a5d3-1e57-4184-b927-b7992714abbd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:39.307126 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d342a5d3-1e57-4184-b927-b7992714abbd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.181847 Aug 29 15:33:39.308504 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1087/2192] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:39 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:33:39.451781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ce77d599-c7c0-4b4c-90cb-e656c42cadbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:39.467707 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ce77d599-c7c0-4b4c-90cb-e656c42cadbb tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1528 microversion: 2.1 time: 0.211898 Aug 29 15:33:39.468358 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1106/2193] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:39 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1528 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:39.540181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-76083dca-61d7-46d9-bf4d-df10c3917e76 req-4f138529-5afe-4cdd-baa6-0e9e985c5594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e77d46-8629-4bc8-b216-6cdc3e8f0543", "name": "network-vif-plugged", "status": "completed", "tag": "61f6ec7a-d0af-4057-9f18-4aa7a116a44b"}, {"server_uuid": "7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2", "name": "network-vif-plugged", "status": "completed", "tag": "7e55b383-cc6f-43f7-94eb-352846be645f"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:39.551081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-76083dca-61d7-46d9-bf4d-df10c3917e76 req-4f138529-5afe-4cdd-baa6-0e9e985c5594 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:39.551564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-76083dca-61d7-46d9-bf4d-df10c3917e76 req-4f138529-5afe-4cdd-baa6-0e9e985c5594 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:39.551989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-76083dca-61d7-46d9-bf4d-df10c3917e76 req-4f138529-5afe-4cdd-baa6-0e9e985c5594 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:39.566724 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-76083dca-61d7-46d9-bf4d-df10c3917e76 req-4f138529-5afe-4cdd-baa6-0e9e985c5594 service nova] Creating event network-vif-plugged:61f6ec7a-d0af-4057-9f18-4aa7a116a44b for instance f0e77d46-8629-4bc8-b216-6cdc3e8f0543 on n-h2-839401-11 Aug 29 15:33:39.567274 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-76083dca-61d7-46d9-bf4d-df10c3917e76 req-4f138529-5afe-4cdd-baa6-0e9e985c5594 service nova] Creating event network-vif-plugged:7e55b383-cc6f-43f7-94eb-352846be645f for instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 on n-h1-839401-11 Aug 29 15:33:39.583649 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-76083dca-61d7-46d9-bf4d-df10c3917e76 req-4f138529-5afe-4cdd-baa6-0e9e985c5594 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047273 Aug 29 15:33:39.584660 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1088/2194] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:39.931887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a641fe59-de14-465e-a4ae-ae705b71877e tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:39.942035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a641fe59-de14-465e-a4ae-ae705b71877e tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:39.949047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a641fe59-de14-465e-a4ae-ae705b71877e tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:39.949564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a641fe59-de14-465e-a4ae-ae705b71877e tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:39.951425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a641fe59-de14-465e-a4ae-ae705b71877e tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:39.957823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a641fe59-de14-465e-a4ae-ae705b71877e tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:39.959014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a641fe59-de14-465e-a4ae-ae705b71877e tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:39.960485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a641fe59-de14-465e-a4ae-ae705b71877e tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:39.981256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3c947a72-1e34-413b-bf5c-3cf789a82dd3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:39.982468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3c947a72-1e34-413b-bf5c-3cf789a82dd3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:40.008677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c947a72-1e34-413b-bf5c-3cf789a82dd3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.010783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c947a72-1e34-413b-bf5c-3cf789a82dd3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.011428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c947a72-1e34-413b-bf5c-3cf789a82dd3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:40.012335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c947a72-1e34-413b-bf5c-3cf789a82dd3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.014286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c947a72-1e34-413b-bf5c-3cf789a82dd3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.016583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c947a72-1e34-413b-bf5c-3cf789a82dd3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:40.146327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a641fe59-de14-465e-a4ae-ae705b71877e tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:40.155442 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a641fe59-de14-465e-a4ae-ae705b71877e tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.227239 Aug 29 15:33:40.156513 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1107/2195] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:39 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:40.162065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b6df681d-d72b-4d1b-bdb6-95d345383342 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:40.162926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b6df681d-d72b-4d1b-bdb6-95d345383342 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:40.170218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6df681d-d72b-4d1b-bdb6-95d345383342 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.170974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6df681d-d72b-4d1b-bdb6-95d345383342 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.171427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6df681d-d72b-4d1b-bdb6-95d345383342 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:40.172168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6df681d-d72b-4d1b-bdb6-95d345383342 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.172629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6df681d-d72b-4d1b-bdb6-95d345383342 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.173064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6df681d-d72b-4d1b-bdb6-95d345383342 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:40.188026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3c947a72-1e34-413b-bf5c-3cf789a82dd3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:40.201244 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3c947a72-1e34-413b-bf5c-3cf789a82dd3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1198 microversion: 2.1 time: 0.233241 Aug 29 15:33:40.202142 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1089/2196] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:39 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1198 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:40.207518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fa2033ff-d2f8-4f35-9616-4d47f1850a70 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:40.208430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fa2033ff-d2f8-4f35-9616-4d47f1850a70 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:40.220329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa2033ff-d2f8-4f35-9616-4d47f1850a70 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.221426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa2033ff-d2f8-4f35-9616-4d47f1850a70 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.221654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6df681d-d72b-4d1b-bdb6-95d345383342 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.222220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa2033ff-d2f8-4f35-9616-4d47f1850a70 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:40.222527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6df681d-d72b-4d1b-bdb6-95d345383342 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.223115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa2033ff-d2f8-4f35-9616-4d47f1850a70 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.223227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6df681d-d72b-4d1b-bdb6-95d345383342 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:40.223710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa2033ff-d2f8-4f35-9616-4d47f1850a70 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.223800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-b6df681d-d72b-4d1b-bdb6-95d345383342 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lazy-loading 'fault' on Instance uuid 7e044d38-7a82-4cb6-8e91-fcbdca201a08 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:33:40.224251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa2033ff-d2f8-4f35-9616-4d47f1850a70 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:40.274705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b6df681d-d72b-4d1b-bdb6-95d345383342 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:40.283656 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b6df681d-d72b-4d1b-bdb6-95d345383342 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1257 microversion: 2.1 time: 0.125766 Aug 29 15:33:40.284459 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1108/2197] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:40 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1257 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:40.343456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-53f24183-3a20-4898-9915-6da2559fd9af tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:40.344371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-53f24183-3a20-4898-9915-6da2559fd9af tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:40.357896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53f24183-3a20-4898-9915-6da2559fd9af tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.362084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53f24183-3a20-4898-9915-6da2559fd9af tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.362873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53f24183-3a20-4898-9915-6da2559fd9af tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:40.363803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53f24183-3a20-4898-9915-6da2559fd9af tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.364412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53f24183-3a20-4898-9915-6da2559fd9af tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.365925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53f24183-3a20-4898-9915-6da2559fd9af tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:40.374648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fa2033ff-d2f8-4f35-9616-4d47f1850a70 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:40.383415 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fa2033ff-d2f8-4f35-9616-4d47f1850a70 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.179668 Aug 29 15:33:40.384935 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1090/2198] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:40 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:40.492972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c4bb7428-ec45-496e-b08b-ca68d3982b45 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:40.493854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c4bb7428-ec45-496e-b08b-ca68d3982b45 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:40.502724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4bb7428-ec45-496e-b08b-ca68d3982b45 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.503347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4bb7428-ec45-496e-b08b-ca68d3982b45 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.503934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4bb7428-ec45-496e-b08b-ca68d3982b45 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:40.504729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4bb7428-ec45-496e-b08b-ca68d3982b45 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:40.505305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4bb7428-ec45-496e-b08b-ca68d3982b45 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:40.505914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4bb7428-ec45-496e-b08b-ca68d3982b45 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:40.542526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-53f24183-3a20-4898-9915-6da2559fd9af tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:40.551644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-53f24183-3a20-4898-9915-6da2559fd9af tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:40.553104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-53f24183-3a20-4898-9915-6da2559fd9af tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:40.554298 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-53f24183-3a20-4898-9915-6da2559fd9af tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.222891 Aug 29 15:33:40.557155 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1109/2199] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:40 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:40.650961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c4bb7428-ec45-496e-b08b-ca68d3982b45 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:40.659770 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c4bb7428-ec45-496e-b08b-ca68d3982b45 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1528 microversion: 2.1 time: 0.172020 Aug 29 15:33:40.660333 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1091/2200] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:40 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1528 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:41.176757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e3067020-cfca-49b1-9383-7570cee634ae tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:41.177548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e3067020-cfca-49b1-9383-7570cee634ae tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:41.185344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3067020-cfca-49b1-9383-7570cee634ae tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.185832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3067020-cfca-49b1-9383-7570cee634ae tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.186275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3067020-cfca-49b1-9383-7570cee634ae tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.187085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3067020-cfca-49b1-9383-7570cee634ae tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.187657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3067020-cfca-49b1-9383-7570cee634ae tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.188142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3067020-cfca-49b1-9383-7570cee634ae tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.223562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b1f800bb-8563-4f8a-a16e-f41c56d2eb26 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:41.224626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b1f800bb-8563-4f8a-a16e-f41c56d2eb26 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:41.232190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1f800bb-8563-4f8a-a16e-f41c56d2eb26 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.232773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1f800bb-8563-4f8a-a16e-f41c56d2eb26 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.233496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1f800bb-8563-4f8a-a16e-f41c56d2eb26 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.234293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1f800bb-8563-4f8a-a16e-f41c56d2eb26 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.235860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1f800bb-8563-4f8a-a16e-f41c56d2eb26 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.236380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1f800bb-8563-4f8a-a16e-f41c56d2eb26 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.341574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e3067020-cfca-49b1-9383-7570cee634ae tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:41.350270 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e3067020-cfca-49b1-9383-7570cee634ae tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.177900 Aug 29 15:33:41.351339 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1110/2201] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:41 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:41.356363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b375ee6c-ab9f-452c-9ac9-05d0bdeb4dee tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:41.357198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b375ee6c-ab9f-452c-9ac9-05d0bdeb4dee tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:41.372617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b375ee6c-ab9f-452c-9ac9-05d0bdeb4dee tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.373462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b375ee6c-ab9f-452c-9ac9-05d0bdeb4dee tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.374851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b375ee6c-ab9f-452c-9ac9-05d0bdeb4dee tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.375877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b375ee6c-ab9f-452c-9ac9-05d0bdeb4dee tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.376492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b375ee6c-ab9f-452c-9ac9-05d0bdeb4dee tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.377071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b375ee6c-ab9f-452c-9ac9-05d0bdeb4dee tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.394360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b1f800bb-8563-4f8a-a16e-f41c56d2eb26 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:41.405120 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b1f800bb-8563-4f8a-a16e-f41c56d2eb26 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1198 microversion: 2.1 time: 0.185425 Aug 29 15:33:41.406261 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1092/2202] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:41 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1198 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:41.411064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a727e081-87d8-4a08-8da8-483216330139 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:41.411818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a727e081-87d8-4a08-8da8-483216330139 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:41.413925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:41.426792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b375ee6c-ab9f-452c-9ac9-05d0bdeb4dee tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.427329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b375ee6c-ab9f-452c-9ac9-05d0bdeb4dee tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.427781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b375ee6c-ab9f-452c-9ac9-05d0bdeb4dee tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.428564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-b375ee6c-ab9f-452c-9ac9-05d0bdeb4dee tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lazy-loading 'fault' on Instance uuid 7e044d38-7a82-4cb6-8e91-fcbdca201a08 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:33:41.429063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a727e081-87d8-4a08-8da8-483216330139 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.429741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a727e081-87d8-4a08-8da8-483216330139 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.430974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a727e081-87d8-4a08-8da8-483216330139 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.431869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a727e081-87d8-4a08-8da8-483216330139 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.432611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a727e081-87d8-4a08-8da8-483216330139 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.433218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a727e081-87d8-4a08-8da8-483216330139 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.479750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b375ee6c-ab9f-452c-9ac9-05d0bdeb4dee tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:41.488636 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b375ee6c-ab9f-452c-9ac9-05d0bdeb4dee tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1257 microversion: 2.1 time: 0.135933 Aug 29 15:33:41.489637 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1111/2203] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:41 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1257 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:41.577442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bbacdf9d-3007-4e8d-ad03-1516ff4a6789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:41.578251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bbacdf9d-3007-4e8d-ad03-1516ff4a6789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:41.585308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbacdf9d-3007-4e8d-ad03-1516ff4a6789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.585887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbacdf9d-3007-4e8d-ad03-1516ff4a6789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.586462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbacdf9d-3007-4e8d-ad03-1516ff4a6789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.587296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbacdf9d-3007-4e8d-ad03-1516ff4a6789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.587854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbacdf9d-3007-4e8d-ad03-1516ff4a6789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.588372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbacdf9d-3007-4e8d-ad03-1516ff4a6789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.762867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bbacdf9d-3007-4e8d-ad03-1516ff4a6789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:41.773513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bbacdf9d-3007-4e8d-ad03-1516ff4a6789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:41.774957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bbacdf9d-3007-4e8d-ad03-1516ff4a6789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:41.776304 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bbacdf9d-3007-4e8d-ad03-1516ff4a6789 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.203008 Aug 29 15:33:41.789292 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1112/2204] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:41 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:41.794345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d5cfa976-242d-4856-8ccd-729046296e96 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:41.795912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d5cfa976-242d-4856-8ccd-729046296e96 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:41.802139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5cfa976-242d-4856-8ccd-729046296e96 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.803324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5cfa976-242d-4856-8ccd-729046296e96 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.803324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5cfa976-242d-4856-8ccd-729046296e96 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.804010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5cfa976-242d-4856-8ccd-729046296e96 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:41.804542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5cfa976-242d-4856-8ccd-729046296e96 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:41.805584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5cfa976-242d-4856-8ccd-729046296e96 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:41.824165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a727e081-87d8-4a08-8da8-483216330139 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:41.833155 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a727e081-87d8-4a08-8da8-483216330139 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1476 microversion: 2.1 time: 0.425665 Aug 29 15:33:41.833958 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1093/2205] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:41 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1476 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:41.948122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d5cfa976-242d-4856-8ccd-729046296e96 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:41.956347 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d5cfa976-242d-4856-8ccd-729046296e96 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1528 microversion: 2.1 time: 0.165857 Aug 29 15:33:41.965131 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1113/2206] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:41 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1528 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:42.373077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c76fe936-efa6-4d58-8871-20713ef6b8c5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:42.375007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c76fe936-efa6-4d58-8871-20713ef6b8c5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:42.378028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-65bc3d56-df86-49c2-a052-5054dc813c9e req-4d0fda5b-8ac2-42b9-96f7-84e11f57e3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8", "name": "network-vif-plugged", "status": "completed", "tag": "7384f0e5-3cc6-41d9-b8ee-6ab5e6937bc9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:42.389917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-65bc3d56-df86-49c2-a052-5054dc813c9e req-4d0fda5b-8ac2-42b9-96f7-84e11f57e3a1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.390573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-65bc3d56-df86-49c2-a052-5054dc813c9e req-4d0fda5b-8ac2-42b9-96f7-84e11f57e3a1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.391152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-65bc3d56-df86-49c2-a052-5054dc813c9e req-4d0fda5b-8ac2-42b9-96f7-84e11f57e3a1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.404688 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-65bc3d56-df86-49c2-a052-5054dc813c9e req-4d0fda5b-8ac2-42b9-96f7-84e11f57e3a1 service nova] Creating event network-vif-plugged:7384f0e5-3cc6-41d9-b8ee-6ab5e6937bc9 for instance 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 on n-h1-839401-11 Aug 29 15:33:42.410912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c76fe936-efa6-4d58-8871-20713ef6b8c5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.413552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c76fe936-efa6-4d58-8871-20713ef6b8c5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.414619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c76fe936-efa6-4d58-8871-20713ef6b8c5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.414991 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-65bc3d56-df86-49c2-a052-5054dc813c9e req-4d0fda5b-8ac2-42b9-96f7-84e11f57e3a1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040626 Aug 29 15:33:42.416707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c76fe936-efa6-4d58-8871-20713ef6b8c5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.417181 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1114/2207] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:33:42.418479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c76fe936-efa6-4d58-8871-20713ef6b8c5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.419181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c76fe936-efa6-4d58-8871-20713ef6b8c5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.430725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-473969bc-d624-4abc-ab27-4729fb060055 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:42.431616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-473969bc-d624-4abc-ab27-4729fb060055 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:42.438980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-473969bc-d624-4abc-ab27-4729fb060055 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.440248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-473969bc-d624-4abc-ab27-4729fb060055 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.440877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-473969bc-d624-4abc-ab27-4729fb060055 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.441873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-473969bc-d624-4abc-ab27-4729fb060055 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.442434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-473969bc-d624-4abc-ab27-4729fb060055 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.442971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-473969bc-d624-4abc-ab27-4729fb060055 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.664864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c76fe936-efa6-4d58-8871-20713ef6b8c5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:42.680795 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c76fe936-efa6-4d58-8871-20713ef6b8c5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.309854 Aug 29 15:33:42.689993 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1094/2208] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:42 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:42.692094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-58d49ad8-d896-4b7e-9a33-16b3d009ec58 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:42.702990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-58d49ad8-d896-4b7e-9a33-16b3d009ec58 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:42.710534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-473969bc-d624-4abc-ab27-4729fb060055 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:42.719188 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-473969bc-d624-4abc-ab27-4729fb060055 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1198 microversion: 2.1 time: 0.296640 Aug 29 15:33:42.725562 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1115/2209] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:42 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1198 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:42.742074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58d49ad8-d896-4b7e-9a33-16b3d009ec58 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.743039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58d49ad8-d896-4b7e-9a33-16b3d009ec58 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.743808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58d49ad8-d896-4b7e-9a33-16b3d009ec58 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.744845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58d49ad8-d896-4b7e-9a33-16b3d009ec58 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.746746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58d49ad8-d896-4b7e-9a33-16b3d009ec58 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.747280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58d49ad8-d896-4b7e-9a33-16b3d009ec58 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.800639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-92f6bcca-2198-451b-97db-574afbd542bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:42.805187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58d49ad8-d896-4b7e-9a33-16b3d009ec58 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.806166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58d49ad8-d896-4b7e-9a33-16b3d009ec58 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.807837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58d49ad8-d896-4b7e-9a33-16b3d009ec58 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.808478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-58d49ad8-d896-4b7e-9a33-16b3d009ec58 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lazy-loading 'fault' on Instance uuid 7e044d38-7a82-4cb6-8e91-fcbdca201a08 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:33:42.830270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-92f6bcca-2198-451b-97db-574afbd542bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:42.868377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92f6bcca-2198-451b-97db-574afbd542bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.871744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-58d49ad8-d896-4b7e-9a33-16b3d009ec58 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966abbb1d63042469c45b784b6c7b5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b8d7e70d3244c2ac9866de54967460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:42.873587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92f6bcca-2198-451b-97db-574afbd542bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.874078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92f6bcca-2198-451b-97db-574afbd542bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.874862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92f6bcca-2198-451b-97db-574afbd542bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.875343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92f6bcca-2198-451b-97db-574afbd542bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.875779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92f6bcca-2198-451b-97db-574afbd542bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.887811 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-58d49ad8-d896-4b7e-9a33-16b3d009ec58 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 200 len: 1257 microversion: 2.1 time: 0.204908 Aug 29 15:33:42.891657 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1095/2210] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:42 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 1257 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:42.907175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7df00773-0601-4a29-8613-b7831dceebc8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:42.911055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7df00773-0601-4a29-8613-b7831dceebc8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:42.937255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7df00773-0601-4a29-8613-b7831dceebc8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.937255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7df00773-0601-4a29-8613-b7831dceebc8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.937255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7df00773-0601-4a29-8613-b7831dceebc8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:42.937988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7df00773-0601-4a29-8613-b7831dceebc8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:42.938695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7df00773-0601-4a29-8613-b7831dceebc8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:42.939190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7df00773-0601-4a29-8613-b7831dceebc8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:43.172602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7df00773-0601-4a29-8613-b7831dceebc8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:43.183798 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7df00773-0601-4a29-8613-b7831dceebc8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1475 microversion: 2.1 time: 0.290874 Aug 29 15:33:43.184597 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1096/2211] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:42 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1475 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:43.195782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-287f8f48-bdf2-4f5b-84fd-46436af1a97a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:43.196421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-287f8f48-bdf2-4f5b-84fd-46436af1a97a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:43.212029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-287f8f48-bdf2-4f5b-84fd-46436af1a97a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:43.212552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-287f8f48-bdf2-4f5b-84fd-46436af1a97a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:43.213001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-287f8f48-bdf2-4f5b-84fd-46436af1a97a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:43.216594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-287f8f48-bdf2-4f5b-84fd-46436af1a97a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:43.217128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-287f8f48-bdf2-4f5b-84fd-46436af1a97a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:43.217578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-287f8f48-bdf2-4f5b-84fd-46436af1a97a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:43.235998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-92f6bcca-2198-451b-97db-574afbd542bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:43.259839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-92f6bcca-2198-451b-97db-574afbd542bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:43.265049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-92f6bcca-2198-451b-97db-574afbd542bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:43.273833 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-92f6bcca-2198-451b-97db-574afbd542bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.477267 Aug 29 15:33:43.275024 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1116/2212] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:42 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:43.476570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-287f8f48-bdf2-4f5b-84fd-46436af1a97a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:43.484881 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-287f8f48-bdf2-4f5b-84fd-46436af1a97a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1523 microversion: 2.1 time: 0.299425 Aug 29 15:33:43.485586 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1097/2213] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:43 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:43.703578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-11754b8d-0f85-4221-9f18-30ae17dd35a9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:43.704318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-11754b8d-0f85-4221-9f18-30ae17dd35a9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:43.711847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11754b8d-0f85-4221-9f18-30ae17dd35a9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:43.712419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11754b8d-0f85-4221-9f18-30ae17dd35a9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:43.712943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11754b8d-0f85-4221-9f18-30ae17dd35a9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:43.713759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11754b8d-0f85-4221-9f18-30ae17dd35a9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:43.714298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11754b8d-0f85-4221-9f18-30ae17dd35a9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:43.714780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11754b8d-0f85-4221-9f18-30ae17dd35a9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:43.756961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a5598326-e5ba-49ba-9a5d-e4560f632e64 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:43.757655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a5598326-e5ba-49ba-9a5d-e4560f632e64 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:43.769431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5598326-e5ba-49ba-9a5d-e4560f632e64 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:43.769931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5598326-e5ba-49ba-9a5d-e4560f632e64 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:43.770377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5598326-e5ba-49ba-9a5d-e4560f632e64 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:43.771100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5598326-e5ba-49ba-9a5d-e4560f632e64 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:43.771554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5598326-e5ba-49ba-9a5d-e4560f632e64 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:43.771980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5598326-e5ba-49ba-9a5d-e4560f632e64 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:43.774891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:43.876250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-11754b8d-0f85-4221-9f18-30ae17dd35a9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:43.887377 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-11754b8d-0f85-4221-9f18-30ae17dd35a9 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.187831 Aug 29 15:33:43.888532 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1117/2214] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:43 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:43.917242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ed3e9b55-1579-4be9-8548-b413107d491b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:43.918221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ed3e9b55-1579-4be9-8548-b413107d491b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] [instance: 7e044d38-7a82-4cb6-8e91-fcbdca201a08] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:43.925684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed3e9b55-1579-4be9-8548-b413107d491b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:43.926514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed3e9b55-1579-4be9-8548-b413107d491b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:43.927378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed3e9b55-1579-4be9-8548-b413107d491b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:43.928304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed3e9b55-1579-4be9-8548-b413107d491b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:43.929105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed3e9b55-1579-4be9-8548-b413107d491b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:43.929733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed3e9b55-1579-4be9-8548-b413107d491b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:43.947576 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-ed3e9b55-1579-4be9-8548-b413107d491b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] HTTP exception thrown: Instance 7e044d38-7a82-4cb6-8e91-fcbdca201a08 could not be found. Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ed3e9b55-1579-4be9-8548-b413107d491b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Request method failure captured: Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 HTTP/1.1 Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNvNc1T6ahlp_-So0zZe7_A0pZESmMMldzJYa2cvkuUrUjqLu3rqKj0PQi1swo0QJR61vbqyZhiEmAlI28BtoSe0_HOdoaqFBnwOPuf4zUzzMMUg8J6RypZ96oUCf61ge3oyvRiAL9tGBUclYtPgXVa8l7y93nV0PynC9Bk34J94iyk Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 03b8d7e70d3244c2ac9866de54967460 Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestBootFromVolume-609365633 Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_03b8d7e70d3244c2ac9866de54967460", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/03b8d7e70d3244c2ac9866de54967460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/03b8d7e70d3244c2ac9866de54967460"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/03b8d7e70d3244c2ac9866de54967460"}]}] Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestBootFromVolume-609365633 Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 03b8d7e70d3244c2ac9866de54967460 Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestBootFromVolume-609365633 Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestBootFromVolume-609365633-project Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 966abbb1d63042469c45b784b6c7b5c7 Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestBootFromVolume-609365633-project Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 7e044d38-7a82-4cb6-8e91-fcbdca201a08 could not be found. Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7e044d38-7a82-4cb6-8e91-fcbdca201a08'} Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e044d38-7a82-4cb6-8e91-fcbdca201a08 could not be found. Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e044d38-7a82-4cb6-8e91-fcbdca201a08 could not be found. Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:33:43.950049 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:33:43.953274 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:33:43.953274 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:33:43.953274 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:33:43.953274 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:33:43.953274 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:33:43.953274 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e044d38-7a82-4cb6-8e91-fcbdca201a08 could not be found. Aug 29 15:33:43.953274 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:33:43.955496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ed3e9b55-1579-4be9-8548-b413107d491b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Returning 404 to user: Instance 7e044d38-7a82-4cb6-8e91-fcbdca201a08 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:33:43.955628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a5598326-e5ba-49ba-9a5d-e4560f632e64 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:43.956851 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ed3e9b55-1579-4be9-8548-b413107d491b tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08" status: 404 len: 111 microversion: 2.1 time: 0.044459 Aug 29 15:33:43.957956 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1118/2215] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:43 2022] GET /compute/v2.1/servers/7e044d38-7a82-4cb6-8e91-fcbdca201a08 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:33:43.967683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e7de765b-5dd5-4020-982c-497170665300 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] Calling method '.version_select at 0x7fc42b5ae8b0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:43.968271 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a5598326-e5ba-49ba-9a5d-e4560f632e64 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1198 microversion: 2.1 time: 0.222799 Aug 29 15:33:43.981716 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1098/2216] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:43 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1198 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:43.992541 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e7de765b-5dd5-4020-982c-497170665300 tempest-ServersTestBootFromVolume-609365633 tempest-ServersTestBootFromVolume-609365633-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491875179" status: 202 len: 0 microversion: 2.1 time: 0.029903 Aug 29 15:33:43.993412 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1119/2217] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 15:33:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491875179 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:33:44.210436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0dd3d542-7f64-42df-b3f0-1f008890eeda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:44.210984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0dd3d542-7f64-42df-b3f0-1f008890eeda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:44.218393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0dd3d542-7f64-42df-b3f0-1f008890eeda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:44.218887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0dd3d542-7f64-42df-b3f0-1f008890eeda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:44.219885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0dd3d542-7f64-42df-b3f0-1f008890eeda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:44.220685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0dd3d542-7f64-42df-b3f0-1f008890eeda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:44.221746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0dd3d542-7f64-42df-b3f0-1f008890eeda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:44.222193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0dd3d542-7f64-42df-b3f0-1f008890eeda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:44.304589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ecd4fa85-b634-491f-a59e-1cac7f6f7b35 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:44.305287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ecd4fa85-b634-491f-a59e-1cac7f6f7b35 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:44.322504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecd4fa85-b634-491f-a59e-1cac7f6f7b35 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:44.323269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecd4fa85-b634-491f-a59e-1cac7f6f7b35 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:44.324551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecd4fa85-b634-491f-a59e-1cac7f6f7b35 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:44.325336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecd4fa85-b634-491f-a59e-1cac7f6f7b35 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:44.325822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecd4fa85-b634-491f-a59e-1cac7f6f7b35 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:44.327377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecd4fa85-b634-491f-a59e-1cac7f6f7b35 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:44.553481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ecd4fa85-b634-491f-a59e-1cac7f6f7b35 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:44.563701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ecd4fa85-b634-491f-a59e-1cac7f6f7b35 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:44.565202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ecd4fa85-b634-491f-a59e-1cac7f6f7b35 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:44.577371 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ecd4fa85-b634-491f-a59e-1cac7f6f7b35 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.278038 Aug 29 15:33:44.578518 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1120/2218] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:44 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:44.583611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-02ef616f-90dd-4b38-b69c-4607926a115e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:44.584206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-02ef616f-90dd-4b38-b69c-4607926a115e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:44.602458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02ef616f-90dd-4b38-b69c-4607926a115e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:44.602458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02ef616f-90dd-4b38-b69c-4607926a115e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:44.602943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02ef616f-90dd-4b38-b69c-4607926a115e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:44.603692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02ef616f-90dd-4b38-b69c-4607926a115e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:44.604194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02ef616f-90dd-4b38-b69c-4607926a115e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:44.604638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02ef616f-90dd-4b38-b69c-4607926a115e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:44.728343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0dd3d542-7f64-42df-b3f0-1f008890eeda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:44.738318 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0dd3d542-7f64-42df-b3f0-1f008890eeda tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1475 microversion: 2.1 time: 0.532151 Aug 29 15:33:44.739646 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1099/2219] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:44 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1475 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:44.916891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6b5c83de-9a63-4e87-93f1-a5595f389b64 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:44.923009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6b5c83de-9a63-4e87-93f1-a5595f389b64 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:44.934416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b5c83de-9a63-4e87-93f1-a5595f389b64 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:44.935126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b5c83de-9a63-4e87-93f1-a5595f389b64 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:44.935803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b5c83de-9a63-4e87-93f1-a5595f389b64 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:44.937320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b5c83de-9a63-4e87-93f1-a5595f389b64 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:44.938214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b5c83de-9a63-4e87-93f1-a5595f389b64 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:44.940605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b5c83de-9a63-4e87-93f1-a5595f389b64 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:45.027427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-02ef616f-90dd-4b38-b69c-4607926a115e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:45.039143 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-02ef616f-90dd-4b38-b69c-4607926a115e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1523 microversion: 2.1 time: 0.459356 Aug 29 15:33:45.056859 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1121/2220] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:44 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1523 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:45.070383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-96ad5df4-60b0-4bdf-86bf-564b22d816cd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:45.078730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-96ad5df4-60b0-4bdf-86bf-564b22d816cd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:45.108816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96ad5df4-60b0-4bdf-86bf-564b22d816cd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:45.116159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96ad5df4-60b0-4bdf-86bf-564b22d816cd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:45.118035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96ad5df4-60b0-4bdf-86bf-564b22d816cd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:45.122153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96ad5df4-60b0-4bdf-86bf-564b22d816cd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:45.127192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96ad5df4-60b0-4bdf-86bf-564b22d816cd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:45.150863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96ad5df4-60b0-4bdf-86bf-564b22d816cd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:45.167986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:45.278171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6b5c83de-9a63-4e87-93f1-a5595f389b64 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:45.294901 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6b5c83de-9a63-4e87-93f1-a5595f389b64 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.390519 Aug 29 15:33:45.296208 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1100/2221] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:44 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:45.464004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-dc84b4d8-b585-4938-b964-7cbbf2862902 req-01c3c77d-79ee-4f6e-aa57-65c0baf8b637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2add301-a12d-453d-89dd-12fe794e589c", "name": "network-vif-plugged", "status": "completed", "tag": "7dee5476-02f7-423b-895e-8e40ac13a042"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:45.488075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-dc84b4d8-b585-4938-b964-7cbbf2862902 req-01c3c77d-79ee-4f6e-aa57-65c0baf8b637 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:45.489723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-dc84b4d8-b585-4938-b964-7cbbf2862902 req-01c3c77d-79ee-4f6e-aa57-65c0baf8b637 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:45.490867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-dc84b4d8-b585-4938-b964-7cbbf2862902 req-01c3c77d-79ee-4f6e-aa57-65c0baf8b637 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:45.526910 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-dc84b4d8-b585-4938-b964-7cbbf2862902 req-01c3c77d-79ee-4f6e-aa57-65c0baf8b637 service nova] Creating event network-vif-plugged:7dee5476-02f7-423b-895e-8e40ac13a042 for instance a2add301-a12d-453d-89dd-12fe794e589c on n-h2-839401-11 Aug 29 15:33:45.538002 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-dc84b4d8-b585-4938-b964-7cbbf2862902 req-01c3c77d-79ee-4f6e-aa57-65c0baf8b637 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078858 Aug 29 15:33:45.540640 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1101/2222] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:45.602502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7bd982ba-7450-40df-90d5-59d33ffaed3d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:45.604967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7bd982ba-7450-40df-90d5-59d33ffaed3d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:45.613718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bd982ba-7450-40df-90d5-59d33ffaed3d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:45.614593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bd982ba-7450-40df-90d5-59d33ffaed3d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:45.615246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bd982ba-7450-40df-90d5-59d33ffaed3d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:45.617505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bd982ba-7450-40df-90d5-59d33ffaed3d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:45.618351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bd982ba-7450-40df-90d5-59d33ffaed3d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:45.619124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bd982ba-7450-40df-90d5-59d33ffaed3d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:45.785755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-96ad5df4-60b0-4bdf-86bf-564b22d816cd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:45.806347 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-96ad5df4-60b0-4bdf-86bf-564b22d816cd tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1382 microversion: 2.1 time: 0.747860 Aug 29 15:33:45.819968 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1122/2223] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:45 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1382 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:45.852315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9ea9888c-3911-4936-b30f-5be6ca89408e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:45.859164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9ea9888c-3911-4936-b30f-5be6ca89408e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:45.887480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ea9888c-3911-4936-b30f-5be6ca89408e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:45.888340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ea9888c-3911-4936-b30f-5be6ca89408e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:45.888871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ea9888c-3911-4936-b30f-5be6ca89408e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:45.891055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ea9888c-3911-4936-b30f-5be6ca89408e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:45.894272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ea9888c-3911-4936-b30f-5be6ca89408e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:45.897613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ea9888c-3911-4936-b30f-5be6ca89408e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:45.970913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7bd982ba-7450-40df-90d5-59d33ffaed3d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:45.984366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7bd982ba-7450-40df-90d5-59d33ffaed3d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:45.986218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7bd982ba-7450-40df-90d5-59d33ffaed3d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:45.988937 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7bd982ba-7450-40df-90d5-59d33ffaed3d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.392452 Aug 29 15:33:45.990364 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1102/2224] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:45 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:33:46.012732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2c307134-271b-4fbf-bb53-a38a6d50ebf9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:46.013941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2c307134-271b-4fbf-bb53-a38a6d50ebf9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:46.022662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c307134-271b-4fbf-bb53-a38a6d50ebf9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:46.023436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c307134-271b-4fbf-bb53-a38a6d50ebf9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:46.024139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c307134-271b-4fbf-bb53-a38a6d50ebf9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:46.025056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c307134-271b-4fbf-bb53-a38a6d50ebf9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:46.025702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c307134-271b-4fbf-bb53-a38a6d50ebf9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:46.026274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c307134-271b-4fbf-bb53-a38a6d50ebf9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:46.224945 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2c307134-271b-4fbf-bb53-a38a6d50ebf9 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1535 microversion: 2.1 time: 0.233119 Aug 29 15:33:46.238503 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1103/2225] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:45 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1535 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:46.249699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-185d06d5-80dc-4941-8848-cb6339a73775 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:46.250625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-185d06d5-80dc-4941-8848-cb6339a73775 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:46.261278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-185d06d5-80dc-4941-8848-cb6339a73775 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:46.261995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-185d06d5-80dc-4941-8848-cb6339a73775 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:46.262701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-185d06d5-80dc-4941-8848-cb6339a73775 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:46.263607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-185d06d5-80dc-4941-8848-cb6339a73775 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:46.264219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-185d06d5-80dc-4941-8848-cb6339a73775 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:46.264802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-185d06d5-80dc-4941-8848-cb6339a73775 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:46.513281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9ea9888c-3911-4936-b30f-5be6ca89408e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:46.525226 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9ea9888c-3911-4936-b30f-5be6ca89408e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1473 microversion: 2.1 time: 0.698931 Aug 29 15:33:46.526446 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1123/2226] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:45 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1473 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:46.537388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5f4d20de-500e-48d3-9fb1-9fcdf94ee695 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:46.537388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5f4d20de-500e-48d3-9fb1-9fcdf94ee695 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:46.541073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f4d20de-500e-48d3-9fb1-9fcdf94ee695 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:46.541617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f4d20de-500e-48d3-9fb1-9fcdf94ee695 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:46.542315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f4d20de-500e-48d3-9fb1-9fcdf94ee695 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:46.543660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f4d20de-500e-48d3-9fb1-9fcdf94ee695 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:46.544124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f4d20de-500e-48d3-9fb1-9fcdf94ee695 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:46.544558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f4d20de-500e-48d3-9fb1-9fcdf94ee695 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:46.589982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-185d06d5-80dc-4941-8848-cb6339a73775 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:46.599677 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-185d06d5-80dc-4941-8848-cb6339a73775 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1523 microversion: 2.1 time: 0.359382 Aug 29 15:33:46.614615 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1104/2227] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:46 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:46.619693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-70e5d6ad-76e8-466b-86ae-ada330928112 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:46.620326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-70e5d6ad-76e8-466b-86ae-ada330928112 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:46.627430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70e5d6ad-76e8-466b-86ae-ada330928112 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:46.627958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70e5d6ad-76e8-466b-86ae-ada330928112 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:46.628413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70e5d6ad-76e8-466b-86ae-ada330928112 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:46.629277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70e5d6ad-76e8-466b-86ae-ada330928112 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:46.629750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70e5d6ad-76e8-466b-86ae-ada330928112 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:46.630192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70e5d6ad-76e8-466b-86ae-ada330928112 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:46.831214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-70e5d6ad-76e8-466b-86ae-ada330928112 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:46.846075 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-70e5d6ad-76e8-466b-86ae-ada330928112 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.225022 Aug 29 15:33:46.846075 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1105/2228] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:46 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:47.005170 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5f4d20de-500e-48d3-9fb1-9fcdf94ee695 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1535 microversion: 2.1 time: 0.477051 Aug 29 15:33:47.006033 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1124/2229] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:46 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1535 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:47.020615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d556b24b-c5f1-4c2e-ab69-2ea3c09c7c59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:47.021395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d556b24b-c5f1-4c2e-ab69-2ea3c09c7c59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:47.040372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0569c5ae-12b7-40f2-aab0-49850428f6b3 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:47.044846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0569c5ae-12b7-40f2-aab0-49850428f6b3 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:47.074725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d556b24b-c5f1-4c2e-ab69-2ea3c09c7c59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:47.078775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d556b24b-c5f1-4c2e-ab69-2ea3c09c7c59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:47.079415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d556b24b-c5f1-4c2e-ab69-2ea3c09c7c59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:47.080382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d556b24b-c5f1-4c2e-ab69-2ea3c09c7c59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:47.081075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d556b24b-c5f1-4c2e-ab69-2ea3c09c7c59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:47.081842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d556b24b-c5f1-4c2e-ab69-2ea3c09c7c59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:47.086767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0569c5ae-12b7-40f2-aab0-49850428f6b3 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:47.087465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0569c5ae-12b7-40f2-aab0-49850428f6b3 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:47.088857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0569c5ae-12b7-40f2-aab0-49850428f6b3 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:47.089568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0569c5ae-12b7-40f2-aab0-49850428f6b3 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:47.091595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0569c5ae-12b7-40f2-aab0-49850428f6b3 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:47.154209 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0569c5ae-12b7-40f2-aab0-49850428f6b3 tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.128546 Aug 29 15:33:47.161027 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1125/2230] 10.222.0.62 () {58 vars in 1176 bytes} [Mon Aug 29 15:33:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:47.173055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ce40382e-adad-4e51-9114-79dc9113768f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-839401-11", "block_migration": false, "disk_over_commit": false}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:47.176190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ce40382e-adad-4e51-9114-79dc9113768f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:47.187249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce40382e-adad-4e51-9114-79dc9113768f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:47.188088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce40382e-adad-4e51-9114-79dc9113768f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:47.188927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce40382e-adad-4e51-9114-79dc9113768f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:47.189890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce40382e-adad-4e51-9114-79dc9113768f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:47.190608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce40382e-adad-4e51-9114-79dc9113768f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:47.191275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce40382e-adad-4e51-9114-79dc9113768f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:47.236867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-ce40382e-adad-4e51-9114-79dc9113768f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lazy-loading 'flavor' on Instance uuid 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:33:47.255301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ce40382e-adad-4e51-9114-79dc9113768f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Going to try to live migrate instance to n-h2-839401-11 {{(pid=122360) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:33:47.338061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d556b24b-c5f1-4c2e-ab69-2ea3c09c7c59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:47.356796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d556b24b-c5f1-4c2e-ab69-2ea3c09c7c59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:47.362225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d556b24b-c5f1-4c2e-ab69-2ea3c09c7c59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:47.368239 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d556b24b-c5f1-4c2e-ab69-2ea3c09c7c59 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.350521 Aug 29 15:33:47.386035 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1106/2231] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:47 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:47.565472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b0ba4684-e41d-4881-ad2e-3637650e9814 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:47.566195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b0ba4684-e41d-4881-ad2e-3637650e9814 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:47.594763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0ba4684-e41d-4881-ad2e-3637650e9814 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:47.595283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0ba4684-e41d-4881-ad2e-3637650e9814 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:47.595754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0ba4684-e41d-4881-ad2e-3637650e9814 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:47.600043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0ba4684-e41d-4881-ad2e-3637650e9814 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:47.602146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0ba4684-e41d-4881-ad2e-3637650e9814 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:47.602929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0ba4684-e41d-4881-ad2e-3637650e9814 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:47.837503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b0ba4684-e41d-4881-ad2e-3637650e9814 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:47.847562 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b0ba4684-e41d-4881-ad2e-3637650e9814 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1473 microversion: 2.1 time: 0.302096 Aug 29 15:33:47.849107 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1107/2232] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:47 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1473 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:47.854917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b80e5259-7d9b-42ec-8f20-22c551a72a01 req-fb454fa5-702c-4e19-a0c8-4809cef52181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11592c2a-43a5-492f-a40a-64ae99efa92e", "name": "network-vif-unplugged", "status": "completed", "tag": "b8190072-2f76-41df-9404-7f44a26edb8c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:47.866353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b80e5259-7d9b-42ec-8f20-22c551a72a01 req-fb454fa5-702c-4e19-a0c8-4809cef52181 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:47.866842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b80e5259-7d9b-42ec-8f20-22c551a72a01 req-fb454fa5-702c-4e19-a0c8-4809cef52181 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:47.867280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b80e5259-7d9b-42ec-8f20-22c551a72a01 req-fb454fa5-702c-4e19-a0c8-4809cef52181 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:47.882505 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b80e5259-7d9b-42ec-8f20-22c551a72a01 req-fb454fa5-702c-4e19-a0c8-4809cef52181 service nova] Creating event network-vif-unplugged:b8190072-2f76-41df-9404-7f44a26edb8c for instance 11592c2a-43a5-492f-a40a-64ae99efa92e on n-h1-839401-11 Aug 29 15:33:47.901468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-b80e5259-7d9b-42ec-8f20-22c551a72a01 req-fb454fa5-702c-4e19-a0c8-4809cef52181 service nova] Instance 11592c2a-43a5-492f-a40a-64ae99efa92e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:33:47.917035 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b80e5259-7d9b-42ec-8f20-22c551a72a01 req-fb454fa5-702c-4e19-a0c8-4809cef52181 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066410 Aug 29 15:33:47.917870 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1108/2233] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:47.929490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ddfc97cf-fdca-45be-8737-fd16638f9a56 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:47.930223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ddfc97cf-fdca-45be-8737-fd16638f9a56 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:47.941654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ddfc97cf-fdca-45be-8737-fd16638f9a56 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:47.942583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ddfc97cf-fdca-45be-8737-fd16638f9a56 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:47.945227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ddfc97cf-fdca-45be-8737-fd16638f9a56 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:47.946621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ddfc97cf-fdca-45be-8737-fd16638f9a56 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:47.947616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ddfc97cf-fdca-45be-8737-fd16638f9a56 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:47.948417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ddfc97cf-fdca-45be-8737-fd16638f9a56 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:48.137938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ddfc97cf-fdca-45be-8737-fd16638f9a56 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:48.148660 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ddfc97cf-fdca-45be-8737-fd16638f9a56 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1523 microversion: 2.1 time: 0.224913 Aug 29 15:33:48.149340 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1109/2234] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:47 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:48.154756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a497e89c-c6ea-4d07-93cf-09f391813e07 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:48.155801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a497e89c-c6ea-4d07-93cf-09f391813e07 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:48.162730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a497e89c-c6ea-4d07-93cf-09f391813e07 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:48.163228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a497e89c-c6ea-4d07-93cf-09f391813e07 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:48.163690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a497e89c-c6ea-4d07-93cf-09f391813e07 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:48.164732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a497e89c-c6ea-4d07-93cf-09f391813e07 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:48.165368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a497e89c-c6ea-4d07-93cf-09f391813e07 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:48.165882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a497e89c-c6ea-4d07-93cf-09f391813e07 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:48.333940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a497e89c-c6ea-4d07-93cf-09f391813e07 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:48.346759 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a497e89c-c6ea-4d07-93cf-09f391813e07 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1320 microversion: 2.1 time: 0.196111 Aug 29 15:33:48.347723 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1110/2235] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:48 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1320 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:48.394509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a3770a5f-6864-43d5-8356-a97d8782d944 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:48.395694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a3770a5f-6864-43d5-8356-a97d8782d944 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:48.406464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3770a5f-6864-43d5-8356-a97d8782d944 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:48.409345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3770a5f-6864-43d5-8356-a97d8782d944 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:48.410858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3770a5f-6864-43d5-8356-a97d8782d944 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:48.412972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3770a5f-6864-43d5-8356-a97d8782d944 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:48.418721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3770a5f-6864-43d5-8356-a97d8782d944 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:48.419832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3770a5f-6864-43d5-8356-a97d8782d944 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:48.647695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a3770a5f-6864-43d5-8356-a97d8782d944 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:48.670202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a3770a5f-6864-43d5-8356-a97d8782d944 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:48.672290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a3770a5f-6864-43d5-8356-a97d8782d944 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:48.673921 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a3770a5f-6864-43d5-8356-a97d8782d944 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.285450 Aug 29 15:33:48.703663 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1111/2236] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:48 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:48.873570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-837c079c-1ca4-41f0-8e9e-ad70903e03bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:48.873570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-837c079c-1ca4-41f0-8e9e-ad70903e03bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:48.879236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-837c079c-1ca4-41f0-8e9e-ad70903e03bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:48.879740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-837c079c-1ca4-41f0-8e9e-ad70903e03bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:48.880206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-837c079c-1ca4-41f0-8e9e-ad70903e03bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:48.880902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-837c079c-1ca4-41f0-8e9e-ad70903e03bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:48.881461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-837c079c-1ca4-41f0-8e9e-ad70903e03bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:48.881900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-837c079c-1ca4-41f0-8e9e-ad70903e03bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:49.142187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-837c079c-1ca4-41f0-8e9e-ad70903e03bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:49.154175 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-837c079c-1ca4-41f0-8e9e-ad70903e03bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1473 microversion: 2.1 time: 0.285985 Aug 29 15:33:49.154839 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1112/2237] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:48 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1473 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:49.174045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-98642b26-61a7-46b4-bd30-ad6f13c6532d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:49.174773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-98642b26-61a7-46b4-bd30-ad6f13c6532d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:49.183194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98642b26-61a7-46b4-bd30-ad6f13c6532d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:49.183919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98642b26-61a7-46b4-bd30-ad6f13c6532d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:49.184734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98642b26-61a7-46b4-bd30-ad6f13c6532d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:49.185847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98642b26-61a7-46b4-bd30-ad6f13c6532d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:49.187061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98642b26-61a7-46b4-bd30-ad6f13c6532d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:49.187522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98642b26-61a7-46b4-bd30-ad6f13c6532d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:49.558311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-98642b26-61a7-46b4-bd30-ad6f13c6532d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:49.572103 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-98642b26-61a7-46b4-bd30-ad6f13c6532d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1523 microversion: 2.1 time: 0.402235 Aug 29 15:33:49.585877 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1113/2238] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:49 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1523 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:49.590910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aa0be7c0-c0bc-447f-bfc9-967f7b7a58a4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:49.591537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aa0be7c0-c0bc-447f-bfc9-967f7b7a58a4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:49.612527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa0be7c0-c0bc-447f-bfc9-967f7b7a58a4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:49.613040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa0be7c0-c0bc-447f-bfc9-967f7b7a58a4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:49.613533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa0be7c0-c0bc-447f-bfc9-967f7b7a58a4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:49.614281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa0be7c0-c0bc-447f-bfc9-967f7b7a58a4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:49.614804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa0be7c0-c0bc-447f-bfc9-967f7b7a58a4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:49.615262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa0be7c0-c0bc-447f-bfc9-967f7b7a58a4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:49.921661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aa0be7c0-c0bc-447f-bfc9-967f7b7a58a4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:49.933619 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aa0be7c0-c0bc-447f-bfc9-967f7b7a58a4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1511 microversion: 2.1 time: 0.346511 Aug 29 15:33:49.934220 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1114/2239] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:49 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1511 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:49.953118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f40175bd-4690-4a9d-a89c-03bc9c667317 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:49.953927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f40175bd-4690-4a9d-a89c-03bc9c667317 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:49.961759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f40175bd-4690-4a9d-a89c-03bc9c667317 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:49.961759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f40175bd-4690-4a9d-a89c-03bc9c667317 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:49.962220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f40175bd-4690-4a9d-a89c-03bc9c667317 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:49.963136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f40175bd-4690-4a9d-a89c-03bc9c667317 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:49.963792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f40175bd-4690-4a9d-a89c-03bc9c667317 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:49.964057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f40175bd-4690-4a9d-a89c-03bc9c667317 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:50.220473 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ce40382e-adad-4e51-9114-79dc9113768f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8/action" status: 202 len: 0 microversion: 2.1 time: 3.051094 Aug 29 15:33:50.222177 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1126/2240] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:33:47 2022] POST /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8/action => generated 0 bytes in 3054 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:33:50.241434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-be4eca56-a111-4df2-9b40-0bea1366bfc8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:50.243251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-be4eca56-a111-4df2-9b40-0bea1366bfc8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:50.264698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be4eca56-a111-4df2-9b40-0bea1366bfc8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:50.265620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be4eca56-a111-4df2-9b40-0bea1366bfc8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:50.266598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be4eca56-a111-4df2-9b40-0bea1366bfc8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:50.267821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be4eca56-a111-4df2-9b40-0bea1366bfc8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:50.268880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be4eca56-a111-4df2-9b40-0bea1366bfc8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:50.269629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be4eca56-a111-4df2-9b40-0bea1366bfc8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:50.483148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-be4eca56-a111-4df2-9b40-0bea1366bfc8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:50.492306 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-be4eca56-a111-4df2-9b40-0bea1366bfc8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1512 microversion: 2.1 time: 0.265121 Aug 29 15:33:50.497308 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1127/2241] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:50 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1512 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:50.508138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ccfb1fdd-f29e-48de-b256-2d29183c899b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:50.509362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ccfb1fdd-f29e-48de-b256-2d29183c899b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:50.516683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccfb1fdd-f29e-48de-b256-2d29183c899b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:50.517607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccfb1fdd-f29e-48de-b256-2d29183c899b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:50.518323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccfb1fdd-f29e-48de-b256-2d29183c899b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:50.519289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccfb1fdd-f29e-48de-b256-2d29183c899b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:50.520134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccfb1fdd-f29e-48de-b256-2d29183c899b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:50.520777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccfb1fdd-f29e-48de-b256-2d29183c899b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:50.652244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f40175bd-4690-4a9d-a89c-03bc9c667317 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:50.654826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:50.670065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f40175bd-4690-4a9d-a89c-03bc9c667317 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:50.671633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f40175bd-4690-4a9d-a89c-03bc9c667317 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:50.672894 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f40175bd-4690-4a9d-a89c-03bc9c667317 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.723731 Aug 29 15:33:50.678055 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1115/2242] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:49 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:50.689194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-523c6b60-cfc0-4b3f-a30d-42de9bc1c177 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:50.690280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-523c6b60-cfc0-4b3f-a30d-42de9bc1c177 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:50.698436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-523c6b60-cfc0-4b3f-a30d-42de9bc1c177 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:50.699421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-523c6b60-cfc0-4b3f-a30d-42de9bc1c177 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:50.700232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-523c6b60-cfc0-4b3f-a30d-42de9bc1c177 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:50.701233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-523c6b60-cfc0-4b3f-a30d-42de9bc1c177 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:50.702119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-523c6b60-cfc0-4b3f-a30d-42de9bc1c177 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:50.702881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-523c6b60-cfc0-4b3f-a30d-42de9bc1c177 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:50.761436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ccfb1fdd-f29e-48de-b256-2d29183c899b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:50.769642 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ccfb1fdd-f29e-48de-b256-2d29183c899b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1470 microversion: 2.1 time: 0.270832 Aug 29 15:33:50.785194 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1128/2243] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:50 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1470 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:50.785194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4a458579-b83c-45c4-90ae-2e21fc7594a5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:50.785194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4a458579-b83c-45c4-90ae-2e21fc7594a5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: d624c852-fdae-4a2b-bd07-3d751e56c170] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:50.796347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a458579-b83c-45c4-90ae-2e21fc7594a5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:50.797481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a458579-b83c-45c4-90ae-2e21fc7594a5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:50.799146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a458579-b83c-45c4-90ae-2e21fc7594a5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:50.800732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a458579-b83c-45c4-90ae-2e21fc7594a5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:50.801390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a458579-b83c-45c4-90ae-2e21fc7594a5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:50.802008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a458579-b83c-45c4-90ae-2e21fc7594a5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.039035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4a458579-b83c-45c4-90ae-2e21fc7594a5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:51.060757 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4a458579-b83c-45c4-90ae-2e21fc7594a5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170" status: 200 len: 1512 microversion: 2.1 time: 0.282019 Aug 29 15:33:51.069994 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1129/2244] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:50 2022] GET /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170 => generated 1512 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:51.076582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ffb12444-418a-44e9-95ac-35faebe75df8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:51.077181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ffb12444-418a-44e9-95ac-35faebe75df8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:51.084281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffb12444-418a-44e9-95ac-35faebe75df8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.084842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffb12444-418a-44e9-95ac-35faebe75df8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.085630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffb12444-418a-44e9-95ac-35faebe75df8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.086021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffb12444-418a-44e9-95ac-35faebe75df8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.086477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffb12444-418a-44e9-95ac-35faebe75df8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.086908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffb12444-418a-44e9-95ac-35faebe75df8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.092127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-523c6b60-cfc0-4b3f-a30d-42de9bc1c177 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:51.126414 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-523c6b60-cfc0-4b3f-a30d-42de9bc1c177 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.441159 Aug 29 15:33:51.132787 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1116/2245] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:50 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:51.152723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fd4be8a4-9973-4d65-8386-9266ff20a647 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:51.158353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fd4be8a4-9973-4d65-8386-9266ff20a647 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:51.178099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd4be8a4-9973-4d65-8386-9266ff20a647 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.178682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd4be8a4-9973-4d65-8386-9266ff20a647 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.181019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd4be8a4-9973-4d65-8386-9266ff20a647 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.182028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd4be8a4-9973-4d65-8386-9266ff20a647 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.182674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd4be8a4-9973-4d65-8386-9266ff20a647 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.186491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd4be8a4-9973-4d65-8386-9266ff20a647 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.327888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ffb12444-418a-44e9-95ac-35faebe75df8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:51.337078 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ffb12444-418a-44e9-95ac-35faebe75df8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1523 microversion: 2.1 time: 0.265827 Aug 29 15:33:51.337720 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1130/2246] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:51 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:51.348295 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fd4be8a4-9973-4d65-8386-9266ff20a647 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "POST /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e/action" status: 204 len: 0 microversion: 2.1 time: 0.212855 Aug 29 15:33:51.349406 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1117/2247] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:33:51 2022] POST /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e/action => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:33:51.357510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0a6427cd-baa9-476a-99b7-b0b656ef8473 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:51.364371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0a6427cd-baa9-476a-99b7-b0b656ef8473 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:51.366031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0a6427cd-baa9-476a-99b7-b0b656ef8473 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:33:51.378268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e7c4645d-e23d-4b7c-9996-4e06f1e81bcc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:51.381506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a6427cd-baa9-476a-99b7-b0b656ef8473 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.382391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a6427cd-baa9-476a-99b7-b0b656ef8473 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.382975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a6427cd-baa9-476a-99b7-b0b656ef8473 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.383928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a6427cd-baa9-476a-99b7-b0b656ef8473 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.384135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e7c4645d-e23d-4b7c-9996-4e06f1e81bcc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:51.384848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a6427cd-baa9-476a-99b7-b0b656ef8473 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.385722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a6427cd-baa9-476a-99b7-b0b656ef8473 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.395509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7c4645d-e23d-4b7c-9996-4e06f1e81bcc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.396221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7c4645d-e23d-4b7c-9996-4e06f1e81bcc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.396888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7c4645d-e23d-4b7c-9996-4e06f1e81bcc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.400550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7c4645d-e23d-4b7c-9996-4e06f1e81bcc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.401742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7c4645d-e23d-4b7c-9996-4e06f1e81bcc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.402901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7c4645d-e23d-4b7c-9996-4e06f1e81bcc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.514942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-0a6427cd-baa9-476a-99b7-b0b656ef8473 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:33:51.614221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0a6427cd-baa9-476a-99b7-b0b656ef8473 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:51.624525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a6427cd-baa9-476a-99b7-b0b656ef8473 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.625891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a6427cd-baa9-476a-99b7-b0b656ef8473 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.626754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a6427cd-baa9-476a-99b7-b0b656ef8473 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.916476 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0a6427cd-baa9-476a-99b7-b0b656ef8473 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.565119 Aug 29 15:33:51.921244 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1131/2248] 10.222.0.62 () {58 vars in 1167 bytes} [Mon Aug 29 15:33:51 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:51.922628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aa7469cd-6f8e-4936-bc98-ba23662b5f56 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:51.923357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aa7469cd-6f8e-4936-bc98-ba23662b5f56 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:51.940385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e7c4645d-e23d-4b7c-9996-4e06f1e81bcc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:51.944779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa7469cd-6f8e-4936-bc98-ba23662b5f56 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.946713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa7469cd-6f8e-4936-bc98-ba23662b5f56 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.950353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa7469cd-6f8e-4936-bc98-ba23662b5f56 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.951412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa7469cd-6f8e-4936-bc98-ba23662b5f56 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:51.953416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa7469cd-6f8e-4936-bc98-ba23662b5f56 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:51.953924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa7469cd-6f8e-4936-bc98-ba23662b5f56 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:51.973802 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e7c4645d-e23d-4b7c-9996-4e06f1e81bcc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1470 microversion: 2.1 time: 0.603406 Aug 29 15:33:51.975478 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1118/2249] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:51 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1470 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:52.005276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2afe9611-7129-4367-8c60-d619f47a643b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:52.036080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2afe9611-7129-4367-8c60-d619f47a643b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:52.040961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2afe9611-7129-4367-8c60-d619f47a643b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-671223453', 'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:33:52.086813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2afe9611-7129-4367-8c60-d619f47a643b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:52.087338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2afe9611-7129-4367-8c60-d619f47a643b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:52.087755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2afe9611-7129-4367-8c60-d619f47a643b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:52.088498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2afe9611-7129-4367-8c60-d619f47a643b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:52.088962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2afe9611-7129-4367-8c60-d619f47a643b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:52.089425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2afe9611-7129-4367-8c60-d619f47a643b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:52.242364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aa7469cd-6f8e-4936-bc98-ba23662b5f56 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:52.251542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-2afe9611-7129-4367-8c60-d619f47a643b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:33:52.259512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aa7469cd-6f8e-4936-bc98-ba23662b5f56 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:52.262553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aa7469cd-6f8e-4936-bc98-ba23662b5f56 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:52.270904 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aa7469cd-6f8e-4936-bc98-ba23662b5f56 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.345512 Aug 29 15:33:52.271849 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1132/2250] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:51 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:52.278105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-77be2f36-24c5-479d-b8c8-1d0d612c90f2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:52.279393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-77be2f36-24c5-479d-b8c8-1d0d612c90f2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:52.313057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77be2f36-24c5-479d-b8c8-1d0d612c90f2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:52.315698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77be2f36-24c5-479d-b8c8-1d0d612c90f2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:52.317574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77be2f36-24c5-479d-b8c8-1d0d612c90f2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:52.322983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77be2f36-24c5-479d-b8c8-1d0d612c90f2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:52.327775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77be2f36-24c5-479d-b8c8-1d0d612c90f2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:52.329053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77be2f36-24c5-479d-b8c8-1d0d612c90f2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:52.418037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2afe9611-7129-4367-8c60-d619f47a643b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:52.429027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2afe9611-7129-4367-8c60-d619f47a643b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:52.430254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2afe9611-7129-4367-8c60-d619f47a643b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:52.430976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2afe9611-7129-4367-8c60-d619f47a643b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:52.546166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-77be2f36-24c5-479d-b8c8-1d0d612c90f2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:52.555586 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-77be2f36-24c5-479d-b8c8-1d0d612c90f2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.282414 Aug 29 15:33:52.556191 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1133/2251] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:52 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:52.561736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-11f38451-14db-4648-bf6a-df8538af93fd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:52.562811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-11f38451-14db-4648-bf6a-df8538af93fd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:52.574953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11f38451-14db-4648-bf6a-df8538af93fd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:52.575451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11f38451-14db-4648-bf6a-df8538af93fd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:52.575891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11f38451-14db-4648-bf6a-df8538af93fd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:52.576607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11f38451-14db-4648-bf6a-df8538af93fd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:52.577059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11f38451-14db-4648-bf6a-df8538af93fd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:52.577771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11f38451-14db-4648-bf6a-df8538af93fd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:52.801637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-11f38451-14db-4648-bf6a-df8538af93fd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:52.812621 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-11f38451-14db-4648-bf6a-df8538af93fd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1523 microversion: 2.1 time: 0.254969 Aug 29 15:33:52.818917 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1134/2252] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:52 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:52.957654 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2afe9611-7129-4367-8c60-d619f47a643b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-671223453" status: 200 len: 1515 microversion: 2.1 time: 0.979186 Aug 29 15:33:52.958852 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1119/2253] 10.222.0.62 () {58 vars in 1261 bytes} [Mon Aug 29 15:33:51 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-671223453 => generated 1515 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:52.986945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f20e120-5b35-415a-99b6-2ded2f5e0d71 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:52.998028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1fecdfad-f91b-456b-814e-e04112e4942b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:52.998649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1fecdfad-f91b-456b-814e-e04112e4942b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:53.003765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3f20e120-5b35-415a-99b6-2ded2f5e0d71 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:53.007532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fecdfad-f91b-456b-814e-e04112e4942b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.011689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3f20e120-5b35-415a-99b6-2ded2f5e0d71 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:33:53.012586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fecdfad-f91b-456b-814e-e04112e4942b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.017171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fecdfad-f91b-456b-814e-e04112e4942b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.018345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fecdfad-f91b-456b-814e-e04112e4942b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.018970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fecdfad-f91b-456b-814e-e04112e4942b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.019554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fecdfad-f91b-456b-814e-e04112e4942b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.027301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f20e120-5b35-415a-99b6-2ded2f5e0d71 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.027991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f20e120-5b35-415a-99b6-2ded2f5e0d71 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.028438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f20e120-5b35-415a-99b6-2ded2f5e0d71 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.031444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f20e120-5b35-415a-99b6-2ded2f5e0d71 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.032129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f20e120-5b35-415a-99b6-2ded2f5e0d71 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.032757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f20e120-5b35-415a-99b6-2ded2f5e0d71 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.172558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-3f20e120-5b35-415a-99b6-2ded2f5e0d71 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:33:53.266164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3f20e120-5b35-415a-99b6-2ded2f5e0d71 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:53.278249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f20e120-5b35-415a-99b6-2ded2f5e0d71 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.279060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f20e120-5b35-415a-99b6-2ded2f5e0d71 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.279757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f20e120-5b35-415a-99b6-2ded2f5e0d71 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.381892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1fecdfad-f91b-456b-814e-e04112e4942b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:53.391204 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1fecdfad-f91b-456b-814e-e04112e4942b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1470 microversion: 2.1 time: 0.398288 Aug 29 15:33:53.413811 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1120/2254] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:52 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1470 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:53.428540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-43db78fa-2c9b-4a35-aec5-4d02c2430aa8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:53.433017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-43db78fa-2c9b-4a35-aec5-4d02c2430aa8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:53.453428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43db78fa-2c9b-4a35-aec5-4d02c2430aa8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.455336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43db78fa-2c9b-4a35-aec5-4d02c2430aa8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.456847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43db78fa-2c9b-4a35-aec5-4d02c2430aa8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.458658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43db78fa-2c9b-4a35-aec5-4d02c2430aa8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.460908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43db78fa-2c9b-4a35-aec5-4d02c2430aa8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.462986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43db78fa-2c9b-4a35-aec5-4d02c2430aa8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.565038 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3f20e120-5b35-415a-99b6-2ded2f5e0d71 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.582557 Aug 29 15:33:53.565842 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1135/2255] 10.222.0.62 () {58 vars in 1173 bytes} [Mon Aug 29 15:33:52 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:53.589384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b235986-d594-4509-a75c-2acbedb2744e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:53.590388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6b235986-d594-4509-a75c-2acbedb2744e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:53.592814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:53.619916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b235986-d594-4509-a75c-2acbedb2744e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.620778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b235986-d594-4509-a75c-2acbedb2744e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.621323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b235986-d594-4509-a75c-2acbedb2744e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.622310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b235986-d594-4509-a75c-2acbedb2744e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.622993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b235986-d594-4509-a75c-2acbedb2744e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.623817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b235986-d594-4509-a75c-2acbedb2744e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.630193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:53.887709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-43db78fa-2c9b-4a35-aec5-4d02c2430aa8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:53.902327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-43db78fa-2c9b-4a35-aec5-4d02c2430aa8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:53.907063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-43db78fa-2c9b-4a35-aec5-4d02c2430aa8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:53.907063 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-43db78fa-2c9b-4a35-aec5-4d02c2430aa8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.502161 Aug 29 15:33:53.921143 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1121/2256] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:53 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:53.921143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-babf1327-3c3b-43c4-a909-6e8fec929433 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:53.921143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-babf1327-3c3b-43c4-a909-6e8fec929433 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:53.921143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.compute.servers [None req-babf1327-3c3b-43c4-a909-6e8fec929433 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Removing options 'limit' from query {{(pid=122361) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 15:33:53.921645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-babf1327-3c3b-43c4-a909-6e8fec929433 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:33:53.927140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-babf1327-3c3b-43c4-a909-6e8fec929433 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.927644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-babf1327-3c3b-43c4-a909-6e8fec929433 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.928076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-babf1327-3c3b-43c4-a909-6e8fec929433 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.928809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-babf1327-3c3b-43c4-a909-6e8fec929433 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.929586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-babf1327-3c3b-43c4-a909-6e8fec929433 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.930095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-babf1327-3c3b-43c4-a909-6e8fec929433 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.939603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b235986-d594-4509-a75c-2acbedb2744e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:53.950449 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6b235986-d594-4509-a75c-2acbedb2744e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.369113 Aug 29 15:33:53.963419 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1136/2257] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:53 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:53.963419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-49017458-6554-479b-bd06-86721be0ad90 req-a6285e08-135e-4487-a969-a7be472b3649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11592c2a-43a5-492f-a40a-64ae99efa92e", "name": "network-vif-plugged", "status": "completed", "tag": "b8190072-2f76-41df-9404-7f44a26edb8c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:53.969583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-49017458-6554-479b-bd06-86721be0ad90 req-a6285e08-135e-4487-a969-a7be472b3649 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:53.970273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-49017458-6554-479b-bd06-86721be0ad90 req-a6285e08-135e-4487-a969-a7be472b3649 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:53.970928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-49017458-6554-479b-bd06-86721be0ad90 req-a6285e08-135e-4487-a969-a7be472b3649 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:53.987709 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-49017458-6554-479b-bd06-86721be0ad90 req-a6285e08-135e-4487-a969-a7be472b3649 service nova] Creating event network-vif-plugged:b8190072-2f76-41df-9404-7f44a26edb8c for instance 11592c2a-43a5-492f-a40a-64ae99efa92e on n-h1-839401-11 Aug 29 15:33:53.995874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-49017458-6554-479b-bd06-86721be0ad90 req-a6285e08-135e-4487-a969-a7be472b3649 service nova] Instance 11592c2a-43a5-492f-a40a-64ae99efa92e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:33:54.000112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-babf1327-3c3b-43c4-a909-6e8fec929433 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:54.004892 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-49017458-6554-479b-bd06-86721be0ad90 req-a6285e08-135e-4487-a969-a7be472b3649 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051500 Aug 29 15:33:54.005701 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1137/2258] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:54.013979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-859f3b95-01a5-4bf6-b3f6-4fd2c2819ae0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:54.014863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-859f3b95-01a5-4bf6-b3f6-4fd2c2819ae0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:54.019711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-babf1327-3c3b-43c4-a909-6e8fec929433 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.021036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-babf1327-3c3b-43c4-a909-6e8fec929433 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.021672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-babf1327-3c3b-43c4-a909-6e8fec929433 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.023343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-859f3b95-01a5-4bf6-b3f6-4fd2c2819ae0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.024041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-859f3b95-01a5-4bf6-b3f6-4fd2c2819ae0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.024941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-859f3b95-01a5-4bf6-b3f6-4fd2c2819ae0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.025893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-859f3b95-01a5-4bf6-b3f6-4fd2c2819ae0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.026927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-859f3b95-01a5-4bf6-b3f6-4fd2c2819ae0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.026927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-859f3b95-01a5-4bf6-b3f6-4fd2c2819ae0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.263150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-859f3b95-01a5-4bf6-b3f6-4fd2c2819ae0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:54.277473 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-859f3b95-01a5-4bf6-b3f6-4fd2c2819ae0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1523 microversion: 2.1 time: 0.269943 Aug 29 15:33:54.280634 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1138/2259] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:54 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:54.382129 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-babf1327-3c3b-43c4-a909-6e8fec929433 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.471369 Aug 29 15:33:54.384634 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1122/2260] 10.222.0.62 () {58 vars in 1161 bytes} [Mon Aug 29 15:33:53 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:54.414010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-82d7064b-d789-4391-9e63-ea9f48102743 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:54.423600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-82d7064b-d789-4391-9e63-ea9f48102743 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:54.424976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-82d7064b-d789-4391-9e63-ea9f48102743 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:33:54.428531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-840c21e6-4861-47e5-aa28-29477402454e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:54.429367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-840c21e6-4861-47e5-aa28-29477402454e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:54.433556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82d7064b-d789-4391-9e63-ea9f48102743 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.434341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82d7064b-d789-4391-9e63-ea9f48102743 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.434939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82d7064b-d789-4391-9e63-ea9f48102743 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.435921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82d7064b-d789-4391-9e63-ea9f48102743 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.436903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82d7064b-d789-4391-9e63-ea9f48102743 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.437707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82d7064b-d789-4391-9e63-ea9f48102743 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.441474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-840c21e6-4861-47e5-aa28-29477402454e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.442052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-840c21e6-4861-47e5-aa28-29477402454e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.443812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-840c21e6-4861-47e5-aa28-29477402454e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.448617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-840c21e6-4861-47e5-aa28-29477402454e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.449289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-840c21e6-4861-47e5-aa28-29477402454e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.449884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-840c21e6-4861-47e5-aa28-29477402454e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.594454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-82d7064b-d789-4391-9e63-ea9f48102743 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:33:54.687064 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-82d7064b-d789-4391-9e63-ea9f48102743 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.277323 Aug 29 15:33:54.696612 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1139/2261] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:33:54 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:54.703986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3b44721d-e92b-447b-9b65-3d5409e36e76 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:54.709814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3b44721d-e92b-447b-9b65-3d5409e36e76 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:54.710883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.compute.servers [None req-3b44721d-e92b-447b-9b65-3d5409e36e76 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Removing options 'limit' from query {{(pid=122360) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 15:33:54.711566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3b44721d-e92b-447b-9b65-3d5409e36e76 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:33:54.717754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b44721d-e92b-447b-9b65-3d5409e36e76 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.718255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b44721d-e92b-447b-9b65-3d5409e36e76 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.718743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b44721d-e92b-447b-9b65-3d5409e36e76 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.719487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b44721d-e92b-447b-9b65-3d5409e36e76 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.719936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b44721d-e92b-447b-9b65-3d5409e36e76 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.720353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b44721d-e92b-447b-9b65-3d5409e36e76 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.732854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-840c21e6-4861-47e5-aa28-29477402454e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:54.744864 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-840c21e6-4861-47e5-aa28-29477402454e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1470 microversion: 2.1 time: 0.320021 Aug 29 15:33:54.745692 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1123/2262] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:54 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1470 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:54.769075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-3b44721d-e92b-447b-9b65-3d5409e36e76 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:33:54.800777 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3b44721d-e92b-447b-9b65-3d5409e36e76 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.101545 Aug 29 15:33:54.801858 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1140/2263] 10.222.0.62 () {58 vars in 1150 bytes} [Mon Aug 29 15:33:54 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:54.814387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0ddc9c87-80b3-4075-9460-50eaf2b1a817 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:54.820234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0ddc9c87-80b3-4075-9460-50eaf2b1a817 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:54.820973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0ddc9c87-80b3-4075-9460-50eaf2b1a817 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:33:54.827821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ddc9c87-80b3-4075-9460-50eaf2b1a817 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.828398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ddc9c87-80b3-4075-9460-50eaf2b1a817 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.828905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ddc9c87-80b3-4075-9460-50eaf2b1a817 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.829733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ddc9c87-80b3-4075-9460-50eaf2b1a817 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.830336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ddc9c87-80b3-4075-9460-50eaf2b1a817 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.831445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ddc9c87-80b3-4075-9460-50eaf2b1a817 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.863069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-afa96630-f044-4f48-9905-604236f471cf req-eb9082bd-e78c-4304-9d2d-58902110b43c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc", "name": "network-vif-unplugged", "status": "completed", "tag": "8d13372d-483a-4d92-9792-82a84a9eb8eb"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:54.874193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-0ddc9c87-80b3-4075-9460-50eaf2b1a817 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:33:54.883082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-afa96630-f044-4f48-9905-604236f471cf req-eb9082bd-e78c-4304-9d2d-58902110b43c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.883560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-afa96630-f044-4f48-9905-604236f471cf req-eb9082bd-e78c-4304-9d2d-58902110b43c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.886855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-afa96630-f044-4f48-9905-604236f471cf req-eb9082bd-e78c-4304-9d2d-58902110b43c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.905262 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0ddc9c87-80b3-4075-9460-50eaf2b1a817 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.095191 Aug 29 15:33:54.909150 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1124/2264] 10.222.0.62 () {58 vars in 1125 bytes} [Mon Aug 29 15:33:54 2022] GET /compute/v2.1/servers => generated 1010 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:54.914592 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-afa96630-f044-4f48-9905-604236f471cf req-eb9082bd-e78c-4304-9d2d-58902110b43c service nova] Creating event network-vif-unplugged:8d13372d-483a-4d92-9792-82a84a9eb8eb for instance d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc on n-h1-839401-11 Aug 29 15:33:54.922409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6e165688-6169-45b6-ba77-a54d4ef54619 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:54.926574 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-afa96630-f044-4f48-9905-604236f471cf req-eb9082bd-e78c-4304-9d2d-58902110b43c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067546 Aug 29 15:33:54.929007 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1141/2265] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:54.933526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6e165688-6169-45b6-ba77-a54d4ef54619 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:54.934202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6e165688-6169-45b6-ba77-a54d4ef54619 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:33:54.939685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f6c1f840-2c82-45c4-a4d6-56b17c229d39 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:54.940466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f6c1f840-2c82-45c4-a4d6-56b17c229d39 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:54.946902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e165688-6169-45b6-ba77-a54d4ef54619 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.947390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e165688-6169-45b6-ba77-a54d4ef54619 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.948200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e165688-6169-45b6-ba77-a54d4ef54619 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.951438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e165688-6169-45b6-ba77-a54d4ef54619 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.951438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e165688-6169-45b6-ba77-a54d4ef54619 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.951438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e165688-6169-45b6-ba77-a54d4ef54619 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.961533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6c1f840-2c82-45c4-a4d6-56b17c229d39 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.962031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6c1f840-2c82-45c4-a4d6-56b17c229d39 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.962466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6c1f840-2c82-45c4-a4d6-56b17c229d39 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:54.963177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6c1f840-2c82-45c4-a4d6-56b17c229d39 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:54.963613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6c1f840-2c82-45c4-a4d6-56b17c229d39 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:54.964071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6c1f840-2c82-45c4-a4d6-56b17c229d39 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.057816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-6e165688-6169-45b6-ba77-a54d4ef54619 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:33:55.181307 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6e165688-6169-45b6-ba77-a54d4ef54619 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.260626 Aug 29 15:33:55.182938 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1125/2266] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:33:54 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:33:55.196602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-39eb0ecf-5335-4cab-ab40-2d8c050fec3c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:55.200656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-39eb0ecf-5335-4cab-ab40-2d8c050fec3c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:55.228438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39eb0ecf-5335-4cab-ab40-2d8c050fec3c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.230726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39eb0ecf-5335-4cab-ab40-2d8c050fec3c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.231299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39eb0ecf-5335-4cab-ab40-2d8c050fec3c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.232195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39eb0ecf-5335-4cab-ab40-2d8c050fec3c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.232870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39eb0ecf-5335-4cab-ab40-2d8c050fec3c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.233121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39eb0ecf-5335-4cab-ab40-2d8c050fec3c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.514980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-39eb0ecf-5335-4cab-ab40-2d8c050fec3c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:55.526128 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-39eb0ecf-5335-4cab-ab40-2d8c050fec3c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.340597 Aug 29 15:33:55.527069 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1126/2267] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:55 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:55.533870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-82e63b63-86c8-4a1b-abcd-e0714ffaab54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:55.539486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-82e63b63-86c8-4a1b-abcd-e0714ffaab54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:55.540700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.compute.servers [None req-82e63b63-86c8-4a1b-abcd-e0714ffaab54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Removing options 'limit' from query {{(pid=122361) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 15:33:55.541779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-82e63b63-86c8-4a1b-abcd-e0714ffaab54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:33:55.548880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82e63b63-86c8-4a1b-abcd-e0714ffaab54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.549848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82e63b63-86c8-4a1b-abcd-e0714ffaab54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.552465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82e63b63-86c8-4a1b-abcd-e0714ffaab54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.553869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82e63b63-86c8-4a1b-abcd-e0714ffaab54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.554612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82e63b63-86c8-4a1b-abcd-e0714ffaab54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.555276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82e63b63-86c8-4a1b-abcd-e0714ffaab54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.592469 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-82e63b63-86c8-4a1b-abcd-e0714ffaab54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.063604 Aug 29 15:33:55.594266 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1127/2268] 10.222.0.62 () {58 vars in 1140 bytes} [Mon Aug 29 15:33:55 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:55.600459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9c25a948-015e-47cb-9c2c-747f1f66cec1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:55.601706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9c25a948-015e-47cb-9c2c-747f1f66cec1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:55.609645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c25a948-015e-47cb-9c2c-747f1f66cec1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.610513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c25a948-015e-47cb-9c2c-747f1f66cec1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.611975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c25a948-015e-47cb-9c2c-747f1f66cec1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.613694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c25a948-015e-47cb-9c2c-747f1f66cec1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.614718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c25a948-015e-47cb-9c2c-747f1f66cec1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.615353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c25a948-015e-47cb-9c2c-747f1f66cec1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.705736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f6c1f840-2c82-45c4-a4d6-56b17c229d39 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:55.724504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f6c1f840-2c82-45c4-a4d6-56b17c229d39 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:55.727146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f6c1f840-2c82-45c4-a4d6-56b17c229d39 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:55.728904 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f6c1f840-2c82-45c4-a4d6-56b17c229d39 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.798335 Aug 29 15:33:55.730344 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1142/2269] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:54 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:33:55.763386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4cbd847e-daac-4885-b35e-27c9376674fe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:55.777319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4cbd847e-daac-4885-b35e-27c9376674fe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:55.778191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4cbd847e-daac-4885-b35e-27c9376674fe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-671223453', 'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:33:55.785222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cbd847e-daac-4885-b35e-27c9376674fe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.785736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cbd847e-daac-4885-b35e-27c9376674fe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.786581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cbd847e-daac-4885-b35e-27c9376674fe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.787769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cbd847e-daac-4885-b35e-27c9376674fe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.787942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cbd847e-daac-4885-b35e-27c9376674fe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.788370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cbd847e-daac-4885-b35e-27c9376674fe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.880162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9c25a948-015e-47cb-9c2c-747f1f66cec1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:55.889698 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9c25a948-015e-47cb-9c2c-747f1f66cec1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1523 microversion: 2.1 time: 0.294187 Aug 29 15:33:55.894181 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1128/2270] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:55 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:55.911892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-4cbd847e-daac-4885-b35e-27c9376674fe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:33:55.917533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4c696fcc-64a5-4563-9ec0-9d94a0cc32a7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:55.918324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4c696fcc-64a5-4563-9ec0-9d94a0cc32a7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:55.938317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c696fcc-64a5-4563-9ec0-9d94a0cc32a7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.939037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c696fcc-64a5-4563-9ec0-9d94a0cc32a7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.939624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c696fcc-64a5-4563-9ec0-9d94a0cc32a7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:55.940991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c696fcc-64a5-4563-9ec0-9d94a0cc32a7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:55.941581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c696fcc-64a5-4563-9ec0-9d94a0cc32a7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:55.942121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c696fcc-64a5-4563-9ec0-9d94a0cc32a7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:56.072672 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4cbd847e-daac-4885-b35e-27c9376674fe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-671223453" status: 200 len: 345 microversion: 2.1 time: 0.340788 Aug 29 15:33:56.087825 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1143/2271] 10.222.0.62 () {58 vars in 1240 bytes} [Mon Aug 29 15:33:55 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-671223453 => generated 345 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:56.097616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3a81d719-cc0b-4a06-a1ee-808ddfc16d2b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:56.111826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a81d719-cc0b-4a06-a1ee-808ddfc16d2b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:56.112719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a81d719-cc0b-4a06-a1ee-808ddfc16d2b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:56.113381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a81d719-cc0b-4a06-a1ee-808ddfc16d2b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:56.172161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4c696fcc-64a5-4563-9ec0-9d94a0cc32a7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:56.188744 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4c696fcc-64a5-4563-9ec0-9d94a0cc32a7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1462 microversion: 2.1 time: 0.276966 Aug 29 15:33:56.189486 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1129/2272] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:55 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1462 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:56.207567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3a81d719-cc0b-4a06-a1ee-808ddfc16d2b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Going to try to stop instance {{(pid=122360) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:33:56.223281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-63b30131-0ced-45ce-9133-64c830ca67c3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:56.225561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-63b30131-0ced-45ce-9133-64c830ca67c3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:56.247326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63b30131-0ced-45ce-9133-64c830ca67c3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:56.247836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63b30131-0ced-45ce-9133-64c830ca67c3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:56.248278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63b30131-0ced-45ce-9133-64c830ca67c3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:56.249011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63b30131-0ced-45ce-9133-64c830ca67c3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:56.249512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63b30131-0ced-45ce-9133-64c830ca67c3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:56.249937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63b30131-0ced-45ce-9133-64c830ca67c3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:56.286631 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3a81d719-cc0b-4a06-a1ee-808ddfc16d2b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "POST /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543/action" status: 202 len: 0 microversion: 2.1 time: 0.195702 Aug 29 15:33:56.290705 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1144/2273] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:33:56 2022] POST /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:33:56.294065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:56.313233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-83c9f460-a9b5-4194-9066-4eb2969ada55 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:56.317573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-83c9f460-a9b5-4194-9066-4eb2969ada55 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:56.330856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83c9f460-a9b5-4194-9066-4eb2969ada55 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:56.333490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83c9f460-a9b5-4194-9066-4eb2969ada55 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:56.334214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83c9f460-a9b5-4194-9066-4eb2969ada55 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:56.335339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83c9f460-a9b5-4194-9066-4eb2969ada55 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:56.336804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83c9f460-a9b5-4194-9066-4eb2969ada55 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:56.337520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83c9f460-a9b5-4194-9066-4eb2969ada55 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:56.491416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-63b30131-0ced-45ce-9133-64c830ca67c3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:56.521490 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-63b30131-0ced-45ce-9133-64c830ca67c3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1462 microversion: 2.1 time: 0.312883 Aug 29 15:33:56.522097 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1130/2274] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:56 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1462 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:56.547852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8c14517a-b091-4eeb-82d9-d2801f5f4088 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Action: 'create', calling method: .version_select at 0x7fc433ab4a60>, body: {"keypair": {"name": "tempest-keypair-1787447980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5j5YB3bW7un5od9fGyw1w4xaD9wSVodwGosWCMmp6zWy67mKuHsD6p9DPHjs4T3PRcBT0CxkA9ddRTKtev/3G8EeJRLahb4bAlf47isdomY4bcBWdlP6S4X77tTgmpKQ=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:56.580724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-8c14517a-b091-4eeb-82d9-d2801f5f4088 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Getting quotas for project cac390dda11d4f38983e1478de0dbde1. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:33:56.593734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-8c14517a-b091-4eeb-82d9-d2801f5f4088 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Getting quotas for user e57b95d059f74c7a894903b5a8f933df and project cac390dda11d4f38983e1478de0dbde1. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:33:56.668044 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8c14517a-b091-4eeb-82d9-d2801f5f4088 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126489 Aug 29 15:33:56.675064 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1131/2275] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:33:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:33:56.675064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c8f70ed3-86aa-432e-9bed-93af249c8e96 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:56.675363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c8f70ed3-86aa-432e-9bed-93af249c8e96 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:56.696527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-83c9f460-a9b5-4194-9066-4eb2969ada55 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:56.715049 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-83c9f460-a9b5-4194-9066-4eb2969ada55 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.409904 Aug 29 15:33:56.719489 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1145/2276] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:56 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:56.739150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8f70ed3-86aa-432e-9bed-93af249c8e96 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:56.740060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8f70ed3-86aa-432e-9bed-93af249c8e96 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:56.740973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8f70ed3-86aa-432e-9bed-93af249c8e96 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:56.741982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8f70ed3-86aa-432e-9bed-93af249c8e96 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:56.742807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8f70ed3-86aa-432e-9bed-93af249c8e96 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:56.744115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8f70ed3-86aa-432e-9bed-93af249c8e96 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:56.759407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cc86b1d4-0351-4afc-a082-cb68b3d17197 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:56.760350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cc86b1d4-0351-4afc-a082-cb68b3d17197 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:56.775078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc86b1d4-0351-4afc-a082-cb68b3d17197 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:56.775271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc86b1d4-0351-4afc-a082-cb68b3d17197 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:56.776039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc86b1d4-0351-4afc-a082-cb68b3d17197 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:56.786156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc86b1d4-0351-4afc-a082-cb68b3d17197 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:56.786743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc86b1d4-0351-4afc-a082-cb68b3d17197 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:56.787358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc86b1d4-0351-4afc-a082-cb68b3d17197 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:56.960067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c8f70ed3-86aa-432e-9bed-93af249c8e96 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:56.974333 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c8f70ed3-86aa-432e-9bed-93af249c8e96 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.303804 Aug 29 15:33:56.975272 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1132/2277] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:56 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:56.995733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-590a7167-c464-4fb2-8cc6-7b838fc3e77b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:56.997012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-590a7167-c464-4fb2-8cc6-7b838fc3e77b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:57.010871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-590a7167-c464-4fb2-8cc6-7b838fc3e77b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:57.011909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-590a7167-c464-4fb2-8cc6-7b838fc3e77b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:57.014147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-590a7167-c464-4fb2-8cc6-7b838fc3e77b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:57.016700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-590a7167-c464-4fb2-8cc6-7b838fc3e77b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:57.017333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-590a7167-c464-4fb2-8cc6-7b838fc3e77b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:57.018666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-590a7167-c464-4fb2-8cc6-7b838fc3e77b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:57.210450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cc86b1d4-0351-4afc-a082-cb68b3d17197 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:57.220444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cc86b1d4-0351-4afc-a082-cb68b3d17197 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:57.227688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cc86b1d4-0351-4afc-a082-cb68b3d17197 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:57.230428 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cc86b1d4-0351-4afc-a082-cb68b3d17197 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.481670 Aug 29 15:33:57.241872 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1146/2278] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:56 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:33:57.249962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e118f2e4-6cb1-4c60-b07c-3587f81a2a69 req-6d45acf6-85d6-4157-b247-0e52d519f327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc", "tag": "8d13372d-483a-4d92-9792-82a84a9eb8eb"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:33:57.261629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-590a7167-c464-4fb2-8cc6-7b838fc3e77b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:57.270978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e118f2e4-6cb1-4c60-b07c-3587f81a2a69 req-6d45acf6-85d6-4157-b247-0e52d519f327 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:57.271633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e118f2e4-6cb1-4c60-b07c-3587f81a2a69 req-6d45acf6-85d6-4157-b247-0e52d519f327 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:57.272169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e118f2e4-6cb1-4c60-b07c-3587f81a2a69 req-6d45acf6-85d6-4157-b247-0e52d519f327 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:57.273288 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-590a7167-c464-4fb2-8cc6-7b838fc3e77b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1523 microversion: 2.1 time: 0.296804 Aug 29 15:33:57.276346 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1133/2279] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:56 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:57.301861 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e118f2e4-6cb1-4c60-b07c-3587f81a2a69 req-6d45acf6-85d6-4157-b247-0e52d519f327 service nova] Creating event network-changed:8d13372d-483a-4d92-9792-82a84a9eb8eb for instance d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc on n-h1-839401-11 Aug 29 15:33:57.309047 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e118f2e4-6cb1-4c60-b07c-3587f81a2a69 req-6d45acf6-85d6-4157-b247-0e52d519f327 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065363 Aug 29 15:33:57.310216 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1147/2280] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:33:57.769009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1064c682-1972-4e30-8439-cbd5c4a17d4c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:57.770123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1064c682-1972-4e30-8439-cbd5c4a17d4c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:57.773941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:33:57.790215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1064c682-1972-4e30-8439-cbd5c4a17d4c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:57.790932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1064c682-1972-4e30-8439-cbd5c4a17d4c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:57.791579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1064c682-1972-4e30-8439-cbd5c4a17d4c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:57.792680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1064c682-1972-4e30-8439-cbd5c4a17d4c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:57.793388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1064c682-1972-4e30-8439-cbd5c4a17d4c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:57.793983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1064c682-1972-4e30-8439-cbd5c4a17d4c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:57.997376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b605ca4d-7883-4920-b3dc-83e7d8f59730 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:57.998113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b605ca4d-7883-4920-b3dc-83e7d8f59730 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:58.005771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b605ca4d-7883-4920-b3dc-83e7d8f59730 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:58.006547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b605ca4d-7883-4920-b3dc-83e7d8f59730 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:58.007180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b605ca4d-7883-4920-b3dc-83e7d8f59730 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:58.008070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b605ca4d-7883-4920-b3dc-83e7d8f59730 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:58.008801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b605ca4d-7883-4920-b3dc-83e7d8f59730 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:58.009622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b605ca4d-7883-4920-b3dc-83e7d8f59730 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:58.088218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1064c682-1972-4e30-8439-cbd5c4a17d4c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:58.100463 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1064c682-1972-4e30-8439-cbd5c4a17d4c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.359024 Aug 29 15:33:58.116585 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1134/2281] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:57 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:58.264873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c4c6883a-39bf-49bb-bf5f-b315981ea9d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:58.270563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c4c6883a-39bf-49bb-bf5f-b315981ea9d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:58.299370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c6883a-39bf-49bb-bf5f-b315981ea9d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:58.300262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c6883a-39bf-49bb-bf5f-b315981ea9d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:58.306494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c6883a-39bf-49bb-bf5f-b315981ea9d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:58.307743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c6883a-39bf-49bb-bf5f-b315981ea9d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:58.308454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c6883a-39bf-49bb-bf5f-b315981ea9d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:58.312398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c6883a-39bf-49bb-bf5f-b315981ea9d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:58.585451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b605ca4d-7883-4920-b3dc-83e7d8f59730 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:58.596687 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b605ca4d-7883-4920-b3dc-83e7d8f59730 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.604878 Aug 29 15:33:58.599150 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1148/2282] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:57 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:33:58.612152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8f220f7f-75d0-4f1c-87b2-4763044e29df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:58.613695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8f220f7f-75d0-4f1c-87b2-4763044e29df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:58.629313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f220f7f-75d0-4f1c-87b2-4763044e29df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:58.631453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f220f7f-75d0-4f1c-87b2-4763044e29df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:58.632056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f220f7f-75d0-4f1c-87b2-4763044e29df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:58.637884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f220f7f-75d0-4f1c-87b2-4763044e29df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:58.638734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f220f7f-75d0-4f1c-87b2-4763044e29df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:58.639444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f220f7f-75d0-4f1c-87b2-4763044e29df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:58.828901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c4c6883a-39bf-49bb-bf5f-b315981ea9d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:58.846839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c4c6883a-39bf-49bb-bf5f-b315981ea9d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:58.851675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c4c6883a-39bf-49bb-bf5f-b315981ea9d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:58.853014 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c4c6883a-39bf-49bb-bf5f-b315981ea9d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.592393 Aug 29 15:33:58.870106 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1135/2283] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:58 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:33:59.042085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8f220f7f-75d0-4f1c-87b2-4763044e29df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:59.053860 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8f220f7f-75d0-4f1c-87b2-4763044e29df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1523 microversion: 2.1 time: 0.451041 Aug 29 15:33:59.054458 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1149/2284] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:58 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1523 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:59.124285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-473c4e5c-4918-49d8-b3c3-e13a1512c5b8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:59.125175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-473c4e5c-4918-49d8-b3c3-e13a1512c5b8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:59.137902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-473c4e5c-4918-49d8-b3c3-e13a1512c5b8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:59.139613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-473c4e5c-4918-49d8-b3c3-e13a1512c5b8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:59.140167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-473c4e5c-4918-49d8-b3c3-e13a1512c5b8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:59.142954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-473c4e5c-4918-49d8-b3c3-e13a1512c5b8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:59.144096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-473c4e5c-4918-49d8-b3c3-e13a1512c5b8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:59.145332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-473c4e5c-4918-49d8-b3c3-e13a1512c5b8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:59.625745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-980c6354-5023-4b0a-b138-a2ea30802727 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:59.627024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-980c6354-5023-4b0a-b138-a2ea30802727 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:59.642360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-980c6354-5023-4b0a-b138-a2ea30802727 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:59.642917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-980c6354-5023-4b0a-b138-a2ea30802727 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:59.643362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-980c6354-5023-4b0a-b138-a2ea30802727 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:59.655334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-980c6354-5023-4b0a-b138-a2ea30802727 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:59.656083 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-980c6354-5023-4b0a-b138-a2ea30802727 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:59.656698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-980c6354-5023-4b0a-b138-a2ea30802727 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:59.757887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-473c4e5c-4918-49d8-b3c3-e13a1512c5b8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:33:59.777140 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-473c4e5c-4918-49d8-b3c3-e13a1512c5b8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.656985 Aug 29 15:33:59.792573 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1136/2285] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:59 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:33:59.893115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-16221ede-bba6-4e39-ac6a-87a095fa5de2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:33:59.893983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-16221ede-bba6-4e39-ac6a-87a095fa5de2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:33:59.909453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16221ede-bba6-4e39-ac6a-87a095fa5de2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:59.909956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16221ede-bba6-4e39-ac6a-87a095fa5de2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:59.911493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16221ede-bba6-4e39-ac6a-87a095fa5de2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:33:59.913529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16221ede-bba6-4e39-ac6a-87a095fa5de2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:33:59.914014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16221ede-bba6-4e39-ac6a-87a095fa5de2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:33:59.914462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16221ede-bba6-4e39-ac6a-87a095fa5de2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:00.086276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-980c6354-5023-4b0a-b138-a2ea30802727 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:00.095265 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-980c6354-5023-4b0a-b138-a2ea30802727 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.475184 Aug 29 15:34:00.099111 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1150/2286] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:33:59 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:00.117937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c213360d-d1dd-434f-83c3-1e3bfeb98017 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:00.118493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c213360d-d1dd-434f-83c3-1e3bfeb98017 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:00.138323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c213360d-d1dd-434f-83c3-1e3bfeb98017 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:00.139385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c213360d-d1dd-434f-83c3-1e3bfeb98017 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:00.139870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c213360d-d1dd-434f-83c3-1e3bfeb98017 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:00.140602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c213360d-d1dd-434f-83c3-1e3bfeb98017 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:00.141551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c213360d-d1dd-434f-83c3-1e3bfeb98017 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:00.142237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c213360d-d1dd-434f-83c3-1e3bfeb98017 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:00.396679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-16221ede-bba6-4e39-ac6a-87a095fa5de2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:00.414825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-16221ede-bba6-4e39-ac6a-87a095fa5de2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:00.418987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-16221ede-bba6-4e39-ac6a-87a095fa5de2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:00.420595 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-16221ede-bba6-4e39-ac6a-87a095fa5de2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.533976 Aug 29 15:34:00.422667 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1137/2287] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:33:59 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:34:00.430979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7ac4816c-7b64-4aa0-bd61-bf078c714e4a tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Calling method '.version_select at 0x7fc42b6da940>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:00.440352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ac4816c-7b64-4aa0-bd61-bf078c714e4a tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:00.441875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ac4816c-7b64-4aa0-bd61-bf078c714e4a tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:00.444205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ac4816c-7b64-4aa0-bd61-bf078c714e4a tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:00.467562 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7ac4816c-7b64-4aa0-bd61-bf078c714e4a tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] 10.222.0.62 "GET /compute/v2.1/os-migrations" status: 200 len: 3910 microversion: 2.1 time: 0.043478 Aug 29 15:34:00.468228 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1138/2288] 10.222.0.62 () {58 vars in 1143 bytes} [Mon Aug 29 15:34:00 2022] GET /compute/v2.1/os-migrations => generated 3910 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:00.475292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c213360d-d1dd-434f-83c3-1e3bfeb98017 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:00.496910 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c213360d-d1dd-434f-83c3-1e3bfeb98017 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1523 microversion: 2.1 time: 0.395883 Aug 29 15:34:00.510964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-21c71170-2a96-4229-a4b7-75e676503653 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:00.514625 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1151/2289] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:00 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1523 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:00.521556 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-21c71170-2a96-4229-a4b7-75e676503653 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021435 Aug 29 15:34:00.523385 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1139/2290] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:34:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:00.535512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-54a1f63d-bd8f-48ca-bb01-9775cf9b0c58 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1123810623", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:00.569201 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-54a1f63d-bd8f-48ca-bb01-9775cf9b0c58 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.037861 Aug 29 15:34:00.570493 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1152/2291] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Aug 29 15:34:00 2022] POST /compute/v2.1/flavors => generated 499 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:00.585323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cfa30e8a-909e-4118-be91-dab969fa4503 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:00.599517 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cfa30e8a-909e-4118-be91-dab969fa4503 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021068 Aug 29 15:34:00.601132 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1140/2292] 10.222.0.62 () {58 vars in 1182 bytes} [Mon Aug 29 15:34:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:34:00.732534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-623552384", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "214749f2-0e21-48de-82a9-352a778a2b97"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:00.807197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] validate_networks() for None {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:34:00.808433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-68af1e57-5f16-42ec-be2f-364fec6a2c16 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:00.812270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-68af1e57-5f16-42ec-be2f-364fec6a2c16 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:00.840750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-68af1e57-5f16-42ec-be2f-364fec6a2c16 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:00.841652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-68af1e57-5f16-42ec-be2f-364fec6a2c16 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:00.842466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-68af1e57-5f16-42ec-be2f-364fec6a2c16 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:00.843427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-68af1e57-5f16-42ec-be2f-364fec6a2c16 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:00.844407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-68af1e57-5f16-42ec-be2f-364fec6a2c16 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:00.845191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-68af1e57-5f16-42ec-be2f-364fec6a2c16 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.178713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-68af1e57-5f16-42ec-be2f-364fec6a2c16 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:01.195418 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-68af1e57-5f16-42ec-be2f-364fec6a2c16 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.397738 Aug 29 15:34:01.229134 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1141/2293] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:00 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:01.250628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3bff042e-b058-4966-bf39-40131431b1a5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:01.254506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3bff042e-b058-4966-bf39-40131431b1a5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:01.278940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bff042e-b058-4966-bf39-40131431b1a5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:01.280224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bff042e-b058-4966-bf39-40131431b1a5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:01.282276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bff042e-b058-4966-bf39-40131431b1a5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.283698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bff042e-b058-4966-bf39-40131431b1a5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:01.284785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bff042e-b058-4966-bf39-40131431b1a5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:01.285584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bff042e-b058-4966-bf39-40131431b1a5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.367681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:34:01.368986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:34:01.368986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:34:01.369525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:34:01.370247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:34:01.396610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:01.419863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:01.420368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.426512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:01.431094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:01.432729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.550545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Getting quotas for project cac390dda11d4f38983e1478de0dbde1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:34:01.565812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Getting quotas for user e57b95d059f74c7a894903b5a8f933df and project cac390dda11d4f38983e1478de0dbde1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:34:01.604430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:34:01.607119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:34:01.672553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3bff042e-b058-4966-bf39-40131431b1a5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:01.687010 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3bff042e-b058-4966-bf39-40131431b1a5 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.451988 Aug 29 15:34:01.688149 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1142/2294] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:01 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:01.700673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d6561862-0493-4dab-a871-d5a67ed97912 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:01.706199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d6561862-0493-4dab-a871-d5a67ed97912 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:01.721284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6561862-0493-4dab-a871-d5a67ed97912 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:01.721984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6561862-0493-4dab-a871-d5a67ed97912 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:01.722863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6561862-0493-4dab-a871-d5a67ed97912 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.723814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6561862-0493-4dab-a871-d5a67ed97912 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:01.725448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6561862-0493-4dab-a871-d5a67ed97912 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:01.726157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6561862-0493-4dab-a871-d5a67ed97912 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.769298 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-da1cf02e-59cd-4b97-affd-39f8d00bfe45 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041308 Aug 29 15:34:01.770076 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1153/2295] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:34:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:34:01.794504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-87b40011-8898-4bcc-9f46-7ff0b9d70af7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:01.801448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-87b40011-8898-4bcc-9f46-7ff0b9d70af7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:01.837691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87b40011-8898-4bcc-9f46-7ff0b9d70af7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:01.853106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87b40011-8898-4bcc-9f46-7ff0b9d70af7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:01.853594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87b40011-8898-4bcc-9f46-7ff0b9d70af7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.854381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87b40011-8898-4bcc-9f46-7ff0b9d70af7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:01.857761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87b40011-8898-4bcc-9f46-7ff0b9d70af7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:01.858239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87b40011-8898-4bcc-9f46-7ff0b9d70af7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:01.871105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:02.138333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d6561862-0493-4dab-a871-d5a67ed97912 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:02.182619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d6561862-0493-4dab-a871-d5a67ed97912 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:02.189825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d6561862-0493-4dab-a871-d5a67ed97912 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:02.195534 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d6561862-0493-4dab-a871-d5a67ed97912 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.502162 Aug 29 15:34:02.200248 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1143/2296] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:01 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:02.214413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-56c71d8b-8ae3-43c5-a3ed-71ab8d15ba4c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:02.215534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-56c71d8b-8ae3-43c5-a3ed-71ab8d15ba4c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:02.278260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-87b40011-8898-4bcc-9f46-7ff0b9d70af7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:02.294246 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-87b40011-8898-4bcc-9f46-7ff0b9d70af7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1523 microversion: 2.1 time: 0.506815 Aug 29 15:34:02.295433 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1154/2297] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:01 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1523 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:02.305180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b37f98a8-7e0c-4c03-8bed-19031b3d5250 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:02.306291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b37f98a8-7e0c-4c03-8bed-19031b3d5250 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:02.330418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b37f98a8-7e0c-4c03-8bed-19031b3d5250 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:02.332936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b37f98a8-7e0c-4c03-8bed-19031b3d5250 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:02.333713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b37f98a8-7e0c-4c03-8bed-19031b3d5250 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:02.335138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b37f98a8-7e0c-4c03-8bed-19031b3d5250 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:02.336900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b37f98a8-7e0c-4c03-8bed-19031b3d5250 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:02.337573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b37f98a8-7e0c-4c03-8bed-19031b3d5250 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:02.466968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-56c71d8b-8ae3-43c5-a3ed-71ab8d15ba4c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:02.486039 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-56c71d8b-8ae3-43c5-a3ed-71ab8d15ba4c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1278 microversion: 2.1 time: 0.282180 Aug 29 15:34:02.488466 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1144/2298] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:02 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1278 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:02.636203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b37f98a8-7e0c-4c03-8bed-19031b3d5250 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:02.649527 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b37f98a8-7e0c-4c03-8bed-19031b3d5250 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.351515 Aug 29 15:34:02.651716 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1155/2299] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:02 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:02.712034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f713c0ef-1413-45cc-9809-523d387cf657 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:02.714104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f713c0ef-1413-45cc-9809-523d387cf657 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:02.725538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f713c0ef-1413-45cc-9809-523d387cf657 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:02.729193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f713c0ef-1413-45cc-9809-523d387cf657 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:02.729628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f713c0ef-1413-45cc-9809-523d387cf657 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:02.730404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f713c0ef-1413-45cc-9809-523d387cf657 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:02.730874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f713c0ef-1413-45cc-9809-523d387cf657 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:02.731283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f713c0ef-1413-45cc-9809-523d387cf657 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:03.076422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f713c0ef-1413-45cc-9809-523d387cf657 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:03.090149 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f713c0ef-1413-45cc-9809-523d387cf657 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.382602 Aug 29 15:34:03.091780 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1145/2300] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:02 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:03.271036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e45de65c-3a92-43c5-92a7-a00062b350e5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:03.271396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e45de65c-3a92-43c5-92a7-a00062b350e5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:03.302726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e45de65c-3a92-43c5-92a7-a00062b350e5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:03.303274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e45de65c-3a92-43c5-92a7-a00062b350e5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:03.303722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e45de65c-3a92-43c5-92a7-a00062b350e5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:03.304451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e45de65c-3a92-43c5-92a7-a00062b350e5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:03.304911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e45de65c-3a92-43c5-92a7-a00062b350e5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:03.305405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e45de65c-3a92-43c5-92a7-a00062b350e5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:03.329646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-59f837eb-d74a-45b1-ba41-edd8d609a6f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:03.330569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-59f837eb-d74a-45b1-ba41-edd8d609a6f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:03.338409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59f837eb-d74a-45b1-ba41-edd8d609a6f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:03.339326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59f837eb-d74a-45b1-ba41-edd8d609a6f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:03.340015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59f837eb-d74a-45b1-ba41-edd8d609a6f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:03.340955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59f837eb-d74a-45b1-ba41-edd8d609a6f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:03.341845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59f837eb-d74a-45b1-ba41-edd8d609a6f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:03.342648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59f837eb-d74a-45b1-ba41-edd8d609a6f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:03.579716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-59f837eb-d74a-45b1-ba41-edd8d609a6f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:03.592949 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-59f837eb-d74a-45b1-ba41-edd8d609a6f6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1523 microversion: 2.1 time: 0.278878 Aug 29 15:34:03.594097 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1146/2301] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:03 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:03.600987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1822bb33-cd5b-495a-a145-989db88ddbfa tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:03.602251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1822bb33-cd5b-495a-a145-989db88ddbfa tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:03.610354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1822bb33-cd5b-495a-a145-989db88ddbfa tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:03.611191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1822bb33-cd5b-495a-a145-989db88ddbfa tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:03.612031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1822bb33-cd5b-495a-a145-989db88ddbfa tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:03.613143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1822bb33-cd5b-495a-a145-989db88ddbfa tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:03.614543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1822bb33-cd5b-495a-a145-989db88ddbfa tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:03.615768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1822bb33-cd5b-495a-a145-989db88ddbfa tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:03.789979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1822bb33-cd5b-495a-a145-989db88ddbfa tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:03.826953 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1822bb33-cd5b-495a-a145-989db88ddbfa tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1330 microversion: 2.1 time: 0.228772 Aug 29 15:34:03.844371 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1147/2302] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:03 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1330 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:03.867546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9c6f82f1-2885-478c-b465-f1528dce4375 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:03.868549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9c6f82f1-2885-478c-b465-f1528dce4375 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:03.893077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6f82f1-2885-478c-b465-f1528dce4375 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:03.895217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6f82f1-2885-478c-b465-f1528dce4375 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:03.897622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6f82f1-2885-478c-b465-f1528dce4375 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:03.901433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6f82f1-2885-478c-b465-f1528dce4375 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:03.907338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6f82f1-2885-478c-b465-f1528dce4375 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:03.908159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6f82f1-2885-478c-b465-f1528dce4375 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:03.909777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e45de65c-3a92-43c5-92a7-a00062b350e5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:03.923571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e45de65c-3a92-43c5-92a7-a00062b350e5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:03.938837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e45de65c-3a92-43c5-92a7-a00062b350e5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:03.940251 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e45de65c-3a92-43c5-92a7-a00062b350e5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.673879 Aug 29 15:34:03.963014 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1156/2303] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:03 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:04.113741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3374dab3-2337-44e3-a8ed-6f032da18979 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:04.114783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3374dab3-2337-44e3-a8ed-6f032da18979 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:04.127383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3374dab3-2337-44e3-a8ed-6f032da18979 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:04.128096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3374dab3-2337-44e3-a8ed-6f032da18979 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:04.128707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3374dab3-2337-44e3-a8ed-6f032da18979 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:04.129881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3374dab3-2337-44e3-a8ed-6f032da18979 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:04.135655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3374dab3-2337-44e3-a8ed-6f032da18979 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:04.136525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3374dab3-2337-44e3-a8ed-6f032da18979 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:04.253666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9c6f82f1-2885-478c-b465-f1528dce4375 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:04.264901 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9c6f82f1-2885-478c-b465-f1528dce4375 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.419284 Aug 29 15:34:04.265538 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1148/2304] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:03 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:04.450739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3374dab3-2337-44e3-a8ed-6f032da18979 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:04.467491 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3374dab3-2337-44e3-a8ed-6f032da18979 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.355773 Aug 29 15:34:04.471220 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1157/2305] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:04 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:04.517758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-270436869", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "f1b63681-5595-428b-8a23-15bbfd2c0bdc"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:04.611543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] validate_networks() for [('f1b63681-5595-428b-8a23-15bbfd2c0bdc', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:34:04.635640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-79d531bf-0fd5-458a-930b-921ef2db8dc6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:04.637335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-79d531bf-0fd5-458a-930b-921ef2db8dc6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:04.651076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79d531bf-0fd5-458a-930b-921ef2db8dc6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:04.651595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79d531bf-0fd5-458a-930b-921ef2db8dc6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:04.652251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79d531bf-0fd5-458a-930b-921ef2db8dc6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:04.653140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79d531bf-0fd5-458a-930b-921ef2db8dc6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:04.653759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79d531bf-0fd5-458a-930b-921ef2db8dc6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:04.655244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79d531bf-0fd5-458a-930b-921ef2db8dc6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:04.874740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-79d531bf-0fd5-458a-930b-921ef2db8dc6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:04.895515 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-79d531bf-0fd5-458a-930b-921ef2db8dc6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1523 microversion: 2.1 time: 0.278703 Aug 29 15:34:04.896165 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1158/2306] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:04 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:04.901979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eefd5104-c513-4183-8032-653f88e4c4b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:04.906132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eefd5104-c513-4183-8032-653f88e4c4b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:04.914428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eefd5104-c513-4183-8032-653f88e4c4b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:04.915964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eefd5104-c513-4183-8032-653f88e4c4b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:04.916565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eefd5104-c513-4183-8032-653f88e4c4b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:04.917546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eefd5104-c513-4183-8032-653f88e4c4b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:04.918331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eefd5104-c513-4183-8032-653f88e4c4b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:04.919044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eefd5104-c513-4183-8032-653f88e4c4b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:05.020130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eefd5104-c513-4183-8032-653f88e4c4b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:05.040925 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eefd5104-c513-4183-8032-653f88e4c4b0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1330 microversion: 2.1 time: 0.143421 Aug 29 15:34:05.041991 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1159/2307] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:04 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1330 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:05.057691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a3782de9-e639-4ec4-953c-ad41b568f55a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:05.058579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a3782de9-e639-4ec4-953c-ad41b568f55a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:05.069805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3782de9-e639-4ec4-953c-ad41b568f55a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:05.070312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3782de9-e639-4ec4-953c-ad41b568f55a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:05.070778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3782de9-e639-4ec4-953c-ad41b568f55a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:05.071488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3782de9-e639-4ec4-953c-ad41b568f55a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:05.071952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3782de9-e639-4ec4-953c-ad41b568f55a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:05.072386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3782de9-e639-4ec4-953c-ad41b568f55a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:05.321359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a3782de9-e639-4ec4-953c-ad41b568f55a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:05.333745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a3782de9-e639-4ec4-953c-ad41b568f55a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:05.335592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a3782de9-e639-4ec4-953c-ad41b568f55a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:05.339505 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a3782de9-e639-4ec4-953c-ad41b568f55a tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.295695 Aug 29 15:34:05.340685 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1160/2308] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:05 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:05.354200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bde3f26a-303d-4785-9d2c-48445f92fddd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:05.355132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bde3f26a-303d-4785-9d2c-48445f92fddd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:05.365474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bde3f26a-303d-4785-9d2c-48445f92fddd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:05.366194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bde3f26a-303d-4785-9d2c-48445f92fddd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:05.367353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bde3f26a-303d-4785-9d2c-48445f92fddd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:05.368355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bde3f26a-303d-4785-9d2c-48445f92fddd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:05.369574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bde3f26a-303d-4785-9d2c-48445f92fddd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:05.370205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bde3f26a-303d-4785-9d2c-48445f92fddd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:05.372742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:34:05.373225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:34:05.373705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:34:05.374113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:34:05.374607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:34:05.390983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:05.391472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:05.391915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:05.392863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:05.393199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:05.393799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:05.412967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Getting quotas for project e9bb92cd24774733bc0f5054a240cd28. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:34:05.420798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Getting quotas for user 0f9814ba6cea472c8759e8f3bf67c734 and project e9bb92cd24774733bc0f5054a240cd28. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:34:05.441960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:34:05.444948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:34:05.538437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bde3f26a-303d-4785-9d2c-48445f92fddd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:05.547799 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f9efd42a-0439-4f4d-ab64-46fe3233001b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.281178 Aug 29 15:34:05.558084 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1149/2309] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:34:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:34:05.566199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f3d36f0a-c250-4d84-9524-49b0c2ca28e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:05.568188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f3d36f0a-c250-4d84-9524-49b0c2ca28e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:05.581294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3d36f0a-c250-4d84-9524-49b0c2ca28e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:05.581991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3d36f0a-c250-4d84-9524-49b0c2ca28e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:05.582531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3d36f0a-c250-4d84-9524-49b0c2ca28e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:05.583515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3d36f0a-c250-4d84-9524-49b0c2ca28e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:05.583878 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bde3f26a-303d-4785-9d2c-48445f92fddd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.234854 Aug 29 15:34:05.584795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3d36f0a-c250-4d84-9524-49b0c2ca28e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:05.585581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3d36f0a-c250-4d84-9524-49b0c2ca28e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:05.585836 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1161/2310] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:05 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:05.599815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dccadb03-4d6a-4fb1-82eb-2c52c0e90f86 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:05.602247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dccadb03-4d6a-4fb1-82eb-2c52c0e90f86 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:05.684330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dccadb03-4d6a-4fb1-82eb-2c52c0e90f86 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:05.695558 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dccadb03-4d6a-4fb1-82eb-2c52c0e90f86 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1217 microversion: 2.1 time: 0.108621 Aug 29 15:34:05.697268 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1162/2311] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:05 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:05.920403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-72f685fe-568a-4e47-aa10-296f6a84d602 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:05.921304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-72f685fe-568a-4e47-aa10-296f6a84d602 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:05.944690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72f685fe-568a-4e47-aa10-296f6a84d602 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:05.947117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72f685fe-568a-4e47-aa10-296f6a84d602 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:05.947998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72f685fe-568a-4e47-aa10-296f6a84d602 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:05.950353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72f685fe-568a-4e47-aa10-296f6a84d602 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:05.953748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72f685fe-568a-4e47-aa10-296f6a84d602 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:05.954286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72f685fe-568a-4e47-aa10-296f6a84d602 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:06.137264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-72f685fe-568a-4e47-aa10-296f6a84d602 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:06.150207 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-72f685fe-568a-4e47-aa10-296f6a84d602 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1505 microversion: 2.1 time: 0.235566 Aug 29 15:34:06.151417 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1163/2312] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:05 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1505 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:06.177577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0ead764c-2168-4bb6-9945-5fbd917eb2f7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:06.178357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0ead764c-2168-4bb6-9945-5fbd917eb2f7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:06.186406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ead764c-2168-4bb6-9945-5fbd917eb2f7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:06.186904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ead764c-2168-4bb6-9945-5fbd917eb2f7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:06.187688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ead764c-2168-4bb6-9945-5fbd917eb2f7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:06.188790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ead764c-2168-4bb6-9945-5fbd917eb2f7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:06.189519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ead764c-2168-4bb6-9945-5fbd917eb2f7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:06.190846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ead764c-2168-4bb6-9945-5fbd917eb2f7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:06.323703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0ead764c-2168-4bb6-9945-5fbd917eb2f7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:06.334371 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0ead764c-2168-4bb6-9945-5fbd917eb2f7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1336 microversion: 2.1 time: 0.165840 Aug 29 15:34:06.337022 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1164/2313] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:06 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1336 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:06.367043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b24c81f-5abc-45da-bf49-2056755b613b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:06.367849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6b24c81f-5abc-45da-bf49-2056755b613b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:06.380904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b24c81f-5abc-45da-bf49-2056755b613b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:06.381310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b24c81f-5abc-45da-bf49-2056755b613b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:06.383631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b24c81f-5abc-45da-bf49-2056755b613b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:06.386345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b24c81f-5abc-45da-bf49-2056755b613b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:06.386859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b24c81f-5abc-45da-bf49-2056755b613b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:06.388430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b24c81f-5abc-45da-bf49-2056755b613b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:06.599164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b24c81f-5abc-45da-bf49-2056755b613b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:06.610697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b24c81f-5abc-45da-bf49-2056755b613b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:06.613454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b24c81f-5abc-45da-bf49-2056755b613b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:06.615172 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6b24c81f-5abc-45da-bf49-2056755b613b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.254428 Aug 29 15:34:06.625240 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1165/2314] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:06 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:06.625240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-185630b8-e79c-4a87-882a-df3acbc5ab66 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:06.625240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-185630b8-e79c-4a87-882a-df3acbc5ab66 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:06.630111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-185630b8-e79c-4a87-882a-df3acbc5ab66 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:06.630621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-185630b8-e79c-4a87-882a-df3acbc5ab66 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:06.631063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-185630b8-e79c-4a87-882a-df3acbc5ab66 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:06.631781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-185630b8-e79c-4a87-882a-df3acbc5ab66 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:06.632922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-185630b8-e79c-4a87-882a-df3acbc5ab66 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:06.633376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-185630b8-e79c-4a87-882a-df3acbc5ab66 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:06.642624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f3d36f0a-c250-4d84-9524-49b0c2ca28e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:06.655648 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f3d36f0a-c250-4d84-9524-49b0c2ca28e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 1.095390 Aug 29 15:34:06.657800 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1150/2315] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:05 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:06.718874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-53f1548c-4fd0-466e-998d-b9482e699266 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:06.719925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-53f1548c-4fd0-466e-998d-b9482e699266 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:06.727103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53f1548c-4fd0-466e-998d-b9482e699266 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:06.728643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53f1548c-4fd0-466e-998d-b9482e699266 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:06.729438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53f1548c-4fd0-466e-998d-b9482e699266 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:06.730418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53f1548c-4fd0-466e-998d-b9482e699266 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:06.731277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53f1548c-4fd0-466e-998d-b9482e699266 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:06.732018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53f1548c-4fd0-466e-998d-b9482e699266 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:06.828708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-53f1548c-4fd0-466e-998d-b9482e699266 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:06.842669 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-53f1548c-4fd0-466e-998d-b9482e699266 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1213 microversion: 2.1 time: 0.128120 Aug 29 15:34:06.850284 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1151/2316] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:06 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:07.047241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-185630b8-e79c-4a87-882a-df3acbc5ab66 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:07.062311 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-185630b8-e79c-4a87-882a-df3acbc5ab66 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.443942 Aug 29 15:34:07.085473 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1166/2317] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:06 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:07.177035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d248f688-0562-4745-8789-605ad944c044 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:07.177873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d248f688-0562-4745-8789-605ad944c044 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:07.199175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d248f688-0562-4745-8789-605ad944c044 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:07.199981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d248f688-0562-4745-8789-605ad944c044 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:07.200608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d248f688-0562-4745-8789-605ad944c044 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.201578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d248f688-0562-4745-8789-605ad944c044 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:07.202178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d248f688-0562-4745-8789-605ad944c044 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:07.203009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d248f688-0562-4745-8789-605ad944c044 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.246261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:07.361338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fa23f8d6-14eb-407c-bdd7-7ad6e9f74073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:07.362257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fa23f8d6-14eb-407c-bdd7-7ad6e9f74073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:07.386863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa23f8d6-14eb-407c-bdd7-7ad6e9f74073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:07.389727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa23f8d6-14eb-407c-bdd7-7ad6e9f74073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:07.392984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa23f8d6-14eb-407c-bdd7-7ad6e9f74073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.394831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa23f8d6-14eb-407c-bdd7-7ad6e9f74073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:07.395496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa23f8d6-14eb-407c-bdd7-7ad6e9f74073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:07.401243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa23f8d6-14eb-407c-bdd7-7ad6e9f74073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.573705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d248f688-0562-4745-8789-605ad944c044 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:07.582071 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d248f688-0562-4745-8789-605ad944c044 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1505 microversion: 2.1 time: 0.410197 Aug 29 15:34:07.583093 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1152/2318] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:07 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:07.610990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fa23f8d6-14eb-407c-bdd7-7ad6e9f74073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:07.619710 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fa23f8d6-14eb-407c-bdd7-7ad6e9f74073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1378 microversion: 2.1 time: 0.263027 Aug 29 15:34:07.620552 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1167/2319] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:07 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1378 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:07.642155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-60af5029-4e96-4b58-95dd-b83a3a241832 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:07.642844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-60af5029-4e96-4b58-95dd-b83a3a241832 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:07.649963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60af5029-4e96-4b58-95dd-b83a3a241832 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:07.650455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60af5029-4e96-4b58-95dd-b83a3a241832 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:07.650884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60af5029-4e96-4b58-95dd-b83a3a241832 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.651598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60af5029-4e96-4b58-95dd-b83a3a241832 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:07.652046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60af5029-4e96-4b58-95dd-b83a3a241832 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:07.652462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60af5029-4e96-4b58-95dd-b83a3a241832 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.683700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98ed7220-48fa-4837-be49-1b3fcd99656d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:07.684385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-98ed7220-48fa-4837-be49-1b3fcd99656d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:07.703172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98ed7220-48fa-4837-be49-1b3fcd99656d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:07.704628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98ed7220-48fa-4837-be49-1b3fcd99656d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:07.705213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98ed7220-48fa-4837-be49-1b3fcd99656d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.706034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98ed7220-48fa-4837-be49-1b3fcd99656d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:07.706720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98ed7220-48fa-4837-be49-1b3fcd99656d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:07.707311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98ed7220-48fa-4837-be49-1b3fcd99656d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.903928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-60af5029-4e96-4b58-95dd-b83a3a241832 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:07.914844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-60af5029-4e96-4b58-95dd-b83a3a241832 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:07.917166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-60af5029-4e96-4b58-95dd-b83a3a241832 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:07.918809 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-60af5029-4e96-4b58-95dd-b83a3a241832 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.280939 Aug 29 15:34:07.920079 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1153/2320] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:07 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:07.925264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-323c128d-1301-48f3-8c0a-3b418f1389a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:07.926160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-323c128d-1301-48f3-8c0a-3b418f1389a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:07.935790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-98ed7220-48fa-4837-be49-1b3fcd99656d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:07.942830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-323c128d-1301-48f3-8c0a-3b418f1389a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:07.943877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-323c128d-1301-48f3-8c0a-3b418f1389a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:07.944764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-323c128d-1301-48f3-8c0a-3b418f1389a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.946363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-323c128d-1301-48f3-8c0a-3b418f1389a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:07.947007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-323c128d-1301-48f3-8c0a-3b418f1389a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:07.947817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-323c128d-1301-48f3-8c0a-3b418f1389a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:07.955086 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-98ed7220-48fa-4837-be49-1b3fcd99656d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.275820 Aug 29 15:34:07.968995 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1168/2321] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:07 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:08.051677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-323c128d-1301-48f3-8c0a-3b418f1389a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:08.061027 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-323c128d-1301-48f3-8c0a-3b418f1389a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1277 microversion: 2.1 time: 0.139589 Aug 29 15:34:08.061664 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1154/2322] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:07 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:08.086027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c4e316b8-9ef9-438d-a780-02e9dfbd0cec tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:08.086698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c4e316b8-9ef9-438d-a780-02e9dfbd0cec tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:08.093402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4e316b8-9ef9-438d-a780-02e9dfbd0cec tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.093896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4e316b8-9ef9-438d-a780-02e9dfbd0cec tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.094333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4e316b8-9ef9-438d-a780-02e9dfbd0cec tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.095048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4e316b8-9ef9-438d-a780-02e9dfbd0cec tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.095531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4e316b8-9ef9-438d-a780-02e9dfbd0cec tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.095954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4e316b8-9ef9-438d-a780-02e9dfbd0cec tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.249675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c4e316b8-9ef9-438d-a780-02e9dfbd0cec tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:08.258553 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c4e316b8-9ef9-438d-a780-02e9dfbd0cec tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.176573 Aug 29 15:34:08.268264 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1169/2323] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:08 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:08.484452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-0eb9145c-1c63-4f6a-949e-91293eee585f req-ecd6c61e-b28a-4936-af3d-f9e537305247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74984943-d6e3-4b74-b251-f05fff364c27", "tag": "f5fdbe76-975e-466c-9d17-812c0ec39457"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:08.505292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0eb9145c-1c63-4f6a-949e-91293eee585f req-ecd6c61e-b28a-4936-af3d-f9e537305247 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.506064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0eb9145c-1c63-4f6a-949e-91293eee585f req-ecd6c61e-b28a-4936-af3d-f9e537305247 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.506691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0eb9145c-1c63-4f6a-949e-91293eee585f req-ecd6c61e-b28a-4936-af3d-f9e537305247 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.519588 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-0eb9145c-1c63-4f6a-949e-91293eee585f req-ecd6c61e-b28a-4936-af3d-f9e537305247 service nova] Creating event network-changed:f5fdbe76-975e-466c-9d17-812c0ec39457 for instance 74984943-d6e3-4b74-b251-f05fff364c27 on n-h2-839401-11 Aug 29 15:34:08.525452 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-0eb9145c-1c63-4f6a-949e-91293eee585f req-ecd6c61e-b28a-4936-af3d-f9e537305247 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053024 Aug 29 15:34:08.526570 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1155/2324] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:08.604010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9b8535b1-0a09-40ad-bb0f-09893dcc182e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:08.604683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9b8535b1-0a09-40ad-bb0f-09893dcc182e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:08.611890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b8535b1-0a09-40ad-bb0f-09893dcc182e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.612669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b8535b1-0a09-40ad-bb0f-09893dcc182e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.613208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b8535b1-0a09-40ad-bb0f-09893dcc182e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.613863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b8535b1-0a09-40ad-bb0f-09893dcc182e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.614326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b8535b1-0a09-40ad-bb0f-09893dcc182e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.614755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b8535b1-0a09-40ad-bb0f-09893dcc182e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.642216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8ebf207f-f6c1-4acf-8b6b-96d3991d679a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:08.643412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8ebf207f-f6c1-4acf-8b6b-96d3991d679a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:08.651329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ebf207f-f6c1-4acf-8b6b-96d3991d679a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.651802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ebf207f-f6c1-4acf-8b6b-96d3991d679a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.652308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ebf207f-f6c1-4acf-8b6b-96d3991d679a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.653179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ebf207f-f6c1-4acf-8b6b-96d3991d679a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.653815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ebf207f-f6c1-4acf-8b6b-96d3991d679a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.654753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ebf207f-f6c1-4acf-8b6b-96d3991d679a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.766001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9b8535b1-0a09-40ad-bb0f-09893dcc182e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:08.774259 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9b8535b1-0a09-40ad-bb0f-09893dcc182e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1505 microversion: 2.1 time: 0.174759 Aug 29 15:34:08.774885 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1170/2325] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:08 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:08.944596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-35ccc3f0-d417-4114-bf41-507601a7b5e8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:08.945317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-35ccc3f0-d417-4114-bf41-507601a7b5e8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:08.951714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ccc3f0-d417-4114-bf41-507601a7b5e8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.952558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ccc3f0-d417-4114-bf41-507601a7b5e8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.953311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ccc3f0-d417-4114-bf41-507601a7b5e8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.954063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ccc3f0-d417-4114-bf41-507601a7b5e8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:08.954548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ccc3f0-d417-4114-bf41-507601a7b5e8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:08.955104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35ccc3f0-d417-4114-bf41-507601a7b5e8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:08.992481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8ebf207f-f6c1-4acf-8b6b-96d3991d679a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:09.001700 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8ebf207f-f6c1-4acf-8b6b-96d3991d679a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1378 microversion: 2.1 time: 0.363993 Aug 29 15:34:09.002606 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1156/2326] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:08 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1378 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:09.007623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a38ebd65-1ecc-4473-9f3a-c3331895cf24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:09.008436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a38ebd65-1ecc-4473-9f3a-c3331895cf24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:09.018294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38ebd65-1ecc-4473-9f3a-c3331895cf24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:09.018788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38ebd65-1ecc-4473-9f3a-c3331895cf24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:09.019228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38ebd65-1ecc-4473-9f3a-c3331895cf24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:09.019943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38ebd65-1ecc-4473-9f3a-c3331895cf24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:09.020406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38ebd65-1ecc-4473-9f3a-c3331895cf24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:09.020885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38ebd65-1ecc-4473-9f3a-c3331895cf24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:09.096659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-35ccc3f0-d417-4114-bf41-507601a7b5e8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:09.100213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:09.106092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-35ccc3f0-d417-4114-bf41-507601a7b5e8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:09.107560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-35ccc3f0-d417-4114-bf41-507601a7b5e8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:09.108753 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-35ccc3f0-d417-4114-bf41-507601a7b5e8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.168271 Aug 29 15:34:09.109408 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1171/2327] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:08 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:09.113988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-008c73f8-49c2-409b-98f4-dad98d1f32d9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:09.114599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-008c73f8-49c2-409b-98f4-dad98d1f32d9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:09.120362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-008c73f8-49c2-409b-98f4-dad98d1f32d9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:09.120848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-008c73f8-49c2-409b-98f4-dad98d1f32d9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:09.121318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-008c73f8-49c2-409b-98f4-dad98d1f32d9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:09.122020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-008c73f8-49c2-409b-98f4-dad98d1f32d9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:09.122473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-008c73f8-49c2-409b-98f4-dad98d1f32d9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:09.122897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-008c73f8-49c2-409b-98f4-dad98d1f32d9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:09.185290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-008c73f8-49c2-409b-98f4-dad98d1f32d9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:09.194376 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-008c73f8-49c2-409b-98f4-dad98d1f32d9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1277 microversion: 2.1 time: 0.083939 Aug 29 15:34:09.195167 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1172/2328] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:09 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:09.279742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bfc3fd1c-f2cd-4d04-a793-cbed66ab251c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:09.280362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bfc3fd1c-f2cd-4d04-a793-cbed66ab251c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:09.286839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfc3fd1c-f2cd-4d04-a793-cbed66ab251c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:09.287341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfc3fd1c-f2cd-4d04-a793-cbed66ab251c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:09.288068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfc3fd1c-f2cd-4d04-a793-cbed66ab251c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:09.288497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfc3fd1c-f2cd-4d04-a793-cbed66ab251c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:09.289112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfc3fd1c-f2cd-4d04-a793-cbed66ab251c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:09.289607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfc3fd1c-f2cd-4d04-a793-cbed66ab251c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:09.323585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a38ebd65-1ecc-4473-9f3a-c3331895cf24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:09.343850 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a38ebd65-1ecc-4473-9f3a-c3331895cf24 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.339716 Aug 29 15:34:09.347324 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1157/2329] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:09 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:09.448592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bfc3fd1c-f2cd-4d04-a793-cbed66ab251c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:09.463218 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bfc3fd1c-f2cd-4d04-a793-cbed66ab251c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.187607 Aug 29 15:34:09.463821 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1173/2330] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:09 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:09.795989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b5c05093-fc21-4bd5-b2ce-528b5eb1f1b6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:09.796607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b5c05093-fc21-4bd5-b2ce-528b5eb1f1b6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:09.804457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5c05093-fc21-4bd5-b2ce-528b5eb1f1b6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:09.804956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5c05093-fc21-4bd5-b2ce-528b5eb1f1b6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:09.805432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5c05093-fc21-4bd5-b2ce-528b5eb1f1b6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:09.806153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5c05093-fc21-4bd5-b2ce-528b5eb1f1b6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:09.806604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5c05093-fc21-4bd5-b2ce-528b5eb1f1b6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:09.807030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5c05093-fc21-4bd5-b2ce-528b5eb1f1b6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:09.961076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b5c05093-fc21-4bd5-b2ce-528b5eb1f1b6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:09.971103 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b5c05093-fc21-4bd5-b2ce-528b5eb1f1b6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1505 microversion: 2.1 time: 0.178761 Aug 29 15:34:09.971836 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1158/2331] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:09 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:10.025292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c90fcf2a-683f-43a1-a424-a52ed69f2688 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:10.026192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c90fcf2a-683f-43a1-a424-a52ed69f2688 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:10.036724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c90fcf2a-683f-43a1-a424-a52ed69f2688 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:10.037237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c90fcf2a-683f-43a1-a424-a52ed69f2688 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:10.038132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c90fcf2a-683f-43a1-a424-a52ed69f2688 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:10.038896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c90fcf2a-683f-43a1-a424-a52ed69f2688 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:10.038896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c90fcf2a-683f-43a1-a424-a52ed69f2688 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:10.039335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c90fcf2a-683f-43a1-a424-a52ed69f2688 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:10.132510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-473a4c32-20c3-41d7-95eb-07da27c4db4d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:10.133286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-473a4c32-20c3-41d7-95eb-07da27c4db4d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:10.141480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-473a4c32-20c3-41d7-95eb-07da27c4db4d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:10.142466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-473a4c32-20c3-41d7-95eb-07da27c4db4d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:10.143333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-473a4c32-20c3-41d7-95eb-07da27c4db4d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:10.144362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-473a4c32-20c3-41d7-95eb-07da27c4db4d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:10.146307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-473a4c32-20c3-41d7-95eb-07da27c4db4d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:10.146969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-473a4c32-20c3-41d7-95eb-07da27c4db4d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:10.287537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c90fcf2a-683f-43a1-a424-a52ed69f2688 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:10.294038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-473a4c32-20c3-41d7-95eb-07da27c4db4d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:10.316886 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c90fcf2a-683f-43a1-a424-a52ed69f2688 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1378 microversion: 2.1 time: 0.297220 Aug 29 15:34:10.317917 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1174/2332] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:10 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1378 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:10.318369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-473a4c32-20c3-41d7-95eb-07da27c4db4d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:10.324333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-850cb6bd-aa13-482f-b7ea-6c51fbbdde22 req-5991a418-7a34-4c53-94d7-5db504f47c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2", "name": "network-vif-unplugged", "status": "completed", "tag": "7e55b383-cc6f-43f7-94eb-352846be645f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:10.326139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-473a4c32-20c3-41d7-95eb-07da27c4db4d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:10.327912 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-473a4c32-20c3-41d7-95eb-07da27c4db4d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.199829 Aug 29 15:34:10.328819 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1159/2333] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:10 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:34:10.339653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-14519b71-6216-498b-b015-bdf11ff16db6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:10.347064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-14519b71-6216-498b-b015-bdf11ff16db6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:10.353615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14519b71-6216-498b-b015-bdf11ff16db6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:10.354172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14519b71-6216-498b-b015-bdf11ff16db6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:10.354698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14519b71-6216-498b-b015-bdf11ff16db6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:10.355622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14519b71-6216-498b-b015-bdf11ff16db6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:10.356445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14519b71-6216-498b-b015-bdf11ff16db6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:10.357211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14519b71-6216-498b-b015-bdf11ff16db6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:10.363042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-850cb6bd-aa13-482f-b7ea-6c51fbbdde22 req-5991a418-7a34-4c53-94d7-5db504f47c56 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:10.364453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-850cb6bd-aa13-482f-b7ea-6c51fbbdde22 req-5991a418-7a34-4c53-94d7-5db504f47c56 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:10.366132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-850cb6bd-aa13-482f-b7ea-6c51fbbdde22 req-5991a418-7a34-4c53-94d7-5db504f47c56 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:10.389159 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-850cb6bd-aa13-482f-b7ea-6c51fbbdde22 req-5991a418-7a34-4c53-94d7-5db504f47c56 service nova] Creating event network-vif-unplugged:7e55b383-cc6f-43f7-94eb-352846be645f for instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 on n-h1-839401-11 Aug 29 15:34:10.398503 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-850cb6bd-aa13-482f-b7ea-6c51fbbdde22 req-5991a418-7a34-4c53-94d7-5db504f47c56 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079202 Aug 29 15:34:10.410338 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1175/2334] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:10.418941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-71b6fecb-d485-4ba9-9249-fa4fb36c01c0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:10.419882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-71b6fecb-d485-4ba9-9249-fa4fb36c01c0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:10.428766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71b6fecb-d485-4ba9-9249-fa4fb36c01c0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:10.429693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71b6fecb-d485-4ba9-9249-fa4fb36c01c0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:10.430420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71b6fecb-d485-4ba9-9249-fa4fb36c01c0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:10.431605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71b6fecb-d485-4ba9-9249-fa4fb36c01c0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:10.432251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71b6fecb-d485-4ba9-9249-fa4fb36c01c0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:10.432847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71b6fecb-d485-4ba9-9249-fa4fb36c01c0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:10.477954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-14519b71-6216-498b-b015-bdf11ff16db6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:10.488626 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-14519b71-6216-498b-b015-bdf11ff16db6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1277 microversion: 2.1 time: 0.158360 Aug 29 15:34:10.503753 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1160/2335] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:10 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:10.509186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e21925a3-fbfe-4260-8d39-f03d90123002 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:10.510016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e21925a3-fbfe-4260-8d39-f03d90123002 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:10.517589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e21925a3-fbfe-4260-8d39-f03d90123002 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:10.518404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e21925a3-fbfe-4260-8d39-f03d90123002 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:10.519091 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e21925a3-fbfe-4260-8d39-f03d90123002 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:10.520064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e21925a3-fbfe-4260-8d39-f03d90123002 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:10.520684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e21925a3-fbfe-4260-8d39-f03d90123002 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:10.521752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e21925a3-fbfe-4260-8d39-f03d90123002 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:10.676238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-71b6fecb-d485-4ba9-9249-fa4fb36c01c0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:10.686396 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-71b6fecb-d485-4ba9-9249-fa4fb36c01c0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.274192 Aug 29 15:34:10.687683 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1176/2336] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:10 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:10.732730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e21925a3-fbfe-4260-8d39-f03d90123002 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:10.741726 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e21925a3-fbfe-4260-8d39-f03d90123002 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.236275 Aug 29 15:34:10.742642 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1161/2337] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:10 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:10.994605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e2625403-c112-4686-99e6-c9900004ac61 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:10.995272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e2625403-c112-4686-99e6-c9900004ac61 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:11.001330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:11.003628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2625403-c112-4686-99e6-c9900004ac61 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:11.004137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2625403-c112-4686-99e6-c9900004ac61 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:11.004785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2625403-c112-4686-99e6-c9900004ac61 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:11.005576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2625403-c112-4686-99e6-c9900004ac61 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:11.006050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2625403-c112-4686-99e6-c9900004ac61 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:11.006478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2625403-c112-4686-99e6-c9900004ac61 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:11.342087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bcd13774-c169-4931-8fad-31936dac4b52 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:11.343241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bcd13774-c169-4931-8fad-31936dac4b52 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:11.350866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcd13774-c169-4931-8fad-31936dac4b52 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:11.351546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcd13774-c169-4931-8fad-31936dac4b52 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:11.352155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcd13774-c169-4931-8fad-31936dac4b52 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:11.353004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcd13774-c169-4931-8fad-31936dac4b52 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:11.353609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcd13774-c169-4931-8fad-31936dac4b52 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:11.354192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcd13774-c169-4931-8fad-31936dac4b52 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:11.398392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e2625403-c112-4686-99e6-c9900004ac61 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:11.408686 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e2625403-c112-4686-99e6-c9900004ac61 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 200 len: 1508 microversion: 2.1 time: 0.417771 Aug 29 15:34:11.409319 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1177/2338] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:10 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 1508 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:11.414923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f244bf8f-8d05-49c6-9045-c403c0c2db83 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:11.415528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f244bf8f-8d05-49c6-9045-c403c0c2db83 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:11.422883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f244bf8f-8d05-49c6-9045-c403c0c2db83 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:11.423859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f244bf8f-8d05-49c6-9045-c403c0c2db83 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:11.425177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f244bf8f-8d05-49c6-9045-c403c0c2db83 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:11.425943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f244bf8f-8d05-49c6-9045-c403c0c2db83 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:11.426437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f244bf8f-8d05-49c6-9045-c403c0c2db83 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:11.426854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f244bf8f-8d05-49c6-9045-c403c0c2db83 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:11.478988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=14 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:11.537751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bcd13774-c169-4931-8fad-31936dac4b52 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:11.545884 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bcd13774-c169-4931-8fad-31936dac4b52 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1378 microversion: 2.1 time: 0.208030 Aug 29 15:34:11.546629 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1162/2339] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:11 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1378 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:11.551659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:11.552386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:11.558867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:11.559555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:11.560123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:11.560987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:11.561881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:11.562538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:11.598705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:11.605894 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.compute.api [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Working on deleting snapshot a07d7891-bff3-4dad-9bd2-7c5db9f0bb70 from shelved instance... Aug 29 15:34:11.775077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f244bf8f-8d05-49c6-9045-c403c0c2db83 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:11.812983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f244bf8f-8d05-49c6-9045-c403c0c2db83 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:11.820255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f244bf8f-8d05-49c6-9045-c403c0c2db83 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:11.822129 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f244bf8f-8d05-49c6-9045-c403c0c2db83 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.411599 Aug 29 15:34:11.838627 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1178/2340] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:11 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:11.844119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-08ebe490-3bd1-4d8a-ad19-ad6d85bc3096 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:11.844767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-08ebe490-3bd1-4d8a-ad19-ad6d85bc3096 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:11.864251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08ebe490-3bd1-4d8a-ad19-ad6d85bc3096 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:11.864764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08ebe490-3bd1-4d8a-ad19-ad6d85bc3096 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:11.865235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08ebe490-3bd1-4d8a-ad19-ad6d85bc3096 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:11.866154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08ebe490-3bd1-4d8a-ad19-ad6d85bc3096 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:11.866764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08ebe490-3bd1-4d8a-ad19-ad6d85bc3096 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:11.867477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08ebe490-3bd1-4d8a-ad19-ad6d85bc3096 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:12.209557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-08ebe490-3bd1-4d8a-ad19-ad6d85bc3096 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:12.218180 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-08ebe490-3bd1-4d8a-ad19-ad6d85bc3096 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1317 microversion: 2.1 time: 0.383243 Aug 29 15:34:12.219219 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1179/2341] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:11 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:12.224861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-01ac95ec-d4f9-4105-aa5d-13558da24221 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:12.225723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-01ac95ec-d4f9-4105-aa5d-13558da24221 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:12.232804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01ac95ec-d4f9-4105-aa5d-13558da24221 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:12.233752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01ac95ec-d4f9-4105-aa5d-13558da24221 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:12.234425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01ac95ec-d4f9-4105-aa5d-13558da24221 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:12.235408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01ac95ec-d4f9-4105-aa5d-13558da24221 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:12.235993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01ac95ec-d4f9-4105-aa5d-13558da24221 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:12.236521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01ac95ec-d4f9-4105-aa5d-13558da24221 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:12.381805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Doing local delete in cell dcf211bc-da73-4d63-b885-2b9e7c1e329b(cell1) {{(pid=122361) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 29 15:34:12.382523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:12.383000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:12.383469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:12.383925 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.compute.api [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 29 15:34:12.388576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] deallocate_for_instance() {{(pid=122361) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 29 15:34:12.467187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-01ac95ec-d4f9-4105-aa5d-13558da24221 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:12.475514 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-01ac95ec-d4f9-4105-aa5d-13558da24221 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.254957 Aug 29 15:34:12.476334 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1180/2342] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:12 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:12.481187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b10ade9b-14d1-49de-bc2e-ae3d155edada tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:12.481811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b10ade9b-14d1-49de-bc2e-ae3d155edada tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:12.489150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b10ade9b-14d1-49de-bc2e-ae3d155edada tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:12.489881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b10ade9b-14d1-49de-bc2e-ae3d155edada tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:12.490466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b10ade9b-14d1-49de-bc2e-ae3d155edada tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:12.491441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b10ade9b-14d1-49de-bc2e-ae3d155edada tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:12.492052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b10ade9b-14d1-49de-bc2e-ae3d155edada tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:12.492479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b10ade9b-14d1-49de-bc2e-ae3d155edada tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:12.732001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b10ade9b-14d1-49de-bc2e-ae3d155edada tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:12.749781 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b10ade9b-14d1-49de-bc2e-ae3d155edada tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.272075 Aug 29 15:34:12.761553 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1181/2343] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:12 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:12.769916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-40a9cd1b-a2d0-4c85-9875-2f0af202473d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:12.770889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-40a9cd1b-a2d0-4c85-9875-2f0af202473d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:12.777937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40a9cd1b-a2d0-4c85-9875-2f0af202473d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:12.778614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40a9cd1b-a2d0-4c85-9875-2f0af202473d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:12.779499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40a9cd1b-a2d0-4c85-9875-2f0af202473d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:12.780458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40a9cd1b-a2d0-4c85-9875-2f0af202473d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:12.781143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40a9cd1b-a2d0-4c85-9875-2f0af202473d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:12.781782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40a9cd1b-a2d0-4c85-9875-2f0af202473d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:12.952618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Updating instance_info_cache with network_info: [] {{(pid=122361) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:34:13.036895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-40a9cd1b-a2d0-4c85-9875-2f0af202473d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:13.047403 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-40a9cd1b-a2d0-4c85-9875-2f0af202473d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1378 microversion: 2.1 time: 0.281245 Aug 29 15:34:13.048252 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1182/2344] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:12 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1378 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:13.072960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ff59db85-04ab-462e-b709-c4b9ebfb53b4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:13.079720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ff59db85-04ab-462e-b709-c4b9ebfb53b4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:13.102962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff59db85-04ab-462e-b709-c4b9ebfb53b4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:13.104620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff59db85-04ab-462e-b709-c4b9ebfb53b4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:13.105141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff59db85-04ab-462e-b709-c4b9ebfb53b4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:13.107408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff59db85-04ab-462e-b709-c4b9ebfb53b4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:13.108731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff59db85-04ab-462e-b709-c4b9ebfb53b4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:13.110070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff59db85-04ab-462e-b709-c4b9ebfb53b4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:13.227333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:13.243033 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5a32043c-aa47-478f-82f1-24e87aeaebe2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 204 len: 0 microversion: 2.1 time: 1.695235 Aug 29 15:34:13.244044 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1163/2345] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:34:11 2022] DELETE /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 0 bytes in 1697 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:34:13.249426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-a80ca211-973d-4d18-b50b-f59257702d64 req-12e2ab39-794d-4ae0-9411-65c83f28e3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2", "name": "network-vif-deleted", "tag": "7e55b383-cc6f-43f7-94eb-352846be645f"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:13.260672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a80ca211-973d-4d18-b50b-f59257702d64 req-12e2ab39-794d-4ae0-9411-65c83f28e3f4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:13.261168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a80ca211-973d-4d18-b50b-f59257702d64 req-12e2ab39-794d-4ae0-9411-65c83f28e3f4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:13.261592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a80ca211-973d-4d18-b50b-f59257702d64 req-12e2ab39-794d-4ae0-9411-65c83f28e3f4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:13.275834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.compute.server_external_events [req-a80ca211-973d-4d18-b50b-f59257702d64 req-12e2ab39-794d-4ae0-9411-65c83f28e3f4 service nova] Unable to find a host for instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2. Dropping event network-vif-deleted {{(pid=122361) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 15:34:13.276743 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-a80ca211-973d-4d18-b50b-f59257702d64 req-12e2ab39-794d-4ae0-9411-65c83f28e3f4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.031506 Aug 29 15:34:13.277401 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1164/2346] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 15:34:13.282450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-5b745a27-7003-4eb3-a88b-77e364aee63e req-cbee8283-168c-4ad9-81cc-78d249912a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f838765-3a8a-47c2-9907-367ddaf2d90f", "tag": "0f30a440-530f-4c46-b4fb-89f0c9814d97"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:13.292640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5b745a27-7003-4eb3-a88b-77e364aee63e req-cbee8283-168c-4ad9-81cc-78d249912a23 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:13.293157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5b745a27-7003-4eb3-a88b-77e364aee63e req-cbee8283-168c-4ad9-81cc-78d249912a23 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:13.293600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5b745a27-7003-4eb3-a88b-77e364aee63e req-cbee8283-168c-4ad9-81cc-78d249912a23 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:13.304580 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5b745a27-7003-4eb3-a88b-77e364aee63e req-cbee8283-168c-4ad9-81cc-78d249912a23 service nova] Creating event network-changed:0f30a440-530f-4c46-b4fb-89f0c9814d97 for instance 0f838765-3a8a-47c2-9907-367ddaf2d90f on n-h1-839401-11 Aug 29 15:34:13.310149 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-5b745a27-7003-4eb3-a88b-77e364aee63e req-cbee8283-168c-4ad9-81cc-78d249912a23 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031528 Aug 29 15:34:13.311496 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1165/2347] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:13.316685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1cf9898b-9254-4ed8-aaab-2b052a42a7ae tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:13.317402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1cf9898b-9254-4ed8-aaab-2b052a42a7ae tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:13.324386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cf9898b-9254-4ed8-aaab-2b052a42a7ae tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:13.325258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cf9898b-9254-4ed8-aaab-2b052a42a7ae tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:13.325258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cf9898b-9254-4ed8-aaab-2b052a42a7ae tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:13.326469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cf9898b-9254-4ed8-aaab-2b052a42a7ae tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:13.326469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cf9898b-9254-4ed8-aaab-2b052a42a7ae tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:13.326817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cf9898b-9254-4ed8-aaab-2b052a42a7ae tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:13.438937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ff59db85-04ab-462e-b709-c4b9ebfb53b4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:13.450902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ff59db85-04ab-462e-b709-c4b9ebfb53b4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:13.452962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ff59db85-04ab-462e-b709-c4b9ebfb53b4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:13.454521 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ff59db85-04ab-462e-b709-c4b9ebfb53b4 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1486 microversion: 2.25 time: 0.391614 Aug 29 15:34:13.455224 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1183/2348] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:13 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1486 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:13.465640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6e8d6d8d-1e37-4fbe-af50-ea82e63ac5a6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:13.466887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6e8d6d8d-1e37-4fbe-af50-ea82e63ac5a6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:13.475621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e8d6d8d-1e37-4fbe-af50-ea82e63ac5a6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:13.476618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e8d6d8d-1e37-4fbe-af50-ea82e63ac5a6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:13.477210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e8d6d8d-1e37-4fbe-af50-ea82e63ac5a6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:13.478179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e8d6d8d-1e37-4fbe-af50-ea82e63ac5a6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:13.478889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e8d6d8d-1e37-4fbe-af50-ea82e63ac5a6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:13.479398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e8d6d8d-1e37-4fbe-af50-ea82e63ac5a6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:13.494779 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-6e8d6d8d-1e37-4fbe-af50-ea82e63ac5a6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6e8d6d8d-1e37-4fbe-af50-ea82e63ac5a6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 HTTP/1.1 Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2'} Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:13.496548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:13.510217 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:13.510217 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:13.510217 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:13.510217 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:13.510217 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:13.510217 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. Aug 29 15:34:13.510217 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:13.510217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6e8d6d8d-1e37-4fbe-af50-ea82e63ac5a6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:13.510217 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6e8d6d8d-1e37-4fbe-af50-ea82e63ac5a6 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 404 len: 111 microversion: 2.1 time: 0.041195 Aug 29 15:34:13.510217 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1184/2349] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:13 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:34:13.510217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-855c9be0-fe6a-4660-8584-9e12be80e29a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:13.510217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-855c9be0-fe6a-4660-8584-9e12be80e29a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:13.511675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-855c9be0-fe6a-4660-8584-9e12be80e29a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:13.511675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-855c9be0-fe6a-4660-8584-9e12be80e29a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:13.511675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-855c9be0-fe6a-4660-8584-9e12be80e29a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:13.511907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-855c9be0-fe6a-4660-8584-9e12be80e29a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:13.512349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-855c9be0-fe6a-4660-8584-9e12be80e29a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:13.512943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-855c9be0-fe6a-4660-8584-9e12be80e29a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:13.719349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-855c9be0-fe6a-4660-8584-9e12be80e29a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:13.730649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1cf9898b-9254-4ed8-aaab-2b052a42a7ae tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:13.734433 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-855c9be0-fe6a-4660-8584-9e12be80e29a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.234495 Aug 29 15:34:13.735643 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1185/2350] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:13 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:13.741077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1617224931", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "cb3199df-483a-4605-86c6-a5d65679d5da"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:13.745896 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1cf9898b-9254-4ed8-aaab-2b052a42a7ae tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1317 microversion: 2.1 time: 0.433166 Aug 29 15:34:13.760660 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1166/2351] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:13 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:13.772741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-91736d26-d853-4c4f-b0ab-5ce1d6f503c4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:13.773614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-91736d26-d853-4c4f-b0ab-5ce1d6f503c4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:13.780729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91736d26-d853-4c4f-b0ab-5ce1d6f503c4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:13.781252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91736d26-d853-4c4f-b0ab-5ce1d6f503c4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:13.781695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91736d26-d853-4c4f-b0ab-5ce1d6f503c4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:13.782451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91736d26-d853-4c4f-b0ab-5ce1d6f503c4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:13.782928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91736d26-d853-4c4f-b0ab-5ce1d6f503c4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:13.783385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91736d26-d853-4c4f-b0ab-5ce1d6f503c4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:13.808347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] validate_networks() for [('cb3199df-483a-4605-86c6-a5d65679d5da', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:34:14.236316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:34:14.236761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:34:14.237312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:34:14.237851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:34:14.238282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:34:14.248334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.249069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.249677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.250564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.251017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.251599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.271156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Getting quotas for project bbbc9e55a8f24d70a82b79243b0fa9e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:34:14.277210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Getting quotas for user 8dbbadfdb27047dd9237f4a1d311867e and project bbbc9e55a8f24d70a82b79243b0fa9e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:34:14.291767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:34:14.294280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:34:14.342991 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ab1ad143-137d-4958-aa61-6d76318467f4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606189 Aug 29 15:34:14.349193 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1186/2352] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:34:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:34:14.362668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d8e92949-c78b-4b46-85b6-b8059667aae5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:14.368593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d8e92949-c78b-4b46-85b6-b8059667aae5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:14.380209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8e92949-c78b-4b46-85b6-b8059667aae5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.381477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8e92949-c78b-4b46-85b6-b8059667aae5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.382272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8e92949-c78b-4b46-85b6-b8059667aae5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.383157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8e92949-c78b-4b46-85b6-b8059667aae5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.384163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8e92949-c78b-4b46-85b6-b8059667aae5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.384747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8e92949-c78b-4b46-85b6-b8059667aae5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.434991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-91736d26-d853-4c4f-b0ab-5ce1d6f503c4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:14.453229 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-91736d26-d853-4c4f-b0ab-5ce1d6f503c4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.684706 Aug 29 15:34:14.467464 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1167/2353] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:13 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:14.467464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4bb0e768-ba08-4c8d-9310-7cc9bdd9b2ab tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:14.467464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4bb0e768-ba08-4c8d-9310-7cc9bdd9b2ab tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:14.556929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4bb0e768-ba08-4c8d-9310-7cc9bdd9b2ab tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:14.567350 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4bb0e768-ba08-4c8d-9310-7cc9bdd9b2ab tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1215 microversion: 2.1 time: 0.110682 Aug 29 15:34:14.569530 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1168/2354] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:14 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:14.576806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b4ddd88e-06e4-46e9-818c-f5f6fbabe2bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:14.577557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b4ddd88e-06e4-46e9-818c-f5f6fbabe2bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:14.584563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4ddd88e-06e4-46e9-818c-f5f6fbabe2bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.585154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4ddd88e-06e4-46e9-818c-f5f6fbabe2bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.585771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4ddd88e-06e4-46e9-818c-f5f6fbabe2bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.586635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4ddd88e-06e4-46e9-818c-f5f6fbabe2bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.587099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4ddd88e-06e4-46e9-818c-f5f6fbabe2bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.587537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4ddd88e-06e4-46e9-818c-f5f6fbabe2bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.591878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d8e92949-c78b-4b46-85b6-b8059667aae5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:14.601725 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d8e92949-c78b-4b46-85b6-b8059667aae5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1378 microversion: 2.1 time: 0.250774 Aug 29 15:34:14.603057 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1187/2355] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:14 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1378 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:14.760026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8e526804-28d1-4522-90d9-b6ec8996c857 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:14.763657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8e526804-28d1-4522-90d9-b6ec8996c857 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:14.771060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e526804-28d1-4522-90d9-b6ec8996c857 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.771606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e526804-28d1-4522-90d9-b6ec8996c857 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.771981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e526804-28d1-4522-90d9-b6ec8996c857 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.772827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e526804-28d1-4522-90d9-b6ec8996c857 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.773939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e526804-28d1-4522-90d9-b6ec8996c857 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.774517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e526804-28d1-4522-90d9-b6ec8996c857 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.876911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b4ddd88e-06e4-46e9-818c-f5f6fbabe2bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:14.888740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b4ddd88e-06e4-46e9-818c-f5f6fbabe2bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:14.890456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b4ddd88e-06e4-46e9-818c-f5f6fbabe2bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:14.891662 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b4ddd88e-06e4-46e9-818c-f5f6fbabe2bd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1476 microversion: 2.25 time: 0.320201 Aug 29 15:34:14.892280 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1169/2356] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:14 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1476 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:14.905415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-930d45e4-c4c9-4335-b2ab-b5c347a514a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:14.906338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-930d45e4-c4c9-4335-b2ab-b5c347a514a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:14.914149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-930d45e4-c4c9-4335-b2ab-b5c347a514a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.914783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-930d45e4-c4c9-4335-b2ab-b5c347a514a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.915344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-930d45e4-c4c9-4335-b2ab-b5c347a514a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.916254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-930d45e4-c4c9-4335-b2ab-b5c347a514a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.916914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-930d45e4-c4c9-4335-b2ab-b5c347a514a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.917435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-930d45e4-c4c9-4335-b2ab-b5c347a514a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.933099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8e526804-28d1-4522-90d9-b6ec8996c857 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:14.941776 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8e526804-28d1-4522-90d9-b6ec8996c857 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.187859 Aug 29 15:34:14.942518 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1188/2357] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:14 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:14.947845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f70a6cbf-2251-4ed1-bb9f-c6a87acb1afa tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '.version_select at 0x7fc42be02b80>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:14.951776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f70a6cbf-2251-4ed1-bb9f-c6a87acb1afa tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.952348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f70a6cbf-2251-4ed1-bb9f-c6a87acb1afa tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.952875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f70a6cbf-2251-4ed1-bb9f-c6a87acb1afa tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.970375 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f70a6cbf-2251-4ed1-bb9f-c6a87acb1afa tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/os-migrations" status: 200 len: 4751 microversion: 2.25 time: 0.026610 Aug 29 15:34:14.971123 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1189/2358] 10.222.0.62 () {60 vars in 1184 bytes} [Mon Aug 29 15:34:14 2022] GET /compute/v2.1/os-migrations => generated 4751 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:14.987247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-415e9be4-c383-460c-b8ed-c56fd18c3bb6 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:14.987916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-415e9be4-c383-460c-b8ed-c56fd18c3bb6 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:14.994651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-415e9be4-c383-460c-b8ed-c56fd18c3bb6 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.995131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-415e9be4-c383-460c-b8ed-c56fd18c3bb6 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.995796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-415e9be4-c383-460c-b8ed-c56fd18c3bb6 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:14.996651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-415e9be4-c383-460c-b8ed-c56fd18c3bb6 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:14.998474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-415e9be4-c383-460c-b8ed-c56fd18c3bb6 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:14.999149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-415e9be4-c383-460c-b8ed-c56fd18c3bb6 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.091514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-930d45e4-c4c9-4335-b2ab-b5c347a514a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:15.100275 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-930d45e4-c4c9-4335-b2ab-b5c347a514a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1317 microversion: 2.1 time: 0.201746 Aug 29 15:34:15.101112 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1170/2359] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:14 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:15.171515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-415e9be4-c383-460c-b8ed-c56fd18c3bb6 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] Lazy-loading 'services' on Instance uuid d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:15.174952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:15.186387 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-415e9be4-c383-460c-b8ed-c56fd18c3bb6 tempest-LiveAutoBlockMigrationV225Test-354114141 tempest-LiveAutoBlockMigrationV225Test-354114141-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1970 microversion: 2.25 time: 0.202776 Aug 29 15:34:15.187027 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1190/2360] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:14 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1970 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:34:15.228042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1cdefce6-3cc0-490c-bf99-b9ed7cbbffed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:15.228818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1cdefce6-3cc0-490c-bf99-b9ed7cbbffed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:15.235268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cdefce6-3cc0-490c-bf99-b9ed7cbbffed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.235887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cdefce6-3cc0-490c-bf99-b9ed7cbbffed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.236371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cdefce6-3cc0-490c-bf99-b9ed7cbbffed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.237187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cdefce6-3cc0-490c-bf99-b9ed7cbbffed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.237737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cdefce6-3cc0-490c-bf99-b9ed7cbbffed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.238221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cdefce6-3cc0-490c-bf99-b9ed7cbbffed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.264686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1cdefce6-3cc0-490c-bf99-b9ed7cbbffed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:15.331755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:15.348623 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1cdefce6-3cc0-490c-bf99-b9ed7cbbffed tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 204 len: 0 microversion: 2.25 time: 0.124545 Aug 29 15:34:15.349310 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1171/2361] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:34:15 2022] DELETE /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:34:15.358029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-38ea4b9b-e92b-4664-a236-04a1e3f7b0f0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:15.358782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-38ea4b9b-e92b-4664-a236-04a1e3f7b0f0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:15.365158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38ea4b9b-e92b-4664-a236-04a1e3f7b0f0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.365609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38ea4b9b-e92b-4664-a236-04a1e3f7b0f0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.366047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38ea4b9b-e92b-4664-a236-04a1e3f7b0f0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.366739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38ea4b9b-e92b-4664-a236-04a1e3f7b0f0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.367193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38ea4b9b-e92b-4664-a236-04a1e3f7b0f0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.367704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38ea4b9b-e92b-4664-a236-04a1e3f7b0f0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.475321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-78fdf3ad-ffd8-42c5-9e74-0960f42cd3ad tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:15.476166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-78fdf3ad-ffd8-42c5-9e74-0960f42cd3ad tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:15.480526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:15.488159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78fdf3ad-ffd8-42c5-9e74-0960f42cd3ad tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.488645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78fdf3ad-ffd8-42c5-9e74-0960f42cd3ad tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.489118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78fdf3ad-ffd8-42c5-9e74-0960f42cd3ad tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.489857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78fdf3ad-ffd8-42c5-9e74-0960f42cd3ad tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.490444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78fdf3ad-ffd8-42c5-9e74-0960f42cd3ad tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.490930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78fdf3ad-ffd8-42c5-9e74-0960f42cd3ad tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.506550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-38ea4b9b-e92b-4664-a236-04a1e3f7b0f0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:15.515911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-38ea4b9b-e92b-4664-a236-04a1e3f7b0f0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:15.517376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-38ea4b9b-e92b-4664-a236-04a1e3f7b0f0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:15.518763 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-38ea4b9b-e92b-4664-a236-04a1e3f7b0f0 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1482 microversion: 2.25 time: 0.164948 Aug 29 15:34:15.520007 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1191/2362] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:15 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1482 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:15.589558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-26e7ce76-3c72-4ae9-87a0-fc6cca6a3da8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:15.590071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-26e7ce76-3c72-4ae9-87a0-fc6cca6a3da8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:15.596538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26e7ce76-3c72-4ae9-87a0-fc6cca6a3da8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.597287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26e7ce76-3c72-4ae9-87a0-fc6cca6a3da8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.597512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26e7ce76-3c72-4ae9-87a0-fc6cca6a3da8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.598277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26e7ce76-3c72-4ae9-87a0-fc6cca6a3da8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.598741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26e7ce76-3c72-4ae9-87a0-fc6cca6a3da8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.599174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26e7ce76-3c72-4ae9-87a0-fc6cca6a3da8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.630771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-78fdf3ad-ffd8-42c5-9e74-0960f42cd3ad tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:15.639572 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-78fdf3ad-ffd8-42c5-9e74-0960f42cd3ad tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.168609 Aug 29 15:34:15.640167 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1172/2363] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:15 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:15.645751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-acd1ae98-dbb6-43a3-a3bb-d01a068a53af tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:15.646392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-acd1ae98-dbb6-43a3-a3bb-d01a068a53af tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:15.653379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acd1ae98-dbb6-43a3-a3bb-d01a068a53af tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.654247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acd1ae98-dbb6-43a3-a3bb-d01a068a53af tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.654751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acd1ae98-dbb6-43a3-a3bb-d01a068a53af tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.655579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acd1ae98-dbb6-43a3-a3bb-d01a068a53af tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.656041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acd1ae98-dbb6-43a3-a3bb-d01a068a53af tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.656490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acd1ae98-dbb6-43a3-a3bb-d01a068a53af tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.664129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-26e7ce76-3c72-4ae9-87a0-fc6cca6a3da8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:15.672498 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-26e7ce76-3c72-4ae9-87a0-fc6cca6a3da8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1219 microversion: 2.1 time: 0.087073 Aug 29 15:34:15.673330 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1192/2364] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:15 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:15.798292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-acd1ae98-dbb6-43a3-a3bb-d01a068a53af tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:15.807506 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-acd1ae98-dbb6-43a3-a3bb-d01a068a53af tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1378 microversion: 2.1 time: 0.165761 Aug 29 15:34:15.808630 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1173/2365] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:15 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1378 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:15.969834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-863877a5-0e1b-4829-960c-7e07c985caf1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:15.970617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-863877a5-0e1b-4829-960c-7e07c985caf1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:15.977976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-863877a5-0e1b-4829-960c-7e07c985caf1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.978544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-863877a5-0e1b-4829-960c-7e07c985caf1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.978995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-863877a5-0e1b-4829-960c-7e07c985caf1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:15.979718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-863877a5-0e1b-4829-960c-7e07c985caf1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:15.980171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-863877a5-0e1b-4829-960c-7e07c985caf1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:15.980676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-863877a5-0e1b-4829-960c-7e07c985caf1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.126295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6480b720-2703-4fbb-ab1e-f4187e68b0cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:16.127168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6480b720-2703-4fbb-ab1e-f4187e68b0cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:16.131980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-863877a5-0e1b-4829-960c-7e07c985caf1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:16.133934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6480b720-2703-4fbb-ab1e-f4187e68b0cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:16.134433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6480b720-2703-4fbb-ab1e-f4187e68b0cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:16.134862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6480b720-2703-4fbb-ab1e-f4187e68b0cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.135552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6480b720-2703-4fbb-ab1e-f4187e68b0cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:16.135999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6480b720-2703-4fbb-ab1e-f4187e68b0cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:16.136415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6480b720-2703-4fbb-ab1e-f4187e68b0cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.140768 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-863877a5-0e1b-4829-960c-7e07c985caf1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.175829 Aug 29 15:34:16.141756 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1193/2366] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:15 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:16.279190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6480b720-2703-4fbb-ab1e-f4187e68b0cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:16.288146 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6480b720-2703-4fbb-ab1e-f4187e68b0cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1317 microversion: 2.1 time: 0.168838 Aug 29 15:34:16.288788 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1174/2367] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:16 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:16.543425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eebd8b44-00b2-4f7e-bc6f-6e324b088e43 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:16.544168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eebd8b44-00b2-4f7e-bc6f-6e324b088e43 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:16.551427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eebd8b44-00b2-4f7e-bc6f-6e324b088e43 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:16.551983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eebd8b44-00b2-4f7e-bc6f-6e324b088e43 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:16.552431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eebd8b44-00b2-4f7e-bc6f-6e324b088e43 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.553221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eebd8b44-00b2-4f7e-bc6f-6e324b088e43 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:16.553680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eebd8b44-00b2-4f7e-bc6f-6e324b088e43 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:16.554108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eebd8b44-00b2-4f7e-bc6f-6e324b088e43 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.661864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c88455b9-d693-4fde-be62-1dc3e1372a1c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:16.662278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c88455b9-d693-4fde-be62-1dc3e1372a1c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:16.669878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c88455b9-d693-4fde-be62-1dc3e1372a1c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:16.670490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c88455b9-d693-4fde-be62-1dc3e1372a1c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:16.670939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c88455b9-d693-4fde-be62-1dc3e1372a1c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.671810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c88455b9-d693-4fde-be62-1dc3e1372a1c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:16.672268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c88455b9-d693-4fde-be62-1dc3e1372a1c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:16.672715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c88455b9-d693-4fde-be62-1dc3e1372a1c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.728839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eebd8b44-00b2-4f7e-bc6f-6e324b088e43 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:16.739463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eebd8b44-00b2-4f7e-bc6f-6e324b088e43 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:16.741278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eebd8b44-00b2-4f7e-bc6f-6e324b088e43 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:16.742735 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eebd8b44-00b2-4f7e-bc6f-6e324b088e43 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1482 microversion: 2.25 time: 0.203680 Aug 29 15:34:16.743324 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1194/2368] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:16 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1482 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:16.755230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2171da29-572a-49c0-bd3e-0fb9ae00406e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:16.755230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2171da29-572a-49c0-bd3e-0fb9ae00406e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:16.760509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2171da29-572a-49c0-bd3e-0fb9ae00406e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:16.761147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2171da29-572a-49c0-bd3e-0fb9ae00406e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:16.761615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2171da29-572a-49c0-bd3e-0fb9ae00406e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.762331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2171da29-572a-49c0-bd3e-0fb9ae00406e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:16.762842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2171da29-572a-49c0-bd3e-0fb9ae00406e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:16.763276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2171da29-572a-49c0-bd3e-0fb9ae00406e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.833524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c88455b9-d693-4fde-be62-1dc3e1372a1c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:16.833939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2171da29-572a-49c0-bd3e-0fb9ae00406e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:16.842290 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2171da29-572a-49c0-bd3e-0fb9ae00406e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1211 microversion: 2.1 time: 0.097910 Aug 29 15:34:16.842487 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c88455b9-d693-4fde-be62-1dc3e1372a1c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.185273 Aug 29 15:34:16.843123 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1195/2369] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:16 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:16.847726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bc69eb16-b626-4bdf-9f1e-1e5a1510c799 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:16.848333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bc69eb16-b626-4bdf-9f1e-1e5a1510c799 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:16.853554 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1175/2370] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:16 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:16.855185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc69eb16-b626-4bdf-9f1e-1e5a1510c799 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:16.855750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc69eb16-b626-4bdf-9f1e-1e5a1510c799 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:16.856243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc69eb16-b626-4bdf-9f1e-1e5a1510c799 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.857002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc69eb16-b626-4bdf-9f1e-1e5a1510c799 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:16.857543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc69eb16-b626-4bdf-9f1e-1e5a1510c799 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:16.858051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc69eb16-b626-4bdf-9f1e-1e5a1510c799 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:16.995095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bc69eb16-b626-4bdf-9f1e-1e5a1510c799 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:17.004220 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bc69eb16-b626-4bdf-9f1e-1e5a1510c799 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1378 microversion: 2.1 time: 0.160260 Aug 29 15:34:17.004829 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1196/2371] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:16 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1378 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:17.163112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9644e636-4db6-4a00-9907-111f93001ccc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:17.163873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9644e636-4db6-4a00-9907-111f93001ccc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:17.172086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9644e636-4db6-4a00-9907-111f93001ccc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.172691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9644e636-4db6-4a00-9907-111f93001ccc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.173148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9644e636-4db6-4a00-9907-111f93001ccc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.173924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9644e636-4db6-4a00-9907-111f93001ccc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.174442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9644e636-4db6-4a00-9907-111f93001ccc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.174933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9644e636-4db6-4a00-9907-111f93001ccc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.309628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e960e42b-6ad8-44f0-9fca-a71a1e090a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:17.310521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e960e42b-6ad8-44f0-9fca-a71a1e090a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:17.315445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9644e636-4db6-4a00-9907-111f93001ccc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:17.317980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e960e42b-6ad8-44f0-9fca-a71a1e090a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.318613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e960e42b-6ad8-44f0-9fca-a71a1e090a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.319123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e960e42b-6ad8-44f0-9fca-a71a1e090a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.320032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e960e42b-6ad8-44f0-9fca-a71a1e090a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.320565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e960e42b-6ad8-44f0-9fca-a71a1e090a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.321003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e960e42b-6ad8-44f0-9fca-a71a1e090a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.324372 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9644e636-4db6-4a00-9907-111f93001ccc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.165924 Aug 29 15:34:17.325176 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1176/2372] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:17 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:17.547437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-37bc2e4c-7547-442c-bf71-5119ef9f6f5e req-119e8048-13d6-4744-bb9d-ecda85526d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74984943-d6e3-4b74-b251-f05fff364c27", "name": "network-vif-plugged", "status": "completed", "tag": "f5fdbe76-975e-466c-9d17-812c0ec39457"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:17.567078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-37bc2e4c-7547-442c-bf71-5119ef9f6f5e req-119e8048-13d6-4744-bb9d-ecda85526d58 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.567078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-37bc2e4c-7547-442c-bf71-5119ef9f6f5e req-119e8048-13d6-4744-bb9d-ecda85526d58 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.568893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-37bc2e4c-7547-442c-bf71-5119ef9f6f5e req-119e8048-13d6-4744-bb9d-ecda85526d58 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.581410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e960e42b-6ad8-44f0-9fca-a71a1e090a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:17.585948 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-37bc2e4c-7547-442c-bf71-5119ef9f6f5e req-119e8048-13d6-4744-bb9d-ecda85526d58 service nova] Creating event network-vif-plugged:f5fdbe76-975e-466c-9d17-812c0ec39457 for instance 74984943-d6e3-4b74-b251-f05fff364c27 on n-h2-839401-11 Aug 29 15:34:17.590961 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e960e42b-6ad8-44f0-9fca-a71a1e090a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1317 microversion: 2.1 time: 0.285624 Aug 29 15:34:17.591304 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-37bc2e4c-7547-442c-bf71-5119ef9f6f5e req-119e8048-13d6-4744-bb9d-ecda85526d58 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048996 Aug 29 15:34:17.592076 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1177/2373] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:17.595632 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1197/2374] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:17 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:17.767668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-53f7edfd-1f1d-4446-a6e0-211baeb8bfaa tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:17.768451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-53f7edfd-1f1d-4446-a6e0-211baeb8bfaa tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:17.776695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53f7edfd-1f1d-4446-a6e0-211baeb8bfaa tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.777221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53f7edfd-1f1d-4446-a6e0-211baeb8bfaa tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.777823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53f7edfd-1f1d-4446-a6e0-211baeb8bfaa tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.778722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53f7edfd-1f1d-4446-a6e0-211baeb8bfaa tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.779639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53f7edfd-1f1d-4446-a6e0-211baeb8bfaa tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.780199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53f7edfd-1f1d-4446-a6e0-211baeb8bfaa tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.863591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ff4bafe8-8fef-440a-bdbe-2ec60c902c34 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:17.864337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ff4bafe8-8fef-440a-bdbe-2ec60c902c34 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:17.875814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff4bafe8-8fef-440a-bdbe-2ec60c902c34 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.880262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff4bafe8-8fef-440a-bdbe-2ec60c902c34 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.880734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff4bafe8-8fef-440a-bdbe-2ec60c902c34 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.881554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff4bafe8-8fef-440a-bdbe-2ec60c902c34 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.882012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff4bafe8-8fef-440a-bdbe-2ec60c902c34 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.882436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff4bafe8-8fef-440a-bdbe-2ec60c902c34 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.954679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ff4bafe8-8fef-440a-bdbe-2ec60c902c34 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:17.962762 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ff4bafe8-8fef-440a-bdbe-2ec60c902c34 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1267 microversion: 2.1 time: 0.103123 Aug 29 15:34:17.963275 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1198/2375] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:17 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1267 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:17.967998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-39c82fa2-773a-40ae-9275-ec0306526aa0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:17.968618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-39c82fa2-773a-40ae-9275-ec0306526aa0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:17.974649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39c82fa2-773a-40ae-9275-ec0306526aa0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.975438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39c82fa2-773a-40ae-9275-ec0306526aa0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.975934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39c82fa2-773a-40ae-9275-ec0306526aa0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:17.977692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39c82fa2-773a-40ae-9275-ec0306526aa0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:17.978834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39c82fa2-773a-40ae-9275-ec0306526aa0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:17.979871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39c82fa2-773a-40ae-9275-ec0306526aa0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:18.073876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-53f7edfd-1f1d-4446-a6e0-211baeb8bfaa tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:18.083834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-53f7edfd-1f1d-4446-a6e0-211baeb8bfaa tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:18.085377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-53f7edfd-1f1d-4446-a6e0-211baeb8bfaa tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:18.086745 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-53f7edfd-1f1d-4446-a6e0-211baeb8bfaa tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1482 microversion: 2.25 time: 0.323989 Aug 29 15:34:18.090104 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1178/2376] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:17 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1482 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:18.103807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-089222df-faf8-4f57-8695-b92c8e1b54b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:18.104741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-089222df-faf8-4f57-8695-b92c8e1b54b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:18.114500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-089222df-faf8-4f57-8695-b92c8e1b54b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.115490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-089222df-faf8-4f57-8695-b92c8e1b54b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.116091 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-089222df-faf8-4f57-8695-b92c8e1b54b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:18.117469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-089222df-faf8-4f57-8695-b92c8e1b54b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.118012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-089222df-faf8-4f57-8695-b92c8e1b54b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.118901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-089222df-faf8-4f57-8695-b92c8e1b54b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:18.138139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-39c82fa2-773a-40ae-9275-ec0306526aa0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:18.148581 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-39c82fa2-773a-40ae-9275-ec0306526aa0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.184101 Aug 29 15:34:18.149474 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1199/2377] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:17 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:18.346515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-23cbd787-3bc8-46c4-a0ee-b4fd3be6caf9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:18.347319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-23cbd787-3bc8-46c4-a0ee-b4fd3be6caf9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:18.355725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23cbd787-3bc8-46c4-a0ee-b4fd3be6caf9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.356270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23cbd787-3bc8-46c4-a0ee-b4fd3be6caf9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.356723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23cbd787-3bc8-46c4-a0ee-b4fd3be6caf9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:18.357487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23cbd787-3bc8-46c4-a0ee-b4fd3be6caf9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.357954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23cbd787-3bc8-46c4-a0ee-b4fd3be6caf9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.358379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23cbd787-3bc8-46c4-a0ee-b4fd3be6caf9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:18.550885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-089222df-faf8-4f57-8695-b92c8e1b54b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:18.565920 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-089222df-faf8-4f57-8695-b92c8e1b54b2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1378 microversion: 2.1 time: 0.474317 Aug 29 15:34:18.577549 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1179/2378] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:18 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1378 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:18.584663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f9b09519-226a-4fec-9a60-ec6c0bddde08 req-b3fff876-1692-473e-b6e8-85c61240c20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc", "name": "network-vif-deleted", "tag": "8d13372d-483a-4d92-9792-82a84a9eb8eb"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:18.595385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f9b09519-226a-4fec-9a60-ec6c0bddde08 req-b3fff876-1692-473e-b6e8-85c61240c20d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.595906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f9b09519-226a-4fec-9a60-ec6c0bddde08 req-b3fff876-1692-473e-b6e8-85c61240c20d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.596369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f9b09519-226a-4fec-9a60-ec6c0bddde08 req-b3fff876-1692-473e-b6e8-85c61240c20d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:18.608986 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f9b09519-226a-4fec-9a60-ec6c0bddde08 req-b3fff876-1692-473e-b6e8-85c61240c20d service nova] Creating event network-vif-deleted:8d13372d-483a-4d92-9792-82a84a9eb8eb for instance d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc on n-h2-839401-11 Aug 29 15:34:18.614224 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f9b09519-226a-4fec-9a60-ec6c0bddde08 req-b3fff876-1692-473e-b6e8-85c61240c20d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035394 Aug 29 15:34:18.615305 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1180/2379] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:18.620199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d55a209e-6aba-443c-9d5c-21554f3c826c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:18.620918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d55a209e-6aba-443c-9d5c-21554f3c826c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:18.627276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55a209e-6aba-443c-9d5c-21554f3c826c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.627770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55a209e-6aba-443c-9d5c-21554f3c826c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.628264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55a209e-6aba-443c-9d5c-21554f3c826c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:18.628928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55a209e-6aba-443c-9d5c-21554f3c826c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.629415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55a209e-6aba-443c-9d5c-21554f3c826c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.630478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55a209e-6aba-443c-9d5c-21554f3c826c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:18.631327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-23cbd787-3bc8-46c4-a0ee-b4fd3be6caf9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:18.640182 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-23cbd787-3bc8-46c4-a0ee-b4fd3be6caf9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.298063 Aug 29 15:34:18.653352 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1200/2380] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:18 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:18.779422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d55a209e-6aba-443c-9d5c-21554f3c826c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:18.788892 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d55a209e-6aba-443c-9d5c-21554f3c826c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1317 microversion: 2.1 time: 0.172810 Aug 29 15:34:18.789532 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1181/2381] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:18 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:18.986301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9e48beae-76c8-4756-bcf7-b90ea7266c12 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:18.986955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9e48beae-76c8-4756-bcf7-b90ea7266c12 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:18.993411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e48beae-76c8-4756-bcf7-b90ea7266c12 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.993936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e48beae-76c8-4756-bcf7-b90ea7266c12 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.994392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e48beae-76c8-4756-bcf7-b90ea7266c12 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:18.995103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e48beae-76c8-4756-bcf7-b90ea7266c12 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:18.995555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e48beae-76c8-4756-bcf7-b90ea7266c12 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:18.995979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e48beae-76c8-4756-bcf7-b90ea7266c12 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.073183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e48beae-76c8-4756-bcf7-b90ea7266c12 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:19.082010 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9e48beae-76c8-4756-bcf7-b90ea7266c12 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1273 microversion: 2.1 time: 0.099897 Aug 29 15:34:19.082606 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1201/2382] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:18 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:19.112616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c415aec3-2ade-4d4e-aead-08dcdd6cc8d1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:19.113414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c415aec3-2ade-4d4e-aead-08dcdd6cc8d1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:19.123191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c415aec3-2ade-4d4e-aead-08dcdd6cc8d1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.123802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c415aec3-2ade-4d4e-aead-08dcdd6cc8d1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.124375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c415aec3-2ade-4d4e-aead-08dcdd6cc8d1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.125204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c415aec3-2ade-4d4e-aead-08dcdd6cc8d1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.125649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c415aec3-2ade-4d4e-aead-08dcdd6cc8d1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.127359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c415aec3-2ade-4d4e-aead-08dcdd6cc8d1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.130899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:DELETE=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:19.172270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-41d6e0af-f903-4ceb-825d-a7d4bc3f4464 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:19.173136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-41d6e0af-f903-4ceb-825d-a7d4bc3f4464 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:19.194512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-41d6e0af-f903-4ceb-825d-a7d4bc3f4464 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.195329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-41d6e0af-f903-4ceb-825d-a7d4bc3f4464 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.196110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-41d6e0af-f903-4ceb-825d-a7d4bc3f4464 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.197576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-41d6e0af-f903-4ceb-825d-a7d4bc3f4464 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.198206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-41d6e0af-f903-4ceb-825d-a7d4bc3f4464 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.199161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-41d6e0af-f903-4ceb-825d-a7d4bc3f4464 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.244495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c415aec3-2ade-4d4e-aead-08dcdd6cc8d1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:19.256805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c415aec3-2ade-4d4e-aead-08dcdd6cc8d1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:19.258431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c415aec3-2ade-4d4e-aead-08dcdd6cc8d1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:19.259708 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c415aec3-2ade-4d4e-aead-08dcdd6cc8d1 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1265 microversion: 2.25 time: 0.152145 Aug 29 15:34:19.261948 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1182/2383] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:19 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:19.495185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-41d6e0af-f903-4ceb-825d-a7d4bc3f4464 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:19.507729 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-41d6e0af-f903-4ceb-825d-a7d4bc3f4464 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.340749 Aug 29 15:34:19.508342 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1202/2384] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:19 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:19.590782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a59597ea-f82e-473b-bc4a-5125ab1dab8b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:19.591415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a59597ea-f82e-473b-bc4a-5125ab1dab8b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:19.599217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a59597ea-f82e-473b-bc4a-5125ab1dab8b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.599765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a59597ea-f82e-473b-bc4a-5125ab1dab8b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.600205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a59597ea-f82e-473b-bc4a-5125ab1dab8b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.600976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a59597ea-f82e-473b-bc4a-5125ab1dab8b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.601466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a59597ea-f82e-473b-bc4a-5125ab1dab8b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.601883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a59597ea-f82e-473b-bc4a-5125ab1dab8b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.664189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cfb087e9-fbc6-48e3-8234-6dba3950110a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:19.665024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cfb087e9-fbc6-48e3-8234-6dba3950110a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:19.673664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfb087e9-fbc6-48e3-8234-6dba3950110a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.674509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfb087e9-fbc6-48e3-8234-6dba3950110a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.675097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfb087e9-fbc6-48e3-8234-6dba3950110a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.676857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfb087e9-fbc6-48e3-8234-6dba3950110a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.677440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfb087e9-fbc6-48e3-8234-6dba3950110a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.677951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfb087e9-fbc6-48e3-8234-6dba3950110a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.768061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a59597ea-f82e-473b-bc4a-5125ab1dab8b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:19.777056 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a59597ea-f82e-473b-bc4a-5125ab1dab8b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1378 microversion: 2.1 time: 0.190660 Aug 29 15:34:19.777803 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1183/2385] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:19 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1378 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:19.819646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-99694e74-a4ae-48f5-a5a2-7f7eecda0451 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:19.820867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-99694e74-a4ae-48f5-a5a2-7f7eecda0451 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:19.829718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99694e74-a4ae-48f5-a5a2-7f7eecda0451 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.831015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99694e74-a4ae-48f5-a5a2-7f7eecda0451 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.832351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99694e74-a4ae-48f5-a5a2-7f7eecda0451 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.833247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99694e74-a4ae-48f5-a5a2-7f7eecda0451 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:19.833864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99694e74-a4ae-48f5-a5a2-7f7eecda0451 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:19.834481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99694e74-a4ae-48f5-a5a2-7f7eecda0451 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:19.920506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cfb087e9-fbc6-48e3-8234-6dba3950110a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:19.929788 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cfb087e9-fbc6-48e3-8234-6dba3950110a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.271176 Aug 29 15:34:19.930757 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1203/2386] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:19 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:20.040382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-99694e74-a4ae-48f5-a5a2-7f7eecda0451 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.049657 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-99694e74-a4ae-48f5-a5a2-7f7eecda0451 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1317 microversion: 2.1 time: 0.234100 Aug 29 15:34:20.064944 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1184/2387] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:19 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:20.111710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a19e82e3-24e0-4673-9e2d-ba71b26987bd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:20.115124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a19e82e3-24e0-4673-9e2d-ba71b26987bd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:20.126254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a19e82e3-24e0-4673-9e2d-ba71b26987bd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.126749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a19e82e3-24e0-4673-9e2d-ba71b26987bd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.127187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a19e82e3-24e0-4673-9e2d-ba71b26987bd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.127900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a19e82e3-24e0-4673-9e2d-ba71b26987bd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.128356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a19e82e3-24e0-4673-9e2d-ba71b26987bd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.128794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a19e82e3-24e0-4673-9e2d-ba71b26987bd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.257482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-854bc59e-b259-48e7-aa32-dd9d6df4419d req-6236eb40-afa9-4c45-8fe6-7cfc5db3be81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa", "tag": "924d833e-f874-4700-8474-ffbf6438a336"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:20.282292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-854bc59e-b259-48e7-aa32-dd9d6df4419d req-6236eb40-afa9-4c45-8fe6-7cfc5db3be81 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.283080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-854bc59e-b259-48e7-aa32-dd9d6df4419d req-6236eb40-afa9-4c45-8fe6-7cfc5db3be81 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.283676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-854bc59e-b259-48e7-aa32-dd9d6df4419d req-6236eb40-afa9-4c45-8fe6-7cfc5db3be81 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.302108 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-854bc59e-b259-48e7-aa32-dd9d6df4419d req-6236eb40-afa9-4c45-8fe6-7cfc5db3be81 service nova] Creating event network-changed:924d833e-f874-4700-8474-ffbf6438a336 for instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa on n-h1-839401-11 Aug 29 15:34:20.308414 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-854bc59e-b259-48e7-aa32-dd9d6df4419d req-6236eb40-afa9-4c45-8fe6-7cfc5db3be81 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067134 Aug 29 15:34:20.313460 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1185/2388] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:34:20.324621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-15f06b75-592c-4b3b-9cf6-68018d81e639 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:20.325382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-15f06b75-592c-4b3b-9cf6-68018d81e639 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:20.348175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15f06b75-592c-4b3b-9cf6-68018d81e639 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.348689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15f06b75-592c-4b3b-9cf6-68018d81e639 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.349179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15f06b75-592c-4b3b-9cf6-68018d81e639 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.350105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15f06b75-592c-4b3b-9cf6-68018d81e639 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.350647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15f06b75-592c-4b3b-9cf6-68018d81e639 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.351649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15f06b75-592c-4b3b-9cf6-68018d81e639 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.406497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a19e82e3-24e0-4673-9e2d-ba71b26987bd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.431374 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a19e82e3-24e0-4673-9e2d-ba71b26987bd tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1315 microversion: 2.1 time: 0.330917 Aug 29 15:34:20.433943 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1204/2389] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:20 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:20.454131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-62fadfd6-e149-40bb-bebe-5c8c3f43b5fe tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:20.459743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-62fadfd6-e149-40bb-bebe-5c8c3f43b5fe tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.460828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-62fadfd6-e149-40bb-bebe-5c8c3f43b5fe tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Searching by: {'deleted': False, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:20.461003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-15f06b75-592c-4b3b-9cf6-68018d81e639 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.467905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62fadfd6-e149-40bb-bebe-5c8c3f43b5fe tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.468681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62fadfd6-e149-40bb-bebe-5c8c3f43b5fe tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.470267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62fadfd6-e149-40bb-bebe-5c8c3f43b5fe tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.471197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62fadfd6-e149-40bb-bebe-5c8c3f43b5fe tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.471926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62fadfd6-e149-40bb-bebe-5c8c3f43b5fe tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.472030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-15f06b75-592c-4b3b-9cf6-68018d81e639 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.472752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62fadfd6-e149-40bb-bebe-5c8c3f43b5fe tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.474045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-15f06b75-592c-4b3b-9cf6-68018d81e639 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.475446 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-15f06b75-592c-4b3b-9cf6-68018d81e639 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1265 microversion: 2.25 time: 0.155340 Aug 29 15:34:20.476376 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1186/2390] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:20 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:20.501971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-62fadfd6-e149-40bb-bebe-5c8c3f43b5fe tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:34:20.529344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-33488d53-d167-4c3c-90e7-ee1dc0713b14 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:20.530152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-33488d53-d167-4c3c-90e7-ee1dc0713b14 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:20.533022 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-62fadfd6-e149-40bb-bebe-5c8c3f43b5fe tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.097587 Aug 29 15:34:20.534587 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1205/2391] 10.222.0.62 () {58 vars in 1125 bytes} [Mon Aug 29 15:34:20 2022] GET /compute/v2.1/servers => generated 339 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:20.546165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-33488d53-d167-4c3c-90e7-ee1dc0713b14 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.546814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-33488d53-d167-4c3c-90e7-ee1dc0713b14 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.547359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-33488d53-d167-4c3c-90e7-ee1dc0713b14 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.548167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-33488d53-d167-4c3c-90e7-ee1dc0713b14 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.548733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-33488d53-d167-4c3c-90e7-ee1dc0713b14 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.549460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-33488d53-d167-4c3c-90e7-ee1dc0713b14 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.550932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-09ff337c-4330-4f11-867a-783f72f9de56 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:20.556998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-09ff337c-4330-4f11-867a-783f72f9de56 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.557859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-09ff337c-4330-4f11-867a-783f72f9de56 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Searching by: {'deleted': False, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:20.564527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09ff337c-4330-4f11-867a-783f72f9de56 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.565023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09ff337c-4330-4f11-867a-783f72f9de56 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.565483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09ff337c-4330-4f11-867a-783f72f9de56 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.566274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09ff337c-4330-4f11-867a-783f72f9de56 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.567475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09ff337c-4330-4f11-867a-783f72f9de56 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.568546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09ff337c-4330-4f11-867a-783f72f9de56 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.608254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-09ff337c-4330-4f11-867a-783f72f9de56 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:34:20.639091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:20.654251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=19 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:20.657975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-09ff337c-4330-4f11-867a-783f72f9de56 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.677246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09ff337c-4330-4f11-867a-783f72f9de56 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.677796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09ff337c-4330-4f11-867a-783f72f9de56 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.678269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09ff337c-4330-4f11-867a-783f72f9de56 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.722473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-33488d53-d167-4c3c-90e7-ee1dc0713b14 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:20.731384 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-33488d53-d167-4c3c-90e7-ee1dc0713b14 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.206350 Aug 29 15:34:20.745468 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1187/2392] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:20 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:20.799155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b7d22e3e-9e33-4d22-9b2d-519555f1fffe tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:20.800050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b7d22e3e-9e33-4d22-9b2d-519555f1fffe tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:20.808693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7d22e3e-9e33-4d22-9b2d-519555f1fffe tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.809507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7d22e3e-9e33-4d22-9b2d-519555f1fffe tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.810158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7d22e3e-9e33-4d22-9b2d-519555f1fffe tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.811190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7d22e3e-9e33-4d22-9b2d-519555f1fffe tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.811761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7d22e3e-9e33-4d22-9b2d-519555f1fffe tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.812403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7d22e3e-9e33-4d22-9b2d-519555f1fffe tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:20.970156 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-09ff337c-4330-4f11-867a-783f72f9de56 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.425757 Aug 29 15:34:20.970753 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1206/2393] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:34:20 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:20.976792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-af18c32c-82a7-4434-a44b-0e746eefdb48 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:20.977616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-af18c32c-82a7-4434-a44b-0e746eefdb48 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:20.994722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af18c32c-82a7-4434-a44b-0e746eefdb48 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:20.997403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af18c32c-82a7-4434-a44b-0e746eefdb48 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:20.999479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af18c32c-82a7-4434-a44b-0e746eefdb48 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.004044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af18c32c-82a7-4434-a44b-0e746eefdb48 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.004823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af18c32c-82a7-4434-a44b-0e746eefdb48 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.005474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af18c32c-82a7-4434-a44b-0e746eefdb48 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.012711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b7d22e3e-9e33-4d22-9b2d-519555f1fffe tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:21.022444 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b7d22e3e-9e33-4d22-9b2d-519555f1fffe tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1378 microversion: 2.1 time: 0.227098 Aug 29 15:34:21.033933 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1188/2394] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:20 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1378 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:21.040530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-8f1f13c4-309e-467b-aa9d-377dad6006f1 req-fa128022-fb27-456f-a1bb-ed08e5d5cb56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f838765-3a8a-47c2-9907-367ddaf2d90f", "name": "network-vif-plugged", "status": "completed", "tag": "0f30a440-530f-4c46-b4fb-89f0c9814d97"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:21.056238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8f1f13c4-309e-467b-aa9d-377dad6006f1 req-fa128022-fb27-456f-a1bb-ed08e5d5cb56 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.056869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8f1f13c4-309e-467b-aa9d-377dad6006f1 req-fa128022-fb27-456f-a1bb-ed08e5d5cb56 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.057346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8f1f13c4-309e-467b-aa9d-377dad6006f1 req-fa128022-fb27-456f-a1bb-ed08e5d5cb56 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.072272 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-8f1f13c4-309e-467b-aa9d-377dad6006f1 req-fa128022-fb27-456f-a1bb-ed08e5d5cb56 service nova] Creating event network-vif-plugged:0f30a440-530f-4c46-b4fb-89f0c9814d97 for instance 0f838765-3a8a-47c2-9907-367ddaf2d90f on n-h1-839401-11 Aug 29 15:34:21.078823 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-8f1f13c4-309e-467b-aa9d-377dad6006f1 req-fa128022-fb27-456f-a1bb-ed08e5d5cb56 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042760 Aug 29 15:34:21.080970 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1189/2395] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:21.088928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cc22e25a-0982-4665-8c23-1735abf39851 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:21.098527 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cc22e25a-0982-4665-8c23-1735abf39851 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015912 Aug 29 15:34:21.099958 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1190/2396] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:34:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:21.105535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-21072bc6-3555-41fc-8796-d946b29bb268 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:21.107005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-21072bc6-3555-41fc-8796-d946b29bb268 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:21.115620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21072bc6-3555-41fc-8796-d946b29bb268 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.116576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21072bc6-3555-41fc-8796-d946b29bb268 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.117362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21072bc6-3555-41fc-8796-d946b29bb268 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.118393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21072bc6-3555-41fc-8796-d946b29bb268 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.119011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21072bc6-3555-41fc-8796-d946b29bb268 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.119717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21072bc6-3555-41fc-8796-d946b29bb268 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.246031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-af18c32c-82a7-4434-a44b-0e746eefdb48 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:21.256342 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-af18c32c-82a7-4434-a44b-0e746eefdb48 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.284179 Aug 29 15:34:21.257165 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1207/2397] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:20 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:21.341262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-21072bc6-3555-41fc-8796-d946b29bb268 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:21.352304 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-21072bc6-3555-41fc-8796-d946b29bb268 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1317 microversion: 2.1 time: 0.250759 Aug 29 15:34:21.354009 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1191/2398] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:21 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:21.457718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e95ea7b8-621f-4885-9490-e5dba6324fdf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:21.458601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e95ea7b8-621f-4885-9490-e5dba6324fdf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:21.466519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e95ea7b8-621f-4885-9490-e5dba6324fdf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.467270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e95ea7b8-621f-4885-9490-e5dba6324fdf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.467807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e95ea7b8-621f-4885-9490-e5dba6324fdf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.468697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e95ea7b8-621f-4885-9490-e5dba6324fdf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.469428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e95ea7b8-621f-4885-9490-e5dba6324fdf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.469894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e95ea7b8-621f-4885-9490-e5dba6324fdf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.500058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d3e6ab42-7626-49de-8e82-f17b92268d8b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:21.500681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d3e6ab42-7626-49de-8e82-f17b92268d8b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:21.507183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3e6ab42-7626-49de-8e82-f17b92268d8b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.507672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3e6ab42-7626-49de-8e82-f17b92268d8b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.508158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3e6ab42-7626-49de-8e82-f17b92268d8b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.508941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3e6ab42-7626-49de-8e82-f17b92268d8b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.509509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3e6ab42-7626-49de-8e82-f17b92268d8b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.509940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3e6ab42-7626-49de-8e82-f17b92268d8b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.592783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d3e6ab42-7626-49de-8e82-f17b92268d8b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:21.602105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d3e6ab42-7626-49de-8e82-f17b92268d8b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:21.603877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d3e6ab42-7626-49de-8e82-f17b92268d8b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:21.605051 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d3e6ab42-7626-49de-8e82-f17b92268d8b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1265 microversion: 2.25 time: 0.109720 Aug 29 15:34:21.615207 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1192/2399] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:21 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:21.635048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e95ea7b8-621f-4885-9490-e5dba6324fdf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:21.645687 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e95ea7b8-621f-4885-9490-e5dba6324fdf tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1315 microversion: 2.1 time: 0.193428 Aug 29 15:34:21.650591 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1208/2400] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:21 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:21.656709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f3db945d-854d-482e-b084-39306014a0d9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:21.657506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f3db945d-854d-482e-b084-39306014a0d9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:21.664156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3db945d-854d-482e-b084-39306014a0d9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.664637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3db945d-854d-482e-b084-39306014a0d9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.665231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3db945d-854d-482e-b084-39306014a0d9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.665941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3db945d-854d-482e-b084-39306014a0d9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.666399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3db945d-854d-482e-b084-39306014a0d9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.666914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3db945d-854d-482e-b084-39306014a0d9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.694605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f3db945d-854d-482e-b084-39306014a0d9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:21.752819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c34d507b-3954-48b8-9241-346663a23276 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:21.753769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c34d507b-3954-48b8-9241-346663a23276 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:21.762910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c34d507b-3954-48b8-9241-346663a23276 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.763567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c34d507b-3954-48b8-9241-346663a23276 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.764214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c34d507b-3954-48b8-9241-346663a23276 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.764943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c34d507b-3954-48b8-9241-346663a23276 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.765494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c34d507b-3954-48b8-9241-346663a23276 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.765936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c34d507b-3954-48b8-9241-346663a23276 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.790778 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f3db945d-854d-482e-b084-39306014a0d9 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 204 len: 0 microversion: 2.1 time: 0.138444 Aug 29 15:34:21.791753 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1193/2401] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:34:21 2022] DELETE /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:34:21.801033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b36c8a81-fd5e-49b7-b010-ebebc1d7e3ac tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:21.801892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b36c8a81-fd5e-49b7-b010-ebebc1d7e3ac tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:21.809701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b36c8a81-fd5e-49b7-b010-ebebc1d7e3ac tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.810279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b36c8a81-fd5e-49b7-b010-ebebc1d7e3ac tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.810781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b36c8a81-fd5e-49b7-b010-ebebc1d7e3ac tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.811650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b36c8a81-fd5e-49b7-b010-ebebc1d7e3ac tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:21.812173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b36c8a81-fd5e-49b7-b010-ebebc1d7e3ac tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:21.812809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b36c8a81-fd5e-49b7-b010-ebebc1d7e3ac tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:21.924990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c34d507b-3954-48b8-9241-346663a23276 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:21.933170 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c34d507b-3954-48b8-9241-346663a23276 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.184862 Aug 29 15:34:21.941581 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1209/2402] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:21 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:21.970036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b36c8a81-fd5e-49b7-b010-ebebc1d7e3ac tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:21.978038 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b36c8a81-fd5e-49b7-b010-ebebc1d7e3ac tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1713 microversion: 2.1 time: 0.181810 Aug 29 15:34:21.978675 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1194/2403] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:21 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1713 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:22.051948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9e20f69b-6f17-4c7d-8033-672b9b3acd5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:22.053263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9e20f69b-6f17-4c7d-8033-672b9b3acd5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:22.061042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e20f69b-6f17-4c7d-8033-672b9b3acd5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.061803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e20f69b-6f17-4c7d-8033-672b9b3acd5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.062341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e20f69b-6f17-4c7d-8033-672b9b3acd5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.064137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e20f69b-6f17-4c7d-8033-672b9b3acd5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.064829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e20f69b-6f17-4c7d-8033-672b9b3acd5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.065552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e20f69b-6f17-4c7d-8033-672b9b3acd5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.220610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e20f69b-6f17-4c7d-8033-672b9b3acd5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.229026 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9e20f69b-6f17-4c7d-8033-672b9b3acd5f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1527 microversion: 2.1 time: 0.186044 Aug 29 15:34:22.229634 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1210/2404] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:22 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1527 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:22.249612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c602833f-ae2a-4b5c-a8d5-f1dcbdbfc7cf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:22.250252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c602833f-ae2a-4b5c-a8d5-f1dcbdbfc7cf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:22.256757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c602833f-ae2a-4b5c-a8d5-f1dcbdbfc7cf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.257278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c602833f-ae2a-4b5c-a8d5-f1dcbdbfc7cf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.257748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c602833f-ae2a-4b5c-a8d5-f1dcbdbfc7cf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.258473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c602833f-ae2a-4b5c-a8d5-f1dcbdbfc7cf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.258921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c602833f-ae2a-4b5c-a8d5-f1dcbdbfc7cf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.259383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c602833f-ae2a-4b5c-a8d5-f1dcbdbfc7cf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.278382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7345036d-1adc-495a-8ef0-ff1f77167f18 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:22.279314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7345036d-1adc-495a-8ef0-ff1f77167f18 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:22.286143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7345036d-1adc-495a-8ef0-ff1f77167f18 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.286727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7345036d-1adc-495a-8ef0-ff1f77167f18 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.287292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7345036d-1adc-495a-8ef0-ff1f77167f18 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.288077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7345036d-1adc-495a-8ef0-ff1f77167f18 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.288607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7345036d-1adc-495a-8ef0-ff1f77167f18 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.289117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7345036d-1adc-495a-8ef0-ff1f77167f18 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.417558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c602833f-ae2a-4b5c-a8d5-f1dcbdbfc7cf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.428493 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c602833f-ae2a-4b5c-a8d5-f1dcbdbfc7cf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1527 microversion: 2.1 time: 0.182761 Aug 29 15:34:22.435274 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1195/2405] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:22 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1527 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:22.440966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c1432bb5-17ae-4a1e-b6c2-790a1ea8054d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:22.442740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c1432bb5-17ae-4a1e-b6c2-790a1ea8054d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:22.452869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7345036d-1adc-495a-8ef0-ff1f77167f18 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.458273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1432bb5-17ae-4a1e-b6c2-790a1ea8054d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.458783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1432bb5-17ae-4a1e-b6c2-790a1ea8054d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.459429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1432bb5-17ae-4a1e-b6c2-790a1ea8054d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.460154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1432bb5-17ae-4a1e-b6c2-790a1ea8054d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.460613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1432bb5-17ae-4a1e-b6c2-790a1ea8054d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.461035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1432bb5-17ae-4a1e-b6c2-790a1ea8054d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.463059 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7345036d-1adc-495a-8ef0-ff1f77167f18 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.189299 Aug 29 15:34:22.463975 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1211/2406] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:22 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:22.469424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9b37c4cc-1773-413f-acb8-9ffa31f1d7e6 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:22.489454 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9b37c4cc-1773-413f-acb8-9ffa31f1d7e6 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/214749f2-0e21-48de-82a9-352a778a2b97" status: 202 len: 0 microversion: 2.1 time: 0.024064 Aug 29 15:34:22.490178 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1212/2407] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:34:22 2022] DELETE /compute/v2.1/flavors/214749f2-0e21-48de-82a9-352a778a2b97 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:34:22.498009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-25112e36-0824-439b-9de4-64650b8ea951 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:22.526697 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-25112e36-0824-439b-9de4-64650b8ea951 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032135 Aug 29 15:34:22.527522 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1213/2408] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:34:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:22.547496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-33fd5247-423f-4127-b7cb-093670129564 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:22.549294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-33fd5247-423f-4127-b7cb-093670129564 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:22.558420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33fd5247-423f-4127-b7cb-093670129564 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.559162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33fd5247-423f-4127-b7cb-093670129564 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.560327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33fd5247-423f-4127-b7cb-093670129564 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.560525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33fd5247-423f-4127-b7cb-093670129564 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.561071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33fd5247-423f-4127-b7cb-093670129564 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.561549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33fd5247-423f-4127-b7cb-093670129564 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.597403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-33fd5247-423f-4127-b7cb-093670129564 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.604999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-33fd5247-423f-4127-b7cb-093670129564 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Old instance type tempest-test_resize_flavor_-1123810623, new instance type m1.heat {{(pid=122360) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 15:34:22.613020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-33fd5247-423f-4127-b7cb-093670129564 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:34:22.613500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-33fd5247-423f-4127-b7cb-093670129564 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:34:22.614086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-33fd5247-423f-4127-b7cb-093670129564 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:34:22.614560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-33fd5247-423f-4127-b7cb-093670129564 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:34:22.614980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-33fd5247-423f-4127-b7cb-093670129564 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:34:22.638449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c1432bb5-17ae-4a1e-b6c2-790a1ea8054d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.649794 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c1432bb5-17ae-4a1e-b6c2-790a1ea8054d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1317 microversion: 2.1 time: 0.218199 Aug 29 15:34:22.650018 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1196/2409] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:22 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:22.654990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5c86ac28-6475-42f2-bb91-28e33a3ec631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:22.655595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5c86ac28-6475-42f2-bb91-28e33a3ec631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:22.672350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c86ac28-6475-42f2-bb91-28e33a3ec631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.672868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c86ac28-6475-42f2-bb91-28e33a3ec631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.673362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c86ac28-6475-42f2-bb91-28e33a3ec631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.674102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c86ac28-6475-42f2-bb91-28e33a3ec631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.674573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c86ac28-6475-42f2-bb91-28e33a3ec631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.675004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c86ac28-6475-42f2-bb91-28e33a3ec631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.699722 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-33fd5247-423f-4127-b7cb-093670129564 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "POST /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27/action" status: 202 len: 0 microversion: 2.1 time: 0.156830 Aug 29 15:34:22.701347 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1214/2410] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:34:22 2022] POST /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:34:22.709299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a970fd1-9464-43a4-8c2d-bc468368b1c1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:22.709991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9a970fd1-9464-43a4-8c2d-bc468368b1c1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:22.715971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:22.717895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a970fd1-9464-43a4-8c2d-bc468368b1c1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.718532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a970fd1-9464-43a4-8c2d-bc468368b1c1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.718992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a970fd1-9464-43a4-8c2d-bc468368b1c1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.720211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a970fd1-9464-43a4-8c2d-bc468368b1c1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.720211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a970fd1-9464-43a4-8c2d-bc468368b1c1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.720590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a970fd1-9464-43a4-8c2d-bc468368b1c1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.759828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5c86ac28-6475-42f2-bb91-28e33a3ec631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.768803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5c86ac28-6475-42f2-bb91-28e33a3ec631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.770378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5c86ac28-6475-42f2-bb91-28e33a3ec631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.771638 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5c86ac28-6475-42f2-bb91-28e33a3ec631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1265 microversion: 2.25 time: 0.120749 Aug 29 15:34:22.784991 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1197/2411] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:22 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1265 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:22.784991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3b8279ab-7ed1-47cf-a377-f2f762689c1c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:22.784991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3b8279ab-7ed1-47cf-a377-f2f762689c1c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:22.788216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b8279ab-7ed1-47cf-a377-f2f762689c1c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.788370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b8279ab-7ed1-47cf-a377-f2f762689c1c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.788928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b8279ab-7ed1-47cf-a377-f2f762689c1c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.789677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b8279ab-7ed1-47cf-a377-f2f762689c1c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.790147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b8279ab-7ed1-47cf-a377-f2f762689c1c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.790629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b8279ab-7ed1-47cf-a377-f2f762689c1c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.933465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9a970fd1-9464-43a4-8c2d-bc468368b1c1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.944797 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a970fd1-9464-43a4-8c2d-bc468368b1c1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1315 microversion: 2.1 time: 0.241595 Aug 29 15:34:22.955738 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1215/2412] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:22 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:22.962600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7dc54120-1572-4b27-ae35-2ec2866c12aa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:22.963592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7dc54120-1572-4b27-ae35-2ec2866c12aa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:22.971992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dc54120-1572-4b27-ae35-2ec2866c12aa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.972754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dc54120-1572-4b27-ae35-2ec2866c12aa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.973360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dc54120-1572-4b27-ae35-2ec2866c12aa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.974280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dc54120-1572-4b27-ae35-2ec2866c12aa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:22.975044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dc54120-1572-4b27-ae35-2ec2866c12aa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:22.975564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dc54120-1572-4b27-ae35-2ec2866c12aa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:22.985291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3b8279ab-7ed1-47cf-a377-f2f762689c1c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:22.997073 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3b8279ab-7ed1-47cf-a377-f2f762689c1c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1536 microversion: 2.1 time: 0.223642 Aug 29 15:34:22.998208 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1198/2413] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:22 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1536 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:23.003788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4849e85d-2312-4cf8-aa68-64109ad837dc tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:23.004401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4849e85d-2312-4cf8-aa68-64109ad837dc tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:23.011716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4849e85d-2312-4cf8-aa68-64109ad837dc tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:23.012743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4849e85d-2312-4cf8-aa68-64109ad837dc tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:23.012743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4849e85d-2312-4cf8-aa68-64109ad837dc tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:23.014637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4849e85d-2312-4cf8-aa68-64109ad837dc tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:23.015382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4849e85d-2312-4cf8-aa68-64109ad837dc tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:23.017706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4849e85d-2312-4cf8-aa68-64109ad837dc tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:23.073929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:23.158518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7dc54120-1572-4b27-ae35-2ec2866c12aa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:23.169564 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7dc54120-1572-4b27-ae35-2ec2866c12aa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.216204 Aug 29 15:34:23.172458 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1216/2414] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:22 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:23.229655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4849e85d-2312-4cf8-aa68-64109ad837dc tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:23.238723 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4849e85d-2312-4cf8-aa68-64109ad837dc tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1713 microversion: 2.1 time: 0.239337 Aug 29 15:34:23.241121 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1199/2415] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:22 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1713 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:23.484046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b8ba8842-7097-4539-b55c-be75c22a57f0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:23.484667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b8ba8842-7097-4539-b55c-be75c22a57f0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:23.492324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8ba8842-7097-4539-b55c-be75c22a57f0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:23.492824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8ba8842-7097-4539-b55c-be75c22a57f0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:23.493311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8ba8842-7097-4539-b55c-be75c22a57f0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:23.494010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8ba8842-7097-4539-b55c-be75c22a57f0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:23.494466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8ba8842-7097-4539-b55c-be75c22a57f0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:23.494887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8ba8842-7097-4539-b55c-be75c22a57f0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:23.653238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b8ba8842-7097-4539-b55c-be75c22a57f0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:23.663314 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b8ba8842-7097-4539-b55c-be75c22a57f0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.183200 Aug 29 15:34:23.663905 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1217/2416] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:23 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:23.674347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-65fe280b-094f-45c6-a05a-afd85a8cf886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:23.675270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-65fe280b-094f-45c6-a05a-afd85a8cf886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:23.682677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65fe280b-094f-45c6-a05a-afd85a8cf886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:23.683270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65fe280b-094f-45c6-a05a-afd85a8cf886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:23.683773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65fe280b-094f-45c6-a05a-afd85a8cf886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:23.684563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65fe280b-094f-45c6-a05a-afd85a8cf886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:23.685259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65fe280b-094f-45c6-a05a-afd85a8cf886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:23.685692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65fe280b-094f-45c6-a05a-afd85a8cf886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:23.796763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c242f99a-cb0e-4ca5-83a5-2558c5b3bea2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:23.797454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c242f99a-cb0e-4ca5-83a5-2558c5b3bea2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:23.803924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c242f99a-cb0e-4ca5-83a5-2558c5b3bea2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:23.804726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c242f99a-cb0e-4ca5-83a5-2558c5b3bea2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:23.805312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c242f99a-cb0e-4ca5-83a5-2558c5b3bea2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:23.806066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c242f99a-cb0e-4ca5-83a5-2558c5b3bea2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:23.806718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c242f99a-cb0e-4ca5-83a5-2558c5b3bea2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:23.807298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c242f99a-cb0e-4ca5-83a5-2558c5b3bea2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:23.853537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-65fe280b-094f-45c6-a05a-afd85a8cf886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:23.866448 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-65fe280b-094f-45c6-a05a-afd85a8cf886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1317 microversion: 2.1 time: 0.195809 Aug 29 15:34:23.867217 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1200/2417] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:23 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:23.880120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c242f99a-cb0e-4ca5-83a5-2558c5b3bea2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:23.890970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c242f99a-cb0e-4ca5-83a5-2558c5b3bea2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:23.892816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c242f99a-cb0e-4ca5-83a5-2558c5b3bea2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:23.894842 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c242f99a-cb0e-4ca5-83a5-2558c5b3bea2 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1265 microversion: 2.25 time: 0.102526 Aug 29 15:34:23.895436 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1218/2418] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:23 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:34:23.968207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-15394f7d-ec2b-48c6-a1c7-5794665273f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:23.968856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-15394f7d-ec2b-48c6-a1c7-5794665273f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:23.975519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15394f7d-ec2b-48c6-a1c7-5794665273f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:23.976215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15394f7d-ec2b-48c6-a1c7-5794665273f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:23.976656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15394f7d-ec2b-48c6-a1c7-5794665273f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:23.977406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15394f7d-ec2b-48c6-a1c7-5794665273f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:23.977864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15394f7d-ec2b-48c6-a1c7-5794665273f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:23.978295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15394f7d-ec2b-48c6-a1c7-5794665273f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.026814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0cf8d13a-7977-4484-a0cd-d71a5098de00 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:24.027443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0cf8d13a-7977-4484-a0cd-d71a5098de00 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:24.035180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cf8d13a-7977-4484-a0cd-d71a5098de00 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.035911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cf8d13a-7977-4484-a0cd-d71a5098de00 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.036553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cf8d13a-7977-4484-a0cd-d71a5098de00 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.038058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cf8d13a-7977-4484-a0cd-d71a5098de00 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.039097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cf8d13a-7977-4484-a0cd-d71a5098de00 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.039531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cf8d13a-7977-4484-a0cd-d71a5098de00 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.204363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-15394f7d-ec2b-48c6-a1c7-5794665273f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:24.229796 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-15394f7d-ec2b-48c6-a1c7-5794665273f1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1315 microversion: 2.1 time: 0.264216 Aug 29 15:34:24.232864 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1201/2419] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:23 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:24.245617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-83ef4afa-0a23-44d8-b282-7add98e9bdf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:24.248664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-83ef4afa-0a23-44d8-b282-7add98e9bdf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:24.278796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83ef4afa-0a23-44d8-b282-7add98e9bdf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.281527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83ef4afa-0a23-44d8-b282-7add98e9bdf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.282499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83ef4afa-0a23-44d8-b282-7add98e9bdf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.284301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83ef4afa-0a23-44d8-b282-7add98e9bdf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.285304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83ef4afa-0a23-44d8-b282-7add98e9bdf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.286795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83ef4afa-0a23-44d8-b282-7add98e9bdf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.515166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-83ef4afa-0a23-44d8-b282-7add98e9bdf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:24.526651 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-83ef4afa-0a23-44d8-b282-7add98e9bdf5 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.290632 Aug 29 15:34:24.527952 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1202/2420] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:24 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:24.539155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f7b5a42-ad9b-41f8-86e3-58954fad4658 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:24.540432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9f7b5a42-ad9b-41f8-86e3-58954fad4658 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:24.548217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f7b5a42-ad9b-41f8-86e3-58954fad4658 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.549365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f7b5a42-ad9b-41f8-86e3-58954fad4658 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.550033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f7b5a42-ad9b-41f8-86e3-58954fad4658 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.550975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f7b5a42-ad9b-41f8-86e3-58954fad4658 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.551687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f7b5a42-ad9b-41f8-86e3-58954fad4658 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.552351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f7b5a42-ad9b-41f8-86e3-58954fad4658 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.579374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=18 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:24.613269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0cf8d13a-7977-4484-a0cd-d71a5098de00 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:24.621563 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0cf8d13a-7977-4484-a0cd-d71a5098de00 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1536 microversion: 2.1 time: 0.598678 Aug 29 15:34:24.622369 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1219/2421] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:24 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1536 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:24.685491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0996db4c-b2aa-4cb4-b174-3409eb4e3c8a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:24.686125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0996db4c-b2aa-4cb4-b174-3409eb4e3c8a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:24.697563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0996db4c-b2aa-4cb4-b174-3409eb4e3c8a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.698077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0996db4c-b2aa-4cb4-b174-3409eb4e3c8a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.698521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0996db4c-b2aa-4cb4-b174-3409eb4e3c8a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.699235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0996db4c-b2aa-4cb4-b174-3409eb4e3c8a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.699692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0996db4c-b2aa-4cb4-b174-3409eb4e3c8a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.700119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0996db4c-b2aa-4cb4-b174-3409eb4e3c8a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.726488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9f7b5a42-ad9b-41f8-86e3-58954fad4658 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:24.738133 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9f7b5a42-ad9b-41f8-86e3-58954fad4658 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1713 microversion: 2.1 time: 0.208311 Aug 29 15:34:24.744531 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1203/2422] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:24 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1713 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:24.874214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0996db4c-b2aa-4cb4-b174-3409eb4e3c8a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:24.887525 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0996db4c-b2aa-4cb4-b174-3409eb4e3c8a tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.207309 Aug 29 15:34:24.888583 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1220/2423] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:24 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:24.892196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-73ccf7db-66c9-4ebb-b165-39ed2c92e9ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:24.893158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-73ccf7db-66c9-4ebb-b165-39ed2c92e9ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:24.900416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73ccf7db-66c9-4ebb-b165-39ed2c92e9ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.901303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73ccf7db-66c9-4ebb-b165-39ed2c92e9ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.901946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73ccf7db-66c9-4ebb-b165-39ed2c92e9ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.902704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73ccf7db-66c9-4ebb-b165-39ed2c92e9ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.903173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73ccf7db-66c9-4ebb-b165-39ed2c92e9ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.903938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73ccf7db-66c9-4ebb-b165-39ed2c92e9ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.919420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fd8a813b-f0a7-4514-a8f5-2a204ca4b5a7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:24.921909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fd8a813b-f0a7-4514-a8f5-2a204ca4b5a7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:24.930906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd8a813b-f0a7-4514-a8f5-2a204ca4b5a7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.932988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd8a813b-f0a7-4514-a8f5-2a204ca4b5a7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.933708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd8a813b-f0a7-4514-a8f5-2a204ca4b5a7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.935175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd8a813b-f0a7-4514-a8f5-2a204ca4b5a7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.936420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd8a813b-f0a7-4514-a8f5-2a204ca4b5a7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.937297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd8a813b-f0a7-4514-a8f5-2a204ca4b5a7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.975105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd8a813b-f0a7-4514-a8f5-2a204ca4b5a7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:24.975594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd8a813b-f0a7-4514-a8f5-2a204ca4b5a7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:24.976027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd8a813b-f0a7-4514-a8f5-2a204ca4b5a7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:24.976478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-fd8a813b-f0a7-4514-a8f5-2a204ca4b5a7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lazy-loading 'fault' on Instance uuid d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:25.031937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd8a813b-f0a7-4514-a8f5-2a204ca4b5a7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:25.043895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd8a813b-f0a7-4514-a8f5-2a204ca4b5a7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:25.047631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd8a813b-f0a7-4514-a8f5-2a204ca4b5a7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:25.050109 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fd8a813b-f0a7-4514-a8f5-2a204ca4b5a7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1270 microversion: 2.25 time: 0.134381 Aug 29 15:34:25.065135 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1221/2424] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:24 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:34:25.077033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-73ccf7db-66c9-4ebb-b165-39ed2c92e9ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:25.090132 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-73ccf7db-66c9-4ebb-b165-39ed2c92e9ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1317 microversion: 2.1 time: 0.201768 Aug 29 15:34:25.090835 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1204/2425] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:24 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:25.251842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bdf83b79-9dd5-428b-8527-0f164cfeac15 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:25.252592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bdf83b79-9dd5-428b-8527-0f164cfeac15 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:25.259024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdf83b79-9dd5-428b-8527-0f164cfeac15 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:25.259505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdf83b79-9dd5-428b-8527-0f164cfeac15 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:25.259938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdf83b79-9dd5-428b-8527-0f164cfeac15 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:25.260658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdf83b79-9dd5-428b-8527-0f164cfeac15 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:25.261114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdf83b79-9dd5-428b-8527-0f164cfeac15 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:25.261573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdf83b79-9dd5-428b-8527-0f164cfeac15 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:25.439286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bdf83b79-9dd5-428b-8527-0f164cfeac15 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:25.447733 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bdf83b79-9dd5-428b-8527-0f164cfeac15 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1315 microversion: 2.1 time: 0.199858 Aug 29 15:34:25.448342 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1222/2426] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:25 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:25.551993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f3c96613-163a-4aa9-8464-c411b76e17ab tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:25.552659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f3c96613-163a-4aa9-8464-c411b76e17ab tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:25.559410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3c96613-163a-4aa9-8464-c411b76e17ab tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:25.559920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3c96613-163a-4aa9-8464-c411b76e17ab tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:25.560359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3c96613-163a-4aa9-8464-c411b76e17ab tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:25.561100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3c96613-163a-4aa9-8464-c411b76e17ab tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:25.561565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3c96613-163a-4aa9-8464-c411b76e17ab tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:25.561988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3c96613-163a-4aa9-8464-c411b76e17ab tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:25.642893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-72d5a15c-cfa2-41b8-a6b2-acfe53942e7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:25.644278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-72d5a15c-cfa2-41b8-a6b2-acfe53942e7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:25.652277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72d5a15c-cfa2-41b8-a6b2-acfe53942e7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:25.652779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72d5a15c-cfa2-41b8-a6b2-acfe53942e7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:25.653240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72d5a15c-cfa2-41b8-a6b2-acfe53942e7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:25.654289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72d5a15c-cfa2-41b8-a6b2-acfe53942e7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:25.654789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72d5a15c-cfa2-41b8-a6b2-acfe53942e7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:25.655179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72d5a15c-cfa2-41b8-a6b2-acfe53942e7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:25.681477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:25.733931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f3c96613-163a-4aa9-8464-c411b76e17ab tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:25.744251 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f3c96613-163a-4aa9-8464-c411b76e17ab tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.195894 Aug 29 15:34:25.745294 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1205/2427] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:25 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:25.762434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7b525bc0-c7e9-47b1-a865-a3d7189935f1 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:25.763449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7b525bc0-c7e9-47b1-a865-a3d7189935f1 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:25.770501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b525bc0-c7e9-47b1-a865-a3d7189935f1 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:25.770987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b525bc0-c7e9-47b1-a865-a3d7189935f1 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:25.771492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b525bc0-c7e9-47b1-a865-a3d7189935f1 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:25.772305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b525bc0-c7e9-47b1-a865-a3d7189935f1 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:25.772795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b525bc0-c7e9-47b1-a865-a3d7189935f1 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:25.773264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b525bc0-c7e9-47b1-a865-a3d7189935f1 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:25.855237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-72d5a15c-cfa2-41b8-a6b2-acfe53942e7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:25.863727 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-72d5a15c-cfa2-41b8-a6b2-acfe53942e7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1536 microversion: 2.1 time: 0.225042 Aug 29 15:34:25.864428 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1223/2428] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:25 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1536 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:25.910892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-871538d5-6806-4dcb-b34b-bfe3eaee1833 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:25.912271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-871538d5-6806-4dcb-b34b-bfe3eaee1833 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:25.922797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-871538d5-6806-4dcb-b34b-bfe3eaee1833 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:25.923699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-871538d5-6806-4dcb-b34b-bfe3eaee1833 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:25.924937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-871538d5-6806-4dcb-b34b-bfe3eaee1833 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:25.926326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-871538d5-6806-4dcb-b34b-bfe3eaee1833 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:25.926997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-871538d5-6806-4dcb-b34b-bfe3eaee1833 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:25.927782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-871538d5-6806-4dcb-b34b-bfe3eaee1833 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:25.988131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7b525bc0-c7e9-47b1-a865-a3d7189935f1 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:25.997414 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7b525bc0-c7e9-47b1-a865-a3d7189935f1 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1713 microversion: 2.1 time: 0.241395 Aug 29 15:34:25.998350 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1206/2429] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:25 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1713 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:26.075494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8dfd3018-173e-46c1-9dc8-5cf97c345e9d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:26.076473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8dfd3018-173e-46c1-9dc8-5cf97c345e9d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:26.084576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8dfd3018-173e-46c1-9dc8-5cf97c345e9d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:26.085383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8dfd3018-173e-46c1-9dc8-5cf97c345e9d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:26.086708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8dfd3018-173e-46c1-9dc8-5cf97c345e9d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:26.087965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8dfd3018-173e-46c1-9dc8-5cf97c345e9d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:26.088785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8dfd3018-173e-46c1-9dc8-5cf97c345e9d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:26.090300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8dfd3018-173e-46c1-9dc8-5cf97c345e9d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:26.145396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8dfd3018-173e-46c1-9dc8-5cf97c345e9d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:26.146409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8dfd3018-173e-46c1-9dc8-5cf97c345e9d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:26.147077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8dfd3018-173e-46c1-9dc8-5cf97c345e9d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:26.147852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-8dfd3018-173e-46c1-9dc8-5cf97c345e9d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lazy-loading 'fault' on Instance uuid d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:26.179229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-871538d5-6806-4dcb-b34b-bfe3eaee1833 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:26.192103 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-871538d5-6806-4dcb-b34b-bfe3eaee1833 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.286021 Aug 29 15:34:26.205502 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1224/2430] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:25 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:26.213330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6323046a-ada7-41dd-aa1d-dcac9d6f1e23 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:26.214481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6323046a-ada7-41dd-aa1d-dcac9d6f1e23 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:26.223932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6323046a-ada7-41dd-aa1d-dcac9d6f1e23 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:26.224895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6323046a-ada7-41dd-aa1d-dcac9d6f1e23 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:26.225948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6323046a-ada7-41dd-aa1d-dcac9d6f1e23 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:26.227171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6323046a-ada7-41dd-aa1d-dcac9d6f1e23 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:26.228108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6323046a-ada7-41dd-aa1d-dcac9d6f1e23 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:26.228733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6323046a-ada7-41dd-aa1d-dcac9d6f1e23 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:26.238177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8dfd3018-173e-46c1-9dc8-5cf97c345e9d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:26.247988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8dfd3018-173e-46c1-9dc8-5cf97c345e9d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:26.250129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8dfd3018-173e-46c1-9dc8-5cf97c345e9d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:26.251605 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8dfd3018-173e-46c1-9dc8-5cf97c345e9d tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 200 len: 1193 microversion: 2.25 time: 0.180687 Aug 29 15:34:26.252672 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1207/2431] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:26 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 1193 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:26.389794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6323046a-ada7-41dd-aa1d-dcac9d6f1e23 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:26.401590 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6323046a-ada7-41dd-aa1d-dcac9d6f1e23 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1317 microversion: 2.1 time: 0.193886 Aug 29 15:34:26.404540 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1225/2432] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:26 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:26.470847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cfd4b293-fa49-4ee5-8d87-310db5a5464e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:26.471572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cfd4b293-fa49-4ee5-8d87-310db5a5464e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:26.478580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfd4b293-fa49-4ee5-8d87-310db5a5464e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:26.479272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfd4b293-fa49-4ee5-8d87-310db5a5464e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:26.479778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfd4b293-fa49-4ee5-8d87-310db5a5464e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:26.480695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfd4b293-fa49-4ee5-8d87-310db5a5464e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:26.481240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfd4b293-fa49-4ee5-8d87-310db5a5464e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:26.481824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfd4b293-fa49-4ee5-8d87-310db5a5464e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:26.768924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1eb144de-799a-492d-aef9-e640809eccaa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:26.778223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1eb144de-799a-492d-aef9-e640809eccaa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:26.789371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1eb144de-799a-492d-aef9-e640809eccaa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:26.789944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1eb144de-799a-492d-aef9-e640809eccaa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:26.790423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1eb144de-799a-492d-aef9-e640809eccaa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:26.792201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1eb144de-799a-492d-aef9-e640809eccaa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:26.792735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1eb144de-799a-492d-aef9-e640809eccaa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:26.793554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1eb144de-799a-492d-aef9-e640809eccaa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:26.869550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cfd4b293-fa49-4ee5-8d87-310db5a5464e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:26.882313 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cfd4b293-fa49-4ee5-8d87-310db5a5464e tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1315 microversion: 2.1 time: 0.415764 Aug 29 15:34:26.897439 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1208/2433] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:26 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:26.903765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-85a27fc6-9a1d-45e7-b45d-b6177951a32b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:26.904482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-85a27fc6-9a1d-45e7-b45d-b6177951a32b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:26.950244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85a27fc6-9a1d-45e7-b45d-b6177951a32b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:26.963458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85a27fc6-9a1d-45e7-b45d-b6177951a32b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:26.964383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85a27fc6-9a1d-45e7-b45d-b6177951a32b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:26.968440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85a27fc6-9a1d-45e7-b45d-b6177951a32b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:26.969828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85a27fc6-9a1d-45e7-b45d-b6177951a32b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:26.970511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85a27fc6-9a1d-45e7-b45d-b6177951a32b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.063890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1eb144de-799a-492d-aef9-e640809eccaa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:27.077482 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1eb144de-799a-492d-aef9-e640809eccaa tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1522 microversion: 2.1 time: 0.312807 Aug 29 15:34:27.080571 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1226/2434] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:26 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:27.089445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-91112f2f-76c5-4016-bf55-c8d3c939a135 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:27.090304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-91112f2f-76c5-4016-bf55-c8d3c939a135 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:27.097664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91112f2f-76c5-4016-bf55-c8d3c939a135 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.098499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91112f2f-76c5-4016-bf55-c8d3c939a135 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.105351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91112f2f-76c5-4016-bf55-c8d3c939a135 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.107325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91112f2f-76c5-4016-bf55-c8d3c939a135 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.108454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91112f2f-76c5-4016-bf55-c8d3c939a135 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.109156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91112f2f-76c5-4016-bf55-c8d3c939a135 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.349949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-91112f2f-76c5-4016-bf55-c8d3c939a135 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:27.359804 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-91112f2f-76c5-4016-bf55-c8d3c939a135 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1713 microversion: 2.1 time: 0.276718 Aug 29 15:34:27.369190 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1227/2435] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:27 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1713 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:27.369501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-85a27fc6-9a1d-45e7-b45d-b6177951a32b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:27.369593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c89103fa-2cc1-4d10-9ebc-4e501c9b43a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:27.369593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c89103fa-2cc1-4d10-9ebc-4e501c9b43a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:27.375226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c89103fa-2cc1-4d10-9ebc-4e501c9b43a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.375752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c89103fa-2cc1-4d10-9ebc-4e501c9b43a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.376232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c89103fa-2cc1-4d10-9ebc-4e501c9b43a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.377232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c89103fa-2cc1-4d10-9ebc-4e501c9b43a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.377716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c89103fa-2cc1-4d10-9ebc-4e501c9b43a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.378145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c89103fa-2cc1-4d10-9ebc-4e501c9b43a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.379669 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-85a27fc6-9a1d-45e7-b45d-b6177951a32b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1536 microversion: 2.1 time: 0.480872 Aug 29 15:34:27.393927 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1209/2436] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:26 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1536 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:27.401856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-a165f9ca-8057-48d8-acb1-54ca1f989d23 req-c64fb202-759b-4b27-bbcf-f466d1464454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa", "name": "network-vif-plugged", "status": "completed", "tag": "924d833e-f874-4700-8474-ffbf6438a336"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:27.412583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a165f9ca-8057-48d8-acb1-54ca1f989d23 req-c64fb202-759b-4b27-bbcf-f466d1464454 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.413182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a165f9ca-8057-48d8-acb1-54ca1f989d23 req-c64fb202-759b-4b27-bbcf-f466d1464454 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.413838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a165f9ca-8057-48d8-acb1-54ca1f989d23 req-c64fb202-759b-4b27-bbcf-f466d1464454 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.428175 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-a165f9ca-8057-48d8-acb1-54ca1f989d23 req-c64fb202-759b-4b27-bbcf-f466d1464454 service nova] Creating event network-vif-plugged:924d833e-f874-4700-8474-ffbf6438a336 for instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa on n-h1-839401-11 Aug 29 15:34:27.436841 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-a165f9ca-8057-48d8-acb1-54ca1f989d23 req-c64fb202-759b-4b27-bbcf-f466d1464454 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038766 Aug 29 15:34:27.437822 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1210/2437] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:27.443426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c9c77504-08da-4c52-898f-00d58fb96df5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:27.444113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c9c77504-08da-4c52-898f-00d58fb96df5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:27.451464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9c77504-08da-4c52-898f-00d58fb96df5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.451957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9c77504-08da-4c52-898f-00d58fb96df5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.452394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9c77504-08da-4c52-898f-00d58fb96df5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.453133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9c77504-08da-4c52-898f-00d58fb96df5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.453593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9c77504-08da-4c52-898f-00d58fb96df5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.454025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9c77504-08da-4c52-898f-00d58fb96df5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.472458 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-c9c77504-08da-4c52-898f-00d58fb96df5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] HTTP exception thrown: Instance d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc could not be found. Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c9c77504-08da-4c52-898f-00d58fb96df5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Request method failure captured: Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc HTTP/1.1 Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNp9DXxKqZa_RRXSEhegpFvOgEYKZccwROpVhhDp1V7lLp7_8__NkuMACj6wnIslK5_kmPd2ELM-AzNVOAt7RJD9Uk8U3OxRuotLE0bzh9OM3ouSISIuXAlPdHpTX7T4A6StS0IfKYA6vTV9yay3uVhpeZ1RNwKXJmoYk2Wad1JbYXI Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: ef5a2735bd95451ab466c5560cbe28fe Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1701535054 Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ef5a2735bd95451ab466c5560cbe28fe", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ef5a2735bd95451ab466c5560cbe28fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ef5a2735bd95451ab466c5560cbe28fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ef5a2735bd95451ab466c5560cbe28fe"}]}] Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1701535054 Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: ef5a2735bd95451ab466c5560cbe28fe Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1701535054 Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-LiveAutoBlockMigrationV225Test-1701535054-project Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 9011569d41804e27a53fe5831988a88a Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1701535054-project Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc could not be found. Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'd3c1cf8d-4269-4b76-b9b1-08cd94c20ecc'} Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc could not be found. Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc could not be found. Aug 29 15:34:27.474651 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:34:27.480128 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:27.480128 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:34:27.480128 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:27.480128 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:27.480128 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:27.480128 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:27.480128 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:27.480128 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc could not be found. Aug 29 15:34:27.480128 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:34:27.480128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c9c77504-08da-4c52-898f-00d58fb96df5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Returning 404 to user: Instance d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:27.480128 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c9c77504-08da-4c52-898f-00d58fb96df5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc" status: 404 len: 111 microversion: 2.25 time: 0.037176 Aug 29 15:34:27.480128 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1211/2438] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:27 2022] GET /compute/v2.1/servers/d3c1cf8d-4269-4b76-b9b1-08cd94c20ecc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:34:27.484826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fe152c33-556d-4ecf-9adb-9605b7e3b932 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:27.485468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fe152c33-556d-4ecf-9adb-9605b7e3b932 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:27.492547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe152c33-556d-4ecf-9adb-9605b7e3b932 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.493272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe152c33-556d-4ecf-9adb-9605b7e3b932 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.493546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe152c33-556d-4ecf-9adb-9605b7e3b932 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.494527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe152c33-556d-4ecf-9adb-9605b7e3b932 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.495000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe152c33-556d-4ecf-9adb-9605b7e3b932 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.495446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe152c33-556d-4ecf-9adb-9605b7e3b932 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.610784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c89103fa-2cc1-4d10-9ebc-4e501c9b43a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:27.622495 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c89103fa-2cc1-4d10-9ebc-4e501c9b43a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.260563 Aug 29 15:34:27.623169 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1228/2439] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:27 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:27.802189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fe152c33-556d-4ecf-9adb-9605b7e3b932 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:27.812434 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fe152c33-556d-4ecf-9adb-9605b7e3b932 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1506 microversion: 2.1 time: 0.331300 Aug 29 15:34:27.813040 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1212/2440] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:27 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:27.842194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cd58b0dc-f7bd-479f-a26f-d4264a6a8a6e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:27.842962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cd58b0dc-f7bd-479f-a26f-d4264a6a8a6e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:27.852681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd58b0dc-f7bd-479f-a26f-d4264a6a8a6e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.853157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd58b0dc-f7bd-479f-a26f-d4264a6a8a6e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.853654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd58b0dc-f7bd-479f-a26f-d4264a6a8a6e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.854504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd58b0dc-f7bd-479f-a26f-d4264a6a8a6e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.855021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd58b0dc-f7bd-479f-a26f-d4264a6a8a6e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.855694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd58b0dc-f7bd-479f-a26f-d4264a6a8a6e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.905852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5f55b5e1-7fb1-4209-8255-3ace6b5b16ba tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:27.906636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5f55b5e1-7fb1-4209-8255-3ace6b5b16ba tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:27.913924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f55b5e1-7fb1-4209-8255-3ace6b5b16ba tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.914804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f55b5e1-7fb1-4209-8255-3ace6b5b16ba tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.915253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f55b5e1-7fb1-4209-8255-3ace6b5b16ba tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:27.916213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f55b5e1-7fb1-4209-8255-3ace6b5b16ba tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:27.916829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f55b5e1-7fb1-4209-8255-3ace6b5b16ba tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:27.917298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f55b5e1-7fb1-4209-8255-3ace6b5b16ba tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:28.017121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cd58b0dc-f7bd-479f-a26f-d4264a6a8a6e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:28.026915 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cd58b0dc-f7bd-479f-a26f-d4264a6a8a6e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1506 microversion: 2.1 time: 0.191696 Aug 29 15:34:28.028602 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1229/2441] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:27 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:28.053489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:28.057275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:28.064751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:28.065556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:28.066295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:28.067439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:28.068276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:28.069309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:28.197423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:34:28.198043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:34:28.199232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:34:28.199767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:34:28.200251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:34:28.291710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:28.301424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:28.302045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:28.302599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:28.303516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:28.304068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:28.304619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:28.340104 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-71d4d3ad-67f9-41be-a60f-7d5a1a13f5d4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "POST /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f/action" status: 202 len: 1108 microversion: 2.1 time: 0.292251 Aug 29 15:34:28.350234 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1230/2442] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:34:28 2022] POST /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f/action => generated 1108 bytes in 294 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 29 15:34:28.350234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-19bdb8bc-e402-4b64-b35c-8fc4caef41a3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:28.350234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-19bdb8bc-e402-4b64-b35c-8fc4caef41a3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:28.362954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19bdb8bc-e402-4b64-b35c-8fc4caef41a3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:28.363482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19bdb8bc-e402-4b64-b35c-8fc4caef41a3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:28.368363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19bdb8bc-e402-4b64-b35c-8fc4caef41a3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:28.369188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19bdb8bc-e402-4b64-b35c-8fc4caef41a3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:28.369692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19bdb8bc-e402-4b64-b35c-8fc4caef41a3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:28.370134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19bdb8bc-e402-4b64-b35c-8fc4caef41a3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:28.592563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-19bdb8bc-e402-4b64-b35c-8fc4caef41a3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:28.603225 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-19bdb8bc-e402-4b64-b35c-8fc4caef41a3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1499 microversion: 2.1 time: 0.260639 Aug 29 15:34:28.604514 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1231/2443] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:28 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1499 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:28.610623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6f4ca14d-b9ea-46d7-a446-c7d84a60519d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:28.611259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6f4ca14d-b9ea-46d7-a446-c7d84a60519d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:28.625613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f4ca14d-b9ea-46d7-a446-c7d84a60519d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:28.629240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f4ca14d-b9ea-46d7-a446-c7d84a60519d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:28.629783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f4ca14d-b9ea-46d7-a446-c7d84a60519d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:28.630650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f4ca14d-b9ea-46d7-a446-c7d84a60519d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:28.631204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f4ca14d-b9ea-46d7-a446-c7d84a60519d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:28.631902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f4ca14d-b9ea-46d7-a446-c7d84a60519d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:28.644782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5f55b5e1-7fb1-4209-8255-3ace6b5b16ba tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:28.655721 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5f55b5e1-7fb1-4209-8255-3ace6b5b16ba tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1315 microversion: 2.1 time: 0.755506 Aug 29 15:34:28.657780 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1213/2444] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:27 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:28.666708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f084850d-568d-4463-bab4-68a0f8d026c5 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:28.670902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f084850d-568d-4463-bab4-68a0f8d026c5 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:28.679389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f084850d-568d-4463-bab4-68a0f8d026c5 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:28.679916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f084850d-568d-4463-bab4-68a0f8d026c5 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:28.682568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f084850d-568d-4463-bab4-68a0f8d026c5 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:28.686247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f084850d-568d-4463-bab4-68a0f8d026c5 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:28.686247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f084850d-568d-4463-bab4-68a0f8d026c5 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:28.686446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f084850d-568d-4463-bab4-68a0f8d026c5 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:28.826775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6f4ca14d-b9ea-46d7-a446-c7d84a60519d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:28.835163 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6f4ca14d-b9ea-46d7-a446-c7d84a60519d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.229206 Aug 29 15:34:28.848483 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1232/2445] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:28 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:28.850269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2cc098b1-adda-4a1b-b2d4-68250bb65514 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:28.850840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2cc098b1-adda-4a1b-b2d4-68250bb65514 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:28.862205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f084850d-568d-4463-bab4-68a0f8d026c5 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:28.867291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cc098b1-adda-4a1b-b2d4-68250bb65514 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:28.867778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cc098b1-adda-4a1b-b2d4-68250bb65514 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:28.868839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cc098b1-adda-4a1b-b2d4-68250bb65514 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:28.868965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cc098b1-adda-4a1b-b2d4-68250bb65514 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:28.871468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cc098b1-adda-4a1b-b2d4-68250bb65514 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:28.877390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cc098b1-adda-4a1b-b2d4-68250bb65514 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:28.893480 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f084850d-568d-4463-bab4-68a0f8d026c5 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1646 microversion: 2.1 time: 0.231859 Aug 29 15:34:28.894810 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1214/2446] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:28 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1646 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:28.900539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-01c32701-6fe4-4590-b276-4b9a822f4bc2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:28.912702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-01c32701-6fe4-4590-b276-4b9a822f4bc2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:28.915291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-01c32701-6fe4-4590-b276-4b9a822f4bc2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:28.926197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:28.931437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01c32701-6fe4-4590-b276-4b9a822f4bc2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:28.932241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01c32701-6fe4-4590-b276-4b9a822f4bc2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:28.932903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01c32701-6fe4-4590-b276-4b9a822f4bc2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:28.933987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01c32701-6fe4-4590-b276-4b9a822f4bc2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:28.934892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01c32701-6fe4-4590-b276-4b9a822f4bc2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:28.935812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01c32701-6fe4-4590-b276-4b9a822f4bc2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.051837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-01c32701-6fe4-4590-b276-4b9a822f4bc2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:34:29.144717 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-01c32701-6fe4-4590-b276-4b9a822f4bc2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.248443 Aug 29 15:34:29.146292 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1215/2447] 10.222.0.62 () {58 vars in 1154 bytes} [Mon Aug 29 15:34:28 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:29.155535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-09828950-e2a0-47b4-b1b6-613d637342d9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:29.156068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-09828950-e2a0-47b4-b1b6-613d637342d9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:29.169576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09828950-e2a0-47b4-b1b6-613d637342d9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.170200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09828950-e2a0-47b4-b1b6-613d637342d9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.171979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09828950-e2a0-47b4-b1b6-613d637342d9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.172858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09828950-e2a0-47b4-b1b6-613d637342d9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.177789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09828950-e2a0-47b4-b1b6-613d637342d9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.178350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09828950-e2a0-47b4-b1b6-613d637342d9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.182015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2cc098b1-adda-4a1b-b2d4-68250bb65514 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:29.196564 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2cc098b1-adda-4a1b-b2d4-68250bb65514 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.359567 Aug 29 15:34:29.197952 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1233/2448] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:28 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:29.213600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-153ace11-32d2-4e62-9e0c-e1ccdaa67c92 req-80540449-8a7f-475d-868b-e09208472c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b402c3ad-5b4f-46c8-85c4-22988e175bf3", "name": "network-vif-deleted", "tag": "d9c36bd7-ba6d-45a9-a314-4837dd1f32e0"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:29.233300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-153ace11-32d2-4e62-9e0c-e1ccdaa67c92 req-80540449-8a7f-475d-868b-e09208472c94 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.233748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-153ace11-32d2-4e62-9e0c-e1ccdaa67c92 req-80540449-8a7f-475d-868b-e09208472c94 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.234138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-153ace11-32d2-4e62-9e0c-e1ccdaa67c92 req-80540449-8a7f-475d-868b-e09208472c94 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.254410 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-153ace11-32d2-4e62-9e0c-e1ccdaa67c92 req-80540449-8a7f-475d-868b-e09208472c94 service nova] Creating event network-vif-deleted:d9c36bd7-ba6d-45a9-a314-4837dd1f32e0 for instance b402c3ad-5b4f-46c8-85c4-22988e175bf3 on n-h1-839401-11 Aug 29 15:34:29.271075 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-153ace11-32d2-4e62-9e0c-e1ccdaa67c92 req-80540449-8a7f-475d-868b-e09208472c94 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069966 Aug 29 15:34:29.271689 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1234/2449] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:29.276914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e5640e00-8a4f-4d2c-b5c2-a95f849fcc54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:29.292937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5640e00-8a4f-4d2c-b5c2-a95f849fcc54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.293483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5640e00-8a4f-4d2c-b5c2-a95f849fcc54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.293926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5640e00-8a4f-4d2c-b5c2-a95f849fcc54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.340606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e5640e00-8a4f-4d2c-b5c2-a95f849fcc54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Going to try to start instance {{(pid=122360) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 15:34:29.405515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-09828950-e2a0-47b4-b1b6-613d637342d9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:29.414688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:29.417324 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e5640e00-8a4f-4d2c-b5c2-a95f849fcc54 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "POST /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543/action" status: 202 len: 0 microversion: 2.1 time: 0.140521 Aug 29 15:34:29.418710 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1235/2450] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:34:29 2022] POST /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:34:29.420087 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-09828950-e2a0-47b4-b1b6-613d637342d9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.272334 Aug 29 15:34:29.420700 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1216/2451] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:29 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:29.447193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-989721a2-822a-48ca-b268-5a0494d5c533 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:29.448009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-989721a2-822a-48ca-b268-5a0494d5c533 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:29.482037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-989721a2-822a-48ca-b268-5a0494d5c533 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.482664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-989721a2-822a-48ca-b268-5a0494d5c533 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.483269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-989721a2-822a-48ca-b268-5a0494d5c533 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.484087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-989721a2-822a-48ca-b268-5a0494d5c533 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.489691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-989721a2-822a-48ca-b268-5a0494d5c533 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.490334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-989721a2-822a-48ca-b268-5a0494d5c533 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.683722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bebd7587-d243-4f3f-a7e7-2e5c072dbf5f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:29.685562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bebd7587-d243-4f3f-a7e7-2e5c072dbf5f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:29.698545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-989721a2-822a-48ca-b268-5a0494d5c533 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:29.710031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bebd7587-d243-4f3f-a7e7-2e5c072dbf5f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.710693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bebd7587-d243-4f3f-a7e7-2e5c072dbf5f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.712102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bebd7587-d243-4f3f-a7e7-2e5c072dbf5f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.714535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bebd7587-d243-4f3f-a7e7-2e5c072dbf5f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.715131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bebd7587-d243-4f3f-a7e7-2e5c072dbf5f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.715675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bebd7587-d243-4f3f-a7e7-2e5c072dbf5f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.718335 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-989721a2-822a-48ca-b268-5a0494d5c533 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1508 microversion: 2.1 time: 0.281635 Aug 29 15:34:29.719589 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1236/2452] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:29 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1508 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:29.861597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a9d93750-a08f-4643-b2c1-5e5bb9e5e978 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:29.863242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a9d93750-a08f-4643-b2c1-5e5bb9e5e978 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:29.878409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9d93750-a08f-4643-b2c1-5e5bb9e5e978 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.879140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9d93750-a08f-4643-b2c1-5e5bb9e5e978 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.879838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9d93750-a08f-4643-b2c1-5e5bb9e5e978 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:29.880844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9d93750-a08f-4643-b2c1-5e5bb9e5e978 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:29.881408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9d93750-a08f-4643-b2c1-5e5bb9e5e978 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:29.882053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9d93750-a08f-4643-b2c1-5e5bb9e5e978 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.167781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bebd7587-d243-4f3f-a7e7-2e5c072dbf5f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:30.182395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a9d93750-a08f-4643-b2c1-5e5bb9e5e978 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:30.182759 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bebd7587-d243-4f3f-a7e7-2e5c072dbf5f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1502 microversion: 2.1 time: 0.502490 Aug 29 15:34:30.183980 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1217/2453] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:29 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1502 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:30.200769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e5c4cdb3-f9cb-4e94-80c3-92c3bdd401fa tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:30.201737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e5c4cdb3-f9cb-4e94-80c3-92c3bdd401fa tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:30.213567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:30.219458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5c4cdb3-f9cb-4e94-80c3-92c3bdd401fa tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.219798 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a9d93750-a08f-4643-b2c1-5e5bb9e5e978 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.360348 Aug 29 15:34:30.220482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5c4cdb3-f9cb-4e94-80c3-92c3bdd401fa tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.225988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5c4cdb3-f9cb-4e94-80c3-92c3bdd401fa tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.226764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5c4cdb3-f9cb-4e94-80c3-92c3bdd401fa tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.227232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5c4cdb3-f9cb-4e94-80c3-92c3bdd401fa tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.227664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5c4cdb3-f9cb-4e94-80c3-92c3bdd401fa tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.235228 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1237/2454] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:29 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:30.241072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1b746000-627b-4dc1-9f1c-21e832eb660a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:30.253642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b746000-627b-4dc1-9f1c-21e832eb660a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.254144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b746000-627b-4dc1-9f1c-21e832eb660a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.254585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b746000-627b-4dc1-9f1c-21e832eb660a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.284782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5c4cdb3-f9cb-4e94-80c3-92c3bdd401fa tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.285547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5c4cdb3-f9cb-4e94-80c3-92c3bdd401fa tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.286118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5c4cdb3-f9cb-4e94-80c3-92c3bdd401fa tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.286781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-e5c4cdb3-f9cb-4e94-80c3-92c3bdd401fa tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lazy-loading 'fault' on Instance uuid b402c3ad-5b4f-46c8-85c4-22988e175bf3 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:30.291735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1b746000-627b-4dc1-9f1c-21e832eb660a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Going to try to stop instance {{(pid=122360) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:34:30.348383 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1b746000-627b-4dc1-9f1c-21e832eb660a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "POST /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa/action" status: 202 len: 0 microversion: 2.1 time: 0.110790 Aug 29 15:34:30.350241 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1238/2455] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:34:30 2022] POST /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:34:30.357707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-93b2773c-d1b5-4574-9c49-7822daab016e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:30.358932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-93b2773c-d1b5-4574-9c49-7822daab016e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:30.367192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93b2773c-d1b5-4574-9c49-7822daab016e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.367912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93b2773c-d1b5-4574-9c49-7822daab016e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.368624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93b2773c-d1b5-4574-9c49-7822daab016e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.369604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93b2773c-d1b5-4574-9c49-7822daab016e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.370216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93b2773c-d1b5-4574-9c49-7822daab016e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.370795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93b2773c-d1b5-4574-9c49-7822daab016e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.455537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e5c4cdb3-f9cb-4e94-80c3-92c3bdd401fa tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740f4dfad6284ccfb489d614ca14306e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96dd481c3ca94886a7c2fb32f10daec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:30.465887 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e5c4cdb3-f9cb-4e94-80c3-92c3bdd401fa tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 200 len: 1367 microversion: 2.1 time: 0.280642 Aug 29 15:34:30.471134 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1218/2456] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:30 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:30.481502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b8f4b214-0f46-4021-9978-2066318f1062 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:30.482748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b8f4b214-0f46-4021-9978-2066318f1062 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:30.498417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8f4b214-0f46-4021-9978-2066318f1062 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.498923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8f4b214-0f46-4021-9978-2066318f1062 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.499364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8f4b214-0f46-4021-9978-2066318f1062 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.500080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8f4b214-0f46-4021-9978-2066318f1062 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.500560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8f4b214-0f46-4021-9978-2066318f1062 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.501060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8f4b214-0f46-4021-9978-2066318f1062 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.574231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:30.611085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-93b2773c-d1b5-4574-9c49-7822daab016e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:30.621136 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-93b2773c-d1b5-4574-9c49-7822daab016e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.269428 Aug 29 15:34:30.622910 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1239/2457] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:30 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:30.628172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e28c9a6c-6896-4194-a0e6-d93a53cd8124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:30.629802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e28c9a6c-6896-4194-a0e6-d93a53cd8124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:30.641969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e28c9a6c-6896-4194-a0e6-d93a53cd8124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.642633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e28c9a6c-6896-4194-a0e6-d93a53cd8124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.643863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e28c9a6c-6896-4194-a0e6-d93a53cd8124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.644344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e28c9a6c-6896-4194-a0e6-d93a53cd8124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.647702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e28c9a6c-6896-4194-a0e6-d93a53cd8124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.647702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e28c9a6c-6896-4194-a0e6-d93a53cd8124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.686939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:30.828364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b8f4b214-0f46-4021-9978-2066318f1062 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:30.847276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e28c9a6c-6896-4194-a0e6-d93a53cd8124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:30.850363 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b8f4b214-0f46-4021-9978-2066318f1062 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.377538 Aug 29 15:34:30.851334 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1219/2458] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:30 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:30.861465 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e28c9a6c-6896-4194-a0e6-d93a53cd8124 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.235260 Aug 29 15:34:30.861465 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1240/2459] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:30 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:30.900226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c9aee97-1835-4a0d-aba4-94c2ec6e9cf2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:30.901870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5c9aee97-1835-4a0d-aba4-94c2ec6e9cf2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:30.934666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c9aee97-1835-4a0d-aba4-94c2ec6e9cf2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.939706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c9aee97-1835-4a0d-aba4-94c2ec6e9cf2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.940524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c9aee97-1835-4a0d-aba4-94c2ec6e9cf2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:30.942121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c9aee97-1835-4a0d-aba4-94c2ec6e9cf2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:30.942839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c9aee97-1835-4a0d-aba4-94c2ec6e9cf2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:30.943496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c9aee97-1835-4a0d-aba4-94c2ec6e9cf2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:31.197435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5c9aee97-1835-4a0d-aba4-94c2ec6e9cf2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:31.218119 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5c9aee97-1835-4a0d-aba4-94c2ec6e9cf2 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1508 microversion: 2.1 time: 0.356405 Aug 29 15:34:31.218944 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1241/2460] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:30 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1508 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:31.243142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e74ffbf4-8917-490d-88b2-7c5e285f0f69 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:31.245162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e74ffbf4-8917-490d-88b2-7c5e285f0f69 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:31.253121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e74ffbf4-8917-490d-88b2-7c5e285f0f69 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:31.253870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e74ffbf4-8917-490d-88b2-7c5e285f0f69 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:31.254316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e74ffbf4-8917-490d-88b2-7c5e285f0f69 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:31.256496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e74ffbf4-8917-490d-88b2-7c5e285f0f69 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:31.256977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e74ffbf4-8917-490d-88b2-7c5e285f0f69 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:31.257445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e74ffbf4-8917-490d-88b2-7c5e285f0f69 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:31.423764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e74ffbf4-8917-490d-88b2-7c5e285f0f69 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:31.434725 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e74ffbf4-8917-490d-88b2-7c5e285f0f69 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.196067 Aug 29 15:34:31.435328 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1220/2461] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:31 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:31.490279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9bd2b88a-c4d1-4b72-9380-a00ef6ab7a72 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:31.491066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9bd2b88a-c4d1-4b72-9380-a00ef6ab7a72 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] [instance: b402c3ad-5b4f-46c8-85c4-22988e175bf3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:31.498327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bd2b88a-c4d1-4b72-9380-a00ef6ab7a72 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:31.498889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bd2b88a-c4d1-4b72-9380-a00ef6ab7a72 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:31.499345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bd2b88a-c4d1-4b72-9380-a00ef6ab7a72 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:31.500066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bd2b88a-c4d1-4b72-9380-a00ef6ab7a72 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:31.500524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bd2b88a-c4d1-4b72-9380-a00ef6ab7a72 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:31.500954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bd2b88a-c4d1-4b72-9380-a00ef6ab7a72 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:31.517633 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-9bd2b88a-c4d1-4b72-9380-a00ef6ab7a72 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] HTTP exception thrown: Instance b402c3ad-5b4f-46c8-85c4-22988e175bf3 could not be found. Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9bd2b88a-c4d1-4b72-9380-a00ef6ab7a72 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Request method failure captured: Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 HTTP/1.1 Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNv_sJIL8sXU1Wqr0589ovGhhkRsp6G4FNG_pemsGBnxv5xzdPa5KaPzeMH2BlrU4tQ3ZnCLbTwXLWk1Ix3649tN3t4_ZbC2abT0bIELR3gNBU8FBOBADbYdwU9WZpKL5Ghovm9FOg6N0Ke9cMU7QRjVhm6O3vx8fm-xMMEQIGgs3qo Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 96dd481c3ca94886a7c2fb32f10daec2 Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestManualDisk-1022293675 Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_96dd481c3ca94886a7c2fb32f10daec2", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/96dd481c3ca94886a7c2fb32f10daec2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/96dd481c3ca94886a7c2fb32f10daec2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/96dd481c3ca94886a7c2fb32f10daec2"}]}] Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestManualDisk-1022293675 Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 96dd481c3ca94886a7c2fb32f10daec2 Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestManualDisk-1022293675 Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestManualDisk-1022293675-project Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 740f4dfad6284ccfb489d614ca14306e Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestManualDisk-1022293675-project Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance b402c3ad-5b4f-46c8-85c4-22988e175bf3 could not be found. Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b402c3ad-5b4f-46c8-85c4-22988e175bf3'} Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b402c3ad-5b4f-46c8-85c4-22988e175bf3 could not be found. Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b402c3ad-5b4f-46c8-85c4-22988e175bf3 could not be found. Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:31.519589 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:31.525153 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:31.525153 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:31.525153 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:31.525153 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:31.525153 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:31.525153 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b402c3ad-5b4f-46c8-85c4-22988e175bf3 could not be found. Aug 29 15:34:31.525153 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:31.525153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9bd2b88a-c4d1-4b72-9380-a00ef6ab7a72 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Returning 404 to user: Instance b402c3ad-5b4f-46c8-85c4-22988e175bf3 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:31.525153 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9bd2b88a-c4d1-4b72-9380-a00ef6ab7a72 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3" status: 404 len: 111 microversion: 2.1 time: 0.035192 Aug 29 15:34:31.525937 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1242/2462] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:31 2022] GET /compute/v2.1/servers/b402c3ad-5b4f-46c8-85c4-22988e175bf3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:34:31.533300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-adcba3d8-f856-4eff-b8cc-a2c58960dc34 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] Calling method '.version_select at 0x7fc42b911280>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:31.555338 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-adcba3d8-f856-4eff-b8cc-a2c58960dc34 tempest-ServersTestManualDisk-1022293675 tempest-ServersTestManualDisk-1022293675-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1815473144" status: 202 len: 0 microversion: 2.1 time: 0.025994 Aug 29 15:34:31.556258 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1221/2463] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 15:34:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1815473144 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:34:31.643359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9f06da80-4750-4c6b-b782-7aada8735ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:31.644399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9f06da80-4750-4c6b-b782-7aada8735ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:31.651297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f06da80-4750-4c6b-b782-7aada8735ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:31.652015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f06da80-4750-4c6b-b782-7aada8735ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:31.652697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f06da80-4750-4c6b-b782-7aada8735ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:31.653976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f06da80-4750-4c6b-b782-7aada8735ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:31.654632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f06da80-4750-4c6b-b782-7aada8735ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:31.655256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f06da80-4750-4c6b-b782-7aada8735ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:31.830436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9f06da80-4750-4c6b-b782-7aada8735ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:31.839908 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9f06da80-4750-4c6b-b782-7aada8735ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.200327 Aug 29 15:34:31.847405 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1243/2464] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:31 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:31.874430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-043e46c7-22ee-44c8-b090-af8bbe6ee913 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:31.875092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-043e46c7-22ee-44c8-b090-af8bbe6ee913 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:31.885896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-043e46c7-22ee-44c8-b090-af8bbe6ee913 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:31.886776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-043e46c7-22ee-44c8-b090-af8bbe6ee913 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:31.887444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-043e46c7-22ee-44c8-b090-af8bbe6ee913 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:31.888419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-043e46c7-22ee-44c8-b090-af8bbe6ee913 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:31.889235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-043e46c7-22ee-44c8-b090-af8bbe6ee913 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:31.889899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-043e46c7-22ee-44c8-b090-af8bbe6ee913 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:31.896395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cefec6a8-3928-4f2c-b309-034953f1484c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:31.896816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cefec6a8-3928-4f2c-b309-034953f1484c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:31.937649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cefec6a8-3928-4f2c-b309-034953f1484c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:31.938601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cefec6a8-3928-4f2c-b309-034953f1484c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:31.938716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cefec6a8-3928-4f2c-b309-034953f1484c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:31.939536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cefec6a8-3928-4f2c-b309-034953f1484c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:31.941374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cefec6a8-3928-4f2c-b309-034953f1484c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:31.942174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cefec6a8-3928-4f2c-b309-034953f1484c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.180269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cefec6a8-3928-4f2c-b309-034953f1484c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:32.188741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-043e46c7-22ee-44c8-b090-af8bbe6ee913 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:32.189803 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cefec6a8-3928-4f2c-b309-034953f1484c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.307040 Aug 29 15:34:32.206541 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1244/2465] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:31 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:32.209187 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-043e46c7-22ee-44c8-b090-af8bbe6ee913 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.338690 Aug 29 15:34:32.210001 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1222/2466] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:31 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:32.239633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bb203a90-7da5-4f1c-9cd2-b3053d4399e8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:32.240503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bb203a90-7da5-4f1c-9cd2-b3053d4399e8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:32.247493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb203a90-7da5-4f1c-9cd2-b3053d4399e8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.248195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb203a90-7da5-4f1c-9cd2-b3053d4399e8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.248774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb203a90-7da5-4f1c-9cd2-b3053d4399e8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.249695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb203a90-7da5-4f1c-9cd2-b3053d4399e8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.250300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb203a90-7da5-4f1c-9cd2-b3053d4399e8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.250884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb203a90-7da5-4f1c-9cd2-b3053d4399e8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.401499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bb203a90-7da5-4f1c-9cd2-b3053d4399e8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:32.410718 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bb203a90-7da5-4f1c-9cd2-b3053d4399e8 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1512 microversion: 2.1 time: 0.175257 Aug 29 15:34:32.411568 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1245/2467] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:32 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:32.442388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-66941132-920b-4b37-b330-b65271bff1a6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:32.448827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-66941132-920b-4b37-b330-b65271bff1a6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:32.449674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.compute.servers [None req-66941132-920b-4b37-b330-b65271bff1a6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Removing options 'limit' from query {{(pid=122361) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 15:34:32.450528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-66941132-920b-4b37-b330-b65271bff1a6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:32.452056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66941132-920b-4b37-b330-b65271bff1a6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.452786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66941132-920b-4b37-b330-b65271bff1a6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.453456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66941132-920b-4b37-b330-b65271bff1a6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.454410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66941132-920b-4b37-b330-b65271bff1a6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.455084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66941132-920b-4b37-b330-b65271bff1a6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.455776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66941132-920b-4b37-b330-b65271bff1a6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.457502 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-66941132-920b-4b37-b330-b65271bff1a6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.020212 Aug 29 15:34:32.457904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c846d92b-20bb-4c5c-8388-994db539306d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:32.458689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c846d92b-20bb-4c5c-8388-994db539306d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:32.459116 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1223/2468] 10.222.0.62 () {58 vars in 1140 bytes} [Mon Aug 29 15:34:32 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:34:32.469923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c846d92b-20bb-4c5c-8388-994db539306d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.472593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c846d92b-20bb-4c5c-8388-994db539306d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.473069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c846d92b-20bb-4c5c-8388-994db539306d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.473451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f8a3ab76-36d6-4154-a7ca-21f1ab9eedea tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:32.473823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c846d92b-20bb-4c5c-8388-994db539306d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.474319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c846d92b-20bb-4c5c-8388-994db539306d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.474730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f8a3ab76-36d6-4154-a7ca-21f1ab9eedea tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:32.477075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c846d92b-20bb-4c5c-8388-994db539306d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.481431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8a3ab76-36d6-4154-a7ca-21f1ab9eedea tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.482158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8a3ab76-36d6-4154-a7ca-21f1ab9eedea tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.482819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8a3ab76-36d6-4154-a7ca-21f1ab9eedea tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.483735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8a3ab76-36d6-4154-a7ca-21f1ab9eedea tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.484387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8a3ab76-36d6-4154-a7ca-21f1ab9eedea tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.485010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8a3ab76-36d6-4154-a7ca-21f1ab9eedea tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.642489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f8a3ab76-36d6-4154-a7ca-21f1ab9eedea tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:32.652103 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f8a3ab76-36d6-4154-a7ca-21f1ab9eedea tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1512 microversion: 2.1 time: 0.183349 Aug 29 15:34:32.652763 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1224/2469] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:32 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:32.674460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3c75a452-d1e4-4a6e-84ea-8b85cf48cc05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:32.675346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3c75a452-d1e4-4a6e-84ea-8b85cf48cc05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: d624c852-fdae-4a2b-bd07-3d751e56c170] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:32.682941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c75a452-d1e4-4a6e-84ea-8b85cf48cc05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.683594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c75a452-d1e4-4a6e-84ea-8b85cf48cc05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.684173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c75a452-d1e4-4a6e-84ea-8b85cf48cc05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.684960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c75a452-d1e4-4a6e-84ea-8b85cf48cc05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.686011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c75a452-d1e4-4a6e-84ea-8b85cf48cc05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.686011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c75a452-d1e4-4a6e-84ea-8b85cf48cc05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.807326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c846d92b-20bb-4c5c-8388-994db539306d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:32.818319 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c846d92b-20bb-4c5c-8388-994db539306d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.365821 Aug 29 15:34:32.833185 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1246/2470] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:32 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:32.860373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3c75a452-d1e4-4a6e-84ea-8b85cf48cc05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:32.871340 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3c75a452-d1e4-4a6e-84ea-8b85cf48cc05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170" status: 200 len: 1512 microversion: 2.1 time: 0.201376 Aug 29 15:34:32.871694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7f9c4405-2fa7-44cf-9f6a-106849089b57 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:32.881396 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1225/2471] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:32 2022] GET /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170 => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:32.881485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7f9c4405-2fa7-44cf-9f6a-106849089b57 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:32.884334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f9c4405-2fa7-44cf-9f6a-106849089b57 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.884852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f9c4405-2fa7-44cf-9f6a-106849089b57 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.885337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f9c4405-2fa7-44cf-9f6a-106849089b57 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.886734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f9c4405-2fa7-44cf-9f6a-106849089b57 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.887216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f9c4405-2fa7-44cf-9f6a-106849089b57 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.887649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f9c4405-2fa7-44cf-9f6a-106849089b57 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.893019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-afb35824-7143-4ce9-8bb8-37a763168b98 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:32.893818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-afb35824-7143-4ce9-8bb8-37a763168b98 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:32.901416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb35824-7143-4ce9-8bb8-37a763168b98 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.902062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb35824-7143-4ce9-8bb8-37a763168b98 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.902611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb35824-7143-4ce9-8bb8-37a763168b98 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:32.903882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb35824-7143-4ce9-8bb8-37a763168b98 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:32.904537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb35824-7143-4ce9-8bb8-37a763168b98 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:32.905187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb35824-7143-4ce9-8bb8-37a763168b98 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.052259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-afb35824-7143-4ce9-8bb8-37a763168b98 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:33.062861 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-afb35824-7143-4ce9-8bb8-37a763168b98 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1511 microversion: 2.1 time: 0.174534 Aug 29 15:34:33.064008 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1226/2472] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:32 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:33.085772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-34fb3a4b-265e-4288-b77e-5602ea908ea6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:33.093846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-34fb3a4b-265e-4288-b77e-5602ea908ea6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:33.094986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-34fb3a4b-265e-4288-b77e-5602ea908ea6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:33.117879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7f9c4405-2fa7-44cf-9f6a-106849089b57 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:33.125899 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7f9c4405-2fa7-44cf-9f6a-106849089b57 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.261636 Aug 29 15:34:33.137482 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1247/2473] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:32 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:33.214437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b7ada46f-281c-4e74-8749-d8ccb1c4cba3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:33.215333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b7ada46f-281c-4e74-8749-d8ccb1c4cba3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:33.225262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7ada46f-281c-4e74-8749-d8ccb1c4cba3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.226042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7ada46f-281c-4e74-8749-d8ccb1c4cba3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.226656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7ada46f-281c-4e74-8749-d8ccb1c4cba3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.227732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7ada46f-281c-4e74-8749-d8ccb1c4cba3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.228445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7ada46f-281c-4e74-8749-d8ccb1c4cba3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.229040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7ada46f-281c-4e74-8749-d8ccb1c4cba3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.243288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34fb3a4b-265e-4288-b77e-5602ea908ea6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.244548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34fb3a4b-265e-4288-b77e-5602ea908ea6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.245205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34fb3a4b-265e-4288-b77e-5602ea908ea6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.246767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34fb3a4b-265e-4288-b77e-5602ea908ea6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.247473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34fb3a4b-265e-4288-b77e-5602ea908ea6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.248392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34fb3a4b-265e-4288-b77e-5602ea908ea6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.339897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-34fb3a4b-265e-4288-b77e-5602ea908ea6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:34:33.410825 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-34fb3a4b-265e-4288-b77e-5602ea908ea6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.330279 Aug 29 15:34:33.419423 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1227/2474] 10.222.0.62 () {58 vars in 1154 bytes} [Mon Aug 29 15:34:33 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:33.419423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0b1627eb-3ad8-43e0-85af-e2b4d3325434 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:33.419423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0b1627eb-3ad8-43e0-85af-e2b4d3325434 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:33.424931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b1627eb-3ad8-43e0-85af-e2b4d3325434 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.425621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b1627eb-3ad8-43e0-85af-e2b4d3325434 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.426617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b1627eb-3ad8-43e0-85af-e2b4d3325434 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.426786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b1627eb-3ad8-43e0-85af-e2b4d3325434 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.427321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b1627eb-3ad8-43e0-85af-e2b4d3325434 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.427768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b1627eb-3ad8-43e0-85af-e2b4d3325434 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.462862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b7ada46f-281c-4e74-8749-d8ccb1c4cba3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:33.472211 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b7ada46f-281c-4e74-8749-d8ccb1c4cba3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.263677 Aug 29 15:34:33.480741 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1248/2475] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:33 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:33.486651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d9d0ff7d-9812-4980-b41e-406541a08e7c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:33.487284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d9d0ff7d-9812-4980-b41e-406541a08e7c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:33.494214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9d0ff7d-9812-4980-b41e-406541a08e7c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.494707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9d0ff7d-9812-4980-b41e-406541a08e7c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.495284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9d0ff7d-9812-4980-b41e-406541a08e7c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.495993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9d0ff7d-9812-4980-b41e-406541a08e7c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.496437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9d0ff7d-9812-4980-b41e-406541a08e7c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.496857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9d0ff7d-9812-4980-b41e-406541a08e7c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.582256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0b1627eb-3ad8-43e0-85af-e2b4d3325434 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:33.593400 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0b1627eb-3ad8-43e0-85af-e2b4d3325434 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.180337 Aug 29 15:34:33.594354 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1228/2476] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:33 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:33.691280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d9d0ff7d-9812-4980-b41e-406541a08e7c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:33.700654 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d9d0ff7d-9812-4980-b41e-406541a08e7c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1512 microversion: 2.1 time: 0.218325 Aug 29 15:34:33.701718 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1249/2477] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:33 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:33.721157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a8883440-8571-40fc-8460-5135b31a770d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:33.721864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a8883440-8571-40fc-8460-5135b31a770d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: d624c852-fdae-4a2b-bd07-3d751e56c170] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:33.728884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8883440-8571-40fc-8460-5135b31a770d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.729616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8883440-8571-40fc-8460-5135b31a770d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.729904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8883440-8571-40fc-8460-5135b31a770d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.730723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8883440-8571-40fc-8460-5135b31a770d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.732225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8883440-8571-40fc-8460-5135b31a770d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.732862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8883440-8571-40fc-8460-5135b31a770d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.848897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-062a0ac1-5844-442b-98e1-5e5817033c97 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:33.848897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-062a0ac1-5844-442b-98e1-5e5817033c97 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:33.854022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-062a0ac1-5844-442b-98e1-5e5817033c97 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.854513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-062a0ac1-5844-442b-98e1-5e5817033c97 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.855093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-062a0ac1-5844-442b-98e1-5e5817033c97 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.855823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-062a0ac1-5844-442b-98e1-5e5817033c97 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.856348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-062a0ac1-5844-442b-98e1-5e5817033c97 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.856775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-062a0ac1-5844-442b-98e1-5e5817033c97 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.911985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a8883440-8571-40fc-8460-5135b31a770d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:33.921348 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a8883440-8571-40fc-8460-5135b31a770d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170" status: 200 len: 1512 microversion: 2.1 time: 0.204029 Aug 29 15:34:33.929151 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1229/2478] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:33 2022] GET /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170 => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:33.943138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eb2e87f9-09ad-4de3-ac0f-e4bcded59870 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:33.943754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eb2e87f9-09ad-4de3-ac0f-e4bcded59870 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:33.951764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb2e87f9-09ad-4de3-ac0f-e4bcded59870 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.954071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb2e87f9-09ad-4de3-ac0f-e4bcded59870 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.954071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb2e87f9-09ad-4de3-ac0f-e4bcded59870 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:33.954071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb2e87f9-09ad-4de3-ac0f-e4bcded59870 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:33.962871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb2e87f9-09ad-4de3-ac0f-e4bcded59870 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:33.963656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb2e87f9-09ad-4de3-ac0f-e4bcded59870 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.120541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-062a0ac1-5844-442b-98e1-5e5817033c97 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:34.131723 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-062a0ac1-5844-442b-98e1-5e5817033c97 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.291391 Aug 29 15:34:34.132316 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1250/2479] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:33 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:34.148003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5b85656f-2d08-438f-ab00-0e5b9067e545 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:34.149217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5b85656f-2d08-438f-ab00-0e5b9067e545 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:34.163020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eb2e87f9-09ad-4de3-ac0f-e4bcded59870 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:34.166273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b85656f-2d08-438f-ab00-0e5b9067e545 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.167144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b85656f-2d08-438f-ab00-0e5b9067e545 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.170961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b85656f-2d08-438f-ab00-0e5b9067e545 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.171806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b85656f-2d08-438f-ab00-0e5b9067e545 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.172292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b85656f-2d08-438f-ab00-0e5b9067e545 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.172734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b85656f-2d08-438f-ab00-0e5b9067e545 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.175168 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eb2e87f9-09ad-4de3-ac0f-e4bcded59870 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1511 microversion: 2.1 time: 0.236268 Aug 29 15:34:34.176755 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1230/2480] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:33 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1511 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:34.197678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f7863852-8d6d-485a-ae58-5c90c196aaf1 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:34.208945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f7863852-8d6d-485a-ae58-5c90c196aaf1 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:34.211426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f7863852-8d6d-485a-ae58-5c90c196aaf1 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:34.223713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7863852-8d6d-485a-ae58-5c90c196aaf1 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.226920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7863852-8d6d-485a-ae58-5c90c196aaf1 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.227499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7863852-8d6d-485a-ae58-5c90c196aaf1 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.231764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7863852-8d6d-485a-ae58-5c90c196aaf1 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.232590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7863852-8d6d-485a-ae58-5c90c196aaf1 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.233259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7863852-8d6d-485a-ae58-5c90c196aaf1 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.279526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-f7863852-8d6d-485a-ae58-5c90c196aaf1 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:34:34.321023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f7863852-8d6d-485a-ae58-5c90c196aaf1 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:34.329746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7863852-8d6d-485a-ae58-5c90c196aaf1 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.330367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7863852-8d6d-485a-ae58-5c90c196aaf1 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.330884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7863852-8d6d-485a-ae58-5c90c196aaf1 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.476769 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f7863852-8d6d-485a-ae58-5c90c196aaf1 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.284549 Aug 29 15:34:34.476991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5b85656f-2d08-438f-ab00-0e5b9067e545 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:34.477535 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1231/2481] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:34:34 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:34.484545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dda83d61-c856-435d-aa45-64eed9d27cda tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:34.485385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dda83d61-c856-435d-aa45-64eed9d27cda tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:34.488378 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5b85656f-2d08-438f-ab00-0e5b9067e545 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.344313 Aug 29 15:34:34.489231 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1251/2482] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:34 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:34.493047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dda83d61-c856-435d-aa45-64eed9d27cda tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.493794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dda83d61-c856-435d-aa45-64eed9d27cda tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.494737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dda83d61-c856-435d-aa45-64eed9d27cda tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.495699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dda83d61-c856-435d-aa45-64eed9d27cda tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.496477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dda83d61-c856-435d-aa45-64eed9d27cda tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.497145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dda83d61-c856-435d-aa45-64eed9d27cda tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.498939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-230ffb1d-90ec-4f27-91e2-044c893a57da tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:34.499577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-230ffb1d-90ec-4f27-91e2-044c893a57da tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:34.509127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-230ffb1d-90ec-4f27-91e2-044c893a57da tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.509628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-230ffb1d-90ec-4f27-91e2-044c893a57da tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.512019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-230ffb1d-90ec-4f27-91e2-044c893a57da tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.520553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-230ffb1d-90ec-4f27-91e2-044c893a57da tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.521741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-230ffb1d-90ec-4f27-91e2-044c893a57da tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.522971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-230ffb1d-90ec-4f27-91e2-044c893a57da tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.526031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dda83d61-c856-435d-aa45-64eed9d27cda tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:34.578845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:34.616479 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dda83d61-c856-435d-aa45-64eed9d27cda tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "DELETE /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 204 len: 0 microversion: 2.25 time: 0.137397 Aug 29 15:34:34.617472 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1232/2483] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:34:34 2022] DELETE /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:34:34.623804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3628c3ed-cee6-4969-a8f2-f4e7ac49d0f3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:34.629905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3628c3ed-cee6-4969-a8f2-f4e7ac49d0f3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:34.631255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3628c3ed-cee6-4969-a8f2-f4e7ac49d0f3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:34.705903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3628c3ed-cee6-4969-a8f2-f4e7ac49d0f3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.706419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3628c3ed-cee6-4969-a8f2-f4e7ac49d0f3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.707092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3628c3ed-cee6-4969-a8f2-f4e7ac49d0f3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.707593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3628c3ed-cee6-4969-a8f2-f4e7ac49d0f3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.708192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3628c3ed-cee6-4969-a8f2-f4e7ac49d0f3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.708681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3628c3ed-cee6-4969-a8f2-f4e7ac49d0f3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.739318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-3628c3ed-cee6-4969-a8f2-f4e7ac49d0f3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:34:34.742744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-230ffb1d-90ec-4f27-91e2-044c893a57da tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:34.751508 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-230ffb1d-90ec-4f27-91e2-044c893a57da tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.260622 Aug 29 15:34:34.752447 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1252/2484] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:34 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:34.757321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-423d301d-e490-4a9a-a1fa-5f5061106aac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:34.758431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-423d301d-e490-4a9a-a1fa-5f5061106aac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:34.770104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-423d301d-e490-4a9a-a1fa-5f5061106aac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.770697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-423d301d-e490-4a9a-a1fa-5f5061106aac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.771443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-423d301d-e490-4a9a-a1fa-5f5061106aac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.772404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-423d301d-e490-4a9a-a1fa-5f5061106aac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.772923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-423d301d-e490-4a9a-a1fa-5f5061106aac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.773456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-423d301d-e490-4a9a-a1fa-5f5061106aac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.777208 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3628c3ed-cee6-4969-a8f2-f4e7ac49d0f3 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.158017 Aug 29 15:34:34.786584 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1233/2485] 10.222.0.62 () {58 vars in 1150 bytes} [Mon Aug 29 15:34:34 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:34.786584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ead7abbe-8166-4f38-be7e-6667de6a156c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:34.786584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ead7abbe-8166-4f38-be7e-6667de6a156c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:34.793984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ead7abbe-8166-4f38-be7e-6667de6a156c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.794776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ead7abbe-8166-4f38-be7e-6667de6a156c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.795419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ead7abbe-8166-4f38-be7e-6667de6a156c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.796332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ead7abbe-8166-4f38-be7e-6667de6a156c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:34.797273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ead7abbe-8166-4f38-be7e-6667de6a156c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:34.801463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ead7abbe-8166-4f38-be7e-6667de6a156c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:34.983934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ead7abbe-8166-4f38-be7e-6667de6a156c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:34.992138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ead7abbe-8166-4f38-be7e-6667de6a156c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:34.993834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ead7abbe-8166-4f38-be7e-6667de6a156c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:34.995005 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ead7abbe-8166-4f38-be7e-6667de6a156c tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1733 microversion: 2.25 time: 0.215313 Aug 29 15:34:35.011621 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1234/2486] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:34 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1733 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:35.017694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4a223e98-8bfb-483b-872b-462443ca8739 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:35.024907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4a223e98-8bfb-483b-872b-462443ca8739 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:35.025605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4a223e98-8bfb-483b-872b-462443ca8739 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:35.032178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a223e98-8bfb-483b-872b-462443ca8739 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.032371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a223e98-8bfb-483b-872b-462443ca8739 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.032634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a223e98-8bfb-483b-872b-462443ca8739 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.033641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a223e98-8bfb-483b-872b-462443ca8739 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.033841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a223e98-8bfb-483b-872b-462443ca8739 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.034258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a223e98-8bfb-483b-872b-462443ca8739 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.073006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-423d301d-e490-4a9a-a1fa-5f5061106aac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:35.084015 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-423d301d-e490-4a9a-a1fa-5f5061106aac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.330258 Aug 29 15:34:35.084639 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1253/2487] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:34 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:35.134381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-4a223e98-8bfb-483b-872b-462443ca8739 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:34:35.155670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d0dae4b-ef3d-4ccb-82d4-7ec14aab52b7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:35.156302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9d0dae4b-ef3d-4ccb-82d4-7ec14aab52b7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:35.170753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d0dae4b-ef3d-4ccb-82d4-7ec14aab52b7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.173991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d0dae4b-ef3d-4ccb-82d4-7ec14aab52b7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.174567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d0dae4b-ef3d-4ccb-82d4-7ec14aab52b7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.175195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d0dae4b-ef3d-4ccb-82d4-7ec14aab52b7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.175670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d0dae4b-ef3d-4ccb-82d4-7ec14aab52b7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.176100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d0dae4b-ef3d-4ccb-82d4-7ec14aab52b7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.198079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:35.223011 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4a223e98-8bfb-483b-872b-462443ca8739 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.210218 Aug 29 15:34:35.224141 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1235/2488] 10.222.0.62 () {58 vars in 1212 bytes} [Mon Aug 29 15:34:35 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:35.238850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f7fcd543-4ef9-4b2d-a396-1d8e0bc546bd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:35.254435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f7fcd543-4ef9-4b2d-a396-1d8e0bc546bd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:35.255394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f7fcd543-4ef9-4b2d-a396-1d8e0bc546bd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:35.261500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7fcd543-4ef9-4b2d-a396-1d8e0bc546bd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.262181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7fcd543-4ef9-4b2d-a396-1d8e0bc546bd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.262694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7fcd543-4ef9-4b2d-a396-1d8e0bc546bd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.263604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7fcd543-4ef9-4b2d-a396-1d8e0bc546bd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.264157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7fcd543-4ef9-4b2d-a396-1d8e0bc546bd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.264769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7fcd543-4ef9-4b2d-a396-1d8e0bc546bd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.362159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-f7fcd543-4ef9-4b2d-a396-1d8e0bc546bd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:34:35.429330 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f7fcd543-4ef9-4b2d-a396-1d8e0bc546bd tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.197142 Aug 29 15:34:35.430618 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1236/2489] 10.222.0.62 () {58 vars in 1196 bytes} [Mon Aug 29 15:34:35 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:35.442209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-41e2a028-ab6f-438a-a57f-ddf3f61d381d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:35.448128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-41e2a028-ab6f-438a-a57f-ddf3f61d381d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:35.448931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-41e2a028-ab6f-438a-a57f-ddf3f61d381d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'name': '-671223453', 'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:35.455137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41e2a028-ab6f-438a-a57f-ddf3f61d381d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.455752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41e2a028-ab6f-438a-a57f-ddf3f61d381d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.456293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41e2a028-ab6f-438a-a57f-ddf3f61d381d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.457309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41e2a028-ab6f-438a-a57f-ddf3f61d381d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.457878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41e2a028-ab6f-438a-a57f-ddf3f61d381d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.458477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41e2a028-ab6f-438a-a57f-ddf3f61d381d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.568089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-41e2a028-ab6f-438a-a57f-ddf3f61d381d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:34:35.632382 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-41e2a028-ab6f-438a-a57f-ddf3f61d381d tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers?name=-671223453" status: 200 len: 345 microversion: 2.1 time: 0.194098 Aug 29 15:34:35.640979 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1237/2490] 10.222.0.62 () {58 vars in 1156 bytes} [Mon Aug 29 15:34:35 2022] GET /compute/v2.1/servers?name=-671223453 => generated 345 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:35.640979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f62ca637-6159-414d-b624-bea6a36e97c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:35.640979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f62ca637-6159-414d-b624-bea6a36e97c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:35.645590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f62ca637-6159-414d-b624-bea6a36e97c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.646146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f62ca637-6159-414d-b624-bea6a36e97c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.646541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f62ca637-6159-414d-b624-bea6a36e97c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.647928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f62ca637-6159-414d-b624-bea6a36e97c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.647928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f62ca637-6159-414d-b624-bea6a36e97c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.648155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f62ca637-6159-414d-b624-bea6a36e97c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.793008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f62ca637-6159-414d-b624-bea6a36e97c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:35.801119 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f62ca637-6159-414d-b624-bea6a36e97c0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.166646 Aug 29 15:34:35.801739 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1238/2491] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:35 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:35.806529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e25ff68e-523d-4593-b6c4-56c83f67025b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:35.811513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e25ff68e-523d-4593-b6c4-56c83f67025b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:35.812510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e25ff68e-523d-4593-b6c4-56c83f67025b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:35.818917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e25ff68e-523d-4593-b6c4-56c83f67025b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.819692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e25ff68e-523d-4593-b6c4-56c83f67025b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.819848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e25ff68e-523d-4593-b6c4-56c83f67025b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.820511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e25ff68e-523d-4593-b6c4-56c83f67025b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.820969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e25ff68e-523d-4593-b6c4-56c83f67025b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.821424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e25ff68e-523d-4593-b6c4-56c83f67025b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.870054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9d0dae4b-ef3d-4ccb-82d4-7ec14aab52b7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:35.879469 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d0dae4b-ef3d-4ccb-82d4-7ec14aab52b7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.727960 Aug 29 15:34:35.880738 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1254/2492] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:35 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:35.886463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1ef94f82-ca22-44d2-89a3-873bc37da280 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:35.887898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1ef94f82-ca22-44d2-89a3-873bc37da280 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:35.894977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ef94f82-ca22-44d2-89a3-873bc37da280 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.895677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ef94f82-ca22-44d2-89a3-873bc37da280 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.896325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ef94f82-ca22-44d2-89a3-873bc37da280 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.897842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ef94f82-ca22-44d2-89a3-873bc37da280 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:35.898460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ef94f82-ca22-44d2-89a3-873bc37da280 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:35.899119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ef94f82-ca22-44d2-89a3-873bc37da280 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:35.943385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-e25ff68e-523d-4593-b6c4-56c83f67025b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:34:36.037777 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e25ff68e-523d-4593-b6c4-56c83f67025b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.234843 Aug 29 15:34:36.039030 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1239/2493] 10.222.0.62 () {58 vars in 1154 bytes} [Mon Aug 29 15:34:35 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:36.046391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a6e0251e-3910-4085-84ac-022b7fde228b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:36.046391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a6e0251e-3910-4085-84ac-022b7fde228b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:36.051470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6e0251e-3910-4085-84ac-022b7fde228b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.052011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6e0251e-3910-4085-84ac-022b7fde228b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.052450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6e0251e-3910-4085-84ac-022b7fde228b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.053392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6e0251e-3910-4085-84ac-022b7fde228b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.054500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6e0251e-3910-4085-84ac-022b7fde228b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.054931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6e0251e-3910-4085-84ac-022b7fde228b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.152567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1ef94f82-ca22-44d2-89a3-873bc37da280 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:36.163855 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1ef94f82-ca22-44d2-89a3-873bc37da280 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.281667 Aug 29 15:34:36.177763 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1255/2494] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:35 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:36.183843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-22e58741-881c-4f45-aa4b-31326d7646de tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:36.189375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-22e58741-881c-4f45-aa4b-31326d7646de tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:36.190451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-22e58741-881c-4f45-aa4b-31326d7646de tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-67122345', 'deleted': False, 'project_id': '448ade75da744a0fa52b64221fabfc21'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:34:36.195809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22e58741-881c-4f45-aa4b-31326d7646de tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.196319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22e58741-881c-4f45-aa4b-31326d7646de tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.196749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22e58741-881c-4f45-aa4b-31326d7646de tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.197500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22e58741-881c-4f45-aa4b-31326d7646de tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.197936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22e58741-881c-4f45-aa4b-31326d7646de tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.198358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22e58741-881c-4f45-aa4b-31326d7646de tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.294042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-22e58741-881c-4f45-aa4b-31326d7646de tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:34:36.313275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a6e0251e-3910-4085-84ac-022b7fde228b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:36.323550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a6e0251e-3910-4085-84ac-022b7fde228b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:36.325395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a6e0251e-3910-4085-84ac-022b7fde228b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:36.326932 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a6e0251e-3910-4085-84ac-022b7fde228b tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1733 microversion: 2.25 time: 0.286756 Aug 29 15:34:36.346264 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1240/2495] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:36 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1733 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:36.353996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eff4eeaa-34d8-47f4-9d47-03ff1091c3d4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:36.354767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eff4eeaa-34d8-47f4-9d47-03ff1091c3d4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:36.361038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eff4eeaa-34d8-47f4-9d47-03ff1091c3d4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.361567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eff4eeaa-34d8-47f4-9d47-03ff1091c3d4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.362008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eff4eeaa-34d8-47f4-9d47-03ff1091c3d4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.362712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eff4eeaa-34d8-47f4-9d47-03ff1091c3d4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.363172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eff4eeaa-34d8-47f4-9d47-03ff1091c3d4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.363597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eff4eeaa-34d8-47f4-9d47-03ff1091c3d4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.378284 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-22e58741-881c-4f45-aa4b-31326d7646de tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-67122345" status: 200 len: 345 microversion: 2.1 time: 0.199218 Aug 29 15:34:36.379455 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1256/2496] 10.222.0.62 () {58 vars in 1226 bytes} [Mon Aug 29 15:34:36 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-67122345 => generated 345 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:36.391562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b0d1edfc-a603-4486-9f28-1607c52aaebe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:36.393907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b0d1edfc-a603-4486-9f28-1607c52aaebe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:36.405931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0d1edfc-a603-4486-9f28-1607c52aaebe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.407041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0d1edfc-a603-4486-9f28-1607c52aaebe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.408187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0d1edfc-a603-4486-9f28-1607c52aaebe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.410474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0d1edfc-a603-4486-9f28-1607c52aaebe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.411167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0d1edfc-a603-4486-9f28-1607c52aaebe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.411834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0d1edfc-a603-4486-9f28-1607c52aaebe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.439782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b0d1edfc-a603-4486-9f28-1607c52aaebe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:36.542171 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b0d1edfc-a603-4486-9f28-1607c52aaebe tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 204 len: 0 microversion: 2.1 time: 0.154607 Aug 29 15:34:36.543261 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1257/2497] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:34:36 2022] DELETE /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:34:36.555857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-37a58b31-c0a7-4231-b4b7-97c147044c9b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:36.556876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-37a58b31-c0a7-4231-b4b7-97c147044c9b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:36.564830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37a58b31-c0a7-4231-b4b7-97c147044c9b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.565439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37a58b31-c0a7-4231-b4b7-97c147044c9b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.566579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37a58b31-c0a7-4231-b4b7-97c147044c9b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.567355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37a58b31-c0a7-4231-b4b7-97c147044c9b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.567994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37a58b31-c0a7-4231-b4b7-97c147044c9b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.569320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37a58b31-c0a7-4231-b4b7-97c147044c9b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.641774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eff4eeaa-34d8-47f4-9d47-03ff1091c3d4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:36.652394 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eff4eeaa-34d8-47f4-9d47-03ff1091c3d4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.304812 Aug 29 15:34:36.653621 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1241/2498] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:36 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:36.784592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-37a58b31-c0a7-4231-b4b7-97c147044c9b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:36.800908 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-37a58b31-c0a7-4231-b4b7-97c147044c9b tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1517 microversion: 2.1 time: 0.250348 Aug 29 15:34:36.802525 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1258/2499] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:36 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1517 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:36.828340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-89e84614-19f6-4577-bd62-6bd96e077ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:36.828745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-89e84614-19f6-4577-bd62-6bd96e077ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:36.839238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89e84614-19f6-4577-bd62-6bd96e077ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.840050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89e84614-19f6-4577-bd62-6bd96e077ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.840486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89e84614-19f6-4577-bd62-6bd96e077ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.847032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89e84614-19f6-4577-bd62-6bd96e077ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.847615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89e84614-19f6-4577-bd62-6bd96e077ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.848050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89e84614-19f6-4577-bd62-6bd96e077ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.906780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-43d145d4-a552-4fad-be32-f694bb81e866 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:36.907430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-43d145d4-a552-4fad-be32-f694bb81e866 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:36.913065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:36.915085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43d145d4-a552-4fad-be32-f694bb81e866 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.915648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43d145d4-a552-4fad-be32-f694bb81e866 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.916149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43d145d4-a552-4fad-be32-f694bb81e866 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:36.916896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43d145d4-a552-4fad-be32-f694bb81e866 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:36.917409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43d145d4-a552-4fad-be32-f694bb81e866 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:36.917840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43d145d4-a552-4fad-be32-f694bb81e866 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.169214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-89e84614-19f6-4577-bd62-6bd96e077ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:37.178119 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-89e84614-19f6-4577-bd62-6bd96e077ae4 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.355195 Aug 29 15:34:37.178700 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1242/2500] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:36 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:37.195153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-e8830516-03c1-4d12-adf1-f400c2f27a40 req-f4fa99f0-9b32-4848-ad7b-261de5f45534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982d1df4-7b96-4fbf-8ec2-61752962955d", "name": "network-vif-deleted", "tag": "d8c016af-2dfc-466a-9191-b6fedaf0ee01"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:37.218842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e8830516-03c1-4d12-adf1-f400c2f27a40 req-f4fa99f0-9b32-4848-ad7b-261de5f45534 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.219619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e8830516-03c1-4d12-adf1-f400c2f27a40 req-f4fa99f0-9b32-4848-ad7b-261de5f45534 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.220221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e8830516-03c1-4d12-adf1-f400c2f27a40 req-f4fa99f0-9b32-4848-ad7b-261de5f45534 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.226471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-43d145d4-a552-4fad-be32-f694bb81e866 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:37.250983 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-e8830516-03c1-4d12-adf1-f400c2f27a40 req-f4fa99f0-9b32-4848-ad7b-261de5f45534 service nova] Creating event network-vif-deleted:d8c016af-2dfc-466a-9191-b6fedaf0ee01 for instance 982d1df4-7b96-4fbf-8ec2-61752962955d on n-h2-839401-11 Aug 29 15:34:37.256217 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-43d145d4-a552-4fad-be32-f694bb81e866 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.353745 Aug 29 15:34:37.258620 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1259/2501] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:36 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:37.263231 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-e8830516-03c1-4d12-adf1-f400c2f27a40 req-f4fa99f0-9b32-4848-ad7b-261de5f45534 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076182 Aug 29 15:34:37.263854 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1243/2502] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:37.274938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-61a1c407-7179-4d48-b5c1-c404897949ae tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:37.276201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-61a1c407-7179-4d48-b5c1-c404897949ae tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:37.293413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61a1c407-7179-4d48-b5c1-c404897949ae tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.293928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61a1c407-7179-4d48-b5c1-c404897949ae tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.294373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61a1c407-7179-4d48-b5c1-c404897949ae tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.295118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61a1c407-7179-4d48-b5c1-c404897949ae tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.295593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61a1c407-7179-4d48-b5c1-c404897949ae tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.296006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61a1c407-7179-4d48-b5c1-c404897949ae tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.356335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ce81c9ae-8d29-4aae-9a7f-37df15c252cd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:37.357223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ce81c9ae-8d29-4aae-9a7f-37df15c252cd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:37.369046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce81c9ae-8d29-4aae-9a7f-37df15c252cd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.369683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce81c9ae-8d29-4aae-9a7f-37df15c252cd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.370138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce81c9ae-8d29-4aae-9a7f-37df15c252cd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.370895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce81c9ae-8d29-4aae-9a7f-37df15c252cd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.371363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce81c9ae-8d29-4aae-9a7f-37df15c252cd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.371804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce81c9ae-8d29-4aae-9a7f-37df15c252cd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.441389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ce81c9ae-8d29-4aae-9a7f-37df15c252cd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:37.450267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ce81c9ae-8d29-4aae-9a7f-37df15c252cd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:37.451832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ce81c9ae-8d29-4aae-9a7f-37df15c252cd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:37.453133 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ce81c9ae-8d29-4aae-9a7f-37df15c252cd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1666 microversion: 2.25 time: 0.102674 Aug 29 15:34:37.453809 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1244/2503] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:37 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1666 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:34:37.519400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-61a1c407-7179-4d48-b5c1-c404897949ae tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:37.528504 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-61a1c407-7179-4d48-b5c1-c404897949ae tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.267528 Aug 29 15:34:37.529165 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1260/2504] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:37 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:37.674577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a62cad84-efab-4346-98f0-ee434419d123 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:37.675234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a62cad84-efab-4346-98f0-ee434419d123 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:37.682973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a62cad84-efab-4346-98f0-ee434419d123 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.683954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a62cad84-efab-4346-98f0-ee434419d123 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.684397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a62cad84-efab-4346-98f0-ee434419d123 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.685274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a62cad84-efab-4346-98f0-ee434419d123 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.686040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a62cad84-efab-4346-98f0-ee434419d123 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.686578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a62cad84-efab-4346-98f0-ee434419d123 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.827102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5b207934-3997-48cd-8b3a-a60ab4e957af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:37.827855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5b207934-3997-48cd-8b3a-a60ab4e957af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:37.836795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b207934-3997-48cd-8b3a-a60ab4e957af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.839135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b207934-3997-48cd-8b3a-a60ab4e957af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.841681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b207934-3997-48cd-8b3a-a60ab4e957af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.846354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b207934-3997-48cd-8b3a-a60ab4e957af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:37.846354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b207934-3997-48cd-8b3a-a60ab4e957af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:37.846354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b207934-3997-48cd-8b3a-a60ab4e957af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:37.885655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a62cad84-efab-4346-98f0-ee434419d123 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:37.894486 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a62cad84-efab-4346-98f0-ee434419d123 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.224493 Aug 29 15:34:37.895105 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1245/2505] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:37 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:38.017937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5b207934-3997-48cd-8b3a-a60ab4e957af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:38.026622 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5b207934-3997-48cd-8b3a-a60ab4e957af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1517 microversion: 2.1 time: 0.203810 Aug 29 15:34:38.027523 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1261/2506] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:37 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1517 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:38.200672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-91092bc1-c5c3-41c1-ba91-214c469f7bb6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:38.206909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-91092bc1-c5c3-41c1-ba91-214c469f7bb6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:38.216792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91092bc1-c5c3-41c1-ba91-214c469f7bb6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.217589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91092bc1-c5c3-41c1-ba91-214c469f7bb6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.218034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91092bc1-c5c3-41c1-ba91-214c469f7bb6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.218752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91092bc1-c5c3-41c1-ba91-214c469f7bb6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.219414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91092bc1-c5c3-41c1-ba91-214c469f7bb6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.219960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91092bc1-c5c3-41c1-ba91-214c469f7bb6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.282273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-835dd742-239a-4b77-b8b6-69b1c0bafafe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:38.282863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-835dd742-239a-4b77-b8b6-69b1c0bafafe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:38.294393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-835dd742-239a-4b77-b8b6-69b1c0bafafe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.296488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-835dd742-239a-4b77-b8b6-69b1c0bafafe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.298481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-835dd742-239a-4b77-b8b6-69b1c0bafafe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.299995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-835dd742-239a-4b77-b8b6-69b1c0bafafe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.301738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-835dd742-239a-4b77-b8b6-69b1c0bafafe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.302455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-835dd742-239a-4b77-b8b6-69b1c0bafafe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.397909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-91092bc1-c5c3-41c1-ba91-214c469f7bb6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:38.408553 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-91092bc1-c5c3-41c1-ba91-214c469f7bb6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.212052 Aug 29 15:34:38.413265 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1246/2507] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:38 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:38.479861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d9c5b37c-44ca-424a-babd-26b090b51fd8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:38.481196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d9c5b37c-44ca-424a-babd-26b090b51fd8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:38.489057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9c5b37c-44ca-424a-babd-26b090b51fd8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.489738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9c5b37c-44ca-424a-babd-26b090b51fd8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.490285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9c5b37c-44ca-424a-babd-26b090b51fd8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.491438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9c5b37c-44ca-424a-babd-26b090b51fd8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.491926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9c5b37c-44ca-424a-babd-26b090b51fd8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.492517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9c5b37c-44ca-424a-babd-26b090b51fd8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.518818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-835dd742-239a-4b77-b8b6-69b1c0bafafe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:38.549002 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-835dd742-239a-4b77-b8b6-69b1c0bafafe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.273203 Aug 29 15:34:38.562557 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1262/2508] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:38 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:38.575679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b11ad28d-a4cb-481e-b8f0-5e716aff942c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:38.576214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b11ad28d-a4cb-481e-b8f0-5e716aff942c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:38.589481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b11ad28d-a4cb-481e-b8f0-5e716aff942c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.590146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b11ad28d-a4cb-481e-b8f0-5e716aff942c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.590462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b11ad28d-a4cb-481e-b8f0-5e716aff942c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.591165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b11ad28d-a4cb-481e-b8f0-5e716aff942c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.591667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b11ad28d-a4cb-481e-b8f0-5e716aff942c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.592030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b11ad28d-a4cb-481e-b8f0-5e716aff942c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.606771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d9c5b37c-44ca-424a-babd-26b090b51fd8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:38.616124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d9c5b37c-44ca-424a-babd-26b090b51fd8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:38.617834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d9c5b37c-44ca-424a-babd-26b090b51fd8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:38.619216 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d9c5b37c-44ca-424a-babd-26b090b51fd8 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1666 microversion: 2.25 time: 0.145404 Aug 29 15:34:38.619707 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1247/2509] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:38 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1666 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:38.765954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b11ad28d-a4cb-481e-b8f0-5e716aff942c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:38.774843 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b11ad28d-a4cb-481e-b8f0-5e716aff942c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.210782 Aug 29 15:34:38.775838 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1263/2510] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:38 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:38.920197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-155d8e96-1f22-42ed-a81c-cb0b22f76289 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:38.920895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-155d8e96-1f22-42ed-a81c-cb0b22f76289 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:38.929009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-155d8e96-1f22-42ed-a81c-cb0b22f76289 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.929620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-155d8e96-1f22-42ed-a81c-cb0b22f76289 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.930100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-155d8e96-1f22-42ed-a81c-cb0b22f76289 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.930940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-155d8e96-1f22-42ed-a81c-cb0b22f76289 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:38.931403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-155d8e96-1f22-42ed-a81c-cb0b22f76289 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:38.931914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-155d8e96-1f22-42ed-a81c-cb0b22f76289 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:38.936402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:39.049971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-15da1a6b-4c04-4f13-8ce1-7c813d95223c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:39.050592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-15da1a6b-4c04-4f13-8ce1-7c813d95223c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:39.058093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15da1a6b-4c04-4f13-8ce1-7c813d95223c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:39.058587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15da1a6b-4c04-4f13-8ce1-7c813d95223c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:39.059232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15da1a6b-4c04-4f13-8ce1-7c813d95223c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:39.060144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15da1a6b-4c04-4f13-8ce1-7c813d95223c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:39.060644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15da1a6b-4c04-4f13-8ce1-7c813d95223c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:39.061206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15da1a6b-4c04-4f13-8ce1-7c813d95223c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:39.078142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-155d8e96-1f22-42ed-a81c-cb0b22f76289 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:39.087376 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-155d8e96-1f22-42ed-a81c-cb0b22f76289 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.172791 Aug 29 15:34:39.101114 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1248/2511] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:38 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:39.232229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-15da1a6b-4c04-4f13-8ce1-7c813d95223c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:39.240515 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-15da1a6b-4c04-4f13-8ce1-7c813d95223c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1517 microversion: 2.1 time: 0.194750 Aug 29 15:34:39.241352 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1264/2512] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:39 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1517 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:39.433123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f79cbc8c-3606-4d7f-8459-bfa6f0192042 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:39.433959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f79cbc8c-3606-4d7f-8459-bfa6f0192042 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:39.443557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f79cbc8c-3606-4d7f-8459-bfa6f0192042 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:39.444048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f79cbc8c-3606-4d7f-8459-bfa6f0192042 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:39.444483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f79cbc8c-3606-4d7f-8459-bfa6f0192042 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:39.445232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f79cbc8c-3606-4d7f-8459-bfa6f0192042 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:39.445687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f79cbc8c-3606-4d7f-8459-bfa6f0192042 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:39.446108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f79cbc8c-3606-4d7f-8459-bfa6f0192042 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:39.573695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-262d57aa-68f2-441e-aecf-7595cd2c637a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:39.574382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-262d57aa-68f2-441e-aecf-7595cd2c637a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:39.580958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-262d57aa-68f2-441e-aecf-7595cd2c637a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:39.581471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-262d57aa-68f2-441e-aecf-7595cd2c637a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:39.581901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-262d57aa-68f2-441e-aecf-7595cd2c637a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:39.582590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-262d57aa-68f2-441e-aecf-7595cd2c637a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:39.583041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-262d57aa-68f2-441e-aecf-7595cd2c637a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:39.583544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-262d57aa-68f2-441e-aecf-7595cd2c637a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:39.659377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f79cbc8c-3606-4d7f-8459-bfa6f0192042 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:39.670435 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f79cbc8c-3606-4d7f-8459-bfa6f0192042 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.241460 Aug 29 15:34:39.683784 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1249/2513] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:39 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:39.692603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f8b2eff-9c5a-4f03-96d4-914eca6ee9c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:39.693292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9f8b2eff-9c5a-4f03-96d4-914eca6ee9c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:39.700273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f8b2eff-9c5a-4f03-96d4-914eca6ee9c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:39.701291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f8b2eff-9c5a-4f03-96d4-914eca6ee9c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:39.701936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f8b2eff-9c5a-4f03-96d4-914eca6ee9c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:39.703093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f8b2eff-9c5a-4f03-96d4-914eca6ee9c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:39.703756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f8b2eff-9c5a-4f03-96d4-914eca6ee9c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:39.704373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f8b2eff-9c5a-4f03-96d4-914eca6ee9c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:39.772306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9f8b2eff-9c5a-4f03-96d4-914eca6ee9c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:39.781539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9f8b2eff-9c5a-4f03-96d4-914eca6ee9c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:39.783005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9f8b2eff-9c5a-4f03-96d4-914eca6ee9c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:39.784203 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9f8b2eff-9c5a-4f03-96d4-914eca6ee9c5 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1371 microversion: 2.25 time: 0.098854 Aug 29 15:34:39.785043 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1250/2514] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:39 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:39.798352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ef8bce90-7fa5-4589-80a6-9085bc955a70 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:39.799473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-262d57aa-68f2-441e-aecf-7595cd2c637a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:39.799610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ef8bce90-7fa5-4589-80a6-9085bc955a70 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:39.808211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef8bce90-7fa5-4589-80a6-9085bc955a70 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:39.808469 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-262d57aa-68f2-441e-aecf-7595cd2c637a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.238902 Aug 29 15:34:39.809027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef8bce90-7fa5-4589-80a6-9085bc955a70 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:39.809532 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1265/2515] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:39 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:39.817841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef8bce90-7fa5-4589-80a6-9085bc955a70 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:39.818731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef8bce90-7fa5-4589-80a6-9085bc955a70 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:39.819271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef8bce90-7fa5-4589-80a6-9085bc955a70 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:39.819796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef8bce90-7fa5-4589-80a6-9085bc955a70 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:39.956298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ef8bce90-7fa5-4589-80a6-9085bc955a70 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:39.964684 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ef8bce90-7fa5-4589-80a6-9085bc955a70 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.171099 Aug 29 15:34:39.965273 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1251/2516] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:39 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:40.114602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-36b4fdcd-bf25-42ff-a051-93fe20c10cc2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:40.115253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-36b4fdcd-bf25-42ff-a051-93fe20c10cc2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:40.133178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36b4fdcd-bf25-42ff-a051-93fe20c10cc2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.133651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36b4fdcd-bf25-42ff-a051-93fe20c10cc2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.134090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36b4fdcd-bf25-42ff-a051-93fe20c10cc2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.134796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36b4fdcd-bf25-42ff-a051-93fe20c10cc2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.135262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36b4fdcd-bf25-42ff-a051-93fe20c10cc2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.135701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36b4fdcd-bf25-42ff-a051-93fe20c10cc2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.266398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3b40634f-a199-489f-bbda-50865f46cfb7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:40.267195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3b40634f-a199-489f-bbda-50865f46cfb7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:40.274080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b40634f-a199-489f-bbda-50865f46cfb7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.274801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b40634f-a199-489f-bbda-50865f46cfb7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.275423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b40634f-a199-489f-bbda-50865f46cfb7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.276432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b40634f-a199-489f-bbda-50865f46cfb7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.277042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b40634f-a199-489f-bbda-50865f46cfb7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.277696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b40634f-a199-489f-bbda-50865f46cfb7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.521254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-36b4fdcd-bf25-42ff-a051-93fe20c10cc2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:40.530085 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-36b4fdcd-bf25-42ff-a051-93fe20c10cc2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.423821 Aug 29 15:34:40.530690 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1266/2517] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:40 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:40.696245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-573d9f28-ccbd-4b54-8205-7cc5df0d2e95 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:40.696864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-573d9f28-ccbd-4b54-8205-7cc5df0d2e95 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:40.703275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-573d9f28-ccbd-4b54-8205-7cc5df0d2e95 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.703765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-573d9f28-ccbd-4b54-8205-7cc5df0d2e95 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.704224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-573d9f28-ccbd-4b54-8205-7cc5df0d2e95 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.705258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-573d9f28-ccbd-4b54-8205-7cc5df0d2e95 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.705893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-573d9f28-ccbd-4b54-8205-7cc5df0d2e95 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.706452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-573d9f28-ccbd-4b54-8205-7cc5df0d2e95 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.710690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3b40634f-a199-489f-bbda-50865f46cfb7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:40.729453 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3b40634f-a199-489f-bbda-50865f46cfb7 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1517 microversion: 2.1 time: 0.471236 Aug 29 15:34:40.730371 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1252/2518] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:40 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1517 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:40.807934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5bab7700-48b8-4fa9-8186-2e6b24b1edbe tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:40.808667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5bab7700-48b8-4fa9-8186-2e6b24b1edbe tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:40.822883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bab7700-48b8-4fa9-8186-2e6b24b1edbe tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.826061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bab7700-48b8-4fa9-8186-2e6b24b1edbe tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.826949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bab7700-48b8-4fa9-8186-2e6b24b1edbe tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.840039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bab7700-48b8-4fa9-8186-2e6b24b1edbe tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.849020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bab7700-48b8-4fa9-8186-2e6b24b1edbe tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.850483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bab7700-48b8-4fa9-8186-2e6b24b1edbe tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.913358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bab7700-48b8-4fa9-8186-2e6b24b1edbe tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.914279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bab7700-48b8-4fa9-8186-2e6b24b1edbe tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.915035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bab7700-48b8-4fa9-8186-2e6b24b1edbe tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.915757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-5bab7700-48b8-4fa9-8186-2e6b24b1edbe tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lazy-loading 'fault' on Instance uuid 982d1df4-7b96-4fbf-8ec2-61752962955d {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:40.965833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-573d9f28-ccbd-4b54-8205-7cc5df0d2e95 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:40.975883 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-573d9f28-ccbd-4b54-8205-7cc5df0d2e95 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.284532 Aug 29 15:34:40.976800 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1267/2519] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:40 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:40.982309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-94ae1936-8f86-443e-bf58-9d20c7369300 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:40.984870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-94ae1936-8f86-443e-bf58-9d20c7369300 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:40.997269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ae1936-8f86-443e-bf58-9d20c7369300 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:40.997993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ae1936-8f86-443e-bf58-9d20c7369300 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:40.998922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ae1936-8f86-443e-bf58-9d20c7369300 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:40.999807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ae1936-8f86-443e-bf58-9d20c7369300 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:41.001867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ae1936-8f86-443e-bf58-9d20c7369300 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:41.002493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ae1936-8f86-443e-bf58-9d20c7369300 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:41.006447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5bab7700-48b8-4fa9-8186-2e6b24b1edbe tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:41.019537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5bab7700-48b8-4fa9-8186-2e6b24b1edbe tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:41.023081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5bab7700-48b8-4fa9-8186-2e6b24b1edbe tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:41.026688 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5bab7700-48b8-4fa9-8186-2e6b24b1edbe tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 200 len: 1376 microversion: 2.25 time: 0.222991 Aug 29 15:34:41.041581 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1253/2520] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:40 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 1376 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:34:41.048992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9077c78e-7266-4ac7-acc4-13355962d8b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:41.050616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9077c78e-7266-4ac7-acc4-13355962d8b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:41.060464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9077c78e-7266-4ac7-acc4-13355962d8b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:41.063306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9077c78e-7266-4ac7-acc4-13355962d8b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:41.074707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9077c78e-7266-4ac7-acc4-13355962d8b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:41.075737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9077c78e-7266-4ac7-acc4-13355962d8b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:41.076665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9077c78e-7266-4ac7-acc4-13355962d8b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:41.077324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9077c78e-7266-4ac7-acc4-13355962d8b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:41.415630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-94ae1936-8f86-443e-bf58-9d20c7369300 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:41.422735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:41.432387 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-94ae1936-8f86-443e-bf58-9d20c7369300 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.453904 Aug 29 15:34:41.435307 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1268/2521] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:40 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:41.471676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-624f749e-6af5-4233-89cb-a5fbe0dabb55 req-f180b9cd-089b-4898-a320-0e6d8ba56504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8", "name": "network-vif-unplugged", "status": "completed", "tag": "7384f0e5-3cc6-41d9-b8ee-6ab5e6937bc9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:41.494135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9077c78e-7266-4ac7-acc4-13355962d8b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:41.515279 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9077c78e-7266-4ac7-acc4-13355962d8b0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.469995 Aug 29 15:34:41.524967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-624f749e-6af5-4233-89cb-a5fbe0dabb55 req-f180b9cd-089b-4898-a320-0e6d8ba56504 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:41.526028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-624f749e-6af5-4233-89cb-a5fbe0dabb55 req-f180b9cd-089b-4898-a320-0e6d8ba56504 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:41.527399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-624f749e-6af5-4233-89cb-a5fbe0dabb55 req-f180b9cd-089b-4898-a320-0e6d8ba56504 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:41.538924 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1254/2522] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:41 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:41.552136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3ea761e5-60e5-435e-b9b6-3a1588b50f43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:41.553073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3ea761e5-60e5-435e-b9b6-3a1588b50f43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:41.555547 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-624f749e-6af5-4233-89cb-a5fbe0dabb55 req-f180b9cd-089b-4898-a320-0e6d8ba56504 service nova] Creating event network-vif-unplugged:7384f0e5-3cc6-41d9-b8ee-6ab5e6937bc9 for instance 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 on n-h1-839401-11 Aug 29 15:34:41.574001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ea761e5-60e5-435e-b9b6-3a1588b50f43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:41.574502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ea761e5-60e5-435e-b9b6-3a1588b50f43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:41.574944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ea761e5-60e5-435e-b9b6-3a1588b50f43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:41.577056 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-624f749e-6af5-4233-89cb-a5fbe0dabb55 req-f180b9cd-089b-4898-a320-0e6d8ba56504 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136608 Aug 29 15:34:41.579052 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1269/2523] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:41.579434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ea761e5-60e5-435e-b9b6-3a1588b50f43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:41.579915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ea761e5-60e5-435e-b9b6-3a1588b50f43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:41.580359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ea761e5-60e5-435e-b9b6-3a1588b50f43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:41.755458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eb02a73a-75d8-4414-8543-f5fee2ac591a tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:41.756354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eb02a73a-75d8-4414-8543-f5fee2ac591a tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:41.772570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb02a73a-75d8-4414-8543-f5fee2ac591a tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:41.776602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb02a73a-75d8-4414-8543-f5fee2ac591a tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:41.777454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb02a73a-75d8-4414-8543-f5fee2ac591a tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:41.779008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb02a73a-75d8-4414-8543-f5fee2ac591a tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:41.779635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb02a73a-75d8-4414-8543-f5fee2ac591a tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:41.780903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb02a73a-75d8-4414-8543-f5fee2ac591a tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:41.920716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eb02a73a-75d8-4414-8543-f5fee2ac591a tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:41.931680 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eb02a73a-75d8-4414-8543-f5fee2ac591a tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1475 microversion: 2.1 time: 0.181144 Aug 29 15:34:41.940504 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1270/2524] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:41 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1475 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:41.998852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f0588fe4-6fb9-42ff-b3a7-f9be82d14d77 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:41.999822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f0588fe4-6fb9-42ff-b3a7-f9be82d14d77 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:42.009931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0588fe4-6fb9-42ff-b3a7-f9be82d14d77 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:42.013542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0588fe4-6fb9-42ff-b3a7-f9be82d14d77 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:42.014010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0588fe4-6fb9-42ff-b3a7-f9be82d14d77 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:42.014780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0588fe4-6fb9-42ff-b3a7-f9be82d14d77 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:42.015241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0588fe4-6fb9-42ff-b3a7-f9be82d14d77 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:42.018346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0588fe4-6fb9-42ff-b3a7-f9be82d14d77 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:42.358340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3ea761e5-60e5-435e-b9b6-3a1588b50f43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:42.365839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f0588fe4-6fb9-42ff-b3a7-f9be82d14d77 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:42.370373 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3ea761e5-60e5-435e-b9b6-3a1588b50f43 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.822401 Aug 29 15:34:42.371668 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1255/2525] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:41 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:42.391159 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f0588fe4-6fb9-42ff-b3a7-f9be82d14d77 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.397008 Aug 29 15:34:42.402445 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1271/2526] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:41 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:42.406061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0fe43bbd-e7ab-403c-83cf-b433cd38af7e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:42.406061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0fe43bbd-e7ab-403c-83cf-b433cd38af7e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 982d1df4-7b96-4fbf-8ec2-61752962955d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:42.408109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fe43bbd-e7ab-403c-83cf-b433cd38af7e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:42.409201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fe43bbd-e7ab-403c-83cf-b433cd38af7e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:42.409850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fe43bbd-e7ab-403c-83cf-b433cd38af7e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:42.410787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fe43bbd-e7ab-403c-83cf-b433cd38af7e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:42.411972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fe43bbd-e7ab-403c-83cf-b433cd38af7e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:42.412450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fe43bbd-e7ab-403c-83cf-b433cd38af7e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:42.433391 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-0fe43bbd-e7ab-403c-83cf-b433cd38af7e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] HTTP exception thrown: Instance 982d1df4-7b96-4fbf-8ec2-61752962955d could not be found. Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0fe43bbd-e7ab-403c-83cf-b433cd38af7e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Request method failure captured: Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d HTTP/1.1 Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNp9DXxKqZa_RRXSEhegpFvOgEYKZccwROpVhhDp1V7lLp7_8__NkuMACj6wnIslK5_kmPd2ELM-AzNVOAt7RJD9Uk8U3OxRuotLE0bzh9OM3ouSISIuXAlPdHpTX7T4A6StS0IfKYA6vTV9yay3uVhpeZ1RNwKXJmoYk2Wad1JbYXI Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: ef5a2735bd95451ab466c5560cbe28fe Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1701535054 Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ef5a2735bd95451ab466c5560cbe28fe", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ef5a2735bd95451ab466c5560cbe28fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ef5a2735bd95451ab466c5560cbe28fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ef5a2735bd95451ab466c5560cbe28fe"}]}] Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1701535054 Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: ef5a2735bd95451ab466c5560cbe28fe Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1701535054 Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-LiveAutoBlockMigrationV225Test-1701535054-project Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 9011569d41804e27a53fe5831988a88a Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1701535054-project Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 982d1df4-7b96-4fbf-8ec2-61752962955d could not be found. Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '982d1df4-7b96-4fbf-8ec2-61752962955d'} Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 982d1df4-7b96-4fbf-8ec2-61752962955d could not be found. Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 982d1df4-7b96-4fbf-8ec2-61752962955d could not be found. Aug 29 15:34:42.435674 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:34:42.441495 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:42.441495 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:34:42.441495 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:42.441495 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:42.441495 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:42.441495 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:42.441495 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:42.441495 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 982d1df4-7b96-4fbf-8ec2-61752962955d could not be found. Aug 29 15:34:42.441495 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:34:42.441495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0fe43bbd-e7ab-403c-83cf-b433cd38af7e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Returning 404 to user: Instance 982d1df4-7b96-4fbf-8ec2-61752962955d could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:42.441495 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0fe43bbd-e7ab-403c-83cf-b433cd38af7e tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d" status: 404 len: 111 microversion: 2.25 time: 0.064874 Aug 29 15:34:42.441495 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1256/2527] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:42 2022] GET /compute/v2.1/servers/982d1df4-7b96-4fbf-8ec2-61752962955d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:34:42.448268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ab81cd04-b738-4f0b-bd48-e6074be7d351 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '.version_select at 0x7fc42ac76040>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:42.467719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-08760a6e-1348-4bf2-bcbf-849ceffb42bb tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:42.468250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-08760a6e-1348-4bf2-bcbf-849ceffb42bb tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:42.478466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08760a6e-1348-4bf2-bcbf-849ceffb42bb tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:42.480354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08760a6e-1348-4bf2-bcbf-849ceffb42bb tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:42.481137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08760a6e-1348-4bf2-bcbf-849ceffb42bb tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:42.482055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08760a6e-1348-4bf2-bcbf-849ceffb42bb tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:42.482809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08760a6e-1348-4bf2-bcbf-849ceffb42bb tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:42.484295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08760a6e-1348-4bf2-bcbf-849ceffb42bb tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:42.510194 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ab81cd04-b738-4f0b-bd48-e6074be7d351 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1134045687" status: 204 len: 0 microversion: 2.25 time: 0.066437 Aug 29 15:34:42.511289 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1272/2528] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 15:34:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1134045687 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 15:34:42.550582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e3860e53-a177-43d1-a5e8-038ee492a4d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:42.553701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e3860e53-a177-43d1-a5e8-038ee492a4d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:42.572483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3860e53-a177-43d1-a5e8-038ee492a4d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:42.573111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3860e53-a177-43d1-a5e8-038ee492a4d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:42.577158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3860e53-a177-43d1-a5e8-038ee492a4d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:42.577870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3860e53-a177-43d1-a5e8-038ee492a4d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:42.578651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3860e53-a177-43d1-a5e8-038ee492a4d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:42.579275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3860e53-a177-43d1-a5e8-038ee492a4d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:42.780332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-08760a6e-1348-4bf2-bcbf-849ceffb42bb tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:42.798132 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-08760a6e-1348-4bf2-bcbf-849ceffb42bb tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.335289 Aug 29 15:34:42.810963 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1257/2529] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:42 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:42.964170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-59fc99fb-53e1-46ce-b59c-0910b644ac17 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:42.965047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-59fc99fb-53e1-46ce-b59c-0910b644ac17 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:42.973776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59fc99fb-53e1-46ce-b59c-0910b644ac17 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:42.974435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59fc99fb-53e1-46ce-b59c-0910b644ac17 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:42.975001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59fc99fb-53e1-46ce-b59c-0910b644ac17 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:42.975859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59fc99fb-53e1-46ce-b59c-0910b644ac17 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:42.976647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59fc99fb-53e1-46ce-b59c-0910b644ac17 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:42.977263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59fc99fb-53e1-46ce-b59c-0910b644ac17 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.016164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59fc99fb-53e1-46ce-b59c-0910b644ac17 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.016904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59fc99fb-53e1-46ce-b59c-0910b644ac17 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.017503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59fc99fb-53e1-46ce-b59c-0910b644ac17 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.018090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-59fc99fb-53e1-46ce-b59c-0910b644ac17 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lazy-loading 'fault' on Instance uuid a2add301-a12d-453d-89dd-12fe794e589c {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:43.098118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-59fc99fb-53e1-46ce-b59c-0910b644ac17 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:43.118342 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-59fc99fb-53e1-46ce-b59c-0910b644ac17 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 200 len: 1310 microversion: 2.1 time: 0.157201 Aug 29 15:34:43.118898 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1258/2530] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:42 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 1310 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:43.141059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e3860e53-a177-43d1-a5e8-038ee492a4d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:43.164289 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e3860e53-a177-43d1-a5e8-038ee492a4d1 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.623820 Aug 29 15:34:43.177108 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1273/2531] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:42 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:43.395433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-58845478-b604-4233-b8c2-77869325466a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:43.399038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-58845478-b604-4233-b8c2-77869325466a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:43.411599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58845478-b604-4233-b8c2-77869325466a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.412470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58845478-b604-4233-b8c2-77869325466a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.413433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58845478-b604-4233-b8c2-77869325466a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.414577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58845478-b604-4233-b8c2-77869325466a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.415336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58845478-b604-4233-b8c2-77869325466a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.415997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58845478-b604-4233-b8c2-77869325466a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.417289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-852a9aba-1a48-499d-a767-e3044d74da32 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:43.418018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-852a9aba-1a48-499d-a767-e3044d74da32 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:43.433689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852a9aba-1a48-499d-a767-e3044d74da32 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.441211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852a9aba-1a48-499d-a767-e3044d74da32 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.441808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852a9aba-1a48-499d-a767-e3044d74da32 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.442977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852a9aba-1a48-499d-a767-e3044d74da32 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.444041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852a9aba-1a48-499d-a767-e3044d74da32 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.444659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852a9aba-1a48-499d-a767-e3044d74da32 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.623756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-58845478-b604-4233-b8c2-77869325466a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:43.634749 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-58845478-b604-4233-b8c2-77869325466a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.246625 Aug 29 15:34:43.636128 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1259/2532] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:43 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:43.641465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e47dffb-bcc0-4557-b881-c8c4bee7b4d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:43.642347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9e47dffb-bcc0-4557-b881-c8c4bee7b4d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:43.649184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:43.653850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e47dffb-bcc0-4557-b881-c8c4bee7b4d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.654883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e47dffb-bcc0-4557-b881-c8c4bee7b4d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.655550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e47dffb-bcc0-4557-b881-c8c4bee7b4d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.656449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e47dffb-bcc0-4557-b881-c8c4bee7b4d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.657060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e47dffb-bcc0-4557-b881-c8c4bee7b4d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.657664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e47dffb-bcc0-4557-b881-c8c4bee7b4d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.708690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9e47dffb-bcc0-4557-b881-c8c4bee7b4d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:43.811963 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9e47dffb-bcc0-4557-b881-c8c4bee7b4d9 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 204 len: 0 microversion: 2.25 time: 0.173977 Aug 29 15:34:43.813114 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1260/2533] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:34:43 2022] DELETE /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:34:43.825138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ab9421ad-0dfe-424f-9071-5a342473d6b7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:43.825533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ab9421ad-0dfe-424f-9071-5a342473d6b7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:43.833662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab9421ad-0dfe-424f-9071-5a342473d6b7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.834168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab9421ad-0dfe-424f-9071-5a342473d6b7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.834721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab9421ad-0dfe-424f-9071-5a342473d6b7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.835450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab9421ad-0dfe-424f-9071-5a342473d6b7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.835911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab9421ad-0dfe-424f-9071-5a342473d6b7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.836338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab9421ad-0dfe-424f-9071-5a342473d6b7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.846002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-852a9aba-1a48-499d-a767-e3044d74da32 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:43.859219 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-852a9aba-1a48-499d-a767-e3044d74da32 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.448234 Aug 29 15:34:43.873534 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1274/2534] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:43 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:43.880421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-57973b3e-39dd-4499-8301-f68d7e7fb4c5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:43.881525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-57973b3e-39dd-4499-8301-f68d7e7fb4c5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:43.903849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57973b3e-39dd-4499-8301-f68d7e7fb4c5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.905293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57973b3e-39dd-4499-8301-f68d7e7fb4c5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.906032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57973b3e-39dd-4499-8301-f68d7e7fb4c5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:43.907084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57973b3e-39dd-4499-8301-f68d7e7fb4c5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:43.909743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57973b3e-39dd-4499-8301-f68d7e7fb4c5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:43.910438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57973b3e-39dd-4499-8301-f68d7e7fb4c5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.020902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ab9421ad-0dfe-424f-9071-5a342473d6b7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:44.030209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ab9421ad-0dfe-424f-9071-5a342473d6b7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:44.031805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ab9421ad-0dfe-424f-9071-5a342473d6b7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:44.033177 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ab9421ad-0dfe-424f-9071-5a342473d6b7 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1549 microversion: 2.25 time: 0.215565 Aug 29 15:34:44.034198 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1261/2535] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:43 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1549 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:44.104525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-48743be4-dd32-4144-8eb9-9f43061a0b14 req-3e07fe19-76c8-4d21-ad17-280d8418c868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2add301-a12d-453d-89dd-12fe794e589c", "name": "network-vif-deleted", "tag": "7dee5476-02f7-423b-895e-8e40ac13a042"}, {"name": "network-changed", "server_uuid": "8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8", "tag": "7384f0e5-3cc6-41d9-b8ee-6ab5e6937bc9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:44.114938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-57973b3e-39dd-4499-8301-f68d7e7fb4c5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:44.123078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-48743be4-dd32-4144-8eb9-9f43061a0b14 req-3e07fe19-76c8-4d21-ad17-280d8418c868 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.123572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-48743be4-dd32-4144-8eb9-9f43061a0b14 req-3e07fe19-76c8-4d21-ad17-280d8418c868 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.123697 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-57973b3e-39dd-4499-8301-f68d7e7fb4c5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.254637 Aug 29 15:34:44.123988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-48743be4-dd32-4144-8eb9-9f43061a0b14 req-3e07fe19-76c8-4d21-ad17-280d8418c868 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.124938 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1275/2536] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:43 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:44.140588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6f6aa329-3a62-4519-921c-af38ac660467 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:44.141406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6f6aa329-3a62-4519-921c-af38ac660467 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: a2add301-a12d-453d-89dd-12fe794e589c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:44.148818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f6aa329-3a62-4519-921c-af38ac660467 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.149723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f6aa329-3a62-4519-921c-af38ac660467 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.150303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f6aa329-3a62-4519-921c-af38ac660467 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.151147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f6aa329-3a62-4519-921c-af38ac660467 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.151752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f6aa329-3a62-4519-921c-af38ac660467 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.152328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f6aa329-3a62-4519-921c-af38ac660467 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.156728 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-48743be4-dd32-4144-8eb9-9f43061a0b14 req-3e07fe19-76c8-4d21-ad17-280d8418c868 service nova] Creating event network-vif-deleted:7dee5476-02f7-423b-895e-8e40ac13a042 for instance a2add301-a12d-453d-89dd-12fe794e589c on n-h2-839401-11 Aug 29 15:34:44.158820 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-48743be4-dd32-4144-8eb9-9f43061a0b14 req-3e07fe19-76c8-4d21-ad17-280d8418c868 service nova] Creating event network-changed:7384f0e5-3cc6-41d9-b8ee-6ab5e6937bc9 for instance 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 on n-h1-839401-11 Aug 29 15:34:44.168416 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-48743be4-dd32-4144-8eb9-9f43061a0b14 req-3e07fe19-76c8-4d21-ad17-280d8418c868 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.068185 Aug 29 15:34:44.169588 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-6f6aa329-3a62-4519-921c-af38ac660467 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] HTTP exception thrown: Instance a2add301-a12d-453d-89dd-12fe794e589c could not be found. Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6f6aa329-3a62-4519-921c-af38ac660467 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Request method failure captured: Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c HTTP/1.1 Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNw6szHp2btbIrMvgQ98ntgw2gpBwrHi9RSvnE1UoIUZONVAdlXHorsh2Pvha5hLgSaIw6LOKp5LehH-Mmsy-9zYSgN9Y_tmaboTVTeoXgpYc310lLhQm6ipiqgql5xdg1vW_0-2xpsPunFFLw4OC37gmd76WKXFyYSGbmuumWTxJAU Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 448ade75da744a0fa52b64221fabfc21 Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ListServerFiltersTestJSON-589148671 Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_448ade75da744a0fa52b64221fabfc21", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/448ade75da744a0fa52b64221fabfc21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/448ade75da744a0fa52b64221fabfc21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/448ade75da744a0fa52b64221fabfc21"}]}] Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ListServerFiltersTestJSON-589148671 Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 448ade75da744a0fa52b64221fabfc21 Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-589148671 Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ListServerFiltersTestJSON-589148671-project Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 8430472729074bdbb6fc9bf8a0506e66 Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ListServerFiltersTestJSON-589148671-project Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance a2add301-a12d-453d-89dd-12fe794e589c could not be found. Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'a2add301-a12d-453d-89dd-12fe794e589c'} Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2add301-a12d-453d-89dd-12fe794e589c could not be found. Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2add301-a12d-453d-89dd-12fe794e589c could not be found. Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:44.172065 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:44.176418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:44.176418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:44.176418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:44.176418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:44.176418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:44.176418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2add301-a12d-453d-89dd-12fe794e589c could not be found. Aug 29 15:34:44.176418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:44.176418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6f6aa329-3a62-4519-921c-af38ac660467 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Returning 404 to user: Instance a2add301-a12d-453d-89dd-12fe794e589c could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:44.176418 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6f6aa329-3a62-4519-921c-af38ac660467 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c" status: 404 len: 111 microversion: 2.1 time: 0.036881 Aug 29 15:34:44.176418 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1276/2537] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:44 2022] GET /compute/v2.1/servers/a2add301-a12d-453d-89dd-12fe794e589c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:34:44.177325 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1262/2538] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:34:44.182852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b3034bec-e8be-4dd1-8091-73aa8f641e65 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:44.183134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b3034bec-e8be-4dd1-8091-73aa8f641e65 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: d624c852-fdae-4a2b-bd07-3d751e56c170] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:44.189738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3034bec-e8be-4dd1-8091-73aa8f641e65 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.190342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3034bec-e8be-4dd1-8091-73aa8f641e65 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.190837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3034bec-e8be-4dd1-8091-73aa8f641e65 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.191755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3034bec-e8be-4dd1-8091-73aa8f641e65 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.192469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3034bec-e8be-4dd1-8091-73aa8f641e65 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.193111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3034bec-e8be-4dd1-8091-73aa8f641e65 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.204722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fff7393c-67c4-4ca2-874d-0a705f5102dc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:44.205558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fff7393c-67c4-4ca2-874d-0a705f5102dc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:44.213111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff7393c-67c4-4ca2-874d-0a705f5102dc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.213691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff7393c-67c4-4ca2-874d-0a705f5102dc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.217202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff7393c-67c4-4ca2-874d-0a705f5102dc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.218700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff7393c-67c4-4ca2-874d-0a705f5102dc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.219299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff7393c-67c4-4ca2-874d-0a705f5102dc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.221213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff7393c-67c4-4ca2-874d-0a705f5102dc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.280804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b3034bec-e8be-4dd1-8091-73aa8f641e65 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: d624c852-fdae-4a2b-bd07-3d751e56c170] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:44.319639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:44.436308 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b3034bec-e8be-4dd1-8091-73aa8f641e65 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170" status: 204 len: 0 microversion: 2.1 time: 0.255325 Aug 29 15:34:44.440774 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1277/2539] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:34:44 2022] DELETE /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:34:44.450583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3ed0b4e0-9124-4b2e-867e-241c013be8d4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:44.451396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3ed0b4e0-9124-4b2e-867e-241c013be8d4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: d624c852-fdae-4a2b-bd07-3d751e56c170] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:44.463049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ed0b4e0-9124-4b2e-867e-241c013be8d4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.463627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ed0b4e0-9124-4b2e-867e-241c013be8d4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.465214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ed0b4e0-9124-4b2e-867e-241c013be8d4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.466575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ed0b4e0-9124-4b2e-867e-241c013be8d4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.467775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ed0b4e0-9124-4b2e-867e-241c013be8d4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.468225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ed0b4e0-9124-4b2e-867e-241c013be8d4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.541981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fff7393c-67c4-4ca2-874d-0a705f5102dc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:44.547057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:44.552858 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fff7393c-67c4-4ca2-874d-0a705f5102dc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.371010 Aug 29 15:34:44.553797 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1263/2540] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:44 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:44.658811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f65beb63-bdcb-4a79-b7c1-e7382dac41fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:44.659456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f65beb63-bdcb-4a79-b7c1-e7382dac41fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:44.668885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f65beb63-bdcb-4a79-b7c1-e7382dac41fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.669843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f65beb63-bdcb-4a79-b7c1-e7382dac41fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.670619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f65beb63-bdcb-4a79-b7c1-e7382dac41fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.672067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f65beb63-bdcb-4a79-b7c1-e7382dac41fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.672271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f65beb63-bdcb-4a79-b7c1-e7382dac41fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.673153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f65beb63-bdcb-4a79-b7c1-e7382dac41fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.827330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f65beb63-bdcb-4a79-b7c1-e7382dac41fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:44.837771 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f65beb63-bdcb-4a79-b7c1-e7382dac41fc tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.184624 Aug 29 15:34:44.838760 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1264/2541] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:44 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:44.884203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8256306e-9d39-47a3-a95c-2a9fbef51335 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:44.885414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8256306e-9d39-47a3-a95c-2a9fbef51335 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:44.895723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8256306e-9d39-47a3-a95c-2a9fbef51335 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.898142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8256306e-9d39-47a3-a95c-2a9fbef51335 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.898902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8256306e-9d39-47a3-a95c-2a9fbef51335 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:44.900558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8256306e-9d39-47a3-a95c-2a9fbef51335 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:44.901365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8256306e-9d39-47a3-a95c-2a9fbef51335 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:44.902353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8256306e-9d39-47a3-a95c-2a9fbef51335 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.065128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3ed0b4e0-9124-4b2e-867e-241c013be8d4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:45.074615 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3ed0b4e0-9124-4b2e-867e-241c013be8d4 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170" status: 200 len: 1518 microversion: 2.1 time: 0.631642 Aug 29 15:34:45.075824 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1278/2542] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:44 2022] GET /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170 => generated 1518 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:45.081796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-58e34998-45d3-4b12-9220-03be07e210fb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:45.083090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-58e34998-45d3-4b12-9220-03be07e210fb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:45.094223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58e34998-45d3-4b12-9220-03be07e210fb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.094806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58e34998-45d3-4b12-9220-03be07e210fb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.095674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58e34998-45d3-4b12-9220-03be07e210fb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.096444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58e34998-45d3-4b12-9220-03be07e210fb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.096961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58e34998-45d3-4b12-9220-03be07e210fb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.102513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58e34998-45d3-4b12-9220-03be07e210fb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.198639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8256306e-9d39-47a3-a95c-2a9fbef51335 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:45.216212 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8256306e-9d39-47a3-a95c-2a9fbef51335 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.338711 Aug 29 15:34:45.231884 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1265/2543] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:44 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:45.262588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-496f27ff-5f06-4d1f-9355-cdf79ef4f79d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:45.264111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-496f27ff-5f06-4d1f-9355-cdf79ef4f79d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:45.297323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-496f27ff-5f06-4d1f-9355-cdf79ef4f79d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.298041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-496f27ff-5f06-4d1f-9355-cdf79ef4f79d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.300038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-496f27ff-5f06-4d1f-9355-cdf79ef4f79d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.301322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-496f27ff-5f06-4d1f-9355-cdf79ef4f79d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.302090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-496f27ff-5f06-4d1f-9355-cdf79ef4f79d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.302509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-496f27ff-5f06-4d1f-9355-cdf79ef4f79d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.380934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-58e34998-45d3-4b12-9220-03be07e210fb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:45.406727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-58e34998-45d3-4b12-9220-03be07e210fb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:45.416780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-58e34998-45d3-4b12-9220-03be07e210fb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:45.418367 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-58e34998-45d3-4b12-9220-03be07e210fb tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1549 microversion: 2.25 time: 0.341356 Aug 29 15:34:45.419149 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1279/2544] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:45 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1549 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:45.581561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bb81642a-5548-4edf-b7c8-1b6b15d171a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:45.583146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bb81642a-5548-4edf-b7c8-1b6b15d171a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:45.591541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb81642a-5548-4edf-b7c8-1b6b15d171a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.592043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb81642a-5548-4edf-b7c8-1b6b15d171a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.592475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb81642a-5548-4edf-b7c8-1b6b15d171a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.593215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb81642a-5548-4edf-b7c8-1b6b15d171a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.593664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb81642a-5548-4edf-b7c8-1b6b15d171a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.597457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb81642a-5548-4edf-b7c8-1b6b15d171a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.697168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-496f27ff-5f06-4d1f-9355-cdf79ef4f79d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:45.712050 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-496f27ff-5f06-4d1f-9355-cdf79ef4f79d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.476387 Aug 29 15:34:45.713494 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1266/2545] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:45 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:45.864848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-685b21f5-b9ba-4026-95b4-ea872c8a2d44 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:45.866499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-685b21f5-b9ba-4026-95b4-ea872c8a2d44 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:45.873857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=16 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:45.883992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-685b21f5-b9ba-4026-95b4-ea872c8a2d44 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.884806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-685b21f5-b9ba-4026-95b4-ea872c8a2d44 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.885488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-685b21f5-b9ba-4026-95b4-ea872c8a2d44 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.886417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-685b21f5-b9ba-4026-95b4-ea872c8a2d44 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:45.890392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-685b21f5-b9ba-4026-95b4-ea872c8a2d44 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:45.891834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-685b21f5-b9ba-4026-95b4-ea872c8a2d44 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:45.910220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bb81642a-5548-4edf-b7c8-1b6b15d171a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:45.920809 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bb81642a-5548-4edf-b7c8-1b6b15d171a4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.350510 Aug 29 15:34:45.928367 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1280/2546] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:45 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:46.228294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:46.254554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-685b21f5-b9ba-4026-95b4-ea872c8a2d44 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:46.262646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-de421755-1951-4561-ad78-1a39d7877604 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'create', calling method: .version_select at 0x7fc42ad0d1f0>, body: {"keypair": {"name": "tempest-keypair-1877837348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC8ISjTKzXPw3xJbdvIcNrnNdWSHWik6ROKBjrg+MWP8ie4kpqSWoCTWLMgwg7pH2Dz6199HtSNT2fTu8WShqNqVaBRjeSt8JWyoqxbA/si+Xap8BCvpZZ4mljE4UBE1A=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:46.264240 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-685b21f5-b9ba-4026-95b4-ea872c8a2d44 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.403886 Aug 29 15:34:46.264836 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1267/2547] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:45 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:46.269876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-94343f43-d1cd-480c-add5-31d2f169fd2f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:46.270533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-94343f43-d1cd-480c-add5-31d2f169fd2f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: d624c852-fdae-4a2b-bd07-3d751e56c170] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:46.276638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94343f43-d1cd-480c-add5-31d2f169fd2f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.277156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94343f43-d1cd-480c-add5-31d2f169fd2f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.277928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94343f43-d1cd-480c-add5-31d2f169fd2f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.278626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94343f43-d1cd-480c-add5-31d2f169fd2f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.279085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94343f43-d1cd-480c-add5-31d2f169fd2f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.279509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94343f43-d1cd-480c-add5-31d2f169fd2f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.284629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-de421755-1951-4561-ad78-1a39d7877604 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Getting quotas for project 990c752c7bb141c1bf496c98fbc3c9a7. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:34:46.291803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-de421755-1951-4561-ad78-1a39d7877604 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Getting quotas for user 51efa71a8bfe457982698a5755ae3cc6 and project 990c752c7bb141c1bf496c98fbc3c9a7. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:34:46.330599 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-de421755-1951-4561-ad78-1a39d7877604 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.249941 Aug 29 15:34:46.331231 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1281/2548] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:34:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:34:46.336501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-21719e90-e6a6-4f66-b885-10a1fa16ddea req-847051ee-d328-4e7a-b823-e67bd5226595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf46166-597d-4649-a09a-600d8c57524d", "name": "network-vif-deleted", "tag": "fb9190f9-2a49-4198-bf76-f097d8ef044f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:46.346801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-21719e90-e6a6-4f66-b885-10a1fa16ddea req-847051ee-d328-4e7a-b823-e67bd5226595 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.347208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-21719e90-e6a6-4f66-b885-10a1fa16ddea req-847051ee-d328-4e7a-b823-e67bd5226595 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.347644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-21719e90-e6a6-4f66-b885-10a1fa16ddea req-847051ee-d328-4e7a-b823-e67bd5226595 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.360091 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-21719e90-e6a6-4f66-b885-10a1fa16ddea req-847051ee-d328-4e7a-b823-e67bd5226595 service nova] Creating event network-vif-deleted:fb9190f9-2a49-4198-bf76-f097d8ef044f for instance 4cf46166-597d-4649-a09a-600d8c57524d on n-h2-839401-11 Aug 29 15:34:46.366225 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-21719e90-e6a6-4f66-b885-10a1fa16ddea req-847051ee-d328-4e7a-b823-e67bd5226595 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Aug 29 15:34:46.367006 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1282/2549] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:46.372485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-92f583fc-7e87-43ac-b3cf-24f9dda1bbc7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:46.373400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-92f583fc-7e87-43ac-b3cf-24f9dda1bbc7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:46.382428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92f583fc-7e87-43ac-b3cf-24f9dda1bbc7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.383005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92f583fc-7e87-43ac-b3cf-24f9dda1bbc7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.383340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92f583fc-7e87-43ac-b3cf-24f9dda1bbc7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.384347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92f583fc-7e87-43ac-b3cf-24f9dda1bbc7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.384747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92f583fc-7e87-43ac-b3cf-24f9dda1bbc7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.385271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92f583fc-7e87-43ac-b3cf-24f9dda1bbc7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.538726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-94343f43-d1cd-480c-add5-31d2f169fd2f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:46.550236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-92f583fc-7e87-43ac-b3cf-24f9dda1bbc7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:46.567948 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-92f583fc-7e87-43ac-b3cf-24f9dda1bbc7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.199550 Aug 29 15:34:46.568221 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-94343f43-d1cd-480c-add5-31d2f169fd2f tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170" status: 200 len: 1518 microversion: 2.1 time: 0.299624 Aug 29 15:34:46.572638 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1268/2550] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:46 2022] GET /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170 => generated 1518 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:46.585803 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1283/2551] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:46 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:46.589866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-81789e6f-7e26-4afc-92b4-b6fff3487631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:46.591013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-81789e6f-7e26-4afc-92b4-b6fff3487631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:46.598972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81789e6f-7e26-4afc-92b4-b6fff3487631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.599471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81789e6f-7e26-4afc-92b4-b6fff3487631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.600070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81789e6f-7e26-4afc-92b4-b6fff3487631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.600806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81789e6f-7e26-4afc-92b4-b6fff3487631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.601317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81789e6f-7e26-4afc-92b4-b6fff3487631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.601756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81789e6f-7e26-4afc-92b4-b6fff3487631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.640227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81789e6f-7e26-4afc-92b4-b6fff3487631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.640725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81789e6f-7e26-4afc-92b4-b6fff3487631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.641212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81789e6f-7e26-4afc-92b4-b6fff3487631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.641674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-81789e6f-7e26-4afc-92b4-b6fff3487631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lazy-loading 'fault' on Instance uuid 4cf46166-597d-4649-a09a-600d8c57524d {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:46.737593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-886284ab-16e3-40c6-9c55-22474030e702 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:46.737891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-886284ab-16e3-40c6-9c55-22474030e702 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:46.745239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-886284ab-16e3-40c6-9c55-22474030e702 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.745239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-886284ab-16e3-40c6-9c55-22474030e702 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.745464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-886284ab-16e3-40c6-9c55-22474030e702 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.746178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-886284ab-16e3-40c6-9c55-22474030e702 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.746588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-886284ab-16e3-40c6-9c55-22474030e702 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.747015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-886284ab-16e3-40c6-9c55-22474030e702 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.756451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-81789e6f-7e26-4afc-92b4-b6fff3487631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:46.769588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-81789e6f-7e26-4afc-92b4-b6fff3487631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:46.770790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-81789e6f-7e26-4afc-92b4-b6fff3487631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:46.771975 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-81789e6f-7e26-4afc-92b4-b6fff3487631 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 200 len: 1352 microversion: 2.25 time: 0.198223 Aug 29 15:34:46.772749 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1269/2552] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:46 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 1352 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:46.948070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3ecfda08-5c24-4f17-b500-289841679be7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:46.949007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3ecfda08-5c24-4f17-b500-289841679be7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:46.955993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ecfda08-5c24-4f17-b500-289841679be7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.956384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ecfda08-5c24-4f17-b500-289841679be7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.956827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ecfda08-5c24-4f17-b500-289841679be7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:46.957683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ecfda08-5c24-4f17-b500-289841679be7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:46.958418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ecfda08-5c24-4f17-b500-289841679be7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:46.959006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ecfda08-5c24-4f17-b500-289841679be7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.047835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-886284ab-16e3-40c6-9c55-22474030e702 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:47.061452 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-886284ab-16e3-40c6-9c55-22474030e702 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.328175 Aug 29 15:34:47.065214 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1284/2553] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:46 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:47.107517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3ecfda08-5c24-4f17-b500-289841679be7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:47.117780 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3ecfda08-5c24-4f17-b500-289841679be7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.173695 Aug 29 15:34:47.118703 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1270/2554] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:46 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:47.287171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dd76bca8-ef49-42f5-9c0e-8e210953baac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:47.288338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dd76bca8-ef49-42f5-9c0e-8e210953baac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:47.296307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd76bca8-ef49-42f5-9c0e-8e210953baac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.297026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd76bca8-ef49-42f5-9c0e-8e210953baac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.297932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd76bca8-ef49-42f5-9c0e-8e210953baac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.298892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd76bca8-ef49-42f5-9c0e-8e210953baac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.299695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd76bca8-ef49-42f5-9c0e-8e210953baac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.300356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd76bca8-ef49-42f5-9c0e-8e210953baac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.534819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-1f9ff5f7-5499-4e55-b730-45067dd3e849 req-1bc66445-a25e-46da-bc09-2cf48cca4661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d624c852-fdae-4a2b-bd07-3d751e56c170", "name": "network-vif-deleted", "tag": "803fd968-9041-42a9-a133-91672dd13b1a"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:47.555462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1f9ff5f7-5499-4e55-b730-45067dd3e849 req-1bc66445-a25e-46da-bc09-2cf48cca4661 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.555961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1f9ff5f7-5499-4e55-b730-45067dd3e849 req-1bc66445-a25e-46da-bc09-2cf48cca4661 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.556403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1f9ff5f7-5499-4e55-b730-45067dd3e849 req-1bc66445-a25e-46da-bc09-2cf48cca4661 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.587584 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-1f9ff5f7-5499-4e55-b730-45067dd3e849 req-1bc66445-a25e-46da-bc09-2cf48cca4661 service nova] Creating event network-vif-deleted:803fd968-9041-42a9-a133-91672dd13b1a for instance d624c852-fdae-4a2b-bd07-3d751e56c170 on n-h1-839401-11 Aug 29 15:34:47.597256 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-1f9ff5f7-5499-4e55-b730-45067dd3e849 req-1bc66445-a25e-46da-bc09-2cf48cca4661 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066095 Aug 29 15:34:47.602828 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1271/2555] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:34:47.608639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d59cc457-21ed-445e-ac90-cd9903a04cbc tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:47.615699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d59cc457-21ed-445e-ac90-cd9903a04cbc tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: d624c852-fdae-4a2b-bd07-3d751e56c170] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:47.628959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d59cc457-21ed-445e-ac90-cd9903a04cbc tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.633417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d59cc457-21ed-445e-ac90-cd9903a04cbc tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.633973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d59cc457-21ed-445e-ac90-cd9903a04cbc tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.634748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d59cc457-21ed-445e-ac90-cd9903a04cbc tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.635860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d59cc457-21ed-445e-ac90-cd9903a04cbc tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.636293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d59cc457-21ed-445e-ac90-cd9903a04cbc tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.674889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dd76bca8-ef49-42f5-9c0e-8e210953baac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:47.690969 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dd76bca8-ef49-42f5-9c0e-8e210953baac tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.408448 Aug 29 15:34:47.697872 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1285/2556] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:47 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:47.719911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d8381e9f-94c9-4035-8800-c0f0ee2c9feb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:47.721009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d8381e9f-94c9-4035-8800-c0f0ee2c9feb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:47.728547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8381e9f-94c9-4035-8800-c0f0ee2c9feb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.729465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8381e9f-94c9-4035-8800-c0f0ee2c9feb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.730050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8381e9f-94c9-4035-8800-c0f0ee2c9feb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.730965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8381e9f-94c9-4035-8800-c0f0ee2c9feb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.731558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8381e9f-94c9-4035-8800-c0f0ee2c9feb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.732324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8381e9f-94c9-4035-8800-c0f0ee2c9feb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.768129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d59cc457-21ed-445e-ac90-cd9903a04cbc tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:47.778044 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d59cc457-21ed-445e-ac90-cd9903a04cbc tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170" status: 200 len: 1306 microversion: 2.1 time: 0.173222 Aug 29 15:34:47.803445 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1272/2557] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:47 2022] GET /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170 => generated 1306 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:47.814151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-383bc366-b5c8-499d-b7f3-82a854df31a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:47.814796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-383bc366-b5c8-499d-b7f3-82a854df31a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: 4cf46166-597d-4649-a09a-600d8c57524d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:47.834861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-383bc366-b5c8-499d-b7f3-82a854df31a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.835564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-383bc366-b5c8-499d-b7f3-82a854df31a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.836244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-383bc366-b5c8-499d-b7f3-82a854df31a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.837889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-383bc366-b5c8-499d-b7f3-82a854df31a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.840809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-383bc366-b5c8-499d-b7f3-82a854df31a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.841867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-383bc366-b5c8-499d-b7f3-82a854df31a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.897656 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-383bc366-b5c8-499d-b7f3-82a854df31a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] HTTP exception thrown: Instance 4cf46166-597d-4649-a09a-600d8c57524d could not be found. Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-383bc366-b5c8-499d-b7f3-82a854df31a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Request method failure captured: Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d HTTP/1.1 Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNp9DXxKqZa_RRXSEhegpFvOgEYKZccwROpVhhDp1V7lLp7_8__NkuMACj6wnIslK5_kmPd2ELM-AzNVOAt7RJD9Uk8U3OxRuotLE0bzh9OM3ouSISIuXAlPdHpTX7T4A6StS0IfKYA6vTV9yay3uVhpeZ1RNwKXJmoYk2Wad1JbYXI Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: ef5a2735bd95451ab466c5560cbe28fe Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1701535054 Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ef5a2735bd95451ab466c5560cbe28fe", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ef5a2735bd95451ab466c5560cbe28fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ef5a2735bd95451ab466c5560cbe28fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ef5a2735bd95451ab466c5560cbe28fe"}]}] Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1701535054 Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: ef5a2735bd95451ab466c5560cbe28fe Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1701535054 Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-LiveAutoBlockMigrationV225Test-1701535054-project Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 9011569d41804e27a53fe5831988a88a Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1701535054-project Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 4cf46166-597d-4649-a09a-600d8c57524d could not be found. Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '4cf46166-597d-4649-a09a-600d8c57524d'} Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cf46166-597d-4649-a09a-600d8c57524d could not be found. Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cf46166-597d-4649-a09a-600d8c57524d could not be found. Aug 29 15:34:47.906387 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:34:47.909736 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:47.909736 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:34:47.909736 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:47.909736 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:47.909736 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:47.909736 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:47.909736 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:47.909736 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cf46166-597d-4649-a09a-600d8c57524d could not be found. Aug 29 15:34:47.909736 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:34:47.910474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-383bc366-b5c8-499d-b7f3-82a854df31a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Returning 404 to user: Instance 4cf46166-597d-4649-a09a-600d8c57524d could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:47.914034 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-383bc366-b5c8-499d-b7f3-82a854df31a6 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d" status: 404 len: 111 microversion: 2.25 time: 0.109244 Aug 29 15:34:47.918444 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1273/2558] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:47 2022] GET /compute/v2.1/servers/4cf46166-597d-4649-a09a-600d8c57524d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:34:47.937396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d0091135-26f7-4410-ad30-6810549299dd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:47.946720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d0091135-26f7-4410-ad30-6810549299dd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:47.957807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0091135-26f7-4410-ad30-6810549299dd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.966192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0091135-26f7-4410-ad30-6810549299dd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.967151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0091135-26f7-4410-ad30-6810549299dd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:47.985216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0091135-26f7-4410-ad30-6810549299dd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:47.985739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0091135-26f7-4410-ad30-6810549299dd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:47.986893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0091135-26f7-4410-ad30-6810549299dd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.062180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d0091135-26f7-4410-ad30-6810549299dd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:48.074688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d8381e9f-94c9-4035-8800-c0f0ee2c9feb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:48.090265 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d8381e9f-94c9-4035-8800-c0f0ee2c9feb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.390416 Aug 29 15:34:48.102921 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1286/2559] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:47 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:48.118531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-092ae64e-3fd6-4151-9004-f799d9b42489 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:48.119932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-092ae64e-3fd6-4151-9004-f799d9b42489 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:48.137895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092ae64e-3fd6-4151-9004-f799d9b42489 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.139266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092ae64e-3fd6-4151-9004-f799d9b42489 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.141325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092ae64e-3fd6-4151-9004-f799d9b42489 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.143223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092ae64e-3fd6-4151-9004-f799d9b42489 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.144316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092ae64e-3fd6-4151-9004-f799d9b42489 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.145474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092ae64e-3fd6-4151-9004-f799d9b42489 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.200017 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d0091135-26f7-4410-ad30-6810549299dd tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 204 len: 0 microversion: 2.25 time: 0.275654 Aug 29 15:34:48.203514 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1274/2560] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:34:47 2022] DELETE /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:34:48.211594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2d452022-af55-4aa1-b66c-3fbf4f27cf6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:48.212525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2d452022-af55-4aa1-b66c-3fbf4f27cf6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:48.218999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d452022-af55-4aa1-b66c-3fbf4f27cf6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.219757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d452022-af55-4aa1-b66c-3fbf4f27cf6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.220379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d452022-af55-4aa1-b66c-3fbf4f27cf6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.221362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d452022-af55-4aa1-b66c-3fbf4f27cf6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.222027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d452022-af55-4aa1-b66c-3fbf4f27cf6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.222659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d452022-af55-4aa1-b66c-3fbf4f27cf6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.360873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-092ae64e-3fd6-4151-9004-f799d9b42489 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:48.366318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:48.374387 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-092ae64e-3fd6-4151-9004-f799d9b42489 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.269758 Aug 29 15:34:48.376011 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1287/2561] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:48 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:48.387603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bfdf4bc0-d143-47cb-a35c-c26ef30d2276 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:48.389048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bfdf4bc0-d143-47cb-a35c-c26ef30d2276 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:48.401888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfdf4bc0-d143-47cb-a35c-c26ef30d2276 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.403128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfdf4bc0-d143-47cb-a35c-c26ef30d2276 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.403797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfdf4bc0-d143-47cb-a35c-c26ef30d2276 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.405254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfdf4bc0-d143-47cb-a35c-c26ef30d2276 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.406025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfdf4bc0-d143-47cb-a35c-c26ef30d2276 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.406983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfdf4bc0-d143-47cb-a35c-c26ef30d2276 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.463012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2d452022-af55-4aa1-b66c-3fbf4f27cf6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:48.472337 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2d452022-af55-4aa1-b66c-3fbf4f27cf6c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.264874 Aug 29 15:34:48.487597 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1275/2562] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:48 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:48.581738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bfdf4bc0-d143-47cb-a35c-c26ef30d2276 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:48.590857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bfdf4bc0-d143-47cb-a35c-c26ef30d2276 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:48.593903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bfdf4bc0-d143-47cb-a35c-c26ef30d2276 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:48.595162 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bfdf4bc0-d143-47cb-a35c-c26ef30d2276 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1564 microversion: 2.25 time: 0.217764 Aug 29 15:34:48.595774 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1288/2563] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:48 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1564 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:48.718125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f593856b-8c76-4e64-8b19-cf81a8916d62 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:48.719237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f593856b-8c76-4e64-8b19-cf81a8916d62 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:48.728271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f593856b-8c76-4e64-8b19-cf81a8916d62 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.729384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f593856b-8c76-4e64-8b19-cf81a8916d62 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.730016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f593856b-8c76-4e64-8b19-cf81a8916d62 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.730718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f593856b-8c76-4e64-8b19-cf81a8916d62 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.731376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f593856b-8c76-4e64-8b19-cf81a8916d62 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.731941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f593856b-8c76-4e64-8b19-cf81a8916d62 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.811699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b640f127-4117-4e6d-bf75-4f0633e373fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:48.812479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b640f127-4117-4e6d-bf75-4f0633e373fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: d624c852-fdae-4a2b-bd07-3d751e56c170] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:48.824427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b640f127-4117-4e6d-bf75-4f0633e373fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.825698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b640f127-4117-4e6d-bf75-4f0633e373fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.827652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b640f127-4117-4e6d-bf75-4f0633e373fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.828345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b640f127-4117-4e6d-bf75-4f0633e373fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.829908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b640f127-4117-4e6d-bf75-4f0633e373fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.830936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b640f127-4117-4e6d-bf75-4f0633e373fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.860130 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-b640f127-4117-4e6d-bf75-4f0633e373fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] HTTP exception thrown: Instance d624c852-fdae-4a2b-bd07-3d751e56c170 could not be found. Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b640f127-4117-4e6d-bf75-4f0633e373fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Request method failure captured: Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170 HTTP/1.1 Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNw6szHp2btbIrMvgQ98ntgw2gpBwrHi9RSvnE1UoIUZONVAdlXHorsh2Pvha5hLgSaIw6LOKp5LehH-Mmsy-9zYSgN9Y_tmaboTVTeoXgpYc310lLhQm6ipiqgql5xdg1vW_0-2xpsPunFFLw4OC37gmd76WKXFyYSGbmuumWTxJAU Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 448ade75da744a0fa52b64221fabfc21 Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ListServerFiltersTestJSON-589148671 Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_448ade75da744a0fa52b64221fabfc21", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/448ade75da744a0fa52b64221fabfc21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/448ade75da744a0fa52b64221fabfc21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/448ade75da744a0fa52b64221fabfc21"}]}] Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ListServerFiltersTestJSON-589148671 Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 448ade75da744a0fa52b64221fabfc21 Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-589148671 Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ListServerFiltersTestJSON-589148671-project Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 8430472729074bdbb6fc9bf8a0506e66 Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ListServerFiltersTestJSON-589148671-project Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance d624c852-fdae-4a2b-bd07-3d751e56c170 could not be found. Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'd624c852-fdae-4a2b-bd07-3d751e56c170'} Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d624c852-fdae-4a2b-bd07-3d751e56c170 could not be found. Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d624c852-fdae-4a2b-bd07-3d751e56c170 could not be found. Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:48.873847 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:48.877424 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:48.877424 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:48.877424 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:48.877424 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:48.877424 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:48.877424 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d624c852-fdae-4a2b-bd07-3d751e56c170 could not be found. Aug 29 15:34:48.877424 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:48.877424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b640f127-4117-4e6d-bf75-4f0633e373fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Returning 404 to user: Instance d624c852-fdae-4a2b-bd07-3d751e56c170 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:48.877424 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b640f127-4117-4e6d-bf75-4f0633e373fb tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170" status: 404 len: 111 microversion: 2.1 time: 0.068652 Aug 29 15:34:48.877424 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1289/2564] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:48 2022] GET /compute/v2.1/servers/d624c852-fdae-4a2b-bd07-3d751e56c170 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:34:48.884393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-30e92406-8535-48d0-becd-1426b932a4c6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:48.885226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-30e92406-8535-48d0-becd-1426b932a4c6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:48.892468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30e92406-8535-48d0-becd-1426b932a4c6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.893276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30e92406-8535-48d0-becd-1426b932a4c6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.893977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30e92406-8535-48d0-becd-1426b932a4c6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.894896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30e92406-8535-48d0-becd-1426b932a4c6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:48.895621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30e92406-8535-48d0-becd-1426b932a4c6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:48.896255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30e92406-8535-48d0-becd-1426b932a4c6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:48.930510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-30e92406-8535-48d0-becd-1426b932a4c6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:48.991133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f593856b-8c76-4e64-8b19-cf81a8916d62 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:49.002843 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f593856b-8c76-4e64-8b19-cf81a8916d62 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.288955 Aug 29 15:34:49.006980 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1276/2565] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:48 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:49.080366 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-30e92406-8535-48d0-becd-1426b932a4c6 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 204 len: 0 microversion: 2.1 time: 0.199583 Aug 29 15:34:49.084389 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1290/2566] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:34:48 2022] DELETE /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:34:49.093833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-646d56d8-4c13-4529-b3fc-8a0fd3fb83af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:49.095298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-646d56d8-4c13-4529-b3fc-8a0fd3fb83af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:49.104521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-646d56d8-4c13-4529-b3fc-8a0fd3fb83af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:49.105747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-646d56d8-4c13-4529-b3fc-8a0fd3fb83af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:49.106574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-646d56d8-4c13-4529-b3fc-8a0fd3fb83af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:49.111266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-646d56d8-4c13-4529-b3fc-8a0fd3fb83af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:49.112173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-646d56d8-4c13-4529-b3fc-8a0fd3fb83af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:49.113402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-646d56d8-4c13-4529-b3fc-8a0fd3fb83af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:49.116693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-726c9e61-1040-4285-9475-1bf217216251 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:49.117317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-726c9e61-1040-4285-9475-1bf217216251 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:49.132838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-726c9e61-1040-4285-9475-1bf217216251 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:49.133662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-726c9e61-1040-4285-9475-1bf217216251 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:49.141543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-726c9e61-1040-4285-9475-1bf217216251 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:49.142508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-726c9e61-1040-4285-9475-1bf217216251 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:49.143069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-726c9e61-1040-4285-9475-1bf217216251 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:49.143578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-726c9e61-1040-4285-9475-1bf217216251 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:49.462267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-726c9e61-1040-4285-9475-1bf217216251 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:49.462611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-646d56d8-4c13-4529-b3fc-8a0fd3fb83af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:49.478198 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-646d56d8-4c13-4529-b3fc-8a0fd3fb83af tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1518 microversion: 2.1 time: 0.391656 Aug 29 15:34:49.482328 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1277/2567] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:49 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1518 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:49.499580 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-726c9e61-1040-4285-9475-1bf217216251 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.388102 Aug 29 15:34:49.504663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2f2d33d1-b193-49de-aad8-e12d96484b56 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:49.508915 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1291/2568] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:49 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:49.516367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2f2d33d1-b193-49de-aad8-e12d96484b56 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:49.524057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-47eeea30-7277-479a-92a3-9347815a3369 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:49.524714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-47eeea30-7277-479a-92a3-9347815a3369 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:49.535880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f2d33d1-b193-49de-aad8-e12d96484b56 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:49.537049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-47eeea30-7277-479a-92a3-9347815a3369 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:49.541651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f2d33d1-b193-49de-aad8-e12d96484b56 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:49.543742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f2d33d1-b193-49de-aad8-e12d96484b56 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:49.544917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-47eeea30-7277-479a-92a3-9347815a3369 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:49.545429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-47eeea30-7277-479a-92a3-9347815a3369 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:49.545819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f2d33d1-b193-49de-aad8-e12d96484b56 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:49.546178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-47eeea30-7277-479a-92a3-9347815a3369 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:49.546641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-47eeea30-7277-479a-92a3-9347815a3369 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:49.546972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f2d33d1-b193-49de-aad8-e12d96484b56 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:49.547075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-47eeea30-7277-479a-92a3-9347815a3369 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:49.548489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f2d33d1-b193-49de-aad8-e12d96484b56 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:49.783512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2f2d33d1-b193-49de-aad8-e12d96484b56 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:49.793707 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2f2d33d1-b193-49de-aad8-e12d96484b56 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.310027 Aug 29 15:34:49.809446 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1278/2569] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:49 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:49.816458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1617690265", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1ac0823-5377-4aa5-8e1a-80f39f87d37f"}], "security_groups": [{"name": "tempest-securitygroup--1307725031"}], "key_name": "tempest-keypair-1877837348", "user_data": "}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:49.879884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-47eeea30-7277-479a-92a3-9347815a3369 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:49.890323 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-47eeea30-7277-479a-92a3-9347815a3369 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.380190 Aug 29 15:34:49.891713 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1292/2570] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:49 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:49.897474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-155a6fc9-a7e6-4600-9a77-b0ff9fd55151 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:49.898440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-155a6fc9-a7e6-4600-9a77-b0ff9fd55151 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:49.906703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-155a6fc9-a7e6-4600-9a77-b0ff9fd55151 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:49.907498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-155a6fc9-a7e6-4600-9a77-b0ff9fd55151 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:49.908068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-155a6fc9-a7e6-4600-9a77-b0ff9fd55151 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:49.908887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-155a6fc9-a7e6-4600-9a77-b0ff9fd55151 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:49.909427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-155a6fc9-a7e6-4600-9a77-b0ff9fd55151 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:49.909939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-155a6fc9-a7e6-4600-9a77-b0ff9fd55151 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:50.001325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] validate_networks() for [('d1ac0823-5377-4aa5-8e1a-80f39f87d37f', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:34:50.128983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-155a6fc9-a7e6-4600-9a77-b0ff9fd55151 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:50.144039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-155a6fc9-a7e6-4600-9a77-b0ff9fd55151 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:50.148715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-155a6fc9-a7e6-4600-9a77-b0ff9fd55151 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:50.150388 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-155a6fc9-a7e6-4600-9a77-b0ff9fd55151 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1564 microversion: 2.25 time: 0.257416 Aug 29 15:34:50.166645 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1293/2571] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:49 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1564 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:50.173747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-31ac7f77-6b43-4134-8665-26e2fc412765 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:50.174672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-31ac7f77-6b43-4134-8665-26e2fc412765 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:50.183161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31ac7f77-6b43-4134-8665-26e2fc412765 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:50.184399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31ac7f77-6b43-4134-8665-26e2fc412765 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:50.185226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31ac7f77-6b43-4134-8665-26e2fc412765 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:50.187215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31ac7f77-6b43-4134-8665-26e2fc412765 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:50.192350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31ac7f77-6b43-4134-8665-26e2fc412765 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:50.193188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31ac7f77-6b43-4134-8665-26e2fc412765 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:50.429150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-31ac7f77-6b43-4134-8665-26e2fc412765 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:50.441240 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-31ac7f77-6b43-4134-8665-26e2fc412765 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.273015 Aug 29 15:34:50.445185 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1294/2572] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:50 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:50.447619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-3008b76e-30e7-4d6c-94d9-794da26e8915 req-a6053684-84c1-404a-bc89-48ad669f1c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89c49de-27db-4e19-a013-217c6075debb", "name": "network-vif-deleted", "tag": "0b3487a8-bae5-4c07-9952-d6c8810ee302"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:50.464483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3008b76e-30e7-4d6c-94d9-794da26e8915 req-a6053684-84c1-404a-bc89-48ad669f1c43 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:50.464960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3008b76e-30e7-4d6c-94d9-794da26e8915 req-a6053684-84c1-404a-bc89-48ad669f1c43 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:50.465417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3008b76e-30e7-4d6c-94d9-794da26e8915 req-a6053684-84c1-404a-bc89-48ad669f1c43 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:50.478200 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-3008b76e-30e7-4d6c-94d9-794da26e8915 req-a6053684-84c1-404a-bc89-48ad669f1c43 service nova] Creating event network-vif-deleted:0b3487a8-bae5-4c07-9952-d6c8810ee302 for instance a89c49de-27db-4e19-a013-217c6075debb on n-h1-839401-11 Aug 29 15:34:50.483425 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-3008b76e-30e7-4d6c-94d9-794da26e8915 req-a6053684-84c1-404a-bc89-48ad669f1c43 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040096 Aug 29 15:34:50.488131 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1295/2573] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:50.499879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ad8bde5e-970b-4119-b061-005697730b05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:50.500587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ad8bde5e-970b-4119-b061-005697730b05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:50.519358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad8bde5e-970b-4119-b061-005697730b05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:50.520520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad8bde5e-970b-4119-b061-005697730b05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:50.521497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad8bde5e-970b-4119-b061-005697730b05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:50.522522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad8bde5e-970b-4119-b061-005697730b05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:50.523084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad8bde5e-970b-4119-b061-005697730b05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:50.523647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad8bde5e-970b-4119-b061-005697730b05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:50.724690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ad8bde5e-970b-4119-b061-005697730b05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:50.734274 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ad8bde5e-970b-4119-b061-005697730b05 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1518 microversion: 2.1 time: 0.238787 Aug 29 15:34:50.737409 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1296/2574] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:50 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1518 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:50.744153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-81889271-4f34-4bdb-ba5a-7b5d3a293a17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:50.745047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-81889271-4f34-4bdb-ba5a-7b5d3a293a17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:50.750895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:50.753486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81889271-4f34-4bdb-ba5a-7b5d3a293a17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:50.754236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81889271-4f34-4bdb-ba5a-7b5d3a293a17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:50.754884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81889271-4f34-4bdb-ba5a-7b5d3a293a17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:50.755912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81889271-4f34-4bdb-ba5a-7b5d3a293a17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:50.756440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81889271-4f34-4bdb-ba5a-7b5d3a293a17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:50.756930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81889271-4f34-4bdb-ba5a-7b5d3a293a17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:50.832927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:34:50.833564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:34:50.834118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:34:50.835566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:34:50.835566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:34:50.844819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:50.845358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:50.845867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:50.846654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:50.847182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:50.847675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:50.890648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Getting quotas for project 990c752c7bb141c1bf496c98fbc3c9a7. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:34:50.897430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Getting quotas for user 51efa71a8bfe457982698a5755ae3cc6 and project 990c752c7bb141c1bf496c98fbc3c9a7. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:34:50.913614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:34:50.919979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:34:50.929871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-81889271-4f34-4bdb-ba5a-7b5d3a293a17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:50.939522 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-81889271-4f34-4bdb-ba5a-7b5d3a293a17 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.200409 Aug 29 15:34:50.940516 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1297/2575] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:50 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:50.951459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-77fbef6c-98cc-4f82-873c-728d7816ae86 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:50.952197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-77fbef6c-98cc-4f82-873c-728d7816ae86 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:50.959235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77fbef6c-98cc-4f82-873c-728d7816ae86 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:50.959891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77fbef6c-98cc-4f82-873c-728d7816ae86 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:50.960438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77fbef6c-98cc-4f82-873c-728d7816ae86 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:50.961340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77fbef6c-98cc-4f82-873c-728d7816ae86 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:50.962242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77fbef6c-98cc-4f82-873c-728d7816ae86 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:50.962882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77fbef6c-98cc-4f82-873c-728d7816ae86 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:50.996777 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bbf27be4-38a8-4c61-bb5b-58b3e0581c5e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.185930 Aug 29 15:34:51.004141 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1279/2576] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:34:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:34:51.006919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b6b59a5b-84f5-472f-a406-063f2dc195fe tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:51.010746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b6b59a5b-84f5-472f-a406-063f2dc195fe tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:51.025251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6b59a5b-84f5-472f-a406-063f2dc195fe tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.026027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6b59a5b-84f5-472f-a406-063f2dc195fe tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.026569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6b59a5b-84f5-472f-a406-063f2dc195fe tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:51.027759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6b59a5b-84f5-472f-a406-063f2dc195fe tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.028319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6b59a5b-84f5-472f-a406-063f2dc195fe tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.028871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6b59a5b-84f5-472f-a406-063f2dc195fe tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:51.058226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:51.174882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-77fbef6c-98cc-4f82-873c-728d7816ae86 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:51.183354 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-77fbef6c-98cc-4f82-873c-728d7816ae86 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.237005 Aug 29 15:34:51.183920 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1298/2577] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:50 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:51.193422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1722ede6-2734-46d2-87d7-83427e885e3f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:51.194672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1722ede6-2734-46d2-87d7-83427e885e3f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:51.213857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b6b59a5b-84f5-472f-a406-063f2dc195fe tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:51.230542 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b6b59a5b-84f5-472f-a406-063f2dc195fe tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.227835 Aug 29 15:34:51.231316 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1280/2578] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:51 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:51.248146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-58eec147-6ced-4d4c-b97c-fb1e5783a301 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:51.249201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-58eec147-6ced-4d4c-b97c-fb1e5783a301 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:51.263606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58eec147-6ced-4d4c-b97c-fb1e5783a301 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.265358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58eec147-6ced-4d4c-b97c-fb1e5783a301 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.265822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58eec147-6ced-4d4c-b97c-fb1e5783a301 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:51.269884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58eec147-6ced-4d4c-b97c-fb1e5783a301 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.271633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58eec147-6ced-4d4c-b97c-fb1e5783a301 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.272915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58eec147-6ced-4d4c-b97c-fb1e5783a301 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:51.283921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1722ede6-2734-46d2-87d7-83427e885e3f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:51.294329 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1722ede6-2734-46d2-87d7-83427e885e3f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1239 microversion: 2.1 time: 0.107500 Aug 29 15:34:51.295725 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1299/2579] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:51 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1239 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:51.348435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58eec147-6ced-4d4c-b97c-fb1e5783a301 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.349364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58eec147-6ced-4d4c-b97c-fb1e5783a301 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.350059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58eec147-6ced-4d4c-b97c-fb1e5783a301 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:51.350700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-58eec147-6ced-4d4c-b97c-fb1e5783a301 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lazy-loading 'fault' on Instance uuid a89c49de-27db-4e19-a013-217c6075debb {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:51.427982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-58eec147-6ced-4d4c-b97c-fb1e5783a301 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:51.435956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-58eec147-6ced-4d4c-b97c-fb1e5783a301 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:51.446834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-58eec147-6ced-4d4c-b97c-fb1e5783a301 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9011569d41804e27a53fe5831988a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5a2735bd95451ab466c5560cbe28fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:51.448214 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-58eec147-6ced-4d4c-b97c-fb1e5783a301 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 200 len: 1351 microversion: 2.25 time: 0.215695 Aug 29 15:34:51.464444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ee4cfda3-95eb-4c8b-9bc5-061af7b3487a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:51.465597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ee4cfda3-95eb-4c8b-9bc5-061af7b3487a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:51.466148 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1281/2580] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:51 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 1351 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:34:51.474774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4cfda3-95eb-4c8b-9bc5-061af7b3487a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.475274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4cfda3-95eb-4c8b-9bc5-061af7b3487a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.475706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4cfda3-95eb-4c8b-9bc5-061af7b3487a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:51.476644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4cfda3-95eb-4c8b-9bc5-061af7b3487a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.477122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4cfda3-95eb-4c8b-9bc5-061af7b3487a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.477574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4cfda3-95eb-4c8b-9bc5-061af7b3487a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:51.622331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ee4cfda3-95eb-4c8b-9bc5-061af7b3487a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:51.635221 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ee4cfda3-95eb-4c8b-9bc5-061af7b3487a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.175757 Aug 29 15:34:51.635820 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1300/2581] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:51 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:51.760527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9548107d-0fd8-4683-97c6-45101facc707 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:51.761428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9548107d-0fd8-4683-97c6-45101facc707 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:51.769339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9548107d-0fd8-4683-97c6-45101facc707 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.769862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9548107d-0fd8-4683-97c6-45101facc707 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.770302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9548107d-0fd8-4683-97c6-45101facc707 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:51.771001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9548107d-0fd8-4683-97c6-45101facc707 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.771456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9548107d-0fd8-4683-97c6-45101facc707 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.771881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9548107d-0fd8-4683-97c6-45101facc707 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:51.916662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9548107d-0fd8-4683-97c6-45101facc707 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:51.925633 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9548107d-0fd8-4683-97c6-45101facc707 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1518 microversion: 2.1 time: 0.169079 Aug 29 15:34:51.926709 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1282/2582] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:51 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:51.961558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ef58b4ab-08c2-4c4d-93e6-e1a24ba281dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:51.962130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ef58b4ab-08c2-4c4d-93e6-e1a24ba281dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:51.968445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef58b4ab-08c2-4c4d-93e6-e1a24ba281dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.968933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef58b4ab-08c2-4c4d-93e6-e1a24ba281dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.969390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef58b4ab-08c2-4c4d-93e6-e1a24ba281dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:51.970094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef58b4ab-08c2-4c4d-93e6-e1a24ba281dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:51.970550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef58b4ab-08c2-4c4d-93e6-e1a24ba281dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:51.970980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef58b4ab-08c2-4c4d-93e6-e1a24ba281dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.152996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ef58b4ab-08c2-4c4d-93e6-e1a24ba281dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:52.161340 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ef58b4ab-08c2-4c4d-93e6-e1a24ba281dc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.203765 Aug 29 15:34:52.161958 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1301/2583] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:51 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:52.206102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1a1a7c14-a294-480a-937f-8c6127f5fe87 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:52.207656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1a1a7c14-a294-480a-937f-8c6127f5fe87 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:52.216278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a1a7c14-a294-480a-937f-8c6127f5fe87 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.216778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a1a7c14-a294-480a-937f-8c6127f5fe87 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.217268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a1a7c14-a294-480a-937f-8c6127f5fe87 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.217994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a1a7c14-a294-480a-937f-8c6127f5fe87 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.218444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a1a7c14-a294-480a-937f-8c6127f5fe87 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.218862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a1a7c14-a294-480a-937f-8c6127f5fe87 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.250794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-78cf6a0e-2be6-4891-853f-2aef6bbfb77b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:52.251391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-78cf6a0e-2be6-4891-853f-2aef6bbfb77b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:52.262191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78cf6a0e-2be6-4891-853f-2aef6bbfb77b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.262679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78cf6a0e-2be6-4891-853f-2aef6bbfb77b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.263345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78cf6a0e-2be6-4891-853f-2aef6bbfb77b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.264059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78cf6a0e-2be6-4891-853f-2aef6bbfb77b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.264511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78cf6a0e-2be6-4891-853f-2aef6bbfb77b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.265139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78cf6a0e-2be6-4891-853f-2aef6bbfb77b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.415579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-78cf6a0e-2be6-4891-853f-2aef6bbfb77b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:52.425557 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-78cf6a0e-2be6-4891-853f-2aef6bbfb77b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.178492 Aug 29 15:34:52.426535 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1302/2584] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:52 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:52.445453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-11896d78-649e-4d22-9b37-b82403708c79 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:52.446096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-11896d78-649e-4d22-9b37-b82403708c79 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:52.454015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11896d78-649e-4d22-9b37-b82403708c79 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.454831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11896d78-649e-4d22-9b37-b82403708c79 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.455366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11896d78-649e-4d22-9b37-b82403708c79 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.456602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11896d78-649e-4d22-9b37-b82403708c79 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.457366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11896d78-649e-4d22-9b37-b82403708c79 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.457866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11896d78-649e-4d22-9b37-b82403708c79 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.532439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-11896d78-649e-4d22-9b37-b82403708c79 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:52.540999 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-11896d78-649e-4d22-9b37-b82403708c79 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1291 microversion: 2.1 time: 0.102352 Aug 29 15:34:52.541633 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1303/2585] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:52 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1291 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:52.546225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6c9cbb1b-941c-4809-a873-550d22def453 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:52.546843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6c9cbb1b-941c-4809-a873-550d22def453 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] [instance: a89c49de-27db-4e19-a013-217c6075debb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:52.554015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c9cbb1b-941c-4809-a873-550d22def453 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.555919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c9cbb1b-941c-4809-a873-550d22def453 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.556381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c9cbb1b-941c-4809-a873-550d22def453 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.557140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c9cbb1b-941c-4809-a873-550d22def453 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.557661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c9cbb1b-941c-4809-a873-550d22def453 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.558094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c9cbb1b-941c-4809-a873-550d22def453 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.810577 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-6c9cbb1b-941c-4809-a873-550d22def453 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] HTTP exception thrown: Instance a89c49de-27db-4e19-a013-217c6075debb could not be found. Aug 29 15:34:52.811496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1a1a7c14-a294-480a-937f-8c6127f5fe87 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6c9cbb1b-941c-4809-a873-550d22def453 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Request method failure captured: Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb HTTP/1.1 Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNp9DXxKqZa_RRXSEhegpFvOgEYKZccwROpVhhDp1V7lLp7_8__NkuMACj6wnIslK5_kmPd2ELM-AzNVOAt7RJD9Uk8U3OxRuotLE0bzh9OM3ouSISIuXAlPdHpTX7T4A6StS0IfKYA6vTV9yay3uVhpeZ1RNwKXJmoYk2Wad1JbYXI Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: ef5a2735bd95451ab466c5560cbe28fe Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1701535054 Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ef5a2735bd95451ab466c5560cbe28fe", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ef5a2735bd95451ab466c5560cbe28fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ef5a2735bd95451ab466c5560cbe28fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ef5a2735bd95451ab466c5560cbe28fe"}]}] Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1701535054 Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: ef5a2735bd95451ab466c5560cbe28fe Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1701535054 Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-LiveAutoBlockMigrationV225Test-1701535054-project Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 9011569d41804e27a53fe5831988a88a Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1701535054-project Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance a89c49de-27db-4e19-a013-217c6075debb could not be found. Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'a89c49de-27db-4e19-a013-217c6075debb'} Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89c49de-27db-4e19-a013-217c6075debb could not be found. Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89c49de-27db-4e19-a013-217c6075debb could not be found. Aug 29 15:34:52.812564 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:52.816929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:52.816929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:52.816929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:52.816929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:52.816929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:52.816929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:52.816929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:52.816929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89c49de-27db-4e19-a013-217c6075debb could not be found. Aug 29 15:34:52.816929 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:52.816929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6c9cbb1b-941c-4809-a873-550d22def453 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] Returning 404 to user: Instance a89c49de-27db-4e19-a013-217c6075debb could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:52.816929 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6c9cbb1b-941c-4809-a873-550d22def453 tempest-LiveAutoBlockMigrationV225Test-1701535054 tempest-LiveAutoBlockMigrationV225Test-1701535054-project] 10.222.0.62 "GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb" status: 404 len: 111 microversion: 2.25 time: 0.271431 Aug 29 15:34:52.818628 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1304/2586] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:34:52 2022] GET /compute/v2.1/servers/a89c49de-27db-4e19-a013-217c6075debb => generated 111 bytes in 275 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:34:52.823811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4470ee30-0369-47f0-8ebc-6ca5a5f80c35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:52.824422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4470ee30-0369-47f0-8ebc-6ca5a5f80c35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:52.824540 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1a1a7c14-a294-480a-937f-8c6127f5fe87 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.623385 Aug 29 15:34:52.825385 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1283/2587] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:52 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:52.843892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4470ee30-0369-47f0-8ebc-6ca5a5f80c35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.844658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4470ee30-0369-47f0-8ebc-6ca5a5f80c35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.845121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4470ee30-0369-47f0-8ebc-6ca5a5f80c35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.845912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4470ee30-0369-47f0-8ebc-6ca5a5f80c35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.846376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4470ee30-0369-47f0-8ebc-6ca5a5f80c35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.846941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4470ee30-0369-47f0-8ebc-6ca5a5f80c35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.947288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-58587260-c121-4196-ab96-829cb06df42c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:52.948220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-58587260-c121-4196-ab96-829cb06df42c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:52.955161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58587260-c121-4196-ab96-829cb06df42c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.955665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58587260-c121-4196-ab96-829cb06df42c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.956124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58587260-c121-4196-ab96-829cb06df42c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:52.956993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58587260-c121-4196-ab96-829cb06df42c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:52.957499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58587260-c121-4196-ab96-829cb06df42c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:52.958114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58587260-c121-4196-ab96-829cb06df42c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.090668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4470ee30-0369-47f0-8ebc-6ca5a5f80c35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:53.097671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:53.100443 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4470ee30-0369-47f0-8ebc-6ca5a5f80c35 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.281807 Aug 29 15:34:53.107879 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1305/2588] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:52 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:53.187725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-238063b9-e12d-41cf-9694-78a122265229 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:53.188337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-238063b9-e12d-41cf-9694-78a122265229 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:53.196118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-238063b9-e12d-41cf-9694-78a122265229 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.196781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-238063b9-e12d-41cf-9694-78a122265229 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.197888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-238063b9-e12d-41cf-9694-78a122265229 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.198605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-238063b9-e12d-41cf-9694-78a122265229 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.199060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-238063b9-e12d-41cf-9694-78a122265229 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.199495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-238063b9-e12d-41cf-9694-78a122265229 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.438008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-58587260-c121-4196-ab96-829cb06df42c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:53.447989 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-58587260-c121-4196-ab96-829cb06df42c tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1518 microversion: 2.1 time: 0.504961 Aug 29 15:34:53.454720 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1284/2589] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:52 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1518 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:53.487453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5b41bc99-73a8-43eb-bcab-9cf46537f6bc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:53.492527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5b41bc99-73a8-43eb-bcab-9cf46537f6bc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:53.504228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b41bc99-73a8-43eb-bcab-9cf46537f6bc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.504790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b41bc99-73a8-43eb-bcab-9cf46537f6bc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.505255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b41bc99-73a8-43eb-bcab-9cf46537f6bc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.506101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b41bc99-73a8-43eb-bcab-9cf46537f6bc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.511787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b41bc99-73a8-43eb-bcab-9cf46537f6bc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.513633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b41bc99-73a8-43eb-bcab-9cf46537f6bc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.622007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-238063b9-e12d-41cf-9694-78a122265229 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:53.633439 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-238063b9-e12d-41cf-9694-78a122265229 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.449287 Aug 29 15:34:53.634725 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1306/2590] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:53 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:53.640662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-b91e9961-7c82-449a-ae36-05d6fb78d355 req-b8ae2e9b-10ca-480d-a2d8-5c166a183e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e77d46-8629-4bc8-b216-6cdc3e8f0543", "name": "network-vif-deleted", "tag": "61f6ec7a-d0af-4057-9f18-4aa7a116a44b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:53.653403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b91e9961-7c82-449a-ae36-05d6fb78d355 req-b8ae2e9b-10ca-480d-a2d8-5c166a183e65 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.654385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b91e9961-7c82-449a-ae36-05d6fb78d355 req-b8ae2e9b-10ca-480d-a2d8-5c166a183e65 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.655115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b91e9961-7c82-449a-ae36-05d6fb78d355 req-b8ae2e9b-10ca-480d-a2d8-5c166a183e65 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.670963 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-b91e9961-7c82-449a-ae36-05d6fb78d355 req-b8ae2e9b-10ca-480d-a2d8-5c166a183e65 service nova] Creating event network-vif-deleted:61f6ec7a-d0af-4057-9f18-4aa7a116a44b for instance f0e77d46-8629-4bc8-b216-6cdc3e8f0543 on n-h2-839401-11 Aug 29 15:34:53.676280 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-b91e9961-7c82-449a-ae36-05d6fb78d355 req-b8ae2e9b-10ca-480d-a2d8-5c166a183e65 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039910 Aug 29 15:34:53.677404 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1307/2591] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:53.684583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-13e66d16-b126-45bf-80bc-08f4709fca70 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:53.685490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-13e66d16-b126-45bf-80bc-08f4709fca70 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:53.692785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13e66d16-b126-45bf-80bc-08f4709fca70 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.693541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13e66d16-b126-45bf-80bc-08f4709fca70 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.694240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13e66d16-b126-45bf-80bc-08f4709fca70 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.695103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13e66d16-b126-45bf-80bc-08f4709fca70 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.695710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13e66d16-b126-45bf-80bc-08f4709fca70 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.696139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13e66d16-b126-45bf-80bc-08f4709fca70 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.758003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5b41bc99-73a8-43eb-bcab-9cf46537f6bc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:53.766688 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5b41bc99-73a8-43eb-bcab-9cf46537f6bc tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1392 microversion: 2.1 time: 0.308511 Aug 29 15:34:53.767258 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1285/2592] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:53 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1392 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:53.772498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-13e66d16-b126-45bf-80bc-08f4709fca70 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:53.781544 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-13e66d16-b126-45bf-80bc-08f4709fca70 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1297 microversion: 2.1 time: 0.102028 Aug 29 15:34:53.782095 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1308/2593] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:53 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1297 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:53.850845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-17a6c2db-90ec-4f63-92b8-2c613b256f79 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:53.851601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-17a6c2db-90ec-4f63-92b8-2c613b256f79 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:53.866440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a6c2db-90ec-4f63-92b8-2c613b256f79 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.867263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a6c2db-90ec-4f63-92b8-2c613b256f79 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.868843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a6c2db-90ec-4f63-92b8-2c613b256f79 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:53.870333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a6c2db-90ec-4f63-92b8-2c613b256f79 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:53.871146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a6c2db-90ec-4f63-92b8-2c613b256f79 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:53.871938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a6c2db-90ec-4f63-92b8-2c613b256f79 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.122073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c852baaf-d25c-42c1-b135-7db94da0caf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:54.122738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c852baaf-d25c-42c1-b135-7db94da0caf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:54.130709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c852baaf-d25c-42c1-b135-7db94da0caf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.131485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c852baaf-d25c-42c1-b135-7db94da0caf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.132138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c852baaf-d25c-42c1-b135-7db94da0caf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.133053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c852baaf-d25c-42c1-b135-7db94da0caf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.133734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c852baaf-d25c-42c1-b135-7db94da0caf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.134333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c852baaf-d25c-42c1-b135-7db94da0caf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.214340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-17a6c2db-90ec-4f63-92b8-2c613b256f79 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:54.227445 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-17a6c2db-90ec-4f63-92b8-2c613b256f79 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.380858 Aug 29 15:34:54.228043 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1286/2594] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:53 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:54.474714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2897e01e-74cf-4873-a3ae-8190277414ff tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:54.475422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2897e01e-74cf-4873-a3ae-8190277414ff tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:54.482369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2897e01e-74cf-4873-a3ae-8190277414ff tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.483321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2897e01e-74cf-4873-a3ae-8190277414ff tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.483763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2897e01e-74cf-4873-a3ae-8190277414ff tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.484445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2897e01e-74cf-4873-a3ae-8190277414ff tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.485131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2897e01e-74cf-4873-a3ae-8190277414ff tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.485529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2897e01e-74cf-4873-a3ae-8190277414ff tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.530596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2897e01e-74cf-4873-a3ae-8190277414ff tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.532636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2897e01e-74cf-4873-a3ae-8190277414ff tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.533186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2897e01e-74cf-4873-a3ae-8190277414ff tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.533758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-2897e01e-74cf-4873-a3ae-8190277414ff tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lazy-loading 'fault' on Instance uuid f0e77d46-8629-4bc8-b216-6cdc3e8f0543 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:34:54.633348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2897e01e-74cf-4873-a3ae-8190277414ff tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8430472729074bdbb6fc9bf8a0506e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448ade75da744a0fa52b64221fabfc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:54.643342 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2897e01e-74cf-4873-a3ae-8190277414ff tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 200 len: 1310 microversion: 2.1 time: 0.171996 Aug 29 15:34:54.658441 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1287/2595] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:54 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 1310 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:54.662241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ecaccd8a-5b62-4a78-bc28-21d27a037073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:54.662878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ecaccd8a-5b62-4a78-bc28-21d27a037073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:54.669827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecaccd8a-5b62-4a78-bc28-21d27a037073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.670315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecaccd8a-5b62-4a78-bc28-21d27a037073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.670749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecaccd8a-5b62-4a78-bc28-21d27a037073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.671492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecaccd8a-5b62-4a78-bc28-21d27a037073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.671948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecaccd8a-5b62-4a78-bc28-21d27a037073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.672424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecaccd8a-5b62-4a78-bc28-21d27a037073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.775893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c852baaf-d25c-42c1-b135-7db94da0caf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:54.785886 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c852baaf-d25c-42c1-b135-7db94da0caf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.668112 Aug 29 15:34:54.786483 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1309/2596] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:54 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:54.800032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cebc38d7-6e05-4724-8050-1278aca028e2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:54.800857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cebc38d7-6e05-4724-8050-1278aca028e2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:54.821563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cebc38d7-6e05-4724-8050-1278aca028e2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.822304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cebc38d7-6e05-4724-8050-1278aca028e2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.822920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cebc38d7-6e05-4724-8050-1278aca028e2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.823813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cebc38d7-6e05-4724-8050-1278aca028e2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.824420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cebc38d7-6e05-4724-8050-1278aca028e2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.824985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cebc38d7-6e05-4724-8050-1278aca028e2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.915060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ecaccd8a-5b62-4a78-bc28-21d27a037073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:54.924599 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ecaccd8a-5b62-4a78-bc28-21d27a037073 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.272222 Aug 29 15:34:54.925466 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1288/2597] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:54 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:54.930441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-04a12feb-4372-4a5b-945f-eb99264e50ed tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:54.938157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-04a12feb-4372-4a5b-945f-eb99264e50ed tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:54.948923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a12feb-4372-4a5b-945f-eb99264e50ed tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.953030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a12feb-4372-4a5b-945f-eb99264e50ed tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.953530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a12feb-4372-4a5b-945f-eb99264e50ed tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:54.956942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a12feb-4372-4a5b-945f-eb99264e50ed tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:54.957564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a12feb-4372-4a5b-945f-eb99264e50ed tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:54.958011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a12feb-4372-4a5b-945f-eb99264e50ed tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.131934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cebc38d7-6e05-4724-8050-1278aca028e2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:55.144106 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cebc38d7-6e05-4724-8050-1278aca028e2 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1382 microversion: 2.1 time: 0.355643 Aug 29 15:34:55.144985 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1310/2598] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:54 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1382 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:55.175689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-96e7cfad-7031-479e-a7a8-5482fb6cf75e tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '.version_select at 0x7fc42ad03280>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:55.180309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96e7cfad-7031-479e-a7a8-5482fb6cf75e tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.187295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96e7cfad-7031-479e-a7a8-5482fb6cf75e tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.188287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96e7cfad-7031-479e-a7a8-5482fb6cf75e tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.227792 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-96e7cfad-7031-479e-a7a8-5482fb6cf75e tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/os-migrations" status: 200 len: 2759 microversion: 2.1 time: 0.059988 Aug 29 15:34:55.240926 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1311/2599] 10.222.0.62 () {58 vars in 1143 bytes} [Mon Aug 29 15:34:55 2022] GET /compute/v2.1/os-migrations => generated 2759 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:55.251787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-739fc01f-8c60-4686-be2c-10643c892a5f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:55.254172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-739fc01f-8c60-4686-be2c-10643c892a5f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:55.266590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-739fc01f-8c60-4686-be2c-10643c892a5f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.267155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-739fc01f-8c60-4686-be2c-10643c892a5f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.271703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-739fc01f-8c60-4686-be2c-10643c892a5f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.272478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-739fc01f-8c60-4686-be2c-10643c892a5f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.272983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-739fc01f-8c60-4686-be2c-10643c892a5f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.273458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-739fc01f-8c60-4686-be2c-10643c892a5f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.427751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-04a12feb-4372-4a5b-945f-eb99264e50ed tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:55.436022 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-04a12feb-4372-4a5b-945f-eb99264e50ed tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1365 microversion: 2.1 time: 0.509231 Aug 29 15:34:55.436606 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1289/2600] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:54 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1365 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:55.455444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8b5a2d55-2aa7-44fb-8192-9b1537acdf24 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:55.456276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8b5a2d55-2aa7-44fb-8192-9b1537acdf24 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:55.465188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b5a2d55-2aa7-44fb-8192-9b1537acdf24 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.465966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b5a2d55-2aa7-44fb-8192-9b1537acdf24 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.466623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b5a2d55-2aa7-44fb-8192-9b1537acdf24 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.468159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b5a2d55-2aa7-44fb-8192-9b1537acdf24 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.468948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b5a2d55-2aa7-44fb-8192-9b1537acdf24 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.469695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b5a2d55-2aa7-44fb-8192-9b1537acdf24 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.573797 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-739fc01f-8c60-4686-be2c-10643c892a5f tempest-LiveMigrationTest-2067297426 tempest-LiveMigrationTest-2067297426-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1535 microversion: 2.1 time: 0.331479 Aug 29 15:34:55.574771 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1312/2601] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:55 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1535 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:55.612821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4e48ee48-b0a5-47ab-882a-5a7435b84267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:55.613751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4e48ee48-b0a5-47ab-882a-5a7435b84267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:55.620433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e48ee48-b0a5-47ab-882a-5a7435b84267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.621285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e48ee48-b0a5-47ab-882a-5a7435b84267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.621957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e48ee48-b0a5-47ab-882a-5a7435b84267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.623170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e48ee48-b0a5-47ab-882a-5a7435b84267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.623840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e48ee48-b0a5-47ab-882a-5a7435b84267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.624513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e48ee48-b0a5-47ab-882a-5a7435b84267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.654940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4e48ee48-b0a5-47ab-882a-5a7435b84267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:34:55.758336 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4e48ee48-b0a5-47ab-882a-5a7435b84267 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 204 len: 0 microversion: 2.1 time: 0.149204 Aug 29 15:34:55.761165 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1313/2602] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:34:55 2022] DELETE /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:34:55.769308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-371af984-19ae-414b-b962-fde906b47bf0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:55.770400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-371af984-19ae-414b-b962-fde906b47bf0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] [instance: f0e77d46-8629-4bc8-b216-6cdc3e8f0543] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:55.774062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8b5a2d55-2aa7-44fb-8192-9b1537acdf24 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:55.778505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-371af984-19ae-414b-b962-fde906b47bf0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.779196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-371af984-19ae-414b-b962-fde906b47bf0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.779821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-371af984-19ae-414b-b962-fde906b47bf0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.780767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-371af984-19ae-414b-b962-fde906b47bf0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.781622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-371af984-19ae-414b-b962-fde906b47bf0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.782316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-371af984-19ae-414b-b962-fde906b47bf0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.783852 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8b5a2d55-2aa7-44fb-8192-9b1537acdf24 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.333415 Aug 29 15:34:55.784446 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1290/2603] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:55 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:55.801476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-56423dee-51a4-4e82-bcab-c864d9b19f42 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:55.802356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-56423dee-51a4-4e82-bcab-c864d9b19f42 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:55.806218 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-371af984-19ae-414b-b962-fde906b47bf0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] HTTP exception thrown: Instance f0e77d46-8629-4bc8-b216-6cdc3e8f0543 could not be found. Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-371af984-19ae-414b-b962-fde906b47bf0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Request method failure captured: Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 HTTP/1.1 Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNw6szHp2btbIrMvgQ98ntgw2gpBwrHi9RSvnE1UoIUZONVAdlXHorsh2Pvha5hLgSaIw6LOKp5LehH-Mmsy-9zYSgN9Y_tmaboTVTeoXgpYc310lLhQm6ipiqgql5xdg1vW_0-2xpsPunFFLw4OC37gmd76WKXFyYSGbmuumWTxJAU Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 448ade75da744a0fa52b64221fabfc21 Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ListServerFiltersTestJSON-589148671 Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_448ade75da744a0fa52b64221fabfc21", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/448ade75da744a0fa52b64221fabfc21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/448ade75da744a0fa52b64221fabfc21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/448ade75da744a0fa52b64221fabfc21"}]}] Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ListServerFiltersTestJSON-589148671 Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 448ade75da744a0fa52b64221fabfc21 Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-589148671 Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ListServerFiltersTestJSON-589148671-project Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 8430472729074bdbb6fc9bf8a0506e66 Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ListServerFiltersTestJSON-589148671-project Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance f0e77d46-8629-4bc8-b216-6cdc3e8f0543 could not be found. Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'f0e77d46-8629-4bc8-b216-6cdc3e8f0543'} Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0e77d46-8629-4bc8-b216-6cdc3e8f0543 could not be found. Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0e77d46-8629-4bc8-b216-6cdc3e8f0543 could not be found. Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:34:55.812838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:55.817348 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:34:55.817348 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:34:55.817348 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:34:55.817348 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:34:55.817348 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:34:55.817348 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0e77d46-8629-4bc8-b216-6cdc3e8f0543 could not be found. Aug 29 15:34:55.817348 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:34:55.817348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-371af984-19ae-414b-b962-fde906b47bf0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] Returning 404 to user: Instance f0e77d46-8629-4bc8-b216-6cdc3e8f0543 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:34:55.817348 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-371af984-19ae-414b-b962-fde906b47bf0 tempest-ListServerFiltersTestJSON-589148671 tempest-ListServerFiltersTestJSON-589148671-project] 10.222.0.62 "GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543" status: 404 len: 111 microversion: 2.1 time: 0.051802 Aug 29 15:34:55.817348 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1314/2604] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:55 2022] GET /compute/v2.1/servers/f0e77d46-8629-4bc8-b216-6cdc3e8f0543 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:34:55.819943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56423dee-51a4-4e82-bcab-c864d9b19f42 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.822712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56423dee-51a4-4e82-bcab-c864d9b19f42 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.823371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56423dee-51a4-4e82-bcab-c864d9b19f42 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.824407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56423dee-51a4-4e82-bcab-c864d9b19f42 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.825019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56423dee-51a4-4e82-bcab-c864d9b19f42 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.825781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-92e5cd57-6b28-4c95-901b-a5a87cb59884 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:55.826375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56423dee-51a4-4e82-bcab-c864d9b19f42 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.826638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-92e5cd57-6b28-4c95-901b-a5a87cb59884 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:55.838739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92e5cd57-6b28-4c95-901b-a5a87cb59884 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.841019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92e5cd57-6b28-4c95-901b-a5a87cb59884 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.841695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92e5cd57-6b28-4c95-901b-a5a87cb59884 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:55.842586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92e5cd57-6b28-4c95-901b-a5a87cb59884 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:55.843161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92e5cd57-6b28-4c95-901b-a5a87cb59884 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:55.844573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92e5cd57-6b28-4c95-901b-a5a87cb59884 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:56.113980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-92e5cd57-6b28-4c95-901b-a5a87cb59884 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:56.124400 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-92e5cd57-6b28-4c95-901b-a5a87cb59884 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.306474 Aug 29 15:34:56.124963 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1315/2605] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:55 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:56.131548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0e31d802-11a3-4e44-958d-5778a01fbce3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:56.132427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0e31d802-11a3-4e44-958d-5778a01fbce3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:56.139652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e31d802-11a3-4e44-958d-5778a01fbce3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:56.140429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e31d802-11a3-4e44-958d-5778a01fbce3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:56.141336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e31d802-11a3-4e44-958d-5778a01fbce3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:56.142285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e31d802-11a3-4e44-958d-5778a01fbce3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:56.142869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e31d802-11a3-4e44-958d-5778a01fbce3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:56.143340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e31d802-11a3-4e44-958d-5778a01fbce3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:56.256403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-56423dee-51a4-4e82-bcab-c864d9b19f42 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:56.273608 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-56423dee-51a4-4e82-bcab-c864d9b19f42 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1388 microversion: 2.1 time: 0.481978 Aug 29 15:34:56.274992 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1291/2606] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:55 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1388 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:56.281471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-115098d2-2ff1-4708-9a6c-3abb8b38afdd req-22f0233a-d2f6-417c-bc2b-8ca2f22ceb3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af95f7c-5362-4cf9-b80e-38cd6a518783", "tag": "2984ebfd-8f23-4f8e-83af-0a164bd8c5aa"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:56.297387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-115098d2-2ff1-4708-9a6c-3abb8b38afdd req-22f0233a-d2f6-417c-bc2b-8ca2f22ceb3e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:56.298028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-115098d2-2ff1-4708-9a6c-3abb8b38afdd req-22f0233a-d2f6-417c-bc2b-8ca2f22ceb3e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:56.298939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-115098d2-2ff1-4708-9a6c-3abb8b38afdd req-22f0233a-d2f6-417c-bc2b-8ca2f22ceb3e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:56.312932 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-115098d2-2ff1-4708-9a6c-3abb8b38afdd req-22f0233a-d2f6-417c-bc2b-8ca2f22ceb3e service nova] Creating event network-changed:2984ebfd-8f23-4f8e-83af-0a164bd8c5aa for instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 on n-h2-839401-11 Aug 29 15:34:56.319167 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-115098d2-2ff1-4708-9a6c-3abb8b38afdd req-22f0233a-d2f6-417c-bc2b-8ca2f22ceb3e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042469 Aug 29 15:34:56.320095 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1292/2607] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:34:56.457097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8e6fe855-1ac0-464b-90b9-e74ade44665c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:56.458487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8e6fe855-1ac0-464b-90b9-e74ade44665c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:56.462067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:56.469386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e6fe855-1ac0-464b-90b9-e74ade44665c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:56.470209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e6fe855-1ac0-464b-90b9-e74ade44665c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:56.470970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e6fe855-1ac0-464b-90b9-e74ade44665c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:56.475715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e6fe855-1ac0-464b-90b9-e74ade44665c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:56.476615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e6fe855-1ac0-464b-90b9-e74ade44665c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:56.477397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e6fe855-1ac0-464b-90b9-e74ade44665c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:56.498473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0e31d802-11a3-4e44-958d-5778a01fbce3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:56.514128 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0e31d802-11a3-4e44-958d-5778a01fbce3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.387167 Aug 29 15:34:56.514674 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1316/2608] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:56 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:56.789381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8e6fe855-1ac0-464b-90b9-e74ade44665c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:56.799209 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8e6fe855-1ac0-464b-90b9-e74ade44665c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1365 microversion: 2.1 time: 0.346705 Aug 29 15:34:56.800379 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1293/2609] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:56 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:56.806958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-896df3d7-f95e-48f2-818f-8f2f6b0e09f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:56.808001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-896df3d7-f95e-48f2-818f-8f2f6b0e09f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:56.815025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-896df3d7-f95e-48f2-818f-8f2f6b0e09f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:56.815654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-896df3d7-f95e-48f2-818f-8f2f6b0e09f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:56.816477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-896df3d7-f95e-48f2-818f-8f2f6b0e09f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:56.817553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-896df3d7-f95e-48f2-818f-8f2f6b0e09f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:56.818402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-896df3d7-f95e-48f2-818f-8f2f6b0e09f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:56.819036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-896df3d7-f95e-48f2-818f-8f2f6b0e09f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:57.020598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-896df3d7-f95e-48f2-818f-8f2f6b0e09f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:57.030339 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-896df3d7-f95e-48f2-818f-8f2f6b0e09f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.228193 Aug 29 15:34:57.041944 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1317/2610] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:56 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:57.146485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-67573833-f137-4723-934f-1faa44811bca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:57.147345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-67573833-f137-4723-934f-1faa44811bca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:57.153985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67573833-f137-4723-934f-1faa44811bca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:57.154700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67573833-f137-4723-934f-1faa44811bca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:57.155296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67573833-f137-4723-934f-1faa44811bca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:57.156162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67573833-f137-4723-934f-1faa44811bca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:57.156754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67573833-f137-4723-934f-1faa44811bca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:57.157352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67573833-f137-4723-934f-1faa44811bca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:57.304269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d6a8b9db-361d-4bac-b95e-4c2a615ee997 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:57.304974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d6a8b9db-361d-4bac-b95e-4c2a615ee997 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:57.313400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6a8b9db-361d-4bac-b95e-4c2a615ee997 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:57.314132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6a8b9db-361d-4bac-b95e-4c2a615ee997 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:57.314831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6a8b9db-361d-4bac-b95e-4c2a615ee997 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:57.315745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6a8b9db-361d-4bac-b95e-4c2a615ee997 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:57.316848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6a8b9db-361d-4bac-b95e-4c2a615ee997 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:57.317543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6a8b9db-361d-4bac-b95e-4c2a615ee997 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:57.495689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d6a8b9db-361d-4bac-b95e-4c2a615ee997 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:57.504976 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d6a8b9db-361d-4bac-b95e-4c2a615ee997 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1388 microversion: 2.1 time: 0.213686 Aug 29 15:34:57.505834 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1318/2611] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:57 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1388 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:57.536037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3bda022f-e46e-4b7d-a67f-d5e0cb73a291 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:57.536727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3bda022f-e46e-4b7d-a67f-d5e0cb73a291 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:57.544996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3bda022f-e46e-4b7d-a67f-d5e0cb73a291 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:57.545600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3bda022f-e46e-4b7d-a67f-d5e0cb73a291 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:57.546500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3bda022f-e46e-4b7d-a67f-d5e0cb73a291 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:57.547287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3bda022f-e46e-4b7d-a67f-d5e0cb73a291 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:57.548056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3bda022f-e46e-4b7d-a67f-d5e0cb73a291 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:57.548375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3bda022f-e46e-4b7d-a67f-d5e0cb73a291 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:57.700963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3bda022f-e46e-4b7d-a67f-d5e0cb73a291 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:57.710078 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3bda022f-e46e-4b7d-a67f-d5e0cb73a291 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.178118 Aug 29 15:34:57.710880 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1319/2612] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:57 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:57.824907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e634ce3b-48c4-4664-9bef-4aed78f6c747 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:57.825983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e634ce3b-48c4-4664-9bef-4aed78f6c747 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:57.849665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e634ce3b-48c4-4664-9bef-4aed78f6c747 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:57.850283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e634ce3b-48c4-4664-9bef-4aed78f6c747 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:57.850810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e634ce3b-48c4-4664-9bef-4aed78f6c747 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:57.851653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e634ce3b-48c4-4664-9bef-4aed78f6c747 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:57.852214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e634ce3b-48c4-4664-9bef-4aed78f6c747 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:57.852734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e634ce3b-48c4-4664-9bef-4aed78f6c747 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:58.023723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e634ce3b-48c4-4664-9bef-4aed78f6c747 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:58.032310 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e634ce3b-48c4-4664-9bef-4aed78f6c747 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1365 microversion: 2.1 time: 0.213166 Aug 29 15:34:58.033031 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1320/2613] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:57 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:58.051830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-137745ae-e173-4921-a9e8-8b07837c3de8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:58.052365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-137745ae-e173-4921-a9e8-8b07837c3de8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:58.058858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-137745ae-e173-4921-a9e8-8b07837c3de8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:58.059346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-137745ae-e173-4921-a9e8-8b07837c3de8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:58.059794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-137745ae-e173-4921-a9e8-8b07837c3de8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:58.060493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-137745ae-e173-4921-a9e8-8b07837c3de8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:58.060944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-137745ae-e173-4921-a9e8-8b07837c3de8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:58.061459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-137745ae-e173-4921-a9e8-8b07837c3de8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:58.096739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-67573833-f137-4723-934f-1faa44811bca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:58.110100 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-67573833-f137-4723-934f-1faa44811bca tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.967667 Aug 29 15:34:58.110947 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1294/2614] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:57 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:58.226288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-137745ae-e173-4921-a9e8-8b07837c3de8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:58.242462 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-137745ae-e173-4921-a9e8-8b07837c3de8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.194614 Aug 29 15:34:58.243086 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1321/2615] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:58 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:34:58.527363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d02341c7-1b3c-4822-ba61-067cf1707134 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:58.528238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d02341c7-1b3c-4822-ba61-067cf1707134 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:58.534630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d02341c7-1b3c-4822-ba61-067cf1707134 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:58.535121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d02341c7-1b3c-4822-ba61-067cf1707134 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:58.535671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d02341c7-1b3c-4822-ba61-067cf1707134 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:58.536452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d02341c7-1b3c-4822-ba61-067cf1707134 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:58.537333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d02341c7-1b3c-4822-ba61-067cf1707134 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:58.537834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d02341c7-1b3c-4822-ba61-067cf1707134 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:58.664035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d02341c7-1b3c-4822-ba61-067cf1707134 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:58.674096 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d02341c7-1b3c-4822-ba61-067cf1707134 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1346 microversion: 2.1 time: 0.151448 Aug 29 15:34:58.674692 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1295/2616] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:58 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1346 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:58.731022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6af59192-d156-49f0-bb00-05610f03f173 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:58.731639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6af59192-d156-49f0-bb00-05610f03f173 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:58.740348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6af59192-d156-49f0-bb00-05610f03f173 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:58.740877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6af59192-d156-49f0-bb00-05610f03f173 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:58.741422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6af59192-d156-49f0-bb00-05610f03f173 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:58.742071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6af59192-d156-49f0-bb00-05610f03f173 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:58.742660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6af59192-d156-49f0-bb00-05610f03f173 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:58.743202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6af59192-d156-49f0-bb00-05610f03f173 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:58.759852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-7cafa9f3-38a5-4381-bcbe-6e6e5ff1a5bc req-2b4e9ec6-fd3e-45c7-8b97-6bb698600aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8", "name": "network-vif-deleted", "tag": "7384f0e5-3cc6-41d9-b8ee-6ab5e6937bc9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:34:58.769875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7cafa9f3-38a5-4381-bcbe-6e6e5ff1a5bc req-2b4e9ec6-fd3e-45c7-8b97-6bb698600aa0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:58.770527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7cafa9f3-38a5-4381-bcbe-6e6e5ff1a5bc req-2b4e9ec6-fd3e-45c7-8b97-6bb698600aa0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:58.771031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7cafa9f3-38a5-4381-bcbe-6e6e5ff1a5bc req-2b4e9ec6-fd3e-45c7-8b97-6bb698600aa0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:58.793978 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-7cafa9f3-38a5-4381-bcbe-6e6e5ff1a5bc req-2b4e9ec6-fd3e-45c7-8b97-6bb698600aa0 service nova] Creating event network-vif-deleted:7384f0e5-3cc6-41d9-b8ee-6ab5e6937bc9 for instance 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 on n-h2-839401-11 Aug 29 15:34:58.800051 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-7cafa9f3-38a5-4381-bcbe-6e6e5ff1a5bc req-2b4e9ec6-fd3e-45c7-8b97-6bb698600aa0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044313 Aug 29 15:34:58.800671 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1296/2617] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:34:58.886715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6af59192-d156-49f0-bb00-05610f03f173 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:58.891147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:58.896221 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6af59192-d156-49f0-bb00-05610f03f173 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.169625 Aug 29 15:34:58.896887 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1322/2618] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:58 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:59.056275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-903c1aca-7877-4a15-8ca2-0a177950257c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:59.057241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-903c1aca-7877-4a15-8ca2-0a177950257c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:59.066222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-903c1aca-7877-4a15-8ca2-0a177950257c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:59.067070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-903c1aca-7877-4a15-8ca2-0a177950257c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:59.067729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-903c1aca-7877-4a15-8ca2-0a177950257c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:59.068702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-903c1aca-7877-4a15-8ca2-0a177950257c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:59.069459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-903c1aca-7877-4a15-8ca2-0a177950257c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:59.070097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-903c1aca-7877-4a15-8ca2-0a177950257c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:59.132618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0f2a4e5e-ddef-4011-856b-f4411ae03372 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:59.133284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0f2a4e5e-ddef-4011-856b-f4411ae03372 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:59.140745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f2a4e5e-ddef-4011-856b-f4411ae03372 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:59.141651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f2a4e5e-ddef-4011-856b-f4411ae03372 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:59.142108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f2a4e5e-ddef-4011-856b-f4411ae03372 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:59.142829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f2a4e5e-ddef-4011-856b-f4411ae03372 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:59.143496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f2a4e5e-ddef-4011-856b-f4411ae03372 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:59.144196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f2a4e5e-ddef-4011-856b-f4411ae03372 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:59.326610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0f2a4e5e-ddef-4011-856b-f4411ae03372 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:59.332681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-903c1aca-7877-4a15-8ca2-0a177950257c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:59.336217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:34:59.336603 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0f2a4e5e-ddef-4011-856b-f4411ae03372 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.208533 Aug 29 15:34:59.342263 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-903c1aca-7877-4a15-8ca2-0a177950257c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1365 microversion: 2.1 time: 0.292311 Aug 29 15:34:59.349600 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1297/2619] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:59 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:59.350021 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1323/2620] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:59 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:59.354926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-985606c4-1e49-453d-8f35-933f94a4e6a2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:59.355799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-985606c4-1e49-453d-8f35-933f94a4e6a2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:59.362768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-985606c4-1e49-453d-8f35-933f94a4e6a2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:59.363533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-985606c4-1e49-453d-8f35-933f94a4e6a2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:59.364192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-985606c4-1e49-453d-8f35-933f94a4e6a2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:59.364962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-985606c4-1e49-453d-8f35-933f94a4e6a2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:59.365529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-985606c4-1e49-453d-8f35-933f94a4e6a2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:59.366024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-985606c4-1e49-453d-8f35-933f94a4e6a2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:59.622651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-985606c4-1e49-453d-8f35-933f94a4e6a2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:59.631230 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-985606c4-1e49-453d-8f35-933f94a4e6a2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.279911 Aug 29 15:34:59.639191 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1298/2621] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:59 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:59.694805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ccc6a0d4-7201-481a-8695-53e543e60ad6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:59.695821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ccc6a0d4-7201-481a-8695-53e543e60ad6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:59.703065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccc6a0d4-7201-481a-8695-53e543e60ad6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:59.703762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccc6a0d4-7201-481a-8695-53e543e60ad6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:59.704371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccc6a0d4-7201-481a-8695-53e543e60ad6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:59.705445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccc6a0d4-7201-481a-8695-53e543e60ad6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:59.706426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccc6a0d4-7201-481a-8695-53e543e60ad6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:59.706866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccc6a0d4-7201-481a-8695-53e543e60ad6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:59.777876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ccc6a0d4-7201-481a-8695-53e543e60ad6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:34:59.785641 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ccc6a0d4-7201-481a-8695-53e543e60ad6 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1346 microversion: 2.1 time: 0.094674 Aug 29 15:34:59.786608 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1324/2622] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:59 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:34:59.918402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9408f303-4d90-441f-be7a-316d4a31ff91 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:34:59.919017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9408f303-4d90-441f-be7a-316d4a31ff91 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:34:59.925295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9408f303-4d90-441f-be7a-316d4a31ff91 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:59.925809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9408f303-4d90-441f-be7a-316d4a31ff91 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:59.926274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9408f303-4d90-441f-be7a-316d4a31ff91 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:34:59.926993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9408f303-4d90-441f-be7a-316d4a31ff91 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:34:59.927427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9408f303-4d90-441f-be7a-316d4a31ff91 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:34:59.927853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9408f303-4d90-441f-be7a-316d4a31ff91 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:00.172731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9408f303-4d90-441f-be7a-316d4a31ff91 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:00.182712 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9408f303-4d90-441f-be7a-316d4a31ff91 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.267597 Aug 29 15:35:00.194420 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1299/2623] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:34:59 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:00.359747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-acbfbeb6-fc2a-4c71-ad4a-1c4272089bad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:00.360685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-acbfbeb6-fc2a-4c71-ad4a-1c4272089bad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:00.366396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3ea97e84-46b3-4017-a2c8-9c981a1f9a9b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:00.367231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3ea97e84-46b3-4017-a2c8-9c981a1f9a9b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:00.369585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acbfbeb6-fc2a-4c71-ad4a-1c4272089bad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:00.370399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acbfbeb6-fc2a-4c71-ad4a-1c4272089bad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:00.371123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acbfbeb6-fc2a-4c71-ad4a-1c4272089bad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:00.372210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acbfbeb6-fc2a-4c71-ad4a-1c4272089bad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:00.372875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acbfbeb6-fc2a-4c71-ad4a-1c4272089bad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:00.373526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acbfbeb6-fc2a-4c71-ad4a-1c4272089bad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:00.375787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ea97e84-46b3-4017-a2c8-9c981a1f9a9b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:00.376333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ea97e84-46b3-4017-a2c8-9c981a1f9a9b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:00.376767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ea97e84-46b3-4017-a2c8-9c981a1f9a9b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:00.377935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ea97e84-46b3-4017-a2c8-9c981a1f9a9b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:00.378596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ea97e84-46b3-4017-a2c8-9c981a1f9a9b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:00.379273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ea97e84-46b3-4017-a2c8-9c981a1f9a9b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:00.629553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3ea97e84-46b3-4017-a2c8-9c981a1f9a9b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:00.644319 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3ea97e84-46b3-4017-a2c8-9c981a1f9a9b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1365 microversion: 2.1 time: 0.284651 Aug 29 15:35:00.645410 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1300/2624] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:00 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:00.666463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-99212118-1e0a-4440-bd03-b45f481fd906 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:00.667335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-99212118-1e0a-4440-bd03-b45f481fd906 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:00.673954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99212118-1e0a-4440-bd03-b45f481fd906 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:00.674652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99212118-1e0a-4440-bd03-b45f481fd906 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:00.675239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99212118-1e0a-4440-bd03-b45f481fd906 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:00.676129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99212118-1e0a-4440-bd03-b45f481fd906 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:00.676731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99212118-1e0a-4440-bd03-b45f481fd906 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:00.677420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99212118-1e0a-4440-bd03-b45f481fd906 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:00.740837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-acbfbeb6-fc2a-4c71-ad4a-1c4272089bad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:00.751075 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-acbfbeb6-fc2a-4c71-ad4a-1c4272089bad tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1512 microversion: 2.1 time: 0.395213 Aug 29 15:35:00.751679 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1325/2625] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:00 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1512 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:00.805950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d14d9d36-6344-4215-87f6-b4d6d885162d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:00.807486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d14d9d36-6344-4215-87f6-b4d6d885162d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:00.820151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d14d9d36-6344-4215-87f6-b4d6d885162d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:00.821095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d14d9d36-6344-4215-87f6-b4d6d885162d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:00.821902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d14d9d36-6344-4215-87f6-b4d6d885162d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:00.822867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d14d9d36-6344-4215-87f6-b4d6d885162d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:00.823469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d14d9d36-6344-4215-87f6-b4d6d885162d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:00.826543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d14d9d36-6344-4215-87f6-b4d6d885162d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:00.856240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:00.908067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:00.932956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d14d9d36-6344-4215-87f6-b4d6d885162d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:00.945274 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d14d9d36-6344-4215-87f6-b4d6d885162d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1183 microversion: 2.1 time: 0.143401 Aug 29 15:35:00.949947 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1326/2626] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:00 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:01.006791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-99212118-1e0a-4440-bd03-b45f481fd906 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:01.018900 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-99212118-1e0a-4440-bd03-b45f481fd906 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1513 microversion: 2.1 time: 0.358894 Aug 29 15:35:01.021521 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1301/2627] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:00 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1513 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:01.205290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d85c6bc0-0d2e-4d0b-8f8b-5fa3233bf23a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:01.206550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d85c6bc0-0d2e-4d0b-8f8b-5fa3233bf23a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:01.224801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85c6bc0-0d2e-4d0b-8f8b-5fa3233bf23a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:01.227044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85c6bc0-0d2e-4d0b-8f8b-5fa3233bf23a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:01.229738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85c6bc0-0d2e-4d0b-8f8b-5fa3233bf23a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:01.233937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85c6bc0-0d2e-4d0b-8f8b-5fa3233bf23a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:01.235735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85c6bc0-0d2e-4d0b-8f8b-5fa3233bf23a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:01.237455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85c6bc0-0d2e-4d0b-8f8b-5fa3233bf23a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:01.298669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:01.677927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ffb7ad39-b05e-4805-8889-1ac1a65239ff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:01.679151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ffb7ad39-b05e-4805-8889-1ac1a65239ff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:01.690015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffb7ad39-b05e-4805-8889-1ac1a65239ff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:01.690828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffb7ad39-b05e-4805-8889-1ac1a65239ff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:01.691993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffb7ad39-b05e-4805-8889-1ac1a65239ff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:01.693811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffb7ad39-b05e-4805-8889-1ac1a65239ff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:01.696847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffb7ad39-b05e-4805-8889-1ac1a65239ff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:01.697579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffb7ad39-b05e-4805-8889-1ac1a65239ff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:01.825996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d85c6bc0-0d2e-4d0b-8f8b-5fa3233bf23a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:01.846425 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d85c6bc0-0d2e-4d0b-8f8b-5fa3233bf23a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1541 microversion: 2.1 time: 0.641967 Aug 29 15:35:01.846425 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1327/2628] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:01 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1541 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:01.864380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ae195e19-d412-4c97-b36a-6e5f838b01b9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:01.865017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ae195e19-d412-4c97-b36a-6e5f838b01b9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:01.893761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae195e19-d412-4c97-b36a-6e5f838b01b9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:01.902983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae195e19-d412-4c97-b36a-6e5f838b01b9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:01.905579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae195e19-d412-4c97-b36a-6e5f838b01b9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:01.909738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae195e19-d412-4c97-b36a-6e5f838b01b9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:01.910255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae195e19-d412-4c97-b36a-6e5f838b01b9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:01.920037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae195e19-d412-4c97-b36a-6e5f838b01b9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:02.116798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ffb7ad39-b05e-4805-8889-1ac1a65239ff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:02.136770 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ffb7ad39-b05e-4805-8889-1ac1a65239ff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1365 microversion: 2.1 time: 0.471972 Aug 29 15:35:02.138046 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1302/2629] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:01 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1365 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:02.146004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-350fddd7-3097-4795-a7ce-14b6a9b663cf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:02.147379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-350fddd7-3097-4795-a7ce-14b6a9b663cf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:02.159420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-350fddd7-3097-4795-a7ce-14b6a9b663cf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:02.160087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-350fddd7-3097-4795-a7ce-14b6a9b663cf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:02.160797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-350fddd7-3097-4795-a7ce-14b6a9b663cf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:02.161707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-350fddd7-3097-4795-a7ce-14b6a9b663cf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:02.162334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-350fddd7-3097-4795-a7ce-14b6a9b663cf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:02.162910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-350fddd7-3097-4795-a7ce-14b6a9b663cf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:02.251518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-350fddd7-3097-4795-a7ce-14b6a9b663cf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:02.263307 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-350fddd7-3097-4795-a7ce-14b6a9b663cf tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1183 microversion: 2.1 time: 0.123577 Aug 29 15:35:02.264443 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1303/2630] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:02 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:02.273322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-904f00c5-07f1-41b9-9c98-2227e5d4bc09 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:02.274804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-904f00c5-07f1-41b9-9c98-2227e5d4bc09 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:02.281917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ae195e19-d412-4c97-b36a-6e5f838b01b9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:02.295838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-904f00c5-07f1-41b9-9c98-2227e5d4bc09 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:02.296410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-904f00c5-07f1-41b9-9c98-2227e5d4bc09 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:02.296660 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ae195e19-d412-4c97-b36a-6e5f838b01b9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1489 microversion: 2.1 time: 0.447984 Aug 29 15:35:02.296858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-904f00c5-07f1-41b9-9c98-2227e5d4bc09 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:02.297287 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1328/2631] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:01 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1489 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:02.308691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-904f00c5-07f1-41b9-9c98-2227e5d4bc09 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:02.309627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-904f00c5-07f1-41b9-9c98-2227e5d4bc09 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:02.310238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-904f00c5-07f1-41b9-9c98-2227e5d4bc09 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:02.324943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aa98696b-2ef8-45df-9e40-8e4f638cf5c3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:02.325746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aa98696b-2ef8-45df-9e40-8e4f638cf5c3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:02.338958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa98696b-2ef8-45df-9e40-8e4f638cf5c3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:02.340975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa98696b-2ef8-45df-9e40-8e4f638cf5c3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:02.343740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa98696b-2ef8-45df-9e40-8e4f638cf5c3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:02.344753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa98696b-2ef8-45df-9e40-8e4f638cf5c3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:02.347483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa98696b-2ef8-45df-9e40-8e4f638cf5c3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:02.348124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa98696b-2ef8-45df-9e40-8e4f638cf5c3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:02.454295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aa98696b-2ef8-45df-9e40-8e4f638cf5c3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:02.576206 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aa98696b-2ef8-45df-9e40-8e4f638cf5c3 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 204 len: 0 microversion: 2.1 time: 0.258078 Aug 29 15:35:02.580386 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1329/2632] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:02 2022] DELETE /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:35:02.589121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-951d56be-84ae-41ec-bff2-edb09565f000 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:02.590072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-951d56be-84ae-41ec-bff2-edb09565f000 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:02.606776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-951d56be-84ae-41ec-bff2-edb09565f000 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:02.619156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-951d56be-84ae-41ec-bff2-edb09565f000 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:02.619690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-951d56be-84ae-41ec-bff2-edb09565f000 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:02.620460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-951d56be-84ae-41ec-bff2-edb09565f000 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:02.629254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-951d56be-84ae-41ec-bff2-edb09565f000 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:02.631485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-951d56be-84ae-41ec-bff2-edb09565f000 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:02.898889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-904f00c5-07f1-41b9-9c98-2227e5d4bc09 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:02.914006 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-904f00c5-07f1-41b9-9c98-2227e5d4bc09 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1519 microversion: 2.1 time: 0.647475 Aug 29 15:35:02.914608 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1304/2633] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:02 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1519 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:02.929625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-951d56be-84ae-41ec-bff2-edb09565f000 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:02.938560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4e4a03b2-6448-4abb-9333-d54fb745c1f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:02.942357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4e4a03b2-6448-4abb-9333-d54fb745c1f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:02.944301 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-951d56be-84ae-41ec-bff2-edb09565f000 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1495 microversion: 2.1 time: 0.360720 Aug 29 15:35:02.945117 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1330/2634] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:02 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1495 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:02.969837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e4a03b2-6448-4abb-9333-d54fb745c1f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:02.970586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e4a03b2-6448-4abb-9333-d54fb745c1f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:02.971015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e4a03b2-6448-4abb-9333-d54fb745c1f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:02.971715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e4a03b2-6448-4abb-9333-d54fb745c1f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:02.972332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e4a03b2-6448-4abb-9333-d54fb745c1f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:02.973096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e4a03b2-6448-4abb-9333-d54fb745c1f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:03.161789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6acd0197-f93e-4388-8332-62eed24296e4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:03.162432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6acd0197-f93e-4388-8332-62eed24296e4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:03.179096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6acd0197-f93e-4388-8332-62eed24296e4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:03.179608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6acd0197-f93e-4388-8332-62eed24296e4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:03.180049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6acd0197-f93e-4388-8332-62eed24296e4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:03.180778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6acd0197-f93e-4388-8332-62eed24296e4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:03.181268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6acd0197-f93e-4388-8332-62eed24296e4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:03.181694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6acd0197-f93e-4388-8332-62eed24296e4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:03.604319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4e4a03b2-6448-4abb-9333-d54fb745c1f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:03.613366 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4e4a03b2-6448-4abb-9333-d54fb745c1f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1540 microversion: 2.1 time: 0.697605 Aug 29 15:35:03.625928 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1305/2635] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:02 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1540 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:03.631220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1460dc14-34cd-45b2-9869-668a44e45a87 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:03.632100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1460dc14-34cd-45b2-9869-668a44e45a87 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:03.640354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1460dc14-34cd-45b2-9869-668a44e45a87 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:03.648422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1460dc14-34cd-45b2-9869-668a44e45a87 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:03.653984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1460dc14-34cd-45b2-9869-668a44e45a87 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:03.655042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1460dc14-34cd-45b2-9869-668a44e45a87 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:03.655718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1460dc14-34cd-45b2-9869-668a44e45a87 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:03.656347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1460dc14-34cd-45b2-9869-668a44e45a87 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:03.999592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6acd0197-f93e-4388-8332-62eed24296e4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:04.014102 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6acd0197-f93e-4388-8332-62eed24296e4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1365 microversion: 2.1 time: 0.856591 Aug 29 15:35:04.016800 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1331/2636] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:03 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1365 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:04.031527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ddb723c8-021f-4c76-a49b-4d7e8d397ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:04.032861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ddb723c8-021f-4c76-a49b-4d7e8d397ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:04.052672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddb723c8-021f-4c76-a49b-4d7e8d397ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:04.053823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddb723c8-021f-4c76-a49b-4d7e8d397ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:04.054926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddb723c8-021f-4c76-a49b-4d7e8d397ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:04.059253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddb723c8-021f-4c76-a49b-4d7e8d397ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:04.060574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddb723c8-021f-4c76-a49b-4d7e8d397ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:04.061990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddb723c8-021f-4c76-a49b-4d7e8d397ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:04.295676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1460dc14-34cd-45b2-9869-668a44e45a87 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:04.306444 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1460dc14-34cd-45b2-9869-668a44e45a87 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1183 microversion: 2.1 time: 0.678901 Aug 29 15:35:04.310310 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1306/2637] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:03 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1183 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:04.335771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3d13c948-744d-4d58-80bb-b37020e70260 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:04.337996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3d13c948-744d-4d58-80bb-b37020e70260 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:04.349895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d13c948-744d-4d58-80bb-b37020e70260 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:04.354432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d13c948-744d-4d58-80bb-b37020e70260 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:04.355094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d13c948-744d-4d58-80bb-b37020e70260 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:04.364559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d13c948-744d-4d58-80bb-b37020e70260 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:04.365421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d13c948-744d-4d58-80bb-b37020e70260 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:04.366178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d13c948-744d-4d58-80bb-b37020e70260 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:04.627791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ddb723c8-021f-4c76-a49b-4d7e8d397ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:04.637328 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ddb723c8-021f-4c76-a49b-4d7e8d397ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1519 microversion: 2.1 time: 0.617393 Aug 29 15:35:04.638310 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1332/2638] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:04 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1519 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:04.647020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-6609f7bf-bd39-4846-825f-6449e60d4aa9 req-f85a3361-505a-4688-85c8-a3d5d6842e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f838765-3a8a-47c2-9907-367ddaf2d90f", "name": "network-vif-unplugged", "status": "completed", "tag": "0f30a440-530f-4c46-b4fb-89f0c9814d97"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:04.669708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6609f7bf-bd39-4846-825f-6449e60d4aa9 req-f85a3361-505a-4688-85c8-a3d5d6842e3f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:04.672914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6609f7bf-bd39-4846-825f-6449e60d4aa9 req-f85a3361-505a-4688-85c8-a3d5d6842e3f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:04.673494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6609f7bf-bd39-4846-825f-6449e60d4aa9 req-f85a3361-505a-4688-85c8-a3d5d6842e3f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:04.697906 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-6609f7bf-bd39-4846-825f-6449e60d4aa9 req-f85a3361-505a-4688-85c8-a3d5d6842e3f service nova] Creating event network-vif-unplugged:0f30a440-530f-4c46-b4fb-89f0c9814d97 for instance 0f838765-3a8a-47c2-9907-367ddaf2d90f on n-h1-839401-11 Aug 29 15:35:04.706696 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-6609f7bf-bd39-4846-825f-6449e60d4aa9 req-f85a3361-505a-4688-85c8-a3d5d6842e3f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065196 Aug 29 15:35:04.709332 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1333/2639] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:04.719297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-34952bdd-3625-47bc-9170-20b65acd0976 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:04.724093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-34952bdd-3625-47bc-9170-20b65acd0976 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:04.737823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34952bdd-3625-47bc-9170-20b65acd0976 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:04.741004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34952bdd-3625-47bc-9170-20b65acd0976 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:04.741676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34952bdd-3625-47bc-9170-20b65acd0976 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:04.743364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34952bdd-3625-47bc-9170-20b65acd0976 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:04.744183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34952bdd-3625-47bc-9170-20b65acd0976 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:04.744873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34952bdd-3625-47bc-9170-20b65acd0976 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:04.938734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3d13c948-744d-4d58-80bb-b37020e70260 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:04.949470 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3d13c948-744d-4d58-80bb-b37020e70260 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1495 microversion: 2.1 time: 0.632135 Aug 29 15:35:04.951319 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1307/2640] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:04 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1495 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:05.042319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-184eabe9-221b-4ff4-b028-0c81474de611 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:05.043312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-184eabe9-221b-4ff4-b028-0c81474de611 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:05.053074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-184eabe9-221b-4ff4-b028-0c81474de611 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:05.053882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-184eabe9-221b-4ff4-b028-0c81474de611 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:05.055042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-184eabe9-221b-4ff4-b028-0c81474de611 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:05.057462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-184eabe9-221b-4ff4-b028-0c81474de611 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:05.058091 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-184eabe9-221b-4ff4-b028-0c81474de611 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:05.059187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-184eabe9-221b-4ff4-b028-0c81474de611 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:05.095696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-34952bdd-3625-47bc-9170-20b65acd0976 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:05.108557 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-34952bdd-3625-47bc-9170-20b65acd0976 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1540 microversion: 2.1 time: 0.393395 Aug 29 15:35:05.109404 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1334/2641] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:04 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1540 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:05.331864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-abaa275f-7868-48f2-8900-35d9f236dad8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:05.332594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-abaa275f-7868-48f2-8900-35d9f236dad8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:05.340007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abaa275f-7868-48f2-8900-35d9f236dad8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:05.345972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abaa275f-7868-48f2-8900-35d9f236dad8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:05.346651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abaa275f-7868-48f2-8900-35d9f236dad8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:05.347555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abaa275f-7868-48f2-8900-35d9f236dad8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:05.351906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abaa275f-7868-48f2-8900-35d9f236dad8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:05.352538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abaa275f-7868-48f2-8900-35d9f236dad8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:05.468269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-abaa275f-7868-48f2-8900-35d9f236dad8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:05.486078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-184eabe9-221b-4ff4-b028-0c81474de611 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:05.487013 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-abaa275f-7868-48f2-8900-35d9f236dad8 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1183 microversion: 2.1 time: 0.150887 Aug 29 15:35:05.488222 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1335/2642] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:05 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:05.500892 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-184eabe9-221b-4ff4-b028-0c81474de611 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1365 microversion: 2.1 time: 0.462860 Aug 29 15:35:05.510465 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1308/2643] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:05 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1365 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:05.658660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e0aad110-0e8e-4739-a380-01fa13cea9e7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:05.659356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e0aad110-0e8e-4739-a380-01fa13cea9e7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:05.669589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0aad110-0e8e-4739-a380-01fa13cea9e7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:05.670846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0aad110-0e8e-4739-a380-01fa13cea9e7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:05.673271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0aad110-0e8e-4739-a380-01fa13cea9e7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:05.674145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0aad110-0e8e-4739-a380-01fa13cea9e7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:05.674743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0aad110-0e8e-4739-a380-01fa13cea9e7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:05.677548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0aad110-0e8e-4739-a380-01fa13cea9e7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:05.896439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e0aad110-0e8e-4739-a380-01fa13cea9e7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:05.909703 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e0aad110-0e8e-4739-a380-01fa13cea9e7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1519 microversion: 2.1 time: 0.255291 Aug 29 15:35:05.910753 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1336/2644] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:05 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1519 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:05.972581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f8fd815a-68b5-413d-b7cf-f23d5ea70bf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:05.973302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f8fd815a-68b5-413d-b7cf-f23d5ea70bf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:05.989949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8fd815a-68b5-413d-b7cf-f23d5ea70bf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:05.991580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8fd815a-68b5-413d-b7cf-f23d5ea70bf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:05.992276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8fd815a-68b5-413d-b7cf-f23d5ea70bf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:05.993271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8fd815a-68b5-413d-b7cf-f23d5ea70bf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:05.993947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8fd815a-68b5-413d-b7cf-f23d5ea70bf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:05.996050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8fd815a-68b5-413d-b7cf-f23d5ea70bf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:06.132061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-28533697-29f9-4cfc-8a9c-882871b96527 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:06.133232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-28533697-29f9-4cfc-8a9c-882871b96527 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:06.143517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28533697-29f9-4cfc-8a9c-882871b96527 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:06.144255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28533697-29f9-4cfc-8a9c-882871b96527 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:06.148597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28533697-29f9-4cfc-8a9c-882871b96527 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:06.149840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28533697-29f9-4cfc-8a9c-882871b96527 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:06.150911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28533697-29f9-4cfc-8a9c-882871b96527 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:06.151641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-28533697-29f9-4cfc-8a9c-882871b96527 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:06.404880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f8fd815a-68b5-413d-b7cf-f23d5ea70bf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:06.416415 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f8fd815a-68b5-413d-b7cf-f23d5ea70bf4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1495 microversion: 2.1 time: 0.447852 Aug 29 15:35:06.419592 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1309/2645] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:05 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1495 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:06.444739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-28533697-29f9-4cfc-8a9c-882871b96527 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:06.456728 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-28533697-29f9-4cfc-8a9c-882871b96527 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1472 microversion: 2.1 time: 0.328981 Aug 29 15:35:06.459813 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1337/2646] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:06 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:06.511151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-290adf77-5f9d-4451-8b08-45fc4ea8b488 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:06.512395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-290adf77-5f9d-4451-8b08-45fc4ea8b488 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:06.530533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b32a94f3-888f-44b4-b955-b83fff5b7a56 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:06.531403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b32a94f3-888f-44b4-b955-b83fff5b7a56 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:06.539645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-290adf77-5f9d-4451-8b08-45fc4ea8b488 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:06.544887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b32a94f3-888f-44b4-b955-b83fff5b7a56 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:06.545750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-290adf77-5f9d-4451-8b08-45fc4ea8b488 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:06.546351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-290adf77-5f9d-4451-8b08-45fc4ea8b488 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:06.548529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b32a94f3-888f-44b4-b955-b83fff5b7a56 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:06.549373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-290adf77-5f9d-4451-8b08-45fc4ea8b488 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:06.549792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b32a94f3-888f-44b4-b955-b83fff5b7a56 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:06.550686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b32a94f3-888f-44b4-b955-b83fff5b7a56 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:06.551303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-290adf77-5f9d-4451-8b08-45fc4ea8b488 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:06.551899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-290adf77-5f9d-4451-8b08-45fc4ea8b488 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:06.552515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b32a94f3-888f-44b4-b955-b83fff5b7a56 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:06.557612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b32a94f3-888f-44b4-b955-b83fff5b7a56 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:06.599057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:06.677553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-290adf77-5f9d-4451-8b08-45fc4ea8b488 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:06.688217 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-290adf77-5f9d-4451-8b08-45fc4ea8b488 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1183 microversion: 2.1 time: 0.182905 Aug 29 15:35:06.702914 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1310/2647] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:06 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:06.772913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f8683439-4d5d-4865-b685-05a6a93b50d1 req-17ee148b-b4b4-4e2c-a3c6-33cb1d6202ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74984943-d6e3-4b74-b251-f05fff364c27", "name": "network-vif-unplugged", "status": "completed", "tag": "f5fdbe76-975e-466c-9d17-812c0ec39457"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:06.809037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f8683439-4d5d-4865-b685-05a6a93b50d1 req-17ee148b-b4b4-4e2c-a3c6-33cb1d6202ee service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:06.809546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f8683439-4d5d-4865-b685-05a6a93b50d1 req-17ee148b-b4b4-4e2c-a3c6-33cb1d6202ee service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:06.817493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f8683439-4d5d-4865-b685-05a6a93b50d1 req-17ee148b-b4b4-4e2c-a3c6-33cb1d6202ee service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:06.847273 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f8683439-4d5d-4865-b685-05a6a93b50d1 req-17ee148b-b4b4-4e2c-a3c6-33cb1d6202ee service nova] Creating event network-vif-unplugged:f5fdbe76-975e-466c-9d17-812c0ec39457 for instance 74984943-d6e3-4b74-b251-f05fff364c27 on n-h2-839401-11 Aug 29 15:35:06.861664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-f8683439-4d5d-4865-b685-05a6a93b50d1 req-17ee148b-b4b4-4e2c-a3c6-33cb1d6202ee service nova] Instance 74984943-d6e3-4b74-b251-f05fff364c27 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:35:06.873401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b32a94f3-888f-44b4-b955-b83fff5b7a56 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:06.881856 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b32a94f3-888f-44b4-b955-b83fff5b7a56 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1365 microversion: 2.1 time: 0.357461 Aug 29 15:35:06.882456 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1338/2648] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:06 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1365 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:06.886497 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f8683439-4d5d-4865-b685-05a6a93b50d1 req-17ee148b-b4b4-4e2c-a3c6-33cb1d6202ee service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118310 Aug 29 15:35:06.887392 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1311/2649] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:06.930226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-273a2b45-a9c0-4e8b-bb59-5e7ad55e98fd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:06.936240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b8f9aded-b927-45d7-a6a3-857ab876f538 req-043a9b1f-87ee-494e-97e0-a6e2ba66368d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa", "name": "network-vif-deleted", "tag": "924d833e-f874-4700-8474-ffbf6438a336"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:06.937231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-273a2b45-a9c0-4e8b-bb59-5e7ad55e98fd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:06.950332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-273a2b45-a9c0-4e8b-bb59-5e7ad55e98fd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:06.954729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b8f9aded-b927-45d7-a6a3-857ab876f538 req-043a9b1f-87ee-494e-97e0-a6e2ba66368d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:06.955651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-273a2b45-a9c0-4e8b-bb59-5e7ad55e98fd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:06.956254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-273a2b45-a9c0-4e8b-bb59-5e7ad55e98fd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:06.957401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-273a2b45-a9c0-4e8b-bb59-5e7ad55e98fd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:06.959693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-273a2b45-a9c0-4e8b-bb59-5e7ad55e98fd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:06.962366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-273a2b45-a9c0-4e8b-bb59-5e7ad55e98fd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:06.968050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b8f9aded-b927-45d7-a6a3-857ab876f538 req-043a9b1f-87ee-494e-97e0-a6e2ba66368d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:06.969434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b8f9aded-b927-45d7-a6a3-857ab876f538 req-043a9b1f-87ee-494e-97e0-a6e2ba66368d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:07.014716 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b8f9aded-b927-45d7-a6a3-857ab876f538 req-043a9b1f-87ee-494e-97e0-a6e2ba66368d service nova] Creating event network-vif-deleted:924d833e-f874-4700-8474-ffbf6438a336 for instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa on n-h1-839401-11 Aug 29 15:35:07.027144 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b8f9aded-b927-45d7-a6a3-857ab876f538 req-043a9b1f-87ee-494e-97e0-a6e2ba66368d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094699 Aug 29 15:35:07.028097 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1312/2650] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:07.358533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-273a2b45-a9c0-4e8b-bb59-5e7ad55e98fd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:07.368280 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-273a2b45-a9c0-4e8b-bb59-5e7ad55e98fd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1519 microversion: 2.1 time: 0.441918 Aug 29 15:35:07.369776 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1339/2651] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:06 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1519 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:07.441289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8e5c7933-67a2-4cda-b7dd-2c43994ebeb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:07.442190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8e5c7933-67a2-4cda-b7dd-2c43994ebeb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:07.449449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5c7933-67a2-4cda-b7dd-2c43994ebeb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:07.450398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5c7933-67a2-4cda-b7dd-2c43994ebeb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:07.451088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5c7933-67a2-4cda-b7dd-2c43994ebeb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:07.452528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5c7933-67a2-4cda-b7dd-2c43994ebeb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:07.453299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5c7933-67a2-4cda-b7dd-2c43994ebeb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:07.453999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5c7933-67a2-4cda-b7dd-2c43994ebeb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:07.488044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b903e081-963a-48ef-b966-b8be2374e91b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:07.489629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b903e081-963a-48ef-b966-b8be2374e91b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:07.503528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b903e081-963a-48ef-b966-b8be2374e91b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:07.505698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b903e081-963a-48ef-b966-b8be2374e91b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:07.506387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b903e081-963a-48ef-b966-b8be2374e91b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:07.508240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b903e081-963a-48ef-b966-b8be2374e91b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:07.509512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b903e081-963a-48ef-b966-b8be2374e91b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:07.510375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b903e081-963a-48ef-b966-b8be2374e91b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:07.545735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5c7933-67a2-4cda-b7dd-2c43994ebeb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:07.550442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5c7933-67a2-4cda-b7dd-2c43994ebeb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:07.551352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e5c7933-67a2-4cda-b7dd-2c43994ebeb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:07.551976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-8e5c7933-67a2-4cda-b7dd-2c43994ebeb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lazy-loading 'fault' on Instance uuid 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:07.639721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8e5c7933-67a2-4cda-b7dd-2c43994ebeb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:07.655619 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8e5c7933-67a2-4cda-b7dd-2c43994ebeb7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 200 len: 1305 microversion: 2.1 time: 0.219896 Aug 29 15:35:07.657239 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1313/2652] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:07 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 1305 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:07.709347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-00c2f130-8bd8-4bb1-b1db-c456f8832956 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:07.711893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-00c2f130-8bd8-4bb1-b1db-c456f8832956 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:07.728225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00c2f130-8bd8-4bb1-b1db-c456f8832956 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:07.728639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00c2f130-8bd8-4bb1-b1db-c456f8832956 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:07.729151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00c2f130-8bd8-4bb1-b1db-c456f8832956 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:07.729892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00c2f130-8bd8-4bb1-b1db-c456f8832956 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:07.730560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00c2f130-8bd8-4bb1-b1db-c456f8832956 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:07.731745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00c2f130-8bd8-4bb1-b1db-c456f8832956 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:07.819930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b903e081-963a-48ef-b966-b8be2374e91b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:07.861978 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b903e081-963a-48ef-b966-b8be2374e91b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1472 microversion: 2.1 time: 0.381737 Aug 29 15:35:07.862609 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1340/2653] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:07 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1472 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:07.900726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-00c2f130-8bd8-4bb1-b1db-c456f8832956 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:07.903549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b1dfd90b-3b28-4ee2-b06a-ab4a9a8e11f9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:07.904279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b1dfd90b-3b28-4ee2-b06a-ab4a9a8e11f9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:07.913365 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-00c2f130-8bd8-4bb1-b1db-c456f8832956 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1183 microversion: 2.1 time: 0.208876 Aug 29 15:35:07.918563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:07.918973 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1314/2654] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:07 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:07.920059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1dfd90b-3b28-4ee2-b06a-ab4a9a8e11f9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:07.920561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1dfd90b-3b28-4ee2-b06a-ab4a9a8e11f9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:07.921005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1dfd90b-3b28-4ee2-b06a-ab4a9a8e11f9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:07.921758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1dfd90b-3b28-4ee2-b06a-ab4a9a8e11f9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:07.922222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1dfd90b-3b28-4ee2-b06a-ab4a9a8e11f9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:07.922652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1dfd90b-3b28-4ee2-b06a-ab4a9a8e11f9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:08.120941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b1dfd90b-3b28-4ee2-b06a-ab4a9a8e11f9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:08.132690 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b1dfd90b-3b28-4ee2-b06a-ab4a9a8e11f9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1365 microversion: 2.1 time: 0.233066 Aug 29 15:35:08.133985 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1341/2655] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:07 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:08.393500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fef6992c-8cb4-4164-a100-efa7836c8934 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:08.395922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fef6992c-8cb4-4164-a100-efa7836c8934 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:08.403903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fef6992c-8cb4-4164-a100-efa7836c8934 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:08.405203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fef6992c-8cb4-4164-a100-efa7836c8934 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:08.406259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fef6992c-8cb4-4164-a100-efa7836c8934 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:08.408294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fef6992c-8cb4-4164-a100-efa7836c8934 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:08.409043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fef6992c-8cb4-4164-a100-efa7836c8934 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:08.411300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fef6992c-8cb4-4164-a100-efa7836c8934 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:08.480846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1071411617", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "ca12b050-adae-47b1-a13e-95c322fca7d9"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:08.620318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] validate_networks() for [('ca12b050-adae-47b1-a13e-95c322fca7d9', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:35:08.664957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fef6992c-8cb4-4164-a100-efa7836c8934 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:08.675480 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fef6992c-8cb4-4164-a100-efa7836c8934 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1519 microversion: 2.1 time: 0.287560 Aug 29 15:35:08.676131 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1342/2656] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:08 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1519 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:08.687094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d6d4a4e8-6fd7-4e22-8c6a-18ec214e7264 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:08.690568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d6d4a4e8-6fd7-4e22-8c6a-18ec214e7264 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:08.707096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6d4a4e8-6fd7-4e22-8c6a-18ec214e7264 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:08.707778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6d4a4e8-6fd7-4e22-8c6a-18ec214e7264 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:08.709570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6d4a4e8-6fd7-4e22-8c6a-18ec214e7264 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:08.710354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6d4a4e8-6fd7-4e22-8c6a-18ec214e7264 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:08.710771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6d4a4e8-6fd7-4e22-8c6a-18ec214e7264 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:08.712912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6d4a4e8-6fd7-4e22-8c6a-18ec214e7264 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:08.729791 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-d6d4a4e8-6fd7-4e22-8c6a-18ec214e7264 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d6d4a4e8-6fd7-4e22-8c6a-18ec214e7264 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa HTTP/1.1 Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa'} Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:08.731732 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:08.735990 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:08.735990 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:08.735990 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:08.735990 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:08.735990 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:08.735990 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. Aug 29 15:35:08.735990 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:08.735990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d6d4a4e8-6fd7-4e22-8c6a-18ec214e7264 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:08.735990 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d6d4a4e8-6fd7-4e22-8c6a-18ec214e7264 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 404 len: 111 microversion: 2.1 time: 0.051490 Aug 29 15:35:08.735990 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1343/2657] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:08 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:08.886533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3e33e0e9-5898-4261-8c10-344a1f353db9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:08.887581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3e33e0e9-5898-4261-8c10-344a1f353db9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:08.896248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e33e0e9-5898-4261-8c10-344a1f353db9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:08.897097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e33e0e9-5898-4261-8c10-344a1f353db9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:08.898132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e33e0e9-5898-4261-8c10-344a1f353db9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:08.899200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e33e0e9-5898-4261-8c10-344a1f353db9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:08.899985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e33e0e9-5898-4261-8c10-344a1f353db9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:08.900623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e33e0e9-5898-4261-8c10-344a1f353db9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:09.111409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3e33e0e9-5898-4261-8c10-344a1f353db9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:09.121140 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3e33e0e9-5898-4261-8c10-344a1f353db9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1472 microversion: 2.1 time: 0.238330 Aug 29 15:35:09.121892 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1344/2658] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:08 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1472 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:09.126752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-0fc4366d-b6b6-436d-93bf-34821b93ca20 req-e8a1ed9a-b25b-433e-ad41-135700e9b44a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af95f7c-5362-4cf9-b80e-38cd6a518783", "name": "network-vif-plugged", "status": "completed", "tag": "2984ebfd-8f23-4f8e-83af-0a164bd8c5aa"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:09.139495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0fc4366d-b6b6-436d-93bf-34821b93ca20 req-e8a1ed9a-b25b-433e-ad41-135700e9b44a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:09.140266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0fc4366d-b6b6-436d-93bf-34821b93ca20 req-e8a1ed9a-b25b-433e-ad41-135700e9b44a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:09.141156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0fc4366d-b6b6-436d-93bf-34821b93ca20 req-e8a1ed9a-b25b-433e-ad41-135700e9b44a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:09.157303 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-0fc4366d-b6b6-436d-93bf-34821b93ca20 req-e8a1ed9a-b25b-433e-ad41-135700e9b44a service nova] Creating event network-vif-plugged:2984ebfd-8f23-4f8e-83af-0a164bd8c5aa for instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 on n-h2-839401-11 Aug 29 15:35:09.202120 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-0fc4366d-b6b6-436d-93bf-34821b93ca20 req-e8a1ed9a-b25b-433e-ad41-135700e9b44a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075274 Aug 29 15:35:09.206217 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1345/2659] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:09.219830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-390807731", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "cb3199df-483a-4605-86c6-a5d65679d5da"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:09.253051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:35:09.253890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:35:09.254365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:35:09.254982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:35:09.255965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:35:09.294263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:09.297946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:09.299877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:09.300942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:09.306531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:09.307338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:09.317461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] validate_networks() for [('cb3199df-483a-4605-86c6-a5d65679d5da', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:35:09.328944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:09.355914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Getting quotas for project ab4615dd6897416ca44c89b092e5526d. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:35:09.381640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Getting quotas for user 7138531e3322432c991b0d0b00e3fa63 and project ab4615dd6897416ca44c89b092e5526d. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:35:09.431415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Going to run 2 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:35:09.438234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: c3ec48cd-e9ba-44a3-b2b0-a2a5945d6eba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:35:09.524033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=c3ec48cd-e9ba-44a3-b2b0-a2a5945d6eba,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:35:09.649867 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-af4e72fd-9b9f-4118-836c-3f5ad5cd387f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.328282 Aug 29 15:35:09.661306 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1315/2660] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:35:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:35:09.666705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b967299c-ef58-47d3-8a7d-3475b36f0b4d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:09.669858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b967299c-ef58-47d3-8a7d-3475b36f0b4d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:09.685438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b967299c-ef58-47d3-8a7d-3475b36f0b4d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:09.687107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b967299c-ef58-47d3-8a7d-3475b36f0b4d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:09.688486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b967299c-ef58-47d3-8a7d-3475b36f0b4d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:09.691412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b967299c-ef58-47d3-8a7d-3475b36f0b4d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:09.692156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b967299c-ef58-47d3-8a7d-3475b36f0b4d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:09.692778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b967299c-ef58-47d3-8a7d-3475b36f0b4d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:09.763057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b967299c-ef58-47d3-8a7d-3475b36f0b4d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:09.764194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b967299c-ef58-47d3-8a7d-3475b36f0b4d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:09.764838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b967299c-ef58-47d3-8a7d-3475b36f0b4d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:09.765611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-b967299c-ef58-47d3-8a7d-3475b36f0b4d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lazy-loading 'fault' on Instance uuid 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:09.888584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b967299c-ef58-47d3-8a7d-3475b36f0b4d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:09.902022 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b967299c-ef58-47d3-8a7d-3475b36f0b4d tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 200 len: 1142 microversion: 2.1 time: 0.238970 Aug 29 15:35:09.904009 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1316/2661] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:09 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 1142 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:09.914860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a153ab12-636f-4bf4-a79f-7bb7e261f3d6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:09.917125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a153ab12-636f-4bf4-a79f-7bb7e261f3d6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:09.930398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a153ab12-636f-4bf4-a79f-7bb7e261f3d6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:09.932082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a153ab12-636f-4bf4-a79f-7bb7e261f3d6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:09.932911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a153ab12-636f-4bf4-a79f-7bb7e261f3d6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:09.936389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a153ab12-636f-4bf4-a79f-7bb7e261f3d6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:09.938024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a153ab12-636f-4bf4-a79f-7bb7e261f3d6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:09.938739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a153ab12-636f-4bf4-a79f-7bb7e261f3d6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:10.126067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:35:10.126734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:35:10.127660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:35:10.128176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:35:10.128841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:35:10.166590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:10.171646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:10.177203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:10.178644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:10.179845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:10.180491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:10.230376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Getting quotas for project bbbc9e55a8f24d70a82b79243b0fa9e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:35:10.240442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Getting quotas for user 8dbbadfdb27047dd9237f4a1d311867e and project bbbc9e55a8f24d70a82b79243b0fa9e1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:35:10.267990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:35:10.271029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:35:10.348819 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4c65a52a-399c-440b-8f55-2a7d4245a0d2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141024 Aug 29 15:35:10.350422 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1346/2662] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:35:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:35:10.356326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-31843ecc-9f40-4777-960c-82a3b2a52193 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:10.357079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-31843ecc-9f40-4777-960c-82a3b2a52193 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:10.366836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31843ecc-9f40-4777-960c-82a3b2a52193 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:10.368440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31843ecc-9f40-4777-960c-82a3b2a52193 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:10.369164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31843ecc-9f40-4777-960c-82a3b2a52193 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:10.370262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31843ecc-9f40-4777-960c-82a3b2a52193 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:10.370943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31843ecc-9f40-4777-960c-82a3b2a52193 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:10.371579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31843ecc-9f40-4777-960c-82a3b2a52193 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:10.404935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-31843ecc-9f40-4777-960c-82a3b2a52193 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:10.550615 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-31843ecc-9f40-4777-960c-82a3b2a52193 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 204 len: 0 microversion: 2.1 time: 0.198376 Aug 29 15:35:10.551264 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1347/2663] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:10 2022] DELETE /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:35:10.566974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1ef5c191-9a01-49fc-b81e-52f34de91851 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:10.582435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1ef5c191-9a01-49fc-b81e-52f34de91851 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:10.585281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1ef5c191-9a01-49fc-b81e-52f34de91851 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Searching by: {'deleted': False, 'project_id': 'ab4615dd6897416ca44c89b092e5526d'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:35:10.634771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ef5c191-9a01-49fc-b81e-52f34de91851 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:10.635577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ef5c191-9a01-49fc-b81e-52f34de91851 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:10.638118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ef5c191-9a01-49fc-b81e-52f34de91851 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:10.639172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ef5c191-9a01-49fc-b81e-52f34de91851 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:10.641399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ef5c191-9a01-49fc-b81e-52f34de91851 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:10.642026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ef5c191-9a01-49fc-b81e-52f34de91851 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:10.705981 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1ef5c191-9a01-49fc-b81e-52f34de91851 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.151657 Aug 29 15:35:10.706593 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1348/2664] 10.222.0.62 () {58 vars in 1125 bytes} [Mon Aug 29 15:35:10 2022] GET /compute/v2.1/servers => generated 677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:10.729542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eb4e01ea-6e4c-4388-93a0-d8de6276d63d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:10.730431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eb4e01ea-6e4c-4388-93a0-d8de6276d63d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:10.746716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb4e01ea-6e4c-4388-93a0-d8de6276d63d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:10.747234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb4e01ea-6e4c-4388-93a0-d8de6276d63d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:10.747730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb4e01ea-6e4c-4388-93a0-d8de6276d63d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:10.748452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb4e01ea-6e4c-4388-93a0-d8de6276d63d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:10.748925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb4e01ea-6e4c-4388-93a0-d8de6276d63d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:10.754158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb4e01ea-6e4c-4388-93a0-d8de6276d63d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:10.984763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a153ab12-636f-4bf4-a79f-7bb7e261f3d6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:11.002057 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a153ab12-636f-4bf4-a79f-7bb7e261f3d6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1365 microversion: 2.1 time: 1.096124 Aug 29 15:35:11.003732 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1317/2665] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:09 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1365 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:11.019083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-89147b21-4611-48b8-9f2e-0516982ed2cd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:11.021748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-89147b21-4611-48b8-9f2e-0516982ed2cd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:11.023579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eb4e01ea-6e4c-4388-93a0-d8de6276d63d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:11.032614 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eb4e01ea-6e4c-4388-93a0-d8de6276d63d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1519 microversion: 2.1 time: 0.322052 Aug 29 15:35:11.033330 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1349/2666] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:10 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1519 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:11.046687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89147b21-4611-48b8-9f2e-0516982ed2cd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.046687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89147b21-4611-48b8-9f2e-0516982ed2cd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.046687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89147b21-4611-48b8-9f2e-0516982ed2cd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.046687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89147b21-4611-48b8-9f2e-0516982ed2cd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.046687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89147b21-4611-48b8-9f2e-0516982ed2cd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.048354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89147b21-4611-48b8-9f2e-0516982ed2cd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.060105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3533e794-4cdd-4aba-9d3a-a1d570b04c4b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:11.061674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3533e794-4cdd-4aba-9d3a-a1d570b04c4b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:11.164675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3533e794-4cdd-4aba-9d3a-a1d570b04c4b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:11.176449 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3533e794-4cdd-4aba-9d3a-a1d570b04c4b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1214 microversion: 2.1 time: 0.119597 Aug 29 15:35:11.179373 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1350/2667] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:11 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:11.192048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7d7b81a0-b9e3-430a-afa5-d385e768c71e tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:11.192675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7d7b81a0-b9e3-430a-afa5-d385e768c71e tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:11.210074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d7b81a0-b9e3-430a-afa5-d385e768c71e tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.210567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d7b81a0-b9e3-430a-afa5-d385e768c71e tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.211466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d7b81a0-b9e3-430a-afa5-d385e768c71e tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.212417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d7b81a0-b9e3-430a-afa5-d385e768c71e tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.213127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d7b81a0-b9e3-430a-afa5-d385e768c71e tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.213793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d7b81a0-b9e3-430a-afa5-d385e768c71e tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.443420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7d7b81a0-b9e3-430a-afa5-d385e768c71e tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:11.460416 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7d7b81a0-b9e3-430a-afa5-d385e768c71e tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1664 microversion: 2.1 time: 0.278562 Aug 29 15:35:11.468526 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1351/2668] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:11 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1664 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:11.474217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6834e8d2-a867-4929-a2fb-1d288b717ffe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:11.474837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6834e8d2-a867-4929-a2fb-1d288b717ffe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:11.496778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6834e8d2-a867-4929-a2fb-1d288b717ffe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.497315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6834e8d2-a867-4929-a2fb-1d288b717ffe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.497762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6834e8d2-a867-4929-a2fb-1d288b717ffe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.498468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6834e8d2-a867-4929-a2fb-1d288b717ffe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.498924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6834e8d2-a867-4929-a2fb-1d288b717ffe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.499350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6834e8d2-a867-4929-a2fb-1d288b717ffe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.642478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-89147b21-4611-48b8-9f2e-0516982ed2cd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:11.651352 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-89147b21-4611-48b8-9f2e-0516982ed2cd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1469 microversion: 2.1 time: 0.642811 Aug 29 15:35:11.656744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6834e8d2-a867-4929-a2fb-1d288b717ffe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:11.667078 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6834e8d2-a867-4929-a2fb-1d288b717ffe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1224 microversion: 2.1 time: 0.197282 Aug 29 15:35:11.667921 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1318/2669] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:11 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1469 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:11.682640 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1352/2670] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:11 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1224 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:11.695047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-53dc37b5-6374-47ac-944a-58a02fe4652e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:11.697679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a691774a-a357-4c37-97b5-c88c21d362a2 req-63c8d92c-85f7-4971-9a3d-17ab3e585396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f838765-3a8a-47c2-9907-367ddaf2d90f", "name": "network-vif-plugged", "status": "completed", "tag": "0f30a440-530f-4c46-b4fb-89f0c9814d97"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:11.701182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-53dc37b5-6374-47ac-944a-58a02fe4652e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:11.719358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53dc37b5-6374-47ac-944a-58a02fe4652e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.725532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53dc37b5-6374-47ac-944a-58a02fe4652e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.726398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53dc37b5-6374-47ac-944a-58a02fe4652e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.727373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53dc37b5-6374-47ac-944a-58a02fe4652e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.729417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53dc37b5-6374-47ac-944a-58a02fe4652e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.730087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53dc37b5-6374-47ac-944a-58a02fe4652e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.732909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a691774a-a357-4c37-97b5-c88c21d362a2 req-63c8d92c-85f7-4971-9a3d-17ab3e585396 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.738133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a691774a-a357-4c37-97b5-c88c21d362a2 req-63c8d92c-85f7-4971-9a3d-17ab3e585396 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.738853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a691774a-a357-4c37-97b5-c88c21d362a2 req-63c8d92c-85f7-4971-9a3d-17ab3e585396 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.759974 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a691774a-a357-4c37-97b5-c88c21d362a2 req-63c8d92c-85f7-4971-9a3d-17ab3e585396 service nova] Creating event network-vif-plugged:0f30a440-530f-4c46-b4fb-89f0c9814d97 for instance 0f838765-3a8a-47c2-9907-367ddaf2d90f on n-h1-839401-11 Aug 29 15:35:11.761401 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-53dc37b5-6374-47ac-944a-58a02fe4652e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] HTTP exception thrown: Instance 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 could not be found. Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-53dc37b5-6374-47ac-944a-58a02fe4652e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Request method failure captured: Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 HTTP/1.1 Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNqyZh8cI-S3BYoWeV3ZIfZCv7DYX3-5WfzhenLF0YzuUQMBghE0z6ME5UmGWOt4xbbbGLqBULo6GaH6pRRu9-2b_A1IVr9F7L4OLv0EFzrIZPENt1NXLQB8NULNfiQZCm1XXw040O0zJ6baE9-jONzixjWhGU8m6PJ9mS52C-B9D-A Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 31544ac2992c46aa8fecdff53a43ae42 Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-LiveMigrationTest-445924921 Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31544ac2992c46aa8fecdff53a43ae42", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31544ac2992c46aa8fecdff53a43ae42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31544ac2992c46aa8fecdff53a43ae42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31544ac2992c46aa8fecdff53a43ae42"}]}] Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-LiveMigrationTest-445924921 Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 31544ac2992c46aa8fecdff53a43ae42 Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-LiveMigrationTest-445924921 Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-LiveMigrationTest-445924921-project Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 498e44c8a15f451ba8ff39eff4156075 Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-LiveMigrationTest-445924921-project Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 could not be found. Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8'} Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 could not be found. Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 could not be found. Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:11.763296 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:11.766896 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:11.766896 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:11.766896 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:11.766896 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:11.766896 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:11.766896 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 could not be found. Aug 29 15:35:11.766896 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:11.772435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-53dc37b5-6374-47ac-944a-58a02fe4652e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Returning 404 to user: Instance 8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:11.773680 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-53dc37b5-6374-47ac-944a-58a02fe4652e tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8" status: 404 len: 111 microversion: 2.1 time: 0.102260 Aug 29 15:35:11.774467 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1319/2671] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:11 2022] GET /compute/v2.1/servers/8ebac1a7-2a4f-40b4-91dc-b9afdacf1eb8 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:11.797664 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a691774a-a357-4c37-97b5-c88c21d362a2 req-63c8d92c-85f7-4971-9a3d-17ab3e585396 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113089 Aug 29 15:35:11.806953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:11.808312 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1353/2672] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:11.809183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:11.819899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.820616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.821329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.822295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.824364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.825674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.911852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.915558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.925826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:11.927204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:11.927897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:11.930271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:12.024837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-359a9310-fdba-44b7-93d6-9ff2b0418d28 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:12.025935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-359a9310-fdba-44b7-93d6-9ff2b0418d28 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:12.030036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Getting quotas for project cac390dda11d4f38983e1478de0dbde1. Resources: {'ram', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:35:12.036932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-359a9310-fdba-44b7-93d6-9ff2b0418d28 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.042481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-359a9310-fdba-44b7-93d6-9ff2b0418d28 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.043267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-359a9310-fdba-44b7-93d6-9ff2b0418d28 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:12.044222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-359a9310-fdba-44b7-93d6-9ff2b0418d28 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.046099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-359a9310-fdba-44b7-93d6-9ff2b0418d28 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.047285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Getting quotas for user e57b95d059f74c7a894903b5a8f933df and project cac390dda11d4f38983e1478de0dbde1. Resources: {'ram', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:35:12.047945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-359a9310-fdba-44b7-93d6-9ff2b0418d28 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:12.344625 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f4f1cb1f-0019-4d66-b896-9fea118dc630 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "POST /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27/action" status: 202 len: 0 microversion: 2.1 time: 0.568663 Aug 29 15:35:12.351261 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1320/2673] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:35:11 2022] POST /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:35:12.373200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2edca302-85e0-42cf-9ae1-8392ff78ee91 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:12.378581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2edca302-85e0-42cf-9ae1-8392ff78ee91 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:12.403347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2edca302-85e0-42cf-9ae1-8392ff78ee91 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.403846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2edca302-85e0-42cf-9ae1-8392ff78ee91 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.409096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2edca302-85e0-42cf-9ae1-8392ff78ee91 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:12.409909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2edca302-85e0-42cf-9ae1-8392ff78ee91 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.410394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2edca302-85e0-42cf-9ae1-8392ff78ee91 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.410832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2edca302-85e0-42cf-9ae1-8392ff78ee91 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:12.715168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2edca302-85e0-42cf-9ae1-8392ff78ee91 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:12.724214 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2edca302-85e0-42cf-9ae1-8392ff78ee91 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1519 microversion: 2.1 time: 0.371664 Aug 29 15:35:12.726843 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1321/2674] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:12 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1519 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:12.743286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9c4a0348-cd3b-49da-924f-06603139d6a0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:12.743911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9c4a0348-cd3b-49da-924f-06603139d6a0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:12.750886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c4a0348-cd3b-49da-924f-06603139d6a0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.751457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c4a0348-cd3b-49da-924f-06603139d6a0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.751902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c4a0348-cd3b-49da-924f-06603139d6a0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:12.752614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c4a0348-cd3b-49da-924f-06603139d6a0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.753195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c4a0348-cd3b-49da-924f-06603139d6a0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.753709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c4a0348-cd3b-49da-924f-06603139d6a0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:12.821530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9c4a0348-cd3b-49da-924f-06603139d6a0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:12.826068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-359a9310-fdba-44b7-93d6-9ff2b0418d28 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:12.855433 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9c4a0348-cd3b-49da-924f-06603139d6a0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1266 microversion: 2.1 time: 0.127053 Aug 29 15:35:12.872050 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-359a9310-fdba-44b7-93d6-9ff2b0418d28 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1365 microversion: 2.1 time: 0.851800 Aug 29 15:35:12.875515 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1354/2675] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:12 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1365 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:12.879752 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1322/2676] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:12 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:12.886089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-95ef1666-6c88-4512-aa74-2e4c641f5f72 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:12.886704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-95ef1666-6c88-4512-aa74-2e4c641f5f72 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:12.892770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-39148b89-4d73-46a8-b6b9-6692c5eb4a2e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:12.893438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-39148b89-4d73-46a8-b6b9-6692c5eb4a2e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:12.907349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39148b89-4d73-46a8-b6b9-6692c5eb4a2e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.907851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39148b89-4d73-46a8-b6b9-6692c5eb4a2e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.908294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39148b89-4d73-46a8-b6b9-6692c5eb4a2e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:12.909009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39148b89-4d73-46a8-b6b9-6692c5eb4a2e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.909497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39148b89-4d73-46a8-b6b9-6692c5eb4a2e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.911657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95ef1666-6c88-4512-aa74-2e4c641f5f72 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.912147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95ef1666-6c88-4512-aa74-2e4c641f5f72 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.912577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95ef1666-6c88-4512-aa74-2e4c641f5f72 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:12.913312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95ef1666-6c88-4512-aa74-2e4c641f5f72 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:12.913768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95ef1666-6c88-4512-aa74-2e4c641f5f72 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:12.914214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95ef1666-6c88-4512-aa74-2e4c641f5f72 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:12.914744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39148b89-4d73-46a8-b6b9-6692c5eb4a2e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:13.161273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-95ef1666-6c88-4512-aa74-2e4c641f5f72 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:13.172515 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-95ef1666-6c88-4512-aa74-2e4c641f5f72 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1664 microversion: 2.1 time: 0.291317 Aug 29 15:35:13.173680 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1323/2677] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:12 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1664 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:13.178487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-701e6d1c-b995-40c3-97e4-5fee311a76cd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:13.179294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-701e6d1c-b995-40c3-97e4-5fee311a76cd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:13.197227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:13.198922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-701e6d1c-b995-40c3-97e4-5fee311a76cd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:13.199580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-701e6d1c-b995-40c3-97e4-5fee311a76cd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:13.200027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-701e6d1c-b995-40c3-97e4-5fee311a76cd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:13.203001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-701e6d1c-b995-40c3-97e4-5fee311a76cd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:13.203481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-701e6d1c-b995-40c3-97e4-5fee311a76cd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:13.205651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-701e6d1c-b995-40c3-97e4-5fee311a76cd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:13.391825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-39148b89-4d73-46a8-b6b9-6692c5eb4a2e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:13.403917 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-39148b89-4d73-46a8-b6b9-6692c5eb4a2e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1468 microversion: 2.1 time: 0.527223 Aug 29 15:35:13.404524 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1355/2678] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:12 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1468 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:13.467888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-701e6d1c-b995-40c3-97e4-5fee311a76cd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:13.482822 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-701e6d1c-b995-40c3-97e4-5fee311a76cd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1272 microversion: 2.1 time: 0.307876 Aug 29 15:35:13.483412 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1324/2679] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:13 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1272 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:13.749545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-35c02dda-e810-4106-a262-e6a4772d42b8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:13.750173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-35c02dda-e810-4106-a262-e6a4772d42b8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:13.775541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35c02dda-e810-4106-a262-e6a4772d42b8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:13.776050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35c02dda-e810-4106-a262-e6a4772d42b8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:13.776814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35c02dda-e810-4106-a262-e6a4772d42b8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:13.785015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35c02dda-e810-4106-a262-e6a4772d42b8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:13.790849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35c02dda-e810-4106-a262-e6a4772d42b8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:13.791308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35c02dda-e810-4106-a262-e6a4772d42b8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:13.876798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4fbdc169-a777-4db8-84a1-59a642835796 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:13.877443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4fbdc169-a777-4db8-84a1-59a642835796 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:13.904567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fbdc169-a777-4db8-84a1-59a642835796 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:13.912421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fbdc169-a777-4db8-84a1-59a642835796 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:13.912985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fbdc169-a777-4db8-84a1-59a642835796 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:13.925580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fbdc169-a777-4db8-84a1-59a642835796 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:13.926172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fbdc169-a777-4db8-84a1-59a642835796 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:13.926622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fbdc169-a777-4db8-84a1-59a642835796 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:14.102245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4fbdc169-a777-4db8-84a1-59a642835796 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:14.115055 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4fbdc169-a777-4db8-84a1-59a642835796 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1266 microversion: 2.1 time: 0.242827 Aug 29 15:35:14.115939 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1325/2680] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:13 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:14.146486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a1329133-9e45-460b-945b-6e0c7a39c66f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:14.150809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a1329133-9e45-460b-945b-6e0c7a39c66f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:14.167016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1329133-9e45-460b-945b-6e0c7a39c66f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:14.170548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1329133-9e45-460b-945b-6e0c7a39c66f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:14.171444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1329133-9e45-460b-945b-6e0c7a39c66f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:14.172594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1329133-9e45-460b-945b-6e0c7a39c66f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:14.173565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1329133-9e45-460b-945b-6e0c7a39c66f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:14.181472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1329133-9e45-460b-945b-6e0c7a39c66f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:15.810060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-35c02dda-e810-4106-a262-e6a4772d42b8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:15.819287 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-35c02dda-e810-4106-a262-e6a4772d42b8 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1519 microversion: 2.1 time: 2.076016 Aug 29 15:35:15.820484 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1356/2681] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:13 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1519 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:15.825617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c6b49401-db38-4711-a969-f5e42edae3aa tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:15.826433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c6b49401-db38-4711-a969-f5e42edae3aa tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:15.838536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6b49401-db38-4711-a969-f5e42edae3aa tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:15.841409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6b49401-db38-4711-a969-f5e42edae3aa tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:15.841919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6b49401-db38-4711-a969-f5e42edae3aa tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:15.842684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6b49401-db38-4711-a969-f5e42edae3aa tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:15.843161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6b49401-db38-4711-a969-f5e42edae3aa tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:15.843595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6b49401-db38-4711-a969-f5e42edae3aa tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:16.239816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c6b49401-db38-4711-a969-f5e42edae3aa tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:16.247050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:16.249775 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c6b49401-db38-4711-a969-f5e42edae3aa tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1596 microversion: 2.1 time: 0.428089 Aug 29 15:35:16.255222 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1357/2682] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:15 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1596 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:16.265075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ae0bd7b3-c208-4534-a85d-75d548246fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:16.266132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ae0bd7b3-c208-4534-a85d-75d548246fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:16.273618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae0bd7b3-c208-4534-a85d-75d548246fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:16.274502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae0bd7b3-c208-4534-a85d-75d548246fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:16.275148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae0bd7b3-c208-4534-a85d-75d548246fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:16.276078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae0bd7b3-c208-4534-a85d-75d548246fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:16.277048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae0bd7b3-c208-4534-a85d-75d548246fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:16.277705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae0bd7b3-c208-4534-a85d-75d548246fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:16.451833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a1329133-9e45-460b-945b-6e0c7a39c66f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:16.476519 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a1329133-9e45-460b-945b-6e0c7a39c66f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1551 microversion: 2.1 time: 2.338803 Aug 29 15:35:16.480149 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1326/2683] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:14 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1551 bytes in 2350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:16.492639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-951ca6c4-f279-44b8-820c-11001c0420b6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:16.497060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-951ca6c4-f279-44b8-820c-11001c0420b6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:16.520155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-951ca6c4-f279-44b8-820c-11001c0420b6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:16.522125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-951ca6c4-f279-44b8-820c-11001c0420b6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:16.523270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-951ca6c4-f279-44b8-820c-11001c0420b6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:16.527741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-951ca6c4-f279-44b8-820c-11001c0420b6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:16.529291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-951ca6c4-f279-44b8-820c-11001c0420b6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:16.530260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-951ca6c4-f279-44b8-820c-11001c0420b6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:16.992050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-951ca6c4-f279-44b8-820c-11001c0420b6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:17.005675 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-951ca6c4-f279-44b8-820c-11001c0420b6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1278 microversion: 2.1 time: 0.520675 Aug 29 15:35:17.009485 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1327/2684] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:16 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1278 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:17.036472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-c98d82f8-f2de-49ed-9749-50d2bbd622fa req-3a10d795-7fcb-4687-acb1-240b5fdadda8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74984943-d6e3-4b74-b251-f05fff364c27", "name": "network-vif-plugged", "status": "completed", "tag": "f5fdbe76-975e-466c-9d17-812c0ec39457"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:17.064840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c98d82f8-f2de-49ed-9749-50d2bbd622fa req-3a10d795-7fcb-4687-acb1-240b5fdadda8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.065579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c98d82f8-f2de-49ed-9749-50d2bbd622fa req-3a10d795-7fcb-4687-acb1-240b5fdadda8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.066425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c98d82f8-f2de-49ed-9749-50d2bbd622fa req-3a10d795-7fcb-4687-acb1-240b5fdadda8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.091725 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-c98d82f8-f2de-49ed-9749-50d2bbd622fa req-3a10d795-7fcb-4687-acb1-240b5fdadda8 service nova] Creating event network-vif-plugged:f5fdbe76-975e-466c-9d17-812c0ec39457 for instance 74984943-d6e3-4b74-b251-f05fff364c27 on n-h2-839401-11 Aug 29 15:35:17.108844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-c98d82f8-f2de-49ed-9749-50d2bbd622fa req-3a10d795-7fcb-4687-acb1-240b5fdadda8 service nova] Instance 74984943-d6e3-4b74-b251-f05fff364c27 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:35:17.116337 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-c98d82f8-f2de-49ed-9749-50d2bbd622fa req-3a10d795-7fcb-4687-acb1-240b5fdadda8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104478 Aug 29 15:35:17.130621 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1328/2685] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:17.136680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2a03404a-1c59-400c-a9ea-ab98d968df72 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:17.137676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2a03404a-1c59-400c-a9ea-ab98d968df72 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:17.153434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a03404a-1c59-400c-a9ea-ab98d968df72 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.155892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a03404a-1c59-400c-a9ea-ab98d968df72 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.156547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a03404a-1c59-400c-a9ea-ab98d968df72 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.158080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a03404a-1c59-400c-a9ea-ab98d968df72 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.158925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a03404a-1c59-400c-a9ea-ab98d968df72 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.159561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a03404a-1c59-400c-a9ea-ab98d968df72 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.457154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2a03404a-1c59-400c-a9ea-ab98d968df72 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:17.466902 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2a03404a-1c59-400c-a9ea-ab98d968df72 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1272 microversion: 2.1 time: 0.334469 Aug 29 15:35:17.469787 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1329/2686] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:17 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1272 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:17.481267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f4d751c9-6b4b-44cc-bf31-6865c8af9fa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:17.482714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f4d751c9-6b4b-44cc-bf31-6865c8af9fa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:17.501062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4d751c9-6b4b-44cc-bf31-6865c8af9fa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.515934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4d751c9-6b4b-44cc-bf31-6865c8af9fa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.525426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4d751c9-6b4b-44cc-bf31-6865c8af9fa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.526829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4d751c9-6b4b-44cc-bf31-6865c8af9fa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.527998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4d751c9-6b4b-44cc-bf31-6865c8af9fa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.533152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4d751c9-6b4b-44cc-bf31-6865c8af9fa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.542638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:17.646054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ae0bd7b3-c208-4534-a85d-75d548246fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:17.664004 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ae0bd7b3-c208-4534-a85d-75d548246fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1468 microversion: 2.1 time: 1.403521 Aug 29 15:35:17.666099 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1358/2687] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:16 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1468 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:17.685612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1fddc1da-785a-46b8-b247-6db38085ef8c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:17.688920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1fddc1da-785a-46b8-b247-6db38085ef8c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:17.708110 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f4d751c9-6b4b-44cc-bf31-6865c8af9fa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.236041 Aug 29 15:35:17.709402 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1330/2688] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:35:17 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/os-interface => generated 284 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:17.712257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fddc1da-785a-46b8-b247-6db38085ef8c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.713216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fddc1da-785a-46b8-b247-6db38085ef8c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.714504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fddc1da-785a-46b8-b247-6db38085ef8c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.716149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7e53cf18-4b61-439b-a54b-d54ee0b43532 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:17.716925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7e53cf18-4b61-439b-a54b-d54ee0b43532 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:17.717698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fddc1da-785a-46b8-b247-6db38085ef8c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.719189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fddc1da-785a-46b8-b247-6db38085ef8c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.721746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1fddc1da-785a-46b8-b247-6db38085ef8c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.734599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e53cf18-4b61-439b-a54b-d54ee0b43532 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.737388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e53cf18-4b61-439b-a54b-d54ee0b43532 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.738705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e53cf18-4b61-439b-a54b-d54ee0b43532 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:17.744545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e53cf18-4b61-439b-a54b-d54ee0b43532 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:17.745171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e53cf18-4b61-439b-a54b-d54ee0b43532 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:17.745768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e53cf18-4b61-439b-a54b-d54ee0b43532 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:18.438935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7e53cf18-4b61-439b-a54b-d54ee0b43532 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0d7efc0874edd84d5ae2508f926f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4b87127094af08ec1bed30151e67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:18.447843 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7e53cf18-4b61-439b-a54b-d54ee0b43532 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 200 len: 1596 microversion: 2.1 time: 0.737170 Aug 29 15:35:18.449036 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1331/2689] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:17 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 1596 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:18.464491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0808dbc4-fa93-46bb-9eba-3f3191468089 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:18.474474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0808dbc4-fa93-46bb-9eba-3f3191468089 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:18.482972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0808dbc4-fa93-46bb-9eba-3f3191468089 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:18.485945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0808dbc4-fa93-46bb-9eba-3f3191468089 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:18.486578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0808dbc4-fa93-46bb-9eba-3f3191468089 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:18.493197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0808dbc4-fa93-46bb-9eba-3f3191468089 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:18.493913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0808dbc4-fa93-46bb-9eba-3f3191468089 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:18.494558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0808dbc4-fa93-46bb-9eba-3f3191468089 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:18.573802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0808dbc4-fa93-46bb-9eba-3f3191468089 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:18.772625 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0808dbc4-fa93-46bb-9eba-3f3191468089 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "DELETE /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 204 len: 0 microversion: 2.1 time: 0.322115 Aug 29 15:35:18.777510 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1332/2690] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:18 2022] DELETE /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:35:18.787107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b120ad50-0a28-4565-a20c-cbf5095e619f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:18.795864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b120ad50-0a28-4565-a20c-cbf5095e619f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:18.802679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b120ad50-0a28-4565-a20c-cbf5095e619f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:18.807244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b120ad50-0a28-4565-a20c-cbf5095e619f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:18.808071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b120ad50-0a28-4565-a20c-cbf5095e619f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:18.809038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b120ad50-0a28-4565-a20c-cbf5095e619f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:18.811191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b120ad50-0a28-4565-a20c-cbf5095e619f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:18.813402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b120ad50-0a28-4565-a20c-cbf5095e619f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:19.215007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b120ad50-0a28-4565-a20c-cbf5095e619f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:19.228652 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b120ad50-0a28-4565-a20c-cbf5095e619f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1320 microversion: 2.1 time: 0.445581 Aug 29 15:35:19.229713 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1333/2691] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:18 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1320 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:19.424369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:19.529039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-a5349679-3a75-4146-b43b-7bfbf7293ee2 req-f3671be3-8157-4516-a30b-9802ade9931f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6135fb3a-980d-4e8a-ad76-4908f4f53a0a", "name": "network-vif-deleted", "tag": "c70a93be-38b6-4ac7-89fb-2c06e79c39b9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:19.542573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a5349679-3a75-4146-b43b-7bfbf7293ee2 req-f3671be3-8157-4516-a30b-9802ade9931f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:19.543348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a5349679-3a75-4146-b43b-7bfbf7293ee2 req-f3671be3-8157-4516-a30b-9802ade9931f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:19.544160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a5349679-3a75-4146-b43b-7bfbf7293ee2 req-f3671be3-8157-4516-a30b-9802ade9931f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:19.565033 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-a5349679-3a75-4146-b43b-7bfbf7293ee2 req-f3671be3-8157-4516-a30b-9802ade9931f service nova] Creating event network-vif-deleted:c70a93be-38b6-4ac7-89fb-2c06e79c39b9 for instance 6135fb3a-980d-4e8a-ad76-4908f4f53a0a on n-h2-839401-11 Aug 29 15:35:19.574345 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-a5349679-3a75-4146-b43b-7bfbf7293ee2 req-f3671be3-8157-4516-a30b-9802ade9931f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.343006 Aug 29 15:35:19.575629 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1334/2692] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:19.581626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6b99c677-c9e3-432e-a864-52014c052328 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:19.582646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6b99c677-c9e3-432e-a864-52014c052328 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:19.589686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b99c677-c9e3-432e-a864-52014c052328 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:19.590460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b99c677-c9e3-432e-a864-52014c052328 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:19.591190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b99c677-c9e3-432e-a864-52014c052328 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:19.592052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b99c677-c9e3-432e-a864-52014c052328 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:19.592656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b99c677-c9e3-432e-a864-52014c052328 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:19.594444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b99c677-c9e3-432e-a864-52014c052328 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:19.903225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1fddc1da-785a-46b8-b247-6db38085ef8c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:19.916308 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1fddc1da-785a-46b8-b247-6db38085ef8c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1504 microversion: 2.1 time: 2.246798 Aug 29 15:35:19.916929 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1359/2693] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:17 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1504 bytes in 2250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:19.955068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9e719bdb-b8d7-40ec-90f8-0e32ff073a9b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:19.959013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9e719bdb-b8d7-40ec-90f8-0e32ff073a9b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:19.972232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e719bdb-b8d7-40ec-90f8-0e32ff073a9b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:19.974308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e719bdb-b8d7-40ec-90f8-0e32ff073a9b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:19.975105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e719bdb-b8d7-40ec-90f8-0e32ff073a9b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:19.979988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e719bdb-b8d7-40ec-90f8-0e32ff073a9b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:19.980711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e719bdb-b8d7-40ec-90f8-0e32ff073a9b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:19.981450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e719bdb-b8d7-40ec-90f8-0e32ff073a9b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:19.993547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6b99c677-c9e3-432e-a864-52014c052328 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:20.010064 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6b99c677-c9e3-432e-a864-52014c052328 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1314 microversion: 2.1 time: 0.431818 Aug 29 15:35:20.024721 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1335/2694] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:19 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:20.035668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ece407c8-c634-404d-bf1e-8336f9bd9e89 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:20.038295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ece407c8-c634-404d-bf1e-8336f9bd9e89 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:20.077839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ece407c8-c634-404d-bf1e-8336f9bd9e89 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.078648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ece407c8-c634-404d-bf1e-8336f9bd9e89 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.079605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ece407c8-c634-404d-bf1e-8336f9bd9e89 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.080730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ece407c8-c634-404d-bf1e-8336f9bd9e89 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.081882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ece407c8-c634-404d-bf1e-8336f9bd9e89 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.083138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ece407c8-c634-404d-bf1e-8336f9bd9e89 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.503807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ece407c8-c634-404d-bf1e-8336f9bd9e89 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:20.514893 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ece407c8-c634-404d-bf1e-8336f9bd9e89 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1666 microversion: 2.1 time: 0.488650 Aug 29 15:35:20.530207 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1336/2695] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:20 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1666 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:20.535576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-34b853cb-f810-4192-87a8-a13e4fb1160d tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:20.536200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-34b853cb-f810-4192-87a8-a13e4fb1160d tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] [instance: 6135fb3a-980d-4e8a-ad76-4908f4f53a0a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:20.542812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b853cb-f810-4192-87a8-a13e4fb1160d tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.543512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b853cb-f810-4192-87a8-a13e4fb1160d tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.544247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b853cb-f810-4192-87a8-a13e4fb1160d tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.545114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b853cb-f810-4192-87a8-a13e4fb1160d tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.545743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b853cb-f810-4192-87a8-a13e4fb1160d tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.546325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b853cb-f810-4192-87a8-a13e4fb1160d tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.561991 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-34b853cb-f810-4192-87a8-a13e4fb1160d tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] HTTP exception thrown: Instance 6135fb3a-980d-4e8a-ad76-4908f4f53a0a could not be found. Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-34b853cb-f810-4192-87a8-a13e4fb1160d tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Request method failure captured: Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a HTTP/1.1 Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNwwGeBAbIiSqQIOytKb4OZx2H2SWiyGmMxNywE2R5K-58qITq2W6JJGHCsVM6N0ZX8duJK55scF2ZLse9Mztf2rE29QDIK2nEr4ADLyoQaFrILKA1BZVwII4Gb7KVkUQxQX0_MMry5EVy1pfb8rQGgav23ycLmjjkNQ3J9l_eE_5VA Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 30f4b87127094af08ec1bed30151e67c Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersTestFqdnHostnames-771527614 Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_30f4b87127094af08ec1bed30151e67c", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/30f4b87127094af08ec1bed30151e67c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/30f4b87127094af08ec1bed30151e67c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/30f4b87127094af08ec1bed30151e67c"}]}] Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersTestFqdnHostnames-771527614 Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 30f4b87127094af08ec1bed30151e67c Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-771527614 Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersTestFqdnHostnames-771527614-project Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: fec0d7efc0874edd84d5ae2508f926f4 Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersTestFqdnHostnames-771527614-project Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 6135fb3a-980d-4e8a-ad76-4908f4f53a0a could not be found. Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '6135fb3a-980d-4e8a-ad76-4908f4f53a0a'} Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6135fb3a-980d-4e8a-ad76-4908f4f53a0a could not be found. Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6135fb3a-980d-4e8a-ad76-4908f4f53a0a could not be found. Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:20.563670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:20.568892 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:20.568892 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:20.568892 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:20.568892 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:20.568892 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:20.568892 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6135fb3a-980d-4e8a-ad76-4908f4f53a0a could not be found. Aug 29 15:35:20.568892 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:20.568892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-34b853cb-f810-4192-87a8-a13e4fb1160d tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Returning 404 to user: Instance 6135fb3a-980d-4e8a-ad76-4908f4f53a0a could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:20.568892 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-34b853cb-f810-4192-87a8-a13e4fb1160d tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a" status: 404 len: 111 microversion: 2.1 time: 0.034096 Aug 29 15:35:20.569543 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1337/2696] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:20 2022] GET /compute/v2.1/servers/6135fb3a-980d-4e8a-ad76-4908f4f53a0a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:20.574598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-86720944-27b6-44dd-bcef-75365cd91719 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:20.575194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-86720944-27b6-44dd-bcef-75365cd91719 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:20.583274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86720944-27b6-44dd-bcef-75365cd91719 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.584060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86720944-27b6-44dd-bcef-75365cd91719 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.584635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86720944-27b6-44dd-bcef-75365cd91719 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.585575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86720944-27b6-44dd-bcef-75365cd91719 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.586179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86720944-27b6-44dd-bcef-75365cd91719 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.586752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86720944-27b6-44dd-bcef-75365cd91719 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.631512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e719bdb-b8d7-40ec-90f8-0e32ff073a9b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:20.640462 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9e719bdb-b8d7-40ec-90f8-0e32ff073a9b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1468 microversion: 2.1 time: 0.708076 Aug 29 15:35:20.641038 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1360/2697] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:19 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1468 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:20.645805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8e755ce9-c8a7-4bca-83df-9accf12eca53 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:20.646732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8e755ce9-c8a7-4bca-83df-9accf12eca53 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:20.653448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e755ce9-c8a7-4bca-83df-9accf12eca53 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.654114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e755ce9-c8a7-4bca-83df-9accf12eca53 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.654720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e755ce9-c8a7-4bca-83df-9accf12eca53 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.655567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e755ce9-c8a7-4bca-83df-9accf12eca53 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.656165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e755ce9-c8a7-4bca-83df-9accf12eca53 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.656730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e755ce9-c8a7-4bca-83df-9accf12eca53 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.657357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:20.910481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-86720944-27b6-44dd-bcef-75365cd91719 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:20.920192 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-86720944-27b6-44dd-bcef-75365cd91719 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 200 len: 1504 microversion: 2.1 time: 0.349288 Aug 29 15:35:20.921230 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1338/2698] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:20 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 1504 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:20.927409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6680c5d1-e27b-432f-a74b-cb8fa7e5d888 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] Calling method '.version_select at 0x7fc42a9ee700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:20.956605 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6680c5d1-e27b-432f-a74b-cb8fa7e5d888 tempest-ServersTestFqdnHostnames-771527614 tempest-ServersTestFqdnHostnames-771527614-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-217128555" status: 202 len: 0 microversion: 2.1 time: 0.033679 Aug 29 15:35:20.957482 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1339/2699] 10.222.0.62 () {58 vars in 1218 bytes} [Mon Aug 29 15:35:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-217128555 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:35:20.965986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d7dd8873-5542-47c4-868b-669320c85602 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:20.966474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d7dd8873-5542-47c4-868b-669320c85602 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:20.974138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7dd8873-5542-47c4-868b-669320c85602 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.974900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7dd8873-5542-47c4-868b-669320c85602 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.975617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7dd8873-5542-47c4-868b-669320c85602 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:20.976486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7dd8873-5542-47c4-868b-669320c85602 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:20.977076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7dd8873-5542-47c4-868b-669320c85602 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:20.977678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7dd8873-5542-47c4-868b-669320c85602 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:21.175235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:21.191237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8e755ce9-c8a7-4bca-83df-9accf12eca53 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:21.208416 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8e755ce9-c8a7-4bca-83df-9accf12eca53 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1320 microversion: 2.1 time: 0.566091 Aug 29 15:35:21.210113 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1361/2700] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:20 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1320 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:21.223362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c7aae72a-44a2-42b9-9157-c6640290631f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:21.224691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c7aae72a-44a2-42b9-9157-c6640290631f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:21.242018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7aae72a-44a2-42b9-9157-c6640290631f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:21.242522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7aae72a-44a2-42b9-9157-c6640290631f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:21.242965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7aae72a-44a2-42b9-9157-c6640290631f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:21.243787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7aae72a-44a2-42b9-9157-c6640290631f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:21.244406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7aae72a-44a2-42b9-9157-c6640290631f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:21.244973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7aae72a-44a2-42b9-9157-c6640290631f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:21.485453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d7dd8873-5542-47c4-868b-669320c85602 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:21.621981 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d7dd8873-5542-47c4-868b-669320c85602 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 204 len: 0 microversion: 2.1 time: 0.659215 Aug 29 15:35:21.624947 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1340/2701] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:20 2022] DELETE /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 0 bytes in 663 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:35:21.633153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b47170a9-800f-4885-a5cb-c993faaeb58c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:21.634501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b47170a9-800f-4885-a5cb-c993faaeb58c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:21.647363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b47170a9-800f-4885-a5cb-c993faaeb58c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:21.648203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b47170a9-800f-4885-a5cb-c993faaeb58c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:21.648907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b47170a9-800f-4885-a5cb-c993faaeb58c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:21.649859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b47170a9-800f-4885-a5cb-c993faaeb58c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:21.657973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b47170a9-800f-4885-a5cb-c993faaeb58c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:21.659134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b47170a9-800f-4885-a5cb-c993faaeb58c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:21.941368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c7aae72a-44a2-42b9-9157-c6640290631f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:21.951108 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c7aae72a-44a2-42b9-9157-c6640290631f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1314 microversion: 2.1 time: 0.739732 Aug 29 15:35:21.967780 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1362/2702] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:21 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:21.974471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7ffa17d4-b302-44cf-a391-6d018a9c756c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:21.975471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7ffa17d4-b302-44cf-a391-6d018a9c756c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:21.983727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ffa17d4-b302-44cf-a391-6d018a9c756c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:21.984916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ffa17d4-b302-44cf-a391-6d018a9c756c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:21.985627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ffa17d4-b302-44cf-a391-6d018a9c756c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:21.991139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=5 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:21.996061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ffa17d4-b302-44cf-a391-6d018a9c756c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:21.998691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ffa17d4-b302-44cf-a391-6d018a9c756c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:21.999446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ffa17d4-b302-44cf-a391-6d018a9c756c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:22.164914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b47170a9-800f-4885-a5cb-c993faaeb58c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:22.195303 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b47170a9-800f-4885-a5cb-c993faaeb58c tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 200 len: 1599 microversion: 2.1 time: 0.567034 Aug 29 15:35:22.198280 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1341/2703] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:21 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 1599 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:22.225103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1405649856", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "f1b63681-5595-428b-8a23-15bbfd2c0bdc"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:22.318196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] validate_networks() for [('f1b63681-5595-428b-8a23-15bbfd2c0bdc', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:35:23.254750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7ffa17d4-b302-44cf-a391-6d018a9c756c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:23.266488 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7ffa17d4-b302-44cf-a391-6d018a9c756c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1534 microversion: 2.1 time: 1.296643 Aug 29 15:35:23.270657 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1363/2704] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:21 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1534 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:23.291170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e9ca9577-6166-4abc-b188-0612518b8bdf req-b7620534-a8d3-4fac-bb4b-7ae8e7bf354c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4195b2a3-e1ec-408b-95dc-5ac81dc095e5", "tag": "2ad06ede-9024-40d5-85e9-a67bfc4eee98"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:23.327868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e9ca9577-6166-4abc-b188-0612518b8bdf req-b7620534-a8d3-4fac-bb4b-7ae8e7bf354c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:23.329274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e9ca9577-6166-4abc-b188-0612518b8bdf req-b7620534-a8d3-4fac-bb4b-7ae8e7bf354c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:23.330220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e9ca9577-6166-4abc-b188-0612518b8bdf req-b7620534-a8d3-4fac-bb4b-7ae8e7bf354c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:23.389897 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e9ca9577-6166-4abc-b188-0612518b8bdf req-b7620534-a8d3-4fac-bb4b-7ae8e7bf354c service nova] Creating event network-changed:2ad06ede-9024-40d5-85e9-a67bfc4eee98 for instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 on n-h1-839401-11 Aug 29 15:35:23.400578 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e9ca9577-6166-4abc-b188-0612518b8bdf req-b7620534-a8d3-4fac-bb4b-7ae8e7bf354c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128406 Aug 29 15:35:23.404743 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1364/2705] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:23.416151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-af4ff291-be80-40bd-abfb-c4052f699607 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:23.420163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-af4ff291-be80-40bd-abfb-c4052f699607 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:23.438182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af4ff291-be80-40bd-abfb-c4052f699607 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:23.442216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af4ff291-be80-40bd-abfb-c4052f699607 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:23.443512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af4ff291-be80-40bd-abfb-c4052f699607 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:23.445275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af4ff291-be80-40bd-abfb-c4052f699607 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:23.448438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af4ff291-be80-40bd-abfb-c4052f699607 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:23.450015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af4ff291-be80-40bd-abfb-c4052f699607 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:23.746901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:35:23.747973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:35:23.748447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:35:23.749203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:35:23.750191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:35:23.764572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:23.770019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:23.770710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:23.771641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:23.772104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:23.772529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:23.823998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Getting quotas for project e9bb92cd24774733bc0f5054a240cd28. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:35:23.849119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Getting quotas for user 0f9814ba6cea472c8759e8f3bf67c734 and project e9bb92cd24774733bc0f5054a240cd28. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:35:23.865409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:35:23.868347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:35:23.934014 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-785255a3-c50f-4acd-9381-5a29819bef73 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.734380 Aug 29 15:35:23.940580 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1342/2706] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:35:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:35:23.942353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b716ca4f-4cf8-469f-a0bb-62ed1d374309 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:23.943035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b716ca4f-4cf8-469f-a0bb-62ed1d374309 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:23.951150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b716ca4f-4cf8-469f-a0bb-62ed1d374309 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:23.951648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b716ca4f-4cf8-469f-a0bb-62ed1d374309 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:23.952091 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b716ca4f-4cf8-469f-a0bb-62ed1d374309 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:23.952818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b716ca4f-4cf8-469f-a0bb-62ed1d374309 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:23.953844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b716ca4f-4cf8-469f-a0bb-62ed1d374309 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:23.954514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b716ca4f-4cf8-469f-a0bb-62ed1d374309 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:24.091534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-af4ff291-be80-40bd-abfb-c4052f699607 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:24.105963 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-af4ff291-be80-40bd-abfb-c4052f699607 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1320 microversion: 2.1 time: 0.696527 Aug 29 15:35:24.108662 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1365/2707] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:23 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1320 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:24.122742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-27288656-9d59-4c5f-9ae0-0a8dbbdc0abd req-ae6763bb-c789-4acd-9e99-d29ade226e58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ec48cd-e9ba-44a3-b2b0-a2a5945d6eba", "tag": "7ffbc6b9-8e38-4e87-9d09-f05205023aad"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:24.146438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-27288656-9d59-4c5f-9ae0-0a8dbbdc0abd req-ae6763bb-c789-4acd-9e99-d29ade226e58 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:24.152898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-27288656-9d59-4c5f-9ae0-0a8dbbdc0abd req-ae6763bb-c789-4acd-9e99-d29ade226e58 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:24.155344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-27288656-9d59-4c5f-9ae0-0a8dbbdc0abd req-ae6763bb-c789-4acd-9e99-d29ade226e58 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:24.188702 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-27288656-9d59-4c5f-9ae0-0a8dbbdc0abd req-ae6763bb-c789-4acd-9e99-d29ade226e58 service nova] Creating event network-changed:7ffbc6b9-8e38-4e87-9d09-f05205023aad for instance c3ec48cd-e9ba-44a3-b2b0-a2a5945d6eba on n-h1-839401-11 Aug 29 15:35:24.195807 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-27288656-9d59-4c5f-9ae0-0a8dbbdc0abd req-ae6763bb-c789-4acd-9e99-d29ade226e58 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085720 Aug 29 15:35:24.197917 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1366/2708] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:24.205295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a8407e43-3524-4b1c-8b82-cc735d08b766 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:24.206354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a8407e43-3524-4b1c-8b82-cc735d08b766 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: 51a3c2ae-98a2-4e37-96ef-3e787faf0d11] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:24.224260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8407e43-3524-4b1c-8b82-cc735d08b766 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:24.225357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8407e43-3524-4b1c-8b82-cc735d08b766 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:24.226272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8407e43-3524-4b1c-8b82-cc735d08b766 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:24.228261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8407e43-3524-4b1c-8b82-cc735d08b766 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:24.229181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8407e43-3524-4b1c-8b82-cc735d08b766 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:24.230667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8407e43-3524-4b1c-8b82-cc735d08b766 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:24.258075 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-a8407e43-3524-4b1c-8b82-cc735d08b766 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] HTTP exception thrown: Instance 51a3c2ae-98a2-4e37-96ef-3e787faf0d11 could not be found. Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a8407e43-3524-4b1c-8b82-cc735d08b766 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Request method failure captured: Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 HTTP/1.1 Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqyZh8cI-S3BYoWeV3ZIfZCv7DYX3-5WfzhenLF0YzuUQMBghE0z6ME5UmGWOt4xbbbGLqBULo6GaH6pRRu9-2b_A1IVr9F7L4OLv0EFzrIZPENt1NXLQB8NULNfiQZCm1XXw040O0zJ6baE9-jONzixjWhGU8m6PJ9mS52C-B9D-A Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 31544ac2992c46aa8fecdff53a43ae42 Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-LiveMigrationTest-445924921 Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31544ac2992c46aa8fecdff53a43ae42", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31544ac2992c46aa8fecdff53a43ae42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31544ac2992c46aa8fecdff53a43ae42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31544ac2992c46aa8fecdff53a43ae42"}]}] Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-LiveMigrationTest-445924921 Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 31544ac2992c46aa8fecdff53a43ae42 Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-LiveMigrationTest-445924921 Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-LiveMigrationTest-445924921-project Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 498e44c8a15f451ba8ff39eff4156075 Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-LiveMigrationTest-445924921-project Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 51a3c2ae-98a2-4e37-96ef-3e787faf0d11 could not be found. Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '51a3c2ae-98a2-4e37-96ef-3e787faf0d11'} Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51a3c2ae-98a2-4e37-96ef-3e787faf0d11 could not be found. Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51a3c2ae-98a2-4e37-96ef-3e787faf0d11 could not be found. Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:24.261877 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:24.265704 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:24.265704 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:24.265704 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:24.265704 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:24.265704 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:24.265704 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51a3c2ae-98a2-4e37-96ef-3e787faf0d11 could not be found. Aug 29 15:35:24.265704 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:24.267741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a8407e43-3524-4b1c-8b82-cc735d08b766 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Returning 404 to user: Instance 51a3c2ae-98a2-4e37-96ef-3e787faf0d11 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:24.268920 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a8407e43-3524-4b1c-8b82-cc735d08b766 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11" status: 404 len: 111 microversion: 2.1 time: 0.069561 Aug 29 15:35:24.273892 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1367/2709] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:24 2022] GET /compute/v2.1/servers/51a3c2ae-98a2-4e37-96ef-3e787faf0d11 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:24.280845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0a426b42-7028-483d-9371-9e42f887523b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:24.281765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0a426b42-7028-483d-9371-9e42f887523b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:24.386757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0a426b42-7028-483d-9371-9e42f887523b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:24.412184 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0a426b42-7028-483d-9371-9e42f887523b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1218 microversion: 2.1 time: 0.135670 Aug 29 15:35:24.429160 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1368/2710] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:24 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:24.448406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c93672c-8e87-4589-9c1a-5dd7cc2ec073 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '.version_select at 0x7fc42b835700>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:24.504440 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5c93672c-8e87-4589-9c1a-5dd7cc2ec073 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-245590058" status: 202 len: 0 microversion: 2.1 time: 0.073809 Aug 29 15:35:24.511167 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1369/2711] 10.222.0.62 () {58 vars in 1218 bytes} [Mon Aug 29 15:35:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-245590058 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:35:24.526846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5281f377-7281-4790-8814-86c2fc337329 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:24.529881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5281f377-7281-4790-8814-86c2fc337329 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:24.541658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5281f377-7281-4790-8814-86c2fc337329 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:24.550048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5281f377-7281-4790-8814-86c2fc337329 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:24.551247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5281f377-7281-4790-8814-86c2fc337329 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:24.554124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5281f377-7281-4790-8814-86c2fc337329 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:24.554781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5281f377-7281-4790-8814-86c2fc337329 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:24.556658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5281f377-7281-4790-8814-86c2fc337329 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:24.733567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b716ca4f-4cf8-469f-a0bb-62ed1d374309 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:24.748380 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b716ca4f-4cf8-469f-a0bb-62ed1d374309 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1314 microversion: 2.1 time: 0.810819 Aug 29 15:35:24.752241 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1343/2712] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:23 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1314 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:25.131975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-18bc5005-21f6-4b56-a9d1-f6b7273783af tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:25.133037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-18bc5005-21f6-4b56-a9d1-f6b7273783af tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:25.141029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18bc5005-21f6-4b56-a9d1-f6b7273783af tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.141974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18bc5005-21f6-4b56-a9d1-f6b7273783af tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.142603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18bc5005-21f6-4b56-a9d1-f6b7273783af tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:25.143591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18bc5005-21f6-4b56-a9d1-f6b7273783af tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.144357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18bc5005-21f6-4b56-a9d1-f6b7273783af tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.145791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18bc5005-21f6-4b56-a9d1-f6b7273783af tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:25.284534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5281f377-7281-4790-8814-86c2fc337329 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:25.296650 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5281f377-7281-4790-8814-86c2fc337329 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1534 microversion: 2.1 time: 0.776633 Aug 29 15:35:25.301330 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1370/2713] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:24 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1534 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:25.434752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2a5e439b-5b2f-4287-9d39-9b46a2455dee tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:25.435370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2a5e439b-5b2f-4287-9d39-9b46a2455dee tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:25.451555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a5e439b-5b2f-4287-9d39-9b46a2455dee tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.452511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a5e439b-5b2f-4287-9d39-9b46a2455dee tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.453338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a5e439b-5b2f-4287-9d39-9b46a2455dee tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:25.453872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a5e439b-5b2f-4287-9d39-9b46a2455dee tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.454339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a5e439b-5b2f-4287-9d39-9b46a2455dee tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.455077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a5e439b-5b2f-4287-9d39-9b46a2455dee tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:25.614402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2a5e439b-5b2f-4287-9d39-9b46a2455dee tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:25.622910 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2a5e439b-5b2f-4287-9d39-9b46a2455dee tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1214 microversion: 2.1 time: 0.191991 Aug 29 15:35:25.624772 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1371/2714] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:25 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:25.633526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-5f0a9780-5ccb-4a33-8148-c9466b270756 req-5b91232a-d0b3-4af7-bd2e-15b584a43b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a3c2ae-98a2-4e37-96ef-3e787faf0d11", "name": "network-vif-deleted", "tag": "7a9162b3-e31e-4ebc-b3c4-b04ef19e4065"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:25.651412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5f0a9780-5ccb-4a33-8148-c9466b270756 req-5b91232a-d0b3-4af7-bd2e-15b584a43b99 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.651912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5f0a9780-5ccb-4a33-8148-c9466b270756 req-5b91232a-d0b3-4af7-bd2e-15b584a43b99 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.652488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5f0a9780-5ccb-4a33-8148-c9466b270756 req-5b91232a-d0b3-4af7-bd2e-15b584a43b99 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:25.669593 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-5f0a9780-5ccb-4a33-8148-c9466b270756 req-5b91232a-d0b3-4af7-bd2e-15b584a43b99 service nova] Creating event network-vif-deleted:7a9162b3-e31e-4ebc-b3c4-b04ef19e4065 for instance 51a3c2ae-98a2-4e37-96ef-3e787faf0d11 on n-h1-839401-11 Aug 29 15:35:25.676835 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-5f0a9780-5ccb-4a33-8148-c9466b270756 req-5b91232a-d0b3-4af7-bd2e-15b584a43b99 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050328 Aug 29 15:35:25.678300 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1372/2715] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:25.774808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e89c21e9-71ff-4ee4-8ddf-cd49015f59b1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:25.775575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e89c21e9-71ff-4ee4-8ddf-cd49015f59b1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:25.795717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e89c21e9-71ff-4ee4-8ddf-cd49015f59b1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.797472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e89c21e9-71ff-4ee4-8ddf-cd49015f59b1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.799387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e89c21e9-71ff-4ee4-8ddf-cd49015f59b1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:25.801071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e89c21e9-71ff-4ee4-8ddf-cd49015f59b1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:25.803945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e89c21e9-71ff-4ee4-8ddf-cd49015f59b1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:25.804750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e89c21e9-71ff-4ee4-8ddf-cd49015f59b1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:26.002625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-18bc5005-21f6-4b56-a9d1-f6b7273783af tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:26.016102 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-18bc5005-21f6-4b56-a9d1-f6b7273783af tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1320 microversion: 2.1 time: 0.891350 Aug 29 15:35:26.029687 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1344/2716] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:25 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1320 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:26.029687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-c5051523-b985-4081-9433-ca9af313fe80 req-2fb486a4-5dd6-4ec8-a70c-29c2a7a3bd31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74984943-d6e3-4b74-b251-f05fff364c27", "name": "network-vif-unplugged", "status": "completed", "tag": "f5fdbe76-975e-466c-9d17-812c0ec39457"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:26.036159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c5051523-b985-4081-9433-ca9af313fe80 req-2fb486a4-5dd6-4ec8-a70c-29c2a7a3bd31 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:26.037269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c5051523-b985-4081-9433-ca9af313fe80 req-2fb486a4-5dd6-4ec8-a70c-29c2a7a3bd31 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:26.037714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c5051523-b985-4081-9433-ca9af313fe80 req-2fb486a4-5dd6-4ec8-a70c-29c2a7a3bd31 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:26.057283 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-c5051523-b985-4081-9433-ca9af313fe80 req-2fb486a4-5dd6-4ec8-a70c-29c2a7a3bd31 service nova] Creating event network-vif-unplugged:f5fdbe76-975e-466c-9d17-812c0ec39457 for instance 74984943-d6e3-4b74-b251-f05fff364c27 on n-h2-839401-11 Aug 29 15:35:26.064507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-c5051523-b985-4081-9433-ca9af313fe80 req-2fb486a4-5dd6-4ec8-a70c-29c2a7a3bd31 service nova] Instance 74984943-d6e3-4b74-b251-f05fff364c27 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:35:26.072711 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-c5051523-b985-4081-9433-ca9af313fe80 req-2fb486a4-5dd6-4ec8-a70c-29c2a7a3bd31 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051549 Aug 29 15:35:26.074271 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1345/2717] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:26.240012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e89c21e9-71ff-4ee4-8ddf-cd49015f59b1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:26.256223 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e89c21e9-71ff-4ee4-8ddf-cd49015f59b1 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1314 microversion: 2.1 time: 0.480869 Aug 29 15:35:26.257481 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1373/2718] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:25 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:26.274266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f3d2aff0-9692-4ec0-bc86-89397c51326f req-e7dce3f0-7e95-46f4-bec4-d6eb317ac48a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af95f7c-5362-4cf9-b80e-38cd6a518783", "tag": "2984ebfd-8f23-4f8e-83af-0a164bd8c5aa"}, {"name": "network-changed", "server_uuid": "fc999f5d-20a5-4d24-830d-115be27f060c", "tag": "fcb0f450-5a4d-4679-8a1f-67418fa2243a"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:26.293346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f3d2aff0-9692-4ec0-bc86-89397c51326f req-e7dce3f0-7e95-46f4-bec4-d6eb317ac48a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:26.297471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f3d2aff0-9692-4ec0-bc86-89397c51326f req-e7dce3f0-7e95-46f4-bec4-d6eb317ac48a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:26.297962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f3d2aff0-9692-4ec0-bc86-89397c51326f req-e7dce3f0-7e95-46f4-bec4-d6eb317ac48a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:26.327614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bcec488b-1182-4e1b-bbba-71dfc295c97b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:26.328292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bcec488b-1182-4e1b-bbba-71dfc295c97b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:26.329013 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f3d2aff0-9692-4ec0-bc86-89397c51326f req-e7dce3f0-7e95-46f4-bec4-d6eb317ac48a service nova] Creating event network-changed:2984ebfd-8f23-4f8e-83af-0a164bd8c5aa for instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 on n-h2-839401-11 Aug 29 15:35:26.329804 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f3d2aff0-9692-4ec0-bc86-89397c51326f req-e7dce3f0-7e95-46f4-bec4-d6eb317ac48a service nova] Creating event network-changed:fcb0f450-5a4d-4679-8a1f-67418fa2243a for instance fc999f5d-20a5-4d24-830d-115be27f060c on n-h1-839401-11 Aug 29 15:35:26.339641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcec488b-1182-4e1b-bbba-71dfc295c97b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:26.343003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcec488b-1182-4e1b-bbba-71dfc295c97b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:26.346068 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f3d2aff0-9692-4ec0-bc86-89397c51326f req-e7dce3f0-7e95-46f4-bec4-d6eb317ac48a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.084579 Aug 29 15:35:26.353566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcec488b-1182-4e1b-bbba-71dfc295c97b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:26.354289 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1346/2719] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:26.354411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcec488b-1182-4e1b-bbba-71dfc295c97b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:26.354823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcec488b-1182-4e1b-bbba-71dfc295c97b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:26.355245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcec488b-1182-4e1b-bbba-71dfc295c97b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:26.647592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ac53cc59-8010-4480-9bee-89b9e9bed3ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:26.648245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ac53cc59-8010-4480-9bee-89b9e9bed3ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:26.655921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac53cc59-8010-4480-9bee-89b9e9bed3ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:26.656427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac53cc59-8010-4480-9bee-89b9e9bed3ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:26.656870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac53cc59-8010-4480-9bee-89b9e9bed3ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:26.658047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac53cc59-8010-4480-9bee-89b9e9bed3ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:26.658523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac53cc59-8010-4480-9bee-89b9e9bed3ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:26.659269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac53cc59-8010-4480-9bee-89b9e9bed3ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:26.773528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ac53cc59-8010-4480-9bee-89b9e9bed3ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:26.781616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:26.789457 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ac53cc59-8010-4480-9bee-89b9e9bed3ce tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1270 microversion: 2.1 time: 0.147403 Aug 29 15:35:26.790495 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1347/2720] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:26 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1270 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:26.938604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bcec488b-1182-4e1b-bbba-71dfc295c97b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:26.956160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-51639c8f-5f04-4937-9a4e-9f925429fe51 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:26.956680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-51639c8f-5f04-4937-9a4e-9f925429fe51 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:26.964739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51639c8f-5f04-4937-9a4e-9f925429fe51 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:26.965260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51639c8f-5f04-4937-9a4e-9f925429fe51 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:26.969058 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bcec488b-1182-4e1b-bbba-71dfc295c97b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1534 microversion: 2.1 time: 0.648035 Aug 29 15:35:26.969854 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1374/2721] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:26 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1534 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:26.970776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51639c8f-5f04-4937-9a4e-9f925429fe51 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:26.971527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51639c8f-5f04-4937-9a4e-9f925429fe51 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:26.972036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51639c8f-5f04-4937-9a4e-9f925429fe51 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:26.972621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51639c8f-5f04-4937-9a4e-9f925429fe51 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:26.999407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-51639c8f-5f04-4937-9a4e-9f925429fe51 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:27.047179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cb3d7fd7-a9ee-4aa4-9c20-217ced723b54 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:27.048243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cb3d7fd7-a9ee-4aa4-9c20-217ced723b54 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:27.060520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb3d7fd7-a9ee-4aa4-9c20-217ced723b54 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:27.064268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb3d7fd7-a9ee-4aa4-9c20-217ced723b54 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:27.065375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb3d7fd7-a9ee-4aa4-9c20-217ced723b54 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:27.067968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb3d7fd7-a9ee-4aa4-9c20-217ced723b54 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:27.068612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb3d7fd7-a9ee-4aa4-9c20-217ced723b54 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:27.071014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb3d7fd7-a9ee-4aa4-9c20-217ced723b54 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:27.110173 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-51639c8f-5f04-4937-9a4e-9f925429fe51 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 204 len: 0 microversion: 2.1 time: 0.157051 Aug 29 15:35:27.128409 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1348/2722] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:26 2022] DELETE /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:35:27.137282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8fb2bb5f-3a95-4938-8d79-a096a9bc8258 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:27.139109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8fb2bb5f-3a95-4938-8d79-a096a9bc8258 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:27.146827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fb2bb5f-3a95-4938-8d79-a096a9bc8258 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:27.147542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fb2bb5f-3a95-4938-8d79-a096a9bc8258 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:27.147969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fb2bb5f-3a95-4938-8d79-a096a9bc8258 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:27.148825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fb2bb5f-3a95-4938-8d79-a096a9bc8258 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:27.149358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fb2bb5f-3a95-4938-8d79-a096a9bc8258 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:27.149779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fb2bb5f-3a95-4938-8d79-a096a9bc8258 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:27.371347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8fb2bb5f-3a95-4938-8d79-a096a9bc8258 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:27.379830 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8fb2bb5f-3a95-4938-8d79-a096a9bc8258 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1483 microversion: 2.1 time: 0.246898 Aug 29 15:35:27.385261 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1349/2723] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:27 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1483 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:27.398044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-86d0c006-ada4-4a76-8aa7-9761d99b1dc9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:27.401762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-86d0c006-ada4-4a76-8aa7-9761d99b1dc9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:27.430890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86d0c006-ada4-4a76-8aa7-9761d99b1dc9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:27.431918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86d0c006-ada4-4a76-8aa7-9761d99b1dc9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:27.434352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86d0c006-ada4-4a76-8aa7-9761d99b1dc9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:27.436638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86d0c006-ada4-4a76-8aa7-9761d99b1dc9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:27.437940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86d0c006-ada4-4a76-8aa7-9761d99b1dc9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:27.438641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86d0c006-ada4-4a76-8aa7-9761d99b1dc9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:27.511434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cb3d7fd7-a9ee-4aa4-9c20-217ced723b54 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:27.525564 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cb3d7fd7-a9ee-4aa4-9c20-217ced723b54 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1320 microversion: 2.1 time: 0.491819 Aug 29 15:35:27.528072 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1375/2724] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:27 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1320 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:27.630891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-86d0c006-ada4-4a76-8aa7-9761d99b1dc9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:27.641700 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-86d0c006-ada4-4a76-8aa7-9761d99b1dc9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1314 microversion: 2.1 time: 0.254761 Aug 29 15:35:27.643044 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1350/2725] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:27 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:27.734513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-644fade0-c4d3-49bf-b0a9-e69007eb1437 req-7d14d5b8-6597-41a0-9f2c-d6eadf553ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f838765-3a8a-47c2-9907-367ddaf2d90f", "name": "network-vif-deleted", "tag": "0f30a440-530f-4c46-b4fb-89f0c9814d97"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:27.745257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-644fade0-c4d3-49bf-b0a9-e69007eb1437 req-7d14d5b8-6597-41a0-9f2c-d6eadf553ac7 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:27.745734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-644fade0-c4d3-49bf-b0a9-e69007eb1437 req-7d14d5b8-6597-41a0-9f2c-d6eadf553ac7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:27.746364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-644fade0-c4d3-49bf-b0a9-e69007eb1437 req-7d14d5b8-6597-41a0-9f2c-d6eadf553ac7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:27.758922 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-644fade0-c4d3-49bf-b0a9-e69007eb1437 req-7d14d5b8-6597-41a0-9f2c-d6eadf553ac7 service nova] Creating event network-vif-deleted:0f30a440-530f-4c46-b4fb-89f0c9814d97 for instance 0f838765-3a8a-47c2-9907-367ddaf2d90f on n-h1-839401-11 Aug 29 15:35:27.764591 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-644fade0-c4d3-49bf-b0a9-e69007eb1437 req-7d14d5b8-6597-41a0-9f2c-d6eadf553ac7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033675 Aug 29 15:35:27.765797 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1376/2726] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:27.813796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ce1ab17a-2cde-4d6c-9b51-4a28df9eb2a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:27.815686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ce1ab17a-2cde-4d6c-9b51-4a28df9eb2a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:27.825037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce1ab17a-2cde-4d6c-9b51-4a28df9eb2a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:27.825874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce1ab17a-2cde-4d6c-9b51-4a28df9eb2a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:27.826576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce1ab17a-2cde-4d6c-9b51-4a28df9eb2a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:27.827520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce1ab17a-2cde-4d6c-9b51-4a28df9eb2a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:27.828529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce1ab17a-2cde-4d6c-9b51-4a28df9eb2a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:27.829221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce1ab17a-2cde-4d6c-9b51-4a28df9eb2a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:27.914158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ce1ab17a-2cde-4d6c-9b51-4a28df9eb2a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:27.923263 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ce1ab17a-2cde-4d6c-9b51-4a28df9eb2a0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1270 microversion: 2.1 time: 0.115447 Aug 29 15:35:27.924181 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1351/2727] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:27 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1270 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:27.995080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4d8fac09-bf1b-480c-8dc0-692247b4a4f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:27.996179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4d8fac09-bf1b-480c-8dc0-692247b4a4f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:28.002988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d8fac09-bf1b-480c-8dc0-692247b4a4f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:28.003704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d8fac09-bf1b-480c-8dc0-692247b4a4f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:28.004335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d8fac09-bf1b-480c-8dc0-692247b4a4f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:28.005222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d8fac09-bf1b-480c-8dc0-692247b4a4f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:28.005940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d8fac09-bf1b-480c-8dc0-692247b4a4f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:28.006534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d8fac09-bf1b-480c-8dc0-692247b4a4f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:28.248459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4d8fac09-bf1b-480c-8dc0-692247b4a4f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:28.260060 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4d8fac09-bf1b-480c-8dc0-692247b4a4f3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1534 microversion: 2.1 time: 0.268609 Aug 29 15:35:28.260668 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1377/2728] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:27 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1534 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:28.402338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-36bdf202-da47-4f4d-939e-f9ef7a6397c9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:28.403159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-36bdf202-da47-4f4d-939e-f9ef7a6397c9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:28.410869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36bdf202-da47-4f4d-939e-f9ef7a6397c9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:28.411953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36bdf202-da47-4f4d-939e-f9ef7a6397c9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:28.412616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36bdf202-da47-4f4d-939e-f9ef7a6397c9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:28.413621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36bdf202-da47-4f4d-939e-f9ef7a6397c9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:28.414285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36bdf202-da47-4f4d-939e-f9ef7a6397c9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:28.414933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36bdf202-da47-4f4d-939e-f9ef7a6397c9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:28.551861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d072c85f-27d8-43e0-adb6-d31e10652dd2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:28.553348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d072c85f-27d8-43e0-adb6-d31e10652dd2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:28.559187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:28.561056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d072c85f-27d8-43e0-adb6-d31e10652dd2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:28.561731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d072c85f-27d8-43e0-adb6-d31e10652dd2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:28.562316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d072c85f-27d8-43e0-adb6-d31e10652dd2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:28.563239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d072c85f-27d8-43e0-adb6-d31e10652dd2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:28.563837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d072c85f-27d8-43e0-adb6-d31e10652dd2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:28.564426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d072c85f-27d8-43e0-adb6-d31e10652dd2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:28.607618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36bdf202-da47-4f4d-939e-f9ef7a6397c9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:28.618091 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-36bdf202-da47-4f4d-939e-f9ef7a6397c9 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1483 microversion: 2.1 time: 0.221284 Aug 29 15:35:28.619431 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1352/2729] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:28 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1483 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:28.664822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-39dfd785-f57b-4fea-a6ac-60a8c93cfc94 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:28.665774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-39dfd785-f57b-4fea-a6ac-60a8c93cfc94 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:28.672008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39dfd785-f57b-4fea-a6ac-60a8c93cfc94 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:28.672738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39dfd785-f57b-4fea-a6ac-60a8c93cfc94 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:28.673370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39dfd785-f57b-4fea-a6ac-60a8c93cfc94 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:28.674256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39dfd785-f57b-4fea-a6ac-60a8c93cfc94 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:28.674937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39dfd785-f57b-4fea-a6ac-60a8c93cfc94 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:28.675369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39dfd785-f57b-4fea-a6ac-60a8c93cfc94 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:28.824193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-39dfd785-f57b-4fea-a6ac-60a8c93cfc94 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:28.832993 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-39dfd785-f57b-4fea-a6ac-60a8c93cfc94 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1314 microversion: 2.1 time: 0.172280 Aug 29 15:35:28.847944 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1353/2730] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:28 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:28.944597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-066441ae-1513-4c9a-a8c4-387f7ca59754 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:28.945559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d072c85f-27d8-43e0-adb6-d31e10652dd2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:28.946036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-066441ae-1513-4c9a-a8c4-387f7ca59754 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:28.954076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-066441ae-1513-4c9a-a8c4-387f7ca59754 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:28.954797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-066441ae-1513-4c9a-a8c4-387f7ca59754 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:28.955337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-066441ae-1513-4c9a-a8c4-387f7ca59754 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:28.956209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-066441ae-1513-4c9a-a8c4-387f7ca59754 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:28.956376 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d072c85f-27d8-43e0-adb6-d31e10652dd2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1320 microversion: 2.1 time: 0.408354 Aug 29 15:35:28.956866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-066441ae-1513-4c9a-a8c4-387f7ca59754 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:28.961266 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1378/2731] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:28 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1320 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:28.961473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-066441ae-1513-4c9a-a8c4-387f7ca59754 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:29.042539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-066441ae-1513-4c9a-a8c4-387f7ca59754 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:29.055460 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-066441ae-1513-4c9a-a8c4-387f7ca59754 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1270 microversion: 2.1 time: 0.115241 Aug 29 15:35:29.065668 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1354/2732] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:28 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1270 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:29.284379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-caba56e0-467f-46f9-bc43-a44befdb302e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:29.284921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-caba56e0-467f-46f9-bc43-a44befdb302e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:29.303181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-caba56e0-467f-46f9-bc43-a44befdb302e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:29.303661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-caba56e0-467f-46f9-bc43-a44befdb302e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:29.304729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-caba56e0-467f-46f9-bc43-a44befdb302e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:29.306430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-caba56e0-467f-46f9-bc43-a44befdb302e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:29.307472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-caba56e0-467f-46f9-bc43-a44befdb302e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:29.308060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-caba56e0-467f-46f9-bc43-a44befdb302e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:29.640337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ebe8e941-b59c-4b5c-99ca-bc7cf4616261 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:29.644468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ebe8e941-b59c-4b5c-99ca-bc7cf4616261 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:29.672839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebe8e941-b59c-4b5c-99ca-bc7cf4616261 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:29.673627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebe8e941-b59c-4b5c-99ca-bc7cf4616261 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:29.682381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebe8e941-b59c-4b5c-99ca-bc7cf4616261 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:29.683846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebe8e941-b59c-4b5c-99ca-bc7cf4616261 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:29.684488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebe8e941-b59c-4b5c-99ca-bc7cf4616261 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:29.685074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebe8e941-b59c-4b5c-99ca-bc7cf4616261 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:29.934526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-caba56e0-467f-46f9-bc43-a44befdb302e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:29.939669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:29.945576 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-caba56e0-467f-46f9-bc43-a44befdb302e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1534 microversion: 2.1 time: 0.665194 Aug 29 15:35:29.950922 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1379/2733] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:29 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1534 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:29.957909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-62415db4-f052-4795-9866-661ec4a42f37 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:29.960888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-62415db4-f052-4795-9866-661ec4a42f37 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:29.980101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62415db4-f052-4795-9866-661ec4a42f37 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:29.982570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62415db4-f052-4795-9866-661ec4a42f37 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:29.984230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62415db4-f052-4795-9866-661ec4a42f37 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:29.985293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62415db4-f052-4795-9866-661ec4a42f37 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:29.985973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62415db4-f052-4795-9866-661ec4a42f37 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:29.999805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62415db4-f052-4795-9866-661ec4a42f37 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:30.689949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ebe8e941-b59c-4b5c-99ca-bc7cf4616261 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:30.708023 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ebe8e941-b59c-4b5c-99ca-bc7cf4616261 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1483 microversion: 2.1 time: 1.072542 Aug 29 15:35:30.711503 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1355/2734] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:29 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1483 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:30.723453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eeddc148-83f3-4be9-92b5-e6d1f5bbc1f8 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:30.724529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eeddc148-83f3-4be9-92b5-e6d1f5bbc1f8 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:30.732381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeddc148-83f3-4be9-92b5-e6d1f5bbc1f8 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:30.733403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeddc148-83f3-4be9-92b5-e6d1f5bbc1f8 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:30.734062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeddc148-83f3-4be9-92b5-e6d1f5bbc1f8 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:30.734976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeddc148-83f3-4be9-92b5-e6d1f5bbc1f8 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:30.741128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeddc148-83f3-4be9-92b5-e6d1f5bbc1f8 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:30.741917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eeddc148-83f3-4be9-92b5-e6d1f5bbc1f8 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:31.466004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-62415db4-f052-4795-9866-661ec4a42f37 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:31.515633 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-62415db4-f052-4795-9866-661ec4a42f37 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1314 microversion: 2.1 time: 1.563040 Aug 29 15:35:31.542868 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1380/2735] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:29 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1314 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:31.550763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3495dcd2-9843-415f-99ea-0451299a38c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:31.551688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3495dcd2-9843-415f-99ea-0451299a38c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:31.562602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3495dcd2-9843-415f-99ea-0451299a38c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:31.563487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3495dcd2-9843-415f-99ea-0451299a38c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:31.564159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3495dcd2-9843-415f-99ea-0451299a38c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:31.565156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3495dcd2-9843-415f-99ea-0451299a38c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:31.566733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3495dcd2-9843-415f-99ea-0451299a38c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:31.567452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3495dcd2-9843-415f-99ea-0451299a38c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:31.709851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eeddc148-83f3-4be9-92b5-e6d1f5bbc1f8 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:31.724340 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eeddc148-83f3-4be9-92b5-e6d1f5bbc1f8 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1320 microversion: 2.1 time: 1.011425 Aug 29 15:35:31.738555 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1356/2736] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:30 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1320 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:31.745277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f99c8006-ae4f-4a97-a723-a869e1bc7713 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:31.746213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f99c8006-ae4f-4a97-a723-a869e1bc7713 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:31.746567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3495dcd2-9843-415f-99ea-0451299a38c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:31.760691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:31.762790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f99c8006-ae4f-4a97-a723-a869e1bc7713 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:31.765457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f99c8006-ae4f-4a97-a723-a869e1bc7713 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:31.766580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f99c8006-ae4f-4a97-a723-a869e1bc7713 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:31.767562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f99c8006-ae4f-4a97-a723-a869e1bc7713 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:31.768853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f99c8006-ae4f-4a97-a723-a869e1bc7713 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:31.769535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f99c8006-ae4f-4a97-a723-a869e1bc7713 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:31.787461 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3495dcd2-9843-415f-99ea-0451299a38c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1276 microversion: 2.1 time: 0.240613 Aug 29 15:35:31.788402 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1381/2737] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:31 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:31.989954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c143c9af-3b8b-475d-b75f-4132e8ac73fa req-c02b77d4-fe71-4bcd-885d-d60f17b41df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4195b2a3-e1ec-408b-95dc-5ac81dc095e5", "name": "network-vif-plugged", "status": "completed", "tag": "2ad06ede-9024-40d5-85e9-a67bfc4eee98"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:32.005965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c143c9af-3b8b-475d-b75f-4132e8ac73fa req-c02b77d4-fe71-4bcd-885d-d60f17b41df4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.006768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c143c9af-3b8b-475d-b75f-4132e8ac73fa req-c02b77d4-fe71-4bcd-885d-d60f17b41df4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.007604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c143c9af-3b8b-475d-b75f-4132e8ac73fa req-c02b77d4-fe71-4bcd-885d-d60f17b41df4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.029620 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c143c9af-3b8b-475d-b75f-4132e8ac73fa req-c02b77d4-fe71-4bcd-885d-d60f17b41df4 service nova] Creating event network-vif-plugged:2ad06ede-9024-40d5-85e9-a67bfc4eee98 for instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 on n-h1-839401-11 Aug 29 15:35:32.038675 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c143c9af-3b8b-475d-b75f-4132e8ac73fa req-c02b77d4-fe71-4bcd-885d-d60f17b41df4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247412 Aug 29 15:35:32.041033 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1382/2738] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:32.049762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-55ec2feb-c9ff-4eff-9892-1c56a12e0cb4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:32.050708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-55ec2feb-c9ff-4eff-9892-1c56a12e0cb4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:32.081222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55ec2feb-c9ff-4eff-9892-1c56a12e0cb4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.082708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55ec2feb-c9ff-4eff-9892-1c56a12e0cb4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.084284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55ec2feb-c9ff-4eff-9892-1c56a12e0cb4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.089672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55ec2feb-c9ff-4eff-9892-1c56a12e0cb4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.091970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55ec2feb-c9ff-4eff-9892-1c56a12e0cb4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.092915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55ec2feb-c9ff-4eff-9892-1c56a12e0cb4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.356547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-55ec2feb-c9ff-4eff-9892-1c56a12e0cb4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:32.366307 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-55ec2feb-c9ff-4eff-9892-1c56a12e0cb4 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1483 microversion: 2.1 time: 0.323189 Aug 29 15:35:32.368148 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1383/2739] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:32 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1483 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:32.427000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f99c8006-ae4f-4a97-a723-a869e1bc7713 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:32.435576 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f99c8006-ae4f-4a97-a723-a869e1bc7713 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1527 microversion: 2.1 time: 0.695230 Aug 29 15:35:32.438585 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1357/2740] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:31 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1527 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:32.461852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1544f512-cd42-4712-aeb2-a915a44a59cb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:32.462818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1544f512-cd42-4712-aeb2-a915a44a59cb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:32.483901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1544f512-cd42-4712-aeb2-a915a44a59cb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.488643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1544f512-cd42-4712-aeb2-a915a44a59cb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.489300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1544f512-cd42-4712-aeb2-a915a44a59cb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.490293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1544f512-cd42-4712-aeb2-a915a44a59cb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.490833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1544f512-cd42-4712-aeb2-a915a44a59cb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.491281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1544f512-cd42-4712-aeb2-a915a44a59cb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.554672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-407d7ff8-ae49-47f1-9f8d-2bd53f894ea8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:32.556400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-407d7ff8-ae49-47f1-9f8d-2bd53f894ea8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:32.564414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-407d7ff8-ae49-47f1-9f8d-2bd53f894ea8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.565248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-407d7ff8-ae49-47f1-9f8d-2bd53f894ea8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.565978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-407d7ff8-ae49-47f1-9f8d-2bd53f894ea8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.566850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-407d7ff8-ae49-47f1-9f8d-2bd53f894ea8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.567472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-407d7ff8-ae49-47f1-9f8d-2bd53f894ea8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.568770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-407d7ff8-ae49-47f1-9f8d-2bd53f894ea8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.795694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1544f512-cd42-4712-aeb2-a915a44a59cb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:32.812934 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1544f512-cd42-4712-aeb2-a915a44a59cb tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1527 microversion: 2.1 time: 0.355067 Aug 29 15:35:32.829755 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1384/2741] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:32 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1527 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:32.835564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9dbaa652-c5ac-4242-a340-c84c62db23d6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:32.836189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9dbaa652-c5ac-4242-a340-c84c62db23d6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:32.851140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9dbaa652-c5ac-4242-a340-c84c62db23d6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.851990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9dbaa652-c5ac-4242-a340-c84c62db23d6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.852936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9dbaa652-c5ac-4242-a340-c84c62db23d6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:32.854040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9dbaa652-c5ac-4242-a340-c84c62db23d6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:32.854721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9dbaa652-c5ac-4242-a340-c84c62db23d6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:32.855363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9dbaa652-c5ac-4242-a340-c84c62db23d6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.111723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-407d7ff8-ae49-47f1-9f8d-2bd53f894ea8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:33.125549 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-407d7ff8-ae49-47f1-9f8d-2bd53f894ea8 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1314 microversion: 2.1 time: 0.576589 Aug 29 15:35:33.126408 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1358/2742] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:32 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:33.135839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-806f1917-481e-46a2-b966-c79f1a6dc419 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:33.138875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-806f1917-481e-46a2-b966-c79f1a6dc419 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:33.149950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-806f1917-481e-46a2-b966-c79f1a6dc419 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.151184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-806f1917-481e-46a2-b966-c79f1a6dc419 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.152019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-806f1917-481e-46a2-b966-c79f1a6dc419 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.152935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-806f1917-481e-46a2-b966-c79f1a6dc419 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.154415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-806f1917-481e-46a2-b966-c79f1a6dc419 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.155324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-806f1917-481e-46a2-b966-c79f1a6dc419 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.251510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9dbaa652-c5ac-4242-a340-c84c62db23d6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:33.261847 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9dbaa652-c5ac-4242-a340-c84c62db23d6 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1320 microversion: 2.1 time: 0.430512 Aug 29 15:35:33.263250 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1385/2743] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:32 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1320 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:33.287144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-677d370a-2c7b-435d-a280-19c93b0978b3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:33.295327 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-677d370a-2c7b-435d-a280-19c93b0978b3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] HTTP exception thrown: Flavor 214749f2-0e21-48de-82a9-352a778a2b97 could not be found. Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-677d370a-2c7b-435d-a280-19c93b0978b3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Request method failure captured: Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/flavors/214749f2-0e21-48de-82a9-352a778a2b97 HTTP/1.1 Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNu9nxb3kbW60LxsfHzDGckMyxTRsmfFoXkOAc1Si6CtEEWJRFBN6k9Anxm-7UYiYvE7ybSEzOhgiUmpLXPpG4OJfyPTQVzMhO92lUkDkGJAtY2jwmGbXCSa-NGG8kEFBoL1zWITI8tRPH3_ahwOfvpUM3p_AO4SZ_wkc9spyC2zSck Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 094265a4efd8497ca10efe66cb7a434d Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-MigrationsAdminTest-651344996 Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_094265a4efd8497ca10efe66cb7a434d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/094265a4efd8497ca10efe66cb7a434d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/094265a4efd8497ca10efe66cb7a434d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/094265a4efd8497ca10efe66cb7a434d"}]}] Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-MigrationsAdminTest-651344996 Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 094265a4efd8497ca10efe66cb7a434d Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-MigrationsAdminTest-651344996 Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-MigrationsAdminTest-651344996-project-admin Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: c6120724d1ad4272a1507ebc11cbf895 Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-MigrationsAdminTest-651344996-project-admin Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: exception: Flavor 214749f2-0e21-48de-82a9-352a778a2b97 could not be found. Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '214749f2-0e21-48de-82a9-352a778a2b97'} Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 214749f2-0e21-48de-82a9-352a778a2b97 could not be found. Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 214749f2-0e21-48de-82a9-352a778a2b97 could not be found. Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:33.302106 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:33.310773 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:33.310773 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:33.310773 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:33.310773 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:33.310773 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:33.310773 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:33.310773 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 214749f2-0e21-48de-82a9-352a778a2b97 could not be found. Aug 29 15:35:33.310773 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:33.310773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-677d370a-2c7b-435d-a280-19c93b0978b3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Returning 404 to user: Flavor 214749f2-0e21-48de-82a9-352a778a2b97 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:33.310773 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-677d370a-2c7b-435d-a280-19c93b0978b3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/214749f2-0e21-48de-82a9-352a778a2b97" status: 404 len: 109 microversion: 2.1 time: 0.038387 Aug 29 15:35:33.310773 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1386/2744] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:33 2022] DELETE /compute/v2.1/flavors/214749f2-0e21-48de-82a9-352a778a2b97 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:33.391927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ef91cdf-421b-4a13-ade2-dab19173b52b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:33.393927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ef91cdf-421b-4a13-ade2-dab19173b52b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:33.408259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef91cdf-421b-4a13-ade2-dab19173b52b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.409904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef91cdf-421b-4a13-ade2-dab19173b52b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.410393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef91cdf-421b-4a13-ade2-dab19173b52b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.411163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef91cdf-421b-4a13-ade2-dab19173b52b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.411627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef91cdf-421b-4a13-ade2-dab19173b52b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.415807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef91cdf-421b-4a13-ade2-dab19173b52b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.610436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5ef91cdf-421b-4a13-ade2-dab19173b52b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:33.627451 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ef91cdf-421b-4a13-ade2-dab19173b52b tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 200 len: 1441 microversion: 2.1 time: 0.239442 Aug 29 15:35:33.629419 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1387/2745] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:33 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 1441 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:33.635222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1980819226", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:33.751786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] validate_networks() for None {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:35:33.800928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:33.860027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:33.910987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-806f1917-481e-46a2-b966-c79f1a6dc419 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:33.934934 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-806f1917-481e-46a2-b966-c79f1a6dc419 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1318 microversion: 2.1 time: 0.805961 Aug 29 15:35:33.936507 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1359/2746] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:33 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1318 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:33.942554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-fea52d65-853d-45bc-bde7-dba7af39a45c req-2bcf3154-8206-49db-99af-dd4f307365f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b00ee0c9-6348-4a38-a096-53fcbded92c7", "name": "network-vif-deleted", "tag": "fc2e3960-31a2-4784-b5a4-edc91e5a8f77"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:33.955585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fea52d65-853d-45bc-bde7-dba7af39a45c req-2bcf3154-8206-49db-99af-dd4f307365f2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:33.956716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fea52d65-853d-45bc-bde7-dba7af39a45c req-2bcf3154-8206-49db-99af-dd4f307365f2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:33.957734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fea52d65-853d-45bc-bde7-dba7af39a45c req-2bcf3154-8206-49db-99af-dd4f307365f2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:33.979433 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-fea52d65-853d-45bc-bde7-dba7af39a45c req-2bcf3154-8206-49db-99af-dd4f307365f2 service nova] Creating event network-vif-deleted:fc2e3960-31a2-4784-b5a4-edc91e5a8f77 for instance b00ee0c9-6348-4a38-a096-53fcbded92c7 on n-h2-839401-11 Aug 29 15:35:33.991672 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-fea52d65-853d-45bc-bde7-dba7af39a45c req-2bcf3154-8206-49db-99af-dd4f307365f2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053131 Aug 29 15:35:33.993436 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1360/2747] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:34.151038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5fb8caa5-dead-48aa-b41e-167516bcb66f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:34.151741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5fb8caa5-dead-48aa-b41e-167516bcb66f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:34.163442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fb8caa5-dead-48aa-b41e-167516bcb66f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.166378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fb8caa5-dead-48aa-b41e-167516bcb66f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.167964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fb8caa5-dead-48aa-b41e-167516bcb66f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.172993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fb8caa5-dead-48aa-b41e-167516bcb66f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.173524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fb8caa5-dead-48aa-b41e-167516bcb66f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.174142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fb8caa5-dead-48aa-b41e-167516bcb66f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.357711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:35:34.358473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:35:34.359212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:35:34.359772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:35:34.360331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:35:34.373794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.374290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.374729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.375468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.375922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.376341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.400248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Getting quotas for project cac390dda11d4f38983e1478de0dbde1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:35:34.407693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Getting quotas for user e57b95d059f74c7a894903b5a8f933df and project cac390dda11d4f38983e1478de0dbde1. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:35:34.423682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:35:34.427054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:35:34.510023 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-52d87600-e2fc-4638-8e65-5d4ed8597c2f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876955 Aug 29 15:35:34.510865 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1388/2748] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:35:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:35:34.520400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bb0ecbf5-198a-4a4a-bc8b-eb1695c34b88 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:34.523032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bb0ecbf5-198a-4a4a-bc8b-eb1695c34b88 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:34.535444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb0ecbf5-198a-4a4a-bc8b-eb1695c34b88 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.536124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb0ecbf5-198a-4a4a-bc8b-eb1695c34b88 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.536839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb0ecbf5-198a-4a4a-bc8b-eb1695c34b88 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.537609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb0ecbf5-198a-4a4a-bc8b-eb1695c34b88 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.538557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb0ecbf5-198a-4a4a-bc8b-eb1695c34b88 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.538996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb0ecbf5-198a-4a4a-bc8b-eb1695c34b88 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.840130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bb0ecbf5-198a-4a4a-bc8b-eb1695c34b88 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:34.858367 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bb0ecbf5-198a-4a4a-bc8b-eb1695c34b88 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1320 microversion: 2.1 time: 0.344915 Aug 29 15:35:34.860357 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1389/2749] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:34 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1320 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:34.867040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-8327bab1-6ffc-4cf3-8c1e-5fe0ce4972af req-deff2c0b-ebca-47cb-8e01-8353c9f32d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74984943-d6e3-4b74-b251-f05fff364c27", "name": "network-vif-plugged", "status": "completed", "tag": "f5fdbe76-975e-466c-9d17-812c0ec39457"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:34.880218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8327bab1-6ffc-4cf3-8c1e-5fe0ce4972af req-deff2c0b-ebca-47cb-8e01-8353c9f32d33 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:34.881060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8327bab1-6ffc-4cf3-8c1e-5fe0ce4972af req-deff2c0b-ebca-47cb-8e01-8353c9f32d33 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:34.881909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8327bab1-6ffc-4cf3-8c1e-5fe0ce4972af req-deff2c0b-ebca-47cb-8e01-8353c9f32d33 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:34.901017 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-8327bab1-6ffc-4cf3-8c1e-5fe0ce4972af req-deff2c0b-ebca-47cb-8e01-8353c9f32d33 service nova] Creating event network-vif-plugged:f5fdbe76-975e-466c-9d17-812c0ec39457 for instance 74984943-d6e3-4b74-b251-f05fff364c27 on n-h2-839401-11 Aug 29 15:35:34.909133 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-8327bab1-6ffc-4cf3-8c1e-5fe0ce4972af req-deff2c0b-ebca-47cb-8e01-8353c9f32d33 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046964 Aug 29 15:35:34.910357 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1390/2750] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:34.917877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6f6358df-00e3-4c63-b61d-705de21a0cc7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:34.918907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6f6358df-00e3-4c63-b61d-705de21a0cc7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:35.001515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6f6358df-00e3-4c63-b61d-705de21a0cc7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:35.010409 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6f6358df-00e3-4c63-b61d-705de21a0cc7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1213 microversion: 2.1 time: 0.097728 Aug 29 15:35:35.013429 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1391/2751] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:34 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:35.023073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-614189e6-81eb-4e59-a584-729524438bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:35.026206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-614189e6-81eb-4e59-a584-729524438bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: b00ee0c9-6348-4a38-a096-53fcbded92c7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:35.033021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5fb8caa5-dead-48aa-b41e-167516bcb66f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:35.042085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-614189e6-81eb-4e59-a584-729524438bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.042816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-614189e6-81eb-4e59-a584-729524438bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.044201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-614189e6-81eb-4e59-a584-729524438bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.045388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-614189e6-81eb-4e59-a584-729524438bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.048411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-614189e6-81eb-4e59-a584-729524438bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.050165 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5fb8caa5-dead-48aa-b41e-167516bcb66f tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1314 microversion: 2.1 time: 0.903703 Aug 29 15:35:35.050387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-614189e6-81eb-4e59-a584-729524438bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.051380 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1361/2752] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:34 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1314 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:35.056397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-34305285-a50c-48c4-9e92-bb4d2520606b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:35.061493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-34305285-a50c-48c4-9e92-bb4d2520606b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:35.083698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34305285-a50c-48c4-9e92-bb4d2520606b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.084564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34305285-a50c-48c4-9e92-bb4d2520606b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.085212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34305285-a50c-48c4-9e92-bb4d2520606b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.086144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34305285-a50c-48c4-9e92-bb4d2520606b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.086710 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-614189e6-81eb-4e59-a584-729524438bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] HTTP exception thrown: Instance b00ee0c9-6348-4a38-a096-53fcbded92c7 could not be found. Aug 29 15:35:35.087388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34305285-a50c-48c4-9e92-bb4d2520606b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.091400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34305285-a50c-48c4-9e92-bb4d2520606b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-614189e6-81eb-4e59-a584-729524438bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Request method failure captured: Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 HTTP/1.1 Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqyZh8cI-S3BYoWeV3ZIfZCv7DYX3-5WfzhenLF0YzuUQMBghE0z6ME5UmGWOt4xbbbGLqBULo6GaH6pRRu9-2b_A1IVr9F7L4OLv0EFzrIZPENt1NXLQB8NULNfiQZCm1XXw040O0zJ6baE9-jONzixjWhGU8m6PJ9mS52C-B9D-A Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 31544ac2992c46aa8fecdff53a43ae42 Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-LiveMigrationTest-445924921 Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31544ac2992c46aa8fecdff53a43ae42", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31544ac2992c46aa8fecdff53a43ae42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31544ac2992c46aa8fecdff53a43ae42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31544ac2992c46aa8fecdff53a43ae42"}]}] Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-LiveMigrationTest-445924921 Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 31544ac2992c46aa8fecdff53a43ae42 Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-LiveMigrationTest-445924921 Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-LiveMigrationTest-445924921-project Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 498e44c8a15f451ba8ff39eff4156075 Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-LiveMigrationTest-445924921-project Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance b00ee0c9-6348-4a38-a096-53fcbded92c7 could not be found. Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b00ee0c9-6348-4a38-a096-53fcbded92c7'} Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b00ee0c9-6348-4a38-a096-53fcbded92c7 could not be found. Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b00ee0c9-6348-4a38-a096-53fcbded92c7 could not be found. Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:35.092654 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:35.098853 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:35.098853 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:35.098853 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:35.098853 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:35.098853 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:35.098853 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b00ee0c9-6348-4a38-a096-53fcbded92c7 could not be found. Aug 29 15:35:35.098853 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:35.098853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-614189e6-81eb-4e59-a584-729524438bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Returning 404 to user: Instance b00ee0c9-6348-4a38-a096-53fcbded92c7 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:35.098853 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-614189e6-81eb-4e59-a584-729524438bc0 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7" status: 404 len: 111 microversion: 2.1 time: 0.080875 Aug 29 15:35:35.106331 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1392/2753] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:35 2022] GET /compute/v2.1/servers/b00ee0c9-6348-4a38-a096-53fcbded92c7 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:35.118007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9f4b0064-5b6f-487e-8c22-52d6b9916329 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:35.122968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9f4b0064-5b6f-487e-8c22-52d6b9916329 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:35.136420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f4b0064-5b6f-487e-8c22-52d6b9916329 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.136923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f4b0064-5b6f-487e-8c22-52d6b9916329 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.137393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f4b0064-5b6f-487e-8c22-52d6b9916329 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.138114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f4b0064-5b6f-487e-8c22-52d6b9916329 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.138567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f4b0064-5b6f-487e-8c22-52d6b9916329 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.138991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f4b0064-5b6f-487e-8c22-52d6b9916329 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.223669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9f4b0064-5b6f-487e-8c22-52d6b9916329 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:35.441347 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9f4b0064-5b6f-487e-8c22-52d6b9916329 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 204 len: 0 microversion: 2.1 time: 0.333098 Aug 29 15:35:35.442373 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1393/2754] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:35 2022] DELETE /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:35:35.454632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-45eff042-de3d-475b-999e-f3b7b1a95353 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:35.455918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-45eff042-de3d-475b-999e-f3b7b1a95353 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:35.462933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45eff042-de3d-475b-999e-f3b7b1a95353 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.463620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45eff042-de3d-475b-999e-f3b7b1a95353 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.464216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45eff042-de3d-475b-999e-f3b7b1a95353 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.465165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45eff042-de3d-475b-999e-f3b7b1a95353 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.465778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45eff042-de3d-475b-999e-f3b7b1a95353 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.466360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45eff042-de3d-475b-999e-f3b7b1a95353 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.611034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-34305285-a50c-48c4-9e92-bb4d2520606b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:35.627175 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-34305285-a50c-48c4-9e92-bb4d2520606b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1318 microversion: 2.1 time: 0.574477 Aug 29 15:35:35.629049 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1362/2755] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:35 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:35.634009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-45eff042-de3d-475b-999e-f3b7b1a95353 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:35.644569 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-45eff042-de3d-475b-999e-f3b7b1a95353 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1501 microversion: 2.1 time: 0.197839 Aug 29 15:35:35.645603 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1394/2756] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:35 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1501 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:35.881939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3edeadb1-dca1-4c77-93ed-37870c39c8c5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:35.883175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3edeadb1-dca1-4c77-93ed-37870c39c8c5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:35.896996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3edeadb1-dca1-4c77-93ed-37870c39c8c5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.897805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3edeadb1-dca1-4c77-93ed-37870c39c8c5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.899197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3edeadb1-dca1-4c77-93ed-37870c39c8c5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.900130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3edeadb1-dca1-4c77-93ed-37870c39c8c5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:35.901360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3edeadb1-dca1-4c77-93ed-37870c39c8c5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:35.901986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3edeadb1-dca1-4c77-93ed-37870c39c8c5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:35.931589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:36.034507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6e9428be-46a4-4366-8842-a5820a6f7534 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:36.035200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6e9428be-46a4-4366-8842-a5820a6f7534 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:36.052873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9428be-46a4-4366-8842-a5820a6f7534 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.053429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9428be-46a4-4366-8842-a5820a6f7534 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.053866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9428be-46a4-4366-8842-a5820a6f7534 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.054593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9428be-46a4-4366-8842-a5820a6f7534 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.055046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9428be-46a4-4366-8842-a5820a6f7534 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.055453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9428be-46a4-4366-8842-a5820a6f7534 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.159650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6e9428be-46a4-4366-8842-a5820a6f7534 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:36.184367 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6e9428be-46a4-4366-8842-a5820a6f7534 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1265 microversion: 2.1 time: 0.156801 Aug 29 15:35:36.187165 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1395/2757] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:36 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:36.193657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-11d229bc-309a-4744-8f13-dfa9e0850050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:36.194267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-11d229bc-309a-4744-8f13-dfa9e0850050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:36.202501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11d229bc-309a-4744-8f13-dfa9e0850050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.202905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11d229bc-309a-4744-8f13-dfa9e0850050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.203345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11d229bc-309a-4744-8f13-dfa9e0850050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.204030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11d229bc-309a-4744-8f13-dfa9e0850050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.204748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11d229bc-309a-4744-8f13-dfa9e0850050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.205381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11d229bc-309a-4744-8f13-dfa9e0850050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.483278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-11d229bc-309a-4744-8f13-dfa9e0850050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:36.493602 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-11d229bc-309a-4744-8f13-dfa9e0850050 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1500 microversion: 2.1 time: 0.304995 Aug 29 15:35:36.495286 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1396/2758] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:36 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1500 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:36.516266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e303b1cd-ed37-41e6-addd-af1672d0b7d0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:36.517129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e303b1cd-ed37-41e6-addd-af1672d0b7d0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:36.525376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e303b1cd-ed37-41e6-addd-af1672d0b7d0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.526440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e303b1cd-ed37-41e6-addd-af1672d0b7d0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.527093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e303b1cd-ed37-41e6-addd-af1672d0b7d0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.528253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e303b1cd-ed37-41e6-addd-af1672d0b7d0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.528922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e303b1cd-ed37-41e6-addd-af1672d0b7d0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.529857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e303b1cd-ed37-41e6-addd-af1672d0b7d0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.562811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-e303b1cd-ed37-41e6-addd-af1672d0b7d0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lazy-loading 'flavor' on Instance uuid 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:36.677816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:36.692982 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e303b1cd-ed37-41e6-addd-af1672d0b7d0 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "POST /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5/action" status: 202 len: 0 microversion: 2.1 time: 0.180535 Aug 29 15:35:36.697709 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1397/2759] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:35:36 2022] POST /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:35:36.703573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dc9b2e15-1bf3-46e3-953d-f08215b19360 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:36.704619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dc9b2e15-1bf3-46e3-953d-f08215b19360 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:36.712255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc9b2e15-1bf3-46e3-953d-f08215b19360 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.713174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc9b2e15-1bf3-46e3-953d-f08215b19360 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.713484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc9b2e15-1bf3-46e3-953d-f08215b19360 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.714415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc9b2e15-1bf3-46e3-953d-f08215b19360 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.715165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc9b2e15-1bf3-46e3-953d-f08215b19360 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.715743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc9b2e15-1bf3-46e3-953d-f08215b19360 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.763211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3edeadb1-dca1-4c77-93ed-37870c39c8c5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:36.777925 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3edeadb1-dca1-4c77-93ed-37870c39c8c5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1320 microversion: 2.1 time: 0.901301 Aug 29 15:35:36.782081 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1363/2760] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:35 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1320 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:36.797729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fac3d244-9cff-41de-b016-bb732665a6e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:36.798723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fac3d244-9cff-41de-b016-bb732665a6e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:36.810134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fac3d244-9cff-41de-b016-bb732665a6e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.813612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fac3d244-9cff-41de-b016-bb732665a6e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.814296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fac3d244-9cff-41de-b016-bb732665a6e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.815396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fac3d244-9cff-41de-b016-bb732665a6e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.816205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fac3d244-9cff-41de-b016-bb732665a6e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.817869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fac3d244-9cff-41de-b016-bb732665a6e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.908914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dc9b2e15-1bf3-46e3-953d-f08215b19360 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:36.924166 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dc9b2e15-1bf3-46e3-953d-f08215b19360 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1318 microversion: 2.1 time: 0.225034 Aug 29 15:35:36.925771 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1398/2761] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:36 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:36.946815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2f828ecd-e4b2-47f5-a8b1-853fcf01e451 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:36.947338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2f828ecd-e4b2-47f5-a8b1-853fcf01e451 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:36.953927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f828ecd-e4b2-47f5-a8b1-853fcf01e451 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.954504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f828ecd-e4b2-47f5-a8b1-853fcf01e451 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.954952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f828ecd-e4b2-47f5-a8b1-853fcf01e451 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:36.955709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f828ecd-e4b2-47f5-a8b1-853fcf01e451 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:36.956175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f828ecd-e4b2-47f5-a8b1-853fcf01e451 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:36.956755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f828ecd-e4b2-47f5-a8b1-853fcf01e451 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.126440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2f828ecd-e4b2-47f5-a8b1-853fcf01e451 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:37.134651 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2f828ecd-e4b2-47f5-a8b1-853fcf01e451 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1508 microversion: 2.1 time: 0.207324 Aug 29 15:35:37.135355 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1399/2762] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:36 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1508 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:37.266017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1140194732", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": "none"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:37.323545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:35:37.323954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:35:37.324441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:35:37.324850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:35:37.325288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:35:37.334592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.335087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.335519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.336433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.336891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.337340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.355993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Getting quotas for project eb11c811f8be4235afdc24c2554bfc62. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:35:37.361434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Getting quotas for user d87f5c77dc8e409696ae6beed439082d and project eb11c811f8be4235afdc24c2554bfc62. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:35:37.373821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:35:37.376163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:35:37.394857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fac3d244-9cff-41de-b016-bb732665a6e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:37.404216 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fac3d244-9cff-41de-b016-bb732665a6e3 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1501 microversion: 2.1 time: 0.620646 Aug 29 15:35:37.404912 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1364/2763] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:36 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1501 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:37.422776 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4890bac7-eee9-432d-a9bb-376b59d34122 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.286325 Aug 29 15:35:37.429187 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1400/2764] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:35:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 288 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:35:37.429187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-82e4eef5-d562-4e0e-80dc-e091e973dae9 req-3d1d8aff-b841-4292-a752-cb3e859c985f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "923c4a5b-679a-41e3-9d6b-f7bbcc603db3", "tag": "cc2e791e-3b26-47d3-98e5-ffbbe4d0c8e7"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:37.445144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-3ad29a81-b073-4cdd-a292-06286ecbe984 req-c6c0e00b-0889-4bc5-a3aa-025640673a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ec48cd-e9ba-44a3-b2b0-a2a5945d6eba", "name": "network-vif-plugged", "status": "completed", "tag": "7ffbc6b9-8e38-4e87-9d09-f05205023aad"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:37.450543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-82e4eef5-d562-4e0e-80dc-e091e973dae9 req-3d1d8aff-b841-4292-a752-cb3e859c985f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.451074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-82e4eef5-d562-4e0e-80dc-e091e973dae9 req-3d1d8aff-b841-4292-a752-cb3e859c985f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.451732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-82e4eef5-d562-4e0e-80dc-e091e973dae9 req-3d1d8aff-b841-4292-a752-cb3e859c985f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.469695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3ad29a81-b073-4cdd-a292-06286ecbe984 req-c6c0e00b-0889-4bc5-a3aa-025640673a70 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.469849 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-82e4eef5-d562-4e0e-80dc-e091e973dae9 req-3d1d8aff-b841-4292-a752-cb3e859c985f service nova] Creating event network-changed:cc2e791e-3b26-47d3-98e5-ffbbe4d0c8e7 for instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 on n-h2-839401-11 Aug 29 15:35:37.470663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3ad29a81-b073-4cdd-a292-06286ecbe984 req-c6c0e00b-0889-4bc5-a3aa-025640673a70 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.471459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3ad29a81-b073-4cdd-a292-06286ecbe984 req-c6c0e00b-0889-4bc5-a3aa-025640673a70 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.476609 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-82e4eef5-d562-4e0e-80dc-e091e973dae9 req-3d1d8aff-b841-4292-a752-cb3e859c985f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051688 Aug 29 15:35:37.477696 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1401/2765] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:37.485474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a86adc11-4d5b-4b28-8297-a7d9d3ee2570 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:37.486221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a86adc11-4d5b-4b28-8297-a7d9d3ee2570 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:37.494417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a86adc11-4d5b-4b28-8297-a7d9d3ee2570 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.495169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a86adc11-4d5b-4b28-8297-a7d9d3ee2570 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.495927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a86adc11-4d5b-4b28-8297-a7d9d3ee2570 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.496793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a86adc11-4d5b-4b28-8297-a7d9d3ee2570 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.497437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a86adc11-4d5b-4b28-8297-a7d9d3ee2570 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.498020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a86adc11-4d5b-4b28-8297-a7d9d3ee2570 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.501975 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-3ad29a81-b073-4cdd-a292-06286ecbe984 req-c6c0e00b-0889-4bc5-a3aa-025640673a70 service nova] Creating event network-vif-plugged:7ffbc6b9-8e38-4e87-9d09-f05205023aad for instance c3ec48cd-e9ba-44a3-b2b0-a2a5945d6eba on n-h1-839401-11 Aug 29 15:35:37.519323 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-3ad29a81-b073-4cdd-a292-06286ecbe984 req-c6c0e00b-0889-4bc5-a3aa-025640673a70 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077252 Aug 29 15:35:37.524366 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1365/2766] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:37.534235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-22ae0d9a-2514-49ba-8697-4abc277b594c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:37.540905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-22ae0d9a-2514-49ba-8697-4abc277b594c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:37.610665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a86adc11-4d5b-4b28-8297-a7d9d3ee2570 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:37.622954 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a86adc11-4d5b-4b28-8297-a7d9d3ee2570 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1271 microversion: 2.1 time: 0.143846 Aug 29 15:35:37.626960 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1402/2767] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:37 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:37.693882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-22ae0d9a-2514-49ba-8697-4abc277b594c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:37.705470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-22ae0d9a-2514-49ba-8697-4abc277b594c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:37.707054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-22ae0d9a-2514-49ba-8697-4abc277b594c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:37.710533 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-22ae0d9a-2514-49ba-8697-4abc277b594c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1278 microversion: 2.54 time: 0.184848 Aug 29 15:35:37.713187 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1366/2768] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:37 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:37.806859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-14f88cde-3a3b-415a-af04-bc24b76f5aa5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:37.807800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-14f88cde-3a3b-415a-af04-bc24b76f5aa5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:37.818327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14f88cde-3a3b-415a-af04-bc24b76f5aa5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.820618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14f88cde-3a3b-415a-af04-bc24b76f5aa5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.822746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14f88cde-3a3b-415a-af04-bc24b76f5aa5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.823827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14f88cde-3a3b-415a-af04-bc24b76f5aa5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.824941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14f88cde-3a3b-415a-af04-bc24b76f5aa5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.827327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14f88cde-3a3b-415a-af04-bc24b76f5aa5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.949538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7123fa3b-737e-4240-84cd-a6dde3e30e16 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:37.950403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7123fa3b-737e-4240-84cd-a6dde3e30e16 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:37.975518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7123fa3b-737e-4240-84cd-a6dde3e30e16 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.976791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7123fa3b-737e-4240-84cd-a6dde3e30e16 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.979531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7123fa3b-737e-4240-84cd-a6dde3e30e16 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:37.980453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7123fa3b-737e-4240-84cd-a6dde3e30e16 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:37.981048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7123fa3b-737e-4240-84cd-a6dde3e30e16 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:37.983067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7123fa3b-737e-4240-84cd-a6dde3e30e16 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.272778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-14f88cde-3a3b-415a-af04-bc24b76f5aa5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:38.284244 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-14f88cde-3a3b-415a-af04-bc24b76f5aa5 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1320 microversion: 2.1 time: 0.481510 Aug 29 15:35:38.300533 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1403/2769] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:37 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1320 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:38.309165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bf6bc71d-d0e2-48e8-974b-c7a3fdbf9353 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:38.310895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bf6bc71d-d0e2-48e8-974b-c7a3fdbf9353 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:38.329292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf6bc71d-d0e2-48e8-974b-c7a3fdbf9353 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.330070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf6bc71d-d0e2-48e8-974b-c7a3fdbf9353 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.330729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf6bc71d-d0e2-48e8-974b-c7a3fdbf9353 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.335098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf6bc71d-d0e2-48e8-974b-c7a3fdbf9353 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.335772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf6bc71d-d0e2-48e8-974b-c7a3fdbf9353 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.336362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf6bc71d-d0e2-48e8-974b-c7a3fdbf9353 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.496385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7123fa3b-737e-4240-84cd-a6dde3e30e16 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:38.505107 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7123fa3b-737e-4240-84cd-a6dde3e30e16 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1318 microversion: 2.1 time: 0.561935 Aug 29 15:35:38.513166 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1367/2770] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:37 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:38.519882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0c88fcb7-ddf5-431d-a1ff-e73aba18caea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:38.521793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0c88fcb7-ddf5-431d-a1ff-e73aba18caea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:38.538559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c88fcb7-ddf5-431d-a1ff-e73aba18caea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.539367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c88fcb7-ddf5-431d-a1ff-e73aba18caea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.540035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c88fcb7-ddf5-431d-a1ff-e73aba18caea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.542549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c88fcb7-ddf5-431d-a1ff-e73aba18caea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.543239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c88fcb7-ddf5-431d-a1ff-e73aba18caea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.544482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c88fcb7-ddf5-431d-a1ff-e73aba18caea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.615553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c88fcb7-ddf5-431d-a1ff-e73aba18caea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.616298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c88fcb7-ddf5-431d-a1ff-e73aba18caea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.616885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c88fcb7-ddf5-431d-a1ff-e73aba18caea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.617507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-0c88fcb7-ddf5-431d-a1ff-e73aba18caea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lazy-loading 'fault' on Instance uuid f5a6423f-2bd0-4c93-acc1-3cec1fe811ff {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:38.752665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bf6bc71d-d0e2-48e8-974b-c7a3fdbf9353 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:38.761329 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bf6bc71d-d0e2-48e8-974b-c7a3fdbf9353 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1491 microversion: 2.1 time: 0.459238 Aug 29 15:35:38.762536 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1404/2771] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:38 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1491 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:38.769401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b22ad87-d77c-4242-a149-7879546c926d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:38.770326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6b22ad87-d77c-4242-a149-7879546c926d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:38.779824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0c88fcb7-ddf5-431d-a1ff-e73aba18caea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:38.794821 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0c88fcb7-ddf5-431d-a1ff-e73aba18caea tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1301 microversion: 2.1 time: 0.279120 Aug 29 15:35:38.795795 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1368/2772] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:38 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1301 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:38.803949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b22ad87-d77c-4242-a149-7879546c926d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.805637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b22ad87-d77c-4242-a149-7879546c926d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.807856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b22ad87-d77c-4242-a149-7879546c926d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.812739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-394d3647-08f4-4452-9322-d791fd62312a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:38.813682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-394d3647-08f4-4452-9322-d791fd62312a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:38.817345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b22ad87-d77c-4242-a149-7879546c926d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.824180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b22ad87-d77c-4242-a149-7879546c926d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.827319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b22ad87-d77c-4242-a149-7879546c926d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.831844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-394d3647-08f4-4452-9322-d791fd62312a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.836578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-394d3647-08f4-4452-9322-d791fd62312a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.837064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-394d3647-08f4-4452-9322-d791fd62312a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:38.837870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-394d3647-08f4-4452-9322-d791fd62312a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:38.838350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-394d3647-08f4-4452-9322-d791fd62312a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:38.840553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-394d3647-08f4-4452-9322-d791fd62312a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.103204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-394d3647-08f4-4452-9322-d791fd62312a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:39.115245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-394d3647-08f4-4452-9322-d791fd62312a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:39.117691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-394d3647-08f4-4452-9322-d791fd62312a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:39.119534 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-394d3647-08f4-4452-9322-d791fd62312a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1330 microversion: 2.54 time: 0.315978 Aug 29 15:35:39.120662 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1369/2773] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:38 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1330 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:39.125260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b22ad87-d77c-4242-a149-7879546c926d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:39.133902 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6b22ad87-d77c-4242-a149-7879546c926d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1313 microversion: 2.1 time: 0.369715 Aug 29 15:35:39.152650 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1405/2774] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:38 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:39.157548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1a9d910d-2726-4ea6-89bd-48bdf249d6ab tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:39.158994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1a9d910d-2726-4ea6-89bd-48bdf249d6ab tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:39.165778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a9d910d-2726-4ea6-89bd-48bdf249d6ab tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.166363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a9d910d-2726-4ea6-89bd-48bdf249d6ab tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.166865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a9d910d-2726-4ea6-89bd-48bdf249d6ab tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.167648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a9d910d-2726-4ea6-89bd-48bdf249d6ab tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.168171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a9d910d-2726-4ea6-89bd-48bdf249d6ab tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.168998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a9d910d-2726-4ea6-89bd-48bdf249d6ab tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.200270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1a9d910d-2726-4ea6-89bd-48bdf249d6ab tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:39.307230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-edc802d9-6409-4b0f-8cfd-cfe78f013429 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:39.309343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-edc802d9-6409-4b0f-8cfd-cfe78f013429 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:39.323233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edc802d9-6409-4b0f-8cfd-cfe78f013429 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.324236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edc802d9-6409-4b0f-8cfd-cfe78f013429 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.324890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edc802d9-6409-4b0f-8cfd-cfe78f013429 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.325825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edc802d9-6409-4b0f-8cfd-cfe78f013429 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.328752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edc802d9-6409-4b0f-8cfd-cfe78f013429 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.329958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edc802d9-6409-4b0f-8cfd-cfe78f013429 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.389810 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1a9d910d-2726-4ea6-89bd-48bdf249d6ab tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 204 len: 0 microversion: 2.1 time: 0.239859 Aug 29 15:35:39.393841 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1370/2775] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:39 2022] DELETE /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:35:39.403519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb6d0649-b775-4148-b8ea-306019fe7cb9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:39.404227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bb6d0649-b775-4148-b8ea-306019fe7cb9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:39.420218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb6d0649-b775-4148-b8ea-306019fe7cb9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.420665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb6d0649-b775-4148-b8ea-306019fe7cb9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.421761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb6d0649-b775-4148-b8ea-306019fe7cb9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.424592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb6d0649-b775-4148-b8ea-306019fe7cb9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.425075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb6d0649-b775-4148-b8ea-306019fe7cb9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.425538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb6d0649-b775-4148-b8ea-306019fe7cb9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.692633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bb6d0649-b775-4148-b8ea-306019fe7cb9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:39.706693 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bb6d0649-b775-4148-b8ea-306019fe7cb9 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1497 microversion: 2.1 time: 0.309785 Aug 29 15:35:39.707614 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1371/2776] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:39 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1497 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:39.712438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-9009128f-a827-486f-96b5-c792fe149e8c req-48655af6-e780-41b6-a1aa-3fc1f3f1f114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a6423f-2bd0-4c93-acc1-3cec1fe811ff", "name": "network-vif-deleted", "tag": "e0ec5ed9-c9fd-4c5d-98bc-c1fe2504891d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:39.725886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-edc802d9-6409-4b0f-8cfd-cfe78f013429 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:39.726566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9009128f-a827-486f-96b5-c792fe149e8c req-48655af6-e780-41b6-a1aa-3fc1f3f1f114 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.727050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9009128f-a827-486f-96b5-c792fe149e8c req-48655af6-e780-41b6-a1aa-3fc1f3f1f114 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.727483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9009128f-a827-486f-96b5-c792fe149e8c req-48655af6-e780-41b6-a1aa-3fc1f3f1f114 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.735645 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-edc802d9-6409-4b0f-8cfd-cfe78f013429 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1320 microversion: 2.1 time: 0.432267 Aug 29 15:35:39.737994 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1406/2777] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:39 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1320 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:39.753334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c9368e9c-6cea-417a-aba2-58aa56296fb3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:39.754269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c9368e9c-6cea-417a-aba2-58aa56296fb3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:39.755012 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-9009128f-a827-486f-96b5-c792fe149e8c req-48655af6-e780-41b6-a1aa-3fc1f3f1f114 service nova] Creating event network-vif-deleted:e0ec5ed9-c9fd-4c5d-98bc-c1fe2504891d for instance f5a6423f-2bd0-4c93-acc1-3cec1fe811ff on n-h2-839401-11 Aug 29 15:35:39.760944 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-9009128f-a827-486f-96b5-c792fe149e8c req-48655af6-e780-41b6-a1aa-3fc1f3f1f114 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051802 Aug 29 15:35:39.761185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9368e9c-6cea-417a-aba2-58aa56296fb3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.761630 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1372/2778] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:39.762553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9368e9c-6cea-417a-aba2-58aa56296fb3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.762866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9368e9c-6cea-417a-aba2-58aa56296fb3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.763712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9368e9c-6cea-417a-aba2-58aa56296fb3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.764199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9368e9c-6cea-417a-aba2-58aa56296fb3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.764644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9368e9c-6cea-417a-aba2-58aa56296fb3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.767051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-7d75b222-0f86-4aa1-8b88-dbf3b849fc35 req-5515f6ac-d3d2-4f61-99dd-dc4d5738b59b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc999f5d-20a5-4d24-830d-115be27f060c", "name": "network-vif-plugged", "status": "completed", "tag": "fcb0f450-5a4d-4679-8a1f-67418fa2243a"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:39.777968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7d75b222-0f86-4aa1-8b88-dbf3b849fc35 req-5515f6ac-d3d2-4f61-99dd-dc4d5738b59b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.778688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7d75b222-0f86-4aa1-8b88-dbf3b849fc35 req-5515f6ac-d3d2-4f61-99dd-dc4d5738b59b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.779829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7d75b222-0f86-4aa1-8b88-dbf3b849fc35 req-5515f6ac-d3d2-4f61-99dd-dc4d5738b59b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.795979 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-7d75b222-0f86-4aa1-8b88-dbf3b849fc35 req-5515f6ac-d3d2-4f61-99dd-dc4d5738b59b service nova] Creating event network-vif-plugged:fcb0f450-5a4d-4679-8a1f-67418fa2243a for instance fc999f5d-20a5-4d24-830d-115be27f060c on n-h1-839401-11 Aug 29 15:35:39.801323 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-7d75b222-0f86-4aa1-8b88-dbf3b849fc35 req-5515f6ac-d3d2-4f61-99dd-dc4d5738b59b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038167 Aug 29 15:35:39.806154 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1373/2779] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:39.817002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ee7ae0c7-f693-4102-9bdb-38d7bbf59309 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:39.817925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ee7ae0c7-f693-4102-9bdb-38d7bbf59309 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:39.824278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee7ae0c7-f693-4102-9bdb-38d7bbf59309 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.824770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee7ae0c7-f693-4102-9bdb-38d7bbf59309 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.825236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee7ae0c7-f693-4102-9bdb-38d7bbf59309 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.825942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee7ae0c7-f693-4102-9bdb-38d7bbf59309 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.826403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee7ae0c7-f693-4102-9bdb-38d7bbf59309 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.826841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee7ae0c7-f693-4102-9bdb-38d7bbf59309 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.862087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee7ae0c7-f693-4102-9bdb-38d7bbf59309 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:39.862583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee7ae0c7-f693-4102-9bdb-38d7bbf59309 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:39.863229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee7ae0c7-f693-4102-9bdb-38d7bbf59309 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:39.863841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-ee7ae0c7-f693-4102-9bdb-38d7bbf59309 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lazy-loading 'fault' on Instance uuid f5a6423f-2bd0-4c93-acc1-3cec1fe811ff {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:39.907559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ee7ae0c7-f693-4102-9bdb-38d7bbf59309 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:39.917321 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ee7ae0c7-f693-4102-9bdb-38d7bbf59309 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1301 microversion: 2.1 time: 0.104846 Aug 29 15:35:39.917925 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1374/2780] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:39 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1301 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:40.149588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-08fee828-5911-4888-af1e-ce8341ac02f6 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:40.149588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-08fee828-5911-4888-af1e-ce8341ac02f6 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:40.162158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08fee828-5911-4888-af1e-ce8341ac02f6 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.162810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08fee828-5911-4888-af1e-ce8341ac02f6 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.163732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08fee828-5911-4888-af1e-ce8341ac02f6 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.164556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08fee828-5911-4888-af1e-ce8341ac02f6 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.165151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08fee828-5911-4888-af1e-ce8341ac02f6 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.165686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08fee828-5911-4888-af1e-ce8341ac02f6 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.264003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-08fee828-5911-4888-af1e-ce8341ac02f6 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:40.274393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-08fee828-5911-4888-af1e-ce8341ac02f6 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:40.276232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-08fee828-5911-4888-af1e-ce8341ac02f6 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:40.278724 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-08fee828-5911-4888-af1e-ce8341ac02f6 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1330 microversion: 2.54 time: 0.134330 Aug 29 15:35:40.279711 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1375/2781] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:40 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1330 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:35:40.285869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ed06d222-f8ab-4f72-892f-7e6aef510236 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:40.286496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ed06d222-f8ab-4f72-892f-7e6aef510236 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:40.298659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed06d222-f8ab-4f72-892f-7e6aef510236 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.299418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed06d222-f8ab-4f72-892f-7e6aef510236 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.299933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed06d222-f8ab-4f72-892f-7e6aef510236 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.301325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed06d222-f8ab-4f72-892f-7e6aef510236 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.301874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed06d222-f8ab-4f72-892f-7e6aef510236 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.302694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed06d222-f8ab-4f72-892f-7e6aef510236 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.352718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c9368e9c-6cea-417a-aba2-58aa56296fb3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:40.366125 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c9368e9c-6cea-417a-aba2-58aa56296fb3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1318 microversion: 2.1 time: 0.626689 Aug 29 15:35:40.367424 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1407/2782] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:39 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:40.471734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ed06d222-f8ab-4f72-892f-7e6aef510236 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:40.480811 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ed06d222-f8ab-4f72-892f-7e6aef510236 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1313 microversion: 2.1 time: 0.199958 Aug 29 15:35:40.494436 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1376/2783] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:40 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:40.731200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-93286451-8466-4c66-b88a-0c64fbe322e4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:40.732079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-93286451-8466-4c66-b88a-0c64fbe322e4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:40.740640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93286451-8466-4c66-b88a-0c64fbe322e4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.741233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93286451-8466-4c66-b88a-0c64fbe322e4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.742030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93286451-8466-4c66-b88a-0c64fbe322e4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.742895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93286451-8466-4c66-b88a-0c64fbe322e4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.743532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93286451-8466-4c66-b88a-0c64fbe322e4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.744113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93286451-8466-4c66-b88a-0c64fbe322e4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.759641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b119e7a-d53a-4f95-9ebb-06a7c8de4bc0 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:40.760607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4b119e7a-d53a-4f95-9ebb-06a7c8de4bc0 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:40.772626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b119e7a-d53a-4f95-9ebb-06a7c8de4bc0 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.773489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b119e7a-d53a-4f95-9ebb-06a7c8de4bc0 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.774079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b119e7a-d53a-4f95-9ebb-06a7c8de4bc0 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.774931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b119e7a-d53a-4f95-9ebb-06a7c8de4bc0 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.775843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b119e7a-d53a-4f95-9ebb-06a7c8de4bc0 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.777993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b119e7a-d53a-4f95-9ebb-06a7c8de4bc0 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.931366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4b119e7a-d53a-4f95-9ebb-06a7c8de4bc0 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:40.939585 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4b119e7a-d53a-4f95-9ebb-06a7c8de4bc0 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1320 microversion: 2.1 time: 0.183760 Aug 29 15:35:40.940297 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1377/2784] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:40 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:40.945474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9ed4b1a9-1939-4821-9247-4fd6e3a61724 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:40.946332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9ed4b1a9-1939-4821-9247-4fd6e3a61724 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:40.952421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ed4b1a9-1939-4821-9247-4fd6e3a61724 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.952994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ed4b1a9-1939-4821-9247-4fd6e3a61724 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.953471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ed4b1a9-1939-4821-9247-4fd6e3a61724 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.954166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ed4b1a9-1939-4821-9247-4fd6e3a61724 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.954626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ed4b1a9-1939-4821-9247-4fd6e3a61724 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.955072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ed4b1a9-1939-4821-9247-4fd6e3a61724 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.996242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ed4b1a9-1939-4821-9247-4fd6e3a61724 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:40.996938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ed4b1a9-1939-4821-9247-4fd6e3a61724 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:40.997555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ed4b1a9-1939-4821-9247-4fd6e3a61724 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:40.998009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-9ed4b1a9-1939-4821-9247-4fd6e3a61724 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lazy-loading 'fault' on Instance uuid f5a6423f-2bd0-4c93-acc1-3cec1fe811ff {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:41.002984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-93286451-8466-4c66-b88a-0c64fbe322e4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:41.011278 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-93286451-8466-4c66-b88a-0c64fbe322e4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1497 microversion: 2.1 time: 0.284795 Aug 29 15:35:41.014590 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1408/2785] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:40 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1497 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:41.045134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9ed4b1a9-1939-4821-9247-4fd6e3a61724 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:41.052932 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9ed4b1a9-1939-4821-9247-4fd6e3a61724 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1301 microversion: 2.1 time: 0.111691 Aug 29 15:35:41.053554 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1378/2786] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:40 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1301 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:41.304975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0a799602-00e4-4fcb-aefd-d70d9f03d3a2 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:41.305633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0a799602-00e4-4fcb-aefd-d70d9f03d3a2 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:41.312529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a799602-00e4-4fcb-aefd-d70d9f03d3a2 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.313328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a799602-00e4-4fcb-aefd-d70d9f03d3a2 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.313760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a799602-00e4-4fcb-aefd-d70d9f03d3a2 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:41.314455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a799602-00e4-4fcb-aefd-d70d9f03d3a2 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.314909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a799602-00e4-4fcb-aefd-d70d9f03d3a2 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.315366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a799602-00e4-4fcb-aefd-d70d9f03d3a2 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:41.388794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-539d8681-8a85-4984-8f0a-657756d0d153 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:41.389728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-539d8681-8a85-4984-8f0a-657756d0d153 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:41.422847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-539d8681-8a85-4984-8f0a-657756d0d153 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.423730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-539d8681-8a85-4984-8f0a-657756d0d153 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.425140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-539d8681-8a85-4984-8f0a-657756d0d153 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:41.426279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-539d8681-8a85-4984-8f0a-657756d0d153 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.428390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-539d8681-8a85-4984-8f0a-657756d0d153 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.429125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-539d8681-8a85-4984-8f0a-657756d0d153 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:41.439974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0a799602-00e4-4fcb-aefd-d70d9f03d3a2 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:41.450250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0a799602-00e4-4fcb-aefd-d70d9f03d3a2 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:41.451918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0a799602-00e4-4fcb-aefd-d70d9f03d3a2 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:41.468952 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0a799602-00e4-4fcb-aefd-d70d9f03d3a2 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1330 microversion: 2.54 time: 0.153226 Aug 29 15:35:41.470849 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1409/2787] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:41 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1330 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:41.503960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a058cfbe-d3f6-450c-933f-3b5fed6f035f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:41.504589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a058cfbe-d3f6-450c-933f-3b5fed6f035f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:41.507986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:41.515271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a058cfbe-d3f6-450c-933f-3b5fed6f035f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.515951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a058cfbe-d3f6-450c-933f-3b5fed6f035f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.516672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a058cfbe-d3f6-450c-933f-3b5fed6f035f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:41.517630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a058cfbe-d3f6-450c-933f-3b5fed6f035f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.518299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a058cfbe-d3f6-450c-933f-3b5fed6f035f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.518876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a058cfbe-d3f6-450c-933f-3b5fed6f035f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:41.692782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a058cfbe-d3f6-450c-933f-3b5fed6f035f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:41.706280 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a058cfbe-d3f6-450c-933f-3b5fed6f035f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1313 microversion: 2.1 time: 0.205634 Aug 29 15:35:41.721344 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1410/2788] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:41 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:41.960155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f4e5a5a2-07bb-412e-b308-324aec48e885 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:41.961117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f4e5a5a2-07bb-412e-b308-324aec48e885 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:41.967904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4e5a5a2-07bb-412e-b308-324aec48e885 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.968404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4e5a5a2-07bb-412e-b308-324aec48e885 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.968844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4e5a5a2-07bb-412e-b308-324aec48e885 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:41.969581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4e5a5a2-07bb-412e-b308-324aec48e885 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:41.970257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4e5a5a2-07bb-412e-b308-324aec48e885 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:41.970683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4e5a5a2-07bb-412e-b308-324aec48e885 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.198438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-539d8681-8a85-4984-8f0a-657756d0d153 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:42.209554 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-539d8681-8a85-4984-8f0a-657756d0d153 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1318 microversion: 2.1 time: 0.826181 Aug 29 15:35:42.211208 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1379/2789] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:41 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1318 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:42.221886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d32d4083-c6b4-4eae-bb9f-1426bdc0c07d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:42.222572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d32d4083-c6b4-4eae-bb9f-1426bdc0c07d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:42.234944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d32d4083-c6b4-4eae-bb9f-1426bdc0c07d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.235288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d32d4083-c6b4-4eae-bb9f-1426bdc0c07d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.235672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d32d4083-c6b4-4eae-bb9f-1426bdc0c07d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.236488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d32d4083-c6b4-4eae-bb9f-1426bdc0c07d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.237002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d32d4083-c6b4-4eae-bb9f-1426bdc0c07d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.237465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d32d4083-c6b4-4eae-bb9f-1426bdc0c07d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.260711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:42.313810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f4e5a5a2-07bb-412e-b308-324aec48e885 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:42.326791 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f4e5a5a2-07bb-412e-b308-324aec48e885 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1320 microversion: 2.1 time: 0.370360 Aug 29 15:35:42.328484 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1411/2790] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:41 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1320 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:42.339122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7d580a85-8a90-46b4-bfd8-76038dc27300 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:42.341879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7d580a85-8a90-46b4-bfd8-76038dc27300 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:42.352938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d580a85-8a90-46b4-bfd8-76038dc27300 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.354120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d580a85-8a90-46b4-bfd8-76038dc27300 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.355428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d580a85-8a90-46b4-bfd8-76038dc27300 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.356473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d580a85-8a90-46b4-bfd8-76038dc27300 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.358624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d580a85-8a90-46b4-bfd8-76038dc27300 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.360197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d580a85-8a90-46b4-bfd8-76038dc27300 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.436294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d580a85-8a90-46b4-bfd8-76038dc27300 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.436781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d580a85-8a90-46b4-bfd8-76038dc27300 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.441605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d580a85-8a90-46b4-bfd8-76038dc27300 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.443571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-7d580a85-8a90-46b4-bfd8-76038dc27300 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lazy-loading 'fault' on Instance uuid f5a6423f-2bd0-4c93-acc1-3cec1fe811ff {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:35:42.677485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7d580a85-8a90-46b4-bfd8-76038dc27300 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498e44c8a15f451ba8ff39eff4156075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31544ac2992c46aa8fecdff53a43ae42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:42.690481 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7d580a85-8a90-46b4-bfd8-76038dc27300 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 200 len: 1301 microversion: 2.1 time: 0.359081 Aug 29 15:35:42.705698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d32d4083-c6b4-4eae-bb9f-1426bdc0c07d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbbadfdb27047dd9237f4a1d311867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbbc9e55a8f24d70a82b79243b0fa9e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:42.706313 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1412/2791] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:42 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 1301 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:42.714029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7b671e72-8d42-482a-81c9-9ad0bf6810ae tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:42.714943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7b671e72-8d42-482a-81c9-9ad0bf6810ae tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:42.722073 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d32d4083-c6b4-4eae-bb9f-1426bdc0c07d tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 200 len: 1497 microversion: 2.1 time: 0.510075 Aug 29 15:35:42.723526 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1380/2792] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:42 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 1497 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:42.728598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dc6b6627-e8a1-4363-a0e2-3b0eb16ce315 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:42.729526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dc6b6627-e8a1-4363-a0e2-3b0eb16ce315 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:42.744882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b671e72-8d42-482a-81c9-9ad0bf6810ae tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.745414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b671e72-8d42-482a-81c9-9ad0bf6810ae tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.746072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b671e72-8d42-482a-81c9-9ad0bf6810ae tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.747185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b671e72-8d42-482a-81c9-9ad0bf6810ae tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.747796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b671e72-8d42-482a-81c9-9ad0bf6810ae tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.748426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b671e72-8d42-482a-81c9-9ad0bf6810ae tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.749370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc6b6627-e8a1-4363-a0e2-3b0eb16ce315 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.750281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc6b6627-e8a1-4363-a0e2-3b0eb16ce315 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.750828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc6b6627-e8a1-4363-a0e2-3b0eb16ce315 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.751623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc6b6627-e8a1-4363-a0e2-3b0eb16ce315 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.752180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc6b6627-e8a1-4363-a0e2-3b0eb16ce315 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.752840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc6b6627-e8a1-4363-a0e2-3b0eb16ce315 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.919158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7b671e72-8d42-482a-81c9-9ad0bf6810ae tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:42.930024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7b671e72-8d42-482a-81c9-9ad0bf6810ae tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:42.931506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7b671e72-8d42-482a-81c9-9ad0bf6810ae tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:42.932670 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7b671e72-8d42-482a-81c9-9ad0bf6810ae tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1338 microversion: 2.54 time: 0.225117 Aug 29 15:35:42.933303 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1413/2793] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:42 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1338 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:42.938628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-eb16ce91-2e0b-4c95-b2de-e752702cef1d req-d76f0084-bbb3-4961-8d65-e97f28d56dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4195b2a3-e1ec-408b-95dc-5ac81dc095e5", "name": "network-vif-deleted", "tag": "2ad06ede-9024-40d5-85e9-a67bfc4eee98"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:42.950393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-eb16ce91-2e0b-4c95-b2de-e752702cef1d req-d76f0084-bbb3-4961-8d65-e97f28d56dba service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:42.951151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-eb16ce91-2e0b-4c95-b2de-e752702cef1d req-d76f0084-bbb3-4961-8d65-e97f28d56dba service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:42.951750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-eb16ce91-2e0b-4c95-b2de-e752702cef1d req-d76f0084-bbb3-4961-8d65-e97f28d56dba service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:42.965802 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-eb16ce91-2e0b-4c95-b2de-e752702cef1d req-d76f0084-bbb3-4961-8d65-e97f28d56dba service nova] Creating event network-vif-deleted:2ad06ede-9024-40d5-85e9-a67bfc4eee98 for instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 on n-h1-839401-11 Aug 29 15:35:42.971728 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-eb16ce91-2e0b-4c95-b2de-e752702cef1d req-d76f0084-bbb3-4961-8d65-e97f28d56dba service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036731 Aug 29 15:35:42.972675 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1414/2794] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:43.225333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dc6b6627-e8a1-4363-a0e2-3b0eb16ce315 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:43.233600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ee40d78d-aaa4-4bf1-923b-a86f26e95b2e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:43.234313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ee40d78d-aaa4-4bf1-923b-a86f26e95b2e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:43.240164 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dc6b6627-e8a1-4363-a0e2-3b0eb16ce315 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1313 microversion: 2.1 time: 0.515280 Aug 29 15:35:43.246828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee40d78d-aaa4-4bf1-923b-a86f26e95b2e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.247331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee40d78d-aaa4-4bf1-923b-a86f26e95b2e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.247814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee40d78d-aaa4-4bf1-923b-a86f26e95b2e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.248305 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1381/2795] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:42 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:43.248484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee40d78d-aaa4-4bf1-923b-a86f26e95b2e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.248937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee40d78d-aaa4-4bf1-923b-a86f26e95b2e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.249459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee40d78d-aaa4-4bf1-923b-a86f26e95b2e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.365774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d31b7e15-05ff-459f-a865-66a445f8a93f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:43.366734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d31b7e15-05ff-459f-a865-66a445f8a93f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:43.378646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d31b7e15-05ff-459f-a865-66a445f8a93f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.379509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d31b7e15-05ff-459f-a865-66a445f8a93f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.380177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d31b7e15-05ff-459f-a865-66a445f8a93f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.381065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d31b7e15-05ff-459f-a865-66a445f8a93f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.382149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d31b7e15-05ff-459f-a865-66a445f8a93f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.384344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d31b7e15-05ff-459f-a865-66a445f8a93f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.447285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ee40d78d-aaa4-4bf1-923b-a86f26e95b2e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:43.456167 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ee40d78d-aaa4-4bf1-923b-a86f26e95b2e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1318 microversion: 2.1 time: 0.226614 Aug 29 15:35:43.457066 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1415/2796] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:43 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:43.714807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-927e250c-5ab2-4d71-a62d-f73263fa5df7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:43.715530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-927e250c-5ab2-4d71-a62d-f73263fa5df7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] [instance: f5a6423f-2bd0-4c93-acc1-3cec1fe811ff] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:43.724170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-927e250c-5ab2-4d71-a62d-f73263fa5df7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.724980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-927e250c-5ab2-4d71-a62d-f73263fa5df7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.725904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-927e250c-5ab2-4d71-a62d-f73263fa5df7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.727531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-927e250c-5ab2-4d71-a62d-f73263fa5df7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.728027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-927e250c-5ab2-4d71-a62d-f73263fa5df7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.728710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-927e250c-5ab2-4d71-a62d-f73263fa5df7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.734806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:43.747461 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-927e250c-5ab2-4d71-a62d-f73263fa5df7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] HTTP exception thrown: Instance f5a6423f-2bd0-4c93-acc1-3cec1fe811ff could not be found. Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-927e250c-5ab2-4d71-a62d-f73263fa5df7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Request method failure captured: Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff HTTP/1.1 Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNqyZh8cI-S3BYoWeV3ZIfZCv7DYX3-5WfzhenLF0YzuUQMBghE0z6ME5UmGWOt4xbbbGLqBULo6GaH6pRRu9-2b_A1IVr9F7L4OLv0EFzrIZPENt1NXLQB8NULNfiQZCm1XXw040O0zJ6baE9-jONzixjWhGU8m6PJ9mS52C-B9D-A Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 31544ac2992c46aa8fecdff53a43ae42 Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-LiveMigrationTest-445924921 Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31544ac2992c46aa8fecdff53a43ae42", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31544ac2992c46aa8fecdff53a43ae42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31544ac2992c46aa8fecdff53a43ae42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31544ac2992c46aa8fecdff53a43ae42"}]}] Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-LiveMigrationTest-445924921 Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 31544ac2992c46aa8fecdff53a43ae42 Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-LiveMigrationTest-445924921 Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-LiveMigrationTest-445924921-project Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 498e44c8a15f451ba8ff39eff4156075 Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-LiveMigrationTest-445924921-project Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance f5a6423f-2bd0-4c93-acc1-3cec1fe811ff could not be found. Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'f5a6423f-2bd0-4c93-acc1-3cec1fe811ff'} Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a6423f-2bd0-4c93-acc1-3cec1fe811ff could not be found. Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a6423f-2bd0-4c93-acc1-3cec1fe811ff could not be found. Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:43.749528 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:43.753226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:43.753226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:43.753226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:43.753226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:43.753226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:43.753226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a6423f-2bd0-4c93-acc1-3cec1fe811ff could not be found. Aug 29 15:35:43.753226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:43.755031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-927e250c-5ab2-4d71-a62d-f73263fa5df7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] Returning 404 to user: Instance f5a6423f-2bd0-4c93-acc1-3cec1fe811ff could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:43.756084 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-927e250c-5ab2-4d71-a62d-f73263fa5df7 tempest-LiveMigrationTest-445924921 tempest-LiveMigrationTest-445924921-project] 10.222.0.62 "GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff" status: 404 len: 111 microversion: 2.1 time: 0.046817 Aug 29 15:35:43.756867 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1416/2797] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:43 2022] GET /compute/v2.1/servers/f5a6423f-2bd0-4c93-acc1-3cec1fe811ff => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:43.767363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-281202dd-1020-4436-afe4-bfc1e8d601b2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:43.768376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-281202dd-1020-4436-afe4-bfc1e8d601b2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:43.779043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d31b7e15-05ff-459f-a865-66a445f8a93f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:43.779547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-281202dd-1020-4436-afe4-bfc1e8d601b2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.779719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-281202dd-1020-4436-afe4-bfc1e8d601b2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.780174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-281202dd-1020-4436-afe4-bfc1e8d601b2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.781637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-281202dd-1020-4436-afe4-bfc1e8d601b2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.782157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-281202dd-1020-4436-afe4-bfc1e8d601b2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.782594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-281202dd-1020-4436-afe4-bfc1e8d601b2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.794122 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d31b7e15-05ff-459f-a865-66a445f8a93f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 200 len: 1508 microversion: 2.1 time: 0.449042 Aug 29 15:35:43.796718 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1382/2798] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:43 2022] GET /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 1508 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:43.797732 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-281202dd-1020-4436-afe4-bfc1e8d601b2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-281202dd-1020-4436-afe4-bfc1e8d601b2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 HTTP/1.1 Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '4195b2a3-e1ec-408b-95dc-5ac81dc095e5'} Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:43.799572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:43.803975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:43.803975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:43.803975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:43.803975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:43.803975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:43.803975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. Aug 29 15:35:43.803975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:43.803975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-281202dd-1020-4436-afe4-bfc1e8d601b2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:43.803975 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-281202dd-1020-4436-afe4-bfc1e8d601b2 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 404 len: 111 microversion: 2.1 time: 0.043050 Aug 29 15:35:43.807097 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1417/2799] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:43 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:43.817722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cad81871-c967-43c3-97ac-f7f7d0be9dae tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:43.817722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cad81871-c967-43c3-97ac-f7f7d0be9dae tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:43.822913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-259411b7-89c9-42c6-8da9-a3f840c771bd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:43.823541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-259411b7-89c9-42c6-8da9-a3f840c771bd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: c3ec48cd-e9ba-44a3-b2b0-a2a5945d6eba] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:43.830939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-259411b7-89c9-42c6-8da9-a3f840c771bd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.831613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-259411b7-89c9-42c6-8da9-a3f840c771bd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.832163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-259411b7-89c9-42c6-8da9-a3f840c771bd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.832903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-259411b7-89c9-42c6-8da9-a3f840c771bd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.833522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-259411b7-89c9-42c6-8da9-a3f840c771bd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.833948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-259411b7-89c9-42c6-8da9-a3f840c771bd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.850296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cad81871-c967-43c3-97ac-f7f7d0be9dae tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.850791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cad81871-c967-43c3-97ac-f7f7d0be9dae tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.851265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cad81871-c967-43c3-97ac-f7f7d0be9dae tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.855878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cad81871-c967-43c3-97ac-f7f7d0be9dae tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.856923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cad81871-c967-43c3-97ac-f7f7d0be9dae tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.857587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cad81871-c967-43c3-97ac-f7f7d0be9dae tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.896396 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-cad81871-c967-43c3-97ac-f7f7d0be9dae tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cad81871-c967-43c3-97ac-f7f7d0be9dae tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 HTTP/1.1 Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '4195b2a3-e1ec-408b-95dc-5ac81dc095e5'} Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:43.902664 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:43.906681 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. Aug 29 15:35:43.906681 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:43.906681 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:43.906681 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:43.906681 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:43.906681 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:43.906681 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:43.906681 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:43.906681 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:43.906681 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. Aug 29 15:35:43.906681 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:43.909481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cad81871-c967-43c3-97ac-f7f7d0be9dae tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:43.910393 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cad81871-c967-43c3-97ac-f7f7d0be9dae tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 404 len: 111 microversion: 2.1 time: 0.102009 Aug 29 15:35:43.915121 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1383/2800] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:43 2022] DELETE /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:43.936683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d8d92932-8b35-4b95-bf6f-466ff1126f68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:43.937313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d8d92932-8b35-4b95-bf6f-466ff1126f68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 4195b2a3-e1ec-408b-95dc-5ac81dc095e5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:43.979453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8d92932-8b35-4b95-bf6f-466ff1126f68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.979982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8d92932-8b35-4b95-bf6f-466ff1126f68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.980439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8d92932-8b35-4b95-bf6f-466ff1126f68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:43.987799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8d92932-8b35-4b95-bf6f-466ff1126f68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:43.993758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8d92932-8b35-4b95-bf6f-466ff1126f68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:43.994269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8d92932-8b35-4b95-bf6f-466ff1126f68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.040695 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-d8d92932-8b35-4b95-bf6f-466ff1126f68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d8d92932-8b35-4b95-bf6f-466ff1126f68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 HTTP/1.1 Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '4195b2a3-e1ec-408b-95dc-5ac81dc095e5'} Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:44.049235 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:44.053070 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:44.053070 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:44.053070 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:44.053070 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:44.053070 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:44.053070 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. Aug 29 15:35:44.053070 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:44.054362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d8d92932-8b35-4b95-bf6f-466ff1126f68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance 4195b2a3-e1ec-408b-95dc-5ac81dc095e5 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:44.055219 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d8d92932-8b35-4b95-bf6f-466ff1126f68 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5" status: 404 len: 111 microversion: 2.1 time: 0.138882 Aug 29 15:35:44.059036 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1384/2801] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:43 2022] GET /compute/v2.1/servers/4195b2a3-e1ec-408b-95dc-5ac81dc095e5 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:44.093744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a469e5bd-4e0d-4eb9-b5b1-a9e80798345a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:44.094672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a469e5bd-4e0d-4eb9-b5b1-a9e80798345a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:44.109422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a469e5bd-4e0d-4eb9-b5b1-a9e80798345a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.112096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a469e5bd-4e0d-4eb9-b5b1-a9e80798345a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.118487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a469e5bd-4e0d-4eb9-b5b1-a9e80798345a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.124740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a469e5bd-4e0d-4eb9-b5b1-a9e80798345a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.129001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a469e5bd-4e0d-4eb9-b5b1-a9e80798345a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.129638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a469e5bd-4e0d-4eb9-b5b1-a9e80798345a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.197143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-259411b7-89c9-42c6-8da9-a3f840c771bd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:44.217812 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-259411b7-89c9-42c6-8da9-a3f840c771bd tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/c3ec48cd-e9ba-44a3-b2b0-a2a5945d6eba" status: 200 len: 1508 microversion: 2.1 time: 0.398733 Aug 29 15:35:44.237077 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1418/2802] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:43 2022] GET /compute/v2.1/servers/c3ec48cd-e9ba-44a3-b2b0-a2a5945d6eba => generated 1508 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:44.252762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-29843bf4-9dad-4230-8e27-f851f6e9f977 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:44.256349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-29843bf4-9dad-4230-8e27-f851f6e9f977 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:44.287125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29843bf4-9dad-4230-8e27-f851f6e9f977 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.293133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29843bf4-9dad-4230-8e27-f851f6e9f977 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.293986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29843bf4-9dad-4230-8e27-f851f6e9f977 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.295014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29843bf4-9dad-4230-8e27-f851f6e9f977 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.295697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29843bf4-9dad-4230-8e27-f851f6e9f977 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.296286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29843bf4-9dad-4230-8e27-f851f6e9f977 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.321426 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-29843bf4-9dad-4230-8e27-f851f6e9f977 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-29843bf4-9dad-4230-8e27-f851f6e9f977 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa HTTP/1.1 Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa'} Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:44.350051 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:44.354163 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. Aug 29 15:35:44.354163 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:44.354163 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:44.354163 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:44.354163 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:44.354163 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:44.354163 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:44.354163 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:44.354163 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:44.354163 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. Aug 29 15:35:44.354163 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:44.361048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-29843bf4-9dad-4230-8e27-f851f6e9f977 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:44.366603 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-29843bf4-9dad-4230-8e27-f851f6e9f977 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 404 len: 111 microversion: 2.1 time: 0.128170 Aug 29 15:35:44.379603 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1419/2803] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:44 2022] DELETE /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:44.385312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-18f639bb-2387-4d9f-8d0a-ef12ad0fc456 req-61a600a6-8d6f-43b1-9ece-d74a842536a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0330d585-be01-45a3-b20a-9ce9cdfbaa43", "tag": "53083e31-a61d-4467-9153-eb9ce7344ee5"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:44.396893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a469e5bd-4e0d-4eb9-b5b1-a9e80798345a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:44.404946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-18f639bb-2387-4d9f-8d0a-ef12ad0fc456 req-61a600a6-8d6f-43b1-9ece-d74a842536a1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.405624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-18f639bb-2387-4d9f-8d0a-ef12ad0fc456 req-61a600a6-8d6f-43b1-9ece-d74a842536a1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.406206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-18f639bb-2387-4d9f-8d0a-ef12ad0fc456 req-61a600a6-8d6f-43b1-9ece-d74a842536a1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.423060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a469e5bd-4e0d-4eb9-b5b1-a9e80798345a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:44.425141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a469e5bd-4e0d-4eb9-b5b1-a9e80798345a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:44.428655 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a469e5bd-4e0d-4eb9-b5b1-a9e80798345a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1336 microversion: 2.54 time: 0.370659 Aug 29 15:35:44.431733 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-18f639bb-2387-4d9f-8d0a-ef12ad0fc456 req-61a600a6-8d6f-43b1-9ece-d74a842536a1 service nova] Creating event network-changed:53083e31-a61d-4467-9153-eb9ce7344ee5 for instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 on n-h2-839401-11 Aug 29 15:35:44.432176 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1385/2804] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:44 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1336 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:44.448080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1299bf44-96f2-40d9-9fc5-27bf70592a9f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:44.448800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1299bf44-96f2-40d9-9fc5-27bf70592a9f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: c3ec48cd-e9ba-44a3-b2b0-a2a5945d6eba] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:44.453548 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-18f639bb-2387-4d9f-8d0a-ef12ad0fc456 req-61a600a6-8d6f-43b1-9ece-d74a842536a1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071989 Aug 29 15:35:44.454431 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1420/2805] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:44.463600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1299bf44-96f2-40d9-9fc5-27bf70592a9f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.466876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-180e81f4-9177-44ab-b71a-e1af6a0368ec tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:44.468052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-180e81f4-9177-44ab-b71a-e1af6a0368ec tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:44.474482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1299bf44-96f2-40d9-9fc5-27bf70592a9f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.479644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1299bf44-96f2-40d9-9fc5-27bf70592a9f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.481022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-180e81f4-9177-44ab-b71a-e1af6a0368ec tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.484455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1299bf44-96f2-40d9-9fc5-27bf70592a9f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.484779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-180e81f4-9177-44ab-b71a-e1af6a0368ec tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.485278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-180e81f4-9177-44ab-b71a-e1af6a0368ec tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.485514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1299bf44-96f2-40d9-9fc5-27bf70592a9f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.486047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-180e81f4-9177-44ab-b71a-e1af6a0368ec tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.486247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1299bf44-96f2-40d9-9fc5-27bf70592a9f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.486550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-180e81f4-9177-44ab-b71a-e1af6a0368ec tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.487018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-180e81f4-9177-44ab-b71a-e1af6a0368ec tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.553992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1299bf44-96f2-40d9-9fc5-27bf70592a9f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: c3ec48cd-e9ba-44a3-b2b0-a2a5945d6eba] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:44.708692 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1299bf44-96f2-40d9-9fc5-27bf70592a9f tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c3ec48cd-e9ba-44a3-b2b0-a2a5945d6eba" status: 204 len: 0 microversion: 2.1 time: 0.274936 Aug 29 15:35:44.709768 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1386/2806] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:44 2022] DELETE /compute/v2.1/servers/c3ec48cd-e9ba-44a3-b2b0-a2a5945d6eba => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:35:44.715336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0918dc5e-8933-4fa7-a0be-5f978d4fefec tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:44.716241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0918dc5e-8933-4fa7-a0be-5f978d4fefec tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:44.722807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0918dc5e-8933-4fa7-a0be-5f978d4fefec tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.723245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0918dc5e-8933-4fa7-a0be-5f978d4fefec tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.723692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0918dc5e-8933-4fa7-a0be-5f978d4fefec tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.724399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0918dc5e-8933-4fa7-a0be-5f978d4fefec tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.724863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0918dc5e-8933-4fa7-a0be-5f978d4fefec tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.725317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0918dc5e-8933-4fa7-a0be-5f978d4fefec tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.749473 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-0918dc5e-8933-4fa7-a0be-5f978d4fefec tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0918dc5e-8933-4fa7-a0be-5f978d4fefec tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa HTTP/1.1 Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa'} Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:44.751908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:44.756000 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:44.756000 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:44.756000 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:44.756000 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:44.756000 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:44.756000 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. Aug 29 15:35:44.756000 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:44.756000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0918dc5e-8933-4fa7-a0be-5f978d4fefec tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance 9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:44.756000 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0918dc5e-8933-4fa7-a0be-5f978d4fefec tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa" status: 404 len: 111 microversion: 2.1 time: 0.044122 Aug 29 15:35:44.756960 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1387/2807] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:44 2022] GET /compute/v2.1/servers/9ef6719f-d3e5-41a8-99a0-3eb8d5e691fa => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:44.764439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e275ae48-ea8d-4800-924d-05a75a9a597d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:44.765641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e275ae48-ea8d-4800-924d-05a75a9a597d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:44.781625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e275ae48-ea8d-4800-924d-05a75a9a597d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.782191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e275ae48-ea8d-4800-924d-05a75a9a597d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.782614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e275ae48-ea8d-4800-924d-05a75a9a597d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.784231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e275ae48-ea8d-4800-924d-05a75a9a597d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.784712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e275ae48-ea8d-4800-924d-05a75a9a597d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.785173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e275ae48-ea8d-4800-924d-05a75a9a597d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.868330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-180e81f4-9177-44ab-b71a-e1af6a0368ec tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:44.886019 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-180e81f4-9177-44ab-b71a-e1af6a0368ec tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1313 microversion: 2.1 time: 0.430547 Aug 29 15:35:44.887729 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1421/2808] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:44 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:44.892939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e61b6869-0491-4569-8830-5565f7799027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:44.893676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e61b6869-0491-4569-8830-5565f7799027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:44.902862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e61b6869-0491-4569-8830-5565f7799027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.903609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e61b6869-0491-4569-8830-5565f7799027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.904200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e61b6869-0491-4569-8830-5565f7799027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.905105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e61b6869-0491-4569-8830-5565f7799027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:44.905763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e61b6869-0491-4569-8830-5565f7799027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:44.906341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e61b6869-0491-4569-8830-5565f7799027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:44.940737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e61b6869-0491-4569-8830-5565f7799027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: fc999f5d-20a5-4d24-830d-115be27f060c] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:35:45.035624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e275ae48-ea8d-4800-924d-05a75a9a597d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:45.046015 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e275ae48-ea8d-4800-924d-05a75a9a597d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1318 microversion: 2.1 time: 0.287954 Aug 29 15:35:45.059620 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1388/2809] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:44 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:45.066217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-16b0376e-bb5b-4dbb-8933-c1c280ca309b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:45.067217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-16b0376e-bb5b-4dbb-8933-c1c280ca309b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:45.068316 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e61b6869-0491-4569-8830-5565f7799027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c" status: 204 len: 0 microversion: 2.1 time: 0.178988 Aug 29 15:35:45.069357 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1422/2810] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:44 2022] DELETE /compute/v2.1/servers/fc999f5d-20a5-4d24-830d-115be27f060c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:35:45.088729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16b0376e-bb5b-4dbb-8933-c1c280ca309b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.089601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16b0376e-bb5b-4dbb-8933-c1c280ca309b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.091087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16b0376e-bb5b-4dbb-8933-c1c280ca309b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.092082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16b0376e-bb5b-4dbb-8933-c1c280ca309b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.092754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16b0376e-bb5b-4dbb-8933-c1c280ca309b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.093461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16b0376e-bb5b-4dbb-8933-c1c280ca309b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.120513 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-16b0376e-bb5b-4dbb-8933-c1c280ca309b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-16b0376e-bb5b-4dbb-8933-c1c280ca309b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 HTTP/1.1 Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2'} Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:45.126290 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:45.129757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. Aug 29 15:35:45.129757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.129757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:45.129757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.129757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.129757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:45.129757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:45.129757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:45.129757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:45.129757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. Aug 29 15:35:45.129757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.132728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-16b0376e-bb5b-4dbb-8933-c1c280ca309b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:45.133953 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-16b0376e-bb5b-4dbb-8933-c1c280ca309b tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 404 len: 111 microversion: 2.1 time: 0.072763 Aug 29 15:35:45.137883 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1389/2811] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:45 2022] DELETE /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:45.144719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-74947713-199c-44d7-822c-5434b915f3df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:45.146330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-74947713-199c-44d7-822c-5434b915f3df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:45.154328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74947713-199c-44d7-822c-5434b915f3df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.154827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74947713-199c-44d7-822c-5434b915f3df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.155265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74947713-199c-44d7-822c-5434b915f3df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.155975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74947713-199c-44d7-822c-5434b915f3df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.156552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74947713-199c-44d7-822c-5434b915f3df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.156973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74947713-199c-44d7-822c-5434b915f3df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.176344 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-74947713-199c-44d7-822c-5434b915f3df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-74947713-199c-44d7-822c-5434b915f3df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 HTTP/1.1 Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2'} Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:45.178468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.182097 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.182097 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:45.182097 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:45.182097 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:45.182097 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:45.182097 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. Aug 29 15:35:45.182097 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.184504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-74947713-199c-44d7-822c-5434b915f3df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance 7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:45.186891 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-74947713-199c-44d7-822c-5434b915f3df tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2" status: 404 len: 111 microversion: 2.1 time: 0.046404 Aug 29 15:35:45.187740 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1423/2812] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:45 2022] GET /compute/v2.1/servers/7fee6e92-5e7a-4d23-9ff3-5fa50fb2b5c2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:45.195965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7c62e8a2-5a43-4037-8ea9-d56233d32488 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:45.196487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7c62e8a2-5a43-4037-8ea9-d56233d32488 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:45.202680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c62e8a2-5a43-4037-8ea9-d56233d32488 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.203082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c62e8a2-5a43-4037-8ea9-d56233d32488 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.203723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c62e8a2-5a43-4037-8ea9-d56233d32488 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.204627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c62e8a2-5a43-4037-8ea9-d56233d32488 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.205369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c62e8a2-5a43-4037-8ea9-d56233d32488 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.206206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c62e8a2-5a43-4037-8ea9-d56233d32488 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.245444 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-7c62e8a2-5a43-4037-8ea9-d56233d32488 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7c62e8a2-5a43-4037-8ea9-d56233d32488 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd HTTP/1.1 Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'c5035af0-406d-4c78-90b3-a679558859bd'} Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:45.250601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:45.254224 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. Aug 29 15:35:45.254224 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.254224 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:45.254224 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.254224 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.254224 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:45.254224 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:45.254224 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:45.254224 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:45.254224 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. Aug 29 15:35:45.254224 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.256315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7c62e8a2-5a43-4037-8ea9-d56233d32488 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:45.257434 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7c62e8a2-5a43-4037-8ea9-d56233d32488 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 404 len: 111 microversion: 2.1 time: 0.065494 Aug 29 15:35:45.261302 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1390/2813] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:45 2022] DELETE /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:45.268351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-86bee289-afe4-4feb-88e7-5b3d14c04be4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:45.269796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-86bee289-afe4-4feb-88e7-5b3d14c04be4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: c5035af0-406d-4c78-90b3-a679558859bd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:45.281594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86bee289-afe4-4feb-88e7-5b3d14c04be4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.282093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86bee289-afe4-4feb-88e7-5b3d14c04be4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.282535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86bee289-afe4-4feb-88e7-5b3d14c04be4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.285134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86bee289-afe4-4feb-88e7-5b3d14c04be4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.285604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86bee289-afe4-4feb-88e7-5b3d14c04be4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.290259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86bee289-afe4-4feb-88e7-5b3d14c04be4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.292989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-893560362", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "ca12b050-adae-47b1-a13e-95c322fca7d9"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:45.323977 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-86bee289-afe4-4feb-88e7-5b3d14c04be4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-86bee289-afe4-4feb-88e7-5b3d14c04be4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd HTTP/1.1 Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'c5035af0-406d-4c78-90b3-a679558859bd'} Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:45.330469 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.334449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.334449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:45.334449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:45.334449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:45.334449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:45.334449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. Aug 29 15:35:45.334449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.334449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-86bee289-afe4-4feb-88e7-5b3d14c04be4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance c5035af0-406d-4c78-90b3-a679558859bd could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:45.335702 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-86bee289-afe4-4feb-88e7-5b3d14c04be4 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd" status: 404 len: 111 microversion: 2.1 time: 0.072546 Aug 29 15:35:45.346296 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1424/2814] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:45 2022] GET /compute/v2.1/servers/c5035af0-406d-4c78-90b3-a679558859bd => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:35:45.351351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8ae3955c-33a6-4139-882c-64cf9a5b61e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:45.351857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8ae3955c-33a6-4139-882c-64cf9a5b61e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 02663235-8b3c-44ab-adab-2cc0d57541bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:45.359834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ae3955c-33a6-4139-882c-64cf9a5b61e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.360327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ae3955c-33a6-4139-882c-64cf9a5b61e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.360765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ae3955c-33a6-4139-882c-64cf9a5b61e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.361516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ae3955c-33a6-4139-882c-64cf9a5b61e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.362002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ae3955c-33a6-4139-882c-64cf9a5b61e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.369580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ae3955c-33a6-4139-882c-64cf9a5b61e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.380931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] validate_networks() for [('ca12b050-adae-47b1-a13e-95c322fca7d9', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:35:45.412155 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-8ae3955c-33a6-4139-882c-64cf9a5b61e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8ae3955c-33a6-4139-882c-64cf9a5b61e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/02663235-8b3c-44ab-adab-2cc0d57541bf HTTP/1.1 Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '02663235-8b3c-44ab-adab-2cc0d57541bf'} Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:45.416183 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:45.420052 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. Aug 29 15:35:45.420052 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.420052 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:45.420052 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.420052 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.420052 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:45.420052 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:45.420052 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:45.420052 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:45.420052 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. Aug 29 15:35:45.420052 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.420052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8ae3955c-33a6-4139-882c-64cf9a5b61e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:45.420052 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8ae3955c-33a6-4139-882c-64cf9a5b61e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "DELETE /compute/v2.1/servers/02663235-8b3c-44ab-adab-2cc0d57541bf" status: 404 len: 111 microversion: 2.1 time: 0.070357 Aug 29 15:35:45.420052 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1425/2815] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:45 2022] DELETE /compute/v2.1/servers/02663235-8b3c-44ab-adab-2cc0d57541bf => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:45.438535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-104c0b6a-f84e-49b2-8c6e-884d163a35ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:45.439278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-104c0b6a-f84e-49b2-8c6e-884d163a35ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 02663235-8b3c-44ab-adab-2cc0d57541bf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:45.457534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-104c0b6a-f84e-49b2-8c6e-884d163a35ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.458149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-104c0b6a-f84e-49b2-8c6e-884d163a35ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.458741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-104c0b6a-f84e-49b2-8c6e-884d163a35ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.459249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-104c0b6a-f84e-49b2-8c6e-884d163a35ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.460833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-104c0b6a-f84e-49b2-8c6e-884d163a35ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.461347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-104c0b6a-f84e-49b2-8c6e-884d163a35ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.482025 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-104c0b6a-f84e-49b2-8c6e-884d163a35ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-104c0b6a-f84e-49b2-8c6e-884d163a35ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/02663235-8b3c-44ab-adab-2cc0d57541bf HTTP/1.1 Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '02663235-8b3c-44ab-adab-2cc0d57541bf'} Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:45.483573 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.487394 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:45.487394 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:45.487394 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:45.487394 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:45.487394 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:45.487394 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. Aug 29 15:35:45.487394 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:45.489250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-104c0b6a-f84e-49b2-8c6e-884d163a35ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance 02663235-8b3c-44ab-adab-2cc0d57541bf could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:45.490378 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-104c0b6a-f84e-49b2-8c6e-884d163a35ce tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/02663235-8b3c-44ab-adab-2cc0d57541bf" status: 404 len: 111 microversion: 2.1 time: 0.056116 Aug 29 15:35:45.494770 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1426/2816] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:45 2022] GET /compute/v2.1/servers/02663235-8b3c-44ab-adab-2cc0d57541bf => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:45.500669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5e0ef415-33d9-405f-8a8b-7202b403c40c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:45.502150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5e0ef415-33d9-405f-8a8b-7202b403c40c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:45.513356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e0ef415-33d9-405f-8a8b-7202b403c40c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.516327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e0ef415-33d9-405f-8a8b-7202b403c40c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.517079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e0ef415-33d9-405f-8a8b-7202b403c40c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.518363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e0ef415-33d9-405f-8a8b-7202b403c40c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.519032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e0ef415-33d9-405f-8a8b-7202b403c40c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.520270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e0ef415-33d9-405f-8a8b-7202b403c40c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.633220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e0ef415-33d9-405f-8a8b-7202b403c40c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:45.659459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e0ef415-33d9-405f-8a8b-7202b403c40c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:45.670870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e0ef415-33d9-405f-8a8b-7202b403c40c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:45.672326 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5e0ef415-33d9-405f-8a8b-7202b403c40c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1336 microversion: 2.54 time: 0.176260 Aug 29 15:35:45.677969 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1427/2817] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:45 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1336 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:45.909527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-116b3eb8-100a-4228-ac7e-9be73182d6b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:45.910771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-116b3eb8-100a-4228-ac7e-9be73182d6b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:45.931203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-116b3eb8-100a-4228-ac7e-9be73182d6b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.937831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-116b3eb8-100a-4228-ac7e-9be73182d6b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.939401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-116b3eb8-100a-4228-ac7e-9be73182d6b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:45.944470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-116b3eb8-100a-4228-ac7e-9be73182d6b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:45.945213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-116b3eb8-100a-4228-ac7e-9be73182d6b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:45.946696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-116b3eb8-100a-4228-ac7e-9be73182d6b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:46.323691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-116b3eb8-100a-4228-ac7e-9be73182d6b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:46.362715 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-116b3eb8-100a-4228-ac7e-9be73182d6b9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1313 microversion: 2.1 time: 0.458394 Aug 29 15:35:46.363326 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1428/2818] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:45 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:46.406425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-ce2f7ff3-f67e-4c93-8020-c01c12ac01e9 req-211747fa-55ba-4da6-a666-96dc8e38843b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923c4a5b-679a-41e3-9d6b-f7bbcc603db3", "name": "network-vif-plugged", "status": "completed", "tag": "cc2e791e-3b26-47d3-98e5-ffbbe4d0c8e7"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:46.425317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ce2f7ff3-f67e-4c93-8020-c01c12ac01e9 req-211747fa-55ba-4da6-a666-96dc8e38843b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:46.425887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ce2f7ff3-f67e-4c93-8020-c01c12ac01e9 req-211747fa-55ba-4da6-a666-96dc8e38843b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:46.426390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ce2f7ff3-f67e-4c93-8020-c01c12ac01e9 req-211747fa-55ba-4da6-a666-96dc8e38843b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:46.441807 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-ce2f7ff3-f67e-4c93-8020-c01c12ac01e9 req-211747fa-55ba-4da6-a666-96dc8e38843b service nova] Creating event network-vif-plugged:cc2e791e-3b26-47d3-98e5-ffbbe4d0c8e7 for instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 on n-h2-839401-11 Aug 29 15:35:46.449929 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-ce2f7ff3-f67e-4c93-8020-c01c12ac01e9 req-211747fa-55ba-4da6-a666-96dc8e38843b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057771 Aug 29 15:35:46.451334 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1429/2819] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:46.457774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-23e72e3e-e352-4f86-b24d-a7bc4a6f5a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:46.459499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-23e72e3e-e352-4f86-b24d-a7bc4a6f5a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:46.474860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e72e3e-e352-4f86-b24d-a7bc4a6f5a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:46.475675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e72e3e-e352-4f86-b24d-a7bc4a6f5a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:46.476364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e72e3e-e352-4f86-b24d-a7bc4a6f5a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:46.477685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e72e3e-e352-4f86-b24d-a7bc4a6f5a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:46.478342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e72e3e-e352-4f86-b24d-a7bc4a6f5a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:46.478955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e72e3e-e352-4f86-b24d-a7bc4a6f5a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:46.799076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-23e72e3e-e352-4f86-b24d-a7bc4a6f5a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:46.808372 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-23e72e3e-e352-4f86-b24d-a7bc4a6f5a32 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1318 microversion: 2.1 time: 0.355521 Aug 29 15:35:46.813888 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1430/2820] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:46 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:46.823755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-db28ab38-8477-43b2-855f-3e90f7e949af tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:46.825174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-db28ab38-8477-43b2-855f-3e90f7e949af tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:46.849651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db28ab38-8477-43b2-855f-3e90f7e949af tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:46.850158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db28ab38-8477-43b2-855f-3e90f7e949af tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:46.850596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db28ab38-8477-43b2-855f-3e90f7e949af tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:46.851406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db28ab38-8477-43b2-855f-3e90f7e949af tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:46.851968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db28ab38-8477-43b2-855f-3e90f7e949af tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:46.852409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db28ab38-8477-43b2-855f-3e90f7e949af tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:46.921059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:35:46.921675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:35:46.921979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:35:46.922438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:35:46.922852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:35:46.933263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:46.933756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:46.934201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:46.935330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:46.936415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:46.937059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:46.958133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Getting quotas for project ab4615dd6897416ca44c89b092e5526d. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:35:46.968815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Getting quotas for user 7138531e3322432c991b0d0b00e3fa63 and project ab4615dd6897416ca44c89b092e5526d. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:35:46.979576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-db28ab38-8477-43b2-855f-3e90f7e949af tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:46.993106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-db28ab38-8477-43b2-855f-3e90f7e949af tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:46.994674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-db28ab38-8477-43b2-855f-3e90f7e949af tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:46.995957 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-db28ab38-8477-43b2-855f-3e90f7e949af tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1336 microversion: 2.54 time: 0.180815 Aug 29 15:35:47.006035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Going to run 2 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:35:47.012324 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1431/2821] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:46 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1336 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:47.012572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b73a7195-711e-46b6-ad0f-a6e38339b2fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:35:47.029289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:47.075435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=b73a7195-711e-46b6-ad0f-a6e38339b2fb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:35:47.171827 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-47b98399-f1e6-4fc1-afb2-ee7623ae8fdb tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.879223 Aug 29 15:35:47.173004 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1391/2822] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:35:45 2022] POST /compute/v2.1/servers => generated 32 bytes in 1885 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:35:47.181459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-efd886b1-8c43-400d-b0e1-f6a75c348443 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:47.186581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-efd886b1-8c43-400d-b0e1-f6a75c348443 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:47.187397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-efd886b1-8c43-400d-b0e1-f6a75c348443 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Searching by: {'deleted': False, 'project_id': 'ab4615dd6897416ca44c89b092e5526d'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:35:47.207346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efd886b1-8c43-400d-b0e1-f6a75c348443 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:47.208336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efd886b1-8c43-400d-b0e1-f6a75c348443 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:47.208993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efd886b1-8c43-400d-b0e1-f6a75c348443 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:47.209951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efd886b1-8c43-400d-b0e1-f6a75c348443 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:47.210620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efd886b1-8c43-400d-b0e1-f6a75c348443 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:47.211239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efd886b1-8c43-400d-b0e1-f6a75c348443 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:47.240386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-efd886b1-8c43-400d-b0e1-f6a75c348443 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:35:47.288947 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-efd886b1-8c43-400d-b0e1-f6a75c348443 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.111204 Aug 29 15:35:47.302651 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1432/2823] 10.222.0.62 () {58 vars in 1125 bytes} [Mon Aug 29 15:35:47 2022] GET /compute/v2.1/servers => generated 1335 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:47.303983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-751abbe0-ede7-4abe-ab85-2e14d7d3eeff tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:47.305336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-751abbe0-ede7-4abe-ab85-2e14d7d3eeff tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:47.384328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-06b7f346-664b-45b7-8b02-a8c71977ea1a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:47.385162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-06b7f346-664b-45b7-8b02-a8c71977ea1a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:47.387462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=16 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:47.400620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06b7f346-664b-45b7-8b02-a8c71977ea1a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:47.405003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06b7f346-664b-45b7-8b02-a8c71977ea1a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:47.405585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06b7f346-664b-45b7-8b02-a8c71977ea1a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:47.407155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06b7f346-664b-45b7-8b02-a8c71977ea1a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:47.407840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06b7f346-664b-45b7-8b02-a8c71977ea1a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:47.408525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06b7f346-664b-45b7-8b02-a8c71977ea1a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:47.487743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-751abbe0-ede7-4abe-ab85-2e14d7d3eeff tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:47.496617 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-751abbe0-ede7-4abe-ab85-2e14d7d3eeff tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1217 microversion: 2.1 time: 0.198027 Aug 29 15:35:47.513295 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1392/2824] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:47 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1217 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:47.835008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-63f87f18-1f22-4365-9391-baeab3086987 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:47.835630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-63f87f18-1f22-4365-9391-baeab3086987 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:47.848858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63f87f18-1f22-4365-9391-baeab3086987 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:47.849584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63f87f18-1f22-4365-9391-baeab3086987 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:47.851105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63f87f18-1f22-4365-9391-baeab3086987 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:47.852040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63f87f18-1f22-4365-9391-baeab3086987 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:47.854516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63f87f18-1f22-4365-9391-baeab3086987 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:47.855233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63f87f18-1f22-4365-9391-baeab3086987 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.426151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-06b7f346-664b-45b7-8b02-a8c71977ea1a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:48.434196 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-06b7f346-664b-45b7-8b02-a8c71977ea1a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1313 microversion: 2.1 time: 1.054087 Aug 29 15:35:48.452576 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1433/2825] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:47 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1313 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:48.458019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3fa4c180-5d50-4bca-959b-b91a35e8baff tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:48.458880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3fa4c180-5d50-4bca-959b-b91a35e8baff tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:48.466834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3fa4c180-5d50-4bca-959b-b91a35e8baff tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.467605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3fa4c180-5d50-4bca-959b-b91a35e8baff tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.468197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3fa4c180-5d50-4bca-959b-b91a35e8baff tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.469147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3fa4c180-5d50-4bca-959b-b91a35e8baff tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.469760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3fa4c180-5d50-4bca-959b-b91a35e8baff tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.470359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3fa4c180-5d50-4bca-959b-b91a35e8baff tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.622580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3fa4c180-5d50-4bca-959b-b91a35e8baff tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:48.641378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3fa4c180-5d50-4bca-959b-b91a35e8baff tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:48.646455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3fa4c180-5d50-4bca-959b-b91a35e8baff tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:48.648916 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3fa4c180-5d50-4bca-959b-b91a35e8baff tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1357 microversion: 2.54 time: 0.194957 Aug 29 15:35:48.674814 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1434/2826] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:48 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:48.705378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-63f87f18-1f22-4365-9391-baeab3086987 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:48.716052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-30df8bd4-89f1-48f4-8337-028c94c6e97a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:48.716381 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-63f87f18-1f22-4365-9391-baeab3086987 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1318 microversion: 2.1 time: 0.884962 Aug 29 15:35:48.716698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-30df8bd4-89f1-48f4-8337-028c94c6e97a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:48.733811 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1393/2827] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:47 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1318 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:48.740561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2bfb6d7b-6918-413f-9ac6-9bd6bf463799 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Action: 'create', calling method: .version_select at 0x7fc42aa68700>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1297591306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHIhH/f2UfieB4FFks5vv7RSn5RHNmdoY+VeQxDMleY9+/6EucIidVZo+pg5yffGZUiQkeorQyjbIrhYzxaPgh/ZMagaNHSBMIYWXCXH/+8BlGV9qrq0KX0CYoYTi77IQ=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:48.753073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30df8bd4-89f1-48f4-8337-028c94c6e97a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.757776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30df8bd4-89f1-48f4-8337-028c94c6e97a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.758929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30df8bd4-89f1-48f4-8337-028c94c6e97a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.760331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30df8bd4-89f1-48f4-8337-028c94c6e97a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.761786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-2bfb6d7b-6918-413f-9ac6-9bd6bf463799 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Getting quotas for project eb11c811f8be4235afdc24c2554bfc62. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:35:48.762602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30df8bd4-89f1-48f4-8337-028c94c6e97a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.767137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30df8bd4-89f1-48f4-8337-028c94c6e97a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.771572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-2bfb6d7b-6918-413f-9ac6-9bd6bf463799 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Getting quotas for user d87f5c77dc8e409696ae6beed439082d and project eb11c811f8be4235afdc24c2554bfc62. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:35:48.807342 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2bfb6d7b-6918-413f-9ac6-9bd6bf463799 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.069142 Aug 29 15:35:48.808047 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1394/2828] 10.222.0.62 () {62 vars in 1200 bytes} [Mon Aug 29 15:35:48 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:35:48.859286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1297591306", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:48.862712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:48.893192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.893697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.894140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:48.894861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:48.895368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:48.895764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.096176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:35:49.100286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:35:49.100994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:35:49.101582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:35:49.103446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:35:49.240533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-30df8bd4-89f1-48f4-8337-028c94c6e97a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:49.259203 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-30df8bd4-89f1-48f4-8337-028c94c6e97a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1213 microversion: 2.1 time: 0.567925 Aug 29 15:35:49.261867 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1435/2829] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:48 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1213 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:49.269826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:49.279444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.280336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.281062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.282270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.282966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.283720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.343180 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-77eb3059-8f63-4b1c-82e8-a8450b8ffbdd tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "POST /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a/action" status: 202 len: 1140 microversion: 2.54 time: 0.524491 Aug 29 15:35:49.345027 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1395/2830] 10.222.0.62 () {62 vars in 1320 bytes} [Mon Aug 29 15:35:48 2022] POST /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a/action => generated 1140 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 15:35:49.365879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f957f639-ff6c-4f9c-94f2-a85843a3f753 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:49.366930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f957f639-ff6c-4f9c-94f2-a85843a3f753 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:49.373799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f957f639-ff6c-4f9c-94f2-a85843a3f753 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.374738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f957f639-ff6c-4f9c-94f2-a85843a3f753 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.375359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f957f639-ff6c-4f9c-94f2-a85843a3f753 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.376648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f957f639-ff6c-4f9c-94f2-a85843a3f753 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.377824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f957f639-ff6c-4f9c-94f2-a85843a3f753 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.378539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f957f639-ff6c-4f9c-94f2-a85843a3f753 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.463565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2787da7b-f53b-4dda-abfb-dc64a8e91304 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:49.464702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2787da7b-f53b-4dda-abfb-dc64a8e91304 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:49.479448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2787da7b-f53b-4dda-abfb-dc64a8e91304 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.479956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2787da7b-f53b-4dda-abfb-dc64a8e91304 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.480949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2787da7b-f53b-4dda-abfb-dc64a8e91304 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.481981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2787da7b-f53b-4dda-abfb-dc64a8e91304 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.482635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2787da7b-f53b-4dda-abfb-dc64a8e91304 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.483219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2787da7b-f53b-4dda-abfb-dc64a8e91304 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.584258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f957f639-ff6c-4f9c-94f2-a85843a3f753 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:49.597847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:49.605830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f957f639-ff6c-4f9c-94f2-a85843a3f753 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:49.610303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f957f639-ff6c-4f9c-94f2-a85843a3f753 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:49.618264 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f957f639-ff6c-4f9c-94f2-a85843a3f753 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.256361 Aug 29 15:35:49.629543 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1436/2831] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:49 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:49.637123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a06830d0-51ba-4d94-bf86-b732554a70fe req-b29099b7-383e-4bd8-9ade-ff6831b984d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc999f5d-20a5-4d24-830d-115be27f060c", "name": "network-vif-deleted", "tag": "fcb0f450-5a4d-4679-8a1f-67418fa2243a"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:49.684092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a06830d0-51ba-4d94-bf86-b732554a70fe req-b29099b7-383e-4bd8-9ade-ff6831b984d2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.685666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a06830d0-51ba-4d94-bf86-b732554a70fe req-b29099b7-383e-4bd8-9ade-ff6831b984d2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.686296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a06830d0-51ba-4d94-bf86-b732554a70fe req-b29099b7-383e-4bd8-9ade-ff6831b984d2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.711497 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a06830d0-51ba-4d94-bf86-b732554a70fe req-b29099b7-383e-4bd8-9ade-ff6831b984d2 service nova] Creating event network-vif-deleted:fcb0f450-5a4d-4679-8a1f-67418fa2243a for instance fc999f5d-20a5-4d24-830d-115be27f060c on n-h1-839401-11 Aug 29 15:35:49.718102 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a06830d0-51ba-4d94-bf86-b732554a70fe req-b29099b7-383e-4bd8-9ade-ff6831b984d2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094842 Aug 29 15:35:49.719357 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1437/2832] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:49.742072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-999fd1fa-2e5f-4d21-b90f-fc7ee24ef45f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:49.742803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-999fd1fa-2e5f-4d21-b90f-fc7ee24ef45f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:49.754791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-999fd1fa-2e5f-4d21-b90f-fc7ee24ef45f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.755386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-999fd1fa-2e5f-4d21-b90f-fc7ee24ef45f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.755835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-999fd1fa-2e5f-4d21-b90f-fc7ee24ef45f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:49.756549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-999fd1fa-2e5f-4d21-b90f-fc7ee24ef45f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:49.757016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-999fd1fa-2e5f-4d21-b90f-fc7ee24ef45f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:49.757487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-999fd1fa-2e5f-4d21-b90f-fc7ee24ef45f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.503805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-999fd1fa-2e5f-4d21-b90f-fc7ee24ef45f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:50.512231 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-999fd1fa-2e5f-4d21-b90f-fc7ee24ef45f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1318 microversion: 2.1 time: 0.775595 Aug 29 15:35:50.533556 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1438/2833] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:49 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1318 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:50.540877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fcfa3b84-bed5-42b7-bf7c-9bae3aef8027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:50.554090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fcfa3b84-bed5-42b7-bf7c-9bae3aef8027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:50.560826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcfa3b84-bed5-42b7-bf7c-9bae3aef8027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.561571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcfa3b84-bed5-42b7-bf7c-9bae3aef8027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.562220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcfa3b84-bed5-42b7-bf7c-9bae3aef8027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.563089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcfa3b84-bed5-42b7-bf7c-9bae3aef8027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.563722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcfa3b84-bed5-42b7-bf7c-9bae3aef8027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.564314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcfa3b84-bed5-42b7-bf7c-9bae3aef8027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.676979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2787da7b-f53b-4dda-abfb-dc64a8e91304 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:50.685252 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2787da7b-f53b-4dda-abfb-dc64a8e91304 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1313 microversion: 2.1 time: 1.229370 Aug 29 15:35:50.705285 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1396/2834] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:49 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1313 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:50.705285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-188296cd-1006-4395-a4f6-7e3d4e77de1c req-48cd0bf6-bd4a-4d5e-b71e-77334aafc669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ec48cd-e9ba-44a3-b2b0-a2a5945d6eba", "name": "network-vif-deleted", "tag": "7ffbc6b9-8e38-4e87-9d09-f05205023aad"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:50.719131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-188296cd-1006-4395-a4f6-7e3d4e77de1c req-48cd0bf6-bd4a-4d5e-b71e-77334aafc669 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.724323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-188296cd-1006-4395-a4f6-7e3d4e77de1c req-48cd0bf6-bd4a-4d5e-b71e-77334aafc669 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.729181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-188296cd-1006-4395-a4f6-7e3d4e77de1c req-48cd0bf6-bd4a-4d5e-b71e-77334aafc669 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.743666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fcfa3b84-bed5-42b7-bf7c-9bae3aef8027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:50.753706 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fcfa3b84-bed5-42b7-bf7c-9bae3aef8027 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1287 microversion: 2.1 time: 0.218669 Aug 29 15:35:50.769962 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-188296cd-1006-4395-a4f6-7e3d4e77de1c req-48cd0bf6-bd4a-4d5e-b71e-77334aafc669 service nova] Creating event network-vif-deleted:7ffbc6b9-8e38-4e87-9d09-f05205023aad for instance c3ec48cd-e9ba-44a3-b2b0-a2a5945d6eba on n-h1-839401-11 Aug 29 15:35:50.777581 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1439/2835] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:50 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1287 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:50.782770 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-188296cd-1006-4395-a4f6-7e3d4e77de1c req-48cd0bf6-bd4a-4d5e-b71e-77334aafc669 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086021 Aug 29 15:35:50.782977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f4e3d9c1-c50b-4232-a161-1b2b8f8ec293 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:50.783540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f4e3d9c1-c50b-4232-a161-1b2b8f8ec293 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:50.786204 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1397/2836] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:50.805432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4e3d9c1-c50b-4232-a161-1b2b8f8ec293 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.806736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4e3d9c1-c50b-4232-a161-1b2b8f8ec293 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.807521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4e3d9c1-c50b-4232-a161-1b2b8f8ec293 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:50.808401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4e3d9c1-c50b-4232-a161-1b2b8f8ec293 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:50.809300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4e3d9c1-c50b-4232-a161-1b2b8f8ec293 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:50.809887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4e3d9c1-c50b-4232-a161-1b2b8f8ec293 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.020633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f4e3d9c1-c50b-4232-a161-1b2b8f8ec293 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:51.036300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f4e3d9c1-c50b-4232-a161-1b2b8f8ec293 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:51.037789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f4e3d9c1-c50b-4232-a161-1b2b8f8ec293 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:51.038978 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f4e3d9c1-c50b-4232-a161-1b2b8f8ec293 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.260203 Aug 29 15:35:51.039584 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1440/2837] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:50 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:51.291775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a4b1a4fa-c42a-40f3-9eb0-84a4fb525d9a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:51.292360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a4b1a4fa-c42a-40f3-9eb0-84a4fb525d9a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:51.301028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4b1a4fa-c42a-40f3-9eb0-84a4fb525d9a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.302692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4b1a4fa-c42a-40f3-9eb0-84a4fb525d9a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.303338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4b1a4fa-c42a-40f3-9eb0-84a4fb525d9a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.304419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4b1a4fa-c42a-40f3-9eb0-84a4fb525d9a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.305289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4b1a4fa-c42a-40f3-9eb0-84a4fb525d9a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.306129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4b1a4fa-c42a-40f3-9eb0-84a4fb525d9a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.322925 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-a4b1a4fa-c42a-40f3-9eb0-84a4fb525d9a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a4b1a4fa-c42a-40f3-9eb0-84a4fb525d9a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c HTTP/1.1 Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '16758bc6-5ab1-42fc-8f6f-fe955bf6f83c'} Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:51.324640 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:51.329062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:35:51.329062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.329062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:51.329062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.329062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:51.329062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:51.329062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:51.329062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:51.329062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:51.329062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:35:51.329062 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.329062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a4b1a4fa-c42a-40f3-9eb0-84a4fb525d9a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:51.329062 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a4b1a4fa-c42a-40f3-9eb0-84a4fb525d9a tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "DELETE /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 404 len: 111 microversion: 2.1 time: 0.038758 Aug 29 15:35:51.332802 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1398/2838] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:51 2022] DELETE /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:51.336385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8c97c9ba-f8c6-4e71-92c3-0aff5cfaf5e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:51.337140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8c97c9ba-f8c6-4e71-92c3-0aff5cfaf5e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:51.344174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c97c9ba-f8c6-4e71-92c3-0aff5cfaf5e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.344746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c97c9ba-f8c6-4e71-92c3-0aff5cfaf5e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.345339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c97c9ba-f8c6-4e71-92c3-0aff5cfaf5e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.346164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c97c9ba-f8c6-4e71-92c3-0aff5cfaf5e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.346691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c97c9ba-f8c6-4e71-92c3-0aff5cfaf5e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.347130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c97c9ba-f8c6-4e71-92c3-0aff5cfaf5e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.363960 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-8c97c9ba-f8c6-4e71-92c3-0aff5cfaf5e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8c97c9ba-f8c6-4e71-92c3-0aff5cfaf5e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c HTTP/1.1 Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '16758bc6-5ab1-42fc-8f6f-fe955bf6f83c'} Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:51.365956 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.372272 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:51.372272 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:51.372272 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:51.372272 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:51.372272 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:51.372272 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. Aug 29 15:35:51.372272 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.372272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8c97c9ba-f8c6-4e71-92c3-0aff5cfaf5e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance 16758bc6-5ab1-42fc-8f6f-fe955bf6f83c could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:51.372272 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8c97c9ba-f8c6-4e71-92c3-0aff5cfaf5e7 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c" status: 404 len: 111 microversion: 2.1 time: 0.035265 Aug 29 15:35:51.372272 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1441/2839] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:51 2022] GET /compute/v2.1/servers/16758bc6-5ab1-42fc-8f6f-fe955bf6f83c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:51.376576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e2d0d2c5-68a7-4ddb-8ec7-dd717dd88899 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:51.377449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e2d0d2c5-68a7-4ddb-8ec7-dd717dd88899 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:51.384084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2d0d2c5-68a7-4ddb-8ec7-dd717dd88899 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.384575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2d0d2c5-68a7-4ddb-8ec7-dd717dd88899 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.385013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2d0d2c5-68a7-4ddb-8ec7-dd717dd88899 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.385790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2d0d2c5-68a7-4ddb-8ec7-dd717dd88899 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.386248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2d0d2c5-68a7-4ddb-8ec7-dd717dd88899 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.386673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2d0d2c5-68a7-4ddb-8ec7-dd717dd88899 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.402594 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-e2d0d2c5-68a7-4ddb-8ec7-dd717dd88899 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e2d0d2c5-68a7-4ddb-8ec7-dd717dd88899 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 HTTP/1.1 Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'f59e1efd-a5b5-44ad-98ce-33999d052840'} Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:51.404177 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:51.410660 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. Aug 29 15:35:51.410660 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.410660 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:51.410660 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.410660 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:51.410660 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:51.410660 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:51.410660 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:51.410660 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:51.410660 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. Aug 29 15:35:51.410660 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.410660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e2d0d2c5-68a7-4ddb-8ec7-dd717dd88899 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:51.410660 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e2d0d2c5-68a7-4ddb-8ec7-dd717dd88899 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 404 len: 111 microversion: 2.1 time: 0.033116 Aug 29 15:35:51.410660 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1399/2840] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:35:51 2022] DELETE /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:51.417535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4ba1dd25-abc3-488f-8464-45d178c4b527 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:51.418128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4ba1dd25-abc3-488f-8464-45d178c4b527 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] [instance: f59e1efd-a5b5-44ad-98ce-33999d052840] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:51.424839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba1dd25-abc3-488f-8464-45d178c4b527 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.425445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba1dd25-abc3-488f-8464-45d178c4b527 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.425945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba1dd25-abc3-488f-8464-45d178c4b527 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.426663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba1dd25-abc3-488f-8464-45d178c4b527 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.427116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba1dd25-abc3-488f-8464-45d178c4b527 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.427749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba1dd25-abc3-488f-8464-45d178c4b527 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.444196 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-4ba1dd25-abc3-488f-8464-45d178c4b527 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] HTTP exception thrown: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4ba1dd25-abc3-488f-8464-45d178c4b527 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Request method failure captured: Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 HTTP/1.1 Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNuXMMPeomFt0e-k4M4wky_k_hIKal1128yAD7I58my90UdsA3klZNjABQqnEz2DDonjKZj-OCJgWjBQoXsb61Igo7H1FIYeYPiHmho-7vADXbCHrfMYMgG-oPF6D1gs0xLnc812jQPJrAyKHRqCVJtWImyeL8nqxNmSq0J51zFIH4s Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbbc9e55a8f24d70a82b79243b0fa9e1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbbc9e55a8f24d70a82b79243b0fa9e1"}]}] Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbbc9e55a8f24d70a82b79243b0fa9e1 Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersTestJSON-903334037 Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 8dbbadfdb27047dd9237f4a1d311867e Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersTestJSON-903334037-project Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'f59e1efd-a5b5-44ad-98ce-33999d052840'} Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:35:51.446002 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.450989 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:35:51.450989 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:35:51.450989 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:35:51.450989 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:35:51.450989 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:35:51.450989 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. Aug 29 15:35:51.450989 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:35:51.450989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4ba1dd25-abc3-488f-8464-45d178c4b527 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] Returning 404 to user: Instance f59e1efd-a5b5-44ad-98ce-33999d052840 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:35:51.450989 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4ba1dd25-abc3-488f-8464-45d178c4b527 tempest-DeleteServersTestJSON-903334037 tempest-DeleteServersTestJSON-903334037-project] 10.222.0.62 "GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840" status: 404 len: 111 microversion: 2.1 time: 0.034510 Aug 29 15:35:51.450989 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1442/2841] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:51 2022] GET /compute/v2.1/servers/f59e1efd-a5b5-44ad-98ce-33999d052840 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:35:51.537704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aac05002-7148-4fd3-9fe6-8e487d4fefa1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:51.538584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aac05002-7148-4fd3-9fe6-8e487d4fefa1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:51.555404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aac05002-7148-4fd3-9fe6-8e487d4fefa1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.556303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aac05002-7148-4fd3-9fe6-8e487d4fefa1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.556964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aac05002-7148-4fd3-9fe6-8e487d4fefa1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.557931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aac05002-7148-4fd3-9fe6-8e487d4fefa1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.558552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aac05002-7148-4fd3-9fe6-8e487d4fefa1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.559233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aac05002-7148-4fd3-9fe6-8e487d4fefa1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.718315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a6859597-b353-482f-8cae-e592f981a3e2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:51.719013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a6859597-b353-482f-8cae-e592f981a3e2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:51.728083 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6859597-b353-482f-8cae-e592f981a3e2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.728576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6859597-b353-482f-8cae-e592f981a3e2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.729018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6859597-b353-482f-8cae-e592f981a3e2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.729803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6859597-b353-482f-8cae-e592f981a3e2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:51.730446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6859597-b353-482f-8cae-e592f981a3e2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:51.731028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6859597-b353-482f-8cae-e592f981a3e2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:51.991667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a6859597-b353-482f-8cae-e592f981a3e2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:52.000453 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a6859597-b353-482f-8cae-e592f981a3e2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1313 microversion: 2.1 time: 0.285936 Aug 29 15:35:52.001125 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1443/2842] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:51 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:52.011149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-732a642d-3c68-46df-b9fa-bad917e6a7b2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:52.012033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-732a642d-3c68-46df-b9fa-bad917e6a7b2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:52.018571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-732a642d-3c68-46df-b9fa-bad917e6a7b2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:52.019263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-732a642d-3c68-46df-b9fa-bad917e6a7b2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:52.019705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-732a642d-3c68-46df-b9fa-bad917e6a7b2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:52.020410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-732a642d-3c68-46df-b9fa-bad917e6a7b2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:52.020864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-732a642d-3c68-46df-b9fa-bad917e6a7b2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:52.021479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-732a642d-3c68-46df-b9fa-bad917e6a7b2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:52.051581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aac05002-7148-4fd3-9fe6-8e487d4fefa1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:52.064110 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aac05002-7148-4fd3-9fe6-8e487d4fefa1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1508 microversion: 2.1 time: 0.530889 Aug 29 15:35:52.066346 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1400/2843] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:51 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1508 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:52.073873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-42f6258e-2e03-4f2b-a5d8-8b752c1b2fad tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:52.074743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-42f6258e-2e03-4f2b-a5d8-8b752c1b2fad tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:52.084345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42f6258e-2e03-4f2b-a5d8-8b752c1b2fad tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:52.084943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42f6258e-2e03-4f2b-a5d8-8b752c1b2fad tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:52.086597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42f6258e-2e03-4f2b-a5d8-8b752c1b2fad tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:52.100257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42f6258e-2e03-4f2b-a5d8-8b752c1b2fad tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:52.103626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42f6258e-2e03-4f2b-a5d8-8b752c1b2fad tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:52.104265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42f6258e-2e03-4f2b-a5d8-8b752c1b2fad tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:52.169649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:52.214458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-732a642d-3c68-46df-b9fa-bad917e6a7b2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:52.227104 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-732a642d-3c68-46df-b9fa-bad917e6a7b2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1275 microversion: 2.1 time: 0.224674 Aug 29 15:35:52.228361 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1444/2844] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:52 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1275 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:52.233535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-38f35e12-f6df-4579-8eed-a623dae7bec7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:52.234411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-38f35e12-f6df-4579-8eed-a623dae7bec7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:52.241469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38f35e12-f6df-4579-8eed-a623dae7bec7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:52.242287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38f35e12-f6df-4579-8eed-a623dae7bec7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:52.243052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38f35e12-f6df-4579-8eed-a623dae7bec7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:52.254202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38f35e12-f6df-4579-8eed-a623dae7bec7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:52.254998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38f35e12-f6df-4579-8eed-a623dae7bec7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:52.255556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38f35e12-f6df-4579-8eed-a623dae7bec7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:52.278931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-42f6258e-2e03-4f2b-a5d8-8b752c1b2fad tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:52.289458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-42f6258e-2e03-4f2b-a5d8-8b752c1b2fad tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:52.291902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-42f6258e-2e03-4f2b-a5d8-8b752c1b2fad tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:52.295813 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-42f6258e-2e03-4f2b-a5d8-8b752c1b2fad tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.226896 Aug 29 15:35:52.298431 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1401/2845] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:52 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:52.693206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-38f35e12-f6df-4579-8eed-a623dae7bec7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:52.702432 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-38f35e12-f6df-4579-8eed-a623dae7bec7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1508 microversion: 2.1 time: 0.472544 Aug 29 15:35:52.707728 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1445/2846] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:52 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1508 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:52.731490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5cae6813-c45a-481c-81c5-0ba2179ea3ed tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:52.734502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5cae6813-c45a-481c-81c5-0ba2179ea3ed tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:52.754372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cae6813-c45a-481c-81c5-0ba2179ea3ed tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:52.755370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cae6813-c45a-481c-81c5-0ba2179ea3ed tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:52.756620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cae6813-c45a-481c-81c5-0ba2179ea3ed tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:52.759212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cae6813-c45a-481c-81c5-0ba2179ea3ed tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:52.759717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cae6813-c45a-481c-81c5-0ba2179ea3ed tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:52.763314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cae6813-c45a-481c-81c5-0ba2179ea3ed tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:52.953013 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5cae6813-c45a-481c-81c5-0ba2179ea3ed tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "PUT /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1080 microversion: 2.1 time: 0.225346 Aug 29 15:35:52.971448 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1402/2847] 10.222.0.62 () {60 vars in 1256 bytes} [Mon Aug 29 15:35:52 2022] PUT /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1080 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:52.974616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fdab7680-303f-46b6-9aca-74f0e1c46f84 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:52.975322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fdab7680-303f-46b6-9aca-74f0e1c46f84 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:52.982773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fdab7680-303f-46b6-9aca-74f0e1c46f84 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:52.983370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fdab7680-303f-46b6-9aca-74f0e1c46f84 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:52.984036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fdab7680-303f-46b6-9aca-74f0e1c46f84 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:52.984832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fdab7680-303f-46b6-9aca-74f0e1c46f84 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:52.985560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fdab7680-303f-46b6-9aca-74f0e1c46f84 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:52.993875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fdab7680-303f-46b6-9aca-74f0e1c46f84 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:53.025769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-79576507-3341-41f9-b46e-1b9972082d6f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:53.026695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-79576507-3341-41f9-b46e-1b9972082d6f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:53.039938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79576507-3341-41f9-b46e-1b9972082d6f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:53.042354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79576507-3341-41f9-b46e-1b9972082d6f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:53.042954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79576507-3341-41f9-b46e-1b9972082d6f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:53.045810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79576507-3341-41f9-b46e-1b9972082d6f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:53.047570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79576507-3341-41f9-b46e-1b9972082d6f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:53.048209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79576507-3341-41f9-b46e-1b9972082d6f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:53.321611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-79576507-3341-41f9-b46e-1b9972082d6f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:53.330496 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-79576507-3341-41f9-b46e-1b9972082d6f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1313 microversion: 2.1 time: 0.310946 Aug 29 15:35:53.331646 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1403/2848] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:53 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:53.336503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-563e4e8d-1be0-4683-9cf9-d413afe0f2fe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:53.337133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-563e4e8d-1be0-4683-9cf9-d413afe0f2fe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:53.352622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-563e4e8d-1be0-4683-9cf9-d413afe0f2fe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:53.353396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-563e4e8d-1be0-4683-9cf9-d413afe0f2fe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:53.353981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-563e4e8d-1be0-4683-9cf9-d413afe0f2fe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:53.354973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-563e4e8d-1be0-4683-9cf9-d413afe0f2fe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:53.355580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-563e4e8d-1be0-4683-9cf9-d413afe0f2fe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:53.356188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-563e4e8d-1be0-4683-9cf9-d413afe0f2fe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:53.434589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-563e4e8d-1be0-4683-9cf9-d413afe0f2fe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:53.454902 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-563e4e8d-1be0-4683-9cf9-d413afe0f2fe tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1275 microversion: 2.1 time: 0.112248 Aug 29 15:35:53.454902 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1404/2849] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:53 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1275 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:53.463364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fb940b2c-42bd-423e-89d2-e5657be5e956 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:53.464563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fb940b2c-42bd-423e-89d2-e5657be5e956 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:53.471546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb940b2c-42bd-423e-89d2-e5657be5e956 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:53.472032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb940b2c-42bd-423e-89d2-e5657be5e956 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:53.472477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb940b2c-42bd-423e-89d2-e5657be5e956 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:53.473342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb940b2c-42bd-423e-89d2-e5657be5e956 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:53.474082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb940b2c-42bd-423e-89d2-e5657be5e956 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:53.474560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb940b2c-42bd-423e-89d2-e5657be5e956 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:53.567616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fb940b2c-42bd-423e-89d2-e5657be5e956 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:53.577900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fb940b2c-42bd-423e-89d2-e5657be5e956 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:53.579345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fb940b2c-42bd-423e-89d2-e5657be5e956 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:53.580594 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fb940b2c-42bd-423e-89d2-e5657be5e956 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.133502 Aug 29 15:35:53.581166 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1405/2850] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:53 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:53.655307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fdab7680-303f-46b6-9aca-74f0e1c46f84 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:53.668932 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fdab7680-303f-46b6-9aca-74f0e1c46f84 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1506 microversion: 2.1 time: 0.697614 Aug 29 15:35:53.669594 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1446/2851] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:52 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1506 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:53.690258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b91ada83-499f-44bf-84e8-1424ca6d0d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:53.690877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b91ada83-499f-44bf-84e8-1424ca6d0d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:53.705589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e6a22ddd-5faa-4014-9bbe-518cdb593694 req-c268da97-2f96-493f-95c5-e123d1158608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b73a7195-711e-46b6-ad0f-a6e38339b2fb", "tag": "a669bbc2-3726-4712-8702-e54becdb8f7d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:53.707677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b91ada83-499f-44bf-84e8-1424ca6d0d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:53.708184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b91ada83-499f-44bf-84e8-1424ca6d0d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:53.708621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b91ada83-499f-44bf-84e8-1424ca6d0d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:53.716414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b91ada83-499f-44bf-84e8-1424ca6d0d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:53.716862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b91ada83-499f-44bf-84e8-1424ca6d0d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:53.717333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b91ada83-499f-44bf-84e8-1424ca6d0d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:53.723931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e6a22ddd-5faa-4014-9bbe-518cdb593694 req-c268da97-2f96-493f-95c5-e123d1158608 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:53.724682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e6a22ddd-5faa-4014-9bbe-518cdb593694 req-c268da97-2f96-493f-95c5-e123d1158608 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:53.725403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e6a22ddd-5faa-4014-9bbe-518cdb593694 req-c268da97-2f96-493f-95c5-e123d1158608 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:53.755355 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e6a22ddd-5faa-4014-9bbe-518cdb593694 req-c268da97-2f96-493f-95c5-e123d1158608 service nova] Creating event network-changed:a669bbc2-3726-4712-8702-e54becdb8f7d for instance b73a7195-711e-46b6-ad0f-a6e38339b2fb on n-h1-839401-11 Aug 29 15:35:53.770249 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e6a22ddd-5faa-4014-9bbe-518cdb593694 req-c268da97-2f96-493f-95c5-e123d1158608 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069616 Aug 29 15:35:53.772455 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1447/2852] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:35:53.976664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b91ada83-499f-44bf-84e8-1424ca6d0d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:53.985105 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b91ada83-499f-44bf-84e8-1424ca6d0d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1506 microversion: 2.1 time: 0.299102 Aug 29 15:35:53.985697 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1406/2853] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:53 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:54.008018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:54.012889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:54.020630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:54.021213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:54.021657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:54.022770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:54.023233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:54.023662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:54.109876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:35:54.110695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:35:54.111482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:35:54.112100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:35:54.112726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:35:54.193581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:54.200452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:54.201072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:54.201818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:54.202932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:54.203516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:54.204099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:54.237371 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d9b83078-b424-4707-93f0-5e7994a3adc6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "POST /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3/action" status: 202 len: 1112 microversion: 2.1 time: 0.235178 Aug 29 15:35:54.238902 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1448/2854] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:35:54 2022] POST /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3/action => generated 1112 bytes in 238 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 15:35:54.260725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e1b9c315-96fe-41f2-af29-b856a10b3f21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:54.261692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e1b9c315-96fe-41f2-af29-b856a10b3f21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:54.278455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1b9c315-96fe-41f2-af29-b856a10b3f21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:54.279250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1b9c315-96fe-41f2-af29-b856a10b3f21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:54.279884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1b9c315-96fe-41f2-af29-b856a10b3f21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:54.280639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1b9c315-96fe-41f2-af29-b856a10b3f21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:54.281891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1b9c315-96fe-41f2-af29-b856a10b3f21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:54.282333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1b9c315-96fe-41f2-af29-b856a10b3f21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:54.353058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bc39c46f-36b8-4018-baee-fb138fce6d0f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:54.353890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bc39c46f-36b8-4018-baee-fb138fce6d0f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:54.361532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc39c46f-36b8-4018-baee-fb138fce6d0f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:54.362128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc39c46f-36b8-4018-baee-fb138fce6d0f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:54.363636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc39c46f-36b8-4018-baee-fb138fce6d0f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:54.365417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc39c46f-36b8-4018-baee-fb138fce6d0f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:54.366138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc39c46f-36b8-4018-baee-fb138fce6d0f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:54.367110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc39c46f-36b8-4018-baee-fb138fce6d0f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:54.450984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e1b9c315-96fe-41f2-af29-b856a10b3f21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:54.460529 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e1b9c315-96fe-41f2-af29-b856a10b3f21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.208848 Aug 29 15:35:54.461926 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1407/2855] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:54 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:54.469819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-44e06103-93fe-4415-98cc-d3dea8fe0eac tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:54.470795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-44e06103-93fe-4415-98cc-d3dea8fe0eac tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:54.477421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44e06103-93fe-4415-98cc-d3dea8fe0eac tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:54.477836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44e06103-93fe-4415-98cc-d3dea8fe0eac tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:54.478280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44e06103-93fe-4415-98cc-d3dea8fe0eac tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:54.478995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44e06103-93fe-4415-98cc-d3dea8fe0eac tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:54.479461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44e06103-93fe-4415-98cc-d3dea8fe0eac tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:54.479902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44e06103-93fe-4415-98cc-d3dea8fe0eac tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:54.549601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-44e06103-93fe-4415-98cc-d3dea8fe0eac tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:54.559382 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-44e06103-93fe-4415-98cc-d3dea8fe0eac tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1275 microversion: 2.1 time: 0.093310 Aug 29 15:35:54.560248 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1408/2856] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:54 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:54.604376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fb1463b6-4daf-4be0-9697-0aab56772a90 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:54.604999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fb1463b6-4daf-4be0-9697-0aab56772a90 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:54.612509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb1463b6-4daf-4be0-9697-0aab56772a90 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:54.613120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb1463b6-4daf-4be0-9697-0aab56772a90 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:54.613636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb1463b6-4daf-4be0-9697-0aab56772a90 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:54.614732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb1463b6-4daf-4be0-9697-0aab56772a90 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:54.615204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb1463b6-4daf-4be0-9697-0aab56772a90 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:54.615636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb1463b6-4daf-4be0-9697-0aab56772a90 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:54.694433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fb1463b6-4daf-4be0-9697-0aab56772a90 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:54.705956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fb1463b6-4daf-4be0-9697-0aab56772a90 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:54.707572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fb1463b6-4daf-4be0-9697-0aab56772a90 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:54.709066 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fb1463b6-4daf-4be0-9697-0aab56772a90 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.109206 Aug 29 15:35:54.717469 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1409/2857] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:54 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:54.912098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bc39c46f-36b8-4018-baee-fb138fce6d0f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:54.920186 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bc39c46f-36b8-4018-baee-fb138fce6d0f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1313 microversion: 2.1 time: 0.572011 Aug 29 15:35:54.920842 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1449/2858] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:54 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1313 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:55.481960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-70409f86-30a7-4ff7-9a00-3891910b7858 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:55.482580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-70409f86-30a7-4ff7-9a00-3891910b7858 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:55.489857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70409f86-30a7-4ff7-9a00-3891910b7858 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.490567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70409f86-30a7-4ff7-9a00-3891910b7858 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.491070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70409f86-30a7-4ff7-9a00-3891910b7858 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:55.491976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70409f86-30a7-4ff7-9a00-3891910b7858 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.492742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70409f86-30a7-4ff7-9a00-3891910b7858 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.493403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70409f86-30a7-4ff7-9a00-3891910b7858 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:55.587139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c763990b-2e09-4c67-8611-87f83eeb8104 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:55.587861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c763990b-2e09-4c67-8611-87f83eeb8104 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:55.598945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c763990b-2e09-4c67-8611-87f83eeb8104 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.599518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c763990b-2e09-4c67-8611-87f83eeb8104 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.600628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c763990b-2e09-4c67-8611-87f83eeb8104 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:55.601463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c763990b-2e09-4c67-8611-87f83eeb8104 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.602207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c763990b-2e09-4c67-8611-87f83eeb8104 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.602716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c763990b-2e09-4c67-8611-87f83eeb8104 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:55.694197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-70409f86-30a7-4ff7-9a00-3891910b7858 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:55.706395 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-70409f86-30a7-4ff7-9a00-3891910b7858 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.228100 Aug 29 15:35:55.708704 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1410/2859] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:55 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:55.745506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3fc6cea0-6c4f-4847-9920-07308e3771ee tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:55.746955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3fc6cea0-6c4f-4847-9920-07308e3771ee tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:55.755523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fc6cea0-6c4f-4847-9920-07308e3771ee tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.756885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fc6cea0-6c4f-4847-9920-07308e3771ee tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.757624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fc6cea0-6c4f-4847-9920-07308e3771ee tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:55.759151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fc6cea0-6c4f-4847-9920-07308e3771ee tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.760040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fc6cea0-6c4f-4847-9920-07308e3771ee tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.761288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fc6cea0-6c4f-4847-9920-07308e3771ee tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:55.862666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3fc6cea0-6c4f-4847-9920-07308e3771ee tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:55.869656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c763990b-2e09-4c67-8611-87f83eeb8104 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:55.871828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3fc6cea0-6c4f-4847-9920-07308e3771ee tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:55.880996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3fc6cea0-6c4f-4847-9920-07308e3771ee tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:55.882160 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3fc6cea0-6c4f-4847-9920-07308e3771ee tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.151615 Aug 29 15:35:55.882703 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c763990b-2e09-4c67-8611-87f83eeb8104 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1317 microversion: 2.1 time: 0.305269 Aug 29 15:35:55.884023 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1450/2860] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:55 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:55.887072 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1411/2861] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:55 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:55.941843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f3cabb2b-196b-4a7d-b455-52a4b73c53b6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:55.942468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f3cabb2b-196b-4a7d-b455-52a4b73c53b6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:55.954958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3cabb2b-196b-4a7d-b455-52a4b73c53b6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.955746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3cabb2b-196b-4a7d-b455-52a4b73c53b6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.956366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3cabb2b-196b-4a7d-b455-52a4b73c53b6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:55.957140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3cabb2b-196b-4a7d-b455-52a4b73c53b6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:55.965151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3cabb2b-196b-4a7d-b455-52a4b73c53b6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:55.965885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3cabb2b-196b-4a7d-b455-52a4b73c53b6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:56.334228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f3cabb2b-196b-4a7d-b455-52a4b73c53b6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:56.342599 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f3cabb2b-196b-4a7d-b455-52a4b73c53b6 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1313 microversion: 2.1 time: 0.404504 Aug 29 15:35:56.343629 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1412/2862] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:55 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:56.731205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0c49717f-3338-48ac-94a4-ac6e171818ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:56.732988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0c49717f-3338-48ac-94a4-ac6e171818ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:56.740782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c49717f-3338-48ac-94a4-ac6e171818ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:56.742179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c49717f-3338-48ac-94a4-ac6e171818ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:56.743352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c49717f-3338-48ac-94a4-ac6e171818ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:56.744659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c49717f-3338-48ac-94a4-ac6e171818ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:56.745347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c49717f-3338-48ac-94a4-ac6e171818ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:56.746413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c49717f-3338-48ac-94a4-ac6e171818ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:56.907768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-59598320-d19a-4ee5-a97a-06ae4b219d0d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:56.909248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-59598320-d19a-4ee5-a97a-06ae4b219d0d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:56.919829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59598320-d19a-4ee5-a97a-06ae4b219d0d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:56.920699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59598320-d19a-4ee5-a97a-06ae4b219d0d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:56.921291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59598320-d19a-4ee5-a97a-06ae4b219d0d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:56.922235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59598320-d19a-4ee5-a97a-06ae4b219d0d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:56.922900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59598320-d19a-4ee5-a97a-06ae4b219d0d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:56.924159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59598320-d19a-4ee5-a97a-06ae4b219d0d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:56.949191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:57.224030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:57.238760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0c49717f-3338-48ac-94a4-ac6e171818ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:57.257050 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0c49717f-3338-48ac-94a4-ac6e171818ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.530134 Aug 29 15:35:57.259274 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1451/2863] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:56 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:57.277239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9aa78738-d5ae-427a-b78f-452ccc47abeb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:57.278659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9aa78738-d5ae-427a-b78f-452ccc47abeb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:57.304458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9aa78738-d5ae-427a-b78f-452ccc47abeb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:57.305591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9aa78738-d5ae-427a-b78f-452ccc47abeb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:57.306456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9aa78738-d5ae-427a-b78f-452ccc47abeb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:57.307615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9aa78738-d5ae-427a-b78f-452ccc47abeb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:57.308795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9aa78738-d5ae-427a-b78f-452ccc47abeb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:57.309589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9aa78738-d5ae-427a-b78f-452ccc47abeb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:57.675810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-59598320-d19a-4ee5-a97a-06ae4b219d0d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:57.686941 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-59598320-d19a-4ee5-a97a-06ae4b219d0d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1317 microversion: 2.1 time: 0.784730 Aug 29 15:35:57.688346 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1413/2864] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:56 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1317 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:57.695579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d7f8cc58-39d6-422a-9b08-152b5a130e64 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:57.698265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d7f8cc58-39d6-422a-9b08-152b5a130e64 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:57.711530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7f8cc58-39d6-422a-9b08-152b5a130e64 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:57.712507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7f8cc58-39d6-422a-9b08-152b5a130e64 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:57.713165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7f8cc58-39d6-422a-9b08-152b5a130e64 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:57.714720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7f8cc58-39d6-422a-9b08-152b5a130e64 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:57.715594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7f8cc58-39d6-422a-9b08-152b5a130e64 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:57.716177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7f8cc58-39d6-422a-9b08-152b5a130e64 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:57.783018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9aa78738-d5ae-427a-b78f-452ccc47abeb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:57.795803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9aa78738-d5ae-427a-b78f-452ccc47abeb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:57.799826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9aa78738-d5ae-427a-b78f-452ccc47abeb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:57.801841 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9aa78738-d5ae-427a-b78f-452ccc47abeb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.540775 Aug 29 15:35:57.803022 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1452/2865] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:57 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:58.143191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-6746d3b6-62aa-4bac-b34f-ccb0ea92e781 req-35568e3a-4c04-453e-92f9-571667a308b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0330d585-be01-45a3-b20a-9ce9cdfbaa43", "name": "network-vif-plugged", "status": "completed", "tag": "53083e31-a61d-4467-9153-eb9ce7344ee5"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:58.158465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6746d3b6-62aa-4bac-b34f-ccb0ea92e781 req-35568e3a-4c04-453e-92f9-571667a308b2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:58.158956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6746d3b6-62aa-4bac-b34f-ccb0ea92e781 req-35568e3a-4c04-453e-92f9-571667a308b2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:58.159395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6746d3b6-62aa-4bac-b34f-ccb0ea92e781 req-35568e3a-4c04-453e-92f9-571667a308b2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:58.196310 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-6746d3b6-62aa-4bac-b34f-ccb0ea92e781 req-35568e3a-4c04-453e-92f9-571667a308b2 service nova] Creating event network-vif-plugged:53083e31-a61d-4467-9153-eb9ce7344ee5 for instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 on n-h2-839401-11 Aug 29 15:35:58.215133 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-6746d3b6-62aa-4bac-b34f-ccb0ea92e781 req-35568e3a-4c04-453e-92f9-571667a308b2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069773 Aug 29 15:35:58.216058 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1453/2866] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:35:58.279729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-51498d3d-69cd-4dbe-8f1e-e43a47e2ef5f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:58.280566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-51498d3d-69cd-4dbe-8f1e-e43a47e2ef5f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:58.293798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:58.295742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51498d3d-69cd-4dbe-8f1e-e43a47e2ef5f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:58.296494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51498d3d-69cd-4dbe-8f1e-e43a47e2ef5f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:58.298920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51498d3d-69cd-4dbe-8f1e-e43a47e2ef5f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:58.300021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51498d3d-69cd-4dbe-8f1e-e43a47e2ef5f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:58.302816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51498d3d-69cd-4dbe-8f1e-e43a47e2ef5f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:58.303497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51498d3d-69cd-4dbe-8f1e-e43a47e2ef5f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:58.512217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d7f8cc58-39d6-422a-9b08-152b5a130e64 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:58.547012 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d7f8cc58-39d6-422a-9b08-152b5a130e64 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1313 microversion: 2.1 time: 0.841345 Aug 29 15:35:58.548669 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1414/2867] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:57 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1313 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:35:58.711190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-41fed335-03dd-4300-9a69-d3b86f0bd43d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:58.713009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-41fed335-03dd-4300-9a69-d3b86f0bd43d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:58.737898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41fed335-03dd-4300-9a69-d3b86f0bd43d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:58.738556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41fed335-03dd-4300-9a69-d3b86f0bd43d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:58.740747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41fed335-03dd-4300-9a69-d3b86f0bd43d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:58.741576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41fed335-03dd-4300-9a69-d3b86f0bd43d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:58.743211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41fed335-03dd-4300-9a69-d3b86f0bd43d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:58.744782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41fed335-03dd-4300-9a69-d3b86f0bd43d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:58.784372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=14 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:58.851253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-51498d3d-69cd-4dbe-8f1e-e43a47e2ef5f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:58.857322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:35:58.867092 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-51498d3d-69cd-4dbe-8f1e-e43a47e2ef5f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.591478 Aug 29 15:35:58.882285 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1454/2868] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:58 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:58.894293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b6233910-1c43-4fcc-b031-22123a02716c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:58.895211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b6233910-1c43-4fcc-b031-22123a02716c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:58.904819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6233910-1c43-4fcc-b031-22123a02716c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:58.905642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6233910-1c43-4fcc-b031-22123a02716c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:58.906342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6233910-1c43-4fcc-b031-22123a02716c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:58.907242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6233910-1c43-4fcc-b031-22123a02716c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:58.908072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6233910-1c43-4fcc-b031-22123a02716c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:58.908703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6233910-1c43-4fcc-b031-22123a02716c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:59.087575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-41fed335-03dd-4300-9a69-d3b86f0bd43d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:59.096460 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-41fed335-03dd-4300-9a69-d3b86f0bd43d tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1317 microversion: 2.1 time: 0.391613 Aug 29 15:35:59.100087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b6233910-1c43-4fcc-b031-22123a02716c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:59.109996 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1415/2869] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:58 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:35:59.118711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b6233910-1c43-4fcc-b031-22123a02716c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:59.120326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b6233910-1c43-4fcc-b031-22123a02716c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:59.121557 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b6233910-1c43-4fcc-b031-22123a02716c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.237326 Aug 29 15:35:59.122139 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1455/2870] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:35:58 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:35:59.168739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-ff9a0fb9-e55a-4767-8926-d2396912c9c5 req-55247d08-fa1b-4817-8843-3a6a82fc5b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b02587-e9cd-4361-874a-0ede2593daef", "tag": "3a0e9dae-9a01-4902-9b3b-c920d9d702e4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:35:59.181644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ff9a0fb9-e55a-4767-8926-d2396912c9c5 req-55247d08-fa1b-4817-8843-3a6a82fc5b12 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:59.182424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ff9a0fb9-e55a-4767-8926-d2396912c9c5 req-55247d08-fa1b-4817-8843-3a6a82fc5b12 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:59.182862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ff9a0fb9-e55a-4767-8926-d2396912c9c5 req-55247d08-fa1b-4817-8843-3a6a82fc5b12 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:59.201793 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-ff9a0fb9-e55a-4767-8926-d2396912c9c5 req-55247d08-fa1b-4817-8843-3a6a82fc5b12 service nova] Creating event network-changed:3a0e9dae-9a01-4902-9b3b-c920d9d702e4 for instance b9b02587-e9cd-4361-874a-0ede2593daef on n-h1-839401-11 Aug 29 15:35:59.208271 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-ff9a0fb9-e55a-4767-8926-d2396912c9c5 req-55247d08-fa1b-4817-8843-3a6a82fc5b12 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046892 Aug 29 15:35:59.209687 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1416/2871] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:35:59.574735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a499a539-e74b-4e2c-9e76-6c35e6c67a83 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:59.575800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a499a539-e74b-4e2c-9e76-6c35e6c67a83 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:59.584820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a499a539-e74b-4e2c-9e76-6c35e6c67a83 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:59.585676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a499a539-e74b-4e2c-9e76-6c35e6c67a83 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:59.586405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a499a539-e74b-4e2c-9e76-6c35e6c67a83 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:59.587388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a499a539-e74b-4e2c-9e76-6c35e6c67a83 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:59.588348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a499a539-e74b-4e2c-9e76-6c35e6c67a83 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:59.589382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a499a539-e74b-4e2c-9e76-6c35e6c67a83 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:59.889541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-439368fa-bc02-4751-9577-9a1df90866b4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:35:59.890978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-439368fa-bc02-4751-9577-9a1df90866b4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:35:59.906276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-439368fa-bc02-4751-9577-9a1df90866b4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:59.908299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-439368fa-bc02-4751-9577-9a1df90866b4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:59.908813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-439368fa-bc02-4751-9577-9a1df90866b4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:59.911378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-439368fa-bc02-4751-9577-9a1df90866b4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:35:59.912188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-439368fa-bc02-4751-9577-9a1df90866b4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:35:59.912751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-439368fa-bc02-4751-9577-9a1df90866b4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:35:59.960126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a499a539-e74b-4e2c-9e76-6c35e6c67a83 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:35:59.972051 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a499a539-e74b-4e2c-9e76-6c35e6c67a83 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1313 microversion: 2.1 time: 0.407643 Aug 29 15:35:59.973326 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1456/2872] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:59 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:00.122115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-25aee20f-eaca-4a1d-8a24-e3dc10661221 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:00.123097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-25aee20f-eaca-4a1d-8a24-e3dc10661221 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:00.142993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25aee20f-eaca-4a1d-8a24-e3dc10661221 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:00.143497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25aee20f-eaca-4a1d-8a24-e3dc10661221 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:00.143938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25aee20f-eaca-4a1d-8a24-e3dc10661221 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:00.144903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25aee20f-eaca-4a1d-8a24-e3dc10661221 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:00.145403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25aee20f-eaca-4a1d-8a24-e3dc10661221 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:00.145837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25aee20f-eaca-4a1d-8a24-e3dc10661221 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:00.472007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-439368fa-bc02-4751-9577-9a1df90866b4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:00.498248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:00.507995 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-439368fa-bc02-4751-9577-9a1df90866b4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.618429 Aug 29 15:36:00.525287 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1417/2873] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:35:59 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:00.540554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8dc6d8f0-7ae2-4e30-92bf-c9f4f34ad220 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:00.541591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8dc6d8f0-7ae2-4e30-92bf-c9f4f34ad220 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:00.554987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8dc6d8f0-7ae2-4e30-92bf-c9f4f34ad220 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:00.555530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8dc6d8f0-7ae2-4e30-92bf-c9f4f34ad220 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:00.556181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8dc6d8f0-7ae2-4e30-92bf-c9f4f34ad220 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:00.557829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8dc6d8f0-7ae2-4e30-92bf-c9f4f34ad220 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:00.558426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8dc6d8f0-7ae2-4e30-92bf-c9f4f34ad220 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:00.559702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8dc6d8f0-7ae2-4e30-92bf-c9f4f34ad220 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:00.639529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8dc6d8f0-7ae2-4e30-92bf-c9f4f34ad220 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:00.651376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8dc6d8f0-7ae2-4e30-92bf-c9f4f34ad220 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:00.653474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8dc6d8f0-7ae2-4e30-92bf-c9f4f34ad220 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:00.655005 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8dc6d8f0-7ae2-4e30-92bf-c9f4f34ad220 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.128166 Aug 29 15:36:00.656771 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1418/2874] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:00 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:00.662782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-223098c3-bcfc-40ab-a3e7-a193b44ce17e req-52551ecb-356a-412a-b2eb-d7002c327501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b73a7195-711e-46b6-ad0f-a6e38339b2fb", "name": "network-vif-plugged", "status": "completed", "tag": "a669bbc2-3726-4712-8702-e54becdb8f7d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:00.678612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-223098c3-bcfc-40ab-a3e7-a193b44ce17e req-52551ecb-356a-412a-b2eb-d7002c327501 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:00.679150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-223098c3-bcfc-40ab-a3e7-a193b44ce17e req-52551ecb-356a-412a-b2eb-d7002c327501 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:00.679642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-223098c3-bcfc-40ab-a3e7-a193b44ce17e req-52551ecb-356a-412a-b2eb-d7002c327501 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:00.698450 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-223098c3-bcfc-40ab-a3e7-a193b44ce17e req-52551ecb-356a-412a-b2eb-d7002c327501 service nova] Creating event network-vif-plugged:a669bbc2-3726-4712-8702-e54becdb8f7d for instance b73a7195-711e-46b6-ad0f-a6e38339b2fb on n-h1-839401-11 Aug 29 15:36:00.704901 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-223098c3-bcfc-40ab-a3e7-a193b44ce17e req-52551ecb-356a-412a-b2eb-d7002c327501 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046535 Aug 29 15:36:00.706306 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1419/2875] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:00.787272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-25aee20f-eaca-4a1d-8a24-e3dc10661221 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:00.804302 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-25aee20f-eaca-4a1d-8a24-e3dc10661221 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1317 microversion: 2.1 time: 0.685968 Aug 29 15:36:00.806372 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1457/2876] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:00 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1317 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:01.007871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-92bcd242-d1e8-48ba-9165-19bd671836f0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:01.010030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-92bcd242-d1e8-48ba-9165-19bd671836f0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:01.019232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92bcd242-d1e8-48ba-9165-19bd671836f0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:01.030748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92bcd242-d1e8-48ba-9165-19bd671836f0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:01.031564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92bcd242-d1e8-48ba-9165-19bd671836f0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:01.032616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92bcd242-d1e8-48ba-9165-19bd671836f0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:01.033738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92bcd242-d1e8-48ba-9165-19bd671836f0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:01.034375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92bcd242-d1e8-48ba-9165-19bd671836f0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:01.296456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-92bcd242-d1e8-48ba-9165-19bd671836f0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:01.318049 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-92bcd242-d1e8-48ba-9165-19bd671836f0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1463 microversion: 2.1 time: 0.322107 Aug 29 15:36:01.319987 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1420/2877] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:00 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1463 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:01.338542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ce0e793f-9035-444e-81bc-e530ba2a7f35 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:01.340403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ce0e793f-9035-444e-81bc-e530ba2a7f35 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:01.352531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce0e793f-9035-444e-81bc-e530ba2a7f35 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:01.353368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce0e793f-9035-444e-81bc-e530ba2a7f35 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:01.354043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce0e793f-9035-444e-81bc-e530ba2a7f35 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:01.354988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce0e793f-9035-444e-81bc-e530ba2a7f35 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:01.356258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce0e793f-9035-444e-81bc-e530ba2a7f35 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:01.356903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce0e793f-9035-444e-81bc-e530ba2a7f35 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:01.528121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1cb4d3df-a6ee-4f04-8106-72509026f0d5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:01.528741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1cb4d3df-a6ee-4f04-8106-72509026f0d5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:01.536942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb4d3df-a6ee-4f04-8106-72509026f0d5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:01.538007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb4d3df-a6ee-4f04-8106-72509026f0d5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:01.539677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb4d3df-a6ee-4f04-8106-72509026f0d5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:01.540669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb4d3df-a6ee-4f04-8106-72509026f0d5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:01.542092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb4d3df-a6ee-4f04-8106-72509026f0d5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:01.543027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb4d3df-a6ee-4f04-8106-72509026f0d5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:01.646746 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ce0e793f-9035-444e-81bc-e530ba2a7f35 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1616 microversion: 2.1 time: 0.311999 Aug 29 15:36:01.661956 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1458/2878] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:01 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1616 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:01.667797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7b412bd4-7942-4ba8-ae1b-05427f5e9be3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:01.668428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7b412bd4-7942-4ba8-ae1b-05427f5e9be3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:01.674695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b412bd4-7942-4ba8-ae1b-05427f5e9be3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:01.675183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b412bd4-7942-4ba8-ae1b-05427f5e9be3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:01.675608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b412bd4-7942-4ba8-ae1b-05427f5e9be3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:01.677391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b412bd4-7942-4ba8-ae1b-05427f5e9be3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:01.678290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b412bd4-7942-4ba8-ae1b-05427f5e9be3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:01.679052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b412bd4-7942-4ba8-ae1b-05427f5e9be3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:01.767012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7b412bd4-7942-4ba8-ae1b-05427f5e9be3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c6120724d1ad4272a1507ebc11cbf895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094265a4efd8497ca10efe66cb7a434d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:01.768119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7b412bd4-7942-4ba8-ae1b-05427f5e9be3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] flavor_id is None. Assuming migration. {{(pid=122360) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 15:36:01.768924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7b412bd4-7942-4ba8-ae1b-05427f5e9be3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122360) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 15:36:01.901124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1cb4d3df-a6ee-4f04-8106-72509026f0d5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:01.913421 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1cb4d3df-a6ee-4f04-8106-72509026f0d5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.389049 Aug 29 15:36:01.927919 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1421/2879] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:01 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:01.930000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-be140090-62c2-4cbd-9043-b3f4f74190fa tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:01.930623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-be140090-62c2-4cbd-9043-b3f4f74190fa tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:01.938102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be140090-62c2-4cbd-9043-b3f4f74190fa tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:01.938918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be140090-62c2-4cbd-9043-b3f4f74190fa tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:01.939771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be140090-62c2-4cbd-9043-b3f4f74190fa tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:01.941262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be140090-62c2-4cbd-9043-b3f4f74190fa tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:01.941779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be140090-62c2-4cbd-9043-b3f4f74190fa tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:01.942206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be140090-62c2-4cbd-9043-b3f4f74190fa tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:02.062952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-be140090-62c2-4cbd-9043-b3f4f74190fa tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:02.095911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-be140090-62c2-4cbd-9043-b3f4f74190fa tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:02.097418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-be140090-62c2-4cbd-9043-b3f4f74190fa tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:02.102462 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-be140090-62c2-4cbd-9043-b3f4f74190fa tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.183219 Aug 29 15:36:02.117363 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1422/2880] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:01 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:02.128525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6553a571-db7b-4d87-ad1f-f653a625f8bf tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:02.129199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6553a571-db7b-4d87-ad1f-f653a625f8bf tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:02.144456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6553a571-db7b-4d87-ad1f-f653a625f8bf tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:02.144964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6553a571-db7b-4d87-ad1f-f653a625f8bf tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:02.145437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6553a571-db7b-4d87-ad1f-f653a625f8bf tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:02.150464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6553a571-db7b-4d87-ad1f-f653a625f8bf tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:02.150969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6553a571-db7b-4d87-ad1f-f653a625f8bf tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:02.151426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6553a571-db7b-4d87-ad1f-f653a625f8bf tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:02.382159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6553a571-db7b-4d87-ad1f-f653a625f8bf tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:02.395783 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6553a571-db7b-4d87-ad1f-f653a625f8bf tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1317 microversion: 2.1 time: 0.277339 Aug 29 15:36:02.398084 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1423/2881] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:02 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:02.449798 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7b412bd4-7942-4ba8-ae1b-05427f5e9be3 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43/action" status: 202 len: 0 microversion: 2.1 time: 0.785583 Aug 29 15:36:02.452928 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1459/2882] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:36:01 2022] POST /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:36:02.458928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cadbbd40-375c-41ab-aeb2-33b35c3a3b56 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:02.459484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cadbbd40-375c-41ab-aeb2-33b35c3a3b56 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:02.475492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cadbbd40-375c-41ab-aeb2-33b35c3a3b56 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:02.478141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cadbbd40-375c-41ab-aeb2-33b35c3a3b56 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:02.480233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cadbbd40-375c-41ab-aeb2-33b35c3a3b56 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:02.498661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cadbbd40-375c-41ab-aeb2-33b35c3a3b56 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:02.499434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cadbbd40-375c-41ab-aeb2-33b35c3a3b56 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:02.499907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cadbbd40-375c-41ab-aeb2-33b35c3a3b56 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:02.731908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cadbbd40-375c-41ab-aeb2-33b35c3a3b56 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:02.740774 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cadbbd40-375c-41ab-aeb2-33b35c3a3b56 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1472 microversion: 2.1 time: 0.285860 Aug 29 15:36:02.741779 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1424/2883] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:02 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1472 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:02.938447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ef2861ac-5f50-4ccb-8c15-faf044ddb834 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:02.939671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ef2861ac-5f50-4ccb-8c15-faf044ddb834 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:02.956008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef2861ac-5f50-4ccb-8c15-faf044ddb834 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:02.958097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef2861ac-5f50-4ccb-8c15-faf044ddb834 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:02.960463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef2861ac-5f50-4ccb-8c15-faf044ddb834 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:02.961621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef2861ac-5f50-4ccb-8c15-faf044ddb834 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:02.962505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef2861ac-5f50-4ccb-8c15-faf044ddb834 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:02.963333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef2861ac-5f50-4ccb-8c15-faf044ddb834 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:03.128519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-15498153-365e-49fc-8b12-8f8bd8b38856 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:03.129827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-15498153-365e-49fc-8b12-8f8bd8b38856 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:03.139218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15498153-365e-49fc-8b12-8f8bd8b38856 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:03.141735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15498153-365e-49fc-8b12-8f8bd8b38856 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:03.147659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ef2861ac-5f50-4ccb-8c15-faf044ddb834 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:03.151052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15498153-365e-49fc-8b12-8f8bd8b38856 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:03.151826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15498153-365e-49fc-8b12-8f8bd8b38856 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:03.152310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15498153-365e-49fc-8b12-8f8bd8b38856 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:03.154544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15498153-365e-49fc-8b12-8f8bd8b38856 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:03.158624 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ef2861ac-5f50-4ccb-8c15-faf044ddb834 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.226805 Aug 29 15:36:03.160406 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1460/2884] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:02 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:03.293427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-15498153-365e-49fc-8b12-8f8bd8b38856 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:03.306646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-15498153-365e-49fc-8b12-8f8bd8b38856 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:03.308127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-15498153-365e-49fc-8b12-8f8bd8b38856 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:03.309380 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-15498153-365e-49fc-8b12-8f8bd8b38856 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.185224 Aug 29 15:36:03.313495 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1425/2885] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:03 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:03.418589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d6d8478b-fa42-4d16-a81f-390c9e51d872 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:03.419335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d6d8478b-fa42-4d16-a81f-390c9e51d872 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:03.427399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6d8478b-fa42-4d16-a81f-390c9e51d872 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:03.428360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6d8478b-fa42-4d16-a81f-390c9e51d872 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:03.429299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6d8478b-fa42-4d16-a81f-390c9e51d872 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:03.430353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6d8478b-fa42-4d16-a81f-390c9e51d872 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:03.430927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6d8478b-fa42-4d16-a81f-390c9e51d872 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:03.431241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6d8478b-fa42-4d16-a81f-390c9e51d872 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:03.580426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d6d8478b-fa42-4d16-a81f-390c9e51d872 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:03.588406 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d6d8478b-fa42-4d16-a81f-390c9e51d872 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1317 microversion: 2.1 time: 0.174156 Aug 29 15:36:03.593719 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1461/2886] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:03 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:03.762305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-660748fd-9c8d-44a6-a935-b480586fa9c2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:03.763369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-660748fd-9c8d-44a6-a935-b480586fa9c2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:03.770580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-660748fd-9c8d-44a6-a935-b480586fa9c2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:03.771367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-660748fd-9c8d-44a6-a935-b480586fa9c2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:03.772024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-660748fd-9c8d-44a6-a935-b480586fa9c2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:03.772984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-660748fd-9c8d-44a6-a935-b480586fa9c2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:03.773569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-660748fd-9c8d-44a6-a935-b480586fa9c2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:03.774214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-660748fd-9c8d-44a6-a935-b480586fa9c2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:04.055376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-660748fd-9c8d-44a6-a935-b480586fa9c2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:04.090553 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-660748fd-9c8d-44a6-a935-b480586fa9c2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1472 microversion: 2.1 time: 0.332147 Aug 29 15:36:04.097281 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1426/2887] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:03 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1472 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:04.185339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-00d95646-659b-4e67-adc3-4f812d650ee1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:04.187283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-00d95646-659b-4e67-adc3-4f812d650ee1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:04.215223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00d95646-659b-4e67-adc3-4f812d650ee1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:04.220848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00d95646-659b-4e67-adc3-4f812d650ee1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:04.221981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00d95646-659b-4e67-adc3-4f812d650ee1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:04.223663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00d95646-659b-4e67-adc3-4f812d650ee1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:04.226954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00d95646-659b-4e67-adc3-4f812d650ee1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:04.228537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00d95646-659b-4e67-adc3-4f812d650ee1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:04.345161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8a867cfd-55cf-4393-8637-0ede58035df7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:04.351615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8a867cfd-55cf-4393-8637-0ede58035df7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:04.365946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a867cfd-55cf-4393-8637-0ede58035df7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:04.366758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a867cfd-55cf-4393-8637-0ede58035df7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:04.367472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a867cfd-55cf-4393-8637-0ede58035df7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:04.369977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a867cfd-55cf-4393-8637-0ede58035df7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:04.371052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a867cfd-55cf-4393-8637-0ede58035df7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:04.372060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a867cfd-55cf-4393-8637-0ede58035df7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:04.638460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8a867cfd-55cf-4393-8637-0ede58035df7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:04.660255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8a867cfd-55cf-4393-8637-0ede58035df7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:04.661671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8a867cfd-55cf-4393-8637-0ede58035df7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:04.671483 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8a867cfd-55cf-4393-8637-0ede58035df7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.336195 Aug 29 15:36:04.674676 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1427/2888] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:04 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:04.682141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-def5d300-3610-40dd-8ef5-384c4164cae1 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:04.694873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-def5d300-3610-40dd-8ef5-384c4164cae1 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:04.718173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def5d300-3610-40dd-8ef5-384c4164cae1 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:04.719547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def5d300-3610-40dd-8ef5-384c4164cae1 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:04.720011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def5d300-3610-40dd-8ef5-384c4164cae1 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:04.720830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def5d300-3610-40dd-8ef5-384c4164cae1 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:04.727036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def5d300-3610-40dd-8ef5-384c4164cae1 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:04.731837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def5d300-3610-40dd-8ef5-384c4164cae1 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:04.978763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-00d95646-659b-4e67-adc3-4f812d650ee1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:04.989858 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-00d95646-659b-4e67-adc3-4f812d650ee1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.811666 Aug 29 15:36:04.990456 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1462/2889] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:04 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:04.993233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-def5d300-3610-40dd-8ef5-384c4164cae1 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:05.005380 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-def5d300-3610-40dd-8ef5-384c4164cae1 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1317 microversion: 2.1 time: 0.329002 Aug 29 15:36:05.019260 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1428/2890] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:04 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:05.121515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ce902709-5c25-4114-9ee2-af68c16eaada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:05.122278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ce902709-5c25-4114-9ee2-af68c16eaada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:05.131665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce902709-5c25-4114-9ee2-af68c16eaada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:05.141879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce902709-5c25-4114-9ee2-af68c16eaada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:05.142684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce902709-5c25-4114-9ee2-af68c16eaada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:05.144107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce902709-5c25-4114-9ee2-af68c16eaada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:05.144738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce902709-5c25-4114-9ee2-af68c16eaada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:05.146360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce902709-5c25-4114-9ee2-af68c16eaada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:05.569777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ce902709-5c25-4114-9ee2-af68c16eaada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:05.586301 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ce902709-5c25-4114-9ee2-af68c16eaada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1472 microversion: 2.1 time: 0.465319 Aug 29 15:36:05.587437 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1463/2891] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:05 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1472 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:05.682291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ec929dc0-c5c1-475f-aa1d-09f49808dc31 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Calling method '.version_select at 0x7fc42bda7ee0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:05.713787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1b2aa6ba-6300-45d1-9bfc-7f3b5b792051 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:05.714931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1b2aa6ba-6300-45d1-9bfc-7f3b5b792051 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:05.726222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b2aa6ba-6300-45d1-9bfc-7f3b5b792051 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:05.726919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b2aa6ba-6300-45d1-9bfc-7f3b5b792051 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:05.728617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b2aa6ba-6300-45d1-9bfc-7f3b5b792051 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:05.729820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b2aa6ba-6300-45d1-9bfc-7f3b5b792051 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:05.732212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b2aa6ba-6300-45d1-9bfc-7f3b5b792051 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:05.734484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b2aa6ba-6300-45d1-9bfc-7f3b5b792051 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:05.771595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:05.792865 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ec929dc0-c5c1-475f-aa1d-09f49808dc31 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31" status: 200 len: 371 microversion: 2.1 time: 0.578838 Aug 29 15:36:05.801066 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1429/2892] 10.222.0.62 () {58 vars in 1242 bytes} [Mon Aug 29 15:36:05 2022] GET /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31 => generated 371 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:36:05.806210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5194d051-1445-4569-83cd-7b48bfe44d88 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Action: 'update', calling method: .version_select at 0x7fc42aa75670>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:05.876423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1b2aa6ba-6300-45d1-9bfc-7f3b5b792051 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:05.890763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1b2aa6ba-6300-45d1-9bfc-7f3b5b792051 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:05.893005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1b2aa6ba-6300-45d1-9bfc-7f3b5b792051 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:05.896548 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1b2aa6ba-6300-45d1-9bfc-7f3b5b792051 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.185256 Aug 29 15:36:05.897849 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1464/2893] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:05 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:36:06.013278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c2b5b2f2-80e5-40ca-861b-10859b9da5a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:06.014093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c2b5b2f2-80e5-40ca-861b-10859b9da5a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:06.028655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b5b2f2-80e5-40ca-861b-10859b9da5a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:06.029434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b5b2f2-80e5-40ca-861b-10859b9da5a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:06.031784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b5b2f2-80e5-40ca-861b-10859b9da5a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:06.033403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b5b2f2-80e5-40ca-861b-10859b9da5a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:06.035258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b5b2f2-80e5-40ca-861b-10859b9da5a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:06.036003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b5b2f2-80e5-40ca-861b-10859b9da5a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:06.158725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5194d051-1445-4569-83cd-7b48bfe44d88 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:06.159222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5194d051-1445-4569-83cd-7b48bfe44d88 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:06.159666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5194d051-1445-4569-83cd-7b48bfe44d88 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:06.160518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5194d051-1445-4569-83cd-7b48bfe44d88 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:06.160979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5194d051-1445-4569-83cd-7b48bfe44d88 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:06.161443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5194d051-1445-4569-83cd-7b48bfe44d88 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:06.239844 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5194d051-1445-4569-83cd-7b48bfe44d88 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31" status: 200 len: 328 microversion: 2.1 time: 0.437305 Aug 29 15:36:06.254907 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1430/2894] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 15:36:05 2022] PUT /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31 => generated 328 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:06.275407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8a9259ed-982a-4c8f-817b-1aa4fd2f976c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:06.279196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8a9259ed-982a-4c8f-817b-1aa4fd2f976c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:06.306677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a9259ed-982a-4c8f-817b-1aa4fd2f976c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:06.309907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a9259ed-982a-4c8f-817b-1aa4fd2f976c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:06.310693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a9259ed-982a-4c8f-817b-1aa4fd2f976c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:06.313863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a9259ed-982a-4c8f-817b-1aa4fd2f976c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:06.318497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a9259ed-982a-4c8f-817b-1aa4fd2f976c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:06.323098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a9259ed-982a-4c8f-817b-1aa4fd2f976c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:06.548541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c2b5b2f2-80e5-40ca-861b-10859b9da5a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:06.557692 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c2b5b2f2-80e5-40ca-861b-10859b9da5a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.549647 Aug 29 15:36:06.558890 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1465/2895] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:06 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:06.599125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8a9259ed-982a-4c8f-817b-1aa4fd2f976c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:06.608683 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8a9259ed-982a-4c8f-817b-1aa4fd2f976c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1317 microversion: 2.1 time: 0.349505 Aug 29 15:36:06.615177 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1431/2896] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:06 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:06.629181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dd198b65-acde-4ddf-aa67-f59e78e52cbc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:06.630043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dd198b65-acde-4ddf-aa67-f59e78e52cbc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:06.672000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd198b65-acde-4ddf-aa67-f59e78e52cbc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:06.672522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd198b65-acde-4ddf-aa67-f59e78e52cbc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:06.672978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd198b65-acde-4ddf-aa67-f59e78e52cbc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:06.677913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd198b65-acde-4ddf-aa67-f59e78e52cbc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:06.682965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd198b65-acde-4ddf-aa67-f59e78e52cbc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:06.684070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd198b65-acde-4ddf-aa67-f59e78e52cbc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:06.900428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dd198b65-acde-4ddf-aa67-f59e78e52cbc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:06.909459 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dd198b65-acde-4ddf-aa67-f59e78e52cbc tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 0.290748 Aug 29 15:36:06.911039 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1432/2897] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:06 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:06.980625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bef8c84e-ad51-42ca-bb82-17f05875ce8c tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:06.984513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bef8c84e-ad51-42ca-bb82-17f05875ce8c tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:06.984933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bef8c84e-ad51-42ca-bb82-17f05875ce8c tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:06.985430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bef8c84e-ad51-42ca-bb82-17f05875ce8c tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:06.986282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bef8c84e-ad51-42ca-bb82-17f05875ce8c tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:06.986739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bef8c84e-ad51-42ca-bb82-17f05875ce8c tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:06.987158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bef8c84e-ad51-42ca-bb82-17f05875ce8c tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:06.996624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1189897493", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:07.019749 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bef8c84e-ad51-42ca-bb82-17f05875ce8c tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.106930 Aug 29 15:36:07.020409 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1433/2898] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:36:06 2022] GET /compute/v2.1/os-services => generated 949 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:07.025266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-9ccac800-a8c1-4a4b-99db-764ad9d31d3e req-8d89dfc1-4283-414b-b329-16bdd959f39c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b02587-e9cd-4361-874a-0ede2593daef", "name": "network-vif-plugged", "status": "completed", "tag": "3a0e9dae-9a01-4902-9b3b-c920d9d702e4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:07.034855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9ccac800-a8c1-4a4b-99db-764ad9d31d3e req-8d89dfc1-4283-414b-b329-16bdd959f39c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.035349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9ccac800-a8c1-4a4b-99db-764ad9d31d3e req-8d89dfc1-4283-414b-b329-16bdd959f39c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.035796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9ccac800-a8c1-4a4b-99db-764ad9d31d3e req-8d89dfc1-4283-414b-b329-16bdd959f39c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.047181 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-9ccac800-a8c1-4a4b-99db-764ad9d31d3e req-8d89dfc1-4283-414b-b329-16bdd959f39c service nova] Creating event network-vif-plugged:3a0e9dae-9a01-4902-9b3b-c920d9d702e4 for instance b9b02587-e9cd-4361-874a-0ede2593daef on n-h1-839401-11 Aug 29 15:36:07.054985 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-9ccac800-a8c1-4a4b-99db-764ad9d31d3e req-8d89dfc1-4283-414b-b329-16bdd959f39c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033302 Aug 29 15:36:07.056003 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1434/2899] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:07.063237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d93bf376-7cdb-4fd3-badb-d27f25449116 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:07.064287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d93bf376-7cdb-4fd3-badb-d27f25449116 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:07.070759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d93bf376-7cdb-4fd3-badb-d27f25449116 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.071265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d93bf376-7cdb-4fd3-badb-d27f25449116 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.071868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d93bf376-7cdb-4fd3-badb-d27f25449116 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.072586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d93bf376-7cdb-4fd3-badb-d27f25449116 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.073052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d93bf376-7cdb-4fd3-badb-d27f25449116 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.073536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d93bf376-7cdb-4fd3-badb-d27f25449116 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.082605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] validate_networks() for None {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:36:07.149863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d93bf376-7cdb-4fd3-badb-d27f25449116 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:07.159670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d93bf376-7cdb-4fd3-badb-d27f25449116 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:07.161145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d93bf376-7cdb-4fd3-badb-d27f25449116 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:07.162350 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d93bf376-7cdb-4fd3-badb-d27f25449116 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.104762 Aug 29 15:36:07.163237 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1435/2900] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:07 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:07.167917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3ce12420-3e6e-4185-8db0-4787d9ef6ffc tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:07.172271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ce12420-3e6e-4185-8db0-4787d9ef6ffc tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.172787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ce12420-3e6e-4185-8db0-4787d9ef6ffc tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.173390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ce12420-3e6e-4185-8db0-4787d9ef6ffc tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.174138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ce12420-3e6e-4185-8db0-4787d9ef6ffc tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.174600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ce12420-3e6e-4185-8db0-4787d9ef6ffc tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.175026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ce12420-3e6e-4185-8db0-4787d9ef6ffc tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.201424 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3ce12420-3e6e-4185-8db0-4787d9ef6ffc tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?host=n-d-839401-11" status: 200 len: 581 microversion: 2.1 time: 0.036889 Aug 29 15:36:07.202358 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1436/2901] 10.222.0.62 () {58 vars in 1174 bytes} [Mon Aug 29 15:36:07 2022] GET /compute/v2.1/os-services?host=n-d-839401-11 => generated 581 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:07.214566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dd09a095-9e4f-468a-a719-6d94f6d33e5f tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:07.218379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd09a095-9e4f-468a-a719-6d94f6d33e5f tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.218873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd09a095-9e4f-468a-a719-6d94f6d33e5f tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.219308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd09a095-9e4f-468a-a719-6d94f6d33e5f tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.220079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd09a095-9e4f-468a-a719-6d94f6d33e5f tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.220651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd09a095-9e4f-468a-a719-6d94f6d33e5f tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.220966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd09a095-9e4f-468a-a719-6d94f6d33e5f tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.253941 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dd09a095-9e4f-468a-a719-6d94f6d33e5f tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.042971 Aug 29 15:36:07.254596 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1437/2902] 10.222.0.62 () {58 vars in 1176 bytes} [Mon Aug 29 15:36:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:36:07.270822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b310f660-a397-4b24-851f-6ae710a9e5ee tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:07.275752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b310f660-a397-4b24-851f-6ae710a9e5ee tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.276530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b310f660-a397-4b24-851f-6ae710a9e5ee tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.277363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b310f660-a397-4b24-851f-6ae710a9e5ee tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.278308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b310f660-a397-4b24-851f-6ae710a9e5ee tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.278943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b310f660-a397-4b24-851f-6ae710a9e5ee tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.279554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b310f660-a397-4b24-851f-6ae710a9e5ee tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.327059 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b310f660-a397-4b24-851f-6ae710a9e5ee tempest-ServicesAdminTestJSON-748444862 tempest-ServicesAdminTestJSON-748444862-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.061525 Aug 29 15:36:07.328537 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1438/2903] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:36:07 2022] GET /compute/v2.1/os-services => generated 949 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:07.463275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:36:07.464554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:36:07.465048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:36:07.465503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:36:07.465924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:36:07.483163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.483873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.484313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.487944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.491969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.492760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.525449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Getting quotas for project 325ef63c97944ef095271d56d3c26f31. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:07.534506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Getting quotas for user e3fceaa19ad04010811b370f5a030e6c and project 325ef63c97944ef095271d56d3c26f31. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:07.552911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.utils [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] cores quota exceeded for 325ef63c97944ef095271d56d3c26f31, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122360) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 29 15:36:07.553830 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Request method failure captured: Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 145 Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNzjQtaq5eH88kvgtILbpeRA_TB1hFp9zNCNPxPf3_wOSUiTNwi-ogacQHBKfDCKPhGKZHWmPS-btiSZoyuk1gNCGcefCSqqFSjJc1xFnTnZgT6DZIPwk9k4Jlfj8rlK5vI8lmWNyej5vqSKIj8TMYGW5ywQRuThyLbct1il4SacJ6k Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 325ef63c97944ef095271d56d3c26f31 Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-QuotasAdminNegativeTest-57882341 Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_325ef63c97944ef095271d56d3c26f31", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/325ef63c97944ef095271d56d3c26f31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/325ef63c97944ef095271d56d3c26f31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/325ef63c97944ef095271d56d3c26f31"}]}] Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-QuotasAdminNegativeTest-57882341 Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 325ef63c97944ef095271d56d3c26f31 Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-57882341 Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-QuotasAdminNegativeTest-57882341-project Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e3fceaa19ad04010811b370f5a030e6c Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-QuotasAdminNegativeTest-57882341-project Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1189897493", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1189897493', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452'}}} Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:36:07.570695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 15:36:07.577193 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:07.580143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-715b45f8-a625-4501-8039-ea5d71a53bdd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:07.580292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-715b45f8-a625-4501-8039-ea5d71a53bdd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:07.581999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:07.582821 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9558a4b5-1c31-4345-a682-22bee1a28ce9 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.022543 Aug 29 15:36:07.584700 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1466/2904] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:36:06 2022] POST /compute/v2.1/servers => generated 111 bytes in 1025 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:36:07.594695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-715b45f8-a625-4501-8039-ea5d71a53bdd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.596253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-715b45f8-a625-4501-8039-ea5d71a53bdd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.597541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3cf4991d-a27e-4be0-99e8-b7bde903c8de tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Action: 'update', calling method: .version_select at 0x7fc42b547280>, body: {"quota_set": {"cores": 20}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:07.598135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-715b45f8-a625-4501-8039-ea5d71a53bdd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.599023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-715b45f8-a625-4501-8039-ea5d71a53bdd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.600264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-715b45f8-a625-4501-8039-ea5d71a53bdd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.602473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-715b45f8-a625-4501-8039-ea5d71a53bdd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.888464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-715b45f8-a625-4501-8039-ea5d71a53bdd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:07.901885 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-715b45f8-a625-4501-8039-ea5d71a53bdd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.326926 Aug 29 15:36:07.914609 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1439/2905] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:07 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:07.920188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f6b02e87-bb39-4ecf-a68f-f2ec38782b96 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:07.931248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f6b02e87-bb39-4ecf-a68f-f2ec38782b96 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:07.938107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6b02e87-bb39-4ecf-a68f-f2ec38782b96 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.938935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6b02e87-bb39-4ecf-a68f-f2ec38782b96 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.939714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6b02e87-bb39-4ecf-a68f-f2ec38782b96 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.940574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6b02e87-bb39-4ecf-a68f-f2ec38782b96 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.941655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6b02e87-bb39-4ecf-a68f-f2ec38782b96 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.942308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6b02e87-bb39-4ecf-a68f-f2ec38782b96 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.944324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cf4991d-a27e-4be0-99e8-b7bde903c8de tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.945948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cf4991d-a27e-4be0-99e8-b7bde903c8de tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.946885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cf4991d-a27e-4be0-99e8-b7bde903c8de tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.948315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cf4991d-a27e-4be0-99e8-b7bde903c8de tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:07.949005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cf4991d-a27e-4be0-99e8-b7bde903c8de tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:07.949666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cf4991d-a27e-4be0-99e8-b7bde903c8de tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:07.966891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:08.057698 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3cf4991d-a27e-4be0-99e8-b7bde903c8de tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31" status: 200 len: 329 microversion: 2.1 time: 0.467745 Aug 29 15:36:08.058686 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1467/2906] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 15:36:07 2022] PUT /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31 => generated 329 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:08.065568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a7f85181-23e7-43f5-85f4-005205733ef7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:08.065568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a7f85181-23e7-43f5-85f4-005205733ef7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:08.071898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7f85181-23e7-43f5-85f4-005205733ef7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.072407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7f85181-23e7-43f5-85f4-005205733ef7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.073008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7f85181-23e7-43f5-85f4-005205733ef7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.073772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7f85181-23e7-43f5-85f4-005205733ef7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.074235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7f85181-23e7-43f5-85f4-005205733ef7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.074664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7f85181-23e7-43f5-85f4-005205733ef7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.215444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f6b02e87-bb39-4ecf-a68f-f2ec38782b96 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:08.223988 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f6b02e87-bb39-4ecf-a68f-f2ec38782b96 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1317 microversion: 2.1 time: 0.308175 Aug 29 15:36:08.227665 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1440/2907] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:07 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:08.245834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-64a79aef-22b2-469c-acab-1fdebdbbe88d tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Calling method '.version_select at 0x7fc42b6c8040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:08.361495 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-64a79aef-22b2-469c-acab-1fdebdbbe88d tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31" status: 200 len: 371 microversion: 2.1 time: 0.132604 Aug 29 15:36:08.362294 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1441/2908] 10.222.0.62 () {58 vars in 1242 bytes} [Mon Aug 29 15:36:08 2022] GET /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31 => generated 371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:08.374570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7dbdf505-aaca-472c-910b-8bea881c1d31 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:08.375240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7dbdf505-aaca-472c-910b-8bea881c1d31 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:08.381953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dbdf505-aaca-472c-910b-8bea881c1d31 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.382673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dbdf505-aaca-472c-910b-8bea881c1d31 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.383262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dbdf505-aaca-472c-910b-8bea881c1d31 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.384134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dbdf505-aaca-472c-910b-8bea881c1d31 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.384878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dbdf505-aaca-472c-910b-8bea881c1d31 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.385544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dbdf505-aaca-472c-910b-8bea881c1d31 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.509765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7dbdf505-aaca-472c-910b-8bea881c1d31 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:08.516929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a7f85181-23e7-43f5-85f4-005205733ef7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:08.519752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7dbdf505-aaca-472c-910b-8bea881c1d31 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:08.521521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7dbdf505-aaca-472c-910b-8bea881c1d31 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:08.523981 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7dbdf505-aaca-472c-910b-8bea881c1d31 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.154099 Aug 29 15:36:08.525357 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1442/2909] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:08 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:08.534744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-34b18c3f-d389-4983-b8c1-656976759cf7 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Action: 'update', calling method: .version_select at 0x7fc42baa7f70>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:08.543239 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a7f85181-23e7-43f5-85f4-005205733ef7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 0.483320 Aug 29 15:36:08.545028 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1468/2910] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:08 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:08.637471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b18c3f-d389-4983-b8c1-656976759cf7 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.637960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b18c3f-d389-4983-b8c1-656976759cf7 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.638705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b18c3f-d389-4983-b8c1-656976759cf7 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.639118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b18c3f-d389-4983-b8c1-656976759cf7 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.639571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b18c3f-d389-4983-b8c1-656976759cf7 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.640312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b18c3f-d389-4983-b8c1-656976759cf7 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.719876 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-34b18c3f-d389-4983-b8c1-656976759cf7 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31" status: 200 len: 328 microversion: 2.1 time: 0.192888 Aug 29 15:36:08.721121 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1443/2911] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 15:36:08 2022] PUT /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31 => generated 328 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:08.907218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-262987049", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:08.928184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7d203606-3aa4-4067-bbd3-22eef42c2d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:08.928968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7d203606-3aa4-4067-bbd3-22eef42c2d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:08.941481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d203606-3aa4-4067-bbd3-22eef42c2d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.943528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d203606-3aa4-4067-bbd3-22eef42c2d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.945122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d203606-3aa4-4067-bbd3-22eef42c2d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.946054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d203606-3aa4-4067-bbd3-22eef42c2d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:08.947597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d203606-3aa4-4067-bbd3-22eef42c2d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:08.948728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d203606-3aa4-4067-bbd3-22eef42c2d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:08.988954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] validate_networks() for None {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:36:09.201008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7d203606-3aa4-4067-bbd3-22eef42c2d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:09.208993 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7d203606-3aa4-4067-bbd3-22eef42c2d0f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.287040 Aug 29 15:36:09.221589 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1444/2912] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:08 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:09.253406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d7ac2564-8990-4e9e-9b0b-e5791f45d1a9 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:09.256307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d7ac2564-8990-4e9e-9b0b-e5791f45d1a9 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:09.272341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7ac2564-8990-4e9e-9b0b-e5791f45d1a9 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.277149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7ac2564-8990-4e9e-9b0b-e5791f45d1a9 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.277683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7ac2564-8990-4e9e-9b0b-e5791f45d1a9 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.278654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7ac2564-8990-4e9e-9b0b-e5791f45d1a9 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.279201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7ac2564-8990-4e9e-9b0b-e5791f45d1a9 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.279697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7ac2564-8990-4e9e-9b0b-e5791f45d1a9 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.393306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:36:09.393306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:36:09.394740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:36:09.400043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:36:09.400813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:36:09.427639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.428386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.430312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.432307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.451327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.455627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.509902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Getting quotas for project 325ef63c97944ef095271d56d3c26f31. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:09.517658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Getting quotas for user e3fceaa19ad04010811b370f5a030e6c and project 325ef63c97944ef095271d56d3c26f31. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:09.534691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.utils [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] instances quota exceeded for 325ef63c97944ef095271d56d3c26f31, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122360) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 29 15:36:09.535623 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Request method failure captured: Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 144 Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNzjQtaq5eH88kvgtILbpeRA_TB1hFp9zNCNPxPf3_wOSUiTNwi-ogacQHBKfDCKPhGKZHWmPS-btiSZoyuk1gNCGcefCSqqFSjJc1xFnTnZgT6DZIPwk9k4Jlfj8rlK5vI8lmWNyej5vqSKIj8TMYGW5ywQRuThyLbct1il4SacJ6k Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 325ef63c97944ef095271d56d3c26f31 Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-QuotasAdminNegativeTest-57882341 Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_325ef63c97944ef095271d56d3c26f31", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/325ef63c97944ef095271d56d3c26f31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/325ef63c97944ef095271d56d3c26f31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/325ef63c97944ef095271d56d3c26f31"}]}] Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-QuotasAdminNegativeTest-57882341 Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 325ef63c97944ef095271d56d3c26f31 Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-57882341 Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-QuotasAdminNegativeTest-57882341-project Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e3fceaa19ad04010811b370f5a030e6c Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-QuotasAdminNegativeTest-57882341-project Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-262987049", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-262987049', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452'}}} Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:36:09.537910 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 15:36:09.542239 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:09.546135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:09.546878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d7ac2564-8990-4e9e-9b0b-e5791f45d1a9 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:09.547241 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d7e52795-e4c7-4e4b-b820-2ab9005a42e0 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.645088 Aug 29 15:36:09.552201 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1469/2913] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:36:08 2022] POST /compute/v2.1/servers => generated 119 bytes in 651 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:36:09.559599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d0c1de82-d8a7-4de7-ab98-457a4c98739e tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:09.560174 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d7ac2564-8990-4e9e-9b0b-e5791f45d1a9 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1317 microversion: 2.1 time: 0.314351 Aug 29 15:36:09.560538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d0c1de82-d8a7-4de7-ab98-457a4c98739e tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:09.561249 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1445/2914] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:09 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:09.569298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0c1de82-d8a7-4de7-ab98-457a4c98739e tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.569900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0c1de82-d8a7-4de7-ab98-457a4c98739e tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.570408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0c1de82-d8a7-4de7-ab98-457a4c98739e tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.571208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0c1de82-d8a7-4de7-ab98-457a4c98739e tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.571739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0c1de82-d8a7-4de7-ab98-457a4c98739e tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.572498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0c1de82-d8a7-4de7-ab98-457a4c98739e tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.579566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5c33ced9-464d-4359-8b87-23046017dbdc tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Action: 'update', calling method: .version_select at 0x7fc42b6f1ca0>, body: {"quota_set": {"instances": 10}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:09.680695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d0c1de82-d8a7-4de7-ab98-457a4c98739e tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:09.713524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d0c1de82-d8a7-4de7-ab98-457a4c98739e tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:09.716242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d0c1de82-d8a7-4de7-ab98-457a4c98739e tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:09.719309 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d0c1de82-d8a7-4de7-ab98-457a4c98739e tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.165930 Aug 29 15:36:09.724627 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1470/2915] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:09 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:09.908633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-069e4388-4822-40f8-adae-a522a42bf36a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:09.909234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-069e4388-4822-40f8-adae-a522a42bf36a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:09.922574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-069e4388-4822-40f8-adae-a522a42bf36a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.923118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-069e4388-4822-40f8-adae-a522a42bf36a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.923567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-069e4388-4822-40f8-adae-a522a42bf36a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.925771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-069e4388-4822-40f8-adae-a522a42bf36a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.931474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-069e4388-4822-40f8-adae-a522a42bf36a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.932032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-069e4388-4822-40f8-adae-a522a42bf36a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.951201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c33ced9-464d-4359-8b87-23046017dbdc tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.951846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c33ced9-464d-4359-8b87-23046017dbdc tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.952107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c33ced9-464d-4359-8b87-23046017dbdc tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:09.955678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c33ced9-464d-4359-8b87-23046017dbdc tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:09.956140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c33ced9-464d-4359-8b87-23046017dbdc tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:09.956740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c33ced9-464d-4359-8b87-23046017dbdc tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:10.036596 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5c33ced9-464d-4359-8b87-23046017dbdc tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31" status: 200 len: 329 microversion: 2.1 time: 0.469627 Aug 29 15:36:10.044594 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1446/2916] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 15:36:09 2022] PUT /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31 => generated 329 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:10.049809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9423acc9-4815-4212-b5f5-1eaec29a0fbd tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Calling method '.version_select at 0x7fc42baa7820>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:10.141401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-069e4388-4822-40f8-adae-a522a42bf36a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:10.145379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:10.158035 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-069e4388-4822-40f8-adae-a522a42bf36a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 0.431901 Aug 29 15:36:10.174059 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1471/2917] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:09 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:10.240080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e8ce0f4c-10cc-4108-878a-5681ed5e8fa3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:10.240925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e8ce0f4c-10cc-4108-878a-5681ed5e8fa3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:10.256203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8ce0f4c-10cc-4108-878a-5681ed5e8fa3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:10.260356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8ce0f4c-10cc-4108-878a-5681ed5e8fa3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:10.261034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8ce0f4c-10cc-4108-878a-5681ed5e8fa3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:10.262091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8ce0f4c-10cc-4108-878a-5681ed5e8fa3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:10.262550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8ce0f4c-10cc-4108-878a-5681ed5e8fa3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:10.265752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8ce0f4c-10cc-4108-878a-5681ed5e8fa3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:10.411926 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9423acc9-4815-4212-b5f5-1eaec29a0fbd tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31" status: 200 len: 371 microversion: 2.1 time: 0.365840 Aug 29 15:36:10.415376 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1447/2918] 10.222.0.62 () {58 vars in 1242 bytes} [Mon Aug 29 15:36:10 2022] GET /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31 => generated 371 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:10.429651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a37ff776-3c6f-4b54-9fc5-312226b01098 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Action: 'update', calling method: .version_select at 0x7fc42b94d4c0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:10.531763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a37ff776-3c6f-4b54-9fc5-312226b01098 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:10.533523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a37ff776-3c6f-4b54-9fc5-312226b01098 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:10.534207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a37ff776-3c6f-4b54-9fc5-312226b01098 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:10.535385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a37ff776-3c6f-4b54-9fc5-312226b01098 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:10.536206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a37ff776-3c6f-4b54-9fc5-312226b01098 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:10.538101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a37ff776-3c6f-4b54-9fc5-312226b01098 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:10.571088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e8ce0f4c-10cc-4108-878a-5681ed5e8fa3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:10.587230 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e8ce0f4c-10cc-4108-878a-5681ed5e8fa3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.355424 Aug 29 15:36:10.597892 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1472/2919] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:10 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:10.598120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c273d2db-a0f9-4566-b430-15cb0ff78a2e tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:10.598979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c273d2db-a0f9-4566-b430-15cb0ff78a2e tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:10.614309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c273d2db-a0f9-4566-b430-15cb0ff78a2e tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:10.615904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c273d2db-a0f9-4566-b430-15cb0ff78a2e tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:10.616500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c273d2db-a0f9-4566-b430-15cb0ff78a2e tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:10.617914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c273d2db-a0f9-4566-b430-15cb0ff78a2e tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:10.619997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c273d2db-a0f9-4566-b430-15cb0ff78a2e tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:10.620626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c273d2db-a0f9-4566-b430-15cb0ff78a2e tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:10.661075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:10.685028 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a37ff776-3c6f-4b54-9fc5-312226b01098 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31" status: 200 len: 325 microversion: 2.1 time: 0.260316 Aug 29 15:36:10.697123 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1448/2920] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 15:36:10 2022] PUT /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31 => generated 325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:10.750266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6aa686c3-4d10-4db4-97c3-65c17fec092a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:10.751366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6aa686c3-4d10-4db4-97c3-65c17fec092a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:10.763736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa686c3-4d10-4db4-97c3-65c17fec092a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:10.764674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa686c3-4d10-4db4-97c3-65c17fec092a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:10.765359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa686c3-4d10-4db4-97c3-65c17fec092a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:10.766297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa686c3-4d10-4db4-97c3-65c17fec092a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:10.767013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa686c3-4d10-4db4-97c3-65c17fec092a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:10.767617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa686c3-4d10-4db4-97c3-65c17fec092a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:10.923367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6aa686c3-4d10-4db4-97c3-65c17fec092a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:10.941037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6aa686c3-4d10-4db4-97c3-65c17fec092a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:10.945837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6aa686c3-4d10-4db4-97c3-65c17fec092a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:10.950835 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6aa686c3-4d10-4db4-97c3-65c17fec092a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.207781 Aug 29 15:36:10.951466 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1449/2921] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:10 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:36:10.960391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-607716774", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:11.052738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:36:11.350540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:36:11.352178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:36:11.352723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:36:11.353195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:36:11.353602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:36:11.370764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.371259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.371697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.372593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.373058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.373513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.424019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Getting quotas for project 325ef63c97944ef095271d56d3c26f31. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:11.431467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Getting quotas for user e3fceaa19ad04010811b370f5a030e6c and project 325ef63c97944ef095271d56d3c26f31. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:11.436190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c273d2db-a0f9-4566-b430-15cb0ff78a2e tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:11.448811 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c273d2db-a0f9-4566-b430-15cb0ff78a2e tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 200 len: 1506 microversion: 2.1 time: 0.859179 Aug 29 15:36:11.449884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.utils [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] ram quota exceeded for 325ef63c97944ef095271d56d3c26f31, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122361) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Request method failure captured: Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 144 Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNzjQtaq5eH88kvgtILbpeRA_TB1hFp9zNCNPxPf3_wOSUiTNwi-ogacQHBKfDCKPhGKZHWmPS-btiSZoyuk1gNCGcefCSqqFSjJc1xFnTnZgT6DZIPwk9k4Jlfj8rlK5vI8lmWNyej5vqSKIj8TMYGW5ywQRuThyLbct1il4SacJ6k Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 325ef63c97944ef095271d56d3c26f31 Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-QuotasAdminNegativeTest-57882341 Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_325ef63c97944ef095271d56d3c26f31", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/325ef63c97944ef095271d56d3c26f31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/325ef63c97944ef095271d56d3c26f31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/325ef63c97944ef095271d56d3c26f31"}]}] Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-QuotasAdminNegativeTest-57882341 Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 325ef63c97944ef095271d56d3c26f31 Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-57882341 Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-QuotasAdminNegativeTest-57882341-project Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e3fceaa19ad04010811b370f5a030e6c Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-QuotasAdminNegativeTest-57882341-project Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-607716774", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-607716774', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452'}}} Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:36:11.465011 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f5b46dda-8333-4e4b-8003-eed1b0795953 tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.502414 Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1450/2922] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:36:10 2022] POST /compute/v2.1/servers => generated 110 bytes in 506 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-09fbde09-74e9-4d0f-a194-9954c33e8309 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:11.468842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-09fbde09-74e9-4d0f-a194-9954c33e8309 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:11.484408 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1473/2923] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:10 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 1506 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:11.495021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3ec9c6eb-26e5-4d77-a2fe-65b3c52a9960 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Action: 'update', calling method: .version_select at 0x7fc433ba1670>, body: {"quota_set": {"ram": 51200}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:11.495706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09fbde09-74e9-4d0f-a194-9954c33e8309 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.496440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09fbde09-74e9-4d0f-a194-9954c33e8309 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.497131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09fbde09-74e9-4d0f-a194-9954c33e8309 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.498069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09fbde09-74e9-4d0f-a194-9954c33e8309 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.502057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09fbde09-74e9-4d0f-a194-9954c33e8309 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.503185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09fbde09-74e9-4d0f-a194-9954c33e8309 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.831670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-09fbde09-74e9-4d0f-a194-9954c33e8309 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:11.845829 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-09fbde09-74e9-4d0f-a194-9954c33e8309 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 0.381895 Aug 29 15:36:11.845829 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1451/2924] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:11 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:11.862493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ec9c6eb-26e5-4d77-a2fe-65b3c52a9960 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.863673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ec9c6eb-26e5-4d77-a2fe-65b3c52a9960 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.864149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-766920f9-2205-4f4f-9e6f-e6479a86c105 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:11.864428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ec9c6eb-26e5-4d77-a2fe-65b3c52a9960 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.865336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ec9c6eb-26e5-4d77-a2fe-65b3c52a9960 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.867384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ec9c6eb-26e5-4d77-a2fe-65b3c52a9960 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.867997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ec9c6eb-26e5-4d77-a2fe-65b3c52a9960 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.870502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-766920f9-2205-4f4f-9e6f-e6479a86c105 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b73a7195-711e-46b6-ad0f-a6e38339b2fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:11.883603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-766920f9-2205-4f4f-9e6f-e6479a86c105 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.886369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-766920f9-2205-4f4f-9e6f-e6479a86c105 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.886864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-766920f9-2205-4f4f-9e6f-e6479a86c105 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.889357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-766920f9-2205-4f4f-9e6f-e6479a86c105 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.889984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-766920f9-2205-4f4f-9e6f-e6479a86c105 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.890440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-766920f9-2205-4f4f-9e6f-e6479a86c105 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.962865 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3ec9c6eb-26e5-4d77-a2fe-65b3c52a9960 tempest-QuotasAdminNegativeTest-1488752946 tempest-QuotasAdminNegativeTest-1488752946-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31" status: 200 len: 329 microversion: 2.1 time: 0.476420 Aug 29 15:36:11.970596 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1474/2925] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 15:36:11 2022] PUT /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31 => generated 329 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:11.983010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6559fa51-4f9a-4885-9136-072f106d83d2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:11.983637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6559fa51-4f9a-4885-9136-072f106d83d2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:11.994528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6559fa51-4f9a-4885-9136-072f106d83d2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.995033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6559fa51-4f9a-4885-9136-072f106d83d2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.995477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6559fa51-4f9a-4885-9136-072f106d83d2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.996206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6559fa51-4f9a-4885-9136-072f106d83d2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.996658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6559fa51-4f9a-4885-9136-072f106d83d2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.997126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6559fa51-4f9a-4885-9136-072f106d83d2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:12.297176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-766920f9-2205-4f4f-9e6f-e6479a86c105 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:12.307325 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-766920f9-2205-4f4f-9e6f-e6479a86c105 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b73a7195-711e-46b6-ad0f-a6e38339b2fb" status: 200 len: 1505 microversion: 2.1 time: 0.461702 Aug 29 15:36:12.307931 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1452/2926] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:11 2022] GET /compute/v2.1/servers/b73a7195-711e-46b6-ad0f-a6e38339b2fb => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:12.313776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-254ef1b6-be5f-4e1d-8ea9-1e07d38aaae1 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:12.314614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-254ef1b6-be5f-4e1d-8ea9-1e07d38aaae1 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:12.332313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-254ef1b6-be5f-4e1d-8ea9-1e07d38aaae1 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:12.333419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-254ef1b6-be5f-4e1d-8ea9-1e07d38aaae1 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:12.334241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-254ef1b6-be5f-4e1d-8ea9-1e07d38aaae1 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:12.336389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-254ef1b6-be5f-4e1d-8ea9-1e07d38aaae1 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:12.337160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-254ef1b6-be5f-4e1d-8ea9-1e07d38aaae1 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:12.338095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-254ef1b6-be5f-4e1d-8ea9-1e07d38aaae1 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:12.435312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-254ef1b6-be5f-4e1d-8ea9-1e07d38aaae1 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:12.471593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-254ef1b6-be5f-4e1d-8ea9-1e07d38aaae1 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:12.473745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-254ef1b6-be5f-4e1d-8ea9-1e07d38aaae1 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:12.475323 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-254ef1b6-be5f-4e1d-8ea9-1e07d38aaae1 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.165662 Aug 29 15:36:12.475924 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1453/2927] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:12 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:12.481468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e980ad0f-3575-4cc7-a539-da1253a4333c tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Action: 'update', calling method: .version_select at 0x7fc433a4b280>, body: {"quota_set": {"ram": 0}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:12.487200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e980ad0f-3575-4cc7-a539-da1253a4333c tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'e3fceaa19ad04010811b370f5a030e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325ef63c97944ef095271d56d3c26f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:12.502316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6559fa51-4f9a-4885-9136-072f106d83d2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e980ad0f-3575-4cc7-a539-da1253a4333c tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Request method failure captured: Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: request: PUT /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31 HTTP/1.1 Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 25 Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNzjQtaq5eH88kvgtILbpeRA_TB1hFp9zNCNPxPf3_wOSUiTNwi-ogacQHBKfDCKPhGKZHWmPS-btiSZoyuk1gNCGcefCSqqFSjJc1xFnTnZgT6DZIPwk9k4Jlfj8rlK5vI8lmWNyej5vqSKIj8TMYGW5ywQRuThyLbct1il4SacJ6k Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 325ef63c97944ef095271d56d3c26f31 Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-QuotasAdminNegativeTest-57882341 Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_325ef63c97944ef095271d56d3c26f31", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/325ef63c97944ef095271d56d3c26f31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/325ef63c97944ef095271d56d3c26f31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/325ef63c97944ef095271d56d3c26f31"}]}] Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-QuotasAdminNegativeTest-57882341 Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 325ef63c97944ef095271d56d3c26f31 Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-57882341 Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-QuotasAdminNegativeTest-57882341-project Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e3fceaa19ad04010811b370f5a030e6c Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-QuotasAdminNegativeTest-57882341-project Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: {"quota_set": {"ram": 0}} Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '325ef63c97944ef095271d56d3c26f31', 'body': {'quota_set': {'ram': 0}}} Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:36:12.507922 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:36:12.511969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:36:12.511969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:36:12.511969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:36:12.511969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:36:12.511969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 29 15:36:12.511969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:12.511969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:12.511969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:12.511969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:12.511969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:12.511969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:12.511969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:36:12.511969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:36:12.511969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 29 15:36:12.511969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:12.519438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e980ad0f-3575-4cc7-a539-da1253a4333c tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:12.523363 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e980ad0f-3575-4cc7-a539-da1253a4333c tempest-QuotasAdminNegativeTest-57882341 tempest-QuotasAdminNegativeTest-57882341-project] 10.222.0.62 "PUT /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31" status: 403 len: 116 microversion: 2.1 time: 0.045048 Aug 29 15:36:12.526503 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6559fa51-4f9a-4885-9136-072f106d83d2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.556876 Aug 29 15:36:12.527291 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1454/2928] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 15:36:12 2022] PUT /compute/v2.1/os-quota-sets/325ef63c97944ef095271d56d3c26f31 => generated 116 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:36:12.544761 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1475/2929] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:11 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:12.553313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0b182493-6407-4d0e-929e-4c464267c629 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:12.553851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0b182493-6407-4d0e-929e-4c464267c629 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b73a7195-711e-46b6-ad0f-a6e38339b2fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:12.562299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b182493-6407-4d0e-929e-4c464267c629 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:12.562789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b182493-6407-4d0e-929e-4c464267c629 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:12.563225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b182493-6407-4d0e-929e-4c464267c629 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:12.563995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b182493-6407-4d0e-929e-4c464267c629 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:12.564807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b182493-6407-4d0e-929e-4c464267c629 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:12.565275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b182493-6407-4d0e-929e-4c464267c629 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:12.608578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0b182493-6407-4d0e-929e-4c464267c629 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b73a7195-711e-46b6-ad0f-a6e38339b2fb] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:36:12.816962 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0b182493-6407-4d0e-929e-4c464267c629 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b73a7195-711e-46b6-ad0f-a6e38339b2fb" status: 204 len: 0 microversion: 2.1 time: 0.277765 Aug 29 15:36:12.820967 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1455/2930] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:36:12 2022] DELETE /compute/v2.1/servers/b73a7195-711e-46b6-ad0f-a6e38339b2fb => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:36:12.835936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85a7d747-4020-4b00-84f2-a53d828c5d3c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:12.836785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-85a7d747-4020-4b00-84f2-a53d828c5d3c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:12.856517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85a7d747-4020-4b00-84f2-a53d828c5d3c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:12.857780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85a7d747-4020-4b00-84f2-a53d828c5d3c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:12.859110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85a7d747-4020-4b00-84f2-a53d828c5d3c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:12.862045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85a7d747-4020-4b00-84f2-a53d828c5d3c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:12.863103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85a7d747-4020-4b00-84f2-a53d828c5d3c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:12.865581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85a7d747-4020-4b00-84f2-a53d828c5d3c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:12.868826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-67792cc7-3e5a-4982-a7d6-5ab64556ac58 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:12.870137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-67792cc7-3e5a-4982-a7d6-5ab64556ac58 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:12.883889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67792cc7-3e5a-4982-a7d6-5ab64556ac58 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:12.886023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67792cc7-3e5a-4982-a7d6-5ab64556ac58 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:12.886955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67792cc7-3e5a-4982-a7d6-5ab64556ac58 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:12.888505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67792cc7-3e5a-4982-a7d6-5ab64556ac58 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:12.895129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67792cc7-3e5a-4982-a7d6-5ab64556ac58 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:12.895129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67792cc7-3e5a-4982-a7d6-5ab64556ac58 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:12.918859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-85a7d747-4020-4b00-84f2-a53d828c5d3c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:36:13.041859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:UPDATE=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:13.054171 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85a7d747-4020-4b00-84f2-a53d828c5d3c tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 204 len: 0 microversion: 2.1 time: 0.230690 Aug 29 15:36:13.055069 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1476/2931] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:36:12 2022] DELETE /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:36:13.069893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a28984c0-5cab-46fe-97e4-3937ba0be062 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:13.071136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a28984c0-5cab-46fe-97e4-3937ba0be062 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b73a7195-711e-46b6-ad0f-a6e38339b2fb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:13.080267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a28984c0-5cab-46fe-97e4-3937ba0be062 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:13.081011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a28984c0-5cab-46fe-97e4-3937ba0be062 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:13.081785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a28984c0-5cab-46fe-97e4-3937ba0be062 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:13.082913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a28984c0-5cab-46fe-97e4-3937ba0be062 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:13.083768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a28984c0-5cab-46fe-97e4-3937ba0be062 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:13.084362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a28984c0-5cab-46fe-97e4-3937ba0be062 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:13.179937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-67792cc7-3e5a-4982-a7d6-5ab64556ac58 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:13.188432 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-67792cc7-3e5a-4982-a7d6-5ab64556ac58 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 0.328217 Aug 29 15:36:13.189200 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1456/2932] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:12 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:13.317338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a28984c0-5cab-46fe-97e4-3937ba0be062 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:13.330840 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a28984c0-5cab-46fe-97e4-3937ba0be062 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b73a7195-711e-46b6-ad0f-a6e38339b2fb" status: 200 len: 1511 microversion: 2.1 time: 0.270587 Aug 29 15:36:13.331293 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1477/2933] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:13 2022] GET /compute/v2.1/servers/b73a7195-711e-46b6-ad0f-a6e38339b2fb => generated 1511 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:13.513512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-efe275d8-1eee-4263-b2f2-9ae118b6571f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:13.515690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-efe275d8-1eee-4263-b2f2-9ae118b6571f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:13.530346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-efe275d8-1eee-4263-b2f2-9ae118b6571f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:13.531254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-efe275d8-1eee-4263-b2f2-9ae118b6571f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:13.533895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-efe275d8-1eee-4263-b2f2-9ae118b6571f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:13.536246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-efe275d8-1eee-4263-b2f2-9ae118b6571f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:13.537999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-efe275d8-1eee-4263-b2f2-9ae118b6571f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:13.540265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-efe275d8-1eee-4263-b2f2-9ae118b6571f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:13.552237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bdd422a8-bbd3-492e-a4c1-1c63b2cd571f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:13.552966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bdd422a8-bbd3-492e-a4c1-1c63b2cd571f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:13.565188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdd422a8-bbd3-492e-a4c1-1c63b2cd571f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:13.566039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdd422a8-bbd3-492e-a4c1-1c63b2cd571f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:13.566639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdd422a8-bbd3-492e-a4c1-1c63b2cd571f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:13.569914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdd422a8-bbd3-492e-a4c1-1c63b2cd571f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:13.570614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdd422a8-bbd3-492e-a4c1-1c63b2cd571f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:13.571220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdd422a8-bbd3-492e-a4c1-1c63b2cd571f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:13.678096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-efe275d8-1eee-4263-b2f2-9ae118b6571f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:13.688404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-efe275d8-1eee-4263-b2f2-9ae118b6571f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:13.690881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-efe275d8-1eee-4263-b2f2-9ae118b6571f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:13.692674 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-efe275d8-1eee-4263-b2f2-9ae118b6571f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.198151 Aug 29 15:36:13.711990 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1457/2934] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:13 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:13.970646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bdd422a8-bbd3-492e-a4c1-1c63b2cd571f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:13.980226 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bdd422a8-bbd3-492e-a4c1-1c63b2cd571f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.432272 Aug 29 15:36:13.999786 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1478/2935] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:13 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:14.215112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-69530bbe-7679-4c2a-8910-0b73ddfd10ce tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:14.215738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-69530bbe-7679-4c2a-8910-0b73ddfd10ce tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:14.222542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69530bbe-7679-4c2a-8910-0b73ddfd10ce tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:14.223369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69530bbe-7679-4c2a-8910-0b73ddfd10ce tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:14.224083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69530bbe-7679-4c2a-8910-0b73ddfd10ce tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:14.225178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69530bbe-7679-4c2a-8910-0b73ddfd10ce tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:14.226463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69530bbe-7679-4c2a-8910-0b73ddfd10ce tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:14.226993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69530bbe-7679-4c2a-8910-0b73ddfd10ce tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:14.356198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-297f174d-e576-45e3-a26f-b19b0808ef1a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:14.356198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-297f174d-e576-45e3-a26f-b19b0808ef1a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b73a7195-711e-46b6-ad0f-a6e38339b2fb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:14.394828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-297f174d-e576-45e3-a26f-b19b0808ef1a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:14.397337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-297f174d-e576-45e3-a26f-b19b0808ef1a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:14.398809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-297f174d-e576-45e3-a26f-b19b0808ef1a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:14.401596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-297f174d-e576-45e3-a26f-b19b0808ef1a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:14.402309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-297f174d-e576-45e3-a26f-b19b0808ef1a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:14.404738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-297f174d-e576-45e3-a26f-b19b0808ef1a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:14.665932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-297f174d-e576-45e3-a26f-b19b0808ef1a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:14.679828 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-297f174d-e576-45e3-a26f-b19b0808ef1a tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b73a7195-711e-46b6-ad0f-a6e38339b2fb" status: 200 len: 1511 microversion: 2.1 time: 0.331417 Aug 29 15:36:14.685245 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1479/2936] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:14 2022] GET /compute/v2.1/servers/b73a7195-711e-46b6-ad0f-a6e38339b2fb => generated 1511 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:14.722709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-be3043ab-f695-4e3e-bef3-9482bc0cb191 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:14.723457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-be3043ab-f695-4e3e-bef3-9482bc0cb191 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:14.739513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be3043ab-f695-4e3e-bef3-9482bc0cb191 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:14.741465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be3043ab-f695-4e3e-bef3-9482bc0cb191 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:14.742436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be3043ab-f695-4e3e-bef3-9482bc0cb191 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:14.745152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be3043ab-f695-4e3e-bef3-9482bc0cb191 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:14.746393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be3043ab-f695-4e3e-bef3-9482bc0cb191 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:14.748270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be3043ab-f695-4e3e-bef3-9482bc0cb191 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:14.922026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-be3043ab-f695-4e3e-bef3-9482bc0cb191 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:14.934537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-be3043ab-f695-4e3e-bef3-9482bc0cb191 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:14.937050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-be3043ab-f695-4e3e-bef3-9482bc0cb191 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:14.941404 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-be3043ab-f695-4e3e-bef3-9482bc0cb191 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.222919 Aug 29 15:36:14.944046 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1480/2937] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:14 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:36:15.006374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-78a9c5f5-0121-4855-8c5f-6e8e18379495 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:15.007067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-78a9c5f5-0121-4855-8c5f-6e8e18379495 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:15.017730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a9c5f5-0121-4855-8c5f-6e8e18379495 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:15.018248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a9c5f5-0121-4855-8c5f-6e8e18379495 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:15.018700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a9c5f5-0121-4855-8c5f-6e8e18379495 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:15.022059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a9c5f5-0121-4855-8c5f-6e8e18379495 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:15.024969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a9c5f5-0121-4855-8c5f-6e8e18379495 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:15.027851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a9c5f5-0121-4855-8c5f-6e8e18379495 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:15.237267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-69530bbe-7679-4c2a-8910-0b73ddfd10ce tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:15.255485 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-69530bbe-7679-4c2a-8910-0b73ddfd10ce tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 1.044497 Aug 29 15:36:15.271220 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1458/2938] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:14 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:15.589769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-78a9c5f5-0121-4855-8c5f-6e8e18379495 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:15.598517 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-78a9c5f5-0121-4855-8c5f-6e8e18379495 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.596156 Aug 29 15:36:15.601795 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1481/2939] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:15 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:15.704347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cd4018c1-5b01-4f64-867d-850c10f26dc2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:15.705317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cd4018c1-5b01-4f64-867d-850c10f26dc2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b73a7195-711e-46b6-ad0f-a6e38339b2fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:15.743685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd4018c1-5b01-4f64-867d-850c10f26dc2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:15.750986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd4018c1-5b01-4f64-867d-850c10f26dc2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:15.756232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd4018c1-5b01-4f64-867d-850c10f26dc2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:15.759779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd4018c1-5b01-4f64-867d-850c10f26dc2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:15.760425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd4018c1-5b01-4f64-867d-850c10f26dc2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:15.762943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd4018c1-5b01-4f64-867d-850c10f26dc2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:15.969032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-61c71d8e-15e4-40e3-a3be-026234495d65 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:15.980419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-61c71d8e-15e4-40e3-a3be-026234495d65 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:16.002743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61c71d8e-15e4-40e3-a3be-026234495d65 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.003169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61c71d8e-15e4-40e3-a3be-026234495d65 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.003755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61c71d8e-15e4-40e3-a3be-026234495d65 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.004801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61c71d8e-15e4-40e3-a3be-026234495d65 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.005489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61c71d8e-15e4-40e3-a3be-026234495d65 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.006022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61c71d8e-15e4-40e3-a3be-026234495d65 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.225895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-61c71d8e-15e4-40e3-a3be-026234495d65 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:16.250632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-61c71d8e-15e4-40e3-a3be-026234495d65 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:16.252216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-61c71d8e-15e4-40e3-a3be-026234495d65 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:16.257137 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-61c71d8e-15e4-40e3-a3be-026234495d65 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.291322 Aug 29 15:36:16.258367 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1482/2940] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:15 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:36:16.282947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ecc3cf54-d9d5-415e-a811-d571c089d714 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:16.283666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ecc3cf54-d9d5-415e-a811-d571c089d714 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:16.296301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecc3cf54-d9d5-415e-a811-d571c089d714 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.297986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecc3cf54-d9d5-415e-a811-d571c089d714 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.301258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecc3cf54-d9d5-415e-a811-d571c089d714 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.302659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecc3cf54-d9d5-415e-a811-d571c089d714 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.303570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecc3cf54-d9d5-415e-a811-d571c089d714 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.304202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecc3cf54-d9d5-415e-a811-d571c089d714 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.570888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cd4018c1-5b01-4f64-867d-850c10f26dc2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:16.593408 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cd4018c1-5b01-4f64-867d-850c10f26dc2 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b73a7195-711e-46b6-ad0f-a6e38339b2fb" status: 200 len: 1511 microversion: 2.1 time: 0.893213 Aug 29 15:36:16.606343 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1459/2941] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:15 2022] GET /compute/v2.1/servers/b73a7195-711e-46b6-ad0f-a6e38339b2fb => generated 1511 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:16.623536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a43bf43b-0783-4ba8-81e4-7f7eca1a5ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:16.624523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a43bf43b-0783-4ba8-81e4-7f7eca1a5ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:16.640192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a43bf43b-0783-4ba8-81e4-7f7eca1a5ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.644325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a43bf43b-0783-4ba8-81e4-7f7eca1a5ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.645027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a43bf43b-0783-4ba8-81e4-7f7eca1a5ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.645979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a43bf43b-0783-4ba8-81e4-7f7eca1a5ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:16.654487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a43bf43b-0783-4ba8-81e4-7f7eca1a5ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:16.655397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a43bf43b-0783-4ba8-81e4-7f7eca1a5ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:16.801950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ecc3cf54-d9d5-415e-a811-d571c089d714 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:16.814281 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ecc3cf54-d9d5-415e-a811-d571c089d714 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 0.537365 Aug 29 15:36:16.816927 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1483/2942] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:16 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:17.132412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c84a98d3-6aaa-41af-af10-1dcd7038e53c req-bb459385-1fb3-4d77-838c-eda2f78583f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b02587-e9cd-4361-874a-0ede2593daef", "name": "network-vif-deleted", "tag": "3a0e9dae-9a01-4902-9b3b-c920d9d702e4"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:17.160415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c84a98d3-6aaa-41af-af10-1dcd7038e53c req-bb459385-1fb3-4d77-838c-eda2f78583f2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.161603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c84a98d3-6aaa-41af-af10-1dcd7038e53c req-bb459385-1fb3-4d77-838c-eda2f78583f2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.162046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c84a98d3-6aaa-41af-af10-1dcd7038e53c req-bb459385-1fb3-4d77-838c-eda2f78583f2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.224767 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c84a98d3-6aaa-41af-af10-1dcd7038e53c req-bb459385-1fb3-4d77-838c-eda2f78583f2 service nova] Creating event network-vif-deleted:3a0e9dae-9a01-4902-9b3b-c920d9d702e4 for instance b9b02587-e9cd-4361-874a-0ede2593daef on n-h1-839401-11 Aug 29 15:36:17.236210 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c84a98d3-6aaa-41af-af10-1dcd7038e53c req-bb459385-1fb3-4d77-838c-eda2f78583f2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109069 Aug 29 15:36:17.242834 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1484/2943] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:17.284881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-33b72c26-5c43-4366-aab1-718bba7e8188 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:17.285905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-33b72c26-5c43-4366-aab1-718bba7e8188 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:17.302548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33b72c26-5c43-4366-aab1-718bba7e8188 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.303051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33b72c26-5c43-4366-aab1-718bba7e8188 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.303503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33b72c26-5c43-4366-aab1-718bba7e8188 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.315644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33b72c26-5c43-4366-aab1-718bba7e8188 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.325252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33b72c26-5c43-4366-aab1-718bba7e8188 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.327147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33b72c26-5c43-4366-aab1-718bba7e8188 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.829168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a43bf43b-0783-4ba8-81e4-7f7eca1a5ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:17.842169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:17.846157 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a43bf43b-0783-4ba8-81e4-7f7eca1a5ca4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 1.226699 Aug 29 15:36:17.847278 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1460/2944] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:16 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:17.869807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-edf74211-6eac-48a0-bcad-25e9ed8d5817 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:17.869952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-edf74211-6eac-48a0-bcad-25e9ed8d5817 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b73a7195-711e-46b6-ad0f-a6e38339b2fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:17.877720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edf74211-6eac-48a0-bcad-25e9ed8d5817 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.878559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edf74211-6eac-48a0-bcad-25e9ed8d5817 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.879353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edf74211-6eac-48a0-bcad-25e9ed8d5817 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:17.880222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edf74211-6eac-48a0-bcad-25e9ed8d5817 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:17.881168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edf74211-6eac-48a0-bcad-25e9ed8d5817 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:17.882228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edf74211-6eac-48a0-bcad-25e9ed8d5817 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.307593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-33b72c26-5c43-4366-aab1-718bba7e8188 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:18.320962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-33b72c26-5c43-4366-aab1-718bba7e8188 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:18.325982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-33b72c26-5c43-4366-aab1-718bba7e8188 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:18.329104 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-33b72c26-5c43-4366-aab1-718bba7e8188 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 1.047954 Aug 29 15:36:18.332596 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1485/2945] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:17 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:18.345922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-562c42fb-5811-4d9a-88e6-27afe9080425 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:18.346920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-562c42fb-5811-4d9a-88e6-27afe9080425 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:18.361616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-562c42fb-5811-4d9a-88e6-27afe9080425 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.362144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-562c42fb-5811-4d9a-88e6-27afe9080425 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.362558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-562c42fb-5811-4d9a-88e6-27afe9080425 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.363302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-562c42fb-5811-4d9a-88e6-27afe9080425 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.363775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-562c42fb-5811-4d9a-88e6-27afe9080425 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.369564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-562c42fb-5811-4d9a-88e6-27afe9080425 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.699656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-562c42fb-5811-4d9a-88e6-27afe9080425 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:18.712322 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-562c42fb-5811-4d9a-88e6-27afe9080425 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 0.377788 Aug 29 15:36:18.713930 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1486/2946] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:18 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:18.879540 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4d98ffaa-8cf7-4836-9b1c-8dc76e9dda4c tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] 10.222.0.62 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.163650 Aug 29 15:36:18.880141 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1487/2947] 10.222.0.62 () {58 vars in 1128 bytes} [Mon Aug 29 15:36:18 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 15:36:18.890031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c536d7ee-17cf-4c46-9a74-6322fe3ef7bf tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:18.891004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c536d7ee-17cf-4c46-9a74-6322fe3ef7bf tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:18.906290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c536d7ee-17cf-4c46-9a74-6322fe3ef7bf tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.908885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c536d7ee-17cf-4c46-9a74-6322fe3ef7bf tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.910553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c536d7ee-17cf-4c46-9a74-6322fe3ef7bf tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:18.913194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c536d7ee-17cf-4c46-9a74-6322fe3ef7bf tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:18.913925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c536d7ee-17cf-4c46-9a74-6322fe3ef7bf tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:18.914831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c536d7ee-17cf-4c46-9a74-6322fe3ef7bf tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:19.042889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-edf74211-6eac-48a0-bcad-25e9ed8d5817 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7138531e3322432c991b0d0b00e3fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4615dd6897416ca44c89b092e5526d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:19.057547 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-edf74211-6eac-48a0-bcad-25e9ed8d5817 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b73a7195-711e-46b6-ad0f-a6e38339b2fb" status: 200 len: 1511 microversion: 2.1 time: 1.208798 Aug 29 15:36:19.060646 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1461/2948] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:17 2022] GET /compute/v2.1/servers/b73a7195-711e-46b6-ad0f-a6e38339b2fb => generated 1511 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:19.068471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d5af3965-ff8e-49ea-b93f-550b957096b4 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] Calling method '.version_select at 0x7fc433a52040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:19.148145 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-d5af3965-ff8e-49ea-b93f-550b957096b4 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] HTTP exception thrown: Image not found. Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d5af3965-ff8e-49ea-b93f-550b957096b4 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] Request method failure captured: Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNzy0KZUXAphl9ed03vsNMw3x_wjRUYMZPVt3lKMlHXACQ30GjxAY5w6zQGUxIFugedV2TRvYjuFzIySp4Wk2x1jkMI785lXFq9B9T5RxG-svQtXAtommmuNyusZxGgDvY3mlkbzfKOLgTWi87XWbCT3qcsF5tXiatM20STHaCUW_hY Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 9642cae7fb8b4134b38484c6f94b7952 Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-584464123 Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9642cae7fb8b4134b38484c6f94b7952", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9642cae7fb8b4134b38484c6f94b7952"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9642cae7fb8b4134b38484c6f94b7952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9642cae7fb8b4134b38484c6f94b7952"}]}] Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-584464123 Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 9642cae7fb8b4134b38484c6f94b7952 Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-584464123 Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesDeleteNegativeTestJSON-584464123-project Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 7430c3edc8a249979a7312f5ba7b1427 Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-584464123-project Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: exception: Image not found. Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '-1'} Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.150830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d5af3965-ff8e-49ea-b93f-550b957096b4 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] Returning 404 to user: Image not found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d5af3965-ff8e-49ea-b93f-550b957096b4 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] 10.222.0.62 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.088364 Aug 29 15:36:19.155424 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1462/2949] 10.222.0.62 () {58 vars in 1134 bytes} [Mon Aug 29 15:36:19 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:36:19.170854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-622ddbf6-eaee-45f0-93b0-7f60c3cf0ffd req-36f7ed24-e32d-442c-ba2c-3b6f33ac8839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b73a7195-711e-46b6-ad0f-a6e38339b2fb", "name": "network-vif-deleted", "tag": "a669bbc2-3726-4712-8702-e54becdb8f7d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:19.190984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-622ddbf6-eaee-45f0-93b0-7f60c3cf0ffd req-36f7ed24-e32d-442c-ba2c-3b6f33ac8839 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:19.191496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-622ddbf6-eaee-45f0-93b0-7f60c3cf0ffd req-36f7ed24-e32d-442c-ba2c-3b6f33ac8839 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:19.192211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-622ddbf6-eaee-45f0-93b0-7f60c3cf0ffd req-36f7ed24-e32d-442c-ba2c-3b6f33ac8839 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:19.211633 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-622ddbf6-eaee-45f0-93b0-7f60c3cf0ffd req-36f7ed24-e32d-442c-ba2c-3b6f33ac8839 service nova] Creating event network-vif-deleted:a669bbc2-3726-4712-8702-e54becdb8f7d for instance b73a7195-711e-46b6-ad0f-a6e38339b2fb on n-h1-839401-11 Aug 29 15:36:19.224850 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-622ddbf6-eaee-45f0-93b0-7f60c3cf0ffd req-36f7ed24-e32d-442c-ba2c-3b6f33ac8839 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070322 Aug 29 15:36:19.225819 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1463/2950] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:19.231970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e4edcf0d-a2d1-4cb5-85cf-d4ec0a47d7fa tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] Calling method '.version_select at 0x7fc433aa6e50>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:19.260725 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-e4edcf0d-a2d1-4cb5-85cf-d4ec0a47d7fa tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] HTTP exception thrown: Image not found. Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e4edcf0d-a2d1-4cb5-85cf-d4ec0a47d7fa tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] Request method failure captured: Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/images/299dedc2-2be9-4f3a-882e-56eb9aade88j HTTP/1.1 Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNzy0KZUXAphl9ed03vsNMw3x_wjRUYMZPVt3lKMlHXACQ30GjxAY5w6zQGUxIFugedV2TRvYjuFzIySp4Wk2x1jkMI785lXFq9B9T5RxG-svQtXAtommmuNyusZxGgDvY3mlkbzfKOLgTWi87XWbCT3qcsF5tXiatM20STHaCUW_hY Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 9642cae7fb8b4134b38484c6f94b7952 Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-584464123 Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9642cae7fb8b4134b38484c6f94b7952", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9642cae7fb8b4134b38484c6f94b7952"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9642cae7fb8b4134b38484c6f94b7952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9642cae7fb8b4134b38484c6f94b7952"}]}] Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-584464123 Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 9642cae7fb8b4134b38484c6f94b7952 Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-584464123 Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesDeleteNegativeTestJSON-584464123-project Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 7430c3edc8a249979a7312f5ba7b1427 Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-584464123-project Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: exception: Image not found. Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '299dedc2-2be9-4f3a-882e-56eb9aade88j'} Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 299dedc2-2be9-4f3a-882e-56eb9aade88j to delete Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 299dedc2-2be9-4f3a-882e-56eb9aade88j could not be found. Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:19.263706 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:36:19.267639 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.274517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e4edcf0d-a2d1-4cb5-85cf-d4ec0a47d7fa tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] Returning 404 to user: Image not found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:19.275414 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e4edcf0d-a2d1-4cb5-85cf-d4ec0a47d7fa tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] 10.222.0.62 "DELETE /compute/v2.1/images/299dedc2-2be9-4f3a-882e-56eb9aade88j" status: 404 len: 62 microversion: 2.1 time: 0.047996 Aug 29 15:36:19.277520 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1464/2951] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:19 2022] DELETE /compute/v2.1/images/299dedc2-2be9-4f3a-882e-56eb9aade88j => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:36:19.289591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-63aa3ca6-906e-4ce4-bc23-4da0ea805575 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] Calling method '.version_select at 0x7fc42b102040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:19.308652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c536d7ee-17cf-4c46-9a74-6322fe3ef7bf tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:19.312639 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-63aa3ca6-906e-4ce4-bc23-4da0ea805575 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] HTTP exception thrown: Image not found. Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-63aa3ca6-906e-4ce4-bc23-4da0ea805575 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] Request method failure captured: Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/images/ff3ebfbe-e1e7-4bdd-8438-55536adfaa231 HTTP/1.1 Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNzy0KZUXAphl9ed03vsNMw3x_wjRUYMZPVt3lKMlHXACQ30GjxAY5w6zQGUxIFugedV2TRvYjuFzIySp4Wk2x1jkMI785lXFq9B9T5RxG-svQtXAtommmuNyusZxGgDvY3mlkbzfKOLgTWi87XWbCT3qcsF5tXiatM20STHaCUW_hY Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 9642cae7fb8b4134b38484c6f94b7952 Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-584464123 Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9642cae7fb8b4134b38484c6f94b7952", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9642cae7fb8b4134b38484c6f94b7952"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9642cae7fb8b4134b38484c6f94b7952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9642cae7fb8b4134b38484c6f94b7952"}]}] Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-584464123 Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 9642cae7fb8b4134b38484c6f94b7952 Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-584464123 Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesDeleteNegativeTestJSON-584464123-project Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 7430c3edc8a249979a7312f5ba7b1427 Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-584464123-project Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: exception: Image not found. Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'ff3ebfbe-e1e7-4bdd-8438-55536adfaa231'} Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ff3ebfbe-e1e7-4bdd-8438-55536adfaa231 to delete Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ff3ebfbe-e1e7-4bdd-8438-55536adfaa231 could not be found. Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:19.314718 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:36:19.319541 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.324915 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c536d7ee-17cf-4c46-9a74-6322fe3ef7bf tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.442400 Aug 29 15:36:19.325050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-63aa3ca6-906e-4ce4-bc23-4da0ea805575 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] Returning 404 to user: Image not found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:19.326415 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1488/2952] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:18 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:19.339684 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-63aa3ca6-906e-4ce4-bc23-4da0ea805575 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] 10.222.0.62 "DELETE /compute/v2.1/images/ff3ebfbe-e1e7-4bdd-8438-55536adfaa231" status: 404 len: 62 microversion: 2.1 time: 0.042416 Aug 29 15:36:19.344876 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1465/2953] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:36:19 2022] DELETE /compute/v2.1/images/ff3ebfbe-e1e7-4bdd-8438-55536adfaa231 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:36:19.351829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6968cc81-aa5f-4777-b002-d9c14a312716 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] Calling method '.version_select at 0x7fc433c45790>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:19.359242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ad23cafd-09b0-444f-a773-b0c0a42df25b tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:19.359993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ad23cafd-09b0-444f-a773-b0c0a42df25b tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:19.370605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad23cafd-09b0-444f-a773-b0c0a42df25b tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:19.371051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad23cafd-09b0-444f-a773-b0c0a42df25b tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:19.371493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad23cafd-09b0-444f-a773-b0c0a42df25b tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:19.372597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad23cafd-09b0-444f-a773-b0c0a42df25b tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:19.373071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad23cafd-09b0-444f-a773-b0c0a42df25b tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:19.373527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad23cafd-09b0-444f-a773-b0c0a42df25b tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:19.395935 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-6968cc81-aa5f-4777-b002-d9c14a312716 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] HTTP exception thrown: Image not found. Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6968cc81-aa5f-4777-b002-d9c14a312716 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] Request method failure captured: Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/images/tempest-invalid-449156642 HTTP/1.1 Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNzy0KZUXAphl9ed03vsNMw3x_wjRUYMZPVt3lKMlHXACQ30GjxAY5w6zQGUxIFugedV2TRvYjuFzIySp4Wk2x1jkMI785lXFq9B9T5RxG-svQtXAtommmuNyusZxGgDvY3mlkbzfKOLgTWi87XWbCT3qcsF5tXiatM20STHaCUW_hY Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 9642cae7fb8b4134b38484c6f94b7952 Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-584464123 Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9642cae7fb8b4134b38484c6f94b7952", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9642cae7fb8b4134b38484c6f94b7952"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9642cae7fb8b4134b38484c6f94b7952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9642cae7fb8b4134b38484c6f94b7952"}]}] Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-584464123 Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 9642cae7fb8b4134b38484c6f94b7952 Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-584464123 Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesDeleteNegativeTestJSON-584464123-project Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 7430c3edc8a249979a7312f5ba7b1427 Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-584464123-project Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: exception: Image not found. Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'tempest-invalid-449156642'} Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-449156642 to delete Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-449156642 could not be found. Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.398409 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:36:19.410947 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.417847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6968cc81-aa5f-4777-b002-d9c14a312716 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] Returning 404 to user: Image not found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:19.419188 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6968cc81-aa5f-4777-b002-d9c14a312716 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] 10.222.0.62 "DELETE /compute/v2.1/images/tempest-invalid-449156642" status: 404 len: 62 microversion: 2.1 time: 0.073306 Aug 29 15:36:19.420548 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1489/2954] 10.222.0.62 () {58 vars in 1203 bytes} [Mon Aug 29 15:36:19 2022] DELETE /compute/v2.1/images/tempest-invalid-449156642 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:36:19.432463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-807c8655-4202-4f78-973c-a80d24c52682 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] Calling method '.version_select at 0x7fc433ba1af0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:19.477904 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-807c8655-4202-4f78-973c-a80d24c52682 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] HTTP exception thrown: Image not found. Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-807c8655-4202-4f78-973c-a80d24c52682 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] Request method failure captured: Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/images/db444837-bbce-460f-8bea-b731c857ea26 HTTP/1.1 Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNzy0KZUXAphl9ed03vsNMw3x_wjRUYMZPVt3lKMlHXACQ30GjxAY5w6zQGUxIFugedV2TRvYjuFzIySp4Wk2x1jkMI785lXFq9B9T5RxG-svQtXAtommmuNyusZxGgDvY3mlkbzfKOLgTWi87XWbCT3qcsF5tXiatM20STHaCUW_hY Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 9642cae7fb8b4134b38484c6f94b7952 Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-584464123 Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9642cae7fb8b4134b38484c6f94b7952", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9642cae7fb8b4134b38484c6f94b7952"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9642cae7fb8b4134b38484c6f94b7952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9642cae7fb8b4134b38484c6f94b7952"}]}] Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-584464123 Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 9642cae7fb8b4134b38484c6f94b7952 Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-584464123 Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesDeleteNegativeTestJSON-584464123-project Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 7430c3edc8a249979a7312f5ba7b1427 Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-584464123-project Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: exception: Image not found. Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'db444837-bbce-460f-8bea-b731c857ea26'} Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image db444837-bbce-460f-8bea-b731c857ea26 to delete Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image db444837-bbce-460f-8bea-b731c857ea26 could not be found. Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:19.480519 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:36:19.484319 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:36:19.491370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-807c8655-4202-4f78-973c-a80d24c52682 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] Returning 404 to user: Image not found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:19.493336 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-807c8655-4202-4f78-973c-a80d24c52682 tempest-ImagesDeleteNegativeTestJSON-584464123 tempest-ImagesDeleteNegativeTestJSON-584464123-project] 10.222.0.62 "DELETE /compute/v2.1/images/db444837-bbce-460f-8bea-b731c857ea26" status: 404 len: 62 microversion: 2.1 time: 0.067214 Aug 29 15:36:19.494760 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1490/2955] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:19 2022] DELETE /compute/v2.1/images/db444837-bbce-460f-8bea-b731c857ea26 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:36:19.606318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ad23cafd-09b0-444f-a773-b0c0a42df25b tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:19.622943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ad23cafd-09b0-444f-a773-b0c0a42df25b tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:19.627376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ad23cafd-09b0-444f-a773-b0c0a42df25b tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:19.631681 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ad23cafd-09b0-444f-a773-b0c0a42df25b tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.280069 Aug 29 15:36:19.633067 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1466/2956] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:19 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:36:19.737389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b7bd5cd5-abcb-4f20-a060-bf540920ce7c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:19.739126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b7bd5cd5-abcb-4f20-a060-bf540920ce7c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:19.759890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7bd5cd5-abcb-4f20-a060-bf540920ce7c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:19.763324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7bd5cd5-abcb-4f20-a060-bf540920ce7c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:19.764148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7bd5cd5-abcb-4f20-a060-bf540920ce7c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:19.768176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7bd5cd5-abcb-4f20-a060-bf540920ce7c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:19.773468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7bd5cd5-abcb-4f20-a060-bf540920ce7c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:19.774787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7bd5cd5-abcb-4f20-a060-bf540920ce7c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:19.791419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:20.096738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cfa29df6-403b-4869-9fa8-1e9d9baf4d6b tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:20.098603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cfa29df6-403b-4869-9fa8-1e9d9baf4d6b tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b73a7195-711e-46b6-ad0f-a6e38339b2fb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:20.118081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfa29df6-403b-4869-9fa8-1e9d9baf4d6b tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:20.126402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfa29df6-403b-4869-9fa8-1e9d9baf4d6b tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:20.127757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfa29df6-403b-4869-9fa8-1e9d9baf4d6b tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:20.132682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfa29df6-403b-4869-9fa8-1e9d9baf4d6b tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:20.138105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfa29df6-403b-4869-9fa8-1e9d9baf4d6b tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:20.140720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfa29df6-403b-4869-9fa8-1e9d9baf4d6b tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:20.178851 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-cfa29df6-403b-4869-9fa8-1e9d9baf4d6b tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] HTTP exception thrown: Instance b73a7195-711e-46b6-ad0f-a6e38339b2fb could not be found. Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cfa29df6-403b-4869-9fa8-1e9d9baf4d6b tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Request method failure captured: Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/b73a7195-711e-46b6-ad0f-a6e38339b2fb HTTP/1.1 Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNyso4siGeqhnn3MH1Ypnm2QJjl6x12_jO7Mdj0S6BcDOL4jgDyLjCgMZ4nTTrd1q4hxX9778Sn_iSw_F2qtWQzHv2SsTSds1W-Ia9KknpgJaJtPkTEsyoZ8aR2SYvxvX_hDENMmdhXZsD5CHQH1Vwdz2L5iReAS33y2ajW0Tf3C540 Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: ab4615dd6897416ca44c89b092e5526d Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-MultipleCreateTestJSON-544973609 Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ab4615dd6897416ca44c89b092e5526d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ab4615dd6897416ca44c89b092e5526d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ab4615dd6897416ca44c89b092e5526d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ab4615dd6897416ca44c89b092e5526d"}]}] Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-MultipleCreateTestJSON-544973609 Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: ab4615dd6897416ca44c89b092e5526d Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-MultipleCreateTestJSON-544973609 Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-MultipleCreateTestJSON-544973609-project Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 7138531e3322432c991b0d0b00e3fa63 Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-MultipleCreateTestJSON-544973609-project Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance b73a7195-711e-46b6-ad0f-a6e38339b2fb could not be found. Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'b73a7195-711e-46b6-ad0f-a6e38339b2fb'} Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b73a7195-711e-46b6-ad0f-a6e38339b2fb could not be found. Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b73a7195-711e-46b6-ad0f-a6e38339b2fb could not be found. Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:20.182854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:20.190038 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:20.190038 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:20.190038 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:20.190038 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:20.190038 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:20.190038 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b73a7195-711e-46b6-ad0f-a6e38339b2fb could not be found. Aug 29 15:36:20.190038 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:20.194064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cfa29df6-403b-4869-9fa8-1e9d9baf4d6b tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Returning 404 to user: Instance b73a7195-711e-46b6-ad0f-a6e38339b2fb could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:20.195891 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cfa29df6-403b-4869-9fa8-1e9d9baf4d6b tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b73a7195-711e-46b6-ad0f-a6e38339b2fb" status: 404 len: 111 microversion: 2.1 time: 0.118811 Aug 29 15:36:20.197183 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1467/2957] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:20 2022] GET /compute/v2.1/servers/b73a7195-711e-46b6-ad0f-a6e38339b2fb => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:36:20.212469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8a379af4-b0b5-43ba-8d5c-a456f5f6b435 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:20.212730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8a379af4-b0b5-43ba-8d5c-a456f5f6b435 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] [instance: b9b02587-e9cd-4361-874a-0ede2593daef] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:20.228012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a379af4-b0b5-43ba-8d5c-a456f5f6b435 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:20.242519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a379af4-b0b5-43ba-8d5c-a456f5f6b435 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:20.243644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a379af4-b0b5-43ba-8d5c-a456f5f6b435 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:20.249752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a379af4-b0b5-43ba-8d5c-a456f5f6b435 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:20.251268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a379af4-b0b5-43ba-8d5c-a456f5f6b435 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:20.251994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a379af4-b0b5-43ba-8d5c-a456f5f6b435 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:20.279018 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-8a379af4-b0b5-43ba-8d5c-a456f5f6b435 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] HTTP exception thrown: Instance b9b02587-e9cd-4361-874a-0ede2593daef could not be found. Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8a379af4-b0b5-43ba-8d5c-a456f5f6b435 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Request method failure captured: Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef HTTP/1.1 Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNyso4siGeqhnn3MH1Ypnm2QJjl6x12_jO7Mdj0S6BcDOL4jgDyLjCgMZ4nTTrd1q4hxX9778Sn_iSw_F2qtWQzHv2SsTSds1W-Ia9KknpgJaJtPkTEsyoZ8aR2SYvxvX_hDENMmdhXZsD5CHQH1Vwdz2L5iReAS33y2ajW0Tf3C540 Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: ab4615dd6897416ca44c89b092e5526d Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-MultipleCreateTestJSON-544973609 Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ab4615dd6897416ca44c89b092e5526d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ab4615dd6897416ca44c89b092e5526d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ab4615dd6897416ca44c89b092e5526d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ab4615dd6897416ca44c89b092e5526d"}]}] Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-MultipleCreateTestJSON-544973609 Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: ab4615dd6897416ca44c89b092e5526d Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-MultipleCreateTestJSON-544973609 Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-MultipleCreateTestJSON-544973609-project Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 7138531e3322432c991b0d0b00e3fa63 Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-MultipleCreateTestJSON-544973609-project Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance b9b02587-e9cd-4361-874a-0ede2593daef could not be found. Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'b9b02587-e9cd-4361-874a-0ede2593daef'} Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9b02587-e9cd-4361-874a-0ede2593daef could not be found. Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9b02587-e9cd-4361-874a-0ede2593daef could not be found. Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:20.280728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:20.285467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:20.285467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:20.285467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:20.285467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:20.285467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:20.285467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9b02587-e9cd-4361-874a-0ede2593daef could not be found. Aug 29 15:36:20.285467 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:20.285467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8a379af4-b0b5-43ba-8d5c-a456f5f6b435 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] Returning 404 to user: Instance b9b02587-e9cd-4361-874a-0ede2593daef could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:20.286829 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8a379af4-b0b5-43ba-8d5c-a456f5f6b435 tempest-MultipleCreateTestJSON-544973609 tempest-MultipleCreateTestJSON-544973609-project] 10.222.0.62 "GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef" status: 404 len: 111 microversion: 2.1 time: 0.085683 Aug 29 15:36:20.287922 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1468/2958] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:20 2022] GET /compute/v2.1/servers/b9b02587-e9cd-4361-874a-0ede2593daef => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:36:20.352006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d821c734-9a19-435e-ad82-fc7dfc482762 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:20.354165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d821c734-9a19-435e-ad82-fc7dfc482762 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:20.380815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d821c734-9a19-435e-ad82-fc7dfc482762 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:20.385932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d821c734-9a19-435e-ad82-fc7dfc482762 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:20.390223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d821c734-9a19-435e-ad82-fc7dfc482762 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:20.391194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d821c734-9a19-435e-ad82-fc7dfc482762 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:20.393709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d821c734-9a19-435e-ad82-fc7dfc482762 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:20.395995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d821c734-9a19-435e-ad82-fc7dfc482762 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:20.414393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b7bd5cd5-abcb-4f20-a060-bf540920ce7c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:20.426278 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b7bd5cd5-abcb-4f20-a060-bf540920ce7c tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 0.695405 Aug 29 15:36:20.430012 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1491/2959] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:19 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:20.657642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-93ee1b33-466b-4674-8401-a3cda485aac4 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:20.658271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-93ee1b33-466b-4674-8401-a3cda485aac4 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:20.674682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ee1b33-466b-4674-8401-a3cda485aac4 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:20.678336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ee1b33-466b-4674-8401-a3cda485aac4 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:20.678812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ee1b33-466b-4674-8401-a3cda485aac4 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:20.679569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ee1b33-466b-4674-8401-a3cda485aac4 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:20.682280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ee1b33-466b-4674-8401-a3cda485aac4 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:20.682947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ee1b33-466b-4674-8401-a3cda485aac4 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:20.783369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d821c734-9a19-435e-ad82-fc7dfc482762 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:20.803855 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d821c734-9a19-435e-ad82-fc7dfc482762 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.459510 Aug 29 15:36:20.817438 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1469/2960] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:20 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:20.833779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-93ee1b33-466b-4674-8401-a3cda485aac4 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:20.849631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-93ee1b33-466b-4674-8401-a3cda485aac4 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:20.855478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-93ee1b33-466b-4674-8401-a3cda485aac4 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:20.862573 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-93ee1b33-466b-4674-8401-a3cda485aac4 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.207091 Aug 29 15:36:20.862985 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1492/2961] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:20 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:36:21.469171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-af5ffd6b-edaa-4304-919e-04dc2b4b373d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:21.469981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-af5ffd6b-edaa-4304-919e-04dc2b4b373d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:21.489973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=18 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:21.490946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=44 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:21.509338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af5ffd6b-edaa-4304-919e-04dc2b4b373d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:21.509844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af5ffd6b-edaa-4304-919e-04dc2b4b373d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:21.510288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af5ffd6b-edaa-4304-919e-04dc2b4b373d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:21.511141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af5ffd6b-edaa-4304-919e-04dc2b4b373d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:21.511983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af5ffd6b-edaa-4304-919e-04dc2b4b373d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:21.512932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af5ffd6b-edaa-4304-919e-04dc2b4b373d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:21.827527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2b5e32ca-9c4a-48bd-9081-ed7aaa511c76 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:21.828778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2b5e32ca-9c4a-48bd-9081-ed7aaa511c76 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:21.844686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b5e32ca-9c4a-48bd-9081-ed7aaa511c76 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:21.845501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b5e32ca-9c4a-48bd-9081-ed7aaa511c76 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:21.848694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b5e32ca-9c4a-48bd-9081-ed7aaa511c76 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:21.849522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b5e32ca-9c4a-48bd-9081-ed7aaa511c76 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:21.850182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b5e32ca-9c4a-48bd-9081-ed7aaa511c76 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:21.850629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b5e32ca-9c4a-48bd-9081-ed7aaa511c76 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:21.893720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:21.947441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=28 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:22.183368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2b5e32ca-9c4a-48bd-9081-ed7aaa511c76 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:22.194183 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2b5e32ca-9c4a-48bd-9081-ed7aaa511c76 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.373626 Aug 29 15:36:22.194705 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1493/2962] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:21 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:22.211827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-94e37f73-2e69-499e-bd5f-082d4ca1e565 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:22.212487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-94e37f73-2e69-499e-bd5f-082d4ca1e565 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:22.226903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94e37f73-2e69-499e-bd5f-082d4ca1e565 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:22.227515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94e37f73-2e69-499e-bd5f-082d4ca1e565 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:22.227851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94e37f73-2e69-499e-bd5f-082d4ca1e565 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:22.228581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94e37f73-2e69-499e-bd5f-082d4ca1e565 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:22.229043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94e37f73-2e69-499e-bd5f-082d4ca1e565 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:22.229936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-af5ffd6b-edaa-4304-919e-04dc2b4b373d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:22.237035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94e37f73-2e69-499e-bd5f-082d4ca1e565 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:22.258758 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-af5ffd6b-edaa-4304-919e-04dc2b4b373d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 0.813607 Aug 29 15:36:22.262110 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1470/2963] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:21 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:22.487401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-94e37f73-2e69-499e-bd5f-082d4ca1e565 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:22.504140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-94e37f73-2e69-499e-bd5f-082d4ca1e565 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:22.518845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-94e37f73-2e69-499e-bd5f-082d4ca1e565 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:22.526683 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-94e37f73-2e69-499e-bd5f-082d4ca1e565 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1409 microversion: 2.54 time: 0.326182 Aug 29 15:36:22.528082 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1494/2964] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:22 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1409 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:23.219491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8318ed58-e36c-45c8-99ba-fe027e2b44a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:23.222205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8318ed58-e36c-45c8-99ba-fe027e2b44a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:23.238293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8318ed58-e36c-45c8-99ba-fe027e2b44a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:23.239612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8318ed58-e36c-45c8-99ba-fe027e2b44a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:23.243101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8318ed58-e36c-45c8-99ba-fe027e2b44a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:23.245250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8318ed58-e36c-45c8-99ba-fe027e2b44a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:23.247757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8318ed58-e36c-45c8-99ba-fe027e2b44a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:23.249980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8318ed58-e36c-45c8-99ba-fe027e2b44a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:23.283479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-72916bdb-9cb8-499e-be17-c286bc7de77a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:23.284934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-72916bdb-9cb8-499e-be17-c286bc7de77a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:23.298704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72916bdb-9cb8-499e-be17-c286bc7de77a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:23.299274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72916bdb-9cb8-499e-be17-c286bc7de77a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:23.301983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72916bdb-9cb8-499e-be17-c286bc7de77a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:23.302772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72916bdb-9cb8-499e-be17-c286bc7de77a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:23.304429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72916bdb-9cb8-499e-be17-c286bc7de77a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:23.305745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72916bdb-9cb8-499e-be17-c286bc7de77a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:24.004924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-72916bdb-9cb8-499e-be17-c286bc7de77a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:24.025592 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-72916bdb-9cb8-499e-be17-c286bc7de77a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 0.744008 Aug 29 15:36:24.027109 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1495/2965] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:23 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:24.037753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c82910c6-f860-43f7-ac0a-a6364733d87d tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:24.038992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c82910c6-f860-43f7-ac0a-a6364733d87d tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:24.047108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c82910c6-f860-43f7-ac0a-a6364733d87d tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:24.048174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c82910c6-f860-43f7-ac0a-a6364733d87d tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:24.048975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c82910c6-f860-43f7-ac0a-a6364733d87d tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:24.050130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c82910c6-f860-43f7-ac0a-a6364733d87d tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:24.050925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c82910c6-f860-43f7-ac0a-a6364733d87d tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:24.053722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c82910c6-f860-43f7-ac0a-a6364733d87d tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:24.096161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8318ed58-e36c-45c8-99ba-fe027e2b44a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:24.104986 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8318ed58-e36c-45c8-99ba-fe027e2b44a3 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.891538 Aug 29 15:36:24.105621 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1471/2966] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:23 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:24.217630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c82910c6-f860-43f7-ac0a-a6364733d87d tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:24.229751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c82910c6-f860-43f7-ac0a-a6364733d87d tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:24.231893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c82910c6-f860-43f7-ac0a-a6364733d87d tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:24.233667 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c82910c6-f860-43f7-ac0a-a6364733d87d tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1415 microversion: 2.54 time: 0.204749 Aug 29 15:36:24.249110 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1496/2967] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:24 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1415 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:25.051873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bc2e278e-3b39-48fc-b5af-acc2b96e4300 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:25.052492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bc2e278e-3b39-48fc-b5af-acc2b96e4300 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:25.066097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc2e278e-3b39-48fc-b5af-acc2b96e4300 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:25.066424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc2e278e-3b39-48fc-b5af-acc2b96e4300 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:25.066831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc2e278e-3b39-48fc-b5af-acc2b96e4300 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:25.067549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc2e278e-3b39-48fc-b5af-acc2b96e4300 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:25.068379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc2e278e-3b39-48fc-b5af-acc2b96e4300 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:25.068481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc2e278e-3b39-48fc-b5af-acc2b96e4300 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:25.127193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9637d20c-a91e-49a0-adca-f1acb0b5451d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:25.128302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9637d20c-a91e-49a0-adca-f1acb0b5451d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:25.141037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9637d20c-a91e-49a0-adca-f1acb0b5451d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:25.149867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9637d20c-a91e-49a0-adca-f1acb0b5451d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:25.150328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9637d20c-a91e-49a0-adca-f1acb0b5451d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:25.151081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9637d20c-a91e-49a0-adca-f1acb0b5451d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:25.151539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9637d20c-a91e-49a0-adca-f1acb0b5451d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:25.151960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9637d20c-a91e-49a0-adca-f1acb0b5451d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:25.433960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9637d20c-a91e-49a0-adca-f1acb0b5451d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:25.445430 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9637d20c-a91e-49a0-adca-f1acb0b5451d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.322871 Aug 29 15:36:25.446062 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1497/2968] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:25 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:25.475116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a038bff9-9faa-4087-9188-d4fd5d40b2ab tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:25.476095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a038bff9-9faa-4087-9188-d4fd5d40b2ab tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:25.500658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a038bff9-9faa-4087-9188-d4fd5d40b2ab tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:25.501306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a038bff9-9faa-4087-9188-d4fd5d40b2ab tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:25.501785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a038bff9-9faa-4087-9188-d4fd5d40b2ab tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:25.502609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a038bff9-9faa-4087-9188-d4fd5d40b2ab tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:25.503007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a038bff9-9faa-4087-9188-d4fd5d40b2ab tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:25.503438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a038bff9-9faa-4087-9188-d4fd5d40b2ab tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:25.630300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a038bff9-9faa-4087-9188-d4fd5d40b2ab tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:25.644877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a038bff9-9faa-4087-9188-d4fd5d40b2ab tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:25.647141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a038bff9-9faa-4087-9188-d4fd5d40b2ab tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:25.650796 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a038bff9-9faa-4087-9188-d4fd5d40b2ab tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1415 microversion: 2.54 time: 0.185457 Aug 29 15:36:25.652559 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1498/2969] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:25 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1415 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:26.028131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bc2e278e-3b39-48fc-b5af-acc2b96e4300 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:26.043975 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bc2e278e-3b39-48fc-b5af-acc2b96e4300 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 0.996651 Aug 29 15:36:26.045707 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1472/2970] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:25 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:26.471740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-96b86c1d-7a1a-4c5e-9f1b-d342b98b83c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:26.474116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-96b86c1d-7a1a-4c5e-9f1b-d342b98b83c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:26.495944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96b86c1d-7a1a-4c5e-9f1b-d342b98b83c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:26.496432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96b86c1d-7a1a-4c5e-9f1b-d342b98b83c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:26.496873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96b86c1d-7a1a-4c5e-9f1b-d342b98b83c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:26.497624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96b86c1d-7a1a-4c5e-9f1b-d342b98b83c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:26.498090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96b86c1d-7a1a-4c5e-9f1b-d342b98b83c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:26.498508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96b86c1d-7a1a-4c5e-9f1b-d342b98b83c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:26.679534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d224701c-738a-4a5f-a7f5-7f3e7a4921a7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:26.680146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d224701c-738a-4a5f-a7f5-7f3e7a4921a7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:26.701671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d224701c-738a-4a5f-a7f5-7f3e7a4921a7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:26.706030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d224701c-738a-4a5f-a7f5-7f3e7a4921a7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:26.710107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d224701c-738a-4a5f-a7f5-7f3e7a4921a7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:26.712583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d224701c-738a-4a5f-a7f5-7f3e7a4921a7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:26.713253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d224701c-738a-4a5f-a7f5-7f3e7a4921a7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:26.715360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d224701c-738a-4a5f-a7f5-7f3e7a4921a7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:26.852186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-96b86c1d-7a1a-4c5e-9f1b-d342b98b83c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:26.861352 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-96b86c1d-7a1a-4c5e-9f1b-d342b98b83c2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1517 microversion: 2.1 time: 0.398246 Aug 29 15:36:26.865992 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1499/2971] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:26 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1517 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:26.933234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d224701c-738a-4a5f-a7f5-7f3e7a4921a7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:26.952130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d224701c-738a-4a5f-a7f5-7f3e7a4921a7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:26.958434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d224701c-738a-4a5f-a7f5-7f3e7a4921a7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:26.963956 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d224701c-738a-4a5f-a7f5-7f3e7a4921a7 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1415 microversion: 2.54 time: 0.288700 Aug 29 15:36:26.965040 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1473/2972] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:26 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1415 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:27.073470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-91ff6ca2-0a7d-4944-82bd-65173b087d44 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:27.074440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-91ff6ca2-0a7d-4944-82bd-65173b087d44 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:27.116497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91ff6ca2-0a7d-4944-82bd-65173b087d44 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:27.118710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91ff6ca2-0a7d-4944-82bd-65173b087d44 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:27.119882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91ff6ca2-0a7d-4944-82bd-65173b087d44 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:27.121354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91ff6ca2-0a7d-4944-82bd-65173b087d44 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:27.122686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91ff6ca2-0a7d-4944-82bd-65173b087d44 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:27.123448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91ff6ca2-0a7d-4944-82bd-65173b087d44 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:27.886163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e0553dba-8f76-4667-b790-0748afe1cfc5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:27.886893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e0553dba-8f76-4667-b790-0748afe1cfc5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:27.907838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0553dba-8f76-4667-b790-0748afe1cfc5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:27.908715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0553dba-8f76-4667-b790-0748afe1cfc5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:27.909506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0553dba-8f76-4667-b790-0748afe1cfc5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:27.910443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0553dba-8f76-4667-b790-0748afe1cfc5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:27.915813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0553dba-8f76-4667-b790-0748afe1cfc5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:27.916939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0553dba-8f76-4667-b790-0748afe1cfc5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:28.270211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-91ff6ca2-0a7d-4944-82bd-65173b087d44 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:28.283386 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-91ff6ca2-0a7d-4944-82bd-65173b087d44 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 1.216302 Aug 29 15:36:28.288622 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1500/2973] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:27 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:28.294122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-324c11fe-837d-4bf9-aeec-d190304483e5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:28.297921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-324c11fe-837d-4bf9-aeec-d190304483e5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:28.327811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-324c11fe-837d-4bf9-aeec-d190304483e5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:28.330155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-324c11fe-837d-4bf9-aeec-d190304483e5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:28.331139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-324c11fe-837d-4bf9-aeec-d190304483e5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:28.344322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-324c11fe-837d-4bf9-aeec-d190304483e5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:28.344876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-324c11fe-837d-4bf9-aeec-d190304483e5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:28.345359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-324c11fe-837d-4bf9-aeec-d190304483e5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:28.521671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-324c11fe-837d-4bf9-aeec-d190304483e5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:28.531478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-324c11fe-837d-4bf9-aeec-d190304483e5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:28.533745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-324c11fe-837d-4bf9-aeec-d190304483e5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:28.536068 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-324c11fe-837d-4bf9-aeec-d190304483e5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1415 microversion: 2.54 time: 0.246088 Aug 29 15:36:28.537282 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1501/2974] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:28 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1415 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:28.611913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e0553dba-8f76-4667-b790-0748afe1cfc5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:28.630618 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e0553dba-8f76-4667-b790-0748afe1cfc5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1523 microversion: 2.1 time: 0.745054 Aug 29 15:36:28.642403 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1474/2975] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:27 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1523 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:29.311991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-54aee1a0-3686-4d32-ac48-fb344436f9b7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:29.313312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-54aee1a0-3686-4d32-ac48-fb344436f9b7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:29.327496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54aee1a0-3686-4d32-ac48-fb344436f9b7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:29.328283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54aee1a0-3686-4d32-ac48-fb344436f9b7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:29.329028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54aee1a0-3686-4d32-ac48-fb344436f9b7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:29.329982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54aee1a0-3686-4d32-ac48-fb344436f9b7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:29.332432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54aee1a0-3686-4d32-ac48-fb344436f9b7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:29.333134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54aee1a0-3686-4d32-ac48-fb344436f9b7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:29.560469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5810be11-e695-4939-b922-f30a82bd38c3 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:29.562345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5810be11-e695-4939-b922-f30a82bd38c3 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:29.571033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5810be11-e695-4939-b922-f30a82bd38c3 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:29.572468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5810be11-e695-4939-b922-f30a82bd38c3 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:29.573211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5810be11-e695-4939-b922-f30a82bd38c3 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:29.574414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5810be11-e695-4939-b922-f30a82bd38c3 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:29.575570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5810be11-e695-4939-b922-f30a82bd38c3 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:29.576230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5810be11-e695-4939-b922-f30a82bd38c3 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:30.078829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5810be11-e695-4939-b922-f30a82bd38c3 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:30.087300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-54aee1a0-3686-4d32-ac48-fb344436f9b7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:30.091592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5810be11-e695-4939-b922-f30a82bd38c3 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:30.095383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5810be11-e695-4939-b922-f30a82bd38c3 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:30.102606 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5810be11-e695-4939-b922-f30a82bd38c3 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1415 microversion: 2.54 time: 0.542746 Aug 29 15:36:30.103807 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1475/2976] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:29 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1415 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:30.108874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c56b7de5-c305-4744-9e6e-95729cea20f0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:30.115020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c56b7de5-c305-4744-9e6e-95729cea20f0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:30.128176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c56b7de5-c305-4744-9e6e-95729cea20f0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:30.128927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c56b7de5-c305-4744-9e6e-95729cea20f0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:30.129547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c56b7de5-c305-4744-9e6e-95729cea20f0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:30.130165 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-54aee1a0-3686-4d32-ac48-fb344436f9b7 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 0.822032 Aug 29 15:36:30.130624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c56b7de5-c305-4744-9e6e-95729cea20f0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:30.131317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c56b7de5-c305-4744-9e6e-95729cea20f0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:30.131929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c56b7de5-c305-4744-9e6e-95729cea20f0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:30.133402 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1502/2977] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:29 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:30.475058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c56b7de5-c305-4744-9e6e-95729cea20f0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:30.491784 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c56b7de5-c305-4744-9e6e-95729cea20f0 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1523 microversion: 2.1 time: 0.379108 Aug 29 15:36:30.497421 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1476/2978] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:30 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1523 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:31.057794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-38421f46-8aba-42cc-a501-d87e035c03e2 req-a36445b7-e7bb-46a2-a73f-ac89da8e9d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923c4a5b-679a-41e3-9d6b-f7bbcc603db3", "name": "network-vif-unplugged", "status": "completed", "tag": "cc2e791e-3b26-47d3-98e5-ffbbe4d0c8e7"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:31.092065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-38421f46-8aba-42cc-a501-d87e035c03e2 req-a36445b7-e7bb-46a2-a73f-ac89da8e9d15 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:31.092555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-38421f46-8aba-42cc-a501-d87e035c03e2 req-a36445b7-e7bb-46a2-a73f-ac89da8e9d15 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:31.092991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-38421f46-8aba-42cc-a501-d87e035c03e2 req-a36445b7-e7bb-46a2-a73f-ac89da8e9d15 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:31.131575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-db2b76e7-08a7-469e-944b-205f6ae224a5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:31.133152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-db2b76e7-08a7-469e-944b-205f6ae224a5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:31.139604 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-38421f46-8aba-42cc-a501-d87e035c03e2 req-a36445b7-e7bb-46a2-a73f-ac89da8e9d15 service nova] Creating event network-vif-unplugged:cc2e791e-3b26-47d3-98e5-ffbbe4d0c8e7 for instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 on n-h2-839401-11 Aug 29 15:36:31.152285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db2b76e7-08a7-469e-944b-205f6ae224a5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:31.152789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db2b76e7-08a7-469e-944b-205f6ae224a5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:31.153259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db2b76e7-08a7-469e-944b-205f6ae224a5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:31.155660 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-38421f46-8aba-42cc-a501-d87e035c03e2 req-a36445b7-e7bb-46a2-a73f-ac89da8e9d15 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098756 Aug 29 15:36:31.156865 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1503/2979] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:31.160524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db2b76e7-08a7-469e-944b-205f6ae224a5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:31.161027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db2b76e7-08a7-469e-944b-205f6ae224a5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:31.161495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db2b76e7-08a7-469e-944b-205f6ae224a5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:31.167787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2ae2aaa6-f94f-4965-952b-be06f4dddf8a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:31.170675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2ae2aaa6-f94f-4965-952b-be06f4dddf8a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:31.188049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ae2aaa6-f94f-4965-952b-be06f4dddf8a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:31.188585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ae2aaa6-f94f-4965-952b-be06f4dddf8a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:31.189075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ae2aaa6-f94f-4965-952b-be06f4dddf8a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:31.198307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ae2aaa6-f94f-4965-952b-be06f4dddf8a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:31.199319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ae2aaa6-f94f-4965-952b-be06f4dddf8a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:31.201686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ae2aaa6-f94f-4965-952b-be06f4dddf8a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:31.488165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2ae2aaa6-f94f-4965-952b-be06f4dddf8a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:31.498150 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2ae2aaa6-f94f-4965-952b-be06f4dddf8a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 0.339841 Aug 29 15:36:31.501963 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1504/2980] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:31 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:31.523176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b39c93f4-bbcc-40a3-bbfa-5f43e29f0eb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:31.524134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b39c93f4-bbcc-40a3-bbfa-5f43e29f0eb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:31.547863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b39c93f4-bbcc-40a3-bbfa-5f43e29f0eb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:31.548363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b39c93f4-bbcc-40a3-bbfa-5f43e29f0eb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:31.564715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b39c93f4-bbcc-40a3-bbfa-5f43e29f0eb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:31.567838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b39c93f4-bbcc-40a3-bbfa-5f43e29f0eb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:31.569314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b39c93f4-bbcc-40a3-bbfa-5f43e29f0eb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:31.569908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b39c93f4-bbcc-40a3-bbfa-5f43e29f0eb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:31.981922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-db2b76e7-08a7-469e-944b-205f6ae224a5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:31.999519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-db2b76e7-08a7-469e-944b-205f6ae224a5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:32.003226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b39c93f4-bbcc-40a3-bbfa-5f43e29f0eb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:32.005826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-db2b76e7-08a7-469e-944b-205f6ae224a5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:32.009364 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-db2b76e7-08a7-469e-944b-205f6ae224a5 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1415 microversion: 2.54 time: 0.882412 Aug 29 15:36:32.011365 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b39c93f4-bbcc-40a3-bbfa-5f43e29f0eb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1523 microversion: 2.1 time: 0.492906 Aug 29 15:36:32.011894 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1477/2981] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:31 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1415 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:32.034585 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1505/2982] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:31 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1523 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:32.529716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f53be824-c939-43e2-a7ca-41a6eeb22f02 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:32.530411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f53be824-c939-43e2-a7ca-41a6eeb22f02 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:32.548156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f53be824-c939-43e2-a7ca-41a6eeb22f02 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:32.551484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f53be824-c939-43e2-a7ca-41a6eeb22f02 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:32.552764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f53be824-c939-43e2-a7ca-41a6eeb22f02 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:32.556183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f53be824-c939-43e2-a7ca-41a6eeb22f02 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:32.556933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f53be824-c939-43e2-a7ca-41a6eeb22f02 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:32.560135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f53be824-c939-43e2-a7ca-41a6eeb22f02 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:33.037001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-355b2dcc-508d-452a-8aa4-384c8b0ef9cb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:33.040815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-355b2dcc-508d-452a-8aa4-384c8b0ef9cb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:33.055587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f53be824-c939-43e2-a7ca-41a6eeb22f02 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:33.065225 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f53be824-c939-43e2-a7ca-41a6eeb22f02 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 0.540749 Aug 29 15:36:33.067230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-355b2dcc-508d-452a-8aa4-384c8b0ef9cb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:33.071046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-355b2dcc-508d-452a-8aa4-384c8b0ef9cb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:33.071603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-355b2dcc-508d-452a-8aa4-384c8b0ef9cb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:33.073869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-355b2dcc-508d-452a-8aa4-384c8b0ef9cb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:33.074641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-355b2dcc-508d-452a-8aa4-384c8b0ef9cb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:33.076699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-355b2dcc-508d-452a-8aa4-384c8b0ef9cb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:33.081948 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1478/2983] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:32 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:33.103795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f930c8e5-918e-4ed1-bca8-d46ef5378799 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:33.104544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f930c8e5-918e-4ed1-bca8-d46ef5378799 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:33.111401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f930c8e5-918e-4ed1-bca8-d46ef5378799 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:33.112153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f930c8e5-918e-4ed1-bca8-d46ef5378799 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:33.114650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f930c8e5-918e-4ed1-bca8-d46ef5378799 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:33.115542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f930c8e5-918e-4ed1-bca8-d46ef5378799 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:33.119808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f930c8e5-918e-4ed1-bca8-d46ef5378799 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:33.120471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f930c8e5-918e-4ed1-bca8-d46ef5378799 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:33.241867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-355b2dcc-508d-452a-8aa4-384c8b0ef9cb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:33.277126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-355b2dcc-508d-452a-8aa4-384c8b0ef9cb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:33.281731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-355b2dcc-508d-452a-8aa4-384c8b0ef9cb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:33.290566 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-355b2dcc-508d-452a-8aa4-384c8b0ef9cb tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1400 microversion: 2.54 time: 0.253325 Aug 29 15:36:33.291915 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1506/2984] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:33 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1400 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:36:33.326901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f53a479f-ee4d-44d0-8a9a-c5f517becb7a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '.version_select at 0x7fc433c33820>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:33.382392 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f53a479f-ee4d-44d0-8a9a-c5f517becb7a tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1297591306" status: 204 len: 0 microversion: 2.54 time: 0.061533 Aug 29 15:36:33.385795 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1507/2985] 10.222.0.62 () {60 vars in 1319 bytes} [Mon Aug 29 15:36:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1297591306 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:36:33.410208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1a60685f-429f-41e1-9640-3c86978dcf49 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:33.411764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1a60685f-429f-41e1-9640-3c86978dcf49 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:33.428376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a60685f-429f-41e1-9640-3c86978dcf49 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:33.431019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a60685f-429f-41e1-9640-3c86978dcf49 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:33.434110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a60685f-429f-41e1-9640-3c86978dcf49 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:33.436604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a60685f-429f-41e1-9640-3c86978dcf49 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:33.438397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a60685f-429f-41e1-9640-3c86978dcf49 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:33.440163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a60685f-429f-41e1-9640-3c86978dcf49 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:33.532059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1a60685f-429f-41e1-9640-3c86978dcf49 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:36:33.631904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:33.636535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f930c8e5-918e-4ed1-bca8-d46ef5378799 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:33.650659 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f930c8e5-918e-4ed1-bca8-d46ef5378799 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1523 microversion: 2.1 time: 0.567506 Aug 29 15:36:33.651256 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1479/2986] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:33 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1523 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:33.785266 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1a60685f-429f-41e1-9640-3c86978dcf49 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 204 len: 0 microversion: 2.54 time: 0.379579 Aug 29 15:36:33.785961 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1508/2987] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:36:33 2022] DELETE /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:36:33.795220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-11f54cab-eac7-4223-9b0a-a7982d7b5f6c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:33.796667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-11f54cab-eac7-4223-9b0a-a7982d7b5f6c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:33.810849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11f54cab-eac7-4223-9b0a-a7982d7b5f6c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:33.811777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11f54cab-eac7-4223-9b0a-a7982d7b5f6c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:33.814338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11f54cab-eac7-4223-9b0a-a7982d7b5f6c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:33.815573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11f54cab-eac7-4223-9b0a-a7982d7b5f6c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:33.816286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11f54cab-eac7-4223-9b0a-a7982d7b5f6c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:33.819960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11f54cab-eac7-4223-9b0a-a7982d7b5f6c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:34.087080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-11f54cab-eac7-4223-9b0a-a7982d7b5f6c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:34.095600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bf936c41-7bfc-479b-b8c6-ec7033efcfa2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:34.096905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bf936c41-7bfc-479b-b8c6-ec7033efcfa2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:34.114919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-11f54cab-eac7-4223-9b0a-a7982d7b5f6c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:34.117036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-11f54cab-eac7-4223-9b0a-a7982d7b5f6c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:34.119259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf936c41-7bfc-479b-b8c6-ec7033efcfa2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:34.119834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf936c41-7bfc-479b-b8c6-ec7033efcfa2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:34.120294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf936c41-7bfc-479b-b8c6-ec7033efcfa2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:34.120934 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-11f54cab-eac7-4223-9b0a-a7982d7b5f6c tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1406 microversion: 2.54 time: 0.330580 Aug 29 15:36:34.121042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf936c41-7bfc-479b-b8c6-ec7033efcfa2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:34.121552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf936c41-7bfc-479b-b8c6-ec7033efcfa2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:34.121987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf936c41-7bfc-479b-b8c6-ec7033efcfa2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:34.122770 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1480/2988] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:33 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:34.520651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bf936c41-7bfc-479b-b8c6-ec7033efcfa2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:34.535045 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bf936c41-7bfc-479b-b8c6-ec7033efcfa2 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 0.445284 Aug 29 15:36:34.553400 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1509/2989] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:34 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:34.671684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-45db5982-c1de-4c8c-a7df-d9b4d6b803e1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:34.672356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-45db5982-c1de-4c8c-a7df-d9b4d6b803e1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:34.693984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45db5982-c1de-4c8c-a7df-d9b4d6b803e1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:34.694504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45db5982-c1de-4c8c-a7df-d9b4d6b803e1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:34.694938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45db5982-c1de-4c8c-a7df-d9b4d6b803e1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:34.696170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45db5982-c1de-4c8c-a7df-d9b4d6b803e1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:34.696818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45db5982-c1de-4c8c-a7df-d9b4d6b803e1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:34.697475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45db5982-c1de-4c8c-a7df-d9b4d6b803e1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:34.861242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7d9a2e2f-4c6e-47ef-9185-a3aff52a81be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:34.880267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7d9a2e2f-4c6e-47ef-9185-a3aff52a81be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:34.880267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d9a2e2f-4c6e-47ef-9185-a3aff52a81be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:34.880267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d9a2e2f-4c6e-47ef-9185-a3aff52a81be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:34.880267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d9a2e2f-4c6e-47ef-9185-a3aff52a81be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:34.886556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d9a2e2f-4c6e-47ef-9185-a3aff52a81be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:34.886745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d9a2e2f-4c6e-47ef-9185-a3aff52a81be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:34.889278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d9a2e2f-4c6e-47ef-9185-a3aff52a81be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:35.076970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7d9a2e2f-4c6e-47ef-9185-a3aff52a81be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:35.090741 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7d9a2e2f-4c6e-47ef-9185-a3aff52a81be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.233847 Aug 29 15:36:35.091642 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1510/2990] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:34 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:35.114584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b9949c19-371f-4647-9f1f-5a9f6d0568f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:35.115345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b9949c19-371f-4647-9f1f-5a9f6d0568f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:35.129633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9949c19-371f-4647-9f1f-5a9f6d0568f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:35.130735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9949c19-371f-4647-9f1f-5a9f6d0568f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:35.131443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9949c19-371f-4647-9f1f-5a9f6d0568f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:35.134447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9949c19-371f-4647-9f1f-5a9f6d0568f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:35.135172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9949c19-371f-4647-9f1f-5a9f6d0568f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:35.135835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9949c19-371f-4647-9f1f-5a9f6d0568f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:35.406684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-45db5982-c1de-4c8c-a7df-d9b4d6b803e1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:35.419918 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-45db5982-c1de-4c8c-a7df-d9b4d6b803e1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1523 microversion: 2.1 time: 0.752246 Aug 29 15:36:35.420621 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1481/2991] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:34 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1523 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:35.430242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-22200904-3b56-4b40-ad55-b6b8e349af54 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:35.433059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-22200904-3b56-4b40-ad55-b6b8e349af54 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:35.467496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22200904-3b56-4b40-ad55-b6b8e349af54 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:35.468369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22200904-3b56-4b40-ad55-b6b8e349af54 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:35.469344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22200904-3b56-4b40-ad55-b6b8e349af54 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:35.470588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22200904-3b56-4b40-ad55-b6b8e349af54 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:35.471280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22200904-3b56-4b40-ad55-b6b8e349af54 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:35.471937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22200904-3b56-4b40-ad55-b6b8e349af54 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:35.533470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:35.696720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-22200904-3b56-4b40-ad55-b6b8e349af54 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:35.739113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-22200904-3b56-4b40-ad55-b6b8e349af54 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:35.745020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-22200904-3b56-4b40-ad55-b6b8e349af54 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:35.746670 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-22200904-3b56-4b40-ad55-b6b8e349af54 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1406 microversion: 2.54 time: 0.320525 Aug 29 15:36:35.749532 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1482/2992] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:35 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:35.770636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-822f166b-4455-4578-9425-44df88cebe31 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:35.771692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-822f166b-4455-4578-9425-44df88cebe31 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:35.778830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-822f166b-4455-4578-9425-44df88cebe31 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:35.779684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-822f166b-4455-4578-9425-44df88cebe31 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:35.780340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-822f166b-4455-4578-9425-44df88cebe31 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:35.781663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-822f166b-4455-4578-9425-44df88cebe31 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:35.782791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-822f166b-4455-4578-9425-44df88cebe31 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:35.783611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-822f166b-4455-4578-9425-44df88cebe31 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:36.075469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b9949c19-371f-4647-9f1f-5a9f6d0568f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:36.086795 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b9949c19-371f-4647-9f1f-5a9f6d0568f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.977387 Aug 29 15:36:36.103366 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1511/2993] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:35 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:36.124490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-95c2a523-cc78-41dc-b878-3f3f2c54a413 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:36.125742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-95c2a523-cc78-41dc-b878-3f3f2c54a413 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:36.150029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95c2a523-cc78-41dc-b878-3f3f2c54a413 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:36.151585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95c2a523-cc78-41dc-b878-3f3f2c54a413 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:36.153641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95c2a523-cc78-41dc-b878-3f3f2c54a413 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:36.154846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95c2a523-cc78-41dc-b878-3f3f2c54a413 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:36.155480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95c2a523-cc78-41dc-b878-3f3f2c54a413 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:36.156307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95c2a523-cc78-41dc-b878-3f3f2c54a413 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:36.785025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-95c2a523-cc78-41dc-b878-3f3f2c54a413 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:36.794120 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-95c2a523-cc78-41dc-b878-3f3f2c54a413 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.683878 Aug 29 15:36:36.794716 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1512/2994] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:36 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:36.799308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ca7a5cf0-bffa-44a4-b18d-e70492ed1774 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:36.818771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ca7a5cf0-bffa-44a4-b18d-e70492ed1774 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:36.843685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca7a5cf0-bffa-44a4-b18d-e70492ed1774 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:36.844694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca7a5cf0-bffa-44a4-b18d-e70492ed1774 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:36.845444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca7a5cf0-bffa-44a4-b18d-e70492ed1774 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:36.849461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca7a5cf0-bffa-44a4-b18d-e70492ed1774 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:36.850875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca7a5cf0-bffa-44a4-b18d-e70492ed1774 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:36.851522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca7a5cf0-bffa-44a4-b18d-e70492ed1774 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:37.046880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-822f166b-4455-4578-9425-44df88cebe31 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:37.058341 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-822f166b-4455-4578-9425-44df88cebe31 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 1.307655 Aug 29 15:36:37.060091 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1483/2995] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:35 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:37.067339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e669b333-9d3e-4d35-a8e0-c5ef36484731 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:37.068215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e669b333-9d3e-4d35-a8e0-c5ef36484731 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:37.074900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e669b333-9d3e-4d35-a8e0-c5ef36484731 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:37.075775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e669b333-9d3e-4d35-a8e0-c5ef36484731 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:37.078942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e669b333-9d3e-4d35-a8e0-c5ef36484731 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:37.081597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e669b333-9d3e-4d35-a8e0-c5ef36484731 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:37.084659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e669b333-9d3e-4d35-a8e0-c5ef36484731 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:37.088308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e669b333-9d3e-4d35-a8e0-c5ef36484731 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:37.175858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e669b333-9d3e-4d35-a8e0-c5ef36484731 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:37.178001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e669b333-9d3e-4d35-a8e0-c5ef36484731 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:37.179213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e669b333-9d3e-4d35-a8e0-c5ef36484731 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:37.180575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-e669b333-9d3e-4d35-a8e0-c5ef36484731 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lazy-loading 'fault' on Instance uuid 0414175c-5a57-4b76-8970-d0986dfb279a {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:36:37.300387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e669b333-9d3e-4d35-a8e0-c5ef36484731 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:37.321431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e669b333-9d3e-4d35-a8e0-c5ef36484731 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:37.325707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e669b333-9d3e-4d35-a8e0-c5ef36484731 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:37.328620 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e669b333-9d3e-4d35-a8e0-c5ef36484731 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1411 microversion: 2.54 time: 0.266561 Aug 29 15:36:37.328765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ca7a5cf0-bffa-44a4-b18d-e70492ed1774 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:37.331516 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1484/2996] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:37 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1411 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:37.340988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0bd3dc55-18f0-4484-bd8a-3aa46e82786d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1729223159"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:37.360964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0bd3dc55-18f0-4484-bd8a-3aa46e82786d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:37.364850 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ca7a5cf0-bffa-44a4-b18d-e70492ed1774 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1523 microversion: 2.1 time: 0.569044 Aug 29 15:36:37.373557 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1513/2997] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:36 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1523 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:37.374754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bd3dc55-18f0-4484-bd8a-3aa46e82786d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:37.375301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bd3dc55-18f0-4484-bd8a-3aa46e82786d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:37.375747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bd3dc55-18f0-4484-bd8a-3aa46e82786d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:37.376490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bd3dc55-18f0-4484-bd8a-3aa46e82786d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:37.376961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bd3dc55-18f0-4484-bd8a-3aa46e82786d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:37.387362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bd3dc55-18f0-4484-bd8a-3aa46e82786d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:37.926562 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0bd3dc55-18f0-4484-bd8a-3aa46e82786d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 202 len: 0 microversion: 2.1 time: 0.589788 Aug 29 15:36:37.928034 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1485/2998] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:36:37 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 29 15:36:38.082004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-87fe7c66-0727-45c2-bb0f-ee5defabf859 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:38.083702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-87fe7c66-0727-45c2-bb0f-ee5defabf859 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:38.104350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87fe7c66-0727-45c2-bb0f-ee5defabf859 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:38.105370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87fe7c66-0727-45c2-bb0f-ee5defabf859 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:38.105994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87fe7c66-0727-45c2-bb0f-ee5defabf859 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:38.106919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87fe7c66-0727-45c2-bb0f-ee5defabf859 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:38.107813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87fe7c66-0727-45c2-bb0f-ee5defabf859 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:38.108415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87fe7c66-0727-45c2-bb0f-ee5defabf859 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:38.111192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-041e8332-25ce-4322-aa75-0ab489dc29f6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Action: 'create', calling method: .version_select at 0x7fc433b6c700>, body: {"keypair": {"name": "tempest-keypair-66583430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5w2d4Yj84ZQbAsgeni0Y8fjj5+u7IZuBgMvnFrN+KDXwxEhVER3z0hMjFuXNBZVEBtIWnM4zx1HSLslWjZeNJH9hP3ynSDRrGQi+HUM1ZZnGRuaGONCspLeFPMKvmeHQ=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:38.134032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-041e8332-25ce-4322-aa75-0ab489dc29f6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Getting quotas for project 4f7cf262cab649fea4b4a44d3c4d7dec. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:38.147801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-041e8332-25ce-4322-aa75-0ab489dc29f6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Getting quotas for user d6e53abcc8ad4e1b91ed86a6c1fdb021 and project 4f7cf262cab649fea4b4a44d3c4d7dec. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:38.191711 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-041e8332-25ce-4322-aa75-0ab489dc29f6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.389875 Aug 29 15:36:38.193437 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1514/2999] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:36:37 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:38.362111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bdcd80fe-098b-4c4e-8569-9d1fb5b1b167 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:38.363528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bdcd80fe-098b-4c4e-8569-9d1fb5b1b167 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:38.375839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdcd80fe-098b-4c4e-8569-9d1fb5b1b167 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:38.376510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdcd80fe-098b-4c4e-8569-9d1fb5b1b167 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:38.378532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdcd80fe-098b-4c4e-8569-9d1fb5b1b167 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:38.380318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdcd80fe-098b-4c4e-8569-9d1fb5b1b167 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:38.382014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdcd80fe-098b-4c4e-8569-9d1fb5b1b167 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:38.385021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdcd80fe-098b-4c4e-8569-9d1fb5b1b167 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:38.471693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdcd80fe-098b-4c4e-8569-9d1fb5b1b167 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:38.475091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdcd80fe-098b-4c4e-8569-9d1fb5b1b167 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:38.476041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdcd80fe-098b-4c4e-8569-9d1fb5b1b167 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:38.476849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-bdcd80fe-098b-4c4e-8569-9d1fb5b1b167 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lazy-loading 'fault' on Instance uuid 0414175c-5a57-4b76-8970-d0986dfb279a {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:36:38.555576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-87fe7c66-0727-45c2-bb0f-ee5defabf859 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:38.566074 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-87fe7c66-0727-45c2-bb0f-ee5defabf859 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1477 microversion: 2.1 time: 0.489651 Aug 29 15:36:38.571950 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1486/3000] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:38 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1477 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:38.582305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-28f81cec-8277-4880-aa7c-2406f5609857 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:38.585626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-28f81cec-8277-4880-aa7c-2406f5609857 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:38.600353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28f81cec-8277-4880-aa7c-2406f5609857 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:38.603878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28f81cec-8277-4880-aa7c-2406f5609857 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:38.604666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28f81cec-8277-4880-aa7c-2406f5609857 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:38.605736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28f81cec-8277-4880-aa7c-2406f5609857 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:38.608086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28f81cec-8277-4880-aa7c-2406f5609857 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:38.611557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28f81cec-8277-4880-aa7c-2406f5609857 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:39.148726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bdcd80fe-098b-4c4e-8569-9d1fb5b1b167 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:39.170339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bdcd80fe-098b-4c4e-8569-9d1fb5b1b167 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:39.179886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bdcd80fe-098b-4c4e-8569-9d1fb5b1b167 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd87f5c77dc8e409696ae6beed439082d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb11c811f8be4235afdc24c2554bfc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:39.181451 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bdcd80fe-098b-4c4e-8569-9d1fb5b1b167 tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 200 len: 1411 microversion: 2.54 time: 0.824384 Aug 29 15:36:39.200019 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1515/3001] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:38 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 1411 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:39.311879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-28f81cec-8277-4880-aa7c-2406f5609857 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:39.323625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-538660629", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "2d27d5b5-0bb7-4454-8b95-3d130a3377a8"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:39.326572 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-28f81cec-8277-4880-aa7c-2406f5609857 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1523 microversion: 2.1 time: 0.750367 Aug 29 15:36:39.327418 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1487/3002] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:38 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1523 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:39.520633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] validate_networks() for [('2d27d5b5-0bb7-4454-8b95-3d130a3377a8', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:36:39.591891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2a42b507-611e-4a53-88d9-b54102ff32be tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:39.592511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2a42b507-611e-4a53-88d9-b54102ff32be tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:39.602869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a42b507-611e-4a53-88d9-b54102ff32be tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:39.604132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a42b507-611e-4a53-88d9-b54102ff32be tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:39.605777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a42b507-611e-4a53-88d9-b54102ff32be tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:39.608565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a42b507-611e-4a53-88d9-b54102ff32be tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:39.614392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a42b507-611e-4a53-88d9-b54102ff32be tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:39.616073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a42b507-611e-4a53-88d9-b54102ff32be tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:40.389202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2a42b507-611e-4a53-88d9-b54102ff32be tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:40.394266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:36:40.394689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:36:40.395160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:36:40.395563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:36:40.395968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:36:40.408765 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2a42b507-611e-4a53-88d9-b54102ff32be tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1476 microversion: 2.1 time: 0.820277 Aug 29 15:36:40.426698 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1488/3003] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:39 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1476 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:40.427787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:40.428315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:40.428755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:40.430429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:40.432222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:40.432934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:40.435568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1cb833af-9a08-4242-8694-c0b249072f4f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:40.436585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1cb833af-9a08-4242-8694-c0b249072f4f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] [instance: 0414175c-5a57-4b76-8970-d0986dfb279a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:40.446592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb833af-9a08-4242-8694-c0b249072f4f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:40.450670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb833af-9a08-4242-8694-c0b249072f4f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:40.451301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb833af-9a08-4242-8694-c0b249072f4f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:40.454775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb833af-9a08-4242-8694-c0b249072f4f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:40.455511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb833af-9a08-4242-8694-c0b249072f4f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:40.456513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb833af-9a08-4242-8694-c0b249072f4f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:40.482893 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-1cb833af-9a08-4242-8694-c0b249072f4f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] HTTP exception thrown: Instance 0414175c-5a57-4b76-8970-d0986dfb279a could not be found. Aug 29 15:36:40.488868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Getting quotas for project eaeecb44c6534cba89e3d68177917529. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1cb833af-9a08-4242-8694-c0b249072f4f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Request method failure captured: Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a HTTP/1.1 Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNzIeoeJNyLg6T-Th-eExk5SM-58WzKFV84wB518fkhYZB-rrd7qKZ5SNMeAj8k3iagxo0Ni-0n6vlZKVyvgRpK8q_xwVqYDogLo8CHh5MHVxk6an_dWhzJTm4T5NJVgR9J5RPYsHYK_kbPnCWr0m_SjTb1YVJzge0aIojuvvG3E-xo Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.54 Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: eb11c811f8be4235afdc24c2554bfc62 Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerShowV254Test-524747229 Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eb11c811f8be4235afdc24c2554bfc62", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eb11c811f8be4235afdc24c2554bfc62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eb11c811f8be4235afdc24c2554bfc62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eb11c811f8be4235afdc24c2554bfc62"}]}] Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerShowV254Test-524747229 Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: eb11c811f8be4235afdc24c2554bfc62 Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerShowV254Test-524747229 Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerShowV254Test-524747229-project Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: d87f5c77dc8e409696ae6beed439082d Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerShowV254Test-524747229-project Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 0414175c-5a57-4b76-8970-d0986dfb279a could not be found. Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '0414175c-5a57-4b76-8970-d0986dfb279a'} Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0414175c-5a57-4b76-8970-d0986dfb279a could not be found. Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0414175c-5a57-4b76-8970-d0986dfb279a could not be found. Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:36:40.492181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:40.499803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:36:40.499803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:36:40.499803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:36:40.499803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:36:40.499803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:36:40.499803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0414175c-5a57-4b76-8970-d0986dfb279a could not be found. Aug 29 15:36:40.499803 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:36:40.500887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:40.504238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1cb833af-9a08-4242-8694-c0b249072f4f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] Returning 404 to user: Instance 0414175c-5a57-4b76-8970-d0986dfb279a could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:36:40.505389 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1cb833af-9a08-4242-8694-c0b249072f4f tempest-ServerShowV254Test-524747229 tempest-ServerShowV254Test-524747229-project] 10.222.0.62 "GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a" status: 404 len: 111 microversion: 2.54 time: 0.077226 Aug 29 15:36:40.506329 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1489/3004] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:36:40 2022] GET /compute/v2.1/servers/0414175c-5a57-4b76-8970-d0986dfb279a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:36:40.510073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Getting quotas for user 6de4fe0749d449748eca6937b123d2df and project eaeecb44c6534cba89e3d68177917529. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:40.527901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fc311a63-8aed-4a6e-b417-e66e00dd3c07 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:40.536079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fc311a63-8aed-4a6e-b417-e66e00dd3c07 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:40.552521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:36:40.556694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:36:40.557526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc311a63-8aed-4a6e-b417-e66e00dd3c07 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:40.558590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc311a63-8aed-4a6e-b417-e66e00dd3c07 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:40.560532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc311a63-8aed-4a6e-b417-e66e00dd3c07 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:40.563144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc311a63-8aed-4a6e-b417-e66e00dd3c07 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:40.564009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc311a63-8aed-4a6e-b417-e66e00dd3c07 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:40.566062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc311a63-8aed-4a6e-b417-e66e00dd3c07 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:40.719153 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8050e7f0-a52f-46aa-8fc5-1699fcdfe00b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.517144 Aug 29 15:36:40.722794 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1516/3005] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:36:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:36:40.736828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9641d916-26e1-46eb-b5a3-34512c16595a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:40.737497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9641d916-26e1-46eb-b5a3-34512c16595a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:40.983339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9641d916-26e1-46eb-b5a3-34512c16595a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:40.992250 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9641d916-26e1-46eb-b5a3-34512c16595a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1224 microversion: 2.1 time: 0.262692 Aug 29 15:36:40.996054 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1517/3006] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:40 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1224 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:41.261284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fc311a63-8aed-4a6e-b417-e66e00dd3c07 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:41.276969 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fc311a63-8aed-4a6e-b417-e66e00dd3c07 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1523 microversion: 2.1 time: 0.769338 Aug 29 15:36:41.286229 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1490/3007] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:40 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1523 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:41.434867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c0a8ec3d-4c15-4aff-a69f-d50b31439712 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:41.436177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c0a8ec3d-4c15-4aff-a69f-d50b31439712 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:41.459323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a8ec3d-4c15-4aff-a69f-d50b31439712 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:41.460209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a8ec3d-4c15-4aff-a69f-d50b31439712 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:41.460923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a8ec3d-4c15-4aff-a69f-d50b31439712 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:41.468038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a8ec3d-4c15-4aff-a69f-d50b31439712 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:41.470774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a8ec3d-4c15-4aff-a69f-d50b31439712 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:41.472398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a8ec3d-4c15-4aff-a69f-d50b31439712 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:41.897563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-6927c9f0-dab4-429a-aead-a6f9cb84ac48 req-b33205ff-2e78-4c87-b615-fc51cb8a87f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923c4a5b-679a-41e3-9d6b-f7bbcc603db3", "name": "network-vif-plugged", "status": "completed", "tag": "cc2e791e-3b26-47d3-98e5-ffbbe4d0c8e7"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:41.925839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:41.929236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6927c9f0-dab4-429a-aead-a6f9cb84ac48 req-b33205ff-2e78-4c87-b615-fc51cb8a87f7 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:41.929952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6927c9f0-dab4-429a-aead-a6f9cb84ac48 req-b33205ff-2e78-4c87-b615-fc51cb8a87f7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:41.930606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6927c9f0-dab4-429a-aead-a6f9cb84ac48 req-b33205ff-2e78-4c87-b615-fc51cb8a87f7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:41.947698 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-6927c9f0-dab4-429a-aead-a6f9cb84ac48 req-b33205ff-2e78-4c87-b615-fc51cb8a87f7 service nova] Creating event network-vif-plugged:cc2e791e-3b26-47d3-98e5-ffbbe4d0c8e7 for instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 on n-h2-839401-11 Aug 29 15:36:41.959653 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-6927c9f0-dab4-429a-aead-a6f9cb84ac48 req-b33205ff-2e78-4c87-b615-fc51cb8a87f7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102664 Aug 29 15:36:41.961407 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1491/3008] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:42.017014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c1a1aaa7-435c-43ad-8564-78f1036bd527 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:42.018203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c1a1aaa7-435c-43ad-8564-78f1036bd527 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:42.044881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a1aaa7-435c-43ad-8564-78f1036bd527 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:42.045791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a1aaa7-435c-43ad-8564-78f1036bd527 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:42.047030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a1aaa7-435c-43ad-8564-78f1036bd527 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:42.050822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a1aaa7-435c-43ad-8564-78f1036bd527 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:42.051609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a1aaa7-435c-43ad-8564-78f1036bd527 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:42.052295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a1aaa7-435c-43ad-8564-78f1036bd527 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:42.092600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c0a8ec3d-4c15-4aff-a69f-d50b31439712 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:42.115359 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c0a8ec3d-4c15-4aff-a69f-d50b31439712 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1476 microversion: 2.1 time: 0.680546 Aug 29 15:36:42.121706 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1518/3009] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:41 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1476 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:42.171065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-d2fbcd9e-4d50-4d11-a841-1d4a030d3344 req-0d69b01a-6042-490d-84bc-2b5e96ebe6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0330d585-be01-45a3-b20a-9ce9cdfbaa43", "name": "network-vif-unplugged", "status": "completed", "tag": "53083e31-a61d-4467-9153-eb9ce7344ee5"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:42.220753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d2fbcd9e-4d50-4d11-a841-1d4a030d3344 req-0d69b01a-6042-490d-84bc-2b5e96ebe6f8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:42.221516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d2fbcd9e-4d50-4d11-a841-1d4a030d3344 req-0d69b01a-6042-490d-84bc-2b5e96ebe6f8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:42.221977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d2fbcd9e-4d50-4d11-a841-1d4a030d3344 req-0d69b01a-6042-490d-84bc-2b5e96ebe6f8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:42.264151 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-d2fbcd9e-4d50-4d11-a841-1d4a030d3344 req-0d69b01a-6042-490d-84bc-2b5e96ebe6f8 service nova] Creating event network-vif-unplugged:53083e31-a61d-4467-9153-eb9ce7344ee5 for instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 on n-h1-839401-11 Aug 29 15:36:42.286343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-d2fbcd9e-4d50-4d11-a841-1d4a030d3344 req-0d69b01a-6042-490d-84bc-2b5e96ebe6f8 service nova] Instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:36:42.348761 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-d2fbcd9e-4d50-4d11-a841-1d4a030d3344 req-0d69b01a-6042-490d-84bc-2b5e96ebe6f8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.198272 Aug 29 15:36:42.354924 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1519/3010] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:42.356372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c1a1aaa7-435c-43ad-8564-78f1036bd527 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:42.370496 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c1a1aaa7-435c-43ad-8564-78f1036bd527 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1228 microversion: 2.1 time: 0.358040 Aug 29 15:36:42.373468 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1492/3011] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:42 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1228 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:42.374412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fa43698f-6a0e-40e4-918c-3877bd7d538c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:42.377017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fa43698f-6a0e-40e4-918c-3877bd7d538c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:42.405079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa43698f-6a0e-40e4-918c-3877bd7d538c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:42.405668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa43698f-6a0e-40e4-918c-3877bd7d538c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:42.408660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa43698f-6a0e-40e4-918c-3877bd7d538c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:42.410788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa43698f-6a0e-40e4-918c-3877bd7d538c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:42.411291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa43698f-6a0e-40e4-918c-3877bd7d538c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:42.413441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa43698f-6a0e-40e4-918c-3877bd7d538c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:43.102224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fa43698f-6a0e-40e4-918c-3877bd7d538c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:43.121556 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fa43698f-6a0e-40e4-918c-3877bd7d538c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1523 microversion: 2.1 time: 0.759833 Aug 29 15:36:43.126057 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1520/3012] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:42 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1523 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:43.148626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4ea73108-f9c6-47b7-bfc7-51e6a9d98e81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:43.149307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4ea73108-f9c6-47b7-bfc7-51e6a9d98e81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:43.158379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ea73108-f9c6-47b7-bfc7-51e6a9d98e81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:43.164312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ea73108-f9c6-47b7-bfc7-51e6a9d98e81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:43.164949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ea73108-f9c6-47b7-bfc7-51e6a9d98e81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:43.168233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ea73108-f9c6-47b7-bfc7-51e6a9d98e81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:43.168715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ea73108-f9c6-47b7-bfc7-51e6a9d98e81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:43.169180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ea73108-f9c6-47b7-bfc7-51e6a9d98e81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:43.392821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fa7bc029-47a9-4ec5-9ee8-283835602efb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:43.393529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fa7bc029-47a9-4ec5-9ee8-283835602efb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:43.411506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa7bc029-47a9-4ec5-9ee8-283835602efb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:43.412022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa7bc029-47a9-4ec5-9ee8-283835602efb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:43.412474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa7bc029-47a9-4ec5-9ee8-283835602efb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:43.413247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa7bc029-47a9-4ec5-9ee8-283835602efb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:43.430541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa7bc029-47a9-4ec5-9ee8-283835602efb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:43.431055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa7bc029-47a9-4ec5-9ee8-283835602efb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:43.669917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fa7bc029-47a9-4ec5-9ee8-283835602efb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:43.684156 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fa7bc029-47a9-4ec5-9ee8-283835602efb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1284 microversion: 2.1 time: 0.295333 Aug 29 15:36:43.685339 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1521/3013] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:43 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1284 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:43.687994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4ea73108-f9c6-47b7-bfc7-51e6a9d98e81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:43.691497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1811776346", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "d6d011d7-3a33-4483-ae55-fa0d27ab805b"}], "security_groups": [{"name": "tempest-securitygroup--260268977"}], "key_name": "tempest-keypair-66583430", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:43.701510 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4ea73108-f9c6-47b7-bfc7-51e6a9d98e81 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1476 microversion: 2.1 time: 0.554112 Aug 29 15:36:43.702782 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1493/3014] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:43 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1476 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:44.051515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] validate_networks() for [('d6d011d7-3a33-4483-ae55-fa0d27ab805b', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:36:44.157971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7f935b3e-6f3c-4d39-a7f9-61da45d1764f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:44.159849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7f935b3e-6f3c-4d39-a7f9-61da45d1764f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:44.177798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f935b3e-6f3c-4d39-a7f9-61da45d1764f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:44.179108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f935b3e-6f3c-4d39-a7f9-61da45d1764f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:44.180846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f935b3e-6f3c-4d39-a7f9-61da45d1764f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:44.182284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f935b3e-6f3c-4d39-a7f9-61da45d1764f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:44.185071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f935b3e-6f3c-4d39-a7f9-61da45d1764f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:44.185610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f935b3e-6f3c-4d39-a7f9-61da45d1764f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:45.881277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7f935b3e-6f3c-4d39-a7f9-61da45d1764f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:45.902008 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7f935b3e-6f3c-4d39-a7f9-61da45d1764f tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1523 microversion: 2.1 time: 1.756043 Aug 29 15:36:45.905843 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1494/3015] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:44 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1523 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:45.910898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-08cdd7ef-d721-49f6-83c1-e707fee7e534 req-d32178a4-51af-4187-ad7e-fcd5cc72e269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0330d585-be01-45a3-b20a-9ce9cdfbaa43", "tag": "53083e31-a61d-4467-9153-eb9ce7344ee5"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:45.967350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-08cdd7ef-d721-49f6-83c1-e707fee7e534 req-d32178a4-51af-4187-ad7e-fcd5cc72e269 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:45.967853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-08cdd7ef-d721-49f6-83c1-e707fee7e534 req-d32178a4-51af-4187-ad7e-fcd5cc72e269 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:45.982012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-08cdd7ef-d721-49f6-83c1-e707fee7e534 req-d32178a4-51af-4187-ad7e-fcd5cc72e269 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:46.020004 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-08cdd7ef-d721-49f6-83c1-e707fee7e534 req-d32178a4-51af-4187-ad7e-fcd5cc72e269 service nova] Creating event network-changed:53083e31-a61d-4467-9153-eb9ce7344ee5 for instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 on n-h1-839401-11 Aug 29 15:36:46.041448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-08cdd7ef-d721-49f6-83c1-e707fee7e534 req-d32178a4-51af-4187-ad7e-fcd5cc72e269 service nova] Instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:36:46.110244 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-08cdd7ef-d721-49f6-83c1-e707fee7e534 req-d32178a4-51af-4187-ad7e-fcd5cc72e269 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178904 Aug 29 15:36:46.115961 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1495/3016] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:46.147270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0714b5b9-6400-4c67-94b1-7a79a6625533 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:46.148545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0714b5b9-6400-4c67-94b1-7a79a6625533 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:46.163673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0714b5b9-6400-4c67-94b1-7a79a6625533 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:46.164175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0714b5b9-6400-4c67-94b1-7a79a6625533 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:46.164612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0714b5b9-6400-4c67-94b1-7a79a6625533 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:46.165362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0714b5b9-6400-4c67-94b1-7a79a6625533 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:46.165822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0714b5b9-6400-4c67-94b1-7a79a6625533 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:46.166249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0714b5b9-6400-4c67-94b1-7a79a6625533 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:46.172880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:36:46.173887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:36:46.174727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:36:46.175601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:36:46.175724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:36:46.196305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:46.196305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:46.202559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:46.207159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:46.207844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:46.213760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:46.257677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Getting quotas for project 4f7cf262cab649fea4b4a44d3c4d7dec. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:46.274931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Getting quotas for user d6e53abcc8ad4e1b91ed86a6c1fdb021 and project 4f7cf262cab649fea4b4a44d3c4d7dec. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:46.312080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:36:46.322054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:36:46.468953 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-89876df0-9b86-4207-969c-1c7085cbc3ae tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.782292 Aug 29 15:36:46.475208 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1522/3017] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:36:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 2789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:36:46.491845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4aa52719-bde5-45da-b3de-0f418157ee74 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:46.492973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4aa52719-bde5-45da-b3de-0f418157ee74 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:46.500419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4aa52719-bde5-45da-b3de-0f418157ee74 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:46.505633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4aa52719-bde5-45da-b3de-0f418157ee74 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:46.506325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4aa52719-bde5-45da-b3de-0f418157ee74 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:46.507252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4aa52719-bde5-45da-b3de-0f418157ee74 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:46.510738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4aa52719-bde5-45da-b3de-0f418157ee74 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:46.511374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4aa52719-bde5-45da-b3de-0f418157ee74 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:46.922079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0714b5b9-6400-4c67-94b1-7a79a6625533 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:46.934826 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0714b5b9-6400-4c67-94b1-7a79a6625533 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1324 microversion: 2.1 time: 0.817252 Aug 29 15:36:46.960280 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1496/3018] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:46 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1324 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:47.281354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4aa52719-bde5-45da-b3de-0f418157ee74 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:47.298345 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4aa52719-bde5-45da-b3de-0f418157ee74 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1476 microversion: 2.1 time: 0.821287 Aug 29 15:36:47.301421 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1523/3019] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:46 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1476 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:47.316720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c67f3645-0018-4ec8-8f69-f27757a1c228 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:47.322161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c67f3645-0018-4ec8-8f69-f27757a1c228 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:47.451769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b0f5fdc4-28cb-4394-a3d5-595b289e8e93 tempest-QuotasTestJSON-1613756016 tempest-QuotasTestJSON-1613756016-project] Calling method '.version_select at 0x7fc433a12d30>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:47.500983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c67f3645-0018-4ec8-8f69-f27757a1c228 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:47.510661 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c67f3645-0018-4ec8-8f69-f27757a1c228 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1240 microversion: 2.1 time: 0.207505 Aug 29 15:36:47.513648 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1524/3020] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:47 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1240 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:47.545281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-56f9f41e-a17d-4469-aaa6-66521b404d7e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:47.546177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-56f9f41e-a17d-4469-aaa6-66521b404d7e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:47.559537 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b0f5fdc4-28cb-4394-a3d5-595b289e8e93 tempest-QuotasTestJSON-1613756016 tempest-QuotasTestJSON-1613756016-project] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/2403f5ab84ed495695d470c7c22db464/defaults" status: 200 len: 371 microversion: 2.1 time: 0.597353 Aug 29 15:36:47.560570 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1497/3021] 10.222.0.62 () {58 vars in 1269 bytes} [Mon Aug 29 15:36:46 2022] GET /compute/v2.1/os-quota-sets/2403f5ab84ed495695d470c7c22db464/defaults => generated 371 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:47.577787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56f9f41e-a17d-4469-aaa6-66521b404d7e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:47.596778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56f9f41e-a17d-4469-aaa6-66521b404d7e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:47.597665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56f9f41e-a17d-4469-aaa6-66521b404d7e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:47.598650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56f9f41e-a17d-4469-aaa6-66521b404d7e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:47.599644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56f9f41e-a17d-4469-aaa6-66521b404d7e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:47.600287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56f9f41e-a17d-4469-aaa6-66521b404d7e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:47.718302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5c69526c-4b50-4044-a7b0-9bc68e17a565 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Action: 'create', calling method: .version_select at 0x7fc433a12670>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1487087049", "policies": ["affinity"]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:47.790152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5c69526c-4b50-4044-a7b0-9bc68e17a565 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:47.826653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5c69526c-4b50-4044-a7b0-9bc68e17a565 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for user abb7582f47fd4fd78149bf92742e9659 and project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:47.955478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5c69526c-4b50-4044-a7b0-9bc68e17a565 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:47.969722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-56f9f41e-a17d-4469-aaa6-66521b404d7e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:47.971948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5c69526c-4b50-4044-a7b0-9bc68e17a565 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for user abb7582f47fd4fd78149bf92742e9659 and project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:47.985304 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-56f9f41e-a17d-4469-aaa6-66521b404d7e tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1508 microversion: 2.1 time: 0.467784 Aug 29 15:36:47.991155 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1525/3022] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:47 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1508 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:47.997136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-39952b10-76ea-4afd-b103-d601539d023e tempest-QuotasTestJSON-1613756016 tempest-QuotasTestJSON-1613756016-project] Calling method '.version_select at 0x7fc433c1a940>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:48.002915 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5c69526c-4b50-4044-a7b0-9bc68e17a565 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.440899 Aug 29 15:36:48.008768 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1498/3023] 10.222.0.62 () {60 vars in 1174 bytes} [Mon Aug 29 15:36:47 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:48.031496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-adf8d7ad-6807-42bc-9152-dc126285518a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:48.037289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-adf8d7ad-6807-42bc-9152-dc126285518a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:48.051076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf8d7ad-6807-42bc-9152-dc126285518a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:48.053426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf8d7ad-6807-42bc-9152-dc126285518a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:48.056790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf8d7ad-6807-42bc-9152-dc126285518a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:48.058155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf8d7ad-6807-42bc-9152-dc126285518a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:48.060757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf8d7ad-6807-42bc-9152-dc126285518a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:48.061496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf8d7ad-6807-42bc-9152-dc126285518a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:48.158677 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-39952b10-76ea-4afd-b103-d601539d023e tempest-QuotasTestJSON-1613756016 tempest-QuotasTestJSON-1613756016-project] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/2403f5ab84ed495695d470c7c22db464" status: 200 len: 371 microversion: 2.1 time: 0.165321 Aug 29 15:36:48.162242 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1526/3024] 10.222.0.62 () {58 vars in 1242 bytes} [Mon Aug 29 15:36:47 2022] GET /compute/v2.1/os-quota-sets/2403f5ab84ed495695d470c7c22db464 => generated 371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:48.167220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-040e4190-3faf-4838-ba10-5b3af87769d7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:48.190174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-040e4190-3faf-4838-ba10-5b3af87769d7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:48.208014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-040e4190-3faf-4838-ba10-5b3af87769d7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:48.210419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-040e4190-3faf-4838-ba10-5b3af87769d7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:48.211052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-040e4190-3faf-4838-ba10-5b3af87769d7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:48.211945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-040e4190-3faf-4838-ba10-5b3af87769d7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:48.216205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-040e4190-3faf-4838-ba10-5b3af87769d7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:48.217416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-040e4190-3faf-4838-ba10-5b3af87769d7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:48.480415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-040e4190-3faf-4838-ba10-5b3af87769d7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:48.493927 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-040e4190-3faf-4838-ba10-5b3af87769d7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 200 len: 1508 microversion: 2.1 time: 0.329729 Aug 29 15:36:48.508122 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1527/3025] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:48 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 1508 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:48.535729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0dafd0a8-d57f-4215-b547-772d34881829 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Action: 'create', calling method: .version_select at 0x7fc42ad0dc10>, body: {"server_group": {"name": "tempest-server-group-2132551812", "policies": ["affinity"]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:48.621668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-0dafd0a8-d57f-4215-b547-772d34881829 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:48.636423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-0dafd0a8-d57f-4215-b547-772d34881829 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for user abb7582f47fd4fd78149bf92742e9659 and project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:48.663153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-adf8d7ad-6807-42bc-9152-dc126285518a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:48.675621 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-adf8d7ad-6807-42bc-9152-dc126285518a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1324 microversion: 2.1 time: 0.658558 Aug 29 15:36:48.678755 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1499/3026] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:48 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1324 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:48.697696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-9c0b18e4-395a-492c-8d9d-9d06cb79fbce req-8f83df2d-5920-4296-861a-0beacfbdd5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b6cfb1a-bfac-45e1-9b33-2e080c11f838", "tag": "2e7d7a73-65af-4b13-a5be-e623d343d65d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:48.734734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9c0b18e4-395a-492c-8d9d-9d06cb79fbce req-8f83df2d-5920-4296-861a-0beacfbdd5b1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:48.736716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9c0b18e4-395a-492c-8d9d-9d06cb79fbce req-8f83df2d-5920-4296-861a-0beacfbdd5b1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:48.737508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9c0b18e4-395a-492c-8d9d-9d06cb79fbce req-8f83df2d-5920-4296-861a-0beacfbdd5b1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:48.760391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-0dafd0a8-d57f-4215-b547-772d34881829 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:48.763720 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-9c0b18e4-395a-492c-8d9d-9d06cb79fbce req-8f83df2d-5920-4296-861a-0beacfbdd5b1 service nova] Creating event network-changed:2e7d7a73-65af-4b13-a5be-e623d343d65d for instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 on n-h1-839401-11 Aug 29 15:36:48.772752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-0dafd0a8-d57f-4215-b547-772d34881829 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for user abb7582f47fd4fd78149bf92742e9659 and project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:48.776589 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-9c0b18e4-395a-492c-8d9d-9d06cb79fbce req-8f83df2d-5920-4296-861a-0beacfbdd5b1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095877 Aug 29 15:36:48.783567 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1500/3027] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:48.796130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-770b96a9-40f1-492a-b8b2-2dba6e778042 tempest-QuotasTestJSON-1613756016 tempest-QuotasTestJSON-1613756016-project] Calling method '.version_select at 0x7fc42b102af0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:48.804641 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0dafd0a8-d57f-4215-b547-772d34881829 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.278412 Aug 29 15:36:48.805883 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1528/3028] 10.222.0.62 () {60 vars in 1173 bytes} [Mon Aug 29 15:36:48 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:48.827487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-77d0be26-3483-450e-8e94-08ffcf78e626 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:48.828186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-77d0be26-3483-450e-8e94-08ffcf78e626 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:48.837579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77d0be26-3483-450e-8e94-08ffcf78e626 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:48.838203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77d0be26-3483-450e-8e94-08ffcf78e626 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:48.838799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77d0be26-3483-450e-8e94-08ffcf78e626 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:48.839517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77d0be26-3483-450e-8e94-08ffcf78e626 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:48.839993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77d0be26-3483-450e-8e94-08ffcf78e626 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:48.840412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77d0be26-3483-450e-8e94-08ffcf78e626 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:48.966814 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-770b96a9-40f1-492a-b8b2-2dba6e778042 tempest-QuotasTestJSON-1613756016 tempest-QuotasTestJSON-1613756016-project] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/2403f5ab84ed495695d470c7c22db464/defaults" status: 200 len: 371 microversion: 2.1 time: 0.181539 Aug 29 15:36:48.976987 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1501/3029] 10.222.0.62 () {58 vars in 1269 bytes} [Mon Aug 29 15:36:48 2022] GET /compute/v2.1/os-quota-sets/2403f5ab84ed495695d470c7c22db464/defaults => generated 371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:48.982551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dac92757-0eea-41a3-9b17-3e2a2c71ef6d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:48.983130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dac92757-0eea-41a3-9b17-3e2a2c71ef6d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:49.003524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dac92757-0eea-41a3-9b17-3e2a2c71ef6d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:49.005781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dac92757-0eea-41a3-9b17-3e2a2c71ef6d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:49.006292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dac92757-0eea-41a3-9b17-3e2a2c71ef6d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:49.010618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dac92757-0eea-41a3-9b17-3e2a2c71ef6d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:49.011226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dac92757-0eea-41a3-9b17-3e2a2c71ef6d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:49.015138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dac92757-0eea-41a3-9b17-3e2a2c71ef6d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:49.094830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dac92757-0eea-41a3-9b17-3e2a2c71ef6d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:36:49.103779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-77d0be26-3483-450e-8e94-08ffcf78e626 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:49.112766 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-77d0be26-3483-450e-8e94-08ffcf78e626 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1474 microversion: 2.1 time: 0.305670 Aug 29 15:36:49.127639 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1529/3030] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:48 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1474 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:49.127639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c0c33b52-9f61-4a87-abfc-a26307adfd92 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:49.127639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c0c33b52-9f61-4a87-abfc-a26307adfd92 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:49.127925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:49.146047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0c33b52-9f61-4a87-abfc-a26307adfd92 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:49.146556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0c33b52-9f61-4a87-abfc-a26307adfd92 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:49.147004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0c33b52-9f61-4a87-abfc-a26307adfd92 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:49.147734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0c33b52-9f61-4a87-abfc-a26307adfd92 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:49.148508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0c33b52-9f61-4a87-abfc-a26307adfd92 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:49.153554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0c33b52-9f61-4a87-abfc-a26307adfd92 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:49.313438 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dac92757-0eea-41a3-9b17-3e2a2c71ef6d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "DELETE /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 204 len: 0 microversion: 2.1 time: 0.340919 Aug 29 15:36:49.318224 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1502/3031] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:36:48 2022] DELETE /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:36:49.339765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d822015e-4a36-4a80-ac5c-954e4987e7b7 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Action: 'create', calling method: .version_select at 0x7fc433a12a60>, body: {"server_group": {"name": "tempest-server-group-2132551812", "policies": ["affinity"]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:49.340927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c0c33b52-9f61-4a87-abfc-a26307adfd92 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:49.348398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:49.353934 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c0c33b52-9f61-4a87-abfc-a26307adfd92 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1244 microversion: 2.1 time: 0.235226 Aug 29 15:36:49.362003 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1530/3032] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:49 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1244 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:49.379033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4bc21c6f-8918-469a-af66-24d39b87664e tempest-QuotasTestJSON-1613756016 tempest-QuotasTestJSON-1613756016-project] Calling method '.version_select at 0x7fc433ba1550>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:49.398509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-d822015e-4a36-4a80-ac5c-954e4987e7b7 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:49.410297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-d822015e-4a36-4a80-ac5c-954e4987e7b7 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for user abb7582f47fd4fd78149bf92742e9659 and project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:49.545454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-d822015e-4a36-4a80-ac5c-954e4987e7b7 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:49.563426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-d822015e-4a36-4a80-ac5c-954e4987e7b7 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for user abb7582f47fd4fd78149bf92742e9659 and project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:49.570611 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4bc21c6f-8918-469a-af66-24d39b87664e tempest-QuotasTestJSON-1613756016 tempest-QuotasTestJSON-1613756016-project] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/2403f5ab84ed495695d470c7c22db464" status: 200 len: 371 microversion: 2.1 time: 0.189688 Aug 29 15:36:49.573052 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1531/3033] 10.222.0.62 () {58 vars in 1242 bytes} [Mon Aug 29 15:36:49 2022] GET /compute/v2.1/os-quota-sets/2403f5ab84ed495695d470c7c22db464 => generated 371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:49.589473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-cea339f0-84bc-4f3f-853c-d22fbcc1d125 req-51d5966f-e579-45e8-b63e-325c0fd73fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af95f7c-5362-4cf9-b80e-38cd6a518783", "name": "network-vif-plugged", "status": "completed", "tag": "2984ebfd-8f23-4f8e-83af-0a164bd8c5aa"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:49.594873 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d822015e-4a36-4a80-ac5c-954e4987e7b7 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.270183 Aug 29 15:36:49.596260 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1503/3034] 10.222.0.62 () {60 vars in 1173 bytes} [Mon Aug 29 15:36:49 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:49.603238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8290191c-e6c9-41fa-8c3a-39360a3ff639 tempest-QuotasTestJSON-1613756016 tempest-QuotasTestJSON-1613756016-project] Calling method '.version_select at 0x7fc42b102dc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:49.630216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cea339f0-84bc-4f3f-853c-d22fbcc1d125 req-51d5966f-e579-45e8-b63e-325c0fd73fe2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:49.631141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cea339f0-84bc-4f3f-853c-d22fbcc1d125 req-51d5966f-e579-45e8-b63e-325c0fd73fe2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:49.631600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cea339f0-84bc-4f3f-853c-d22fbcc1d125 req-51d5966f-e579-45e8-b63e-325c0fd73fe2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:49.646101 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-cea339f0-84bc-4f3f-853c-d22fbcc1d125 req-51d5966f-e579-45e8-b63e-325c0fd73fe2 service nova] Creating event network-vif-plugged:2984ebfd-8f23-4f8e-83af-0a164bd8c5aa for instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 on n-h2-839401-11 Aug 29 15:36:49.651984 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-cea339f0-84bc-4f3f-853c-d22fbcc1d125 req-51d5966f-e579-45e8-b63e-325c0fd73fe2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077621 Aug 29 15:36:49.652831 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1532/3035] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:49.658372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e51511bf-b056-4b9b-ba1e-90bf41eb7c34 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:49.711843 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e51511bf-b056-4b9b-ba1e-90bf41eb7c34 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "DELETE /compute/v2.1/os-server-groups/28d6566a-cd38-4b5d-81f3-0b38b8f8b451" status: 204 len: 0 microversion: 2.1 time: 0.056679 Aug 29 15:36:49.713808 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1533/3036] 10.222.0.62 () {58 vars in 1266 bytes} [Mon Aug 29 15:36:49 2022] DELETE /compute/v2.1/os-server-groups/28d6566a-cd38-4b5d-81f3-0b38b8f8b451 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:36:49.717814 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8290191c-e6c9-41fa-8c3a-39360a3ff639 tempest-QuotasTestJSON-1613756016 tempest-QuotasTestJSON-1613756016-project] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/2403f5ab84ed495695d470c7c22db464?user_id=163a74b28b094665a1db7a0c23f388f5" status: 200 len: 371 microversion: 2.1 time: 0.119456 Aug 29 15:36:49.719140 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1504/3037] 10.222.0.62 () {58 vars in 1323 bytes} [Mon Aug 29 15:36:49 2022] GET /compute/v2.1/os-quota-sets/2403f5ab84ed495695d470c7c22db464?user_id=163a74b28b094665a1db7a0c23f388f5 => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:49.724788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-da1d1977-9156-4b65-94de-ba88d3fe9acb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:49.725654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-da1d1977-9156-4b65-94de-ba88d3fe9acb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:49.733192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da1d1977-9156-4b65-94de-ba88d3fe9acb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:49.734006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da1d1977-9156-4b65-94de-ba88d3fe9acb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:49.735346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da1d1977-9156-4b65-94de-ba88d3fe9acb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:49.736746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da1d1977-9156-4b65-94de-ba88d3fe9acb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:49.737736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da1d1977-9156-4b65-94de-ba88d3fe9acb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:49.738339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da1d1977-9156-4b65-94de-ba88d3fe9acb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:49.738568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1745861567", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "f1b63681-5595-428b-8a23-15bbfd2c0bdc"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:49.904398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] validate_networks() for [('f1b63681-5595-428b-8a23-15bbfd2c0bdc', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:36:50.036971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-da1d1977-9156-4b65-94de-ba88d3fe9acb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:50.055689 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-da1d1977-9156-4b65-94de-ba88d3fe9acb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1324 microversion: 2.1 time: 0.335181 Aug 29 15:36:50.060245 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1505/3038] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:49 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:50.075947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a1778151-9763-49b6-90b9-14e60eaef023 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:50.156446 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a1778151-9763-49b6-90b9-14e60eaef023 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.082634 Aug 29 15:36:50.167142 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1506/3039] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:36:50 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:50.184217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4608eb75-60da-44ac-b821-09e516ea4038 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:50.184858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4608eb75-60da-44ac-b821-09e516ea4038 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:50.209835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4608eb75-60da-44ac-b821-09e516ea4038 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:50.210350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4608eb75-60da-44ac-b821-09e516ea4038 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:50.210794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4608eb75-60da-44ac-b821-09e516ea4038 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:50.211521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4608eb75-60da-44ac-b821-09e516ea4038 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:50.212007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4608eb75-60da-44ac-b821-09e516ea4038 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:50.212432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4608eb75-60da-44ac-b821-09e516ea4038 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:50.763336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4608eb75-60da-44ac-b821-09e516ea4038 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:50.781347 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4608eb75-60da-44ac-b821-09e516ea4038 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1474 microversion: 2.1 time: 0.612780 Aug 29 15:36:50.783121 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1507/3040] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:50 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1474 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:50.797017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0056e681-11d9-46ed-a8c5-de257d528dca tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:50.872484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:50.886011 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0056e681-11d9-46ed-a8c5-de257d528dca tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "DELETE /compute/v2.1/os-server-groups/2d3341d4-d388-48b7-9991-a56a5a73c82e" status: 204 len: 0 microversion: 2.1 time: 0.101344 Aug 29 15:36:50.888786 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1508/3041] 10.222.0.62 () {58 vars in 1266 bytes} [Mon Aug 29 15:36:50 2022] DELETE /compute/v2.1/os-server-groups/2d3341d4-d388-48b7-9991-a56a5a73c82e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:36:50.904847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cfc9d861-8165-4ebb-b807-0c915125e822 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:50.908450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cfc9d861-8165-4ebb-b807-0c915125e822 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:50.931041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfc9d861-8165-4ebb-b807-0c915125e822 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:50.931649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfc9d861-8165-4ebb-b807-0c915125e822 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:50.932101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfc9d861-8165-4ebb-b807-0c915125e822 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:50.933012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfc9d861-8165-4ebb-b807-0c915125e822 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:50.936694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfc9d861-8165-4ebb-b807-0c915125e822 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:50.938726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfc9d861-8165-4ebb-b807-0c915125e822 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:51.324825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cfc9d861-8165-4ebb-b807-0c915125e822 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:51.336070 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cfc9d861-8165-4ebb-b807-0c915125e822 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1292 microversion: 2.1 time: 0.446078 Aug 29 15:36:51.355919 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1509/3042] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:50 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1292 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:51.367964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9c256e26-0823-4318-be52-e29ebb5436bf tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:51.397628 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9c256e26-0823-4318-be52-e29ebb5436bf tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.040261 Aug 29 15:36:51.399057 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1510/3043] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:36:51 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:51.410463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0ee198a0-5e21-44eb-84cc-5d3de5608854 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:51.411099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0ee198a0-5e21-44eb-84cc-5d3de5608854 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:51.425693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ee198a0-5e21-44eb-84cc-5d3de5608854 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:51.426192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ee198a0-5e21-44eb-84cc-5d3de5608854 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:51.426633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ee198a0-5e21-44eb-84cc-5d3de5608854 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:51.427347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ee198a0-5e21-44eb-84cc-5d3de5608854 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:51.427803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ee198a0-5e21-44eb-84cc-5d3de5608854 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:51.428228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ee198a0-5e21-44eb-84cc-5d3de5608854 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:52.072956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0ee198a0-5e21-44eb-84cc-5d3de5608854 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:52.086902 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0ee198a0-5e21-44eb-84cc-5d3de5608854 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1324 microversion: 2.1 time: 0.683291 Aug 29 15:36:52.087454 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1511/3044] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:51 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1324 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:52.099988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6f1804b8-38e0-4fc4-b77f-04bfc61e727c tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Action: 'create', calling method: .version_select at 0x7fc42b6c8b80>, body: {"server_group": {"name": "tempest-server-group-16454562", "policies": ["affinity"]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:52.155637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-6f1804b8-38e0-4fc4-b77f-04bfc61e727c tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:52.167081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-6f1804b8-38e0-4fc4-b77f-04bfc61e727c tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for user abb7582f47fd4fd78149bf92742e9659 and project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:52.264207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-6f1804b8-38e0-4fc4-b77f-04bfc61e727c tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:52.278917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:36:52.280041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:36:52.280696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:36:52.281326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:36:52.282014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:36:52.282663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-6f1804b8-38e0-4fc4-b77f-04bfc61e727c tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for user abb7582f47fd4fd78149bf92742e9659 and project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:52.289409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:52.301126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:52.302696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:52.303799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:52.304879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:52.305551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:52.306165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:52.331261 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6f1804b8-38e0-4fc4-b77f-04bfc61e727c tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.238477 Aug 29 15:36:52.331921 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1512/3045] 10.222.0.62 () {60 vars in 1173 bytes} [Mon Aug 29 15:36:52 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:52.338658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e310cfd-56ae-4eff-9120-4041a737f975 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:52.339234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Getting quotas for project e9bb92cd24774733bc0f5054a240cd28. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:52.347138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9e310cfd-56ae-4eff-9120-4041a737f975 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:52.348155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Getting quotas for user 0f9814ba6cea472c8759e8f3bf67c734 and project e9bb92cd24774733bc0f5054a240cd28. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:52.366697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e310cfd-56ae-4eff-9120-4041a737f975 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:52.367202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e310cfd-56ae-4eff-9120-4041a737f975 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:52.367622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e310cfd-56ae-4eff-9120-4041a737f975 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:52.373537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:36:52.377423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:36:52.378818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e310cfd-56ae-4eff-9120-4041a737f975 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:52.379384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e310cfd-56ae-4eff-9120-4041a737f975 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:52.379846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e310cfd-56ae-4eff-9120-4041a737f975 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:52.450514 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-52ceae94-0e48-41e0-851e-4cd6f5133416 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.735105 Aug 29 15:36:52.452144 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1534/3046] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:36:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:36:52.462706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ab0fe560-704a-46af-8f98-89c08a422d66 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:52.553356 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ab0fe560-704a-46af-8f98-89c08a422d66 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "DELETE /compute/v2.1/os-server-groups/c8345a6b-3ada-4eb4-903e-90c0cb3adda4" status: 204 len: 0 microversion: 2.1 time: 0.098566 Aug 29 15:36:52.554251 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1535/3047] 10.222.0.62 () {58 vars in 1266 bytes} [Mon Aug 29 15:36:52 2022] DELETE /compute/v2.1/os-server-groups/c8345a6b-3ada-4eb4-903e-90c0cb3adda4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:36:52.560837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a57b0047-65be-41fd-9242-30fa96d5306a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:52.562057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a57b0047-65be-41fd-9242-30fa96d5306a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:52.578316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a57b0047-65be-41fd-9242-30fa96d5306a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:52.579467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a57b0047-65be-41fd-9242-30fa96d5306a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:52.580330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a57b0047-65be-41fd-9242-30fa96d5306a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:52.581468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a57b0047-65be-41fd-9242-30fa96d5306a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:52.582124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a57b0047-65be-41fd-9242-30fa96d5306a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:52.582718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a57b0047-65be-41fd-9242-30fa96d5306a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:52.739490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a57b0047-65be-41fd-9242-30fa96d5306a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:52.753044 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a57b0047-65be-41fd-9242-30fa96d5306a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1298 microversion: 2.1 time: 0.197350 Aug 29 15:36:52.758075 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1536/3048] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:52 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1298 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:52.773816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a3187675-6586-40e7-9934-1283518612f1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:52.774750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a3187675-6586-40e7-9934-1283518612f1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:53.015692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9e310cfd-56ae-4eff-9120-4041a737f975 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:53.026663 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9e310cfd-56ae-4eff-9120-4041a737f975 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1471 microversion: 2.1 time: 0.693189 Aug 29 15:36:53.029879 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1513/3049] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:52 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1471 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:53.038277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a3187675-6586-40e7-9934-1283518612f1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:53.047106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4caa4c9a-9bf1-4be0-9441-9ebbb84a3154 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:53.051317 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a3187675-6586-40e7-9934-1283518612f1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1218 microversion: 2.1 time: 0.289910 Aug 29 15:36:53.051951 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1537/3050] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:52 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1218 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:53.062968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3ef62382-50e7-471b-b7f2-5d6093e14977 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:53.067658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3ef62382-50e7-471b-b7f2-5d6093e14977 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:53.082204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ef62382-50e7-471b-b7f2-5d6093e14977 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:53.082699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ef62382-50e7-471b-b7f2-5d6093e14977 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:53.088358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ef62382-50e7-471b-b7f2-5d6093e14977 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:53.089537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ef62382-50e7-471b-b7f2-5d6093e14977 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:53.089638 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4caa4c9a-9bf1-4be0-9441-9ebbb84a3154 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.057013 Aug 29 15:36:53.089733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ef62382-50e7-471b-b7f2-5d6093e14977 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:53.090067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ef62382-50e7-471b-b7f2-5d6093e14977 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:53.098591 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1514/3051] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:36:53 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:53.107818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4d253702-c1c2-4ffb-9b81-e602d2880066 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Action: 'create', calling method: .version_select at 0x7fc42b102d30>, body: {"server_group": {"name": "tempest-server-group-175051903", "policies": ["anti-affinity"]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:53.180046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-4d253702-c1c2-4ffb-9b81-e602d2880066 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:53.198293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-4d253702-c1c2-4ffb-9b81-e602d2880066 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for user abb7582f47fd4fd78149bf92742e9659 and project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:53.344689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-4d253702-c1c2-4ffb-9b81-e602d2880066 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:53.367550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-4d253702-c1c2-4ffb-9b81-e602d2880066 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for user abb7582f47fd4fd78149bf92742e9659 and project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:53.436847 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4d253702-c1c2-4ffb-9b81-e602d2880066 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.333877 Aug 29 15:36:53.438192 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1515/3052] 10.222.0.62 () {60 vars in 1173 bytes} [Mon Aug 29 15:36:53 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:36:53.450672 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3ef62382-50e7-471b-b7f2-5d6093e14977 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "POST /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43/action" status: 202 len: 0 microversion: 2.1 time: 0.395636 Aug 29 15:36:53.452890 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1538/3053] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:36:53 2022] POST /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:36:53.456498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7e8dc183-21ae-4ae0-b736-54482e942245 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:53.467803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7e8dc183-21ae-4ae0-b736-54482e942245 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:53.482433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-15e8180b-a54a-44d7-a343-4cada78527d2 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:53.497795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e8dc183-21ae-4ae0-b736-54482e942245 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:53.502145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e8dc183-21ae-4ae0-b736-54482e942245 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:53.505333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e8dc183-21ae-4ae0-b736-54482e942245 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:53.506561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e8dc183-21ae-4ae0-b736-54482e942245 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:53.509064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e8dc183-21ae-4ae0-b736-54482e942245 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:53.510979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e8dc183-21ae-4ae0-b736-54482e942245 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:53.557813 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-15e8180b-a54a-44d7-a343-4cada78527d2 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "DELETE /compute/v2.1/os-server-groups/c75e4225-8bce-4e7a-acdc-c37bb0f0a860" status: 204 len: 0 microversion: 2.1 time: 0.102705 Aug 29 15:36:53.558935 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1539/3054] 10.222.0.62 () {58 vars in 1266 bytes} [Mon Aug 29 15:36:53 2022] DELETE /compute/v2.1/os-server-groups/c75e4225-8bce-4e7a-acdc-c37bb0f0a860 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:36:53.585463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-58dc38dd-cbf1-4943-b6b2-58ddbfc6a5ac tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:53.592907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-58dc38dd-cbf1-4943-b6b2-58ddbfc6a5ac tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:53.614495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58dc38dd-cbf1-4943-b6b2-58ddbfc6a5ac tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:53.615202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58dc38dd-cbf1-4943-b6b2-58ddbfc6a5ac tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:53.615808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58dc38dd-cbf1-4943-b6b2-58ddbfc6a5ac tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:53.616801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58dc38dd-cbf1-4943-b6b2-58ddbfc6a5ac tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:53.618908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58dc38dd-cbf1-4943-b6b2-58ddbfc6a5ac tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:53.620850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58dc38dd-cbf1-4943-b6b2-58ddbfc6a5ac tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:54.672778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7e8dc183-21ae-4ae0-b736-54482e942245 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:54.715633 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7e8dc183-21ae-4ae0-b736-54482e942245 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1324 microversion: 2.1 time: 1.276501 Aug 29 15:36:54.730203 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1516/3055] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:53 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1324 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:54.745904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e8936b2b-f546-462a-a928-0f1ef2ae9269 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:54.778348 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e8936b2b-f546-462a-a928-0f1ef2ae9269 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.044945 Aug 29 15:36:54.780705 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1517/3056] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:36:54 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:54.793371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-40f5d43d-0eef-43c3-896f-db47f172fa6d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:54.797449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-40f5d43d-0eef-43c3-896f-db47f172fa6d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:54.817030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40f5d43d-0eef-43c3-896f-db47f172fa6d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:54.820687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40f5d43d-0eef-43c3-896f-db47f172fa6d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:54.822053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40f5d43d-0eef-43c3-896f-db47f172fa6d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:54.823511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40f5d43d-0eef-43c3-896f-db47f172fa6d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:54.824202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40f5d43d-0eef-43c3-896f-db47f172fa6d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:54.824870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40f5d43d-0eef-43c3-896f-db47f172fa6d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:55.434926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-40f5d43d-0eef-43c3-896f-db47f172fa6d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:55.464101 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-40f5d43d-0eef-43c3-896f-db47f172fa6d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1365 microversion: 2.1 time: 0.681441 Aug 29 15:36:55.471944 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1518/3057] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:54 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1365 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:55.489171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-35882f59-a505-41e2-bed1-f23a80869b0b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:55.493387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-35882f59-a505-41e2-bed1-f23a80869b0b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:55.511681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35882f59-a505-41e2-bed1-f23a80869b0b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:55.512571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35882f59-a505-41e2-bed1-f23a80869b0b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:55.514040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35882f59-a505-41e2-bed1-f23a80869b0b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:55.515746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35882f59-a505-41e2-bed1-f23a80869b0b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:55.516884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35882f59-a505-41e2-bed1-f23a80869b0b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:55.518574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35882f59-a505-41e2-bed1-f23a80869b0b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:55.865786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-35882f59-a505-41e2-bed1-f23a80869b0b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:55.882354 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-35882f59-a505-41e2-bed1-f23a80869b0b tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1270 microversion: 2.1 time: 0.408099 Aug 29 15:36:55.882973 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1519/3058] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:55 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1270 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:55.900092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-58dc38dd-cbf1-4943-b6b2-58ddbfc6a5ac tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:55.914882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-324ec12a-4162-44a6-bfe2-4173fa7ced24 req-f917457a-3d54-4bb3-b9a4-7a53d4648167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923c4a5b-679a-41e3-9d6b-f7bbcc603db3", "name": "network-vif-deleted", "tag": "cc2e791e-3b26-47d3-98e5-ffbbe4d0c8e7"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:55.926275 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-58dc38dd-cbf1-4943-b6b2-58ddbfc6a5ac tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1470 microversion: 2.1 time: 2.354728 Aug 29 15:36:55.945173 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1540/3059] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:53 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1470 bytes in 2379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:55.976553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-324ec12a-4162-44a6-bfe2-4173fa7ced24 req-f917457a-3d54-4bb3-b9a4-7a53d4648167 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:55.977118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-324ec12a-4162-44a6-bfe2-4173fa7ced24 req-f917457a-3d54-4bb3-b9a4-7a53d4648167 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:55.977856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1157314355", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "f69b4d96-1ded-49d3-aa89-4967736b8b18"}]}, "os:scheduler_hints": {"group": "049cc90a-d189-4922-8757-c2c9c2820458"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:55.980944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-324ec12a-4162-44a6-bfe2-4173fa7ced24 req-f917457a-3d54-4bb3-b9a4-7a53d4648167 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:56.030358 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-324ec12a-4162-44a6-bfe2-4173fa7ced24 req-f917457a-3d54-4bb3-b9a4-7a53d4648167 service nova] Creating event network-vif-deleted:cc2e791e-3b26-47d3-98e5-ffbbe4d0c8e7 for instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 on n-h2-839401-11 Aug 29 15:36:56.056428 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-324ec12a-4162-44a6-bfe2-4173fa7ced24 req-f917457a-3d54-4bb3-b9a4-7a53d4648167 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150832 Aug 29 15:36:56.057892 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1520/3060] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:56.072489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-89a45d99-5e4a-4326-8cf5-d66e822cd542 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:56.073556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-89a45d99-5e4a-4326-8cf5-d66e822cd542 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:56.090528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89a45d99-5e4a-4326-8cf5-d66e822cd542 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:56.091316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89a45d99-5e4a-4326-8cf5-d66e822cd542 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:56.093270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89a45d99-5e4a-4326-8cf5-d66e822cd542 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:56.095121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89a45d99-5e4a-4326-8cf5-d66e822cd542 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:56.096748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89a45d99-5e4a-4326-8cf5-d66e822cd542 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:56.097461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89a45d99-5e4a-4326-8cf5-d66e822cd542 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:56.110503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] validate_networks() for [('f69b4d96-1ded-49d3-aa89-4967736b8b18', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:36:56.441571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-89a45d99-5e4a-4326-8cf5-d66e822cd542 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:56.451110 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-89a45d99-5e4a-4326-8cf5-d66e822cd542 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1324 microversion: 2.1 time: 0.391662 Aug 29 15:36:56.454782 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1521/3061] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:56 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:56.498125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-38ee0222-b2df-4acd-b365-986b4730a9b8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:56.498909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-38ee0222-b2df-4acd-b365-986b4730a9b8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:56.510665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ee0222-b2df-4acd-b365-986b4730a9b8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:56.512772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ee0222-b2df-4acd-b365-986b4730a9b8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:56.515746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ee0222-b2df-4acd-b365-986b4730a9b8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:56.517358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ee0222-b2df-4acd-b365-986b4730a9b8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:56.518043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ee0222-b2df-4acd-b365-986b4730a9b8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:56.518628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ee0222-b2df-4acd-b365-986b4730a9b8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:56.817587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-38ee0222-b2df-4acd-b365-986b4730a9b8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:56.839303 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-38ee0222-b2df-4acd-b365-986b4730a9b8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1365 microversion: 2.1 time: 0.347771 Aug 29 15:36:56.839913 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1522/3062] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:56 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:56.904609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-714d3c32-c0a0-437e-be21-bb5ebd7f1425 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:56.906790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-714d3c32-c0a0-437e-be21-bb5ebd7f1425 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:56.926712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-714d3c32-c0a0-437e-be21-bb5ebd7f1425 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:56.928007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-714d3c32-c0a0-437e-be21-bb5ebd7f1425 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:56.928815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-714d3c32-c0a0-437e-be21-bb5ebd7f1425 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:56.929819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-714d3c32-c0a0-437e-be21-bb5ebd7f1425 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:56.930464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-714d3c32-c0a0-437e-be21-bb5ebd7f1425 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:56.931049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-714d3c32-c0a0-437e-be21-bb5ebd7f1425 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:57.052719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-714d3c32-c0a0-437e-be21-bb5ebd7f1425 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:57.061800 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-714d3c32-c0a0-437e-be21-bb5ebd7f1425 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1276 microversion: 2.1 time: 0.162150 Aug 29 15:36:57.066097 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1523/3063] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:56 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:57.083263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6951b1c7-6d57-4e33-8c91-5b9041c505bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:57.088038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6951b1c7-6d57-4e33-8c91-5b9041c505bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:57.105503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6951b1c7-6d57-4e33-8c91-5b9041c505bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:57.106571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6951b1c7-6d57-4e33-8c91-5b9041c505bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:57.107069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6951b1c7-6d57-4e33-8c91-5b9041c505bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:57.107830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6951b1c7-6d57-4e33-8c91-5b9041c505bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:57.108290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6951b1c7-6d57-4e33-8c91-5b9041c505bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:57.109344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6951b1c7-6d57-4e33-8c91-5b9041c505bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:57.410051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6951b1c7-6d57-4e33-8c91-5b9041c505bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:57.442196 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6951b1c7-6d57-4e33-8c91-5b9041c505bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1470 microversion: 2.1 time: 0.366164 Aug 29 15:36:57.442885 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1524/3064] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:57 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1470 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:57.459367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-885b8b91-abe3-4e7d-bcc4-f3b2a3a9fdfa req-d97487ef-c278-4e0d-8229-df5ee7e81372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0330d585-be01-45a3-b20a-9ce9cdfbaa43", "name": "network-vif-plugged", "status": "completed", "tag": "53083e31-a61d-4467-9153-eb9ce7344ee5"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:36:57.487586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-885b8b91-abe3-4e7d-bcc4-f3b2a3a9fdfa req-d97487ef-c278-4e0d-8229-df5ee7e81372 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:57.488088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-885b8b91-abe3-4e7d-bcc4-f3b2a3a9fdfa req-d97487ef-c278-4e0d-8229-df5ee7e81372 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:57.488520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-885b8b91-abe3-4e7d-bcc4-f3b2a3a9fdfa req-d97487ef-c278-4e0d-8229-df5ee7e81372 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:57.535135 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-885b8b91-abe3-4e7d-bcc4-f3b2a3a9fdfa req-d97487ef-c278-4e0d-8229-df5ee7e81372 service nova] Creating event network-vif-plugged:53083e31-a61d-4467-9153-eb9ce7344ee5 for instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 on n-h1-839401-11 Aug 29 15:36:57.550152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-885b8b91-abe3-4e7d-bcc4-f3b2a3a9fdfa req-d97487ef-c278-4e0d-8229-df5ee7e81372 service nova] Instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:36:57.564878 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-885b8b91-abe3-4e7d-bcc4-f3b2a3a9fdfa req-d97487ef-c278-4e0d-8229-df5ee7e81372 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120340 Aug 29 15:36:57.566304 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1525/3065] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:57.575475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3a3e468a-71cd-4393-9c22-32c881d6e4e9 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:57.576933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3a3e468a-71cd-4393-9c22-32c881d6e4e9 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:57.588772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a3e468a-71cd-4393-9c22-32c881d6e4e9 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:57.590265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a3e468a-71cd-4393-9c22-32c881d6e4e9 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:57.591183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a3e468a-71cd-4393-9c22-32c881d6e4e9 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:57.592193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a3e468a-71cd-4393-9c22-32c881d6e4e9 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:57.592807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a3e468a-71cd-4393-9c22-32c881d6e4e9 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:57.593574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a3e468a-71cd-4393-9c22-32c881d6e4e9 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:57.908892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3a3e468a-71cd-4393-9c22-32c881d6e4e9 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:57.922398 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3a3e468a-71cd-4393-9c22-32c881d6e4e9 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1324 microversion: 2.1 time: 0.354375 Aug 29 15:36:57.923595 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1526/3066] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:57 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1324 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:57.938008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fc25a993-5978-446e-b43c-d80d35ddfb23 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:57.940274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fc25a993-5978-446e-b43c-d80d35ddfb23 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:57.952358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc25a993-5978-446e-b43c-d80d35ddfb23 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:57.952888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc25a993-5978-446e-b43c-d80d35ddfb23 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:57.953365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc25a993-5978-446e-b43c-d80d35ddfb23 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:57.954080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc25a993-5978-446e-b43c-d80d35ddfb23 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:57.954538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc25a993-5978-446e-b43c-d80d35ddfb23 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:57.954970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc25a993-5978-446e-b43c-d80d35ddfb23 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:58.042391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:36:58.042968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:36:58.043274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:36:58.043984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:36:58.044693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:36:58.093695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:58.094106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:58.094558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:58.095290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:58.095756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:58.111596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:58.211430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:58.238661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for user abb7582f47fd4fd78149bf92742e9659 and project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:58.280752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:36:58.290869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:36:58.366889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122360) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 29 15:36:58.408849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_group_members'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:58.420662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for user abb7582f47fd4fd78149bf92742e9659 and project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_group_members'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:58.548405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_group_members'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:36:58.575378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Getting quotas for user abb7582f47fd4fd78149bf92742e9659 and project cbb55ec892b64ac9ab5085a7c37c1ee0. Resources: {'server_group_members'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:36:58.672594 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9953a2b6-0d61-4a7f-b56b-7bc76d1a4fe9 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.722229 Aug 29 15:36:58.677426 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1541/3067] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:36:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:36:58.686087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d8285136-c778-4135-9179-ccd6b98adf21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:58.689589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d8285136-c778-4135-9179-ccd6b98adf21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:58.713323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8285136-c778-4135-9179-ccd6b98adf21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:58.713824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8285136-c778-4135-9179-ccd6b98adf21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:58.716793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8285136-c778-4135-9179-ccd6b98adf21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:58.717756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8285136-c778-4135-9179-ccd6b98adf21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:58.718449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8285136-c778-4135-9179-ccd6b98adf21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:58.721540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8285136-c778-4135-9179-ccd6b98adf21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:58.843719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d8285136-c778-4135-9179-ccd6b98adf21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:58.857633 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d8285136-c778-4135-9179-ccd6b98adf21 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1276 microversion: 2.1 time: 0.178971 Aug 29 15:36:58.871792 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1542/3068] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:58 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1276 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:58.882194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-17f665b7-e008-463d-a34e-920b04423e09 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:58.883070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-17f665b7-e008-463d-a34e-920b04423e09 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:58.889395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17f665b7-e008-463d-a34e-920b04423e09 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:58.890159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17f665b7-e008-463d-a34e-920b04423e09 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:58.890765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17f665b7-e008-463d-a34e-920b04423e09 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:58.892123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17f665b7-e008-463d-a34e-920b04423e09 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:58.892767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17f665b7-e008-463d-a34e-920b04423e09 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:58.893379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17f665b7-e008-463d-a34e-920b04423e09 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:59.634251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-17f665b7-e008-463d-a34e-920b04423e09 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:59.654158 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-17f665b7-e008-463d-a34e-920b04423e09 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1470 microversion: 2.1 time: 0.780702 Aug 29 15:36:59.654780 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1543/3069] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:58 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1470 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:59.670799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-55a816a7-d410-410c-baf0-9471727d7586 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:59.685950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-55a816a7-d410-410c-baf0-9471727d7586 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:59.890174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fc25a993-5978-446e-b43c-d80d35ddfb23 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:59.894582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:59.915281 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fc25a993-5978-446e-b43c-d80d35ddfb23 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1365 microversion: 2.1 time: 1.982983 Aug 29 15:36:59.917255 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1527/3070] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:57 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1365 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:36:59.935550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c43e91d8-4108-41e7-99ae-39efb79da6d2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:59.940719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-55a816a7-d410-410c-baf0-9471727d7586 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:36:59.941977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c43e91d8-4108-41e7-99ae-39efb79da6d2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:36:59.970396 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-55a816a7-d410-410c-baf0-9471727d7586 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1213 microversion: 2.1 time: 0.311805 Aug 29 15:36:59.977469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c43e91d8-4108-41e7-99ae-39efb79da6d2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:59.978709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c43e91d8-4108-41e7-99ae-39efb79da6d2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:59.982075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c43e91d8-4108-41e7-99ae-39efb79da6d2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:59.983137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c43e91d8-4108-41e7-99ae-39efb79da6d2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:59.984172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c43e91d8-4108-41e7-99ae-39efb79da6d2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:59.986716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c43e91d8-4108-41e7-99ae-39efb79da6d2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:00.006209 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1544/3071] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:59 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1213 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:00.032008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-130a2ab6-7821-4234-ad4a-a7ea9988ebbe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:00.034161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-130a2ab6-7821-4234-ad4a-a7ea9988ebbe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:00.069703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-130a2ab6-7821-4234-ad4a-a7ea9988ebbe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:00.070486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-130a2ab6-7821-4234-ad4a-a7ea9988ebbe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:00.072171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-130a2ab6-7821-4234-ad4a-a7ea9988ebbe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:00.073058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-130a2ab6-7821-4234-ad4a-a7ea9988ebbe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:00.074915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-130a2ab6-7821-4234-ad4a-a7ea9988ebbe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:00.075641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-130a2ab6-7821-4234-ad4a-a7ea9988ebbe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:00.225488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-130a2ab6-7821-4234-ad4a-a7ea9988ebbe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:00.238176 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-130a2ab6-7821-4234-ad4a-a7ea9988ebbe tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1276 microversion: 2.1 time: 0.230072 Aug 29 15:37:00.249851 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1545/3072] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:00 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1276 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:00.365853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-86eeaf09-ff12-441b-8b04-ba0b05226d72 req-47f7a4ac-b88e-4a90-a965-4ee53d58ac77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401ad5c3-264d-437d-a249-035450439c18", "tag": "bf81ac2f-eb0e-454d-982c-455aa2f19213"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:00.385434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-86eeaf09-ff12-441b-8b04-ba0b05226d72 req-47f7a4ac-b88e-4a90-a965-4ee53d58ac77 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:00.396811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-86eeaf09-ff12-441b-8b04-ba0b05226d72 req-47f7a4ac-b88e-4a90-a965-4ee53d58ac77 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:00.401130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-86eeaf09-ff12-441b-8b04-ba0b05226d72 req-47f7a4ac-b88e-4a90-a965-4ee53d58ac77 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:00.429411 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-86eeaf09-ff12-441b-8b04-ba0b05226d72 req-47f7a4ac-b88e-4a90-a965-4ee53d58ac77 service nova] Creating event network-changed:bf81ac2f-eb0e-454d-982c-455aa2f19213 for instance 401ad5c3-264d-437d-a249-035450439c18 on n-h1-839401-11 Aug 29 15:37:00.469275 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-86eeaf09-ff12-441b-8b04-ba0b05226d72 req-47f7a4ac-b88e-4a90-a965-4ee53d58ac77 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103338 Aug 29 15:37:00.471895 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1546/3073] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:37:00.680830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0bfc313d-597b-46b4-94cb-07cc162d088b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:00.681727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0bfc313d-597b-46b4-94cb-07cc162d088b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:00.693599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:00.717293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bfc313d-597b-46b4-94cb-07cc162d088b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:00.719694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bfc313d-597b-46b4-94cb-07cc162d088b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:00.726190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c43e91d8-4108-41e7-99ae-39efb79da6d2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:00.738466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bfc313d-597b-46b4-94cb-07cc162d088b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:00.739307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bfc313d-597b-46b4-94cb-07cc162d088b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:00.739805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bfc313d-597b-46b4-94cb-07cc162d088b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:00.740247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bfc313d-597b-46b4-94cb-07cc162d088b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:00.754678 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c43e91d8-4108-41e7-99ae-39efb79da6d2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1324 microversion: 2.1 time: 0.831511 Aug 29 15:37:00.757946 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1528/3074] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:36:59 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1324 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:00.947784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5999aba0-da4e-410d-8e7f-1b3b41eeaf15 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:00.948402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5999aba0-da4e-410d-8e7f-1b3b41eeaf15 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:00.957646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5999aba0-da4e-410d-8e7f-1b3b41eeaf15 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:00.958316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5999aba0-da4e-410d-8e7f-1b3b41eeaf15 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:00.959068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5999aba0-da4e-410d-8e7f-1b3b41eeaf15 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:00.959893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5999aba0-da4e-410d-8e7f-1b3b41eeaf15 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:00.960466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5999aba0-da4e-410d-8e7f-1b3b41eeaf15 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:00.961350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5999aba0-da4e-410d-8e7f-1b3b41eeaf15 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:01.059556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0bfc313d-597b-46b4-94cb-07cc162d088b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:01.071587 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0bfc313d-597b-46b4-94cb-07cc162d088b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1470 microversion: 2.1 time: 0.396804 Aug 29 15:37:01.075027 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1547/3075] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:00 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1470 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:01.082621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d38f0f1a-49a8-4f0b-905a-75dd664d1734 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:01.083565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d38f0f1a-49a8-4f0b-905a-75dd664d1734 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:01.109573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d38f0f1a-49a8-4f0b-905a-75dd664d1734 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:01.110476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d38f0f1a-49a8-4f0b-905a-75dd664d1734 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:01.111096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d38f0f1a-49a8-4f0b-905a-75dd664d1734 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:01.112146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d38f0f1a-49a8-4f0b-905a-75dd664d1734 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:01.112774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d38f0f1a-49a8-4f0b-905a-75dd664d1734 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:01.113385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d38f0f1a-49a8-4f0b-905a-75dd664d1734 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:01.313617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d38f0f1a-49a8-4f0b-905a-75dd664d1734 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:01.326337 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d38f0f1a-49a8-4f0b-905a-75dd664d1734 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1265 microversion: 2.1 time: 0.249926 Aug 29 15:37:01.326935 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1548/3076] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:01 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:01.360702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6f2cffcb-11e6-4d91-84ab-4fe96fd85b72 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:01.361781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6f2cffcb-11e6-4d91-84ab-4fe96fd85b72 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:01.367580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5999aba0-da4e-410d-8e7f-1b3b41eeaf15 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:01.382992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f2cffcb-11e6-4d91-84ab-4fe96fd85b72 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:01.383700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f2cffcb-11e6-4d91-84ab-4fe96fd85b72 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:01.391627 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5999aba0-da4e-410d-8e7f-1b3b41eeaf15 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1365 microversion: 2.1 time: 0.447476 Aug 29 15:37:01.394904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f2cffcb-11e6-4d91-84ab-4fe96fd85b72 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:01.395799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f2cffcb-11e6-4d91-84ab-4fe96fd85b72 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:01.396314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f2cffcb-11e6-4d91-84ab-4fe96fd85b72 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:01.396762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f2cffcb-11e6-4d91-84ab-4fe96fd85b72 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:01.401554 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1529/3077] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:00 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1365 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:01.567175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6f2cffcb-11e6-4d91-84ab-4fe96fd85b72 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:01.580293 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6f2cffcb-11e6-4d91-84ab-4fe96fd85b72 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1276 microversion: 2.1 time: 0.244075 Aug 29 15:37:01.581193 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1549/3078] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:01 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1276 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:01.643069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-32dfcdc4-dab7-4aad-99d8-1a9c11a15a18 req-02a7be65-6c9e-46d7-82ee-630e7b62fd91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b6cfb1a-bfac-45e1-9b33-2e080c11f838", "name": "network-vif-plugged", "status": "completed", "tag": "2e7d7a73-65af-4b13-a5be-e623d343d65d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:01.665860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-32dfcdc4-dab7-4aad-99d8-1a9c11a15a18 req-02a7be65-6c9e-46d7-82ee-630e7b62fd91 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:01.666643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-32dfcdc4-dab7-4aad-99d8-1a9c11a15a18 req-02a7be65-6c9e-46d7-82ee-630e7b62fd91 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:01.668152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-32dfcdc4-dab7-4aad-99d8-1a9c11a15a18 req-02a7be65-6c9e-46d7-82ee-630e7b62fd91 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:01.697791 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-32dfcdc4-dab7-4aad-99d8-1a9c11a15a18 req-02a7be65-6c9e-46d7-82ee-630e7b62fd91 service nova] Creating event network-vif-plugged:2e7d7a73-65af-4b13-a5be-e623d343d65d for instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 on n-h1-839401-11 Aug 29 15:37:01.711059 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-32dfcdc4-dab7-4aad-99d8-1a9c11a15a18 req-02a7be65-6c9e-46d7-82ee-630e7b62fd91 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072214 Aug 29 15:37:01.712236 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1530/3079] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:01.779077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7fbb5b20-da0c-4640-88e2-e236a24a65cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:01.779680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7fbb5b20-da0c-4640-88e2-e236a24a65cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:01.788144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fbb5b20-da0c-4640-88e2-e236a24a65cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:01.795908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fbb5b20-da0c-4640-88e2-e236a24a65cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:01.797308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fbb5b20-da0c-4640-88e2-e236a24a65cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:01.800883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fbb5b20-da0c-4640-88e2-e236a24a65cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:01.801402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fbb5b20-da0c-4640-88e2-e236a24a65cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:01.801849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fbb5b20-da0c-4640-88e2-e236a24a65cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:02.104645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4e6ef499-9d91-46ab-aa82-09d209f168f9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:02.105628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4e6ef499-9d91-46ab-aa82-09d209f168f9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:02.126422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e6ef499-9d91-46ab-aa82-09d209f168f9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:02.127163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e6ef499-9d91-46ab-aa82-09d209f168f9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:02.128161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e6ef499-9d91-46ab-aa82-09d209f168f9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:02.129076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e6ef499-9d91-46ab-aa82-09d209f168f9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:02.129752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e6ef499-9d91-46ab-aa82-09d209f168f9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:02.130393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e6ef499-9d91-46ab-aa82-09d209f168f9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:02.205389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7fbb5b20-da0c-4640-88e2-e236a24a65cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:02.219327 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7fbb5b20-da0c-4640-88e2-e236a24a65cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1324 microversion: 2.1 time: 0.442703 Aug 29 15:37:02.221725 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1550/3080] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:01 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1324 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:02.352250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5149e28c-ca25-46e6-af06-4a7ac579a0bc tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:02.353055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5149e28c-ca25-46e6-af06-4a7ac579a0bc tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:02.362314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5149e28c-ca25-46e6-af06-4a7ac579a0bc tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:02.367628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5149e28c-ca25-46e6-af06-4a7ac579a0bc tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:02.369591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5149e28c-ca25-46e6-af06-4a7ac579a0bc tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:02.383266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5149e28c-ca25-46e6-af06-4a7ac579a0bc tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:02.386185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5149e28c-ca25-46e6-af06-4a7ac579a0bc tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:02.386815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5149e28c-ca25-46e6-af06-4a7ac579a0bc tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:02.863057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5149e28c-ca25-46e6-af06-4a7ac579a0bc tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:02.878462 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5149e28c-ca25-46e6-af06-4a7ac579a0bc tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1271 microversion: 2.1 time: 0.531685 Aug 29 15:37:02.881394 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1551/3081] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:02 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1271 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:02.889816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b515e7c4-4b1c-4919-850b-167867b12478 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:02.891201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b515e7c4-4b1c-4919-850b-167867b12478 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:02.900744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b515e7c4-4b1c-4919-850b-167867b12478 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:02.901597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b515e7c4-4b1c-4919-850b-167867b12478 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:02.902823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b515e7c4-4b1c-4919-850b-167867b12478 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:02.903676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b515e7c4-4b1c-4919-850b-167867b12478 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:02.904748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b515e7c4-4b1c-4919-850b-167867b12478 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:02.905533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b515e7c4-4b1c-4919-850b-167867b12478 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:02.927973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4e6ef499-9d91-46ab-aa82-09d209f168f9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:02.935965 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4e6ef499-9d91-46ab-aa82-09d209f168f9 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1470 microversion: 2.1 time: 0.835765 Aug 29 15:37:02.965277 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1531/3082] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:02 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1470 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:02.974020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6a6940e1-0f1b-4502-8465-35a5937588cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:02.974904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6a6940e1-0f1b-4502-8465-35a5937588cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:02.981398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a6940e1-0f1b-4502-8465-35a5937588cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:02.982112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a6940e1-0f1b-4502-8465-35a5937588cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:02.982728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a6940e1-0f1b-4502-8465-35a5937588cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:02.983592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a6940e1-0f1b-4502-8465-35a5937588cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:02.984260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a6940e1-0f1b-4502-8465-35a5937588cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:02.984841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a6940e1-0f1b-4502-8465-35a5937588cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:03.214854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b515e7c4-4b1c-4919-850b-167867b12478 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:03.224751 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b515e7c4-4b1c-4919-850b-167867b12478 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1365 microversion: 2.1 time: 0.341857 Aug 29 15:37:03.225392 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1552/3083] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:02 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:03.245076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24dc52b9-cda7-46c3-96a8-ee65cf847f46 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:03.245971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-24dc52b9-cda7-46c3-96a8-ee65cf847f46 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:03.257637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24dc52b9-cda7-46c3-96a8-ee65cf847f46 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:03.259474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24dc52b9-cda7-46c3-96a8-ee65cf847f46 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:03.260273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24dc52b9-cda7-46c3-96a8-ee65cf847f46 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:03.261532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24dc52b9-cda7-46c3-96a8-ee65cf847f46 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:03.262148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24dc52b9-cda7-46c3-96a8-ee65cf847f46 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:03.262734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24dc52b9-cda7-46c3-96a8-ee65cf847f46 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:03.398456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=36 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:03.474250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6a6940e1-0f1b-4502-8465-35a5937588cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:03.496349 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6a6940e1-0f1b-4502-8465-35a5937588cd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1318 microversion: 2.1 time: 0.522664 Aug 29 15:37:03.502825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-24dc52b9-cda7-46c3-96a8-ee65cf847f46 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:03.510434 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1532/3084] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:02 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:03.529275 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-24dc52b9-cda7-46c3-96a8-ee65cf847f46 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1324 microversion: 2.1 time: 0.289506 Aug 29 15:37:03.529980 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1553/3085] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:03 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1324 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:03.900450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-322f8bb6-94c0-4a8b-8be1-3737bce8cac4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:03.901305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-322f8bb6-94c0-4a8b-8be1-3737bce8cac4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:03.909594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=95,nova_api:INSERT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:03.915644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-322f8bb6-94c0-4a8b-8be1-3737bce8cac4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:03.916890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-322f8bb6-94c0-4a8b-8be1-3737bce8cac4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:03.926307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-322f8bb6-94c0-4a8b-8be1-3737bce8cac4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:03.927680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-322f8bb6-94c0-4a8b-8be1-3737bce8cac4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:03.928307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-322f8bb6-94c0-4a8b-8be1-3737bce8cac4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:03.928829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-322f8bb6-94c0-4a8b-8be1-3737bce8cac4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:03.974766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d9f26497-34f2-4a57-9b85-bb7d0de7ced8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:03.975479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d9f26497-34f2-4a57-9b85-bb7d0de7ced8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:03.994615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9f26497-34f2-4a57-9b85-bb7d0de7ced8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:03.995666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9f26497-34f2-4a57-9b85-bb7d0de7ced8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:03.996302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9f26497-34f2-4a57-9b85-bb7d0de7ced8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:03.997443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9f26497-34f2-4a57-9b85-bb7d0de7ced8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:03.998253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9f26497-34f2-4a57-9b85-bb7d0de7ced8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:03.998854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9f26497-34f2-4a57-9b85-bb7d0de7ced8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.026035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:04.150978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-322f8bb6-94c0-4a8b-8be1-3737bce8cac4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:04.167017 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-322f8bb6-94c0-4a8b-8be1-3737bce8cac4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1271 microversion: 2.1 time: 0.271935 Aug 29 15:37:04.167662 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1533/3086] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:03 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:04.252123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b3490424-7bcc-4f0b-b9e4-538fa1202f41 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:04.253234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b3490424-7bcc-4f0b-b9e4-538fa1202f41 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:04.267258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3490424-7bcc-4f0b-b9e4-538fa1202f41 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:04.268099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3490424-7bcc-4f0b-b9e4-538fa1202f41 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:04.268535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3490424-7bcc-4f0b-b9e4-538fa1202f41 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.269275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3490424-7bcc-4f0b-b9e4-538fa1202f41 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:04.269730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3490424-7bcc-4f0b-b9e4-538fa1202f41 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:04.270152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3490424-7bcc-4f0b-b9e4-538fa1202f41 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.282454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d9f26497-34f2-4a57-9b85-bb7d0de7ced8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:04.299355 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d9f26497-34f2-4a57-9b85-bb7d0de7ced8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1470 microversion: 2.1 time: 0.327439 Aug 29 15:37:04.300265 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1554/3087] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:03 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1470 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:04.531585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0bc5b4de-8c08-4a9b-b6fe-b5312f058582 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:04.533035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0bc5b4de-8c08-4a9b-b6fe-b5312f058582 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:04.544952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bc5b4de-8c08-4a9b-b6fe-b5312f058582 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:04.555299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bc5b4de-8c08-4a9b-b6fe-b5312f058582 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:04.556241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bc5b4de-8c08-4a9b-b6fe-b5312f058582 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.558229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bc5b4de-8c08-4a9b-b6fe-b5312f058582 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:04.558976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bc5b4de-8c08-4a9b-b6fe-b5312f058582 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:04.559812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bc5b4de-8c08-4a9b-b6fe-b5312f058582 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.651142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b3490424-7bcc-4f0b-b9e4-538fa1202f41 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:04.660041 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b3490424-7bcc-4f0b-b9e4-538fa1202f41 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1365 microversion: 2.1 time: 0.412083 Aug 29 15:37:04.669886 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1534/3088] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:04 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1365 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:04.684110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f083b28b-9635-4643-912b-eef628374c58 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:04.684740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f083b28b-9635-4643-912b-eef628374c58 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:04.714323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f083b28b-9635-4643-912b-eef628374c58 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:04.714846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f083b28b-9635-4643-912b-eef628374c58 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:04.715291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f083b28b-9635-4643-912b-eef628374c58 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.716310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f083b28b-9635-4643-912b-eef628374c58 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:04.716489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f083b28b-9635-4643-912b-eef628374c58 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:04.731163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f083b28b-9635-4643-912b-eef628374c58 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:05.016295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0bc5b4de-8c08-4a9b-b6fe-b5312f058582 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:05.025811 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0bc5b4de-8c08-4a9b-b6fe-b5312f058582 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1318 microversion: 2.1 time: 0.498644 Aug 29 15:37:05.027746 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1555/3089] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:04 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:05.066871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-7a576607-d3f8-445a-8be6-d9c90dcfa6b1 req-e38e5716-8b5a-4581-bd04-4080b91e5065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8794d0c2-c530-4890-935c-4addf377478c", "tag": "0994906b-e8c7-441c-937e-88a208667dd1"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:05.084727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7a576607-d3f8-445a-8be6-d9c90dcfa6b1 req-e38e5716-8b5a-4581-bd04-4080b91e5065 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:05.086420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7a576607-d3f8-445a-8be6-d9c90dcfa6b1 req-e38e5716-8b5a-4581-bd04-4080b91e5065 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:05.087228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7a576607-d3f8-445a-8be6-d9c90dcfa6b1 req-e38e5716-8b5a-4581-bd04-4080b91e5065 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:05.102651 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-7a576607-d3f8-445a-8be6-d9c90dcfa6b1 req-e38e5716-8b5a-4581-bd04-4080b91e5065 service nova] Creating event network-changed:0994906b-e8c7-441c-937e-88a208667dd1 for instance 8794d0c2-c530-4890-935c-4addf377478c on n-h1-839401-11 Aug 29 15:37:05.110515 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-7a576607-d3f8-445a-8be6-d9c90dcfa6b1 req-e38e5716-8b5a-4581-bd04-4080b91e5065 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049139 Aug 29 15:37:05.111616 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1556/3090] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:05.189966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-516ee1ca-7d05-4db6-898a-edc1d5717aa5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:05.191960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-516ee1ca-7d05-4db6-898a-edc1d5717aa5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:05.206108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-516ee1ca-7d05-4db6-898a-edc1d5717aa5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:05.207182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-516ee1ca-7d05-4db6-898a-edc1d5717aa5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:05.208023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-516ee1ca-7d05-4db6-898a-edc1d5717aa5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:05.209138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-516ee1ca-7d05-4db6-898a-edc1d5717aa5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:05.209887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-516ee1ca-7d05-4db6-898a-edc1d5717aa5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:05.210527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-516ee1ca-7d05-4db6-898a-edc1d5717aa5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:05.306411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f083b28b-9635-4643-912b-eef628374c58 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:05.321346 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f083b28b-9635-4643-912b-eef628374c58 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1324 microversion: 2.1 time: 0.650247 Aug 29 15:37:05.321941 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1535/3091] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:04 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1324 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:05.334850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-798e845a-12c6-4ebf-bfd4-efc7d542e2a1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:05.339696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-798e845a-12c6-4ebf-bfd4-efc7d542e2a1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:05.360545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-798e845a-12c6-4ebf-bfd4-efc7d542e2a1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:05.362642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-798e845a-12c6-4ebf-bfd4-efc7d542e2a1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:05.363320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-798e845a-12c6-4ebf-bfd4-efc7d542e2a1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:05.366506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-798e845a-12c6-4ebf-bfd4-efc7d542e2a1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:05.367327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-798e845a-12c6-4ebf-bfd4-efc7d542e2a1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:05.369463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-798e845a-12c6-4ebf-bfd4-efc7d542e2a1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:05.549349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-516ee1ca-7d05-4db6-898a-edc1d5717aa5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:05.561034 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-516ee1ca-7d05-4db6-898a-edc1d5717aa5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1313 microversion: 2.1 time: 0.376614 Aug 29 15:37:05.564511 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1557/3092] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:05 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:05.580921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e5b058f3-f055-4647-ac71-b73c627a2c01 req-d98adfbb-01fd-466d-8eea-93de62d2ef9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0330d585-be01-45a3-b20a-9ce9cdfbaa43", "name": "network-vif-unplugged", "status": "completed", "tag": "53083e31-a61d-4467-9153-eb9ce7344ee5"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:05.596457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e5b058f3-f055-4647-ac71-b73c627a2c01 req-d98adfbb-01fd-466d-8eea-93de62d2ef9f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:05.599086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e5b058f3-f055-4647-ac71-b73c627a2c01 req-d98adfbb-01fd-466d-8eea-93de62d2ef9f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:05.599760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e5b058f3-f055-4647-ac71-b73c627a2c01 req-d98adfbb-01fd-466d-8eea-93de62d2ef9f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:05.624434 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e5b058f3-f055-4647-ac71-b73c627a2c01 req-d98adfbb-01fd-466d-8eea-93de62d2ef9f service nova] Creating event network-vif-unplugged:53083e31-a61d-4467-9153-eb9ce7344ee5 for instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 on n-h1-839401-11 Aug 29 15:37:05.643004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-e5b058f3-f055-4647-ac71-b73c627a2c01 req-d98adfbb-01fd-466d-8eea-93de62d2ef9f service nova] Instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:37:05.670019 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e5b058f3-f055-4647-ac71-b73c627a2c01 req-d98adfbb-01fd-466d-8eea-93de62d2ef9f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103830 Aug 29 15:37:05.670872 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1558/3093] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:05.690110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dcce7836-e628-4321-b6f3-38ef2aa21300 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:05.690807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dcce7836-e628-4321-b6f3-38ef2aa21300 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:05.701291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcce7836-e628-4321-b6f3-38ef2aa21300 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:05.702112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcce7836-e628-4321-b6f3-38ef2aa21300 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:05.702799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcce7836-e628-4321-b6f3-38ef2aa21300 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:05.703692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcce7836-e628-4321-b6f3-38ef2aa21300 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:05.704358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcce7836-e628-4321-b6f3-38ef2aa21300 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:05.704790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcce7836-e628-4321-b6f3-38ef2aa21300 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:05.773501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-798e845a-12c6-4ebf-bfd4-efc7d542e2a1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:05.783248 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-798e845a-12c6-4ebf-bfd4-efc7d542e2a1 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1470 microversion: 2.1 time: 0.455861 Aug 29 15:37:05.797651 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1536/3094] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:05 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1470 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:06.024429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dcce7836-e628-4321-b6f3-38ef2aa21300 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:06.062115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-177026ce-b12f-4e07-aa85-7d55c39d5af4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:06.066039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-177026ce-b12f-4e07-aa85-7d55c39d5af4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:06.075364 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dcce7836-e628-4321-b6f3-38ef2aa21300 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1365 microversion: 2.1 time: 0.390507 Aug 29 15:37:06.080950 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1559/3095] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:05 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1365 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:06.099008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-177026ce-b12f-4e07-aa85-7d55c39d5af4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:06.099850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-177026ce-b12f-4e07-aa85-7d55c39d5af4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:06.101274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-177026ce-b12f-4e07-aa85-7d55c39d5af4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:06.102571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-177026ce-b12f-4e07-aa85-7d55c39d5af4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:06.105406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-177026ce-b12f-4e07-aa85-7d55c39d5af4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:06.106004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-177026ce-b12f-4e07-aa85-7d55c39d5af4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:06.346754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bb9ddf69-aff9-4a37-b083-b0ff7b3953b5 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:06.347547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bb9ddf69-aff9-4a37-b083-b0ff7b3953b5 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:06.387991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb9ddf69-aff9-4a37-b083-b0ff7b3953b5 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:06.389491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb9ddf69-aff9-4a37-b083-b0ff7b3953b5 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:06.390267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb9ddf69-aff9-4a37-b083-b0ff7b3953b5 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:06.396698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb9ddf69-aff9-4a37-b083-b0ff7b3953b5 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:06.400922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb9ddf69-aff9-4a37-b083-b0ff7b3953b5 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:06.411229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb9ddf69-aff9-4a37-b083-b0ff7b3953b5 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:06.865998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bb9ddf69-aff9-4a37-b083-b0ff7b3953b5 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:06.876616 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bb9ddf69-aff9-4a37-b083-b0ff7b3953b5 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1324 microversion: 2.1 time: 0.535683 Aug 29 15:37:06.878517 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1560/3096] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:06 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1324 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:06.884153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ef8c6873-9c00-45a8-9411-5451ffd18e22 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:06.885316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ef8c6873-9c00-45a8-9411-5451ffd18e22 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:06.895487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef8c6873-9c00-45a8-9411-5451ffd18e22 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:06.896379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef8c6873-9c00-45a8-9411-5451ffd18e22 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:06.898850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef8c6873-9c00-45a8-9411-5451ffd18e22 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:06.899842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef8c6873-9c00-45a8-9411-5451ffd18e22 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:06.900520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef8c6873-9c00-45a8-9411-5451ffd18e22 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:06.901129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef8c6873-9c00-45a8-9411-5451ffd18e22 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:07.168606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ef8c6873-9c00-45a8-9411-5451ffd18e22 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:07.200572 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ef8c6873-9c00-45a8-9411-5451ffd18e22 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1313 microversion: 2.1 time: 0.320590 Aug 29 15:37:07.217732 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1561/3097] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:06 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:07.224377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dacdae95-789d-47a4-8c7b-2c1d9f5d98dd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:07.228440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dacdae95-789d-47a4-8c7b-2c1d9f5d98dd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:07.256634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dacdae95-789d-47a4-8c7b-2c1d9f5d98dd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:07.257482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dacdae95-789d-47a4-8c7b-2c1d9f5d98dd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:07.258081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dacdae95-789d-47a4-8c7b-2c1d9f5d98dd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:07.259109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dacdae95-789d-47a4-8c7b-2c1d9f5d98dd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:07.259857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dacdae95-789d-47a4-8c7b-2c1d9f5d98dd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:07.260571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dacdae95-789d-47a4-8c7b-2c1d9f5d98dd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:07.345644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-177026ce-b12f-4e07-aa85-7d55c39d5af4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:07.365292 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-177026ce-b12f-4e07-aa85-7d55c39d5af4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1318 microversion: 2.1 time: 1.317409 Aug 29 15:37:07.366516 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1537/3098] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:06 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1318 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:07.382409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ac5e4e21-0ca5-452f-8efe-6e8725ef5b05 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:07.383473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ac5e4e21-0ca5-452f-8efe-6e8725ef5b05 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:07.390863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac5e4e21-0ca5-452f-8efe-6e8725ef5b05 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:07.391891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac5e4e21-0ca5-452f-8efe-6e8725ef5b05 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:07.392492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac5e4e21-0ca5-452f-8efe-6e8725ef5b05 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:07.393710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac5e4e21-0ca5-452f-8efe-6e8725ef5b05 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:07.394481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac5e4e21-0ca5-452f-8efe-6e8725ef5b05 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:07.395057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac5e4e21-0ca5-452f-8efe-6e8725ef5b05 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:07.444331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dacdae95-789d-47a4-8c7b-2c1d9f5d98dd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:07.468110 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dacdae95-789d-47a4-8c7b-2c1d9f5d98dd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1470 microversion: 2.1 time: 0.246030 Aug 29 15:37:07.470903 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1562/3099] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:07 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1470 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:07.805114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-fd9225c3-5a96-4afe-b75b-78197b8a4844 req-02143789-7127-4519-8fe4-43443feea678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a26d1257-743d-4e66-8c12-a7eb833b949b", "tag": "344aa345-e02f-423a-b939-d84694888591"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:07.828811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fd9225c3-5a96-4afe-b75b-78197b8a4844 req-02143789-7127-4519-8fe4-43443feea678 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:07.829530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fd9225c3-5a96-4afe-b75b-78197b8a4844 req-02143789-7127-4519-8fe4-43443feea678 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:07.830150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fd9225c3-5a96-4afe-b75b-78197b8a4844 req-02143789-7127-4519-8fe4-43443feea678 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:07.871475 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-fd9225c3-5a96-4afe-b75b-78197b8a4844 req-02143789-7127-4519-8fe4-43443feea678 service nova] Creating event network-changed:344aa345-e02f-423a-b939-d84694888591 for instance a26d1257-743d-4e66-8c12-a7eb833b949b on n-h2-839401-11 Aug 29 15:37:07.877199 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-fd9225c3-5a96-4afe-b75b-78197b8a4844 req-02143789-7127-4519-8fe4-43443feea678 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076175 Aug 29 15:37:07.879213 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1563/3100] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:07.905594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4e6c112a-8b87-4ac0-8a07-54b1563ae74a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:07.906619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4e6c112a-8b87-4ac0-8a07-54b1563ae74a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:07.913475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e6c112a-8b87-4ac0-8a07-54b1563ae74a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:07.914423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e6c112a-8b87-4ac0-8a07-54b1563ae74a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:07.915072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e6c112a-8b87-4ac0-8a07-54b1563ae74a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:07.916003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e6c112a-8b87-4ac0-8a07-54b1563ae74a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:07.917024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e6c112a-8b87-4ac0-8a07-54b1563ae74a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:07.922520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e6c112a-8b87-4ac0-8a07-54b1563ae74a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:08.168804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:08.255096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4e6c112a-8b87-4ac0-8a07-54b1563ae74a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:08.289551 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4e6c112a-8b87-4ac0-8a07-54b1563ae74a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1521 microversion: 2.1 time: 0.387342 Aug 29 15:37:08.292269 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1564/3101] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:07 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:08.302410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-89f9f6e2-00fe-420d-a021-cf67f7e71132 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:08.304220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-89f9f6e2-00fe-420d-a021-cf67f7e71132 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:08.337506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89f9f6e2-00fe-420d-a021-cf67f7e71132 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:08.340188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89f9f6e2-00fe-420d-a021-cf67f7e71132 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:08.341016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89f9f6e2-00fe-420d-a021-cf67f7e71132 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:08.346396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89f9f6e2-00fe-420d-a021-cf67f7e71132 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:08.347163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89f9f6e2-00fe-420d-a021-cf67f7e71132 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:08.347814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89f9f6e2-00fe-420d-a021-cf67f7e71132 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:08.618043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-89f9f6e2-00fe-420d-a021-cf67f7e71132 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:08.630096 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-89f9f6e2-00fe-420d-a021-cf67f7e71132 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1313 microversion: 2.1 time: 0.336224 Aug 29 15:37:08.631575 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1565/3102] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:08 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:08.659684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-43c48d5f-b216-44fd-9626-11302799b477 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:08.659684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-43c48d5f-b216-44fd-9626-11302799b477 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:08.672248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43c48d5f-b216-44fd-9626-11302799b477 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:08.673072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43c48d5f-b216-44fd-9626-11302799b477 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:08.673940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43c48d5f-b216-44fd-9626-11302799b477 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:08.674849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43c48d5f-b216-44fd-9626-11302799b477 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:08.675588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43c48d5f-b216-44fd-9626-11302799b477 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:08.676381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43c48d5f-b216-44fd-9626-11302799b477 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:08.811051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ac5e4e21-0ca5-452f-8efe-6e8725ef5b05 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:08.821137 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ac5e4e21-0ca5-452f-8efe-6e8725ef5b05 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1365 microversion: 2.1 time: 1.448277 Aug 29 15:37:08.826747 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1538/3103] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:07 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1365 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:08.838344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a13c25e5-8a2c-4e51-b9c1-4be4a5305671 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:08.839232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a13c25e5-8a2c-4e51-b9c1-4be4a5305671 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:08.855201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a13c25e5-8a2c-4e51-b9c1-4be4a5305671 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:08.855706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a13c25e5-8a2c-4e51-b9c1-4be4a5305671 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:08.856164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a13c25e5-8a2c-4e51-b9c1-4be4a5305671 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:08.856870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a13c25e5-8a2c-4e51-b9c1-4be4a5305671 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:08.857367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a13c25e5-8a2c-4e51-b9c1-4be4a5305671 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:08.857790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a13c25e5-8a2c-4e51-b9c1-4be4a5305671 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.002591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-43c48d5f-b216-44fd-9626-11302799b477 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:09.017222 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-43c48d5f-b216-44fd-9626-11302799b477 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1521 microversion: 2.1 time: 0.366369 Aug 29 15:37:09.021306 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1566/3104] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:08 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:09.030950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-970649d8-758d-4737-8ccb-133360a05d4e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:09.031857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-970649d8-758d-4737-8ccb-133360a05d4e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:09.042423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-970649d8-758d-4737-8ccb-133360a05d4e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.049284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-970649d8-758d-4737-8ccb-133360a05d4e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.050049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-970649d8-758d-4737-8ccb-133360a05d4e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.054407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-970649d8-758d-4737-8ccb-133360a05d4e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.055086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-970649d8-758d-4737-8ccb-133360a05d4e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.055794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-970649d8-758d-4737-8ccb-133360a05d4e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.315748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-970649d8-758d-4737-8ccb-133360a05d4e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:09.329112 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-970649d8-758d-4737-8ccb-133360a05d4e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1470 microversion: 2.1 time: 0.302571 Aug 29 15:37:09.337955 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1567/3105] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:09 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1470 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:09.355932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-abc4b2e0-474d-4467-b11d-8dce9302181b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-180600709", "metadata": {"": ""}}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-abc4b2e0-474d-4467-b11d-8dce9302181b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Request method failure captured: Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838/action HTTP/1.1 Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 106 Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN0GbvIiUff-Csg384q60lkXu4i6-mvBJpd3uHC3XwYXy4PaOZ7rdjlazGQlvtMKGXenSXNWI7wpdDnEyRTa364NbLtw3ESiH3fXKpDQtDE_4rOyqKq2j2P24J-z87DcgMla1UHDGJpmC4Fh5kcRUC7Pl2mjjcnRflSX472pqyiJs6U Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaeecb44c6534cba89e3d68177917529", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}] Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6de4fe0749d449748eca6937b123d2df Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-180600709", "metadata": {"": ""}}} Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '2b6cfb1a-bfac-45e1-9b33-2e080c11f838', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-180600709', 'metadata': {'': ''}}}} Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'': ''} Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:37:09.360624 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:37:09.364822 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:37:09.364822 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:37:09.364822 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:37:09.364822 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:37:09.364822 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:37:09.364822 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:37:09.364822 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:09.364822 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:09.364822 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:09.364822 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:09.364822 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:09.364822 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:09.364822 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:37:09.364822 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:37:09.364822 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:37:09.364822 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:09.375108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-abc4b2e0-474d-4467-b11d-8dce9302181b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:09.376404 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-abc4b2e0-474d-4467-b11d-8dce9302181b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "POST /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838/action" status: 400 len: 170 microversion: 2.1 time: 0.037249 Aug 29 15:37:09.377634 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1568/3106] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Aug 29 15:37:09 2022] POST /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838/action => generated 170 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:37:09.388610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b0ef3bea-ecae-4376-8c09-5d587e62df97 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:09.392556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b0ef3bea-ecae-4376-8c09-5d587e62df97 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:09.409477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0ef3bea-ecae-4376-8c09-5d587e62df97 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.410247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0ef3bea-ecae-4376-8c09-5d587e62df97 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.411472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0ef3bea-ecae-4376-8c09-5d587e62df97 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.413976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0ef3bea-ecae-4376-8c09-5d587e62df97 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.414682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0ef3bea-ecae-4376-8c09-5d587e62df97 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.416955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0ef3bea-ecae-4376-8c09-5d587e62df97 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.720647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a13c25e5-8a2c-4e51-b9c1-4be4a5305671 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:09.737370 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a13c25e5-8a2c-4e51-b9c1-4be4a5305671 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1318 microversion: 2.1 time: 0.908442 Aug 29 15:37:09.749788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b0ef3bea-ecae-4376-8c09-5d587e62df97 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:09.753433 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1539/3107] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:08 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1318 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:09.763259 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b0ef3bea-ecae-4376-8c09-5d587e62df97 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1521 microversion: 2.1 time: 0.378079 Aug 29 15:37:09.765897 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1569/3108] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:09 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:09.777952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6612510c-e407-4ea7-addf-f556fe54d344 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:09.783997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6612510c-e407-4ea7-addf-f556fe54d344 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:09.789559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-886b81e3-14df-4616-8cf5-56da60a824fd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:09.796523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-886b81e3-14df-4616-8cf5-56da60a824fd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:09.816708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6612510c-e407-4ea7-addf-f556fe54d344 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.817915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6612510c-e407-4ea7-addf-f556fe54d344 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.818518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6612510c-e407-4ea7-addf-f556fe54d344 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.819396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6612510c-e407-4ea7-addf-f556fe54d344 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.820021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6612510c-e407-4ea7-addf-f556fe54d344 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.820594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6612510c-e407-4ea7-addf-f556fe54d344 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.822027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-886b81e3-14df-4616-8cf5-56da60a824fd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.823349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-886b81e3-14df-4616-8cf5-56da60a824fd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.824611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-886b81e3-14df-4616-8cf5-56da60a824fd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.826704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-886b81e3-14df-4616-8cf5-56da60a824fd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:09.828560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-886b81e3-14df-4616-8cf5-56da60a824fd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:09.831890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-886b81e3-14df-4616-8cf5-56da60a824fd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:09.958642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=56 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:10.242082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-886b81e3-14df-4616-8cf5-56da60a824fd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:10.262972 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-886b81e3-14df-4616-8cf5-56da60a824fd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1521 microversion: 2.1 time: 0.475624 Aug 29 15:37:10.264039 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1570/3109] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:09 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:10.293703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-d936c0f4-5ee4-4fa6-ae99-bdd1c6c17416 req-161a8165-1507-47c5-bd5f-49b88f818375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401ad5c3-264d-437d-a249-035450439c18", "name": "network-vif-plugged", "status": "completed", "tag": "bf81ac2f-eb0e-454d-982c-455aa2f19213"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:10.318275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d936c0f4-5ee4-4fa6-ae99-bdd1c6c17416 req-161a8165-1507-47c5-bd5f-49b88f818375 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:10.318900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d936c0f4-5ee4-4fa6-ae99-bdd1c6c17416 req-161a8165-1507-47c5-bd5f-49b88f818375 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:10.319720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d936c0f4-5ee4-4fa6-ae99-bdd1c6c17416 req-161a8165-1507-47c5-bd5f-49b88f818375 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:10.347442 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-d936c0f4-5ee4-4fa6-ae99-bdd1c6c17416 req-161a8165-1507-47c5-bd5f-49b88f818375 service nova] Creating event network-vif-plugged:bf81ac2f-eb0e-454d-982c-455aa2f19213 for instance 401ad5c3-264d-437d-a249-035450439c18 on n-h1-839401-11 Aug 29 15:37:10.366461 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-d936c0f4-5ee4-4fa6-ae99-bdd1c6c17416 req-161a8165-1507-47c5-bd5f-49b88f818375 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079602 Aug 29 15:37:10.367502 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1571/3110] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:10.377268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a53347cb-eec3-4c26-bf88-b8061097a97b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:10.379571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a53347cb-eec3-4c26-bf88-b8061097a97b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:10.400423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a53347cb-eec3-4c26-bf88-b8061097a97b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:10.402429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a53347cb-eec3-4c26-bf88-b8061097a97b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:10.404661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a53347cb-eec3-4c26-bf88-b8061097a97b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:10.405797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a53347cb-eec3-4c26-bf88-b8061097a97b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:10.408705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a53347cb-eec3-4c26-bf88-b8061097a97b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:10.422756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a53347cb-eec3-4c26-bf88-b8061097a97b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:10.775885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6612510c-e407-4ea7-addf-f556fe54d344 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:10.789336 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6612510c-e407-4ea7-addf-f556fe54d344 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1313 microversion: 2.1 time: 1.034628 Aug 29 15:37:10.791086 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1540/3111] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:09 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1313 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:10.798899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3a474afc-6345-4ed8-8929-64d0f4e47b67 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-792968560", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3a474afc-6345-4ed8-8929-64d0f4e47b67 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Request method failure captured: Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838/action HTTP/1.1 Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 618 Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN0GbvIiUff-Csg384q60lkXu4i6-mvBJpd3uHC3XwYXy4PaOZ7rdjlazGQlvtMKGXenSXNWI7wpdDnEyRTa364NbLtw3ESiH3fXKpDQtDE_4rOyqKq2j2P24J-z87DcgMla1UHDGJpmC4Fh5kcRUC7Pl2mjjcnRflSX472pqyiJs6U Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaeecb44c6534cba89e3d68177917529", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}] Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6de4fe0749d449748eca6937b123d2df Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-792968560", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '2b6cfb1a-bfac-45e1-9b33-2e080c11f838', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-792968560', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:37:10.805728 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:37:10.808531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:10.810897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a53347cb-eec3-4c26-bf88-b8061097a97b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:10.816427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3a474afc-6345-4ed8-8929-64d0f4e47b67 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:10.818898 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3a474afc-6345-4ed8-8929-64d0f4e47b67 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "POST /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838/action" status: 400 len: 938 microversion: 2.1 time: 0.023972 Aug 29 15:37:10.821042 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1541/3112] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Aug 29 15:37:10 2022] POST /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838/action => generated 938 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:37:10.837187 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a53347cb-eec3-4c26-bf88-b8061097a97b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1365 microversion: 2.1 time: 0.461245 Aug 29 15:37:10.837187 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1572/3113] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:10 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1365 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:10.847996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d280e2f0-8d39-4176-85b4-a9990a4b5946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:10.848280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-5eb50c20-58d8-43bf-81fa-112e900ae6fb req-19c7756c-3720-4a84-a90c-19da74dbb34e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0330d585-be01-45a3-b20a-9ce9cdfbaa43", "tag": "53083e31-a61d-4467-9153-eb9ce7344ee5"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:10.852897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d280e2f0-8d39-4176-85b4-a9990a4b5946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:10.868481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d280e2f0-8d39-4176-85b4-a9990a4b5946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:10.870648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d280e2f0-8d39-4176-85b4-a9990a4b5946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:10.871156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d280e2f0-8d39-4176-85b4-a9990a4b5946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:10.872530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d280e2f0-8d39-4176-85b4-a9990a4b5946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:10.872530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d280e2f0-8d39-4176-85b4-a9990a4b5946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:10.872941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d280e2f0-8d39-4176-85b4-a9990a4b5946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:10.883471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5eb50c20-58d8-43bf-81fa-112e900ae6fb req-19c7756c-3720-4a84-a90c-19da74dbb34e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:10.883963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5eb50c20-58d8-43bf-81fa-112e900ae6fb req-19c7756c-3720-4a84-a90c-19da74dbb34e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:10.884389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5eb50c20-58d8-43bf-81fa-112e900ae6fb req-19c7756c-3720-4a84-a90c-19da74dbb34e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:10.908584 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-5eb50c20-58d8-43bf-81fa-112e900ae6fb req-19c7756c-3720-4a84-a90c-19da74dbb34e service nova] Creating event network-changed:53083e31-a61d-4467-9153-eb9ce7344ee5 for instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 on n-h2-839401-11 Aug 29 15:37:10.920950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-5eb50c20-58d8-43bf-81fa-112e900ae6fb req-19c7756c-3720-4a84-a90c-19da74dbb34e service nova] Instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:37:10.947479 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-5eb50c20-58d8-43bf-81fa-112e900ae6fb req-19c7756c-3720-4a84-a90c-19da74dbb34e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114759 Aug 29 15:37:10.948439 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1573/3114] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:10.954064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dc1d4965-f139-4daa-84ab-ab0f6d4ee143 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:10.962206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dc1d4965-f139-4daa-84ab-ab0f6d4ee143 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:10.974810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc1d4965-f139-4daa-84ab-ab0f6d4ee143 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:10.975568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc1d4965-f139-4daa-84ab-ab0f6d4ee143 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:10.976206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc1d4965-f139-4daa-84ab-ab0f6d4ee143 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:10.977074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc1d4965-f139-4daa-84ab-ab0f6d4ee143 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:10.982072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc1d4965-f139-4daa-84ab-ab0f6d4ee143 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:10.982780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc1d4965-f139-4daa-84ab-ab0f6d4ee143 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:11.268523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dc1d4965-f139-4daa-84ab-ab0f6d4ee143 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:11.271989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:11.294296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d280e2f0-8d39-4176-85b4-a9990a4b5946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:11.306454 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d280e2f0-8d39-4176-85b4-a9990a4b5946 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1470 microversion: 2.1 time: 0.484116 Aug 29 15:37:11.317116 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dc1d4965-f139-4daa-84ab-ab0f6d4ee143 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1318 microversion: 2.1 time: 0.357785 Aug 29 15:37:11.317310 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1542/3115] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:10 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1470 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:11.325657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e15a17fc-ca0c-4e8f-a409-5f5827bf23a7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:11.326290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e15a17fc-ca0c-4e8f-a409-5f5827bf23a7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:11.333903 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1574/3116] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:10 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:11.346562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e15a17fc-ca0c-4e8f-a409-5f5827bf23a7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:11.347068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e15a17fc-ca0c-4e8f-a409-5f5827bf23a7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:11.347513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e15a17fc-ca0c-4e8f-a409-5f5827bf23a7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:11.348262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e15a17fc-ca0c-4e8f-a409-5f5827bf23a7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:11.348719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e15a17fc-ca0c-4e8f-a409-5f5827bf23a7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:11.349183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e15a17fc-ca0c-4e8f-a409-5f5827bf23a7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:11.629532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e15a17fc-ca0c-4e8f-a409-5f5827bf23a7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:11.639411 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e15a17fc-ca0c-4e8f-a409-5f5827bf23a7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1521 microversion: 2.1 time: 0.330255 Aug 29 15:37:11.646415 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1543/3117] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:11 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:11.668624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fd71bc64-e62e-4d28-8527-da6efb8a268a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:11.669277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fd71bc64-e62e-4d28-8527-da6efb8a268a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:11.677602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd71bc64-e62e-4d28-8527-da6efb8a268a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:11.678217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd71bc64-e62e-4d28-8527-da6efb8a268a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:11.678914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd71bc64-e62e-4d28-8527-da6efb8a268a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:11.679817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd71bc64-e62e-4d28-8527-da6efb8a268a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:11.680628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd71bc64-e62e-4d28-8527-da6efb8a268a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:11.681218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd71bc64-e62e-4d28-8527-da6efb8a268a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:11.814112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-81a78f3b-6242-47c0-9829-2d3b24e7c731 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:11.815124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-81a78f3b-6242-47c0-9829-2d3b24e7c731 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:11.824936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81a78f3b-6242-47c0-9829-2d3b24e7c731 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:11.836544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81a78f3b-6242-47c0-9829-2d3b24e7c731 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:11.850259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81a78f3b-6242-47c0-9829-2d3b24e7c731 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:11.852840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81a78f3b-6242-47c0-9829-2d3b24e7c731 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:11.854501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81a78f3b-6242-47c0-9829-2d3b24e7c731 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:11.855175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81a78f3b-6242-47c0-9829-2d3b24e7c731 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:12.023501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd71bc64-e62e-4d28-8527-da6efb8a268a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:12.032597 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fd71bc64-e62e-4d28-8527-da6efb8a268a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1521 microversion: 2.1 time: 0.367980 Aug 29 15:37:12.037305 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1575/3118] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:11 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:12.052739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-87345800-ad88-458a-ae70-fd7436368bd1 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:12.055380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-87345800-ad88-458a-ae70-fd7436368bd1 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:12.071881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87345800-ad88-458a-ae70-fd7436368bd1 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:12.072408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87345800-ad88-458a-ae70-fd7436368bd1 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:12.072843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87345800-ad88-458a-ae70-fd7436368bd1 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:12.073589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87345800-ad88-458a-ae70-fd7436368bd1 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:12.075069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87345800-ad88-458a-ae70-fd7436368bd1 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:12.079395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87345800-ad88-458a-ae70-fd7436368bd1 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:12.228546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-81a78f3b-6242-47c0-9829-2d3b24e7c731 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:12.236724 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-81a78f3b-6242-47c0-9829-2d3b24e7c731 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1313 microversion: 2.1 time: 0.426744 Aug 29 15:37:12.242302 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1544/3119] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:11 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:12.255115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0ebd8518-9cde-40cb-92d2-9c89197eed5a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0ebd8518-9cde-40cb-92d2-9c89197eed5a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Request method failure captured: Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838/action HTTP/1.1 Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 285 Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN0GbvIiUff-Csg384q60lkXu4i6-mvBJpd3uHC3XwYXy4PaOZ7rdjlazGQlvtMKGXenSXNWI7wpdDnEyRTa364NbLtw3ESiH3fXKpDQtDE_4rOyqKq2j2P24J-z87DcgMla1UHDGJpmC4Fh5kcRUC7Pl2mjjcnRflSX472pqyiJs6U Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaeecb44c6534cba89e3d68177917529", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}] Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6de4fe0749d449748eca6937b123d2df Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '2b6cfb1a-bfac-45e1-9b33-2e080c11f838', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:12.262361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0ebd8518-9cde-40cb-92d2-9c89197eed5a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:12.265913 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0ebd8518-9cde-40cb-92d2-9c89197eed5a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "POST /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838/action" status: 400 len: 619 microversion: 2.1 time: 0.020839 Aug 29 15:37:12.268391 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1545/3120] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Aug 29 15:37:12 2022] POST /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838/action => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:37:12.277904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea5504ef-0480-42bd-a517-018bd91e0bce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:12.283226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ea5504ef-0480-42bd-a517-018bd91e0bce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:12.301479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea5504ef-0480-42bd-a517-018bd91e0bce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:12.302012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea5504ef-0480-42bd-a517-018bd91e0bce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:12.302481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea5504ef-0480-42bd-a517-018bd91e0bce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:12.303248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea5504ef-0480-42bd-a517-018bd91e0bce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:12.303728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea5504ef-0480-42bd-a517-018bd91e0bce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:12.304174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea5504ef-0480-42bd-a517-018bd91e0bce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:12.530516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-87345800-ad88-458a-ae70-fd7436368bd1 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:12.540607 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-87345800-ad88-458a-ae70-fd7436368bd1 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1365 microversion: 2.1 time: 0.500756 Aug 29 15:37:12.545299 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1576/3121] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:12 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1365 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:12.553601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9bd802cf-67f8-49c3-bc05-cebd03bc45f6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:12.554498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9bd802cf-67f8-49c3-bc05-cebd03bc45f6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:12.561908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bd802cf-67f8-49c3-bc05-cebd03bc45f6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:12.562804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bd802cf-67f8-49c3-bc05-cebd03bc45f6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:12.563602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bd802cf-67f8-49c3-bc05-cebd03bc45f6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:12.564607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bd802cf-67f8-49c3-bc05-cebd03bc45f6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:12.565321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bd802cf-67f8-49c3-bc05-cebd03bc45f6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:12.565976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bd802cf-67f8-49c3-bc05-cebd03bc45f6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:12.686147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ea5504ef-0480-42bd-a517-018bd91e0bce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:12.700314 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ea5504ef-0480-42bd-a517-018bd91e0bce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1521 microversion: 2.1 time: 0.430664 Aug 29 15:37:12.701757 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1546/3122] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:12 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:12.708584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-25019b05-fcf2-4ff1-a30c-35383fe9e1bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:12.709734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-25019b05-fcf2-4ff1-a30c-35383fe9e1bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:12.723050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25019b05-fcf2-4ff1-a30c-35383fe9e1bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:12.723909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25019b05-fcf2-4ff1-a30c-35383fe9e1bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:12.725995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25019b05-fcf2-4ff1-a30c-35383fe9e1bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:12.728220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25019b05-fcf2-4ff1-a30c-35383fe9e1bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:12.728945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25019b05-fcf2-4ff1-a30c-35383fe9e1bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:12.729786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25019b05-fcf2-4ff1-a30c-35383fe9e1bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:12.738872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:13.104367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9bd802cf-67f8-49c3-bc05-cebd03bc45f6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:13.126099 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9bd802cf-67f8-49c3-bc05-cebd03bc45f6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1318 microversion: 2.1 time: 0.578732 Aug 29 15:37:13.126727 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1577/3123] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:12 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1318 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:13.133766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8bb3ca1f-95f8-448c-a726-87691ad3c29a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:13.134398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8bb3ca1f-95f8-448c-a726-87691ad3c29a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:13.151491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8bb3ca1f-95f8-448c-a726-87691ad3c29a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:13.154040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8bb3ca1f-95f8-448c-a726-87691ad3c29a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:13.156849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8bb3ca1f-95f8-448c-a726-87691ad3c29a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:13.159494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8bb3ca1f-95f8-448c-a726-87691ad3c29a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:13.161751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8bb3ca1f-95f8-448c-a726-87691ad3c29a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:13.162946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8bb3ca1f-95f8-448c-a726-87691ad3c29a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:13.480632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8bb3ca1f-95f8-448c-a726-87691ad3c29a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:13.495257 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8bb3ca1f-95f8-448c-a726-87691ad3c29a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1521 microversion: 2.1 time: 0.361660 Aug 29 15:37:13.496632 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1578/3124] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:13 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:13.510631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-237ba5dd-81e0-4be4-be8e-460a2b9edad6 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:13.515956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-237ba5dd-81e0-4be4-be8e-460a2b9edad6 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:13.538547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-237ba5dd-81e0-4be4-be8e-460a2b9edad6 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:13.540719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-237ba5dd-81e0-4be4-be8e-460a2b9edad6 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:13.544268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-237ba5dd-81e0-4be4-be8e-460a2b9edad6 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:13.545268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-237ba5dd-81e0-4be4-be8e-460a2b9edad6 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:13.545999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-237ba5dd-81e0-4be4-be8e-460a2b9edad6 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:13.546656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-237ba5dd-81e0-4be4-be8e-460a2b9edad6 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:14.197494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-237ba5dd-81e0-4be4-be8e-460a2b9edad6 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:14.215120 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-237ba5dd-81e0-4be4-be8e-460a2b9edad6 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1313 microversion: 2.1 time: 0.715832 Aug 29 15:37:14.217026 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1579/3125] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:13 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:14.226296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4ba0ed92-ae10-47f2-b410-1a922adc8dba tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2143822016"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:14.232254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4ba0ed92-ae10-47f2-b410-1a922adc8dba tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:14.247422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba0ed92-ae10-47f2-b410-1a922adc8dba tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:14.248496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba0ed92-ae10-47f2-b410-1a922adc8dba tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:14.252925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba0ed92-ae10-47f2-b410-1a922adc8dba tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:14.253993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba0ed92-ae10-47f2-b410-1a922adc8dba tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:14.254657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba0ed92-ae10-47f2-b410-1a922adc8dba tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:14.255335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba0ed92-ae10-47f2-b410-1a922adc8dba tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:14.471580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-25019b05-fcf2-4ff1-a30c-35383fe9e1bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:14.484942 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-25019b05-fcf2-4ff1-a30c-35383fe9e1bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1470 microversion: 2.1 time: 1.781843 Aug 29 15:37:14.485571 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1547/3126] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:12 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1470 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:14.516914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c5ec9f12-60d1-4329-81dd-f814249da4d8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:14.517630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c5ec9f12-60d1-4329-81dd-f814249da4d8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:14.530881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5ec9f12-60d1-4329-81dd-f814249da4d8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:14.531700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5ec9f12-60d1-4329-81dd-f814249da4d8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:14.532335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5ec9f12-60d1-4329-81dd-f814249da4d8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:14.533429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5ec9f12-60d1-4329-81dd-f814249da4d8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:14.536267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5ec9f12-60d1-4329-81dd-f814249da4d8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:14.536949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5ec9f12-60d1-4329-81dd-f814249da4d8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:14.919847 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4ba0ed92-ae10-47f2-b410-1a922adc8dba tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "POST /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838/action" status: 202 len: 0 microversion: 2.1 time: 0.701225 Aug 29 15:37:14.931428 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1580/3127] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:37:14 2022] POST /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838/action => generated 0 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:37:14.974763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-844824ec-086f-4cde-bf32-48f27f30c8f9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:14.975496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-844824ec-086f-4cde-bf32-48f27f30c8f9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:15.004400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-844824ec-086f-4cde-bf32-48f27f30c8f9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:15.004895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-844824ec-086f-4cde-bf32-48f27f30c8f9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:15.005355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-844824ec-086f-4cde-bf32-48f27f30c8f9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:15.006079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-844824ec-086f-4cde-bf32-48f27f30c8f9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:15.006532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-844824ec-086f-4cde-bf32-48f27f30c8f9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:15.007100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-844824ec-086f-4cde-bf32-48f27f30c8f9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:15.893393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c5ec9f12-60d1-4329-81dd-f814249da4d8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:15.904233 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c5ec9f12-60d1-4329-81dd-f814249da4d8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1365 microversion: 2.1 time: 1.398858 Aug 29 15:37:15.917369 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1548/3128] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:14 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1365 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:15.940101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-faf2b0c4-0895-4490-a74f-db6288d0cb61 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1188486887"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:15.956963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-faf2b0c4-0895-4490-a74f-db6288d0cb61 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:15.991257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-faf2b0c4-0895-4490-a74f-db6288d0cb61 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:15.991703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-faf2b0c4-0895-4490-a74f-db6288d0cb61 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:15.992152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-faf2b0c4-0895-4490-a74f-db6288d0cb61 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:15.992876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-faf2b0c4-0895-4490-a74f-db6288d0cb61 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:16.000307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-faf2b0c4-0895-4490-a74f-db6288d0cb61 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:16.002859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-faf2b0c4-0895-4490-a74f-db6288d0cb61 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:16.188033 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-faf2b0c4-0895-4490-a74f-db6288d0cb61 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] HTTP exception thrown: Cannot 'createImage' instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 while it is in task_state image_snapshot Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-faf2b0c4-0895-4490-a74f-db6288d0cb61 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Request method failure captured: Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838/action HTTP/1.1 Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 85 Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN0GbvIiUff-Csg384q60lkXu4i6-mvBJpd3uHC3XwYXy4PaOZ7rdjlazGQlvtMKGXenSXNWI7wpdDnEyRTa364NbLtw3ESiH3fXKpDQtDE_4rOyqKq2j2P24J-z87DcgMla1UHDGJpmC4Fh5kcRUC7Pl2mjjcnRflSX472pqyiJs6U Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaeecb44c6534cba89e3d68177917529", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}] Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6de4fe0749d449748eca6937b123d2df Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1188486887"}} Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: exception: Cannot 'createImage' instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 while it is in task_state image_snapshot Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '2b6cfb1a-bfac-45e1-9b33-2e080c11f838', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1188486887'}}} Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:37:16.192458 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 while it is in task_state image_snapshot Aug 29 15:37:16.196769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:16.196769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:16.196769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:16.196769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:16.196769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:16.196769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:16.196769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:16.196769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:16.196769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 while it is in task_state image_snapshot Aug 29 15:37:16.196769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:16.203057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-faf2b0c4-0895-4490-a74f-db6288d0cb61 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Returning 409 to user: Cannot 'createImage' instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 while it is in task_state image_snapshot {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:16.205895 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-faf2b0c4-0895-4490-a74f-db6288d0cb61 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "POST /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838/action" status: 409 len: 159 microversion: 2.1 time: 0.292170 Aug 29 15:37:16.207545 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1549/3129] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:37:15 2022] POST /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838/action => generated 159 bytes in 294 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:37:16.215371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-308f3a02-7f0b-4bec-85a0-7dafa54a718e tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:16.218387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-308f3a02-7f0b-4bec-85a0-7dafa54a718e tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:16.232713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-308f3a02-7f0b-4bec-85a0-7dafa54a718e tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:16.233918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-308f3a02-7f0b-4bec-85a0-7dafa54a718e tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:16.235259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-308f3a02-7f0b-4bec-85a0-7dafa54a718e tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:16.236732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-308f3a02-7f0b-4bec-85a0-7dafa54a718e tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:16.237975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-308f3a02-7f0b-4bec-85a0-7dafa54a718e tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:16.239126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-308f3a02-7f0b-4bec-85a0-7dafa54a718e tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:16.579690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-844824ec-086f-4cde-bf32-48f27f30c8f9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:16.631435 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-844824ec-086f-4cde-bf32-48f27f30c8f9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1318 microversion: 2.1 time: 1.693505 Aug 29 15:37:16.632523 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1581/3130] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:14 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1318 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:16.666508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4025b7c7-a9bc-4ff0-8465-35954834e5c8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:16.669371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4025b7c7-a9bc-4ff0-8465-35954834e5c8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:16.691205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4025b7c7-a9bc-4ff0-8465-35954834e5c8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:16.692121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4025b7c7-a9bc-4ff0-8465-35954834e5c8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:16.692489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4025b7c7-a9bc-4ff0-8465-35954834e5c8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:16.693244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4025b7c7-a9bc-4ff0-8465-35954834e5c8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:16.694510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4025b7c7-a9bc-4ff0-8465-35954834e5c8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:16.695222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4025b7c7-a9bc-4ff0-8465-35954834e5c8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:16.957473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-308f3a02-7f0b-4bec-85a0-7dafa54a718e tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:16.968524 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-308f3a02-7f0b-4bec-85a0-7dafa54a718e tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1313 microversion: 2.1 time: 0.758732 Aug 29 15:37:16.992921 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1550/3131] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:16 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1313 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:17.042183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d334c8de-d2ce-4c17-8a7d-3d0dac605d38 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '.version_select at 0x7fc42a957790>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:17.233692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4025b7c7-a9bc-4ff0-8465-35954834e5c8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:17.243632 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4025b7c7-a9bc-4ff0-8465-35954834e5c8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1470 microversion: 2.1 time: 0.609172 Aug 29 15:37:17.245102 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1582/3132] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:16 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1470 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:17.252308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-af8296c9-e467-4a53-99e1-f5d7a9552184 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:17.253546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-af8296c9-e467-4a53-99e1-f5d7a9552184 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:17.263338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af8296c9-e467-4a53-99e1-f5d7a9552184 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.264282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af8296c9-e467-4a53-99e1-f5d7a9552184 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.265243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af8296c9-e467-4a53-99e1-f5d7a9552184 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.266977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af8296c9-e467-4a53-99e1-f5d7a9552184 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.267664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af8296c9-e467-4a53-99e1-f5d7a9552184 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.268294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af8296c9-e467-4a53-99e1-f5d7a9552184 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.328912 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d334c8de-d2ce-4c17-8a7d-3d0dac605d38 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "DELETE /compute/v2.1/images/1987f218-d4ae-4535-8d0a-166d68e92552" status: 204 len: 0 microversion: 2.1 time: 0.332188 Aug 29 15:37:17.329521 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1551/3133] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:16 2022] DELETE /compute/v2.1/images/1987f218-d4ae-4535-8d0a-166d68e92552 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:37:17.336666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c6861060-37f7-4af7-ba73-4cafcf566051 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:17.337595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c6861060-37f7-4af7-ba73-4cafcf566051 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:17.354818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6861060-37f7-4af7-ba73-4cafcf566051 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.355334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6861060-37f7-4af7-ba73-4cafcf566051 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.358007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6861060-37f7-4af7-ba73-4cafcf566051 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.359070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6861060-37f7-4af7-ba73-4cafcf566051 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.359844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6861060-37f7-4af7-ba73-4cafcf566051 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.360610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6861060-37f7-4af7-ba73-4cafcf566051 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.608643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c6861060-37f7-4af7-ba73-4cafcf566051 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:17.638214 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c6861060-37f7-4af7-ba73-4cafcf566051 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1682 microversion: 2.1 time: 0.307348 Aug 29 15:37:17.638553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-af8296c9-e467-4a53-99e1-f5d7a9552184 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:17.651752 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-af8296c9-e467-4a53-99e1-f5d7a9552184 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1555 microversion: 2.1 time: 0.405253 Aug 29 15:37:17.657641 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1552/3134] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:17 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1682 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:17.663038 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1583/3135] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:17 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1555 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:17.664205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-57f3762d-700d-40c2-a37c-bba3d6709ce2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:17.665041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-57f3762d-700d-40c2-a37c-bba3d6709ce2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:17.672093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f8d330f-a7ef-47cc-ae63-fc3ed6fd34fc tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:17.673230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3f8d330f-a7ef-47cc-ae63-fc3ed6fd34fc tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:17.681515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f8d330f-a7ef-47cc-ae63-fc3ed6fd34fc tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.683003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f8d330f-a7ef-47cc-ae63-fc3ed6fd34fc tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.683365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57f3762d-700d-40c2-a37c-bba3d6709ce2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.683878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57f3762d-700d-40c2-a37c-bba3d6709ce2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.684148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f8d330f-a7ef-47cc-ae63-fc3ed6fd34fc tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.684322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57f3762d-700d-40c2-a37c-bba3d6709ce2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.685046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57f3762d-700d-40c2-a37c-bba3d6709ce2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.685528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57f3762d-700d-40c2-a37c-bba3d6709ce2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.685682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f8d330f-a7ef-47cc-ae63-fc3ed6fd34fc tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.686509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f8d330f-a7ef-47cc-ae63-fc3ed6fd34fc tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.687161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f8d330f-a7ef-47cc-ae63-fc3ed6fd34fc tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.695671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57f3762d-700d-40c2-a37c-bba3d6709ce2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.911629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-57f3762d-700d-40c2-a37c-bba3d6709ce2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:17.921979 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-57f3762d-700d-40c2-a37c-bba3d6709ce2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1539 microversion: 2.1 time: 0.262523 Aug 29 15:37:17.922925 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1553/3136] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:17 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1539 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:17.929218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e7357478-7e1a-4d84-9fa7-e895190ccd4b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:17.929966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e7357478-7e1a-4d84-9fa7-e895190ccd4b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:17.937400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7357478-7e1a-4d84-9fa7-e895190ccd4b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.938587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7357478-7e1a-4d84-9fa7-e895190ccd4b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.939278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7357478-7e1a-4d84-9fa7-e895190ccd4b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:17.940282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7357478-7e1a-4d84-9fa7-e895190ccd4b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:17.940938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7357478-7e1a-4d84-9fa7-e895190ccd4b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:17.941636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7357478-7e1a-4d84-9fa7-e895190ccd4b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:18.004061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3f8d330f-a7ef-47cc-ae63-fc3ed6fd34fc tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:18.015658 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3f8d330f-a7ef-47cc-ae63-fc3ed6fd34fc tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1318 microversion: 2.1 time: 0.350163 Aug 29 15:37:18.017639 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1584/3137] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:17 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:18.034617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ef8e4b8-6c84-4969-851c-e6bad51869b3 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:18.035643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ef8e4b8-6c84-4969-851c-e6bad51869b3 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:18.047070 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e7357478-7e1a-4d84-9fa7-e895190ccd4b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122604 Aug 29 15:37:18.049783 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1554/3138] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:37:17 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:18.053806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef8e4b8-6c84-4969-851c-e6bad51869b3 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:18.054740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef8e4b8-6c84-4969-851c-e6bad51869b3 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:18.055407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef8e4b8-6c84-4969-851c-e6bad51869b3 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:18.056380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef8e4b8-6c84-4969-851c-e6bad51869b3 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:18.057190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef8e4b8-6c84-4969-851c-e6bad51869b3 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:18.058089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ef8e4b8-6c84-4969-851c-e6bad51869b3 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:18.270005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6fc5d4ff-41bf-416c-8d46-c56f4194c31a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:18.270900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6fc5d4ff-41bf-416c-8d46-c56f4194c31a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:18.287079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fc5d4ff-41bf-416c-8d46-c56f4194c31a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:18.287939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fc5d4ff-41bf-416c-8d46-c56f4194c31a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:18.288561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fc5d4ff-41bf-416c-8d46-c56f4194c31a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:18.289928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fc5d4ff-41bf-416c-8d46-c56f4194c31a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:18.293113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fc5d4ff-41bf-416c-8d46-c56f4194c31a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:18.294578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fc5d4ff-41bf-416c-8d46-c56f4194c31a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:18.472484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5ef8e4b8-6c84-4969-851c-e6bad51869b3 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:18.487066 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ef8e4b8-6c84-4969-851c-e6bad51869b3 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1313 microversion: 2.1 time: 0.462132 Aug 29 15:37:18.487874 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1585/3139] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:18 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:18.512948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bfbd62d8-c863-4c7e-8dca-11b36d8a8ff9 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Action: 'create', calling method: .version_select at 0x7fc42b5751f0>, body: {"keypair": {"name": "tempest-keypair-1528689471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhR7pPqy/XCmJVOnpz2bmf9d29dakeS5Q4zb2By5YVMv91UosMYQRRGXvPN0veRjGiTDnkhHtm3L6zu/JJVAFnNoeC7P5FpEMPEA1CRGfsliwf0xYJfFd1+lEHVWtvGAA=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:18.534231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-bfbd62d8-c863-4c7e-8dca-11b36d8a8ff9 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Getting quotas for project 64900d09e46d44e58a07e062a419bc09. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:37:18.540435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-bfbd62d8-c863-4c7e-8dca-11b36d8a8ff9 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Getting quotas for user 06adfce1215a460d8b289916b806b0b9 and project 64900d09e46d44e58a07e062a419bc09. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:37:18.585044 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bfbd62d8-c863-4c7e-8dca-11b36d8a8ff9 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.082082 Aug 29 15:37:18.586229 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1586/3140] 10.222.0.62 () {62 vars in 1200 bytes} [Mon Aug 29 15:37:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:37:18.671567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bd4b747f-22c3-4139-ad33-2c26abc95c60 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:18.680409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bd4b747f-22c3-4139-ad33-2c26abc95c60 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:18.681341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6fc5d4ff-41bf-416c-8d46-c56f4194c31a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:18.696277 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6fc5d4ff-41bf-416c-8d46-c56f4194c31a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1470 microversion: 2.1 time: 0.429601 Aug 29 15:37:18.700291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd4b747f-22c3-4139-ad33-2c26abc95c60 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:18.707593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd4b747f-22c3-4139-ad33-2c26abc95c60 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:18.707593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd4b747f-22c3-4139-ad33-2c26abc95c60 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:18.707593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd4b747f-22c3-4139-ad33-2c26abc95c60 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:18.707593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd4b747f-22c3-4139-ad33-2c26abc95c60 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:18.707948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd4b747f-22c3-4139-ad33-2c26abc95c60 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:18.713149 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1555/3141] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:18 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1470 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:18.928983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bd4b747f-22c3-4139-ad33-2c26abc95c60 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:18.942389 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bd4b747f-22c3-4139-ad33-2c26abc95c60 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1682 microversion: 2.1 time: 0.282577 Aug 29 15:37:18.943174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-649d6862-f0a3-4169-a052-c24b08b62f85 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:18.943963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-649d6862-f0a3-4169-a052-c24b08b62f85 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:18.957593 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1587/3142] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:18 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1682 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:18.959029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-649d6862-f0a3-4169-a052-c24b08b62f85 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:18.959755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-649d6862-f0a3-4169-a052-c24b08b62f85 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:18.960648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-649d6862-f0a3-4169-a052-c24b08b62f85 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:18.961518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-649d6862-f0a3-4169-a052-c24b08b62f85 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:18.962080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-649d6862-f0a3-4169-a052-c24b08b62f85 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:18.963601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-649d6862-f0a3-4169-a052-c24b08b62f85 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.040942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f859d941-e04f-4661-a975-66a44282b6b2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:19.041833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f859d941-e04f-4661-a975-66a44282b6b2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:19.054045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f859d941-e04f-4661-a975-66a44282b6b2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.055328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f859d941-e04f-4661-a975-66a44282b6b2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.056056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f859d941-e04f-4661-a975-66a44282b6b2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.057309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f859d941-e04f-4661-a975-66a44282b6b2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.058356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f859d941-e04f-4661-a975-66a44282b6b2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.058986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f859d941-e04f-4661-a975-66a44282b6b2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.256360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-649d6862-f0a3-4169-a052-c24b08b62f85 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:19.268337 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-649d6862-f0a3-4169-a052-c24b08b62f85 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1539 microversion: 2.1 time: 0.329139 Aug 29 15:37:19.268951 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1556/3143] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:18 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1539 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:19.379084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f859d941-e04f-4661-a975-66a44282b6b2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:19.398061 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f859d941-e04f-4661-a975-66a44282b6b2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1318 microversion: 2.1 time: 0.360509 Aug 29 15:37:19.399904 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1588/3144] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:19 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:19.510675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5bc2e809-ac20-4624-9e01-2de8508cb0bf tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:19.511741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5bc2e809-ac20-4624-9e01-2de8508cb0bf tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:19.527088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bc2e809-ac20-4624-9e01-2de8508cb0bf tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.528725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bc2e809-ac20-4624-9e01-2de8508cb0bf tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.529221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bc2e809-ac20-4624-9e01-2de8508cb0bf tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.530354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bc2e809-ac20-4624-9e01-2de8508cb0bf tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.530823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bc2e809-ac20-4624-9e01-2de8508cb0bf tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.531259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bc2e809-ac20-4624-9e01-2de8508cb0bf tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.534604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-99fe0711-4652-4aa6-8d7e-1fc3a68eb1d9 req-efa47dd8-52af-4276-ad1e-b3906d7fb0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a26d1257-743d-4e66-8c12-a7eb833b949b", "name": "network-vif-plugged", "status": "completed", "tag": "344aa345-e02f-423a-b939-d84694888591"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:19.564208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-99fe0711-4652-4aa6-8d7e-1fc3a68eb1d9 req-efa47dd8-52af-4276-ad1e-b3906d7fb0b2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.565607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-99fe0711-4652-4aa6-8d7e-1fc3a68eb1d9 req-efa47dd8-52af-4276-ad1e-b3906d7fb0b2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.566070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-99fe0711-4652-4aa6-8d7e-1fc3a68eb1d9 req-efa47dd8-52af-4276-ad1e-b3906d7fb0b2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.604234 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-99fe0711-4652-4aa6-8d7e-1fc3a68eb1d9 req-efa47dd8-52af-4276-ad1e-b3906d7fb0b2 service nova] Creating event network-vif-plugged:344aa345-e02f-423a-b939-d84694888591 for instance a26d1257-743d-4e66-8c12-a7eb833b949b on n-h2-839401-11 Aug 29 15:37:19.610939 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-99fe0711-4652-4aa6-8d7e-1fc3a68eb1d9 req-efa47dd8-52af-4276-ad1e-b3906d7fb0b2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083211 Aug 29 15:37:19.612827 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1589/3145] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:19.753795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-668b0648-261c-4829-ac66-c9e1cf5c42f5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:19.758725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-668b0648-261c-4829-ac66-c9e1cf5c42f5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:19.782233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-668b0648-261c-4829-ac66-c9e1cf5c42f5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.783798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-668b0648-261c-4829-ac66-c9e1cf5c42f5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.784866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-668b0648-261c-4829-ac66-c9e1cf5c42f5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.787119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-668b0648-261c-4829-ac66-c9e1cf5c42f5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.788807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-668b0648-261c-4829-ac66-c9e1cf5c42f5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.789996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-668b0648-261c-4829-ac66-c9e1cf5c42f5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.932328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5bc2e809-ac20-4624-9e01-2de8508cb0bf tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:19.946546 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5bc2e809-ac20-4624-9e01-2de8508cb0bf tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1313 microversion: 2.1 time: 0.437696 Aug 29 15:37:19.947742 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1557/3146] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:19 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:19.968266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d48fe796-cf4b-4e7e-8f3c-6774b332f6b3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:19.969191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d48fe796-cf4b-4e7e-8f3c-6774b332f6b3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:19.978448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d48fe796-cf4b-4e7e-8f3c-6774b332f6b3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.979191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d48fe796-cf4b-4e7e-8f3c-6774b332f6b3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.980223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d48fe796-cf4b-4e7e-8f3c-6774b332f6b3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:19.981121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d48fe796-cf4b-4e7e-8f3c-6774b332f6b3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:19.981860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d48fe796-cf4b-4e7e-8f3c-6774b332f6b3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:19.982704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d48fe796-cf4b-4e7e-8f3c-6774b332f6b3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:20.191220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-668b0648-261c-4829-ac66-c9e1cf5c42f5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:20.203979 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-668b0648-261c-4829-ac66-c9e1cf5c42f5 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1470 microversion: 2.1 time: 0.457350 Aug 29 15:37:20.223750 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1590/3147] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:19 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1470 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:20.292752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-39b94371-6834-40bb-bab7-450719b56598 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:20.294056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-39b94371-6834-40bb-bab7-450719b56598 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:20.307676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b94371-6834-40bb-bab7-450719b56598 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:20.312087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b94371-6834-40bb-bab7-450719b56598 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:20.313605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b94371-6834-40bb-bab7-450719b56598 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:20.314758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b94371-6834-40bb-bab7-450719b56598 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:20.317421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b94371-6834-40bb-bab7-450719b56598 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:20.317858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b94371-6834-40bb-bab7-450719b56598 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:20.544505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-39b94371-6834-40bb-bab7-450719b56598 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:20.548566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:20.557491 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-39b94371-6834-40bb-bab7-450719b56598 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1539 microversion: 2.1 time: 0.270566 Aug 29 15:37:20.569111 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1591/3148] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:20 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1539 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:20.569111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fd43c775-c313-4f26-bd05-41978088c907 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:20.569111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fd43c775-c313-4f26-bd05-41978088c907 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:20.573544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd43c775-c313-4f26-bd05-41978088c907 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:20.574494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd43c775-c313-4f26-bd05-41978088c907 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:20.575071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd43c775-c313-4f26-bd05-41978088c907 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:20.576002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd43c775-c313-4f26-bd05-41978088c907 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:20.576541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd43c775-c313-4f26-bd05-41978088c907 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:20.577031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd43c775-c313-4f26-bd05-41978088c907 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:20.844215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd43c775-c313-4f26-bd05-41978088c907 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:20.856697 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fd43c775-c313-4f26-bd05-41978088c907 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1318 microversion: 2.1 time: 0.296953 Aug 29 15:37:20.859223 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1592/3149] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:20 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:20.890481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-7b3a0abe-f6d2-4bcb-9480-e25d4ae1250b req-5e12147d-fc3c-474a-91a8-4b1790b93c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401ad5c3-264d-437d-a249-035450439c18", "tag": "bf81ac2f-eb0e-454d-982c-455aa2f19213"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:20.896036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:20.915229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7b3a0abe-f6d2-4bcb-9480-e25d4ae1250b req-5e12147d-fc3c-474a-91a8-4b1790b93c00 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:20.915724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7b3a0abe-f6d2-4bcb-9480-e25d4ae1250b req-5e12147d-fc3c-474a-91a8-4b1790b93c00 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:20.916153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7b3a0abe-f6d2-4bcb-9480-e25d4ae1250b req-5e12147d-fc3c-474a-91a8-4b1790b93c00 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:20.937674 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-7b3a0abe-f6d2-4bcb-9480-e25d4ae1250b req-5e12147d-fc3c-474a-91a8-4b1790b93c00 service nova] Creating event network-changed:bf81ac2f-eb0e-454d-982c-455aa2f19213 for instance 401ad5c3-264d-437d-a249-035450439c18 on n-h1-839401-11 Aug 29 15:37:20.951067 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-7b3a0abe-f6d2-4bcb-9480-e25d4ae1250b req-5e12147d-fc3c-474a-91a8-4b1790b93c00 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064081 Aug 29 15:37:20.953975 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1593/3150] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:20.963415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d48fe796-cf4b-4e7e-8f3c-6774b332f6b3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:20.972223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d167912-a4c7-481f-83a2-9d9fbb98b799 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:20.972223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2d167912-a4c7-481f-83a2-9d9fbb98b799 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:20.981471 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d48fe796-cf4b-4e7e-8f3c-6774b332f6b3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1682 microversion: 2.1 time: 1.021155 Aug 29 15:37:20.994026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d167912-a4c7-481f-83a2-9d9fbb98b799 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:20.994773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d167912-a4c7-481f-83a2-9d9fbb98b799 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:20.995397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d167912-a4c7-481f-83a2-9d9fbb98b799 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:20.996253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d167912-a4c7-481f-83a2-9d9fbb98b799 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:20.996848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d167912-a4c7-481f-83a2-9d9fbb98b799 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:20.997523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d167912-a4c7-481f-83a2-9d9fbb98b799 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:21.013947 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1558/3151] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:19 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1682 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:21.229271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a10e6af-a852-446e-94c8-c96660d97fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:21.230492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a10e6af-a852-446e-94c8-c96660d97fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:21.241852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a10e6af-a852-446e-94c8-c96660d97fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:21.242501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a10e6af-a852-446e-94c8-c96660d97fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:21.243397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a10e6af-a852-446e-94c8-c96660d97fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:21.244637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a10e6af-a852-446e-94c8-c96660d97fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:21.245516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a10e6af-a852-446e-94c8-c96660d97fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:21.246371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a10e6af-a852-446e-94c8-c96660d97fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:21.335402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d167912-a4c7-481f-83a2-9d9fbb98b799 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:21.346038 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d167912-a4c7-481f-83a2-9d9fbb98b799 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1313 microversion: 2.1 time: 0.381578 Aug 29 15:37:21.347018 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1594/3152] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:20 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:21.581749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a0352d77-bcc8-45d8-98a6-e3f7975efec8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:21.582386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a0352d77-bcc8-45d8-98a6-e3f7975efec8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:21.594464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0352d77-bcc8-45d8-98a6-e3f7975efec8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:21.594969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0352d77-bcc8-45d8-98a6-e3f7975efec8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:21.596499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0352d77-bcc8-45d8-98a6-e3f7975efec8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:21.597335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0352d77-bcc8-45d8-98a6-e3f7975efec8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:21.597799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0352d77-bcc8-45d8-98a6-e3f7975efec8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:21.598253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0352d77-bcc8-45d8-98a6-e3f7975efec8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:21.824209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5a10e6af-a852-446e-94c8-c96660d97fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:21.838431 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5a10e6af-a852-446e-94c8-c96660d97fd8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1463 microversion: 2.1 time: 0.614097 Aug 29 15:37:21.853889 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1559/3153] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:21 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1463 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:21.865459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f892279f-40d2-4c14-943c-104320e6b1bc req-c354d5d3-37cf-4b9b-a434-297826a51678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8794d0c2-c530-4890-935c-4addf377478c", "name": "network-vif-plugged", "status": "completed", "tag": "0994906b-e8c7-441c-937e-88a208667dd1"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:21.871093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a0352d77-bcc8-45d8-98a6-e3f7975efec8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:21.881718 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a0352d77-bcc8-45d8-98a6-e3f7975efec8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1539 microversion: 2.1 time: 0.303715 Aug 29 15:37:21.883459 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1595/3154] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:21 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1539 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:21.884834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f892279f-40d2-4c14-943c-104320e6b1bc req-c354d5d3-37cf-4b9b-a434-297826a51678 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:21.885456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f892279f-40d2-4c14-943c-104320e6b1bc req-c354d5d3-37cf-4b9b-a434-297826a51678 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:21.886238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f892279f-40d2-4c14-943c-104320e6b1bc req-c354d5d3-37cf-4b9b-a434-297826a51678 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:21.889685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-282574638", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2af9e937-0e76-45e3-a5d7-060213c8be09"}, {"port": "898c5b2c-e9b1-4662-8491-a1b8d879ce2b", "tag": "port-1"}, {"port": "c7354a20-9cbe-469c-965c-d5e127f1f1bc", "tag": "port-2"}, {"uuid": "c9df24c8-fbdc-4388-9343-e766ece29cc1", "tag": "net-1"}, {"uuid": "c9df24c8-fbdc-4388-9343-e766ece29cc1"}, {"uuid": "d791af12-98be-49b7-b952-1b4bf5b6a50f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d791af12-98be-49b7-b952-1b4bf5b6a50f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "9c0f5124-312c-49db-b75a-d7a231d9a79a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1919e5fb-7bea-4d29-bd7e-b71d8f8a5e7d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "94374595-95e3-4629-be8c-98778da398e2", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2067421718"}], "key_name": "tempest-keypair-1528689471", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:21.900979 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f892279f-40d2-4c14-943c-104320e6b1bc req-c354d5d3-37cf-4b9b-a434-297826a51678 service nova] Creating event network-vif-plugged:0994906b-e8c7-441c-937e-88a208667dd1 for instance 8794d0c2-c530-4890-935c-4addf377478c on n-h1-839401-11 Aug 29 15:37:21.909622 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f892279f-40d2-4c14-943c-104320e6b1bc req-c354d5d3-37cf-4b9b-a434-297826a51678 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054247 Aug 29 15:37:21.910802 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1560/3155] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:22.093711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] validate_networks() for [('2af9e937-0e76-45e3-a5d7-060213c8be09', None, None, None, None, None), (None, None, '898c5b2c-e9b1-4662-8491-a1b8d879ce2b', None, None, None), (None, None, 'c7354a20-9cbe-469c-965c-d5e127f1f1bc', None, None, None), ('c9df24c8-fbdc-4388-9343-e766ece29cc1', None, None, None, None, None), ('c9df24c8-fbdc-4388-9343-e766ece29cc1', None, None, None, None, None), ('d791af12-98be-49b7-b952-1b4bf5b6a50f', '10.2.2.100', None, None, None, None), ('d791af12-98be-49b7-b952-1b4bf5b6a50f', '10.2.2.200', None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:37:22.362740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f6bed85e-7866-44e2-a012-1962ad3c47c2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:22.363472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f6bed85e-7866-44e2-a012-1962ad3c47c2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:22.370888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6bed85e-7866-44e2-a012-1962ad3c47c2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:22.371991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6bed85e-7866-44e2-a012-1962ad3c47c2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:22.372746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6bed85e-7866-44e2-a012-1962ad3c47c2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:22.374403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6bed85e-7866-44e2-a012-1962ad3c47c2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:22.375408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6bed85e-7866-44e2-a012-1962ad3c47c2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:22.376422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6bed85e-7866-44e2-a012-1962ad3c47c2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:22.629766 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f6bed85e-7866-44e2-a012-1962ad3c47c2 tempest-MigrationsAdminTest-651344996 tempest-MigrationsAdminTest-651344996-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1616 microversion: 2.1 time: 0.717430 Aug 29 15:37:22.630363 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1561/3156] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:21 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1616 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:22.635249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-79c5e138-4f73-4092-8078-d17e68d49886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:22.635855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-79c5e138-4f73-4092-8078-d17e68d49886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:22.642478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79c5e138-4f73-4092-8078-d17e68d49886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:22.643163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79c5e138-4f73-4092-8078-d17e68d49886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:22.657127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79c5e138-4f73-4092-8078-d17e68d49886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:22.657127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79c5e138-4f73-4092-8078-d17e68d49886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:22.657127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79c5e138-4f73-4092-8078-d17e68d49886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:22.657127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79c5e138-4f73-4092-8078-d17e68d49886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:22.808142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-79c5e138-4f73-4092-8078-d17e68d49886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:22.818089 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-79c5e138-4f73-4092-8078-d17e68d49886 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1318 microversion: 2.1 time: 0.186461 Aug 29 15:37:22.818689 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1562/3157] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:22 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:22.826213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3c9dd8e7-ec15-4ac4-8a5d-4c278e9c031a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:22.827073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3c9dd8e7-ec15-4ac4-8a5d-4c278e9c031a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:22.834012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c9dd8e7-ec15-4ac4-8a5d-4c278e9c031a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:22.834514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c9dd8e7-ec15-4ac4-8a5d-4c278e9c031a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:22.834955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c9dd8e7-ec15-4ac4-8a5d-4c278e9c031a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:22.835634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c9dd8e7-ec15-4ac4-8a5d-4c278e9c031a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:22.836109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c9dd8e7-ec15-4ac4-8a5d-4c278e9c031a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:22.836566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c9dd8e7-ec15-4ac4-8a5d-4c278e9c031a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:22.982229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3c9dd8e7-ec15-4ac4-8a5d-4c278e9c031a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:22.991421 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3c9dd8e7-ec15-4ac4-8a5d-4c278e9c031a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.169193 Aug 29 15:37:22.992660 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1563/3158] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:22 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:22.997561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-00a082df-44f1-4bc6-b15b-94dfa6ff67eb tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:22.998415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-00a082df-44f1-4bc6-b15b-94dfa6ff67eb tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:23.005050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00a082df-44f1-4bc6-b15b-94dfa6ff67eb tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.005842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00a082df-44f1-4bc6-b15b-94dfa6ff67eb tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.006450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00a082df-44f1-4bc6-b15b-94dfa6ff67eb tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:23.007306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00a082df-44f1-4bc6-b15b-94dfa6ff67eb tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.007907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00a082df-44f1-4bc6-b15b-94dfa6ff67eb tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.008549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00a082df-44f1-4bc6-b15b-94dfa6ff67eb tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:23.150597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-00a082df-44f1-4bc6-b15b-94dfa6ff67eb tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:23.159836 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-00a082df-44f1-4bc6-b15b-94dfa6ff67eb tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1498 microversion: 2.1 time: 0.165963 Aug 29 15:37:23.167112 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1564/3159] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:22 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1498 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:23.167112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ccf62932-ff79-40f6-835a-4cce367cd54a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:23.167112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ccf62932-ff79-40f6-835a-4cce367cd54a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:23.174048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccf62932-ff79-40f6-835a-4cce367cd54a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.175293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccf62932-ff79-40f6-835a-4cce367cd54a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.175822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccf62932-ff79-40f6-835a-4cce367cd54a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:23.176660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccf62932-ff79-40f6-835a-4cce367cd54a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.177146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccf62932-ff79-40f6-835a-4cce367cd54a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.177566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccf62932-ff79-40f6-835a-4cce367cd54a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:23.207201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ccf62932-ff79-40f6-835a-4cce367cd54a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:37:23.210360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:23.313653 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ccf62932-ff79-40f6-835a-4cce367cd54a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 204 len: 0 microversion: 2.1 time: 0.151731 Aug 29 15:37:23.314268 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1565/3160] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:23 2022] DELETE /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:37:23.324678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2e959187-41cb-41dc-87bd-0e7af11286fe tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:23.325537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2e959187-41cb-41dc-87bd-0e7af11286fe tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:23.331981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e959187-41cb-41dc-87bd-0e7af11286fe tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.332567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e959187-41cb-41dc-87bd-0e7af11286fe tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.333013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e959187-41cb-41dc-87bd-0e7af11286fe tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:23.333749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e959187-41cb-41dc-87bd-0e7af11286fe tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.334201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e959187-41cb-41dc-87bd-0e7af11286fe tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.334631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e959187-41cb-41dc-87bd-0e7af11286fe tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:23.489010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2e959187-41cb-41dc-87bd-0e7af11286fe tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:23.498018 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2e959187-41cb-41dc-87bd-0e7af11286fe tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1521 microversion: 2.1 time: 0.182424 Aug 29 15:37:23.499132 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1566/3161] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:23 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:23.504997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-984135a7-fae6-47ca-aeb6-0ba2ece6af18 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1317557758"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:23.507520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-984135a7-fae6-47ca-aeb6-0ba2ece6af18 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:23.513989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-984135a7-fae6-47ca-aeb6-0ba2ece6af18 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.514518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-984135a7-fae6-47ca-aeb6-0ba2ece6af18 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.514972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-984135a7-fae6-47ca-aeb6-0ba2ece6af18 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:23.515661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-984135a7-fae6-47ca-aeb6-0ba2ece6af18 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.516123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-984135a7-fae6-47ca-aeb6-0ba2ece6af18 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.516548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-984135a7-fae6-47ca-aeb6-0ba2ece6af18 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:23.762623 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-984135a7-fae6-47ca-aeb6-0ba2ece6af18 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 202 len: 0 microversion: 2.1 time: 0.259533 Aug 29 15:37:23.763929 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1567/3162] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:37:23 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 29 15:37:23.774099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a2992b13-9c2a-465d-9170-615ec483698c tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:23.799001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.compute.server_groups [None req-a2992b13-9c2a-465d-9170-615ec483698c tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Querying cell dcf211bc-da73-4d63-b885-2b9e7c1e329b(cell1) for 1 instances {{(pid=122361) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 15:37:23.799754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2992b13-9c2a-465d-9170-615ec483698c tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.800330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2992b13-9c2a-465d-9170-615ec483698c tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.800778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2992b13-9c2a-465d-9170-615ec483698c tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:23.834467 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a2992b13-9c2a-465d-9170-615ec483698c tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/os-server-groups/049cc90a-d189-4922-8757-c2c9c2820458" status: 200 len: 222 microversion: 2.1 time: 0.068535 Aug 29 15:37:23.834973 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1568/3163] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:37:23 2022] GET /compute/v2.1/os-server-groups/049cc90a-d189-4922-8757-c2c9c2820458 => generated 222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:23.840472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-08caee5b-6e0c-43ab-a4bf-9cbfa928dcb0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:23.841748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-08caee5b-6e0c-43ab-a4bf-9cbfa928dcb0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:23.860430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08caee5b-6e0c-43ab-a4bf-9cbfa928dcb0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.860937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08caee5b-6e0c-43ab-a4bf-9cbfa928dcb0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.861563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08caee5b-6e0c-43ab-a4bf-9cbfa928dcb0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:23.862303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08caee5b-6e0c-43ab-a4bf-9cbfa928dcb0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:23.862770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08caee5b-6e0c-43ab-a4bf-9cbfa928dcb0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:23.863337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08caee5b-6e0c-43ab-a4bf-9cbfa928dcb0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.059414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-08caee5b-6e0c-43ab-a4bf-9cbfa928dcb0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:24.070884 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-08caee5b-6e0c-43ab-a4bf-9cbfa928dcb0 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1469 microversion: 2.1 time: 0.234407 Aug 29 15:37:24.072424 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1569/3164] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:23 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1469 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:24.077229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a09725fa-2808-45e8-856a-ad2750e4702e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:24.077882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a09725fa-2808-45e8-856a-ad2750e4702e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:24.085357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a09725fa-2808-45e8-856a-ad2750e4702e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.085792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a09725fa-2808-45e8-856a-ad2750e4702e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.086286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a09725fa-2808-45e8-856a-ad2750e4702e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.087103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a09725fa-2808-45e8-856a-ad2750e4702e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.087533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a09725fa-2808-45e8-856a-ad2750e4702e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.088101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a09725fa-2808-45e8-856a-ad2750e4702e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.118587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a09725fa-2808-45e8-856a-ad2750e4702e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:37:24.226158 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a09725fa-2808-45e8-856a-ad2750e4702e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 204 len: 0 microversion: 2.1 time: 0.151949 Aug 29 15:37:24.227073 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1570/3165] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:24 2022] DELETE /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:37:24.236458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a0a5dd25-4911-4c47-9c1a-953e42864072 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:24.237049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a0a5dd25-4911-4c47-9c1a-953e42864072 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:24.243419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0a5dd25-4911-4c47-9c1a-953e42864072 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.244017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0a5dd25-4911-4c47-9c1a-953e42864072 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.244499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0a5dd25-4911-4c47-9c1a-953e42864072 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.245232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0a5dd25-4911-4c47-9c1a-953e42864072 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.245682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0a5dd25-4911-4c47-9c1a-953e42864072 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.246107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0a5dd25-4911-4c47-9c1a-953e42864072 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.276401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a0a5dd25-4911-4c47-9c1a-953e42864072 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:37:24.363552 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a0a5dd25-4911-4c47-9c1a-953e42864072 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 204 len: 0 microversion: 2.1 time: 0.131668 Aug 29 15:37:24.364486 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1571/3166] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:24 2022] DELETE /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:37:24.371519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cffe93fa-4213-45d8-9675-d7fee192ddb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:24.372868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cffe93fa-4213-45d8-9675-d7fee192ddb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:24.378375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffe93fa-4213-45d8-9675-d7fee192ddb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.378855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffe93fa-4213-45d8-9675-d7fee192ddb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.379286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffe93fa-4213-45d8-9675-d7fee192ddb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.379970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffe93fa-4213-45d8-9675-d7fee192ddb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.380416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffe93fa-4213-45d8-9675-d7fee192ddb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.380835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffe93fa-4213-45d8-9675-d7fee192ddb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.522968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cffe93fa-4213-45d8-9675-d7fee192ddb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:24.532337 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cffe93fa-4213-45d8-9675-d7fee192ddb4 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1508 microversion: 2.1 time: 0.166029 Aug 29 15:37:24.532921 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1572/3167] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:24 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:24.537903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-09657bc3-a1d8-4672-911d-8b2c8c431879 req-888a3d45-8790-48f1-9b9d-75de641b073c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b6cfb1a-bfac-45e1-9b33-2e080c11f838", "name": "network-vif-plugged", "status": "completed", "tag": "2e7d7a73-65af-4b13-a5be-e623d343d65d"}, {"server_uuid": "0330d585-be01-45a3-b20a-9ce9cdfbaa43", "name": "network-vif-plugged", "status": "completed", "tag": "53083e31-a61d-4467-9153-eb9ce7344ee5"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:24.559643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-09657bc3-a1d8-4672-911d-8b2c8c431879 req-888a3d45-8790-48f1-9b9d-75de641b073c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.560583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-09657bc3-a1d8-4672-911d-8b2c8c431879 req-888a3d45-8790-48f1-9b9d-75de641b073c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.561666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-09657bc3-a1d8-4672-911d-8b2c8c431879 req-888a3d45-8790-48f1-9b9d-75de641b073c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.579081 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-09657bc3-a1d8-4672-911d-8b2c8c431879 req-888a3d45-8790-48f1-9b9d-75de641b073c service nova] Creating event network-vif-plugged:2e7d7a73-65af-4b13-a5be-e623d343d65d for instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 on n-h1-839401-11 Aug 29 15:37:24.579692 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-09657bc3-a1d8-4672-911d-8b2c8c431879 req-888a3d45-8790-48f1-9b9d-75de641b073c service nova] Creating event network-vif-plugged:53083e31-a61d-4467-9153-eb9ce7344ee5 for instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 on n-h2-839401-11 Aug 29 15:37:24.589068 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-09657bc3-a1d8-4672-911d-8b2c8c431879 req-888a3d45-8790-48f1-9b9d-75de641b073c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054421 Aug 29 15:37:24.589695 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1573/3168] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:24.598754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0f092c5d-a983-476a-a58d-c4895c4f6dcd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:24.599594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0f092c5d-a983-476a-a58d-c4895c4f6dcd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:24.606253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f092c5d-a983-476a-a58d-c4895c4f6dcd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.606751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f092c5d-a983-476a-a58d-c4895c4f6dcd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.607187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f092c5d-a983-476a-a58d-c4895c4f6dcd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.607900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f092c5d-a983-476a-a58d-c4895c4f6dcd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.608590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f092c5d-a983-476a-a58d-c4895c4f6dcd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.608889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f092c5d-a983-476a-a58d-c4895c4f6dcd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.761425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0f092c5d-a983-476a-a58d-c4895c4f6dcd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:24.770739 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0f092c5d-a983-476a-a58d-c4895c4f6dcd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1527 microversion: 2.1 time: 0.176287 Aug 29 15:37:24.771329 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1574/3169] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:24 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1527 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:24.776412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fa7ff15f-c195-40e4-9b38-0e1ed1a99fe4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:24.777078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fa7ff15f-c195-40e4-9b38-0e1ed1a99fe4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:24.783259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa7ff15f-c195-40e4-9b38-0e1ed1a99fe4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.783757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa7ff15f-c195-40e4-9b38-0e1ed1a99fe4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.784185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa7ff15f-c195-40e4-9b38-0e1ed1a99fe4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.784874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa7ff15f-c195-40e4-9b38-0e1ed1a99fe4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.785350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa7ff15f-c195-40e4-9b38-0e1ed1a99fe4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.785764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa7ff15f-c195-40e4-9b38-0e1ed1a99fe4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.822766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:37:24.823418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:37:24.823976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:37:24.824452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:37:24.825062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:37:24.847130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.847130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.847130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.847130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.847130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.847130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.867726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Getting quotas for project 64900d09e46d44e58a07e062a419bc09. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:37:24.876761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Getting quotas for user 06adfce1215a460d8b289916b806b0b9 and project 64900d09e46d44e58a07e062a419bc09. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:37:24.945060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fa7ff15f-c195-40e4-9b38-0e1ed1a99fe4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:24.954216 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fa7ff15f-c195-40e4-9b38-0e1ed1a99fe4 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1504 microversion: 2.1 time: 0.181448 Aug 29 15:37:24.956630 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1575/3170] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:24 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:24.960156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-59456557-5da0-4ea5-b3d3-56ebc4d742f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:24.960920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-59456557-5da0-4ea5-b3d3-56ebc4d742f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:24.963076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:24.971864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59456557-5da0-4ea5-b3d3-56ebc4d742f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.972545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59456557-5da0-4ea5-b3d3-56ebc4d742f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.973002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59456557-5da0-4ea5-b3d3-56ebc4d742f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:24.973883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59456557-5da0-4ea5-b3d3-56ebc4d742f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:24.974429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59456557-5da0-4ea5-b3d3-56ebc4d742f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:24.974856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59456557-5da0-4ea5-b3d3-56ebc4d742f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:25.058233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:37:25.061369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='9c0f5124-312c-49db-b75a-d7a231d9a79a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1919e5fb-7bea-4d29-bd7e-b71d8f8a5e7d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94374595-95e3-4629-be8c-98778da398e2',volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:37:25.146009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-59456557-5da0-4ea5-b3d3-56ebc4d742f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:25.155162 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-59456557-5da0-4ea5-b3d3-56ebc4d742f5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1508 microversion: 2.1 time: 0.198806 Aug 29 15:37:25.155979 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1576/3171] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:24 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:25.176080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9a276114-972d-4fc2-b0ec-6076b083984f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:25.176695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9a276114-972d-4fc2-b0ec-6076b083984f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:25.183360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a276114-972d-4fc2-b0ec-6076b083984f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:25.183846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a276114-972d-4fc2-b0ec-6076b083984f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:25.184397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a276114-972d-4fc2-b0ec-6076b083984f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:25.185128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a276114-972d-4fc2-b0ec-6076b083984f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:25.185749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a276114-972d-4fc2-b0ec-6076b083984f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:25.186718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a276114-972d-4fc2-b0ec-6076b083984f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:25.192958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:25.337592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9a276114-972d-4fc2-b0ec-6076b083984f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:25.346750 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9a276114-972d-4fc2-b0ec-6076b083984f tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1469 microversion: 2.1 time: 0.176370 Aug 29 15:37:25.360905 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1577/3172] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:25 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1469 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:25.360905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eda585e4-c15e-4135-ad16-eaae1a2ddaca tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:25.360905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eda585e4-c15e-4135-ad16-eaae1a2ddaca tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:25.366452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eda585e4-c15e-4135-ad16-eaae1a2ddaca tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:25.367160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eda585e4-c15e-4135-ad16-eaae1a2ddaca tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:25.367725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eda585e4-c15e-4135-ad16-eaae1a2ddaca tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:25.368532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eda585e4-c15e-4135-ad16-eaae1a2ddaca tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:25.369074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eda585e4-c15e-4135-ad16-eaae1a2ddaca tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:25.369888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eda585e4-c15e-4135-ad16-eaae1a2ddaca tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:25.443002 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fa08d32f-12d6-4251-aeb9-c91a8841694d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 3.557655 Aug 29 15:37:25.444182 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1596/3173] 10.222.0.62 () {62 vars in 1189 bytes} [Mon Aug 29 15:37:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 3560 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:37:25.445858 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eda585e4-c15e-4135-ad16-eaae1a2ddaca tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "PUT /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1080 microversion: 2.1 time: 0.097156 Aug 29 15:37:25.459924 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1578/3174] 10.222.0.62 () {60 vars in 1256 bytes} [Mon Aug 29 15:37:25 2022] PUT /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1080 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:25.460176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-15d6c9bb-bf2e-4918-aebd-3cdc6a9105fe tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:25.460176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-15d6c9bb-bf2e-4918-aebd-3cdc6a9105fe tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:25.470169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b2f94851-ca5a-43db-a630-eb42e2f4f2e9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:25.471059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b2f94851-ca5a-43db-a630-eb42e2f4f2e9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:25.477657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2f94851-ca5a-43db-a630-eb42e2f4f2e9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:25.478157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2f94851-ca5a-43db-a630-eb42e2f4f2e9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:25.478593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2f94851-ca5a-43db-a630-eb42e2f4f2e9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:25.479345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2f94851-ca5a-43db-a630-eb42e2f4f2e9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:25.479804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2f94851-ca5a-43db-a630-eb42e2f4f2e9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:25.480227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2f94851-ca5a-43db-a630-eb42e2f4f2e9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:25.559790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-15d6c9bb-bf2e-4918-aebd-3cdc6a9105fe tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:25.577078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-15d6c9bb-bf2e-4918-aebd-3cdc6a9105fe tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:25.578777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-15d6c9bb-bf2e-4918-aebd-3cdc6a9105fe tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:25.579950 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-15d6c9bb-bf2e-4918-aebd-3cdc6a9105fe tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1285 microversion: 2.42 time: 0.128291 Aug 29 15:37:25.593487 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1597/3175] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:25 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:25.650114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b2f94851-ca5a-43db-a630-eb42e2f4f2e9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:25.659016 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b2f94851-ca5a-43db-a630-eb42e2f4f2e9 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1506 microversion: 2.1 time: 0.196267 Aug 29 15:37:25.659852 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1579/3176] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:25 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:25.686041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e54fabb6-52f1-4050-8ba9-d15c84b3daef tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:25.686700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e54fabb6-52f1-4050-8ba9-d15c84b3daef tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:25.706190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e54fabb6-52f1-4050-8ba9-d15c84b3daef tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:25.706728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e54fabb6-52f1-4050-8ba9-d15c84b3daef tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:25.707173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e54fabb6-52f1-4050-8ba9-d15c84b3daef tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:25.707914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e54fabb6-52f1-4050-8ba9-d15c84b3daef tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:25.710212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e54fabb6-52f1-4050-8ba9-d15c84b3daef tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:25.711641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e54fabb6-52f1-4050-8ba9-d15c84b3daef tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:25.792270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d131d4c6-0a93-4a62-b1f5-f35c7b9d00bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:25.793475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d131d4c6-0a93-4a62-b1f5-f35c7b9d00bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:25.799882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d131d4c6-0a93-4a62-b1f5-f35c7b9d00bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:25.800361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d131d4c6-0a93-4a62-b1f5-f35c7b9d00bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:25.800980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d131d4c6-0a93-4a62-b1f5-f35c7b9d00bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:25.801859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d131d4c6-0a93-4a62-b1f5-f35c7b9d00bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:25.802464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d131d4c6-0a93-4a62-b1f5-f35c7b9d00bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:25.803035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d131d4c6-0a93-4a62-b1f5-f35c7b9d00bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:25.886433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e54fabb6-52f1-4050-8ba9-d15c84b3daef tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:25.902931 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e54fabb6-52f1-4050-8ba9-d15c84b3daef tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1506 microversion: 2.1 time: 0.222895 Aug 29 15:37:25.905518 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1598/3177] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:25 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:25.926555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1c2eab81-b747-4612-b7e4-2e28db4cd7a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:25.929242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1c2eab81-b747-4612-b7e4-2e28db4cd7a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:25.936239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c2eab81-b747-4612-b7e4-2e28db4cd7a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:25.936810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c2eab81-b747-4612-b7e4-2e28db4cd7a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:25.937323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c2eab81-b747-4612-b7e4-2e28db4cd7a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:25.938089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c2eab81-b747-4612-b7e4-2e28db4cd7a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:25.938609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c2eab81-b747-4612-b7e4-2e28db4cd7a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:25.939091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c2eab81-b747-4612-b7e4-2e28db4cd7a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.002319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d131d4c6-0a93-4a62-b1f5-f35c7b9d00bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:26.016293 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d131d4c6-0a93-4a62-b1f5-f35c7b9d00bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1527 microversion: 2.1 time: 0.227762 Aug 29 15:37:26.021379 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1580/3178] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:25 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1527 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:26.033812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7d6efdae-66ec-49d4-a777-3cf8f83c0cb8 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:26.034825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7d6efdae-66ec-49d4-a777-3cf8f83c0cb8 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:26.043874 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1c2eab81-b747-4612-b7e4-2e28db4cd7a6 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "PUT /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1082 microversion: 2.1 time: 0.122913 Aug 29 15:37:26.045034 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1599/3179] 10.222.0.62 () {60 vars in 1256 bytes} [Mon Aug 29 15:37:25 2022] PUT /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1082 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:26.057655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d6efdae-66ec-49d4-a777-3cf8f83c0cb8 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.058550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d6efdae-66ec-49d4-a777-3cf8f83c0cb8 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.059249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d6efdae-66ec-49d4-a777-3cf8f83c0cb8 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.060486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d6efdae-66ec-49d4-a777-3cf8f83c0cb8 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.061285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d6efdae-66ec-49d4-a777-3cf8f83c0cb8 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.062477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d6efdae-66ec-49d4-a777-3cf8f83c0cb8 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.063122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b61de372-f35b-421b-9a32-67c82ee88dd5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:26.064064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b61de372-f35b-421b-9a32-67c82ee88dd5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:26.070449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b61de372-f35b-421b-9a32-67c82ee88dd5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.070935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b61de372-f35b-421b-9a32-67c82ee88dd5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.071372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b61de372-f35b-421b-9a32-67c82ee88dd5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.072081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b61de372-f35b-421b-9a32-67c82ee88dd5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.072533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b61de372-f35b-421b-9a32-67c82ee88dd5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.072951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b61de372-f35b-421b-9a32-67c82ee88dd5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.228211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b61de372-f35b-421b-9a32-67c82ee88dd5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:26.237364 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b61de372-f35b-421b-9a32-67c82ee88dd5 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1508 microversion: 2.1 time: 0.178353 Aug 29 15:37:26.239181 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1600/3180] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:26 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:26.260052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-638d560d-f03d-4f23-9fb0-e5a0015ab2dd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:26.262222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-638d560d-f03d-4f23-9fb0-e5a0015ab2dd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:26.269034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-638d560d-f03d-4f23-9fb0-e5a0015ab2dd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.270015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-638d560d-f03d-4f23-9fb0-e5a0015ab2dd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.270460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-638d560d-f03d-4f23-9fb0-e5a0015ab2dd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.271165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-638d560d-f03d-4f23-9fb0-e5a0015ab2dd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.271620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-638d560d-f03d-4f23-9fb0-e5a0015ab2dd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.272365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-638d560d-f03d-4f23-9fb0-e5a0015ab2dd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.429826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7d6efdae-66ec-49d4-a777-3cf8f83c0cb8 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:26.442164 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7d6efdae-66ec-49d4-a777-3cf8f83c0cb8 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1504 microversion: 2.1 time: 0.418884 Aug 29 15:37:26.443015 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1581/3181] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:26 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1504 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:26.447990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f8aaaaf-a4c9-436b-ac36-611c76565e28 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:26.448610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9f8aaaaf-a4c9-436b-ac36-611c76565e28 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:26.456827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f8aaaaf-a4c9-436b-ac36-611c76565e28 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.457488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f8aaaaf-a4c9-436b-ac36-611c76565e28 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.458140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f8aaaaf-a4c9-436b-ac36-611c76565e28 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.458923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f8aaaaf-a4c9-436b-ac36-611c76565e28 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.459471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f8aaaaf-a4c9-436b-ac36-611c76565e28 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.459970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f8aaaaf-a4c9-436b-ac36-611c76565e28 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.508104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-638d560d-f03d-4f23-9fb0-e5a0015ab2dd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:26.518036 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-638d560d-f03d-4f23-9fb0-e5a0015ab2dd tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1508 microversion: 2.1 time: 0.262646 Aug 29 15:37:26.518960 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1601/3182] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:26 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1508 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:26.541049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a021c0aa-1900-44d7-86fb-9f7382911e1a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:26.541880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a021c0aa-1900-44d7-86fb-9f7382911e1a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:26.549120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a021c0aa-1900-44d7-86fb-9f7382911e1a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.550788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a021c0aa-1900-44d7-86fb-9f7382911e1a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.551413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a021c0aa-1900-44d7-86fb-9f7382911e1a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.552389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a021c0aa-1900-44d7-86fb-9f7382911e1a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.553015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a021c0aa-1900-44d7-86fb-9f7382911e1a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.553692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a021c0aa-1900-44d7-86fb-9f7382911e1a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.597165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a021c0aa-1900-44d7-86fb-9f7382911e1a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:37:26.712564 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a021c0aa-1900-44d7-86fb-9f7382911e1a tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 204 len: 0 microversion: 2.1 time: 0.175550 Aug 29 15:37:26.713308 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1602/3183] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:26 2022] DELETE /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:37:26.719155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4c70ee98-af9c-419c-83b3-d10a19489aec tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:26.720270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4c70ee98-af9c-419c-83b3-d10a19489aec tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:26.726600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c70ee98-af9c-419c-83b3-d10a19489aec tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.727088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c70ee98-af9c-419c-83b3-d10a19489aec tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.727561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c70ee98-af9c-419c-83b3-d10a19489aec tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.728428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c70ee98-af9c-419c-83b3-d10a19489aec tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.729320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c70ee98-af9c-419c-83b3-d10a19489aec tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.729955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c70ee98-af9c-419c-83b3-d10a19489aec tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.813920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4c70ee98-af9c-419c-83b3-d10a19489aec tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:26.825399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4c70ee98-af9c-419c-83b3-d10a19489aec tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:26.834590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4c70ee98-af9c-419c-83b3-d10a19489aec tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:26.836314 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4c70ee98-af9c-419c-83b3-d10a19489aec tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1519 microversion: 2.42 time: 0.121566 Aug 29 15:37:26.837444 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1603/3184] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:26 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1519 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:26.842765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-d1857387-10a8-4996-8525-b12e1cdf181a req-3471bc79-74fb-4f89-8e20-39cd691d4ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af95f7c-5362-4cf9-b80e-38cd6a518783", "name": "network-vif-unplugged", "status": "completed", "tag": "2984ebfd-8f23-4f8e-83af-0a164bd8c5aa"}, {"server_uuid": "2b6cfb1a-bfac-45e1-9b33-2e080c11f838", "name": "network-vif-unplugged", "status": "completed", "tag": "2e7d7a73-65af-4b13-a5be-e623d343d65d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:26.857574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d1857387-10a8-4996-8525-b12e1cdf181a req-3471bc79-74fb-4f89-8e20-39cd691d4ebc service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.861967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d1857387-10a8-4996-8525-b12e1cdf181a req-3471bc79-74fb-4f89-8e20-39cd691d4ebc service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.862862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d1857387-10a8-4996-8525-b12e1cdf181a req-3471bc79-74fb-4f89-8e20-39cd691d4ebc service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.885715 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-d1857387-10a8-4996-8525-b12e1cdf181a req-3471bc79-74fb-4f89-8e20-39cd691d4ebc service nova] Creating event network-vif-unplugged:2984ebfd-8f23-4f8e-83af-0a164bd8c5aa for instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 on n-h2-839401-11 Aug 29 15:37:26.886466 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-d1857387-10a8-4996-8525-b12e1cdf181a req-3471bc79-74fb-4f89-8e20-39cd691d4ebc service nova] Creating event network-vif-unplugged:2e7d7a73-65af-4b13-a5be-e623d343d65d for instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 on n-h1-839401-11 Aug 29 15:37:26.900344 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-d1857387-10a8-4996-8525-b12e1cdf181a req-3471bc79-74fb-4f89-8e20-39cd691d4ebc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.061157 Aug 29 15:37:26.906094 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1604/3185] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:26.913042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3b06275c-9d75-44bf-987e-bde36464501c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:26.913672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3b06275c-9d75-44bf-987e-bde36464501c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:26.921438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b06275c-9d75-44bf-987e-bde36464501c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.921935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b06275c-9d75-44bf-987e-bde36464501c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.922374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b06275c-9d75-44bf-987e-bde36464501c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.923089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b06275c-9d75-44bf-987e-bde36464501c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:26.923596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b06275c-9d75-44bf-987e-bde36464501c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:26.924062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b06275c-9d75-44bf-987e-bde36464501c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:26.955496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3b06275c-9d75-44bf-987e-bde36464501c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:37:26.978226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9f8aaaaf-a4c9-436b-ac36-611c76565e28 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:26.987416 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9f8aaaaf-a4c9-436b-ac36-611c76565e28 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1469 microversion: 2.1 time: 0.543190 Aug 29 15:37:27.001931 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1582/3186] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:26 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1469 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:27.027210 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.compute.api [None req-3b06275c-9d75-44bf-987e-bde36464501c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Instance is already in deleting state, ignoring this request Aug 29 15:37:27.028254 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3b06275c-9d75-44bf-987e-bde36464501c tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 204 len: 0 microversion: 2.1 time: 0.120728 Aug 29 15:37:27.029054 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1605/3187] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:26 2022] DELETE /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:37:27.039575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8cbe277d-26a0-49d1-8e4a-5fe8207bc8b1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:27.040210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8cbe277d-26a0-49d1-8e4a-5fe8207bc8b1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:27.047109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cbe277d-26a0-49d1-8e4a-5fe8207bc8b1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:27.047749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cbe277d-26a0-49d1-8e4a-5fe8207bc8b1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:27.048207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cbe277d-26a0-49d1-8e4a-5fe8207bc8b1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:27.048929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cbe277d-26a0-49d1-8e4a-5fe8207bc8b1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:27.049446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cbe277d-26a0-49d1-8e4a-5fe8207bc8b1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:27.050045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cbe277d-26a0-49d1-8e4a-5fe8207bc8b1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:27.059286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4a55f6bd-6735-410d-a527-97f073ac3105 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:27.061817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4a55f6bd-6735-410d-a527-97f073ac3105 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:27.070076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a55f6bd-6735-410d-a527-97f073ac3105 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:27.070901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a55f6bd-6735-410d-a527-97f073ac3105 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:27.071537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a55f6bd-6735-410d-a527-97f073ac3105 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:27.072408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a55f6bd-6735-410d-a527-97f073ac3105 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:27.073297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a55f6bd-6735-410d-a527-97f073ac3105 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:27.074118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a55f6bd-6735-410d-a527-97f073ac3105 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:27.294568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4a55f6bd-6735-410d-a527-97f073ac3105 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:27.303174 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4a55f6bd-6735-410d-a527-97f073ac3105 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1527 microversion: 2.1 time: 0.254179 Aug 29 15:37:27.303933 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1606/3188] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:27 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1527 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:27.466884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9ab42ca8-fb87-421b-8d5c-c9e770bb66e5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:27.467579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9ab42ca8-fb87-421b-8d5c-c9e770bb66e5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:27.474199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ab42ca8-fb87-421b-8d5c-c9e770bb66e5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:27.474694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ab42ca8-fb87-421b-8d5c-c9e770bb66e5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:27.475189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ab42ca8-fb87-421b-8d5c-c9e770bb66e5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:27.475903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ab42ca8-fb87-421b-8d5c-c9e770bb66e5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:27.476360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ab42ca8-fb87-421b-8d5c-c9e770bb66e5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:27.476785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ab42ca8-fb87-421b-8d5c-c9e770bb66e5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:27.519419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8cbe277d-26a0-49d1-8e4a-5fe8207bc8b1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:27.531236 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8cbe277d-26a0-49d1-8e4a-5fe8207bc8b1 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1514 microversion: 2.1 time: 0.497783 Aug 29 15:37:27.534225 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1583/3189] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:27 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1514 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:27.647600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9ab42ca8-fb87-421b-8d5c-c9e770bb66e5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:27.650506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:27.658493 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9ab42ca8-fb87-421b-8d5c-c9e770bb66e5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1504 microversion: 2.1 time: 0.195713 Aug 29 15:37:27.659122 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1607/3190] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:27 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:27.768031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-31a9de3d-04f7-49af-87a7-31761173f3a1 req-643a208b-e2f1-4c05-84e4-938df9614e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b6cfb1a-bfac-45e1-9b33-2e080c11f838", "name": "network-vif-deleted", "tag": "2e7d7a73-65af-4b13-a5be-e623d343d65d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:27.790352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-31a9de3d-04f7-49af-87a7-31761173f3a1 req-643a208b-e2f1-4c05-84e4-938df9614e42 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:27.790846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-31a9de3d-04f7-49af-87a7-31761173f3a1 req-643a208b-e2f1-4c05-84e4-938df9614e42 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:27.791576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-31a9de3d-04f7-49af-87a7-31761173f3a1 req-643a208b-e2f1-4c05-84e4-938df9614e42 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:27.806373 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-31a9de3d-04f7-49af-87a7-31761173f3a1 req-643a208b-e2f1-4c05-84e4-938df9614e42 service nova] Creating event network-vif-deleted:2e7d7a73-65af-4b13-a5be-e623d343d65d for instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 on n-h1-839401-11 Aug 29 15:37:27.811851 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-31a9de3d-04f7-49af-87a7-31761173f3a1 req-643a208b-e2f1-4c05-84e4-938df9614e42 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049130 Aug 29 15:37:27.813330 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1584/3191] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:27.861913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-441fd1fe-209d-4a70-9d2b-3519a6cea6ba tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:27.862655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-441fd1fe-209d-4a70-9d2b-3519a6cea6ba tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:27.880364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-441fd1fe-209d-4a70-9d2b-3519a6cea6ba tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:27.881406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-441fd1fe-209d-4a70-9d2b-3519a6cea6ba tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:27.882046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-441fd1fe-209d-4a70-9d2b-3519a6cea6ba tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:27.883192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-441fd1fe-209d-4a70-9d2b-3519a6cea6ba tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:27.883950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-441fd1fe-209d-4a70-9d2b-3519a6cea6ba tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:27.884728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-441fd1fe-209d-4a70-9d2b-3519a6cea6ba tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:27.996436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-441fd1fe-209d-4a70-9d2b-3519a6cea6ba tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:28.009903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-441fd1fe-209d-4a70-9d2b-3519a6cea6ba tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:28.012274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-441fd1fe-209d-4a70-9d2b-3519a6cea6ba tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:28.013999 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-441fd1fe-209d-4a70-9d2b-3519a6cea6ba tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1593 microversion: 2.42 time: 0.157524 Aug 29 15:37:28.014227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4c1737b2-e129-42ba-a920-a4c57adf2072 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:28.015643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4c1737b2-e129-42ba-a920-a4c57adf2072 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:28.025539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c1737b2-e129-42ba-a920-a4c57adf2072 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:28.026686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c1737b2-e129-42ba-a920-a4c57adf2072 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:28.027406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c1737b2-e129-42ba-a920-a4c57adf2072 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:28.028758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c1737b2-e129-42ba-a920-a4c57adf2072 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:28.029866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c1737b2-e129-42ba-a920-a4c57adf2072 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:28.030790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c1737b2-e129-42ba-a920-a4c57adf2072 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:28.034911 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1608/3192] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:27 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1593 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:28.324048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-881f4316-64fb-4658-b915-b7204f2dd0b8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:28.324894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-881f4316-64fb-4658-b915-b7204f2dd0b8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:28.336338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-881f4316-64fb-4658-b915-b7204f2dd0b8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:28.345888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-881f4316-64fb-4658-b915-b7204f2dd0b8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:28.346460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-881f4316-64fb-4658-b915-b7204f2dd0b8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:28.347492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-881f4316-64fb-4658-b915-b7204f2dd0b8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:28.348123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-881f4316-64fb-4658-b915-b7204f2dd0b8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:28.348873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-881f4316-64fb-4658-b915-b7204f2dd0b8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:28.405516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-881f4316-64fb-4658-b915-b7204f2dd0b8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:28.406005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-881f4316-64fb-4658-b915-b7204f2dd0b8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:28.406464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-881f4316-64fb-4658-b915-b7204f2dd0b8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:28.406896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-881f4316-64fb-4658-b915-b7204f2dd0b8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lazy-loading 'fault' on Instance uuid 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:37:28.491492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-881f4316-64fb-4658-b915-b7204f2dd0b8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:28.502667 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-881f4316-64fb-4658-b915-b7204f2dd0b8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 200 len: 1314 microversion: 2.1 time: 0.182375 Aug 29 15:37:28.504064 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1609/3193] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:28 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:28.556064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-097018d4-56fb-4404-80df-1be089f55ec2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:28.556806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-097018d4-56fb-4404-80df-1be089f55ec2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:28.567099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-097018d4-56fb-4404-80df-1be089f55ec2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:28.568527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-097018d4-56fb-4404-80df-1be089f55ec2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:28.570247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-097018d4-56fb-4404-80df-1be089f55ec2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:28.580704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-097018d4-56fb-4404-80df-1be089f55ec2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:28.582380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-097018d4-56fb-4404-80df-1be089f55ec2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:28.584710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-097018d4-56fb-4404-80df-1be089f55ec2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.028787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4c1737b2-e129-42ba-a920-a4c57adf2072 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:29.047208 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4c1737b2-e129-42ba-a920-a4c57adf2072 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1469 microversion: 2.1 time: 1.040490 Aug 29 15:37:29.051363 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1585/3194] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:28 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1469 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:29.072198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-097018d4-56fb-4404-80df-1be089f55ec2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:29.072731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1021c900-fb80-49c3-a33a-1db2dcab36ae tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:29.072883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1021c900-fb80-49c3-a33a-1db2dcab36ae tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:29.102987 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-097018d4-56fb-4404-80df-1be089f55ec2 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1514 microversion: 2.1 time: 0.550993 Aug 29 15:37:29.123694 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1610/3195] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:28 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1514 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:29.126514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1021c900-fb80-49c3-a33a-1db2dcab36ae tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.128294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1021c900-fb80-49c3-a33a-1db2dcab36ae tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.128963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1021c900-fb80-49c3-a33a-1db2dcab36ae tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.129934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1021c900-fb80-49c3-a33a-1db2dcab36ae tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.132861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1021c900-fb80-49c3-a33a-1db2dcab36ae tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.133522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1021c900-fb80-49c3-a33a-1db2dcab36ae tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.146988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d1551cea-5cda-48b0-945a-80155d7ed58e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:29.148556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d1551cea-5cda-48b0-945a-80155d7ed58e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:29.192344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1551cea-5cda-48b0-945a-80155d7ed58e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.197818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1551cea-5cda-48b0-945a-80155d7ed58e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.199145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1551cea-5cda-48b0-945a-80155d7ed58e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.208402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1551cea-5cda-48b0-945a-80155d7ed58e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.210862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1551cea-5cda-48b0-945a-80155d7ed58e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.214172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1551cea-5cda-48b0-945a-80155d7ed58e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.239017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1021c900-fb80-49c3-a33a-1db2dcab36ae tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.239510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1021c900-fb80-49c3-a33a-1db2dcab36ae tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.240677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1021c900-fb80-49c3-a33a-1db2dcab36ae tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.241206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-1021c900-fb80-49c3-a33a-1db2dcab36ae tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lazy-loading 'fault' on Instance uuid a26d1257-743d-4e66-8c12-a7eb833b949b {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:37:29.429270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d1551cea-5cda-48b0-945a-80155d7ed58e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:29.449190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d1551cea-5cda-48b0-945a-80155d7ed58e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:29.454699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d1551cea-5cda-48b0-945a-80155d7ed58e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:29.456808 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d1551cea-5cda-48b0-945a-80155d7ed58e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1593 microversion: 2.42 time: 0.330791 Aug 29 15:37:29.472745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1021c900-fb80-49c3-a33a-1db2dcab36ae tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb7582f47fd4fd78149bf92742e9659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb55ec892b64ac9ab5085a7c37c1ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:29.482084 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1021c900-fb80-49c3-a33a-1db2dcab36ae tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 200 len: 1303 microversion: 2.1 time: 0.429275 Aug 29 15:37:29.486653 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1586/3196] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:29 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 1303 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:29.508659 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1611/3197] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:29 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1593 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:29.524384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-afb985a1-6f49-42d8-afab-af70f0ffc7ef tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:29.525010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-afb985a1-6f49-42d8-afab-af70f0ffc7ef tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:29.544038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb985a1-6f49-42d8-afab-af70f0ffc7ef tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.544554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb985a1-6f49-42d8-afab-af70f0ffc7ef tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.545056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb985a1-6f49-42d8-afab-af70f0ffc7ef tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.546080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb985a1-6f49-42d8-afab-af70f0ffc7ef tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.546739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb985a1-6f49-42d8-afab-af70f0ffc7ef tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.547375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afb985a1-6f49-42d8-afab-af70f0ffc7ef tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.563565 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-afb985a1-6f49-42d8-afab-af70f0ffc7ef tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] HTTP exception thrown: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-afb985a1-6f49-42d8-afab-af70f0ffc7ef tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Request method failure captured: Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 HTTP/1.1 Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN0GbvIiUff-Csg384q60lkXu4i6-mvBJpd3uHC3XwYXy4PaOZ7rdjlazGQlvtMKGXenSXNWI7wpdDnEyRTa364NbLtw3ESiH3fXKpDQtDE_4rOyqKq2j2P24J-z87DcgMla1UHDGJpmC4Fh5kcRUC7Pl2mjjcnRflSX472pqyiJs6U Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaeecb44c6534cba89e3d68177917529", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}] Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6de4fe0749d449748eca6937b123d2df Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '2b6cfb1a-bfac-45e1-9b33-2e080c11f838'} Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:29.575270 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:29.579386 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:29.579386 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:29.579386 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:29.579386 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:29.579386 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:29.579386 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:29.579386 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. Aug 29 15:37:29.579386 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:29.579386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-afb985a1-6f49-42d8-afab-af70f0ffc7ef tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Returning 404 to user: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:29.581826 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-afb985a1-6f49-42d8-afab-af70f0ffc7ef tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 404 len: 111 microversion: 2.1 time: 0.061021 Aug 29 15:37:29.585226 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1587/3198] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:29 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:29.598869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cbe2c2c5-7020-4132-9db9-c1ac30e9c956 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Action: 'create', calling method: .version_select at 0x7fc42aaa9f70>, body: {"keypair": {"name": "tempest-keypair-1382599746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFP+7EH9uzgfC3y/oKiEV0qWxgGCes0y/XYB2w4j2xiBU2FtfDyp7svGDKaScbE+7AQQ4Sgq62Wa66p/2JUlG6JVATBI1pOHd0YafcWwQdPkMgiwvUwQaP2krihtunLNZQ=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:29.622310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-cbe2c2c5-7020-4132-9db9-c1ac30e9c956 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Getting quotas for project eaeecb44c6534cba89e3d68177917529. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:37:29.630769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-cbe2c2c5-7020-4132-9db9-c1ac30e9c956 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Getting quotas for user 6de4fe0749d449748eca6937b123d2df and project eaeecb44c6534cba89e3d68177917529. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:37:29.668778 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cbe2c2c5-7020-4132-9db9-c1ac30e9c956 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074720 Aug 29 15:37:29.676411 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1612/3199] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:37:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:29.850065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-2407264b-524e-4003-9864-66d35edd6fc5 req-359543b6-ba79-43e6-b5d6-0d7f1f91d3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a26d1257-743d-4e66-8c12-a7eb833b949b", "name": "network-vif-deleted", "tag": "344aa345-e02f-423a-b939-d84694888591"}, {"server_uuid": "0330d585-be01-45a3-b20a-9ce9cdfbaa43", "name": "network-vif-deleted", "tag": "53083e31-a61d-4467-9153-eb9ce7344ee5"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:29.862815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2407264b-524e-4003-9864-66d35edd6fc5 req-359543b6-ba79-43e6-b5d6-0d7f1f91d3a3 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:29.863583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2407264b-524e-4003-9864-66d35edd6fc5 req-359543b6-ba79-43e6-b5d6-0d7f1f91d3a3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:29.864210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2407264b-524e-4003-9864-66d35edd6fc5 req-359543b6-ba79-43e6-b5d6-0d7f1f91d3a3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:29.880138 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-2407264b-524e-4003-9864-66d35edd6fc5 req-359543b6-ba79-43e6-b5d6-0d7f1f91d3a3 service nova] Creating event network-vif-deleted:344aa345-e02f-423a-b939-d84694888591 for instance a26d1257-743d-4e66-8c12-a7eb833b949b on n-h2-839401-11 Aug 29 15:37:29.880951 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-2407264b-524e-4003-9864-66d35edd6fc5 req-359543b6-ba79-43e6-b5d6-0d7f1f91d3a3 service nova] Creating event network-vif-deleted:53083e31-a61d-4467-9153-eb9ce7344ee5 for instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 on n-h2-839401-11 Aug 29 15:37:29.888943 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-2407264b-524e-4003-9864-66d35edd6fc5 req-359543b6-ba79-43e6-b5d6-0d7f1f91d3a3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051618 Aug 29 15:37:29.891311 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1588/3200] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:30.074973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3ff0f364-da9f-47c1-821e-1eed003b5afd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:30.075757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3ff0f364-da9f-47c1-821e-1eed003b5afd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:30.110630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ff0f364-da9f-47c1-821e-1eed003b5afd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.111487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ff0f364-da9f-47c1-821e-1eed003b5afd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.112452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ff0f364-da9f-47c1-821e-1eed003b5afd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.113520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ff0f364-da9f-47c1-821e-1eed003b5afd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.114354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ff0f364-da9f-47c1-821e-1eed003b5afd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.115127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ff0f364-da9f-47c1-821e-1eed003b5afd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.131838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-827de55e-664d-4ca4-8154-14ba89a427ab tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:30.133648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-827de55e-664d-4ca4-8154-14ba89a427ab tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:30.210046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-827de55e-664d-4ca4-8154-14ba89a427ab tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.214089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-827de55e-664d-4ca4-8154-14ba89a427ab tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.218807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-827de55e-664d-4ca4-8154-14ba89a427ab tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.222165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-827de55e-664d-4ca4-8154-14ba89a427ab tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.224002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-827de55e-664d-4ca4-8154-14ba89a427ab tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.226013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-827de55e-664d-4ca4-8154-14ba89a427ab tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.327650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ff0f364-da9f-47c1-821e-1eed003b5afd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.328384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ff0f364-da9f-47c1-821e-1eed003b5afd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.330930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ff0f364-da9f-47c1-821e-1eed003b5afd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.331450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-3ff0f364-da9f-47c1-821e-1eed003b5afd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lazy-loading 'fault' on Instance uuid 0330d585-be01-45a3-b20a-9ce9cdfbaa43 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:37:30.379365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-827de55e-664d-4ca4-8154-14ba89a427ab tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.380208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-827de55e-664d-4ca4-8154-14ba89a427ab tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.380823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-827de55e-664d-4ca4-8154-14ba89a427ab tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.381516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-827de55e-664d-4ca4-8154-14ba89a427ab tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lazy-loading 'fault' on Instance uuid 8794d0c2-c530-4890-935c-4addf377478c {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:37:30.463304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3ff0f364-da9f-47c1-821e-1eed003b5afd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:30.478030 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3ff0f364-da9f-47c1-821e-1eed003b5afd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 200 len: 1303 microversion: 2.1 time: 0.410050 Aug 29 15:37:30.479105 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1613/3201] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:30 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 1303 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:30.503686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9e41de73-258b-40a0-81f5-227ade636503 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:30.505948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9e41de73-258b-40a0-81f5-227ade636503 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:30.531559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e41de73-258b-40a0-81f5-227ade636503 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.531933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-827de55e-664d-4ca4-8154-14ba89a427ab tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f9814ba6cea472c8759e8f3bf67c734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9bb92cd24774733bc0f5054a240cd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:30.534912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e41de73-258b-40a0-81f5-227ade636503 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.535341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e41de73-258b-40a0-81f5-227ade636503 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.536070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e41de73-258b-40a0-81f5-227ade636503 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.538803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e41de73-258b-40a0-81f5-227ade636503 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.539272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e41de73-258b-40a0-81f5-227ade636503 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.558542 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-827de55e-664d-4ca4-8154-14ba89a427ab tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 200 len: 1308 microversion: 2.1 time: 0.430556 Aug 29 15:37:30.560604 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1589/3202] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:30 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 1308 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:30.573275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-821c422e-fce2-4f6f-8feb-faff763206ab tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:30.575210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-821c422e-fce2-4f6f-8feb-faff763206ab tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:30.590489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-821c422e-fce2-4f6f-8feb-faff763206ab tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.591298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-821c422e-fce2-4f6f-8feb-faff763206ab tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.592020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-821c422e-fce2-4f6f-8feb-faff763206ab tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.594002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-821c422e-fce2-4f6f-8feb-faff763206ab tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.595892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-821c422e-fce2-4f6f-8feb-faff763206ab tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.596565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-821c422e-fce2-4f6f-8feb-faff763206ab tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.616577 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-821c422e-fce2-4f6f-8feb-faff763206ab tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] HTTP exception thrown: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-821c422e-fce2-4f6f-8feb-faff763206ab tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Request method failure captured: Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b HTTP/1.1 Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN0OGrcmsxESzzDJByb4ZrK7hEewqBtqAQ8zv_6ma7lXm0v8A5_I8sj6nxHcOOASoofvrneQNrgMCGfS77nEdUkRMeIHUkmaHtFd58POER1IqsXOFJNIp3dJRRFTujkKFPzjcxukYf8y2NNpjR9ilYF9OOlydBbC6kn9z0QceW9tIjY Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: cbb55ec892b64ac9ab5085a7c37c1ee0 Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cbb55ec892b64ac9ab5085a7c37c1ee0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}] Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: cbb55ec892b64ac9ab5085a7c37c1ee0 Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerGroupTestJSON-1682108187-project Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: abb7582f47fd4fd78149bf92742e9659 Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerGroupTestJSON-1682108187-project Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'a26d1257-743d-4e66-8c12-a7eb833b949b'} Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:30.620393 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.624322 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:30.624322 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:30.624322 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:30.624322 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:30.624322 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:30.624322 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. Aug 29 15:37:30.624322 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.626695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-821c422e-fce2-4f6f-8feb-faff763206ab tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Returning 404 to user: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:30.627817 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-821c422e-fce2-4f6f-8feb-faff763206ab tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 404 len: 111 microversion: 2.1 time: 0.062201 Aug 29 15:37:30.630644 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1590/3203] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:30 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:30.647396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cac76c52-ac64-40ad-be11-f65fb000b48b tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:30.690403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.compute.server_groups [None req-cac76c52-ac64-40ad-be11-f65fb000b48b tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Querying cell dcf211bc-da73-4d63-b885-2b9e7c1e329b(cell1) for 1 instances {{(pid=122361) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 15:37:30.692026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cac76c52-ac64-40ad-be11-f65fb000b48b tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.692875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cac76c52-ac64-40ad-be11-f65fb000b48b tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.693640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cac76c52-ac64-40ad-be11-f65fb000b48b tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.722944 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cac76c52-ac64-40ad-be11-f65fb000b48b tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.085170 Aug 29 15:37:30.723930 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1591/3204] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:37:30 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:37:30.735386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d78c75cf-a206-43db-8eb0-269673ecbedb tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:30.766209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.compute.server_groups [None req-d78c75cf-a206-43db-8eb0-269673ecbedb tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Querying cell dcf211bc-da73-4d63-b885-2b9e7c1e329b(cell1) for 1 instances {{(pid=122361) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 15:37:30.781347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d78c75cf-a206-43db-8eb0-269673ecbedb tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.782283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d78c75cf-a206-43db-8eb0-269673ecbedb tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.782972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d78c75cf-a206-43db-8eb0-269673ecbedb tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.811131 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d78c75cf-a206-43db-8eb0-269673ecbedb tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/os-server-groups/049cc90a-d189-4922-8757-c2c9c2820458" status: 200 len: 184 microversion: 2.1 time: 0.079592 Aug 29 15:37:30.814926 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1592/3205] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:37:30 2022] GET /compute/v2.1/os-server-groups/049cc90a-d189-4922-8757-c2c9c2820458 => generated 184 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:30.832849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4c07a828-3a0a-4d0b-b553-ac29085b1ffa tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:30.833532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4c07a828-3a0a-4d0b-b553-ac29085b1ffa tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:30.840206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c07a828-3a0a-4d0b-b553-ac29085b1ffa tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.840803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c07a828-3a0a-4d0b-b553-ac29085b1ffa tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.841417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c07a828-3a0a-4d0b-b553-ac29085b1ffa tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.846906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c07a828-3a0a-4d0b-b553-ac29085b1ffa tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.848298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c07a828-3a0a-4d0b-b553-ac29085b1ffa tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.849074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c07a828-3a0a-4d0b-b553-ac29085b1ffa tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.876298 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-4c07a828-3a0a-4d0b-b553-ac29085b1ffa tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] HTTP exception thrown: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4c07a828-3a0a-4d0b-b553-ac29085b1ffa tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Request method failure captured: Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b HTTP/1.1 Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN0OGrcmsxESzzDJByb4ZrK7hEewqBtqAQ8zv_6ma7lXm0v8A5_I8sj6nxHcOOASoofvrneQNrgMCGfS77nEdUkRMeIHUkmaHtFd58POER1IqsXOFJNIp3dJRRFTujkKFPzjcxukYf8y2NNpjR9ilYF9OOlydBbC6kn9z0QceW9tIjY Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: cbb55ec892b64ac9ab5085a7c37c1ee0 Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cbb55ec892b64ac9ab5085a7c37c1ee0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}] Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: cbb55ec892b64ac9ab5085a7c37c1ee0 Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerGroupTestJSON-1682108187-project Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: abb7582f47fd4fd78149bf92742e9659 Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerGroupTestJSON-1682108187-project Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'a26d1257-743d-4e66-8c12-a7eb833b949b'} Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:30.880907 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:30.884824 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. Aug 29 15:37:30.884824 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.884824 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:30.884824 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.884824 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:30.884824 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:30.884824 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:30.884824 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:30.884824 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:30.884824 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. Aug 29 15:37:30.884824 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.887798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4c07a828-3a0a-4d0b-b553-ac29085b1ffa tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Returning 404 to user: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:30.888912 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4c07a828-3a0a-4d0b-b553-ac29085b1ffa tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 404 len: 111 microversion: 2.1 time: 0.070037 Aug 29 15:37:30.890311 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1593/3206] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:30 2022] DELETE /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:30.900045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c0f764d2-147c-430a-9161-163fa8016509 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:30.900952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c0f764d2-147c-430a-9161-163fa8016509 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] [instance: a26d1257-743d-4e66-8c12-a7eb833b949b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:30.911919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0f764d2-147c-430a-9161-163fa8016509 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.913161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0f764d2-147c-430a-9161-163fa8016509 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.913890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0f764d2-147c-430a-9161-163fa8016509 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.914852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0f764d2-147c-430a-9161-163fa8016509 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:30.915547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0f764d2-147c-430a-9161-163fa8016509 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:30.916200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0f764d2-147c-430a-9161-163fa8016509 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:30.939205 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-c0f764d2-147c-430a-9161-163fa8016509 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] HTTP exception thrown: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c0f764d2-147c-430a-9161-163fa8016509 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Request method failure captured: Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b HTTP/1.1 Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN0OGrcmsxESzzDJByb4ZrK7hEewqBtqAQ8zv_6ma7lXm0v8A5_I8sj6nxHcOOASoofvrneQNrgMCGfS77nEdUkRMeIHUkmaHtFd58POER1IqsXOFJNIp3dJRRFTujkKFPzjcxukYf8y2NNpjR9ilYF9OOlydBbC6kn9z0QceW9tIjY Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: cbb55ec892b64ac9ab5085a7c37c1ee0 Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cbb55ec892b64ac9ab5085a7c37c1ee0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}] Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: cbb55ec892b64ac9ab5085a7c37c1ee0 Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerGroupTestJSON-1682108187-project Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: abb7582f47fd4fd78149bf92742e9659 Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerGroupTestJSON-1682108187-project Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'a26d1257-743d-4e66-8c12-a7eb833b949b'} Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:30.942851 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.946770 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:30.946770 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:30.946770 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:30.946770 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:30.946770 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:30.946770 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. Aug 29 15:37:30.946770 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.950158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c0f764d2-147c-430a-9161-163fa8016509 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Returning 404 to user: Instance a26d1257-743d-4e66-8c12-a7eb833b949b could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:30.951305 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c0f764d2-147c-430a-9161-163fa8016509 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b" status: 404 len: 111 microversion: 2.1 time: 0.056273 Aug 29 15:37:30.952959 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1594/3207] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:30 2022] GET /compute/v2.1/servers/a26d1257-743d-4e66-8c12-a7eb833b949b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:30.962198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bab84a2d-8fbc-4000-92b7-1348458122b5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:30.971585 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-bab84a2d-8fbc-4000-92b7-1348458122b5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] HTTP exception thrown: Instance group c75e4225-8bce-4e7a-acdc-c37bb0f0a860 could not be found. Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bab84a2d-8fbc-4000-92b7-1348458122b5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Request method failure captured: Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/os-server-groups/c75e4225-8bce-4e7a-acdc-c37bb0f0a860 HTTP/1.1 Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN0OGrcmsxESzzDJByb4ZrK7hEewqBtqAQ8zv_6ma7lXm0v8A5_I8sj6nxHcOOASoofvrneQNrgMCGfS77nEdUkRMeIHUkmaHtFd58POER1IqsXOFJNIp3dJRRFTujkKFPzjcxukYf8y2NNpjR9ilYF9OOlydBbC6kn9z0QceW9tIjY Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: cbb55ec892b64ac9ab5085a7c37c1ee0 Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cbb55ec892b64ac9ab5085a7c37c1ee0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}] Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: cbb55ec892b64ac9ab5085a7c37c1ee0 Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerGroupTestJSON-1682108187-project Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: abb7582f47fd4fd78149bf92742e9659 Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerGroupTestJSON-1682108187-project Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance group c75e4225-8bce-4e7a-acdc-c37bb0f0a860 could not be found. Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'c75e4225-8bce-4e7a-acdc-c37bb0f0a860'} Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c75e4225-8bce-4e7a-acdc-c37bb0f0a860 could not be found. Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c75e4225-8bce-4e7a-acdc-c37bb0f0a860 could not be found. Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.983142 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:30.987109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:30.987109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:30.987109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:30.987109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:30.987109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c75e4225-8bce-4e7a-acdc-c37bb0f0a860 could not be found. Aug 29 15:37:30.987109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:30.992001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bab84a2d-8fbc-4000-92b7-1348458122b5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Returning 404 to user: Instance group c75e4225-8bce-4e7a-acdc-c37bb0f0a860 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:30.994582 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bab84a2d-8fbc-4000-92b7-1348458122b5 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "DELETE /compute/v2.1/os-server-groups/c75e4225-8bce-4e7a-acdc-c37bb0f0a860" status: 404 len: 117 microversion: 2.1 time: 0.036219 Aug 29 15:37:30.996249 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1595/3208] 10.222.0.62 () {58 vars in 1266 bytes} [Mon Aug 29 15:37:30 2022] DELETE /compute/v2.1/os-server-groups/c75e4225-8bce-4e7a-acdc-c37bb0f0a860 => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:37:31.007255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2db5f254-6e80-4be8-96b7-188b72062bef tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:31.028917 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-2db5f254-6e80-4be8-96b7-188b72062bef tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] HTTP exception thrown: Instance group c8345a6b-3ada-4eb4-903e-90c0cb3adda4 could not be found. Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2db5f254-6e80-4be8-96b7-188b72062bef tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Request method failure captured: Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/os-server-groups/c8345a6b-3ada-4eb4-903e-90c0cb3adda4 HTTP/1.1 Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN0OGrcmsxESzzDJByb4ZrK7hEewqBtqAQ8zv_6ma7lXm0v8A5_I8sj6nxHcOOASoofvrneQNrgMCGfS77nEdUkRMeIHUkmaHtFd58POER1IqsXOFJNIp3dJRRFTujkKFPzjcxukYf8y2NNpjR9ilYF9OOlydBbC6kn9z0QceW9tIjY Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: cbb55ec892b64ac9ab5085a7c37c1ee0 Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cbb55ec892b64ac9ab5085a7c37c1ee0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}] Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: cbb55ec892b64ac9ab5085a7c37c1ee0 Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerGroupTestJSON-1682108187-project Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: abb7582f47fd4fd78149bf92742e9659 Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerGroupTestJSON-1682108187-project Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance group c8345a6b-3ada-4eb4-903e-90c0cb3adda4 could not be found. Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'c8345a6b-3ada-4eb4-903e-90c0cb3adda4'} Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c8345a6b-3ada-4eb4-903e-90c0cb3adda4 could not be found. Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c8345a6b-3ada-4eb4-903e-90c0cb3adda4 could not be found. Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.035898 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.040531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:31.040531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:31.040531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:31.040531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:31.040531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c8345a6b-3ada-4eb4-903e-90c0cb3adda4 could not be found. Aug 29 15:37:31.040531 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.040531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2db5f254-6e80-4be8-96b7-188b72062bef tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Returning 404 to user: Instance group c8345a6b-3ada-4eb4-903e-90c0cb3adda4 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:31.041257 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2db5f254-6e80-4be8-96b7-188b72062bef tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "DELETE /compute/v2.1/os-server-groups/c8345a6b-3ada-4eb4-903e-90c0cb3adda4" status: 404 len: 117 microversion: 2.1 time: 0.039255 Aug 29 15:37:31.047439 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1596/3209] 10.222.0.62 () {58 vars in 1266 bytes} [Mon Aug 29 15:37:30 2022] DELETE /compute/v2.1/os-server-groups/c8345a6b-3ada-4eb4-903e-90c0cb3adda4 => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:31.057383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cb36068b-cf5d-4bfa-83a1-3204d39ea923 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:31.067531 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-cb36068b-cf5d-4bfa-83a1-3204d39ea923 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] HTTP exception thrown: Instance group 2d3341d4-d388-48b7-9991-a56a5a73c82e could not be found. Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cb36068b-cf5d-4bfa-83a1-3204d39ea923 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Request method failure captured: Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/os-server-groups/2d3341d4-d388-48b7-9991-a56a5a73c82e HTTP/1.1 Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN0OGrcmsxESzzDJByb4ZrK7hEewqBtqAQ8zv_6ma7lXm0v8A5_I8sj6nxHcOOASoofvrneQNrgMCGfS77nEdUkRMeIHUkmaHtFd58POER1IqsXOFJNIp3dJRRFTujkKFPzjcxukYf8y2NNpjR9ilYF9OOlydBbC6kn9z0QceW9tIjY Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: cbb55ec892b64ac9ab5085a7c37c1ee0 Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cbb55ec892b64ac9ab5085a7c37c1ee0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}] Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: cbb55ec892b64ac9ab5085a7c37c1ee0 Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerGroupTestJSON-1682108187-project Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: abb7582f47fd4fd78149bf92742e9659 Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerGroupTestJSON-1682108187-project Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance group 2d3341d4-d388-48b7-9991-a56a5a73c82e could not be found. Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '2d3341d4-d388-48b7-9991-a56a5a73c82e'} Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2d3341d4-d388-48b7-9991-a56a5a73c82e could not be found. Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2d3341d4-d388-48b7-9991-a56a5a73c82e could not be found. Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.069291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.074051 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:31.074051 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:31.074051 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:31.074051 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:31.074051 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2d3341d4-d388-48b7-9991-a56a5a73c82e could not be found. Aug 29 15:37:31.074051 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.074604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cb36068b-cf5d-4bfa-83a1-3204d39ea923 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Returning 404 to user: Instance group 2d3341d4-d388-48b7-9991-a56a5a73c82e could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:31.075644 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cb36068b-cf5d-4bfa-83a1-3204d39ea923 tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "DELETE /compute/v2.1/os-server-groups/2d3341d4-d388-48b7-9991-a56a5a73c82e" status: 404 len: 117 microversion: 2.1 time: 0.026551 Aug 29 15:37:31.079493 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1597/3210] 10.222.0.62 () {58 vars in 1266 bytes} [Mon Aug 29 15:37:31 2022] DELETE /compute/v2.1/os-server-groups/2d3341d4-d388-48b7-9991-a56a5a73c82e => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:31.114272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e6bcd083-2e28-444f-b2c1-5f9f5fded57b tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:31.134317 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-e6bcd083-2e28-444f-b2c1-5f9f5fded57b tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] HTTP exception thrown: Instance group 28d6566a-cd38-4b5d-81f3-0b38b8f8b451 could not be found. Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e6bcd083-2e28-444f-b2c1-5f9f5fded57b tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Request method failure captured: Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/os-server-groups/28d6566a-cd38-4b5d-81f3-0b38b8f8b451 HTTP/1.1 Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN0OGrcmsxESzzDJByb4ZrK7hEewqBtqAQ8zv_6ma7lXm0v8A5_I8sj6nxHcOOASoofvrneQNrgMCGfS77nEdUkRMeIHUkmaHtFd58POER1IqsXOFJNIp3dJRRFTujkKFPzjcxukYf8y2NNpjR9ilYF9OOlydBbC6kn9z0QceW9tIjY Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: cbb55ec892b64ac9ab5085a7c37c1ee0 Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cbb55ec892b64ac9ab5085a7c37c1ee0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cbb55ec892b64ac9ab5085a7c37c1ee0"}]}] Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: cbb55ec892b64ac9ab5085a7c37c1ee0 Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerGroupTestJSON-1682108187 Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerGroupTestJSON-1682108187-project Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: abb7582f47fd4fd78149bf92742e9659 Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerGroupTestJSON-1682108187-project Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance group 28d6566a-cd38-4b5d-81f3-0b38b8f8b451 could not be found. Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '28d6566a-cd38-4b5d-81f3-0b38b8f8b451'} Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 28d6566a-cd38-4b5d-81f3-0b38b8f8b451 could not be found. Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 28d6566a-cd38-4b5d-81f3-0b38b8f8b451 could not be found. Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.136844 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.141566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:31.141566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:31.141566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:31.141566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:31.141566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 28d6566a-cd38-4b5d-81f3-0b38b8f8b451 could not be found. Aug 29 15:37:31.141566 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.144066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e6bcd083-2e28-444f-b2c1-5f9f5fded57b tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Returning 404 to user: Instance group 28d6566a-cd38-4b5d-81f3-0b38b8f8b451 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:31.145870 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e6bcd083-2e28-444f-b2c1-5f9f5fded57b tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "DELETE /compute/v2.1/os-server-groups/28d6566a-cd38-4b5d-81f3-0b38b8f8b451" status: 404 len: 117 microversion: 2.1 time: 0.060158 Aug 29 15:37:31.147260 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1598/3211] 10.222.0.62 () {58 vars in 1266 bytes} [Mon Aug 29 15:37:31 2022] DELETE /compute/v2.1/os-server-groups/28d6566a-cd38-4b5d-81f3-0b38b8f8b451 => generated 117 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:31.155762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5416984a-44e5-45fb-ad6e-9327a1c9ac3d tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:31.211167 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5416984a-44e5-45fb-ad6e-9327a1c9ac3d tempest-ServerGroupTestJSON-1682108187 tempest-ServerGroupTestJSON-1682108187-project] 10.222.0.62 "DELETE /compute/v2.1/os-server-groups/049cc90a-d189-4922-8757-c2c9c2820458" status: 204 len: 0 microversion: 2.1 time: 0.056766 Aug 29 15:37:31.214185 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1599/3212] 10.222.0.62 () {58 vars in 1266 bytes} [Mon Aug 29 15:37:31 2022] DELETE /compute/v2.1/os-server-groups/049cc90a-d189-4922-8757-c2c9c2820458 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:37:31.500962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a96d34d-c92d-4647-9484-a300155cf41d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:31.502081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a96d34d-c92d-4647-9484-a300155cf41d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 0330d585-be01-45a3-b20a-9ce9cdfbaa43] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:31.528232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a96d34d-c92d-4647-9484-a300155cf41d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.528738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a96d34d-c92d-4647-9484-a300155cf41d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.529227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a96d34d-c92d-4647-9484-a300155cf41d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.530010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a96d34d-c92d-4647-9484-a300155cf41d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.534390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a96d34d-c92d-4647-9484-a300155cf41d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.535428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a96d34d-c92d-4647-9484-a300155cf41d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.574736 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-5a96d34d-c92d-4647-9484-a300155cf41d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] HTTP exception thrown: Instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 could not be found. Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a96d34d-c92d-4647-9484-a300155cf41d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Request method failure captured: Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 HTTP/1.1 Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNu7_qAGH9F4T-sEGQ6Fn-tmnEuwowlnuweKCFJVcUgSifVmYMJmfSRBXWi8jaDAfMFH54RTj83N-XG9WMSNHHSrjyczMmdJKp5IDLMRTGYCl-oj5ft2WLudoumPYC0eNStS9lNVLE1tr4v_RxSr-OzeDb0bTV_TnZBRinLfQol-3ZM Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: cac390dda11d4f38983e1478de0dbde1 Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-MigrationsAdminTest-173441369 Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cac390dda11d4f38983e1478de0dbde1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cac390dda11d4f38983e1478de0dbde1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cac390dda11d4f38983e1478de0dbde1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cac390dda11d4f38983e1478de0dbde1"}]}] Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-MigrationsAdminTest-173441369 Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: cac390dda11d4f38983e1478de0dbde1 Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-MigrationsAdminTest-173441369 Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-MigrationsAdminTest-173441369-project Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e57b95d059f74c7a894903b5a8f933df Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-MigrationsAdminTest-173441369-project Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 could not be found. Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '0330d585-be01-45a3-b20a-9ce9cdfbaa43'} Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 could not be found. Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 could not be found. Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:31.576917 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.581561 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.581561 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:31.581561 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:31.581561 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:31.581561 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:31.581561 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 could not be found. Aug 29 15:37:31.581561 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.590220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a96d34d-c92d-4647-9484-a300155cf41d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Returning 404 to user: Instance 0330d585-be01-45a3-b20a-9ce9cdfbaa43 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:31.591545 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5a96d34d-c92d-4647-9484-a300155cf41d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43" status: 404 len: 111 microversion: 2.1 time: 0.095139 Aug 29 15:37:31.595087 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1600/3213] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:31 2022] GET /compute/v2.1/servers/0330d585-be01-45a3-b20a-9ce9cdfbaa43 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:31.602059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f733e377-5159-4d81-9874-8a7845c329f7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:31.602933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f733e377-5159-4d81-9874-8a7845c329f7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 8794d0c2-c530-4890-935c-4addf377478c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:31.641904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f733e377-5159-4d81-9874-8a7845c329f7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.642409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f733e377-5159-4d81-9874-8a7845c329f7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.642846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f733e377-5159-4d81-9874-8a7845c329f7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.643552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f733e377-5159-4d81-9874-8a7845c329f7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.644009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f733e377-5159-4d81-9874-8a7845c329f7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.644434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f733e377-5159-4d81-9874-8a7845c329f7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.672250 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-f733e377-5159-4d81-9874-8a7845c329f7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] HTTP exception thrown: Instance 8794d0c2-c530-4890-935c-4addf377478c could not be found. Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f733e377-5159-4d81-9874-8a7845c329f7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Request method failure captured: Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c HTTP/1.1 Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNxryJ1F-FRESlioMdF1WbdkAAcObpSaqTEybH5DzL6Lf3XpYYN8Ndg-mPZrfaecqef_a4W4lTFISYlVxDF34l59VimkgS1fll6jOF2GseJmP89GHoCpym_jSkKOrHLolltr7iKb7Nuk4gvr3RbOeiOqOd6xaGprBjfWT8m3A2wu1nk Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: e9bb92cd24774733bc0f5054a240cd28 Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1120823105 Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e9bb92cd24774733bc0f5054a240cd28", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e9bb92cd24774733bc0f5054a240cd28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9bb92cd24774733bc0f5054a240cd28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9bb92cd24774733bc0f5054a240cd28"}]}] Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerDiskConfigTestJSON-1120823105 Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: e9bb92cd24774733bc0f5054a240cd28 Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1120823105 Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerDiskConfigTestJSON-1120823105-project Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 0f9814ba6cea472c8759e8f3bf67c734 Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerDiskConfigTestJSON-1120823105-project Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 8794d0c2-c530-4890-935c-4addf377478c could not be found. Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '8794d0c2-c530-4890-935c-4addf377478c'} Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8794d0c2-c530-4890-935c-4addf377478c could not be found. Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8794d0c2-c530-4890-935c-4addf377478c could not be found. Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:31.673835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.677769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.677769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:31.677769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:31.677769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:31.677769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:31.677769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8794d0c2-c530-4890-935c-4addf377478c could not be found. Aug 29 15:37:31.677769 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.679285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f733e377-5159-4d81-9874-8a7845c329f7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Returning 404 to user: Instance 8794d0c2-c530-4890-935c-4addf377478c could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:31.680950 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f733e377-5159-4d81-9874-8a7845c329f7 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c" status: 404 len: 111 microversion: 2.1 time: 0.086282 Aug 29 15:37:31.682484 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1601/3214] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:31 2022] GET /compute/v2.1/servers/8794d0c2-c530-4890-935c-4addf377478c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:31.691477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6012b6a2-c5eb-4267-96d0-0d33114e36b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:31.692186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6012b6a2-c5eb-4267-96d0-0d33114e36b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:31.699246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6012b6a2-c5eb-4267-96d0-0d33114e36b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.699977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6012b6a2-c5eb-4267-96d0-0d33114e36b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.701131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6012b6a2-c5eb-4267-96d0-0d33114e36b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.702061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6012b6a2-c5eb-4267-96d0-0d33114e36b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.702868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6012b6a2-c5eb-4267-96d0-0d33114e36b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.703472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6012b6a2-c5eb-4267-96d0-0d33114e36b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.753062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6012b6a2-c5eb-4267-96d0-0d33114e36b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:37:31.761530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e41de73-258b-40a0-81f5-227ade636503 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:31.785561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e41de73-258b-40a0-81f5-227ade636503 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:31.792635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e41de73-258b-40a0-81f5-227ade636503 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:31.799244 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9e41de73-258b-40a0-81f5-227ade636503 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1661 microversion: 2.42 time: 1.317162 Aug 29 15:37:31.801397 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1614/3215] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:30 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1661 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:31.808044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:31.818030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-669a9226-3451-4f43-91a5-2b49a8321b51 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:31.819115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-669a9226-3451-4f43-91a5-2b49a8321b51 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:31.849266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-669a9226-3451-4f43-91a5-2b49a8321b51 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.853206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-669a9226-3451-4f43-91a5-2b49a8321b51 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.854607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-669a9226-3451-4f43-91a5-2b49a8321b51 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.857819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-669a9226-3451-4f43-91a5-2b49a8321b51 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.859158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-669a9226-3451-4f43-91a5-2b49a8321b51 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.860002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-669a9226-3451-4f43-91a5-2b49a8321b51 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.890994 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-669a9226-3451-4f43-91a5-2b49a8321b51 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] HTTP exception thrown: Instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 could not be found. Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-669a9226-3451-4f43-91a5-2b49a8321b51 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Request method failure captured: Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 HTTP/1.1 Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNxryJ1F-FRESlioMdF1WbdkAAcObpSaqTEybH5DzL6Lf3XpYYN8Ndg-mPZrfaecqef_a4W4lTFISYlVxDF34l59VimkgS1fll6jOF2GseJmP89GHoCpym_jSkKOrHLolltr7iKb7Nuk4gvr3RbOeiOqOd6xaGprBjfWT8m3A2wu1nk Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: e9bb92cd24774733bc0f5054a240cd28 Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1120823105 Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e9bb92cd24774733bc0f5054a240cd28", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e9bb92cd24774733bc0f5054a240cd28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9bb92cd24774733bc0f5054a240cd28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9bb92cd24774733bc0f5054a240cd28"}]}] Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerDiskConfigTestJSON-1120823105 Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: e9bb92cd24774733bc0f5054a240cd28 Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1120823105 Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerDiskConfigTestJSON-1120823105-project Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 0f9814ba6cea472c8759e8f3bf67c734 Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerDiskConfigTestJSON-1120823105-project Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 could not be found. Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '923c4a5b-679a-41e3-9d6b-f7bbcc603db3'} Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 could not be found. Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:31.893612 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:31.900570 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 could not be found. Aug 29 15:37:31.900570 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.900570 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:31.900570 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.900570 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.900570 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:31.900570 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:31.900570 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:31.900570 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:31.900570 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 could not be found. Aug 29 15:37:31.900570 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.902242 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6012b6a2-c5eb-4267-96d0-0d33114e36b8 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "DELETE /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 204 len: 0 microversion: 2.1 time: 0.209808 Aug 29 15:37:31.902442 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1602/3216] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:31 2022] DELETE /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:37:31.905223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-669a9226-3451-4f43-91a5-2b49a8321b51 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Returning 404 to user: Instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:31.906636 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-669a9226-3451-4f43-91a5-2b49a8321b51 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "DELETE /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 404 len: 111 microversion: 2.1 time: 0.103253 Aug 29 15:37:31.913158 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1615/3217] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:31 2022] DELETE /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:31.918863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c57edf05-2a9b-4525-acaf-d9532870447b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:31.919595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c57edf05-2a9b-4525-acaf-d9532870447b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:31.920029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-48c5a508-c556-4a8c-accf-a47b72dd207d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:31.921563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-48c5a508-c556-4a8c-accf-a47b72dd207d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 923c4a5b-679a-41e3-9d6b-f7bbcc603db3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:31.931131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48c5a508-c556-4a8c-accf-a47b72dd207d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.932024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48c5a508-c556-4a8c-accf-a47b72dd207d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.932698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48c5a508-c556-4a8c-accf-a47b72dd207d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.935796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48c5a508-c556-4a8c-accf-a47b72dd207d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.936625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48c5a508-c556-4a8c-accf-a47b72dd207d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.938176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48c5a508-c556-4a8c-accf-a47b72dd207d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.942621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c57edf05-2a9b-4525-acaf-d9532870447b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.948971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c57edf05-2a9b-4525-acaf-d9532870447b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.951306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c57edf05-2a9b-4525-acaf-d9532870447b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.952140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c57edf05-2a9b-4525-acaf-d9532870447b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.952687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c57edf05-2a9b-4525-acaf-d9532870447b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.953167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c57edf05-2a9b-4525-acaf-d9532870447b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:31.956499 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-48c5a508-c556-4a8c-accf-a47b72dd207d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] HTTP exception thrown: Instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 could not be found. Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-48c5a508-c556-4a8c-accf-a47b72dd207d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Request method failure captured: Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 HTTP/1.1 Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNxryJ1F-FRESlioMdF1WbdkAAcObpSaqTEybH5DzL6Lf3XpYYN8Ndg-mPZrfaecqef_a4W4lTFISYlVxDF34l59VimkgS1fll6jOF2GseJmP89GHoCpym_jSkKOrHLolltr7iKb7Nuk4gvr3RbOeiOqOd6xaGprBjfWT8m3A2wu1nk Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: e9bb92cd24774733bc0f5054a240cd28 Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1120823105 Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e9bb92cd24774733bc0f5054a240cd28", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e9bb92cd24774733bc0f5054a240cd28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9bb92cd24774733bc0f5054a240cd28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9bb92cd24774733bc0f5054a240cd28"}]}] Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerDiskConfigTestJSON-1120823105 Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: e9bb92cd24774733bc0f5054a240cd28 Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1120823105 Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerDiskConfigTestJSON-1120823105-project Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 0f9814ba6cea472c8759e8f3bf67c734 Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerDiskConfigTestJSON-1120823105-project Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 could not be found. Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '923c4a5b-679a-41e3-9d6b-f7bbcc603db3'} Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 could not be found. Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 could not be found. Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:31.958235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.963622 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:31.963622 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:31.963622 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:31.963622 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:31.963622 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:31.963622 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 could not be found. Aug 29 15:37:31.963622 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:31.966188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-48c5a508-c556-4a8c-accf-a47b72dd207d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Returning 404 to user: Instance 923c4a5b-679a-41e3-9d6b-f7bbcc603db3 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:31.967391 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-48c5a508-c556-4a8c-accf-a47b72dd207d tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3" status: 404 len: 111 microversion: 2.1 time: 0.052271 Aug 29 15:37:31.971464 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1616/3218] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:31 2022] GET /compute/v2.1/servers/923c4a5b-679a-41e3-9d6b-f7bbcc603db3 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:31.980649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-97db48c4-38bd-4731-9af8-742c5a30af15 req-be8119ad-840c-4fbc-83fc-485b1f5f1976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8794d0c2-c530-4890-935c-4addf377478c", "name": "network-vif-deleted", "tag": "0994906b-e8c7-441c-937e-88a208667dd1"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:31.992551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-97db48c4-38bd-4731-9af8-742c5a30af15 req-be8119ad-840c-4fbc-83fc-485b1f5f1976 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:31.993057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-97db48c4-38bd-4731-9af8-742c5a30af15 req-be8119ad-840c-4fbc-83fc-485b1f5f1976 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:31.993537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-97db48c4-38bd-4731-9af8-742c5a30af15 req-be8119ad-840c-4fbc-83fc-485b1f5f1976 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:32.007727 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-97db48c4-38bd-4731-9af8-742c5a30af15 req-be8119ad-840c-4fbc-83fc-485b1f5f1976 service nova] Creating event network-vif-deleted:0994906b-e8c7-441c-937e-88a208667dd1 for instance 8794d0c2-c530-4890-935c-4addf377478c on n-h1-839401-11 Aug 29 15:37:32.013466 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-97db48c4-38bd-4731-9af8-742c5a30af15 req-be8119ad-840c-4fbc-83fc-485b1f5f1976 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040406 Aug 29 15:37:32.014490 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1617/3219] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:32.024381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-68909cc5-baa5-4a2d-840d-1514ea85e2ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:32.024984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-68909cc5-baa5-4a2d-840d-1514ea85e2ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:32.032801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68909cc5-baa5-4a2d-840d-1514ea85e2ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:32.033594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68909cc5-baa5-4a2d-840d-1514ea85e2ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:32.034199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68909cc5-baa5-4a2d-840d-1514ea85e2ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:32.035104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68909cc5-baa5-4a2d-840d-1514ea85e2ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:32.035730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68909cc5-baa5-4a2d-840d-1514ea85e2ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:32.037078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68909cc5-baa5-4a2d-840d-1514ea85e2ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:32.054456 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-68909cc5-baa5-4a2d-840d-1514ea85e2ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] HTTP exception thrown: Instance 0f838765-3a8a-47c2-9907-367ddaf2d90f could not be found. Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-68909cc5-baa5-4a2d-840d-1514ea85e2ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Request method failure captured: Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f HTTP/1.1 Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNxryJ1F-FRESlioMdF1WbdkAAcObpSaqTEybH5DzL6Lf3XpYYN8Ndg-mPZrfaecqef_a4W4lTFISYlVxDF34l59VimkgS1fll6jOF2GseJmP89GHoCpym_jSkKOrHLolltr7iKb7Nuk4gvr3RbOeiOqOd6xaGprBjfWT8m3A2wu1nk Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: e9bb92cd24774733bc0f5054a240cd28 Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1120823105 Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e9bb92cd24774733bc0f5054a240cd28", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e9bb92cd24774733bc0f5054a240cd28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9bb92cd24774733bc0f5054a240cd28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9bb92cd24774733bc0f5054a240cd28"}]}] Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerDiskConfigTestJSON-1120823105 Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: e9bb92cd24774733bc0f5054a240cd28 Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1120823105 Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerDiskConfigTestJSON-1120823105-project Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 0f9814ba6cea472c8759e8f3bf67c734 Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerDiskConfigTestJSON-1120823105-project Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 0f838765-3a8a-47c2-9907-367ddaf2d90f could not be found. Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '0f838765-3a8a-47c2-9907-367ddaf2d90f'} Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f838765-3a8a-47c2-9907-367ddaf2d90f could not be found. Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:32.057529 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:32.061598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f838765-3a8a-47c2-9907-367ddaf2d90f could not be found. Aug 29 15:37:32.061598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:32.061598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:32.061598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:32.061598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:32.061598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:32.061598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:32.061598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:32.061598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:32.061598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f838765-3a8a-47c2-9907-367ddaf2d90f could not be found. Aug 29 15:37:32.061598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:32.063806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-68909cc5-baa5-4a2d-840d-1514ea85e2ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Returning 404 to user: Instance 0f838765-3a8a-47c2-9907-367ddaf2d90f could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:32.064866 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-68909cc5-baa5-4a2d-840d-1514ea85e2ba tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 404 len: 111 microversion: 2.1 time: 0.049271 Aug 29 15:37:32.069989 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1618/3220] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:32 2022] DELETE /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:32.074934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f40db0cf-3cd6-435b-bee6-3aafd6991263 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:32.078224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f40db0cf-3cd6-435b-bee6-3aafd6991263 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] [instance: 0f838765-3a8a-47c2-9907-367ddaf2d90f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:32.101801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f40db0cf-3cd6-435b-bee6-3aafd6991263 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:32.102445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f40db0cf-3cd6-435b-bee6-3aafd6991263 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:32.102895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f40db0cf-3cd6-435b-bee6-3aafd6991263 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:32.103633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f40db0cf-3cd6-435b-bee6-3aafd6991263 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:32.104106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f40db0cf-3cd6-435b-bee6-3aafd6991263 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:32.104537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f40db0cf-3cd6-435b-bee6-3aafd6991263 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:32.124876 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-f40db0cf-3cd6-435b-bee6-3aafd6991263 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] HTTP exception thrown: Instance 0f838765-3a8a-47c2-9907-367ddaf2d90f could not be found. Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f40db0cf-3cd6-435b-bee6-3aafd6991263 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Request method failure captured: Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f HTTP/1.1 Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNxryJ1F-FRESlioMdF1WbdkAAcObpSaqTEybH5DzL6Lf3XpYYN8Ndg-mPZrfaecqef_a4W4lTFISYlVxDF34l59VimkgS1fll6jOF2GseJmP89GHoCpym_jSkKOrHLolltr7iKb7Nuk4gvr3RbOeiOqOd6xaGprBjfWT8m3A2wu1nk Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: e9bb92cd24774733bc0f5054a240cd28 Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1120823105 Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e9bb92cd24774733bc0f5054a240cd28", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e9bb92cd24774733bc0f5054a240cd28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9bb92cd24774733bc0f5054a240cd28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9bb92cd24774733bc0f5054a240cd28"}]}] Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerDiskConfigTestJSON-1120823105 Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: e9bb92cd24774733bc0f5054a240cd28 Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1120823105 Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerDiskConfigTestJSON-1120823105-project Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 0f9814ba6cea472c8759e8f3bf67c734 Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerDiskConfigTestJSON-1120823105-project Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 0f838765-3a8a-47c2-9907-367ddaf2d90f could not be found. Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '0f838765-3a8a-47c2-9907-367ddaf2d90f'} Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f838765-3a8a-47c2-9907-367ddaf2d90f could not be found. Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f838765-3a8a-47c2-9907-367ddaf2d90f could not be found. Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:32.126885 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:32.131627 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:32.131627 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:32.131627 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:32.131627 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:32.131627 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:32.131627 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f838765-3a8a-47c2-9907-367ddaf2d90f could not be found. Aug 29 15:37:32.131627 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:32.132990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f40db0cf-3cd6-435b-bee6-3aafd6991263 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] Returning 404 to user: Instance 0f838765-3a8a-47c2-9907-367ddaf2d90f could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:32.150230 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f40db0cf-3cd6-435b-bee6-3aafd6991263 tempest-ServerDiskConfigTestJSON-1120823105 tempest-ServerDiskConfigTestJSON-1120823105-project] 10.222.0.62 "GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f" status: 404 len: 111 microversion: 2.1 time: 0.079045 Aug 29 15:37:32.151857 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1619/3221] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:32 2022] GET /compute/v2.1/servers/0f838765-3a8a-47c2-9907-367ddaf2d90f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:32.414729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c57edf05-2a9b-4525-acaf-d9532870447b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:32.423178 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c57edf05-2a9b-4525-acaf-d9532870447b tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1533 microversion: 2.1 time: 0.517465 Aug 29 15:37:32.423778 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1603/3222] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:31 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1533 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:32.826997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8a551bed-7257-4ab4-b149-0ac37cc0b863 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:32.827726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8a551bed-7257-4ab4-b149-0ac37cc0b863 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:32.842697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a551bed-7257-4ab4-b149-0ac37cc0b863 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:32.843206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a551bed-7257-4ab4-b149-0ac37cc0b863 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:32.843710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a551bed-7257-4ab4-b149-0ac37cc0b863 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:32.844450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a551bed-7257-4ab4-b149-0ac37cc0b863 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:32.844913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a551bed-7257-4ab4-b149-0ac37cc0b863 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:32.849798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a551bed-7257-4ab4-b149-0ac37cc0b863 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:33.431142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8a551bed-7257-4ab4-b149-0ac37cc0b863 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:33.445614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6f2dbcc4-123b-40d3-8d78-239359a59691 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:33.446253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6f2dbcc4-123b-40d3-8d78-239359a59691 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:33.459896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f2dbcc4-123b-40d3-8d78-239359a59691 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:33.460402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f2dbcc4-123b-40d3-8d78-239359a59691 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:33.460845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f2dbcc4-123b-40d3-8d78-239359a59691 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:33.465839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8a551bed-7257-4ab4-b149-0ac37cc0b863 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:33.467736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8a551bed-7257-4ab4-b149-0ac37cc0b863 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:33.468961 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8a551bed-7257-4ab4-b149-0ac37cc0b863 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1708 microversion: 2.42 time: 0.649252 Aug 29 15:37:33.469210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f2dbcc4-123b-40d3-8d78-239359a59691 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:33.477483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f2dbcc4-123b-40d3-8d78-239359a59691 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:33.479328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f2dbcc4-123b-40d3-8d78-239359a59691 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:33.484990 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1620/3223] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:32 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1708 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:33.856264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2035570486", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:34.007463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] validate_networks() for [('2d27d5b5-0bb7-4454-8b95-3d130a3377a8', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:37:34.477494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6f2dbcc4-123b-40d3-8d78-239359a59691 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:34.486759 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6f2dbcc4-123b-40d3-8d78-239359a59691 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1533 microversion: 2.1 time: 1.046619 Aug 29 15:37:34.511274 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1604/3224] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:33 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1533 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:34.516469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bc1dbdbf-452a-4c4f-a08c-024185b290a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:34.517137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bc1dbdbf-452a-4c4f-a08c-024185b290a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:34.528440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc1dbdbf-452a-4c4f-a08c-024185b290a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:34.530490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc1dbdbf-452a-4c4f-a08c-024185b290a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:34.535958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc1dbdbf-452a-4c4f-a08c-024185b290a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:34.536756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc1dbdbf-452a-4c4f-a08c-024185b290a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:34.539079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc1dbdbf-452a-4c4f-a08c-024185b290a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:34.539707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc1dbdbf-452a-4c4f-a08c-024185b290a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:34.864347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:35.124440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bc1dbdbf-452a-4c4f-a08c-024185b290a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:35.131971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:37:35.132789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:37:35.136590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:37:35.137828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:37:35.140215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:37:35.164886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bc1dbdbf-452a-4c4f-a08c-024185b290a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:35.171298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:35.171555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bc1dbdbf-452a-4c4f-a08c-024185b290a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:35.173187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:35.174774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:35.175247 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bc1dbdbf-452a-4c4f-a08c-024185b290a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1708 microversion: 2.42 time: 0.661770 Aug 29 15:37:35.176294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:35.177159 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1605/3225] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:34 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1708 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:35.178691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:35.181668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:35.196090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-e20e5c23-8906-4d73-8b3a-2e3c18d2a279 req-3e1451f5-5590-4bad-bba4-da38b2d1f258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af95f7c-5362-4cf9-b80e-38cd6a518783", "name": "network-vif-plugged", "status": "completed", "tag": "2984ebfd-8f23-4f8e-83af-0a164bd8c5aa"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:35.224636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e20e5c23-8906-4d73-8b3a-2e3c18d2a279 req-3e1451f5-5590-4bad-bba4-da38b2d1f258 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:35.226622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e20e5c23-8906-4d73-8b3a-2e3c18d2a279 req-3e1451f5-5590-4bad-bba4-da38b2d1f258 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:35.229333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e20e5c23-8906-4d73-8b3a-2e3c18d2a279 req-3e1451f5-5590-4bad-bba4-da38b2d1f258 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:35.245013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Getting quotas for project eaeecb44c6534cba89e3d68177917529. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:37:35.250302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:35.261141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Getting quotas for user 6de4fe0749d449748eca6937b123d2df and project eaeecb44c6534cba89e3d68177917529. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:37:35.269909 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-e20e5c23-8906-4d73-8b3a-2e3c18d2a279 req-3e1451f5-5590-4bad-bba4-da38b2d1f258 service nova] Creating event network-vif-plugged:2984ebfd-8f23-4f8e-83af-0a164bd8c5aa for instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 on n-h2-839401-11 Aug 29 15:37:35.281711 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-e20e5c23-8906-4d73-8b3a-2e3c18d2a279 req-3e1451f5-5590-4bad-bba4-da38b2d1f258 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101081 Aug 29 15:37:35.282353 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1606/3226] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:35.294510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:37:35.299979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:37:35.438351 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-db995bf5-5ce2-4551-8da2-c9f63a2e13ab tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.590497 Aug 29 15:37:35.439574 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1621/3227] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:37:35.455044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e52ce261-d2ef-4858-98a2-142f0df931d8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:35.455989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e52ce261-d2ef-4858-98a2-142f0df931d8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:35.519869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a8abd4d-8b4a-450c-8bff-52890aeaa013 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:35.520667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9a8abd4d-8b4a-450c-8bff-52890aeaa013 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:35.533778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a8abd4d-8b4a-450c-8bff-52890aeaa013 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:35.535874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a8abd4d-8b4a-450c-8bff-52890aeaa013 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:35.537114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a8abd4d-8b4a-450c-8bff-52890aeaa013 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:35.539263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a8abd4d-8b4a-450c-8bff-52890aeaa013 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:35.540063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a8abd4d-8b4a-450c-8bff-52890aeaa013 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:35.542092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a8abd4d-8b4a-450c-8bff-52890aeaa013 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:35.944485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e52ce261-d2ef-4858-98a2-142f0df931d8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:35.966099 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e52ce261-d2ef-4858-98a2-142f0df931d8 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1225 microversion: 2.1 time: 0.517725 Aug 29 15:37:35.966722 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1607/3228] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:35 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1225 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:36.202553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ab4fb07f-ea05-45ea-b91c-d6bcef5b5f16 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:36.203203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ab4fb07f-ea05-45ea-b91c-d6bcef5b5f16 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:36.227756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab4fb07f-ea05-45ea-b91c-d6bcef5b5f16 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:36.229573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab4fb07f-ea05-45ea-b91c-d6bcef5b5f16 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:36.231284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab4fb07f-ea05-45ea-b91c-d6bcef5b5f16 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:36.233983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab4fb07f-ea05-45ea-b91c-d6bcef5b5f16 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:36.237935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab4fb07f-ea05-45ea-b91c-d6bcef5b5f16 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:36.239291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab4fb07f-ea05-45ea-b91c-d6bcef5b5f16 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:36.453051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9a8abd4d-8b4a-450c-8bff-52890aeaa013 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:36.471421 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a8abd4d-8b4a-450c-8bff-52890aeaa013 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1533 microversion: 2.1 time: 0.953532 Aug 29 15:37:36.474228 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1622/3229] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:35 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1533 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:36.897675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-0871c468-fb29-47e1-99b9-2005e9ebbd5b req-d04cff0a-538f-4d26-9017-118445d0e46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74984943-d6e3-4b74-b251-f05fff364c27", "name": "network-vif-deleted", "tag": "f5fdbe76-975e-466c-9d17-812c0ec39457"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:36.937220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0871c468-fb29-47e1-99b9-2005e9ebbd5b req-d04cff0a-538f-4d26-9017-118445d0e46d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:36.941875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0871c468-fb29-47e1-99b9-2005e9ebbd5b req-d04cff0a-538f-4d26-9017-118445d0e46d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:36.944224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0871c468-fb29-47e1-99b9-2005e9ebbd5b req-d04cff0a-538f-4d26-9017-118445d0e46d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:37.015680 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-0871c468-fb29-47e1-99b9-2005e9ebbd5b req-d04cff0a-538f-4d26-9017-118445d0e46d service nova] Creating event network-vif-deleted:f5fdbe76-975e-466c-9d17-812c0ec39457 for instance 74984943-d6e3-4b74-b251-f05fff364c27 on n-h2-839401-11 Aug 29 15:37:37.040667 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-0871c468-fb29-47e1-99b9-2005e9ebbd5b req-d04cff0a-538f-4d26-9017-118445d0e46d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147269 Aug 29 15:37:37.043507 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1623/3230] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:37.074526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7afc0a1a-4dcb-458d-9cdc-eb8d787f2236 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:37.077798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7afc0a1a-4dcb-458d-9cdc-eb8d787f2236 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:37.117018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7afc0a1a-4dcb-458d-9cdc-eb8d787f2236 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:37.118733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7afc0a1a-4dcb-458d-9cdc-eb8d787f2236 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:37.119206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7afc0a1a-4dcb-458d-9cdc-eb8d787f2236 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:37.121697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7afc0a1a-4dcb-458d-9cdc-eb8d787f2236 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:37.122182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7afc0a1a-4dcb-458d-9cdc-eb8d787f2236 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:37.127563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7afc0a1a-4dcb-458d-9cdc-eb8d787f2236 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:37.333890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ab4fb07f-ea05-45ea-b91c-d6bcef5b5f16 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:37.381746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ab4fb07f-ea05-45ea-b91c-d6bcef5b5f16 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:37.389132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ab4fb07f-ea05-45ea-b91c-d6bcef5b5f16 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:37.409703 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ab4fb07f-ea05-45ea-b91c-d6bcef5b5f16 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1755 microversion: 2.42 time: 1.211487 Aug 29 15:37:37.417413 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1608/3231] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:36 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1755 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:37:37.504308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-56217218-927f-4a63-ab5a-5551cf053bcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:37.506316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-56217218-927f-4a63-ab5a-5551cf053bcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:37.548151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56217218-927f-4a63-ab5a-5551cf053bcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:37.566472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56217218-927f-4a63-ab5a-5551cf053bcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:37.567000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56217218-927f-4a63-ab5a-5551cf053bcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:37.572640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56217218-927f-4a63-ab5a-5551cf053bcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:37.575263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56217218-927f-4a63-ab5a-5551cf053bcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:37.579671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56217218-927f-4a63-ab5a-5551cf053bcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:37.654218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56217218-927f-4a63-ab5a-5551cf053bcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:37.655344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56217218-927f-4a63-ab5a-5551cf053bcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:37.656963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56217218-927f-4a63-ab5a-5551cf053bcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:37.658458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-56217218-927f-4a63-ab5a-5551cf053bcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lazy-loading 'fault' on Instance uuid 74984943-d6e3-4b74-b251-f05fff364c27 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:37:37.663283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7afc0a1a-4dcb-458d-9cdc-eb8d787f2236 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:37.678081 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7afc0a1a-4dcb-458d-9cdc-eb8d787f2236 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1221 microversion: 2.1 time: 0.629251 Aug 29 15:37:37.681596 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1624/3232] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:37 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1221 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:37.857412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-56217218-927f-4a63-ab5a-5551cf053bcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:37.866182 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-56217218-927f-4a63-ab5a-5551cf053bcf tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 200 len: 1368 microversion: 2.1 time: 0.371939 Aug 29 15:37:37.873830 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1609/3233] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:37 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 1368 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:38.445844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c7588ca6-14b9-4350-a7e2-eb3f3a632dcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:38.445844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c7588ca6-14b9-4350-a7e2-eb3f3a632dcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:38.469911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7588ca6-14b9-4350-a7e2-eb3f3a632dcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:38.470558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7588ca6-14b9-4350-a7e2-eb3f3a632dcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:38.472950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7588ca6-14b9-4350-a7e2-eb3f3a632dcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:38.476539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7588ca6-14b9-4350-a7e2-eb3f3a632dcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:38.478430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7588ca6-14b9-4350-a7e2-eb3f3a632dcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:38.480018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7588ca6-14b9-4350-a7e2-eb3f3a632dcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:38.703591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-68c2a69b-9547-4d83-a653-fb764453aba3 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:38.704219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-68c2a69b-9547-4d83-a653-fb764453aba3 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:38.715234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-68c2a69b-9547-4d83-a653-fb764453aba3 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:38.725976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-68c2a69b-9547-4d83-a653-fb764453aba3 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:38.726468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-68c2a69b-9547-4d83-a653-fb764453aba3 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:38.727612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-68c2a69b-9547-4d83-a653-fb764453aba3 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:38.736375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-68c2a69b-9547-4d83-a653-fb764453aba3 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:38.739416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-68c2a69b-9547-4d83-a653-fb764453aba3 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:38.998915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c7588ca6-14b9-4350-a7e2-eb3f3a632dcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:39.022314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c7588ca6-14b9-4350-a7e2-eb3f3a632dcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:39.032536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-68c2a69b-9547-4d83-a653-fb764453aba3 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:39.039265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c7588ca6-14b9-4350-a7e2-eb3f3a632dcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:39.040873 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c7588ca6-14b9-4350-a7e2-eb3f3a632dcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1755 microversion: 2.42 time: 0.601170 Aug 29 15:37:39.042159 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1625/3234] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:38 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1755 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:39.048549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5d3edcde-ff78-456f-b4cb-813072547ada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:39.049573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5d3edcde-ff78-456f-b4cb-813072547ada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 74984943-d6e3-4b74-b251-f05fff364c27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:39.063110 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-68c2a69b-9547-4d83-a653-fb764453aba3 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1283 microversion: 2.1 time: 0.363641 Aug 29 15:37:39.063729 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1610/3235] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:38 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1283 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:39.064685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d3edcde-ff78-456f-b4cb-813072547ada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:39.065509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d3edcde-ff78-456f-b4cb-813072547ada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:39.066200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d3edcde-ff78-456f-b4cb-813072547ada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:39.067817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d3edcde-ff78-456f-b4cb-813072547ada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:39.068520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d3edcde-ff78-456f-b4cb-813072547ada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:39.069235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d3edcde-ff78-456f-b4cb-813072547ada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:39.106803 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-5d3edcde-ff78-456f-b4cb-813072547ada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] HTTP exception thrown: Instance 74984943-d6e3-4b74-b251-f05fff364c27 could not be found. Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5d3edcde-ff78-456f-b4cb-813072547ada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Request method failure captured: Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 HTTP/1.1 Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNu7_qAGH9F4T-sEGQ6Fn-tmnEuwowlnuweKCFJVcUgSifVmYMJmfSRBXWi8jaDAfMFH54RTj83N-XG9WMSNHHSrjyczMmdJKp5IDLMRTGYCl-oj5ft2WLudoumPYC0eNStS9lNVLE1tr4v_RxSr-OzeDb0bTV_TnZBRinLfQol-3ZM Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: cac390dda11d4f38983e1478de0dbde1 Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-MigrationsAdminTest-173441369 Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cac390dda11d4f38983e1478de0dbde1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cac390dda11d4f38983e1478de0dbde1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cac390dda11d4f38983e1478de0dbde1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cac390dda11d4f38983e1478de0dbde1"}]}] Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-MigrationsAdminTest-173441369 Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: cac390dda11d4f38983e1478de0dbde1 Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-MigrationsAdminTest-173441369 Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-MigrationsAdminTest-173441369-project Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e57b95d059f74c7a894903b5a8f933df Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-MigrationsAdminTest-173441369-project Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 74984943-d6e3-4b74-b251-f05fff364c27 could not be found. Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '74984943-d6e3-4b74-b251-f05fff364c27'} Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74984943-d6e3-4b74-b251-f05fff364c27 could not be found. Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74984943-d6e3-4b74-b251-f05fff364c27 could not be found. Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:39.109116 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:39.113323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:39.113323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:39.113323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:39.113323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:39.113323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:39.113323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74984943-d6e3-4b74-b251-f05fff364c27 could not be found. Aug 29 15:37:39.113323 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:39.116036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5d3edcde-ff78-456f-b4cb-813072547ada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Returning 404 to user: Instance 74984943-d6e3-4b74-b251-f05fff364c27 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:39.117390 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5d3edcde-ff78-456f-b4cb-813072547ada tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27" status: 404 len: 111 microversion: 2.1 time: 0.073851 Aug 29 15:37:39.118548 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1626/3236] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:39 2022] GET /compute/v2.1/servers/74984943-d6e3-4b74-b251-f05fff364c27 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:39.128352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bc75cfc3-32b9-4fa1-af6a-feeb58ea9852 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '.version_select at 0x7fc42a8ee310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:39.181602 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bc75cfc3-32b9-4fa1-af6a-feeb58ea9852 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1787447980" status: 202 len: 0 microversion: 2.1 time: 0.058574 Aug 29 15:37:39.182845 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1611/3237] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 15:37:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1787447980 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:37:40.070796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-69283c60-6eac-492b-8ffb-f944d8268a5d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:40.071559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-69283c60-6eac-492b-8ffb-f944d8268a5d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:40.089568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7fbe30f6-5cd5-4c33-8908-8f219fb8bdf6 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:40.090131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7fbe30f6-5cd5-4c33-8908-8f219fb8bdf6 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:40.099047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69283c60-6eac-492b-8ffb-f944d8268a5d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:40.099573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69283c60-6eac-492b-8ffb-f944d8268a5d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:40.100028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69283c60-6eac-492b-8ffb-f944d8268a5d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:40.107092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69283c60-6eac-492b-8ffb-f944d8268a5d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:40.107810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fbe30f6-5cd5-4c33-8908-8f219fb8bdf6 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:40.107938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69283c60-6eac-492b-8ffb-f944d8268a5d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:40.108318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fbe30f6-5cd5-4c33-8908-8f219fb8bdf6 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:40.108757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fbe30f6-5cd5-4c33-8908-8f219fb8bdf6 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:40.109517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fbe30f6-5cd5-4c33-8908-8f219fb8bdf6 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:40.109979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fbe30f6-5cd5-4c33-8908-8f219fb8bdf6 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:40.110402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fbe30f6-5cd5-4c33-8908-8f219fb8bdf6 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:40.126112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69283c60-6eac-492b-8ffb-f944d8268a5d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:40.721993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7fbe30f6-5cd5-4c33-8908-8f219fb8bdf6 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:40.749318 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7fbe30f6-5cd5-4c33-8908-8f219fb8bdf6 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1283 microversion: 2.1 time: 0.664963 Aug 29 15:37:40.752867 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1612/3238] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:40 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1283 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:41.118692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-69283c60-6eac-492b-8ffb-f944d8268a5d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:41.142136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-69283c60-6eac-492b-8ffb-f944d8268a5d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:41.147140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-69283c60-6eac-492b-8ffb-f944d8268a5d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:41.156019 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-69283c60-6eac-492b-8ffb-f944d8268a5d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1802 microversion: 2.42 time: 1.090244 Aug 29 15:37:41.181415 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1627/3239] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:40 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1802 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:41.782915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3777d289-7b26-4ab6-aa58-822807630532 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:41.784023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3777d289-7b26-4ab6-aa58-822807630532 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:41.799066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:41.807672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3777d289-7b26-4ab6-aa58-822807630532 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:41.808591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3777d289-7b26-4ab6-aa58-822807630532 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:41.809896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3777d289-7b26-4ab6-aa58-822807630532 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:41.813275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3777d289-7b26-4ab6-aa58-822807630532 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:41.816139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3777d289-7b26-4ab6-aa58-822807630532 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:41.817228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3777d289-7b26-4ab6-aa58-822807630532 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:42.116406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3777d289-7b26-4ab6-aa58-822807630532 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:42.137896 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3777d289-7b26-4ab6-aa58-822807630532 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1283 microversion: 2.1 time: 0.356303 Aug 29 15:37:42.158243 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1613/3240] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:41 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1283 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:42.194829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8790e9ac-1708-4873-9018-9fb1a5f43dea tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:42.196700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8790e9ac-1708-4873-9018-9fb1a5f43dea tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:42.218681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8790e9ac-1708-4873-9018-9fb1a5f43dea tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:42.221015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8790e9ac-1708-4873-9018-9fb1a5f43dea tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:42.223495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8790e9ac-1708-4873-9018-9fb1a5f43dea tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:42.225931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8790e9ac-1708-4873-9018-9fb1a5f43dea tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:42.231606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8790e9ac-1708-4873-9018-9fb1a5f43dea tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:42.232903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8790e9ac-1708-4873-9018-9fb1a5f43dea tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:43.051001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8790e9ac-1708-4873-9018-9fb1a5f43dea tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:43.066879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8790e9ac-1708-4873-9018-9fb1a5f43dea tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:43.068553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8790e9ac-1708-4873-9018-9fb1a5f43dea tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:43.069854 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8790e9ac-1708-4873-9018-9fb1a5f43dea tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1802 microversion: 2.42 time: 0.881789 Aug 29 15:37:43.070425 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1628/3241] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:42 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1802 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:43.164937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5788ae20-4da1-4c89-965e-68ede7dc5458 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:43.165581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5788ae20-4da1-4c89-965e-68ede7dc5458 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:43.176642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5788ae20-4da1-4c89-965e-68ede7dc5458 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:43.177217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5788ae20-4da1-4c89-965e-68ede7dc5458 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:43.177606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5788ae20-4da1-4c89-965e-68ede7dc5458 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:43.178323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5788ae20-4da1-4c89-965e-68ede7dc5458 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:43.178775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5788ae20-4da1-4c89-965e-68ede7dc5458 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:43.179197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5788ae20-4da1-4c89-965e-68ede7dc5458 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:43.768628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b8a0f53-c101-4c9b-85a7-fd0cde8da362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:43.769313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6b8a0f53-c101-4c9b-85a7-fd0cde8da362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:43.795082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b8a0f53-c101-4c9b-85a7-fd0cde8da362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:43.797973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b8a0f53-c101-4c9b-85a7-fd0cde8da362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:43.801568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b8a0f53-c101-4c9b-85a7-fd0cde8da362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:43.804508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b8a0f53-c101-4c9b-85a7-fd0cde8da362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:43.812009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b8a0f53-c101-4c9b-85a7-fd0cde8da362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:43.813867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b8a0f53-c101-4c9b-85a7-fd0cde8da362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:43.913009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6b8a0f53-c101-4c9b-85a7-fd0cde8da362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:37:44.081729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5788ae20-4da1-4c89-965e-68ede7dc5458 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:44.086384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:44.094411 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5788ae20-4da1-4c89-965e-68ede7dc5458 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1325 microversion: 2.1 time: 0.933238 Aug 29 15:37:44.118829 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1614/3242] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:43 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1325 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:44.140359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-466f5bde-41a5-4cab-8a03-9f8acaa2b726 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:44.140991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-466f5bde-41a5-4cab-8a03-9f8acaa2b726 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:44.179698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-466f5bde-41a5-4cab-8a03-9f8acaa2b726 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:44.180414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-466f5bde-41a5-4cab-8a03-9f8acaa2b726 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:44.180603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-466f5bde-41a5-4cab-8a03-9f8acaa2b726 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:44.191589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-466f5bde-41a5-4cab-8a03-9f8acaa2b726 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:44.193417 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6b8a0f53-c101-4c9b-85a7-fd0cde8da362 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "DELETE /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 204 len: 0 microversion: 2.1 time: 0.428405 Aug 29 15:37:44.194945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-466f5bde-41a5-4cab-8a03-9f8acaa2b726 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:44.199656 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1629/3243] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:43 2022] DELETE /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:37:44.201221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-466f5bde-41a5-4cab-8a03-9f8acaa2b726 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:44.214658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-32af7b57-71a0-4e2f-9397-4e6628e2957e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:44.215949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-32af7b57-71a0-4e2f-9397-4e6628e2957e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:44.234722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32af7b57-71a0-4e2f-9397-4e6628e2957e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:44.235905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32af7b57-71a0-4e2f-9397-4e6628e2957e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:44.238390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32af7b57-71a0-4e2f-9397-4e6628e2957e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:44.239492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32af7b57-71a0-4e2f-9397-4e6628e2957e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:44.244104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32af7b57-71a0-4e2f-9397-4e6628e2957e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:44.246470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32af7b57-71a0-4e2f-9397-4e6628e2957e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:45.089470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-466f5bde-41a5-4cab-8a03-9f8acaa2b726 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:45.118229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-466f5bde-41a5-4cab-8a03-9f8acaa2b726 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:45.123155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-466f5bde-41a5-4cab-8a03-9f8acaa2b726 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:45.129132 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-466f5bde-41a5-4cab-8a03-9f8acaa2b726 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1802 microversion: 2.42 time: 1.007417 Aug 29 15:37:45.153274 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1615/3244] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:44 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1802 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:45.165361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2bd10653-c72a-44b9-9bb3-3aff7737b5cd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:45.170677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2bd10653-c72a-44b9-9bb3-3aff7737b5cd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:45.194114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bd10653-c72a-44b9-9bb3-3aff7737b5cd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:45.201693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bd10653-c72a-44b9-9bb3-3aff7737b5cd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:45.202359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bd10653-c72a-44b9-9bb3-3aff7737b5cd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:45.204511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bd10653-c72a-44b9-9bb3-3aff7737b5cd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:45.207447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bd10653-c72a-44b9-9bb3-3aff7737b5cd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:45.208296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bd10653-c72a-44b9-9bb3-3aff7737b5cd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:45.212713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:45.282422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=22 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:45.287009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-32af7b57-71a0-4e2f-9397-4e6628e2957e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:45.304234 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-32af7b57-71a0-4e2f-9397-4e6628e2957e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1468 microversion: 2.1 time: 1.100594 Aug 29 15:37:45.320642 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1630/3245] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:44 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1468 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:45.777000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2bd10653-c72a-44b9-9bb3-3aff7737b5cd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:45.789857 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2bd10653-c72a-44b9-9bb3-3aff7737b5cd tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1325 microversion: 2.1 time: 0.635031 Aug 29 15:37:45.790753 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1616/3246] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:45 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1325 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:46.165202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7b748a01-a735-4144-a963-70f4614b2fde tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:46.165863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7b748a01-a735-4144-a963-70f4614b2fde tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:46.187984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b748a01-a735-4144-a963-70f4614b2fde tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:46.195730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b748a01-a735-4144-a963-70f4614b2fde tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:46.196314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b748a01-a735-4144-a963-70f4614b2fde tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:46.197119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b748a01-a735-4144-a963-70f4614b2fde tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:46.197585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b748a01-a735-4144-a963-70f4614b2fde tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:46.198021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b748a01-a735-4144-a963-70f4614b2fde tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:46.329509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c5314f2-1535-4269-8888-21d246b4d7e3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:46.331661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6c5314f2-1535-4269-8888-21d246b4d7e3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:46.347703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:46.360144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c5314f2-1535-4269-8888-21d246b4d7e3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:46.360667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c5314f2-1535-4269-8888-21d246b4d7e3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:46.361138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c5314f2-1535-4269-8888-21d246b4d7e3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:46.372394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c5314f2-1535-4269-8888-21d246b4d7e3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:46.375388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c5314f2-1535-4269-8888-21d246b4d7e3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:46.378252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c5314f2-1535-4269-8888-21d246b4d7e3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:47.122233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7b748a01-a735-4144-a963-70f4614b2fde tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:47.133208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7b748a01-a735-4144-a963-70f4614b2fde tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:47.143120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7b748a01-a735-4144-a963-70f4614b2fde tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:47.144711 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7b748a01-a735-4144-a963-70f4614b2fde tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1849 microversion: 2.42 time: 0.986057 Aug 29 15:37:47.145529 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1631/3247] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:46 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1849 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:47.155747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6f6887c6-4cd1-4bbe-9976-2a1788233b87 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:47.157531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6f6887c6-4cd1-4bbe-9976-2a1788233b87 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:47.173768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f6887c6-4cd1-4bbe-9976-2a1788233b87 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:47.174555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f6887c6-4cd1-4bbe-9976-2a1788233b87 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:47.175196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f6887c6-4cd1-4bbe-9976-2a1788233b87 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:47.176107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f6887c6-4cd1-4bbe-9976-2a1788233b87 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:47.181721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f6887c6-4cd1-4bbe-9976-2a1788233b87 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:47.182405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f6887c6-4cd1-4bbe-9976-2a1788233b87 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:47.723679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6f6887c6-4cd1-4bbe-9976-2a1788233b87 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:47.748031 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6f6887c6-4cd1-4bbe-9976-2a1788233b87 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1325 microversion: 2.1 time: 0.590294 Aug 29 15:37:47.750787 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1632/3248] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:47 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1325 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:48.049970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6c5314f2-1535-4269-8888-21d246b4d7e3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:48.059588 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6c5314f2-1535-4269-8888-21d246b4d7e3 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 200 len: 1468 microversion: 2.1 time: 1.735620 Aug 29 15:37:48.071044 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1617/3249] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:46 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 1468 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:48.174080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c03f36d7-c707-420b-a861-bbc411b41593 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:48.174707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c03f36d7-c707-420b-a861-bbc411b41593 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:48.183991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-63145f6d-30cf-4ffd-8056-6f4e304a0c9f req-1bd4b812-4bb9-45f6-be40-21acaf63f070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11592c2a-43a5-492f-a40a-64ae99efa92e", "name": "network-vif-deleted", "tag": "b8190072-2f76-41df-9404-7f44a26edb8c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:48.189109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c03f36d7-c707-420b-a861-bbc411b41593 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:48.194248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c03f36d7-c707-420b-a861-bbc411b41593 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:48.194754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c03f36d7-c707-420b-a861-bbc411b41593 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:48.195515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c03f36d7-c707-420b-a861-bbc411b41593 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:48.195993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c03f36d7-c707-420b-a861-bbc411b41593 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:48.196479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c03f36d7-c707-420b-a861-bbc411b41593 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:48.208013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-63145f6d-30cf-4ffd-8056-6f4e304a0c9f req-1bd4b812-4bb9-45f6-be40-21acaf63f070 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:48.208613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-63145f6d-30cf-4ffd-8056-6f4e304a0c9f req-1bd4b812-4bb9-45f6-be40-21acaf63f070 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:48.209749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-63145f6d-30cf-4ffd-8056-6f4e304a0c9f req-1bd4b812-4bb9-45f6-be40-21acaf63f070 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:48.246510 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-63145f6d-30cf-4ffd-8056-6f4e304a0c9f req-1bd4b812-4bb9-45f6-be40-21acaf63f070 service nova] Creating event network-vif-deleted:b8190072-2f76-41df-9404-7f44a26edb8c for instance 11592c2a-43a5-492f-a40a-64ae99efa92e on n-h1-839401-11 Aug 29 15:37:48.255776 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-63145f6d-30cf-4ffd-8056-6f4e304a0c9f req-1bd4b812-4bb9-45f6-be40-21acaf63f070 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.499042 Aug 29 15:37:48.256916 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1633/3250] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:48.781355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d36f7ffc-567e-4170-9c83-162d97113a76 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:48.782306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d36f7ffc-567e-4170-9c83-162d97113a76 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:48.789685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d36f7ffc-567e-4170-9c83-162d97113a76 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:48.790108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d36f7ffc-567e-4170-9c83-162d97113a76 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:48.795565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d36f7ffc-567e-4170-9c83-162d97113a76 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:48.797674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d36f7ffc-567e-4170-9c83-162d97113a76 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:48.804891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d36f7ffc-567e-4170-9c83-162d97113a76 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:48.805804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d36f7ffc-567e-4170-9c83-162d97113a76 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:49.042451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d36f7ffc-567e-4170-9c83-162d97113a76 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:49.052442 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d36f7ffc-567e-4170-9c83-162d97113a76 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1325 microversion: 2.1 time: 0.275211 Aug 29 15:37:49.053428 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1634/3251] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:48 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1325 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:49.081950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ae167648-fa67-4089-9d66-a82cf517e544 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:49.082613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ae167648-fa67-4089-9d66-a82cf517e544 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: 11592c2a-43a5-492f-a40a-64ae99efa92e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:49.098431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae167648-fa67-4089-9d66-a82cf517e544 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:49.099145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae167648-fa67-4089-9d66-a82cf517e544 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:49.101763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae167648-fa67-4089-9d66-a82cf517e544 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:49.106166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae167648-fa67-4089-9d66-a82cf517e544 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:49.106901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae167648-fa67-4089-9d66-a82cf517e544 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:49.109916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae167648-fa67-4089-9d66-a82cf517e544 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:49.155055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c03f36d7-c707-420b-a861-bbc411b41593 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:49.170620 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-ae167648-fa67-4089-9d66-a82cf517e544 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] HTTP exception thrown: Instance 11592c2a-43a5-492f-a40a-64ae99efa92e could not be found. Aug 29 15:37:49.173415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c03f36d7-c707-420b-a861-bbc411b41593 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:49.178057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c03f36d7-c707-420b-a861-bbc411b41593 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:49.182202 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c03f36d7-c707-420b-a861-bbc411b41593 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1849 microversion: 2.42 time: 1.010611 Aug 29 15:37:49.183472 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1618/3252] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:48 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1849 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ae167648-fa67-4089-9d66-a82cf517e544 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Request method failure captured: Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e HTTP/1.1 Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNu7_qAGH9F4T-sEGQ6Fn-tmnEuwowlnuweKCFJVcUgSifVmYMJmfSRBXWi8jaDAfMFH54RTj83N-XG9WMSNHHSrjyczMmdJKp5IDLMRTGYCl-oj5ft2WLudoumPYC0eNStS9lNVLE1tr4v_RxSr-OzeDb0bTV_TnZBRinLfQol-3ZM Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: cac390dda11d4f38983e1478de0dbde1 Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-MigrationsAdminTest-173441369 Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cac390dda11d4f38983e1478de0dbde1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cac390dda11d4f38983e1478de0dbde1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cac390dda11d4f38983e1478de0dbde1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cac390dda11d4f38983e1478de0dbde1"}]}] Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-MigrationsAdminTest-173441369 Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: cac390dda11d4f38983e1478de0dbde1 Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-MigrationsAdminTest-173441369 Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-MigrationsAdminTest-173441369-project Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e57b95d059f74c7a894903b5a8f933df Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-MigrationsAdminTest-173441369-project Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 11592c2a-43a5-492f-a40a-64ae99efa92e could not be found. Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '11592c2a-43a5-492f-a40a-64ae99efa92e'} Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11592c2a-43a5-492f-a40a-64ae99efa92e could not be found. Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11592c2a-43a5-492f-a40a-64ae99efa92e could not be found. Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:49.201908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.207321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:49.207321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:49.207321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:49.207321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:49.207321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:49.207321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11592c2a-43a5-492f-a40a-64ae99efa92e could not be found. Aug 29 15:37:49.207321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.207321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ae167648-fa67-4089-9d66-a82cf517e544 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Returning 404 to user: Instance 11592c2a-43a5-492f-a40a-64ae99efa92e could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:49.209847 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ae167648-fa67-4089-9d66-a82cf517e544 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e" status: 404 len: 111 microversion: 2.1 time: 0.131888 Aug 29 15:37:49.213270 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1635/3253] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:49 2022] GET /compute/v2.1/servers/11592c2a-43a5-492f-a40a-64ae99efa92e => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:49.222178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f360069b-e147-4fc1-bbbd-a0f07c41550e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:49.222713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f360069b-e147-4fc1-bbbd-a0f07c41550e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:49.236957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f360069b-e147-4fc1-bbbd-a0f07c41550e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:49.238877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f360069b-e147-4fc1-bbbd-a0f07c41550e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:49.243478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f360069b-e147-4fc1-bbbd-a0f07c41550e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:49.245112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f360069b-e147-4fc1-bbbd-a0f07c41550e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:49.248036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f360069b-e147-4fc1-bbbd-a0f07c41550e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:49.248692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f360069b-e147-4fc1-bbbd-a0f07c41550e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:49.320671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f360069b-e147-4fc1-bbbd-a0f07c41550e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:37:49.407174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-5e7dec82-48ab-482e-b99d-bbd6963fb854 req-0ebb5ded-6feb-4ed3-8192-5049a134bb0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0017b65-7a12-4dbb-926e-51dccc9475a9", "tag": "a469d9e2-82d7-4161-8e7a-b2a82438b48b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:49.440213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5e7dec82-48ab-482e-b99d-bbd6963fb854 req-0ebb5ded-6feb-4ed3-8192-5049a134bb0f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:49.443034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5e7dec82-48ab-482e-b99d-bbd6963fb854 req-0ebb5ded-6feb-4ed3-8192-5049a134bb0f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:49.443495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5e7dec82-48ab-482e-b99d-bbd6963fb854 req-0ebb5ded-6feb-4ed3-8192-5049a134bb0f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:49.464009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:49.511263 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-5e7dec82-48ab-482e-b99d-bbd6963fb854 req-0ebb5ded-6feb-4ed3-8192-5049a134bb0f service nova] Creating event network-changed:a469d9e2-82d7-4161-8e7a-b2a82438b48b for instance e0017b65-7a12-4dbb-926e-51dccc9475a9 on n-h1-839401-11 Aug 29 15:37:49.525209 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f360069b-e147-4fc1-bbbd-a0f07c41550e tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "DELETE /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 204 len: 0 microversion: 2.1 time: 0.304043 Aug 29 15:37:49.529370 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1619/3254] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:49 2022] DELETE /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:37:49.548937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a44ed9c3-8b7a-45e6-8187-7ecd6de36935 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:49.550500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a44ed9c3-8b7a-45e6-8187-7ecd6de36935 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:49.551287 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-5e7dec82-48ab-482e-b99d-bbd6963fb854 req-0ebb5ded-6feb-4ed3-8192-5049a134bb0f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148191 Aug 29 15:37:49.555711 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1636/3255] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:37:49.564538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a44ed9c3-8b7a-45e6-8187-7ecd6de36935 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:49.565222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a44ed9c3-8b7a-45e6-8187-7ecd6de36935 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:49.565676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a44ed9c3-8b7a-45e6-8187-7ecd6de36935 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:49.566415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a44ed9c3-8b7a-45e6-8187-7ecd6de36935 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:49.566879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a44ed9c3-8b7a-45e6-8187-7ecd6de36935 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:49.567310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a44ed9c3-8b7a-45e6-8187-7ecd6de36935 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:50.076077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8dcd2da4-a85c-4a6b-8f25-cf3789f5c27b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:50.077212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8dcd2da4-a85c-4a6b-8f25-cf3789f5c27b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:50.097342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8dcd2da4-a85c-4a6b-8f25-cf3789f5c27b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:50.100325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8dcd2da4-a85c-4a6b-8f25-cf3789f5c27b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:50.102542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8dcd2da4-a85c-4a6b-8f25-cf3789f5c27b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:50.104770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8dcd2da4-a85c-4a6b-8f25-cf3789f5c27b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:50.110539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8dcd2da4-a85c-4a6b-8f25-cf3789f5c27b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:50.111346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8dcd2da4-a85c-4a6b-8f25-cf3789f5c27b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:50.426165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8dcd2da4-a85c-4a6b-8f25-cf3789f5c27b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:50.434137 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8dcd2da4-a85c-4a6b-8f25-cf3789f5c27b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1325 microversion: 2.1 time: 0.362735 Aug 29 15:37:50.442072 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1637/3256] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:50 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1325 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:50.450251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cffdde2d-72cc-4a2d-be70-c3a01eb93a6d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:50.450895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cffdde2d-72cc-4a2d-be70-c3a01eb93a6d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:50.481144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cffdde2d-72cc-4a2d-be70-c3a01eb93a6d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:50.481560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cffdde2d-72cc-4a2d-be70-c3a01eb93a6d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:50.482287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cffdde2d-72cc-4a2d-be70-c3a01eb93a6d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:50.483220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cffdde2d-72cc-4a2d-be70-c3a01eb93a6d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:50.485490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cffdde2d-72cc-4a2d-be70-c3a01eb93a6d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:50.486153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cffdde2d-72cc-4a2d-be70-c3a01eb93a6d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:50.717888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a44ed9c3-8b7a-45e6-8187-7ecd6de36935 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:50.737891 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a44ed9c3-8b7a-45e6-8187-7ecd6de36935 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1468 microversion: 2.1 time: 1.199769 Aug 29 15:37:50.742791 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1620/3257] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:49 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1468 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:51.146569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cffdde2d-72cc-4a2d-be70-c3a01eb93a6d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:51.173451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cffdde2d-72cc-4a2d-be70-c3a01eb93a6d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:51.175122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cffdde2d-72cc-4a2d-be70-c3a01eb93a6d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:51.176350 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cffdde2d-72cc-4a2d-be70-c3a01eb93a6d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1849 microversion: 2.42 time: 0.733232 Aug 29 15:37:51.176922 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1638/3258] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:50 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1849 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:51.456669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4d2220c8-1215-43a7-8011-29f461ee8d26 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:51.457443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4d2220c8-1215-43a7-8011-29f461ee8d26 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:51.473877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d2220c8-1215-43a7-8011-29f461ee8d26 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:51.477768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d2220c8-1215-43a7-8011-29f461ee8d26 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:51.478884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d2220c8-1215-43a7-8011-29f461ee8d26 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:51.480640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d2220c8-1215-43a7-8011-29f461ee8d26 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:51.483045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d2220c8-1215-43a7-8011-29f461ee8d26 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:51.484126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d2220c8-1215-43a7-8011-29f461ee8d26 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:51.684873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-4c9f00f2-0415-4f3a-ad37-a2f5a1ba5701 req-598a2a05-6499-42f6-ad77-d479829d362e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "tag": "528dfe97-4f5f-4f10-a2cd-7936781f265f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:51.718722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4c9f00f2-0415-4f3a-ad37-a2f5a1ba5701 req-598a2a05-6499-42f6-ad77-d479829d362e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:51.719245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4c9f00f2-0415-4f3a-ad37-a2f5a1ba5701 req-598a2a05-6499-42f6-ad77-d479829d362e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:51.719692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4c9f00f2-0415-4f3a-ad37-a2f5a1ba5701 req-598a2a05-6499-42f6-ad77-d479829d362e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:51.760920 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-4c9f00f2-0415-4f3a-ad37-a2f5a1ba5701 req-598a2a05-6499-42f6-ad77-d479829d362e service nova] Creating event network-changed:528dfe97-4f5f-4f10-a2cd-7936781f265f for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:37:51.767411 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-4c9f00f2-0415-4f3a-ad37-a2f5a1ba5701 req-598a2a05-6499-42f6-ad77-d479829d362e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087195 Aug 29 15:37:51.769237 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1639/3259] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:51.781601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-de4b993b-ff6c-4c52-8d81-d5db171dc83d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:51.782639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-de4b993b-ff6c-4c52-8d81-d5db171dc83d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:51.790491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de4b993b-ff6c-4c52-8d81-d5db171dc83d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:51.791296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de4b993b-ff6c-4c52-8d81-d5db171dc83d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:51.791918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de4b993b-ff6c-4c52-8d81-d5db171dc83d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:51.792841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de4b993b-ff6c-4c52-8d81-d5db171dc83d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:51.794170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de4b993b-ff6c-4c52-8d81-d5db171dc83d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:51.795313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de4b993b-ff6c-4c52-8d81-d5db171dc83d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:52.501311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-de4b993b-ff6c-4c52-8d81-d5db171dc83d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:52.509358 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-de4b993b-ff6c-4c52-8d81-d5db171dc83d tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1468 microversion: 2.1 time: 0.737254 Aug 29 15:37:52.513632 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1640/3260] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:51 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1468 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:52.538735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-999778de-d8c0-48e1-94d9-e2e7dcd819d4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:52.542855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-999778de-d8c0-48e1-94d9-e2e7dcd819d4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:52.577683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-999778de-d8c0-48e1-94d9-e2e7dcd819d4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:52.582391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-999778de-d8c0-48e1-94d9-e2e7dcd819d4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:52.582959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-999778de-d8c0-48e1-94d9-e2e7dcd819d4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:52.583832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-999778de-d8c0-48e1-94d9-e2e7dcd819d4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:52.588309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-999778de-d8c0-48e1-94d9-e2e7dcd819d4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:52.589169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-999778de-d8c0-48e1-94d9-e2e7dcd819d4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:52.600515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4d2220c8-1215-43a7-8011-29f461ee8d26 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:52.615495 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4d2220c8-1215-43a7-8011-29f461ee8d26 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1325 microversion: 2.1 time: 1.161579 Aug 29 15:37:52.619423 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1621/3261] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:51 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1325 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:53.552012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ab599ce3-80c2-4497-ba59-ce8fde8dde7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:53.552838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ab599ce3-80c2-4497-ba59-ce8fde8dde7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:53.570446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab599ce3-80c2-4497-ba59-ce8fde8dde7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:53.574500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab599ce3-80c2-4497-ba59-ce8fde8dde7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:53.575194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab599ce3-80c2-4497-ba59-ce8fde8dde7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:53.578154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab599ce3-80c2-4497-ba59-ce8fde8dde7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:53.578861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab599ce3-80c2-4497-ba59-ce8fde8dde7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:53.579555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab599ce3-80c2-4497-ba59-ce8fde8dde7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:53.683786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-999778de-d8c0-48e1-94d9-e2e7dcd819d4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:53.700024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-999778de-d8c0-48e1-94d9-e2e7dcd819d4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:53.703643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-999778de-d8c0-48e1-94d9-e2e7dcd819d4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:53.705013 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-999778de-d8c0-48e1-94d9-e2e7dcd819d4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1849 microversion: 2.42 time: 1.187595 Aug 29 15:37:53.708621 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1641/3262] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:52 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1849 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:53.722476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9ae20ade-9350-4b21-b323-6b36831bbb59 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:53.723944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9ae20ade-9350-4b21-b323-6b36831bbb59 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:53.749597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ae20ade-9350-4b21-b323-6b36831bbb59 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:53.752250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ae20ade-9350-4b21-b323-6b36831bbb59 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:53.752933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ae20ade-9350-4b21-b323-6b36831bbb59 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:53.753983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ae20ade-9350-4b21-b323-6b36831bbb59 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:53.756993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ae20ade-9350-4b21-b323-6b36831bbb59 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:53.759474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ae20ade-9350-4b21-b323-6b36831bbb59 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:54.087288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ab599ce3-80c2-4497-ba59-ce8fde8dde7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:54.106807 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ab599ce3-80c2-4497-ba59-ce8fde8dde7a tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1426 microversion: 2.1 time: 0.563259 Aug 29 15:37:54.108053 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1622/3263] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:53 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1426 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:54.446612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-84f10e17-9b94-4a78-8ce5-d567d7e88010 req-c6c1bc72-490a-4e77-9457-fcfdca3461bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab2a8c5-99e8-428d-99e2-3c62d1d86e3e", "name": "network-vif-deleted", "tag": "da67ee23-a789-4121-8fed-92df23ce0b7e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:54.470698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-84f10e17-9b94-4a78-8ce5-d567d7e88010 req-c6c1bc72-490a-4e77-9457-fcfdca3461bf service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:54.493191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-84f10e17-9b94-4a78-8ce5-d567d7e88010 req-c6c1bc72-490a-4e77-9457-fcfdca3461bf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:54.493947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-84f10e17-9b94-4a78-8ce5-d567d7e88010 req-c6c1bc72-490a-4e77-9457-fcfdca3461bf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:54.530192 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-84f10e17-9b94-4a78-8ce5-d567d7e88010 req-c6c1bc72-490a-4e77-9457-fcfdca3461bf service nova] Creating event network-vif-deleted:da67ee23-a789-4121-8fed-92df23ce0b7e for instance dab2a8c5-99e8-428d-99e2-3c62d1d86e3e on n-h2-839401-11 Aug 29 15:37:54.553968 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-84f10e17-9b94-4a78-8ce5-d567d7e88010 req-c6c1bc72-490a-4e77-9457-fcfdca3461bf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111262 Aug 29 15:37:54.555265 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1623/3264] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:37:54.733562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-32532e06-7532-417e-9e58-4edc51e6a5e1 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:54.734539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-32532e06-7532-417e-9e58-4edc51e6a5e1 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:54.784582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32532e06-7532-417e-9e58-4edc51e6a5e1 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:54.785112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32532e06-7532-417e-9e58-4edc51e6a5e1 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:54.792543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32532e06-7532-417e-9e58-4edc51e6a5e1 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:54.793551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32532e06-7532-417e-9e58-4edc51e6a5e1 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:54.799150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32532e06-7532-417e-9e58-4edc51e6a5e1 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:54.802683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32532e06-7532-417e-9e58-4edc51e6a5e1 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:54.871965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9ae20ade-9350-4b21-b323-6b36831bbb59 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:54.890180 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9ae20ade-9350-4b21-b323-6b36831bbb59 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1325 microversion: 2.1 time: 1.179787 Aug 29 15:37:54.890790 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1642/3265] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:53 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1325 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:55.132085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9503f6dc-6a4e-4c4d-9cee-14e3ce231337 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:55.133395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9503f6dc-6a4e-4c4d-9cee-14e3ce231337 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:55.141634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9503f6dc-6a4e-4c4d-9cee-14e3ce231337 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:55.142466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9503f6dc-6a4e-4c4d-9cee-14e3ce231337 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:55.143739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9503f6dc-6a4e-4c4d-9cee-14e3ce231337 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:55.144808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9503f6dc-6a4e-4c4d-9cee-14e3ce231337 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:55.145458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9503f6dc-6a4e-4c4d-9cee-14e3ce231337 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:55.146356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9503f6dc-6a4e-4c4d-9cee-14e3ce231337 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:55.273740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9503f6dc-6a4e-4c4d-9cee-14e3ce231337 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:55.274635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9503f6dc-6a4e-4c4d-9cee-14e3ce231337 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:55.275778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9503f6dc-6a4e-4c4d-9cee-14e3ce231337 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:55.277129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-9503f6dc-6a4e-4c4d-9cee-14e3ce231337 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lazy-loading 'fault' on Instance uuid dab2a8c5-99e8-428d-99e2-3c62d1d86e3e {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:37:55.641712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9503f6dc-6a4e-4c4d-9cee-14e3ce231337 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b95d059f74c7a894903b5a8f933df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac390dda11d4f38983e1478de0dbde1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:55.651843 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9503f6dc-6a4e-4c4d-9cee-14e3ce231337 tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 200 len: 1302 microversion: 2.1 time: 0.525916 Aug 29 15:37:55.653650 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1643/3266] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:55 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 1302 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:55.911960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2c35b309-c177-4ce1-a31f-743b5eb056c4 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:55.913430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2c35b309-c177-4ce1-a31f-743b5eb056c4 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:55.928928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c35b309-c177-4ce1-a31f-743b5eb056c4 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:55.934113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c35b309-c177-4ce1-a31f-743b5eb056c4 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:55.935897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c35b309-c177-4ce1-a31f-743b5eb056c4 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:55.944281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c35b309-c177-4ce1-a31f-743b5eb056c4 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:55.948069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c35b309-c177-4ce1-a31f-743b5eb056c4 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:55.951185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c35b309-c177-4ce1-a31f-743b5eb056c4 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:56.461694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2c35b309-c177-4ce1-a31f-743b5eb056c4 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:56.477103 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2c35b309-c177-4ce1-a31f-743b5eb056c4 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1325 microversion: 2.1 time: 0.568769 Aug 29 15:37:56.491545 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1644/3267] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:55 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1325 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:56.598165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-32532e06-7532-417e-9e58-4edc51e6a5e1 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:56.628029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-32532e06-7532-417e-9e58-4edc51e6a5e1 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:56.629777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-32532e06-7532-417e-9e58-4edc51e6a5e1 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:56.630990 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-32532e06-7532-417e-9e58-4edc51e6a5e1 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1870 microversion: 2.42 time: 1.903421 Aug 29 15:37:56.663973 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1624/3268] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:54 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1870 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:37:56.681749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b3566bd-fac4-4107-9947-abc5afa3d6bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:56.682632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8b3566bd-fac4-4107-9947-abc5afa3d6bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] [instance: dab2a8c5-99e8-428d-99e2-3c62d1d86e3e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:56.693040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b3566bd-fac4-4107-9947-abc5afa3d6bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:56.698874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b3566bd-fac4-4107-9947-abc5afa3d6bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:56.709365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b3566bd-fac4-4107-9947-abc5afa3d6bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:56.712700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b3566bd-fac4-4107-9947-abc5afa3d6bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:56.714981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b3566bd-fac4-4107-9947-abc5afa3d6bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:56.715595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b3566bd-fac4-4107-9947-abc5afa3d6bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:56.757598 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-8b3566bd-fac4-4107-9947-abc5afa3d6bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] HTTP exception thrown: Instance dab2a8c5-99e8-428d-99e2-3c62d1d86e3e could not be found. Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b3566bd-fac4-4107-9947-abc5afa3d6bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Request method failure captured: Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e HTTP/1.1 Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNu7_qAGH9F4T-sEGQ6Fn-tmnEuwowlnuweKCFJVcUgSifVmYMJmfSRBXWi8jaDAfMFH54RTj83N-XG9WMSNHHSrjyczMmdJKp5IDLMRTGYCl-oj5ft2WLudoumPYC0eNStS9lNVLE1tr4v_RxSr-OzeDb0bTV_TnZBRinLfQol-3ZM Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: cac390dda11d4f38983e1478de0dbde1 Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-MigrationsAdminTest-173441369 Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cac390dda11d4f38983e1478de0dbde1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cac390dda11d4f38983e1478de0dbde1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cac390dda11d4f38983e1478de0dbde1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cac390dda11d4f38983e1478de0dbde1"}]}] Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-MigrationsAdminTest-173441369 Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: cac390dda11d4f38983e1478de0dbde1 Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-MigrationsAdminTest-173441369 Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-MigrationsAdminTest-173441369-project Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e57b95d059f74c7a894903b5a8f933df Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-MigrationsAdminTest-173441369-project Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance dab2a8c5-99e8-428d-99e2-3c62d1d86e3e could not be found. Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'dab2a8c5-99e8-428d-99e2-3c62d1d86e3e'} Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab2a8c5-99e8-428d-99e2-3c62d1d86e3e could not be found. Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab2a8c5-99e8-428d-99e2-3c62d1d86e3e could not be found. Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:56.775710 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:56.780712 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:56.780712 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:56.780712 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:56.780712 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:56.780712 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:56.780712 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab2a8c5-99e8-428d-99e2-3c62d1d86e3e could not be found. Aug 29 15:37:56.780712 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:37:56.791957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b3566bd-fac4-4107-9947-abc5afa3d6bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] Returning 404 to user: Instance dab2a8c5-99e8-428d-99e2-3c62d1d86e3e could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:56.794116 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8b3566bd-fac4-4107-9947-abc5afa3d6bd tempest-MigrationsAdminTest-173441369 tempest-MigrationsAdminTest-173441369-project] 10.222.0.62 "GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e" status: 404 len: 111 microversion: 2.1 time: 0.119728 Aug 29 15:37:56.800642 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1645/3269] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:56 2022] GET /compute/v2.1/servers/dab2a8c5-99e8-428d-99e2-3c62d1d86e3e => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:57.498912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fe6dbfab-221b-476f-bd6d-1c68ae0be3ce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:57.499545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fe6dbfab-221b-476f-bd6d-1c68ae0be3ce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:57.518073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6dbfab-221b-476f-bd6d-1c68ae0be3ce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:57.518589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6dbfab-221b-476f-bd6d-1c68ae0be3ce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:57.519029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6dbfab-221b-476f-bd6d-1c68ae0be3ce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:57.524471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6dbfab-221b-476f-bd6d-1c68ae0be3ce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:57.526758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6dbfab-221b-476f-bd6d-1c68ae0be3ce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:57.528469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6dbfab-221b-476f-bd6d-1c68ae0be3ce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:57.660017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2aa880f4-d2e9-42dc-bf62-1f415b6d7099 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:57.660637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2aa880f4-d2e9-42dc-bf62-1f415b6d7099 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:57.676010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2aa880f4-d2e9-42dc-bf62-1f415b6d7099 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:57.676611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2aa880f4-d2e9-42dc-bf62-1f415b6d7099 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:57.691072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2aa880f4-d2e9-42dc-bf62-1f415b6d7099 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:57.692068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2aa880f4-d2e9-42dc-bf62-1f415b6d7099 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:57.692719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2aa880f4-d2e9-42dc-bf62-1f415b6d7099 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:57.693191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2aa880f4-d2e9-42dc-bf62-1f415b6d7099 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:58.159359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2aa880f4-d2e9-42dc-bf62-1f415b6d7099 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:58.183748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2aa880f4-d2e9-42dc-bf62-1f415b6d7099 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:58.185738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2aa880f4-d2e9-42dc-bf62-1f415b6d7099 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:58.190890 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2aa880f4-d2e9-42dc-bf62-1f415b6d7099 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1870 microversion: 2.42 time: 0.534792 Aug 29 15:37:58.192853 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1646/3270] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:57 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1870 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:58.202134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-970136d3-fb4e-4f23-8fa2-3e9306099f86 req-1f570215-6a04-4f35-aa87-7b60ec330313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "tag": "898c5b2c-e9b1-4662-8491-a1b8d879ce2b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:58.220210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-970136d3-fb4e-4f23-8fa2-3e9306099f86 req-1f570215-6a04-4f35-aa87-7b60ec330313 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:58.222535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-970136d3-fb4e-4f23-8fa2-3e9306099f86 req-1f570215-6a04-4f35-aa87-7b60ec330313 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:58.223396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-970136d3-fb4e-4f23-8fa2-3e9306099f86 req-1f570215-6a04-4f35-aa87-7b60ec330313 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:58.242478 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-970136d3-fb4e-4f23-8fa2-3e9306099f86 req-1f570215-6a04-4f35-aa87-7b60ec330313 service nova] Creating event network-changed:898c5b2c-e9b1-4662-8491-a1b8d879ce2b for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:37:58.248778 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-970136d3-fb4e-4f23-8fa2-3e9306099f86 req-1f570215-6a04-4f35-aa87-7b60ec330313 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054333 Aug 29 15:37:58.257444 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1647/3271] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:59.224610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4972740d-38f6-479e-a2b3-d087c7783719 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:59.226745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4972740d-38f6-479e-a2b3-d087c7783719 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:59.249860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4972740d-38f6-479e-a2b3-d087c7783719 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:59.252654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4972740d-38f6-479e-a2b3-d087c7783719 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:59.253250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4972740d-38f6-479e-a2b3-d087c7783719 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:59.254010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4972740d-38f6-479e-a2b3-d087c7783719 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:59.257845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4972740d-38f6-479e-a2b3-d087c7783719 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:59.258546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4972740d-38f6-479e-a2b3-d087c7783719 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:59.597817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fe6dbfab-221b-476f-bd6d-1c68ae0be3ce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:59.614447 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fe6dbfab-221b-476f-bd6d-1c68ae0be3ce tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1325 microversion: 2.1 time: 2.111449 Aug 29 15:37:59.614971 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1625/3272] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:57 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1325 bytes in 2121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:00.035168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b174a270-1c52-41f0-bc60-6820e8b1368a req-6def8ea2-ca9c-4124-a0b6-4f882222f61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0017b65-7a12-4dbb-926e-51dccc9475a9", "name": "network-vif-plugged", "status": "completed", "tag": "a469d9e2-82d7-4161-8e7a-b2a82438b48b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:00.069162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b174a270-1c52-41f0-bc60-6820e8b1368a req-6def8ea2-ca9c-4124-a0b6-4f882222f61e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:00.073527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b174a270-1c52-41f0-bc60-6820e8b1368a req-6def8ea2-ca9c-4124-a0b6-4f882222f61e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:00.074445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b174a270-1c52-41f0-bc60-6820e8b1368a req-6def8ea2-ca9c-4124-a0b6-4f882222f61e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:00.102855 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b174a270-1c52-41f0-bc60-6820e8b1368a req-6def8ea2-ca9c-4124-a0b6-4f882222f61e service nova] Creating event network-vif-plugged:a469d9e2-82d7-4161-8e7a-b2a82438b48b for instance e0017b65-7a12-4dbb-926e-51dccc9475a9 on n-h1-839401-11 Aug 29 15:38:00.131553 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b174a270-1c52-41f0-bc60-6820e8b1368a req-6def8ea2-ca9c-4124-a0b6-4f882222f61e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098434 Aug 29 15:38:00.142695 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1626/3273] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:00.637476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-04ea67be-474e-4f81-ac37-7a273f61eef2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:00.638423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-04ea67be-474e-4f81-ac37-7a273f61eef2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:00.653345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04ea67be-474e-4f81-ac37-7a273f61eef2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:00.672570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04ea67be-474e-4f81-ac37-7a273f61eef2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:00.673168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04ea67be-474e-4f81-ac37-7a273f61eef2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:00.679024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04ea67be-474e-4f81-ac37-7a273f61eef2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:00.680402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04ea67be-474e-4f81-ac37-7a273f61eef2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:00.681754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04ea67be-474e-4f81-ac37-7a273f61eef2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:00.749865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4972740d-38f6-479e-a2b3-d087c7783719 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:00.760969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:00.774475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4972740d-38f6-479e-a2b3-d087c7783719 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:00.783624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4972740d-38f6-479e-a2b3-d087c7783719 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:00.791256 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4972740d-38f6-479e-a2b3-d087c7783719 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1870 microversion: 2.42 time: 1.571218 Aug 29 15:38:00.793426 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1648/3274] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:37:59 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1870 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:38:01.823995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1bb4ccda-c86a-47b4-a0c3-f9b7fbcf7335 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:01.826208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1bb4ccda-c86a-47b4-a0c3-f9b7fbcf7335 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:01.879635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1bb4ccda-c86a-47b4-a0c3-f9b7fbcf7335 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:01.880151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1bb4ccda-c86a-47b4-a0c3-f9b7fbcf7335 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:01.881609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1bb4ccda-c86a-47b4-a0c3-f9b7fbcf7335 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:01.895305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1bb4ccda-c86a-47b4-a0c3-f9b7fbcf7335 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:01.896922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1bb4ccda-c86a-47b4-a0c3-f9b7fbcf7335 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:01.897572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1bb4ccda-c86a-47b4-a0c3-f9b7fbcf7335 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:02.196230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-04ea67be-474e-4f81-ac37-7a273f61eef2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:02.233277 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-04ea67be-474e-4f81-ac37-7a273f61eef2 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1325 microversion: 2.1 time: 1.601471 Aug 29 15:38:02.240582 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1627/3275] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:00 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1325 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:03.005568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1bb4ccda-c86a-47b4-a0c3-f9b7fbcf7335 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:03.020462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1bb4ccda-c86a-47b4-a0c3-f9b7fbcf7335 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:03.030323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1bb4ccda-c86a-47b4-a0c3-f9b7fbcf7335 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:03.034218 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1bb4ccda-c86a-47b4-a0c3-f9b7fbcf7335 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1870 microversion: 2.42 time: 1.216743 Aug 29 15:38:03.037130 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1649/3276] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:01 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1870 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:03.261111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-39223ae9-48f1-4372-be0c-b4e025315283 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:03.263723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-39223ae9-48f1-4372-be0c-b4e025315283 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:03.286820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39223ae9-48f1-4372-be0c-b4e025315283 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:03.287325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39223ae9-48f1-4372-be0c-b4e025315283 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:03.287748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39223ae9-48f1-4372-be0c-b4e025315283 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:03.288461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39223ae9-48f1-4372-be0c-b4e025315283 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:03.288913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39223ae9-48f1-4372-be0c-b4e025315283 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:03.301683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39223ae9-48f1-4372-be0c-b4e025315283 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:03.831921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-39223ae9-48f1-4372-be0c-b4e025315283 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:03.840080 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-39223ae9-48f1-4372-be0c-b4e025315283 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1325 microversion: 2.1 time: 0.582910 Aug 29 15:38:03.840673 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1628/3277] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:03 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1325 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:04.063560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-54e3a55e-0081-4f05-9f44-a5ba4375b2af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:04.066388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-54e3a55e-0081-4f05-9f44-a5ba4375b2af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:04.078898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54e3a55e-0081-4f05-9f44-a5ba4375b2af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:04.079807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54e3a55e-0081-4f05-9f44-a5ba4375b2af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:04.080409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54e3a55e-0081-4f05-9f44-a5ba4375b2af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:04.081560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54e3a55e-0081-4f05-9f44-a5ba4375b2af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:04.082511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54e3a55e-0081-4f05-9f44-a5ba4375b2af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:04.083164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54e3a55e-0081-4f05-9f44-a5ba4375b2af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:04.707607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-54e3a55e-0081-4f05-9f44-a5ba4375b2af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:04.726422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-54e3a55e-0081-4f05-9f44-a5ba4375b2af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:04.732602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-54e3a55e-0081-4f05-9f44-a5ba4375b2af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:04.734729 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-54e3a55e-0081-4f05-9f44-a5ba4375b2af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.679261 Aug 29 15:38:04.739759 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1650/3278] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:04 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:04.754298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-438abb29-f9bb-4587-8646-a8575ce154c2 req-7a354416-2433-4a07-8511-af5b67d61252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "tag": "c7354a20-9cbe-469c-965c-d5e127f1f1bc"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:04.794170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-438abb29-f9bb-4587-8646-a8575ce154c2 req-7a354416-2433-4a07-8511-af5b67d61252 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:04.797492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-438abb29-f9bb-4587-8646-a8575ce154c2 req-7a354416-2433-4a07-8511-af5b67d61252 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:04.798583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-438abb29-f9bb-4587-8646-a8575ce154c2 req-7a354416-2433-4a07-8511-af5b67d61252 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:04.858425 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-438abb29-f9bb-4587-8646-a8575ce154c2 req-7a354416-2433-4a07-8511-af5b67d61252 service nova] Creating event network-changed:c7354a20-9cbe-469c-965c-d5e127f1f1bc for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:38:04.874140 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-438abb29-f9bb-4587-8646-a8575ce154c2 req-7a354416-2433-4a07-8511-af5b67d61252 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132584 Aug 29 15:38:04.877747 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1651/3279] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:04.891251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-add44f58-f1d7-4363-a8a1-6a639f71331a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:04.894667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-add44f58-f1d7-4363-a8a1-6a639f71331a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:04.943551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-add44f58-f1d7-4363-a8a1-6a639f71331a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:04.944946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-add44f58-f1d7-4363-a8a1-6a639f71331a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:04.950574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-add44f58-f1d7-4363-a8a1-6a639f71331a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:04.954099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-add44f58-f1d7-4363-a8a1-6a639f71331a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:04.960335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-add44f58-f1d7-4363-a8a1-6a639f71331a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:04.964267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-add44f58-f1d7-4363-a8a1-6a639f71331a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:04.990192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1625483562", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "ac67e22a-d06b-4513-96c8-e397d1b6916a"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:05.163437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] validate_networks() for [('ac67e22a-d06b-4513-96c8-e397d1b6916a', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:05.469286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-add44f58-f1d7-4363-a8a1-6a639f71331a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:05.482297 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-add44f58-f1d7-4363-a8a1-6a639f71331a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1522 microversion: 2.1 time: 0.600423 Aug 29 15:38:05.483230 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1652/3280] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:04 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1522 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:05.511425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ddae9018-d02b-4327-aaad-a144b7b8c50b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:05.515732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ddae9018-d02b-4327-aaad-a144b7b8c50b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:05.520996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:05.545139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddae9018-d02b-4327-aaad-a144b7b8c50b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:05.545652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddae9018-d02b-4327-aaad-a144b7b8c50b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:05.546104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddae9018-d02b-4327-aaad-a144b7b8c50b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:05.546833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddae9018-d02b-4327-aaad-a144b7b8c50b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:05.555781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddae9018-d02b-4327-aaad-a144b7b8c50b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:05.556382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddae9018-d02b-4327-aaad-a144b7b8c50b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:06.384932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ddae9018-d02b-4327-aaad-a144b7b8c50b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:06.402350 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ddae9018-d02b-4327-aaad-a144b7b8c50b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1522 microversion: 2.1 time: 0.887835 Aug 29 15:38:06.405966 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1653/3281] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:05 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1522 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:06.418894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fac1ef92-b101-4b38-9f5b-84e7e24d1c40 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:06.427964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fac1ef92-b101-4b38-9f5b-84e7e24d1c40 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:06.443149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fac1ef92-b101-4b38-9f5b-84e7e24d1c40 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:06.445282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fac1ef92-b101-4b38-9f5b-84e7e24d1c40 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:06.445902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fac1ef92-b101-4b38-9f5b-84e7e24d1c40 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:06.446642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fac1ef92-b101-4b38-9f5b-84e7e24d1c40 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:06.451087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fac1ef92-b101-4b38-9f5b-84e7e24d1c40 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:06.451972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fac1ef92-b101-4b38-9f5b-84e7e24d1c40 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:06.781738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fac1ef92-b101-4b38-9f5b-84e7e24d1c40 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:06.799393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fac1ef92-b101-4b38-9f5b-84e7e24d1c40 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:06.801421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fac1ef92-b101-4b38-9f5b-84e7e24d1c40 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:06.805067 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fac1ef92-b101-4b38-9f5b-84e7e24d1c40 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.393197 Aug 29 15:38:06.808451 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1654/3282] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:06 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:07.080421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e4ddba7f-e363-447d-a3bd-7a57fcb0ae4a tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Calling method '.version_select at 0x7fc42aaecee0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:07.302865 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e4ddba7f-e363-447d-a3bd-7a57fcb0ae4a tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/fdda2080eea94548955ae828a84ef532" status: 200 len: 371 microversion: 2.1 time: 0.490895 Aug 29 15:38:07.304424 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1655/3283] 10.222.0.62 () {58 vars in 1242 bytes} [Mon Aug 29 15:38:06 2022] GET /compute/v2.1/os-quota-sets/fdda2080eea94548955ae828a84ef532 => generated 371 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:07.323778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-27ef0f57-af51-4c46-b1e6-d471e7f6987e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1286448344"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:07.328130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-27ef0f57-af51-4c46-b1e6-d471e7f6987e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:07.352496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27ef0f57-af51-4c46-b1e6-d471e7f6987e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:07.366909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27ef0f57-af51-4c46-b1e6-d471e7f6987e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:07.368025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27ef0f57-af51-4c46-b1e6-d471e7f6987e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:07.369156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27ef0f57-af51-4c46-b1e6-d471e7f6987e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:07.370736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27ef0f57-af51-4c46-b1e6-d471e7f6987e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:07.371399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27ef0f57-af51-4c46-b1e6-d471e7f6987e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:07.829995 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-27ef0f57-af51-4c46-b1e6-d471e7f6987e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "POST /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9/action" status: 202 len: 0 microversion: 2.1 time: 0.510086 Aug 29 15:38:07.835689 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1656/3284] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:38:07 2022] POST /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:38:07.863890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8500c343-26bb-41a9-a750-8ee06c38e4b8 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Action: 'update', calling method: .version_select at 0x7fc42aa1bee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:07.993868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:38:07.994539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:38:07.995254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:38:07.995802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:38:07.995982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8500c343-26bb-41a9-a750-8ee06c38e4b8 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:07.996473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8500c343-26bb-41a9-a750-8ee06c38e4b8 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:07.996688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:38:07.999012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8500c343-26bb-41a9-a750-8ee06c38e4b8 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:08.000457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8500c343-26bb-41a9-a750-8ee06c38e4b8 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:08.000928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8500c343-26bb-41a9-a750-8ee06c38e4b8 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:08.001383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8500c343-26bb-41a9-a750-8ee06c38e4b8 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:08.024596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:08.031004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:08.034622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:08.035726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:08.049645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:08.053044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:08.152302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Getting quotas for project bc2c415a57ee498a840c87b29596a2fc. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:08.174446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Getting quotas for user 99403a086f4241d89465f26c45a07dd8 and project bc2c415a57ee498a840c87b29596a2fc. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:08.191448 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8500c343-26bb-41a9-a750-8ee06c38e4b8 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-sets/fdda2080eea94548955ae828a84ef532" status: 200 len: 328 microversion: 2.1 time: 0.353901 Aug 29 15:38:08.192716 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1657/3285] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 15:38:07 2022] PUT /compute/v2.1/os-quota-sets/fdda2080eea94548955ae828a84ef532 => generated 328 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:08.198051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6115891a-f008-456c-8e88-21348d974b57 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:08.199004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6115891a-f008-456c-8e88-21348d974b57 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:08.207060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6115891a-f008-456c-8e88-21348d974b57 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:08.207774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6115891a-f008-456c-8e88-21348d974b57 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:08.208377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6115891a-f008-456c-8e88-21348d974b57 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:08.209281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6115891a-f008-456c-8e88-21348d974b57 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:08.209931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6115891a-f008-456c-8e88-21348d974b57 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:08.211240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:38:08.214428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:38:08.222553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6115891a-f008-456c-8e88-21348d974b57 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:08.279309 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [83abfac2-a2e5-42d4-b471-f7216666d4f2] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 15:38:08.803849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6115891a-f008-456c-8e88-21348d974b57 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:08.822985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6115891a-f008-456c-8e88-21348d974b57 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:08.825053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6115891a-f008-456c-8e88-21348d974b57 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:08.827625 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6115891a-f008-456c-8e88-21348d974b57 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.632634 Aug 29 15:38:08.843193 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1658/3286] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:08 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:08.843193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-77e5753a-95d0-401a-ac0c-a16867f1ee89 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '.version_select at 0x7fc42aa264c0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:09.119882 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-77e5753a-95d0-401a-ac0c-a16867f1ee89 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "DELETE /compute/v2.1/images/d8978de3-b264-4a98-bc01-973a747e2548" status: 204 len: 0 microversion: 2.1 time: 0.288941 Aug 29 15:38:09.121106 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1659/3287] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:08 2022] DELETE /compute/v2.1/images/d8978de3-b264-4a98-bc01-973a747e2548 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:38:09.127910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c72bfc00-43aa-4e89-b2b1-d921ae735ed7 req-26f0c272-7890-4c6a-941f-66f4a9abc9ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "tag": "06aacd47-129b-4ad9-b005-9ae39e561668"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:09.152808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c72bfc00-43aa-4e89-b2b1-d921ae735ed7 req-26f0c272-7890-4c6a-941f-66f4a9abc9ca service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:09.153014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c72bfc00-43aa-4e89-b2b1-d921ae735ed7 req-26f0c272-7890-4c6a-941f-66f4a9abc9ca service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:09.188426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c72bfc00-43aa-4e89-b2b1-d921ae735ed7 req-26f0c272-7890-4c6a-941f-66f4a9abc9ca service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:09.226590 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c72bfc00-43aa-4e89-b2b1-d921ae735ed7 req-26f0c272-7890-4c6a-941f-66f4a9abc9ca service nova] Creating event network-changed:06aacd47-129b-4ad9-b005-9ae39e561668 for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:38:09.238955 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c72bfc00-43aa-4e89-b2b1-d921ae735ed7 req-26f0c272-7890-4c6a-941f-66f4a9abc9ca service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116291 Aug 29 15:38:09.242640 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1660/3288] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:09.255716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aa50f054-80b5-4b78-a1bd-1a9fb045d41c tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:09.293048 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aa50f054-80b5-4b78-a1bd-1a9fb045d41c tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-quota-sets/fdda2080eea94548955ae828a84ef532" status: 202 len: 0 microversion: 2.1 time: 0.044492 Aug 29 15:38:09.293803 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [83abfac2-a2e5-42d4-b471-f7216666d4f2] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 45754. Aug 29 15:38:09.294722 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1661/3289] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:38:09 2022] DELETE /compute/v2.1/os-quota-sets/fdda2080eea94548955ae828a84ef532 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:09.301718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8f578fde-5382-4d98-9978-475dc94afab8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:09.308167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8f578fde-5382-4d98-9978-475dc94afab8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:09.310298 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-73cd0e92-7c6e-4c47-8544-98d8b50040e1 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.089875 Aug 29 15:38:09.312325 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1629/3290] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 5093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:38:09.330248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f578fde-5382-4d98-9978-475dc94afab8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:09.330943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f578fde-5382-4d98-9978-475dc94afab8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:09.331539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f578fde-5382-4d98-9978-475dc94afab8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:09.332543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f578fde-5382-4d98-9978-475dc94afab8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:09.335217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f578fde-5382-4d98-9978-475dc94afab8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:09.335952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f578fde-5382-4d98-9978-475dc94afab8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:09.340731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-06f72e9a-2226-4b23-969b-b2e8a9d81258 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '.version_select at 0x7fc42a8bb820>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:09.423586 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-06f72e9a-2226-4b23-969b-b2e8a9d81258 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] HTTP exception thrown: Image not found. Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-06f72e9a-2226-4b23-969b-b2e8a9d81258 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Request method failure captured: Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/images/d8978de3-b264-4a98-bc01-973a747e2548 HTTP/1.1 Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN0GbvIiUff-Csg384q60lkXu4i6-mvBJpd3uHC3XwYXy4PaOZ7rdjlazGQlvtMKGXenSXNWI7wpdDnEyRTa364NbLtw3ESiH3fXKpDQtDE_4rOyqKq2j2P24J-z87DcgMla1UHDGJpmC4Fh5kcRUC7Pl2mjjcnRflSX472pqyiJs6U Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaeecb44c6534cba89e3d68177917529", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}] Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6de4fe0749d449748eca6937b123d2df Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: exception: Image not found. Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'd8978de3-b264-4a98-bc01-973a747e2548'} Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d8978de3-b264-4a98-bc01-973a747e2548 Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:38:09.426865 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d8978de3-b264-4a98-bc01-973a747e2548 could not be found. Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:38:09.431147 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:09.435393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-06f72e9a-2226-4b23-969b-b2e8a9d81258 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Returning 404 to user: Image not found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:09.436998 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-06f72e9a-2226-4b23-969b-b2e8a9d81258 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/images/d8978de3-b264-4a98-bc01-973a747e2548" status: 404 len: 62 microversion: 2.1 time: 0.119631 Aug 29 15:38:09.437787 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1630/3291] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:38:09 2022] GET /compute/v2.1/images/d8978de3-b264-4a98-bc01-973a747e2548 => generated 62 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:38:09.452717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ab7941a1-4fec-4897-8afa-9fc53caeb26c tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Calling method '.version_select at 0x7fc42b7b29d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:09.597210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8f578fde-5382-4d98-9978-475dc94afab8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:09.609112 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8f578fde-5382-4d98-9978-475dc94afab8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.313284 Aug 29 15:38:09.609710 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1662/3292] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:09 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:09.627525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-31bdac88-7130-4783-91c8-b32b035d4234 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:09.631162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-31bdac88-7130-4783-91c8-b32b035d4234 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:09.747359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-31bdac88-7130-4783-91c8-b32b035d4234 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:09.757855 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-31bdac88-7130-4783-91c8-b32b035d4234 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1225 microversion: 2.1 time: 0.146363 Aug 29 15:38:09.758501 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1663/3293] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:09 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1225 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:09.779160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c3d7248d-0696-47f3-8da9-35c909f1d306 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:09.780127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c3d7248d-0696-47f3-8da9-35c909f1d306 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:09.789048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3d7248d-0696-47f3-8da9-35c909f1d306 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:09.790111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3d7248d-0696-47f3-8da9-35c909f1d306 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:09.791001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3d7248d-0696-47f3-8da9-35c909f1d306 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:09.791649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3d7248d-0696-47f3-8da9-35c909f1d306 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:09.792128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3d7248d-0696-47f3-8da9-35c909f1d306 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:09.792561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3d7248d-0696-47f3-8da9-35c909f1d306 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:10.027831 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ab7941a1-4fec-4897-8afa-9fc53caeb26c tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/fdda2080eea94548955ae828a84ef532" status: 200 len: 371 microversion: 2.1 time: 0.588760 Aug 29 15:38:10.044811 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1631/3294] 10.222.0.62 () {58 vars in 1242 bytes} [Mon Aug 29 15:38:09 2022] GET /compute/v2.1/os-quota-sets/fdda2080eea94548955ae828a84ef532 => generated 371 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:10.054377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8cbd55cc-6f48-4b2a-be21-65f7cc32e4e2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-446064430"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:10.078823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8cbd55cc-6f48-4b2a-be21-65f7cc32e4e2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:10.101630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cbd55cc-6f48-4b2a-be21-65f7cc32e4e2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:10.108487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cbd55cc-6f48-4b2a-be21-65f7cc32e4e2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:10.109673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cbd55cc-6f48-4b2a-be21-65f7cc32e4e2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:10.115466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cbd55cc-6f48-4b2a-be21-65f7cc32e4e2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:10.117797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cbd55cc-6f48-4b2a-be21-65f7cc32e4e2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:10.118599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cbd55cc-6f48-4b2a-be21-65f7cc32e4e2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:10.120205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c3d7248d-0696-47f3-8da9-35c909f1d306 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:10.134065 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c3d7248d-0696-47f3-8da9-35c909f1d306 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1534 microversion: 2.1 time: 0.360786 Aug 29 15:38:10.135622 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1664/3295] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:09 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1534 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:10.153979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0fd59d99-07bf-4897-a291-5f4712d37d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:10.156457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0fd59d99-07bf-4897-a291-5f4712d37d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:10.172608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fd59d99-07bf-4897-a291-5f4712d37d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:10.174598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fd59d99-07bf-4897-a291-5f4712d37d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:10.176951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fd59d99-07bf-4897-a291-5f4712d37d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:10.177851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fd59d99-07bf-4897-a291-5f4712d37d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:10.178326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fd59d99-07bf-4897-a291-5f4712d37d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:10.180457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fd59d99-07bf-4897-a291-5f4712d37d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:10.503024 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8cbd55cc-6f48-4b2a-be21-65f7cc32e4e2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 202 len: 0 microversion: 2.1 time: 0.456362 Aug 29 15:38:10.508808 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1632/3296] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:38:10 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 29 15:38:10.782539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0fd59d99-07bf-4897-a291-5f4712d37d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:10.795984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0fd59d99-07bf-4897-a291-5f4712d37d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:10.808189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0fd59d99-07bf-4897-a291-5f4712d37d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:10.812046 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0fd59d99-07bf-4897-a291-5f4712d37d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.674297 Aug 29 15:38:10.812804 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1665/3297] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:10 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:10.817627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0d3f2840-319d-4da9-82c5-36c3b39f106a tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Calling method '.version_select at 0x7fc42aaac820>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:11.090057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-68616923-87b9-4008-bc36-b068e8707e27 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Action: 'create', calling method: .version_select at 0x7fc42a8728b0>, body: {"keypair": {"name": "tempest-keypair-177554775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoLG3q6fRiVDajAVPz0IXlIuBm52kEkNGs2Q/IuWZK8imZSmPzICzyDbG4LyamshwFz//4ci5oqFbo6kIUeKElufImyo2J/0kjCbL/ectg9lw7Kvwf95dD1G3kH6PzZeg=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:11.149774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-68616923-87b9-4008-bc36-b068e8707e27 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Getting quotas for project 8c81e50c9fdd45919b4d6c8e6682d97d. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:11.168646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-68616923-87b9-4008-bc36-b068e8707e27 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Getting quotas for user 77a898d8b4f7477281081a0e4dedf493 and project 8c81e50c9fdd45919b4d6c8e6682d97d. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:11.234759 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-68616923-87b9-4008-bc36-b068e8707e27 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.724052 Aug 29 15:38:11.235414 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1633/3298] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:38:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:11.246023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-18be2b26-3cf9-44aa-8d6f-097a2c4692f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:11.246797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-18be2b26-3cf9-44aa-8d6f-097a2c4692f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:11.260786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18be2b26-3cf9-44aa-8d6f-097a2c4692f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:11.261377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18be2b26-3cf9-44aa-8d6f-097a2c4692f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:11.261807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18be2b26-3cf9-44aa-8d6f-097a2c4692f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:11.262559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18be2b26-3cf9-44aa-8d6f-097a2c4692f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:11.263095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18be2b26-3cf9-44aa-8d6f-097a2c4692f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:11.268978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18be2b26-3cf9-44aa-8d6f-097a2c4692f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:11.471521 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0d3f2840-319d-4da9-82c5-36c3b39f106a tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/930c7777c1d743ddb41526c30ac1a391/defaults" status: 200 len: 371 microversion: 2.1 time: 0.657305 Aug 29 15:38:11.472237 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1666/3299] 10.222.0.62 () {58 vars in 1269 bytes} [Mon Aug 29 15:38:10 2022] GET /compute/v2.1/os-quota-sets/930c7777c1d743ddb41526c30ac1a391/defaults => generated 371 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:11.494727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-486eea95-9eff-4718-a23a-d21841c1dbff tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:11.495893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-486eea95-9eff-4718-a23a-d21841c1dbff tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:11.507241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-486eea95-9eff-4718-a23a-d21841c1dbff tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:11.513300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-486eea95-9eff-4718-a23a-d21841c1dbff tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:11.513975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-486eea95-9eff-4718-a23a-d21841c1dbff tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:11.515017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-486eea95-9eff-4718-a23a-d21841c1dbff tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:11.515808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-486eea95-9eff-4718-a23a-d21841c1dbff tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:11.516465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-486eea95-9eff-4718-a23a-d21841c1dbff tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:11.654674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-18be2b26-3cf9-44aa-8d6f-097a2c4692f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:11.666297 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-18be2b26-3cf9-44aa-8d6f-097a2c4692f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.429804 Aug 29 15:38:11.670848 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1634/3300] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:11 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:11.684490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-125d9009-90ff-4099-9cd7-f31bb440902b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:11.685276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-125d9009-90ff-4099-9cd7-f31bb440902b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:11.697557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125d9009-90ff-4099-9cd7-f31bb440902b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:11.698058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125d9009-90ff-4099-9cd7-f31bb440902b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:11.698503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125d9009-90ff-4099-9cd7-f31bb440902b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:11.699220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125d9009-90ff-4099-9cd7-f31bb440902b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:11.699681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125d9009-90ff-4099-9cd7-f31bb440902b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:11.700112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125d9009-90ff-4099-9cd7-f31bb440902b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.201763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-486eea95-9eff-4718-a23a-d21841c1dbff tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:12.221942 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-486eea95-9eff-4718-a23a-d21841c1dbff tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1277 microversion: 2.1 time: 0.744708 Aug 29 15:38:12.227882 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1667/3301] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:11 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1277 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:12.247522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-55daa5f0-2cef-483b-9d18-98640e71a6f4 req-d8dbe456-a437-45b0-a654-0e512e2559a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "tag": "29a5d995-57d9-450f-ae74-d0d7be314912"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:12.274834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-55daa5f0-2cef-483b-9d18-98640e71a6f4 req-d8dbe456-a437-45b0-a654-0e512e2559a4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.275584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-55daa5f0-2cef-483b-9d18-98640e71a6f4 req-d8dbe456-a437-45b0-a654-0e512e2559a4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.276176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-55daa5f0-2cef-483b-9d18-98640e71a6f4 req-d8dbe456-a437-45b0-a654-0e512e2559a4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.304763 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-55daa5f0-2cef-483b-9d18-98640e71a6f4 req-d8dbe456-a437-45b0-a654-0e512e2559a4 service nova] Creating event network-changed:29a5d995-57d9-450f-ae74-d0d7be314912 for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:38:12.314823 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-55daa5f0-2cef-483b-9d18-98640e71a6f4 req-d8dbe456-a437-45b0-a654-0e512e2559a4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080377 Aug 29 15:38:12.315517 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1668/3302] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:12.332161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1a1d503d-2702-467a-ba61-643afce4a671 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:12.332889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1a1d503d-2702-467a-ba61-643afce4a671 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:12.352832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a1d503d-2702-467a-ba61-643afce4a671 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.353353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a1d503d-2702-467a-ba61-643afce4a671 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.354178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a1d503d-2702-467a-ba61-643afce4a671 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.355125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a1d503d-2702-467a-ba61-643afce4a671 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.355881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a1d503d-2702-467a-ba61-643afce4a671 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.356535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a1d503d-2702-467a-ba61-643afce4a671 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.531848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-125d9009-90ff-4099-9cd7-f31bb440902b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:12.543068 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-125d9009-90ff-4099-9cd7-f31bb440902b tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1540 microversion: 2.1 time: 0.870596 Aug 29 15:38:12.544481 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1635/3303] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:11 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1540 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:12.550424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b40a2eb4-6821-4a07-b467-bc8ac3dd8c47 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Action: 'update', calling method: .version_select at 0x7fc42a876160>, body: {"quota_set": {"ram": "5120"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:12.737322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:12.749775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b40a2eb4-6821-4a07-b467-bc8ac3dd8c47 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.750803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b40a2eb4-6821-4a07-b467-bc8ac3dd8c47 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.751648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b40a2eb4-6821-4a07-b467-bc8ac3dd8c47 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.752692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b40a2eb4-6821-4a07-b467-bc8ac3dd8c47 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.753588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b40a2eb4-6821-4a07-b467-bc8ac3dd8c47 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.754257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b40a2eb4-6821-4a07-b467-bc8ac3dd8c47 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.845442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1a1d503d-2702-467a-ba61-643afce4a671 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:12.857193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1a1d503d-2702-467a-ba61-643afce4a671 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:12.859143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1a1d503d-2702-467a-ba61-643afce4a671 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:12.860601 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1a1d503d-2702-467a-ba61-643afce4a671 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.544000 Aug 29 15:38:12.860734 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b40a2eb4-6821-4a07-b467-bc8ac3dd8c47 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-sets/98dbc157694b47c1904ef6ffb269179a" status: 200 len: 328 microversion: 2.1 time: 0.314898 Aug 29 15:38:12.861477 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1636/3304] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 15:38:12 2022] PUT /compute/v2.1/os-quota-sets/98dbc157694b47c1904ef6ffb269179a => generated 328 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:12.866339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a7dc3022-66b1-4fb7-a4a5-b3e3e42322f8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:12.873827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a7dc3022-66b1-4fb7-a4a5-b3e3e42322f8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:12.883032 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1669/3305] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:12 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:12.888008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7dc3022-66b1-4fb7-a4a5-b3e3e42322f8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.888511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7dc3022-66b1-4fb7-a4a5-b3e3e42322f8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.888953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7dc3022-66b1-4fb7-a4a5-b3e3e42322f8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.889741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-95df3a68-d64b-4113-bf42-976975930945 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Calling method '.version_select at 0x7fc42aa321f0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:12.899134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7dc3022-66b1-4fb7-a4a5-b3e3e42322f8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.900356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7dc3022-66b1-4fb7-a4a5-b3e3e42322f8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.906541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7dc3022-66b1-4fb7-a4a5-b3e3e42322f8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.982231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95df3a68-d64b-4113-bf42-976975930945 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.982909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95df3a68-d64b-4113-bf42-976975930945 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.983509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95df3a68-d64b-4113-bf42-976975930945 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:12.984574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95df3a68-d64b-4113-bf42-976975930945 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:12.985444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95df3a68-d64b-4113-bf42-976975930945 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:12.986157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95df3a68-d64b-4113-bf42-976975930945 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.020105 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-95df3a68-d64b-4113-bf42-976975930945 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/98dbc157694b47c1904ef6ffb269179a/detail" status: 200 len: 916 microversion: 2.1 time: 0.134918 Aug 29 15:38:13.021819 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1670/3306] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:38:12 2022] GET /compute/v2.1/os-quota-sets/98dbc157694b47c1904ef6ffb269179a/detail => generated 916 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:13.027514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-cf955939-6682-4ebf-851a-d5ff90ab877a req-97271838-7ff3-42de-a423-205f62273e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af95f7c-5362-4cf9-b80e-38cd6a518783", "name": "network-vif-unplugged", "status": "completed", "tag": "2984ebfd-8f23-4f8e-83af-0a164bd8c5aa"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:13.039503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cf955939-6682-4ebf-851a-d5ff90ab877a req-97271838-7ff3-42de-a423-205f62273e48 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.040463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cf955939-6682-4ebf-851a-d5ff90ab877a req-97271838-7ff3-42de-a423-205f62273e48 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.041053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cf955939-6682-4ebf-851a-d5ff90ab877a req-97271838-7ff3-42de-a423-205f62273e48 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.053865 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-cf955939-6682-4ebf-851a-d5ff90ab877a req-97271838-7ff3-42de-a423-205f62273e48 service nova] Creating event network-vif-unplugged:2984ebfd-8f23-4f8e-83af-0a164bd8c5aa for instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 on n-h2-839401-11 Aug 29 15:38:13.060094 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-cf955939-6682-4ebf-851a-d5ff90ab877a req-97271838-7ff3-42de-a423-205f62273e48 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036456 Aug 29 15:38:13.061485 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1671/3307] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:13.223487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-efc9d4b3-e930-404e-9cad-520e4a069973 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Action: 'update', calling method: .version_select at 0x7fc42aa63700>, body: {"quota_set": {"ram": "2048"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:13.325691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efc9d4b3-e930-404e-9cad-520e4a069973 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.326551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efc9d4b3-e930-404e-9cad-520e4a069973 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.327200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efc9d4b3-e930-404e-9cad-520e4a069973 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.329121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efc9d4b3-e930-404e-9cad-520e4a069973 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.329819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efc9d4b3-e930-404e-9cad-520e4a069973 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.330487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efc9d4b3-e930-404e-9cad-520e4a069973 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.406693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efc9d4b3-e930-404e-9cad-520e4a069973 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.407561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efc9d4b3-e930-404e-9cad-520e4a069973 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.408196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efc9d4b3-e930-404e-9cad-520e4a069973 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.409216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efc9d4b3-e930-404e-9cad-520e4a069973 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.409917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efc9d4b3-e930-404e-9cad-520e4a069973 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.412503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efc9d4b3-e930-404e-9cad-520e4a069973 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.485815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a7dc3022-66b1-4fb7-a4a5-b3e3e42322f8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:13.505987 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a7dc3022-66b1-4fb7-a4a5-b3e3e42322f8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.643429 Aug 29 15:38:13.508467 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1637/3308] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:12 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:13.520595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cbd377d1-f7ce-44ac-92cc-6348258dff65 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:13.522899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cbd377d1-f7ce-44ac-92cc-6348258dff65 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:13.531117 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-efc9d4b3-e930-404e-9cad-520e4a069973 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-sets/98dbc157694b47c1904ef6ffb269179a?user_id=9c71decf65dd4424a9ac941300ac822e" status: 200 len: 328 microversion: 2.1 time: 0.317703 Aug 29 15:38:13.532202 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1672/3309] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:38:13 2022] PUT /compute/v2.1/os-quota-sets/98dbc157694b47c1904ef6ffb269179a?user_id=9c71decf65dd4424a9ac941300ac822e => generated 328 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:38:13.535032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbd377d1-f7ce-44ac-92cc-6348258dff65 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.537746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbd377d1-f7ce-44ac-92cc-6348258dff65 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.543105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbd377d1-f7ce-44ac-92cc-6348258dff65 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.546264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbd377d1-f7ce-44ac-92cc-6348258dff65 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.547137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbd377d1-f7ce-44ac-92cc-6348258dff65 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.547995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b68c7b70-cee6-4ecc-a4a2-0ad0c82007db tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Calling method '.version_select at 0x7fc42b71a8b0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:13.548512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbd377d1-f7ce-44ac-92cc-6348258dff65 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.794764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cbd377d1-f7ce-44ac-92cc-6348258dff65 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:13.809747 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cbd377d1-f7ce-44ac-92cc-6348258dff65 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1283 microversion: 2.1 time: 0.294652 Aug 29 15:38:13.834265 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1638/3310] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:13 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1283 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:13.839878 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b68c7b70-cee6-4ecc-a4a2-0ad0c82007db tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/98dbc157694b47c1904ef6ffb269179a?user_id=9c71decf65dd4424a9ac941300ac822e" status: 200 len: 370 microversion: 2.1 time: 0.294025 Aug 29 15:38:13.849658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8920567c-9b05-4ad0-8f2e-d759ba75fec7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:13.850578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8920567c-9b05-4ad0-8f2e-d759ba75fec7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:13.853850 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1673/3311] 10.222.0.62 () {58 vars in 1323 bytes} [Mon Aug 29 15:38:13 2022] GET /compute/v2.1/os-quota-sets/98dbc157694b47c1904ef6ffb269179a?user_id=9c71decf65dd4424a9ac941300ac822e => generated 370 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:13.862047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8920567c-9b05-4ad0-8f2e-d759ba75fec7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.862812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8920567c-9b05-4ad0-8f2e-d759ba75fec7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.864009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8920567c-9b05-4ad0-8f2e-d759ba75fec7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.865242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8920567c-9b05-4ad0-8f2e-d759ba75fec7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.865949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8920567c-9b05-4ad0-8f2e-d759ba75fec7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.866571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8920567c-9b05-4ad0-8f2e-d759ba75fec7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.889262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fd31c764-266e-418d-bd83-8f17e0b8e737 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:13.890578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fd31c764-266e-418d-bd83-8f17e0b8e737 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:13.907344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd31c764-266e-418d-bd83-8f17e0b8e737 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.907864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd31c764-266e-418d-bd83-8f17e0b8e737 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.908523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd31c764-266e-418d-bd83-8f17e0b8e737 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.909018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd31c764-266e-418d-bd83-8f17e0b8e737 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.912266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd31c764-266e-418d-bd83-8f17e0b8e737 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.915515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd31c764-266e-418d-bd83-8f17e0b8e737 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.928724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:14.236268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd31c764-266e-418d-bd83-8f17e0b8e737 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:14.249985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd31c764-266e-418d-bd83-8f17e0b8e737 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:14.253792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd31c764-266e-418d-bd83-8f17e0b8e737 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:14.255479 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fd31c764-266e-418d-bd83-8f17e0b8e737 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.370697 Aug 29 15:38:14.256689 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1674/3312] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:13 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:38:14.359340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-1580335d-7422-4bc3-bdc2-a72d543bd483 req-210eb4c9-72fd-4be5-8f1b-64541666a8ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "tag": "a57525af-726d-4159-bf8f-7847df217cc9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:14.383260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1580335d-7422-4bc3-bdc2-a72d543bd483 req-210eb4c9-72fd-4be5-8f1b-64541666a8ab service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:14.383820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1580335d-7422-4bc3-bdc2-a72d543bd483 req-210eb4c9-72fd-4be5-8f1b-64541666a8ab service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:14.384297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1580335d-7422-4bc3-bdc2-a72d543bd483 req-210eb4c9-72fd-4be5-8f1b-64541666a8ab service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:14.427444 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-1580335d-7422-4bc3-bdc2-a72d543bd483 req-210eb4c9-72fd-4be5-8f1b-64541666a8ab service nova] Creating event network-changed:a57525af-726d-4159-bf8f-7847df217cc9 for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:38:14.461143 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-1580335d-7422-4bc3-bdc2-a72d543bd483 req-210eb4c9-72fd-4be5-8f1b-64541666a8ab service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111399 Aug 29 15:38:14.468360 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1675/3313] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:14.474085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d6f73d48-10e1-459b-a8b8-fbdc967af13c tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Calling method '.version_select at 0x7fc42aab8820>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:14.479364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8920567c-9b05-4ad0-8f2e-d759ba75fec7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:14.490629 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8920567c-9b05-4ad0-8f2e-d759ba75fec7 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1540 microversion: 2.1 time: 0.654708 Aug 29 15:38:14.492081 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1639/3314] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:13 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1540 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:14.533294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1ef684a2-67e9-41ec-a0cb-986a23ba7dc1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:14.533920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1ef684a2-67e9-41ec-a0cb-986a23ba7dc1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:14.557593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef684a2-67e9-41ec-a0cb-986a23ba7dc1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:14.558450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef684a2-67e9-41ec-a0cb-986a23ba7dc1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:14.559117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef684a2-67e9-41ec-a0cb-986a23ba7dc1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:14.560108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef684a2-67e9-41ec-a0cb-986a23ba7dc1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:14.560777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef684a2-67e9-41ec-a0cb-986a23ba7dc1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:14.561632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef684a2-67e9-41ec-a0cb-986a23ba7dc1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:15.001621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1ef684a2-67e9-41ec-a0cb-986a23ba7dc1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:15.008467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:15.011500 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1ef684a2-67e9-41ec-a0cb-986a23ba7dc1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1687 microversion: 2.1 time: 0.485513 Aug 29 15:38:15.016774 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1640/3315] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:14 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1687 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:15.024873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9b17f7fa-cd92-4044-bd37-8452fa9f661c tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:15.029414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9b17f7fa-cd92-4044-bd37-8452fa9f661c tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:15.047443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b17f7fa-cd92-4044-bd37-8452fa9f661c tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:15.048081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b17f7fa-cd92-4044-bd37-8452fa9f661c tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:15.048680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b17f7fa-cd92-4044-bd37-8452fa9f661c tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:15.050345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b17f7fa-cd92-4044-bd37-8452fa9f661c tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:15.052530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b17f7fa-cd92-4044-bd37-8452fa9f661c tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:15.052957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b17f7fa-cd92-4044-bd37-8452fa9f661c tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:15.065554 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d6f73d48-10e1-459b-a8b8-fbdc967af13c tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/930c7777c1d743ddb41526c30ac1a391/defaults" status: 200 len: 371 microversion: 2.1 time: 0.594799 Aug 29 15:38:15.067019 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1676/3316] 10.222.0.62 () {58 vars in 1269 bytes} [Mon Aug 29 15:38:14 2022] GET /compute/v2.1/os-quota-sets/930c7777c1d743ddb41526c30ac1a391/defaults => generated 371 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:15.098385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-383002366", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51e05a82-0321-40a7-a6f5-a305b6e6596c"}], "security_groups": [{"name": "tempest-securitygroup--333016131"}], "key_name": "tempest-keypair-177554775", "user_data": "}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:15.283933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] validate_networks() for [('51e05a82-0321-40a7-a6f5-a305b6e6596c', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:15.961582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:38:15.962334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:38:15.963627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:38:15.964305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:38:15.965008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:38:15.976726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:15.977795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:15.978448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:15.980308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:15.981181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:15.981924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.015439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Getting quotas for project 8c81e50c9fdd45919b4d6c8e6682d97d. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:16.019219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:16.025269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Getting quotas for user 77a898d8b4f7477281081a0e4dedf493 and project 8c81e50c9fdd45919b4d6c8e6682d97d. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:16.049541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:38:16.052062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:38:16.115541 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-04205325-d870-4ad7-89bf-6c466394a6f0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.045965 Aug 29 15:38:16.116639 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1677/3317] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:38:16.131001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9b17f7fa-cd92-4044-bd37-8452fa9f661c tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:16.137491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7f902a1b-28fb-4dc4-b898-6ddf2cbd2c0d tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Action: 'update', calling method: .version_select at 0x7fc42aa73af0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:16.151272 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9b17f7fa-cd92-4044-bd37-8452fa9f661c tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1325 microversion: 2.1 time: 1.132984 Aug 29 15:38:16.156744 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1641/3318] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:15 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1325 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:16.165961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-34752d6b-223d-49a7-84da-711cd27af76e req-26ce32d2-f37e-4b05-b1e6-78786e8ccdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0017b65-7a12-4dbb-926e-51dccc9475a9", "name": "network-vif-plugged", "status": "completed", "tag": "a469d9e2-82d7-4161-8e7a-b2a82438b48b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:16.180982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-34752d6b-223d-49a7-84da-711cd27af76e req-26ce32d2-f37e-4b05-b1e6-78786e8ccdc4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.181488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-34752d6b-223d-49a7-84da-711cd27af76e req-26ce32d2-f37e-4b05-b1e6-78786e8ccdc4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.182170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-34752d6b-223d-49a7-84da-711cd27af76e req-26ce32d2-f37e-4b05-b1e6-78786e8ccdc4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.202328 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-34752d6b-223d-49a7-84da-711cd27af76e req-26ce32d2-f37e-4b05-b1e6-78786e8ccdc4 service nova] Creating event network-vif-plugged:a469d9e2-82d7-4161-8e7a-b2a82438b48b for instance e0017b65-7a12-4dbb-926e-51dccc9475a9 on n-h1-839401-11 Aug 29 15:38:16.216940 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-34752d6b-223d-49a7-84da-711cd27af76e req-26ce32d2-f37e-4b05-b1e6-78786e8ccdc4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057932 Aug 29 15:38:16.218218 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1642/3319] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:16.229231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e34b831c-4f11-4634-86cf-aba55d344944 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:16.230409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e34b831c-4f11-4634-86cf-aba55d344944 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:16.238368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e34b831c-4f11-4634-86cf-aba55d344944 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.239165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e34b831c-4f11-4634-86cf-aba55d344944 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.239815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e34b831c-4f11-4634-86cf-aba55d344944 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.240717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e34b831c-4f11-4634-86cf-aba55d344944 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.241379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e34b831c-4f11-4634-86cf-aba55d344944 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.241994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e34b831c-4f11-4634-86cf-aba55d344944 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.542358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f902a1b-28fb-4dc4-b898-6ddf2cbd2c0d tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.545513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f902a1b-28fb-4dc4-b898-6ddf2cbd2c0d tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.552100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f902a1b-28fb-4dc4-b898-6ddf2cbd2c0d tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.554639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f902a1b-28fb-4dc4-b898-6ddf2cbd2c0d tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.557745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f902a1b-28fb-4dc4-b898-6ddf2cbd2c0d tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.558696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f902a1b-28fb-4dc4-b898-6ddf2cbd2c0d tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.845994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e34b831c-4f11-4634-86cf-aba55d344944 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:16.877499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e34b831c-4f11-4634-86cf-aba55d344944 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:16.879311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e34b831c-4f11-4634-86cf-aba55d344944 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:16.880547 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e34b831c-4f11-4634-86cf-aba55d344944 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.661006 Aug 29 15:38:16.881159 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1643/3320] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:16 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:16.886013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2f6d6ce5-43ac-4753-b8fa-a0df347e74de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:16.886830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2f6d6ce5-43ac-4753-b8fa-a0df347e74de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:16.900905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f6d6ce5-43ac-4753-b8fa-a0df347e74de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.901614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f6d6ce5-43ac-4753-b8fa-a0df347e74de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.902054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f6d6ce5-43ac-4753-b8fa-a0df347e74de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.902742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f6d6ce5-43ac-4753-b8fa-a0df347e74de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.903234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f6d6ce5-43ac-4753-b8fa-a0df347e74de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.906200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f6d6ce5-43ac-4753-b8fa-a0df347e74de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.928244 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7f902a1b-28fb-4dc4-b898-6ddf2cbd2c0d tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-sets/930c7777c1d743ddb41526c30ac1a391" status: 200 len: 329 microversion: 2.1 time: 0.808945 Aug 29 15:38:16.934807 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1678/3321] 10.222.0.62 () {60 vars in 1263 bytes} [Mon Aug 29 15:38:16 2022] PUT /compute/v2.1/os-quota-sets/930c7777c1d743ddb41526c30ac1a391 => generated 329 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:16.934807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-26d8c442-ed99-4f15-a5c4-8d4f94e398d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:16.935202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-26d8c442-ed99-4f15-a5c4-8d4f94e398d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:16.949368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26d8c442-ed99-4f15-a5c4-8d4f94e398d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.949880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26d8c442-ed99-4f15-a5c4-8d4f94e398d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.950359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26d8c442-ed99-4f15-a5c4-8d4f94e398d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.956050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26d8c442-ed99-4f15-a5c4-8d4f94e398d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.956857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26d8c442-ed99-4f15-a5c4-8d4f94e398d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.957565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26d8c442-ed99-4f15-a5c4-8d4f94e398d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.248141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-26d8c442-ed99-4f15-a5c4-8d4f94e398d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:17.270740 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-26d8c442-ed99-4f15-a5c4-8d4f94e398d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1687 microversion: 2.1 time: 0.339155 Aug 29 15:38:17.271395 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1679/3322] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:16 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1687 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:17.300368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-626f8b6a-ef60-4686-986a-acc9dd282ed6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:17.307268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-626f8b6a-ef60-4686-986a-acc9dd282ed6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:17.314321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-626f8b6a-ef60-4686-986a-acc9dd282ed6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.316340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-626f8b6a-ef60-4686-986a-acc9dd282ed6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.316989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-626f8b6a-ef60-4686-986a-acc9dd282ed6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.318619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-626f8b6a-ef60-4686-986a-acc9dd282ed6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.319560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-626f8b6a-ef60-4686-986a-acc9dd282ed6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.320010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-626f8b6a-ef60-4686-986a-acc9dd282ed6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.394423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2f6d6ce5-43ac-4753-b8fa-a0df347e74de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:17.401302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-626f8b6a-ef60-4686-986a-acc9dd282ed6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:17.408508 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2f6d6ce5-43ac-4753-b8fa-a0df347e74de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1522 microversion: 2.1 time: 0.526023 Aug 29 15:38:17.410307 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1644/3323] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:16 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1522 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:17.415895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-00f3995e-bbf6-476a-be6b-859bd3b798cc req-caa147ae-98af-47ca-9b95-143c8caf8141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "tag": "aeebdb13-55ba-4836-8aeb-54a484a60db4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:17.428253 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-626f8b6a-ef60-4686-986a-acc9dd282ed6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1232 microversion: 2.1 time: 0.137385 Aug 29 15:38:17.429164 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1680/3324] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:17 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1232 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:17.434082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3368a67e-48d7-4af6-a42b-0d7ba342f6e7 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Action: 'update', calling method: .version_select at 0x7fc42a9cd160>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:17.445248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-00f3995e-bbf6-476a-be6b-859bd3b798cc req-caa147ae-98af-47ca-9b95-143c8caf8141 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.445935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-00f3995e-bbf6-476a-be6b-859bd3b798cc req-caa147ae-98af-47ca-9b95-143c8caf8141 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.446368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-00f3995e-bbf6-476a-be6b-859bd3b798cc req-caa147ae-98af-47ca-9b95-143c8caf8141 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.465768 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-00f3995e-bbf6-476a-be6b-859bd3b798cc req-caa147ae-98af-47ca-9b95-143c8caf8141 service nova] Creating event network-changed:aeebdb13-55ba-4836-8aeb-54a484a60db4 for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:38:17.477295 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-00f3995e-bbf6-476a-be6b-859bd3b798cc req-caa147ae-98af-47ca-9b95-143c8caf8141 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065402 Aug 29 15:38:17.478649 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1645/3325] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:17.486979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ed4fd963-de97-45be-81ca-2e0aea8c4e84 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:17.488168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ed4fd963-de97-45be-81ca-2e0aea8c4e84 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:17.495365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed4fd963-de97-45be-81ca-2e0aea8c4e84 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.495888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed4fd963-de97-45be-81ca-2e0aea8c4e84 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.496329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed4fd963-de97-45be-81ca-2e0aea8c4e84 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.497072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed4fd963-de97-45be-81ca-2e0aea8c4e84 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.497569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed4fd963-de97-45be-81ca-2e0aea8c4e84 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.498000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed4fd963-de97-45be-81ca-2e0aea8c4e84 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.764067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3368a67e-48d7-4af6-a42b-0d7ba342f6e7 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.765052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3368a67e-48d7-4af6-a42b-0d7ba342f6e7 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.765781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3368a67e-48d7-4af6-a42b-0d7ba342f6e7 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.767636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3368a67e-48d7-4af6-a42b-0d7ba342f6e7 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.768323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3368a67e-48d7-4af6-a42b-0d7ba342f6e7 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.768960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3368a67e-48d7-4af6-a42b-0d7ba342f6e7 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.890210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ed4fd963-de97-45be-81ca-2e0aea8c4e84 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:17.902560 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ed4fd963-de97-45be-81ca-2e0aea8c4e84 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1325 microversion: 2.1 time: 0.422346 Aug 29 15:38:17.903188 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1646/3326] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:17 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1325 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:17.921886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-218bf628-e941-471b-98bf-0e666ae68509 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:17.922262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-218bf628-e941-471b-98bf-0e666ae68509 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:17.929126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-218bf628-e941-471b-98bf-0e666ae68509 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.929849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-218bf628-e941-471b-98bf-0e666ae68509 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.930448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-218bf628-e941-471b-98bf-0e666ae68509 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.931362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-218bf628-e941-471b-98bf-0e666ae68509 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.931998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-218bf628-e941-471b-98bf-0e666ae68509 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.932580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-218bf628-e941-471b-98bf-0e666ae68509 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.970984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-218bf628-e941-471b-98bf-0e666ae68509 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:38:18.020795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=27,nova_api:UPDATE=9 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:18.093630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:18.111759 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-218bf628-e941-471b-98bf-0e666ae68509 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 204 len: 0 microversion: 2.1 time: 0.192976 Aug 29 15:38:18.117745 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1647/3327] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:17 2022] DELETE /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:38:18.127227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-86d7b2dc-52c5-4e68-be2d-e80d571108fb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:18.128592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-86d7b2dc-52c5-4e68-be2d-e80d571108fb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:18.148794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86d7b2dc-52c5-4e68-be2d-e80d571108fb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.149680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86d7b2dc-52c5-4e68-be2d-e80d571108fb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.151723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86d7b2dc-52c5-4e68-be2d-e80d571108fb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.153410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86d7b2dc-52c5-4e68-be2d-e80d571108fb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.154637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86d7b2dc-52c5-4e68-be2d-e80d571108fb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.156008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86d7b2dc-52c5-4e68-be2d-e80d571108fb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.214600 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3368a67e-48d7-4af6-a42b-0d7ba342f6e7 tempest-QuotasAdminTestJSON-2084860163 tempest-QuotasAdminTestJSON-2084860163-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-sets/930c7777c1d743ddb41526c30ac1a391" status: 200 len: 329 microversion: 2.1 time: 0.784292 Aug 29 15:38:18.218769 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1681/3328] 10.222.0.62 () {60 vars in 1263 bytes} [Mon Aug 29 15:38:17 2022] PUT /compute/v2.1/os-quota-sets/930c7777c1d743ddb41526c30ac1a391 => generated 329 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:18.241201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8ea05c08-6ec1-410f-abfb-7f106cea6e2e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:18.241981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8ea05c08-6ec1-410f-abfb-7f106cea6e2e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:18.249745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ea05c08-6ec1-410f-abfb-7f106cea6e2e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.250304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ea05c08-6ec1-410f-abfb-7f106cea6e2e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.250940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ea05c08-6ec1-410f-abfb-7f106cea6e2e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.251496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ea05c08-6ec1-410f-abfb-7f106cea6e2e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.255311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ea05c08-6ec1-410f-abfb-7f106cea6e2e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.255311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ea05c08-6ec1-410f-abfb-7f106cea6e2e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.642272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8ea05c08-6ec1-410f-abfb-7f106cea6e2e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:18.661333 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8ea05c08-6ec1-410f-abfb-7f106cea6e2e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1528 microversion: 2.1 time: 0.441225 Aug 29 15:38:18.662641 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1682/3329] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:18 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1528 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:18.667724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a5dae4dd-bca0-4d8a-ad4d-3676cd1053f3 req-531a1d9e-5c5e-484d-b8b4-3f7df403a8bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af95f7c-5362-4cf9-b80e-38cd6a518783", "name": "network-vif-plugged", "status": "completed", "tag": "2984ebfd-8f23-4f8e-83af-0a164bd8c5aa"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:18.682144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a5dae4dd-bca0-4d8a-ad4d-3676cd1053f3 req-531a1d9e-5c5e-484d-b8b4-3f7df403a8bc service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.682959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a5dae4dd-bca0-4d8a-ad4d-3676cd1053f3 req-531a1d9e-5c5e-484d-b8b4-3f7df403a8bc service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.683742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a5dae4dd-bca0-4d8a-ad4d-3676cd1053f3 req-531a1d9e-5c5e-484d-b8b4-3f7df403a8bc service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.697358 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a5dae4dd-bca0-4d8a-ad4d-3676cd1053f3 req-531a1d9e-5c5e-484d-b8b4-3f7df403a8bc service nova] Creating event network-vif-plugged:2984ebfd-8f23-4f8e-83af-0a164bd8c5aa for instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 on n-h2-839401-11 Aug 29 15:38:18.707445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-86d7b2dc-52c5-4e68-be2d-e80d571108fb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:18.718686 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a5dae4dd-bca0-4d8a-ad4d-3676cd1053f3 req-531a1d9e-5c5e-484d-b8b4-3f7df403a8bc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053894 Aug 29 15:38:18.718928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-86d7b2dc-52c5-4e68-be2d-e80d571108fb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:18.720559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-86d7b2dc-52c5-4e68-be2d-e80d571108fb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:18.722702 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-86d7b2dc-52c5-4e68-be2d-e80d571108fb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.602421 Aug 29 15:38:18.723774 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1683/3330] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:18.731797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ecedcc9b-1998-4f30-8a4f-cb41b65f4ac1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:18.732869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ecedcc9b-1998-4f30-8a4f-cb41b65f4ac1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:18.737747 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1648/3331] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:18 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:18.740582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecedcc9b-1998-4f30-8a4f-cb41b65f4ac1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.741077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecedcc9b-1998-4f30-8a4f-cb41b65f4ac1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.741534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecedcc9b-1998-4f30-8a4f-cb41b65f4ac1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.742542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecedcc9b-1998-4f30-8a4f-cb41b65f4ac1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.743000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecedcc9b-1998-4f30-8a4f-cb41b65f4ac1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.743662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecedcc9b-1998-4f30-8a4f-cb41b65f4ac1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.746541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-04537ce2-30dc-48ba-ae2b-d8891fa5ab81 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:18.747539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-04537ce2-30dc-48ba-ae2b-d8891fa5ab81 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:18.753839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04537ce2-30dc-48ba-ae2b-d8891fa5ab81 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.754425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04537ce2-30dc-48ba-ae2b-d8891fa5ab81 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.754933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04537ce2-30dc-48ba-ae2b-d8891fa5ab81 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.755716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04537ce2-30dc-48ba-ae2b-d8891fa5ab81 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.756319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04537ce2-30dc-48ba-ae2b-d8891fa5ab81 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.756817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04537ce2-30dc-48ba-ae2b-d8891fa5ab81 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.925895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-04537ce2-30dc-48ba-ae2b-d8891fa5ab81 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:18.936437 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-04537ce2-30dc-48ba-ae2b-d8891fa5ab81 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1306 microversion: 2.1 time: 0.196844 Aug 29 15:38:18.937529 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1649/3332] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:18 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1306 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:18.944647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f7976418-8356-4255-ba47-84a29cb04d2e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:18.946297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f7976418-8356-4255-ba47-84a29cb04d2e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:18.961294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7976418-8356-4255-ba47-84a29cb04d2e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.962090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7976418-8356-4255-ba47-84a29cb04d2e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.963059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7976418-8356-4255-ba47-84a29cb04d2e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.965000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7976418-8356-4255-ba47-84a29cb04d2e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.966117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7976418-8356-4255-ba47-84a29cb04d2e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.966725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7976418-8356-4255-ba47-84a29cb04d2e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.003942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ecedcc9b-1998-4f30-8a4f-cb41b65f4ac1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:19.014241 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ecedcc9b-1998-4f30-8a4f-cb41b65f4ac1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1687 microversion: 2.1 time: 0.288414 Aug 29 15:38:19.016402 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1684/3333] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:18 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1687 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:19.513349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-872db3cc-31be-42ee-abe3-e391740f9e29 req-9c3c35d8-a98d-4d9b-adb0-03aed10db051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cedb09-55ea-4009-a00a-3a6259ec9823", "tag": "d1dd5457-8497-4bac-9872-8efc80032791"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:19.526424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-872db3cc-31be-42ee-abe3-e391740f9e29 req-9c3c35d8-a98d-4d9b-adb0-03aed10db051 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.526982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-872db3cc-31be-42ee-abe3-e391740f9e29 req-9c3c35d8-a98d-4d9b-adb0-03aed10db051 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.527359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-872db3cc-31be-42ee-abe3-e391740f9e29 req-9c3c35d8-a98d-4d9b-adb0-03aed10db051 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.541218 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-872db3cc-31be-42ee-abe3-e391740f9e29 req-9c3c35d8-a98d-4d9b-adb0-03aed10db051 service nova] Creating event network-changed:d1dd5457-8497-4bac-9872-8efc80032791 for instance e8cedb09-55ea-4009-a00a-3a6259ec9823 on n-h2-839401-11 Aug 29 15:38:19.546701 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-872db3cc-31be-42ee-abe3-e391740f9e29 req-9c3c35d8-a98d-4d9b-adb0-03aed10db051 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037719 Aug 29 15:38:19.547421 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1685/3334] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:38:19.685541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dd066122-9574-4f97-ad3e-a36a4505d911 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:19.686309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dd066122-9574-4f97-ad3e-a36a4505d911 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:19.695171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd066122-9574-4f97-ad3e-a36a4505d911 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.696214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd066122-9574-4f97-ad3e-a36a4505d911 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.696214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd066122-9574-4f97-ad3e-a36a4505d911 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.697155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd066122-9574-4f97-ad3e-a36a4505d911 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.697675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd066122-9574-4f97-ad3e-a36a4505d911 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.699418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd066122-9574-4f97-ad3e-a36a4505d911 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.799215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f7976418-8356-4255-ba47-84a29cb04d2e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:19.809927 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f7976418-8356-4255-ba47-84a29cb04d2e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1325 microversion: 2.1 time: 0.870083 Aug 29 15:38:19.824246 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1650/3335] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:18 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1325 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:19.831039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-719b63ba-25e6-4f40-87c0-3ef465abf038 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:19.831818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-719b63ba-25e6-4f40-87c0-3ef465abf038 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:19.844006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-719b63ba-25e6-4f40-87c0-3ef465abf038 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.844524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-719b63ba-25e6-4f40-87c0-3ef465abf038 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.844956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-719b63ba-25e6-4f40-87c0-3ef465abf038 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.845697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-719b63ba-25e6-4f40-87c0-3ef465abf038 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.850182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-719b63ba-25e6-4f40-87c0-3ef465abf038 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.850636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-719b63ba-25e6-4f40-87c0-3ef465abf038 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.926187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dd066122-9574-4f97-ad3e-a36a4505d911 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:19.936888 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dd066122-9574-4f97-ad3e-a36a4505d911 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1528 microversion: 2.1 time: 0.256266 Aug 29 15:38:19.951197 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1686/3336] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:19 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1528 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:19.963732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8ee5de0e-2f2a-4d1a-9259-05a09c2fe55e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:19.964612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8ee5de0e-2f2a-4d1a-9259-05a09c2fe55e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:19.972937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ee5de0e-2f2a-4d1a-9259-05a09c2fe55e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.973532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ee5de0e-2f2a-4d1a-9259-05a09c2fe55e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.973992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ee5de0e-2f2a-4d1a-9259-05a09c2fe55e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.974824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ee5de0e-2f2a-4d1a-9259-05a09c2fe55e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.975311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ee5de0e-2f2a-4d1a-9259-05a09c2fe55e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.975773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ee5de0e-2f2a-4d1a-9259-05a09c2fe55e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.072542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8ee5de0e-2f2a-4d1a-9259-05a09c2fe55e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:20.086561 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8ee5de0e-2f2a-4d1a-9259-05a09c2fe55e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1294 microversion: 2.1 time: 0.128606 Aug 29 15:38:20.087692 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1687/3337] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:19 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1294 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:20.093519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2e73f313-5c90-4764-836b-1ce597f798bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:20.094402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2e73f313-5c90-4764-836b-1ce597f798bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:20.101763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e73f313-5c90-4764-836b-1ce597f798bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.102815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e73f313-5c90-4764-836b-1ce597f798bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.103950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e73f313-5c90-4764-836b-1ce597f798bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.105670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e73f313-5c90-4764-836b-1ce597f798bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.106722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e73f313-5c90-4764-836b-1ce597f798bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.107404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e73f313-5c90-4764-836b-1ce597f798bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.368703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2e73f313-5c90-4764-836b-1ce597f798bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:20.393150 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2e73f313-5c90-4764-836b-1ce597f798bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1682 microversion: 2.1 time: 0.302440 Aug 29 15:38:20.395639 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1688/3338] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:20 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1682 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:20.521073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-719b63ba-25e6-4f40-87c0-3ef465abf038 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:20.534112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-719b63ba-25e6-4f40-87c0-3ef465abf038 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:20.536616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-719b63ba-25e6-4f40-87c0-3ef465abf038 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:20.538076 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-719b63ba-25e6-4f40-87c0-3ef465abf038 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.712269 Aug 29 15:38:20.539025 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1651/3339] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:19 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:20.745400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-8d8949aa-127e-4518-84c1-cb474569c1d3 req-b21ce194-6ef8-4b8b-93d6-05a5aa59afec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0017b65-7a12-4dbb-926e-51dccc9475a9", "name": "network-vif-unplugged", "status": "completed", "tag": "a469d9e2-82d7-4161-8e7a-b2a82438b48b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:20.758559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8d8949aa-127e-4518-84c1-cb474569c1d3 req-b21ce194-6ef8-4b8b-93d6-05a5aa59afec service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.759334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8d8949aa-127e-4518-84c1-cb474569c1d3 req-b21ce194-6ef8-4b8b-93d6-05a5aa59afec service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.759941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8d8949aa-127e-4518-84c1-cb474569c1d3 req-b21ce194-6ef8-4b8b-93d6-05a5aa59afec service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.777064 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-8d8949aa-127e-4518-84c1-cb474569c1d3 req-b21ce194-6ef8-4b8b-93d6-05a5aa59afec service nova] Creating event network-vif-unplugged:a469d9e2-82d7-4161-8e7a-b2a82438b48b for instance e0017b65-7a12-4dbb-926e-51dccc9475a9 on n-h1-839401-11 Aug 29 15:38:20.783956 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-8d8949aa-127e-4518-84c1-cb474569c1d3 req-b21ce194-6ef8-4b8b-93d6-05a5aa59afec service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042971 Aug 29 15:38:20.788318 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1689/3340] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:20.833444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-24978694-9385-4e3c-b64e-065c99b26021 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:20.834982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-24978694-9385-4e3c-b64e-065c99b26021 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:20.844877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24978694-9385-4e3c-b64e-065c99b26021 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.845397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24978694-9385-4e3c-b64e-065c99b26021 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.846214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24978694-9385-4e3c-b64e-065c99b26021 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.854900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24978694-9385-4e3c-b64e-065c99b26021 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.856081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24978694-9385-4e3c-b64e-065c99b26021 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.857431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24978694-9385-4e3c-b64e-065c99b26021 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.986985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-05932bf3-436c-470e-a652-49a6ea8bd971 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:20.993534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-05932bf3-436c-470e-a652-49a6ea8bd971 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:21.032237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05932bf3-436c-470e-a652-49a6ea8bd971 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.035223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05932bf3-436c-470e-a652-49a6ea8bd971 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.051580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05932bf3-436c-470e-a652-49a6ea8bd971 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.058395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05932bf3-436c-470e-a652-49a6ea8bd971 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.062382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05932bf3-436c-470e-a652-49a6ea8bd971 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.067870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05932bf3-436c-470e-a652-49a6ea8bd971 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.341054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-05932bf3-436c-470e-a652-49a6ea8bd971 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:21.361292 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-05932bf3-436c-470e-a652-49a6ea8bd971 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1486 microversion: 2.1 time: 0.403972 Aug 29 15:38:21.403352 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1690/3341] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:20 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1486 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:21.425768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-24978694-9385-4e3c-b64e-065c99b26021 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:21.438868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-afbfc5d6-e6ef-4252-919c-a33a5fd376c0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:21.442267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-afbfc5d6-e6ef-4252-919c-a33a5fd376c0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:21.449138 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-24978694-9385-4e3c-b64e-065c99b26021 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1325 microversion: 2.1 time: 0.621288 Aug 29 15:38:21.454818 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1652/3342] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:20 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1325 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:21.472572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-c9c093c7-fe5d-4047-875f-a2073da1c26f req-a93668d3-eb39-4999-9e4a-80290877c167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0017b65-7a12-4dbb-926e-51dccc9475a9", "name": "network-vif-deleted", "tag": "a469d9e2-82d7-4161-8e7a-b2a82438b48b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:21.493706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afbfc5d6-e6ef-4252-919c-a33a5fd376c0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.494639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afbfc5d6-e6ef-4252-919c-a33a5fd376c0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.498170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afbfc5d6-e6ef-4252-919c-a33a5fd376c0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.500791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afbfc5d6-e6ef-4252-919c-a33a5fd376c0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.502949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afbfc5d6-e6ef-4252-919c-a33a5fd376c0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.503632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c9c093c7-fe5d-4047-875f-a2073da1c26f req-a93668d3-eb39-4999-9e4a-80290877c167 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.507268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afbfc5d6-e6ef-4252-919c-a33a5fd376c0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.507715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c9c093c7-fe5d-4047-875f-a2073da1c26f req-a93668d3-eb39-4999-9e4a-80290877c167 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.508360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c9c093c7-fe5d-4047-875f-a2073da1c26f req-a93668d3-eb39-4999-9e4a-80290877c167 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.545738 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-c9c093c7-fe5d-4047-875f-a2073da1c26f req-a93668d3-eb39-4999-9e4a-80290877c167 service nova] Creating event network-vif-deleted:a469d9e2-82d7-4161-8e7a-b2a82438b48b for instance e0017b65-7a12-4dbb-926e-51dccc9475a9 on n-h1-839401-11 Aug 29 15:38:21.558121 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-c9c093c7-fe5d-4047-875f-a2073da1c26f req-a93668d3-eb39-4999-9e4a-80290877c167 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101664 Aug 29 15:38:21.563789 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1653/3343] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:21.575126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5da4b9e6-9c12-4cd3-b264-1a9943b25f8a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:21.578490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5da4b9e6-9c12-4cd3-b264-1a9943b25f8a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:21.593426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5da4b9e6-9c12-4cd3-b264-1a9943b25f8a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.596119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5da4b9e6-9c12-4cd3-b264-1a9943b25f8a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.601821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5da4b9e6-9c12-4cd3-b264-1a9943b25f8a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.603077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5da4b9e6-9c12-4cd3-b264-1a9943b25f8a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.603733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5da4b9e6-9c12-4cd3-b264-1a9943b25f8a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.604363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5da4b9e6-9c12-4cd3-b264-1a9943b25f8a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.893015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-afbfc5d6-e6ef-4252-919c-a33a5fd376c0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:21.913290 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-afbfc5d6-e6ef-4252-919c-a33a5fd376c0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1361 microversion: 2.1 time: 0.502962 Aug 29 15:38:21.915360 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1691/3344] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:21 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1361 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:21.929617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8ca997ea-4a06-41f9-a516-1833c6b85ae0 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:21.930400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8ca997ea-4a06-41f9-a516-1833c6b85ae0 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:21.945893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ca997ea-4a06-41f9-a516-1833c6b85ae0 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.947344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ca997ea-4a06-41f9-a516-1833c6b85ae0 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.949662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ca997ea-4a06-41f9-a516-1833c6b85ae0 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.951353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5da4b9e6-9c12-4cd3-b264-1a9943b25f8a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:21.953332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ca997ea-4a06-41f9-a516-1833c6b85ae0 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.954037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ca997ea-4a06-41f9-a516-1833c6b85ae0 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.956901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ca997ea-4a06-41f9-a516-1833c6b85ae0 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.961244 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5da4b9e6-9c12-4cd3-b264-1a9943b25f8a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1682 microversion: 2.1 time: 0.395606 Aug 29 15:38:21.962254 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1654/3345] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:21 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1682 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:22.391098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7d8ac906-3927-44f3-b64f-3fc0803f2f78 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:22.392530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7d8ac906-3927-44f3-b64f-3fc0803f2f78 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:22.415901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d8ac906-3927-44f3-b64f-3fc0803f2f78 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.417895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d8ac906-3927-44f3-b64f-3fc0803f2f78 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.420552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d8ac906-3927-44f3-b64f-3fc0803f2f78 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:22.420658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8ca997ea-4a06-41f9-a516-1833c6b85ae0 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:22.421810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d8ac906-3927-44f3-b64f-3fc0803f2f78 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.423163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d8ac906-3927-44f3-b64f-3fc0803f2f78 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.425061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d8ac906-3927-44f3-b64f-3fc0803f2f78 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:22.439928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8ca997ea-4a06-41f9-a516-1833c6b85ae0 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:22.441430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8ca997ea-4a06-41f9-a516-1833c6b85ae0 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:22.454767 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8ca997ea-4a06-41f9-a516-1833c6b85ae0 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.535441 Aug 29 15:38:22.469143 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1692/3346] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:21 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:22.483545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-72ca62e3-c104-4fb8-82bf-9b33b8ad40cd tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:22.490681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-72ca62e3-c104-4fb8-82bf-9b33b8ad40cd tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:22.507594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72ca62e3-c104-4fb8-82bf-9b33b8ad40cd tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.509306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72ca62e3-c104-4fb8-82bf-9b33b8ad40cd tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.509763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72ca62e3-c104-4fb8-82bf-9b33b8ad40cd tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:22.510516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72ca62e3-c104-4fb8-82bf-9b33b8ad40cd tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.513430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72ca62e3-c104-4fb8-82bf-9b33b8ad40cd tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.517145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72ca62e3-c104-4fb8-82bf-9b33b8ad40cd tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:22.553743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d8ac906-3927-44f3-b64f-3fc0803f2f78 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.554495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d8ac906-3927-44f3-b64f-3fc0803f2f78 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.558199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d8ac906-3927-44f3-b64f-3fc0803f2f78 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:22.558712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-7d8ac906-3927-44f3-b64f-3fc0803f2f78 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lazy-loading 'fault' on Instance uuid e0017b65-7a12-4dbb-926e-51dccc9475a9 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:38:22.674073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7d8ac906-3927-44f3-b64f-3fc0803f2f78 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:22.686075 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7d8ac906-3927-44f3-b64f-3fc0803f2f78 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 200 len: 1315 microversion: 2.1 time: 0.303586 Aug 29 15:38:22.689759 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1655/3347] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:22 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:22.946351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-70c4c0af-06b2-4910-8961-519d6c60df59 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:22.947435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-70c4c0af-06b2-4910-8961-519d6c60df59 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:22.953213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:22.956832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=20 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:22.976090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70c4c0af-06b2-4910-8961-519d6c60df59 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.976845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70c4c0af-06b2-4910-8961-519d6c60df59 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.977428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70c4c0af-06b2-4910-8961-519d6c60df59 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:22.979541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70c4c0af-06b2-4910-8961-519d6c60df59 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.984060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70c4c0af-06b2-4910-8961-519d6c60df59 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.986280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70c4c0af-06b2-4910-8961-519d6c60df59 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.589394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-72ca62e3-c104-4fb8-82bf-9b33b8ad40cd tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:23.605176 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-72ca62e3-c104-4fb8-82bf-9b33b8ad40cd tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1325 microversion: 2.1 time: 1.125974 Aug 29 15:38:23.621943 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1693/3348] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:22 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1325 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:23.634564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-84450369-4f97-462d-ab20-f3dfb7a6698c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:23.638064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-84450369-4f97-462d-ab20-f3dfb7a6698c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:23.649359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84450369-4f97-462d-ab20-f3dfb7a6698c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.651184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84450369-4f97-462d-ab20-f3dfb7a6698c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.657247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84450369-4f97-462d-ab20-f3dfb7a6698c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.660992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84450369-4f97-462d-ab20-f3dfb7a6698c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.661997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84450369-4f97-462d-ab20-f3dfb7a6698c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.662798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84450369-4f97-462d-ab20-f3dfb7a6698c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.093386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-84450369-4f97-462d-ab20-f3dfb7a6698c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:24.101676 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-84450369-4f97-462d-ab20-f3dfb7a6698c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1682 microversion: 2.1 time: 0.478091 Aug 29 15:38:24.104503 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1694/3349] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:23 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1682 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:24.124472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a0959726-3b24-4906-8487-6650edd810e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:24.125431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a0959726-3b24-4906-8487-6650edd810e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:24.138631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0959726-3b24-4906-8487-6650edd810e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.140063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0959726-3b24-4906-8487-6650edd810e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.140747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0959726-3b24-4906-8487-6650edd810e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.141693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0959726-3b24-4906-8487-6650edd810e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.142564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0959726-3b24-4906-8487-6650edd810e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.143173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0959726-3b24-4906-8487-6650edd810e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.289881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-70c4c0af-06b2-4910-8961-519d6c60df59 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:24.306610 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-70c4c0af-06b2-4910-8961-519d6c60df59 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1361 microversion: 2.1 time: 1.362314 Aug 29 15:38:24.333063 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1656/3350] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:22 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1361 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:24.350694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2240ae6f-89e2-477b-a973-e74e756786bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:24.351338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2240ae6f-89e2-477b-a973-e74e756786bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:24.370632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2240ae6f-89e2-477b-a973-e74e756786bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.373034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2240ae6f-89e2-477b-a973-e74e756786bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.373711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2240ae6f-89e2-477b-a973-e74e756786bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.374679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2240ae6f-89e2-477b-a973-e74e756786bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.376473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2240ae6f-89e2-477b-a973-e74e756786bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.377428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2240ae6f-89e2-477b-a973-e74e756786bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.405718 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-2240ae6f-89e2-477b-a973-e74e756786bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] HTTP exception thrown: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2240ae6f-89e2-477b-a973-e74e756786bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Request method failure captured: Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 HTTP/1.1 Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN0GbvIiUff-Csg384q60lkXu4i6-mvBJpd3uHC3XwYXy4PaOZ7rdjlazGQlvtMKGXenSXNWI7wpdDnEyRTa364NbLtw3ESiH3fXKpDQtDE_4rOyqKq2j2P24J-z87DcgMla1UHDGJpmC4Fh5kcRUC7Pl2mjjcnRflSX472pqyiJs6U Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaeecb44c6534cba89e3d68177917529", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}] Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6de4fe0749d449748eca6937b123d2df Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'e0017b65-7a12-4dbb-926e-51dccc9475a9'} Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:24.407407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:24.412316 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:24.412316 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:24.412316 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:24.412316 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:24.412316 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:24.412316 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:24.412316 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. Aug 29 15:38:24.412316 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:24.418540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2240ae6f-89e2-477b-a973-e74e756786bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Returning 404 to user: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:24.420425 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2240ae6f-89e2-477b-a973-e74e756786bb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 404 len: 111 microversion: 2.1 time: 0.085968 Aug 29 15:38:24.421514 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1657/3351] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:24 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:24.633049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bab4d6fd-696e-439b-a91d-092152813588 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:24.633912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bab4d6fd-696e-439b-a91d-092152813588 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:24.643061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bab4d6fd-696e-439b-a91d-092152813588 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.649223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bab4d6fd-696e-439b-a91d-092152813588 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.650191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bab4d6fd-696e-439b-a91d-092152813588 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.652887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bab4d6fd-696e-439b-a91d-092152813588 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.654085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bab4d6fd-696e-439b-a91d-092152813588 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.654709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bab4d6fd-696e-439b-a91d-092152813588 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.679773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:25.178832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a0959726-3b24-4906-8487-6650edd810e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:25.195405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a0959726-3b24-4906-8487-6650edd810e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:25.211043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a0959726-3b24-4906-8487-6650edd810e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:25.216102 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a0959726-3b24-4906-8487-6650edd810e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 1.110493 Aug 29 15:38:25.216837 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1695/3352] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:24 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:25.230795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-216352753", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:25.338481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] validate_networks() for [('2d27d5b5-0bb7-4454-8b95-3d130a3377a8', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:25.456105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bab4d6fd-696e-439b-a91d-092152813588 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:25.471637 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bab4d6fd-696e-439b-a91d-092152813588 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1325 microversion: 2.1 time: 0.843750 Aug 29 15:38:25.476324 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1658/3353] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:24 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1325 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:25.488458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b6ba617e-055e-4166-b8a3-41fe3fbfc69f req-69758e6a-ffdf-4f8e-aaf9-29437b5fbe04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c7ad8e-1ed9-4347-bb61-13e861e30886", "tag": "3b0b56b0-e15e-416f-9d4e-484bdf83401b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:25.518356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b6ba617e-055e-4166-b8a3-41fe3fbfc69f req-69758e6a-ffdf-4f8e-aaf9-29437b5fbe04 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.520507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b6ba617e-055e-4166-b8a3-41fe3fbfc69f req-69758e6a-ffdf-4f8e-aaf9-29437b5fbe04 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.522392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b6ba617e-055e-4166-b8a3-41fe3fbfc69f req-69758e6a-ffdf-4f8e-aaf9-29437b5fbe04 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.562814 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b6ba617e-055e-4166-b8a3-41fe3fbfc69f req-69758e6a-ffdf-4f8e-aaf9-29437b5fbe04 service nova] Creating event network-changed:3b0b56b0-e15e-416f-9d4e-484bdf83401b for instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 on n-h1-839401-11 Aug 29 15:38:25.577679 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b6ba617e-055e-4166-b8a3-41fe3fbfc69f req-69758e6a-ffdf-4f8e-aaf9-29437b5fbe04 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095990 Aug 29 15:38:25.580087 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1659/3354] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:25.594366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-96556753-5b68-4e79-8743-aa4120cdd884 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:25.599923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-96556753-5b68-4e79-8743-aa4120cdd884 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:25.610074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96556753-5b68-4e79-8743-aa4120cdd884 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.610972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96556753-5b68-4e79-8743-aa4120cdd884 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.612249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96556753-5b68-4e79-8743-aa4120cdd884 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.613493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96556753-5b68-4e79-8743-aa4120cdd884 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.614170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96556753-5b68-4e79-8743-aa4120cdd884 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.614778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96556753-5b68-4e79-8743-aa4120cdd884 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.938613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-96556753-5b68-4e79-8743-aa4120cdd884 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:25.951474 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-96556753-5b68-4e79-8743-aa4120cdd884 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1682 microversion: 2.1 time: 0.368295 Aug 29 15:38:25.967144 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1660/3355] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:25 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1682 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:25.973473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b80f4778-426f-476a-a1b0-29d89f3ec63d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:25.974404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b80f4778-426f-476a-a1b0-29d89f3ec63d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:25.985385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b80f4778-426f-476a-a1b0-29d89f3ec63d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.986758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b80f4778-426f-476a-a1b0-29d89f3ec63d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.987552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b80f4778-426f-476a-a1b0-29d89f3ec63d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.988388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b80f4778-426f-476a-a1b0-29d89f3ec63d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.988983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b80f4778-426f-476a-a1b0-29d89f3ec63d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.989818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b80f4778-426f-476a-a1b0-29d89f3ec63d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.362985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b80f4778-426f-476a-a1b0-29d89f3ec63d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:26.377485 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b80f4778-426f-476a-a1b0-29d89f3ec63d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1361 microversion: 2.1 time: 0.408694 Aug 29 15:38:26.391044 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1661/3356] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:25 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1361 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:26.545811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:38:26.546390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:38:26.546697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:38:26.547108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:38:26.547912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:38:26.568932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c1dc41f9-2c20-46b5-acc8-41fa74e46802 tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Action: 'update', calling method: .version_select at 0x7fc42a842430>, body: {"quota_set": {"ram": "5120"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:26.578977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.579818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.580520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.584160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.584942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.585664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.614938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Getting quotas for project eaeecb44c6534cba89e3d68177917529. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:26.621920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Getting quotas for user 6de4fe0749d449748eca6937b123d2df and project eaeecb44c6534cba89e3d68177917529. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:26.642323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:38:26.645524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:38:26.713407 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b327f059-a5b9-40ba-8b28-3ca5f157ce86 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.495121 Aug 29 15:38:26.714802 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1696/3357] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:38:26.720706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-23c017bc-6162-40d3-92fd-409e740e0058 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:26.721893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-23c017bc-6162-40d3-92fd-409e740e0058 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:26.731532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23c017bc-6162-40d3-92fd-409e740e0058 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.732745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23c017bc-6162-40d3-92fd-409e740e0058 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.733441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23c017bc-6162-40d3-92fd-409e740e0058 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.734519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23c017bc-6162-40d3-92fd-409e740e0058 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.735168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23c017bc-6162-40d3-92fd-409e740e0058 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.735924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23c017bc-6162-40d3-92fd-409e740e0058 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.741186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:26.765929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1dc41f9-2c20-46b5-acc8-41fa74e46802 tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.766602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1dc41f9-2c20-46b5-acc8-41fa74e46802 tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.768329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1dc41f9-2c20-46b5-acc8-41fa74e46802 tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.771913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1dc41f9-2c20-46b5-acc8-41fa74e46802 tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.774152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1dc41f9-2c20-46b5-acc8-41fa74e46802 tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.774822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1dc41f9-2c20-46b5-acc8-41fa74e46802 tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.944779 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c1dc41f9-2c20-46b5-acc8-41fa74e46802 tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-sets/af8b0cc55e384587a8831d23e009f572" status: 200 len: 240 microversion: 2.36 time: 0.552401 Aug 29 15:38:26.947573 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1662/3358] 10.222.0.62 () {62 vars in 1303 bytes} [Mon Aug 29 15:38:26 2022] PUT /compute/v2.1/os-quota-sets/af8b0cc55e384587a8831d23e009f572 => generated 240 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:26.956891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c149d99-89c7-44f4-b8ae-8e15dee864d0 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:26.960801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6c149d99-89c7-44f4-b8ae-8e15dee864d0 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:26.975947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c149d99-89c7-44f4-b8ae-8e15dee864d0 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.976557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c149d99-89c7-44f4-b8ae-8e15dee864d0 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.977111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c149d99-89c7-44f4-b8ae-8e15dee864d0 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.979147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c149d99-89c7-44f4-b8ae-8e15dee864d0 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.991134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c149d99-89c7-44f4-b8ae-8e15dee864d0 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:27.018083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c149d99-89c7-44f4-b8ae-8e15dee864d0 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:27.304211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6c149d99-89c7-44f4-b8ae-8e15dee864d0 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:27.316667 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6c149d99-89c7-44f4-b8ae-8e15dee864d0 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1325 microversion: 2.1 time: 0.367767 Aug 29 15:38:27.319299 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1663/3359] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:26 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1325 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:27.332889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3edd898d-800d-4dbf-8f7c-e40eb72358bf tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:27.335941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3edd898d-800d-4dbf-8f7c-e40eb72358bf tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:27.488508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3edd898d-800d-4dbf-8f7c-e40eb72358bf tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:27.503810 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3edd898d-800d-4dbf-8f7c-e40eb72358bf tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 200 len: 1224 microversion: 2.1 time: 0.183088 Aug 29 15:38:27.518028 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1664/3360] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:27 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 1224 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:27.531026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-81e4636b-c3fa-4310-bb7a-2f90b8b7d73e tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Calling method '.version_select at 0x7fc42a89cca0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:27.689817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81e4636b-c3fa-4310-bb7a-2f90b8b7d73e tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:27.691427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81e4636b-c3fa-4310-bb7a-2f90b8b7d73e tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:27.692830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81e4636b-c3fa-4310-bb7a-2f90b8b7d73e tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:27.694210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81e4636b-c3fa-4310-bb7a-2f90b8b7d73e tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:27.694856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81e4636b-c3fa-4310-bb7a-2f90b8b7d73e tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:27.695479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81e4636b-c3fa-4310-bb7a-2f90b8b7d73e tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:27.729905 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-81e4636b-c3fa-4310-bb7a-2f90b8b7d73e tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/af8b0cc55e384587a8831d23e009f572/detail" status: 200 len: 672 microversion: 2.36 time: 0.209186 Aug 29 15:38:27.731064 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1665/3361] 10.222.0.62 () {60 vars in 1304 bytes} [Mon Aug 29 15:38:27 2022] GET /compute/v2.1/os-quota-sets/af8b0cc55e384587a8831d23e009f572/detail => generated 672 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:27.737993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8f2069e1-10f0-419e-872a-b6af9c85812e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:27.738710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8f2069e1-10f0-419e-872a-b6af9c85812e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:27.760959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f2069e1-10f0-419e-872a-b6af9c85812e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:27.761772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f2069e1-10f0-419e-872a-b6af9c85812e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:27.762526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f2069e1-10f0-419e-872a-b6af9c85812e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:27.763618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f2069e1-10f0-419e-872a-b6af9c85812e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:27.764244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f2069e1-10f0-419e-872a-b6af9c85812e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:27.764833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f2069e1-10f0-419e-872a-b6af9c85812e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:27.948808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-23c017bc-6162-40d3-92fd-409e740e0058 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:27.973682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-23c017bc-6162-40d3-92fd-409e740e0058 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:27.975809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-23c017bc-6162-40d3-92fd-409e740e0058 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:27.976852 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-23c017bc-6162-40d3-92fd-409e740e0058 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 1.260678 Aug 29 15:38:27.990285 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1697/3362] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:26 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:28.009837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ee945dee-4268-4a55-b3a1-5f6681ab7209 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:28.010449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ee945dee-4268-4a55-b3a1-5f6681ab7209 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:28.024655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee945dee-4268-4a55-b3a1-5f6681ab7209 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.025185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee945dee-4268-4a55-b3a1-5f6681ab7209 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.025630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee945dee-4268-4a55-b3a1-5f6681ab7209 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.026337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee945dee-4268-4a55-b3a1-5f6681ab7209 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.027085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee945dee-4268-4a55-b3a1-5f6681ab7209 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.027518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee945dee-4268-4a55-b3a1-5f6681ab7209 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.108045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8f2069e1-10f0-419e-872a-b6af9c85812e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:28.118287 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8f2069e1-10f0-419e-872a-b6af9c85812e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1682 microversion: 2.1 time: 0.386037 Aug 29 15:38:28.123176 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1666/3363] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:27 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1682 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:28.128197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f10d26ad-0e59-473c-a713-ddecadbed70c tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Action: 'update', calling method: .version_select at 0x7fc42a842310>, body: {"quota_set": {"ram": "2048"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:28.201132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:28.215643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f10d26ad-0e59-473c-a713-ddecadbed70c tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.216111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f10d26ad-0e59-473c-a713-ddecadbed70c tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.216553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f10d26ad-0e59-473c-a713-ddecadbed70c tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.217338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f10d26ad-0e59-473c-a713-ddecadbed70c tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.217806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f10d26ad-0e59-473c-a713-ddecadbed70c tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.218349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f10d26ad-0e59-473c-a713-ddecadbed70c tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.262865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f10d26ad-0e59-473c-a713-ddecadbed70c tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.263269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f10d26ad-0e59-473c-a713-ddecadbed70c tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.263721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f10d26ad-0e59-473c-a713-ddecadbed70c tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.264454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f10d26ad-0e59-473c-a713-ddecadbed70c tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.265072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f10d26ad-0e59-473c-a713-ddecadbed70c tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.267183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f10d26ad-0e59-473c-a713-ddecadbed70c tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.326275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ee945dee-4268-4a55-b3a1-5f6681ab7209 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:28.338368 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ee945dee-4268-4a55-b3a1-5f6681ab7209 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1361 microversion: 2.1 time: 0.328435 Aug 29 15:38:28.356010 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1698/3364] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:27 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1361 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:28.363808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a939ea18-a937-44aa-bb96-c36cb72b87bf tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:28.370485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a939ea18-a937-44aa-bb96-c36cb72b87bf tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:28.387787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a939ea18-a937-44aa-bb96-c36cb72b87bf tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.388283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a939ea18-a937-44aa-bb96-c36cb72b87bf tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.388725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a939ea18-a937-44aa-bb96-c36cb72b87bf tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.389476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a939ea18-a937-44aa-bb96-c36cb72b87bf tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.393896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a939ea18-a937-44aa-bb96-c36cb72b87bf tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.394340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a939ea18-a937-44aa-bb96-c36cb72b87bf tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.399505 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f10d26ad-0e59-473c-a713-ddecadbed70c tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-quota-sets/af8b0cc55e384587a8831d23e009f572?user_id=9fc4cb89520b43ff92571c59946d2edf" status: 200 len: 240 microversion: 2.36 time: 0.274969 Aug 29 15:38:28.406223 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1667/3365] 10.222.0.62 () {62 vars in 1384 bytes} [Mon Aug 29 15:38:28 2022] PUT /compute/v2.1/os-quota-sets/af8b0cc55e384587a8831d23e009f572?user_id=9fc4cb89520b43ff92571c59946d2edf => generated 240 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:28.417740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8cc6ff42-ae24-45a5-a694-0f0f4e8182e9 tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] Calling method '.version_select at 0x7fc42a8eedc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:28.522109 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8cc6ff42-ae24-45a5-a694-0f0f4e8182e9 tempest-QuotasAdminTestV236-1649895799 tempest-QuotasAdminTestV236-1649895799-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/af8b0cc55e384587a8831d23e009f572?user_id=9fc4cb89520b43ff92571c59946d2edf" status: 200 len: 282 microversion: 2.36 time: 0.114007 Aug 29 15:38:28.523196 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1668/3366] 10.222.0.62 () {60 vars in 1364 bytes} [Mon Aug 29 15:38:28 2022] GET /compute/v2.1/os-quota-sets/af8b0cc55e384587a8831d23e009f572?user_id=9fc4cb89520b43ff92571c59946d2edf => generated 282 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:28.528174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bc106e5d-6b0c-43fe-b4d9-18d78f792a81 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:28.528862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bc106e5d-6b0c-43fe-b4d9-18d78f792a81 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:28.549065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc106e5d-6b0c-43fe-b4d9-18d78f792a81 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.549611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc106e5d-6b0c-43fe-b4d9-18d78f792a81 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.550047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc106e5d-6b0c-43fe-b4d9-18d78f792a81 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.550770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc106e5d-6b0c-43fe-b4d9-18d78f792a81 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.553715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc106e5d-6b0c-43fe-b4d9-18d78f792a81 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.554193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc106e5d-6b0c-43fe-b4d9-18d78f792a81 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.646431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bc106e5d-6b0c-43fe-b4d9-18d78f792a81 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:28.657483 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bc106e5d-6b0c-43fe-b4d9-18d78f792a81 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 200 len: 1228 microversion: 2.1 time: 0.132257 Aug 29 15:38:28.658058 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1669/3367] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:28 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 1228 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:28.719982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a939ea18-a937-44aa-bb96-c36cb72b87bf tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:28.734066 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a939ea18-a937-44aa-bb96-c36cb72b87bf tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1325 microversion: 2.1 time: 0.376567 Aug 29 15:38:28.735365 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1699/3368] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:28 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1325 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:28.755615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-29b46033-1073-4a0c-b62f-10d17f65f494 req-a402d384-64a8-4c15-ad61-ccf6e222f23c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cedb09-55ea-4009-a00a-3a6259ec9823", "name": "network-vif-plugged", "status": "completed", "tag": "d1dd5457-8497-4bac-9872-8efc80032791"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:28.768352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-29b46033-1073-4a0c-b62f-10d17f65f494 req-a402d384-64a8-4c15-ad61-ccf6e222f23c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.768746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-29b46033-1073-4a0c-b62f-10d17f65f494 req-a402d384-64a8-4c15-ad61-ccf6e222f23c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.769218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-29b46033-1073-4a0c-b62f-10d17f65f494 req-a402d384-64a8-4c15-ad61-ccf6e222f23c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.801718 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-29b46033-1073-4a0c-b62f-10d17f65f494 req-a402d384-64a8-4c15-ad61-ccf6e222f23c service nova] Creating event network-vif-plugged:d1dd5457-8497-4bac-9872-8efc80032791 for instance e8cedb09-55ea-4009-a00a-3a6259ec9823 on n-h2-839401-11 Aug 29 15:38:28.814013 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-29b46033-1073-4a0c-b62f-10d17f65f494 req-a402d384-64a8-4c15-ad61-ccf6e222f23c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062739 Aug 29 15:38:28.816046 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1670/3369] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:29.014307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c5fe08a5-7337-44f1-b05c-8c13c092783b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:29.014935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c5fe08a5-7337-44f1-b05c-8c13c092783b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:29.029738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5fe08a5-7337-44f1-b05c-8c13c092783b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.030675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5fe08a5-7337-44f1-b05c-8c13c092783b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.031470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5fe08a5-7337-44f1-b05c-8c13c092783b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.032347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5fe08a5-7337-44f1-b05c-8c13c092783b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.034364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5fe08a5-7337-44f1-b05c-8c13c092783b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.041491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5fe08a5-7337-44f1-b05c-8c13c092783b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.146566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b834889c-388a-4a19-8ed8-e2b425b4e162 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:29.147530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b834889c-388a-4a19-8ed8-e2b425b4e162 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:29.170560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b834889c-388a-4a19-8ed8-e2b425b4e162 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.171584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b834889c-388a-4a19-8ed8-e2b425b4e162 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.172411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b834889c-388a-4a19-8ed8-e2b425b4e162 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.173871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b834889c-388a-4a19-8ed8-e2b425b4e162 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.175696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b834889c-388a-4a19-8ed8-e2b425b4e162 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.176638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b834889c-388a-4a19-8ed8-e2b425b4e162 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.439958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c5fe08a5-7337-44f1-b05c-8c13c092783b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:29.455222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c5fe08a5-7337-44f1-b05c-8c13c092783b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:29.458886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c5fe08a5-7337-44f1-b05c-8c13c092783b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:29.459883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b834889c-388a-4a19-8ed8-e2b425b4e162 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:29.461924 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c5fe08a5-7337-44f1-b05c-8c13c092783b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.453304 Aug 29 15:38:29.465860 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1700/3370] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:29 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:29.499366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b01f29e-7650-44df-834f-8f6f5743a030 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:29.500059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8b01f29e-7650-44df-834f-8f6f5743a030 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:29.500641 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b834889c-388a-4a19-8ed8-e2b425b4e162 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1682 microversion: 2.1 time: 0.360442 Aug 29 15:38:29.503455 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1671/3371] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:29 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1682 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:29.525657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b01f29e-7650-44df-834f-8f6f5743a030 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.526161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b01f29e-7650-44df-834f-8f6f5743a030 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.526599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b01f29e-7650-44df-834f-8f6f5743a030 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.527317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b01f29e-7650-44df-834f-8f6f5743a030 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.528944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b01f29e-7650-44df-834f-8f6f5743a030 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.530916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b01f29e-7650-44df-834f-8f6f5743a030 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.679982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb89aef9-d33e-480e-8505-eee05e85650f tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:29.680753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bb89aef9-d33e-480e-8505-eee05e85650f tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:29.690574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb89aef9-d33e-480e-8505-eee05e85650f tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.695051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb89aef9-d33e-480e-8505-eee05e85650f tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.695948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb89aef9-d33e-480e-8505-eee05e85650f tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.698090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb89aef9-d33e-480e-8505-eee05e85650f tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.700502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb89aef9-d33e-480e-8505-eee05e85650f tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.701033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb89aef9-d33e-480e-8505-eee05e85650f tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.953678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bb89aef9-d33e-480e-8505-eee05e85650f tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:29.964193 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bb89aef9-d33e-480e-8505-eee05e85650f tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 200 len: 1276 microversion: 2.1 time: 0.288124 Aug 29 15:38:29.970600 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1672/3372] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:29 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 1276 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:29.988523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-36e438b9-a391-4b54-b4e4-1aa889dac339 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:29.989369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-36e438b9-a391-4b54-b4e4-1aa889dac339 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:30.004189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e438b9-a391-4b54-b4e4-1aa889dac339 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:30.013371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e438b9-a391-4b54-b4e4-1aa889dac339 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:30.015944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e438b9-a391-4b54-b4e4-1aa889dac339 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:30.017287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e438b9-a391-4b54-b4e4-1aa889dac339 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:30.024478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e438b9-a391-4b54-b4e4-1aa889dac339 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:30.025134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e438b9-a391-4b54-b4e4-1aa889dac339 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:30.129939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8b01f29e-7650-44df-834f-8f6f5743a030 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:30.166730 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8b01f29e-7650-44df-834f-8f6f5743a030 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1361 microversion: 2.1 time: 0.690721 Aug 29 15:38:30.170570 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1701/3373] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:29 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1361 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:30.497534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e098b277-a83f-41d6-9eef-4c4d61473d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:30.498795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e098b277-a83f-41d6-9eef-4c4d61473d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:30.510528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e098b277-a83f-41d6-9eef-4c4d61473d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:30.517648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e098b277-a83f-41d6-9eef-4c4d61473d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:30.519213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e098b277-a83f-41d6-9eef-4c4d61473d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:30.524560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e098b277-a83f-41d6-9eef-4c4d61473d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:30.525751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e098b277-a83f-41d6-9eef-4c4d61473d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:30.526686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e098b277-a83f-41d6-9eef-4c4d61473d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:31.148694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e098b277-a83f-41d6-9eef-4c4d61473d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:31.165346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e098b277-a83f-41d6-9eef-4c4d61473d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:31.166791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e098b277-a83f-41d6-9eef-4c4d61473d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:31.167971 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e098b277-a83f-41d6-9eef-4c4d61473d4f tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.678972 Aug 29 15:38:31.183156 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1702/3374] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:30 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:31.183504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36e438b9-a391-4b54-b4e4-1aa889dac339 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:31.184090 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-36e438b9-a391-4b54-b4e4-1aa889dac339 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1325 microversion: 2.1 time: 1.210572 Aug 29 15:38:31.194931 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1673/3375] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:29 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1325 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:31.208423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-79151af9-4ef0-4666-8168-dd6b3766e72f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:31.212141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-feef48a4-8134-4e75-98b9-e0ecaa5223e0 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:31.213031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-79151af9-4ef0-4666-8168-dd6b3766e72f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:31.213846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-feef48a4-8134-4e75-98b9-e0ecaa5223e0 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:31.230554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-feef48a4-8134-4e75-98b9-e0ecaa5223e0 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.233410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-feef48a4-8134-4e75-98b9-e0ecaa5223e0 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.234094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-feef48a4-8134-4e75-98b9-e0ecaa5223e0 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:31.235012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-feef48a4-8134-4e75-98b9-e0ecaa5223e0 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.235249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79151af9-4ef0-4666-8168-dd6b3766e72f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.235931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79151af9-4ef0-4666-8168-dd6b3766e72f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.236553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79151af9-4ef0-4666-8168-dd6b3766e72f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:31.237281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-feef48a4-8134-4e75-98b9-e0ecaa5223e0 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.238384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79151af9-4ef0-4666-8168-dd6b3766e72f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.239179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-feef48a4-8134-4e75-98b9-e0ecaa5223e0 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:31.241642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79151af9-4ef0-4666-8168-dd6b3766e72f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.242288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79151af9-4ef0-4666-8168-dd6b3766e72f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:31.410506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-feef48a4-8134-4e75-98b9-e0ecaa5223e0 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:31.423459 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-feef48a4-8134-4e75-98b9-e0ecaa5223e0 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 200 len: 1282 microversion: 2.1 time: 0.218272 Aug 29 15:38:31.425412 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1674/3376] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:31 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 1282 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:31.435807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8934a693-9304-45f0-829c-86d4d26be86b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:31.437805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8934a693-9304-45f0-829c-86d4d26be86b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:31.454269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8934a693-9304-45f0-829c-86d4d26be86b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.457201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8934a693-9304-45f0-829c-86d4d26be86b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.458032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8934a693-9304-45f0-829c-86d4d26be86b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:31.458933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8934a693-9304-45f0-829c-86d4d26be86b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.462392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8934a693-9304-45f0-829c-86d4d26be86b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.463220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8934a693-9304-45f0-829c-86d4d26be86b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:31.667713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8934a693-9304-45f0-829c-86d4d26be86b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:31.677056 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8934a693-9304-45f0-829c-86d4d26be86b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1361 microversion: 2.1 time: 0.245900 Aug 29 15:38:31.678783 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1675/3377] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:31 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:31.950468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-79151af9-4ef0-4666-8168-dd6b3766e72f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:31.965823 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-79151af9-4ef0-4666-8168-dd6b3766e72f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1682 microversion: 2.1 time: 0.796070 Aug 29 15:38:31.966683 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1703/3378] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:31 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1682 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:32.190992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-30ff19a9-6c99-4152-9330-ab453df57e5c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:32.191602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-30ff19a9-6c99-4152-9330-ab453df57e5c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:32.200250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30ff19a9-6c99-4152-9330-ab453df57e5c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.200869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30ff19a9-6c99-4152-9330-ab453df57e5c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.201393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30ff19a9-6c99-4152-9330-ab453df57e5c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.202220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30ff19a9-6c99-4152-9330-ab453df57e5c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.203320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30ff19a9-6c99-4152-9330-ab453df57e5c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.203814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30ff19a9-6c99-4152-9330-ab453df57e5c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.211893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98f8b2f9-dbe1-41b4-8451-72e56fb2ce92 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:32.212533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-98f8b2f9-dbe1-41b4-8451-72e56fb2ce92 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:32.227614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98f8b2f9-dbe1-41b4-8451-72e56fb2ce92 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.231666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98f8b2f9-dbe1-41b4-8451-72e56fb2ce92 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.233922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98f8b2f9-dbe1-41b4-8451-72e56fb2ce92 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.234759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98f8b2f9-dbe1-41b4-8451-72e56fb2ce92 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.237376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98f8b2f9-dbe1-41b4-8451-72e56fb2ce92 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.240977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98f8b2f9-dbe1-41b4-8451-72e56fb2ce92 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.748406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-30ff19a9-6c99-4152-9330-ab453df57e5c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:32.765674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-30ff19a9-6c99-4152-9330-ab453df57e5c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:32.767645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-30ff19a9-6c99-4152-9330-ab453df57e5c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:32.768891 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-30ff19a9-6c99-4152-9330-ab453df57e5c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.581920 Aug 29 15:38:32.769510 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1676/3379] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:32 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:32.783887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-22412378-e1c0-4876-998c-0104f011e14e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:32.784892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-22412378-e1c0-4876-998c-0104f011e14e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:32.806959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22412378-e1c0-4876-998c-0104f011e14e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.807473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22412378-e1c0-4876-998c-0104f011e14e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.818897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22412378-e1c0-4876-998c-0104f011e14e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.818897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22412378-e1c0-4876-998c-0104f011e14e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.818897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22412378-e1c0-4876-998c-0104f011e14e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.818897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22412378-e1c0-4876-998c-0104f011e14e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.844783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-98f8b2f9-dbe1-41b4-8451-72e56fb2ce92 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:32.860058 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-98f8b2f9-dbe1-41b4-8451-72e56fb2ce92 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1325 microversion: 2.1 time: 0.653035 Aug 29 15:38:32.864941 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1704/3380] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:32 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1325 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:32.871735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fcb2ca32-3555-44ee-9bc0-d32db74a97a2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:32.882574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fcb2ca32-3555-44ee-9bc0-d32db74a97a2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:32.906981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcb2ca32-3555-44ee-9bc0-d32db74a97a2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.914053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcb2ca32-3555-44ee-9bc0-d32db74a97a2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.915281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcb2ca32-3555-44ee-9bc0-d32db74a97a2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.916275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcb2ca32-3555-44ee-9bc0-d32db74a97a2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.919080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcb2ca32-3555-44ee-9bc0-d32db74a97a2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.919937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcb2ca32-3555-44ee-9bc0-d32db74a97a2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.971216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-22412378-e1c0-4876-998c-0104f011e14e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:32.981053 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-22412378-e1c0-4876-998c-0104f011e14e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 200 len: 1282 microversion: 2.1 time: 0.201079 Aug 29 15:38:32.981666 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1677/3381] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:32 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 1282 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:33.027805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c72bad9b-0612-434f-948c-ef1fd39e380e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:33.028442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c72bad9b-0612-434f-948c-ef1fd39e380e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:33.045355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c72bad9b-0612-434f-948c-ef1fd39e380e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.046202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c72bad9b-0612-434f-948c-ef1fd39e380e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.046670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c72bad9b-0612-434f-948c-ef1fd39e380e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.047395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c72bad9b-0612-434f-948c-ef1fd39e380e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.047883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c72bad9b-0612-434f-948c-ef1fd39e380e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.048316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c72bad9b-0612-434f-948c-ef1fd39e380e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.398516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c72bad9b-0612-434f-948c-ef1fd39e380e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:33.412492 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c72bad9b-0612-434f-948c-ef1fd39e380e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1682 microversion: 2.1 time: 0.419436 Aug 29 15:38:33.414323 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1678/3382] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:32 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1682 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:33.441911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-3179e9a1-6831-47e2-a4b4-3064d1b1b2b8 req-90c2712e-9940-4114-8580-4f51e175d943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c7ad8e-1ed9-4347-bb61-13e861e30886", "name": "network-vif-plugged", "status": "completed", "tag": "3b0b56b0-e15e-416f-9d4e-484bdf83401b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:33.477972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3179e9a1-6831-47e2-a4b4-3064d1b1b2b8 req-90c2712e-9940-4114-8580-4f51e175d943 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.478477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3179e9a1-6831-47e2-a4b4-3064d1b1b2b8 req-90c2712e-9940-4114-8580-4f51e175d943 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.481298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3179e9a1-6831-47e2-a4b4-3064d1b1b2b8 req-90c2712e-9940-4114-8580-4f51e175d943 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.499937 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-3179e9a1-6831-47e2-a4b4-3064d1b1b2b8 req-90c2712e-9940-4114-8580-4f51e175d943 service nova] Creating event network-vif-plugged:3b0b56b0-e15e-416f-9d4e-484bdf83401b for instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 on n-h1-839401-11 Aug 29 15:38:33.508338 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-3179e9a1-6831-47e2-a4b4-3064d1b1b2b8 req-90c2712e-9940-4114-8580-4f51e175d943 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079476 Aug 29 15:38:33.510109 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1679/3383] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:33.563854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fcb2ca32-3555-44ee-9bc0-d32db74a97a2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:33.573031 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fcb2ca32-3555-44ee-9bc0-d32db74a97a2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1361 microversion: 2.1 time: 0.706583 Aug 29 15:38:33.578026 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1705/3384] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:32 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1361 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:33.807298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7a501f49-1450-49d7-a215-87f4b7204c0d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:33.808238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7a501f49-1450-49d7-a215-87f4b7204c0d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:33.860109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a501f49-1450-49d7-a215-87f4b7204c0d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.862894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a501f49-1450-49d7-a215-87f4b7204c0d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.866338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a501f49-1450-49d7-a215-87f4b7204c0d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.870621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a501f49-1450-49d7-a215-87f4b7204c0d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.871171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a501f49-1450-49d7-a215-87f4b7204c0d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.876837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a501f49-1450-49d7-a215-87f4b7204c0d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.881476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-466977c1-1f8d-4faf-ad06-c832fa544aab tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:33.882336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-466977c1-1f8d-4faf-ad06-c832fa544aab tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:33.892459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-466977c1-1f8d-4faf-ad06-c832fa544aab tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.896543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-466977c1-1f8d-4faf-ad06-c832fa544aab tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.897393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-466977c1-1f8d-4faf-ad06-c832fa544aab tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.899564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-466977c1-1f8d-4faf-ad06-c832fa544aab tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.900204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-466977c1-1f8d-4faf-ad06-c832fa544aab tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.901898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-466977c1-1f8d-4faf-ad06-c832fa544aab tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.974433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:34.267143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-466977c1-1f8d-4faf-ad06-c832fa544aab tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:34.280166 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-466977c1-1f8d-4faf-ad06-c832fa544aab tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1523 microversion: 2.1 time: 0.403548 Aug 29 15:38:34.282304 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1706/3385] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:33 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1523 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:34.290350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7df3d915-1ff4-46db-a7f0-93aa75a6a9cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.292143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7df3d915-1ff4-46db-a7f0-93aa75a6a9cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:34.301632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df3d915-1ff4-46db-a7f0-93aa75a6a9cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.302449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df3d915-1ff4-46db-a7f0-93aa75a6a9cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.303092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df3d915-1ff4-46db-a7f0-93aa75a6a9cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.304385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df3d915-1ff4-46db-a7f0-93aa75a6a9cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.305535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df3d915-1ff4-46db-a7f0-93aa75a6a9cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.306825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df3d915-1ff4-46db-a7f0-93aa75a6a9cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.315080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7a501f49-1450-49d7-a215-87f4b7204c0d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:34.327470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7a501f49-1450-49d7-a215-87f4b7204c0d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:34.328946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7a501f49-1450-49d7-a215-87f4b7204c0d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:34.332264 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7a501f49-1450-49d7-a215-87f4b7204c0d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.539548 Aug 29 15:38:34.337268 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1680/3386] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:33 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:34.347784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3ce2cb1d-a8be-4c66-9f96-a6824c246292 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.348567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3ce2cb1d-a8be-4c66-9f96-a6824c246292 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:34.360004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ce2cb1d-a8be-4c66-9f96-a6824c246292 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.360520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ce2cb1d-a8be-4c66-9f96-a6824c246292 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.360970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ce2cb1d-a8be-4c66-9f96-a6824c246292 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.361723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ce2cb1d-a8be-4c66-9f96-a6824c246292 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.362187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ce2cb1d-a8be-4c66-9f96-a6824c246292 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.362618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ce2cb1d-a8be-4c66-9f96-a6824c246292 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.407716 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-3ce2cb1d-a8be-4c66-9f96-a6824c246292 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] HTTP exception thrown: Instance is not a member of specified network Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3ce2cb1d-a8be-4c66-9f96-a6824c246292 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Request method failure captured: Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823/ips/invalid HTTP/1.1 Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN1bIdyVBlJbly4XDUdeSwldJczYtmiLyMqZPK1qt7TLK-hTUNXLYK4Dp3OE4plxg9zTCmLYJktGZZH1s3aIjXI2i6_qfUrtG8CPgiE7w93hdfO5M7fZNAJrFD1HEPQEiSQncgPbYrYiWS_97so5U2qzu_X0jSnGOJLrrVagkh41Vzw Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bc2c415a57ee498a840c87b29596a2fc Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-660551768 Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc2c415a57ee498a840c87b29596a2fc", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc2c415a57ee498a840c87b29596a2fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc2c415a57ee498a840c87b29596a2fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc2c415a57ee498a840c87b29596a2fc"}]}] Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-660551768 Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bc2c415a57ee498a840c87b29596a2fc Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-660551768 Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerAddressesNegativeTestJSON-660551768-project Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 99403a086f4241d89465f26c45a07dd8 Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-660551768-project Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance is not a member of specified network Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'server_id': 'e8cedb09-55ea-4009-a00a-3a6259ec9823', 'id': 'invalid'} Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 29 15:38:34.418687 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.424091 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3ce2cb1d-a8be-4c66-9f96-a6824c246292 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:34.428606 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3ce2cb1d-a8be-4c66-9f96-a6824c246292 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.088234 Aug 29 15:38:34.437224 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1681/3387] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:38:34 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823/ips/invalid => generated 91 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:38:34.447986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-38b82232-e6c4-4c11-b8c2-215b78c4d18d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.449338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-38b82232-e6c4-4c11-b8c2-215b78c4d18d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:34.460594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38b82232-e6c4-4c11-b8c2-215b78c4d18d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.461597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38b82232-e6c4-4c11-b8c2-215b78c4d18d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.462437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38b82232-e6c4-4c11-b8c2-215b78c4d18d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.464189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38b82232-e6c4-4c11-b8c2-215b78c4d18d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.465000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38b82232-e6c4-4c11-b8c2-215b78c4d18d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.467918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38b82232-e6c4-4c11-b8c2-215b78c4d18d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.646452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7df3d915-1ff4-46db-a7f0-93aa75a6a9cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:34.658186 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7df3d915-1ff4-46db-a7f0-93aa75a6a9cb tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 200 len: 1324 microversion: 2.1 time: 0.374306 Aug 29 15:38:34.675548 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1707/3388] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:34 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 1324 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:34.688889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-22b2642d-887e-4c7f-9ead-76c3a66cbd1f tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.689722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-22b2642d-887e-4c7f-9ead-76c3a66cbd1f tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Failed to fetch instance by id 999 {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:38:34.690421 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-22b2642d-887e-4c7f-9ead-76c3a66cbd1f tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] HTTP exception thrown: Instance 999 could not be found. Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-22b2642d-887e-4c7f-9ead-76c3a66cbd1f tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Request method failure captured: Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN1bIdyVBlJbly4XDUdeSwldJczYtmiLyMqZPK1qt7TLK-hTUNXLYK4Dp3OE4plxg9zTCmLYJktGZZH1s3aIjXI2i6_qfUrtG8CPgiE7w93hdfO5M7fZNAJrFD1HEPQEiSQncgPbYrYiWS_97so5U2qzu_X0jSnGOJLrrVagkh41Vzw Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bc2c415a57ee498a840c87b29596a2fc Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-660551768 Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc2c415a57ee498a840c87b29596a2fc", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc2c415a57ee498a840c87b29596a2fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc2c415a57ee498a840c87b29596a2fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc2c415a57ee498a840c87b29596a2fc"}]}] Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-660551768 Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bc2c415a57ee498a840c87b29596a2fc Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-660551768 Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerAddressesNegativeTestJSON-660551768-project Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 99403a086f4241d89465f26c45a07dd8 Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-660551768-project Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 999 could not be found. Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'server_id': '999'} Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 29 15:38:34.695844 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.705136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-22b2642d-887e-4c7f-9ead-76c3a66cbd1f tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:34.707641 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-22b2642d-887e-4c7f-9ead-76c3a66cbd1f tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.029524 Aug 29 15:38:34.709761 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1708/3389] 10.222.0.62 () {58 vars in 1149 bytes} [Mon Aug 29 15:38:34 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:38:34.724739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7777210b-7358-4bf6-9bdb-6b32659c15b3 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.728515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7777210b-7358-4bf6-9bdb-6b32659c15b3 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:34.735144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-38b82232-e6c4-4c11-b8c2-215b78c4d18d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:34.744476 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-38b82232-e6c4-4c11-b8c2-215b78c4d18d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1682 microversion: 2.1 time: 0.300511 Aug 29 15:38:34.749394 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1682/3390] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:34 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1682 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:34.756256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-390f1237-f0bf-4fef-9071-ba00bb1b6590 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.760134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7777210b-7358-4bf6-9bdb-6b32659c15b3 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.763054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7777210b-7358-4bf6-9bdb-6b32659c15b3 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.764426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-390f1237-f0bf-4fef-9071-ba00bb1b6590 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:34.773638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-390f1237-f0bf-4fef-9071-ba00bb1b6590 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.773803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7777210b-7358-4bf6-9bdb-6b32659c15b3 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.778895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-390f1237-f0bf-4fef-9071-ba00bb1b6590 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.779600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-390f1237-f0bf-4fef-9071-ba00bb1b6590 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.779827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7777210b-7358-4bf6-9bdb-6b32659c15b3 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.780921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-390f1237-f0bf-4fef-9071-ba00bb1b6590 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.782609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7777210b-7358-4bf6-9bdb-6b32659c15b3 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.783257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-390f1237-f0bf-4fef-9071-ba00bb1b6590 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.784008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-390f1237-f0bf-4fef-9071-ba00bb1b6590 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.784190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7777210b-7358-4bf6-9bdb-6b32659c15b3 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.844458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-390f1237-f0bf-4fef-9071-ba00bb1b6590 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:38:35.050341 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-390f1237-f0bf-4fef-9071-ba00bb1b6590 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 204 len: 0 microversion: 2.1 time: 0.297566 Aug 29 15:38:35.054342 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1683/3391] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:34 2022] DELETE /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:38:35.061411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-37f7b876-1acb-4213-95c1-24faef660770 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:35.062444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-37f7b876-1acb-4213-95c1-24faef660770 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:35.074571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37f7b876-1acb-4213-95c1-24faef660770 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.075576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37f7b876-1acb-4213-95c1-24faef660770 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.076125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37f7b876-1acb-4213-95c1-24faef660770 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.076993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37f7b876-1acb-4213-95c1-24faef660770 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.077690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37f7b876-1acb-4213-95c1-24faef660770 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.078285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37f7b876-1acb-4213-95c1-24faef660770 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.195213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7777210b-7358-4bf6-9bdb-6b32659c15b3 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:35.203996 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7777210b-7358-4bf6-9bdb-6b32659c15b3 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1361 microversion: 2.1 time: 0.492790 Aug 29 15:38:35.206911 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1709/3392] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:34 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1361 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:35.343983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-37f7b876-1acb-4213-95c1-24faef660770 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:35.355030 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-37f7b876-1acb-4213-95c1-24faef660770 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1529 microversion: 2.1 time: 0.298735 Aug 29 15:38:35.356646 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1684/3393] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:35 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1529 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:35.361858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c5bf1d24-d6ae-44a2-a441-7d79d7592a69 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:35.362471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c5bf1d24-d6ae-44a2-a441-7d79d7592a69 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:35.377862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5bf1d24-d6ae-44a2-a441-7d79d7592a69 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.379286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5bf1d24-d6ae-44a2-a441-7d79d7592a69 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.384005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5bf1d24-d6ae-44a2-a441-7d79d7592a69 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.385037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5bf1d24-d6ae-44a2-a441-7d79d7592a69 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.386867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5bf1d24-d6ae-44a2-a441-7d79d7592a69 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.387709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5bf1d24-d6ae-44a2-a441-7d79d7592a69 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.501619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-86bbd0fd-0e55-4114-ad30-02d958b836c6 req-f73365f9-1ca3-467a-9116-859c6c094539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aa34ee1-2f81-4ed2-959c-d61ffa85eec6", "tag": "d1c585ce-bc3b-4b90-b813-d41764060d3c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:35.525166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-86bbd0fd-0e55-4114-ad30-02d958b836c6 req-f73365f9-1ca3-467a-9116-859c6c094539 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.525654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-86bbd0fd-0e55-4114-ad30-02d958b836c6 req-f73365f9-1ca3-467a-9116-859c6c094539 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.526086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-86bbd0fd-0e55-4114-ad30-02d958b836c6 req-f73365f9-1ca3-467a-9116-859c6c094539 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.546474 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-86bbd0fd-0e55-4114-ad30-02d958b836c6 req-f73365f9-1ca3-467a-9116-859c6c094539 service nova] Creating event network-changed:d1c585ce-bc3b-4b90-b813-d41764060d3c for instance 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 on n-h1-839401-11 Aug 29 15:38:35.552795 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-86bbd0fd-0e55-4114-ad30-02d958b836c6 req-f73365f9-1ca3-467a-9116-859c6c094539 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056049 Aug 29 15:38:35.554442 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1685/3394] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:35.682677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-20176312-be4d-4773-96b9-243431e82273 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:35.683435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-20176312-be4d-4773-96b9-243431e82273 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:35.695729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20176312-be4d-4773-96b9-243431e82273 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.696242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20176312-be4d-4773-96b9-243431e82273 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.696681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20176312-be4d-4773-96b9-243431e82273 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.697430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20176312-be4d-4773-96b9-243431e82273 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.697887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20176312-be4d-4773-96b9-243431e82273 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.705718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20176312-be4d-4773-96b9-243431e82273 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.890806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c5bf1d24-d6ae-44a2-a441-7d79d7592a69 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:35.906913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c5bf1d24-d6ae-44a2-a441-7d79d7592a69 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:35.908501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c5bf1d24-d6ae-44a2-a441-7d79d7592a69 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:35.914358 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c5bf1d24-d6ae-44a2-a441-7d79d7592a69 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.557956 Aug 29 15:38:35.919106 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1710/3395] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:35 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:35.932218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d1423d5d-f187-4d42-94eb-f439e2fad3a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:35.933297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d1423d5d-f187-4d42-94eb-f439e2fad3a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:35.934572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-20176312-be4d-4773-96b9-243431e82273 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:35.944741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1423d5d-f187-4d42-94eb-f439e2fad3a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.949355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1423d5d-f187-4d42-94eb-f439e2fad3a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.949986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1423d5d-f187-4d42-94eb-f439e2fad3a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.951453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1423d5d-f187-4d42-94eb-f439e2fad3a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.952142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1423d5d-f187-4d42-94eb-f439e2fad3a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.952788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1423d5d-f187-4d42-94eb-f439e2fad3a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.953289 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-20176312-be4d-4773-96b9-243431e82273 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 200 len: 1324 microversion: 2.1 time: 0.275224 Aug 29 15:38:35.956247 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1686/3396] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:35 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 1324 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:36.228928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-89649f31-048c-4a09-84fa-57e81939916e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:36.230068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-89649f31-048c-4a09-84fa-57e81939916e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:36.240329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89649f31-048c-4a09-84fa-57e81939916e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.241643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89649f31-048c-4a09-84fa-57e81939916e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.242788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89649f31-048c-4a09-84fa-57e81939916e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.244493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89649f31-048c-4a09-84fa-57e81939916e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.245172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89649f31-048c-4a09-84fa-57e81939916e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.246406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89649f31-048c-4a09-84fa-57e81939916e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.309724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d1423d5d-f187-4d42-94eb-f439e2fad3a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:36.319496 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d1423d5d-f187-4d42-94eb-f439e2fad3a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1682 microversion: 2.1 time: 0.398029 Aug 29 15:38:36.320727 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1711/3397] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:35 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1682 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:36.382406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d89b8c8e-e3a5-4c00-9286-b00e8c807e41 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:36.383469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d89b8c8e-e3a5-4c00-9286-b00e8c807e41 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:36.393357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d89b8c8e-e3a5-4c00-9286-b00e8c807e41 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.394205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d89b8c8e-e3a5-4c00-9286-b00e8c807e41 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.395221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d89b8c8e-e3a5-4c00-9286-b00e8c807e41 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.397139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d89b8c8e-e3a5-4c00-9286-b00e8c807e41 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.397833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d89b8c8e-e3a5-4c00-9286-b00e8c807e41 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.399002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d89b8c8e-e3a5-4c00-9286-b00e8c807e41 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.521861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-89649f31-048c-4a09-84fa-57e81939916e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:36.563612 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-89649f31-048c-4a09-84fa-57e81939916e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1547 microversion: 2.1 time: 0.335486 Aug 29 15:38:36.577210 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1687/3398] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:36 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1547 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:36.593898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c35934e1-7d72-4f49-aae0-a1b239cf69fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:36.594992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c35934e1-7d72-4f49-aae0-a1b239cf69fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:36.602946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=17 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:36.604562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c35934e1-7d72-4f49-aae0-a1b239cf69fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.605864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c35934e1-7d72-4f49-aae0-a1b239cf69fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.607242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c35934e1-7d72-4f49-aae0-a1b239cf69fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.608645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c35934e1-7d72-4f49-aae0-a1b239cf69fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.610579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c35934e1-7d72-4f49-aae0-a1b239cf69fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.611328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c35934e1-7d72-4f49-aae0-a1b239cf69fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.635336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=10 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:36.679307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d89b8c8e-e3a5-4c00-9286-b00e8c807e41 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:36.688610 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d89b8c8e-e3a5-4c00-9286-b00e8c807e41 tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1529 microversion: 2.1 time: 0.311368 Aug 29 15:38:36.692872 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1712/3399] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:36 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1529 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:36.725994 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c35934e1-7d72-4f49-aae0-a1b239cf69fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138243 Aug 29 15:38:36.726863 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1688/3400] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:38:36 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:36.943115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1969727974", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:36.943644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-36d8af58-4627-4c35-9a5f-70bb937ed5cc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:36.944110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-36d8af58-4627-4c35-9a5f-70bb937ed5cc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:36.953982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36d8af58-4627-4c35-9a5f-70bb937ed5cc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.954466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36d8af58-4627-4c35-9a5f-70bb937ed5cc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.959138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36d8af58-4627-4c35-9a5f-70bb937ed5cc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.960017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36d8af58-4627-4c35-9a5f-70bb937ed5cc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.960497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36d8af58-4627-4c35-9a5f-70bb937ed5cc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.960932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36d8af58-4627-4c35-9a5f-70bb937ed5cc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:37.019234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] validate_networks() for None {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:37.418784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36d8af58-4627-4c35-9a5f-70bb937ed5cc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:37.430501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36d8af58-4627-4c35-9a5f-70bb937ed5cc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:37.438611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36d8af58-4627-4c35-9a5f-70bb937ed5cc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:37.443588 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-36d8af58-4627-4c35-9a5f-70bb937ed5cc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.504602 Aug 29 15:38:37.444639 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1689/3401] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:36 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:37.456517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0729139c-7334-41f5-82a9-796593d6550c tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:37.467337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0729139c-7334-41f5-82a9-796593d6550c tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:37.475072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0729139c-7334-41f5-82a9-796593d6550c tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:37.477731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0729139c-7334-41f5-82a9-796593d6550c tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:37.478530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0729139c-7334-41f5-82a9-796593d6550c tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:37.480314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0729139c-7334-41f5-82a9-796593d6550c tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:37.486499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0729139c-7334-41f5-82a9-796593d6550c tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:37.487139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0729139c-7334-41f5-82a9-796593d6550c tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:37.978561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:38:37.980310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:38:37.980998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:38:37.981615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:38:37.982238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:38:38.003517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.006934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.007690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:38.008692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.009360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.009946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:38.041860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:UPDATE=5,nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:38.058184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Getting quotas for project f7b1f33fac61405285832b32e2a5c0b4. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:38.072406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Getting quotas for user 0fefa09e4bbb4101b5f05a2f20fcb41c and project f7b1f33fac61405285832b32e2a5c0b4. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:38.108569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:38:38.111230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:38:38.260569 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4cba8c5b-8003-48a8-9418-620a2dd00562 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.538702 Aug 29 15:38:38.280719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=9 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:38.308299 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1713/3402] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:38:38.325766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1dba63fd-22ee-4744-ab55-9b6bfb41051d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:38.326553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1dba63fd-22ee-4744-ab55-9b6bfb41051d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:38.360380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1dba63fd-22ee-4744-ab55-9b6bfb41051d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.378539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1dba63fd-22ee-4744-ab55-9b6bfb41051d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.379228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1dba63fd-22ee-4744-ab55-9b6bfb41051d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:38.380161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1dba63fd-22ee-4744-ab55-9b6bfb41051d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.391667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1dba63fd-22ee-4744-ab55-9b6bfb41051d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.392533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1dba63fd-22ee-4744-ab55-9b6bfb41051d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:38.516571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=28 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:38.883130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1dba63fd-22ee-4744-ab55-9b6bfb41051d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:38.912410 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1dba63fd-22ee-4744-ab55-9b6bfb41051d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1682 microversion: 2.1 time: 0.602484 Aug 29 15:38:38.913002 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1714/3403] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:38 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1682 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:38.916409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0729139c-7334-41f5-82a9-796593d6550c tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:38.927998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-088f11a8-9b17-4744-b225-e343d8a261bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:38.928274 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0729139c-7334-41f5-82a9-796593d6550c tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 200 len: 1324 microversion: 2.1 time: 1.482307 Aug 29 15:38:38.928600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-088f11a8-9b17-4744-b225-e343d8a261bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:38.951626 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1690/3404] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:37 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 1324 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:38.957878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-088f11a8-9b17-4744-b225-e343d8a261bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.958371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-088f11a8-9b17-4744-b225-e343d8a261bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.959000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-088f11a8-9b17-4744-b225-e343d8a261bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:38.959865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-088f11a8-9b17-4744-b225-e343d8a261bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.962398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-448321304", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:38.963715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-088f11a8-9b17-4744-b225-e343d8a261bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.964165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-088f11a8-9b17-4744-b225-e343d8a261bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.026017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:39.093632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:39.215684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-088f11a8-9b17-4744-b225-e343d8a261bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:39.237558 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-088f11a8-9b17-4744-b225-e343d8a261bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1487 microversion: 2.1 time: 0.318571 Aug 29 15:38:39.238291 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1715/3405] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:38 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1487 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:39.249979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6e9aff3b-8e0a-4ab6-bd9b-c667979c7b56 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:39.253346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6e9aff3b-8e0a-4ab6-bd9b-c667979c7b56 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:39.266738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9aff3b-8e0a-4ab6-bd9b-c667979c7b56 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:39.274154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9aff3b-8e0a-4ab6-bd9b-c667979c7b56 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:39.275081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9aff3b-8e0a-4ab6-bd9b-c667979c7b56 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.276136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9aff3b-8e0a-4ab6-bd9b-c667979c7b56 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:39.276646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9aff3b-8e0a-4ab6-bd9b-c667979c7b56 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:39.277050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9aff3b-8e0a-4ab6-bd9b-c667979c7b56 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.973267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6e9aff3b-8e0a-4ab6-bd9b-c667979c7b56 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:39.985944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:38:39.987052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:38:39.987889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:38:39.988519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:38:39.989251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:38:40.003774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.004270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.004718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.005495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.005984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.006381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.006927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6e9aff3b-8e0a-4ab6-bd9b-c667979c7b56 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:40.014563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6e9aff3b-8e0a-4ab6-bd9b-c667979c7b56 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:40.030202 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6e9aff3b-8e0a-4ab6-bd9b-c667979c7b56 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.784557 Aug 29 15:38:40.031038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Getting quotas for project f7b1f33fac61405285832b32e2a5c0b4. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:40.031792 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1716/3406] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:39 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:40.053870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-ac1a70e9-1ad7-43b3-87c7-d3b9f4f9cbfe req-cf72a529-0b87-4d47-b471-f3cf2d1cc3bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cedb09-55ea-4009-a00a-3a6259ec9823", "name": "network-vif-deleted", "tag": "d1dd5457-8497-4bac-9872-8efc80032791"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:40.056100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Getting quotas for user 0fefa09e4bbb4101b5f05a2f20fcb41c and project f7b1f33fac61405285832b32e2a5c0b4. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:40.072008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:38:40.074873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:38:40.078677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ac1a70e9-1ad7-43b3-87c7-d3b9f4f9cbfe req-cf72a529-0b87-4d47-b471-f3cf2d1cc3bb service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.079162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ac1a70e9-1ad7-43b3-87c7-d3b9f4f9cbfe req-cf72a529-0b87-4d47-b471-f3cf2d1cc3bb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.079594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ac1a70e9-1ad7-43b3-87c7-d3b9f4f9cbfe req-cf72a529-0b87-4d47-b471-f3cf2d1cc3bb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.129741 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-ac1a70e9-1ad7-43b3-87c7-d3b9f4f9cbfe req-cf72a529-0b87-4d47-b471-f3cf2d1cc3bb service nova] Creating event network-vif-deleted:d1dd5457-8497-4bac-9872-8efc80032791 for instance e8cedb09-55ea-4009-a00a-3a6259ec9823 on n-h2-839401-11 Aug 29 15:38:40.148672 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-ac1a70e9-1ad7-43b3-87c7-d3b9f4f9cbfe req-cf72a529-0b87-4d47-b471-f3cf2d1cc3bb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113136 Aug 29 15:38:40.160453 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1717/3407] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:40.161016 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b17a3e6c-5284-4c50-bfdb-4e2e7c146f72 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.206122 Aug 29 15:38:40.167546 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1691/3408] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:38:40.185011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d8e916fc-ce26-4e05-994d-8bb259f39266 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:40.185011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d8e916fc-ce26-4e05-994d-8bb259f39266 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:40.185435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dcf41c73-a046-401a-a17b-8c7091449b71 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "445f936d-b582-4672-b907-f3f4216bd2b2"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:40.187598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dcf41c73-a046-401a-a17b-8c7091449b71 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:40.197686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8e916fc-ce26-4e05-994d-8bb259f39266 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.198632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8e916fc-ce26-4e05-994d-8bb259f39266 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.199807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8e916fc-ce26-4e05-994d-8bb259f39266 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.200707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8e916fc-ce26-4e05-994d-8bb259f39266 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.201530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8e916fc-ce26-4e05-994d-8bb259f39266 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.202139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8e916fc-ce26-4e05-994d-8bb259f39266 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.211914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcf41c73-a046-401a-a17b-8c7091449b71 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.215169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcf41c73-a046-401a-a17b-8c7091449b71 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.216973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcf41c73-a046-401a-a17b-8c7091449b71 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.219167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcf41c73-a046-401a-a17b-8c7091449b71 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.220997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcf41c73-a046-401a-a17b-8c7091449b71 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.221647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcf41c73-a046-401a-a17b-8c7091449b71 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.439441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d8e916fc-ce26-4e05-994d-8bb259f39266 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:40.451735 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d8e916fc-ce26-4e05-994d-8bb259f39266 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1682 microversion: 2.1 time: 0.280303 Aug 29 15:38:40.453246 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1692/3409] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:40 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1682 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:40.459892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-94ca1f07-c279-417c-b4d0-d9abc18a9e80 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:40.460771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-94ca1f07-c279-417c-b4d0-d9abc18a9e80 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:40.468838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94ca1f07-c279-417c-b4d0-d9abc18a9e80 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.469743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94ca1f07-c279-417c-b4d0-d9abc18a9e80 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.470384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94ca1f07-c279-417c-b4d0-d9abc18a9e80 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.471326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94ca1f07-c279-417c-b4d0-d9abc18a9e80 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.471943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94ca1f07-c279-417c-b4d0-d9abc18a9e80 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.472773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94ca1f07-c279-417c-b4d0-d9abc18a9e80 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.792945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-94ca1f07-c279-417c-b4d0-d9abc18a9e80 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:40.801859 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-94ca1f07-c279-417c-b4d0-d9abc18a9e80 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 200 len: 1324 microversion: 2.1 time: 0.346519 Aug 29 15:38:40.805801 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1693/3410] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:40 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 1324 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:40.820905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1a9c2a2e-1244-4ee9-8522-e849e439e15b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:40.822168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1a9c2a2e-1244-4ee9-8522-e849e439e15b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:40.834707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:40.961950 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dcf41c73-a046-401a-a17b-8c7091449b71 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "POST /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.794885 Aug 29 15:38:40.966460 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1718/3411] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 15:38:40 2022] POST /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments => generated 194 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:40.993222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1a9c2a2e-1244-4ee9-8522-e849e439e15b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:41.019406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9cad6bb5-7a47-4d5d-a122-a4f314ec5c9e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:41.020445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9cad6bb5-7a47-4d5d-a122-a4f314ec5c9e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:41.022299 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1a9c2a2e-1244-4ee9-8522-e849e439e15b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1213 microversion: 2.1 time: 0.192976 Aug 29 15:38:41.023523 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1694/3412] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:40 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1213 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:41.047535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cad6bb5-7a47-4d5d-a122-a4f314ec5c9e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.048028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cad6bb5-7a47-4d5d-a122-a4f314ec5c9e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.048464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cad6bb5-7a47-4d5d-a122-a4f314ec5c9e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.054551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-636eab96-12be-4da7-94eb-a66018c83296 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:41.055166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-636eab96-12be-4da7-94eb-a66018c83296 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:41.063645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cad6bb5-7a47-4d5d-a122-a4f314ec5c9e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.065543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-636eab96-12be-4da7-94eb-a66018c83296 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.066289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cad6bb5-7a47-4d5d-a122-a4f314ec5c9e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.067023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cad6bb5-7a47-4d5d-a122-a4f314ec5c9e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.077353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-636eab96-12be-4da7-94eb-a66018c83296 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.077948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-636eab96-12be-4da7-94eb-a66018c83296 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.078706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-636eab96-12be-4da7-94eb-a66018c83296 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.079199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-636eab96-12be-4da7-94eb-a66018c83296 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.079715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-636eab96-12be-4da7-94eb-a66018c83296 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.183707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cad6bb5-7a47-4d5d-a122-a4f314ec5c9e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.184167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cad6bb5-7a47-4d5d-a122-a4f314ec5c9e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.184647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cad6bb5-7a47-4d5d-a122-a4f314ec5c9e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.185126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-9cad6bb5-7a47-4d5d-a122-a4f314ec5c9e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lazy-loading 'fault' on Instance uuid e8cedb09-55ea-4009-a00a-3a6259ec9823 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:38:41.293119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9cad6bb5-7a47-4d5d-a122-a4f314ec5c9e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99403a086f4241d89465f26c45a07dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2c415a57ee498a840c87b29596a2fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:41.306857 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9cad6bb5-7a47-4d5d-a122-a4f314ec5c9e tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 200 len: 1315 microversion: 2.1 time: 0.338187 Aug 29 15:38:41.323157 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1719/3413] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:40 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:41.478001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dff79e59-ff7b-452d-9c2c-a9ed76d3cfa5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:41.478639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dff79e59-ff7b-452d-9c2c-a9ed76d3cfa5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:41.488755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dff79e59-ff7b-452d-9c2c-a9ed76d3cfa5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.489301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dff79e59-ff7b-452d-9c2c-a9ed76d3cfa5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.490026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dff79e59-ff7b-452d-9c2c-a9ed76d3cfa5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.491018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dff79e59-ff7b-452d-9c2c-a9ed76d3cfa5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.491650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dff79e59-ff7b-452d-9c2c-a9ed76d3cfa5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.492227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dff79e59-ff7b-452d-9c2c-a9ed76d3cfa5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.669827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-636eab96-12be-4da7-94eb-a66018c83296 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:41.685056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-636eab96-12be-4da7-94eb-a66018c83296 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:41.686542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-636eab96-12be-4da7-94eb-a66018c83296 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:41.687758 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-636eab96-12be-4da7-94eb-a66018c83296 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.637175 Aug 29 15:38:41.688357 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1695/3414] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:41 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:38:41.828899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dcb550ea-2011-411a-8e77-eb603cb57e7d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:41.838030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dcb550ea-2011-411a-8e77-eb603cb57e7d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:41.857877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcb550ea-2011-411a-8e77-eb603cb57e7d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.859307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcb550ea-2011-411a-8e77-eb603cb57e7d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.860002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcb550ea-2011-411a-8e77-eb603cb57e7d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.865881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcb550ea-2011-411a-8e77-eb603cb57e7d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.868308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcb550ea-2011-411a-8e77-eb603cb57e7d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.869428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcb550ea-2011-411a-8e77-eb603cb57e7d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:42.240658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dcb550ea-2011-411a-8e77-eb603cb57e7d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:42.254008 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dcb550ea-2011-411a-8e77-eb603cb57e7d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 200 len: 1324 microversion: 2.1 time: 0.429069 Aug 29 15:38:42.269111 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1696/3415] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:41 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 1324 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:42.269111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7cd3b858-7581-48b1-8136-5be36bb116cb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:42.269111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7cd3b858-7581-48b1-8136-5be36bb116cb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:42.288039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cd3b858-7581-48b1-8136-5be36bb116cb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:42.288616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cd3b858-7581-48b1-8136-5be36bb116cb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:42.299404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cd3b858-7581-48b1-8136-5be36bb116cb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:42.301318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cd3b858-7581-48b1-8136-5be36bb116cb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:42.301806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cd3b858-7581-48b1-8136-5be36bb116cb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:42.302243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cd3b858-7581-48b1-8136-5be36bb116cb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:42.461281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dff79e59-ff7b-452d-9c2c-a9ed76d3cfa5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:42.485673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7cd3b858-7581-48b1-8136-5be36bb116cb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:42.501168 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dff79e59-ff7b-452d-9c2c-a9ed76d3cfa5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1682 microversion: 2.1 time: 1.029526 Aug 29 15:38:42.502102 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1720/3416] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:41 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1682 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:42.504869 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7cd3b858-7581-48b1-8136-5be36bb116cb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1265 microversion: 2.1 time: 0.245346 Aug 29 15:38:42.511801 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1697/3417] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:42 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:42.525539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e805be15-1949-4b05-933f-82aac3647b64 req-1285c144-9b3d-4a88-acd9-0e536eb28664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c7ad8e-1ed9-4347-bb61-13e861e30886", "tag": "3b0b56b0-e15e-416f-9d4e-484bdf83401b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:42.525683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b60a8437-33ba-49f1-bbc2-ad8c8409b8bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:42.525683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b60a8437-33ba-49f1-bbc2-ad8c8409b8bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] [instance: e8cedb09-55ea-4009-a00a-3a6259ec9823] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:42.551651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b60a8437-33ba-49f1-bbc2-ad8c8409b8bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:42.552147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b60a8437-33ba-49f1-bbc2-ad8c8409b8bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:42.552581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b60a8437-33ba-49f1-bbc2-ad8c8409b8bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:42.553314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b60a8437-33ba-49f1-bbc2-ad8c8409b8bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:42.553768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b60a8437-33ba-49f1-bbc2-ad8c8409b8bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:42.554190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b60a8437-33ba-49f1-bbc2-ad8c8409b8bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:42.563150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e805be15-1949-4b05-933f-82aac3647b64 req-1285c144-9b3d-4a88-acd9-0e536eb28664 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:42.568715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e805be15-1949-4b05-933f-82aac3647b64 req-1285c144-9b3d-4a88-acd9-0e536eb28664 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:42.569936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e805be15-1949-4b05-933f-82aac3647b64 req-1285c144-9b3d-4a88-acd9-0e536eb28664 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:42.592868 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e805be15-1949-4b05-933f-82aac3647b64 req-1285c144-9b3d-4a88-acd9-0e536eb28664 service nova] Creating event network-changed:3b0b56b0-e15e-416f-9d4e-484bdf83401b for instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 on n-h1-839401-11 Aug 29 15:38:42.603094 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-b60a8437-33ba-49f1-bbc2-ad8c8409b8bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] HTTP exception thrown: Instance e8cedb09-55ea-4009-a00a-3a6259ec9823 could not be found. Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b60a8437-33ba-49f1-bbc2-ad8c8409b8bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Request method failure captured: Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 HTTP/1.1 Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN1bIdyVBlJbly4XDUdeSwldJczYtmiLyMqZPK1qt7TLK-hTUNXLYK4Dp3OE4plxg9zTCmLYJktGZZH1s3aIjXI2i6_qfUrtG8CPgiE7w93hdfO5M7fZNAJrFD1HEPQEiSQncgPbYrYiWS_97so5U2qzu_X0jSnGOJLrrVagkh41Vzw Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bc2c415a57ee498a840c87b29596a2fc Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-660551768 Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bc2c415a57ee498a840c87b29596a2fc", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bc2c415a57ee498a840c87b29596a2fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc2c415a57ee498a840c87b29596a2fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bc2c415a57ee498a840c87b29596a2fc"}]}] Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-660551768 Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bc2c415a57ee498a840c87b29596a2fc Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-660551768 Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerAddressesNegativeTestJSON-660551768-project Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 99403a086f4241d89465f26c45a07dd8 Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-660551768-project Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance e8cedb09-55ea-4009-a00a-3a6259ec9823 could not be found. Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'e8cedb09-55ea-4009-a00a-3a6259ec9823'} Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8cedb09-55ea-4009-a00a-3a6259ec9823 could not be found. Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8cedb09-55ea-4009-a00a-3a6259ec9823 could not be found. Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:42.604801 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:42.609109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:42.609109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:42.609109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:42.609109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:42.609109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:42.609109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:42.609109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8cedb09-55ea-4009-a00a-3a6259ec9823 could not be found. Aug 29 15:38:42.609109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:42.609109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b60a8437-33ba-49f1-bbc2-ad8c8409b8bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] Returning 404 to user: Instance e8cedb09-55ea-4009-a00a-3a6259ec9823 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:42.609109 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b60a8437-33ba-49f1-bbc2-ad8c8409b8bc tempest-ServerAddressesNegativeTestJSON-660551768 tempest-ServerAddressesNegativeTestJSON-660551768-project] 10.222.0.62 "GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823" status: 404 len: 111 microversion: 2.1 time: 0.092915 Aug 29 15:38:42.610429 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1698/3418] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:42 2022] GET /compute/v2.1/servers/e8cedb09-55ea-4009-a00a-3a6259ec9823 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:42.613772 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e805be15-1949-4b05-933f-82aac3647b64 req-1285c144-9b3d-4a88-acd9-0e536eb28664 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102755 Aug 29 15:38:42.620358 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1721/3419] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:42.711266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fd07b169-b844-48f6-a3e5-65e54ac8f1e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:42.711881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fd07b169-b844-48f6-a3e5-65e54ac8f1e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:42.720974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd07b169-b844-48f6-a3e5-65e54ac8f1e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:42.721574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd07b169-b844-48f6-a3e5-65e54ac8f1e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:42.721943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd07b169-b844-48f6-a3e5-65e54ac8f1e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:42.726898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd07b169-b844-48f6-a3e5-65e54ac8f1e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:42.728239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd07b169-b844-48f6-a3e5-65e54ac8f1e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:42.730783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd07b169-b844-48f6-a3e5-65e54ac8f1e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:42.738224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:43.078551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-cb04a811-19e5-464e-a286-62bb3ccbdffd req-2c5d40c7-80cb-405f-947e-531aae5d5f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa34ee1-2f81-4ed2-959c-d61ffa85eec6", "name": "network-vif-plugged", "status": "completed", "tag": "d1c585ce-bc3b-4b90-b813-d41764060d3c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:43.104395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cb04a811-19e5-464e-a286-62bb3ccbdffd req-2c5d40c7-80cb-405f-947e-531aae5d5f7a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.104891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cb04a811-19e5-464e-a286-62bb3ccbdffd req-2c5d40c7-80cb-405f-947e-531aae5d5f7a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.105600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cb04a811-19e5-464e-a286-62bb3ccbdffd req-2c5d40c7-80cb-405f-947e-531aae5d5f7a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.131066 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-cb04a811-19e5-464e-a286-62bb3ccbdffd req-2c5d40c7-80cb-405f-947e-531aae5d5f7a service nova] Creating event network-vif-plugged:d1c585ce-bc3b-4b90-b813-d41764060d3c for instance 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 on n-h1-839401-11 Aug 29 15:38:43.147307 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-cb04a811-19e5-464e-a286-62bb3ccbdffd req-2c5d40c7-80cb-405f-947e-531aae5d5f7a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072832 Aug 29 15:38:43.148295 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1722/3420] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:43.194238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fd07b169-b844-48f6-a3e5-65e54ac8f1e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:43.217127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fd07b169-b844-48f6-a3e5-65e54ac8f1e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:43.219071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fd07b169-b844-48f6-a3e5-65e54ac8f1e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:43.227429 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fd07b169-b844-48f6-a3e5-65e54ac8f1e4 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.517648 Aug 29 15:38:43.229634 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1699/3421] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:42 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:43.285489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-72fccdc8-69bd-4721-8aa2-ef2f290a0d4a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:43.286519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-72fccdc8-69bd-4721-8aa2-ef2f290a0d4a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:43.294092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72fccdc8-69bd-4721-8aa2-ef2f290a0d4a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.294906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72fccdc8-69bd-4721-8aa2-ef2f290a0d4a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.295535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72fccdc8-69bd-4721-8aa2-ef2f290a0d4a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.296492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72fccdc8-69bd-4721-8aa2-ef2f290a0d4a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.297477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72fccdc8-69bd-4721-8aa2-ef2f290a0d4a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.298114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72fccdc8-69bd-4721-8aa2-ef2f290a0d4a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.538311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-242fc743-d6a6-4521-8856-ff0fbf9b1c6a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:43.539680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-242fc743-d6a6-4521-8856-ff0fbf9b1c6a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:43.547796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-242fc743-d6a6-4521-8856-ff0fbf9b1c6a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.548379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-242fc743-d6a6-4521-8856-ff0fbf9b1c6a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.548904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-242fc743-d6a6-4521-8856-ff0fbf9b1c6a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.549889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-242fc743-d6a6-4521-8856-ff0fbf9b1c6a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.550663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-242fc743-d6a6-4521-8856-ff0fbf9b1c6a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.551304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-242fc743-d6a6-4521-8856-ff0fbf9b1c6a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.724238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-72fccdc8-69bd-4721-8aa2-ef2f290a0d4a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:43.737606 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-72fccdc8-69bd-4721-8aa2-ef2f290a0d4a tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 200 len: 1324 microversion: 2.1 time: 0.454554 Aug 29 15:38:43.738225 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1723/3422] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:43 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 1324 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:43.746253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-79c884ad-ec33-4a82-b724-1bf0dc759db1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:43.746987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-79c884ad-ec33-4a82-b724-1bf0dc759db1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:43.759273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-242fc743-d6a6-4521-8856-ff0fbf9b1c6a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:43.759522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79c884ad-ec33-4a82-b724-1bf0dc759db1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.760248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79c884ad-ec33-4a82-b724-1bf0dc759db1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.761028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79c884ad-ec33-4a82-b724-1bf0dc759db1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.762272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79c884ad-ec33-4a82-b724-1bf0dc759db1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.762927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79c884ad-ec33-4a82-b724-1bf0dc759db1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.763545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79c884ad-ec33-4a82-b724-1bf0dc759db1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.770818 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-242fc743-d6a6-4521-8856-ff0fbf9b1c6a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.236772 Aug 29 15:38:43.776161 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1700/3423] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:43 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:43.891096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-85fccc9b-d7ae-4081-8b5a-a7b5ed6deafb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:43.891710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-85fccc9b-d7ae-4081-8b5a-a7b5ed6deafb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:43.898110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85fccc9b-d7ae-4081-8b5a-a7b5ed6deafb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.898595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85fccc9b-d7ae-4081-8b5a-a7b5ed6deafb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.899254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85fccc9b-d7ae-4081-8b5a-a7b5ed6deafb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.899968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85fccc9b-d7ae-4081-8b5a-a7b5ed6deafb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.900423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85fccc9b-d7ae-4081-8b5a-a7b5ed6deafb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.900847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85fccc9b-d7ae-4081-8b5a-a7b5ed6deafb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.934072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-79c884ad-ec33-4a82-b724-1bf0dc759db1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:43.952828 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-79c884ad-ec33-4a82-b724-1bf0dc759db1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1273 microversion: 2.1 time: 0.213210 Aug 29 15:38:43.965112 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1724/3424] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:43 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1273 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:44.057258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-85fccc9b-d7ae-4081-8b5a-a7b5ed6deafb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:44.069797 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-85fccc9b-d7ae-4081-8b5a-a7b5ed6deafb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.182433 Aug 29 15:38:44.076003 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1701/3425] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:43 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:44.254664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5dd3917b-a069-49a4-95ab-cdf9eea7e59e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.255392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5dd3917b-a069-49a4-95ab-cdf9eea7e59e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:44.270364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5dd3917b-a069-49a4-95ab-cdf9eea7e59e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.271132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5dd3917b-a069-49a4-95ab-cdf9eea7e59e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.271755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5dd3917b-a069-49a4-95ab-cdf9eea7e59e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.272473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5dd3917b-a069-49a4-95ab-cdf9eea7e59e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.273694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5dd3917b-a069-49a4-95ab-cdf9eea7e59e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.274679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5dd3917b-a069-49a4-95ab-cdf9eea7e59e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.759348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9544ba1e-47ec-4e3d-9ecb-e2dcc17f2799 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.759997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9544ba1e-47ec-4e3d-9ecb-e2dcc17f2799 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:44.773130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9544ba1e-47ec-4e3d-9ecb-e2dcc17f2799 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.773592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9544ba1e-47ec-4e3d-9ecb-e2dcc17f2799 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.779293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9544ba1e-47ec-4e3d-9ecb-e2dcc17f2799 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.780921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9544ba1e-47ec-4e3d-9ecb-e2dcc17f2799 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.784382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9544ba1e-47ec-4e3d-9ecb-e2dcc17f2799 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.785060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9544ba1e-47ec-4e3d-9ecb-e2dcc17f2799 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.436866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5dd3917b-a069-49a4-95ab-cdf9eea7e59e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:45.448705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5dd3917b-a069-49a4-95ab-cdf9eea7e59e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:45.450812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5dd3917b-a069-49a4-95ab-cdf9eea7e59e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:45.452389 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5dd3917b-a069-49a4-95ab-cdf9eea7e59e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 1.201945 Aug 29 15:38:45.473072 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1725/3426] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:44 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:45.479052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-10bc3045-3f8f-4e7e-9063-6e5cc0e65ef5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:45.487378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-10bc3045-3f8f-4e7e-9063-6e5cc0e65ef5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:45.500352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10bc3045-3f8f-4e7e-9063-6e5cc0e65ef5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.501366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10bc3045-3f8f-4e7e-9063-6e5cc0e65ef5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.504547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10bc3045-3f8f-4e7e-9063-6e5cc0e65ef5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.505608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10bc3045-3f8f-4e7e-9063-6e5cc0e65ef5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.506304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10bc3045-3f8f-4e7e-9063-6e5cc0e65ef5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.507747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10bc3045-3f8f-4e7e-9063-6e5cc0e65ef5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.646056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9544ba1e-47ec-4e3d-9ecb-e2dcc17f2799 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:45.662010 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9544ba1e-47ec-4e3d-9ecb-e2dcc17f2799 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 200 len: 1324 microversion: 2.1 time: 0.907022 Aug 29 15:38:45.676150 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1702/3427] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:44 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 1324 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:45.681762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-675995f2-a90b-4236-9e9e-c3ce814ed02b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:45.686777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-675995f2-a90b-4236-9e9e-c3ce814ed02b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:45.698308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-675995f2-a90b-4236-9e9e-c3ce814ed02b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.700934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-675995f2-a90b-4236-9e9e-c3ce814ed02b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.706202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-675995f2-a90b-4236-9e9e-c3ce814ed02b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.707348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-675995f2-a90b-4236-9e9e-c3ce814ed02b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.707988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-675995f2-a90b-4236-9e9e-c3ce814ed02b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.708596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-675995f2-a90b-4236-9e9e-c3ce814ed02b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.937689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-10bc3045-3f8f-4e7e-9063-6e5cc0e65ef5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:45.950445 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-10bc3045-3f8f-4e7e-9063-6e5cc0e65ef5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1271 microversion: 2.1 time: 0.475702 Aug 29 15:38:45.951435 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1726/3428] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:45 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1271 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:46.215333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-675995f2-a90b-4236-9e9e-c3ce814ed02b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:46.227976 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-675995f2-a90b-4236-9e9e-c3ce814ed02b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.550351 Aug 29 15:38:46.228590 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1703/3429] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:45 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:46.252777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4f8fe070-6ef6-455c-a7f3-aa1c2fbada10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:46.253611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4f8fe070-6ef6-455c-a7f3-aa1c2fbada10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:46.263358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f8fe070-6ef6-455c-a7f3-aa1c2fbada10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.267144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f8fe070-6ef6-455c-a7f3-aa1c2fbada10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.267682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f8fe070-6ef6-455c-a7f3-aa1c2fbada10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.270891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f8fe070-6ef6-455c-a7f3-aa1c2fbada10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.271461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f8fe070-6ef6-455c-a7f3-aa1c2fbada10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.271953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f8fe070-6ef6-455c-a7f3-aa1c2fbada10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.484041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5fbe7468-9794-4cb0-9677-3e282a35d5c3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:46.485031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5fbe7468-9794-4cb0-9677-3e282a35d5c3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:46.500956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fbe7468-9794-4cb0-9677-3e282a35d5c3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.502588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fbe7468-9794-4cb0-9677-3e282a35d5c3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.503315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fbe7468-9794-4cb0-9677-3e282a35d5c3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.505252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fbe7468-9794-4cb0-9677-3e282a35d5c3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.507980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fbe7468-9794-4cb0-9677-3e282a35d5c3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.509600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5fbe7468-9794-4cb0-9677-3e282a35d5c3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.676465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4f8fe070-6ef6-455c-a7f3-aa1c2fbada10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:46.688631 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4f8fe070-6ef6-455c-a7f3-aa1c2fbada10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.439480 Aug 29 15:38:46.689511 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1727/3430] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:46 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:46.714743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-10391c5d-ef43-404f-b1db-3b220a6dd774 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:46.715990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-10391c5d-ef43-404f-b1db-3b220a6dd774 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:46.724804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10391c5d-ef43-404f-b1db-3b220a6dd774 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.725712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10391c5d-ef43-404f-b1db-3b220a6dd774 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.726877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10391c5d-ef43-404f-b1db-3b220a6dd774 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.728348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10391c5d-ef43-404f-b1db-3b220a6dd774 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.728967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10391c5d-ef43-404f-b1db-3b220a6dd774 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.729586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10391c5d-ef43-404f-b1db-3b220a6dd774 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.949678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5fbe7468-9794-4cb0-9677-3e282a35d5c3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:46.970175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5fbe7468-9794-4cb0-9677-3e282a35d5c3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:46.971841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5fbe7468-9794-4cb0-9677-3e282a35d5c3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:46.973541 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5fbe7468-9794-4cb0-9677-3e282a35d5c3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.496097 Aug 29 15:38:46.987204 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1704/3431] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:46 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:47.003405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0f75f0ca-967f-4e9c-a07b-fe67b4cf5ab5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:47.004146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0f75f0ca-967f-4e9c-a07b-fe67b4cf5ab5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:47.031733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f75f0ca-967f-4e9c-a07b-fe67b4cf5ab5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:47.035181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f75f0ca-967f-4e9c-a07b-fe67b4cf5ab5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:47.035872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f75f0ca-967f-4e9c-a07b-fe67b4cf5ab5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:47.039080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f75f0ca-967f-4e9c-a07b-fe67b4cf5ab5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:47.042213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f75f0ca-967f-4e9c-a07b-fe67b4cf5ab5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:47.046952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f75f0ca-967f-4e9c-a07b-fe67b4cf5ab5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:47.220444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-10391c5d-ef43-404f-b1db-3b220a6dd774 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:47.232306 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-10391c5d-ef43-404f-b1db-3b220a6dd774 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 200 len: 1522 microversion: 2.1 time: 0.522913 Aug 29 15:38:47.233278 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1728/3432] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:46 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:47.239073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ab8556d0-bcd3-4d3f-bad6-63556db2a4d7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:47.240183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ab8556d0-bcd3-4d3f-bad6-63556db2a4d7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:47.253423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab8556d0-bcd3-4d3f-bad6-63556db2a4d7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:47.254190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab8556d0-bcd3-4d3f-bad6-63556db2a4d7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:47.264345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab8556d0-bcd3-4d3f-bad6-63556db2a4d7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:47.265354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab8556d0-bcd3-4d3f-bad6-63556db2a4d7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:47.266554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab8556d0-bcd3-4d3f-bad6-63556db2a4d7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:47.272774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab8556d0-bcd3-4d3f-bad6-63556db2a4d7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:47.392535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0f75f0ca-967f-4e9c-a07b-fe67b4cf5ab5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:47.429575 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0f75f0ca-967f-4e9c-a07b-fe67b4cf5ab5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.440876 Aug 29 15:38:47.431852 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1705/3433] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:46 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:47.445856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cdda0034-e905-4b64-8ea9-6483d6506412 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:47.447035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cdda0034-e905-4b64-8ea9-6483d6506412 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:47.454189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdda0034-e905-4b64-8ea9-6483d6506412 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:47.454906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdda0034-e905-4b64-8ea9-6483d6506412 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:47.456151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdda0034-e905-4b64-8ea9-6483d6506412 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:47.460876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdda0034-e905-4b64-8ea9-6483d6506412 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:47.461545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdda0034-e905-4b64-8ea9-6483d6506412 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:47.462141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdda0034-e905-4b64-8ea9-6483d6506412 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:47.500129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cdda0034-e905-4b64-8ea9-6483d6506412 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:38:47.660049 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cdda0034-e905-4b64-8ea9-6483d6506412 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 204 len: 0 microversion: 2.1 time: 0.226407 Aug 29 15:38:47.661987 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1706/3434] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:47 2022] DELETE /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:38:47.690586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f9901968-f427-453e-bf3c-f31c441b7e4d req-9d3e7897-b6bd-4429-8bbd-a7e691b433ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1199ee4-c322-4c37-a53e-1bf029c7f14c", "tag": "b9c1844c-f849-40a4-b1f6-8dffc854044e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:47.715959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f9901968-f427-453e-bf3c-f31c441b7e4d req-9d3e7897-b6bd-4429-8bbd-a7e691b433ef service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:47.718563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f9901968-f427-453e-bf3c-f31c441b7e4d req-9d3e7897-b6bd-4429-8bbd-a7e691b433ef service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:47.719233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f9901968-f427-453e-bf3c-f31c441b7e4d req-9d3e7897-b6bd-4429-8bbd-a7e691b433ef service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:47.741431 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f9901968-f427-453e-bf3c-f31c441b7e4d req-9d3e7897-b6bd-4429-8bbd-a7e691b433ef service nova] Creating event network-changed:b9c1844c-f849-40a4-b1f6-8dffc854044e for instance b1199ee4-c322-4c37-a53e-1bf029c7f14c on n-h2-839401-11 Aug 29 15:38:47.751862 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f9901968-f427-453e-bf3c-f31c441b7e4d req-9d3e7897-b6bd-4429-8bbd-a7e691b433ef service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085546 Aug 29 15:38:47.756445 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1707/3435] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:47.780904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2926f026-9acb-41bb-8bae-7eabfb980fda tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:47.783656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2926f026-9acb-41bb-8bae-7eabfb980fda tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:47.807014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2926f026-9acb-41bb-8bae-7eabfb980fda tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:47.807655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2926f026-9acb-41bb-8bae-7eabfb980fda tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:47.809488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2926f026-9acb-41bb-8bae-7eabfb980fda tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:47.810321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2926f026-9acb-41bb-8bae-7eabfb980fda tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:47.812252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2926f026-9acb-41bb-8bae-7eabfb980fda tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:47.813647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2926f026-9acb-41bb-8bae-7eabfb980fda tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:47.947761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ab8556d0-bcd3-4d3f-bad6-63556db2a4d7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:47.957654 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ab8556d0-bcd3-4d3f-bad6-63556db2a4d7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1313 microversion: 2.1 time: 0.722816 Aug 29 15:38:47.974684 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1729/3436] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:47 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1313 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:47.982605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7ffd54c4-ca84-4b83-830d-5222277e6a03 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:47.983598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7ffd54c4-ca84-4b83-830d-5222277e6a03 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:48.002139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ffd54c4-ca84-4b83-830d-5222277e6a03 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.003889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ffd54c4-ca84-4b83-830d-5222277e6a03 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.004805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ffd54c4-ca84-4b83-830d-5222277e6a03 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.005916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ffd54c4-ca84-4b83-830d-5222277e6a03 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.006596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ffd54c4-ca84-4b83-830d-5222277e6a03 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.007998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ffd54c4-ca84-4b83-830d-5222277e6a03 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.019972 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2926f026-9acb-41bb-8bae-7eabfb980fda tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 202 len: 0 microversion: 2.1 time: 0.248102 Aug 29 15:38:48.027514 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1708/3437] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:38:47 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:48.034026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fabe1313-2f0c-49a1-a2ec-8b61eda1e1bd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:48.034959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:48.047115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fabe1313-2f0c-49a1-a2ec-8b61eda1e1bd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:48.063638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fabe1313-2f0c-49a1-a2ec-8b61eda1e1bd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.068169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fabe1313-2f0c-49a1-a2ec-8b61eda1e1bd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.069046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fabe1313-2f0c-49a1-a2ec-8b61eda1e1bd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.070052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fabe1313-2f0c-49a1-a2ec-8b61eda1e1bd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.070800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fabe1313-2f0c-49a1-a2ec-8b61eda1e1bd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.071459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fabe1313-2f0c-49a1-a2ec-8b61eda1e1bd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.107209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:48.657324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7ffd54c4-ca84-4b83-830d-5222277e6a03 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:48.670604 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7ffd54c4-ca84-4b83-830d-5222277e6a03 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 200 len: 1528 microversion: 2.1 time: 0.694336 Aug 29 15:38:48.684566 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1730/3438] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:47 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 1528 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:48.713554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-319a57dc-08e8-4a71-ba95-595f1ba13a96 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:48.716754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-319a57dc-08e8-4a71-ba95-595f1ba13a96 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:48.736064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-319a57dc-08e8-4a71-ba95-595f1ba13a96 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.739760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-319a57dc-08e8-4a71-ba95-595f1ba13a96 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.743277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-319a57dc-08e8-4a71-ba95-595f1ba13a96 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.749737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-319a57dc-08e8-4a71-ba95-595f1ba13a96 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.752385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-319a57dc-08e8-4a71-ba95-595f1ba13a96 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.759405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-319a57dc-08e8-4a71-ba95-595f1ba13a96 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.902899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fabe1313-2f0c-49a1-a2ec-8b61eda1e1bd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:48.921568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fabe1313-2f0c-49a1-a2ec-8b61eda1e1bd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:48.924316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fabe1313-2f0c-49a1-a2ec-8b61eda1e1bd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:48.925943 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fabe1313-2f0c-49a1-a2ec-8b61eda1e1bd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.896424 Aug 29 15:38:48.926835 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1709/3439] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:48 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:48.932225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-1c960f3d-53b6-4761-9b7e-bd519a4ab734 req-b634de06-909c-4414-9d88-f4e8af6db960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af95f7c-5362-4cf9-b80e-38cd6a518783", "name": "network-vif-unplugged", "status": "completed", "tag": "2984ebfd-8f23-4f8e-83af-0a164bd8c5aa"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:48.943910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1c960f3d-53b6-4761-9b7e-bd519a4ab734 req-b634de06-909c-4414-9d88-f4e8af6db960 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.944851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1c960f3d-53b6-4761-9b7e-bd519a4ab734 req-b634de06-909c-4414-9d88-f4e8af6db960 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.945635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1c960f3d-53b6-4761-9b7e-bd519a4ab734 req-b634de06-909c-4414-9d88-f4e8af6db960 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.961058 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-1c960f3d-53b6-4761-9b7e-bd519a4ab734 req-b634de06-909c-4414-9d88-f4e8af6db960 service nova] Creating event network-vif-unplugged:2984ebfd-8f23-4f8e-83af-0a164bd8c5aa for instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 on n-h2-839401-11 Aug 29 15:38:48.969565 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-1c960f3d-53b6-4761-9b7e-bd519a4ab734 req-b634de06-909c-4414-9d88-f4e8af6db960 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040795 Aug 29 15:38:48.970688 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1710/3440] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:48.988250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5059d8c1-111b-45f6-a50c-f83e87051d89 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:48.993597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5059d8c1-111b-45f6-a50c-f83e87051d89 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:49.003374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5059d8c1-111b-45f6-a50c-f83e87051d89 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.004366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5059d8c1-111b-45f6-a50c-f83e87051d89 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.005271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5059d8c1-111b-45f6-a50c-f83e87051d89 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.006313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5059d8c1-111b-45f6-a50c-f83e87051d89 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.007923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5059d8c1-111b-45f6-a50c-f83e87051d89 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.008764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5059d8c1-111b-45f6-a50c-f83e87051d89 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.128220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-319a57dc-08e8-4a71-ba95-595f1ba13a96 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:49.141304 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-319a57dc-08e8-4a71-ba95-595f1ba13a96 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1671 microversion: 2.1 time: 0.453735 Aug 29 15:38:49.161417 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1731/3441] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:48 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1671 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:49.522405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5059d8c1-111b-45f6-a50c-f83e87051d89 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:49.535042 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5059d8c1-111b-45f6-a50c-f83e87051d89 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1313 microversion: 2.1 time: 0.557444 Aug 29 15:38:49.548666 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1711/3442] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:48 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1313 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:49.704369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f8c7af56-44bf-4519-919c-23478eb81441 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:49.705878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f8c7af56-44bf-4519-919c-23478eb81441 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:49.714326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8c7af56-44bf-4519-919c-23478eb81441 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.715433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8c7af56-44bf-4519-919c-23478eb81441 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.715989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8c7af56-44bf-4519-919c-23478eb81441 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.716910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8c7af56-44bf-4519-919c-23478eb81441 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.717521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8c7af56-44bf-4519-919c-23478eb81441 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.718016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8c7af56-44bf-4519-919c-23478eb81441 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.738039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:49.949450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c4c17e97-405f-481e-af16-4b25f23388b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:49.949895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c4c17e97-405f-481e-af16-4b25f23388b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:49.959637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c17e97-405f-481e-af16-4b25f23388b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.960424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c17e97-405f-481e-af16-4b25f23388b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.974278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c17e97-405f-481e-af16-4b25f23388b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.974278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c17e97-405f-481e-af16-4b25f23388b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.974278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c17e97-405f-481e-af16-4b25f23388b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.974278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c17e97-405f-481e-af16-4b25f23388b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.022959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:50.171022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f8c7af56-44bf-4519-919c-23478eb81441 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.181924 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f8c7af56-44bf-4519-919c-23478eb81441 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 200 len: 1528 microversion: 2.1 time: 0.481066 Aug 29 15:38:50.182768 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1732/3443] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:49 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 1528 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:50.188715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-4d91ff85-8fc4-4ba1-ae80-3ed62bbda042 req-d02c7620-08fe-47e2-9735-f2109d420100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fdeef99-bce1-4bb6-bf12-24015bdb7f39", "tag": "cc66c773-9cfd-4821-96c2-56ba74e4c8da"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:50.201162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4d91ff85-8fc4-4ba1-ae80-3ed62bbda042 req-d02c7620-08fe-47e2-9735-f2109d420100 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.201664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4d91ff85-8fc4-4ba1-ae80-3ed62bbda042 req-d02c7620-08fe-47e2-9735-f2109d420100 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.202723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4d91ff85-8fc4-4ba1-ae80-3ed62bbda042 req-d02c7620-08fe-47e2-9735-f2109d420100 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.216649 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-4d91ff85-8fc4-4ba1-ae80-3ed62bbda042 req-d02c7620-08fe-47e2-9735-f2109d420100 service nova] Creating event network-changed:cc66c773-9cfd-4821-96c2-56ba74e4c8da for instance 1fdeef99-bce1-4bb6-bf12-24015bdb7f39 on n-h2-839401-11 Aug 29 15:38:50.223364 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-4d91ff85-8fc4-4ba1-ae80-3ed62bbda042 req-d02c7620-08fe-47e2-9735-f2109d420100 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039048 Aug 29 15:38:50.224741 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1733/3444] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:50.230577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9f014915-d641-4dfd-8dbd-5cbd0aa7af33 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.231283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9f014915-d641-4dfd-8dbd-5cbd0aa7af33 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:50.239398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f014915-d641-4dfd-8dbd-5cbd0aa7af33 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.240099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f014915-d641-4dfd-8dbd-5cbd0aa7af33 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.240535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f014915-d641-4dfd-8dbd-5cbd0aa7af33 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.241359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f014915-d641-4dfd-8dbd-5cbd0aa7af33 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.241839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f014915-d641-4dfd-8dbd-5cbd0aa7af33 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.243090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f014915-d641-4dfd-8dbd-5cbd0aa7af33 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.359004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c4c17e97-405f-481e-af16-4b25f23388b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.372104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c4c17e97-405f-481e-af16-4b25f23388b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.373594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c4c17e97-405f-481e-af16-4b25f23388b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.375392 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c4c17e97-405f-481e-af16-4b25f23388b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.429932 Aug 29 15:38:50.376030 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1712/3445] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:49 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:38:50.556872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9f014915-d641-4dfd-8dbd-5cbd0aa7af33 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.557510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a4e34faa-af66-4ebc-b17d-d603b9fde27d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.558568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a4e34faa-af66-4ebc-b17d-d603b9fde27d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:50.568009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4e34faa-af66-4ebc-b17d-d603b9fde27d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.568575 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9f014915-d641-4dfd-8dbd-5cbd0aa7af33 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1671 microversion: 2.1 time: 0.340236 Aug 29 15:38:50.569229 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1734/3446] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1671 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:50.569349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4e34faa-af66-4ebc-b17d-d603b9fde27d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.570247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4e34faa-af66-4ebc-b17d-d603b9fde27d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.571255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4e34faa-af66-4ebc-b17d-d603b9fde27d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.571989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4e34faa-af66-4ebc-b17d-d603b9fde27d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.578345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4e34faa-af66-4ebc-b17d-d603b9fde27d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.833164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a4e34faa-af66-4ebc-b17d-d603b9fde27d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.847038 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a4e34faa-af66-4ebc-b17d-d603b9fde27d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1313 microversion: 2.1 time: 0.289679 Aug 29 15:38:50.847038 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1713/3447] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:50.902528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-21aeb08a-100d-474a-b386-ce3eaaedfbbe req-584c8d9d-3dc9-4d22-85ad-5b986c86d7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa34ee1-2f81-4ed2-959c-d61ffa85eec6", "name": "network-vif-deleted", "tag": "d1c585ce-bc3b-4b90-b813-d41764060d3c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:50.948261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-21aeb08a-100d-474a-b386-ce3eaaedfbbe req-584c8d9d-3dc9-4d22-85ad-5b986c86d7b6 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.948738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-21aeb08a-100d-474a-b386-ce3eaaedfbbe req-584c8d9d-3dc9-4d22-85ad-5b986c86d7b6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.949399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-21aeb08a-100d-474a-b386-ce3eaaedfbbe req-584c8d9d-3dc9-4d22-85ad-5b986c86d7b6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.965865 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-21aeb08a-100d-474a-b386-ce3eaaedfbbe req-584c8d9d-3dc9-4d22-85ad-5b986c86d7b6 service nova] Creating event network-vif-deleted:d1c585ce-bc3b-4b90-b813-d41764060d3c for instance 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 on n-h1-839401-11 Aug 29 15:38:50.978452 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-21aeb08a-100d-474a-b386-ce3eaaedfbbe req-584c8d9d-3dc9-4d22-85ad-5b986c86d7b6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077959 Aug 29 15:38:50.979825 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1735/3448] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:38:51.206820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1c4b7951-51ea-4c8d-bbad-b1e85841041d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:51.207421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1c4b7951-51ea-4c8d-bbad-b1e85841041d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:51.211157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=8 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:51.218163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c4b7951-51ea-4c8d-bbad-b1e85841041d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.218943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c4b7951-51ea-4c8d-bbad-b1e85841041d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.219569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c4b7951-51ea-4c8d-bbad-b1e85841041d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.220464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c4b7951-51ea-4c8d-bbad-b1e85841041d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.221489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c4b7951-51ea-4c8d-bbad-b1e85841041d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.222921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c4b7951-51ea-4c8d-bbad-b1e85841041d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.245567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:51.277573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c4b7951-51ea-4c8d-bbad-b1e85841041d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.279440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c4b7951-51ea-4c8d-bbad-b1e85841041d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.280565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c4b7951-51ea-4c8d-bbad-b1e85841041d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.281278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-1c4b7951-51ea-4c8d-bbad-b1e85841041d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lazy-loading 'fault' on Instance uuid 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:38:51.355447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1c4b7951-51ea-4c8d-bbad-b1e85841041d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de4fe0749d449748eca6937b123d2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaeecb44c6534cba89e3d68177917529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:51.376810 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1c4b7951-51ea-4c8d-bbad-b1e85841041d tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 200 len: 1314 microversion: 2.1 time: 0.173816 Aug 29 15:38:51.381905 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1714/3449] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:51 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:51.402966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7b0db7f9-6c48-474d-8a9e-c2449b5025b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:51.404560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7b0db7f9-6c48-474d-8a9e-c2449b5025b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:51.413234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b0db7f9-6c48-474d-8a9e-c2449b5025b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.413972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b0db7f9-6c48-474d-8a9e-c2449b5025b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.414591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b0db7f9-6c48-474d-8a9e-c2449b5025b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.415547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b0db7f9-6c48-474d-8a9e-c2449b5025b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.416224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b0db7f9-6c48-474d-8a9e-c2449b5025b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.416939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b0db7f9-6c48-474d-8a9e-c2449b5025b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.591428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d96f2c7e-694d-428d-b296-807dc82fec06 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:51.592362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d96f2c7e-694d-428d-b296-807dc82fec06 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:51.602122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d96f2c7e-694d-428d-b296-807dc82fec06 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.602881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d96f2c7e-694d-428d-b296-807dc82fec06 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.603575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d96f2c7e-694d-428d-b296-807dc82fec06 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.604489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d96f2c7e-694d-428d-b296-807dc82fec06 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.605237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d96f2c7e-694d-428d-b296-807dc82fec06 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.605904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d96f2c7e-694d-428d-b296-807dc82fec06 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.713127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7b0db7f9-6c48-474d-8a9e-c2449b5025b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:51.724876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7b0db7f9-6c48-474d-8a9e-c2449b5025b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:51.727923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7b0db7f9-6c48-474d-8a9e-c2449b5025b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:51.729173 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7b0db7f9-6c48-474d-8a9e-c2449b5025b5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.332152 Aug 29 15:38:51.743237 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1736/3450] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:51 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:51.869487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a3242353-1b14-4d0b-b3cf-1916cfb71dda tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:51.870236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a3242353-1b14-4d0b-b3cf-1916cfb71dda tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:51.877560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3242353-1b14-4d0b-b3cf-1916cfb71dda tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.878303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3242353-1b14-4d0b-b3cf-1916cfb71dda tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.878710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3242353-1b14-4d0b-b3cf-1916cfb71dda tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.879505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3242353-1b14-4d0b-b3cf-1916cfb71dda tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.880006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3242353-1b14-4d0b-b3cf-1916cfb71dda tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.880445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3242353-1b14-4d0b-b3cf-1916cfb71dda tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.035879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a3242353-1b14-4d0b-b3cf-1916cfb71dda tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:52.045346 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a3242353-1b14-4d0b-b3cf-1916cfb71dda tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1313 microversion: 2.1 time: 0.184902 Aug 29 15:38:52.046036 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1737/3451] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:51 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:52.398678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e581044b-d16e-4f7d-8f0e-7e3e958b3b1e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:52.399303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e581044b-d16e-4f7d-8f0e-7e3e958b3b1e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:52.406487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e581044b-d16e-4f7d-8f0e-7e3e958b3b1e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.407054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e581044b-d16e-4f7d-8f0e-7e3e958b3b1e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.407294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e581044b-d16e-4f7d-8f0e-7e3e958b3b1e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.407969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e581044b-d16e-4f7d-8f0e-7e3e958b3b1e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.408432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e581044b-d16e-4f7d-8f0e-7e3e958b3b1e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.408857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e581044b-d16e-4f7d-8f0e-7e3e958b3b1e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.424360 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-e581044b-d16e-4f7d-8f0e-7e3e958b3b1e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] HTTP exception thrown: Instance 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 could not be found. Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e581044b-d16e-4f7d-8f0e-7e3e958b3b1e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Request method failure captured: Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 HTTP/1.1 Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN0GbvIiUff-Csg384q60lkXu4i6-mvBJpd3uHC3XwYXy4PaOZ7rdjlazGQlvtMKGXenSXNWI7wpdDnEyRTa364NbLtw3ESiH3fXKpDQtDE_4rOyqKq2j2P24J-z87DcgMla1UHDGJpmC4Fh5kcRUC7Pl2mjjcnRflSX472pqyiJs6U Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaeecb44c6534cba89e3d68177917529", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}] Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6de4fe0749d449748eca6937b123d2df Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 could not be found. Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '9aa34ee1-2f81-4ed2-959c-d61ffa85eec6'} Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 could not be found. Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 could not be found. Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.426584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:52.431505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.431505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:52.431505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:52.431505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:52.431505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:52.431505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:52.431505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 could not be found. Aug 29 15:38:52.431505 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.431505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e581044b-d16e-4f7d-8f0e-7e3e958b3b1e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Returning 404 to user: Instance 9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:52.431505 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e581044b-d16e-4f7d-8f0e-7e3e958b3b1e tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6" status: 404 len: 111 microversion: 2.1 time: 0.034463 Aug 29 15:38:52.431505 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1738/3452] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:52 2022] GET /compute/v2.1/servers/9aa34ee1-2f81-4ed2-959c-d61ffa85eec6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:52.440898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0a30dc21-3ffd-41be-ab81-056425a86a80 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '.version_select at 0x7fc42b5ae310>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:52.465428 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-0a30dc21-3ffd-41be-ab81-056425a86a80 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] HTTP exception thrown: Image not found. Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0a30dc21-3ffd-41be-ab81-056425a86a80 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Request method failure captured: Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/images/d8978de3-b264-4a98-bc01-973a747e2548 HTTP/1.1 Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN0GbvIiUff-Csg384q60lkXu4i6-mvBJpd3uHC3XwYXy4PaOZ7rdjlazGQlvtMKGXenSXNWI7wpdDnEyRTa364NbLtw3ESiH3fXKpDQtDE_4rOyqKq2j2P24J-z87DcgMla1UHDGJpmC4Fh5kcRUC7Pl2mjjcnRflSX472pqyiJs6U Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaeecb44c6534cba89e3d68177917529", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}] Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6de4fe0749d449748eca6937b123d2df Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: exception: Image not found. Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'd8978de3-b264-4a98-bc01-973a747e2548'} Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d8978de3-b264-4a98-bc01-973a747e2548 to delete Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d8978de3-b264-4a98-bc01-973a747e2548 could not be found. Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:52.468043 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0a30dc21-3ffd-41be-ab81-056425a86a80 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Returning 404 to user: Image not found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0a30dc21-3ffd-41be-ab81-056425a86a80 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "DELETE /compute/v2.1/images/d8978de3-b264-4a98-bc01-973a747e2548" status: 404 len: 62 microversion: 2.1 time: 0.033795 Aug 29 15:38:52.473077 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1739/3453] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:52 2022] DELETE /compute/v2.1/images/d8978de3-b264-4a98-bc01-973a747e2548 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:38:52.480011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-514eb0ac-abda-4338-b97e-fa45dbfb22de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:52.480661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-514eb0ac-abda-4338-b97e-fa45dbfb22de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:52.488494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-514eb0ac-abda-4338-b97e-fa45dbfb22de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.489014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-514eb0ac-abda-4338-b97e-fa45dbfb22de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.490044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-514eb0ac-abda-4338-b97e-fa45dbfb22de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.490784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-514eb0ac-abda-4338-b97e-fa45dbfb22de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.491253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-514eb0ac-abda-4338-b97e-fa45dbfb22de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.491680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-514eb0ac-abda-4338-b97e-fa45dbfb22de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.508459 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-514eb0ac-abda-4338-b97e-fa45dbfb22de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] HTTP exception thrown: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-514eb0ac-abda-4338-b97e-fa45dbfb22de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Request method failure captured: Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 HTTP/1.1 Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN0GbvIiUff-Csg384q60lkXu4i6-mvBJpd3uHC3XwYXy4PaOZ7rdjlazGQlvtMKGXenSXNWI7wpdDnEyRTa364NbLtw3ESiH3fXKpDQtDE_4rOyqKq2j2P24J-z87DcgMla1UHDGJpmC4Fh5kcRUC7Pl2mjjcnRflSX472pqyiJs6U Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaeecb44c6534cba89e3d68177917529", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}] Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6de4fe0749d449748eca6937b123d2df Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'e0017b65-7a12-4dbb-926e-51dccc9475a9'} Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:52.510166 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:52.515342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. Aug 29 15:38:52.515342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.515342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:52.515342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.515342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:52.515342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:52.515342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:52.515342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:52.515342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:52.515342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. Aug 29 15:38:52.515342 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.515342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-514eb0ac-abda-4338-b97e-fa45dbfb22de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Returning 404 to user: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:52.515342 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-514eb0ac-abda-4338-b97e-fa45dbfb22de tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 404 len: 111 microversion: 2.1 time: 0.036497 Aug 29 15:38:52.515342 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1740/3454] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:52 2022] DELETE /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:52.521146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-285bcef1-5c8e-4a03-bc1b-5f3629bef9fa tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:52.521782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-285bcef1-5c8e-4a03-bc1b-5f3629bef9fa tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: e0017b65-7a12-4dbb-926e-51dccc9475a9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:52.528342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-285bcef1-5c8e-4a03-bc1b-5f3629bef9fa tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.528850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-285bcef1-5c8e-4a03-bc1b-5f3629bef9fa tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.529320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-285bcef1-5c8e-4a03-bc1b-5f3629bef9fa tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.530029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-285bcef1-5c8e-4a03-bc1b-5f3629bef9fa tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.530480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-285bcef1-5c8e-4a03-bc1b-5f3629bef9fa tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.530905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-285bcef1-5c8e-4a03-bc1b-5f3629bef9fa tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.730157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d96f2c7e-694d-428d-b296-807dc82fec06 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:52.743137 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d96f2c7e-694d-428d-b296-807dc82fec06 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1671 microversion: 2.1 time: 1.156754 Aug 29 15:38:52.743944 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1715/3455] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:51 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1671 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:52.752874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d8bb8124-ec3c-4bc9-bc98-5d71785f3d93 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:52.753988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d8bb8124-ec3c-4bc9-bc98-5d71785f3d93 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:52.760837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8bb8124-ec3c-4bc9-bc98-5d71785f3d93 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.761718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8bb8124-ec3c-4bc9-bc98-5d71785f3d93 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.762407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8bb8124-ec3c-4bc9-bc98-5d71785f3d93 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.763262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8bb8124-ec3c-4bc9-bc98-5d71785f3d93 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.764015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8bb8124-ec3c-4bc9-bc98-5d71785f3d93 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.764550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8bb8124-ec3c-4bc9-bc98-5d71785f3d93 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.794679 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-285bcef1-5c8e-4a03-bc1b-5f3629bef9fa tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] HTTP exception thrown: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-285bcef1-5c8e-4a03-bc1b-5f3629bef9fa tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Request method failure captured: Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 HTTP/1.1 Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN0GbvIiUff-Csg384q60lkXu4i6-mvBJpd3uHC3XwYXy4PaOZ7rdjlazGQlvtMKGXenSXNWI7wpdDnEyRTa364NbLtw3ESiH3fXKpDQtDE_4rOyqKq2j2P24J-z87DcgMla1UHDGJpmC4Fh5kcRUC7Pl2mjjcnRflSX472pqyiJs6U Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaeecb44c6534cba89e3d68177917529", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}] Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6de4fe0749d449748eca6937b123d2df Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'e0017b65-7a12-4dbb-926e-51dccc9475a9'} Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.796414 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:52.800838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.800838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:52.800838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:52.800838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:52.800838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:52.800838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:52.800838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. Aug 29 15:38:52.800838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:52.800838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-285bcef1-5c8e-4a03-bc1b-5f3629bef9fa tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Returning 404 to user: Instance e0017b65-7a12-4dbb-926e-51dccc9475a9 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:52.800838 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-285bcef1-5c8e-4a03-bc1b-5f3629bef9fa tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9" status: 404 len: 111 microversion: 2.1 time: 0.281106 Aug 29 15:38:52.800838 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1741/3456] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:52 2022] GET /compute/v2.1/servers/e0017b65-7a12-4dbb-926e-51dccc9475a9 => generated 111 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:52.808395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-54df2891-c0ed-4c71-a301-467dcbaa4677 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '.version_select at 0x7fc42a999d30>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:52.854269 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-54df2891-c0ed-4c71-a301-467dcbaa4677 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382599746" status: 202 len: 0 microversion: 2.1 time: 0.050712 Aug 29 15:38:52.854879 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1742/3457] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 15:38:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382599746 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:53.069488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-93628031-4b8d-4069-b701-eb4043bdd528 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:53.070105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-93628031-4b8d-4069-b701-eb4043bdd528 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:53.080194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93628031-4b8d-4069-b701-eb4043bdd528 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.081377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93628031-4b8d-4069-b701-eb4043bdd528 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.084214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93628031-4b8d-4069-b701-eb4043bdd528 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.086494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93628031-4b8d-4069-b701-eb4043bdd528 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.086985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93628031-4b8d-4069-b701-eb4043bdd528 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.087423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93628031-4b8d-4069-b701-eb4043bdd528 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.459116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-93628031-4b8d-4069-b701-eb4043bdd528 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:53.482926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d8bb8124-ec3c-4bc9-bc98-5d71785f3d93 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:53.508334 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-93628031-4b8d-4069-b701-eb4043bdd528 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1313 microversion: 2.1 time: 0.444360 Aug 29 15:38:53.512928 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1743/3458] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:53 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:53.519120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d8bb8124-ec3c-4bc9-bc98-5d71785f3d93 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:53.525119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d8bb8124-ec3c-4bc9-bc98-5d71785f3d93 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:53.534458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a1a676fb-651c-4d7e-8244-0f0978e27964 req-2e1fc4a7-1850-4ffc-b90d-2c87af4099fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-plugged", "status": "completed", "tag": "528dfe97-4f5f-4f10-a2cd-7936781f265f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:53.535052 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d8bb8124-ec3c-4bc9-bc98-5d71785f3d93 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.783188 Aug 29 15:38:53.537012 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1716/3459] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:52 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:53.579044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a1a676fb-651c-4d7e-8244-0f0978e27964 req-2e1fc4a7-1850-4ffc-b90d-2c87af4099fa service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.579590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a1a676fb-651c-4d7e-8244-0f0978e27964 req-2e1fc4a7-1850-4ffc-b90d-2c87af4099fa service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.584716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a1a676fb-651c-4d7e-8244-0f0978e27964 req-2e1fc4a7-1850-4ffc-b90d-2c87af4099fa service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.606430 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a1a676fb-651c-4d7e-8244-0f0978e27964 req-2e1fc4a7-1850-4ffc-b90d-2c87af4099fa service nova] Creating event network-vif-plugged:528dfe97-4f5f-4f10-a2cd-7936781f265f for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:38:53.624226 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a1a676fb-651c-4d7e-8244-0f0978e27964 req-2e1fc4a7-1850-4ffc-b90d-2c87af4099fa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108789 Aug 29 15:38:53.630882 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1744/3460] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:53.778970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d10b1705-debb-45b1-ba32-b733bdd6748d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:53.779624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d10b1705-debb-45b1-ba32-b733bdd6748d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:53.797437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d10b1705-debb-45b1-ba32-b733bdd6748d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.798177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d10b1705-debb-45b1-ba32-b733bdd6748d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.801191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d10b1705-debb-45b1-ba32-b733bdd6748d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.802194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d10b1705-debb-45b1-ba32-b733bdd6748d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.803873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d10b1705-debb-45b1-ba32-b733bdd6748d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.804334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d10b1705-debb-45b1-ba32-b733bdd6748d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.986702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ed4092ee-eb0a-46db-89ac-6b2513b2066c tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '.version_select at 0x7fc42aa26ca0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:54.031614 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-ed4092ee-eb0a-46db-89ac-6b2513b2066c tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] HTTP exception thrown: Image not found. Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ed4092ee-eb0a-46db-89ac-6b2513b2066c tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Request method failure captured: Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/images/1987f218-d4ae-4535-8d0a-166d68e92552 HTTP/1.1 Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN0GbvIiUff-Csg384q60lkXu4i6-mvBJpd3uHC3XwYXy4PaOZ7rdjlazGQlvtMKGXenSXNWI7wpdDnEyRTa364NbLtw3ESiH3fXKpDQtDE_4rOyqKq2j2P24J-z87DcgMla1UHDGJpmC4Fh5kcRUC7Pl2mjjcnRflSX472pqyiJs6U Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaeecb44c6534cba89e3d68177917529", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}] Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6de4fe0749d449748eca6937b123d2df Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: exception: Image not found. Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '1987f218-d4ae-4535-8d0a-166d68e92552'} Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1987f218-d4ae-4535-8d0a-166d68e92552 to delete Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1987f218-d4ae-4535-8d0a-166d68e92552 could not be found. Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.035399 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.040237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ed4092ee-eb0a-46db-89ac-6b2513b2066c tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Returning 404 to user: Image not found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:54.044119 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ed4092ee-eb0a-46db-89ac-6b2513b2066c tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "DELETE /compute/v2.1/images/1987f218-d4ae-4535-8d0a-166d68e92552" status: 404 len: 62 microversion: 2.1 time: 0.078251 Aug 29 15:38:54.048630 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1745/3461] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:53 2022] DELETE /compute/v2.1/images/1987f218-d4ae-4535-8d0a-166d68e92552 => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:38:54.053748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7192cf5d-90cf-4417-8c01-089b2d850b64 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:54.054531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7192cf5d-90cf-4417-8c01-089b2d850b64 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:54.064189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7192cf5d-90cf-4417-8c01-089b2d850b64 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.065145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7192cf5d-90cf-4417-8c01-089b2d850b64 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.066426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7192cf5d-90cf-4417-8c01-089b2d850b64 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.067866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7192cf5d-90cf-4417-8c01-089b2d850b64 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.069177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7192cf5d-90cf-4417-8c01-089b2d850b64 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.069808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7192cf5d-90cf-4417-8c01-089b2d850b64 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.092146 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-7192cf5d-90cf-4417-8c01-089b2d850b64 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] HTTP exception thrown: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7192cf5d-90cf-4417-8c01-089b2d850b64 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Request method failure captured: Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 HTTP/1.1 Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN0GbvIiUff-Csg384q60lkXu4i6-mvBJpd3uHC3XwYXy4PaOZ7rdjlazGQlvtMKGXenSXNWI7wpdDnEyRTa364NbLtw3ESiH3fXKpDQtDE_4rOyqKq2j2P24J-z87DcgMla1UHDGJpmC4Fh5kcRUC7Pl2mjjcnRflSX472pqyiJs6U Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaeecb44c6534cba89e3d68177917529", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}] Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6de4fe0749d449748eca6937b123d2df Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '2b6cfb1a-bfac-45e1-9b33-2e080c11f838'} Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:54.094388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:54.099537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. Aug 29 15:38:54.099537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.099537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.099537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.099537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.099537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.099537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.099537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:54.099537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:54.099537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. Aug 29 15:38:54.099537 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.099537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7192cf5d-90cf-4417-8c01-089b2d850b64 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Returning 404 to user: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:54.099537 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7192cf5d-90cf-4417-8c01-089b2d850b64 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 404 len: 111 microversion: 2.1 time: 0.048323 Aug 29 15:38:54.103065 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1746/3462] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:54 2022] DELETE /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:54.109131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2e791519-383d-4280-91b5-87067786c829 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:54.109988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2e791519-383d-4280-91b5-87067786c829 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] [instance: 2b6cfb1a-bfac-45e1-9b33-2e080c11f838] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:54.118824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e791519-383d-4280-91b5-87067786c829 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.119729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e791519-383d-4280-91b5-87067786c829 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.120359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e791519-383d-4280-91b5-87067786c829 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.121313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e791519-383d-4280-91b5-87067786c829 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.121941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e791519-383d-4280-91b5-87067786c829 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.122537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e791519-383d-4280-91b5-87067786c829 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.140447 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-2e791519-383d-4280-91b5-87067786c829 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] HTTP exception thrown: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2e791519-383d-4280-91b5-87067786c829 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Request method failure captured: Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 HTTP/1.1 Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN0GbvIiUff-Csg384q60lkXu4i6-mvBJpd3uHC3XwYXy4PaOZ7rdjlazGQlvtMKGXenSXNWI7wpdDnEyRTa364NbLtw3ESiH3fXKpDQtDE_4rOyqKq2j2P24J-z87DcgMla1UHDGJpmC4Fh5kcRUC7Pl2mjjcnRflSX472pqyiJs6U Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eaeecb44c6534cba89e3d68177917529", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eaeecb44c6534cba89e3d68177917529"}]}] Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: eaeecb44c6534cba89e3d68177917529 Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-104291256 Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6de4fe0749d449748eca6937b123d2df Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-104291256-project Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '2b6cfb1a-bfac-45e1-9b33-2e080c11f838'} Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.142340 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:54.147550 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.147550 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:54.147550 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:54.147550 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:54.147550 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:54.147550 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:54.147550 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. Aug 29 15:38:54.147550 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:38:54.150725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2e791519-383d-4280-91b5-87067786c829 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] Returning 404 to user: Instance 2b6cfb1a-bfac-45e1-9b33-2e080c11f838 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:54.150725 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2e791519-383d-4280-91b5-87067786c829 tempest-ImagesOneServerNegativeTestJSON-104291256 tempest-ImagesOneServerNegativeTestJSON-104291256-project] 10.222.0.62 "GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838" status: 404 len: 111 microversion: 2.1 time: 0.045366 Aug 29 15:38:54.151233 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1747/3463] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:54 2022] GET /compute/v2.1/servers/2b6cfb1a-bfac-45e1-9b33-2e080c11f838 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:54.330013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d10b1705-debb-45b1-ba32-b733bdd6748d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:54.342642 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d10b1705-debb-45b1-ba32-b733bdd6748d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1671 microversion: 2.1 time: 0.580611 Aug 29 15:38:54.343566 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1717/3464] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:53 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1671 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:54.534667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a09031ae-6745-479f-900e-1c7b03e845b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:54.535320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a09031ae-6745-479f-900e-1c7b03e845b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:54.548833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a09031ae-6745-479f-900e-1c7b03e845b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.551269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a09031ae-6745-479f-900e-1c7b03e845b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.552699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a09031ae-6745-479f-900e-1c7b03e845b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.554311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a09031ae-6745-479f-900e-1c7b03e845b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.556623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a09031ae-6745-479f-900e-1c7b03e845b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.557334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a09031ae-6745-479f-900e-1c7b03e845b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.562602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c58b80ab-e773-4192-afae-da87dd8f1971 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:54.563220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c58b80ab-e773-4192-afae-da87dd8f1971 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:54.575834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c58b80ab-e773-4192-afae-da87dd8f1971 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.576356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c58b80ab-e773-4192-afae-da87dd8f1971 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.576796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c58b80ab-e773-4192-afae-da87dd8f1971 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.577735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c58b80ab-e773-4192-afae-da87dd8f1971 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.578351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c58b80ab-e773-4192-afae-da87dd8f1971 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.580076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c58b80ab-e773-4192-afae-da87dd8f1971 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.943920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a09031ae-6745-479f-900e-1c7b03e845b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:54.952280 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a09031ae-6745-479f-900e-1c7b03e845b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1313 microversion: 2.1 time: 0.422869 Aug 29 15:38:54.952862 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1748/3465] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:54 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:55.083941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c58b80ab-e773-4192-afae-da87dd8f1971 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:55.103060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c58b80ab-e773-4192-afae-da87dd8f1971 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:55.104699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c58b80ab-e773-4192-afae-da87dd8f1971 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:55.108071 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c58b80ab-e773-4192-afae-da87dd8f1971 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.550356 Aug 29 15:38:55.110764 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1718/3466] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:54 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:38:55.370204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85157b28-379b-4758-b3f4-ccd05f1fc304 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:55.370877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-85157b28-379b-4758-b3f4-ccd05f1fc304 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:55.385107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85157b28-379b-4758-b3f4-ccd05f1fc304 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.386207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85157b28-379b-4758-b3f4-ccd05f1fc304 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.387861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85157b28-379b-4758-b3f4-ccd05f1fc304 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.390400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85157b28-379b-4758-b3f4-ccd05f1fc304 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.390914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85157b28-379b-4758-b3f4-ccd05f1fc304 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.391355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85157b28-379b-4758-b3f4-ccd05f1fc304 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.801219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-85157b28-379b-4758-b3f4-ccd05f1fc304 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:55.818241 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85157b28-379b-4758-b3f4-ccd05f1fc304 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.452101 Aug 29 15:38:55.818991 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1749/3467] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:55 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:55.834687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c3befdcf-7c58-44e4-81fb-adb9c4c4d3fb req-ba2331cc-9e9c-4462-8347-358ac0851530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-plugged", "status": "completed", "tag": "c7354a20-9cbe-469c-965c-d5e127f1f1bc"}, {"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-plugged", "status": "completed", "tag": "06aacd47-129b-4ad9-b005-9ae39e561668"}, {"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-plugged", "status": "completed", "tag": "898c5b2c-e9b1-4662-8491-a1b8d879ce2b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:55.853329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c3befdcf-7c58-44e4-81fb-adb9c4c4d3fb req-ba2331cc-9e9c-4462-8347-358ac0851530 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.856034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c3befdcf-7c58-44e4-81fb-adb9c4c4d3fb req-ba2331cc-9e9c-4462-8347-358ac0851530 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.857027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c3befdcf-7c58-44e4-81fb-adb9c4c4d3fb req-ba2331cc-9e9c-4462-8347-358ac0851530 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.884501 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c3befdcf-7c58-44e4-81fb-adb9c4c4d3fb req-ba2331cc-9e9c-4462-8347-358ac0851530 service nova] Creating event network-vif-plugged:c7354a20-9cbe-469c-965c-d5e127f1f1bc for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:38:55.891593 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c3befdcf-7c58-44e4-81fb-adb9c4c4d3fb req-ba2331cc-9e9c-4462-8347-358ac0851530 service nova] Creating event network-vif-plugged:06aacd47-129b-4ad9-b005-9ae39e561668 for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:38:55.892222 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c3befdcf-7c58-44e4-81fb-adb9c4c4d3fb req-ba2331cc-9e9c-4462-8347-358ac0851530 service nova] Creating event network-vif-plugged:898c5b2c-e9b1-4662-8491-a1b8d879ce2b for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:38:55.901325 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c3befdcf-7c58-44e4-81fb-adb9c4c4d3fb req-ba2331cc-9e9c-4462-8347-358ac0851530 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.080371 Aug 29 15:38:55.905449 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1750/3468] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:55.921435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4b8c1a1b-13b3-4b4a-90e3-20a3a0f65b46 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:55.924284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4b8c1a1b-13b3-4b4a-90e3-20a3a0f65b46 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:55.930757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-64fd681c-b0c8-4b83-9d6e-e083d74c27be tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4902cd1f-d787-42ee-9400-af2d7d49b463"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:55.932691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b8c1a1b-13b3-4b4a-90e3-20a3a0f65b46 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.933460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b8c1a1b-13b3-4b4a-90e3-20a3a0f65b46 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.933900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b8c1a1b-13b3-4b4a-90e3-20a3a0f65b46 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.934668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-64fd681c-b0c8-4b83-9d6e-e083d74c27be tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:55.935075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b8c1a1b-13b3-4b4a-90e3-20a3a0f65b46 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.935561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b8c1a1b-13b3-4b4a-90e3-20a3a0f65b46 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.936022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b8c1a1b-13b3-4b4a-90e3-20a3a0f65b46 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.951942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64fd681c-b0c8-4b83-9d6e-e083d74c27be tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.952435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64fd681c-b0c8-4b83-9d6e-e083d74c27be tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.953661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64fd681c-b0c8-4b83-9d6e-e083d74c27be tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.954670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64fd681c-b0c8-4b83-9d6e-e083d74c27be tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.955430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64fd681c-b0c8-4b83-9d6e-e083d74c27be tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.956472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64fd681c-b0c8-4b83-9d6e-e083d74c27be tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.097103 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-64fd681c-b0c8-4b83-9d6e-e083d74c27be tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] HTTP exception thrown: Volume 4902cd1f-d787-42ee-9400-af2d7d49b463 could not be found. Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-64fd681c-b0c8-4b83-9d6e-e083d74c27be tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Request method failure captured: Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: request: PUT /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments/445f936d-b582-4672-b907-f3f4216bd2b2 HTTP/1.1 Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 74 Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN0FzXjk3ACNxmp2OBkzl2UwKYKk7_rj5MxFpXrEghsncWflcT4mV2yVAYUseT4Vm4XwZU1ByuyPgLtgYXKEcdFZ_p4_EliKEVsrKH6kiJn4d0d-f9S1nLVJbgWzMm-5ECdL8k_rQFsyJWoB27RzMYDqErpNY0FICHJhkTx_sbRLT1k Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d5d626192612467e96d2b867679663a0 Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-VolumesAdminNegativeTest-279814010 Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d5d626192612467e96d2b867679663a0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d5d626192612467e96d2b867679663a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d5d626192612467e96d2b867679663a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d5d626192612467e96d2b867679663a0"}]}] Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-VolumesAdminNegativeTest-279814010 Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d5d626192612467e96d2b867679663a0 Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-279814010 Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-VolumesAdminNegativeTest-279814010-project-admin Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 4d15bb7dcd9840bc8821c0c361298c5f Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-VolumesAdminNegativeTest-279814010-project-admin Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: {"volumeAttachment": {"volumeId": "4902cd1f-d787-42ee-9400-af2d7d49b463"}} Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: exception: Volume 4902cd1f-d787-42ee-9400-af2d7d49b463 could not be found. Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'server_id': '401ad5c3-264d-437d-a249-035450439c18', 'id': '445f936d-b582-4672-b907-f3f4216bd2b2', 'body': {'volumeAttachment': {'volumeId': '4902cd1f-d787-42ee-9400-af2d7d49b463'}}} Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4902cd1f-d787-42ee-9400-af2d7d49b463 could not be found. (HTTP 404) (Request-ID: req-f5904574-ee76-4950-a54e-737289f09246) Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:38:56.122155 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4902cd1f-d787-42ee-9400-af2d7d49b463 could not be found. Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 4902cd1f-d787-42ee-9400-af2d7d49b463 could not be found. Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4902cd1f-d787-42ee-9400-af2d7d49b463 could not be found. Aug 29 15:38:56.126363 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:38:56.133392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-64fd681c-b0c8-4b83-9d6e-e083d74c27be tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Returning 400 to user: Volume 4902cd1f-d787-42ee-9400-af2d7d49b463 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:56.135775 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-64fd681c-b0c8-4b83-9d6e-e083d74c27be tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] 10.222.0.62 "PUT /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments/445f936d-b582-4672-b907-f3f4216bd2b2" status: 400 len: 107 microversion: 2.1 time: 0.552914 Aug 29 15:38:56.154741 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1719/3469] 10.222.0.62 () {60 vars in 1433 bytes} [Mon Aug 29 15:38:55 2022] PUT /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments/445f936d-b582-4672-b907-f3f4216bd2b2 => generated 107 bytes in 560 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:38:56.167972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-058845bb-afbd-42fa-93f3-86544f412aa9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:56.171739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-058845bb-afbd-42fa-93f3-86544f412aa9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:56.188815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-058845bb-afbd-42fa-93f3-86544f412aa9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.189373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-058845bb-afbd-42fa-93f3-86544f412aa9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.189828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-058845bb-afbd-42fa-93f3-86544f412aa9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.194892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-058845bb-afbd-42fa-93f3-86544f412aa9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.195454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-058845bb-afbd-42fa-93f3-86544f412aa9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.195922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-058845bb-afbd-42fa-93f3-86544f412aa9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.776535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-058845bb-afbd-42fa-93f3-86544f412aa9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:56.785895 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-058845bb-afbd-42fa-93f3-86544f412aa9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1313 microversion: 2.1 time: 0.629636 Aug 29 15:38:56.786546 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1720/3470] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:56 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1313 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:56.791676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e9ceba19-9de6-4404-a063-ce0d5edd5852 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:56.792370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e9ceba19-9de6-4404-a063-ce0d5edd5852 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:56.799393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9ceba19-9de6-4404-a063-ce0d5edd5852 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.800253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9ceba19-9de6-4404-a063-ce0d5edd5852 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.800669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9ceba19-9de6-4404-a063-ce0d5edd5852 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.801553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9ceba19-9de6-4404-a063-ce0d5edd5852 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.802250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9ceba19-9de6-4404-a063-ce0d5edd5852 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.802899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9ceba19-9de6-4404-a063-ce0d5edd5852 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.137173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e9ceba19-9de6-4404-a063-ce0d5edd5852 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:57.149452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e9ceba19-9de6-4404-a063-ce0d5edd5852 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:57.151210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e9ceba19-9de6-4404-a063-ce0d5edd5852 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:57.152459 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e9ceba19-9de6-4404-a063-ce0d5edd5852 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.364650 Aug 29 15:38:57.153228 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1721/3471] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:56 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:57.158252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fc9b2746-4807-4bde-8a17-9d681d95fcb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:57.158757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fc9b2746-4807-4bde-8a17-9d681d95fcb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:57.167391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc9b2746-4807-4bde-8a17-9d681d95fcb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.167957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc9b2746-4807-4bde-8a17-9d681d95fcb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.168397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc9b2746-4807-4bde-8a17-9d681d95fcb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.169151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc9b2746-4807-4bde-8a17-9d681d95fcb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.169647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc9b2746-4807-4bde-8a17-9d681d95fcb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.171330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc9b2746-4807-4bde-8a17-9d681d95fcb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.263158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-fc9b2746-4807-4bde-8a17-9d681d95fcb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lazy-loading 'services' on Instance uuid 401ad5c3-264d-437d-a249-035450439c18 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:38:57.381494 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fc9b2746-4807-4bde-8a17-9d681d95fcb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "DELETE /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments/445f936d-b582-4672-b907-f3f4216bd2b2" status: 202 len: 0 microversion: 2.1 time: 0.225434 Aug 29 15:38:57.383179 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1722/3472] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 15:38:57 2022] DELETE /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments/445f936d-b582-4672-b907-f3f4216bd2b2 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:57.400614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-00a4b526-eac2-4dee-9d49-5c81b2618552 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:57.405696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-00a4b526-eac2-4dee-9d49-5c81b2618552 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:57.416931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00a4b526-eac2-4dee-9d49-5c81b2618552 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.417945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00a4b526-eac2-4dee-9d49-5c81b2618552 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.418607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00a4b526-eac2-4dee-9d49-5c81b2618552 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.421449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00a4b526-eac2-4dee-9d49-5c81b2618552 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.422733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00a4b526-eac2-4dee-9d49-5c81b2618552 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.423376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00a4b526-eac2-4dee-9d49-5c81b2618552 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.468568 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-00a4b526-eac2-4dee-9d49-5c81b2618552 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080649 Aug 29 15:38:57.474233 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1723/3473] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:38:57 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:57.717025 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4b8c1a1b-13b3-4b4a-90e3-20a3a0f65b46 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 200 len: 324 microversion: 2.1 time: 1.808856 Aug 29 15:38:57.722793 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1751/3474] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:38:55 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 324 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:57.727475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-434ecde3-5c47-4498-aa4e-deec2f09471e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:57.728407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-434ecde3-5c47-4498-aa4e-deec2f09471e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:57.735693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-434ecde3-5c47-4498-aa4e-deec2f09471e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.736495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-434ecde3-5c47-4498-aa4e-deec2f09471e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.737214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-434ecde3-5c47-4498-aa4e-deec2f09471e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.739153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-434ecde3-5c47-4498-aa4e-deec2f09471e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.739901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-434ecde3-5c47-4498-aa4e-deec2f09471e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.740560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-434ecde3-5c47-4498-aa4e-deec2f09471e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.811041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-699bb0c2-710d-4ba6-b8eb-f09a3839570d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:57.812209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-699bb0c2-710d-4ba6-b8eb-f09a3839570d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:57.837562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-699bb0c2-710d-4ba6-b8eb-f09a3839570d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.838683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-699bb0c2-710d-4ba6-b8eb-f09a3839570d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.839505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-699bb0c2-710d-4ba6-b8eb-f09a3839570d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.840973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-699bb0c2-710d-4ba6-b8eb-f09a3839570d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.841698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-699bb0c2-710d-4ba6-b8eb-f09a3839570d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.842437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-699bb0c2-710d-4ba6-b8eb-f09a3839570d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.095732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-434ecde3-5c47-4498-aa4e-deec2f09471e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:58.106101 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-434ecde3-5c47-4498-aa4e-deec2f09471e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.382373 Aug 29 15:38:58.109028 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1724/3475] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:57 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:58.138208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-621ef1f5-0259-4811-b5ae-0212b1c928c3 req-b8b15bd1-44d0-4d87-afc5-48c46b37e9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-plugged", "status": "completed", "tag": "29a5d995-57d9-450f-ae74-d0d7be314912"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:58.167432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-621ef1f5-0259-4811-b5ae-0212b1c928c3 req-b8b15bd1-44d0-4d87-afc5-48c46b37e9f5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.168003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-621ef1f5-0259-4811-b5ae-0212b1c928c3 req-b8b15bd1-44d0-4d87-afc5-48c46b37e9f5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.171007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-621ef1f5-0259-4811-b5ae-0212b1c928c3 req-b8b15bd1-44d0-4d87-afc5-48c46b37e9f5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.209968 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-621ef1f5-0259-4811-b5ae-0212b1c928c3 req-b8b15bd1-44d0-4d87-afc5-48c46b37e9f5 service nova] Creating event network-vif-plugged:29a5d995-57d9-450f-ae74-d0d7be314912 for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:38:58.225255 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-621ef1f5-0259-4811-b5ae-0212b1c928c3 req-b8b15bd1-44d0-4d87-afc5-48c46b37e9f5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113965 Aug 29 15:38:58.228119 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1725/3476] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:58.241500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0cd24db4-c765-4b2c-8149-5966ed8d0578 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:58.243645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0cd24db4-c765-4b2c-8149-5966ed8d0578 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:58.264666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cd24db4-c765-4b2c-8149-5966ed8d0578 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.265214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cd24db4-c765-4b2c-8149-5966ed8d0578 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.265959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cd24db4-c765-4b2c-8149-5966ed8d0578 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.267010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cd24db4-c765-4b2c-8149-5966ed8d0578 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.267631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cd24db4-c765-4b2c-8149-5966ed8d0578 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.268266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cd24db4-c765-4b2c-8149-5966ed8d0578 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.535650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-699bb0c2-710d-4ba6-b8eb-f09a3839570d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:58.552899 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-699bb0c2-710d-4ba6-b8eb-f09a3839570d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1313 microversion: 2.1 time: 0.748068 Aug 29 15:38:58.558504 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1752/3477] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:57 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1313 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:58.590179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dcfae0a5-b1ed-455a-b91f-9bb2017f32f3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:58.590863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dcfae0a5-b1ed-455a-b91f-9bb2017f32f3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:58.603534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcfae0a5-b1ed-455a-b91f-9bb2017f32f3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.604435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcfae0a5-b1ed-455a-b91f-9bb2017f32f3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.604885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcfae0a5-b1ed-455a-b91f-9bb2017f32f3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.605689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcfae0a5-b1ed-455a-b91f-9bb2017f32f3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.606153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcfae0a5-b1ed-455a-b91f-9bb2017f32f3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.606585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcfae0a5-b1ed-455a-b91f-9bb2017f32f3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.913901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0cd24db4-c765-4b2c-8149-5966ed8d0578 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:58.926079 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0cd24db4-c765-4b2c-8149-5966ed8d0578 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.692852 Aug 29 15:38:58.926873 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1726/3478] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:58 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:58.951927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3b8f5a07-5148-4b9b-a2a4-54fec9183c96 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:58.953678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3b8f5a07-5148-4b9b-a2a4-54fec9183c96 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:58.966247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b8f5a07-5148-4b9b-a2a4-54fec9183c96 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.967769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b8f5a07-5148-4b9b-a2a4-54fec9183c96 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.968859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b8f5a07-5148-4b9b-a2a4-54fec9183c96 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.972075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b8f5a07-5148-4b9b-a2a4-54fec9183c96 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.973133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b8f5a07-5148-4b9b-a2a4-54fec9183c96 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.985621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b8f5a07-5148-4b9b-a2a4-54fec9183c96 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.048777 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3b8f5a07-5148-4b9b-a2a4-54fec9183c96 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105345 Aug 29 15:38:59.050345 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1727/3479] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:38:58 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:59.055768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3cdbacb2-6099-47dd-83ce-7f4b54611cba tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:59.056919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3cdbacb2-6099-47dd-83ce-7f4b54611cba tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:59.063044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dcfae0a5-b1ed-455a-b91f-9bb2017f32f3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:59.084040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cdbacb2-6099-47dd-83ce-7f4b54611cba tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.084351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dcfae0a5-b1ed-455a-b91f-9bb2017f32f3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:59.090770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cdbacb2-6099-47dd-83ce-7f4b54611cba tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.091559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cdbacb2-6099-47dd-83ce-7f4b54611cba tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.093591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dcfae0a5-b1ed-455a-b91f-9bb2017f32f3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:59.095884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cdbacb2-6099-47dd-83ce-7f4b54611cba tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.099049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cdbacb2-6099-47dd-83ce-7f4b54611cba tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.100643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cdbacb2-6099-47dd-83ce-7f4b54611cba tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.101045 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dcfae0a5-b1ed-455a-b91f-9bb2017f32f3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.525655 Aug 29 15:38:59.103991 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1753/3480] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:58 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:59.505595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3cdbacb2-6099-47dd-83ce-7f4b54611cba tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:59.521337 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3cdbacb2-6099-47dd-83ce-7f4b54611cba tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.467954 Aug 29 15:38:59.533348 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1728/3481] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:59 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:59.544462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6cb9e631-4176-4b75-bf49-23a5c7b792e3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:59.545402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6cb9e631-4176-4b75-bf49-23a5c7b792e3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:59.563417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cb9e631-4176-4b75-bf49-23a5c7b792e3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.564698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cb9e631-4176-4b75-bf49-23a5c7b792e3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.565392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cb9e631-4176-4b75-bf49-23a5c7b792e3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.580081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c666bff0-ca6b-4a53-ba50-b516d8e7ba2b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:59.581314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c666bff0-ca6b-4a53-ba50-b516d8e7ba2b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:59.585189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cb9e631-4176-4b75-bf49-23a5c7b792e3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.586112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cb9e631-4176-4b75-bf49-23a5c7b792e3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.588912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cb9e631-4176-4b75-bf49-23a5c7b792e3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.595951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c666bff0-ca6b-4a53-ba50-b516d8e7ba2b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.596729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c666bff0-ca6b-4a53-ba50-b516d8e7ba2b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.597402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c666bff0-ca6b-4a53-ba50-b516d8e7ba2b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.599477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c666bff0-ca6b-4a53-ba50-b516d8e7ba2b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.600118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c666bff0-ca6b-4a53-ba50-b516d8e7ba2b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.605515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c666bff0-ca6b-4a53-ba50-b516d8e7ba2b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.946150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c666bff0-ca6b-4a53-ba50-b516d8e7ba2b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:59.957074 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c666bff0-ca6b-4a53-ba50-b516d8e7ba2b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1313 microversion: 2.1 time: 0.381086 Aug 29 15:38:59.958050 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1729/3482] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:59 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:00.078424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d26c2aad-3482-474d-a7d8-f91de075cd61 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:00.104887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d26c2aad-3482-474d-a7d8-f91de075cd61 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:00.130814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d26c2aad-3482-474d-a7d8-f91de075cd61 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.131486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d26c2aad-3482-474d-a7d8-f91de075cd61 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.132094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d26c2aad-3482-474d-a7d8-f91de075cd61 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.133252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d26c2aad-3482-474d-a7d8-f91de075cd61 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.134062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d26c2aad-3482-474d-a7d8-f91de075cd61 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.135056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d26c2aad-3482-474d-a7d8-f91de075cd61 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.212990 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d26c2aad-3482-474d-a7d8-f91de075cd61 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154417 Aug 29 15:39:00.219242 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1730/3483] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:39:00 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:00.224694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2cad8797-572d-4a38-9b47-8fe7db9f579e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:00.225615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2cad8797-572d-4a38-9b47-8fe7db9f579e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:00.236295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cad8797-572d-4a38-9b47-8fe7db9f579e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.236807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cad8797-572d-4a38-9b47-8fe7db9f579e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.237602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cad8797-572d-4a38-9b47-8fe7db9f579e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.238507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cad8797-572d-4a38-9b47-8fe7db9f579e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.239925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cad8797-572d-4a38-9b47-8fe7db9f579e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.240595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cad8797-572d-4a38-9b47-8fe7db9f579e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.250206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:00.514312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6cb9e631-4176-4b75-bf49-23a5c7b792e3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:00.523288 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6cb9e631-4176-4b75-bf49-23a5c7b792e3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.983876 Aug 29 15:39:00.523885 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1754/3484] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:59 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:00.539366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-cfd0c5da-b9b2-4dbb-a3a7-cfb76166c167 req-f87aea41-979c-45d7-88e5-9b8e44803065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-plugged", "status": "completed", "tag": "aeebdb13-55ba-4836-8aeb-54a484a60db4"}, {"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-plugged", "status": "completed", "tag": "a57525af-726d-4159-bf8f-7847df217cc9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:00.564721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cfd0c5da-b9b2-4dbb-a3a7-cfb76166c167 req-f87aea41-979c-45d7-88e5-9b8e44803065 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.565247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cfd0c5da-b9b2-4dbb-a3a7-cfb76166c167 req-f87aea41-979c-45d7-88e5-9b8e44803065 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.567762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cfd0c5da-b9b2-4dbb-a3a7-cfb76166c167 req-f87aea41-979c-45d7-88e5-9b8e44803065 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.600842 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-cfd0c5da-b9b2-4dbb-a3a7-cfb76166c167 req-f87aea41-979c-45d7-88e5-9b8e44803065 service nova] Creating event network-vif-plugged:aeebdb13-55ba-4836-8aeb-54a484a60db4 for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:39:00.601685 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-cfd0c5da-b9b2-4dbb-a3a7-cfb76166c167 req-f87aea41-979c-45d7-88e5-9b8e44803065 service nova] Creating event network-vif-plugged:a57525af-726d-4159-bf8f-7847df217cc9 for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:39:00.608310 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-cfd0c5da-b9b2-4dbb-a3a7-cfb76166c167 req-f87aea41-979c-45d7-88e5-9b8e44803065 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077074 Aug 29 15:39:00.610101 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1755/3485] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:00.686687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-642506303", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "d1ac0823-5377-4aa5-8e1a-80f39f87d37f"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:00.766116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2cad8797-572d-4a38-9b47-8fe7db9f579e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:00.783201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2cad8797-572d-4a38-9b47-8fe7db9f579e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:00.789214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2cad8797-572d-4a38-9b47-8fe7db9f579e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:00.794213 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2cad8797-572d-4a38-9b47-8fe7db9f579e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.571301 Aug 29 15:39:00.797039 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1731/3486] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:00 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:00.817301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] validate_networks() for [('d1ac0823-5377-4aa5-8e1a-80f39f87d37f', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:00.978257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2f683dbc-7ed3-4673-9788-fea3c4be32ba tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:00.979760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2f683dbc-7ed3-4673-9788-fea3c4be32ba tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:00.999649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f683dbc-7ed3-4673-9788-fea3c4be32ba tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.000255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f683dbc-7ed3-4673-9788-fea3c4be32ba tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.000797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f683dbc-7ed3-4673-9788-fea3c4be32ba tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.001780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f683dbc-7ed3-4673-9788-fea3c4be32ba tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.002344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f683dbc-7ed3-4673-9788-fea3c4be32ba tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.002875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f683dbc-7ed3-4673-9788-fea3c4be32ba tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.772198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2f683dbc-7ed3-4673-9788-fea3c4be32ba tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:01.781671 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2f683dbc-7ed3-4673-9788-fea3c4be32ba tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1313 microversion: 2.1 time: 0.807378 Aug 29 15:39:01.785885 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1732/3487] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:00 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1313 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:01.795761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-99ed60ae-d160-4599-b9f1-72c3ad3d3bce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:01.801287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:01.803495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:01.804215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:01.804791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:01.805163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-99ed60ae-d160-4599-b9f1-72c3ad3d3bce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:01.805659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:01.824204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99ed60ae-d160-4599-b9f1-72c3ad3d3bce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.825257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99ed60ae-d160-4599-b9f1-72c3ad3d3bce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.825923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99ed60ae-d160-4599-b9f1-72c3ad3d3bce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.827379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99ed60ae-d160-4599-b9f1-72c3ad3d3bce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.828124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99ed60ae-d160-4599-b9f1-72c3ad3d3bce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.828841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99ed60ae-d160-4599-b9f1-72c3ad3d3bce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.830489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.831278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.832049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.832809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.833313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.837289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.884045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:01.900356 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-99ed60ae-d160-4599-b9f1-72c3ad3d3bce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108528 Aug 29 15:39:01.901206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Getting quotas for project 990c752c7bb141c1bf496c98fbc3c9a7. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:01.901509 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1733/3488] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:39:01 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:01.907462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-91b86077-311f-4907-8554-fd7b7f467d2a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:01.908306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-91b86077-311f-4907-8554-fd7b7f467d2a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:01.915935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91b86077-311f-4907-8554-fd7b7f467d2a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.916682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91b86077-311f-4907-8554-fd7b7f467d2a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.917592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91b86077-311f-4907-8554-fd7b7f467d2a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.918516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91b86077-311f-4907-8554-fd7b7f467d2a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.919193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91b86077-311f-4907-8554-fd7b7f467d2a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.919346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Getting quotas for user 51efa71a8bfe457982698a5755ae3cc6 and project 990c752c7bb141c1bf496c98fbc3c9a7. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:01.920042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91b86077-311f-4907-8554-fd7b7f467d2a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.937075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:01.940548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:01.998666 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bb55b7a5-ef0f-48ca-8e5a-9ba40e1dc550 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.318642 Aug 29 15:39:02.000109 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1756/3489] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:39:02.016438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2f52d958-721a-45d4-ab2b-2c2afd194848 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:02.017445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2f52d958-721a-45d4-ab2b-2c2afd194848 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:02.206866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2f52d958-721a-45d4-ab2b-2c2afd194848 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:02.220217 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2f52d958-721a-45d4-ab2b-2c2afd194848 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1214 microversion: 2.1 time: 0.212184 Aug 29 15:39:02.223341 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1757/3490] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:02 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1214 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:02.491450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-91b86077-311f-4907-8554-fd7b7f467d2a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:02.502669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-91b86077-311f-4907-8554-fd7b7f467d2a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:02.504265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-91b86077-311f-4907-8554-fd7b7f467d2a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:02.505518 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-91b86077-311f-4907-8554-fd7b7f467d2a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 0.602701 Aug 29 15:39:02.506219 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1734/3491] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:01 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:02.815368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-836f134e-ad42-4dd7-bb5c-48ead242e92c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:02.816804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-836f134e-ad42-4dd7-bb5c-48ead242e92c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:02.831124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-836f134e-ad42-4dd7-bb5c-48ead242e92c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.837997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-836f134e-ad42-4dd7-bb5c-48ead242e92c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.838716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-836f134e-ad42-4dd7-bb5c-48ead242e92c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.839751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-836f134e-ad42-4dd7-bb5c-48ead242e92c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.840886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-836f134e-ad42-4dd7-bb5c-48ead242e92c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.841571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-836f134e-ad42-4dd7-bb5c-48ead242e92c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.913694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4f0da3bc-f771-497e-b4d4-bd11bdeafd21 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:02.917390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4f0da3bc-f771-497e-b4d4-bd11bdeafd21 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:02.972504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0da3bc-f771-497e-b4d4-bd11bdeafd21 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.973452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0da3bc-f771-497e-b4d4-bd11bdeafd21 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.977985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0da3bc-f771-497e-b4d4-bd11bdeafd21 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.979096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0da3bc-f771-497e-b4d4-bd11bdeafd21 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.982651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0da3bc-f771-497e-b4d4-bd11bdeafd21 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.984876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0da3bc-f771-497e-b4d4-bd11bdeafd21 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.079876 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4f0da3bc-f771-497e-b4d4-bd11bdeafd21 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170434 Aug 29 15:39:03.086019 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1735/3492] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:39:02 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:39:03.097380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f6e41f52-bf0e-4d37-b02f-edce79eece73 req-7658a879-65ae-4005-9e03-7042293cef15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1199ee4-c322-4c37-a53e-1bf029c7f14c", "name": "network-vif-plugged", "status": "completed", "tag": "b9c1844c-f849-40a4-b1f6-8dffc854044e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:03.125415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f6e41f52-bf0e-4d37-b02f-edce79eece73 req-7658a879-65ae-4005-9e03-7042293cef15 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.127592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f6e41f52-bf0e-4d37-b02f-edce79eece73 req-7658a879-65ae-4005-9e03-7042293cef15 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.130056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f6e41f52-bf0e-4d37-b02f-edce79eece73 req-7658a879-65ae-4005-9e03-7042293cef15 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.164700 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f6e41f52-bf0e-4d37-b02f-edce79eece73 req-7658a879-65ae-4005-9e03-7042293cef15 service nova] Creating event network-vif-plugged:b9c1844c-f849-40a4-b1f6-8dffc854044e for instance b1199ee4-c322-4c37-a53e-1bf029c7f14c on n-h2-839401-11 Aug 29 15:39:03.180889 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f6e41f52-bf0e-4d37-b02f-edce79eece73 req-7658a879-65ae-4005-9e03-7042293cef15 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091696 Aug 29 15:39:03.182953 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1736/3493] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:03.244798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-54e38e72-c3e7-4a9b-a334-4bebc27b6eaf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:03.245604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-54e38e72-c3e7-4a9b-a334-4bebc27b6eaf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:03.261265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54e38e72-c3e7-4a9b-a334-4bebc27b6eaf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.261797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54e38e72-c3e7-4a9b-a334-4bebc27b6eaf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.264307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54e38e72-c3e7-4a9b-a334-4bebc27b6eaf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.265345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54e38e72-c3e7-4a9b-a334-4bebc27b6eaf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.266143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54e38e72-c3e7-4a9b-a334-4bebc27b6eaf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.266766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54e38e72-c3e7-4a9b-a334-4bebc27b6eaf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.454249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-54e38e72-c3e7-4a9b-a334-4bebc27b6eaf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:03.480661 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-54e38e72-c3e7-4a9b-a334-4bebc27b6eaf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1266 microversion: 2.1 time: 0.240288 Aug 29 15:39:03.482842 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1737/3494] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:03 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:03.533056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b5a9abce-64b3-44b2-aae4-f87fe49951e7 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:03.533703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b5a9abce-64b3-44b2-aae4-f87fe49951e7 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:03.564994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5a9abce-64b3-44b2-aae4-f87fe49951e7 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.565498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5a9abce-64b3-44b2-aae4-f87fe49951e7 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.565942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5a9abce-64b3-44b2-aae4-f87fe49951e7 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.566690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5a9abce-64b3-44b2-aae4-f87fe49951e7 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.567164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5a9abce-64b3-44b2-aae4-f87fe49951e7 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.567877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5a9abce-64b3-44b2-aae4-f87fe49951e7 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.137108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-836f134e-ad42-4dd7-bb5c-48ead242e92c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:04.148862 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-836f134e-ad42-4dd7-bb5c-48ead242e92c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1313 microversion: 2.1 time: 1.344719 Aug 29 15:39:04.149514 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1758/3495] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:02 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1313 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:04.166749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-32e94206-6fa0-433c-9889-26a8ea1103bb tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:04.180593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-32e94206-6fa0-433c-9889-26a8ea1103bb tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:04.189463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32e94206-6fa0-433c-9889-26a8ea1103bb tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.190247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32e94206-6fa0-433c-9889-26a8ea1103bb tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.198932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32e94206-6fa0-433c-9889-26a8ea1103bb tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.199896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32e94206-6fa0-433c-9889-26a8ea1103bb tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.200553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32e94206-6fa0-433c-9889-26a8ea1103bb tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.201723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32e94206-6fa0-433c-9889-26a8ea1103bb tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.238790 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-32e94206-6fa0-433c-9889-26a8ea1103bb tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084933 Aug 29 15:39:04.240687 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1759/3496] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:39:04 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:04.512353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-def2895e-c284-4866-9589-237c4434db38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:04.515008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-def2895e-c284-4866-9589-237c4434db38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:04.548572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def2895e-c284-4866-9589-237c4434db38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.552075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def2895e-c284-4866-9589-237c4434db38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.552974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def2895e-c284-4866-9589-237c4434db38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.553991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def2895e-c284-4866-9589-237c4434db38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.555242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def2895e-c284-4866-9589-237c4434db38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.557419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def2895e-c284-4866-9589-237c4434db38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.601890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b5a9abce-64b3-44b2-aae4-f87fe49951e7 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:04.627932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b5a9abce-64b3-44b2-aae4-f87fe49951e7 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:04.631473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b5a9abce-64b3-44b2-aae4-f87fe49951e7 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:04.637435 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b5a9abce-64b3-44b2-aae4-f87fe49951e7 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1879 microversion: 2.42 time: 1.107814 Aug 29 15:39:04.657200 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1738/3497] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:03 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1879 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:39:05.146252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-def2895e-c284-4866-9589-237c4434db38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:05.151144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:05.156922 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-def2895e-c284-4866-9589-237c4434db38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1272 microversion: 2.1 time: 0.651559 Aug 29 15:39:05.168099 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1760/3498] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:04 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1272 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:05.172884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2dfc0f7a-9773-411f-aed0-e0b59d55038f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:05.173554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2dfc0f7a-9773-411f-aed0-e0b59d55038f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:05.183996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:05.185710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2dfc0f7a-9773-411f-aed0-e0b59d55038f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:05.186405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2dfc0f7a-9773-411f-aed0-e0b59d55038f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:05.187029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2dfc0f7a-9773-411f-aed0-e0b59d55038f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:05.188130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2dfc0f7a-9773-411f-aed0-e0b59d55038f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:05.188829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2dfc0f7a-9773-411f-aed0-e0b59d55038f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:05.189966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2dfc0f7a-9773-411f-aed0-e0b59d55038f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:05.252680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e941823a-78b4-4b72-8cbb-0a259e63f51b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:05.255360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e941823a-78b4-4b72-8cbb-0a259e63f51b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:05.277561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e941823a-78b4-4b72-8cbb-0a259e63f51b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:05.278486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e941823a-78b4-4b72-8cbb-0a259e63f51b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:05.280267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e941823a-78b4-4b72-8cbb-0a259e63f51b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:05.284301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e941823a-78b4-4b72-8cbb-0a259e63f51b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:05.285195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e941823a-78b4-4b72-8cbb-0a259e63f51b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:05.285902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e941823a-78b4-4b72-8cbb-0a259e63f51b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:05.357734 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e941823a-78b4-4b72-8cbb-0a259e63f51b tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110108 Aug 29 15:39:05.358454 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1761/3499] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:39:05 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:39:05.504602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2dfc0f7a-9773-411f-aed0-e0b59d55038f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:05.522348 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2dfc0f7a-9773-411f-aed0-e0b59d55038f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1313 microversion: 2.1 time: 0.352967 Aug 29 15:39:05.524954 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1739/3500] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:05 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:05.662947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-81c77a38-9989-40eb-af06-be6f88a64498 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:05.663557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-81c77a38-9989-40eb-af06-be6f88a64498 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:05.672392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81c77a38-9989-40eb-af06-be6f88a64498 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:05.672884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81c77a38-9989-40eb-af06-be6f88a64498 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:05.673346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81c77a38-9989-40eb-af06-be6f88a64498 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:05.674047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81c77a38-9989-40eb-af06-be6f88a64498 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:05.674567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81c77a38-9989-40eb-af06-be6f88a64498 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:05.682419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81c77a38-9989-40eb-af06-be6f88a64498 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:05.698378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-199969029", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "d6d011d7-3a33-4483-ae55-fa0d27ab805b"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:05.800082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] validate_networks() for [('d6d011d7-3a33-4483-ae55-fa0d27ab805b', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:06.440477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-81c77a38-9989-40eb-af06-be6f88a64498 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:06.457945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-81c77a38-9989-40eb-af06-be6f88a64498 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:06.465113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-81c77a38-9989-40eb-af06-be6f88a64498 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:06.465113 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-81c77a38-9989-40eb-af06-be6f88a64498 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2837 microversion: 2.42 time: 0.805278 Aug 29 15:39:06.469679 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1762/3501] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:05 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2837 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:06.475474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-40bbe98b-3f18-4d22-a8e9-9c211c4d9a65 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:06.476551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-40bbe98b-3f18-4d22-a8e9-9c211c4d9a65 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:06.484529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40bbe98b-3f18-4d22-a8e9-9c211c4d9a65 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.485671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40bbe98b-3f18-4d22-a8e9-9c211c4d9a65 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.486844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40bbe98b-3f18-4d22-a8e9-9c211c4d9a65 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.488618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40bbe98b-3f18-4d22-a8e9-9c211c4d9a65 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.489664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40bbe98b-3f18-4d22-a8e9-9c211c4d9a65 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.490335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40bbe98b-3f18-4d22-a8e9-9c211c4d9a65 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.659360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-40bbe98b-3f18-4d22-a8e9-9c211c4d9a65 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:06.677149 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-40bbe98b-3f18-4d22-a8e9-9c211c4d9a65 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1272 microversion: 2.1 time: 0.206046 Aug 29 15:39:06.678696 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1763/3502] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:06 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:06.720529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-152ee8eb-9646-4585-81a5-7f1655b05ff3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:06.725889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-152ee8eb-9646-4585-81a5-7f1655b05ff3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:06.750882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-152ee8eb-9646-4585-81a5-7f1655b05ff3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.752934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-152ee8eb-9646-4585-81a5-7f1655b05ff3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.753933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-152ee8eb-9646-4585-81a5-7f1655b05ff3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.755062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-152ee8eb-9646-4585-81a5-7f1655b05ff3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.755773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-152ee8eb-9646-4585-81a5-7f1655b05ff3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.756394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-152ee8eb-9646-4585-81a5-7f1655b05ff3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.798814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:06.799304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:06.799893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:06.800189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:06.800611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:06.864302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.868081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.871016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.876180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.878325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.879063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.983839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Getting quotas for project 4f7cf262cab649fea4b4a44d3c4d7dec. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:07.004046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Getting quotas for user d6e53abcc8ad4e1b91ed86a6c1fdb021 and project 4f7cf262cab649fea4b4a44d3c4d7dec. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:07.060048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:07.070424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:07.165019 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-152ee8eb-9646-4585-81a5-7f1655b05ff3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.465338 Aug 29 15:39:07.166478 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1764/3503] 10.222.0.62 () {60 vars in 1316 bytes} [Mon Aug 29 15:39:06 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822/os-interface => generated 1831 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:07.172133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fa33c0f3-687d-4c2a-8f18-90fe876ffa94 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:07.174002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fa33c0f3-687d-4c2a-8f18-90fe876ffa94 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:07.204150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa33c0f3-687d-4c2a-8f18-90fe876ffa94 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:07.211855 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-53137a4f-96ac-486d-8569-e5f0892653c2 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.517350 Aug 29 15:39:07.216324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa33c0f3-687d-4c2a-8f18-90fe876ffa94 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:07.217300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa33c0f3-687d-4c2a-8f18-90fe876ffa94 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:07.218081 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1740/3504] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:39:07.218459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa33c0f3-687d-4c2a-8f18-90fe876ffa94 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:07.219072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa33c0f3-687d-4c2a-8f18-90fe876ffa94 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:07.219612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa33c0f3-687d-4c2a-8f18-90fe876ffa94 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:07.233262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-25657fb6-1a69-48d3-91fb-9330a4d7d8c3 req-1f4df44f-181d-4deb-95af-0331d6d013f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fdeef99-bce1-4bb6-bf12-24015bdb7f39", "name": "network-vif-plugged", "status": "completed", "tag": "cc66c773-9cfd-4821-96c2-56ba74e4c8da"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:07.279968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-25657fb6-1a69-48d3-91fb-9330a4d7d8c3 req-1f4df44f-181d-4deb-95af-0331d6d013f4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:07.280494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-25657fb6-1a69-48d3-91fb-9330a4d7d8c3 req-1f4df44f-181d-4deb-95af-0331d6d013f4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:07.280935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-25657fb6-1a69-48d3-91fb-9330a4d7d8c3 req-1f4df44f-181d-4deb-95af-0331d6d013f4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:07.317387 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-25657fb6-1a69-48d3-91fb-9330a4d7d8c3 req-1f4df44f-181d-4deb-95af-0331d6d013f4 service nova] Creating event network-vif-plugged:cc66c773-9cfd-4821-96c2-56ba74e4c8da for instance 1fdeef99-bce1-4bb6-bf12-24015bdb7f39 on n-h2-839401-11 Aug 29 15:39:07.327784 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-25657fb6-1a69-48d3-91fb-9330a4d7d8c3 req-1f4df44f-181d-4deb-95af-0331d6d013f4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106889 Aug 29 15:39:07.328416 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1741/3505] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:07.751113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fa33c0f3-687d-4c2a-8f18-90fe876ffa94 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:07.773056 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fa33c0f3-687d-4c2a-8f18-90fe876ffa94 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1313 microversion: 2.1 time: 0.602427 Aug 29 15:39:07.775000 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1765/3506] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:07 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1313 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:07.784783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0c944122-32ee-4448-9f23-efb11ad57d21 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:07.785570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0c944122-32ee-4448-9f23-efb11ad57d21 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:07.961130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-531da400-c03c-4ab3-b9db-2df8627b3d6d tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Action: 'create', calling method: .version_select at 0x7fc42a74d550>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpCqUOodnp7xN/4yOzPOGmyOmv2aIWmCtFk6XKX2LiwGodU7d3Ct4FasZFS0ZioppRKTVsd1jElDUEBfVnBjUqzBE78TQYEq7YVpTLIAh3HyR41loRhuB/WPIxja6ePKg=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-531da400-c03c-4ab3-b9db-2df8627b3d6d tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Request method failure captured: Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 257 Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN2abWJAc0LvN8-N7QpBYX_d44WpxYW8MApUVrd883QI1IZ41DnsHfRRTrQ9FLBPuOUF8b9-WKqtuONpwmTjxx4i4qWdEUnG3Ov92fVG5snDpDsuPpQw2362fwYnba3nul2mFefoBTqKcwzQtkWiRxqu4j5GKBZp8wZD2X34LkrLClg Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d07ece69c25e4ae8b3f1adeec2b57761 Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d07ece69c25e4ae8b3f1adeec2b57761", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d07ece69c25e4ae8b3f1adeec2b57761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d07ece69c25e4ae8b3f1adeec2b57761"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d07ece69c25e4ae8b3f1adeec2b57761"}]}] Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d07ece69c25e4ae8b3f1adeec2b57761 Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-KeyPairsNegativeTestJSON-2136680545-project Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: ec11cb9a375f45fd920369c78a9b36c5 Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2136680545-project Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpCqUOodnp7xN/4yOzPOGmyOmv2aIWmCtFk6XKX2LiwGodU7d3Ct4FasZFS0ZioppRKTVsd1jElDUEBfVnBjUqzBE78TQYEq7YVpTLIAh3HyR41loRhuB/WPIxja6ePKg=="}} Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpCqUOodnp7xN/4yOzPOGmyOmv2aIWmCtFk6XKX2LiwGodU7d3Ct4FasZFS0ZioppRKTVsd1jElDUEBfVnBjUqzBE78TQYEq7YVpTLIAh3HyR41loRhuB/WPIxja6ePKg=='}}} Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 29 15:39:07.966833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 15:39:07.972049 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:07.982450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-531da400-c03c-4ab3-b9db-2df8627b3d6d tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:07.983591 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-531da400-c03c-4ab3-b9db-2df8627b3d6d tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.652008 Aug 29 15:39:07.988006 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1742/3507] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:39:07 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 657 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:39:08.001368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0c944122-32ee-4448-9f23-efb11ad57d21 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:08.011200 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0c944122-32ee-4448-9f23-efb11ad57d21 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1217 microversion: 2.1 time: 0.234518 Aug 29 15:39:08.011858 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1766/3508] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:07 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1217 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:08.033711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a8c724de-6fd4-40e2-a9c7-16202f18f04b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:08.034340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a8c724de-6fd4-40e2-a9c7-16202f18f04b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:08.042829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8c724de-6fd4-40e2-a9c7-16202f18f04b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:08.043456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8c724de-6fd4-40e2-a9c7-16202f18f04b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:08.044023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8c724de-6fd4-40e2-a9c7-16202f18f04b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:08.044754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8c724de-6fd4-40e2-a9c7-16202f18f04b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:08.045352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8c724de-6fd4-40e2-a9c7-16202f18f04b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:08.046250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8c724de-6fd4-40e2-a9c7-16202f18f04b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:08.267471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a8c724de-6fd4-40e2-a9c7-16202f18f04b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:08.282262 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a8c724de-6fd4-40e2-a9c7-16202f18f04b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1314 microversion: 2.1 time: 0.254848 Aug 29 15:39:08.283371 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1767/3509] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:08 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:08.295275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-84b25897-68ed-4e33-a60e-9cd6df99d59f tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Action: 'create', calling method: .version_select at 0x7fc42a999670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1722009818", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:08.325031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-84b25897-68ed-4e33-a60e-9cd6df99d59f tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Getting quotas for project d07ece69c25e4ae8b3f1adeec2b57761. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:08.327512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-147688574", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "70c7d18d-c80c-49b2-aa5d-0937d4b66aa8"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:08.331150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-84b25897-68ed-4e33-a60e-9cd6df99d59f tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Getting quotas for user ec11cb9a375f45fd920369c78a9b36c5 and project d07ece69c25e4ae8b3f1adeec2b57761. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:08.353981 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-84b25897-68ed-4e33-a60e-9cd6df99d59f tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-84b25897-68ed-4e33-a60e-9cd6df99d59f tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Request method failure captured: Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 2167 Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN2abWJAc0LvN8-N7QpBYX_d44WpxYW8MApUVrd883QI1IZ41DnsHfRRTrQ9FLBPuOUF8b9-WKqtuONpwmTjxx4i4qWdEUnG3Ov92fVG5snDpDsuPpQw2362fwYnba3nul2mFefoBTqKcwzQtkWiRxqu4j5GKBZp8wZD2X34LkrLClg Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d07ece69c25e4ae8b3f1adeec2b57761 Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d07ece69c25e4ae8b3f1adeec2b57761", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d07ece69c25e4ae8b3f1adeec2b57761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d07ece69c25e4ae8b3f1adeec2b57761"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d07ece69c25e4ae8b3f1adeec2b57761"}]}] Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d07ece69c25e4ae8b3f1adeec2b57761 Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-KeyPairsNegativeTestJSON-2136680545-project Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: ec11cb9a375f45fd920369c78a9b36c5 Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2136680545-project Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1722009818", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:39:08.379705 n-d-839401-11 devstack@n-api.service[122360]: exception: Keypair data is invalid: failed to generate fingerprint Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1722009818', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:08.382432 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 29 15:39:08.386696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.391576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-84b25897-68ed-4e33-a60e-9cd6df99d59f tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:08.392664 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-84b25897-68ed-4e33-a60e-9cd6df99d59f tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.108174 Aug 29 15:39:08.394122 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1768/3510] 10.222.0.62 () {60 vars in 1160 bytes} [Mon Aug 29 15:39:08 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:08.398601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] validate_networks() for [('70c7d18d-c80c-49b2-aa5d-0937d4b66aa8', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:08.408061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-86f9d4ea-d797-44c9-bcb6-712bd893148d tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Action: 'create', calling method: .version_select at 0x7fc42aa70dc0>, body: {"keypair": {"name": "tempest-keypair-1704153630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjWaUKc7nUGr12PsEbwCtnnscYk0mOQB7/5kP2KChMc/psXQvXNmMD3U+c5KVw9py+aWedZGI9roHZSRlUD+bmNLJcS9KueOS0SskPNwZkglA130TK4ymMK8MUWYmibQw=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:08.443013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-86f9d4ea-d797-44c9-bcb6-712bd893148d tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Getting quotas for project d07ece69c25e4ae8b3f1adeec2b57761. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:08.451876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-86f9d4ea-d797-44c9-bcb6-712bd893148d tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Getting quotas for user ec11cb9a375f45fd920369c78a9b36c5 and project d07ece69c25e4ae8b3f1adeec2b57761. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:08.492401 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-86f9d4ea-d797-44c9-bcb6-712bd893148d tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.089635 Aug 29 15:39:08.493249 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1769/3511] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:39:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:08.512376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b1b524be-846a-47b9-ab65-d2685e1e2c00 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Action: 'create', calling method: .version_select at 0x7fc42a9ca9d0>, body: {"keypair": {"name": "tempest-keypair-1704153630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNug2Ikus7foOlqcvj8tWiGnHVOhP/QNh9BcolErCNeE/iuF1+qhDiBFcHxuMv4qiv65aLepJVA3uCRh/SDTH+kymM5zBERE6a0YDw2Oz8QT506KGxUDCUPZ7USSX0zOeA=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:08.553814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-b1b524be-846a-47b9-ab65-d2685e1e2c00 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Getting quotas for project d07ece69c25e4ae8b3f1adeec2b57761. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:08.560888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-b1b524be-846a-47b9-ab65-d2685e1e2c00 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Getting quotas for user ec11cb9a375f45fd920369c78a9b36c5 and project d07ece69c25e4ae8b3f1adeec2b57761. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:08.591780 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-b1b524be-846a-47b9-ab65-d2685e1e2c00 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] HTTP exception thrown: Key pair 'tempest-keypair-1704153630' already exists. Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b1b524be-846a-47b9-ab65-d2685e1e2c00 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Request method failure captured: Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 273 Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN2abWJAc0LvN8-N7QpBYX_d44WpxYW8MApUVrd883QI1IZ41DnsHfRRTrQ9FLBPuOUF8b9-WKqtuONpwmTjxx4i4qWdEUnG3Ov92fVG5snDpDsuPpQw2362fwYnba3nul2mFefoBTqKcwzQtkWiRxqu4j5GKBZp8wZD2X34LkrLClg Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d07ece69c25e4ae8b3f1adeec2b57761 Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d07ece69c25e4ae8b3f1adeec2b57761", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d07ece69c25e4ae8b3f1adeec2b57761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d07ece69c25e4ae8b3f1adeec2b57761"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d07ece69c25e4ae8b3f1adeec2b57761"}]}] Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d07ece69c25e4ae8b3f1adeec2b57761 Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-KeyPairsNegativeTestJSON-2136680545-project Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: ec11cb9a375f45fd920369c78a9b36c5 Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2136680545-project Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: {"keypair": {"name": "tempest-keypair-1704153630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNug2Ikus7foOlqcvj8tWiGnHVOhP/QNh9BcolErCNeE/iuF1+qhDiBFcHxuMv4qiv65aLepJVA3uCRh/SDTH+kymM5zBERE6a0YDw2Oz8QT506KGxUDCUPZ7USSX0zOeA=="}} Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: exception: Key pair 'tempest-keypair-1704153630' already exists. Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1704153630', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNug2Ikus7foOlqcvj8tWiGnHVOhP/QNh9BcolErCNeE/iuF1+qhDiBFcHxuMv4qiv65aLepJVA3uCRh/SDTH+kymM5zBERE6a0YDw2Oz8QT506KGxUDCUPZ7USSX0zOeA=='}}} Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'ec11cb9a375f45fd920369c78a9b36c5-tempest-keypair-1704153630' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 29 15:39:08.600219 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi session.flush() Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:39:08.606006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'ec11cb9a375f45fd920369c78a9b36c5-tempest-keypair-1704153630' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 29, 15, 39, 8, 581395), 'updated_at': None, 'name': 'tempest-keypair-1704153630', 'user_id': 'ec11cb9a375f45fd920369c78a9b36c5', 'fingerprint': 'ec:6c:80:ba:e7:39:95:24:b5:72:28:31:ec:97:ee:37', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNug2Ikus7foOlqcvj8tWiGnHVOhP/QNh9BcolErCNeE/iuF1+qhDiBFcHxuMv4qiv65aLepJVA3uCRh/SDTH+kymM5zBERE6a0YDw2Oz8QT506KGxUDCUPZ7USSX0zOeA==', 'type': 'ssh'}] Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi keypair.create() Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._create() Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1704153630' already exists. Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 29 15:39:08.616215 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1704153630' already exists. Aug 29 15:39:08.629254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.629254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.629254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.629254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.629254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:08.629254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:08.629254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:08.629254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:08.629254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1704153630' already exists. Aug 29 15:39:08.629254 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.629254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b1b524be-846a-47b9-ab65-d2685e1e2c00 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Returning 409 to user: Key pair 'tempest-keypair-1704153630' already exists. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:08.629254 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b1b524be-846a-47b9-ab65-d2685e1e2c00 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.100406 Aug 29 15:39:08.629254 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1770/3512] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:39:08 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:39:08.629254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-69434490-fad4-4b5b-a604-53d3dfe0e29c tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Calling method '.version_select at 0x7fc42aaac430>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:08.652704 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-69434490-fad4-4b5b-a604-53d3dfe0e29c tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704153630" status: 202 len: 0 microversion: 2.1 time: 0.041229 Aug 29 15:39:08.660093 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1771/3513] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 15:39:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704153630 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:08.667040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e6ee0666-124d-4f0a-b126-9bb66a54e1ad tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Action: 'create', calling method: .version_select at 0x7fc42aa26310>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+Aynpxh9BCLRyLgkNzi5NP0j7SY4Y25VhQ7JINoxQmesApGoHbdnEFF5h3dWYpiQ6E05pPSp8GMyHM/BEpvkFEt55vKZEZBGENZw6tJOGnBo8kPQh52th7jYr2kEtkJQ=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e6ee0666-124d-4f0a-b126-9bb66a54e1ad tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Request method failure captured: Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 247 Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN2abWJAc0LvN8-N7QpBYX_d44WpxYW8MApUVrd883QI1IZ41DnsHfRRTrQ9FLBPuOUF8b9-WKqtuONpwmTjxx4i4qWdEUnG3Ov92fVG5snDpDsuPpQw2362fwYnba3nul2mFefoBTqKcwzQtkWiRxqu4j5GKBZp8wZD2X34LkrLClg Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d07ece69c25e4ae8b3f1adeec2b57761 Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d07ece69c25e4ae8b3f1adeec2b57761", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d07ece69c25e4ae8b3f1adeec2b57761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d07ece69c25e4ae8b3f1adeec2b57761"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d07ece69c25e4ae8b3f1adeec2b57761"}]}] Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d07ece69c25e4ae8b3f1adeec2b57761 Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-KeyPairsNegativeTestJSON-2136680545-project Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: ec11cb9a375f45fd920369c78a9b36c5 Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2136680545-project Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+Aynpxh9BCLRyLgkNzi5NP0j7SY4Y25VhQ7JINoxQmesApGoHbdnEFF5h3dWYpiQ6E05pPSp8GMyHM/BEpvkFEt55vKZEZBGENZw6tJOGnBo8kPQh52th7jYr2kEtkJQ=="}} Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+Aynpxh9BCLRyLgkNzi5NP0j7SY4Y25VhQ7JINoxQmesApGoHbdnEFF5h3dWYpiQ6E05pPSp8GMyHM/BEpvkFEt55vKZEZBGENZw6tJOGnBo8kPQh52th7jYr2kEtkJQ=='}}} Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi '' Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:39:08.672662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e6ee0666-124d-4f0a-b126-9bb66a54e1ad tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e6ee0666-124d-4f0a-b126-9bb66a54e1ad tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.011886 Aug 29 15:39:08.682748 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1772/3514] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:39:08 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:39:08.694312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c80cb63-c552-4d91-991a-faa334d27270 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Action: 'create', calling method: .version_select at 0x7fc42aaf38b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-892752276", "public_key": " "}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:08.723821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-5c80cb63-c552-4d91-991a-faa334d27270 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Getting quotas for project d07ece69c25e4ae8b3f1adeec2b57761. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:08.733729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-5c80cb63-c552-4d91-991a-faa334d27270 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Getting quotas for user ec11cb9a375f45fd920369c78a9b36c5 and project d07ece69c25e4ae8b3f1adeec2b57761. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:08.759895 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-5c80cb63-c552-4d91-991a-faa334d27270 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c80cb63-c552-4d91-991a-faa334d27270 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Request method failure captured: Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 94 Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN2abWJAc0LvN8-N7QpBYX_d44WpxYW8MApUVrd883QI1IZ41DnsHfRRTrQ9FLBPuOUF8b9-WKqtuONpwmTjxx4i4qWdEUnG3Ov92fVG5snDpDsuPpQw2362fwYnba3nul2mFefoBTqKcwzQtkWiRxqu4j5GKBZp8wZD2X34LkrLClg Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d07ece69c25e4ae8b3f1adeec2b57761 Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d07ece69c25e4ae8b3f1adeec2b57761", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d07ece69c25e4ae8b3f1adeec2b57761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d07ece69c25e4ae8b3f1adeec2b57761"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d07ece69c25e4ae8b3f1adeec2b57761"}]}] Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d07ece69c25e4ae8b3f1adeec2b57761 Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-KeyPairsNegativeTestJSON-2136680545-project Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: ec11cb9a375f45fd920369c78a9b36c5 Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2136680545-project Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-892752276", "public_key": " "}} Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: exception: Keypair data is invalid: failed to generate fingerprint Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-892752276', 'public_key': ' '}}} Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.762456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c80cb63-c552-4d91-991a-faa334d27270 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5c80cb63-c552-4d91-991a-faa334d27270 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.081758 Aug 29 15:39:08.776005 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1773/3515] 10.222.0.62 () {60 vars in 1158 bytes} [Mon Aug 29 15:39:08 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:08.779364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b7a5b44-b620-48a4-a18a-b27b6d5263fa tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Action: 'create', calling method: .version_select at 0x7fc42aa89040>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgoX7I5LqsNZkdoUsgSqztOoB7nWv8jLSfyIgEVSOng43C6Q/twqg4mjGfIVNDMZs0J5BwhxcHZfikTecLRPOJUrtSfiCF5mrQ94lk3IQ0H99WNoR90JEYZS1jno7YPkw=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b7a5b44-b620-48a4-a18a-b27b6d5263fa tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Request method failure captured: Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 507 Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN2abWJAc0LvN8-N7QpBYX_d44WpxYW8MApUVrd883QI1IZ41DnsHfRRTrQ9FLBPuOUF8b9-WKqtuONpwmTjxx4i4qWdEUnG3Ov92fVG5snDpDsuPpQw2362fwYnba3nul2mFefoBTqKcwzQtkWiRxqu4j5GKBZp8wZD2X34LkrLClg Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d07ece69c25e4ae8b3f1adeec2b57761 Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d07ece69c25e4ae8b3f1adeec2b57761", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d07ece69c25e4ae8b3f1adeec2b57761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d07ece69c25e4ae8b3f1adeec2b57761"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d07ece69c25e4ae8b3f1adeec2b57761"}]}] Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d07ece69c25e4ae8b3f1adeec2b57761 Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-KeyPairsNegativeTestJSON-2136680545-project Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: ec11cb9a375f45fd920369c78a9b36c5 Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2136680545-project Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgoX7I5LqsNZkdoUsgSqztOoB7nWv8jLSfyIgEVSOng43C6Q/twqg4mjGfIVNDMZs0J5BwhxcHZfikTecLRPOJUrtSfiCF5mrQ94lk3IQ0H99WNoR90JEYZS1jno7YPkw=="}} Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgoX7I5LqsNZkdoUsgSqztOoB7nWv8jLSfyIgEVSOng43C6Q/twqg4mjGfIVNDMZs0J5BwhxcHZfikTecLRPOJUrtSfiCF5mrQ94lk3IQ0H99WNoR90JEYZS1jno7YPkw=='}}} Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 29 15:39:08.783883 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b7a5b44-b620-48a4-a18a-b27b6d5263fa tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8b7a5b44-b620-48a4-a18a-b27b6d5263fa tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.011290 Aug 29 15:39:08.787794 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1774/3516] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:39:08 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:39:08.799972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-720ad62d-9ecb-4858-80d9-de689ce6acaa req-c9866723-9848-4cdc-b854-5c9c95f13ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a392ebb-7660-40af-aba2-c868f57678ce", "tag": "97f1d98b-81b5-4056-ab03-28adf09ab996"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:08.814889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-720ad62d-9ecb-4858-80d9-de689ce6acaa req-c9866723-9848-4cdc-b854-5c9c95f13ef0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:08.815562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-720ad62d-9ecb-4858-80d9-de689ce6acaa req-c9866723-9848-4cdc-b854-5c9c95f13ef0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:08.816566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-720ad62d-9ecb-4858-80d9-de689ce6acaa req-c9866723-9848-4cdc-b854-5c9c95f13ef0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:08.833161 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-720ad62d-9ecb-4858-80d9-de689ce6acaa req-c9866723-9848-4cdc-b854-5c9c95f13ef0 service nova] Creating event network-changed:97f1d98b-81b5-4056-ab03-28adf09ab996 for instance 0a392ebb-7660-40af-aba2-c868f57678ce on n-h1-839401-11 Aug 29 15:39:08.852673 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-720ad62d-9ecb-4858-80d9-de689ce6acaa req-c9866723-9848-4cdc-b854-5c9c95f13ef0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057579 Aug 29 15:39:08.854550 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1775/3517] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:08.863723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e1bbeae6-3078-47f1-8647-0939a63bfb58 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:08.864434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e1bbeae6-3078-47f1-8647-0939a63bfb58 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:08.873819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1bbeae6-3078-47f1-8647-0939a63bfb58 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:08.874329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1bbeae6-3078-47f1-8647-0939a63bfb58 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:08.874771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1bbeae6-3078-47f1-8647-0939a63bfb58 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:08.875530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1bbeae6-3078-47f1-8647-0939a63bfb58 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:08.876012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1bbeae6-3078-47f1-8647-0939a63bfb58 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:08.877157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1bbeae6-3078-47f1-8647-0939a63bfb58 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.027649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e1bbeae6-3078-47f1-8647-0939a63bfb58 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:09.053054 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e1bbeae6-3078-47f1-8647-0939a63bfb58 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1313 microversion: 2.1 time: 0.194896 Aug 29 15:39:09.053770 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1776/3518] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:08 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:09.063252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-784a6215-3427-460a-983a-6ca1149500e4 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Action: 'create', calling method: .version_select at 0x7fc42a999ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1815258950", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:09.088710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-784a6215-3427-460a-983a-6ca1149500e4 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Getting quotas for project d07ece69c25e4ae8b3f1adeec2b57761. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:09.114415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-784a6215-3427-460a-983a-6ca1149500e4 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Getting quotas for user ec11cb9a375f45fd920369c78a9b36c5 and project d07ece69c25e4ae8b3f1adeec2b57761. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:09.135635 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-784a6215-3427-460a-983a-6ca1149500e4 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-784a6215-3427-460a-983a-6ca1149500e4 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Request method failure captured: Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 118 Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN2abWJAc0LvN8-N7QpBYX_d44WpxYW8MApUVrd883QI1IZ41DnsHfRRTrQ9FLBPuOUF8b9-WKqtuONpwmTjxx4i4qWdEUnG3Ov92fVG5snDpDsuPpQw2362fwYnba3nul2mFefoBTqKcwzQtkWiRxqu4j5GKBZp8wZD2X34LkrLClg Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d07ece69c25e4ae8b3f1adeec2b57761 Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d07ece69c25e4ae8b3f1adeec2b57761", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d07ece69c25e4ae8b3f1adeec2b57761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d07ece69c25e4ae8b3f1adeec2b57761"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d07ece69c25e4ae8b3f1adeec2b57761"}]}] Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d07ece69c25e4ae8b3f1adeec2b57761 Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-KeyPairsNegativeTestJSON-2136680545-project Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: ec11cb9a375f45fd920369c78a9b36c5 Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2136680545-project Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1815258950", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: exception: Keypair data is invalid: failed to generate fingerprint Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1815258950', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 29 15:39:09.141390 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 29 15:39:09.147154 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.159090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-784a6215-3427-460a-983a-6ca1149500e4 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:09.161402 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-784a6215-3427-460a-983a-6ca1149500e4 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.105399 Aug 29 15:39:09.165477 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1777/3519] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:39:09 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:09.179490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6023fae9-8c8a-4e40-b438-b7c859599cb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:09.180102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6023fae9-8c8a-4e40-b438-b7c859599cb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:09.183303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:09.196657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6023fae9-8c8a-4e40-b438-b7c859599cb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.197181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6023fae9-8c8a-4e40-b438-b7c859599cb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.198162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6023fae9-8c8a-4e40-b438-b7c859599cb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.199892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6023fae9-8c8a-4e40-b438-b7c859599cb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.200532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6023fae9-8c8a-4e40-b438-b7c859599cb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.201134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6023fae9-8c8a-4e40-b438-b7c859599cb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.314979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6023fae9-8c8a-4e40-b438-b7c859599cb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:09.331841 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6023fae9-8c8a-4e40-b438-b7c859599cb3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1269 microversion: 2.1 time: 0.163857 Aug 29 15:39:09.332439 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1778/3520] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:09 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:09.349396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-961139cb-4197-4512-8434-997d81a869d0 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Calling method '.version_select at 0x7fc42aaf35e0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:09.371232 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-961139cb-4197-4512-8434-997d81a869d0 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-41331826 not found for user ec11cb9a375f45fd920369c78a9b36c5 Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-961139cb-4197-4512-8434-997d81a869d0 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Request method failure captured: Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-41331826 HTTP/1.1 Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN2abWJAc0LvN8-N7QpBYX_d44WpxYW8MApUVrd883QI1IZ41DnsHfRRTrQ9FLBPuOUF8b9-WKqtuONpwmTjxx4i4qWdEUnG3Ov92fVG5snDpDsuPpQw2362fwYnba3nul2mFefoBTqKcwzQtkWiRxqu4j5GKBZp8wZD2X34LkrLClg Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d07ece69c25e4ae8b3f1adeec2b57761 Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d07ece69c25e4ae8b3f1adeec2b57761", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d07ece69c25e4ae8b3f1adeec2b57761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d07ece69c25e4ae8b3f1adeec2b57761"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d07ece69c25e4ae8b3f1adeec2b57761"}]}] Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d07ece69c25e4ae8b3f1adeec2b57761 Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2136680545 Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-KeyPairsNegativeTestJSON-2136680545-project Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: ec11cb9a375f45fd920369c78a9b36c5 Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2136680545-project Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: exception: Keypair tempest-keypair-non-existent-41331826 not found for user ec11cb9a375f45fd920369c78a9b36c5 Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'tempest-keypair-non-existent-41331826'} Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-41331826 not found for user ec11cb9a375f45fd920369c78a9b36c5 Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.373388 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-41331826 not found for user ec11cb9a375f45fd920369c78a9b36c5 Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-41331826 not found for user ec11cb9a375f45fd920369c78a9b36c5 Aug 29 15:39:09.377891 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:09.383777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-961139cb-4197-4512-8434-997d81a869d0 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] Returning 404 to user: Keypair tempest-keypair-non-existent-41331826 not found for user ec11cb9a375f45fd920369c78a9b36c5 {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:09.390591 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-961139cb-4197-4512-8434-997d81a869d0 tempest-KeyPairsNegativeTestJSON-2136680545 tempest-KeyPairsNegativeTestJSON-2136680545-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-41331826" status: 404 len: 143 microversion: 2.1 time: 0.055608 Aug 29 15:39:09.391362 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1779/3521] 10.222.0.62 () {58 vars in 1254 bytes} [Mon Aug 29 15:39:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-41331826 => generated 143 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:09.400771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f05b87a-3adc-41bf-9ea7-3846527e4810 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:09.401651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3f05b87a-3adc-41bf-9ea7-3846527e4810 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:09.423207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f05b87a-3adc-41bf-9ea7-3846527e4810 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.424037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f05b87a-3adc-41bf-9ea7-3846527e4810 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.424658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f05b87a-3adc-41bf-9ea7-3846527e4810 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.425635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f05b87a-3adc-41bf-9ea7-3846527e4810 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.426271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f05b87a-3adc-41bf-9ea7-3846527e4810 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.426862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f05b87a-3adc-41bf-9ea7-3846527e4810 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.891619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3f05b87a-3adc-41bf-9ea7-3846527e4810 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:09.900717 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3f05b87a-3adc-41bf-9ea7-3846527e4810 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1314 microversion: 2.1 time: 0.507955 Aug 29 15:39:09.903969 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1780/3522] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:09 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:10.076566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a2f8f5a2-1fca-48fc-9eea-472f3e439a1e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:10.077328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a2f8f5a2-1fca-48fc-9eea-472f3e439a1e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:10.092263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2f8f5a2-1fca-48fc-9eea-472f3e439a1e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.097001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2f8f5a2-1fca-48fc-9eea-472f3e439a1e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.097896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2f8f5a2-1fca-48fc-9eea-472f3e439a1e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.099542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2f8f5a2-1fca-48fc-9eea-472f3e439a1e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.100463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2f8f5a2-1fca-48fc-9eea-472f3e439a1e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.101366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2f8f5a2-1fca-48fc-9eea-472f3e439a1e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.233899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:10.234896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:10.235576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:10.236261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:10.236863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:10.257275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.258120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.259576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.261435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.264150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.267762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.331539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Getting quotas for project f85af5b50c7e45fc8d1435c0acd2fd0f. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:10.345695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Getting quotas for user 89489223f1fc43bca50388a91cf48afd and project f85af5b50c7e45fc8d1435c0acd2fd0f. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:10.347197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a2f8f5a2-1fca-48fc-9eea-472f3e439a1e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:10.358462 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a2f8f5a2-1fca-48fc-9eea-472f3e439a1e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1462 microversion: 2.1 time: 0.287550 Aug 29 15:39:10.365250 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1781/3523] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:10 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1462 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:10.380276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b75270e4-10be-4346-8dd0-bf77ce865db8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:10.383824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b75270e4-10be-4346-8dd0-bf77ce865db8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:10.396783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:10.400174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b75270e4-10be-4346-8dd0-bf77ce865db8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.402652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:10.403282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b75270e4-10be-4346-8dd0-bf77ce865db8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.404028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b75270e4-10be-4346-8dd0-bf77ce865db8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.405189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b75270e4-10be-4346-8dd0-bf77ce865db8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.407519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b75270e4-10be-4346-8dd0-bf77ce865db8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.408200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b75270e4-10be-4346-8dd0-bf77ce865db8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.502355 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f1c946c7-107e-4e2f-9ef4-3da1ac91da16 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.512517 Aug 29 15:39:10.503647 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1743/3524] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:39:10.514701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-97fec836-89a4-42d6-a4b8-abacaf9225fa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:10.516777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-97fec836-89a4-42d6-a4b8-abacaf9225fa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:10.533462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97fec836-89a4-42d6-a4b8-abacaf9225fa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.536731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97fec836-89a4-42d6-a4b8-abacaf9225fa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.537372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97fec836-89a4-42d6-a4b8-abacaf9225fa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.538298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97fec836-89a4-42d6-a4b8-abacaf9225fa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.541856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97fec836-89a4-42d6-a4b8-abacaf9225fa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.542443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97fec836-89a4-42d6-a4b8-abacaf9225fa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.581796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b75270e4-10be-4346-8dd0-bf77ce865db8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:10.597387 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b75270e4-10be-4346-8dd0-bf77ce865db8 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1275 microversion: 2.1 time: 0.228846 Aug 29 15:39:10.598024 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1782/3525] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:10 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1275 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:10.618516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-72d38e43-5941-4546-a392-b3b60b4cc3da req-ce632b6a-f040-4330-8d7c-2ed418076156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "tag": "528dfe97-4f5f-4f10-a2cd-7936781f265f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:10.665516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-72d38e43-5941-4546-a392-b3b60b4cc3da req-ce632b6a-f040-4330-8d7c-2ed418076156 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.666049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-72d38e43-5941-4546-a392-b3b60b4cc3da req-ce632b6a-f040-4330-8d7c-2ed418076156 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.670178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-72d38e43-5941-4546-a392-b3b60b4cc3da req-ce632b6a-f040-4330-8d7c-2ed418076156 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.709735 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-72d38e43-5941-4546-a392-b3b60b4cc3da req-ce632b6a-f040-4330-8d7c-2ed418076156 service nova] Creating event network-changed:528dfe97-4f5f-4f10-a2cd-7936781f265f for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:39:10.727390 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-72d38e43-5941-4546-a392-b3b60b4cc3da req-ce632b6a-f040-4330-8d7c-2ed418076156 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127910 Aug 29 15:39:10.729862 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1783/3526] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:10.746808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f2f714ee-bab6-4e4d-ab8f-4aa213259ed9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:10.751734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f2f714ee-bab6-4e4d-ab8f-4aa213259ed9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:11.150083 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f2f714ee-bab6-4e4d-ab8f-4aa213259ed9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:11.161756 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f2f714ee-bab6-4e4d-ab8f-4aa213259ed9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1215 microversion: 2.1 time: 0.427155 Aug 29 15:39:11.164545 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1784/3527] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:10 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1215 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:11.180982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1928fd5d-f441-467d-ab9c-078edea4b5af tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:11.182088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1928fd5d-f441-467d-ab9c-078edea4b5af tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:11.205475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1928fd5d-f441-467d-ab9c-078edea4b5af tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:11.207134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1928fd5d-f441-467d-ab9c-078edea4b5af tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:11.209444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1928fd5d-f441-467d-ab9c-078edea4b5af tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:11.211655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1928fd5d-f441-467d-ab9c-078edea4b5af tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:11.214187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1928fd5d-f441-467d-ab9c-078edea4b5af tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:11.214913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1928fd5d-f441-467d-ab9c-078edea4b5af tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:11.370218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-97fec836-89a4-42d6-a4b8-abacaf9225fa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:11.379176 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-97fec836-89a4-42d6-a4b8-abacaf9225fa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1464 microversion: 2.1 time: 0.874042 Aug 29 15:39:11.386484 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1744/3528] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:10 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1464 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:11.606151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1928fd5d-f441-467d-ab9c-078edea4b5af tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:11.617840 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1928fd5d-f441-467d-ab9c-078edea4b5af tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1314 microversion: 2.1 time: 0.450988 Aug 29 15:39:11.629459 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1785/3529] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:11 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:11.631432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0986d498-6d97-48f5-b4fd-74f87f8704c3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:11.631432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0986d498-6d97-48f5-b4fd-74f87f8704c3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:11.641750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0986d498-6d97-48f5-b4fd-74f87f8704c3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:11.643480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0986d498-6d97-48f5-b4fd-74f87f8704c3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:11.644748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0986d498-6d97-48f5-b4fd-74f87f8704c3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:11.645018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1703648986", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b1199ee4-c322-4c37-a53e-1bf029c7f14c"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:11.649779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0986d498-6d97-48f5-b4fd-74f87f8704c3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:11.651002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0986d498-6d97-48f5-b4fd-74f87f8704c3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:11.651878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0986d498-6d97-48f5-b4fd-74f87f8704c3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:11.762686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] validate_networks() for None {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:11.876501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:12.453721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0986d498-6d97-48f5-b4fd-74f87f8704c3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:12.467053 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0986d498-6d97-48f5-b4fd-74f87f8704c3 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1317 microversion: 2.1 time: 0.849100 Aug 29 15:39:12.468677 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1745/3530] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:11 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1317 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:12.499461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a90c1ba5-a4e3-4a29-b064-1f5052a40d03 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:12.499461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a90c1ba5-a4e3-4a29-b064-1f5052a40d03 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:12.516605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a90c1ba5-a4e3-4a29-b064-1f5052a40d03 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.517248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a90c1ba5-a4e3-4a29-b064-1f5052a40d03 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.517918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a90c1ba5-a4e3-4a29-b064-1f5052a40d03 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.518438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a90c1ba5-a4e3-4a29-b064-1f5052a40d03 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.519510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a90c1ba5-a4e3-4a29-b064-1f5052a40d03 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.520433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a90c1ba5-a4e3-4a29-b064-1f5052a40d03 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.596374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:12.597404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:12.598441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:12.599298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:12.599883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:12.620161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.621921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.622963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.630426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.631406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.632096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.663839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a90c1ba5-a4e3-4a29-b064-1f5052a40d03 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:12.675127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Getting quotas for project f7b1f33fac61405285832b32e2a5c0b4. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:12.681223 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a90c1ba5-a4e3-4a29-b064-1f5052a40d03 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1267 microversion: 2.1 time: 0.187428 Aug 29 15:39:12.684865 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1746/3531] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:12 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:12.703549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Getting quotas for user 0fefa09e4bbb4101b5f05a2f20fcb41c and project f7b1f33fac61405285832b32e2a5c0b4. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:12.709463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-38ac6191-0f29-4517-87e2-abff18ed5e3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:12.713438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-38ac6191-0f29-4517-87e2-abff18ed5e3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:12.743189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ac6191-0f29-4517-87e2-abff18ed5e3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.750190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ac6191-0f29-4517-87e2-abff18ed5e3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.752383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ac6191-0f29-4517-87e2-abff18ed5e3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.759155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ac6191-0f29-4517-87e2-abff18ed5e3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.760376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ac6191-0f29-4517-87e2-abff18ed5e3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.762621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ac6191-0f29-4517-87e2-abff18ed5e3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.784757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:12.795790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:12.950367 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fcf18f25-ef1f-47bd-a14f-c7136c11bc8c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.308900 Aug 29 15:39:12.954653 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1786/3532] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:39:12.966368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dab3f15c-aa02-4d64-8acb-6ef3fd958eef tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:12.969813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dab3f15c-aa02-4d64-8acb-6ef3fd958eef tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:13.403744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dab3f15c-aa02-4d64-8acb-6ef3fd958eef tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:13.414151 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dab3f15c-aa02-4d64-8acb-6ef3fd958eef tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1214 microversion: 2.1 time: 0.451902 Aug 29 15:39:13.419146 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1787/3533] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:12 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1214 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:13.494078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-519a9de4-767c-4ed2-8ed1-91ce030ebc60 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:13.494818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-519a9de4-767c-4ed2-8ed1-91ce030ebc60 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:13.507961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-519a9de4-767c-4ed2-8ed1-91ce030ebc60 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.508669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-519a9de4-767c-4ed2-8ed1-91ce030ebc60 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.509434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-519a9de4-767c-4ed2-8ed1-91ce030ebc60 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.528568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-519a9de4-767c-4ed2-8ed1-91ce030ebc60 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.537310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-519a9de4-767c-4ed2-8ed1-91ce030ebc60 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.538041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-519a9de4-767c-4ed2-8ed1-91ce030ebc60 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.104232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-519a9de4-767c-4ed2-8ed1-91ce030ebc60 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:14.123656 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-519a9de4-767c-4ed2-8ed1-91ce030ebc60 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1317 microversion: 2.1 time: 0.633718 Aug 29 15:39:14.124557 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1788/3534] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:13 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:14.134893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-af510774-c13b-4c40-91f2-1ab27ca50ca9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:14.135767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-af510774-c13b-4c40-91f2-1ab27ca50ca9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:14.152536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af510774-c13b-4c40-91f2-1ab27ca50ca9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.153334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af510774-c13b-4c40-91f2-1ab27ca50ca9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.153970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af510774-c13b-4c40-91f2-1ab27ca50ca9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.155005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af510774-c13b-4c40-91f2-1ab27ca50ca9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.158347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af510774-c13b-4c40-91f2-1ab27ca50ca9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.158980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af510774-c13b-4c40-91f2-1ab27ca50ca9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.436696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-38ac6191-0f29-4517-87e2-abff18ed5e3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:14.448565 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-38ac6191-0f29-4517-87e2-abff18ed5e3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1314 microversion: 2.1 time: 1.761619 Aug 29 15:39:14.449256 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1747/3535] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:12 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1314 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:14.463403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4c85841b-2594-46cf-aa5f-420bbe59860e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:14.464369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4c85841b-2594-46cf-aa5f-420bbe59860e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:14.471459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c85841b-2594-46cf-aa5f-420bbe59860e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.476728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c85841b-2594-46cf-aa5f-420bbe59860e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.477627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c85841b-2594-46cf-aa5f-420bbe59860e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.478691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c85841b-2594-46cf-aa5f-420bbe59860e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.482645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c85841b-2594-46cf-aa5f-420bbe59860e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.483294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c85841b-2594-46cf-aa5f-420bbe59860e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.688874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4c85841b-2594-46cf-aa5f-420bbe59860e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:14.702943 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4c85841b-2594-46cf-aa5f-420bbe59860e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1210 microversion: 2.1 time: 0.250219 Aug 29 15:39:14.704885 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1748/3536] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:14 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1210 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:14.717754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-af510774-c13b-4c40-91f2-1ab27ca50ca9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:14.730070 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-af510774-c13b-4c40-91f2-1ab27ca50ca9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1273 microversion: 2.1 time: 0.603853 Aug 29 15:39:14.732857 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1789/3537] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:14 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1273 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:15.153701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c9682f36-bf8a-4c44-a235-e0cd55faf07e tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:15.154889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c9682f36-bf8a-4c44-a235-e0cd55faf07e tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:15.165032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9682f36-bf8a-4c44-a235-e0cd55faf07e tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.166154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9682f36-bf8a-4c44-a235-e0cd55faf07e tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.166810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9682f36-bf8a-4c44-a235-e0cd55faf07e tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.168671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9682f36-bf8a-4c44-a235-e0cd55faf07e tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.170387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9682f36-bf8a-4c44-a235-e0cd55faf07e tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.171307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9682f36-bf8a-4c44-a235-e0cd55faf07e tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.472696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-86e9027e-e07f-43bd-87ab-c6f0cdd3239d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:15.473972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-86e9027e-e07f-43bd-87ab-c6f0cdd3239d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:15.497582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86e9027e-e07f-43bd-87ab-c6f0cdd3239d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.499996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86e9027e-e07f-43bd-87ab-c6f0cdd3239d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.502695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86e9027e-e07f-43bd-87ab-c6f0cdd3239d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.521930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86e9027e-e07f-43bd-87ab-c6f0cdd3239d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.525775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86e9027e-e07f-43bd-87ab-c6f0cdd3239d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.527869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86e9027e-e07f-43bd-87ab-c6f0cdd3239d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.990773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-86e9027e-e07f-43bd-87ab-c6f0cdd3239d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:16.008920 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-86e9027e-e07f-43bd-87ab-c6f0cdd3239d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1314 microversion: 2.1 time: 0.541792 Aug 29 15:39:16.009908 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1790/3538] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:15 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:16.031744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6c1ed9c8-d6aa-42d5-9c68-22262038526b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:16.032735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6c1ed9c8-d6aa-42d5-9c68-22262038526b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:16.040300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c1ed9c8-d6aa-42d5-9c68-22262038526b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.041385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c1ed9c8-d6aa-42d5-9c68-22262038526b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.042041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c1ed9c8-d6aa-42d5-9c68-22262038526b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.043493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c1ed9c8-d6aa-42d5-9c68-22262038526b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.044538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c1ed9c8-d6aa-42d5-9c68-22262038526b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.045613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c1ed9c8-d6aa-42d5-9c68-22262038526b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.160801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6c1ed9c8-d6aa-42d5-9c68-22262038526b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:16.168075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:16.180693 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6c1ed9c8-d6aa-42d5-9c68-22262038526b tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1272 microversion: 2.1 time: 0.155067 Aug 29 15:39:16.182593 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1791/3539] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:16 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:16.195518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7afa31ba-0fed-45a3-a90b-5d426249f3bb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:16.197537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7afa31ba-0fed-45a3-a90b-5d426249f3bb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:16.215765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7afa31ba-0fed-45a3-a90b-5d426249f3bb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.216645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7afa31ba-0fed-45a3-a90b-5d426249f3bb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.217646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7afa31ba-0fed-45a3-a90b-5d426249f3bb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.220209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7afa31ba-0fed-45a3-a90b-5d426249f3bb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.222462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7afa31ba-0fed-45a3-a90b-5d426249f3bb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.223207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7afa31ba-0fed-45a3-a90b-5d426249f3bb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.230376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c9682f36-bf8a-4c44-a235-e0cd55faf07e tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:16.250931 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c9682f36-bf8a-4c44-a235-e0cd55faf07e tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1317 microversion: 2.1 time: 1.109232 Aug 29 15:39:16.252274 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1749/3540] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:15 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1317 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:16.267070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-6bbddf81-67d9-423f-b45b-867994dcd068 req-bd4d4921-3bac-42a6-ab2f-10265af5333f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a392ebb-7660-40af-aba2-c868f57678ce", "name": "network-vif-plugged", "status": "completed", "tag": "97f1d98b-81b5-4056-ab03-28adf09ab996"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:16.294779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6bbddf81-67d9-423f-b45b-867994dcd068 req-bd4d4921-3bac-42a6-ab2f-10265af5333f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.297710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6bbddf81-67d9-423f-b45b-867994dcd068 req-bd4d4921-3bac-42a6-ab2f-10265af5333f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.299053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6bbddf81-67d9-423f-b45b-867994dcd068 req-bd4d4921-3bac-42a6-ab2f-10265af5333f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.330760 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-6bbddf81-67d9-423f-b45b-867994dcd068 req-bd4d4921-3bac-42a6-ab2f-10265af5333f service nova] Creating event network-vif-plugged:97f1d98b-81b5-4056-ab03-28adf09ab996 for instance 0a392ebb-7660-40af-aba2-c868f57678ce on n-h1-839401-11 Aug 29 15:39:16.337273 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-6bbddf81-67d9-423f-b45b-867994dcd068 req-bd4d4921-3bac-42a6-ab2f-10265af5333f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082217 Aug 29 15:39:16.338380 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1750/3541] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:16.490380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7afa31ba-0fed-45a3-a90b-5d426249f3bb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:16.500754 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7afa31ba-0fed-45a3-a90b-5d426249f3bb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1273 microversion: 2.1 time: 0.316096 Aug 29 15:39:16.512538 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1792/3542] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:16 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1273 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:17.042481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-24c6b8f7-9ef1-4054-aaa7-bda31be53a1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:17.044855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-24c6b8f7-9ef1-4054-aaa7-bda31be53a1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:17.063944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24c6b8f7-9ef1-4054-aaa7-bda31be53a1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:17.064633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24c6b8f7-9ef1-4054-aaa7-bda31be53a1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:17.065129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24c6b8f7-9ef1-4054-aaa7-bda31be53a1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:17.068390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24c6b8f7-9ef1-4054-aaa7-bda31be53a1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:17.072487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24c6b8f7-9ef1-4054-aaa7-bda31be53a1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:17.072992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24c6b8f7-9ef1-4054-aaa7-bda31be53a1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:17.204584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e2f810d6-e75f-40b7-af7e-166c509bc7aa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:17.207276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e2f810d6-e75f-40b7-af7e-166c509bc7aa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:17.219608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2f810d6-e75f-40b7-af7e-166c509bc7aa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:17.220116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2f810d6-e75f-40b7-af7e-166c509bc7aa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:17.220594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2f810d6-e75f-40b7-af7e-166c509bc7aa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:17.221352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2f810d6-e75f-40b7-af7e-166c509bc7aa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:17.221878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2f810d6-e75f-40b7-af7e-166c509bc7aa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:17.222256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2f810d6-e75f-40b7-af7e-166c509bc7aa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:17.310218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e2f810d6-e75f-40b7-af7e-166c509bc7aa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:17.320199 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e2f810d6-e75f-40b7-af7e-166c509bc7aa tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1272 microversion: 2.1 time: 0.120250 Aug 29 15:39:17.321421 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1793/3543] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:17 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:17.326608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-31642a0a-924f-4910-89d6-6e6c6c65752c tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:17.327499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-31642a0a-924f-4910-89d6-6e6c6c65752c tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:17.336144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31642a0a-924f-4910-89d6-6e6c6c65752c tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:17.336841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31642a0a-924f-4910-89d6-6e6c6c65752c tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:17.337540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31642a0a-924f-4910-89d6-6e6c6c65752c tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:17.338590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31642a0a-924f-4910-89d6-6e6c6c65752c tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:17.339275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31642a0a-924f-4910-89d6-6e6c6c65752c tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:17.340045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31642a0a-924f-4910-89d6-6e6c6c65752c tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:17.572368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-31642a0a-924f-4910-89d6-6e6c6c65752c tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:17.588474 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-31642a0a-924f-4910-89d6-6e6c6c65752c tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1317 microversion: 2.1 time: 0.265601 Aug 29 15:39:17.589875 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1794/3544] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:17 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:17.595745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-2c4bb4bf-4813-49a1-a1f9-c4a62f01daf3 req-48fe23ff-ffb9-4cad-8af7-26f8156e7c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "351a3593-bfab-4658-9e1f-fc9e81ba3e27", "tag": "f3ac8d50-8c2d-416e-abb4-e43e6b31ade5"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:17.606559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2c4bb4bf-4813-49a1-a1f9-c4a62f01daf3 req-48fe23ff-ffb9-4cad-8af7-26f8156e7c52 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:17.607289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2c4bb4bf-4813-49a1-a1f9-c4a62f01daf3 req-48fe23ff-ffb9-4cad-8af7-26f8156e7c52 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:17.607893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2c4bb4bf-4813-49a1-a1f9-c4a62f01daf3 req-48fe23ff-ffb9-4cad-8af7-26f8156e7c52 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:17.625354 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-2c4bb4bf-4813-49a1-a1f9-c4a62f01daf3 req-48fe23ff-ffb9-4cad-8af7-26f8156e7c52 service nova] Creating event network-changed:f3ac8d50-8c2d-416e-abb4-e43e6b31ade5 for instance 351a3593-bfab-4658-9e1f-fc9e81ba3e27 on n-h1-839401-11 Aug 29 15:39:17.632655 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-2c4bb4bf-4813-49a1-a1f9-c4a62f01daf3 req-48fe23ff-ffb9-4cad-8af7-26f8156e7c52 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041395 Aug 29 15:39:17.633858 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1795/3545] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:17.647559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f6fba082-ee9e-4105-a395-e071df8c4094 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:17.648662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f6fba082-ee9e-4105-a395-e071df8c4094 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:17.662784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6fba082-ee9e-4105-a395-e071df8c4094 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:17.665244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6fba082-ee9e-4105-a395-e071df8c4094 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:17.665740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6fba082-ee9e-4105-a395-e071df8c4094 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:17.666497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6fba082-ee9e-4105-a395-e071df8c4094 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:17.666918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6fba082-ee9e-4105-a395-e071df8c4094 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:17.668189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6fba082-ee9e-4105-a395-e071df8c4094 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:17.914189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-24c6b8f7-9ef1-4054-aaa7-bda31be53a1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:17.927740 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-24c6b8f7-9ef1-4054-aaa7-bda31be53a1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1314 microversion: 2.1 time: 0.895957 Aug 29 15:39:17.929112 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1751/3546] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:17 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1314 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:17.985323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f6fba082-ee9e-4105-a395-e071df8c4094 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:17.996871 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f6fba082-ee9e-4105-a395-e071df8c4094 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1315 microversion: 2.1 time: 0.359222 Aug 29 15:39:17.997706 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1796/3547] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:17 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:18.343513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-98b18a7e-123f-4178-b510-cf3ebacca4b2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:18.344695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-98b18a7e-123f-4178-b510-cf3ebacca4b2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:18.352877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98b18a7e-123f-4178-b510-cf3ebacca4b2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:18.353425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98b18a7e-123f-4178-b510-cf3ebacca4b2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:18.353863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98b18a7e-123f-4178-b510-cf3ebacca4b2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:18.355721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98b18a7e-123f-4178-b510-cf3ebacca4b2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:18.356382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98b18a7e-123f-4178-b510-cf3ebacca4b2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:18.356978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98b18a7e-123f-4178-b510-cf3ebacca4b2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:18.360561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:18.590381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-98b18a7e-123f-4178-b510-cf3ebacca4b2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:18.599720 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-98b18a7e-123f-4178-b510-cf3ebacca4b2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1272 microversion: 2.1 time: 0.262136 Aug 29 15:39:18.600747 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1752/3548] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:18 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1272 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:18.617336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-954a5a4f-58a5-4dde-beaf-7ac719511eff tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:18.618631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-954a5a4f-58a5-4dde-beaf-7ac719511eff tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:18.627183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954a5a4f-58a5-4dde-beaf-7ac719511eff tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:18.629805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954a5a4f-58a5-4dde-beaf-7ac719511eff tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:18.630673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954a5a4f-58a5-4dde-beaf-7ac719511eff tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:18.632727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954a5a4f-58a5-4dde-beaf-7ac719511eff tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:18.634026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954a5a4f-58a5-4dde-beaf-7ac719511eff tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:18.636882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954a5a4f-58a5-4dde-beaf-7ac719511eff tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:18.950256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b569f414-fef2-4392-86f9-36a20bc0ac3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:18.950871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b569f414-fef2-4392-86f9-36a20bc0ac3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:18.957265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b569f414-fef2-4392-86f9-36a20bc0ac3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:18.958023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b569f414-fef2-4392-86f9-36a20bc0ac3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:18.958891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b569f414-fef2-4392-86f9-36a20bc0ac3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:18.959794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b569f414-fef2-4392-86f9-36a20bc0ac3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:18.960432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b569f414-fef2-4392-86f9-36a20bc0ac3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:18.961036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b569f414-fef2-4392-86f9-36a20bc0ac3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.014057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-954a5a4f-58a5-4dde-beaf-7ac719511eff tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:19.029760 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-954a5a4f-58a5-4dde-beaf-7ac719511eff tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1317 microversion: 2.1 time: 0.421863 Aug 29 15:39:19.032370 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1797/3549] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:18 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:19.049668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-def682aa-b9dc-4f94-aac0-781e528ead2e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:19.050535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-def682aa-b9dc-4f94-aac0-781e528ead2e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:19.065364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def682aa-b9dc-4f94-aac0-781e528ead2e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.065995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def682aa-b9dc-4f94-aac0-781e528ead2e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.066314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def682aa-b9dc-4f94-aac0-781e528ead2e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.067041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def682aa-b9dc-4f94-aac0-781e528ead2e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.067506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def682aa-b9dc-4f94-aac0-781e528ead2e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.067924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def682aa-b9dc-4f94-aac0-781e528ead2e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.579689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b569f414-fef2-4392-86f9-36a20bc0ac3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:19.600486 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b569f414-fef2-4392-86f9-36a20bc0ac3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1500 microversion: 2.1 time: 0.652923 Aug 29 15:39:19.620386 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1753/3550] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:18 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1500 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:19.639278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e53f17b8-592b-4e1a-9878-c3d9a7411bb2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:19.640436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e53f17b8-592b-4e1a-9878-c3d9a7411bb2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:19.650213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e53f17b8-592b-4e1a-9878-c3d9a7411bb2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.650896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e53f17b8-592b-4e1a-9878-c3d9a7411bb2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.651738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e53f17b8-592b-4e1a-9878-c3d9a7411bb2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.652745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e53f17b8-592b-4e1a-9878-c3d9a7411bb2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.653532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e53f17b8-592b-4e1a-9878-c3d9a7411bb2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.654315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e53f17b8-592b-4e1a-9878-c3d9a7411bb2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.834469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-def682aa-b9dc-4f94-aac0-781e528ead2e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:19.852332 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-def682aa-b9dc-4f94-aac0-781e528ead2e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1315 microversion: 2.1 time: 0.817796 Aug 29 15:39:19.853583 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1798/3551] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:19 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1315 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:19.861244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-59fdbcd7-0e08-4e52-9142-b30efb6ccc6b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:19.876550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59fdbcd7-0e08-4e52-9142-b30efb6ccc6b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.878720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59fdbcd7-0e08-4e52-9142-b30efb6ccc6b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.879707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59fdbcd7-0e08-4e52-9142-b30efb6ccc6b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.997398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-59fdbcd7-0e08-4e52-9142-b30efb6ccc6b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Going to try to stop instance {{(pid=122360) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:39:20.061768 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-59fdbcd7-0e08-4e52-9142-b30efb6ccc6b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce/action" status: 202 len: 0 microversion: 2.1 time: 0.206588 Aug 29 15:39:20.064250 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1799/3552] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:19 2022] POST /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:20.071266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-190ca334-158d-4361-8586-00d084f29bdd tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:20.072353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-190ca334-158d-4361-8586-00d084f29bdd tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:20.080513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-190ca334-158d-4361-8586-00d084f29bdd tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:20.081374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-190ca334-158d-4361-8586-00d084f29bdd tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:20.082098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-190ca334-158d-4361-8586-00d084f29bdd tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:20.083297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-190ca334-158d-4361-8586-00d084f29bdd tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:20.083981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-190ca334-158d-4361-8586-00d084f29bdd tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:20.084632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-190ca334-158d-4361-8586-00d084f29bdd tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:20.250024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e53f17b8-592b-4e1a-9878-c3d9a7411bb2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:20.279965 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e53f17b8-592b-4e1a-9878-c3d9a7411bb2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1314 microversion: 2.1 time: 0.651356 Aug 29 15:39:20.283753 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1754/3553] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:19 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:20.304841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:20.314205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-db236c5c-9367-4a91-91d1-1f7662cc1049 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:20.315217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-db236c5c-9367-4a91-91d1-1f7662cc1049 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:20.328515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db236c5c-9367-4a91-91d1-1f7662cc1049 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:20.329896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db236c5c-9367-4a91-91d1-1f7662cc1049 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:20.330614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db236c5c-9367-4a91-91d1-1f7662cc1049 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:20.331842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db236c5c-9367-4a91-91d1-1f7662cc1049 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:20.332507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db236c5c-9367-4a91-91d1-1f7662cc1049 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:20.333141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db236c5c-9367-4a91-91d1-1f7662cc1049 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:20.352964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-190ca334-158d-4361-8586-00d084f29bdd tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:20.367079 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-190ca334-158d-4361-8586-00d084f29bdd tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1317 microversion: 2.1 time: 0.301286 Aug 29 15:39:20.368340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:20.373137 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1800/3554] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:20 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:20.629824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-2d4ccdef-06e3-425d-8d70-7fe9b788b971 req-5b34bab1-bc64-4967-93d5-76322f560cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d5c42a-01b8-4e1d-b909-1a52a27bf41b", "tag": "9dff70eb-a996-4932-a744-e53eecee5014"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:20.657342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2d4ccdef-06e3-425d-8d70-7fe9b788b971 req-5b34bab1-bc64-4967-93d5-76322f560cfd service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:20.658344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2d4ccdef-06e3-425d-8d70-7fe9b788b971 req-5b34bab1-bc64-4967-93d5-76322f560cfd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:20.659014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2d4ccdef-06e3-425d-8d70-7fe9b788b971 req-5b34bab1-bc64-4967-93d5-76322f560cfd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:20.673680 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-2d4ccdef-06e3-425d-8d70-7fe9b788b971 req-5b34bab1-bc64-4967-93d5-76322f560cfd service nova] Creating event network-changed:9dff70eb-a996-4932-a744-e53eecee5014 for instance 14d5c42a-01b8-4e1d-b909-1a52a27bf41b on n-h2-839401-11 Aug 29 15:39:20.680980 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-2d4ccdef-06e3-425d-8d70-7fe9b788b971 req-5b34bab1-bc64-4967-93d5-76322f560cfd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055255 Aug 29 15:39:20.682317 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1801/3555] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:20.727636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-db236c5c-9367-4a91-91d1-1f7662cc1049 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:20.741898 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-db236c5c-9367-4a91-91d1-1f7662cc1049 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.455485 Aug 29 15:39:20.745566 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1755/3556] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:20 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:20.874734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d8c85ff4-9570-4b58-a404-4c62e7e8dc83 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:20.875477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d8c85ff4-9570-4b58-a404-4c62e7e8dc83 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:20.892504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8c85ff4-9570-4b58-a404-4c62e7e8dc83 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:20.900759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8c85ff4-9570-4b58-a404-4c62e7e8dc83 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:20.900759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8c85ff4-9570-4b58-a404-4c62e7e8dc83 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:20.900759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8c85ff4-9570-4b58-a404-4c62e7e8dc83 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:20.900759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8c85ff4-9570-4b58-a404-4c62e7e8dc83 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:20.912569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8c85ff4-9570-4b58-a404-4c62e7e8dc83 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.183087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d8c85ff4-9570-4b58-a404-4c62e7e8dc83 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:21.194952 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d8c85ff4-9570-4b58-a404-4c62e7e8dc83 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1315 microversion: 2.1 time: 0.324594 Aug 29 15:39:21.195552 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1802/3557] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:20 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:21.304214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e31a1dcf-70eb-4fe9-adb8-2c8ea54e9df9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:21.305484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e31a1dcf-70eb-4fe9-adb8-2c8ea54e9df9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:21.318673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e31a1dcf-70eb-4fe9-adb8-2c8ea54e9df9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.319181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e31a1dcf-70eb-4fe9-adb8-2c8ea54e9df9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.319627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e31a1dcf-70eb-4fe9-adb8-2c8ea54e9df9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.320343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e31a1dcf-70eb-4fe9-adb8-2c8ea54e9df9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.320806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e31a1dcf-70eb-4fe9-adb8-2c8ea54e9df9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.321281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e31a1dcf-70eb-4fe9-adb8-2c8ea54e9df9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.398231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c9fff78c-def0-45c9-a706-70d8053889aa tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:21.399086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c9fff78c-def0-45c9-a706-70d8053889aa tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:21.413046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9fff78c-def0-45c9-a706-70d8053889aa tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.414307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9fff78c-def0-45c9-a706-70d8053889aa tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.417187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9fff78c-def0-45c9-a706-70d8053889aa tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.419369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9fff78c-def0-45c9-a706-70d8053889aa tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.420362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9fff78c-def0-45c9-a706-70d8053889aa tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.422602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9fff78c-def0-45c9-a706-70d8053889aa tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.779456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c9fff78c-def0-45c9-a706-70d8053889aa tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:21.792506 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c9fff78c-def0-45c9-a706-70d8053889aa tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1317 microversion: 2.1 time: 0.398821 Aug 29 15:39:21.800335 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1803/3558] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:21 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:21.807904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-97d0d923-d1d1-493b-a98a-6b32b8f7a7f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:21.812077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-97d0d923-d1d1-493b-a98a-6b32b8f7a7f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:21.823136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97d0d923-d1d1-493b-a98a-6b32b8f7a7f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.826971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97d0d923-d1d1-493b-a98a-6b32b8f7a7f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.828074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97d0d923-d1d1-493b-a98a-6b32b8f7a7f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.831476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97d0d923-d1d1-493b-a98a-6b32b8f7a7f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.832541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97d0d923-d1d1-493b-a98a-6b32b8f7a7f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.834652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97d0d923-d1d1-493b-a98a-6b32b8f7a7f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.884407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e31a1dcf-70eb-4fe9-adb8-2c8ea54e9df9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:21.901410 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e31a1dcf-70eb-4fe9-adb8-2c8ea54e9df9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1314 microversion: 2.1 time: 0.600828 Aug 29 15:39:21.902647 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1756/3559] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:21 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:22.123255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-97d0d923-d1d1-493b-a98a-6b32b8f7a7f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:22.141212 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-97d0d923-d1d1-493b-a98a-6b32b8f7a7f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.339055 Aug 29 15:39:22.142247 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1804/3560] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:21 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:22.218281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b23d107a-77d8-4bfb-baab-3f0b7744fb7b tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:22.218895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b23d107a-77d8-4bfb-baab-3f0b7744fb7b tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:22.225586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b23d107a-77d8-4bfb-baab-3f0b7744fb7b tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:22.226481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b23d107a-77d8-4bfb-baab-3f0b7744fb7b tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:22.227088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b23d107a-77d8-4bfb-baab-3f0b7744fb7b tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:22.228242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b23d107a-77d8-4bfb-baab-3f0b7744fb7b tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:22.228866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b23d107a-77d8-4bfb-baab-3f0b7744fb7b tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:22.229679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b23d107a-77d8-4bfb-baab-3f0b7744fb7b tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:22.719156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:22.852015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6675d2d8-1cd4-40a4-8845-77cb56510a75 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Action: 'create', calling method: .version_select at 0x7fc433b6b3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1475439180", "description": "tempest-description-402642737"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:23.027301 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6675d2d8-1cd4-40a4-8845-77cb56510a75 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.312251 Aug 29 15:39:23.028259 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1805/3561] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:39:22 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:23.038516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-ea96625e-1855-4815-8c6d-9efaf401af75 req-b9875872-b591-495d-8487-0277d13f9a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc3fe412-4a55-4b64-9b2f-0302fb13bede", "tag": "1cb4516e-b9dd-4bde-96d9-376f37308257"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:23.052553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ea96625e-1855-4815-8c6d-9efaf401af75 req-b9875872-b591-495d-8487-0277d13f9a0c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.053051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ea96625e-1855-4815-8c6d-9efaf401af75 req-b9875872-b591-495d-8487-0277d13f9a0c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.053511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ea96625e-1855-4815-8c6d-9efaf401af75 req-b9875872-b591-495d-8487-0277d13f9a0c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.067606 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-ea96625e-1855-4815-8c6d-9efaf401af75 req-b9875872-b591-495d-8487-0277d13f9a0c service nova] Creating event network-changed:1cb4516e-b9dd-4bde-96d9-376f37308257 for instance bc3fe412-4a55-4b64-9b2f-0302fb13bede on n-h2-839401-11 Aug 29 15:39:23.074167 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-ea96625e-1855-4815-8c6d-9efaf401af75 req-b9875872-b591-495d-8487-0277d13f9a0c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044087 Aug 29 15:39:23.075814 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1806/3562] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:23.084168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-392b25e8-ae30-4962-8dba-ad1cdb39aa78 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:23.085104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-392b25e8-ae30-4962-8dba-ad1cdb39aa78 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:23.092321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392b25e8-ae30-4962-8dba-ad1cdb39aa78 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.093185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392b25e8-ae30-4962-8dba-ad1cdb39aa78 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.093848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392b25e8-ae30-4962-8dba-ad1cdb39aa78 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.094752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392b25e8-ae30-4962-8dba-ad1cdb39aa78 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.095400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392b25e8-ae30-4962-8dba-ad1cdb39aa78 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.096673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392b25e8-ae30-4962-8dba-ad1cdb39aa78 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.144935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b23d107a-77d8-4bfb-baab-3f0b7744fb7b tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:23.154222 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b23d107a-77d8-4bfb-baab-3f0b7744fb7b tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1315 microversion: 2.1 time: 0.940525 Aug 29 15:39:23.169001 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1757/3563] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:22 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1315 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:23.174438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-042c420c-9d0e-4a16-8e66-05b37043b22f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:23.175380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-042c420c-9d0e-4a16-8e66-05b37043b22f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:23.182029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-042c420c-9d0e-4a16-8e66-05b37043b22f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.182861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-042c420c-9d0e-4a16-8e66-05b37043b22f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.183505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-042c420c-9d0e-4a16-8e66-05b37043b22f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.185238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-042c420c-9d0e-4a16-8e66-05b37043b22f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.186120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-042c420c-9d0e-4a16-8e66-05b37043b22f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.188895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-042c420c-9d0e-4a16-8e66-05b37043b22f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.340952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-392b25e8-ae30-4962-8dba-ad1cdb39aa78 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:23.349761 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-392b25e8-ae30-4962-8dba-ad1cdb39aa78 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1317 microversion: 2.1 time: 0.272379 Aug 29 15:39:23.350363 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1807/3564] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:23 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:23.382676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2b3b661f-6b9d-4cc9-a074-99de412acf99 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Action: 'create', calling method: .version_select at 0x7fc42aaac820>, body: {"security_group_rule": {"parent_group_id": "3e7bbce2-a5e9-4e92-a83c-710de8663457", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:23.409631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=40 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:23.646956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-042c420c-9d0e-4a16-8e66-05b37043b22f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:23.658060 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-042c420c-9d0e-4a16-8e66-05b37043b22f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1314 microversion: 2.1 time: 0.487252 Aug 29 15:39:23.662923 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1758/3565] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:23 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:23.676001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-551f2244-9d8c-469b-8127-64d487e75e8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:23.680490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-551f2244-9d8c-469b-8127-64d487e75e8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:23.694346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-551f2244-9d8c-469b-8127-64d487e75e8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.695469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-551f2244-9d8c-469b-8127-64d487e75e8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.696046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-551f2244-9d8c-469b-8127-64d487e75e8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.700245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-551f2244-9d8c-469b-8127-64d487e75e8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.701251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-551f2244-9d8c-469b-8127-64d487e75e8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.701829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-551f2244-9d8c-469b-8127-64d487e75e8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.729389 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2b3b661f-6b9d-4cc9-a074-99de412acf99 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.377784 Aug 29 15:39:23.743248 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1808/3566] 10.222.0.62 () {60 vars in 1195 bytes} [Mon Aug 29 15:39:23 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:23.758507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-46d26cf7-98e9-479d-99c5-4e5442fd2345 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Action: 'create', calling method: .version_select at 0x7fc42aa89670>, body: {"security_group_rule": {"parent_group_id": "3e7bbce2-a5e9-4e92-a83c-710de8663457", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:23.825532 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-46d26cf7-98e9-479d-99c5-4e5442fd2345 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] HTTP exception thrown: This rule already exists in group 3e7bbce2-a5e9-4e92-a83c-710de8663457 Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-46d26cf7-98e9-479d-99c5-4e5442fd2345 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Request method failure captured: Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 138 Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN2qF9BHLr0SjvIVXuVLqpCjuGVhoB84pXD_Sdr7mwqd0Vl1mBR6nocTVMv_yOy-1yTx8qAgGszzb5qGedbn2tQTTUO9uU4rWXMyjQkKSqGjAv4t4q4upGmxyG7RBY6ERdnxhPcPDU_6fCQo4YkriwOOTXvMn2B3zqdMf76xgb6p47A Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: fcdaf58543b44383871a4b4245a23f1e Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fcdaf58543b44383871a4b4245a23f1e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fcdaf58543b44383871a4b4245a23f1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fcdaf58543b44383871a4b4245a23f1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fcdaf58543b44383871a4b4245a23f1e"}]}] Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: fcdaf58543b44383871a4b4245a23f1e Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-723653812-project Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 935f2fda74bd43dfbeda377a4aa085f0 Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812-project Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: {"security_group_rule": {"parent_group_id": "3e7bbce2-a5e9-4e92-a83c-710de8663457", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: exception: This rule already exists in group 3e7bbce2-a5e9-4e92-a83c-710de8663457 Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3e7bbce2-a5e9-4e92-a83c-710de8663457', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 3e7bbce2-a5e9-4e92-a83c-710de8663457 Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 3e7bbce2-a5e9-4e92-a83c-710de8663457 Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:23.827322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:23.831856 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:23.831856 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:23.831856 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 3e7bbce2-a5e9-4e92-a83c-710de8663457 Aug 29 15:39:23.831856 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.831856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-46d26cf7-98e9-479d-99c5-4e5442fd2345 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Returning 400 to user: This rule already exists in group 3e7bbce2-a5e9-4e92-a83c-710de8663457 {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:23.831856 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-46d26cf7-98e9-479d-99c5-4e5442fd2345 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.083734 Aug 29 15:39:23.833915 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1809/3567] 10.222.0.62 () {60 vars in 1195 bytes} [Mon Aug 29 15:39:23 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:39:23.840925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0bf30a56-3224-4f52-8022-9cd73fa915e4 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Calling method '.version_select at 0x7fc42a999940>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:24.073743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-551f2244-9d8c-469b-8127-64d487e75e8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:24.091678 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-551f2244-9d8c-469b-8127-64d487e75e8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.427133 Aug 29 15:39:24.093115 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1759/3568] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:23 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:24.097919 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0bf30a56-3224-4f52-8022-9cd73fa915e4 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-group-rules/79515fb6-0347-43cc-aad9-4f5e93e76c20" status: 202 len: 0 microversion: 2.1 time: 0.262849 Aug 29 15:39:24.098757 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1810/3569] 10.222.0.62 () {58 vars in 1287 bytes} [Mon Aug 29 15:39:23 2022] DELETE /compute/v2.1/os-security-group-rules/79515fb6-0347-43cc-aad9-4f5e93e76c20 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:24.108085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c525c681-8a41-416f-93e0-d943f55ebcd0 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Action: 'create', calling method: .version_select at 0x7fc42a76a790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1972692439", "description": "tempest-description-1452596838"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:24.184783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-22ae19a5-9356-4769-83f0-e5f0c9feb989 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:24.186371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-22ae19a5-9356-4769-83f0-e5f0c9feb989 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:24.199603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22ae19a5-9356-4769-83f0-e5f0c9feb989 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.200634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22ae19a5-9356-4769-83f0-e5f0c9feb989 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.201247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22ae19a5-9356-4769-83f0-e5f0c9feb989 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.202291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22ae19a5-9356-4769-83f0-e5f0c9feb989 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.203063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22ae19a5-9356-4769-83f0-e5f0c9feb989 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.204303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22ae19a5-9356-4769-83f0-e5f0c9feb989 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.378725 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c525c681-8a41-416f-93e0-d943f55ebcd0 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.274232 Aug 29 15:39:24.391588 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1760/3570] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:39:24 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:24.403385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0805c9b3-461e-4e69-b9e4-f4e061ec3777 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:24.405528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0805c9b3-461e-4e69-b9e4-f4e061ec3777 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:24.417663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-22ae19a5-9356-4769-83f0-e5f0c9feb989 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:24.423804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0805c9b3-461e-4e69-b9e4-f4e061ec3777 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.424432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0805c9b3-461e-4e69-b9e4-f4e061ec3777 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.424903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0805c9b3-461e-4e69-b9e4-f4e061ec3777 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.425756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0805c9b3-461e-4e69-b9e4-f4e061ec3777 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.427583 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-22ae19a5-9356-4769-83f0-e5f0c9feb989 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1315 microversion: 2.1 time: 0.255538 Aug 29 15:39:24.428139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0805c9b3-461e-4e69-b9e4-f4e061ec3777 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.428886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0805c9b3-461e-4e69-b9e4-f4e061ec3777 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.437740 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1811/3571] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:24 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:24.447828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-347f1387-45d6-43e5-933a-b442b243c9a7 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Action: 'create', calling method: .version_select at 0x7fc42a999d30>, body: {"security_group_rule": {"parent_group_id": "fb72135c-ca18-494a-a1bf-4fca39c2a5f7", "ip_protocol": "tcp", "from_port": 1003269702, "to_port": 22}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:24.506338 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-347f1387-45d6-43e5-933a-b442b243c9a7 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] HTTP exception thrown: Invalid port range 1003269702:22. Former value cannot be greater than the later Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-347f1387-45d6-43e5-933a-b442b243c9a7 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Request method failure captured: Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 146 Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN2qF9BHLr0SjvIVXuVLqpCjuGVhoB84pXD_Sdr7mwqd0Vl1mBR6nocTVMv_yOy-1yTx8qAgGszzb5qGedbn2tQTTUO9uU4rWXMyjQkKSqGjAv4t4q4upGmxyG7RBY6ERdnxhPcPDU_6fCQo4YkriwOOTXvMn2B3zqdMf76xgb6p47A Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: fcdaf58543b44383871a4b4245a23f1e Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fcdaf58543b44383871a4b4245a23f1e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fcdaf58543b44383871a4b4245a23f1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fcdaf58543b44383871a4b4245a23f1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fcdaf58543b44383871a4b4245a23f1e"}]}] Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: fcdaf58543b44383871a4b4245a23f1e Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-723653812-project Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 935f2fda74bd43dfbeda377a4aa085f0 Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812-project Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: {"security_group_rule": {"parent_group_id": "fb72135c-ca18-494a-a1bf-4fca39c2a5f7", "ip_protocol": "tcp", "from_port": 1003269702, "to_port": 22}} Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid port range 1003269702:22. Former value cannot be greater than the later Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fb72135c-ca18-494a-a1bf-4fca39c2a5f7', 'ip_protocol': 'tcp', 'from_port': 1003269702, 'to_port': 22}}} Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1003269702:22. Former value cannot be greater than the later Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1003269702:22. Former value cannot be greater than the later Aug 29 15:39:24.509389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.514303 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:24.514303 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.514303 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:24.514303 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:24.514303 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:24.514303 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:24.514303 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:24.514303 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1003269702:22. Former value cannot be greater than the later Aug 29 15:39:24.514303 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.517036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-347f1387-45d6-43e5-933a-b442b243c9a7 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Returning 400 to user: Invalid port range 1003269702:22. Former value cannot be greater than the later {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:24.519494 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-347f1387-45d6-43e5-933a-b442b243c9a7 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.079556 Aug 29 15:39:24.520594 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1812/3572] 10.222.0.62 () {60 vars in 1195 bytes} [Mon Aug 29 15:39:24 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:39:24.531028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b4d3c664-0d4f-432e-8bf4-d29fd9753bdd tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Action: 'create', calling method: .version_select at 0x7fc42a9ca9d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1662172708", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:24.538787 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-b4d3c664-0d4f-432e-8bf4-d29fd9753bdd tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] HTTP exception thrown: Security group id should be uuid Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b4d3c664-0d4f-432e-8bf4-d29fd9753bdd tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Request method failure captured: Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 131 Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN2qF9BHLr0SjvIVXuVLqpCjuGVhoB84pXD_Sdr7mwqd0Vl1mBR6nocTVMv_yOy-1yTx8qAgGszzb5qGedbn2tQTTUO9uU4rWXMyjQkKSqGjAv4t4q4upGmxyG7RBY6ERdnxhPcPDU_6fCQo4YkriwOOTXvMn2B3zqdMf76xgb6p47A Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: fcdaf58543b44383871a4b4245a23f1e Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fcdaf58543b44383871a4b4245a23f1e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fcdaf58543b44383871a4b4245a23f1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fcdaf58543b44383871a4b4245a23f1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fcdaf58543b44383871a4b4245a23f1e"}]}] Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: fcdaf58543b44383871a4b4245a23f1e Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-723653812-project Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 935f2fda74bd43dfbeda377a4aa085f0 Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812-project Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1662172708", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: exception: Security group id should be uuid Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1662172708', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:24.543391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:24.548419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 29 15:39:24.548419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.550117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b4d3c664-0d4f-432e-8bf4-d29fd9753bdd tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Returning 400 to user: Security group id should be uuid {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:24.553042 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b4d3c664-0d4f-432e-8bf4-d29fd9753bdd tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.027203 Aug 29 15:39:24.556127 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1813/3573] 10.222.0.62 () {60 vars in 1195 bytes} [Mon Aug 29 15:39:24 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:24.573669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d3cdaabf-ffda-4c22-9220-3f9ff43ab995 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Action: 'create', calling method: .version_select at 0x7fc42aa84e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1334485197", "description": "tempest-description-1710718366"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:24.671595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0805c9b3-461e-4e69-b9e4-f4e061ec3777 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:24.682770 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0805c9b3-461e-4e69-b9e4-f4e061ec3777 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1317 microversion: 2.1 time: 0.285998 Aug 29 15:39:24.683991 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1761/3574] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:24 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:24.691440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-07174384-6392-47f3-bad3-2b81d427613e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:24.692419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-07174384-6392-47f3-bad3-2b81d427613e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:24.699996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07174384-6392-47f3-bad3-2b81d427613e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.701282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07174384-6392-47f3-bad3-2b81d427613e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.702015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07174384-6392-47f3-bad3-2b81d427613e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.703291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07174384-6392-47f3-bad3-2b81d427613e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.704374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07174384-6392-47f3-bad3-2b81d427613e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.705342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07174384-6392-47f3-bad3-2b81d427613e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.810271 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d3cdaabf-ffda-4c22-9220-3f9ff43ab995 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.247997 Aug 29 15:39:24.811043 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1814/3575] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:39:24 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:24.824212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c99bd224-7c7c-41bc-a3ea-fc192420d64a tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Action: 'create', calling method: .version_select at 0x7fc42a93fb80>, body: {"security_group_rule": {"parent_group_id": "016961b7-3686-45ee-8ce7-04133b661007", "ip_protocol": "tempest-999-1199983028", "from_port": 22, "to_port": 22}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:24.901165 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-c99bd224-7c7c-41bc-a3ea-fc192420d64a tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] HTTP exception thrown: Invalid IP protocol tempest-999-1199983028. Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c99bd224-7c7c-41bc-a3ea-fc192420d64a tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Request method failure captured: Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 157 Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN2qF9BHLr0SjvIVXuVLqpCjuGVhoB84pXD_Sdr7mwqd0Vl1mBR6nocTVMv_yOy-1yTx8qAgGszzb5qGedbn2tQTTUO9uU4rWXMyjQkKSqGjAv4t4q4upGmxyG7RBY6ERdnxhPcPDU_6fCQo4YkriwOOTXvMn2B3zqdMf76xgb6p47A Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: fcdaf58543b44383871a4b4245a23f1e Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fcdaf58543b44383871a4b4245a23f1e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fcdaf58543b44383871a4b4245a23f1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fcdaf58543b44383871a4b4245a23f1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fcdaf58543b44383871a4b4245a23f1e"}]}] Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: fcdaf58543b44383871a4b4245a23f1e Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-723653812-project Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 935f2fda74bd43dfbeda377a4aa085f0 Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812-project Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: {"security_group_rule": {"parent_group_id": "016961b7-3686-45ee-8ce7-04133b661007", "ip_protocol": "tempest-999-1199983028", "from_port": 22, "to_port": 22}} Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid IP protocol tempest-999-1199983028. Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'security_group_rule': {'parent_group_id': '016961b7-3686-45ee-8ce7-04133b661007', 'ip_protocol': 'tempest-999-1199983028', 'from_port': 22, 'to_port': 22}}} Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1199983028. Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1199983028. Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.902808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:24.911301 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.911301 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:24.911301 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:24.911301 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:24.911301 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:24.911301 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:24.911301 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1199983028. Aug 29 15:39:24.911301 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:24.911301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c99bd224-7c7c-41bc-a3ea-fc192420d64a tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Returning 400 to user: Invalid IP protocol tempest-999-1199983028. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:24.911301 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c99bd224-7c7c-41bc-a3ea-fc192420d64a tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.084928 Aug 29 15:39:24.911301 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1815/3576] 10.222.0.62 () {60 vars in 1195 bytes} [Mon Aug 29 15:39:24 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:39:24.916294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a1bd2834-0d42-4a7b-8ba4-6f86ee0b1ced tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Action: 'create', calling method: .version_select at 0x7fc42aa89f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-294862632", "description": "tempest-description-534446040"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:24.924104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-07174384-6392-47f3-bad3-2b81d427613e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:24.934349 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-07174384-6392-47f3-bad3-2b81d427613e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1314 microversion: 2.1 time: 0.248269 Aug 29 15:39:24.935762 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1762/3577] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:24 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:25.124803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-27970a01-d7e0-4a37-837a-f854762fb9e7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:25.125138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-27970a01-d7e0-4a37-837a-f854762fb9e7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:25.131607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27970a01-d7e0-4a37-837a-f854762fb9e7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.132412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27970a01-d7e0-4a37-837a-f854762fb9e7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.132855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27970a01-d7e0-4a37-837a-f854762fb9e7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.133646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27970a01-d7e0-4a37-837a-f854762fb9e7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.134074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27970a01-d7e0-4a37-837a-f854762fb9e7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.143001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27970a01-d7e0-4a37-837a-f854762fb9e7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.183397 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a1bd2834-0d42-4a7b-8ba4-6f86ee0b1ced tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.271596 Aug 29 15:39:25.184637 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1816/3578] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:39:24 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:25.199131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec762a8b-32a1-4eae-8f49-2bff6eccffb3 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Action: 'create', calling method: .version_select at 0x7fc42aaeee50>, body: {"security_group_rule": {"parent_group_id": "df0930bd-38b2-4f4c-85c9-2a7d6ee8701d", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:25.270379 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-ec762a8b-32a1-4eae-8f49-2bff6eccffb3 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec762a8b-32a1-4eae-8f49-2bff6eccffb3 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Request method failure captured: Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 138 Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN2qF9BHLr0SjvIVXuVLqpCjuGVhoB84pXD_Sdr7mwqd0Vl1mBR6nocTVMv_yOy-1yTx8qAgGszzb5qGedbn2tQTTUO9uU4rWXMyjQkKSqGjAv4t4q4upGmxyG7RBY6ERdnxhPcPDU_6fCQo4YkriwOOTXvMn2B3zqdMf76xgb6p47A Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: fcdaf58543b44383871a4b4245a23f1e Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fcdaf58543b44383871a4b4245a23f1e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fcdaf58543b44383871a4b4245a23f1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fcdaf58543b44383871a4b4245a23f1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fcdaf58543b44383871a4b4245a23f1e"}]}] Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: fcdaf58543b44383871a4b4245a23f1e Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-723653812-project Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 935f2fda74bd43dfbeda377a4aa085f0 Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812-project Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: {"security_group_rule": {"parent_group_id": "df0930bd-38b2-4f4c-85c9-2a7d6ee8701d", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'df0930bd-38b2-4f4c-85c9-2a7d6ee8701d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 15:39:25.272229 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.276590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:25.276590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.276590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.276590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:25.276590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:25.276590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:25.276590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:25.276590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 15:39:25.276590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.276590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec762a8b-32a1-4eae-8f49-2bff6eccffb3 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:25.276590 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ec762a8b-32a1-4eae-8f49-2bff6eccffb3 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.081674 Aug 29 15:39:25.279349 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1817/3579] 10.222.0.62 () {60 vars in 1195 bytes} [Mon Aug 29 15:39:25 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 88 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:39:25.285674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aa07ae12-3f93-4210-8be0-d2661e68c82b tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Action: 'create', calling method: .version_select at 0x7fc42aa260d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-821297096", "description": "tempest-description-988094331"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:25.380328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-27970a01-d7e0-4a37-837a-f854762fb9e7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:25.391174 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-27970a01-d7e0-4a37-837a-f854762fb9e7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.278105 Aug 29 15:39:25.405178 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1763/3580] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:25 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:25.454282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d4ba3c97-b905-4c55-81aa-27fae9187de8 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:25.456183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d4ba3c97-b905-4c55-81aa-27fae9187de8 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:25.463125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4ba3c97-b905-4c55-81aa-27fae9187de8 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.463888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4ba3c97-b905-4c55-81aa-27fae9187de8 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.464323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4ba3c97-b905-4c55-81aa-27fae9187de8 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.465315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4ba3c97-b905-4c55-81aa-27fae9187de8 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.466076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4ba3c97-b905-4c55-81aa-27fae9187de8 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.466701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4ba3c97-b905-4c55-81aa-27fae9187de8 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.544437 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aa07ae12-3f93-4210-8be0-d2661e68c82b tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.263972 Aug 29 15:39:25.546128 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1818/3581] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:39:25 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:25.561149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-05a5f920-0272-4420-a3fe-da0acc9bf2a9 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Action: 'create', calling method: .version_select at 0x7fc42aa89e50>, body: {"security_group_rule": {"parent_group_id": "5abcf7f5-958e-4123-a29b-352466186cad", "ip_protocol": "tcp", "from_port": 22, "to_port": 1287642442}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:25.633831 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-05a5f920-0272-4420-a3fe-da0acc9bf2a9 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] HTTP exception thrown: Invalid port range 22:1287642442. Valid TCP ports should be between 1-65535 Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-05a5f920-0272-4420-a3fe-da0acc9bf2a9 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Request method failure captured: Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 146 Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN2qF9BHLr0SjvIVXuVLqpCjuGVhoB84pXD_Sdr7mwqd0Vl1mBR6nocTVMv_yOy-1yTx8qAgGszzb5qGedbn2tQTTUO9uU4rWXMyjQkKSqGjAv4t4q4upGmxyG7RBY6ERdnxhPcPDU_6fCQo4YkriwOOTXvMn2B3zqdMf76xgb6p47A Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: fcdaf58543b44383871a4b4245a23f1e Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fcdaf58543b44383871a4b4245a23f1e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fcdaf58543b44383871a4b4245a23f1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fcdaf58543b44383871a4b4245a23f1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fcdaf58543b44383871a4b4245a23f1e"}]}] Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: fcdaf58543b44383871a4b4245a23f1e Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-723653812-project Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 935f2fda74bd43dfbeda377a4aa085f0 Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812-project Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: {"security_group_rule": {"parent_group_id": "5abcf7f5-958e-4123-a29b-352466186cad", "ip_protocol": "tcp", "from_port": 22, "to_port": 1287642442}} Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid port range 22:1287642442. Valid TCP ports should be between 1-65535 Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5abcf7f5-958e-4123-a29b-352466186cad', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1287642442}}} Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1287642442. Valid TCP ports should be between 1-65535 Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1287642442. Valid TCP ports should be between 1-65535 Aug 29 15:39:25.637593 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.644959 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:25.644959 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.644959 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.644959 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:25.644959 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:25.644959 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:25.644959 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:25.644959 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1287642442. Valid TCP ports should be between 1-65535 Aug 29 15:39:25.644959 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.644959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-05a5f920-0272-4420-a3fe-da0acc9bf2a9 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Returning 400 to user: Invalid port range 22:1287642442. Valid TCP ports should be between 1-65535 {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:25.644959 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-05a5f920-0272-4420-a3fe-da0acc9bf2a9 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.085358 Aug 29 15:39:25.644959 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1819/3582] 10.222.0.62 () {60 vars in 1195 bytes} [Mon Aug 29 15:39:25 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:39:25.653491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d58ddc94-6817-418a-a0cf-352485142e00 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Action: 'create', calling method: .version_select at 0x7fc433a5f550>, body: {"security_group_rule": {"parent_group_id": "d780c992-62f4-435e-876b-477c74a21888", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:25.689036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG neutronclient.v2_0.client [None req-d58ddc94-6817-418a-a0cf-352485142e00 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d780c992-62f4-435e-876b-477c74a21888 does not exist", "detail": ""}} {{(pid=122360) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:39:25.690132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.security_group_api [None req-d58ddc94-6817-418a-a0cf-352485142e00 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Neutron security group d780c992-62f4-435e-876b-477c74a21888 not found {{(pid=122360) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:39:25.691421 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-d58ddc94-6817-418a-a0cf-352485142e00 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] HTTP exception thrown: Security group d780c992-62f4-435e-876b-477c74a21888 does not exist Aug 29 15:39:25.691421 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-89ee3051-1407-44e6-b63b-6c1ed23f8564'] Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d58ddc94-6817-418a-a0cf-352485142e00 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Request method failure captured: Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 138 Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN2qF9BHLr0SjvIVXuVLqpCjuGVhoB84pXD_Sdr7mwqd0Vl1mBR6nocTVMv_yOy-1yTx8qAgGszzb5qGedbn2tQTTUO9uU4rWXMyjQkKSqGjAv4t4q4upGmxyG7RBY6ERdnxhPcPDU_6fCQo4YkriwOOTXvMn2B3zqdMf76xgb6p47A Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: fcdaf58543b44383871a4b4245a23f1e Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fcdaf58543b44383871a4b4245a23f1e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fcdaf58543b44383871a4b4245a23f1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fcdaf58543b44383871a4b4245a23f1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fcdaf58543b44383871a4b4245a23f1e"}]}] Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: fcdaf58543b44383871a4b4245a23f1e Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-723653812-project Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 935f2fda74bd43dfbeda377a4aa085f0 Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812-project Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: {"security_group_rule": {"parent_group_id": "d780c992-62f4-435e-876b-477c74a21888", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: exception: Security group d780c992-62f4-435e-876b-477c74a21888 does not exist Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-89ee3051-1407-44e6-b63b-6c1ed23f8564'] Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd780c992-62f4-435e-876b-477c74a21888', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:39:25.694835 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d780c992-62f4-435e-876b-477c74a21888 does not exist Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89ee3051-1407-44e6-b63b-6c1ed23f8564'] Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d780c992-62f4-435e-876b-477c74a21888 does not exist Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89ee3051-1407-44e6-b63b-6c1ed23f8564'] Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d780c992-62f4-435e-876b-477c74a21888 does not exist Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89ee3051-1407-44e6-b63b-6c1ed23f8564'] Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d780c992-62f4-435e-876b-477c74a21888 does not exist Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89ee3051-1407-44e6-b63b-6c1ed23f8564'] Aug 29 15:39:25.703764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.714658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d4ba3c97-b905-4c55-81aa-27fae9187de8 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:25.718573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d58ddc94-6817-418a-a0cf-352485142e00 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Returning 404 to user: Security group d780c992-62f4-435e-876b-477c74a21888 does not exist Aug 29 15:39:25.718573 n-d-839401-11 devstack@n-api.service[122360]: Neutron server returns request_ids: ['req-89ee3051-1407-44e6-b63b-6c1ed23f8564'] {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:25.723260 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d58ddc94-6817-418a-a0cf-352485142e00 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.073072 Aug 29 15:39:25.725341 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1820/3583] 10.222.0.62 () {60 vars in 1195 bytes} [Mon Aug 29 15:39:25 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:25.736254 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d4ba3c97-b905-4c55-81aa-27fae9187de8 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1315 microversion: 2.1 time: 0.286397 Aug 29 15:39:25.738197 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1764/3584] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:25 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:25.749134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6385eb2c-f5f5-4e05-9d0a-f738185d561a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:25.751190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6385eb2c-f5f5-4e05-9d0a-f738185d561a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:25.758151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-58ebf277-8ee0-4bb3-8d79-3043ddca4a71 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Calling method '.version_select at 0x7fc42a759ca0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:25.767647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6385eb2c-f5f5-4e05-9d0a-f738185d561a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.769508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6385eb2c-f5f5-4e05-9d0a-f738185d561a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.769923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6385eb2c-f5f5-4e05-9d0a-f738185d561a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.770982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6385eb2c-f5f5-4e05-9d0a-f738185d561a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.772512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6385eb2c-f5f5-4e05-9d0a-f738185d561a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.775346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6385eb2c-f5f5-4e05-9d0a-f738185d561a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.809229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG neutronclient.v2_0.client [None req-58ebf277-8ee0-4bb3-8d79-3043ddca4a71 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 65e042a5-441c-41d1-93b7-9dc0c42393c8 does not exist", "detail": ""}} {{(pid=122361) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:39:25.810088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.security_group_api [None req-58ebf277-8ee0-4bb3-8d79-3043ddca4a71 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Neutron security group rule 65e042a5-441c-41d1-93b7-9dc0c42393c8 not found {{(pid=122361) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 29 15:39:25.810820 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-58ebf277-8ee0-4bb3-8d79-3043ddca4a71 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] HTTP exception thrown: Security group rule 65e042a5-441c-41d1-93b7-9dc0c42393c8 does not exist Aug 29 15:39:25.810820 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-274ee726-6f40-4876-afd8-c744b83a0244'] Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-58ebf277-8ee0-4bb3-8d79-3043ddca4a71 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Request method failure captured: Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/os-security-group-rules/65e042a5-441c-41d1-93b7-9dc0c42393c8 HTTP/1.1 Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN2qF9BHLr0SjvIVXuVLqpCjuGVhoB84pXD_Sdr7mwqd0Vl1mBR6nocTVMv_yOy-1yTx8qAgGszzb5qGedbn2tQTTUO9uU4rWXMyjQkKSqGjAv4t4q4upGmxyG7RBY6ERdnxhPcPDU_6fCQo4YkriwOOTXvMn2B3zqdMf76xgb6p47A Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: fcdaf58543b44383871a4b4245a23f1e Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fcdaf58543b44383871a4b4245a23f1e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fcdaf58543b44383871a4b4245a23f1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fcdaf58543b44383871a4b4245a23f1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fcdaf58543b44383871a4b4245a23f1e"}]}] Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: fcdaf58543b44383871a4b4245a23f1e Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812 Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-723653812-project Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 935f2fda74bd43dfbeda377a4aa085f0 Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-723653812-project Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: exception: Security group rule 65e042a5-441c-41d1-93b7-9dc0c42393c8 does not exist Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-274ee726-6f40-4876-afd8-c744b83a0244'] Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '65e042a5-441c-41d1-93b7-9dc0c42393c8'} Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:39:25.813431 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 65e042a5-441c-41d1-93b7-9dc0c42393c8 does not exist Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-274ee726-6f40-4876-afd8-c744b83a0244'] Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 65e042a5-441c-41d1-93b7-9dc0c42393c8 does not exist Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-274ee726-6f40-4876-afd8-c744b83a0244'] Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 65e042a5-441c-41d1-93b7-9dc0c42393c8 does not exist Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-274ee726-6f40-4876-afd8-c744b83a0244'] Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 65e042a5-441c-41d1-93b7-9dc0c42393c8 does not exist Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-274ee726-6f40-4876-afd8-c744b83a0244'] Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-58ebf277-8ee0-4bb3-8d79-3043ddca4a71 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Returning 404 to user: Security group rule 65e042a5-441c-41d1-93b7-9dc0c42393c8 does not exist Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-274ee726-6f40-4876-afd8-c744b83a0244'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-58ebf277-8ee0-4bb3-8d79-3043ddca4a71 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-group-rules/65e042a5-441c-41d1-93b7-9dc0c42393c8" status: 404 len: 199 microversion: 2.1 time: 0.074618 Aug 29 15:39:25.823538 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1765/3585] 10.222.0.62 () {58 vars in 1287 bytes} [Mon Aug 29 15:39:25 2022] DELETE /compute/v2.1/os-security-group-rules/65e042a5-441c-41d1-93b7-9dc0c42393c8 => generated 199 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:25.850790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fd096aea-fb1b-4b49-b40b-3a8e209ad9d4 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Calling method '.version_select at 0x7fc42a720e50>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:26.061630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6385eb2c-f5f5-4e05-9d0a-f738185d561a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:26.071735 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6385eb2c-f5f5-4e05-9d0a-f738185d561a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1317 microversion: 2.1 time: 0.344151 Aug 29 15:39:26.084361 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1821/3586] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:25 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:26.093532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-554b7eb5-383a-4688-be04-1ab9d74dc10e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:26.094760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-554b7eb5-383a-4688-be04-1ab9d74dc10e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:26.102928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-554b7eb5-383a-4688-be04-1ab9d74dc10e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.103435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-554b7eb5-383a-4688-be04-1ab9d74dc10e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.103976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-554b7eb5-383a-4688-be04-1ab9d74dc10e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:26.105482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-554b7eb5-383a-4688-be04-1ab9d74dc10e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.106566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-554b7eb5-383a-4688-be04-1ab9d74dc10e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.107287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-554b7eb5-383a-4688-be04-1ab9d74dc10e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:26.137036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:26.140583 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fd096aea-fb1b-4b49-b40b-3a8e209ad9d4 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/5abcf7f5-958e-4123-a29b-352466186cad" status: 202 len: 0 microversion: 2.1 time: 0.314816 Aug 29 15:39:26.141666 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1766/3587] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:39:25 2022] DELETE /compute/v2.1/os-security-groups/5abcf7f5-958e-4123-a29b-352466186cad => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:26.152983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d402e934-01f7-48f2-9579-a2c0413a67c2 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Calling method '.version_select at 0x7fc42a873b80>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:26.334267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-554b7eb5-383a-4688-be04-1ab9d74dc10e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:26.348786 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-554b7eb5-383a-4688-be04-1ab9d74dc10e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1314 microversion: 2.1 time: 0.260687 Aug 29 15:39:26.349878 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1822/3588] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:26 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:26.371313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-94f4dc82-72fd-4aca-98bd-7fc9972eb4ab req-a0003849-0d4a-4c88-8809-170c50b902f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "351a3593-bfab-4658-9e1f-fc9e81ba3e27", "name": "network-vif-plugged", "status": "completed", "tag": "f3ac8d50-8c2d-416e-abb4-e43e6b31ade5"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:26.394779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-94f4dc82-72fd-4aca-98bd-7fc9972eb4ab req-a0003849-0d4a-4c88-8809-170c50b902f1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.395867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-94f4dc82-72fd-4aca-98bd-7fc9972eb4ab req-a0003849-0d4a-4c88-8809-170c50b902f1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.396888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-94f4dc82-72fd-4aca-98bd-7fc9972eb4ab req-a0003849-0d4a-4c88-8809-170c50b902f1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:26.415931 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-94f4dc82-72fd-4aca-98bd-7fc9972eb4ab req-a0003849-0d4a-4c88-8809-170c50b902f1 service nova] Creating event network-vif-plugged:f3ac8d50-8c2d-416e-abb4-e43e6b31ade5 for instance 351a3593-bfab-4658-9e1f-fc9e81ba3e27 on n-h1-839401-11 Aug 29 15:39:26.427527 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-94f4dc82-72fd-4aca-98bd-7fc9972eb4ab req-a0003849-0d4a-4c88-8809-170c50b902f1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075617 Aug 29 15:39:26.430361 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1823/3589] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:26.441482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d266977d-cd7f-4a4a-9fe5-f4d74b7c7d3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:26.442376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d266977d-cd7f-4a4a-9fe5-f4d74b7c7d3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:26.454055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d266977d-cd7f-4a4a-9fe5-f4d74b7c7d3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.454612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d266977d-cd7f-4a4a-9fe5-f4d74b7c7d3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.455404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d266977d-cd7f-4a4a-9fe5-f4d74b7c7d3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:26.456280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d266977d-cd7f-4a4a-9fe5-f4d74b7c7d3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.456795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d266977d-cd7f-4a4a-9fe5-f4d74b7c7d3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.457435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d266977d-cd7f-4a4a-9fe5-f4d74b7c7d3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:26.543036 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d402e934-01f7-48f2-9579-a2c0413a67c2 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/df0930bd-38b2-4f4c-85c9-2a7d6ee8701d" status: 202 len: 0 microversion: 2.1 time: 0.396762 Aug 29 15:39:26.544702 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1767/3590] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:39:26 2022] DELETE /compute/v2.1/os-security-groups/df0930bd-38b2-4f4c-85c9-2a7d6ee8701d => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:39:26.555397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2d02128a-d46d-487f-999b-57c929b3ac61 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Calling method '.version_select at 0x7fc42a7449d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:26.704645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d266977d-cd7f-4a4a-9fe5-f4d74b7c7d3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:26.714251 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d266977d-cd7f-4a4a-9fe5-f4d74b7c7d3c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.281145 Aug 29 15:39:26.715805 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1824/3591] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:26 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:26.774318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f79311b6-8639-4d23-a322-1c20b2525a67 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:26.775846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f79311b6-8639-4d23-a322-1c20b2525a67 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:26.782387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f79311b6-8639-4d23-a322-1c20b2525a67 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.783728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f79311b6-8639-4d23-a322-1c20b2525a67 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.784237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f79311b6-8639-4d23-a322-1c20b2525a67 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:26.785367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f79311b6-8639-4d23-a322-1c20b2525a67 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.785941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f79311b6-8639-4d23-a322-1c20b2525a67 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.786431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f79311b6-8639-4d23-a322-1c20b2525a67 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:26.868505 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2d02128a-d46d-487f-999b-57c929b3ac61 tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/016961b7-3686-45ee-8ce7-04133b661007" status: 202 len: 0 microversion: 2.1 time: 0.318474 Aug 29 15:39:26.870558 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1768/3592] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:39:26 2022] DELETE /compute/v2.1/os-security-groups/016961b7-3686-45ee-8ce7-04133b661007 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:26.890182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-28907949-6a66-4fcc-9e7e-022d7906057b tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Calling method '.version_select at 0x7fc42a720550>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:26.962088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f79311b6-8639-4d23-a322-1c20b2525a67 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:26.970573 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f79311b6-8639-4d23-a322-1c20b2525a67 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1315 microversion: 2.1 time: 0.201809 Aug 29 15:39:26.982370 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1825/3593] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:26 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:27.096737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f2bf9fe9-f0c8-4381-a51d-62478c366fc6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:27.097395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f2bf9fe9-f0c8-4381-a51d-62478c366fc6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:27.103623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2bf9fe9-f0c8-4381-a51d-62478c366fc6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:27.104610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2bf9fe9-f0c8-4381-a51d-62478c366fc6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:27.105046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2bf9fe9-f0c8-4381-a51d-62478c366fc6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.105804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2bf9fe9-f0c8-4381-a51d-62478c366fc6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:27.106369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2bf9fe9-f0c8-4381-a51d-62478c366fc6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:27.107189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2bf9fe9-f0c8-4381-a51d-62478c366fc6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.238071 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-28907949-6a66-4fcc-9e7e-022d7906057b tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/fb72135c-ca18-494a-a1bf-4fca39c2a5f7" status: 202 len: 0 microversion: 2.1 time: 0.362742 Aug 29 15:39:27.239225 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1769/3594] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:39:26 2022] DELETE /compute/v2.1/os-security-groups/fb72135c-ca18-494a-a1bf-4fca39c2a5f7 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:27.249405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-49c9905a-c5f1-499d-84b6-6a57eaeeb4cb tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] Calling method '.version_select at 0x7fc42a7f5430>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:27.261327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f2bf9fe9-f0c8-4381-a51d-62478c366fc6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:27.271761 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f2bf9fe9-f0c8-4381-a51d-62478c366fc6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1317 microversion: 2.1 time: 0.180663 Aug 29 15:39:27.272343 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1826/3595] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:27 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:27.369779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a78bc71b-ccbc-42ec-95e1-bed6e6b50b3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:27.370459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a78bc71b-ccbc-42ec-95e1-bed6e6b50b3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:27.376655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a78bc71b-ccbc-42ec-95e1-bed6e6b50b3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:27.377219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a78bc71b-ccbc-42ec-95e1-bed6e6b50b3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:27.377634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a78bc71b-ccbc-42ec-95e1-bed6e6b50b3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.378341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a78bc71b-ccbc-42ec-95e1-bed6e6b50b3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:27.379033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a78bc71b-ccbc-42ec-95e1-bed6e6b50b3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:27.379458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a78bc71b-ccbc-42ec-95e1-bed6e6b50b3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.518064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a78bc71b-ccbc-42ec-95e1-bed6e6b50b3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:27.526744 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a78bc71b-ccbc-42ec-95e1-bed6e6b50b3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1314 microversion: 2.1 time: 0.160887 Aug 29 15:39:27.527373 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1827/3596] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:27 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:27.623388 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-49c9905a-c5f1-499d-84b6-6a57eaeeb4cb tempest-SecurityGroupRulesNegativeTestJSON-723653812 tempest-SecurityGroupRulesNegativeTestJSON-723653812-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/3e7bbce2-a5e9-4e92-a83c-710de8663457" status: 202 len: 0 microversion: 2.1 time: 0.378618 Aug 29 15:39:27.624548 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1770/3597] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:39:27 2022] DELETE /compute/v2.1/os-security-groups/3e7bbce2-a5e9-4e92-a83c-710de8663457 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:27.691793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-318518af-183c-4921-864f-b6d9bb9f1a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185-project-admin] Calling method '.version_select at 0x7fc433b6ca60>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:27.693637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-318518af-183c-4921-864f-b6d9bb9f1a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:27.694132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-318518af-183c-4921-864f-b6d9bb9f1a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:27.694610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-318518af-183c-4921-864f-b6d9bb9f1a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.709125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-318518af-183c-4921-864f-b6d9bb9f1a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:27.709822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-318518af-183c-4921-864f-b6d9bb9f1a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:27.710069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-318518af-183c-4921-864f-b6d9bb9f1a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.728524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-318518af-183c-4921-864f-b6d9bb9f1a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:27.729183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-318518af-183c-4921-864f-b6d9bb9f1a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:27.729837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-318518af-183c-4921-864f-b6d9bb9f1a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.737138 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-318518af-183c-4921-864f-b6d9bb9f1a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1469483185-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.208725 Aug 29 15:39:27.737731 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1828/3598] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:39:27 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:27.740445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ac7327e4-3270-4c0c-98af-ac16132f70e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:27.741315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ac7327e4-3270-4c0c-98af-ac16132f70e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:27.748446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac7327e4-3270-4c0c-98af-ac16132f70e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:27.749168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac7327e4-3270-4c0c-98af-ac16132f70e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:27.749817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac7327e4-3270-4c0c-98af-ac16132f70e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.751942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac7327e4-3270-4c0c-98af-ac16132f70e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:27.752429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac7327e4-3270-4c0c-98af-ac16132f70e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:27.752877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac7327e4-3270-4c0c-98af-ac16132f70e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.937005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ac7327e4-3270-4c0c-98af-ac16132f70e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:27.946974 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ac7327e4-3270-4c0c-98af-ac16132f70e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.210930 Aug 29 15:39:27.947550 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1771/3599] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:27 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:27.992161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-741f2568-3832-430c-9594-5feb17a3eb55 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:27.993077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-741f2568-3832-430c-9594-5feb17a3eb55 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:28.000564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-741f2568-3832-430c-9594-5feb17a3eb55 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.001212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-741f2568-3832-430c-9594-5feb17a3eb55 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.001897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-741f2568-3832-430c-9594-5feb17a3eb55 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:28.002857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-741f2568-3832-430c-9594-5feb17a3eb55 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.003427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-741f2568-3832-430c-9594-5feb17a3eb55 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.003931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-741f2568-3832-430c-9594-5feb17a3eb55 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:28.263545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-741f2568-3832-430c-9594-5feb17a3eb55 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:28.277297 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-741f2568-3832-430c-9594-5feb17a3eb55 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1315 microversion: 2.1 time: 0.289093 Aug 29 15:39:28.278180 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1829/3600] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:27 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:28.297076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4bbffa3d-c6fd-420c-bf28-72271e92d0ce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:28.298201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4bbffa3d-c6fd-420c-bf28-72271e92d0ce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:28.305479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bbffa3d-c6fd-420c-bf28-72271e92d0ce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.306813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bbffa3d-c6fd-420c-bf28-72271e92d0ce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.307506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bbffa3d-c6fd-420c-bf28-72271e92d0ce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:28.308445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bbffa3d-c6fd-420c-bf28-72271e92d0ce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.309078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bbffa3d-c6fd-420c-bf28-72271e92d0ce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.309681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bbffa3d-c6fd-420c-bf28-72271e92d0ce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:28.493441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4bbffa3d-c6fd-420c-bf28-72271e92d0ce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:28.507250 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4bbffa3d-c6fd-420c-bf28-72271e92d0ce tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1507 microversion: 2.1 time: 0.212965 Aug 29 15:39:28.523519 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1772/3601] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:28 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:28.549333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aaf44c28-7d2b-4faa-b62f-5b0cb754558c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:28.549965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aaf44c28-7d2b-4faa-b62f-5b0cb754558c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:28.565855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf44c28-7d2b-4faa-b62f-5b0cb754558c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.566452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf44c28-7d2b-4faa-b62f-5b0cb754558c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.567025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf44c28-7d2b-4faa-b62f-5b0cb754558c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:28.567855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf44c28-7d2b-4faa-b62f-5b0cb754558c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.568422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf44c28-7d2b-4faa-b62f-5b0cb754558c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.568954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf44c28-7d2b-4faa-b62f-5b0cb754558c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:28.810945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aaf44c28-7d2b-4faa-b62f-5b0cb754558c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:28.849518 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aaf44c28-7d2b-4faa-b62f-5b0cb754558c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1314 microversion: 2.1 time: 0.305361 Aug 29 15:39:28.852489 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1830/3602] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:28 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:28.968210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f0d67fb7-f21b-4df7-b22c-802abd99c9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:28.968767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f0d67fb7-f21b-4df7-b22c-802abd99c9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:29.009160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0d67fb7-f21b-4df7-b22c-802abd99c9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:29.009799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0d67fb7-f21b-4df7-b22c-802abd99c9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:29.011691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0d67fb7-f21b-4df7-b22c-802abd99c9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:29.012473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0d67fb7-f21b-4df7-b22c-802abd99c9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:29.012942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0d67fb7-f21b-4df7-b22c-802abd99c9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:29.013407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0d67fb7-f21b-4df7-b22c-802abd99c9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:29.299353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7e39e9b1-4578-49db-9243-ccf3bea1fe35 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:29.299986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7e39e9b1-4578-49db-9243-ccf3bea1fe35 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:29.303916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:29.319882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e39e9b1-4578-49db-9243-ccf3bea1fe35 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:29.321644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e39e9b1-4578-49db-9243-ccf3bea1fe35 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:29.323758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e39e9b1-4578-49db-9243-ccf3bea1fe35 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:29.325958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e39e9b1-4578-49db-9243-ccf3bea1fe35 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:29.328924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e39e9b1-4578-49db-9243-ccf3bea1fe35 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:29.329441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e39e9b1-4578-49db-9243-ccf3bea1fe35 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:29.448503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f0d67fb7-f21b-4df7-b22c-802abd99c9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:29.459642 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f0d67fb7-f21b-4df7-b22c-802abd99c9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.495685 Aug 29 15:39:29.470477 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1773/3603] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:28 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:29.874174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6e0081e9-f393-4cc0-b7e1-9e5d3a80a32d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:29.875088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6e0081e9-f393-4cc0-b7e1-9e5d3a80a32d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:29.887063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e0081e9-f393-4cc0-b7e1-9e5d3a80a32d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:29.887558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e0081e9-f393-4cc0-b7e1-9e5d3a80a32d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:29.887991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e0081e9-f393-4cc0-b7e1-9e5d3a80a32d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:29.888700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e0081e9-f393-4cc0-b7e1-9e5d3a80a32d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:29.892550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e0081e9-f393-4cc0-b7e1-9e5d3a80a32d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:29.893781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e0081e9-f393-4cc0-b7e1-9e5d3a80a32d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:29.917152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7e39e9b1-4578-49db-9243-ccf3bea1fe35 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:29.926234 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7e39e9b1-4578-49db-9243-ccf3bea1fe35 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1315 microversion: 2.1 time: 0.631466 Aug 29 15:39:29.941101 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1831/3604] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:29 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:30.485054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c92ca3a6-4205-4331-9a80-b2f977806422 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:30.486743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c92ca3a6-4205-4331-9a80-b2f977806422 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:30.494798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c92ca3a6-4205-4331-9a80-b2f977806422 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.495684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c92ca3a6-4205-4331-9a80-b2f977806422 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.496285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c92ca3a6-4205-4331-9a80-b2f977806422 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:30.497192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c92ca3a6-4205-4331-9a80-b2f977806422 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.497903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c92ca3a6-4205-4331-9a80-b2f977806422 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.498485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c92ca3a6-4205-4331-9a80-b2f977806422 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:30.528649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6e0081e9-f393-4cc0-b7e1-9e5d3a80a32d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:30.542542 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6e0081e9-f393-4cc0-b7e1-9e5d3a80a32d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1314 microversion: 2.1 time: 0.671624 Aug 29 15:39:30.544639 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1774/3605] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:29 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:30.771173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c92ca3a6-4205-4331-9a80-b2f977806422 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:30.788173 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c92ca3a6-4205-4331-9a80-b2f977806422 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.307441 Aug 29 15:39:30.791708 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1832/3606] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:30 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:30.948008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-03d53cff-e843-45b3-beca-4f6c6b025c07 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:30.948658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-03d53cff-e843-45b3-beca-4f6c6b025c07 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:30.959705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d53cff-e843-45b3-beca-4f6c6b025c07 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.960416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d53cff-e843-45b3-beca-4f6c6b025c07 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.962260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d53cff-e843-45b3-beca-4f6c6b025c07 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:30.963283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d53cff-e843-45b3-beca-4f6c6b025c07 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.965167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d53cff-e843-45b3-beca-4f6c6b025c07 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.966652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d53cff-e843-45b3-beca-4f6c6b025c07 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.108498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6eb17493-3397-4f53-98ac-59a3e6928a62 tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f05a2153-7336-463b-9530-f136578fd949"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:31.111257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6eb17493-3397-4f53-98ac-59a3e6928a62 tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:31.118138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eb17493-3397-4f53-98ac-59a3e6928a62 tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.118978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eb17493-3397-4f53-98ac-59a3e6928a62 tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.119645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eb17493-3397-4f53-98ac-59a3e6928a62 tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.121031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eb17493-3397-4f53-98ac-59a3e6928a62 tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.121771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eb17493-3397-4f53-98ac-59a3e6928a62 tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.122421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eb17493-3397-4f53-98ac-59a3e6928a62 tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.223827 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-6eb17493-3397-4f53-98ac-59a3e6928a62 tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] HTTP exception thrown: Volume 58b5b313-1904-498f-8bf6-a44bc3dafd97 could not be found. Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6eb17493-3397-4f53-98ac-59a3e6928a62 tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Request method failure captured: Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: request: PUT /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27/os-volume_attachments/58b5b313-1904-498f-8bf6-a44bc3dafd97 HTTP/1.1 Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 74 Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN0FzXjk3ACNxmp2OBkzl2UwKYKk7_rj5MxFpXrEghsncWflcT4mV2yVAYUseT4Vm4XwZU1ByuyPgLtgYXKEcdFZ_p4_EliKEVsrKH6kiJn4d0d-f9S1nLVJbgWzMm-5ECdL8k_rQFsyJWoB27RzMYDqErpNY0FICHJhkTx_sbRLT1k Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d5d626192612467e96d2b867679663a0 Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-VolumesAdminNegativeTest-279814010 Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d5d626192612467e96d2b867679663a0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d5d626192612467e96d2b867679663a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d5d626192612467e96d2b867679663a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d5d626192612467e96d2b867679663a0"}]}] Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-VolumesAdminNegativeTest-279814010 Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d5d626192612467e96d2b867679663a0 Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-279814010 Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-VolumesAdminNegativeTest-279814010-project-admin Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 4d15bb7dcd9840bc8821c0c361298c5f Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-VolumesAdminNegativeTest-279814010-project-admin Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: {"volumeAttachment": {"volumeId": "f05a2153-7336-463b-9530-f136578fd949"}} Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: exception: Volume 58b5b313-1904-498f-8bf6-a44bc3dafd97 could not be found. Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'server_id': '351a3593-bfab-4658-9e1f-fc9e81ba3e27', 'id': '58b5b313-1904-498f-8bf6-a44bc3dafd97', 'body': {'volumeAttachment': {'volumeId': 'f05a2153-7336-463b-9530-f136578fd949'}}} Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 58b5b313-1904-498f-8bf6-a44bc3dafd97 could not be found. (HTTP 404) (Request-ID: req-7f2dfdb0-79d6-4ebd-92b0-86acf7b10f91) Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:39:31.228396 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 58b5b313-1904-498f-8bf6-a44bc3dafd97 could not be found. Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 58b5b313-1904-498f-8bf6-a44bc3dafd97 could not be found. Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 58b5b313-1904-498f-8bf6-a44bc3dafd97 could not be found. Aug 29 15:39:31.232695 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.241983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6eb17493-3397-4f53-98ac-59a3e6928a62 tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] Returning 404 to user: Volume 58b5b313-1904-498f-8bf6-a44bc3dafd97 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:31.243578 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6eb17493-3397-4f53-98ac-59a3e6928a62 tempest-VolumesAdminNegativeTest-279814010 tempest-VolumesAdminNegativeTest-279814010-project-admin] 10.222.0.62 "PUT /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27/os-volume_attachments/58b5b313-1904-498f-8bf6-a44bc3dafd97" status: 404 len: 109 microversion: 2.1 time: 0.140645 Aug 29 15:39:31.245347 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1833/3607] 10.222.0.62 () {60 vars in 1433 bytes} [Mon Aug 29 15:39:31 2022] PUT /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27/os-volume_attachments/58b5b313-1904-498f-8bf6-a44bc3dafd97 => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:39:31.300766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-5883f690-8dd0-4284-be84-6f3be9463a6c req-04adda56-bc4f-4ab9-a754-89390bb954aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d5c42a-01b8-4e1d-b909-1a52a27bf41b", "name": "network-vif-plugged", "status": "completed", "tag": "9dff70eb-a996-4932-a744-e53eecee5014"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:31.316344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5883f690-8dd0-4284-be84-6f3be9463a6c req-04adda56-bc4f-4ab9-a754-89390bb954aa service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.317408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5883f690-8dd0-4284-be84-6f3be9463a6c req-04adda56-bc4f-4ab9-a754-89390bb954aa service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.317549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-03d53cff-e843-45b3-beca-4f6c6b025c07 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:31.318425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5883f690-8dd0-4284-be84-6f3be9463a6c req-04adda56-bc4f-4ab9-a754-89390bb954aa service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.329631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:31.345680 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-5883f690-8dd0-4284-be84-6f3be9463a6c req-04adda56-bc4f-4ab9-a754-89390bb954aa service nova] Creating event network-vif-plugged:9dff70eb-a996-4932-a744-e53eecee5014 for instance 14d5c42a-01b8-4e1d-b909-1a52a27bf41b on n-h2-839401-11 Aug 29 15:39:31.350821 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-5883f690-8dd0-4284-be84-6f3be9463a6c req-04adda56-bc4f-4ab9-a754-89390bb954aa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053817 Aug 29 15:39:31.351528 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1834/3608] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:39:31.359249 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-03d53cff-e843-45b3-beca-4f6c6b025c07 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1315 microversion: 2.1 time: 0.415447 Aug 29 15:39:31.359848 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1775/3609] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:30 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:31.569780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b992b2db-0a24-47fb-8b64-f97e0f58b6a6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:31.570519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b992b2db-0a24-47fb-8b64-f97e0f58b6a6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:31.578506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b992b2db-0a24-47fb-8b64-f97e0f58b6a6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.579320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b992b2db-0a24-47fb-8b64-f97e0f58b6a6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.579929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b992b2db-0a24-47fb-8b64-f97e0f58b6a6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.581001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b992b2db-0a24-47fb-8b64-f97e0f58b6a6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.582627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b992b2db-0a24-47fb-8b64-f97e0f58b6a6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.583357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b992b2db-0a24-47fb-8b64-f97e0f58b6a6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.770333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b992b2db-0a24-47fb-8b64-f97e0f58b6a6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:31.778818 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b992b2db-0a24-47fb-8b64-f97e0f58b6a6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1314 microversion: 2.1 time: 0.216984 Aug 29 15:39:31.793888 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1835/3610] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:31 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:31.812395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-02d4726a-df94-408f-a8de-7281a41dc20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:31.813616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-02d4726a-df94-408f-a8de-7281a41dc20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:31.824542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02d4726a-df94-408f-a8de-7281a41dc20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.825505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02d4726a-df94-408f-a8de-7281a41dc20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.826261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02d4726a-df94-408f-a8de-7281a41dc20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.827575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02d4726a-df94-408f-a8de-7281a41dc20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.828503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02d4726a-df94-408f-a8de-7281a41dc20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.829190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02d4726a-df94-408f-a8de-7281a41dc20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.090380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-02d4726a-df94-408f-a8de-7281a41dc20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:32.098703 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-02d4726a-df94-408f-a8de-7281a41dc20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.290701 Aug 29 15:39:32.099281 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1776/3611] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:31 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:32.379789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3db51d6b-4348-45bb-b57b-af519d0819de tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:32.381152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3db51d6b-4348-45bb-b57b-af519d0819de tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:32.390401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3db51d6b-4348-45bb-b57b-af519d0819de tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.401910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3db51d6b-4348-45bb-b57b-af519d0819de tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.402736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3db51d6b-4348-45bb-b57b-af519d0819de tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.403782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3db51d6b-4348-45bb-b57b-af519d0819de tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.404509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3db51d6b-4348-45bb-b57b-af519d0819de tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.405194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3db51d6b-4348-45bb-b57b-af519d0819de tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.724051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3db51d6b-4348-45bb-b57b-af519d0819de tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:32.732939 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3db51d6b-4348-45bb-b57b-af519d0819de tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1315 microversion: 2.1 time: 0.356873 Aug 29 15:39:32.746391 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1836/3612] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:32 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:32.800375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d18b4b0f-be08-41d3-8405-34f2bef0194c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:32.800996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d18b4b0f-be08-41d3-8405-34f2bef0194c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:32.808914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d18b4b0f-be08-41d3-8405-34f2bef0194c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.809564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d18b4b0f-be08-41d3-8405-34f2bef0194c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.810068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d18b4b0f-be08-41d3-8405-34f2bef0194c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.811167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d18b4b0f-be08-41d3-8405-34f2bef0194c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.811843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d18b4b0f-be08-41d3-8405-34f2bef0194c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.812814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d18b4b0f-be08-41d3-8405-34f2bef0194c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.068488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d18b4b0f-be08-41d3-8405-34f2bef0194c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:33.079845 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d18b4b0f-be08-41d3-8405-34f2bef0194c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1314 microversion: 2.1 time: 0.283119 Aug 29 15:39:33.080660 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1777/3613] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:32 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:33.120426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-52d79251-fa31-4587-8fdd-60634e9561ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:33.121223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-52d79251-fa31-4587-8fdd-60634e9561ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:33.129600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52d79251-fa31-4587-8fdd-60634e9561ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.130486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52d79251-fa31-4587-8fdd-60634e9561ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.131129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52d79251-fa31-4587-8fdd-60634e9561ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.132239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52d79251-fa31-4587-8fdd-60634e9561ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.133026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52d79251-fa31-4587-8fdd-60634e9561ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.133676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52d79251-fa31-4587-8fdd-60634e9561ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.409850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-52d79251-fa31-4587-8fdd-60634e9561ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:33.418735 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-52d79251-fa31-4587-8fdd-60634e9561ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.302718 Aug 29 15:39:33.432961 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1837/3614] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:33 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:33.706703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b9671e7c-0f85-4f57-9a6b-f93cb15c48d7 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:33.707967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b9671e7c-0f85-4f57-9a6b-f93cb15c48d7 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:33.717827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9671e7c-0f85-4f57-9a6b-f93cb15c48d7 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.719085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9671e7c-0f85-4f57-9a6b-f93cb15c48d7 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.719780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9671e7c-0f85-4f57-9a6b-f93cb15c48d7 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.720662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9671e7c-0f85-4f57-9a6b-f93cb15c48d7 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.721143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9671e7c-0f85-4f57-9a6b-f93cb15c48d7 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.722334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9671e7c-0f85-4f57-9a6b-f93cb15c48d7 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.757569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-af778a93-9c4a-4f92-9aaa-8d89a3db263d tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:33.758765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-af778a93-9c4a-4f92-9aaa-8d89a3db263d tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:33.763373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b9671e7c-0f85-4f57-9a6b-f93cb15c48d7 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:39:33.769617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af778a93-9c4a-4f92-9aaa-8d89a3db263d tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.770773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af778a93-9c4a-4f92-9aaa-8d89a3db263d tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.773553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af778a93-9c4a-4f92-9aaa-8d89a3db263d tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.774662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af778a93-9c4a-4f92-9aaa-8d89a3db263d tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.775735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af778a93-9c4a-4f92-9aaa-8d89a3db263d tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.776524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af778a93-9c4a-4f92-9aaa-8d89a3db263d tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.003939 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b9671e7c-0f85-4f57-9a6b-f93cb15c48d7 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "DELETE /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 204 len: 0 microversion: 2.1 time: 0.309077 Aug 29 15:39:34.007879 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1778/3615] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:33 2022] DELETE /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:34.016826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-70e01708-3516-4e55-809b-4fdf4690910d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:34.020066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-70e01708-3516-4e55-809b-4fdf4690910d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:34.022034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-af778a93-9c4a-4f92-9aaa-8d89a3db263d tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:34.030031 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-af778a93-9c4a-4f92-9aaa-8d89a3db263d tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1315 microversion: 2.1 time: 0.278391 Aug 29 15:39:34.034782 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1838/3616] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:33 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:34.047496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70e01708-3516-4e55-809b-4fdf4690910d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.048005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70e01708-3516-4e55-809b-4fdf4690910d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.049531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70e01708-3516-4e55-809b-4fdf4690910d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.050439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70e01708-3516-4e55-809b-4fdf4690910d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.050910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70e01708-3516-4e55-809b-4fdf4690910d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.051347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70e01708-3516-4e55-809b-4fdf4690910d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.100711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-850408ff-50a6-4a8c-9511-ce9fde32dfd6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:34.101368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-850408ff-50a6-4a8c-9511-ce9fde32dfd6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:34.111429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-850408ff-50a6-4a8c-9511-ce9fde32dfd6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.111936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-850408ff-50a6-4a8c-9511-ce9fde32dfd6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.112385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-850408ff-50a6-4a8c-9511-ce9fde32dfd6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.113134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-850408ff-50a6-4a8c-9511-ce9fde32dfd6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.113596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-850408ff-50a6-4a8c-9511-ce9fde32dfd6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.114240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-850408ff-50a6-4a8c-9511-ce9fde32dfd6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.287576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-850408ff-50a6-4a8c-9511-ce9fde32dfd6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:34.290736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-70e01708-3516-4e55-809b-4fdf4690910d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:34.298196 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-850408ff-50a6-4a8c-9511-ce9fde32dfd6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1314 microversion: 2.1 time: 0.200507 Aug 29 15:39:34.299306 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1839/3617] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:34 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:34.304268 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-70e01708-3516-4e55-809b-4fdf4690910d tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1513 microversion: 2.1 time: 0.291451 Aug 29 15:39:34.305182 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1779/3618] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:34 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1513 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:34.443893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6e186452-f97d-43f5-a097-11615400fc3d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:34.444692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6e186452-f97d-43f5-a097-11615400fc3d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:34.456727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e186452-f97d-43f5-a097-11615400fc3d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.459874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e186452-f97d-43f5-a097-11615400fc3d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.460538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e186452-f97d-43f5-a097-11615400fc3d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.465999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e186452-f97d-43f5-a097-11615400fc3d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.466847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e186452-f97d-43f5-a097-11615400fc3d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.467460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e186452-f97d-43f5-a097-11615400fc3d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.496478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-4dd4b8a1-7b7f-47c9-9ea0-0b6839948a87 req-0ad11067-7963-4037-9a16-296ef1a26e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3fe412-4a55-4b64-9b2f-0302fb13bede", "name": "network-vif-plugged", "status": "completed", "tag": "1cb4516e-b9dd-4bde-96d9-376f37308257"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:34.513763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:34.523329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4dd4b8a1-7b7f-47c9-9ea0-0b6839948a87 req-0ad11067-7963-4037-9a16-296ef1a26e46 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.526215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4dd4b8a1-7b7f-47c9-9ea0-0b6839948a87 req-0ad11067-7963-4037-9a16-296ef1a26e46 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.526993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4dd4b8a1-7b7f-47c9-9ea0-0b6839948a87 req-0ad11067-7963-4037-9a16-296ef1a26e46 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.554671 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-4dd4b8a1-7b7f-47c9-9ea0-0b6839948a87 req-0ad11067-7963-4037-9a16-296ef1a26e46 service nova] Creating event network-vif-plugged:1cb4516e-b9dd-4bde-96d9-376f37308257 for instance bc3fe412-4a55-4b64-9b2f-0302fb13bede on n-h2-839401-11 Aug 29 15:39:34.563739 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-4dd4b8a1-7b7f-47c9-9ea0-0b6839948a87 req-0ad11067-7963-4037-9a16-296ef1a26e46 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071068 Aug 29 15:39:34.577409 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1780/3619] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:39:34.679136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6e186452-f97d-43f5-a097-11615400fc3d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:34.682629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:34.690547 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6e186452-f97d-43f5-a097-11615400fc3d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.254187 Aug 29 15:39:34.691155 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1840/3620] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:34 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:34.957413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-03d608dd-aa54-4b8c-ba26-c95386aa2745 tempest-AZV2TestJSON-307032555 tempest-AZV2TestJSON-307032555-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:34.959175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d608dd-aa54-4b8c-ba26-c95386aa2745 tempest-AZV2TestJSON-307032555 tempest-AZV2TestJSON-307032555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.959973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d608dd-aa54-4b8c-ba26-c95386aa2745 tempest-AZV2TestJSON-307032555 tempest-AZV2TestJSON-307032555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.960757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d608dd-aa54-4b8c-ba26-c95386aa2745 tempest-AZV2TestJSON-307032555 tempest-AZV2TestJSON-307032555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.961828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d608dd-aa54-4b8c-ba26-c95386aa2745 tempest-AZV2TestJSON-307032555 tempest-AZV2TestJSON-307032555-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.962411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d608dd-aa54-4b8c-ba26-c95386aa2745 tempest-AZV2TestJSON-307032555 tempest-AZV2TestJSON-307032555-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.963270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03d608dd-aa54-4b8c-ba26-c95386aa2745 tempest-AZV2TestJSON-307032555 tempest-AZV2TestJSON-307032555-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.990883 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-03d608dd-aa54-4b8c-ba26-c95386aa2745 tempest-AZV2TestJSON-307032555 tempest-AZV2TestJSON-307032555-project] 10.222.0.62 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.215786 Aug 29 15:39:34.994488 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1781/3621] 10.222.0.62 () {58 vars in 1164 bytes} [Mon Aug 29 15:39:34 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:35.056377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a54ea6c0-af57-4848-8596-6aeb3f1e88d1 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.057383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a54ea6c0-af57-4848-8596-6aeb3f1e88d1 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.076219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a54ea6c0-af57-4848-8596-6aeb3f1e88d1 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.079009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a54ea6c0-af57-4848-8596-6aeb3f1e88d1 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.081741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a54ea6c0-af57-4848-8596-6aeb3f1e88d1 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.084429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a54ea6c0-af57-4848-8596-6aeb3f1e88d1 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.085603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a54ea6c0-af57-4848-8596-6aeb3f1e88d1 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.086838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a54ea6c0-af57-4848-8596-6aeb3f1e88d1 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.318318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-46a75911-8d0f-46c6-b395-6d7c658f99f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.319086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-46a75911-8d0f-46c6-b395-6d7c658f99f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.330623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46a75911-8d0f-46c6-b395-6d7c658f99f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.331158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46a75911-8d0f-46c6-b395-6d7c658f99f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.331579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46a75911-8d0f-46c6-b395-6d7c658f99f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.332299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46a75911-8d0f-46c6-b395-6d7c658f99f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.332762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46a75911-8d0f-46c6-b395-6d7c658f99f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.333232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46a75911-8d0f-46c6-b395-6d7c658f99f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.342952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a54ea6c0-af57-4848-8596-6aeb3f1e88d1 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:35.355789 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a54ea6c0-af57-4848-8596-6aeb3f1e88d1 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1502 microversion: 2.1 time: 0.304955 Aug 29 15:39:35.369177 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1841/3622] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:35 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1502 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:35.369177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3dfdba49-c4b5-4717-a313-ffb074d1d593 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.369177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3dfdba49-c4b5-4717-a313-ffb074d1d593 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.373701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dfdba49-c4b5-4717-a313-ffb074d1d593 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.373701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dfdba49-c4b5-4717-a313-ffb074d1d593 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.373701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dfdba49-c4b5-4717-a313-ffb074d1d593 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.374035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dfdba49-c4b5-4717-a313-ffb074d1d593 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.374668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dfdba49-c4b5-4717-a313-ffb074d1d593 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.375268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dfdba49-c4b5-4717-a313-ffb074d1d593 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.551313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3dfdba49-c4b5-4717-a313-ffb074d1d593 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:35.561876 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3dfdba49-c4b5-4717-a313-ffb074d1d593 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1513 microversion: 2.1 time: 0.203682 Aug 29 15:39:35.562818 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1842/3623] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:35 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:35.568973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-553fec03-fd10-448a-91b5-3fa81f5abeef tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.569566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-553fec03-fd10-448a-91b5-3fa81f5abeef tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.576865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-553fec03-fd10-448a-91b5-3fa81f5abeef tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.578728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-553fec03-fd10-448a-91b5-3fa81f5abeef tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.579645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-553fec03-fd10-448a-91b5-3fa81f5abeef tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.580474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-553fec03-fd10-448a-91b5-3fa81f5abeef tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.581150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-553fec03-fd10-448a-91b5-3fa81f5abeef tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.582003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-553fec03-fd10-448a-91b5-3fa81f5abeef tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.631356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-46a75911-8d0f-46c6-b395-6d7c658f99f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:35.639398 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-46a75911-8d0f-46c6-b395-6d7c658f99f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1314 microversion: 2.1 time: 0.324945 Aug 29 15:39:35.640222 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1782/3624] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:35 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:35.667113 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-553fec03-fd10-448a-91b5-3fa81f5abeef tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "DELETE /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.102314 Aug 29 15:39:35.667831 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1843/3625] 10.222.0.62 () {58 vars in 1296 bytes} [Mon Aug 29 15:39:35 2022] DELETE /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b/os-server-password => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:35.677329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8644814b-6db7-4ae0-b62b-3da67922e4cb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.677833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8644814b-6db7-4ae0-b62b-3da67922e4cb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.683827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8644814b-6db7-4ae0-b62b-3da67922e4cb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.684356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8644814b-6db7-4ae0-b62b-3da67922e4cb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.685019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8644814b-6db7-4ae0-b62b-3da67922e4cb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.685997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8644814b-6db7-4ae0-b62b-3da67922e4cb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.686455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8644814b-6db7-4ae0-b62b-3da67922e4cb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.686888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8644814b-6db7-4ae0-b62b-3da67922e4cb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.712242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-38eca386-47b8-45ab-92ad-370a1ca9cc1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.713041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-38eca386-47b8-45ab-92ad-370a1ca9cc1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.714227 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8644814b-6db7-4ae0-b62b-3da67922e4cb tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.041209 Aug 29 15:39:35.715384 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1783/3626] 10.222.0.62 () {58 vars in 1293 bytes} [Mon Aug 29 15:39:35 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b/os-server-password => generated 16 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:35.722078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38eca386-47b8-45ab-92ad-370a1ca9cc1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.723021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38eca386-47b8-45ab-92ad-370a1ca9cc1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.723649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38eca386-47b8-45ab-92ad-370a1ca9cc1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.724457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38eca386-47b8-45ab-92ad-370a1ca9cc1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.725018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38eca386-47b8-45ab-92ad-370a1ca9cc1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.725588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38eca386-47b8-45ab-92ad-370a1ca9cc1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.727624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-280e5b3a-2b00-4f65-8fab-a02bca0c34b4 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.728161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-280e5b3a-2b00-4f65-8fab-a02bca0c34b4 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.734968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-280e5b3a-2b00-4f65-8fab-a02bca0c34b4 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.735462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-280e5b3a-2b00-4f65-8fab-a02bca0c34b4 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.735925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-280e5b3a-2b00-4f65-8fab-a02bca0c34b4 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.737158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-280e5b3a-2b00-4f65-8fab-a02bca0c34b4 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.737784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-280e5b3a-2b00-4f65-8fab-a02bca0c34b4 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.738409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-280e5b3a-2b00-4f65-8fab-a02bca0c34b4 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.775682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-280e5b3a-2b00-4f65-8fab-a02bca0c34b4 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:39:35.888731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-38eca386-47b8-45ab-92ad-370a1ca9cc1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:35.897697 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-280e5b3a-2b00-4f65-8fab-a02bca0c34b4 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "DELETE /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 204 len: 0 microversion: 2.1 time: 0.174925 Aug 29 15:39:35.901892 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1784/3627] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:35 2022] DELETE /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:35.902416 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-38eca386-47b8-45ab-92ad-370a1ca9cc1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.191513 Aug 29 15:39:35.902416 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1844/3628] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:35 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:35.908185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fe55d703-3ec8-4fe3-a1fe-89badd775e8e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.909018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fe55d703-3ec8-4fe3-a1fe-89badd775e8e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.920869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe55d703-3ec8-4fe3-a1fe-89badd775e8e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.921438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe55d703-3ec8-4fe3-a1fe-89badd775e8e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.921865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe55d703-3ec8-4fe3-a1fe-89badd775e8e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.922840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe55d703-3ec8-4fe3-a1fe-89badd775e8e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.923333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe55d703-3ec8-4fe3-a1fe-89badd775e8e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.923832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe55d703-3ec8-4fe3-a1fe-89badd775e8e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.203432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fe55d703-3ec8-4fe3-a1fe-89badd775e8e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:36.216950 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fe55d703-3ec8-4fe3-a1fe-89badd775e8e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1508 microversion: 2.1 time: 0.313095 Aug 29 15:39:36.218511 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1785/3629] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:35 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1508 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:36.508707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-445e225b-ca92-4584-bcfe-da4df8064bb6 req-c82c6047-dd66-461d-a8c0-7ff9cd35448f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "351a3593-bfab-4658-9e1f-fc9e81ba3e27", "name": "network-vif-deleted", "tag": "f3ac8d50-8c2d-416e-abb4-e43e6b31ade5"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:36.525184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-445e225b-ca92-4584-bcfe-da4df8064bb6 req-c82c6047-dd66-461d-a8c0-7ff9cd35448f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.525895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-445e225b-ca92-4584-bcfe-da4df8064bb6 req-c82c6047-dd66-461d-a8c0-7ff9cd35448f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.526548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-445e225b-ca92-4584-bcfe-da4df8064bb6 req-c82c6047-dd66-461d-a8c0-7ff9cd35448f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.546092 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-445e225b-ca92-4584-bcfe-da4df8064bb6 req-c82c6047-dd66-461d-a8c0-7ff9cd35448f service nova] Creating event network-vif-deleted:f3ac8d50-8c2d-416e-abb4-e43e6b31ade5 for instance 351a3593-bfab-4658-9e1f-fc9e81ba3e27 on n-h1-839401-11 Aug 29 15:39:36.556727 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-445e225b-ca92-4584-bcfe-da4df8064bb6 req-c82c6047-dd66-461d-a8c0-7ff9cd35448f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051860 Aug 29 15:39:36.558564 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1845/3630] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:39:36.584287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f6be7d1d-20ee-4c51-9358-2b565351e233 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:36.584996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f6be7d1d-20ee-4c51-9358-2b565351e233 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:36.608318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6be7d1d-20ee-4c51-9358-2b565351e233 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.608885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6be7d1d-20ee-4c51-9358-2b565351e233 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.610402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6be7d1d-20ee-4c51-9358-2b565351e233 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.615267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6be7d1d-20ee-4c51-9358-2b565351e233 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.616500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6be7d1d-20ee-4c51-9358-2b565351e233 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.617045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6be7d1d-20ee-4c51-9358-2b565351e233 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.661999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2119cfed-3b9d-4adc-bf4c-3b0bc186d876 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:36.665199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2119cfed-3b9d-4adc-bf4c-3b0bc186d876 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:36.681327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2119cfed-3b9d-4adc-bf4c-3b0bc186d876 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.681900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2119cfed-3b9d-4adc-bf4c-3b0bc186d876 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.682464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2119cfed-3b9d-4adc-bf4c-3b0bc186d876 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.685050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2119cfed-3b9d-4adc-bf4c-3b0bc186d876 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.685606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2119cfed-3b9d-4adc-bf4c-3b0bc186d876 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.687337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2119cfed-3b9d-4adc-bf4c-3b0bc186d876 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.750145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f6be7d1d-20ee-4c51-9358-2b565351e233 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:36.765767 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f6be7d1d-20ee-4c51-9358-2b565351e233 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 200 len: 1302 microversion: 2.1 time: 0.185703 Aug 29 15:39:36.768380 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1786/3631] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:36 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 1302 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:36.894472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2119cfed-3b9d-4adc-bf4c-3b0bc186d876 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:36.907185 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2119cfed-3b9d-4adc-bf4c-3b0bc186d876 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1314 microversion: 2.1 time: 0.250691 Aug 29 15:39:36.908062 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1846/3632] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:36 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:36.924187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4895c82a-5594-41ec-a781-cf12fe47a3fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:36.924961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4895c82a-5594-41ec-a781-cf12fe47a3fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:36.932674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4895c82a-5594-41ec-a781-cf12fe47a3fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.933293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4895c82a-5594-41ec-a781-cf12fe47a3fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.933980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4895c82a-5594-41ec-a781-cf12fe47a3fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.934692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4895c82a-5594-41ec-a781-cf12fe47a3fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.935151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4895c82a-5594-41ec-a781-cf12fe47a3fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.935572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4895c82a-5594-41ec-a781-cf12fe47a3fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.085500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4895c82a-5594-41ec-a781-cf12fe47a3fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:37.096174 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4895c82a-5594-41ec-a781-cf12fe47a3fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.175877 Aug 29 15:39:37.097543 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1787/3633] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:36 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:37.240101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b1a57ed-a484-4094-b585-5e191c7d7088 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:37.240736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6b1a57ed-a484-4094-b585-5e191c7d7088 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:37.251812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b1a57ed-a484-4094-b585-5e191c7d7088 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.253845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b1a57ed-a484-4094-b585-5e191c7d7088 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.254825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b1a57ed-a484-4094-b585-5e191c7d7088 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.256748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b1a57ed-a484-4094-b585-5e191c7d7088 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.257595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b1a57ed-a484-4094-b585-5e191c7d7088 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.258261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b1a57ed-a484-4094-b585-5e191c7d7088 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.469802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b1a57ed-a484-4094-b585-5e191c7d7088 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:37.484362 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6b1a57ed-a484-4094-b585-5e191c7d7088 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1508 microversion: 2.1 time: 0.247889 Aug 29 15:39:37.484972 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1847/3634] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:37 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1508 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:37.797274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-522904a4-7642-4b87-bb7e-b8c2ba192d53 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:37.798558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-522904a4-7642-4b87-bb7e-b8c2ba192d53 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 351a3593-bfab-4658-9e1f-fc9e81ba3e27] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:37.806199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-522904a4-7642-4b87-bb7e-b8c2ba192d53 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.807835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-522904a4-7642-4b87-bb7e-b8c2ba192d53 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.808474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-522904a4-7642-4b87-bb7e-b8c2ba192d53 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.809473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-522904a4-7642-4b87-bb7e-b8c2ba192d53 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.810542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-522904a4-7642-4b87-bb7e-b8c2ba192d53 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.811165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-522904a4-7642-4b87-bb7e-b8c2ba192d53 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.834059 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-522904a4-7642-4b87-bb7e-b8c2ba192d53 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] HTTP exception thrown: Instance 351a3593-bfab-4658-9e1f-fc9e81ba3e27 could not be found. Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-522904a4-7642-4b87-bb7e-b8c2ba192d53 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Request method failure captured: Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 HTTP/1.1 Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNz1hIdZt_suSHp_zw07kITcM1Gs040kzv0_oqiIQnaDxJtgBWSAXsQh_VHjgicOGL6eSi9j44gA9yZLwNkpiTWXyod7tgRzCUyNWhxA8Hs5HeZPd6GjQpZJ1bXAeVFBdP0ycgChRWrFqFQ58A3wXTV4QDpf6JipgGbkKkXWGES7QVc Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 4f7cf262cab649fea4b4a44d3c4d7dec Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-VolumesAdminNegativeTest-432376042 Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f7cf262cab649fea4b4a44d3c4d7dec", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f7cf262cab649fea4b4a44d3c4d7dec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f7cf262cab649fea4b4a44d3c4d7dec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f7cf262cab649fea4b4a44d3c4d7dec"}]}] Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-VolumesAdminNegativeTest-432376042 Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 4f7cf262cab649fea4b4a44d3c4d7dec Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-432376042 Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-VolumesAdminNegativeTest-432376042-project Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: d6e53abcc8ad4e1b91ed86a6c1fdb021 Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-VolumesAdminNegativeTest-432376042-project Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 351a3593-bfab-4658-9e1f-fc9e81ba3e27 could not be found. Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '351a3593-bfab-4658-9e1f-fc9e81ba3e27'} Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 351a3593-bfab-4658-9e1f-fc9e81ba3e27 could not be found. Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 351a3593-bfab-4658-9e1f-fc9e81ba3e27 could not be found. Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:37.836291 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:37.841347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:37.841347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:37.841347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:37.841347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:37.841347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:37.841347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 351a3593-bfab-4658-9e1f-fc9e81ba3e27 could not be found. Aug 29 15:39:37.841347 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:39:37.849300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-522904a4-7642-4b87-bb7e-b8c2ba192d53 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Returning 404 to user: Instance 351a3593-bfab-4658-9e1f-fc9e81ba3e27 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:37.850601 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-522904a4-7642-4b87-bb7e-b8c2ba192d53 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27" status: 404 len: 111 microversion: 2.1 time: 0.061394 Aug 29 15:39:37.852019 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1788/3635] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:37 2022] GET /compute/v2.1/servers/351a3593-bfab-4658-9e1f-fc9e81ba3e27 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:37.932324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98540ac8-c73b-4781-8abf-89cb447044a4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:37.934095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-98540ac8-c73b-4781-8abf-89cb447044a4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:37.970677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98540ac8-c73b-4781-8abf-89cb447044a4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.971698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98540ac8-c73b-4781-8abf-89cb447044a4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.974898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98540ac8-c73b-4781-8abf-89cb447044a4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.976595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98540ac8-c73b-4781-8abf-89cb447044a4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.977715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98540ac8-c73b-4781-8abf-89cb447044a4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.979240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98540ac8-c73b-4781-8abf-89cb447044a4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.118280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-abaa41a0-ea75-4a0b-9ed1-a8acdffedf26 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:38.119316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-abaa41a0-ea75-4a0b-9ed1-a8acdffedf26 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:38.128338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abaa41a0-ea75-4a0b-9ed1-a8acdffedf26 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.132259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abaa41a0-ea75-4a0b-9ed1-a8acdffedf26 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.133881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abaa41a0-ea75-4a0b-9ed1-a8acdffedf26 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.136372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abaa41a0-ea75-4a0b-9ed1-a8acdffedf26 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.137116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abaa41a0-ea75-4a0b-9ed1-a8acdffedf26 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.139482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abaa41a0-ea75-4a0b-9ed1-a8acdffedf26 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.263042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-98540ac8-c73b-4781-8abf-89cb447044a4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:38.297662 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-98540ac8-c73b-4781-8abf-89cb447044a4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1464 microversion: 2.1 time: 0.356170 Aug 29 15:39:38.303308 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1848/3636] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:37 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1464 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:38.668977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a101b15a-0b30-425f-8155-797f227d61a4 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:38.675831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a101b15a-0b30-425f-8155-797f227d61a4 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Searching by: {'deleted': False, 'project_id': '2c35b000bb2242cfaaf8b4b748047a2b'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:39:38.684431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a101b15a-0b30-425f-8155-797f227d61a4 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.685630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a101b15a-0b30-425f-8155-797f227d61a4 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.686651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a101b15a-0b30-425f-8155-797f227d61a4 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.687835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a101b15a-0b30-425f-8155-797f227d61a4 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.688537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a101b15a-0b30-425f-8155-797f227d61a4 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.689358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a101b15a-0b30-425f-8155-797f227d61a4 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.744383 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a101b15a-0b30-425f-8155-797f227d61a4 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.423176 Aug 29 15:39:38.759797 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1849/3637] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:39:38 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:38.766642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6d716d33-944b-4672-a2de-d2a1c7234fc9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:38.767459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6d716d33-944b-4672-a2de-d2a1c7234fc9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:38.775561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d716d33-944b-4672-a2de-d2a1c7234fc9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.776358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d716d33-944b-4672-a2de-d2a1c7234fc9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.776989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d716d33-944b-4672-a2de-d2a1c7234fc9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.777914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d716d33-944b-4672-a2de-d2a1c7234fc9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.778581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d716d33-944b-4672-a2de-d2a1c7234fc9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.780245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d716d33-944b-4672-a2de-d2a1c7234fc9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.882810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-abaa41a0-ea75-4a0b-9ed1-a8acdffedf26 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:38.894610 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-abaa41a0-ea75-4a0b-9ed1-a8acdffedf26 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.780694 Aug 29 15:39:38.895234 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1789/3638] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:38 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:38.913679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-77da6082-1d86-42f5-952f-99eea7785545 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:38.923748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-77da6082-1d86-42f5-952f-99eea7785545 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Searching by: {'deleted': False} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:39:38.931834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77da6082-1d86-42f5-952f-99eea7785545 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.932703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77da6082-1d86-42f5-952f-99eea7785545 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.933439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77da6082-1d86-42f5-952f-99eea7785545 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.934583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77da6082-1d86-42f5-952f-99eea7785545 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.935335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77da6082-1d86-42f5-952f-99eea7785545 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.936153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77da6082-1d86-42f5-952f-99eea7785545 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:39.019446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6d716d33-944b-4672-a2de-d2a1c7234fc9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:39.042797 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6d716d33-944b-4672-a2de-d2a1c7234fc9 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1508 microversion: 2.1 time: 0.281373 Aug 29 15:39:39.045429 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1850/3639] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:38 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1508 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:39.127614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-77da6082-1d86-42f5-952f-99eea7785545 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:39:39.214556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77da6082-1d86-42f5-952f-99eea7785545 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:39.215529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77da6082-1d86-42f5-952f-99eea7785545 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:39.216315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77da6082-1d86-42f5-952f-99eea7785545 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:39.225040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:39.579727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-68b4c3ce-affb-49c3-a4d1-f722ff996f6c req-0a54a3e8-7882-4be3-b5c8-b80c194d27aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d5c42a-01b8-4e1d-b909-1a52a27bf41b", "name": "network-vif-deleted", "tag": "9dff70eb-a996-4932-a744-e53eecee5014"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:39.609988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-68b4c3ce-affb-49c3-a4d1-f722ff996f6c req-0a54a3e8-7882-4be3-b5c8-b80c194d27aa service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:39.612615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-68b4c3ce-affb-49c3-a4d1-f722ff996f6c req-0a54a3e8-7882-4be3-b5c8-b80c194d27aa service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:39.613209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-68b4c3ce-affb-49c3-a4d1-f722ff996f6c req-0a54a3e8-7882-4be3-b5c8-b80c194d27aa service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:39.648443 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-68b4c3ce-affb-49c3-a4d1-f722ff996f6c req-0a54a3e8-7882-4be3-b5c8-b80c194d27aa service nova] Creating event network-vif-deleted:9dff70eb-a996-4932-a744-e53eecee5014 for instance 14d5c42a-01b8-4e1d-b909-1a52a27bf41b on n-h2-839401-11 Aug 29 15:39:39.659949 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-68b4c3ce-affb-49c3-a4d1-f722ff996f6c req-0a54a3e8-7882-4be3-b5c8-b80c194d27aa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082894 Aug 29 15:39:39.664055 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1851/3640] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:39.919387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-52edb5dd-da2b-49e6-ab03-1b83f9a4dd93 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:39.920736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-52edb5dd-da2b-49e6-ab03-1b83f9a4dd93 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:39.946854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52edb5dd-da2b-49e6-ab03-1b83f9a4dd93 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:39.947392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52edb5dd-da2b-49e6-ab03-1b83f9a4dd93 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:39.947925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52edb5dd-da2b-49e6-ab03-1b83f9a4dd93 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:39.952122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52edb5dd-da2b-49e6-ab03-1b83f9a4dd93 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:39.952565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52edb5dd-da2b-49e6-ab03-1b83f9a4dd93 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:39.953271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52edb5dd-da2b-49e6-ab03-1b83f9a4dd93 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.039759 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-77da6082-1d86-42f5-952f-99eea7785545 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 16526 microversion: 2.1 time: 1.129616 Aug 29 15:39:40.040487 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1790/3641] 10.222.0.62 () {58 vars in 1171 bytes} [Mon Aug 29 15:39:38 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 16526 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:39:40.081841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b489e49d-2f6b-4086-90e4-5d544cccc320 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:40.082935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b489e49d-2f6b-4086-90e4-5d544cccc320 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:40.092388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b489e49d-2f6b-4086-90e4-5d544cccc320 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.093021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b489e49d-2f6b-4086-90e4-5d544cccc320 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.093687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b489e49d-2f6b-4086-90e4-5d544cccc320 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.094507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b489e49d-2f6b-4086-90e4-5d544cccc320 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.095067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b489e49d-2f6b-4086-90e4-5d544cccc320 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.095587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b489e49d-2f6b-4086-90e4-5d544cccc320 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.136355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b489e49d-2f6b-4086-90e4-5d544cccc320 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.136960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b489e49d-2f6b-4086-90e4-5d544cccc320 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.137602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b489e49d-2f6b-4086-90e4-5d544cccc320 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.138406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-b489e49d-2f6b-4086-90e4-5d544cccc320 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lazy-loading 'fault' on Instance uuid 14d5c42a-01b8-4e1d-b909-1a52a27bf41b {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:40.192998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b489e49d-2f6b-4086-90e4-5d544cccc320 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89489223f1fc43bca50388a91cf48afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85af5b50c7e45fc8d1435c0acd2fd0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:40.219841 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b489e49d-2f6b-4086-90e4-5d544cccc320 tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 200 len: 1305 microversion: 2.1 time: 0.154403 Aug 29 15:39:40.221476 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1791/3642] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:40 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 1305 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:40.226125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cde1dd6d-91ef-44f0-afec-aa278dabcda0 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:40.231315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cde1dd6d-91ef-44f0-afec-aa278dabcda0 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Searching by: {'deleted': False, 'project_id': '2c35b000bb2242cfaaf8b4b748047a2b'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:39:40.236801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde1dd6d-91ef-44f0-afec-aa278dabcda0 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.237668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde1dd6d-91ef-44f0-afec-aa278dabcda0 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.238880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde1dd6d-91ef-44f0-afec-aa278dabcda0 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.241647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde1dd6d-91ef-44f0-afec-aa278dabcda0 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.242901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde1dd6d-91ef-44f0-afec-aa278dabcda0 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.243587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde1dd6d-91ef-44f0-afec-aa278dabcda0 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.289114 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cde1dd6d-91ef-44f0-afec-aa278dabcda0 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/detail?tenant_id=f7b1f33fac61405285832b32e2a5c0b4" status: 200 len: 15 microversion: 2.1 time: 0.066373 Aug 29 15:39:40.290125 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1792/3643] 10.222.0.62 () {58 vars in 1231 bytes} [Mon Aug 29 15:39:40 2022] GET /compute/v2.1/servers/detail?tenant_id=f7b1f33fac61405285832b32e2a5c0b4 => generated 15 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:40.316485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-74a8727c-5b6b-408d-8f25-73f269085901 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:40.325773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-74a8727c-5b6b-408d-8f25-73f269085901 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Searching by: {'tenant_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'deleted': False} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:39:40.334692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74a8727c-5b6b-408d-8f25-73f269085901 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.336213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74a8727c-5b6b-408d-8f25-73f269085901 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.336871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74a8727c-5b6b-408d-8f25-73f269085901 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.338308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74a8727c-5b6b-408d-8f25-73f269085901 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.339058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74a8727c-5b6b-408d-8f25-73f269085901 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.339710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74a8727c-5b6b-408d-8f25-73f269085901 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.799046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-52edb5dd-da2b-49e6-ab03-1b83f9a4dd93 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:40.820036 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-52edb5dd-da2b-49e6-ab03-1b83f9a4dd93 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.907468 Aug 29 15:39:40.820702 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1852/3644] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:39 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:40.980308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-74a8727c-5b6b-408d-8f25-73f269085901 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:39:41.085610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74a8727c-5b6b-408d-8f25-73f269085901 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.086282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74a8727c-5b6b-408d-8f25-73f269085901 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.086703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74a8727c-5b6b-408d-8f25-73f269085901 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.248546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-697f529d-6a55-4df2-b510-c9a2e047955e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.249512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-697f529d-6a55-4df2-b510-c9a2e047955e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] [instance: 14d5c42a-01b8-4e1d-b909-1a52a27bf41b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:41.261652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-697f529d-6a55-4df2-b510-c9a2e047955e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.268986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-697f529d-6a55-4df2-b510-c9a2e047955e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.270614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-697f529d-6a55-4df2-b510-c9a2e047955e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.277603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-697f529d-6a55-4df2-b510-c9a2e047955e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.278173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-697f529d-6a55-4df2-b510-c9a2e047955e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.278610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-697f529d-6a55-4df2-b510-c9a2e047955e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.310224 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-74a8727c-5b6b-408d-8f25-73f269085901 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f7b1f33fac61405285832b32e2a5c0b4" status: 200 len: 4832 microversion: 2.1 time: 1.002115 Aug 29 15:39:41.311229 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1793/3645] 10.222.0.62 () {58 vars in 1257 bytes} [Mon Aug 29 15:39:40 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f7b1f33fac61405285832b32e2a5c0b4 => generated 4832 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-697f529d-6a55-4df2-b510-c9a2e047955e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] HTTP exception thrown: Instance 14d5c42a-01b8-4e1d-b909-1a52a27bf41b could not be found. Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-697f529d-6a55-4df2-b510-c9a2e047955e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Request method failure captured: Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b HTTP/1.1 Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN2bnQTmXtu_RCbq3nygBMRwHS_O1tnjF_oSOkt_M9SdWSc3skSWWPw2dvHx5VqHrnIWUE7_pMq36ziv3tB-SuiPlDcYdwDuAFf1fsgLZfftb-BPTVNa4_P5lG3EiZqB02_yufUxje79PmQt2sA0FByCw6x6DenNMjxdAZ3MjIxaCoc Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: f85af5b50c7e45fc8d1435c0acd2fd0f Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerPasswordTestJSON-231872921 Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f85af5b50c7e45fc8d1435c0acd2fd0f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f85af5b50c7e45fc8d1435c0acd2fd0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f85af5b50c7e45fc8d1435c0acd2fd0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f85af5b50c7e45fc8d1435c0acd2fd0f"}]}] Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerPasswordTestJSON-231872921 Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: f85af5b50c7e45fc8d1435c0acd2fd0f Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerPasswordTestJSON-231872921 Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerPasswordTestJSON-231872921-project Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 89489223f1fc43bca50388a91cf48afd Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerPasswordTestJSON-231872921-project Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 14d5c42a-01b8-4e1d-b909-1a52a27bf41b could not be found. Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '14d5c42a-01b8-4e1d-b909-1a52a27bf41b'} Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14d5c42a-01b8-4e1d-b909-1a52a27bf41b could not be found. Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:41.325006 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:41.334698 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14d5c42a-01b8-4e1d-b909-1a52a27bf41b could not be found. Aug 29 15:39:41.334698 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:41.334698 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:41.334698 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:41.334698 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:41.334698 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:41.334698 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:41.334698 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:41.334698 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:41.334698 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14d5c42a-01b8-4e1d-b909-1a52a27bf41b could not be found. Aug 29 15:39:41.334698 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:41.334698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-697f529d-6a55-4df2-b510-c9a2e047955e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] Returning 404 to user: Instance 14d5c42a-01b8-4e1d-b909-1a52a27bf41b could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:41.334698 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-697f529d-6a55-4df2-b510-c9a2e047955e tempest-ServerPasswordTestJSON-231872921 tempest-ServerPasswordTestJSON-231872921-project] 10.222.0.62 "GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b" status: 404 len: 111 microversion: 2.1 time: 0.080506 Aug 29 15:39:41.334698 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1853/3646] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:41 2022] GET /compute/v2.1/servers/14d5c42a-01b8-4e1d-b909-1a52a27bf41b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:41.353177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a17aab45-5791-4c66-9445-b93ada4ca5db tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.361129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a17aab45-5791-4c66-9445-b93ada4ca5db tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Searching by: {'tenant_id': '2c35b000bb2242cfaaf8b4b748047a2b', 'deleted': False} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:39:41.366254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a17aab45-5791-4c66-9445-b93ada4ca5db tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.367010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a17aab45-5791-4c66-9445-b93ada4ca5db tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.367646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a17aab45-5791-4c66-9445-b93ada4ca5db tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.368569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a17aab45-5791-4c66-9445-b93ada4ca5db tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.369280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a17aab45-5791-4c66-9445-b93ada4ca5db tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.369952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a17aab45-5791-4c66-9445-b93ada4ca5db tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.404892 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a17aab45-5791-4c66-9445-b93ada4ca5db tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2c35b000bb2242cfaaf8b4b748047a2b" status: 200 len: 15 microversion: 2.1 time: 0.068434 Aug 29 15:39:41.406005 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1854/3647] 10.222.0.62 () {58 vars in 1257 bytes} [Mon Aug 29 15:39:41 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2c35b000bb2242cfaaf8b4b748047a2b => generated 15 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:41.426844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3fede21a-2efe-4946-817c-617b03bce6ec tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.437149 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3fede21a-2efe-4946-817c-617b03bce6ec tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.014039 Aug 29 15:39:41.450473 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1794/3648] 10.222.0.62 () {58 vars in 1189 bytes} [Mon Aug 29 15:39:41 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:41.460153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8108fb25-ed57-4c53-8da6-eafa63aa5fae tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:41.464015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8108fb25-ed57-4c53-8da6-eafa63aa5fae tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:41.471895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8108fb25-ed57-4c53-8da6-eafa63aa5fae tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.473413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8108fb25-ed57-4c53-8da6-eafa63aa5fae tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.474578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8108fb25-ed57-4c53-8da6-eafa63aa5fae tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.475724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8108fb25-ed57-4c53-8da6-eafa63aa5fae tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.476550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8108fb25-ed57-4c53-8da6-eafa63aa5fae tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.477258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8108fb25-ed57-4c53-8da6-eafa63aa5fae tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.579880 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8108fb25-ed57-4c53-8da6-eafa63aa5fae tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c/action" status: 202 len: 0 microversion: 2.1 time: 0.124179 Aug 29 15:39:41.581624 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1855/3649] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:41 2022] POST /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:39:41.589530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eb3d71d4-cc59-482e-b4c5-83390b5fa795 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.594374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eb3d71d4-cc59-482e-b4c5-83390b5fa795 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:41.595081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eb3d71d4-cc59-482e-b4c5-83390b5fa795 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:39:41.610673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb3d71d4-cc59-482e-b4c5-83390b5fa795 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.611991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb3d71d4-cc59-482e-b4c5-83390b5fa795 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.612792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb3d71d4-cc59-482e-b4c5-83390b5fa795 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.615251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb3d71d4-cc59-482e-b4c5-83390b5fa795 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.616671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb3d71d4-cc59-482e-b4c5-83390b5fa795 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.618495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb3d71d4-cc59-482e-b4c5-83390b5fa795 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.653385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-eb3d71d4-cc59-482e-b4c5-83390b5fa795 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:39:41.683267 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eb3d71d4-cc59-482e-b4c5-83390b5fa795 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.097404 Aug 29 15:39:41.690315 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1795/3650] 10.222.0.62 () {58 vars in 1150 bytes} [Mon Aug 29 15:39:41 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:41.697413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-048a9ded-6ee3-458a-82d6-f38b8866703f tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:41.700862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-048a9ded-6ee3-458a-82d6-f38b8866703f tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:41.719829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-048a9ded-6ee3-458a-82d6-f38b8866703f tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.722082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-048a9ded-6ee3-458a-82d6-f38b8866703f tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.722693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-048a9ded-6ee3-458a-82d6-f38b8866703f tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.724322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-048a9ded-6ee3-458a-82d6-f38b8866703f tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.725236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-048a9ded-6ee3-458a-82d6-f38b8866703f tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.725973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-048a9ded-6ee3-458a-82d6-f38b8866703f tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.833758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:41.845054 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-048a9ded-6ee3-458a-82d6-f38b8866703f tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c/action" status: 202 len: 0 microversion: 2.1 time: 0.152473 Aug 29 15:39:41.849713 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1856/3651] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:41 2022] POST /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:41.855374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2a6c1f8c-46b9-44ec-8232-b5f7c8a137a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.855974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2a6c1f8c-46b9-44ec-8232-b5f7c8a137a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:41.859694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bd451a12-fc3a-49cc-aa87-3789b7492758 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.860751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bd451a12-fc3a-49cc-aa87-3789b7492758 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:41.867435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a6c1f8c-46b9-44ec-8232-b5f7c8a137a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.867965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a6c1f8c-46b9-44ec-8232-b5f7c8a137a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.868437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a6c1f8c-46b9-44ec-8232-b5f7c8a137a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.870803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd451a12-fc3a-49cc-aa87-3789b7492758 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.871612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd451a12-fc3a-49cc-aa87-3789b7492758 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.872292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd451a12-fc3a-49cc-aa87-3789b7492758 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.872477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a6c1f8c-46b9-44ec-8232-b5f7c8a137a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.873024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a6c1f8c-46b9-44ec-8232-b5f7c8a137a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.873202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd451a12-fc3a-49cc-aa87-3789b7492758 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.873618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd451a12-fc3a-49cc-aa87-3789b7492758 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.873727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a6c1f8c-46b9-44ec-8232-b5f7c8a137a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.874061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd451a12-fc3a-49cc-aa87-3789b7492758 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.096917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2a6c1f8c-46b9-44ec-8232-b5f7c8a137a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:42.105849 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2a6c1f8c-46b9-44ec-8232-b5f7c8a137a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.257002 Aug 29 15:39:42.118827 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1796/3652] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:41 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:42.396371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-12ab081e-fc81-49c9-8a8d-3b1b925d26ea tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:42.396892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-12ab081e-fc81-49c9-8a8d-3b1b925d26ea tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:42.410261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12ab081e-fc81-49c9-8a8d-3b1b925d26ea tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.412954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12ab081e-fc81-49c9-8a8d-3b1b925d26ea tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.413443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12ab081e-fc81-49c9-8a8d-3b1b925d26ea tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.414187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12ab081e-fc81-49c9-8a8d-3b1b925d26ea tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.417118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12ab081e-fc81-49c9-8a8d-3b1b925d26ea tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.418469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12ab081e-fc81-49c9-8a8d-3b1b925d26ea tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.461399 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bd451a12-fc3a-49cc-aa87-3789b7492758 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1617 microversion: 2.1 time: 0.610046 Aug 29 15:39:42.478615 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1857/3653] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:41 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1617 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:42.484333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-12ab081e-fc81-49c9-8a8d-3b1b925d26ea tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:39:42.498818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6693bd04-c1d5-434d-bd57-16d8f0172560 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:42.501999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6693bd04-c1d5-434d-bd57-16d8f0172560 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:42.515929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6693bd04-c1d5-434d-bd57-16d8f0172560 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.517687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6693bd04-c1d5-434d-bd57-16d8f0172560 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.519229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6693bd04-c1d5-434d-bd57-16d8f0172560 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.521341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6693bd04-c1d5-434d-bd57-16d8f0172560 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.522022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6693bd04-c1d5-434d-bd57-16d8f0172560 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.526479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6693bd04-c1d5-434d-bd57-16d8f0172560 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.676618 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-12ab081e-fc81-49c9-8a8d-3b1b925d26ea tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "DELETE /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 204 len: 0 microversion: 2.1 time: 0.284714 Aug 29 15:39:42.677263 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1797/3654] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:42 2022] DELETE /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:39:42.695640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f90c4ad7-23df-4b35-9b81-3c4c2480f4e0 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:42.696405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f90c4ad7-23df-4b35-9b81-3c4c2480f4e0 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:42.709281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f90c4ad7-23df-4b35-9b81-3c4c2480f4e0 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.709792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f90c4ad7-23df-4b35-9b81-3c4c2480f4e0 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.710266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f90c4ad7-23df-4b35-9b81-3c4c2480f4e0 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.711158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f90c4ad7-23df-4b35-9b81-3c4c2480f4e0 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.711625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f90c4ad7-23df-4b35-9b81-3c4c2480f4e0 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.713050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f90c4ad7-23df-4b35-9b81-3c4c2480f4e0 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.924970 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6693bd04-c1d5-434d-bd57-16d8f0172560 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1617 microversion: 2.1 time: 0.437899 Aug 29 15:39:42.926075 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1858/3655] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:42 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1617 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:42.945212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-750c8c3e-bebe-4782-b835-f5e41611c52d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:42.952030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-750c8c3e-bebe-4782-b835-f5e41611c52d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Searching by: {'host': 'n-h2-839401-11', 'deleted': False} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:39:42.957243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-750c8c3e-bebe-4782-b835-f5e41611c52d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.958094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-750c8c3e-bebe-4782-b835-f5e41611c52d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.958538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-750c8c3e-bebe-4782-b835-f5e41611c52d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.959471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-750c8c3e-bebe-4782-b835-f5e41611c52d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.960114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-750c8c3e-bebe-4782-b835-f5e41611c52d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.960701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-750c8c3e-bebe-4782-b835-f5e41611c52d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.978569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f90c4ad7-23df-4b35-9b81-3c4c2480f4e0 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:42.987180 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f90c4ad7-23df-4b35-9b81-3c4c2480f4e0 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1679 microversion: 2.1 time: 0.303193 Aug 29 15:39:42.993644 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1798/3656] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:42 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1679 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:43.103445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-750c8c3e-bebe-4782-b835-f5e41611c52d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:39:43.132256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f0193624-85a7-42b5-a78b-d42867eb0367 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:43.133595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f0193624-85a7-42b5-a78b-d42867eb0367 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:43.141631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0193624-85a7-42b5-a78b-d42867eb0367 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.142477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0193624-85a7-42b5-a78b-d42867eb0367 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.143437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0193624-85a7-42b5-a78b-d42867eb0367 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.144461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0193624-85a7-42b5-a78b-d42867eb0367 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.145262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0193624-85a7-42b5-a78b-d42867eb0367 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.145865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0193624-85a7-42b5-a78b-d42867eb0367 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.234142 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-750c8c3e-bebe-4782-b835-f5e41611c52d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "GET /compute/v2.1/servers?host=n-h2-839401-11&all_tenants=1" status: 200 len: 1636 microversion: 2.1 time: 0.292281 Aug 29 15:39:43.242555 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1859/3657] 10.222.0.62 () {58 vars in 1192 bytes} [Mon Aug 29 15:39:42 2022] GET /compute/v2.1/servers?host=n-h2-839401-11&all_tenants=1 => generated 1636 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:43.248074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-18fe5445-65f8-41ef-a856-f36f751d25d2 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:43.254081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-18fe5445-65f8-41ef-a856-f36f751d25d2 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:39:43.260043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18fe5445-65f8-41ef-a856-f36f751d25d2 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.260816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18fe5445-65f8-41ef-a856-f36f751d25d2 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.261653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18fe5445-65f8-41ef-a856-f36f751d25d2 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.262568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18fe5445-65f8-41ef-a856-f36f751d25d2 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.263201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18fe5445-65f8-41ef-a856-f36f751d25d2 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.263799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18fe5445-65f8-41ef-a856-f36f751d25d2 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.286737 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-18fe5445-65f8-41ef-a856-f36f751d25d2 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.043531 Aug 29 15:39:43.287991 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1860/3658] 10.222.0.62 () {58 vars in 1196 bytes} [Mon Aug 29 15:39:43 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:43.300149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2698f378-0b10-41ea-a3f2-75d105a62e4d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:43.302895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2698f378-0b10-41ea-a3f2-75d105a62e4d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:43.310110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2698f378-0b10-41ea-a3f2-75d105a62e4d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.310839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2698f378-0b10-41ea-a3f2-75d105a62e4d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.311578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2698f378-0b10-41ea-a3f2-75d105a62e4d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.312449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2698f378-0b10-41ea-a3f2-75d105a62e4d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.313065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2698f378-0b10-41ea-a3f2-75d105a62e4d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.313675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2698f378-0b10-41ea-a3f2-75d105a62e4d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.401123 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2698f378-0b10-41ea-a3f2-75d105a62e4d tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c/action" status: 202 len: 0 microversion: 2.1 time: 0.104871 Aug 29 15:39:43.405882 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1861/3659] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:43 2022] POST /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:39:43.415287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:43.419633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:43.426447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.427671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.428359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.429346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.430032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.430682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.526951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:43.527826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:43.529376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:43.530052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:43.530702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:43.580281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f0193624-85a7-42b5-a78b-d42867eb0367 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:43.588152 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f0193624-85a7-42b5-a78b-d42867eb0367 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.461101 Aug 29 15:39:43.597173 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1799/3660] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:43 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:43.627205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:43.641975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.645709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.647152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.648176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.651037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.651788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.721128 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2b695770-ce55-4f2c-a591-48f9a039a1e2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "POST /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c/action" status: 202 len: 1068 microversion: 2.1 time: 0.311494 Aug 29 15:39:43.730582 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1862/3661] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:43 2022] POST /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c/action => generated 1068 bytes in 321 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 29 15:39:43.748428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-853d4a07-6a31-424a-8886-7dece7a28a1c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:43.749392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-853d4a07-6a31-424a-8886-7dece7a28a1c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:43.756298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-853d4a07-6a31-424a-8886-7dece7a28a1c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.757058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-853d4a07-6a31-424a-8886-7dece7a28a1c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.757706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-853d4a07-6a31-424a-8886-7dece7a28a1c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.758581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-853d4a07-6a31-424a-8886-7dece7a28a1c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.759200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-853d4a07-6a31-424a-8886-7dece7a28a1c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.759788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-853d4a07-6a31-424a-8886-7dece7a28a1c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.022074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24c45e6c-e535-4494-858f-b72dad2fc40a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:44.024142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-24c45e6c-e535-4494-858f-b72dad2fc40a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:44.041653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24c45e6c-e535-4494-858f-b72dad2fc40a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.042331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24c45e6c-e535-4494-858f-b72dad2fc40a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.042789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24c45e6c-e535-4494-858f-b72dad2fc40a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.043519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24c45e6c-e535-4494-858f-b72dad2fc40a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.044128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24c45e6c-e535-4494-858f-b72dad2fc40a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.044759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24c45e6c-e535-4494-858f-b72dad2fc40a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.269931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-853d4a07-6a31-424a-8886-7dece7a28a1c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:44.280169 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-853d4a07-6a31-424a-8886-7dece7a28a1c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1472 microversion: 2.1 time: 0.535464 Aug 29 15:39:44.281616 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1800/3662] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:43 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1472 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:44.596613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-24c45e6c-e535-4494-858f-b72dad2fc40a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:44.610923 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-24c45e6c-e535-4494-858f-b72dad2fc40a tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1679 microversion: 2.1 time: 0.597754 Aug 29 15:39:44.611565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-52b6f52a-f983-417f-9c1c-fc16da038b27 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:44.613052 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1863/3663] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:44 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1679 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:44.628257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-52b6f52a-f983-417f-9c1c-fc16da038b27 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:44.644465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52b6f52a-f983-417f-9c1c-fc16da038b27 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.646403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52b6f52a-f983-417f-9c1c-fc16da038b27 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.648095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52b6f52a-f983-417f-9c1c-fc16da038b27 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.650164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52b6f52a-f983-417f-9c1c-fc16da038b27 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.661813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52b6f52a-f983-417f-9c1c-fc16da038b27 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.662780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52b6f52a-f983-417f-9c1c-fc16da038b27 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.020202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-52b6f52a-f983-417f-9c1c-fc16da038b27 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:45.030816 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-52b6f52a-f983-417f-9c1c-fc16da038b27 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.424575 Aug 29 15:39:45.049298 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1801/3664] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:44 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:45.304978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1a01d4b8-b681-4b9b-bead-cc6876a9aed7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:45.306303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1a01d4b8-b681-4b9b-bead-cc6876a9aed7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:45.323292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a01d4b8-b681-4b9b-bead-cc6876a9aed7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.324593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a01d4b8-b681-4b9b-bead-cc6876a9aed7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.325336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a01d4b8-b681-4b9b-bead-cc6876a9aed7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.326277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a01d4b8-b681-4b9b-bead-cc6876a9aed7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.329434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a01d4b8-b681-4b9b-bead-cc6876a9aed7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.329952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a01d4b8-b681-4b9b-bead-cc6876a9aed7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.635417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a860466d-a541-438c-a517-b30353c75876 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:45.642627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a860466d-a541-438c-a517-b30353c75876 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:45.651130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a860466d-a541-438c-a517-b30353c75876 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.652143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a860466d-a541-438c-a517-b30353c75876 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.652880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a860466d-a541-438c-a517-b30353c75876 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.656109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a860466d-a541-438c-a517-b30353c75876 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.656848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a860466d-a541-438c-a517-b30353c75876 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.657677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a860466d-a541-438c-a517-b30353c75876 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.686158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1a01d4b8-b681-4b9b-bead-cc6876a9aed7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:45.709146 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1a01d4b8-b681-4b9b-bead-cc6876a9aed7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1472 microversion: 2.1 time: 0.409907 Aug 29 15:39:45.716754 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1864/3665] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:45 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1472 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:46.324483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a860466d-a541-438c-a517-b30353c75876 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:46.364344 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a860466d-a541-438c-a517-b30353c75876 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1679 microversion: 2.1 time: 0.733122 Aug 29 15:39:46.378497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2fd0636d-0814-415a-9d20-2446ddae0f2b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:46.379131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2fd0636d-0814-415a-9d20-2446ddae0f2b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:46.384325 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1802/3666] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:45 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1679 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:46.412850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2fd0636d-0814-415a-9d20-2446ddae0f2b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.415978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2fd0636d-0814-415a-9d20-2446ddae0f2b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.422702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2fd0636d-0814-415a-9d20-2446ddae0f2b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.423521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2fd0636d-0814-415a-9d20-2446ddae0f2b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.424023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2fd0636d-0814-415a-9d20-2446ddae0f2b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.424470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2fd0636d-0814-415a-9d20-2446ddae0f2b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.749029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-da538981-7301-4a23-a52e-57bbd4b224ad tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:46.764307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-da538981-7301-4a23-a52e-57bbd4b224ad tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:46.773855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da538981-7301-4a23-a52e-57bbd4b224ad tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.774592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da538981-7301-4a23-a52e-57bbd4b224ad tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.775434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da538981-7301-4a23-a52e-57bbd4b224ad tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.776687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da538981-7301-4a23-a52e-57bbd4b224ad tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.777883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da538981-7301-4a23-a52e-57bbd4b224ad tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.778563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da538981-7301-4a23-a52e-57bbd4b224ad tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.059259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2fd0636d-0814-415a-9d20-2446ddae0f2b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:47.085287 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2fd0636d-0814-415a-9d20-2446ddae0f2b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 1.033653 Aug 29 15:39:47.102824 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1865/3667] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:46 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:47.388456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c60dd220-5b64-49cc-8958-43533cfb9ea6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:47.390231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c60dd220-5b64-49cc-8958-43533cfb9ea6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:47.406389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c60dd220-5b64-49cc-8958-43533cfb9ea6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.409763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c60dd220-5b64-49cc-8958-43533cfb9ea6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.410536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c60dd220-5b64-49cc-8958-43533cfb9ea6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.411594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c60dd220-5b64-49cc-8958-43533cfb9ea6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.412369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c60dd220-5b64-49cc-8958-43533cfb9ea6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.418052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c60dd220-5b64-49cc-8958-43533cfb9ea6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.464755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-da538981-7301-4a23-a52e-57bbd4b224ad tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:47.475250 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-da538981-7301-4a23-a52e-57bbd4b224ad tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1472 microversion: 2.1 time: 0.732118 Aug 29 15:39:47.494579 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1803/3668] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:46 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1472 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:47.661478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c60dd220-5b64-49cc-8958-43533cfb9ea6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:47.688945 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c60dd220-5b64-49cc-8958-43533cfb9ea6 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1612 microversion: 2.1 time: 0.303273 Aug 29 15:39:47.703224 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1866/3669] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:47 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1612 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:47.850004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-aaa0d844-5584-49ab-8114-8925f3ebd8a7 req-db5bf367-3eba-41b5-a9c0-d38094a2492f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401ad5c3-264d-437d-a249-035450439c18", "name": "network-vif-deleted", "tag": "bf81ac2f-eb0e-454d-982c-455aa2f19213"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:47.888444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-aaa0d844-5584-49ab-8114-8925f3ebd8a7 req-db5bf367-3eba-41b5-a9c0-d38094a2492f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.890174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-aaa0d844-5584-49ab-8114-8925f3ebd8a7 req-db5bf367-3eba-41b5-a9c0-d38094a2492f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.893282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-aaa0d844-5584-49ab-8114-8925f3ebd8a7 req-db5bf367-3eba-41b5-a9c0-d38094a2492f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.922943 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-aaa0d844-5584-49ab-8114-8925f3ebd8a7 req-db5bf367-3eba-41b5-a9c0-d38094a2492f service nova] Creating event network-vif-deleted:bf81ac2f-eb0e-454d-982c-455aa2f19213 for instance 401ad5c3-264d-437d-a249-035450439c18 on n-h1-839401-11 Aug 29 15:39:47.931615 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-aaa0d844-5584-49ab-8114-8925f3ebd8a7 req-db5bf367-3eba-41b5-a9c0-d38094a2492f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086765 Aug 29 15:39:47.933527 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1804/3670] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:48.116945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d4b33841-4308-426c-9cac-87c7c4f42989 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:48.118068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d4b33841-4308-426c-9cac-87c7c4f42989 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:48.134918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4b33841-4308-426c-9cac-87c7c4f42989 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.136380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4b33841-4308-426c-9cac-87c7c4f42989 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.138348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4b33841-4308-426c-9cac-87c7c4f42989 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.139387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4b33841-4308-426c-9cac-87c7c4f42989 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.141636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4b33841-4308-426c-9cac-87c7c4f42989 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.143150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4b33841-4308-426c-9cac-87c7c4f42989 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.508685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a29c50b6-259e-46c4-87c6-c87451121d4f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:48.510026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a29c50b6-259e-46c4-87c6-c87451121d4f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:48.528905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a29c50b6-259e-46c4-87c6-c87451121d4f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.531313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a29c50b6-259e-46c4-87c6-c87451121d4f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.532377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a29c50b6-259e-46c4-87c6-c87451121d4f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.538009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a29c50b6-259e-46c4-87c6-c87451121d4f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.539131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a29c50b6-259e-46c4-87c6-c87451121d4f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.539791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a29c50b6-259e-46c4-87c6-c87451121d4f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.798391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d4b33841-4308-426c-9cac-87c7c4f42989 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:48.813728 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d4b33841-4308-426c-9cac-87c7c4f42989 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1510 microversion: 2.1 time: 0.700981 Aug 29 15:39:48.817832 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1867/3671] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:48 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1510 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:48.827236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f92cba27-4f84-4a8a-afd8-691dcc1b6c80 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:48.834528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f92cba27-4f84-4a8a-afd8-691dcc1b6c80 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:48.858817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f92cba27-4f84-4a8a-afd8-691dcc1b6c80 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.859332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f92cba27-4f84-4a8a-afd8-691dcc1b6c80 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.859921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f92cba27-4f84-4a8a-afd8-691dcc1b6c80 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.860826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f92cba27-4f84-4a8a-afd8-691dcc1b6c80 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.861656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f92cba27-4f84-4a8a-afd8-691dcc1b6c80 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.862093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f92cba27-4f84-4a8a-afd8-691dcc1b6c80 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.886760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a29c50b6-259e-46c4-87c6-c87451121d4f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:48.899784 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a29c50b6-259e-46c4-87c6-c87451121d4f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1472 microversion: 2.1 time: 0.397217 Aug 29 15:39:48.902327 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1805/3672] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:48 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1472 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:49.015605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f92cba27-4f84-4a8a-afd8-691dcc1b6c80 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.020620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f92cba27-4f84-4a8a-afd8-691dcc1b6c80 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.023157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f92cba27-4f84-4a8a-afd8-691dcc1b6c80 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.024121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-f92cba27-4f84-4a8a-afd8-691dcc1b6c80 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lazy-loading 'fault' on Instance uuid 401ad5c3-264d-437d-a249-035450439c18 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:49.177846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f92cba27-4f84-4a8a-afd8-691dcc1b6c80 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e53abcc8ad4e1b91ed86a6c1fdb021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7cf262cab649fea4b4a44d3c4d7dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:49.193403 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f92cba27-4f84-4a8a-afd8-691dcc1b6c80 tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 200 len: 1330 microversion: 2.1 time: 0.374153 Aug 29 15:39:49.194263 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1868/3673] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:48 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 1330 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:49.839081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d2c4333c-c480-46f8-a3c3-b5ad3b48de42 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:49.839692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d2c4333c-c480-46f8-a3c3-b5ad3b48de42 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:49.850758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2c4333c-c480-46f8-a3c3-b5ad3b48de42 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.851321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2c4333c-c480-46f8-a3c3-b5ad3b48de42 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.851839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2c4333c-c480-46f8-a3c3-b5ad3b48de42 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.852561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2c4333c-c480-46f8-a3c3-b5ad3b48de42 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.862222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2c4333c-c480-46f8-a3c3-b5ad3b48de42 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.862706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2c4333c-c480-46f8-a3c3-b5ad3b48de42 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.923760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ffe1c182-9986-4fe7-8a01-084033331d84 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:49.924253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ffe1c182-9986-4fe7-8a01-084033331d84 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:49.946443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffe1c182-9986-4fe7-8a01-084033331d84 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.951330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffe1c182-9986-4fe7-8a01-084033331d84 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.951835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffe1c182-9986-4fe7-8a01-084033331d84 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.953981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffe1c182-9986-4fe7-8a01-084033331d84 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.957278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffe1c182-9986-4fe7-8a01-084033331d84 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.960753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffe1c182-9986-4fe7-8a01-084033331d84 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.187872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ffe1c182-9986-4fe7-8a01-084033331d84 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:50.192283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:50.217168 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ffe1c182-9986-4fe7-8a01-084033331d84 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1472 microversion: 2.1 time: 0.297173 Aug 29 15:39:50.235475 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1869/3674] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:49 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1472 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:50.247034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fb9d0068-e502-4f19-a4cb-7fc7d5ff2eee tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:50.259918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fb9d0068-e502-4f19-a4cb-7fc7d5ff2eee tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] [instance: 401ad5c3-264d-437d-a249-035450439c18] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:50.288070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb9d0068-e502-4f19-a4cb-7fc7d5ff2eee tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.294276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb9d0068-e502-4f19-a4cb-7fc7d5ff2eee tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.296757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb9d0068-e502-4f19-a4cb-7fc7d5ff2eee tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.297569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb9d0068-e502-4f19-a4cb-7fc7d5ff2eee tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.298061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb9d0068-e502-4f19-a4cb-7fc7d5ff2eee tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.298804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb9d0068-e502-4f19-a4cb-7fc7d5ff2eee tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.339589 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-fb9d0068-e502-4f19-a4cb-7fc7d5ff2eee tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] HTTP exception thrown: Instance 401ad5c3-264d-437d-a249-035450439c18 could not be found. Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fb9d0068-e502-4f19-a4cb-7fc7d5ff2eee tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Request method failure captured: Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 HTTP/1.1 Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNz1hIdZt_suSHp_zw07kITcM1Gs040kzv0_oqiIQnaDxJtgBWSAXsQh_VHjgicOGL6eSi9j44gA9yZLwNkpiTWXyod7tgRzCUyNWhxA8Hs5HeZPd6GjQpZJ1bXAeVFBdP0ycgChRWrFqFQ58A3wXTV4QDpf6JipgGbkKkXWGES7QVc Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 4f7cf262cab649fea4b4a44d3c4d7dec Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-VolumesAdminNegativeTest-432376042 Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f7cf262cab649fea4b4a44d3c4d7dec", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f7cf262cab649fea4b4a44d3c4d7dec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f7cf262cab649fea4b4a44d3c4d7dec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f7cf262cab649fea4b4a44d3c4d7dec"}]}] Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-VolumesAdminNegativeTest-432376042 Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 4f7cf262cab649fea4b4a44d3c4d7dec Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-432376042 Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-VolumesAdminNegativeTest-432376042-project Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: d6e53abcc8ad4e1b91ed86a6c1fdb021 Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-VolumesAdminNegativeTest-432376042-project Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 401ad5c3-264d-437d-a249-035450439c18 could not be found. Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '401ad5c3-264d-437d-a249-035450439c18'} Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401ad5c3-264d-437d-a249-035450439c18 could not be found. Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401ad5c3-264d-437d-a249-035450439c18 could not be found. Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:50.342548 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:50.348723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:50.348723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:50.348723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:50.348723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:50.348723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:50.348723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401ad5c3-264d-437d-a249-035450439c18 could not be found. Aug 29 15:39:50.348723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:39:50.348723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fb9d0068-e502-4f19-a4cb-7fc7d5ff2eee tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Returning 404 to user: Instance 401ad5c3-264d-437d-a249-035450439c18 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:50.348723 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fb9d0068-e502-4f19-a4cb-7fc7d5ff2eee tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18" status: 404 len: 111 microversion: 2.1 time: 0.108306 Aug 29 15:39:50.349651 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1870/3675] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:50 2022] GET /compute/v2.1/servers/401ad5c3-264d-437d-a249-035450439c18 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:50.359592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d2c4333c-c480-46f8-a3c3-b5ad3b48de42 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:50.362828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cec47536-95fa-43fb-97b0-0479f7ddeccc tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] Calling method '.version_select at 0x7fc42b5ae430>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:50.366832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:50.369768 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d2c4333c-c480-46f8-a3c3-b5ad3b48de42 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1487 microversion: 2.1 time: 0.538071 Aug 29 15:39:50.384448 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1806/3676] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:49 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1487 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:50.406688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-30f5dbcc-967a-4df9-bd33-e6da34d3d2fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:50.409833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-30f5dbcc-967a-4df9-bd33-e6da34d3d2fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:50.417231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30f5dbcc-967a-4df9-bd33-e6da34d3d2fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.418036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30f5dbcc-967a-4df9-bd33-e6da34d3d2fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.418714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30f5dbcc-967a-4df9-bd33-e6da34d3d2fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.418859 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cec47536-95fa-43fb-97b0-0479f7ddeccc tempest-VolumesAdminNegativeTest-432376042 tempest-VolumesAdminNegativeTest-432376042-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-66583430" status: 202 len: 0 microversion: 2.1 time: 0.066539 Aug 29 15:39:50.419805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30f5dbcc-967a-4df9-bd33-e6da34d3d2fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.420078 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1871/3677] 10.222.0.62 () {58 vars in 1215 bytes} [Mon Aug 29 15:39:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-66583430 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:50.420698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30f5dbcc-967a-4df9-bd33-e6da34d3d2fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.422701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30f5dbcc-967a-4df9-bd33-e6da34d3d2fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.511932 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-30f5dbcc-967a-4df9-bd33-e6da34d3d2fe tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 200 len: 146 microversion: 2.1 time: 0.113083 Aug 29 15:39:50.523843 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1807/3678] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:50 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 146 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:50.524749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5a215d21-aa04-43f5-ba1c-2dc73aba0cb6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:50.525515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5a215d21-aa04-43f5-ba1c-2dc73aba0cb6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:50.540537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a215d21-aa04-43f5-ba1c-2dc73aba0cb6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.541059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a215d21-aa04-43f5-ba1c-2dc73aba0cb6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.543094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a215d21-aa04-43f5-ba1c-2dc73aba0cb6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.545016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a215d21-aa04-43f5-ba1c-2dc73aba0cb6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.546085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a215d21-aa04-43f5-ba1c-2dc73aba0cb6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.547813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a215d21-aa04-43f5-ba1c-2dc73aba0cb6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.991811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5a215d21-aa04-43f5-ba1c-2dc73aba0cb6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:51.010371 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5a215d21-aa04-43f5-ba1c-2dc73aba0cb6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.491036 Aug 29 15:39:51.010979 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1872/3679] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:50 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:51.042982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a06fb27b-39ca-45cb-9fd1-35085d83eb8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:51.043810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a06fb27b-39ca-45cb-9fd1-35085d83eb8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:51.065767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:51.068225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a06fb27b-39ca-45cb-9fd1-35085d83eb8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.068732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a06fb27b-39ca-45cb-9fd1-35085d83eb8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.069202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a06fb27b-39ca-45cb-9fd1-35085d83eb8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.069931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a06fb27b-39ca-45cb-9fd1-35085d83eb8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.070398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a06fb27b-39ca-45cb-9fd1-35085d83eb8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.070855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a06fb27b-39ca-45cb-9fd1-35085d83eb8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.243399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5bc54bb5-8505-48a8-860e-1e9e1a04c88d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:51.244287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5bc54bb5-8505-48a8-860e-1e9e1a04c88d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:51.261905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bc54bb5-8505-48a8-860e-1e9e1a04c88d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.262557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bc54bb5-8505-48a8-860e-1e9e1a04c88d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.263355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bc54bb5-8505-48a8-860e-1e9e1a04c88d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.264358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bc54bb5-8505-48a8-860e-1e9e1a04c88d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.265101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bc54bb5-8505-48a8-860e-1e9e1a04c88d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.265778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bc54bb5-8505-48a8-860e-1e9e1a04c88d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.625802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=10 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:51.765549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5bc54bb5-8505-48a8-860e-1e9e1a04c88d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:51.776423 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5bc54bb5-8505-48a8-860e-1e9e1a04c88d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1472 microversion: 2.1 time: 0.537295 Aug 29 15:39:51.785734 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1873/3680] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:51 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1472 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:52.135567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a06fb27b-39ca-45cb-9fd1-35085d83eb8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:52.158512 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a06fb27b-39ca-45cb-9fd1-35085d83eb8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 1.119713 Aug 29 15:39:52.178720 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1808/3681] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:51 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:52.184524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1f28424f-29d2-45c8-a55c-d0646abbbcd2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.187169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1f28424f-29d2-45c8-a55c-d0646abbbcd2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:52.205022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f28424f-29d2-45c8-a55c-d0646abbbcd2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.206787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f28424f-29d2-45c8-a55c-d0646abbbcd2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.207415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f28424f-29d2-45c8-a55c-d0646abbbcd2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.208380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f28424f-29d2-45c8-a55c-d0646abbbcd2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.209033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f28424f-29d2-45c8-a55c-d0646abbbcd2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.209733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f28424f-29d2-45c8-a55c-d0646abbbcd2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.806327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dd1560b2-c6a4-4010-a198-9b6cf677abc2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.807567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dd1560b2-c6a4-4010-a198-9b6cf677abc2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:52.823077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd1560b2-c6a4-4010-a198-9b6cf677abc2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.824028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd1560b2-c6a4-4010-a198-9b6cf677abc2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.824642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd1560b2-c6a4-4010-a198-9b6cf677abc2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.825579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd1560b2-c6a4-4010-a198-9b6cf677abc2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.826237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd1560b2-c6a4-4010-a198-9b6cf677abc2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.830695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd1560b2-c6a4-4010-a198-9b6cf677abc2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.048304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1f28424f-29d2-45c8-a55c-d0646abbbcd2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:53.065309 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1f28424f-29d2-45c8-a55c-d0646abbbcd2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.888592 Aug 29 15:39:53.069278 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1874/3682] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:52 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:53.089341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-946ab1ce-f584-4aa3-817a-f3542fbe7516 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:53.090403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-946ab1ce-f584-4aa3-817a-f3542fbe7516 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:53.094051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:53.098873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-946ab1ce-f584-4aa3-817a-f3542fbe7516 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.099745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-946ab1ce-f584-4aa3-817a-f3542fbe7516 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.100339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-946ab1ce-f584-4aa3-817a-f3542fbe7516 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.101664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-946ab1ce-f584-4aa3-817a-f3542fbe7516 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.102324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-946ab1ce-f584-4aa3-817a-f3542fbe7516 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.103527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-946ab1ce-f584-4aa3-817a-f3542fbe7516 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.283215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:53.615895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-946ab1ce-f584-4aa3-817a-f3542fbe7516 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:53.674120 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-946ab1ce-f584-4aa3-817a-f3542fbe7516 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.586139 Aug 29 15:39:53.691586 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1875/3683] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:53 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:53.897987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-956042320", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "d1ac0823-5377-4aa5-8e1a-80f39f87d37f"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:54.016329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] validate_networks() for [('d1ac0823-5377-4aa5-8e1a-80f39f87d37f', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:54.147887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dd1560b2-c6a4-4010-a198-9b6cf677abc2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:54.157974 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dd1560b2-c6a4-4010-a198-9b6cf677abc2 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1472 microversion: 2.1 time: 1.355516 Aug 29 15:39:54.159054 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1809/3684] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:52 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1472 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:54.744069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1265845235", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "e4e4fdf8-c9df-4ebb-88de-11e454e5ceff"}, {"uuid": "8fe4f29e-3904-4a7b-9421-8cbcb52a1ccd"}, {"uuid": "e4e4fdf8-c9df-4ebb-88de-11e454e5ceff"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:54.868610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] validate_networks() for [('e4e4fdf8-c9df-4ebb-88de-11e454e5ceff', None, None, None, None, None), ('8fe4f29e-3904-4a7b-9421-8cbcb52a1ccd', None, None, None, None, None), ('e4e4fdf8-c9df-4ebb-88de-11e454e5ceff', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:55.685359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:55.685929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:55.686254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:55.686918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:55.687569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:55.712354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.713361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.714052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.715803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.716557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.717364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.749434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Getting quotas for project 990c752c7bb141c1bf496c98fbc3c9a7. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:55.776154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Getting quotas for user 51efa71a8bfe457982698a5755ae3cc6 and project 990c752c7bb141c1bf496c98fbc3c9a7. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:55.802627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:55.806969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:55.895454 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dffa967c-1e10-49e0-9303-6445553c2a0b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.006600 Aug 29 15:39:55.904638 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1876/3685] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:39:55.911284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d475a856-8fd7-425e-a0d3-3f723e1524a5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:55.913668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d475a856-8fd7-425e-a0d3-3f723e1524a5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:55.920966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d475a856-8fd7-425e-a0d3-3f723e1524a5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.921855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d475a856-8fd7-425e-a0d3-3f723e1524a5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.922534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d475a856-8fd7-425e-a0d3-3f723e1524a5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.923549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d475a856-8fd7-425e-a0d3-3f723e1524a5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.924231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d475a856-8fd7-425e-a0d3-3f723e1524a5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.940912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d475a856-8fd7-425e-a0d3-3f723e1524a5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.321208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d475a856-8fd7-425e-a0d3-3f723e1524a5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:56.333775 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d475a856-8fd7-425e-a0d3-3f723e1524a5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1472 microversion: 2.1 time: 0.426259 Aug 29 15:39:56.336257 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1877/3686] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:55 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1472 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:56.349479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2a233c21-37b8-40af-91ea-4e49d80b95c2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:56.350574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2a233c21-37b8-40af-91ea-4e49d80b95c2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:56.477962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2a233c21-37b8-40af-91ea-4e49d80b95c2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:56.500383 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2a233c21-37b8-40af-91ea-4e49d80b95c2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6" status: 200 len: 1214 microversion: 2.1 time: 0.161799 Aug 29 15:39:56.503815 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1878/3687] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:56 2022] GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:56.515008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-828abe5a-b542-4a6c-b542-d074ba5ba119 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:56.516006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-828abe5a-b542-4a6c-b542-d074ba5ba119 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:56.527642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-828abe5a-b542-4a6c-b542-d074ba5ba119 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.531097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-828abe5a-b542-4a6c-b542-d074ba5ba119 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.532197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-828abe5a-b542-4a6c-b542-d074ba5ba119 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.548755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-828abe5a-b542-4a6c-b542-d074ba5ba119 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.550940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-828abe5a-b542-4a6c-b542-d074ba5ba119 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.552164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-828abe5a-b542-4a6c-b542-d074ba5ba119 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.622441 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-828abe5a-b542-4a6c-b542-d074ba5ba119 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/ips" status: 200 len: 146 microversion: 2.1 time: 0.115643 Aug 29 15:39:56.630157 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1879/3688] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:39:56 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/ips => generated 146 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:57.359233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-365e67f6-f562-4b0f-a129-d5bd2e8b5cd0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:57.360674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-365e67f6-f562-4b0f-a129-d5bd2e8b5cd0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:57.378253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-365e67f6-f562-4b0f-a129-d5bd2e8b5cd0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.380322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-365e67f6-f562-4b0f-a129-d5bd2e8b5cd0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.381743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-365e67f6-f562-4b0f-a129-d5bd2e8b5cd0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.384747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-365e67f6-f562-4b0f-a129-d5bd2e8b5cd0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.388580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-365e67f6-f562-4b0f-a129-d5bd2e8b5cd0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.389447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-365e67f6-f562-4b0f-a129-d5bd2e8b5cd0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.612559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:57.613993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:57.614554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:57.615203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:57.615717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:57.640224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.642331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.644535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.646794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.648453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.649510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.738411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Getting quotas for project cde693c11d6d4af0ba9f31249e778e8b. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:57.752404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Getting quotas for user 5e450275cc2d49968f2cb7559109fb66 and project cde693c11d6d4af0ba9f31249e778e8b. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:57.797924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:57.803415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:57.883779 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4a74ae99-7290-4cb4-b388-821b92bbf290 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.143860 Aug 29 15:39:57.885215 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1810/3689] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:39:57.894688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0c0d950a-a873-4b57-a32d-e7f8e0e75560 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:57.895980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0c0d950a-a873-4b57-a32d-e7f8e0e75560 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:57.903933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c0d950a-a873-4b57-a32d-e7f8e0e75560 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.904791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c0d950a-a873-4b57-a32d-e7f8e0e75560 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.906079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c0d950a-a873-4b57-a32d-e7f8e0e75560 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.907351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c0d950a-a873-4b57-a32d-e7f8e0e75560 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.908033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c0d950a-a873-4b57-a32d-e7f8e0e75560 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.908702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c0d950a-a873-4b57-a32d-e7f8e0e75560 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.259982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0c0d950a-a873-4b57-a32d-e7f8e0e75560 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:58.274562 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0c0d950a-a873-4b57-a32d-e7f8e0e75560 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6" status: 200 len: 1274 microversion: 2.1 time: 0.387745 Aug 29 15:39:58.275116 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1811/3690] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:57 2022] GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 => generated 1274 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:58.318124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b2e871c1-001e-483f-8cd3-f1a25d1a8e7e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:58.321322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b2e871c1-001e-483f-8cd3-f1a25d1a8e7e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:58.368924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:58.608695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-365e67f6-f562-4b0f-a129-d5bd2e8b5cd0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:58.635373 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-365e67f6-f562-4b0f-a129-d5bd2e8b5cd0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1478 microversion: 2.1 time: 1.263013 Aug 29 15:39:58.636061 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1880/3691] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:57 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1478 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:58.651590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b2e871c1-001e-483f-8cd3-f1a25d1a8e7e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:58.662170 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b2e871c1-001e-483f-8cd3-f1a25d1a8e7e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1213 microversion: 2.1 time: 0.382572 Aug 29 15:39:58.691555 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1812/3692] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:58 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1213 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:59.308652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b3b253fb-5724-416a-93ef-9e2d1451c2ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:59.310542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b3b253fb-5724-416a-93ef-9e2d1451c2ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:59.340063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3b253fb-5724-416a-93ef-9e2d1451c2ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.342250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3b253fb-5724-416a-93ef-9e2d1451c2ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.347958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3b253fb-5724-416a-93ef-9e2d1451c2ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.349444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3b253fb-5724-416a-93ef-9e2d1451c2ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.352174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3b253fb-5724-416a-93ef-9e2d1451c2ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.353724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3b253fb-5724-416a-93ef-9e2d1451c2ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.664925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-49f9ca75-b892-4b26-bd86-b0870bc77c13 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:59.667009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-49f9ca75-b892-4b26-bd86-b0870bc77c13 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:59.683736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49f9ca75-b892-4b26-bd86-b0870bc77c13 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.684582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49f9ca75-b892-4b26-bd86-b0870bc77c13 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.685482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49f9ca75-b892-4b26-bd86-b0870bc77c13 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.690002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49f9ca75-b892-4b26-bd86-b0870bc77c13 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.691763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49f9ca75-b892-4b26-bd86-b0870bc77c13 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.695195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49f9ca75-b892-4b26-bd86-b0870bc77c13 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.719324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b3b253fb-5724-416a-93ef-9e2d1451c2ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:59.734789 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b3b253fb-5724-416a-93ef-9e2d1451c2ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6" status: 200 len: 1272 microversion: 2.1 time: 0.442411 Aug 29 15:39:59.740984 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1881/3693] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:59 2022] GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 => generated 1272 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:59.756344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d5104c0e-91cb-4474-8512-e867b65160b6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:59.756975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d5104c0e-91cb-4474-8512-e867b65160b6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:59.782618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5104c0e-91cb-4474-8512-e867b65160b6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.783375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5104c0e-91cb-4474-8512-e867b65160b6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.783853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5104c0e-91cb-4474-8512-e867b65160b6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.784614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5104c0e-91cb-4474-8512-e867b65160b6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.785143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5104c0e-91cb-4474-8512-e867b65160b6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.785565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5104c0e-91cb-4474-8512-e867b65160b6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.083396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d5104c0e-91cb-4474-8512-e867b65160b6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:00.109008 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d5104c0e-91cb-4474-8512-e867b65160b6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1265 microversion: 2.1 time: 0.366477 Aug 29 15:40:00.114669 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1882/3694] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:59 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1265 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:00.444384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-49f9ca75-b892-4b26-bd86-b0870bc77c13 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:00.470813 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-49f9ca75-b892-4b26-bd86-b0870bc77c13 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1478 microversion: 2.1 time: 0.813955 Aug 29 15:40:00.471664 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1813/3695] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:59 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1478 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:00.516757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4f5bd256-29ee-4f66-a3e7-1e23f7fd3d24 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "470cf3e2-c74e-47ff-a10c-a08d8a3a0c97"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:00.520367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4f5bd256-29ee-4f66-a3e7-1e23f7fd3d24 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:00.552935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f5bd256-29ee-4f66-a3e7-1e23f7fd3d24 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.557914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f5bd256-29ee-4f66-a3e7-1e23f7fd3d24 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.561439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f5bd256-29ee-4f66-a3e7-1e23f7fd3d24 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.562610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f5bd256-29ee-4f66-a3e7-1e23f7fd3d24 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.563358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f5bd256-29ee-4f66-a3e7-1e23f7fd3d24 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.564861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f5bd256-29ee-4f66-a3e7-1e23f7fd3d24 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.764216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c61a0948-55c9-4b38-932f-aecca632d76b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:00.764842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c61a0948-55c9-4b38-932f-aecca632d76b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:00.779271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c61a0948-55c9-4b38-932f-aecca632d76b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.781965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c61a0948-55c9-4b38-932f-aecca632d76b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.782439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c61a0948-55c9-4b38-932f-aecca632d76b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.783195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c61a0948-55c9-4b38-932f-aecca632d76b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.789550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c61a0948-55c9-4b38-932f-aecca632d76b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.790086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c61a0948-55c9-4b38-932f-aecca632d76b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.297962 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4f5bd256-29ee-4f66-a3e7-1e23f7fd3d24 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "POST /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784054 Aug 29 15:40:01.299009 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1883/3696] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 15:40:00 2022] POST /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/os-volume_attachments => generated 194 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:40:01.322755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-597cffd7-561a-4e2f-9c31-66258d24f84b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:01.324020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-597cffd7-561a-4e2f-9c31-66258d24f84b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:01.353981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-597cffd7-561a-4e2f-9c31-66258d24f84b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.354548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-597cffd7-561a-4e2f-9c31-66258d24f84b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.355431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-597cffd7-561a-4e2f-9c31-66258d24f84b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.356198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-597cffd7-561a-4e2f-9c31-66258d24f84b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.356669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-597cffd7-561a-4e2f-9c31-66258d24f84b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.357129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-597cffd7-561a-4e2f-9c31-66258d24f84b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.496897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-597cffd7-561a-4e2f-9c31-66258d24f84b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:01.509783 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-597cffd7-561a-4e2f-9c31-66258d24f84b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1271 microversion: 2.1 time: 0.208150 Aug 29 15:40:01.513538 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1884/3697] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:01 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1271 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:01.533160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-78f420ec-d843-4bb1-885e-8a3749dc55b0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:01.540261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-78f420ec-d843-4bb1-885e-8a3749dc55b0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:01.561496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78f420ec-d843-4bb1-885e-8a3749dc55b0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.564714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78f420ec-d843-4bb1-885e-8a3749dc55b0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.568140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78f420ec-d843-4bb1-885e-8a3749dc55b0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.569200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78f420ec-d843-4bb1-885e-8a3749dc55b0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.572059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78f420ec-d843-4bb1-885e-8a3749dc55b0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.573993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78f420ec-d843-4bb1-885e-8a3749dc55b0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.940499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c61a0948-55c9-4b38-932f-aecca632d76b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:01.950721 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c61a0948-55c9-4b38-932f-aecca632d76b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6" status: 200 len: 1314 microversion: 2.1 time: 1.191912 Aug 29 15:40:01.957999 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1814/3698] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:00 2022] GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 => generated 1314 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:01.963489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b307f8e8-684c-494d-ac13-98d4d73d4e67 req-e4dd390c-a35d-430a-877b-cd3f2c6b33ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1199ee4-c322-4c37-a53e-1bf029c7f14c", "name": "network-vif-unplugged", "status": "completed", "tag": "b9c1844c-f849-40a4-b1f6-8dffc854044e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:01.997836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b307f8e8-684c-494d-ac13-98d4d73d4e67 req-e4dd390c-a35d-430a-877b-cd3f2c6b33ae service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.998635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b307f8e8-684c-494d-ac13-98d4d73d4e67 req-e4dd390c-a35d-430a-877b-cd3f2c6b33ae service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.999331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b307f8e8-684c-494d-ac13-98d4d73d4e67 req-e4dd390c-a35d-430a-877b-cd3f2c6b33ae service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:02.029821 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b307f8e8-684c-494d-ac13-98d4d73d4e67 req-e4dd390c-a35d-430a-877b-cd3f2c6b33ae service nova] Creating event network-vif-unplugged:b9c1844c-f849-40a4-b1f6-8dffc854044e for instance b1199ee4-c322-4c37-a53e-1bf029c7f14c on n-h2-839401-11 Aug 29 15:40:02.040100 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b307f8e8-684c-494d-ac13-98d4d73d4e67 req-e4dd390c-a35d-430a-877b-cd3f2c6b33ae service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077928 Aug 29 15:40:02.045886 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1815/3699] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:02.099092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-78f420ec-d843-4bb1-885e-8a3749dc55b0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:02.128106 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-78f420ec-d843-4bb1-885e-8a3749dc55b0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1478 microversion: 2.1 time: 0.611574 Aug 29 15:40:02.130530 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1885/3700] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:01 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1478 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:02.534399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6a96097f-4678-45c9-9c5b-a98ada324d5e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:02.534504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6a96097f-4678-45c9-9c5b-a98ada324d5e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:02.553984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a96097f-4678-45c9-9c5b-a98ada324d5e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:02.556937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a96097f-4678-45c9-9c5b-a98ada324d5e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:02.559064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a96097f-4678-45c9-9c5b-a98ada324d5e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:02.562356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a96097f-4678-45c9-9c5b-a98ada324d5e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:02.562852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a96097f-4678-45c9-9c5b-a98ada324d5e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:02.566550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a96097f-4678-45c9-9c5b-a98ada324d5e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:02.982645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f4c19a99-4ce0-415e-bbb5-49d381e8beeb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:02.983281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f4c19a99-4ce0-415e-bbb5-49d381e8beeb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:03.000113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4c19a99-4ce0-415e-bbb5-49d381e8beeb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.001048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4c19a99-4ce0-415e-bbb5-49d381e8beeb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.001881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4c19a99-4ce0-415e-bbb5-49d381e8beeb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.002801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4c19a99-4ce0-415e-bbb5-49d381e8beeb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.003417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4c19a99-4ce0-415e-bbb5-49d381e8beeb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.005492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4c19a99-4ce0-415e-bbb5-49d381e8beeb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.385804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f4c19a99-4ce0-415e-bbb5-49d381e8beeb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:03.395091 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f4c19a99-4ce0-415e-bbb5-49d381e8beeb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6" status: 200 len: 1314 microversion: 2.1 time: 0.417237 Aug 29 15:40:03.399173 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1886/3701] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:02 2022] GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:03.412013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b3e37930-0f38-486a-a201-940461535bc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:03.414093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b3e37930-0f38-486a-a201-940461535bc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:03.427865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3e37930-0f38-486a-a201-940461535bc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.428282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3e37930-0f38-486a-a201-940461535bc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.428723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3e37930-0f38-486a-a201-940461535bc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.434290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3e37930-0f38-486a-a201-940461535bc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.434790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3e37930-0f38-486a-a201-940461535bc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.435416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3e37930-0f38-486a-a201-940461535bc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:04.073644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6a96097f-4678-45c9-9c5b-a98ada324d5e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:04.084686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b3e37930-0f38-486a-a201-940461535bc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:04.096214 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b3e37930-0f38-486a-a201-940461535bc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1478 microversion: 2.1 time: 0.693795 Aug 29 15:40:04.097935 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6a96097f-4678-45c9-9c5b-a98ada324d5e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1271 microversion: 2.1 time: 1.569486 Aug 29 15:40:04.105859 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1887/3702] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:03 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1478 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:04.106635 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1816/3703] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:02 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1271 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:04.420894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a854e8b9-29d8-47da-a469-c64610642c10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:04.421841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a854e8b9-29d8-47da-a469-c64610642c10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:04.432906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a854e8b9-29d8-47da-a469-c64610642c10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.436007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a854e8b9-29d8-47da-a469-c64610642c10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.436824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a854e8b9-29d8-47da-a469-c64610642c10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:04.437787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a854e8b9-29d8-47da-a469-c64610642c10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.439724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a854e8b9-29d8-47da-a469-c64610642c10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.441580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a854e8b9-29d8-47da-a469-c64610642c10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:04.530174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ab8ff3af-114a-453a-b693-005f290df90a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:04.530864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ab8ff3af-114a-453a-b693-005f290df90a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:04.550678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab8ff3af-114a-453a-b693-005f290df90a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.551557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab8ff3af-114a-453a-b693-005f290df90a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.552016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab8ff3af-114a-453a-b693-005f290df90a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:04.552783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab8ff3af-114a-453a-b693-005f290df90a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.553292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab8ff3af-114a-453a-b693-005f290df90a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.553717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab8ff3af-114a-453a-b693-005f290df90a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.009441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ab8ff3af-114a-453a-b693-005f290df90a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:05.024698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ab8ff3af-114a-453a-b693-005f290df90a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:05.026228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ab8ff3af-114a-453a-b693-005f290df90a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:05.033946 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ab8ff3af-114a-453a-b693-005f290df90a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2956 microversion: 2.42 time: 0.501501 Aug 29 15:40:05.035581 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1817/3704] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:04 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2956 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:40:05.061732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b8009e85-ed6a-4b30-ba0e-28acbd9d37da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:05.062495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b8009e85-ed6a-4b30-ba0e-28acbd9d37da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:05.075879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8009e85-ed6a-4b30-ba0e-28acbd9d37da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.077646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8009e85-ed6a-4b30-ba0e-28acbd9d37da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.079703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8009e85-ed6a-4b30-ba0e-28acbd9d37da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.081167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8009e85-ed6a-4b30-ba0e-28acbd9d37da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.083440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8009e85-ed6a-4b30-ba0e-28acbd9d37da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.085641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8009e85-ed6a-4b30-ba0e-28acbd9d37da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.605650 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b8009e85-ed6a-4b30-ba0e-28acbd9d37da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.548555 Aug 29 15:40:05.607042 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1818/3705] 10.222.0.62 () {60 vars in 1316 bytes} [Mon Aug 29 15:40:05 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822/os-interface => generated 1831 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:40:05.612109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ba66d075-b9a7-4a8c-b1ac-3e1558765fb6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:05.613021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ba66d075-b9a7-4a8c-b1ac-3e1558765fb6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:05.628181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba66d075-b9a7-4a8c-b1ac-3e1558765fb6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.629844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba66d075-b9a7-4a8c-b1ac-3e1558765fb6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.631086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba66d075-b9a7-4a8c-b1ac-3e1558765fb6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.637946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba66d075-b9a7-4a8c-b1ac-3e1558765fb6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.638526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba66d075-b9a7-4a8c-b1ac-3e1558765fb6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.638990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba66d075-b9a7-4a8c-b1ac-3e1558765fb6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.736965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:05.786988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a854e8b9-29d8-47da-a469-c64610642c10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:05.814958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:05.823455 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a854e8b9-29d8-47da-a469-c64610642c10 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6" status: 200 len: 1314 microversion: 2.1 time: 1.407486 Aug 29 15:40:05.824957 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1888/3706] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:04 2022] GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 => generated 1314 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:05.831153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4fea35e3-735f-4dd3-ad41-280bb33ceb7c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:05.832120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4fea35e3-735f-4dd3-ad41-280bb33ceb7c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:05.844425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fea35e3-735f-4dd3-ad41-280bb33ceb7c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.845649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fea35e3-735f-4dd3-ad41-280bb33ceb7c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.846478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fea35e3-735f-4dd3-ad41-280bb33ceb7c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.847560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fea35e3-735f-4dd3-ad41-280bb33ceb7c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.848442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fea35e3-735f-4dd3-ad41-280bb33ceb7c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.849164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fea35e3-735f-4dd3-ad41-280bb33ceb7c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:06.297361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ba66d075-b9a7-4a8c-b1ac-3e1558765fb6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:06.305963 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ba66d075-b9a7-4a8c-b1ac-3e1558765fb6 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1478 microversion: 2.1 time: 0.697603 Aug 29 15:40:06.321171 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1819/3707] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:05 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1478 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:06.332077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b19f466f-f1d8-431a-86c1-2e5c4ded361b req-03469be5-c9b9-46f3-a9a1-d8a74007f0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a492671-236f-4e97-a6dc-a3021953eac6", "tag": "b7a99e88-d298-4599-8588-e6bdf652e49a"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:06.364465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b19f466f-f1d8-431a-86c1-2e5c4ded361b req-03469be5-c9b9-46f3-a9a1-d8a74007f0f4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:06.365365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b19f466f-f1d8-431a-86c1-2e5c4ded361b req-03469be5-c9b9-46f3-a9a1-d8a74007f0f4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:06.366071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b19f466f-f1d8-431a-86c1-2e5c4ded361b req-03469be5-c9b9-46f3-a9a1-d8a74007f0f4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:06.390735 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b19f466f-f1d8-431a-86c1-2e5c4ded361b req-03469be5-c9b9-46f3-a9a1-d8a74007f0f4 service nova] Creating event network-changed:b7a99e88-d298-4599-8588-e6bdf652e49a for instance 8a492671-236f-4e97-a6dc-a3021953eac6 on n-h1-839401-11 Aug 29 15:40:06.411708 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b19f466f-f1d8-431a-86c1-2e5c4ded361b req-03469be5-c9b9-46f3-a9a1-d8a74007f0f4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088752 Aug 29 15:40:06.412631 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1820/3708] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:06.418477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-6a5199fc-527c-4c08-adc5-f1475642a749 req-a2222126-9846-494e-913c-ee99fad0f617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1199ee4-c322-4c37-a53e-1bf029c7f14c", "name": "network-vif-plugged", "status": "completed", "tag": "b9c1844c-f849-40a4-b1f6-8dffc854044e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:06.429712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6a5199fc-527c-4c08-adc5-f1475642a749 req-a2222126-9846-494e-913c-ee99fad0f617 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:06.430458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6a5199fc-527c-4c08-adc5-f1475642a749 req-a2222126-9846-494e-913c-ee99fad0f617 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:06.431503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6a5199fc-527c-4c08-adc5-f1475642a749 req-a2222126-9846-494e-913c-ee99fad0f617 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:06.444829 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-6a5199fc-527c-4c08-adc5-f1475642a749 req-a2222126-9846-494e-913c-ee99fad0f617 service nova] Creating event network-vif-plugged:b9c1844c-f849-40a4-b1f6-8dffc854044e for instance b1199ee4-c322-4c37-a53e-1bf029c7f14c on n-h2-839401-11 Aug 29 15:40:06.450368 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-6a5199fc-527c-4c08-adc5-f1475642a749 req-a2222126-9846-494e-913c-ee99fad0f617 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035886 Aug 29 15:40:06.451408 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1821/3709] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:06.495368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:06.536923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4fea35e3-735f-4dd3-ad41-280bb33ceb7c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:06.549658 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4fea35e3-735f-4dd3-ad41-280bb33ceb7c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1313 microversion: 2.1 time: 0.722554 Aug 29 15:40:06.563869 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1889/3710] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:05 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1313 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:06.856436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0bbfd44a-96d0-431a-a509-db9a589d67c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:06.857667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0bbfd44a-96d0-431a-a509-db9a589d67c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:06.869867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bbfd44a-96d0-431a-a509-db9a589d67c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:06.873526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bbfd44a-96d0-431a-a509-db9a589d67c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:06.874236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bbfd44a-96d0-431a-a509-db9a589d67c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:06.875216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bbfd44a-96d0-431a-a509-db9a589d67c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:06.891357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bbfd44a-96d0-431a-a509-db9a589d67c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:06.892218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bbfd44a-96d0-431a-a509-db9a589d67c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:07.276179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0bbfd44a-96d0-431a-a509-db9a589d67c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:07.292677 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0bbfd44a-96d0-431a-a509-db9a589d67c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6" status: 200 len: 1314 microversion: 2.1 time: 0.443985 Aug 29 15:40:07.296820 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1822/3711] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:06 2022] GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:07.345435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-119c9b8e-e947-4018-b306-f5f5842e40fe tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:07.347731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-119c9b8e-e947-4018-b306-f5f5842e40fe tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:07.357362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-119c9b8e-e947-4018-b306-f5f5842e40fe tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:07.358418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-119c9b8e-e947-4018-b306-f5f5842e40fe tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:07.360027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-119c9b8e-e947-4018-b306-f5f5842e40fe tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:07.361192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-119c9b8e-e947-4018-b306-f5f5842e40fe tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:07.361929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-119c9b8e-e947-4018-b306-f5f5842e40fe tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:07.362633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-119c9b8e-e947-4018-b306-f5f5842e40fe tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:07.571339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bcabb10a-a9f7-40bc-a24d-878b5e2c94af tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:07.572711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bcabb10a-a9f7-40bc-a24d-878b5e2c94af tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:07.583891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcabb10a-a9f7-40bc-a24d-878b5e2c94af tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:07.585422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcabb10a-a9f7-40bc-a24d-878b5e2c94af tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:07.588896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcabb10a-a9f7-40bc-a24d-878b5e2c94af tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:07.590055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcabb10a-a9f7-40bc-a24d-878b5e2c94af tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:07.590695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcabb10a-a9f7-40bc-a24d-878b5e2c94af tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:07.591350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcabb10a-a9f7-40bc-a24d-878b5e2c94af tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:07.704189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:07.905048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bcabb10a-a9f7-40bc-a24d-878b5e2c94af tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:07.920911 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bcabb10a-a9f7-40bc-a24d-878b5e2c94af tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1334 microversion: 2.1 time: 0.353382 Aug 29 15:40:07.921044 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1823/3712] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:07 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1334 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:07.992288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-119c9b8e-e947-4018-b306-f5f5842e40fe tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:08.002058 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-119c9b8e-e947-4018-b306-f5f5842e40fe tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1478 microversion: 2.1 time: 0.663981 Aug 29 15:40:08.002900 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1890/3713] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:07 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1478 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:08.317636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-48622bd3-12d7-4bee-b33f-380951ac037f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:08.318532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-48622bd3-12d7-4bee-b33f-380951ac037f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:08.331644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48622bd3-12d7-4bee-b33f-380951ac037f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:08.332312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48622bd3-12d7-4bee-b33f-380951ac037f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:08.333589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48622bd3-12d7-4bee-b33f-380951ac037f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:08.335171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48622bd3-12d7-4bee-b33f-380951ac037f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:08.338775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48622bd3-12d7-4bee-b33f-380951ac037f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:08.339472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48622bd3-12d7-4bee-b33f-380951ac037f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:08.660065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=8 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:08.670488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-48622bd3-12d7-4bee-b33f-380951ac037f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:08.689909 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-48622bd3-12d7-4bee-b33f-380951ac037f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6" status: 200 len: 1314 microversion: 2.1 time: 0.376852 Aug 29 15:40:08.691070 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1824/3714] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:08 2022] GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:08.944132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4348dcd7-3692-45c6-8759-bc293dc0677d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:08.945378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4348dcd7-3692-45c6-8759-bc293dc0677d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:08.958981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4348dcd7-3692-45c6-8759-bc293dc0677d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:08.961690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4348dcd7-3692-45c6-8759-bc293dc0677d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:08.962391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4348dcd7-3692-45c6-8759-bc293dc0677d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:08.963378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4348dcd7-3692-45c6-8759-bc293dc0677d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:08.967210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4348dcd7-3692-45c6-8759-bc293dc0677d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:08.968924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4348dcd7-3692-45c6-8759-bc293dc0677d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.028196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aee4122a-eb65-41e9-98c0-812b5ba94738 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:09.029038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aee4122a-eb65-41e9-98c0-812b5ba94738 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:09.043328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aee4122a-eb65-41e9-98c0-812b5ba94738 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.044134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aee4122a-eb65-41e9-98c0-812b5ba94738 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.044749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aee4122a-eb65-41e9-98c0-812b5ba94738 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.045928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aee4122a-eb65-41e9-98c0-812b5ba94738 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.046556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aee4122a-eb65-41e9-98c0-812b5ba94738 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.047178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aee4122a-eb65-41e9-98c0-812b5ba94738 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.418557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4348dcd7-3692-45c6-8759-bc293dc0677d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:09.431627 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4348dcd7-3692-45c6-8759-bc293dc0677d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 0.490239 Aug 29 15:40:09.432499 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1891/3715] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:08 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:09.435555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4348dcd7-3692-45c6-8759-bc293dc0677d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:09.436775 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4348dcd7-3692-45c6-8759-bc293dc0677d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001460 Aug 29 15:40:09.439496 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1892/3716] 10.222.0.62 () {56 vars in 886 bytes} [Mon Aug 29 15:40:09 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 15:40:09.717949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e3d7f2f1-8741-41eb-8ed1-30eaf9fbd0e8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:09.720454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e3d7f2f1-8741-41eb-8ed1-30eaf9fbd0e8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:09.739251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3d7f2f1-8741-41eb-8ed1-30eaf9fbd0e8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.741294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3d7f2f1-8741-41eb-8ed1-30eaf9fbd0e8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.741805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3d7f2f1-8741-41eb-8ed1-30eaf9fbd0e8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.743507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3d7f2f1-8741-41eb-8ed1-30eaf9fbd0e8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.745137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3d7f2f1-8741-41eb-8ed1-30eaf9fbd0e8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.749501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3d7f2f1-8741-41eb-8ed1-30eaf9fbd0e8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.750439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aee4122a-eb65-41e9-98c0-812b5ba94738 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:09.762382 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aee4122a-eb65-41e9-98c0-812b5ba94738 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1464 microversion: 2.1 time: 0.737601 Aug 29 15:40:09.764465 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1825/3717] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:09 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1464 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:09.791699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7ad5ae65-58a2-4baf-ae68-3f7e111db4b9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:09.792923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7ad5ae65-58a2-4baf-ae68-3f7e111db4b9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:09.809012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ad5ae65-58a2-4baf-ae68-3f7e111db4b9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.810999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ad5ae65-58a2-4baf-ae68-3f7e111db4b9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.811813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ad5ae65-58a2-4baf-ae68-3f7e111db4b9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.813836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ad5ae65-58a2-4baf-ae68-3f7e111db4b9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.816936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ad5ae65-58a2-4baf-ae68-3f7e111db4b9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.817803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ad5ae65-58a2-4baf-ae68-3f7e111db4b9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.236892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7ad5ae65-58a2-4baf-ae68-3f7e111db4b9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:10.252088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e3d7f2f1-8741-41eb-8ed1-30eaf9fbd0e8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:10.315203 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7ad5ae65-58a2-4baf-ae68-3f7e111db4b9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1464 microversion: 2.1 time: 0.527937 Aug 29 15:40:10.315640 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1826/3718] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:09 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1464 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:10.331043 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e3d7f2f1-8741-41eb-8ed1-30eaf9fbd0e8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6" status: 200 len: 1314 microversion: 2.1 time: 0.621940 Aug 29 15:40:10.332485 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1893/3719] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:09 2022] GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:10.347523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:10.350572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:10.372670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.373311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.373961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.374923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.375553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.376156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.457056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1e13e646-f0c0-4bba-bddb-acacc27fe591 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:10.457744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1e13e646-f0c0-4bba-bddb-acacc27fe591 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:10.495470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e13e646-f0c0-4bba-bddb-acacc27fe591 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.497554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e13e646-f0c0-4bba-bddb-acacc27fe591 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.499081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e13e646-f0c0-4bba-bddb-acacc27fe591 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.501934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e13e646-f0c0-4bba-bddb-acacc27fe591 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.504830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e13e646-f0c0-4bba-bddb-acacc27fe591 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.505558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e13e646-f0c0-4bba-bddb-acacc27fe591 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.533126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:10.542598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:40:10.547695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:40:10.548481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:40:10.553913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:40:10.554629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:40:10.685211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:10.692407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.693213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.693822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.695691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.700773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.701468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.764450 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6fba94b2-3488-4560-9531-34cfbabe589f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "POST /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c/action" status: 202 len: 1068 microversion: 2.1 time: 0.425947 Aug 29 15:40:10.785701 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1827/3720] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:10 2022] POST /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c/action => generated 1068 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 15:40:10.798703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7087b4dd-7729-4329-bbe7-6462c04f0dc8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:10.799707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7087b4dd-7729-4329-bbe7-6462c04f0dc8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:10.817682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7087b4dd-7729-4329-bbe7-6462c04f0dc8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.820306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7087b4dd-7729-4329-bbe7-6462c04f0dc8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.823984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7087b4dd-7729-4329-bbe7-6462c04f0dc8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.825070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7087b4dd-7729-4329-bbe7-6462c04f0dc8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.826051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7087b4dd-7729-4329-bbe7-6462c04f0dc8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.827171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7087b4dd-7729-4329-bbe7-6462c04f0dc8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:11.206230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7087b4dd-7729-4329-bbe7-6462c04f0dc8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:11.220986 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7087b4dd-7729-4329-bbe7-6462c04f0dc8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.427670 Aug 29 15:40:11.223232 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1828/3721] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:10 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:11.233617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-8c5294c4-a648-4698-a7a2-6b974dec0b90 req-7d98a9a4-763d-4364-bb24-002cc32f134d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bacda764-ffc5-41ff-8e06-a0ba54ecb7f7", "tag": "58c11c54-9149-4ae2-9080-87e597e5bed4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:11.259827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8c5294c4-a648-4698-a7a2-6b974dec0b90 req-7d98a9a4-763d-4364-bb24-002cc32f134d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:11.260958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8c5294c4-a648-4698-a7a2-6b974dec0b90 req-7d98a9a4-763d-4364-bb24-002cc32f134d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:11.261659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8c5294c4-a648-4698-a7a2-6b974dec0b90 req-7d98a9a4-763d-4364-bb24-002cc32f134d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:11.297417 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-8c5294c4-a648-4698-a7a2-6b974dec0b90 req-7d98a9a4-763d-4364-bb24-002cc32f134d service nova] Creating event network-changed:58c11c54-9149-4ae2-9080-87e597e5bed4 for instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 on n-h2-839401-11 Aug 29 15:40:11.310613 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-8c5294c4-a648-4698-a7a2-6b974dec0b90 req-7d98a9a4-763d-4364-bb24-002cc32f134d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084858 Aug 29 15:40:11.312102 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1829/3722] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:11.357964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a07fbfa5-557a-468d-bf5d-fd4ae71f015b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:11.359205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a07fbfa5-557a-468d-bf5d-fd4ae71f015b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:11.373680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a07fbfa5-557a-468d-bf5d-fd4ae71f015b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:11.376206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a07fbfa5-557a-468d-bf5d-fd4ae71f015b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:11.377360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a07fbfa5-557a-468d-bf5d-fd4ae71f015b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:11.378849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a07fbfa5-557a-468d-bf5d-fd4ae71f015b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:11.380402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a07fbfa5-557a-468d-bf5d-fd4ae71f015b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:11.383299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a07fbfa5-557a-468d-bf5d-fd4ae71f015b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:11.748240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1e13e646-f0c0-4bba-bddb-acacc27fe591 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:11.764073 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1e13e646-f0c0-4bba-bddb-acacc27fe591 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 1.308657 Aug 29 15:40:11.764765 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1894/3723] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:10 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:12.248992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b3869242-5e00-4214-9b99-8e7f92da6334 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:12.252204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b3869242-5e00-4214-9b99-8e7f92da6334 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:12.269419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3869242-5e00-4214-9b99-8e7f92da6334 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.269683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3869242-5e00-4214-9b99-8e7f92da6334 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.275744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3869242-5e00-4214-9b99-8e7f92da6334 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.276792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3869242-5e00-4214-9b99-8e7f92da6334 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.283128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3869242-5e00-4214-9b99-8e7f92da6334 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.283853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3869242-5e00-4214-9b99-8e7f92da6334 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.352858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a07fbfa5-557a-468d-bf5d-fd4ae71f015b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:12.363413 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a07fbfa5-557a-468d-bf5d-fd4ae71f015b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6" status: 200 len: 1314 microversion: 2.1 time: 1.010870 Aug 29 15:40:12.377069 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1830/3724] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:11 2022] GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 => generated 1314 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:12.681475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-dad771ea-5ad8-4c85-9b15-dea212dda297 req-ac41d796-203c-4a6c-af47-36d9108de69e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a492671-236f-4e97-a6dc-a3021953eac6", "name": "network-vif-plugged", "status": "completed", "tag": "b7a99e88-d298-4599-8588-e6bdf652e49a"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:12.745928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-dad771ea-5ad8-4c85-9b15-dea212dda297 req-ac41d796-203c-4a6c-af47-36d9108de69e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.749130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-dad771ea-5ad8-4c85-9b15-dea212dda297 req-ac41d796-203c-4a6c-af47-36d9108de69e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.749967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-dad771ea-5ad8-4c85-9b15-dea212dda297 req-ac41d796-203c-4a6c-af47-36d9108de69e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.795273 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-dad771ea-5ad8-4c85-9b15-dea212dda297 req-ac41d796-203c-4a6c-af47-36d9108de69e service nova] Creating event network-vif-plugged:b7a99e88-d298-4599-8588-e6bdf652e49a for instance 8a492671-236f-4e97-a6dc-a3021953eac6 on n-h1-839401-11 Aug 29 15:40:12.803776 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-dad771ea-5ad8-4c85-9b15-dea212dda297 req-ac41d796-203c-4a6c-af47-36d9108de69e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151680 Aug 29 15:40:12.805334 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1831/3725] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:12.814307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c7fb75f0-bac5-4dc1-8613-04ec7010d884 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:12.815278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c7fb75f0-bac5-4dc1-8613-04ec7010d884 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:12.823360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7fb75f0-bac5-4dc1-8613-04ec7010d884 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.824149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7fb75f0-bac5-4dc1-8613-04ec7010d884 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.824819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7fb75f0-bac5-4dc1-8613-04ec7010d884 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.825810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7fb75f0-bac5-4dc1-8613-04ec7010d884 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.826443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7fb75f0-bac5-4dc1-8613-04ec7010d884 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.827027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7fb75f0-bac5-4dc1-8613-04ec7010d884 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.169512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c7fb75f0-bac5-4dc1-8613-04ec7010d884 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:13.185112 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c7fb75f0-bac5-4dc1-8613-04ec7010d884 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 0.372656 Aug 29 15:40:13.186093 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1832/3726] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:12 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:13.250813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b3869242-5e00-4214-9b99-8e7f92da6334 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:13.269883 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b3869242-5e00-4214-9b99-8e7f92da6334 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 1.025537 Aug 29 15:40:13.271654 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1895/3727] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:12 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:13.385243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-132501cf-aa19-4567-8814-774cafa78dc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:13.386701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-132501cf-aa19-4567-8814-774cafa78dc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:13.397517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-132501cf-aa19-4567-8814-774cafa78dc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:13.409506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-132501cf-aa19-4567-8814-774cafa78dc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:13.410270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-132501cf-aa19-4567-8814-774cafa78dc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.411199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-132501cf-aa19-4567-8814-774cafa78dc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:13.411880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-132501cf-aa19-4567-8814-774cafa78dc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:13.412478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-132501cf-aa19-4567-8814-774cafa78dc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.471156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-d7d21bc9-87bb-4687-bf39-7ba8f3a2f41d req-7df30fa6-9fff-46c3-982f-2408b6d30dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bacda764-ffc5-41ff-8e06-a0ba54ecb7f7", "tag": "e135f3f1-c697-4722-b71b-93e1aadc39b9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:13.508958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d7d21bc9-87bb-4687-bf39-7ba8f3a2f41d req-7df30fa6-9fff-46c3-982f-2408b6d30dd2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:13.509678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d7d21bc9-87bb-4687-bf39-7ba8f3a2f41d req-7df30fa6-9fff-46c3-982f-2408b6d30dd2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:13.510120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d7d21bc9-87bb-4687-bf39-7ba8f3a2f41d req-7df30fa6-9fff-46c3-982f-2408b6d30dd2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.524280 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-d7d21bc9-87bb-4687-bf39-7ba8f3a2f41d req-7df30fa6-9fff-46c3-982f-2408b6d30dd2 service nova] Creating event network-changed:e135f3f1-c697-4722-b71b-93e1aadc39b9 for instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 on n-h2-839401-11 Aug 29 15:40:13.531734 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-d7d21bc9-87bb-4687-bf39-7ba8f3a2f41d req-7df30fa6-9fff-46c3-982f-2408b6d30dd2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064465 Aug 29 15:40:13.532919 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1896/3728] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:13.980184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-132501cf-aa19-4567-8814-774cafa78dc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:14.000754 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-132501cf-aa19-4567-8814-774cafa78dc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6" status: 200 len: 1314 microversion: 2.1 time: 0.620531 Aug 29 15:40:14.002451 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1833/3729] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:13 2022] GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:14.207329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5a995222-97f4-45e0-a3e3-bf7dbd8a7d71 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:14.211945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5a995222-97f4-45e0-a3e3-bf7dbd8a7d71 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:14.226922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a995222-97f4-45e0-a3e3-bf7dbd8a7d71 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.228631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a995222-97f4-45e0-a3e3-bf7dbd8a7d71 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.229991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a995222-97f4-45e0-a3e3-bf7dbd8a7d71 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.247265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a995222-97f4-45e0-a3e3-bf7dbd8a7d71 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.248425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a995222-97f4-45e0-a3e3-bf7dbd8a7d71 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.250761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a995222-97f4-45e0-a3e3-bf7dbd8a7d71 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.299718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7877d738-094c-4218-b82f-110ea786fe8a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:14.302614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7877d738-094c-4218-b82f-110ea786fe8a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:14.332770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7877d738-094c-4218-b82f-110ea786fe8a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.333321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7877d738-094c-4218-b82f-110ea786fe8a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.334659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7877d738-094c-4218-b82f-110ea786fe8a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.337291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7877d738-094c-4218-b82f-110ea786fe8a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.338097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7877d738-094c-4218-b82f-110ea786fe8a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.339095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7877d738-094c-4218-b82f-110ea786fe8a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.616332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7877d738-094c-4218-b82f-110ea786fe8a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:14.632708 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7877d738-094c-4218-b82f-110ea786fe8a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.342313 Aug 29 15:40:14.633493 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1834/3730] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:14 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:15.026864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8c9003a8-828f-4caa-b04c-8b4e912834b5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:15.027500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8c9003a8-828f-4caa-b04c-8b4e912834b5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:15.036303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c9003a8-828f-4caa-b04c-8b4e912834b5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.036796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c9003a8-828f-4caa-b04c-8b4e912834b5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.037269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c9003a8-828f-4caa-b04c-8b4e912834b5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.037973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c9003a8-828f-4caa-b04c-8b4e912834b5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.038629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c9003a8-828f-4caa-b04c-8b4e912834b5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.039353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c9003a8-828f-4caa-b04c-8b4e912834b5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.210459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5a995222-97f4-45e0-a3e3-bf7dbd8a7d71 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:15.220587 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5a995222-97f4-45e0-a3e3-bf7dbd8a7d71 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 1.017509 Aug 29 15:40:15.224076 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1897/3731] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:14 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:15.276243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8c9003a8-828f-4caa-b04c-8b4e912834b5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:15.284915 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8c9003a8-828f-4caa-b04c-8b4e912834b5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6" status: 200 len: 1500 microversion: 2.1 time: 0.266400 Aug 29 15:40:15.285690 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1835/3732] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:15 2022] GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 => generated 1500 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:15.307369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0a07bcd0-3037-4aa5-931e-2bb96995ae66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:15.309814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0a07bcd0-3037-4aa5-931e-2bb96995ae66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:15.316464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a07bcd0-3037-4aa5-931e-2bb96995ae66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.317333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a07bcd0-3037-4aa5-931e-2bb96995ae66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.317864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a07bcd0-3037-4aa5-931e-2bb96995ae66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.318630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a07bcd0-3037-4aa5-931e-2bb96995ae66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.319220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a07bcd0-3037-4aa5-931e-2bb96995ae66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.319719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a07bcd0-3037-4aa5-931e-2bb96995ae66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.405629 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0a07bcd0-3037-4aa5-931e-2bb96995ae66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action" status: 200 len: 14 microversion: 2.1 time: 0.102164 Aug 29 15:40:15.407621 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1898/3733] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:15 2022] POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:40:15.578647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-bc846e4f-ac12-4eaa-a7ab-3741dc82acb3 req-ce570686-d7f5-4f08-bdf1-1a63fd109e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bacda764-ffc5-41ff-8e06-a0ba54ecb7f7", "tag": "a1374456-8083-4382-afb5-5b3e041c88f9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:15.592816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-bc846e4f-ac12-4eaa-a7ab-3741dc82acb3 req-ce570686-d7f5-4f08-bdf1-1a63fd109e3a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.595239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-bc846e4f-ac12-4eaa-a7ab-3741dc82acb3 req-ce570686-d7f5-4f08-bdf1-1a63fd109e3a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.599174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-bc846e4f-ac12-4eaa-a7ab-3741dc82acb3 req-ce570686-d7f5-4f08-bdf1-1a63fd109e3a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.624419 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-bc846e4f-ac12-4eaa-a7ab-3741dc82acb3 req-ce570686-d7f5-4f08-bdf1-1a63fd109e3a service nova] Creating event network-changed:a1374456-8083-4382-afb5-5b3e041c88f9 for instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 on n-h2-839401-11 Aug 29 15:40:15.630427 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-bc846e4f-ac12-4eaa-a7ab-3741dc82acb3 req-ce570686-d7f5-4f08-bdf1-1a63fd109e3a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055332 Aug 29 15:40:15.633070 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1836/3734] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:40:15.658564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-442bcfea-7a46-4cf3-8f58-23136fe3a234 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:15.659804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-442bcfea-7a46-4cf3-8f58-23136fe3a234 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:15.667053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-442bcfea-7a46-4cf3-8f58-23136fe3a234 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.667900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-442bcfea-7a46-4cf3-8f58-23136fe3a234 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.668758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-442bcfea-7a46-4cf3-8f58-23136fe3a234 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.670311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-442bcfea-7a46-4cf3-8f58-23136fe3a234 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.670988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-442bcfea-7a46-4cf3-8f58-23136fe3a234 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.671652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-442bcfea-7a46-4cf3-8f58-23136fe3a234 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.124084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8977dedd-8eaf-4f28-ab9e-722cac2bf014 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:16.133969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8977dedd-8eaf-4f28-ab9e-722cac2bf014 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.135357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8977dedd-8eaf-4f28-ab9e-722cac2bf014 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.136039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8977dedd-8eaf-4f28-ab9e-722cac2bf014 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.217472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8977dedd-8eaf-4f28-ab9e-722cac2bf014 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Going to try to stop instance {{(pid=122361) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:40:16.279000 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8977dedd-8eaf-4f28-ab9e-722cac2bf014 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "POST /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/action" status: 202 len: 0 microversion: 2.1 time: 0.161624 Aug 29 15:40:16.279880 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1837/3735] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:16 2022] POST /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:16.286853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bc4a62f9-5353-4ec8-8f41-d6883bdcb503 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:16.287836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bc4a62f9-5353-4ec8-8f41-d6883bdcb503 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:16.297135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc4a62f9-5353-4ec8-8f41-d6883bdcb503 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.297899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc4a62f9-5353-4ec8-8f41-d6883bdcb503 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.298520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc4a62f9-5353-4ec8-8f41-d6883bdcb503 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.300021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc4a62f9-5353-4ec8-8f41-d6883bdcb503 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.300662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc4a62f9-5353-4ec8-8f41-d6883bdcb503 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.301367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc4a62f9-5353-4ec8-8f41-d6883bdcb503 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.402391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-442bcfea-7a46-4cf3-8f58-23136fe3a234 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:16.418435 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-442bcfea-7a46-4cf3-8f58-23136fe3a234 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.765539 Aug 29 15:40:16.419724 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1899/3736] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:15 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:16.427170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-abba044b-5d47-4b1a-9d71-38ddd3838771 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:16.428091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-abba044b-5d47-4b1a-9d71-38ddd3838771 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:16.447312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abba044b-5d47-4b1a-9d71-38ddd3838771 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.447973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abba044b-5d47-4b1a-9d71-38ddd3838771 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.448917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abba044b-5d47-4b1a-9d71-38ddd3838771 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.450015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abba044b-5d47-4b1a-9d71-38ddd3838771 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.450540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abba044b-5d47-4b1a-9d71-38ddd3838771 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.451624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abba044b-5d47-4b1a-9d71-38ddd3838771 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.510249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bc4a62f9-5353-4ec8-8f41-d6883bdcb503 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:16.544958 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bc4a62f9-5353-4ec8-8f41-d6883bdcb503 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 0.248279 Aug 29 15:40:16.547499 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1838/3737] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:16 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:16.557044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-184e14a1-f93b-4867-b33d-f5b02291a9e0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:16.565579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-184e14a1-f93b-4867-b33d-f5b02291a9e0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:16.580992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-184e14a1-f93b-4867-b33d-f5b02291a9e0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.581809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-184e14a1-f93b-4867-b33d-f5b02291a9e0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.583736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-184e14a1-f93b-4867-b33d-f5b02291a9e0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.584976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-184e14a1-f93b-4867-b33d-f5b02291a9e0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.585800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-184e14a1-f93b-4867-b33d-f5b02291a9e0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.586443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-184e14a1-f93b-4867-b33d-f5b02291a9e0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.695104 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-184e14a1-f93b-4867-b33d-f5b02291a9e0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action" status: 200 len: 14 microversion: 2.1 time: 0.136653 Aug 29 15:40:16.696976 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1839/3738] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:16 2022] POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:40:16.851869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-abba044b-5d47-4b1a-9d71-38ddd3838771 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:16.864630 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-abba044b-5d47-4b1a-9d71-38ddd3838771 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1722 microversion: 2.1 time: 0.441824 Aug 29 15:40:16.867924 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1900/3739] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:16 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1722 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:17.443729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-38ef6dee-1adf-4d01-8bd1-55145eac31b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:17.444469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-38ef6dee-1adf-4d01-8bd1-55145eac31b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:17.453888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ef6dee-1adf-4d01-8bd1-55145eac31b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.455561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ef6dee-1adf-4d01-8bd1-55145eac31b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.456129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ef6dee-1adf-4d01-8bd1-55145eac31b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.456937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ef6dee-1adf-4d01-8bd1-55145eac31b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.457485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ef6dee-1adf-4d01-8bd1-55145eac31b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.457978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38ef6dee-1adf-4d01-8bd1-55145eac31b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.571301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0760a0f7-a16e-417a-9a17-eef31e1fe5c6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:17.571933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0760a0f7-a16e-417a-9a17-eef31e1fe5c6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:17.579160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0760a0f7-a16e-417a-9a17-eef31e1fe5c6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.580004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0760a0f7-a16e-417a-9a17-eef31e1fe5c6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.580659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0760a0f7-a16e-417a-9a17-eef31e1fe5c6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.581622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0760a0f7-a16e-417a-9a17-eef31e1fe5c6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.582322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0760a0f7-a16e-417a-9a17-eef31e1fe5c6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.582960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0760a0f7-a16e-417a-9a17-eef31e1fe5c6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.771355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0760a0f7-a16e-417a-9a17-eef31e1fe5c6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:17.778355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-38ef6dee-1adf-4d01-8bd1-55145eac31b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:17.786216 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0760a0f7-a16e-417a-9a17-eef31e1fe5c6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 0.218554 Aug 29 15:40:17.792179 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-38ef6dee-1adf-4d01-8bd1-55145eac31b8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.354875 Aug 29 15:40:17.793861 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1901/3740] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:17 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:17.794753 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1840/3741] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:17 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:17.799751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f580bb9-aad2-433c-a7c0-e328b6531537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:17.818113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3f580bb9-aad2-433c-a7c0-e328b6531537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:17.835883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f580bb9-aad2-433c-a7c0-e328b6531537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.836448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f580bb9-aad2-433c-a7c0-e328b6531537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.837358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f580bb9-aad2-433c-a7c0-e328b6531537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.838895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f580bb9-aad2-433c-a7c0-e328b6531537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.839588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f580bb9-aad2-433c-a7c0-e328b6531537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.849446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f580bb9-aad2-433c-a7c0-e328b6531537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.889210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-30494615-b49c-485f-92b7-7678c39bb208 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:17.891111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-30494615-b49c-485f-92b7-7678c39bb208 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:17.905815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30494615-b49c-485f-92b7-7678c39bb208 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.906432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30494615-b49c-485f-92b7-7678c39bb208 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.907241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30494615-b49c-485f-92b7-7678c39bb208 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.908943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30494615-b49c-485f-92b7-7678c39bb208 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.910866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30494615-b49c-485f-92b7-7678c39bb208 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.913815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30494615-b49c-485f-92b7-7678c39bb208 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.949952 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3f580bb9-aad2-433c-a7c0-e328b6531537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action" status: 200 len: 14 microversion: 2.1 time: 0.153551 Aug 29 15:40:17.950621 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1902/3742] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:17 2022] POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:40:18.262704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-30494615-b49c-485f-92b7-7678c39bb208 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:18.277553 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-30494615-b49c-485f-92b7-7678c39bb208 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1722 microversion: 2.1 time: 0.394315 Aug 29 15:40:18.278487 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1841/3743] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:17 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1722 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:18.814433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a635768c-7b53-4b93-97e7-b90120be4c94 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:18.815932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a635768c-7b53-4b93-97e7-b90120be4c94 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:18.816241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-999a63b6-6208-4b2d-8c65-8ef9211330db tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:18.816994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-999a63b6-6208-4b2d-8c65-8ef9211330db tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:18.826054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-999a63b6-6208-4b2d-8c65-8ef9211330db tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.826934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a635768c-7b53-4b93-97e7-b90120be4c94 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.827427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a635768c-7b53-4b93-97e7-b90120be4c94 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.827854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a635768c-7b53-4b93-97e7-b90120be4c94 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.828779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a635768c-7b53-4b93-97e7-b90120be4c94 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.829268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a635768c-7b53-4b93-97e7-b90120be4c94 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.829666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a635768c-7b53-4b93-97e7-b90120be4c94 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.833119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-999a63b6-6208-4b2d-8c65-8ef9211330db tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.833992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-999a63b6-6208-4b2d-8c65-8ef9211330db tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.835080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-999a63b6-6208-4b2d-8c65-8ef9211330db tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.836258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-999a63b6-6208-4b2d-8c65-8ef9211330db tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.836861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-999a63b6-6208-4b2d-8c65-8ef9211330db tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.108454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a635768c-7b53-4b93-97e7-b90120be4c94 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:19.125194 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a635768c-7b53-4b93-97e7-b90120be4c94 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 0.315827 Aug 29 15:40:19.131657 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1903/3744] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:18 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:19.138448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-12a1e131-469b-4e51-bf7c-9c9ec5d6fee6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:19.140694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-12a1e131-469b-4e51-bf7c-9c9ec5d6fee6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:19.148734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12a1e131-469b-4e51-bf7c-9c9ec5d6fee6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.149536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12a1e131-469b-4e51-bf7c-9c9ec5d6fee6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.150552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12a1e131-469b-4e51-bf7c-9c9ec5d6fee6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.153077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12a1e131-469b-4e51-bf7c-9c9ec5d6fee6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.153628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12a1e131-469b-4e51-bf7c-9c9ec5d6fee6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.154140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12a1e131-469b-4e51-bf7c-9c9ec5d6fee6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.219961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-999a63b6-6208-4b2d-8c65-8ef9211330db tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:19.237042 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-12a1e131-469b-4e51-bf7c-9c9ec5d6fee6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action" status: 200 len: 14 microversion: 2.1 time: 0.103338 Aug 29 15:40:19.240899 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1904/3745] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:19 2022] POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:40:19.241114 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-999a63b6-6208-4b2d-8c65-8ef9211330db tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.427812 Aug 29 15:40:19.252721 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1842/3746] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:18 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:19.313452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c926c6fd-a05d-4bf3-bb78-ecd46130aa8a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.314175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c926c6fd-a05d-4bf3-bb78-ecd46130aa8a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:19.323191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c926c6fd-a05d-4bf3-bb78-ecd46130aa8a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.323704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c926c6fd-a05d-4bf3-bb78-ecd46130aa8a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.324157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c926c6fd-a05d-4bf3-bb78-ecd46130aa8a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.324884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c926c6fd-a05d-4bf3-bb78-ecd46130aa8a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.325368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c926c6fd-a05d-4bf3-bb78-ecd46130aa8a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.325803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c926c6fd-a05d-4bf3-bb78-ecd46130aa8a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:20.077620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c926c6fd-a05d-4bf3-bb78-ecd46130aa8a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:20.088411 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c926c6fd-a05d-4bf3-bb78-ecd46130aa8a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1722 microversion: 2.1 time: 0.780103 Aug 29 15:40:20.089669 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1905/3747] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:19 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1722 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:20.153517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4cfdeef0-187e-49cd-ab34-0bd36cd74c5b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:20.154165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4cfdeef0-187e-49cd-ab34-0bd36cd74c5b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:20.162371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cfdeef0-187e-49cd-ab34-0bd36cd74c5b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:20.163032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cfdeef0-187e-49cd-ab34-0bd36cd74c5b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:20.164132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cfdeef0-187e-49cd-ab34-0bd36cd74c5b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:20.165060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cfdeef0-187e-49cd-ab34-0bd36cd74c5b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:20.165675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cfdeef0-187e-49cd-ab34-0bd36cd74c5b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:20.166105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cfdeef0-187e-49cd-ab34-0bd36cd74c5b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:20.249070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-afd88505-9aee-4663-8317-6ef8ad7b6720 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:20.251931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-afd88505-9aee-4663-8317-6ef8ad7b6720 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:20.260342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afd88505-9aee-4663-8317-6ef8ad7b6720 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:20.260915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afd88505-9aee-4663-8317-6ef8ad7b6720 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:20.261464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afd88505-9aee-4663-8317-6ef8ad7b6720 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:20.262252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afd88505-9aee-4663-8317-6ef8ad7b6720 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:20.262800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afd88505-9aee-4663-8317-6ef8ad7b6720 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:20.263473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afd88505-9aee-4663-8317-6ef8ad7b6720 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:20.329826 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-afd88505-9aee-4663-8317-6ef8ad7b6720 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action" status: 200 len: 14 microversion: 2.1 time: 0.084355 Aug 29 15:40:20.330821 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1906/3748] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:20 2022] POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:40:20.338538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-75a62b66-e875-44a8-9d83-08f3516d2a17 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:20.339573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-75a62b66-e875-44a8-9d83-08f3516d2a17 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:20.347890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75a62b66-e875-44a8-9d83-08f3516d2a17 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:20.348501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75a62b66-e875-44a8-9d83-08f3516d2a17 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:20.349007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75a62b66-e875-44a8-9d83-08f3516d2a17 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:20.350035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75a62b66-e875-44a8-9d83-08f3516d2a17 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:20.350569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75a62b66-e875-44a8-9d83-08f3516d2a17 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:20.351090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75a62b66-e875-44a8-9d83-08f3516d2a17 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:20.561492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-75a62b66-e875-44a8-9d83-08f3516d2a17 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:20.570022 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-75a62b66-e875-44a8-9d83-08f3516d2a17 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.237942 Aug 29 15:40:20.582261 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1907/3749] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:20 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:20.971567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4cfdeef0-187e-49cd-ab34-0bd36cd74c5b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:20.981579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:20.992618 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4cfdeef0-187e-49cd-ab34-0bd36cd74c5b tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 0.844509 Aug 29 15:40:20.994626 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1843/3750] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:20 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:21.122391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-665b775e-cdfa-4098-a4a3-bad3abf8ea10 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:21.124542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-665b775e-cdfa-4098-a4a3-bad3abf8ea10 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:21.144414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-665b775e-cdfa-4098-a4a3-bad3abf8ea10 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:21.145399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-665b775e-cdfa-4098-a4a3-bad3abf8ea10 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:21.146869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-665b775e-cdfa-4098-a4a3-bad3abf8ea10 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:21.150847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-665b775e-cdfa-4098-a4a3-bad3abf8ea10 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:21.161469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-665b775e-cdfa-4098-a4a3-bad3abf8ea10 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:21.165197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-665b775e-cdfa-4098-a4a3-bad3abf8ea10 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:21.194606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:21.341967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-48ee302c-e712-4914-b6f9-5f724e79de55 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:21.347415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-48ee302c-e712-4914-b6f9-5f724e79de55 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:21.355145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48ee302c-e712-4914-b6f9-5f724e79de55 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:21.355931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48ee302c-e712-4914-b6f9-5f724e79de55 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:21.356591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48ee302c-e712-4914-b6f9-5f724e79de55 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:21.357621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48ee302c-e712-4914-b6f9-5f724e79de55 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:21.358255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48ee302c-e712-4914-b6f9-5f724e79de55 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:21.360156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48ee302c-e712-4914-b6f9-5f724e79de55 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:21.426782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-665b775e-cdfa-4098-a4a3-bad3abf8ea10 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:21.439765 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-665b775e-cdfa-4098-a4a3-bad3abf8ea10 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1722 microversion: 2.1 time: 0.331279 Aug 29 15:40:21.440400 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1908/3751] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:21 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:21.469402 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-48ee302c-e712-4914-b6f9-5f724e79de55 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action" status: 200 len: 14 microversion: 2.1 time: 0.123447 Aug 29 15:40:21.470149 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1844/3752] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:21 2022] POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:40:21.593526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-063849a1-e374-4f35-b00a-4f3cde2c3719 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:21.596109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-063849a1-e374-4f35-b00a-4f3cde2c3719 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:21.608202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063849a1-e374-4f35-b00a-4f3cde2c3719 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:21.610388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063849a1-e374-4f35-b00a-4f3cde2c3719 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:21.613567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063849a1-e374-4f35-b00a-4f3cde2c3719 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:21.614831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063849a1-e374-4f35-b00a-4f3cde2c3719 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:21.617691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063849a1-e374-4f35-b00a-4f3cde2c3719 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:21.619675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063849a1-e374-4f35-b00a-4f3cde2c3719 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:21.836688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-48ee302c-e712-4914-b6f9-5f724e79de55 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:21.838092 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-48ee302c-e712-4914-b6f9-5f724e79de55 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001942 Aug 29 15:40:21.839028 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1845/3753] 10.222.0.62 () {56 vars in 886 bytes} [Mon Aug 29 15:40:21 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 15:40:22.015946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-063849a1-e374-4f35-b00a-4f3cde2c3719 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:22.019658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-14f53843-8f5a-4a93-90c3-3b4c4c88bedc tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:22.023238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-14f53843-8f5a-4a93-90c3-3b4c4c88bedc tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:22.026475 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-063849a1-e374-4f35-b00a-4f3cde2c3719 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.438720 Aug 29 15:40:22.027071 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1909/3754] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:21 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:22.042331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14f53843-8f5a-4a93-90c3-3b4c4c88bedc tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.043426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14f53843-8f5a-4a93-90c3-3b4c4c88bedc tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.044508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14f53843-8f5a-4a93-90c3-3b4c4c88bedc tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.048219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14f53843-8f5a-4a93-90c3-3b4c4c88bedc tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.051018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14f53843-8f5a-4a93-90c3-3b4c4c88bedc tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.051872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14f53843-8f5a-4a93-90c3-3b4c4c88bedc tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.441848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-14f53843-8f5a-4a93-90c3-3b4c4c88bedc tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:22.464486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4e660471-d4a2-42b4-93ed-fe3ae3f6e8ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:22.465665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4e660471-d4a2-42b4-93ed-fe3ae3f6e8ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:22.476123 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-14f53843-8f5a-4a93-90c3-3b4c4c88bedc tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 0.463990 Aug 29 15:40:22.478901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e660471-d4a2-42b4-93ed-fe3ae3f6e8ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.479990 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1846/3755] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:22 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:22.482010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e660471-d4a2-42b4-93ed-fe3ae3f6e8ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.484270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e660471-d4a2-42b4-93ed-fe3ae3f6e8ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.485113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e660471-d4a2-42b4-93ed-fe3ae3f6e8ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.485682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e660471-d4a2-42b4-93ed-fe3ae3f6e8ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.487602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e660471-d4a2-42b4-93ed-fe3ae3f6e8ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.490793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ecb49ed9-3c8d-4cf3-b91d-f9da36959349 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:22.496520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ecb49ed9-3c8d-4cf3-b91d-f9da36959349 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:22.514322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecb49ed9-3c8d-4cf3-b91d-f9da36959349 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.514978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecb49ed9-3c8d-4cf3-b91d-f9da36959349 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.515508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecb49ed9-3c8d-4cf3-b91d-f9da36959349 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.516466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecb49ed9-3c8d-4cf3-b91d-f9da36959349 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.517477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecb49ed9-3c8d-4cf3-b91d-f9da36959349 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.520021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ecb49ed9-3c8d-4cf3-b91d-f9da36959349 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.604369 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ecb49ed9-3c8d-4cf3-b91d-f9da36959349 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action" status: 200 len: 14 microversion: 2.1 time: 0.122674 Aug 29 15:40:22.608354 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1847/3756] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:22 2022] POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:40:22.899604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4e660471-d4a2-42b4-93ed-fe3ae3f6e8ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:22.931378 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4e660471-d4a2-42b4-93ed-fe3ae3f6e8ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1722 microversion: 2.1 time: 0.470919 Aug 29 15:40:22.933392 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1910/3757] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:22 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1722 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:23.050203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f0cf3078-1234-4da3-a2b8-ed61b18eff0a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:23.051215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f0cf3078-1234-4da3-a2b8-ed61b18eff0a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:23.071989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0cf3078-1234-4da3-a2b8-ed61b18eff0a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:23.073267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0cf3078-1234-4da3-a2b8-ed61b18eff0a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:23.074279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0cf3078-1234-4da3-a2b8-ed61b18eff0a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:23.076606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0cf3078-1234-4da3-a2b8-ed61b18eff0a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:23.077420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0cf3078-1234-4da3-a2b8-ed61b18eff0a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:23.078119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0cf3078-1234-4da3-a2b8-ed61b18eff0a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:23.500579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-83a43bda-93a4-4dee-b415-8a72618ed08e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:23.502448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-83a43bda-93a4-4dee-b415-8a72618ed08e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:23.513113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:23.519445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83a43bda-93a4-4dee-b415-8a72618ed08e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:23.521586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83a43bda-93a4-4dee-b415-8a72618ed08e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:23.522871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83a43bda-93a4-4dee-b415-8a72618ed08e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:23.527158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83a43bda-93a4-4dee-b415-8a72618ed08e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:23.533298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f0cf3078-1234-4da3-a2b8-ed61b18eff0a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:23.538681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83a43bda-93a4-4dee-b415-8a72618ed08e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:23.543909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83a43bda-93a4-4dee-b415-8a72618ed08e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:23.556914 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f0cf3078-1234-4da3-a2b8-ed61b18eff0a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.504180 Aug 29 15:40:23.561633 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1848/3758] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:23 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:23.616880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-335035c8-e785-4d0d-8ac5-255789f2ed1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:23.619266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-335035c8-e785-4d0d-8ac5-255789f2ed1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:23.627730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-335035c8-e785-4d0d-8ac5-255789f2ed1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:23.633238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-335035c8-e785-4d0d-8ac5-255789f2ed1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:23.633842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-335035c8-e785-4d0d-8ac5-255789f2ed1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:23.635159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-335035c8-e785-4d0d-8ac5-255789f2ed1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:23.635897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-335035c8-e785-4d0d-8ac5-255789f2ed1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:23.636559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-335035c8-e785-4d0d-8ac5-255789f2ed1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:23.739756 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-335035c8-e785-4d0d-8ac5-255789f2ed1e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action" status: 200 len: 14 microversion: 2.1 time: 0.127288 Aug 29 15:40:23.744192 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1849/3759] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:23 2022] POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:40:23.936214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-83a43bda-93a4-4dee-b415-8a72618ed08e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:23.957638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bac13c63-502e-46f6-81fc-4bf035c9b4db tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:23.958367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bac13c63-502e-46f6-81fc-4bf035c9b4db tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:23.960559 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-83a43bda-93a4-4dee-b415-8a72618ed08e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 0.464710 Aug 29 15:40:23.963557 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1911/3760] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:23 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:23.981101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bac13c63-502e-46f6-81fc-4bf035c9b4db tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:23.982067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bac13c63-502e-46f6-81fc-4bf035c9b4db tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:23.982752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bac13c63-502e-46f6-81fc-4bf035c9b4db tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:23.988044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bac13c63-502e-46f6-81fc-4bf035c9b4db tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:23.988797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bac13c63-502e-46f6-81fc-4bf035c9b4db tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:23.989499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bac13c63-502e-46f6-81fc-4bf035c9b4db tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:24.392941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bac13c63-502e-46f6-81fc-4bf035c9b4db tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:24.425896 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bac13c63-502e-46f6-81fc-4bf035c9b4db tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1722 microversion: 2.1 time: 0.472681 Aug 29 15:40:24.426542 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1850/3761] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:23 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1722 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:24.593363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-23bb09f2-4553-47cf-8c66-4934023261d9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:24.594654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-23bb09f2-4553-47cf-8c66-4934023261d9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:24.618400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23bb09f2-4553-47cf-8c66-4934023261d9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:24.619168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23bb09f2-4553-47cf-8c66-4934023261d9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:24.619767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23bb09f2-4553-47cf-8c66-4934023261d9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:24.620660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23bb09f2-4553-47cf-8c66-4934023261d9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:24.621912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23bb09f2-4553-47cf-8c66-4934023261d9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:24.622695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23bb09f2-4553-47cf-8c66-4934023261d9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:24.878126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1595edce-35bc-495a-8552-8b74b711d31d tempest-ExtensionsTest-1021851960 tempest-ExtensionsTest-1021851960-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:24.879790 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1595edce-35bc-495a-8552-8b74b711d31d tempest-ExtensionsTest-1021851960 tempest-ExtensionsTest-1021851960-project] 10.222.0.62 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.269539 Aug 29 15:40:24.880788 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1851/3762] 10.222.0.62 () {58 vars in 1170 bytes} [Mon Aug 29 15:40:24 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:24.893008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7b7a7bc7-13f2-4b29-bf9e-9d7b56da1427 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:24.907030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7b7a7bc7-13f2-4b29-bf9e-9d7b56da1427 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:24.927583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b7a7bc7-13f2-4b29-bf9e-9d7b56da1427 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:24.928117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b7a7bc7-13f2-4b29-bf9e-9d7b56da1427 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:24.928775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b7a7bc7-13f2-4b29-bf9e-9d7b56da1427 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:24.933023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b7a7bc7-13f2-4b29-bf9e-9d7b56da1427 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:24.934292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b7a7bc7-13f2-4b29-bf9e-9d7b56da1427 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:24.935236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b7a7bc7-13f2-4b29-bf9e-9d7b56da1427 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:25.050400 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7b7a7bc7-13f2-4b29-bf9e-9d7b56da1427 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action" status: 200 len: 14 microversion: 2.1 time: 0.163372 Aug 29 15:40:25.052070 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1852/3763] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:24 2022] POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:40:25.070428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-23bb09f2-4553-47cf-8c66-4934023261d9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:25.078714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d7722e4d-ac52-44d9-8585-f30502a7b58b tempest-ExtensionsTest-1021851960 tempest-ExtensionsTest-1021851960-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:25.084745 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-23bb09f2-4553-47cf-8c66-4934023261d9 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.502512 Aug 29 15:40:25.097109 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d7722e4d-ac52-44d9-8585-f30502a7b58b tempest-ExtensionsTest-1021851960 tempest-ExtensionsTest-1021851960-project] 10.222.0.62 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.026703 Aug 29 15:40:25.097109 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1853/3764] 10.222.0.62 () {58 vars in 1134 bytes} [Mon Aug 29 15:40:25 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:40:25.099693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-db3e6716-19c4-4562-8736-bf2caa93b7ce tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:25.105290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-db3e6716-19c4-4562-8736-bf2caa93b7ce tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:25.105623 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1912/3765] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:24 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:25.126195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db3e6716-19c4-4562-8736-bf2caa93b7ce tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:25.133889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db3e6716-19c4-4562-8736-bf2caa93b7ce tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:25.134553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db3e6716-19c4-4562-8736-bf2caa93b7ce tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:25.141442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db3e6716-19c4-4562-8736-bf2caa93b7ce tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:25.142369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db3e6716-19c4-4562-8736-bf2caa93b7ce tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:25.142963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db3e6716-19c4-4562-8736-bf2caa93b7ce tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:25.459213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65bd3f14-7073-4c4d-8479-5988ecda60bd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:25.463305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-65bd3f14-7073-4c4d-8479-5988ecda60bd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:25.477758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65bd3f14-7073-4c4d-8479-5988ecda60bd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:25.478476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65bd3f14-7073-4c4d-8479-5988ecda60bd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:25.479478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65bd3f14-7073-4c4d-8479-5988ecda60bd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:25.482105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65bd3f14-7073-4c4d-8479-5988ecda60bd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:25.482705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65bd3f14-7073-4c4d-8479-5988ecda60bd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:25.485287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65bd3f14-7073-4c4d-8479-5988ecda60bd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:25.583853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-db3e6716-19c4-4562-8736-bf2caa93b7ce tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:25.592121 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-db3e6716-19c4-4562-8736-bf2caa93b7ce tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 0.501136 Aug 29 15:40:25.592707 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1854/3766] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:25 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:25.966672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-65bd3f14-7073-4c4d-8479-5988ecda60bd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:25.995744 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-65bd3f14-7073-4c4d-8479-5988ecda60bd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1722 microversion: 2.1 time: 0.544960 Aug 29 15:40:26.018148 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1913/3767] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:25 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1722 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:26.063337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5985b56a-943f-4f05-ae6e-1e3ed8c620a5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:26.065682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5985b56a-943f-4f05-ae6e-1e3ed8c620a5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:26.081591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5985b56a-943f-4f05-ae6e-1e3ed8c620a5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:26.081852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5985b56a-943f-4f05-ae6e-1e3ed8c620a5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:26.082221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5985b56a-943f-4f05-ae6e-1e3ed8c620a5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:26.087473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5985b56a-943f-4f05-ae6e-1e3ed8c620a5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:26.088652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5985b56a-943f-4f05-ae6e-1e3ed8c620a5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:26.089930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5985b56a-943f-4f05-ae6e-1e3ed8c620a5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:26.112594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-90a95bf2-64f7-451e-af8a-6e028ba47e2d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:26.114437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-90a95bf2-64f7-451e-af8a-6e028ba47e2d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:26.126346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90a95bf2-64f7-451e-af8a-6e028ba47e2d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:26.126849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90a95bf2-64f7-451e-af8a-6e028ba47e2d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:26.133918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90a95bf2-64f7-451e-af8a-6e028ba47e2d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:26.134819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90a95bf2-64f7-451e-af8a-6e028ba47e2d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:26.135328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90a95bf2-64f7-451e-af8a-6e028ba47e2d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:26.135777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90a95bf2-64f7-451e-af8a-6e028ba47e2d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:26.189124 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5985b56a-943f-4f05-ae6e-1e3ed8c620a5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action" status: 200 len: 14 microversion: 2.1 time: 0.129715 Aug 29 15:40:26.190480 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1855/3768] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:26 2022] POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:40:26.510716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-90a95bf2-64f7-451e-af8a-6e028ba47e2d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:26.523657 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-90a95bf2-64f7-451e-af8a-6e028ba47e2d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.415190 Aug 29 15:40:26.528996 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1914/3769] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:26 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:26.614854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7c29fc85-57ba-468a-ad34-78ec463fb72a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:26.615555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7c29fc85-57ba-468a-ad34-78ec463fb72a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:26.636160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c29fc85-57ba-468a-ad34-78ec463fb72a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:26.639637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c29fc85-57ba-468a-ad34-78ec463fb72a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:26.640455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c29fc85-57ba-468a-ad34-78ec463fb72a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:26.643877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c29fc85-57ba-468a-ad34-78ec463fb72a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:26.644697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c29fc85-57ba-468a-ad34-78ec463fb72a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:26.654081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c29fc85-57ba-468a-ad34-78ec463fb72a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.021300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d2b26d8-3927-40cc-8c89-dae419736c7a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:27.022754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9d2b26d8-3927-40cc-8c89-dae419736c7a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:27.033772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d2b26d8-3927-40cc-8c89-dae419736c7a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.034511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d2b26d8-3927-40cc-8c89-dae419736c7a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.034955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d2b26d8-3927-40cc-8c89-dae419736c7a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.036303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d2b26d8-3927-40cc-8c89-dae419736c7a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.036776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d2b26d8-3927-40cc-8c89-dae419736c7a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.037253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d2b26d8-3927-40cc-8c89-dae419736c7a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.104391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7c29fc85-57ba-468a-ad34-78ec463fb72a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:27.118125 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7c29fc85-57ba-468a-ad34-78ec463fb72a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 0.507518 Aug 29 15:40:27.131846 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1856/3770] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:26 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:27.200183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-765b6073-c22b-4f7e-8d10-155968f075e9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:27.202427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-765b6073-c22b-4f7e-8d10-155968f075e9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:27.210465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-765b6073-c22b-4f7e-8d10-155968f075e9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.210974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-765b6073-c22b-4f7e-8d10-155968f075e9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.211403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-765b6073-c22b-4f7e-8d10-155968f075e9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.212114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-765b6073-c22b-4f7e-8d10-155968f075e9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.212614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-765b6073-c22b-4f7e-8d10-155968f075e9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.213037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-765b6073-c22b-4f7e-8d10-155968f075e9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.285568 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-765b6073-c22b-4f7e-8d10-155968f075e9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action" status: 200 len: 14 microversion: 2.1 time: 0.088420 Aug 29 15:40:27.292361 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1857/3771] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:27 2022] POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:40:27.452181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9d2b26d8-3927-40cc-8c89-dae419736c7a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:27.465729 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d2b26d8-3927-40cc-8c89-dae419736c7a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1699 microversion: 2.1 time: 0.448464 Aug 29 15:40:27.469425 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1915/3772] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:27 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1699 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:27.495061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d8d8ee0b-0580-47d7-ab16-722a38e8887d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:27.506642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8d8ee0b-0580-47d7-ab16-722a38e8887d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.507412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8d8ee0b-0580-47d7-ab16-722a38e8887d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.508017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8d8ee0b-0580-47d7-ab16-722a38e8887d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.536134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d8d8ee0b-0580-47d7-ab16-722a38e8887d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Going to try to start instance {{(pid=122361) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 15:40:27.554253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-13a0658b-eeff-41a6-af6c-932fbe021df7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:27.555284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-13a0658b-eeff-41a6-af6c-932fbe021df7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:27.565526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13a0658b-eeff-41a6-af6c-932fbe021df7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.566175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13a0658b-eeff-41a6-af6c-932fbe021df7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.566622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13a0658b-eeff-41a6-af6c-932fbe021df7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.568072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13a0658b-eeff-41a6-af6c-932fbe021df7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.568552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13a0658b-eeff-41a6-af6c-932fbe021df7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.569204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13a0658b-eeff-41a6-af6c-932fbe021df7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.607524 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d8d8ee0b-0580-47d7-ab16-722a38e8887d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "POST /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/action" status: 202 len: 0 microversion: 2.1 time: 0.117670 Aug 29 15:40:27.608159 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1858/3773] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:27 2022] POST /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:27.636246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c0c5c223-3c0a-45de-98ec-ac739e8d49d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:27.636993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c0c5c223-3c0a-45de-98ec-ac739e8d49d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:27.681931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0c5c223-3c0a-45de-98ec-ac739e8d49d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.684171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0c5c223-3c0a-45de-98ec-ac739e8d49d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.684841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0c5c223-3c0a-45de-98ec-ac739e8d49d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.686258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0c5c223-3c0a-45de-98ec-ac739e8d49d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.686730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0c5c223-3c0a-45de-98ec-ac739e8d49d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.687169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0c5c223-3c0a-45de-98ec-ac739e8d49d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.905634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-13a0658b-eeff-41a6-af6c-932fbe021df7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:27.917513 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-13a0658b-eeff-41a6-af6c-932fbe021df7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.369640 Aug 29 15:40:27.919290 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1916/3774] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:27 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:28.142990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c3824295-90dd-4b6c-8293-952f0a4e2c20 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:28.143639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c3824295-90dd-4b6c-8293-952f0a4e2c20 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:28.163682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3824295-90dd-4b6c-8293-952f0a4e2c20 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:28.164192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3824295-90dd-4b6c-8293-952f0a4e2c20 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:28.164631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3824295-90dd-4b6c-8293-952f0a4e2c20 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:28.174876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3824295-90dd-4b6c-8293-952f0a4e2c20 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:28.176515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3824295-90dd-4b6c-8293-952f0a4e2c20 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:28.179292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3824295-90dd-4b6c-8293-952f0a4e2c20 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:28.312842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c0c5c223-3c0a-45de-98ec-ac739e8d49d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:28.339686 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c0c5c223-3c0a-45de-98ec-ac739e8d49d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1708 microversion: 2.1 time: 0.715613 Aug 29 15:40:28.365343 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1859/3775] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:27 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1708 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:28.891248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e10dde29-00e0-429c-935f-5e331008e7c4 tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] Action: 'create', calling method: .version_select at 0x7fc42a8bfdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1324764209", "metadata": {"Type": "work"}}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:28.914636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c3824295-90dd-4b6c-8293-952f0a4e2c20 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:28.925358 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c3824295-90dd-4b6c-8293-952f0a4e2c20 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 0.788687 Aug 29 15:40:28.928936 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1917/3776] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:28 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:28.947655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f0794a8a-c9ac-47fb-92eb-7720374c3375 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:28.950696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f0794a8a-c9ac-47fb-92eb-7720374c3375 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:28.960480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0794a8a-c9ac-47fb-92eb-7720374c3375 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:28.966627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0794a8a-c9ac-47fb-92eb-7720374c3375 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:28.967429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0794a8a-c9ac-47fb-92eb-7720374c3375 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:28.968325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0794a8a-c9ac-47fb-92eb-7720374c3375 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:28.969375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0794a8a-c9ac-47fb-92eb-7720374c3375 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:28.970038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0794a8a-c9ac-47fb-92eb-7720374c3375 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.121915 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f0794a8a-c9ac-47fb-92eb-7720374c3375 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action" status: 200 len: 8202 microversion: 2.1 time: 0.191031 Aug 29 15:40:29.124262 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1918/3777] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:28 2022] POST /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6/action => generated 8202 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:29.159045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-691f983e-6b8d-48aa-9558-1d5a68daeca8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:29.163018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-691f983e-6b8d-48aa-9558-1d5a68daeca8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:29.195521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-691f983e-6b8d-48aa-9558-1d5a68daeca8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.197113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-691f983e-6b8d-48aa-9558-1d5a68daeca8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.197865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-691f983e-6b8d-48aa-9558-1d5a68daeca8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.199088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-691f983e-6b8d-48aa-9558-1d5a68daeca8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.200731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-691f983e-6b8d-48aa-9558-1d5a68daeca8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.204542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-691f983e-6b8d-48aa-9558-1d5a68daeca8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.477045 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e10dde29-00e0-429c-935f-5e331008e7c4 tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.122664 Aug 29 15:40:29.478452 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1860/3778] 10.222.0.62 () {60 vars in 1156 bytes} [Mon Aug 29 15:40:28 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1125 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 15:40:29.483759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b98f9895-ff64-49b6-b1cb-5f5d52022695 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:29.484559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b98f9895-ff64-49b6-b1cb-5f5d52022695 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:29.502396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=93 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:29.511474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b98f9895-ff64-49b6-b1cb-5f5d52022695 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.512281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b98f9895-ff64-49b6-b1cb-5f5d52022695 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.512860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b98f9895-ff64-49b6-b1cb-5f5d52022695 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.514271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b98f9895-ff64-49b6-b1cb-5f5d52022695 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.514746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b98f9895-ff64-49b6-b1cb-5f5d52022695 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.515320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b98f9895-ff64-49b6-b1cb-5f5d52022695 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.540460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-691f983e-6b8d-48aa-9558-1d5a68daeca8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:29.555037 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-691f983e-6b8d-48aa-9558-1d5a68daeca8 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.411336 Aug 29 15:40:29.555554 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1919/3779] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:29 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:29.560183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-339d2b23-9260-4b3f-ae48-7fd5ec16553c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:29.560791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-339d2b23-9260-4b3f-ae48-7fd5ec16553c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:29.583099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-339d2b23-9260-4b3f-ae48-7fd5ec16553c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.583577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-339d2b23-9260-4b3f-ae48-7fd5ec16553c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.586569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-339d2b23-9260-4b3f-ae48-7fd5ec16553c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.587501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-339d2b23-9260-4b3f-ae48-7fd5ec16553c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.589597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-339d2b23-9260-4b3f-ae48-7fd5ec16553c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.590224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-339d2b23-9260-4b3f-ae48-7fd5ec16553c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.898378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b98f9895-ff64-49b6-b1cb-5f5d52022695 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:29.912800 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b98f9895-ff64-49b6-b1cb-5f5d52022695 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.433082 Aug 29 15:40:29.921074 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1861/3780] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:29 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:29.934791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-e96e887a-6fe3-4b08-9685-c22ff00c69d3 req-1e425faa-e1c2-4acb-afc0-bfd38b2af8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bacda764-ffc5-41ff-8e06-a0ba54ecb7f7", "name": "network-vif-plugged", "status": "completed", "tag": "e135f3f1-c697-4722-b71b-93e1aadc39b9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:29.955965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e96e887a-6fe3-4b08-9685-c22ff00c69d3 req-1e425faa-e1c2-4acb-afc0-bfd38b2af8a2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.958628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e96e887a-6fe3-4b08-9685-c22ff00c69d3 req-1e425faa-e1c2-4acb-afc0-bfd38b2af8a2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.960292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e96e887a-6fe3-4b08-9685-c22ff00c69d3 req-1e425faa-e1c2-4acb-afc0-bfd38b2af8a2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.981330 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-e96e887a-6fe3-4b08-9685-c22ff00c69d3 req-1e425faa-e1c2-4acb-afc0-bfd38b2af8a2 service nova] Creating event network-vif-plugged:e135f3f1-c697-4722-b71b-93e1aadc39b9 for instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 on n-h2-839401-11 Aug 29 15:40:30.022755 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-e96e887a-6fe3-4b08-9685-c22ff00c69d3 req-1e425faa-e1c2-4acb-afc0-bfd38b2af8a2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098914 Aug 29 15:40:30.027524 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1862/3781] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:30.045285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-725e8b86-cdc1-4bda-b545-f1ed88b9386d tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] Calling method '.version_select at 0x7fc42a894b80>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:30.160623 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-725e8b86-cdc1-4bda-b545-f1ed88b9386d tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062" status: 200 len: 353 microversion: 2.1 time: 0.129917 Aug 29 15:40:30.161253 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1863/3782] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:40:30 2022] GET /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062 => generated 353 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:30.173218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8ce603e4-c396-42fb-975f-aa13695270b3 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:30.173976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8ce603e4-c396-42fb-975f-aa13695270b3 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:30.193922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ce603e4-c396-42fb-975f-aa13695270b3 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.194762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ce603e4-c396-42fb-975f-aa13695270b3 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.195448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ce603e4-c396-42fb-975f-aa13695270b3 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.196459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ce603e4-c396-42fb-975f-aa13695270b3 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.197386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ce603e4-c396-42fb-975f-aa13695270b3 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.198225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ce603e4-c396-42fb-975f-aa13695270b3 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.228116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-339d2b23-9260-4b3f-ae48-7fd5ec16553c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:30.240538 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-339d2b23-9260-4b3f-ae48-7fd5ec16553c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1708 microversion: 2.1 time: 0.683875 Aug 29 15:40:30.254987 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1920/3783] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:29 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1708 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:30.264995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a30efd7e-171c-4d1f-86d0-757bde9e1f12 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:30.266099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a30efd7e-171c-4d1f-86d0-757bde9e1f12 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:30.274279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a30efd7e-171c-4d1f-86d0-757bde9e1f12 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.275348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a30efd7e-171c-4d1f-86d0-757bde9e1f12 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.276016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a30efd7e-171c-4d1f-86d0-757bde9e1f12 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.278011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a30efd7e-171c-4d1f-86d0-757bde9e1f12 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.281629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a30efd7e-171c-4d1f-86d0-757bde9e1f12 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.282300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a30efd7e-171c-4d1f-86d0-757bde9e1f12 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.529854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8ce603e4-c396-42fb-975f-aa13695270b3 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:30.538695 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8ce603e4-c396-42fb-975f-aa13695270b3 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 0.370056 Aug 29 15:40:30.539111 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1864/3784] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:30 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:30.577901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0fd77e66-f905-44a1-8654-b2bfaa02e299 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:30.578517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0fd77e66-f905-44a1-8654-b2bfaa02e299 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:30.588081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fd77e66-f905-44a1-8654-b2bfaa02e299 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.588581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fd77e66-f905-44a1-8654-b2bfaa02e299 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.589075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fd77e66-f905-44a1-8654-b2bfaa02e299 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.589908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fd77e66-f905-44a1-8654-b2bfaa02e299 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.590378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fd77e66-f905-44a1-8654-b2bfaa02e299 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.590811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fd77e66-f905-44a1-8654-b2bfaa02e299 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.602429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a30efd7e-171c-4d1f-86d0-757bde9e1f12 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:30.614201 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a30efd7e-171c-4d1f-86d0-757bde9e1f12 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.357595 Aug 29 15:40:30.615696 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1921/3785] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:30 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:30.635203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b9b2838c-791f-4dae-84bd-389f400a868e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:30.636180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b9b2838c-791f-4dae-84bd-389f400a868e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:30.645538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9b2838c-791f-4dae-84bd-389f400a868e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.646361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9b2838c-791f-4dae-84bd-389f400a868e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.647016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9b2838c-791f-4dae-84bd-389f400a868e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.647934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9b2838c-791f-4dae-84bd-389f400a868e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.648613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9b2838c-791f-4dae-84bd-389f400a868e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.649340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9b2838c-791f-4dae-84bd-389f400a868e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.814260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0fd77e66-f905-44a1-8654-b2bfaa02e299 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:30.826370 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0fd77e66-f905-44a1-8654-b2bfaa02e299 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.254431 Aug 29 15:40:30.839143 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1865/3786] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:30 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:31.052325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b9b2838c-791f-4dae-84bd-389f400a868e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:31.062896 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b9b2838c-791f-4dae-84bd-389f400a868e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.431304 Aug 29 15:40:31.064173 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1922/3787] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:30 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:31.087024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-261422982", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "128669ab-992c-4559-a7aa-5dfa8ba3fc41"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:31.087623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bf145f1a-ba1d-49f3-965b-4827a02f28a3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:31.089191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bf145f1a-ba1d-49f3-965b-4827a02f28a3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:31.098666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf145f1a-ba1d-49f3-965b-4827a02f28a3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.099535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf145f1a-ba1d-49f3-965b-4827a02f28a3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.100142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf145f1a-ba1d-49f3-965b-4827a02f28a3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:31.101049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf145f1a-ba1d-49f3-965b-4827a02f28a3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.101733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf145f1a-ba1d-49f3-965b-4827a02f28a3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.102455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf145f1a-ba1d-49f3-965b-4827a02f28a3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:31.164279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] validate_networks() for [('128669ab-992c-4559-a7aa-5dfa8ba3fc41', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:40:31.252395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bf145f1a-ba1d-49f3-965b-4827a02f28a3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:31.270158 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bf145f1a-ba1d-49f3-965b-4827a02f28a3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.187883 Aug 29 15:40:31.271277 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1923/3788] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:31 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:31.276558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c18686d4-3d72-4e6f-97e1-b71acd005a17 tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] Calling method '.version_select at 0x7fc42aa700d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:31.355409 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c18686d4-3d72-4e6f-97e1-b71acd005a17 tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062" status: 200 len: 354 microversion: 2.1 time: 0.082619 Aug 29 15:40:31.355896 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1924/3789] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:40:31 2022] GET /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:31.364294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e7e0e6e0-4ab8-4c67-b27d-adeef195558a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:31.364929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e7e0e6e0-4ab8-4c67-b27d-adeef195558a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:31.371582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7e0e6e0-4ab8-4c67-b27d-adeef195558a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.372365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7e0e6e0-4ab8-4c67-b27d-adeef195558a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.372985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7e0e6e0-4ab8-4c67-b27d-adeef195558a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:31.373891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7e0e6e0-4ab8-4c67-b27d-adeef195558a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.374718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7e0e6e0-4ab8-4c67-b27d-adeef195558a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.375152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7e0e6e0-4ab8-4c67-b27d-adeef195558a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:31.566685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e7e0e6e0-4ab8-4c67-b27d-adeef195558a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:31.577626 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e7e0e6e0-4ab8-4c67-b27d-adeef195558a tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1712 microversion: 2.1 time: 0.220634 Aug 29 15:40:31.579066 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1925/3790] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:31 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1712 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:31.584689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f8b54303-42fc-4e83-a065-b50a6d848c8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:31.585534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f8b54303-42fc-4e83-a065-b50a6d848c8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:31.593205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8b54303-42fc-4e83-a065-b50a6d848c8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.594076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8b54303-42fc-4e83-a065-b50a6d848c8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.594771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8b54303-42fc-4e83-a065-b50a6d848c8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:31.595485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8b54303-42fc-4e83-a065-b50a6d848c8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.595939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8b54303-42fc-4e83-a065-b50a6d848c8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.596570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8b54303-42fc-4e83-a065-b50a6d848c8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:31.616702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:31.663223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f8b54303-42fc-4e83-a065-b50a6d848c8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Locking {{(pid=122360) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 29 15:40:31.701494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:40:31.702011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:40:31.702528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:40:31.703009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:40:31.704184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:40:31.715505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.716332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.717037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:31.718166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.718893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.719554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:31.739797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Getting quotas for project e65be3b9dae94862b36f8b47bcf427a9. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:40:31.741555 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f8b54303-42fc-4e83-a065-b50a6d848c8e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 202 len: 0 microversion: 2.1 time: 0.160106 Aug 29 15:40:31.745313 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1926/3791] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:31 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:31.747659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Getting quotas for user 6d5cf3f21f5c402b87099b7dccc24d35 and project e65be3b9dae94862b36f8b47bcf427a9. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:40:31.750910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-665a220f-4757-4b69-b08e-cc55acae881c tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] Calling method '.version_select at 0x7fc42b786ca0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:31.777070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:40:31.785226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:40:31.818085 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-665a220f-4757-4b69-b08e-cc55acae881c tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062" status: 200 len: 354 microversion: 2.1 time: 0.071585 Aug 29 15:40:31.827265 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1927/3792] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:40:31 2022] GET /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062 => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:31.830516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6aa375cd-a4d7-4488-8bac-3c8d3c034879 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:31.831167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6aa375cd-a4d7-4488-8bac-3c8d3c034879 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:31.848507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6aa375cd-a4d7-4488-8bac-3c8d3c034879 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.849121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6aa375cd-a4d7-4488-8bac-3c8d3c034879 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.849472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6aa375cd-a4d7-4488-8bac-3c8d3c034879 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:31.850185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6aa375cd-a4d7-4488-8bac-3c8d3c034879 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.850641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6aa375cd-a4d7-4488-8bac-3c8d3c034879 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.851067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6aa375cd-a4d7-4488-8bac-3c8d3c034879 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:31.883433 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7e2f555b-98b7-4a02-b563-88d7562e0ca6 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.042633 Aug 29 15:40:31.887881 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1866/3793] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:40:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:40:31.899408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4f939dc7-9da0-4db0-869c-bea48806427f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:31.899408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4f939dc7-9da0-4db0-869c-bea48806427f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:31.904060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f939dc7-9da0-4db0-869c-bea48806427f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.904715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f939dc7-9da0-4db0-869c-bea48806427f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.905190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f939dc7-9da0-4db0-869c-bea48806427f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:31.905963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f939dc7-9da0-4db0-869c-bea48806427f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.906433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f939dc7-9da0-4db0-869c-bea48806427f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.906863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f939dc7-9da0-4db0-869c-bea48806427f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:32.046307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6aa375cd-a4d7-4488-8bac-3c8d3c034879 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:32.055887 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6aa375cd-a4d7-4488-8bac-3c8d3c034879 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 0.231766 Aug 29 15:40:32.066536 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1928/3794] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:31 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:32.076211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3494cd33-9ef3-4e1e-bbd5-f8a916489532 tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] Calling method '.version_select at 0x7fc42b6b5ee0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:32.115254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4f939dc7-9da0-4db0-869c-bea48806427f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:32.118623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:32.131280 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4f939dc7-9da0-4db0-869c-bea48806427f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.241984 Aug 29 15:40:32.132810 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1867/3795] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:31 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:32.138439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5d7db89b-c967-4d8b-92c3-4c6bf7b5f395 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:32.139194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5d7db89b-c967-4d8b-92c3-4c6bf7b5f395 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:32.147726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7db89b-c967-4d8b-92c3-4c6bf7b5f395 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:32.148227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7db89b-c967-4d8b-92c3-4c6bf7b5f395 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:32.148748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7db89b-c967-4d8b-92c3-4c6bf7b5f395 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:32.151395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7db89b-c967-4d8b-92c3-4c6bf7b5f395 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:32.151902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7db89b-c967-4d8b-92c3-4c6bf7b5f395 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:32.152333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7db89b-c967-4d8b-92c3-4c6bf7b5f395 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:32.200675 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3494cd33-9ef3-4e1e-bbd5-f8a916489532 tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062" status: 202 len: 0 microversion: 2.1 time: 0.130369 Aug 29 15:40:32.204653 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1929/3796] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:40:32 2022] DELETE /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:32.209880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-da432b3c-a165-4c44-9aef-addbdb1d420d tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:32.210090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-da432b3c-a165-4c44-9aef-addbdb1d420d tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:32.334398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-da432b3c-a165-4c44-9aef-addbdb1d420d tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5cf3f21f5c402b87099b7dccc24d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65be3b9dae94862b36f8b47bcf427a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:32.347128 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-da432b3c-a165-4c44-9aef-addbdb1d420d tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 200 len: 1231 microversion: 2.1 time: 0.141245 Aug 29 15:40:32.348821 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1930/3797] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:32 2022] GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 1231 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:32.414442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5d7db89b-c967-4d8b-92c3-4c6bf7b5f395 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:32.425213 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5d7db89b-c967-4d8b-92c3-4c6bf7b5f395 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.290686 Aug 29 15:40:32.429415 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1868/3798] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:32 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:32.434392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b418df30-df9e-4ee5-8720-612e4fc61723 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:32.457399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b418df30-df9e-4ee5-8720-612e4fc61723 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:32.459028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-04ecad4f-7a08-47c4-a083-0b8bfc1f849a req-6b802030-2541-43a1-950c-707893a208fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bacda764-ffc5-41ff-8e06-a0ba54ecb7f7", "name": "network-vif-plugged", "status": "completed", "tag": "58c11c54-9149-4ae2-9080-87e597e5bed4"}, {"server_uuid": "bacda764-ffc5-41ff-8e06-a0ba54ecb7f7", "name": "network-vif-plugged", "status": "completed", "tag": "a1374456-8083-4382-afb5-5b3e041c88f9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:32.462334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b418df30-df9e-4ee5-8720-612e4fc61723 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:32.464128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b418df30-df9e-4ee5-8720-612e4fc61723 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:32.484023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-04ecad4f-7a08-47c4-a083-0b8bfc1f849a req-6b802030-2541-43a1-950c-707893a208fc service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:32.484524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-04ecad4f-7a08-47c4-a083-0b8bfc1f849a req-6b802030-2541-43a1-950c-707893a208fc service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:32.485032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-04ecad4f-7a08-47c4-a083-0b8bfc1f849a req-6b802030-2541-43a1-950c-707893a208fc service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:32.506781 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-04ecad4f-7a08-47c4-a083-0b8bfc1f849a req-6b802030-2541-43a1-950c-707893a208fc service nova] Creating event network-vif-plugged:58c11c54-9149-4ae2-9080-87e597e5bed4 for instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 on n-h2-839401-11 Aug 29 15:40:32.510618 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-04ecad4f-7a08-47c4-a083-0b8bfc1f849a req-6b802030-2541-43a1-950c-707893a208fc service nova] Creating event network-vif-plugged:a1374456-8083-4382-afb5-5b3e041c88f9 for instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 on n-h2-839401-11 Aug 29 15:40:32.516625 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-b418df30-df9e-4ee5-8720-612e4fc61723 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] HTTP exception thrown: Instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 is locked Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b418df30-df9e-4ee5-8720-612e4fc61723 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Request method failure captured: Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action HTTP/1.1 Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 15 Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNyVUDTEVho31pZrDnlkVTpcEwslkOPd4iXBEcswKKT8qNvwbqvdNTz64d_m2JkSIgvffpQavLVnlSeN63E26PHHp1t69vN5c_7nv_4r8WgVQdv00nmt_4DxArl83JZzGr3H5WvWvTPBCc47knjE4WwZ8pU378_W4AEE4iwO_16SxpM Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 990c752c7bb141c1bf496c98fbc3c9a7 Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_990c752c7bb141c1bf496c98fbc3c9a7", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/990c752c7bb141c1bf496c98fbc3c9a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/990c752c7bb141c1bf496c98fbc3c9a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/990c752c7bb141c1bf496c98fbc3c9a7"}]}] Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 990c752c7bb141c1bf496c98fbc3c9a7 Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerActionsTestJSON-1192262438-project Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 51efa71a8bfe457982698a5755ae3cc6 Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerActionsTestJSON-1192262438-project Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: {"os-stop": {}} Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 is locked Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '2af95f7c-5362-4cf9-b80e-38cd6a518783', 'body': {'os-stop': {}}} Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 is locked Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 is locked Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 is locked Aug 29 15:40:32.518912 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:32.523714 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-04ecad4f-7a08-47c4-a083-0b8bfc1f849a req-6b802030-2541-43a1-950c-707893a208fc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.169969 Aug 29 15:40:32.524154 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1931/3799] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:32.525796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b418df30-df9e-4ee5-8720-612e4fc61723 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Returning 409 to user: Instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 is locked {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:32.526906 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b418df30-df9e-4ee5-8720-612e4fc61723 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 409 len: 107 microversion: 2.1 time: 0.096452 Aug 29 15:40:32.527986 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1869/3800] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:32 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 107 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:40:32.533752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ef98af8d-7bc4-4fe8-bc9c-e14a9e19f7aa tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] Calling method '.version_select at 0x7fc42b767d30>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:32.536196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f401f0ed-d49e-425d-a147-df17e77490fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:32.536928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f401f0ed-d49e-425d-a147-df17e77490fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:32.570566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f401f0ed-d49e-425d-a147-df17e77490fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:32.571065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f401f0ed-d49e-425d-a147-df17e77490fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:32.571587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f401f0ed-d49e-425d-a147-df17e77490fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:32.572316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f401f0ed-d49e-425d-a147-df17e77490fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:32.572761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f401f0ed-d49e-425d-a147-df17e77490fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:32.573293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f401f0ed-d49e-425d-a147-df17e77490fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:32.619411 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ef98af8d-7bc4-4fe8-bc9c-e14a9e19f7aa tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062" status: 200 len: 353 microversion: 2.1 time: 0.094299 Aug 29 15:40:32.620205 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1932/3801] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:40:32 2022] GET /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:32.684924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f401f0ed-d49e-425d-a147-df17e77490fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Unlocking {{(pid=122361) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 29 15:40:32.852808 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f401f0ed-d49e-425d-a147-df17e77490fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 202 len: 0 microversion: 2.1 time: 0.320547 Aug 29 15:40:32.868314 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1870/3802] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:32 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:40:32.874055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-88da5fe5-04d4-4258-b07e-1b915e6280a3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:32.900381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88da5fe5-04d4-4258-b07e-1b915e6280a3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:32.910156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88da5fe5-04d4-4258-b07e-1b915e6280a3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:32.911050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88da5fe5-04d4-4258-b07e-1b915e6280a3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:32.947378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-88da5fe5-04d4-4258-b07e-1b915e6280a3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Going to try to stop instance {{(pid=122360) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:40:33.028852 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-88da5fe5-04d4-4258-b07e-1b915e6280a3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 202 len: 0 microversion: 2.1 time: 0.160251 Aug 29 15:40:33.031202 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1933/3803] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:32 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:40:33.040991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-739dfca1-1063-4da2-b7c8-5831e60de5b9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:33.042349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-739dfca1-1063-4da2-b7c8-5831e60de5b9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:33.049379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-739dfca1-1063-4da2-b7c8-5831e60de5b9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.050172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-739dfca1-1063-4da2-b7c8-5831e60de5b9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.050949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-739dfca1-1063-4da2-b7c8-5831e60de5b9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.051902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-739dfca1-1063-4da2-b7c8-5831e60de5b9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.052540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-739dfca1-1063-4da2-b7c8-5831e60de5b9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.053353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-739dfca1-1063-4da2-b7c8-5831e60de5b9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.077998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ae43ef3e-fde7-4612-95e1-a4f539d9f09e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:33.078712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ae43ef3e-fde7-4612-95e1-a4f539d9f09e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:33.086815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae43ef3e-fde7-4612-95e1-a4f539d9f09e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.087689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae43ef3e-fde7-4612-95e1-a4f539d9f09e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.088404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae43ef3e-fde7-4612-95e1-a4f539d9f09e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.089648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae43ef3e-fde7-4612-95e1-a4f539d9f09e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.090365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae43ef3e-fde7-4612-95e1-a4f539d9f09e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.091856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae43ef3e-fde7-4612-95e1-a4f539d9f09e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.308451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ae43ef3e-fde7-4612-95e1-a4f539d9f09e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:33.321278 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ae43ef3e-fde7-4612-95e1-a4f539d9f09e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 0.247890 Aug 29 15:40:33.336063 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1934/3804] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:33 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:33.371733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fdcb49df-dc73-4233-ae60-8693c279ce62 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:33.372364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fdcb49df-dc73-4233-ae60-8693c279ce62 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:33.382960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-739dfca1-1063-4da2-b7c8-5831e60de5b9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:33.394927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fdcb49df-dc73-4233-ae60-8693c279ce62 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.396737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fdcb49df-dc73-4233-ae60-8693c279ce62 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.397427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fdcb49df-dc73-4233-ae60-8693c279ce62 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.399261 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-739dfca1-1063-4da2-b7c8-5831e60de5b9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.363796 Aug 29 15:40:33.399913 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1871/3805] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:33 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:33.405744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fdcb49df-dc73-4233-ae60-8693c279ce62 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.406505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fdcb49df-dc73-4233-ae60-8693c279ce62 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.407199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fdcb49df-dc73-4233-ae60-8693c279ce62 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.452796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c5bf22d2-7da7-4def-93d5-215fa7744d3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:33.454226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c5bf22d2-7da7-4def-93d5-215fa7744d3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:33.462574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5bf22d2-7da7-4def-93d5-215fa7744d3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.463226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5bf22d2-7da7-4def-93d5-215fa7744d3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.463661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5bf22d2-7da7-4def-93d5-215fa7744d3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.465373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5bf22d2-7da7-4def-93d5-215fa7744d3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.466020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5bf22d2-7da7-4def-93d5-215fa7744d3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.466626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5bf22d2-7da7-4def-93d5-215fa7744d3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.551678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fdcb49df-dc73-4233-ae60-8693c279ce62 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5cf3f21f5c402b87099b7dccc24d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65be3b9dae94862b36f8b47bcf427a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:33.562172 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fdcb49df-dc73-4233-ae60-8693c279ce62 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 200 len: 1283 microversion: 2.1 time: 0.195939 Aug 29 15:40:33.562972 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1935/3806] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:33 2022] GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 1283 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:33.634778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cde9f7c3-bfa9-492e-8e21-843400206f68 tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] Calling method '.version_select at 0x7fc42b575c10>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:33.715075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c5bf22d2-7da7-4def-93d5-215fa7744d3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:33.724355 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c5bf22d2-7da7-4def-93d5-215fa7744d3f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.275897 Aug 29 15:40:33.729495 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1872/3807] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:33 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:33.747197 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cde9f7c3-bfa9-492e-8e21-843400206f68 tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062" status: 200 len: 353 microversion: 2.1 time: 0.116461 Aug 29 15:40:33.748404 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1936/3808] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:40:33 2022] GET /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062 => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:34.342612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8a1c9bef-cb89-498d-aa8e-cf61e4ce905f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:34.343236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8a1c9bef-cb89-498d-aa8e-cf61e4ce905f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:34.350201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a1c9bef-cb89-498d-aa8e-cf61e4ce905f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.350932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a1c9bef-cb89-498d-aa8e-cf61e4ce905f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.351546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a1c9bef-cb89-498d-aa8e-cf61e4ce905f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:34.352471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a1c9bef-cb89-498d-aa8e-cf61e4ce905f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.353195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a1c9bef-cb89-498d-aa8e-cf61e4ce905f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.353784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a1c9bef-cb89-498d-aa8e-cf61e4ce905f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:34.425998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a8d09057-0bf5-442e-8add-629966a44ef6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:34.426714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a8d09057-0bf5-442e-8add-629966a44ef6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:34.435979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8d09057-0bf5-442e-8add-629966a44ef6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.435979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8d09057-0bf5-442e-8add-629966a44ef6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.436521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8d09057-0bf5-442e-8add-629966a44ef6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:34.448193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8d09057-0bf5-442e-8add-629966a44ef6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.448915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8d09057-0bf5-442e-8add-629966a44ef6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.449620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8d09057-0bf5-442e-8add-629966a44ef6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:34.614972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a8d09057-0bf5-442e-8add-629966a44ef6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:34.624126 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a8d09057-0bf5-442e-8add-629966a44ef6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.203827 Aug 29 15:40:34.624957 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1937/3809] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:34 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:34.631542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9e5fb64a-3877-46da-8995-2baf13b7a0fc tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:34.633044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9e5fb64a-3877-46da-8995-2baf13b7a0fc tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:34.642282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e5fb64a-3877-46da-8995-2baf13b7a0fc tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.642784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e5fb64a-3877-46da-8995-2baf13b7a0fc tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.643221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e5fb64a-3877-46da-8995-2baf13b7a0fc tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:34.643934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e5fb64a-3877-46da-8995-2baf13b7a0fc tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.646600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e5fb64a-3877-46da-8995-2baf13b7a0fc tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.647049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e5fb64a-3877-46da-8995-2baf13b7a0fc tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:34.654504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8a1c9bef-cb89-498d-aa8e-cf61e4ce905f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:34.670884 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8a1c9bef-cb89-498d-aa8e-cf61e4ce905f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1355 microversion: 2.1 time: 0.332216 Aug 29 15:40:34.672953 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1873/3810] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:34 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1355 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:34.749910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4cca9529-0b74-485d-92e3-be5a76f7570f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:34.757756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4cca9529-0b74-485d-92e3-be5a76f7570f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:34.765843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cca9529-0b74-485d-92e3-be5a76f7570f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.766344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cca9529-0b74-485d-92e3-be5a76f7570f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.767111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cca9529-0b74-485d-92e3-be5a76f7570f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:34.772151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cca9529-0b74-485d-92e3-be5a76f7570f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.772539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e5fb64a-3877-46da-8995-2baf13b7a0fc tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5cf3f21f5c402b87099b7dccc24d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65be3b9dae94862b36f8b47bcf427a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:34.773027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cca9529-0b74-485d-92e3-be5a76f7570f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.777732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cca9529-0b74-485d-92e3-be5a76f7570f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:34.782874 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9e5fb64a-3877-46da-8995-2baf13b7a0fc tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 200 len: 1289 microversion: 2.1 time: 0.155678 Aug 29 15:40:34.784729 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1938/3811] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:34 2022] GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 1289 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:34.790850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0dd8bbbf-b5f6-476e-a73b-3bcf28a5a801 tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] Calling method '.version_select at 0x7fc42b862940>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:34.924060 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0dd8bbbf-b5f6-476e-a73b-3bcf28a5a801 tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062" status: 200 len: 353 microversion: 2.1 time: 0.137998 Aug 29 15:40:34.926598 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1939/3812] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:40:34 2022] GET /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062 => generated 353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:35.348020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4cca9529-0b74-485d-92e3-be5a76f7570f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:35.356290 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4cca9529-0b74-485d-92e3-be5a76f7570f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.611772 Aug 29 15:40:35.365689 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1874/3813] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:34 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:35.654879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-63615710-3ad7-4c6b-b946-e3f7bf7e1472 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:35.656172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-63615710-3ad7-4c6b-b946-e3f7bf7e1472 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:35.672766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63615710-3ad7-4c6b-b946-e3f7bf7e1472 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.673532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63615710-3ad7-4c6b-b946-e3f7bf7e1472 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.674333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63615710-3ad7-4c6b-b946-e3f7bf7e1472 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.675096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63615710-3ad7-4c6b-b946-e3f7bf7e1472 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.675780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63615710-3ad7-4c6b-b946-e3f7bf7e1472 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.676217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63615710-3ad7-4c6b-b946-e3f7bf7e1472 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.694533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d91ad5a9-afa7-4765-8210-9d85683bbb24 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:35.695364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d91ad5a9-afa7-4765-8210-9d85683bbb24 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:35.707462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d91ad5a9-afa7-4765-8210-9d85683bbb24 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.707953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d91ad5a9-afa7-4765-8210-9d85683bbb24 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.708651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d91ad5a9-afa7-4765-8210-9d85683bbb24 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.709390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d91ad5a9-afa7-4765-8210-9d85683bbb24 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.709849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d91ad5a9-afa7-4765-8210-9d85683bbb24 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.710269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d91ad5a9-afa7-4765-8210-9d85683bbb24 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.940774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-63615710-3ad7-4c6b-b946-e3f7bf7e1472 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:35.949365 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-63615710-3ad7-4c6b-b946-e3f7bf7e1472 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.305033 Aug 29 15:40:35.950269 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1940/3814] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:35 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:35.955700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7a4485f9-51af-4e44-92d0-30ee9bf2d130 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:35.956653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7a4485f9-51af-4e44-92d0-30ee9bf2d130 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:35.963624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a4485f9-51af-4e44-92d0-30ee9bf2d130 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.964509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a4485f9-51af-4e44-92d0-30ee9bf2d130 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.965232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a4485f9-51af-4e44-92d0-30ee9bf2d130 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.966187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a4485f9-51af-4e44-92d0-30ee9bf2d130 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.966944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a4485f9-51af-4e44-92d0-30ee9bf2d130 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.967951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a4485f9-51af-4e44-92d0-30ee9bf2d130 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.081123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d91ad5a9-afa7-4765-8210-9d85683bbb24 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:36.091322 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d91ad5a9-afa7-4765-8210-9d85683bbb24 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1805 microversion: 2.1 time: 0.401911 Aug 29 15:40:36.093253 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1875/3815] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:35 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1805 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:36.098842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-49e4f57d-5cb6-40b1-9399-2b402fe09b76 tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] Calling method '.version_select at 0x7fc42a872f70>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:36.150622 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-49e4f57d-5cb6-40b1-9399-2b402fe09b76 tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] HTTP exception thrown: Volume afa2868a-da4f-4a2c-a9af-cf0faedea062 could not be found. Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-49e4f57d-5cb6-40b1-9399-2b402fe09b76 tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] Request method failure captured: Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062 HTTP/1.1 Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN3sOK1zmr-NRQEG4-ar55HYOI0K0V62MZAhB6vV_ztndIEkyU6R1I-FpZJnVfjNEIPxd6TaX31wDc3tM82mAdwxfu8jlaKnN43Jbn1HHm0FPN7aUwHGz5EQur740Wci7OPgRXBMsgt9DdjIIabL5QamHDmsxeaAj_5scr5005tcMpg Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: f763ae3784154709a28f0a6c6655d0e4 Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-VolumesGetTestJSON-1287351815 Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f763ae3784154709a28f0a6c6655d0e4", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f763ae3784154709a28f0a6c6655d0e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f763ae3784154709a28f0a6c6655d0e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f763ae3784154709a28f0a6c6655d0e4"}]}] Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-VolumesGetTestJSON-1287351815 Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: f763ae3784154709a28f0a6c6655d0e4 Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-VolumesGetTestJSON-1287351815 Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-VolumesGetTestJSON-1287351815-project Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: a7cf319a7e434349b7e21b2a9ecea828 Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-VolumesGetTestJSON-1287351815-project Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: exception: Volume afa2868a-da4f-4a2c-a9af-cf0faedea062 could not be found. Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'afa2868a-da4f-4a2c-a9af-cf0faedea062'} Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume afa2868a-da4f-4a2c-a9af-cf0faedea062 could not be found. (HTTP 404) (Request-ID: req-7dc78233-38e6-493b-8114-aa6e2c5429ac) Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:40:36.153680 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume afa2868a-da4f-4a2c-a9af-cf0faedea062 could not be found. Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume afa2868a-da4f-4a2c-a9af-cf0faedea062 could not be found. Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume afa2868a-da4f-4a2c-a9af-cf0faedea062 could not be found. Aug 29 15:40:36.158965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:36.166500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-49e4f57d-5cb6-40b1-9399-2b402fe09b76 tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] Returning 404 to user: Volume afa2868a-da4f-4a2c-a9af-cf0faedea062 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:36.167653 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-49e4f57d-5cb6-40b1-9399-2b402fe09b76 tempest-VolumesGetTestJSON-1287351815 tempest-VolumesGetTestJSON-1287351815-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062" status: 404 len: 109 microversion: 2.1 time: 0.073111 Aug 29 15:40:36.168452 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1876/3816] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:40:36 2022] GET /compute/v2.1/os-volumes/afa2868a-da4f-4a2c-a9af-cf0faedea062 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:36.177031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1fcccb21-8bd7-4ac8-9c16-470750444baa tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:36.177841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1fcccb21-8bd7-4ac8-9c16-470750444baa tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:36.185807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fcccb21-8bd7-4ac8-9c16-470750444baa tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.187509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fcccb21-8bd7-4ac8-9c16-470750444baa tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.188203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fcccb21-8bd7-4ac8-9c16-470750444baa tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.189194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fcccb21-8bd7-4ac8-9c16-470750444baa tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.190902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fcccb21-8bd7-4ac8-9c16-470750444baa tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.192214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fcccb21-8bd7-4ac8-9c16-470750444baa tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.234743 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1fcccb21-8bd7-4ac8-9c16-470750444baa tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7/ips" status: 200 len: 218 microversion: 2.1 time: 0.064824 Aug 29 15:40:36.236755 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1877/3817] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:40:36 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7/ips => generated 218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:36.248657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cf3fbac1-176d-42bb-971a-f71647c8d563 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:36.250448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cf3fbac1-176d-42bb-971a-f71647c8d563 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:36.257333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf3fbac1-176d-42bb-971a-f71647c8d563 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.260924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf3fbac1-176d-42bb-971a-f71647c8d563 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.261677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf3fbac1-176d-42bb-971a-f71647c8d563 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.263149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf3fbac1-176d-42bb-971a-f71647c8d563 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.263841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf3fbac1-176d-42bb-971a-f71647c8d563 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.264494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf3fbac1-176d-42bb-971a-f71647c8d563 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.297348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cf3fbac1-176d-42bb-971a-f71647c8d563 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:40:36.353670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7a4485f9-51af-4e44-92d0-30ee9bf2d130 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5cf3f21f5c402b87099b7dccc24d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65be3b9dae94862b36f8b47bcf427a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:36.364551 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7a4485f9-51af-4e44-92d0-30ee9bf2d130 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 200 len: 1331 microversion: 2.1 time: 0.411268 Aug 29 15:40:36.368011 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1941/3818] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:35 2022] GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 1331 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:36.380325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98f127c6-362c-4368-a356-a5d296f03d2f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:36.381926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-98f127c6-362c-4368-a356-a5d296f03d2f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:36.392224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98f127c6-362c-4368-a356-a5d296f03d2f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.393159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98f127c6-362c-4368-a356-a5d296f03d2f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.395264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98f127c6-362c-4368-a356-a5d296f03d2f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.396522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98f127c6-362c-4368-a356-a5d296f03d2f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.397353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98f127c6-362c-4368-a356-a5d296f03d2f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.398001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98f127c6-362c-4368-a356-a5d296f03d2f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.429214 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cf3fbac1-176d-42bb-971a-f71647c8d563 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 204 len: 0 microversion: 2.1 time: 0.185067 Aug 29 15:40:36.434506 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1878/3819] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:40:36 2022] DELETE /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:40:36.440889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3362290a-efff-496e-9ad6-8a070220091f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:36.441674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3362290a-efff-496e-9ad6-8a070220091f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:36.449154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3362290a-efff-496e-9ad6-8a070220091f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.449657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3362290a-efff-496e-9ad6-8a070220091f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.450284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3362290a-efff-496e-9ad6-8a070220091f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.451193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3362290a-efff-496e-9ad6-8a070220091f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.451961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3362290a-efff-496e-9ad6-8a070220091f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.452562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3362290a-efff-496e-9ad6-8a070220091f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.690900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-98f127c6-362c-4368-a356-a5d296f03d2f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:36.704326 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-98f127c6-362c-4368-a356-a5d296f03d2f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.330424 Aug 29 15:40:36.705610 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1942/3820] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:36 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:36.725860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3362290a-efff-496e-9ad6-8a070220091f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:36.734748 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3362290a-efff-496e-9ad6-8a070220091f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1811 microversion: 2.1 time: 0.298918 Aug 29 15:40:36.735849 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1879/3821] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:36 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1811 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:36.974984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-69ab896f-aa45-4ca5-b01f-cf291d580b02 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:36.975756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-69ab896f-aa45-4ca5-b01f-cf291d580b02 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:36.987191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69ab896f-aa45-4ca5-b01f-cf291d580b02 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.988872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69ab896f-aa45-4ca5-b01f-cf291d580b02 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.989809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69ab896f-aa45-4ca5-b01f-cf291d580b02 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.992031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69ab896f-aa45-4ca5-b01f-cf291d580b02 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.992969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69ab896f-aa45-4ca5-b01f-cf291d580b02 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.994712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69ab896f-aa45-4ca5-b01f-cf291d580b02 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:37.020223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-685e88c8-d7cd-4898-ae88-837905691d02 req-bf65f270-0f69-4cdc-ba7b-d50f40c243e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec852709-4ddc-42d0-94da-88df26e5e524", "tag": "1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:37.034102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-685e88c8-d7cd-4898-ae88-837905691d02 req-bf65f270-0f69-4cdc-ba7b-d50f40c243e4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:37.034851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-685e88c8-d7cd-4898-ae88-837905691d02 req-bf65f270-0f69-4cdc-ba7b-d50f40c243e4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:37.035614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-685e88c8-d7cd-4898-ae88-837905691d02 req-bf65f270-0f69-4cdc-ba7b-d50f40c243e4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:37.083838 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-685e88c8-d7cd-4898-ae88-837905691d02 req-bf65f270-0f69-4cdc-ba7b-d50f40c243e4 service nova] Creating event network-changed:1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf for instance ec852709-4ddc-42d0-94da-88df26e5e524 on n-h1-839401-11 Aug 29 15:40:37.101924 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-685e88c8-d7cd-4898-ae88-837905691d02 req-bf65f270-0f69-4cdc-ba7b-d50f40c243e4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.284308 Aug 29 15:40:37.103786 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1943/3822] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:37.327088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-69ab896f-aa45-4ca5-b01f-cf291d580b02 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:37.339179 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-69ab896f-aa45-4ca5-b01f-cf291d580b02 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.370107 Aug 29 15:40:37.340328 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1880/3823] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:36 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:37.388615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f14513ce-2666-434a-a388-771832b51131 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:37.389866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f14513ce-2666-434a-a388-771832b51131 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:37.400131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f14513ce-2666-434a-a388-771832b51131 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:37.401010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f14513ce-2666-434a-a388-771832b51131 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:37.401626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f14513ce-2666-434a-a388-771832b51131 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:37.402861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f14513ce-2666-434a-a388-771832b51131 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:37.403634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f14513ce-2666-434a-a388-771832b51131 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:37.404407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f14513ce-2666-434a-a388-771832b51131 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:37.584382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f14513ce-2666-434a-a388-771832b51131 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5cf3f21f5c402b87099b7dccc24d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65be3b9dae94862b36f8b47bcf427a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:37.592573 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f14513ce-2666-434a-a388-771832b51131 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 200 len: 1331 microversion: 2.1 time: 0.208397 Aug 29 15:40:37.593182 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1944/3824] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:37 2022] GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 1331 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:37.727730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-246f558c-1d48-4382-83e3-800f21e7b12f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:37.728674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-246f558c-1d48-4382-83e3-800f21e7b12f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:37.737009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-246f558c-1d48-4382-83e3-800f21e7b12f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:37.737591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-246f558c-1d48-4382-83e3-800f21e7b12f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:37.738258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-246f558c-1d48-4382-83e3-800f21e7b12f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:37.739025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-246f558c-1d48-4382-83e3-800f21e7b12f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:37.739559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-246f558c-1d48-4382-83e3-800f21e7b12f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:37.740189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-246f558c-1d48-4382-83e3-800f21e7b12f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:37.768634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-056a7a3e-d0e2-4b16-82b0-33e0006df652 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:37.775777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-056a7a3e-d0e2-4b16-82b0-33e0006df652 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:37.792502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-056a7a3e-d0e2-4b16-82b0-33e0006df652 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:37.792953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-056a7a3e-d0e2-4b16-82b0-33e0006df652 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:37.793419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-056a7a3e-d0e2-4b16-82b0-33e0006df652 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:37.794601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-056a7a3e-d0e2-4b16-82b0-33e0006df652 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:37.795377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-056a7a3e-d0e2-4b16-82b0-33e0006df652 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:37.795999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-056a7a3e-d0e2-4b16-82b0-33e0006df652 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:37.898365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-246f558c-1d48-4382-83e3-800f21e7b12f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:37.902741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:37.907730 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-246f558c-1d48-4382-83e3-800f21e7b12f tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.185165 Aug 29 15:40:37.921414 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1881/3825] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:37 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:38.026280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-056a7a3e-d0e2-4b16-82b0-33e0006df652 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:38.036289 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-056a7a3e-d0e2-4b16-82b0-33e0006df652 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1811 microversion: 2.1 time: 0.283016 Aug 29 15:40:38.037503 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1945/3826] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:37 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1811 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:38.363193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b055313-dbb3-4c29-b2b2-3f7f74ab83bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:38.364635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4b055313-dbb3-4c29-b2b2-3f7f74ab83bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:38.373138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b055313-dbb3-4c29-b2b2-3f7f74ab83bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.373678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b055313-dbb3-4c29-b2b2-3f7f74ab83bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.374397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b055313-dbb3-4c29-b2b2-3f7f74ab83bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.375109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b055313-dbb3-4c29-b2b2-3f7f74ab83bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.375748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b055313-dbb3-4c29-b2b2-3f7f74ab83bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.376182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b055313-dbb3-4c29-b2b2-3f7f74ab83bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.517610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4b055313-dbb3-4c29-b2b2-3f7f74ab83bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:38.525536 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4b055313-dbb3-4c29-b2b2-3f7f74ab83bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.167515 Aug 29 15:40:38.526049 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1882/3827] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:38 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:38.614324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b3ab06cf-fdfa-45af-a8ea-2888ea95da72 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:38.614942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b3ab06cf-fdfa-45af-a8ea-2888ea95da72 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:38.623047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3ab06cf-fdfa-45af-a8ea-2888ea95da72 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.623555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3ab06cf-fdfa-45af-a8ea-2888ea95da72 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.624306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3ab06cf-fdfa-45af-a8ea-2888ea95da72 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.625225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3ab06cf-fdfa-45af-a8ea-2888ea95da72 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.625713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3ab06cf-fdfa-45af-a8ea-2888ea95da72 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.626139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3ab06cf-fdfa-45af-a8ea-2888ea95da72 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.769362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b3ab06cf-fdfa-45af-a8ea-2888ea95da72 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5cf3f21f5c402b87099b7dccc24d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65be3b9dae94862b36f8b47bcf427a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:38.770514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:38.775465 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b3ab06cf-fdfa-45af-a8ea-2888ea95da72 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 200 len: 1331 microversion: 2.1 time: 0.165419 Aug 29 15:40:38.776116 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1946/3828] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:38 2022] GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 1331 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:38.931846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-47eb7d7a-b5d4-4f32-806e-7fcc4db3c6f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:38.932627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-47eb7d7a-b5d4-4f32-806e-7fcc4db3c6f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:38.939581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47eb7d7a-b5d4-4f32-806e-7fcc4db3c6f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.940373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47eb7d7a-b5d4-4f32-806e-7fcc4db3c6f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.941021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47eb7d7a-b5d4-4f32-806e-7fcc4db3c6f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.942005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47eb7d7a-b5d4-4f32-806e-7fcc4db3c6f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.942673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47eb7d7a-b5d4-4f32-806e-7fcc4db3c6f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.943305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47eb7d7a-b5d4-4f32-806e-7fcc4db3c6f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.058143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-71959d92-2bdf-4b71-99b9-e476eac87925 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:39.058748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-71959d92-2bdf-4b71-99b9-e476eac87925 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:39.067630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71959d92-2bdf-4b71-99b9-e476eac87925 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.068391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71959d92-2bdf-4b71-99b9-e476eac87925 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.069030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71959d92-2bdf-4b71-99b9-e476eac87925 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.069948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71959d92-2bdf-4b71-99b9-e476eac87925 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.070452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71959d92-2bdf-4b71-99b9-e476eac87925 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.071025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71959d92-2bdf-4b71-99b9-e476eac87925 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.266193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-71959d92-2bdf-4b71-99b9-e476eac87925 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:39.273164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-47eb7d7a-b5d4-4f32-806e-7fcc4db3c6f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:39.279393 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-71959d92-2bdf-4b71-99b9-e476eac87925 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1811 microversion: 2.1 time: 0.223466 Aug 29 15:40:39.280176 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1947/3829] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:39 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1811 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:39.284987 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-47eb7d7a-b5d4-4f32-806e-7fcc4db3c6f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.356946 Aug 29 15:40:39.285829 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1883/3830] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:38 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:39.559144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6cbe7991-0464-439d-a5d1-2265c06327b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:39.563450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6cbe7991-0464-439d-a5d1-2265c06327b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:39.578891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cbe7991-0464-439d-a5d1-2265c06327b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.579400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cbe7991-0464-439d-a5d1-2265c06327b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.582432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cbe7991-0464-439d-a5d1-2265c06327b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.583912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cbe7991-0464-439d-a5d1-2265c06327b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.587982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cbe7991-0464-439d-a5d1-2265c06327b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.588837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cbe7991-0464-439d-a5d1-2265c06327b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.644485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-efba14f7-2a87-48f1-b544-b9e20be538fb req-cdfadee5-e50b-48f7-995a-d443c59ee77c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bacda764-ffc5-41ff-8e06-a0ba54ecb7f7", "name": "network-vif-deleted", "tag": "e135f3f1-c697-4722-b71b-93e1aadc39b9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:39.665716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-efba14f7-2a87-48f1-b544-b9e20be538fb req-cdfadee5-e50b-48f7-995a-d443c59ee77c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.667716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-efba14f7-2a87-48f1-b544-b9e20be538fb req-cdfadee5-e50b-48f7-995a-d443c59ee77c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.668439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-efba14f7-2a87-48f1-b544-b9e20be538fb req-cdfadee5-e50b-48f7-995a-d443c59ee77c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.696662 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-efba14f7-2a87-48f1-b544-b9e20be538fb req-cdfadee5-e50b-48f7-995a-d443c59ee77c service nova] Creating event network-vif-deleted:e135f3f1-c697-4722-b71b-93e1aadc39b9 for instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 on n-h2-839401-11 Aug 29 15:40:39.713772 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-efba14f7-2a87-48f1-b544-b9e20be538fb req-cdfadee5-e50b-48f7-995a-d443c59ee77c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070205 Aug 29 15:40:39.715129 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1884/3831] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:40:39.798125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5707c90f-cc0a-4f11-a408-e5be7dfa7a8f tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:39.799092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5707c90f-cc0a-4f11-a408-e5be7dfa7a8f tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:39.814487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5707c90f-cc0a-4f11-a408-e5be7dfa7a8f tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.815179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5707c90f-cc0a-4f11-a408-e5be7dfa7a8f tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.816690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5707c90f-cc0a-4f11-a408-e5be7dfa7a8f tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.817585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5707c90f-cc0a-4f11-a408-e5be7dfa7a8f tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.818567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5707c90f-cc0a-4f11-a408-e5be7dfa7a8f tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.823823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5707c90f-cc0a-4f11-a408-e5be7dfa7a8f tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.912657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6cbe7991-0464-439d-a5d1-2265c06327b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:39.923002 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6cbe7991-0464-439d-a5d1-2265c06327b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.378889 Aug 29 15:40:39.923612 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1948/3832] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:39 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:40.212244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5707c90f-cc0a-4f11-a408-e5be7dfa7a8f tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5cf3f21f5c402b87099b7dccc24d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65be3b9dae94862b36f8b47bcf427a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:40.221856 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5707c90f-cc0a-4f11-a408-e5be7dfa7a8f tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 200 len: 1331 microversion: 2.1 time: 0.428966 Aug 29 15:40:40.223489 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1885/3833] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:39 2022] GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 1331 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:40.309238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-05d6d7a4-aff6-4d4c-a87e-4694908a3ac3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:40.311391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dcb2de45-8893-44b1-929f-a86a2d350bdd tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:40.311974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-05d6d7a4-aff6-4d4c-a87e-4694908a3ac3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:40.312921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dcb2de45-8893-44b1-929f-a86a2d350bdd tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:40.330850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcb2de45-8893-44b1-929f-a86a2d350bdd tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:40.332692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05d6d7a4-aff6-4d4c-a87e-4694908a3ac3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:40.333226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05d6d7a4-aff6-4d4c-a87e-4694908a3ac3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:40.333668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05d6d7a4-aff6-4d4c-a87e-4694908a3ac3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:40.334375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05d6d7a4-aff6-4d4c-a87e-4694908a3ac3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:40.334835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05d6d7a4-aff6-4d4c-a87e-4694908a3ac3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:40.335258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05d6d7a4-aff6-4d4c-a87e-4694908a3ac3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:40.341646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcb2de45-8893-44b1-929f-a86a2d350bdd tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:40.342085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcb2de45-8893-44b1-929f-a86a2d350bdd tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:40.342811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcb2de45-8893-44b1-929f-a86a2d350bdd tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:40.343265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcb2de45-8893-44b1-929f-a86a2d350bdd tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:40.351638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcb2de45-8893-44b1-929f-a86a2d350bdd tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:40.631507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dcb2de45-8893-44b1-929f-a86a2d350bdd tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:40.642137 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dcb2de45-8893-44b1-929f-a86a2d350bdd tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1631 microversion: 2.1 time: 0.344090 Aug 29 15:40:40.644794 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1949/3834] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:40 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1631 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:40.750046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-05d6d7a4-aff6-4d4c-a87e-4694908a3ac3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:40.765865 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-05d6d7a4-aff6-4d4c-a87e-4694908a3ac3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.463147 Aug 29 15:40:40.766467 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1886/3835] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:40 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:40.943820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4d6a771f-4526-4d03-bd51-6be899066dd9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:40.944436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4d6a771f-4526-4d03-bd51-6be899066dd9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:40.952761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d6a771f-4526-4d03-bd51-6be899066dd9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:40.955393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d6a771f-4526-4d03-bd51-6be899066dd9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:40.956958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d6a771f-4526-4d03-bd51-6be899066dd9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:40.957907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d6a771f-4526-4d03-bd51-6be899066dd9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:40.964463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d6a771f-4526-4d03-bd51-6be899066dd9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:40.965190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d6a771f-4526-4d03-bd51-6be899066dd9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.226322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4d6a771f-4526-4d03-bd51-6be899066dd9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:41.244176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-50d5f972-4953-4c16-929f-95821ffc1649 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:41.244778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-50d5f972-4953-4c16-929f-95821ffc1649 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:41.247079 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4d6a771f-4526-4d03-bd51-6be899066dd9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.307099 Aug 29 15:40:41.250881 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1950/3836] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:40 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:41.261592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d5f972-4953-4c16-929f-95821ffc1649 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.261592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d5f972-4953-4c16-929f-95821ffc1649 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.261592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d5f972-4953-4c16-929f-95821ffc1649 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.261592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d5f972-4953-4c16-929f-95821ffc1649 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.261592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d5f972-4953-4c16-929f-95821ffc1649 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.261592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d5f972-4953-4c16-929f-95821ffc1649 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.494607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-50d5f972-4953-4c16-929f-95821ffc1649 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5cf3f21f5c402b87099b7dccc24d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65be3b9dae94862b36f8b47bcf427a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:41.503567 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-50d5f972-4953-4c16-929f-95821ffc1649 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 200 len: 1331 microversion: 2.1 time: 0.263943 Aug 29 15:40:41.504163 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1887/3837] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:41 2022] GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 1331 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:41.666534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-16ef8609-59bc-4c48-b40d-cddc469c55ba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:41.667489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-16ef8609-59bc-4c48-b40d-cddc469c55ba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:41.675315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ef8609-59bc-4c48-b40d-cddc469c55ba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.676126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ef8609-59bc-4c48-b40d-cddc469c55ba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.676691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ef8609-59bc-4c48-b40d-cddc469c55ba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.677499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ef8609-59bc-4c48-b40d-cddc469c55ba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.677893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ef8609-59bc-4c48-b40d-cddc469c55ba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.678316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ef8609-59bc-4c48-b40d-cddc469c55ba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.730840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-9e84e52e-fb35-4f13-b45b-0fa58f5a0992 req-bf48b0b4-3c55-4592-9f04-0e8a8b45d7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bacda764-ffc5-41ff-8e06-a0ba54ecb7f7", "name": "network-vif-deleted", "tag": "a1374456-8083-4382-afb5-5b3e041c88f9"}, {"server_uuid": "bacda764-ffc5-41ff-8e06-a0ba54ecb7f7", "name": "network-vif-deleted", "tag": "58c11c54-9149-4ae2-9080-87e597e5bed4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:41.746268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:41.762811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:41.764867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9e84e52e-fb35-4f13-b45b-0fa58f5a0992 req-bf48b0b4-3c55-4592-9f04-0e8a8b45d7a5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.765475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9e84e52e-fb35-4f13-b45b-0fa58f5a0992 req-bf48b0b4-3c55-4592-9f04-0e8a8b45d7a5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.765805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9e84e52e-fb35-4f13-b45b-0fa58f5a0992 req-bf48b0b4-3c55-4592-9f04-0e8a8b45d7a5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.779133 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-9e84e52e-fb35-4f13-b45b-0fa58f5a0992 req-bf48b0b4-3c55-4592-9f04-0e8a8b45d7a5 service nova] Creating event network-vif-deleted:a1374456-8083-4382-afb5-5b3e041c88f9 for instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 on n-h2-839401-11 Aug 29 15:40:41.779671 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-9e84e52e-fb35-4f13-b45b-0fa58f5a0992 req-bf48b0b4-3c55-4592-9f04-0e8a8b45d7a5 service nova] Creating event network-vif-deleted:58c11c54-9149-4ae2-9080-87e597e5bed4 for instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 on n-h2-839401-11 Aug 29 15:40:41.785410 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-9e84e52e-fb35-4f13-b45b-0fa58f5a0992 req-bf48b0b4-3c55-4592-9f04-0e8a8b45d7a5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.058728 Aug 29 15:40:41.786712 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1888/3838] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:40:41.797543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-25a8f0a1-3436-4cd8-81a4-865ffc07afd3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:41.798345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-25a8f0a1-3436-4cd8-81a4-865ffc07afd3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:41.809639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-16ef8609-59bc-4c48-b40d-cddc469c55ba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:41.817661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25a8f0a1-3436-4cd8-81a4-865ffc07afd3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.818197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25a8f0a1-3436-4cd8-81a4-865ffc07afd3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.820208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25a8f0a1-3436-4cd8-81a4-865ffc07afd3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.820981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25a8f0a1-3436-4cd8-81a4-865ffc07afd3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.821674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25a8f0a1-3436-4cd8-81a4-865ffc07afd3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.821983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25a8f0a1-3436-4cd8-81a4-865ffc07afd3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.823860 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-16ef8609-59bc-4c48-b40d-cddc469c55ba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1568 microversion: 2.1 time: 0.162637 Aug 29 15:40:41.824575 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1951/3839] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:41 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:41.989992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-25a8f0a1-3436-4cd8-81a4-865ffc07afd3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:41.999654 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-25a8f0a1-3436-4cd8-81a4-865ffc07afd3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.211333 Aug 29 15:40:42.009784 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1889/3840] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:41 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:42.271861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2947ffd6-fff2-4434-93be-0888173892ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:42.272500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2947ffd6-fff2-4434-93be-0888173892ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:42.280040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2947ffd6-fff2-4434-93be-0888173892ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:42.280270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2947ffd6-fff2-4434-93be-0888173892ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:42.280683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2947ffd6-fff2-4434-93be-0888173892ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:42.282561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2947ffd6-fff2-4434-93be-0888173892ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:42.283307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2947ffd6-fff2-4434-93be-0888173892ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:42.283453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2947ffd6-fff2-4434-93be-0888173892ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:42.341601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:42.463587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2947ffd6-fff2-4434-93be-0888173892ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:42.477458 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2947ffd6-fff2-4434-93be-0888173892ca tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.208819 Aug 29 15:40:42.486779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-8d223261-1ac1-4371-bed5-bdbca3843a04 req-d97396f9-830a-43da-a397-f889dcd9f654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec852709-4ddc-42d0-94da-88df26e5e524", "name": "network-vif-plugged", "status": "completed", "tag": "1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:42.492722 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1952/3841] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:42 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:42.499776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8d223261-1ac1-4371-bed5-bdbca3843a04 req-d97396f9-830a-43da-a397-f889dcd9f654 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:42.500433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8d223261-1ac1-4371-bed5-bdbca3843a04 req-d97396f9-830a-43da-a397-f889dcd9f654 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:42.500651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8d223261-1ac1-4371-bed5-bdbca3843a04 req-d97396f9-830a-43da-a397-f889dcd9f654 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:42.523673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b0326e1-bf26-4f63-a2db-8251f3bd191c tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:42.524291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6b0326e1-bf26-4f63-a2db-8251f3bd191c tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:42.529122 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-8d223261-1ac1-4371-bed5-bdbca3843a04 req-d97396f9-830a-43da-a397-f889dcd9f654 service nova] Creating event network-vif-plugged:1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf for instance ec852709-4ddc-42d0-94da-88df26e5e524 on n-h1-839401-11 Aug 29 15:40:42.540618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b0326e1-bf26-4f63-a2db-8251f3bd191c tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:42.544164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b0326e1-bf26-4f63-a2db-8251f3bd191c tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:42.544286 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-8d223261-1ac1-4371-bed5-bdbca3843a04 req-d97396f9-830a-43da-a397-f889dcd9f654 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059489 Aug 29 15:40:42.544286 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1890/3842] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:40:42.544553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b0326e1-bf26-4f63-a2db-8251f3bd191c tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:42.546015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b0326e1-bf26-4f63-a2db-8251f3bd191c tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:42.546653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b0326e1-bf26-4f63-a2db-8251f3bd191c tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:42.547104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b0326e1-bf26-4f63-a2db-8251f3bd191c tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:42.772568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b0326e1-bf26-4f63-a2db-8251f3bd191c tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5cf3f21f5c402b87099b7dccc24d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65be3b9dae94862b36f8b47bcf427a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:42.792315 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6b0326e1-bf26-4f63-a2db-8251f3bd191c tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 200 len: 1331 microversion: 2.1 time: 0.269403 Aug 29 15:40:42.792944 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1953/3843] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:42 2022] GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 1331 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:42.847073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cead0470-7042-4906-8001-8ec122acc06c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:42.848931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cead0470-7042-4906-8001-8ec122acc06c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:42.863979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cead0470-7042-4906-8001-8ec122acc06c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:42.864605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cead0470-7042-4906-8001-8ec122acc06c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:42.865126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cead0470-7042-4906-8001-8ec122acc06c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:42.865984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cead0470-7042-4906-8001-8ec122acc06c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:42.866580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cead0470-7042-4906-8001-8ec122acc06c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:42.877984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cead0470-7042-4906-8001-8ec122acc06c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:42.990279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cead0470-7042-4906-8001-8ec122acc06c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:43.001699 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cead0470-7042-4906-8001-8ec122acc06c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 200 len: 1568 microversion: 2.1 time: 0.159491 Aug 29 15:40:43.016396 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1891/3844] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:42 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:43.027323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aceab52c-f2d1-4cf4-bcb4-211f41837efb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:43.028229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aceab52c-f2d1-4cf4-bcb4-211f41837efb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:43.038789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aceab52c-f2d1-4cf4-bcb4-211f41837efb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.039294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aceab52c-f2d1-4cf4-bcb4-211f41837efb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.039738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aceab52c-f2d1-4cf4-bcb4-211f41837efb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.050644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aceab52c-f2d1-4cf4-bcb4-211f41837efb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.051419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aceab52c-f2d1-4cf4-bcb4-211f41837efb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.052303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aceab52c-f2d1-4cf4-bcb4-211f41837efb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.313060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aceab52c-f2d1-4cf4-bcb4-211f41837efb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:43.323591 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aceab52c-f2d1-4cf4-bcb4-211f41837efb tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1473 microversion: 2.1 time: 0.303037 Aug 29 15:40:43.324356 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1954/3845] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:43 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1473 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:43.499767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0f708296-345c-4da5-97e3-a1ae8b1593db tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:43.500553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0f708296-345c-4da5-97e3-a1ae8b1593db tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:43.518817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f708296-345c-4da5-97e3-a1ae8b1593db tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.520768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f708296-345c-4da5-97e3-a1ae8b1593db tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.521528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f708296-345c-4da5-97e3-a1ae8b1593db tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.523287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f708296-345c-4da5-97e3-a1ae8b1593db tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.524532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f708296-345c-4da5-97e3-a1ae8b1593db tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.525064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f708296-345c-4da5-97e3-a1ae8b1593db tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.749069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0f708296-345c-4da5-97e3-a1ae8b1593db tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:43.759198 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0f708296-345c-4da5-97e3-a1ae8b1593db tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.263610 Aug 29 15:40:43.771010 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1892/3846] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:43 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:43.817016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-12818768-c098-4068-a6ed-5521df5ec487 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:43.819407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-12818768-c098-4068-a6ed-5521df5ec487 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:43.826491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12818768-c098-4068-a6ed-5521df5ec487 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.827149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12818768-c098-4068-a6ed-5521df5ec487 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.827600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12818768-c098-4068-a6ed-5521df5ec487 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.828416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12818768-c098-4068-a6ed-5521df5ec487 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.828971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12818768-c098-4068-a6ed-5521df5ec487 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.829482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12818768-c098-4068-a6ed-5521df5ec487 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.026601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c8ec18cb-51ed-447f-91e0-3f71428b11a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:44.027228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c8ec18cb-51ed-447f-91e0-3f71428b11a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:44.039539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8ec18cb-51ed-447f-91e0-3f71428b11a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.040200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8ec18cb-51ed-447f-91e0-3f71428b11a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.040881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8ec18cb-51ed-447f-91e0-3f71428b11a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.041742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8ec18cb-51ed-447f-91e0-3f71428b11a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.042273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8ec18cb-51ed-447f-91e0-3f71428b11a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.043971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8ec18cb-51ed-447f-91e0-3f71428b11a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.044197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-12818768-c098-4068-a6ed-5521df5ec487 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5cf3f21f5c402b87099b7dccc24d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65be3b9dae94862b36f8b47bcf427a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:44.052490 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-12818768-c098-4068-a6ed-5521df5ec487 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 200 len: 1331 microversion: 2.1 time: 0.239288 Aug 29 15:40:44.053114 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1955/3847] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:43 2022] GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 1331 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:44.065111 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-c8ec18cb-51ed-447f-91e0-3f71428b11a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] HTTP exception thrown: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c8ec18cb-51ed-447f-91e0-3f71428b11a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Request method failure captured: Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 HTTP/1.1 Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN3FWFArgEBvPjlu2qITakZqoYFOGzaI60wQkIknvEYxgjSag1wqLTwhRsJcuBpHHuL2RR4wAz0Ioln31yTVJs0wyn--sQKLJyd94zVFocEp0EnGsBc-mNEBiImYVtePhjxNLBEgOu1quPa1i_GBaB4KTiqBbKL2Tse1Tkf6SCxifRE Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: cde693c11d6d4af0ba9f31249e778e8b Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersTestMultiNic-295713640 Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cde693c11d6d4af0ba9f31249e778e8b", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cde693c11d6d4af0ba9f31249e778e8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cde693c11d6d4af0ba9f31249e778e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cde693c11d6d4af0ba9f31249e778e8b"}]}] Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersTestMultiNic-295713640 Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: cde693c11d6d4af0ba9f31249e778e8b Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersTestMultiNic-295713640 Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersTestMultiNic-295713640-project Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 5e450275cc2d49968f2cb7559109fb66 Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersTestMultiNic-295713640-project Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'bacda764-ffc5-41ff-8e06-a0ba54ecb7f7'} Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:44.066855 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:44.072137 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:44.072137 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:44.072137 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:44.072137 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:44.072137 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:44.072137 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. Aug 29 15:40:44.072137 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:44.072137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c8ec18cb-51ed-447f-91e0-3f71428b11a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Returning 404 to user: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:44.072137 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c8ec18cb-51ed-447f-91e0-3f71428b11a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 404 len: 111 microversion: 2.1 time: 0.046073 Aug 29 15:40:44.074140 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1893/3848] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:44 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:44.346860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2cfe1b5a-4c08-4954-8088-924b2f7553cd tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:44.347524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2cfe1b5a-4c08-4954-8088-924b2f7553cd tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:44.355880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cfe1b5a-4c08-4954-8088-924b2f7553cd tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.356411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cfe1b5a-4c08-4954-8088-924b2f7553cd tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.356840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cfe1b5a-4c08-4954-8088-924b2f7553cd tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.357601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cfe1b5a-4c08-4954-8088-924b2f7553cd tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.358202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cfe1b5a-4c08-4954-8088-924b2f7553cd tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.358587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cfe1b5a-4c08-4954-8088-924b2f7553cd tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.529636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2cfe1b5a-4c08-4954-8088-924b2f7553cd tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:44.541761 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2cfe1b5a-4c08-4954-8088-924b2f7553cd tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1479 microversion: 2.1 time: 0.200664 Aug 29 15:40:44.542401 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1956/3849] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:44 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1479 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:44.782833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-93f4cbce-9d11-407f-a8a5-3501d2480b30 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:44.783615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-93f4cbce-9d11-407f-a8a5-3501d2480b30 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:44.793570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93f4cbce-9d11-407f-a8a5-3501d2480b30 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.794167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93f4cbce-9d11-407f-a8a5-3501d2480b30 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.794709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93f4cbce-9d11-407f-a8a5-3501d2480b30 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.795659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93f4cbce-9d11-407f-a8a5-3501d2480b30 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.796259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93f4cbce-9d11-407f-a8a5-3501d2480b30 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.796840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93f4cbce-9d11-407f-a8a5-3501d2480b30 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:45.075691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6d05d504-f9de-4550-ae86-9323838fc457 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:45.076866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6d05d504-f9de-4550-ae86-9323838fc457 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:45.090157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d05d504-f9de-4550-ae86-9323838fc457 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:45.092475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d05d504-f9de-4550-ae86-9323838fc457 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:45.094085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d05d504-f9de-4550-ae86-9323838fc457 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:45.095751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d05d504-f9de-4550-ae86-9323838fc457 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:45.097582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d05d504-f9de-4550-ae86-9323838fc457 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:45.098043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d05d504-f9de-4550-ae86-9323838fc457 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:45.356663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6d05d504-f9de-4550-ae86-9323838fc457 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5cf3f21f5c402b87099b7dccc24d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65be3b9dae94862b36f8b47bcf427a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:45.366543 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6d05d504-f9de-4550-ae86-9323838fc457 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 200 len: 1536 microversion: 2.1 time: 0.295866 Aug 29 15:40:45.367873 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1957/3850] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:45 2022] GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 1536 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:45.397461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e9f68d06-ac03-478b-ba73-855baa88c016 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Action: 'create', calling method: .version_select at 0x7fc433c1a040>, body: {"pool": "29a1b9f9-a46a-46a0-85cc-fb255d980b29"} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:45.464421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-93f4cbce-9d11-407f-a8a5-3501d2480b30 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:45.473898 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-93f4cbce-9d11-407f-a8a5-3501d2480b30 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.696893 Aug 29 15:40:45.474790 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1894/3851] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:44 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:45.568605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-46a31227-d9c3-487e-8b2f-bb2fe079063a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:45.569399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-46a31227-d9c3-487e-8b2f-bb2fe079063a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:45.578799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46a31227-d9c3-487e-8b2f-bb2fe079063a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:45.579305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46a31227-d9c3-487e-8b2f-bb2fe079063a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:45.579747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46a31227-d9c3-487e-8b2f-bb2fe079063a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:45.580660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46a31227-d9c3-487e-8b2f-bb2fe079063a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:45.581149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46a31227-d9c3-487e-8b2f-bb2fe079063a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:45.581586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46a31227-d9c3-487e-8b2f-bb2fe079063a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:46.020023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-46a31227-d9c3-487e-8b2f-bb2fe079063a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:46.032774 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-46a31227-d9c3-487e-8b2f-bb2fe079063a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1479 microversion: 2.1 time: 0.472634 Aug 29 15:40:46.033774 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1895/3852] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:45 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1479 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:46.513636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2d6bbd8f-0292-4dae-964f-3f7627c6c6f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:46.515852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2d6bbd8f-0292-4dae-964f-3f7627c6c6f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:46.531465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d6bbd8f-0292-4dae-964f-3f7627c6c6f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:46.532045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d6bbd8f-0292-4dae-964f-3f7627c6c6f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:46.532606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d6bbd8f-0292-4dae-964f-3f7627c6c6f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:46.537396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d6bbd8f-0292-4dae-964f-3f7627c6c6f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:46.537898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d6bbd8f-0292-4dae-964f-3f7627c6c6f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:46.538349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d6bbd8f-0292-4dae-964f-3f7627c6c6f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.016330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2d6bbd8f-0292-4dae-964f-3f7627c6c6f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:47.028131 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2d6bbd8f-0292-4dae-964f-3f7627c6c6f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.530411 Aug 29 15:40:47.028744 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1896/3853] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:46 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:47.054432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d4d570ef-c7ec-4941-931f-b1aef4f3e032 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:47.055143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d4d570ef-c7ec-4941-931f-b1aef4f3e032 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:47.068030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4d570ef-c7ec-4941-931f-b1aef4f3e032 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.068802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4d570ef-c7ec-4941-931f-b1aef4f3e032 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.069460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4d570ef-c7ec-4941-931f-b1aef4f3e032 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.070376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4d570ef-c7ec-4941-931f-b1aef4f3e032 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.071081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4d570ef-c7ec-4941-931f-b1aef4f3e032 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.071806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4d570ef-c7ec-4941-931f-b1aef4f3e032 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.495176 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e9f68d06-ac03-478b-ba73-855baa88c016 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.104339 Aug 29 15:40:47.496745 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1958/3854] 10.222.0.62 () {60 vars in 1170 bytes} [Mon Aug 29 15:40:45 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:47.503295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-35064c65-ac48-4f9c-863c-67e4c228ac4f req-d8bfb955-8a6e-4fbb-98ba-1a47fece9c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1199ee4-c322-4c37-a53e-1bf029c7f14c", "name": "network-vif-unplugged", "status": "completed", "tag": "b9c1844c-f849-40a4-b1f6-8dffc854044e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:47.514542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-35064c65-ac48-4f9c-863c-67e4c228ac4f req-d8bfb955-8a6e-4fbb-98ba-1a47fece9c84 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.515117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-35064c65-ac48-4f9c-863c-67e4c228ac4f req-d8bfb955-8a6e-4fbb-98ba-1a47fece9c84 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.515614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-35064c65-ac48-4f9c-863c-67e4c228ac4f req-d8bfb955-8a6e-4fbb-98ba-1a47fece9c84 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.527356 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-35064c65-ac48-4f9c-863c-67e4c228ac4f req-d8bfb955-8a6e-4fbb-98ba-1a47fece9c84 service nova] Creating event network-vif-unplugged:b9c1844c-f849-40a4-b1f6-8dffc854044e for instance b1199ee4-c322-4c37-a53e-1bf029c7f14c on n-h2-839401-11 Aug 29 15:40:47.527932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d4d570ef-c7ec-4941-931f-b1aef4f3e032 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:47.532998 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-35064c65-ac48-4f9c-863c-67e4c228ac4f req-d8bfb955-8a6e-4fbb-98ba-1a47fece9c84 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034179 Aug 29 15:40:47.533999 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1959/3855] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:47.540047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f2934aae-ebab-4ed1-9634-e25a83de5a31 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.11"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:47.541948 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d4d570ef-c7ec-4941-931f-b1aef4f3e032 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1479 microversion: 2.1 time: 0.491582 Aug 29 15:40:47.542545 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1897/3856] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:47 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1479 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:47.543124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f2934aae-ebab-4ed1-9634-e25a83de5a31 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:47.550983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2934aae-ebab-4ed1-9634-e25a83de5a31 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.551567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2934aae-ebab-4ed1-9634-e25a83de5a31 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.552142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2934aae-ebab-4ed1-9634-e25a83de5a31 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.552960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2934aae-ebab-4ed1-9634-e25a83de5a31 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.554036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2934aae-ebab-4ed1-9634-e25a83de5a31 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.554571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2934aae-ebab-4ed1-9634-e25a83de5a31 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.580701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2934aae-ebab-4ed1-9634-e25a83de5a31 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "refresh_cache-ec852709-4ddc-42d0-94da-88df26e5e524" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:40:47.581231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2934aae-ebab-4ed1-9634-e25a83de5a31 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquired lock "refresh_cache-ec852709-4ddc-42d0-94da-88df26e5e524" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:40:48.060401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fc464e11-962b-4182-9c71-b8065de32df0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:48.062070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fc464e11-962b-4182-9c71-b8065de32df0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:48.073023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc464e11-962b-4182-9c71-b8065de32df0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.074292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc464e11-962b-4182-9c71-b8065de32df0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.074990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc464e11-962b-4182-9c71-b8065de32df0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.076235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc464e11-962b-4182-9c71-b8065de32df0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.076955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc464e11-962b-4182-9c71-b8065de32df0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.077815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc464e11-962b-4182-9c71-b8065de32df0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.248185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fc464e11-962b-4182-9c71-b8065de32df0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:48.258415 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fc464e11-962b-4182-9c71-b8065de32df0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.207264 Aug 29 15:40:48.259249 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1898/3857] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:48 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:48.571650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1e18f48b-b5db-46ef-9d8d-2142cea1599e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:48.573899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1e18f48b-b5db-46ef-9d8d-2142cea1599e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:48.591705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e18f48b-b5db-46ef-9d8d-2142cea1599e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.593219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e18f48b-b5db-46ef-9d8d-2142cea1599e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.594100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e18f48b-b5db-46ef-9d8d-2142cea1599e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.595378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e18f48b-b5db-46ef-9d8d-2142cea1599e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.596074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e18f48b-b5db-46ef-9d8d-2142cea1599e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.596729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e18f48b-b5db-46ef-9d8d-2142cea1599e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.906082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1e18f48b-b5db-46ef-9d8d-2142cea1599e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:48.919166 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1e18f48b-b5db-46ef-9d8d-2142cea1599e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1479 microversion: 2.1 time: 0.355012 Aug 29 15:40:48.921353 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1899/3858] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:48 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1479 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:49.204001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-f2934aae-ebab-4ed1-9634-e25a83de5a31 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Building network info cache for instance {{(pid=122360) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:40:49.216698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-ab864ad1-4585-45d6-9371-d67de90c224b req-37896000-b6e2-43ae-93a7-e29c3b9ba91c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec852709-4ddc-42d0-94da-88df26e5e524", "tag": "1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:49.246331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ab864ad1-4585-45d6-9371-d67de90c224b req-37896000-b6e2-43ae-93a7-e29c3b9ba91c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:49.248094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ab864ad1-4585-45d6-9371-d67de90c224b req-37896000-b6e2-43ae-93a7-e29c3b9ba91c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:49.250130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ab864ad1-4585-45d6-9371-d67de90c224b req-37896000-b6e2-43ae-93a7-e29c3b9ba91c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:49.286587 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-ab864ad1-4585-45d6-9371-d67de90c224b req-37896000-b6e2-43ae-93a7-e29c3b9ba91c service nova] Creating event network-changed:1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf for instance ec852709-4ddc-42d0-94da-88df26e5e524 on n-h1-839401-11 Aug 29 15:40:49.295829 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-ab864ad1-4585-45d6-9371-d67de90c224b req-37896000-b6e2-43ae-93a7-e29c3b9ba91c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083967 Aug 29 15:40:49.297365 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1900/3859] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:40:49.308684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-85313371-dea3-4d83-807d-37b3af90b9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:49.310106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-85313371-dea3-4d83-807d-37b3af90b9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:49.318462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85313371-dea3-4d83-807d-37b3af90b9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:49.319297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85313371-dea3-4d83-807d-37b3af90b9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:49.320004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85313371-dea3-4d83-807d-37b3af90b9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:49.321020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85313371-dea3-4d83-807d-37b3af90b9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:49.321766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85313371-dea3-4d83-807d-37b3af90b9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:49.322484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85313371-dea3-4d83-807d-37b3af90b9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:49.870313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-85313371-dea3-4d83-807d-37b3af90b9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:49.874129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:49.878999 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-85313371-dea3-4d83-807d-37b3af90b9be tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.579576 Aug 29 15:40:49.879674 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1901/3860] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:49 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:49.946686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8f930be9-c18f-4e6a-89b7-763fae473661 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:49.947661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8f930be9-c18f-4e6a-89b7-763fae473661 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:49.956937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f930be9-c18f-4e6a-89b7-763fae473661 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:49.961407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f930be9-c18f-4e6a-89b7-763fae473661 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:49.962203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f930be9-c18f-4e6a-89b7-763fae473661 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:49.963166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f930be9-c18f-4e6a-89b7-763fae473661 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:49.963838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f930be9-c18f-4e6a-89b7-763fae473661 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:49.964474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f930be9-c18f-4e6a-89b7-763fae473661 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:50.498678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-f2934aae-ebab-4ed1-9634-e25a83de5a31 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Updating instance_info_cache with network_info: [{"id": "1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf", "address": "fa:16:3e:c5:44:ec", "network": {"id": "128669ab-992c-4559-a7aa-5dfa8ba3fc41", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-2046555952-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e65be3b9dae94862b36f8b47bcf427a9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1be5f20b-1d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122360) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:40:50.514848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2934aae-ebab-4ed1-9634-e25a83de5a31 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Releasing lock "refresh_cache-ec852709-4ddc-42d0-94da-88df26e5e524" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:40:50.516093 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f2934aae-ebab-4ed1-9634-e25a83de5a31 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "POST /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524/action" status: 202 len: 0 microversion: 2.1 time: 2.980901 Aug 29 15:40:50.518385 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1960/3861] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:47 2022] POST /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524/action => generated 0 bytes in 2984 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:40:50.527954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-29fe34a3-2395-4bbb-8d1f-1bdd3ba0cd8e tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Action: 'create', calling method: .version_select at 0x7fc4300863a0>, body: {"pool": "29a1b9f9-a46a-46a0-85cc-fb255d980b29"} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:50.953051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8f930be9-c18f-4e6a-89b7-763fae473661 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:50.962928 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8f930be9-c18f-4e6a-89b7-763fae473661 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1479 microversion: 2.1 time: 1.020678 Aug 29 15:40:50.963525 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1902/3862] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:49 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1479 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:50.980473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-76d6ec89-b2d7-438b-9dce-041139e5bfc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:50.981526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-76d6ec89-b2d7-438b-9dce-041139e5bfc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:50.983641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:50.993042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76d6ec89-b2d7-438b-9dce-041139e5bfc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:50.997174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76d6ec89-b2d7-438b-9dce-041139e5bfc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:50.997956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76d6ec89-b2d7-438b-9dce-041139e5bfc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:51.001758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76d6ec89-b2d7-438b-9dce-041139e5bfc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:51.004329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76d6ec89-b2d7-438b-9dce-041139e5bfc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:51.005906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76d6ec89-b2d7-438b-9dce-041139e5bfc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:51.371753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-76d6ec89-b2d7-438b-9dce-041139e5bfc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:51.388357 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-76d6ec89-b2d7-438b-9dce-041139e5bfc5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.421777 Aug 29 15:40:51.401703 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1903/3863] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:50 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:51.808604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1993169826", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "a0c8894b-8434-4f1a-987e-87c6b9116a2b"}, {"uuid": "4c078daa-c342-4cd9-91ea-809840a451e0"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:51.914357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] validate_networks() for [('a0c8894b-8434-4f1a-987e-87c6b9116a2b', None, None, None, None, None), ('4c078daa-c342-4cd9-91ea-809840a451e0', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:40:53.145843 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-29fe34a3-2395-4bbb-8d1f-1bdd3ba0cd8e tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.622549 Aug 29 15:40:53.146871 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1961/3864] 10.222.0.62 () {60 vars in 1170 bytes} [Mon Aug 29 15:40:50 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:53.151769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e15e15e5-960e-44e8-b839-1f420a282f33 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:53.152401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e15e15e5-960e-44e8-b839-1f420a282f33 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:53.165595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e15e15e5-960e-44e8-b839-1f420a282f33 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.166234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e15e15e5-960e-44e8-b839-1f420a282f33 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.166510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e15e15e5-960e-44e8-b839-1f420a282f33 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.167258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e15e15e5-960e-44e8-b839-1f420a282f33 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.167737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e15e15e5-960e-44e8-b839-1f420a282f33 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.168171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e15e15e5-960e-44e8-b839-1f420a282f33 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.219225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:40:53.220229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:40:53.220883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:40:53.221486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:40:53.222090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:40:53.254323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.254850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.261458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.266738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.267246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.269580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.297534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Getting quotas for project cde693c11d6d4af0ba9f31249e778e8b. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:40:53.307571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Getting quotas for user 5e450275cc2d49968f2cb7559109fb66 and project cde693c11d6d4af0ba9f31249e778e8b. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:40:53.333127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:40:53.335830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:40:53.418898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e15e15e5-960e-44e8-b839-1f420a282f33 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:53.431819 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e15e15e5-960e-44e8-b839-1f420a282f33 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1479 microversion: 2.1 time: 0.283771 Aug 29 15:40:53.435112 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-805aceb4-a750-48c5-8470-f68284751d9f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.628756 Aug 29 15:40:53.435755 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1962/3865] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:53 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1479 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:53.438064 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1904/3866] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:40:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:40:53.442148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c3b8262b-ebaf-4692-b367-92afa3e1cc2d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:53.442764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c3b8262b-ebaf-4692-b367-92afa3e1cc2d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:53.447684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4ce6f591-0fb9-4bf8-bed0-ead735a25f08 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.4"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:53.449610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3b8262b-ebaf-4692-b367-92afa3e1cc2d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.450466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3b8262b-ebaf-4692-b367-92afa3e1cc2d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.451087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3b8262b-ebaf-4692-b367-92afa3e1cc2d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.452150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3b8262b-ebaf-4692-b367-92afa3e1cc2d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.452783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3b8262b-ebaf-4692-b367-92afa3e1cc2d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.453885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3b8262b-ebaf-4692-b367-92afa3e1cc2d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.457990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4ce6f591-0fb9-4bf8-bed0-ead735a25f08 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:53.467800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ce6f591-0fb9-4bf8-bed0-ead735a25f08 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.468391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ce6f591-0fb9-4bf8-bed0-ead735a25f08 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.469243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ce6f591-0fb9-4bf8-bed0-ead735a25f08 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.470456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ce6f591-0fb9-4bf8-bed0-ead735a25f08 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.471266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ce6f591-0fb9-4bf8-bed0-ead735a25f08 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.471865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ce6f591-0fb9-4bf8-bed0-ead735a25f08 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.509533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ce6f591-0fb9-4bf8-bed0-ead735a25f08 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "refresh_cache-ec852709-4ddc-42d0-94da-88df26e5e524" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:40:53.510704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ce6f591-0fb9-4bf8-bed0-ead735a25f08 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquired lock "refresh_cache-ec852709-4ddc-42d0-94da-88df26e5e524" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:40:53.738323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c3b8262b-ebaf-4692-b367-92afa3e1cc2d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:53.753604 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c3b8262b-ebaf-4692-b367-92afa3e1cc2d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1656 microversion: 2.1 time: 0.315320 Aug 29 15:40:53.755181 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1963/3867] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:53 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1656 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:53.783377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-21ad8f28-76d3-4bc9-a1d0-779645f744da tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:53.784011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-21ad8f28-76d3-4bc9-a1d0-779645f744da tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:53.812414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=92 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:53.932303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-21ad8f28-76d3-4bc9-a1d0-779645f744da tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:53.942162 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-21ad8f28-76d3-4bc9-a1d0-779645f744da tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1213 microversion: 2.1 time: 0.170131 Aug 29 15:40:53.955267 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1964/3868] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:53 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1213 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:53.960720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f24d055d-6c83-4fd6-885d-8733d54385db tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:53.972169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f24d055d-6c83-4fd6-885d-8733d54385db tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.980594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f24d055d-6c83-4fd6-885d-8733d54385db tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.981351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f24d055d-6c83-4fd6-885d-8733d54385db tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.010687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f24d055d-6c83-4fd6-885d-8733d54385db tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Going to try to start instance {{(pid=122360) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 15:40:54.038225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:54.080018 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f24d055d-6c83-4fd6-885d-8733d54385db tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 202 len: 0 microversion: 2.1 time: 0.121291 Aug 29 15:40:54.083928 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1965/3869] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:53 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:54.114571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a6960b2a-3e3f-4e3d-8b36-c8a16e0eef2e req-04240f81-93e2-45b1-8d9b-d2c8a3755b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1199ee4-c322-4c37-a53e-1bf029c7f14c", "name": "network-vif-plugged", "status": "completed", "tag": "b9c1844c-f849-40a4-b1f6-8dffc854044e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:54.142274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a6960b2a-3e3f-4e3d-8b36-c8a16e0eef2e req-04240f81-93e2-45b1-8d9b-d2c8a3755b6c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.143823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a6960b2a-3e3f-4e3d-8b36-c8a16e0eef2e req-04240f81-93e2-45b1-8d9b-d2c8a3755b6c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.144508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a6960b2a-3e3f-4e3d-8b36-c8a16e0eef2e req-04240f81-93e2-45b1-8d9b-d2c8a3755b6c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.165433 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a6960b2a-3e3f-4e3d-8b36-c8a16e0eef2e req-04240f81-93e2-45b1-8d9b-d2c8a3755b6c service nova] Creating event network-vif-plugged:b9c1844c-f849-40a4-b1f6-8dffc854044e for instance b1199ee4-c322-4c37-a53e-1bf029c7f14c on n-h2-839401-11 Aug 29 15:40:54.183285 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a6960b2a-3e3f-4e3d-8b36-c8a16e0eef2e req-04240f81-93e2-45b1-8d9b-d2c8a3755b6c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096277 Aug 29 15:40:54.184538 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1966/3870] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:54.191717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-32463156-2e0c-4051-b510-9965a4cbd58d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:54.195070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-32463156-2e0c-4051-b510-9965a4cbd58d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:54.204307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32463156-2e0c-4051-b510-9965a4cbd58d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.206299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32463156-2e0c-4051-b510-9965a4cbd58d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.207016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32463156-2e0c-4051-b510-9965a4cbd58d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.208394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32463156-2e0c-4051-b510-9965a4cbd58d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.211743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32463156-2e0c-4051-b510-9965a4cbd58d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.213335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32463156-2e0c-4051-b510-9965a4cbd58d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.488754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-32463156-2e0c-4051-b510-9965a4cbd58d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:54.507089 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-32463156-2e0c-4051-b510-9965a4cbd58d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1665 microversion: 2.1 time: 0.317995 Aug 29 15:40:54.510499 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1967/3871] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:54 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1665 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:54.530082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2e0e38d9-9b22-4c6f-8452-cc171292eda7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:54.532706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2e0e38d9-9b22-4c6f-8452-cc171292eda7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:54.556296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e0e38d9-9b22-4c6f-8452-cc171292eda7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.559793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e0e38d9-9b22-4c6f-8452-cc171292eda7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.569864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e0e38d9-9b22-4c6f-8452-cc171292eda7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.571006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e0e38d9-9b22-4c6f-8452-cc171292eda7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.571539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e0e38d9-9b22-4c6f-8452-cc171292eda7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.571979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e0e38d9-9b22-4c6f-8452-cc171292eda7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.809554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2e0e38d9-9b22-4c6f-8452-cc171292eda7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:54.818598 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2e0e38d9-9b22-4c6f-8452-cc171292eda7 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1479 microversion: 2.1 time: 0.304240 Aug 29 15:40:54.819379 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1968/3872] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:54 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1479 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:54.902380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG neutronclient.v2_0.client [None req-4ce6f591-0fb9-4bf8-bed0-ead735a25f08 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.4 (775a4727-c8fe-4230-a6d4-6e55c279b2a8) with port 1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 29a1b9f9-a46a-46a0-85cc-fb255d980b29.", "detail": ""}} {{(pid=122361) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:40:54.903167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ce6f591-0fb9-4bf8-bed0-ead735a25f08 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Releasing lock "refresh_cache-ec852709-4ddc-42d0-94da-88df26e5e524" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:40:54.903896 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-4ce6f591-0fb9-4bf8-bed0-ead735a25f08 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.4 (775a4727-c8fe-4230-a6d4-6e55c279b2a8) with port 1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 29a1b9f9-a46a-46a0-85cc-fb255d980b29. Aug 29 15:40:54.903896 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-30aa41d0-d93d-4ce2-9428-770d0e2bfcb1'] Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4ce6f591-0fb9-4bf8-bed0-ead735a25f08 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Request method failure captured: Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524/action HTTP/1.1 Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 44 Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN3uVA0dAB0R7z39dpULTYP4DKXMvY7a2LFfUUazNtlfXhDRDEqmoAVa6QyYbsJ5kLF2PevffX89ieePWXZzduTNFlDgcMFDpxposXi0Smn1tFZuMNV7YVRcmfb6-fav6EIttMYO3HD1gHaEc9A-JD57cwMnfouQLV48t-2YYbQNx-g Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: e65be3b9dae94862b36f8b47bcf427a9 Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-548794726 Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e65be3b9dae94862b36f8b47bcf427a9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e65be3b9dae94862b36f8b47bcf427a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e65be3b9dae94862b36f8b47bcf427a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e65be3b9dae94862b36f8b47bcf427a9"}]}] Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-548794726 Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: e65be3b9dae94862b36f8b47bcf427a9 Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-548794726 Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6d5cf3f21f5c402b87099b7dccc24d35 Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: {"addFloatingIp": {"address": "172.25.2.4"}} Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: exception: Cannot associate floating IP 172.25.2.4 (775a4727-c8fe-4230-a6d4-6e55c279b2a8) with port 1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 29a1b9f9-a46a-46a0-85cc-fb255d980b29. Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-30aa41d0-d93d-4ce2-9428-770d0e2bfcb1'] Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'ec852709-4ddc-42d0-94da-88df26e5e524', 'body': {'addFloatingIp': {'address': '172.25.2.4'}}} Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:40:54.907839 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.4 (775a4727-c8fe-4230-a6d4-6e55c279b2a8) with port 1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 29a1b9f9-a46a-46a0-85cc-fb255d980b29. Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30aa41d0-d93d-4ce2-9428-770d0e2bfcb1'] Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.4 (775a4727-c8fe-4230-a6d4-6e55c279b2a8) with port 1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 29a1b9f9-a46a-46a0-85cc-fb255d980b29. Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30aa41d0-d93d-4ce2-9428-770d0e2bfcb1'] Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.4 (775a4727-c8fe-4230-a6d4-6e55c279b2a8) with port 1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 29a1b9f9-a46a-46a0-85cc-fb255d980b29. Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30aa41d0-d93d-4ce2-9428-770d0e2bfcb1'] Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.4 (775a4727-c8fe-4230-a6d4-6e55c279b2a8) with port 1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 29a1b9f9-a46a-46a0-85cc-fb255d980b29. Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-30aa41d0-d93d-4ce2-9428-770d0e2bfcb1'] Aug 29 15:40:54.912943 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:40:54.916874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4ce6f591-0fb9-4bf8-bed0-ead735a25f08 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Returning 400 to user: Cannot associate floating IP 172.25.2.4 (775a4727-c8fe-4230-a6d4-6e55c279b2a8) with port 1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 29a1b9f9-a46a-46a0-85cc-fb255d980b29. Aug 29 15:40:54.916874 n-d-839401-11 devstack@n-api.service[122361]: Neutron server returns request_ids: ['req-30aa41d0-d93d-4ce2-9428-770d0e2bfcb1'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:54.917824 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4ce6f591-0fb9-4bf8-bed0-ead735a25f08 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "POST /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524/action" status: 400 len: 380 microversion: 2.1 time: 1.477055 Aug 29 15:40:54.918170 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1905/3873] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:53 2022] POST /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524/action => generated 380 bytes in 1479 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:40:54.926652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2b9f985b-d704-4a0f-ba44-b0b6c5c6a319 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '.version_select at 0x7fc42b7129d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:54.963249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-15894e3e-f552-49f3-b194-7cbe98c328c4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:54.964345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-15894e3e-f552-49f3-b194-7cbe98c328c4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:54.984048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15894e3e-f552-49f3-b194-7cbe98c328c4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.984616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15894e3e-f552-49f3-b194-7cbe98c328c4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.985245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15894e3e-f552-49f3-b194-7cbe98c328c4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.987301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15894e3e-f552-49f3-b194-7cbe98c328c4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.988920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15894e3e-f552-49f3-b194-7cbe98c328c4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.989486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15894e3e-f552-49f3-b194-7cbe98c328c4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:55.112931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-15894e3e-f552-49f3-b194-7cbe98c328c4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:55.123168 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-15894e3e-f552-49f3-b194-7cbe98c328c4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1265 microversion: 2.1 time: 0.163945 Aug 29 15:40:55.124336 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1906/3874] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:54 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:55.531746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d870d9c6-d664-439d-b1a5-6d435340b050 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:55.532508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d870d9c6-d664-439d-b1a5-6d435340b050 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:55.545925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d870d9c6-d664-439d-b1a5-6d435340b050 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:55.546425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d870d9c6-d664-439d-b1a5-6d435340b050 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:55.547115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d870d9c6-d664-439d-b1a5-6d435340b050 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:55.547571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d870d9c6-d664-439d-b1a5-6d435340b050 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:55.548019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d870d9c6-d664-439d-b1a5-6d435340b050 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:55.548607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d870d9c6-d664-439d-b1a5-6d435340b050 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:55.784552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d870d9c6-d664-439d-b1a5-6d435340b050 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:55.795816 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d870d9c6-d664-439d-b1a5-6d435340b050 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1665 microversion: 2.1 time: 0.267746 Aug 29 15:40:55.796442 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1907/3875] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:55 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1665 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:55.851479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e5b6d65-88b1-40f0-a54e-8fe80fafcb59 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:55.852112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9e5b6d65-88b1-40f0-a54e-8fe80fafcb59 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:55.866901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e5b6d65-88b1-40f0-a54e-8fe80fafcb59 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:55.869378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e5b6d65-88b1-40f0-a54e-8fe80fafcb59 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:55.870058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e5b6d65-88b1-40f0-a54e-8fe80fafcb59 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:55.875644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e5b6d65-88b1-40f0-a54e-8fe80fafcb59 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:55.877394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e5b6d65-88b1-40f0-a54e-8fe80fafcb59 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:55.878486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e5b6d65-88b1-40f0-a54e-8fe80fafcb59 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.105769 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2b9f985b-d704-4a0f-ba44-b0b6c5c6a319 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "DELETE /compute/v2.1/os-floating-ips/775a4727-c8fe-4230-a6d4-6e55c279b2a8" status: 202 len: 0 microversion: 2.1 time: 1.183046 Aug 29 15:40:56.110522 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1969/3876] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:40:54 2022] DELETE /compute/v2.1/os-floating-ips/775a4727-c8fe-4230-a6d4-6e55c279b2a8 => generated 0 bytes in 1188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:56.117512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0907b156-8c9a-4fc0-836a-4c617fcecc43 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.11"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:56.169406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9e5b6d65-88b1-40f0-a54e-8fe80fafcb59 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:56.182020 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9e5b6d65-88b1-40f0-a54e-8fe80fafcb59 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1479 microversion: 2.1 time: 0.341084 Aug 29 15:40:56.182886 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1908/3877] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:55 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1479 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:56.190501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-17fdd2cf-fdd7-4519-91f2-50324434a692 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:56.192022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-17fdd2cf-fdd7-4519-91f2-50324434a692 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:56.201466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17fdd2cf-fdd7-4519-91f2-50324434a692 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.201960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17fdd2cf-fdd7-4519-91f2-50324434a692 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.202399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17fdd2cf-fdd7-4519-91f2-50324434a692 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.203273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17fdd2cf-fdd7-4519-91f2-50324434a692 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.203740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17fdd2cf-fdd7-4519-91f2-50324434a692 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.204389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17fdd2cf-fdd7-4519-91f2-50324434a692 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.283508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-17fdd2cf-fdd7-4519-91f2-50324434a692 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:56.296037 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-17fdd2cf-fdd7-4519-91f2-50324434a692 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1265 microversion: 2.1 time: 0.112011 Aug 29 15:40:56.296993 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1909/3878] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:56 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:56.306409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0907b156-8c9a-4fc0-836a-4c617fcecc43 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:56.314577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0907b156-8c9a-4fc0-836a-4c617fcecc43 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.315079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0907b156-8c9a-4fc0-836a-4c617fcecc43 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.315598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0907b156-8c9a-4fc0-836a-4c617fcecc43 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.316254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0907b156-8c9a-4fc0-836a-4c617fcecc43 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.316782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0907b156-8c9a-4fc0-836a-4c617fcecc43 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.317251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0907b156-8c9a-4fc0-836a-4c617fcecc43 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.548972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0907b156-8c9a-4fc0-836a-4c617fcecc43 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "refresh_cache-ec852709-4ddc-42d0-94da-88df26e5e524" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:40:56.549418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0907b156-8c9a-4fc0-836a-4c617fcecc43 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquired lock "refresh_cache-ec852709-4ddc-42d0-94da-88df26e5e524" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:40:56.836841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-84e54d5d-5654-41a6-98be-b2658a21ee54 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:56.839465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-84e54d5d-5654-41a6-98be-b2658a21ee54 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:56.875795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84e54d5d-5654-41a6-98be-b2658a21ee54 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.876907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84e54d5d-5654-41a6-98be-b2658a21ee54 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.879187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84e54d5d-5654-41a6-98be-b2658a21ee54 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.881971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84e54d5d-5654-41a6-98be-b2658a21ee54 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.883931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84e54d5d-5654-41a6-98be-b2658a21ee54 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.885778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84e54d5d-5654-41a6-98be-b2658a21ee54 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.362798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-84e54d5d-5654-41a6-98be-b2658a21ee54 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:57.380221 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-84e54d5d-5654-41a6-98be-b2658a21ee54 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1665 microversion: 2.1 time: 0.564818 Aug 29 15:40:57.395717 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1910/3879] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:56 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1665 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:57.406462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-00b9a855-1279-4333-a264-83e99ba07d8e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:57.407122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-00b9a855-1279-4333-a264-83e99ba07d8e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:57.419639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00b9a855-1279-4333-a264-83e99ba07d8e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:57.420918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00b9a855-1279-4333-a264-83e99ba07d8e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:57.421504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00b9a855-1279-4333-a264-83e99ba07d8e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.422357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00b9a855-1279-4333-a264-83e99ba07d8e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:57.423433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00b9a855-1279-4333-a264-83e99ba07d8e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:57.423881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00b9a855-1279-4333-a264-83e99ba07d8e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.698707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-0907b156-8c9a-4fc0-836a-4c617fcecc43 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Building network info cache for instance {{(pid=122360) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:40:57.740944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-00b9a855-1279-4333-a264-83e99ba07d8e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:57.750442 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-00b9a855-1279-4333-a264-83e99ba07d8e tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1464 microversion: 2.1 time: 0.353542 Aug 29 15:40:57.754396 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1911/3880] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:57 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1464 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:57.759399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eedb9a40-6ece-4a9c-bed8-7644de177d4c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:57.765363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eedb9a40-6ece-4a9c-bed8-7644de177d4c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:57.785446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eedb9a40-6ece-4a9c-bed8-7644de177d4c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:57.786532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eedb9a40-6ece-4a9c-bed8-7644de177d4c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:57.787505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eedb9a40-6ece-4a9c-bed8-7644de177d4c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.789302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eedb9a40-6ece-4a9c-bed8-7644de177d4c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:57.790079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eedb9a40-6ece-4a9c-bed8-7644de177d4c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:57.790736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eedb9a40-6ece-4a9c-bed8-7644de177d4c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.878890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eedb9a40-6ece-4a9c-bed8-7644de177d4c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:57.889771 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eedb9a40-6ece-4a9c-bed8-7644de177d4c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1271 microversion: 2.1 time: 0.132929 Aug 29 15:40:57.890678 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1912/3881] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:57 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1271 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:57.902052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f9391f0d-9952-4cc9-90d2-b02f7a8a3272 req-47dbfc6b-4c6a-48b3-9826-502318c44a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec852709-4ddc-42d0-94da-88df26e5e524", "tag": "1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:57.928014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f9391f0d-9952-4cc9-90d2-b02f7a8a3272 req-47dbfc6b-4c6a-48b3-9826-502318c44a39 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:57.928935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f9391f0d-9952-4cc9-90d2-b02f7a8a3272 req-47dbfc6b-4c6a-48b3-9826-502318c44a39 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:57.929601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f9391f0d-9952-4cc9-90d2-b02f7a8a3272 req-47dbfc6b-4c6a-48b3-9826-502318c44a39 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.943311 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f9391f0d-9952-4cc9-90d2-b02f7a8a3272 req-47dbfc6b-4c6a-48b3-9826-502318c44a39 service nova] Creating event network-changed:1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf for instance ec852709-4ddc-42d0-94da-88df26e5e524 on n-h1-839401-11 Aug 29 15:40:57.949310 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f9391f0d-9952-4cc9-90d2-b02f7a8a3272 req-47dbfc6b-4c6a-48b3-9826-502318c44a39 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056425 Aug 29 15:40:57.950505 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1913/3882] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:57.956328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-085292d9-0b58-4652-8dc4-59b902438a19 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:57.958999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-085292d9-0b58-4652-8dc4-59b902438a19 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:57.966536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-085292d9-0b58-4652-8dc4-59b902438a19 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:57.967193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-085292d9-0b58-4652-8dc4-59b902438a19 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:57.967896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-085292d9-0b58-4652-8dc4-59b902438a19 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.968836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-085292d9-0b58-4652-8dc4-59b902438a19 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:57.969464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-085292d9-0b58-4652-8dc4-59b902438a19 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:57.971274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-085292d9-0b58-4652-8dc4-59b902438a19 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.170435 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-085292d9-0b58-4652-8dc4-59b902438a19 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c/action" status: 202 len: 0 microversion: 2.1 time: 0.218393 Aug 29 15:40:58.171876 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1914/3883] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:57 2022] POST /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:58.181854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-45d782e7-2fef-4a67-a58c-5a2ae4f90afd tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:58.182939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-45d782e7-2fef-4a67-a58c-5a2ae4f90afd tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:58.207653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45d782e7-2fef-4a67-a58c-5a2ae4f90afd tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.210218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45d782e7-2fef-4a67-a58c-5a2ae4f90afd tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.211292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45d782e7-2fef-4a67-a58c-5a2ae4f90afd tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.212735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45d782e7-2fef-4a67-a58c-5a2ae4f90afd tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.214650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45d782e7-2fef-4a67-a58c-5a2ae4f90afd tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.215848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45d782e7-2fef-4a67-a58c-5a2ae4f90afd tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.312452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45d782e7-2fef-4a67-a58c-5a2ae4f90afd tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.315232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45d782e7-2fef-4a67-a58c-5a2ae4f90afd tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.315746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45d782e7-2fef-4a67-a58c-5a2ae4f90afd tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.316447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-45d782e7-2fef-4a67-a58c-5a2ae4f90afd tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lazy-loading 'fault' on Instance uuid b1199ee4-c322-4c37-a53e-1bf029c7f14c {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:40:58.687133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-0907b156-8c9a-4fc0-836a-4c617fcecc43 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Updating instance_info_cache with network_info: [{"id": "1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf", "address": "fa:16:3e:c5:44:ec", "network": {"id": "128669ab-992c-4559-a7aa-5dfa8ba3fc41", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-2046555952-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e65be3b9dae94862b36f8b47bcf427a9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1be5f20b-1d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122360) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:40:58.702242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0907b156-8c9a-4fc0-836a-4c617fcecc43 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Releasing lock "refresh_cache-ec852709-4ddc-42d0-94da-88df26e5e524" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:40:58.704151 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0907b156-8c9a-4fc0-836a-4c617fcecc43 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "POST /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524/action" status: 202 len: 0 microversion: 2.1 time: 2.591416 Aug 29 15:40:58.707013 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1970/3884] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:56 2022] POST /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524/action => generated 0 bytes in 2596 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:40:58.724250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-25dd144b-0b97-4c3a-a172-28304d9f618a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:58.724914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-25dd144b-0b97-4c3a-a172-28304d9f618a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:58.736160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25dd144b-0b97-4c3a-a172-28304d9f618a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.736160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25dd144b-0b97-4c3a-a172-28304d9f618a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.736160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25dd144b-0b97-4c3a-a172-28304d9f618a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.736160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25dd144b-0b97-4c3a-a172-28304d9f618a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.736555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25dd144b-0b97-4c3a-a172-28304d9f618a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.736669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25dd144b-0b97-4c3a-a172-28304d9f618a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.772768 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-45d782e7-2fef-4a67-a58c-5a2ae4f90afd tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1600 microversion: 2.1 time: 0.594238 Aug 29 15:40:58.783462 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1915/3885] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:58 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1600 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:58.797955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-92936cff-ca8b-402d-a2c5-7c256d368611 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '.version_select at 0x7fc42b11bdc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:58.964406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-25dd144b-0b97-4c3a-a172-28304d9f618a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:58.974855 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-25dd144b-0b97-4c3a-a172-28304d9f618a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.259914 Aug 29 15:40:58.977076 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1971/3886] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:58 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:58.983151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0977a51f-fc93-4bbd-80a2-1122f5753045 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:58.986174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0977a51f-fc93-4bbd-80a2-1122f5753045 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:58.994123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0977a51f-fc93-4bbd-80a2-1122f5753045 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.995239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0977a51f-fc93-4bbd-80a2-1122f5753045 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.996192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0977a51f-fc93-4bbd-80a2-1122f5753045 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.997655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0977a51f-fc93-4bbd-80a2-1122f5753045 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.998713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0977a51f-fc93-4bbd-80a2-1122f5753045 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.999443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0977a51f-fc93-4bbd-80a2-1122f5753045 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.111347 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0977a51f-fc93-4bbd-80a2-1122f5753045 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c/action" status: 202 len: 0 microversion: 2.1 time: 0.132761 Aug 29 15:40:59.111918 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1972/3887] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:58 2022] POST /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:59.121560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-40aa2ad1-3cb8-46d6-965e-1565b6471011 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:59.122613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-40aa2ad1-3cb8-46d6-965e-1565b6471011 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:59.154872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40aa2ad1-3cb8-46d6-965e-1565b6471011 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.156058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40aa2ad1-3cb8-46d6-965e-1565b6471011 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.156912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40aa2ad1-3cb8-46d6-965e-1565b6471011 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.165432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40aa2ad1-3cb8-46d6-965e-1565b6471011 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.166419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40aa2ad1-3cb8-46d6-965e-1565b6471011 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.167392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40aa2ad1-3cb8-46d6-965e-1565b6471011 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.535688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-40aa2ad1-3cb8-46d6-965e-1565b6471011 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:59.578366 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-40aa2ad1-3cb8-46d6-965e-1565b6471011 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1313 microversion: 2.1 time: 0.464403 Aug 29 15:40:59.578971 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1973/3888] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:59 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:59.604509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ccbcdbdf-f323-4b0a-9d8a-8aa32382c6d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:59.605162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ccbcdbdf-f323-4b0a-9d8a-8aa32382c6d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:59.615385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccbcdbdf-f323-4b0a-9d8a-8aa32382c6d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.615980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccbcdbdf-f323-4b0a-9d8a-8aa32382c6d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.616519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccbcdbdf-f323-4b0a-9d8a-8aa32382c6d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.618052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccbcdbdf-f323-4b0a-9d8a-8aa32382c6d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.618696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccbcdbdf-f323-4b0a-9d8a-8aa32382c6d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.619500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccbcdbdf-f323-4b0a-9d8a-8aa32382c6d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.918000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ccbcdbdf-f323-4b0a-9d8a-8aa32382c6d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:59.926462 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ccbcdbdf-f323-4b0a-9d8a-8aa32382c6d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.331025 Aug 29 15:40:59.927103 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1974/3889] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:59 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:59.937393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c8aac8fa-c46c-43c6-abd5-cf3f4d154b83 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:59.938248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c8aac8fa-c46c-43c6-abd5-cf3f4d154b83 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:59.945023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8aac8fa-c46c-43c6-abd5-cf3f4d154b83 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.951288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8aac8fa-c46c-43c6-abd5-cf3f4d154b83 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.952012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8aac8fa-c46c-43c6-abd5-cf3f4d154b83 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.952959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8aac8fa-c46c-43c6-abd5-cf3f4d154b83 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.955308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8aac8fa-c46c-43c6-abd5-cf3f4d154b83 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.955923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8aac8fa-c46c-43c6-abd5-cf3f4d154b83 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.186108 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c8aac8fa-c46c-43c6-abd5-cf3f4d154b83 tempest-ServersAdminTestJSON-1957790349 tempest-ServersAdminTestJSON-1957790349-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1617 microversion: 2.1 time: 0.257952 Aug 29 15:41:00.189819 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1975/3890] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:59 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1617 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:00.197238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0d61a9eb-01d0-49bc-baa0-9dee2c63a80f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:00.198919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0d61a9eb-01d0-49bc-baa0-9dee2c63a80f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:00.207056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d61a9eb-01d0-49bc-baa0-9dee2c63a80f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.207555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d61a9eb-01d0-49bc-baa0-9dee2c63a80f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.208139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d61a9eb-01d0-49bc-baa0-9dee2c63a80f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.208928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d61a9eb-01d0-49bc-baa0-9dee2c63a80f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.209910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d61a9eb-01d0-49bc-baa0-9dee2c63a80f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.210375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d61a9eb-01d0-49bc-baa0-9dee2c63a80f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.277462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0d61a9eb-01d0-49bc-baa0-9dee2c63a80f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Unlocking {{(pid=122360) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 29 15:41:00.353522 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0d61a9eb-01d0-49bc-baa0-9dee2c63a80f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 202 len: 0 microversion: 2.1 time: 0.162204 Aug 29 15:41:00.357384 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1976/3891] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:00 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:00.360880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ad0de217-1084-4bce-8560-fdc644dcc2f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:00.361901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ad0de217-1084-4bce-8560-fdc644dcc2f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:00.371279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad0de217-1084-4bce-8560-fdc644dcc2f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.373944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad0de217-1084-4bce-8560-fdc644dcc2f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.374918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad0de217-1084-4bce-8560-fdc644dcc2f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.376363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad0de217-1084-4bce-8560-fdc644dcc2f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.377001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad0de217-1084-4bce-8560-fdc644dcc2f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.377663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad0de217-1084-4bce-8560-fdc644dcc2f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.418529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ad0de217-1084-4bce-8560-fdc644dcc2f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:41:00.467093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=4,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=8,nova_cell1:RELEASE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:00.545769 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ad0de217-1084-4bce-8560-fdc644dcc2f0 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 204 len: 0 microversion: 2.1 time: 0.189459 Aug 29 15:41:00.546884 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1977/3892] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:00 2022] DELETE /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:00.553808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a93efadd-ee27-455f-ac19-8cbdfba9bf69 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:00.555902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a93efadd-ee27-455f-ac19-8cbdfba9bf69 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:00.563977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a93efadd-ee27-455f-ac19-8cbdfba9bf69 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.564755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a93efadd-ee27-455f-ac19-8cbdfba9bf69 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.565552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a93efadd-ee27-455f-ac19-8cbdfba9bf69 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.566732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a93efadd-ee27-455f-ac19-8cbdfba9bf69 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.567427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a93efadd-ee27-455f-ac19-8cbdfba9bf69 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.568164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a93efadd-ee27-455f-ac19-8cbdfba9bf69 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.764002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a93efadd-ee27-455f-ac19-8cbdfba9bf69 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:00.772670 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a93efadd-ee27-455f-ac19-8cbdfba9bf69 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.224404 Aug 29 15:41:00.777838 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1978/3893] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:00 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:00.782500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-20f3a9f8-5af2-48da-a800-3944966cfb64 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:00.786930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-20f3a9f8-5af2-48da-a800-3944966cfb64 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:00.800446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20f3a9f8-5af2-48da-a800-3944966cfb64 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.802426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20f3a9f8-5af2-48da-a800-3944966cfb64 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.802618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20f3a9f8-5af2-48da-a800-3944966cfb64 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.803963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20f3a9f8-5af2-48da-a800-3944966cfb64 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.804504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20f3a9f8-5af2-48da-a800-3944966cfb64 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.805011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20f3a9f8-5af2-48da-a800-3944966cfb64 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.841218 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-92936cff-ca8b-402d-a2c5-7c256d368611 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "DELETE /compute/v2.1/os-floating-ips/0da41d60-15d2-4a51-8fb2-512d95a3b9f1" status: 202 len: 0 microversion: 2.1 time: 2.051347 Aug 29 15:41:00.847869 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1916/3894] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:40:58 2022] DELETE /compute/v2.1/os-floating-ips/0da41d60-15d2-4a51-8fb2-512d95a3b9f1 => generated 0 bytes in 2064 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:00.854196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-214e0cb5-2d12-4543-9cd1-b6e91e103eba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:00.855038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-214e0cb5-2d12-4543-9cd1-b6e91e103eba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:00.870840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-214e0cb5-2d12-4543-9cd1-b6e91e103eba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.871629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-214e0cb5-2d12-4543-9cd1-b6e91e103eba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.872284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-214e0cb5-2d12-4543-9cd1-b6e91e103eba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.873280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-214e0cb5-2d12-4543-9cd1-b6e91e103eba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.874462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-214e0cb5-2d12-4543-9cd1-b6e91e103eba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.875109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-214e0cb5-2d12-4543-9cd1-b6e91e103eba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.028398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-20f3a9f8-5af2-48da-a800-3944966cfb64 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:01.039691 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-20f3a9f8-5af2-48da-a800-3944966cfb64 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1470 microversion: 2.1 time: 0.260808 Aug 29 15:41:01.041230 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1979/3895] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:00 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1470 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:01.053574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5acf7777-c0f2-45c4-8b22-7835c38c2be5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.053574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5acf7777-c0f2-45c4-8b22-7835c38c2be5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.066702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5acf7777-c0f2-45c4-8b22-7835c38c2be5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.069778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5acf7777-c0f2-45c4-8b22-7835c38c2be5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.070902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5acf7777-c0f2-45c4-8b22-7835c38c2be5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.071122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5acf7777-c0f2-45c4-8b22-7835c38c2be5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.071583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5acf7777-c0f2-45c4-8b22-7835c38c2be5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.072971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5acf7777-c0f2-45c4-8b22-7835c38c2be5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.359068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-214e0cb5-2d12-4543-9cd1-b6e91e103eba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:01.368153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5acf7777-c0f2-45c4-8b22-7835c38c2be5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:01.370755 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-214e0cb5-2d12-4543-9cd1-b6e91e103eba tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1334 microversion: 2.1 time: 0.520837 Aug 29 15:41:01.380013 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5acf7777-c0f2-45c4-8b22-7835c38c2be5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.337392 Aug 29 15:41:01.380767 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1980/3896] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:01 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:01.390353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6ce5d896-9d3f-428c-8fa7-1577ae9239d0 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6ce5d896-9d3f-428c-8fa7-1577ae9239d0 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Request method failure captured: Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524/action HTTP/1.1 Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 34 Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN3uVA0dAB0R7z39dpULTYP4DKXMvY7a2LFfUUazNtlfXhDRDEqmoAVa6QyYbsJ5kLF2PevffX89ieePWXZzduTNFlDgcMFDpxposXi0Smn1tFZuMNV7YVRcmfb6-fav6EIttMYO3HD1gHaEc9A-JD57cwMnfouQLV48t-2YYbQNx-g Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: e65be3b9dae94862b36f8b47bcf427a9 Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-548794726 Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e65be3b9dae94862b36f8b47bcf427a9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e65be3b9dae94862b36f8b47bcf427a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e65be3b9dae94862b36f8b47bcf427a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e65be3b9dae94862b36f8b47bcf427a9"}]}] Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-548794726 Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: e65be3b9dae94862b36f8b47bcf427a9 Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-548794726 Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6d5cf3f21f5c402b87099b7dccc24d35 Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: {"addFloatingIp": {"address": ""}} Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'ec852709-4ddc-42d0-94da-88df26e5e524', 'body': {'addFloatingIp': {'address': ''}}} Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi '' Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:41:01.391880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:41:01.397023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:41:01.397023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 29 15:41:01.397023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.397023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.397023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.397023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.397023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.397023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.397023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:41:01.397023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:41:01.397023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 29 15:41:01.397023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.397023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6ce5d896-9d3f-428c-8fa7-1577ae9239d0 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:01.397023 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6ce5d896-9d3f-428c-8fa7-1577ae9239d0 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "POST /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524/action" status: 400 len: 142 microversion: 2.1 time: 0.011280 Aug 29 15:41:01.398673 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1917/3897] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:00 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1334 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:01.399073 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1981/3898] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:01 2022] POST /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524/action => generated 142 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:41:01.405262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b8c7c9ea-7b2c-4949-95ea-6f56a2f17abf tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:01.405869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fd4d696f-9fa3-45b5-9a95-2c4734f61681 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.406524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fd4d696f-9fa3-45b5-9a95-2c4734f61681 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.408032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b8c7c9ea-7b2c-4949-95ea-6f56a2f17abf tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.416143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd4d696f-9fa3-45b5-9a95-2c4734f61681 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.416665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd4d696f-9fa3-45b5-9a95-2c4734f61681 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.417130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd4d696f-9fa3-45b5-9a95-2c4734f61681 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.417885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd4d696f-9fa3-45b5-9a95-2c4734f61681 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.418345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd4d696f-9fa3-45b5-9a95-2c4734f61681 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.418773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd4d696f-9fa3-45b5-9a95-2c4734f61681 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.421662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8c7c9ea-7b2c-4949-95ea-6f56a2f17abf tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.422589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8c7c9ea-7b2c-4949-95ea-6f56a2f17abf tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.423309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8c7c9ea-7b2c-4949-95ea-6f56a2f17abf tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.424195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8c7c9ea-7b2c-4949-95ea-6f56a2f17abf tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.424869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8c7c9ea-7b2c-4949-95ea-6f56a2f17abf tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.425450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8c7c9ea-7b2c-4949-95ea-6f56a2f17abf tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.458914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8c7c9ea-7b2c-4949-95ea-6f56a2f17abf tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "refresh_cache-ec852709-4ddc-42d0-94da-88df26e5e524" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:41:01.459771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8c7c9ea-7b2c-4949-95ea-6f56a2f17abf tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquired lock "refresh_cache-ec852709-4ddc-42d0-94da-88df26e5e524" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:41:01.596421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fd4d696f-9fa3-45b5-9a95-2c4734f61681 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:01.605872 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fd4d696f-9fa3-45b5-9a95-2c4734f61681 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.203983 Aug 29 15:41:01.606963 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1918/3899] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:01 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:01.628680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e9165269-6fb5-4fe9-9d49-6213253c6217 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:01.629547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e9165269-6fb5-4fe9-9d49-6213253c6217 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.637521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9165269-6fb5-4fe9-9d49-6213253c6217 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.638654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9165269-6fb5-4fe9-9d49-6213253c6217 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.639306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9165269-6fb5-4fe9-9d49-6213253c6217 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.640445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9165269-6fb5-4fe9-9d49-6213253c6217 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.641648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9165269-6fb5-4fe9-9d49-6213253c6217 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.642728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9165269-6fb5-4fe9-9d49-6213253c6217 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.661184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:01.699997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8c7c9ea-7b2c-4949-95ea-6f56a2f17abf tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Releasing lock "refresh_cache-ec852709-4ddc-42d0-94da-88df26e5e524" {{(pid=122360) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:41:01.701419 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-b8c7c9ea-7b2c-4949-95ea-6f56a2f17abf tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] HTTP exception thrown: floating IP not found Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b8c7c9ea-7b2c-4949-95ea-6f56a2f17abf tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Request method failure captured: Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524/action HTTP/1.1 Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 41 Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN3uVA0dAB0R7z39dpULTYP4DKXMvY7a2LFfUUazNtlfXhDRDEqmoAVa6QyYbsJ5kLF2PevffX89ieePWXZzduTNFlDgcMFDpxposXi0Smn1tFZuMNV7YVRcmfb6-fav6EIttMYO3HD1gHaEc9A-JD57cwMnfouQLV48t-2YYbQNx-g Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: e65be3b9dae94862b36f8b47bcf427a9 Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-548794726 Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e65be3b9dae94862b36f8b47bcf427a9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e65be3b9dae94862b36f8b47bcf427a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e65be3b9dae94862b36f8b47bcf427a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e65be3b9dae94862b36f8b47bcf427a9"}]}] Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-548794726 Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: e65be3b9dae94862b36f8b47bcf427a9 Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-548794726 Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6d5cf3f21f5c402b87099b7dccc24d35 Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: exception: floating IP not found Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'ec852709-4ddc-42d0-94da-88df26e5e524', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 29 15:41:01.703542 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.709272 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.709272 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.709272 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.709272 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.709272 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.709272 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:01.709272 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:01.709272 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 29 15:41:01.709272 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.713111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b8c7c9ea-7b2c-4949-95ea-6f56a2f17abf tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Returning 404 to user: floating IP not found {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:01.714255 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b8c7c9ea-7b2c-4949-95ea-6f56a2f17abf tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "POST /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524/action" status: 404 len: 67 microversion: 2.1 time: 0.314117 Aug 29 15:41:01.721223 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1982/3900] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:01 2022] POST /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524/action => generated 67 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:01.728387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bcffb1c8-3de5-41f1-be61-ee6f23608eb2 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:01.733205 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e9165269-6fb5-4fe9-9d49-6213253c6217 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 202 len: 0 microversion: 2.1 time: 0.107974 Aug 29 15:41:01.736794 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1919/3901] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:01 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:41:01.750686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-74824895-5242-4746-8a00-598ddddd095c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.753298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-74824895-5242-4746-8a00-598ddddd095c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.761029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74824895-5242-4746-8a00-598ddddd095c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.762127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74824895-5242-4746-8a00-598ddddd095c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.762951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74824895-5242-4746-8a00-598ddddd095c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.764143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74824895-5242-4746-8a00-598ddddd095c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.764977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74824895-5242-4746-8a00-598ddddd095c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.765823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74824895-5242-4746-8a00-598ddddd095c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.811148 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-bcffb1c8-3de5-41f1-be61-ee6f23608eb2 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bcffb1c8-3de5-41f1-be61-ee6f23608eb2 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Request method failure captured: Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524/action HTTP/1.1 Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 44 Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN3uVA0dAB0R7z39dpULTYP4DKXMvY7a2LFfUUazNtlfXhDRDEqmoAVa6QyYbsJ5kLF2PevffX89ieePWXZzduTNFlDgcMFDpxposXi0Smn1tFZuMNV7YVRcmfb6-fav6EIttMYO3HD1gHaEc9A-JD57cwMnfouQLV48t-2YYbQNx-g Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: e65be3b9dae94862b36f8b47bcf427a9 Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-548794726 Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e65be3b9dae94862b36f8b47bcf427a9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e65be3b9dae94862b36f8b47bcf427a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e65be3b9dae94862b36f8b47bcf427a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e65be3b9dae94862b36f8b47bcf427a9"}]}] Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-548794726 Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: e65be3b9dae94862b36f8b47bcf427a9 Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-548794726 Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6d5cf3f21f5c402b87099b7dccc24d35 Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: exception: Floating IP not found for address 0.0.0.0. Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'ec852709-4ddc-42d0-94da-88df26e5e524', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 29 15:41:01.812765 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 29 15:41:01.818495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 29 15:41:01.818495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.818495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:01.818495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.818495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:01.818495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:01.818495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:01.818495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:01.818495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:01.818495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 29 15:41:01.818495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:01.818495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bcffb1c8-3de5-41f1-be61-ee6f23608eb2 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:01.819997 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bcffb1c8-3de5-41f1-be61-ee6f23608eb2 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "POST /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524/action" status: 404 len: 88 microversion: 2.1 time: 0.096370 Aug 29 15:41:01.819997 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1983/3902] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:01 2022] POST /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524/action => generated 88 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:01.840118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-895a1b62-4f7c-42b4-859b-3e1f68cbfb91 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.840717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-895a1b62-4f7c-42b4-859b-3e1f68cbfb91 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.848605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-895a1b62-4f7c-42b4-859b-3e1f68cbfb91 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.850137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-895a1b62-4f7c-42b4-859b-3e1f68cbfb91 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.850591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-895a1b62-4f7c-42b4-859b-3e1f68cbfb91 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.851300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-895a1b62-4f7c-42b4-859b-3e1f68cbfb91 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.851750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-895a1b62-4f7c-42b4-859b-3e1f68cbfb91 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.852206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-895a1b62-4f7c-42b4-859b-3e1f68cbfb91 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.880916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-895a1b62-4f7c-42b4-859b-3e1f68cbfb91 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:41:01.970296 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-895a1b62-4f7c-42b4-859b-3e1f68cbfb91 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 204 len: 0 microversion: 2.1 time: 0.143042 Aug 29 15:41:01.973471 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1984/3903] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:01 2022] DELETE /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:01.977945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-74824895-5242-4746-8a00-598ddddd095c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:01.983422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bd61b39f-0a1f-4fc0-b7f5-8d9b4aab1b27 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.984239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bd61b39f-0a1f-4fc0-b7f5-8d9b4aab1b27 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.988532 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-74824895-5242-4746-8a00-598ddddd095c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1674 microversion: 2.1 time: 0.247560 Aug 29 15:41:01.992818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd61b39f-0a1f-4fc0-b7f5-8d9b4aab1b27 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.993989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd61b39f-0a1f-4fc0-b7f5-8d9b4aab1b27 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.994589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd61b39f-0a1f-4fc0-b7f5-8d9b4aab1b27 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.995638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd61b39f-0a1f-4fc0-b7f5-8d9b4aab1b27 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.996270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd61b39f-0a1f-4fc0-b7f5-8d9b4aab1b27 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.996840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd61b39f-0a1f-4fc0-b7f5-8d9b4aab1b27 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.997200 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1920/3904] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:01 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1674 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:02.066905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-34e4ea20-749c-42f4-a560-69359aa06c01 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:02.068153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-34e4ea20-749c-42f4-a560-69359aa06c01 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:02.086064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34e4ea20-749c-42f4-a560-69359aa06c01 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.087201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34e4ea20-749c-42f4-a560-69359aa06c01 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.087753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34e4ea20-749c-42f4-a560-69359aa06c01 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.088705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34e4ea20-749c-42f4-a560-69359aa06c01 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.089613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34e4ea20-749c-42f4-a560-69359aa06c01 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.090321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34e4ea20-749c-42f4-a560-69359aa06c01 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.223419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bd61b39f-0a1f-4fc0-b7f5-8d9b4aab1b27 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5cf3f21f5c402b87099b7dccc24d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65be3b9dae94862b36f8b47bcf427a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:02.246056 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bd61b39f-0a1f-4fc0-b7f5-8d9b4aab1b27 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 200 len: 1542 microversion: 2.1 time: 0.269024 Aug 29 15:41:02.247077 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1985/3905] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:01 2022] GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 1542 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:02.321816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-34e4ea20-749c-42f4-a560-69359aa06c01 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:02.330678 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-34e4ea20-749c-42f4-a560-69359aa06c01 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1470 microversion: 2.1 time: 0.269442 Aug 29 15:41:02.338052 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1921/3906] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:02 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1470 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:02.397881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c31279d-18f8-45be-ac16-edfaeb1d295e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:02.398633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5c31279d-18f8-45be-ac16-edfaeb1d295e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:02.405579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c31279d-18f8-45be-ac16-edfaeb1d295e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.409471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c31279d-18f8-45be-ac16-edfaeb1d295e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.411601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c31279d-18f8-45be-ac16-edfaeb1d295e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.413279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c31279d-18f8-45be-ac16-edfaeb1d295e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.413860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c31279d-18f8-45be-ac16-edfaeb1d295e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.415826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c31279d-18f8-45be-ac16-edfaeb1d295e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.630913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5c31279d-18f8-45be-ac16-edfaeb1d295e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:02.643553 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5c31279d-18f8-45be-ac16-edfaeb1d295e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1334 microversion: 2.1 time: 0.249199 Aug 29 15:41:02.647020 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1986/3907] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:02 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1334 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:03.012243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5cd67fec-8e6e-445c-bf41-4ee0f9e3da48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:03.013786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5cd67fec-8e6e-445c-bf41-4ee0f9e3da48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:03.022014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cd67fec-8e6e-445c-bf41-4ee0f9e3da48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.022592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cd67fec-8e6e-445c-bf41-4ee0f9e3da48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.023107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cd67fec-8e6e-445c-bf41-4ee0f9e3da48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.023903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cd67fec-8e6e-445c-bf41-4ee0f9e3da48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.024496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cd67fec-8e6e-445c-bf41-4ee0f9e3da48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.025070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cd67fec-8e6e-445c-bf41-4ee0f9e3da48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.269217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3e2d326f-5fd4-44d0-b3e2-b77a23b5ceff tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:03.269839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3e2d326f-5fd4-44d0-b3e2-b77a23b5ceff tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:03.277950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e2d326f-5fd4-44d0-b3e2-b77a23b5ceff tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.278758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e2d326f-5fd4-44d0-b3e2-b77a23b5ceff tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.279415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e2d326f-5fd4-44d0-b3e2-b77a23b5ceff tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.280480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e2d326f-5fd4-44d0-b3e2-b77a23b5ceff tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.281160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e2d326f-5fd4-44d0-b3e2-b77a23b5ceff tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.281940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e2d326f-5fd4-44d0-b3e2-b77a23b5ceff tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.285066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:03.323305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:03.401139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5cd67fec-8e6e-445c-bf41-4ee0f9e3da48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:03.413546 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5cd67fec-8e6e-445c-bf41-4ee0f9e3da48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1654 microversion: 2.1 time: 0.406140 Aug 29 15:41:03.424584 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1922/3908] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:03 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1654 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:03.440459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3509d15a-9b46-4838-975b-e4d470c76d9a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:03.443476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3509d15a-9b46-4838-975b-e4d470c76d9a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:03.477719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3509d15a-9b46-4838-975b-e4d470c76d9a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.479173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3509d15a-9b46-4838-975b-e4d470c76d9a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.480963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3509d15a-9b46-4838-975b-e4d470c76d9a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.482942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3509d15a-9b46-4838-975b-e4d470c76d9a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.483586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3509d15a-9b46-4838-975b-e4d470c76d9a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.485728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3509d15a-9b46-4838-975b-e4d470c76d9a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.556813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3e2d326f-5fd4-44d0-b3e2-b77a23b5ceff tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5cf3f21f5c402b87099b7dccc24d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65be3b9dae94862b36f8b47bcf427a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:03.569140 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3e2d326f-5fd4-44d0-b3e2-b77a23b5ceff tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 200 len: 1542 microversion: 2.1 time: 0.304865 Aug 29 15:41:03.570497 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1987/3909] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:03 2022] GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 1542 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:03.577646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-2030dd0f-e8a8-4d18-869f-51c00a9c1093 req-772ab2fe-5392-46e2-afe1-539b40b51e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f529d0ad-a342-49fc-a7d6-f3279fef0eae", "tag": "ee4506b6-6fc8-403c-a99d-fbb3e9f20ae4"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:03.591507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2030dd0f-e8a8-4d18-869f-51c00a9c1093 req-772ab2fe-5392-46e2-afe1-539b40b51e07 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.592987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2030dd0f-e8a8-4d18-869f-51c00a9c1093 req-772ab2fe-5392-46e2-afe1-539b40b51e07 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.593691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2030dd0f-e8a8-4d18-869f-51c00a9c1093 req-772ab2fe-5392-46e2-afe1-539b40b51e07 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.614644 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-2030dd0f-e8a8-4d18-869f-51c00a9c1093 req-772ab2fe-5392-46e2-afe1-539b40b51e07 service nova] Creating event network-changed:ee4506b6-6fc8-403c-a99d-fbb3e9f20ae4 for instance f529d0ad-a342-49fc-a7d6-f3279fef0eae on n-h2-839401-11 Aug 29 15:41:03.622162 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-2030dd0f-e8a8-4d18-869f-51c00a9c1093 req-772ab2fe-5392-46e2-afe1-539b40b51e07 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048709 Aug 29 15:41:03.622839 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1988/3910] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:03.629164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a8b4cf7f-d1b4-4809-86ef-a55062adbe47 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:03.630384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a8b4cf7f-d1b4-4809-86ef-a55062adbe47 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:03.639440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8b4cf7f-d1b4-4809-86ef-a55062adbe47 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.640233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8b4cf7f-d1b4-4809-86ef-a55062adbe47 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.640874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8b4cf7f-d1b4-4809-86ef-a55062adbe47 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.642233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8b4cf7f-d1b4-4809-86ef-a55062adbe47 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.643049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8b4cf7f-d1b4-4809-86ef-a55062adbe47 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.643497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8b4cf7f-d1b4-4809-86ef-a55062adbe47 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.768128 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a8b4cf7f-d1b4-4809-86ef-a55062adbe47 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 202 len: 0 microversion: 2.1 time: 0.143624 Aug 29 15:41:03.772041 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1989/3911] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:03 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:03.781547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-647db747-ad17-48a7-9c17-95ec2fbbcd7e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:03.783006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-647db747-ad17-48a7-9c17-95ec2fbbcd7e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:03.796862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-647db747-ad17-48a7-9c17-95ec2fbbcd7e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.797381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-647db747-ad17-48a7-9c17-95ec2fbbcd7e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.799402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-647db747-ad17-48a7-9c17-95ec2fbbcd7e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.802130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-647db747-ad17-48a7-9c17-95ec2fbbcd7e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.806740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-647db747-ad17-48a7-9c17-95ec2fbbcd7e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.807592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-647db747-ad17-48a7-9c17-95ec2fbbcd7e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.946021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:04.030775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-647db747-ad17-48a7-9c17-95ec2fbbcd7e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:04.041639 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-647db747-ad17-48a7-9c17-95ec2fbbcd7e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1334 microversion: 2.1 time: 0.270956 Aug 29 15:41:04.062861 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1990/3912] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:03 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1334 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:04.084334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f32385bc-936a-4de6-9d57-80e576c362f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:04.086366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f32385bc-936a-4de6-9d57-80e576c362f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:04.106387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f32385bc-936a-4de6-9d57-80e576c362f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:04.106899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f32385bc-936a-4de6-9d57-80e576c362f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:04.109985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f32385bc-936a-4de6-9d57-80e576c362f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:04.110734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f32385bc-936a-4de6-9d57-80e576c362f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:04.114918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f32385bc-936a-4de6-9d57-80e576c362f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:04.115379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f32385bc-936a-4de6-9d57-80e576c362f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:04.385709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f32385bc-936a-4de6-9d57-80e576c362f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:04.394605 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f32385bc-936a-4de6-9d57-80e576c362f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1661 microversion: 2.1 time: 0.330200 Aug 29 15:41:04.395199 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1991/3913] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:04 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1661 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:04.589346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3509d15a-9b46-4838-975b-e4d470c76d9a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:04.592585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-66e106d4-c79e-4618-b7bc-f1b80187dc2d tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:04.593649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-66e106d4-c79e-4618-b7bc-f1b80187dc2d tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:04.605748 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3509d15a-9b46-4838-975b-e4d470c76d9a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1470 microversion: 2.1 time: 1.177516 Aug 29 15:41:04.607005 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1923/3914] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:03 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1470 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:04.611547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66e106d4-c79e-4618-b7bc-f1b80187dc2d tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:04.612391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66e106d4-c79e-4618-b7bc-f1b80187dc2d tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:04.612839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66e106d4-c79e-4618-b7bc-f1b80187dc2d tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:04.614671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66e106d4-c79e-4618-b7bc-f1b80187dc2d tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:04.617971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66e106d4-c79e-4618-b7bc-f1b80187dc2d tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:04.620712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66e106d4-c79e-4618-b7bc-f1b80187dc2d tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.064501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5da158ee-09b5-4df1-b3d7-61eccc1377a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:05.065047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5da158ee-09b5-4df1-b3d7-61eccc1377a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:05.080933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5da158ee-09b5-4df1-b3d7-61eccc1377a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.081562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5da158ee-09b5-4df1-b3d7-61eccc1377a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.082052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5da158ee-09b5-4df1-b3d7-61eccc1377a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.082818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5da158ee-09b5-4df1-b3d7-61eccc1377a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.083329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5da158ee-09b5-4df1-b3d7-61eccc1377a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.083764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5da158ee-09b5-4df1-b3d7-61eccc1377a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.095903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-66e106d4-c79e-4618-b7bc-f1b80187dc2d tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5cf3f21f5c402b87099b7dccc24d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65be3b9dae94862b36f8b47bcf427a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:05.120102 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-66e106d4-c79e-4618-b7bc-f1b80187dc2d tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 200 len: 1542 microversion: 2.1 time: 0.532220 Aug 29 15:41:05.123660 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1992/3915] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:04 2022] GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 1542 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:05.420906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-498018ac-049e-4e56-a649-780b19ff7aff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:05.422324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-498018ac-049e-4e56-a649-780b19ff7aff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:05.435469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-498018ac-049e-4e56-a649-780b19ff7aff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.436414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-498018ac-049e-4e56-a649-780b19ff7aff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.440727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-498018ac-049e-4e56-a649-780b19ff7aff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.441866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-498018ac-049e-4e56-a649-780b19ff7aff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.446117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-498018ac-049e-4e56-a649-780b19ff7aff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.450107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-498018ac-049e-4e56-a649-780b19ff7aff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.721391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-498018ac-049e-4e56-a649-780b19ff7aff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:05.734994 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-498018ac-049e-4e56-a649-780b19ff7aff tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.319050 Aug 29 15:41:05.757172 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1993/3916] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:05 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:05.766081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fa32f74d-42d5-4013-971f-ee5a14a50b60 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:05.767343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fa32f74d-42d5-4013-971f-ee5a14a50b60 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:05.767801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5da158ee-09b5-4df1-b3d7-61eccc1377a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:05.778260 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5da158ee-09b5-4df1-b3d7-61eccc1377a0 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1334 microversion: 2.1 time: 0.717807 Aug 29 15:41:05.779420 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1924/3917] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:05 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1334 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:05.784684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ccaa13a9-e7b1-455d-9b6b-20f35f88030f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:05.785648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ccaa13a9-e7b1-455d-9b6b-20f35f88030f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:05.789744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa32f74d-42d5-4013-971f-ee5a14a50b60 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.794063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa32f74d-42d5-4013-971f-ee5a14a50b60 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.794750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa32f74d-42d5-4013-971f-ee5a14a50b60 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.796555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa32f74d-42d5-4013-971f-ee5a14a50b60 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.797337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa32f74d-42d5-4013-971f-ee5a14a50b60 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.797954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa32f74d-42d5-4013-971f-ee5a14a50b60 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.799782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccaa13a9-e7b1-455d-9b6b-20f35f88030f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.800286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccaa13a9-e7b1-455d-9b6b-20f35f88030f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.800738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccaa13a9-e7b1-455d-9b6b-20f35f88030f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.801494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccaa13a9-e7b1-455d-9b6b-20f35f88030f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.801964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccaa13a9-e7b1-455d-9b6b-20f35f88030f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.802391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccaa13a9-e7b1-455d-9b6b-20f35f88030f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.812891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:05.918608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa32f74d-42d5-4013-971f-ee5a14a50b60 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.925419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa32f74d-42d5-4013-971f-ee5a14a50b60 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.926695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa32f74d-42d5-4013-971f-ee5a14a50b60 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.927707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-fa32f74d-42d5-4013-971f-ee5a14a50b60 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lazy-loading 'fault' on Instance uuid bc3fe412-4a55-4b64-9b2f-0302fb13bede {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:06.044530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fa32f74d-42d5-4013-971f-ee5a14a50b60 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:06.065893 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fa32f74d-42d5-4013-971f-ee5a14a50b60 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 200 len: 1304 microversion: 2.1 time: 0.304532 Aug 29 15:41:06.067295 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1994/3918] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:05 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 1304 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:06.077974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-8e1ea2d0-fc02-409a-8b4c-752cba866ae5 req-978c34ab-223b-4833-aedd-b8d3789cc563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3fe412-4a55-4b64-9b2f-0302fb13bede", "name": "network-vif-deleted", "tag": "1cb4516e-b9dd-4bde-96d9-376f37308257"}, {"server_uuid": "ec852709-4ddc-42d0-94da-88df26e5e524", "name": "network-vif-deleted", "tag": "1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:06.098937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8e1ea2d0-fc02-409a-8b4c-752cba866ae5 req-978c34ab-223b-4833-aedd-b8d3789cc563 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.099885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8e1ea2d0-fc02-409a-8b4c-752cba866ae5 req-978c34ab-223b-4833-aedd-b8d3789cc563 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.100542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8e1ea2d0-fc02-409a-8b4c-752cba866ae5 req-978c34ab-223b-4833-aedd-b8d3789cc563 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.122626 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-8e1ea2d0-fc02-409a-8b4c-752cba866ae5 req-978c34ab-223b-4833-aedd-b8d3789cc563 service nova] Creating event network-vif-deleted:1cb4516e-b9dd-4bde-96d9-376f37308257 for instance bc3fe412-4a55-4b64-9b2f-0302fb13bede on n-h2-839401-11 Aug 29 15:41:06.123840 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-8e1ea2d0-fc02-409a-8b4c-752cba866ae5 req-978c34ab-223b-4833-aedd-b8d3789cc563 service nova] Creating event network-vif-deleted:1be5f20b-1d1a-4a38-a2cc-e120d2fc0caf for instance ec852709-4ddc-42d0-94da-88df26e5e524 on n-h1-839401-11 Aug 29 15:41:06.169041 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-8e1ea2d0-fc02-409a-8b4c-752cba866ae5 req-978c34ab-223b-4833-aedd-b8d3789cc563 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099974 Aug 29 15:41:06.174397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ccaa13a9-e7b1-455d-9b6b-20f35f88030f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:06.177526 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1995/3919] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:06.193288 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ccaa13a9-e7b1-455d-9b6b-20f35f88030f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.411198 Aug 29 15:41:06.196397 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1925/3920] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:05 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:06.212516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e3e80b66-307c-40f7-b736-0194d5eb85bd tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:06.213618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e3e80b66-307c-40f7-b736-0194d5eb85bd tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:06.230252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3e80b66-307c-40f7-b736-0194d5eb85bd tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.231728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3e80b66-307c-40f7-b736-0194d5eb85bd tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.232426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cac77f3a-36a2-48eb-8f3e-220bfe298ae7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:06.233069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cac77f3a-36a2-48eb-8f3e-220bfe298ae7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:06.234855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3e80b66-307c-40f7-b736-0194d5eb85bd tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.235882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3e80b66-307c-40f7-b736-0194d5eb85bd tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.236597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3e80b66-307c-40f7-b736-0194d5eb85bd tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.238391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3e80b66-307c-40f7-b736-0194d5eb85bd tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.260592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cac77f3a-36a2-48eb-8f3e-220bfe298ae7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.275467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cac77f3a-36a2-48eb-8f3e-220bfe298ae7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.281914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cac77f3a-36a2-48eb-8f3e-220bfe298ae7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.283268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cac77f3a-36a2-48eb-8f3e-220bfe298ae7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.283756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cac77f3a-36a2-48eb-8f3e-220bfe298ae7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.287761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cac77f3a-36a2-48eb-8f3e-220bfe298ae7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.324109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3e80b66-307c-40f7-b736-0194d5eb85bd tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.326571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3e80b66-307c-40f7-b736-0194d5eb85bd tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.330243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3e80b66-307c-40f7-b736-0194d5eb85bd tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.331348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-e3e80b66-307c-40f7-b736-0194d5eb85bd tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lazy-loading 'fault' on Instance uuid ec852709-4ddc-42d0-94da-88df26e5e524 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:06.456125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e3e80b66-307c-40f7-b736-0194d5eb85bd tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5cf3f21f5c402b87099b7dccc24d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65be3b9dae94862b36f8b47bcf427a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:06.465586 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e3e80b66-307c-40f7-b736-0194d5eb85bd tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 200 len: 1321 microversion: 2.1 time: 0.285109 Aug 29 15:41:06.470731 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1996/3921] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:06 2022] GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:06.801736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c9536048-3d77-4cc3-9949-00a169d6095f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:06.804087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c9536048-3d77-4cc3-9949-00a169d6095f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:06.820196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9536048-3d77-4cc3-9949-00a169d6095f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.820676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9536048-3d77-4cc3-9949-00a169d6095f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.821032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cac77f3a-36a2-48eb-8f3e-220bfe298ae7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:06.821588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9536048-3d77-4cc3-9949-00a169d6095f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.822085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9536048-3d77-4cc3-9949-00a169d6095f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.822546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9536048-3d77-4cc3-9949-00a169d6095f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.822982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9536048-3d77-4cc3-9949-00a169d6095f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.842693 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cac77f3a-36a2-48eb-8f3e-220bfe298ae7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.620096 Aug 29 15:41:06.849572 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1926/3922] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:06 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:06.876994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d1d71aec-6110-4a25-81c2-bfeb5761caa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:06.877671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d1d71aec-6110-4a25-81c2-bfeb5761caa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:06.900483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1d71aec-6110-4a25-81c2-bfeb5761caa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.901435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1d71aec-6110-4a25-81c2-bfeb5761caa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.909228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1d71aec-6110-4a25-81c2-bfeb5761caa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.910512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1d71aec-6110-4a25-81c2-bfeb5761caa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.911321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1d71aec-6110-4a25-81c2-bfeb5761caa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.912160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1d71aec-6110-4a25-81c2-bfeb5761caa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.082138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c9536048-3d77-4cc3-9949-00a169d6095f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:07.092383 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c9536048-3d77-4cc3-9949-00a169d6095f tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1334 microversion: 2.1 time: 0.294606 Aug 29 15:41:07.093559 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1997/3923] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:06 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1334 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:07.098243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0476a1a3-3141-4633-8c9e-9b689d13a83a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.099077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0476a1a3-3141-4633-8c9e-9b689d13a83a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: bc3fe412-4a55-4b64-9b2f-0302fb13bede] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.107168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0476a1a3-3141-4633-8c9e-9b689d13a83a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.107900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0476a1a3-3141-4633-8c9e-9b689d13a83a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.108507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0476a1a3-3141-4633-8c9e-9b689d13a83a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.109429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0476a1a3-3141-4633-8c9e-9b689d13a83a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.110085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0476a1a3-3141-4633-8c9e-9b689d13a83a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.110777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0476a1a3-3141-4633-8c9e-9b689d13a83a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.128203 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-0476a1a3-3141-4633-8c9e-9b689d13a83a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] HTTP exception thrown: Instance bc3fe412-4a55-4b64-9b2f-0302fb13bede could not be found. Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0476a1a3-3141-4633-8c9e-9b689d13a83a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Request method failure captured: Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede HTTP/1.1 Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN17kQX8gyP42unj-MO47TV6oW6b2E58MRSnBGSLus-E-1pnuTD8pRtN7Z7btTzCN-c-qMJAQkarJh9vqJpotlpX_Ax2_UH-s7yS30Ofolf2KdP6XWwq_RUwrvFNRAp-mJXHib9j1V6JFvPkQGptQSg1KSv2M18zJvdO6eJpuvtrs4c Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: f7b1f33fac61405285832b32e2a5c0b4 Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersAdminTestJSON-1468164546 Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f7b1f33fac61405285832b32e2a5c0b4", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f7b1f33fac61405285832b32e2a5c0b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7b1f33fac61405285832b32e2a5c0b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7b1f33fac61405285832b32e2a5c0b4"}]}] Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersAdminTestJSON-1468164546 Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: f7b1f33fac61405285832b32e2a5c0b4 Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersAdminTestJSON-1468164546 Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersAdminTestJSON-1468164546-project Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 0fefa09e4bbb4101b5f05a2f20fcb41c Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersAdminTestJSON-1468164546-project Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance bc3fe412-4a55-4b64-9b2f-0302fb13bede could not be found. Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'bc3fe412-4a55-4b64-9b2f-0302fb13bede'} Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc3fe412-4a55-4b64-9b2f-0302fb13bede could not be found. Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc3fe412-4a55-4b64-9b2f-0302fb13bede could not be found. Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.130216 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.136222 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.136222 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.136222 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.136222 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:07.136222 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:07.136222 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc3fe412-4a55-4b64-9b2f-0302fb13bede could not be found. Aug 29 15:41:07.136222 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.136222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0476a1a3-3141-4633-8c9e-9b689d13a83a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Returning 404 to user: Instance bc3fe412-4a55-4b64-9b2f-0302fb13bede could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:07.136222 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0476a1a3-3141-4633-8c9e-9b689d13a83a tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede" status: 404 len: 111 microversion: 2.1 time: 0.037178 Aug 29 15:41:07.136222 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1998/3924] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] GET /compute/v2.1/servers/bc3fe412-4a55-4b64-9b2f-0302fb13bede => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:07.145375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e6194fc8-b9df-4420-ae14-483f137d41b1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.146325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e6194fc8-b9df-4420-ae14-483f137d41b1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.153147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6194fc8-b9df-4420-ae14-483f137d41b1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.154203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6194fc8-b9df-4420-ae14-483f137d41b1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.154939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6194fc8-b9df-4420-ae14-483f137d41b1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.155951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6194fc8-b9df-4420-ae14-483f137d41b1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.156622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6194fc8-b9df-4420-ae14-483f137d41b1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.157244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6194fc8-b9df-4420-ae14-483f137d41b1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.193271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e6194fc8-b9df-4420-ae14-483f137d41b1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:41:07.212727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d1d71aec-6110-4a25-81c2-bfeb5761caa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:07.223809 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d1d71aec-6110-4a25-81c2-bfeb5761caa9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.355392 Aug 29 15:41:07.226841 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1927/3925] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:06 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:07.253835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-338e0a29-c511-4ac1-b6df-62e48c15eff8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.254907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-338e0a29-c511-4ac1-b6df-62e48c15eff8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.267298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-338e0a29-c511-4ac1-b6df-62e48c15eff8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.267816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-338e0a29-c511-4ac1-b6df-62e48c15eff8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.269070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-338e0a29-c511-4ac1-b6df-62e48c15eff8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.271501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-338e0a29-c511-4ac1-b6df-62e48c15eff8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.271975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-338e0a29-c511-4ac1-b6df-62e48c15eff8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.272408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-338e0a29-c511-4ac1-b6df-62e48c15eff8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.350314 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e6194fc8-b9df-4420-ae14-483f137d41b1 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 204 len: 0 microversion: 2.1 time: 0.212925 Aug 29 15:41:07.351284 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 1999/3926] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:07 2022] DELETE /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:07.362982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-086f5a2c-8bfb-46d1-8eb1-33b46eb3afca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.364468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-086f5a2c-8bfb-46d1-8eb1-33b46eb3afca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.372625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-086f5a2c-8bfb-46d1-8eb1-33b46eb3afca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.373975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-086f5a2c-8bfb-46d1-8eb1-33b46eb3afca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.373975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-086f5a2c-8bfb-46d1-8eb1-33b46eb3afca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.374970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-086f5a2c-8bfb-46d1-8eb1-33b46eb3afca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.375401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-086f5a2c-8bfb-46d1-8eb1-33b46eb3afca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.376323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-086f5a2c-8bfb-46d1-8eb1-33b46eb3afca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.487224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-338e0a29-c511-4ac1-b6df-62e48c15eff8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:07.495506 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-338e0a29-c511-4ac1-b6df-62e48c15eff8 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.246375 Aug 29 15:41:07.515090 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1928/3927] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:07.528351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5604bd9e-9ed2-4ce2-9e14-fa51136cd70c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.532753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5604bd9e-9ed2-4ce2-9e14-fa51136cd70c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.549977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5604bd9e-9ed2-4ce2-9e14-fa51136cd70c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.551900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5604bd9e-9ed2-4ce2-9e14-fa51136cd70c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.552493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5604bd9e-9ed2-4ce2-9e14-fa51136cd70c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.554336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5604bd9e-9ed2-4ce2-9e14-fa51136cd70c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.558236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5604bd9e-9ed2-4ce2-9e14-fa51136cd70c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.558771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5604bd9e-9ed2-4ce2-9e14-fa51136cd70c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.659118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-086f5a2c-8bfb-46d1-8eb1-33b46eb3afca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:07.672324 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-086f5a2c-8bfb-46d1-8eb1-33b46eb3afca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1468 microversion: 2.1 time: 0.315338 Aug 29 15:41:07.673544 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2000/3928] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1468 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:07.679156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0146b8b8-eea7-45ea-bab8-60c84d1a6751 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.679977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0146b8b8-eea7-45ea-bab8-60c84d1a6751 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] [instance: ec852709-4ddc-42d0-94da-88df26e5e524] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.697368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0146b8b8-eea7-45ea-bab8-60c84d1a6751 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.697841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0146b8b8-eea7-45ea-bab8-60c84d1a6751 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.698287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0146b8b8-eea7-45ea-bab8-60c84d1a6751 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.699007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0146b8b8-eea7-45ea-bab8-60c84d1a6751 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.699463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0146b8b8-eea7-45ea-bab8-60c84d1a6751 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.699892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0146b8b8-eea7-45ea-bab8-60c84d1a6751 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.718780 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-0146b8b8-eea7-45ea-bab8-60c84d1a6751 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] HTTP exception thrown: Instance ec852709-4ddc-42d0-94da-88df26e5e524 could not be found. Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0146b8b8-eea7-45ea-bab8-60c84d1a6751 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Request method failure captured: Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 HTTP/1.1 Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN3uVA0dAB0R7z39dpULTYP4DKXMvY7a2LFfUUazNtlfXhDRDEqmoAVa6QyYbsJ5kLF2PevffX89ieePWXZzduTNFlDgcMFDpxposXi0Smn1tFZuMNV7YVRcmfb6-fav6EIttMYO3HD1gHaEc9A-JD57cwMnfouQLV48t-2YYbQNx-g Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: e65be3b9dae94862b36f8b47bcf427a9 Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-548794726 Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e65be3b9dae94862b36f8b47bcf427a9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e65be3b9dae94862b36f8b47bcf427a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e65be3b9dae94862b36f8b47bcf427a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e65be3b9dae94862b36f8b47bcf427a9"}]}] Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-548794726 Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: e65be3b9dae94862b36f8b47bcf427a9 Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-548794726 Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6d5cf3f21f5c402b87099b7dccc24d35 Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance ec852709-4ddc-42d0-94da-88df26e5e524 could not be found. Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'ec852709-4ddc-42d0-94da-88df26e5e524'} Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec852709-4ddc-42d0-94da-88df26e5e524 could not be found. Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec852709-4ddc-42d0-94da-88df26e5e524 could not be found. Aug 29 15:41:07.720804 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.726121 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:07.726121 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.726121 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:07.726121 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:07.726121 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:07.726121 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:07.726121 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:07.726121 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec852709-4ddc-42d0-94da-88df26e5e524 could not be found. Aug 29 15:41:07.726121 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:07.727778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0146b8b8-eea7-45ea-bab8-60c84d1a6751 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] Returning 404 to user: Instance ec852709-4ddc-42d0-94da-88df26e5e524 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:07.728855 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0146b8b8-eea7-45ea-bab8-60c84d1a6751 tempest-FloatingIPsAssociationNegativeTestJSON-548794726 tempest-FloatingIPsAssociationNegativeTestJSON-548794726-project] 10.222.0.62 "GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524" status: 404 len: 111 microversion: 2.1 time: 0.054103 Aug 29 15:41:07.729650 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2001/3929] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] GET /compute/v2.1/servers/ec852709-4ddc-42d0-94da-88df26e5e524 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:07.774972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5604bd9e-9ed2-4ce2-9e14-fa51136cd70c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:07.788573 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5604bd9e-9ed2-4ce2-9e14-fa51136cd70c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.265430 Aug 29 15:41:07.801123 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1929/3930] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:08.130158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-523f2916-be85-484b-9810-b5abb370d481 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:08.130812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-523f2916-be85-484b-9810-b5abb370d481 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:08.145308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-523f2916-be85-484b-9810-b5abb370d481 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.146079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-523f2916-be85-484b-9810-b5abb370d481 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.146687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-523f2916-be85-484b-9810-b5abb370d481 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.147704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-523f2916-be85-484b-9810-b5abb370d481 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.148739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-523f2916-be85-484b-9810-b5abb370d481 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.148739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-523f2916-be85-484b-9810-b5abb370d481 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.205629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-a8f260b6-c268-4a0a-887d-11e31756ef29 req-2f20c12b-87ac-413a-95c6-9dd9c19786a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f529d0ad-a342-49fc-a7d6-f3279fef0eae", "tag": "8c05207c-16a2-409d-a23b-5e308ea71024"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:08.217834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a8f260b6-c268-4a0a-887d-11e31756ef29 req-2f20c12b-87ac-413a-95c6-9dd9c19786a1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.218660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a8f260b6-c268-4a0a-887d-11e31756ef29 req-2f20c12b-87ac-413a-95c6-9dd9c19786a1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.219362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a8f260b6-c268-4a0a-887d-11e31756ef29 req-2f20c12b-87ac-413a-95c6-9dd9c19786a1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.232520 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-a8f260b6-c268-4a0a-887d-11e31756ef29 req-2f20c12b-87ac-413a-95c6-9dd9c19786a1 service nova] Creating event network-changed:8c05207c-16a2-409d-a23b-5e308ea71024 for instance f529d0ad-a342-49fc-a7d6-f3279fef0eae on n-h2-839401-11 Aug 29 15:41:08.241520 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-a8f260b6-c268-4a0a-887d-11e31756ef29 req-2f20c12b-87ac-413a-95c6-9dd9c19786a1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040107 Aug 29 15:41:08.241948 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1930/3931] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:08.442624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-523f2916-be85-484b-9810-b5abb370d481 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:08.452163 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-523f2916-be85-484b-9810-b5abb370d481 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1334 microversion: 2.1 time: 0.326616 Aug 29 15:41:08.466074 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2002/3932] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:08 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1334 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:08.701594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-beadf90e-6d55-48c7-b23a-82493d13888d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:08.702554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-beadf90e-6d55-48c7-b23a-82493d13888d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:08.715214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-beadf90e-6d55-48c7-b23a-82493d13888d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.716038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-beadf90e-6d55-48c7-b23a-82493d13888d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.716880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-beadf90e-6d55-48c7-b23a-82493d13888d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.717979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-beadf90e-6d55-48c7-b23a-82493d13888d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.718853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-beadf90e-6d55-48c7-b23a-82493d13888d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.719632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-beadf90e-6d55-48c7-b23a-82493d13888d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:09.114003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-beadf90e-6d55-48c7-b23a-82493d13888d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:09.125163 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-beadf90e-6d55-48c7-b23a-82493d13888d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1468 microversion: 2.1 time: 0.428159 Aug 29 15:41:09.126583 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1931/3933] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:08 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1468 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:09.478417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1d6e9e32-6b90-40e4-a0d3-7114f4e7641e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:09.479673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1d6e9e32-6b90-40e4-a0d3-7114f4e7641e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:09.487935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d6e9e32-6b90-40e4-a0d3-7114f4e7641e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:09.488805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d6e9e32-6b90-40e4-a0d3-7114f4e7641e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:09.489545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d6e9e32-6b90-40e4-a0d3-7114f4e7641e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:09.490486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d6e9e32-6b90-40e4-a0d3-7114f4e7641e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:09.491117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d6e9e32-6b90-40e4-a0d3-7114f4e7641e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:09.491707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d6e9e32-6b90-40e4-a0d3-7114f4e7641e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:09.776793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1d6e9e32-6b90-40e4-a0d3-7114f4e7641e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:09.796585 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1d6e9e32-6b90-40e4-a0d3-7114f4e7641e tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1334 microversion: 2.1 time: 0.324187 Aug 29 15:41:09.814258 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2003/3934] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:09 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1334 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:10.150717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1ef79526-b45b-45c5-956b-b69a758106d4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:10.152389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1ef79526-b45b-45c5-956b-b69a758106d4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:10.164004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef79526-b45b-45c5-956b-b69a758106d4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:10.166759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef79526-b45b-45c5-956b-b69a758106d4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:10.167380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef79526-b45b-45c5-956b-b69a758106d4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:10.168285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef79526-b45b-45c5-956b-b69a758106d4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:10.170073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef79526-b45b-45c5-956b-b69a758106d4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:10.170716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ef79526-b45b-45c5-956b-b69a758106d4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:10.397568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1ef79526-b45b-45c5-956b-b69a758106d4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:10.418830 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1ef79526-b45b-45c5-956b-b69a758106d4 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1468 microversion: 2.1 time: 0.268690 Aug 29 15:41:10.420257 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1932/3935] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:10 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1468 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:10.819668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-af8c43cf-d2d6-4666-a5f4-b56f8200fff1 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:10.820902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-af8c43cf-d2d6-4666-a5f4-b56f8200fff1 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:10.836246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af8c43cf-d2d6-4666-a5f4-b56f8200fff1 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:10.837308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af8c43cf-d2d6-4666-a5f4-b56f8200fff1 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:10.841826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af8c43cf-d2d6-4666-a5f4-b56f8200fff1 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:10.842610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af8c43cf-d2d6-4666-a5f4-b56f8200fff1 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:10.843078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af8c43cf-d2d6-4666-a5f4-b56f8200fff1 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:10.843504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af8c43cf-d2d6-4666-a5f4-b56f8200fff1 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.195042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-af8c43cf-d2d6-4666-a5f4-b56f8200fff1 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:11.208091 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-af8c43cf-d2d6-4666-a5f4-b56f8200fff1 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1334 microversion: 2.1 time: 0.393091 Aug 29 15:41:11.226486 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2004/3936] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:10 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1334 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:11.442674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6158bc5b-60ce-45dd-90ec-321c91baf72d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:11.443908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6158bc5b-60ce-45dd-90ec-321c91baf72d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:11.453654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6158bc5b-60ce-45dd-90ec-321c91baf72d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.462543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6158bc5b-60ce-45dd-90ec-321c91baf72d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.463190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6158bc5b-60ce-45dd-90ec-321c91baf72d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.464137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6158bc5b-60ce-45dd-90ec-321c91baf72d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.464788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6158bc5b-60ce-45dd-90ec-321c91baf72d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.465436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6158bc5b-60ce-45dd-90ec-321c91baf72d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.726269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6158bc5b-60ce-45dd-90ec-321c91baf72d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:11.743415 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6158bc5b-60ce-45dd-90ec-321c91baf72d tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1468 microversion: 2.1 time: 0.305238 Aug 29 15:41:11.747580 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1933/3937] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:11 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1468 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:12.240424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ab49a5be-4a9e-4ea5-ad58-6dd8273716f6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:12.241896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ab49a5be-4a9e-4ea5-ad58-6dd8273716f6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:12.246149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:12.264375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab49a5be-4a9e-4ea5-ad58-6dd8273716f6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:12.266705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab49a5be-4a9e-4ea5-ad58-6dd8273716f6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:12.268784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab49a5be-4a9e-4ea5-ad58-6dd8273716f6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.271229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab49a5be-4a9e-4ea5-ad58-6dd8273716f6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:12.272623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab49a5be-4a9e-4ea5-ad58-6dd8273716f6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:12.279275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab49a5be-4a9e-4ea5-ad58-6dd8273716f6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.697508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ab49a5be-4a9e-4ea5-ad58-6dd8273716f6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:12.711387 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ab49a5be-4a9e-4ea5-ad58-6dd8273716f6 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1334 microversion: 2.1 time: 0.483107 Aug 29 15:41:12.727758 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2005/3938] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:12 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1334 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:12.769426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c6dfb096-6cd5-4324-9765-5ae11b32b6a3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:12.770205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c6dfb096-6cd5-4324-9765-5ae11b32b6a3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:12.810805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6dfb096-6cd5-4324-9765-5ae11b32b6a3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:12.815212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6dfb096-6cd5-4324-9765-5ae11b32b6a3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:12.816548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6dfb096-6cd5-4324-9765-5ae11b32b6a3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.818538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6dfb096-6cd5-4324-9765-5ae11b32b6a3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:12.820058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6dfb096-6cd5-4324-9765-5ae11b32b6a3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:12.821960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6dfb096-6cd5-4324-9765-5ae11b32b6a3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:13.433764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c6dfb096-6cd5-4324-9765-5ae11b32b6a3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:13.453768 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c6dfb096-6cd5-4324-9765-5ae11b32b6a3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1468 microversion: 2.1 time: 0.688344 Aug 29 15:41:13.456435 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1934/3939] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:12 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1468 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:13.559366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c744c883-2f98-482c-b9ba-ef0375318178 req-44f51846-37eb-4ca8-8413-0833c37039a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fdeef99-bce1-4bb6-bf12-24015bdb7f39", "name": "network-vif-unplugged", "status": "completed", "tag": "cc66c773-9cfd-4821-96c2-56ba74e4c8da"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:13.596088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c744c883-2f98-482c-b9ba-ef0375318178 req-44f51846-37eb-4ca8-8413-0833c37039a0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:13.597948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c744c883-2f98-482c-b9ba-ef0375318178 req-44f51846-37eb-4ca8-8413-0833c37039a0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:13.598569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c744c883-2f98-482c-b9ba-ef0375318178 req-44f51846-37eb-4ca8-8413-0833c37039a0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:13.635357 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c744c883-2f98-482c-b9ba-ef0375318178 req-44f51846-37eb-4ca8-8413-0833c37039a0 service nova] Creating event network-vif-unplugged:cc66c773-9cfd-4821-96c2-56ba74e4c8da for instance 1fdeef99-bce1-4bb6-bf12-24015bdb7f39 on n-h2-839401-11 Aug 29 15:41:13.653153 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c744c883-2f98-482c-b9ba-ef0375318178 req-44f51846-37eb-4ca8-8413-0833c37039a0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095299 Aug 29 15:41:13.655078 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2006/3940] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:13.749810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e0adbaa1-47d8-4084-abaa-c21653ba23d4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:13.750579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e0adbaa1-47d8-4084-abaa-c21653ba23d4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:13.757293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0adbaa1-47d8-4084-abaa-c21653ba23d4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:13.761572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0adbaa1-47d8-4084-abaa-c21653ba23d4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:13.762232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0adbaa1-47d8-4084-abaa-c21653ba23d4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:13.763532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0adbaa1-47d8-4084-abaa-c21653ba23d4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:13.764192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0adbaa1-47d8-4084-abaa-c21653ba23d4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:13.764715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0adbaa1-47d8-4084-abaa-c21653ba23d4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:13.969722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a8cfb1fe-249d-4f6f-92aa-7daae486f1f0 req-157bc670-ff08-4ee8-bbc1-5ebdcb96f11d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fdeef99-bce1-4bb6-bf12-24015bdb7f39", "name": "network-vif-deleted", "tag": "cc66c773-9cfd-4821-96c2-56ba74e4c8da"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:13.989518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a8cfb1fe-249d-4f6f-92aa-7daae486f1f0 req-157bc670-ff08-4ee8-bbc1-5ebdcb96f11d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:13.991392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a8cfb1fe-249d-4f6f-92aa-7daae486f1f0 req-157bc670-ff08-4ee8-bbc1-5ebdcb96f11d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:13.993047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a8cfb1fe-249d-4f6f-92aa-7daae486f1f0 req-157bc670-ff08-4ee8-bbc1-5ebdcb96f11d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:14.039833 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a8cfb1fe-249d-4f6f-92aa-7daae486f1f0 req-157bc670-ff08-4ee8-bbc1-5ebdcb96f11d service nova] Creating event network-vif-deleted:cc66c773-9cfd-4821-96c2-56ba74e4c8da for instance 1fdeef99-bce1-4bb6-bf12-24015bdb7f39 on n-h2-839401-11 Aug 29 15:41:14.047026 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a8cfb1fe-249d-4f6f-92aa-7daae486f1f0 req-157bc670-ff08-4ee8-bbc1-5ebdcb96f11d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082631 Aug 29 15:41:14.048600 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2007/3941] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:41:14.114595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e0adbaa1-47d8-4084-abaa-c21653ba23d4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:14.117196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:14.124708 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e0adbaa1-47d8-4084-abaa-c21653ba23d4 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1334 microversion: 2.1 time: 0.379914 Aug 29 15:41:14.125974 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1935/3942] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:13 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1334 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:14.478128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2cf73844-678a-4c22-a5e9-e0cfbfcda1da tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:14.478841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2cf73844-678a-4c22-a5e9-e0cfbfcda1da tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:14.487025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cf73844-678a-4c22-a5e9-e0cfbfcda1da tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:14.487776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cf73844-678a-4c22-a5e9-e0cfbfcda1da tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:14.488894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cf73844-678a-4c22-a5e9-e0cfbfcda1da tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:14.489821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cf73844-678a-4c22-a5e9-e0cfbfcda1da tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:14.490440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cf73844-678a-4c22-a5e9-e0cfbfcda1da tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:14.491028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cf73844-678a-4c22-a5e9-e0cfbfcda1da tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:14.530627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cf73844-678a-4c22-a5e9-e0cfbfcda1da tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:14.531511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cf73844-678a-4c22-a5e9-e0cfbfcda1da tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:14.532458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cf73844-678a-4c22-a5e9-e0cfbfcda1da tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:14.532922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-2cf73844-678a-4c22-a5e9-e0cfbfcda1da tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lazy-loading 'fault' on Instance uuid 1fdeef99-bce1-4bb6-bf12-24015bdb7f39 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:14.590985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2cf73844-678a-4c22-a5e9-e0cfbfcda1da tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:14.602872 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2cf73844-678a-4c22-a5e9-e0cfbfcda1da tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 200 len: 1303 microversion: 2.1 time: 0.129067 Aug 29 15:41:14.603700 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2008/3943] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:14 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 1303 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:15.147294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4e1443c7-3c6f-4262-b612-485ce7fb4c39 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:15.147963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4e1443c7-3c6f-4262-b612-485ce7fb4c39 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:15.163675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e1443c7-3c6f-4262-b612-485ce7fb4c39 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:15.164241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e1443c7-3c6f-4262-b612-485ce7fb4c39 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:15.164775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e1443c7-3c6f-4262-b612-485ce7fb4c39 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:15.165808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e1443c7-3c6f-4262-b612-485ce7fb4c39 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:15.174300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e1443c7-3c6f-4262-b612-485ce7fb4c39 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:15.175032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e1443c7-3c6f-4262-b612-485ce7fb4c39 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:15.535245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4e1443c7-3c6f-4262-b612-485ce7fb4c39 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:15.550024 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4e1443c7-3c6f-4262-b612-485ce7fb4c39 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1334 microversion: 2.1 time: 0.407159 Aug 29 15:41:15.551262 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1936/3944] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:15 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1334 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:15.624919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c67d3c66-9057-4351-bdc5-b36044442112 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:15.626734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c67d3c66-9057-4351-bdc5-b36044442112 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: 1fdeef99-bce1-4bb6-bf12-24015bdb7f39] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:15.637405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c67d3c66-9057-4351-bdc5-b36044442112 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:15.638415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c67d3c66-9057-4351-bdc5-b36044442112 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:15.639134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c67d3c66-9057-4351-bdc5-b36044442112 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:15.640492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c67d3c66-9057-4351-bdc5-b36044442112 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:15.641685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c67d3c66-9057-4351-bdc5-b36044442112 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:15.642337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c67d3c66-9057-4351-bdc5-b36044442112 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:15.662796 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-c67d3c66-9057-4351-bdc5-b36044442112 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] HTTP exception thrown: Instance 1fdeef99-bce1-4bb6-bf12-24015bdb7f39 could not be found. Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c67d3c66-9057-4351-bdc5-b36044442112 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Request method failure captured: Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 HTTP/1.1 Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN17kQX8gyP42unj-MO47TV6oW6b2E58MRSnBGSLus-E-1pnuTD8pRtN7Z7btTzCN-c-qMJAQkarJh9vqJpotlpX_Ax2_UH-s7yS30Ofolf2KdP6XWwq_RUwrvFNRAp-mJXHib9j1V6JFvPkQGptQSg1KSv2M18zJvdO6eJpuvtrs4c Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: f7b1f33fac61405285832b32e2a5c0b4 Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersAdminTestJSON-1468164546 Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f7b1f33fac61405285832b32e2a5c0b4", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f7b1f33fac61405285832b32e2a5c0b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7b1f33fac61405285832b32e2a5c0b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7b1f33fac61405285832b32e2a5c0b4"}]}] Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersAdminTestJSON-1468164546 Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: f7b1f33fac61405285832b32e2a5c0b4 Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersAdminTestJSON-1468164546 Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersAdminTestJSON-1468164546-project Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 0fefa09e4bbb4101b5f05a2f20fcb41c Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersAdminTestJSON-1468164546-project Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 1fdeef99-bce1-4bb6-bf12-24015bdb7f39 could not be found. Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '1fdeef99-bce1-4bb6-bf12-24015bdb7f39'} Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fdeef99-bce1-4bb6-bf12-24015bdb7f39 could not be found. Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fdeef99-bce1-4bb6-bf12-24015bdb7f39 could not be found. Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:15.665306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:15.671438 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:15.671438 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:15.671438 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:15.671438 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:15.671438 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:15.671438 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fdeef99-bce1-4bb6-bf12-24015bdb7f39 could not be found. Aug 29 15:41:15.671438 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:15.673713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c67d3c66-9057-4351-bdc5-b36044442112 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Returning 404 to user: Instance 1fdeef99-bce1-4bb6-bf12-24015bdb7f39 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:15.675061 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c67d3c66-9057-4351-bdc5-b36044442112 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39" status: 404 len: 111 microversion: 2.1 time: 0.054136 Aug 29 15:41:15.679122 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2009/3945] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:15 2022] GET /compute/v2.1/servers/1fdeef99-bce1-4bb6-bf12-24015bdb7f39 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:15.684148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-14377b92-b6ed-4fad-9b7a-69ae9299666c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:15.684853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-14377b92-b6ed-4fad-9b7a-69ae9299666c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:15.691560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14377b92-b6ed-4fad-9b7a-69ae9299666c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:15.692999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14377b92-b6ed-4fad-9b7a-69ae9299666c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:15.693674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14377b92-b6ed-4fad-9b7a-69ae9299666c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:15.694592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14377b92-b6ed-4fad-9b7a-69ae9299666c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:15.695230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14377b92-b6ed-4fad-9b7a-69ae9299666c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:15.695898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14377b92-b6ed-4fad-9b7a-69ae9299666c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:15.732138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-14377b92-b6ed-4fad-9b7a-69ae9299666c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:41:15.828585 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-14377b92-b6ed-4fad-9b7a-69ae9299666c tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 204 len: 0 microversion: 2.1 time: 0.147948 Aug 29 15:41:15.833457 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1937/3946] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:15 2022] DELETE /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:41:15.839446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-896fd7e2-90e1-44bf-b1a5-1ee6477e33af tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:15.840444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-896fd7e2-90e1-44bf-b1a5-1ee6477e33af tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:15.852082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-896fd7e2-90e1-44bf-b1a5-1ee6477e33af tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:15.852916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-896fd7e2-90e1-44bf-b1a5-1ee6477e33af tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:15.853384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-896fd7e2-90e1-44bf-b1a5-1ee6477e33af tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:15.854097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-896fd7e2-90e1-44bf-b1a5-1ee6477e33af tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:15.854830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-896fd7e2-90e1-44bf-b1a5-1ee6477e33af tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:15.855155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-896fd7e2-90e1-44bf-b1a5-1ee6477e33af tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:16.188188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-896fd7e2-90e1-44bf-b1a5-1ee6477e33af tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:16.199495 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-896fd7e2-90e1-44bf-b1a5-1ee6477e33af tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1470 microversion: 2.1 time: 0.365005 Aug 29 15:41:16.200088 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2010/3947] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:15 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1470 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:16.575662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cb798a53-becb-4aee-9975-7dc32a85b262 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:16.577282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cb798a53-becb-4aee-9975-7dc32a85b262 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:16.586263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb798a53-becb-4aee-9975-7dc32a85b262 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:16.592937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb798a53-becb-4aee-9975-7dc32a85b262 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:16.593684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb798a53-becb-4aee-9975-7dc32a85b262 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:16.594901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb798a53-becb-4aee-9975-7dc32a85b262 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:16.597629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb798a53-becb-4aee-9975-7dc32a85b262 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:16.598116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb798a53-becb-4aee-9975-7dc32a85b262 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:16.826641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cb798a53-becb-4aee-9975-7dc32a85b262 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:16.837693 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cb798a53-becb-4aee-9975-7dc32a85b262 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1334 microversion: 2.1 time: 0.266880 Aug 29 15:41:16.839322 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1938/3948] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:16 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1334 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:17.220148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-73909385-b9d0-4c79-b9ab-e88093fed5ca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:17.220776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-73909385-b9d0-4c79-b9ab-e88093fed5ca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:17.232379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73909385-b9d0-4c79-b9ab-e88093fed5ca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:17.233403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73909385-b9d0-4c79-b9ab-e88093fed5ca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:17.234397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73909385-b9d0-4c79-b9ab-e88093fed5ca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:17.236618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73909385-b9d0-4c79-b9ab-e88093fed5ca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:17.237456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73909385-b9d0-4c79-b9ab-e88093fed5ca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:17.238061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73909385-b9d0-4c79-b9ab-e88093fed5ca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:17.597475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-73909385-b9d0-4c79-b9ab-e88093fed5ca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:17.614640 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-73909385-b9d0-4c79-b9ab-e88093fed5ca tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1470 microversion: 2.1 time: 0.395366 Aug 29 15:41:17.616297 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2011/3949] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:17 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1470 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:17.863180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-989ed1de-1765-4710-a504-2a9d712572cf tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:17.863808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-989ed1de-1765-4710-a504-2a9d712572cf tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:17.875267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-989ed1de-1765-4710-a504-2a9d712572cf tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:17.877956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-989ed1de-1765-4710-a504-2a9d712572cf tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:17.878517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-989ed1de-1765-4710-a504-2a9d712572cf tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:17.880155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-989ed1de-1765-4710-a504-2a9d712572cf tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:17.880693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-989ed1de-1765-4710-a504-2a9d712572cf tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:17.881152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-989ed1de-1765-4710-a504-2a9d712572cf tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:18.230825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-989ed1de-1765-4710-a504-2a9d712572cf tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:18.242694 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-989ed1de-1765-4710-a504-2a9d712572cf tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1334 microversion: 2.1 time: 0.387139 Aug 29 15:41:18.243338 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1939/3950] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:17 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1334 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:18.637429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fd4ec53a-617e-4efb-922b-4d7ed16fecc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:18.638700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fd4ec53a-617e-4efb-922b-4d7ed16fecc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:18.650766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd4ec53a-617e-4efb-922b-4d7ed16fecc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:18.651344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd4ec53a-617e-4efb-922b-4d7ed16fecc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:18.657713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd4ec53a-617e-4efb-922b-4d7ed16fecc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:18.658475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd4ec53a-617e-4efb-922b-4d7ed16fecc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:18.659353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd4ec53a-617e-4efb-922b-4d7ed16fecc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:18.660040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd4ec53a-617e-4efb-922b-4d7ed16fecc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:18.742875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:18.966240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd4ec53a-617e-4efb-922b-4d7ed16fecc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:18.975167 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fd4ec53a-617e-4efb-922b-4d7ed16fecc5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1470 microversion: 2.1 time: 0.342470 Aug 29 15:41:18.979548 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2012/3951] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:18 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1470 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:19.219649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-1446b997-5805-4a01-96de-5aad6ed28c31 req-66335592-8cc3-4418-ac50-383e4e6d7927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f529d0ad-a342-49fc-a7d6-f3279fef0eae", "name": "network-vif-plugged", "status": "completed", "tag": "8c05207c-16a2-409d-a23b-5e308ea71024"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:19.241344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1446b997-5805-4a01-96de-5aad6ed28c31 req-66335592-8cc3-4418-ac50-383e4e6d7927 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:19.241850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1446b997-5805-4a01-96de-5aad6ed28c31 req-66335592-8cc3-4418-ac50-383e4e6d7927 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:19.243516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1446b997-5805-4a01-96de-5aad6ed28c31 req-66335592-8cc3-4418-ac50-383e4e6d7927 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:19.267852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f3d6c34d-b6e9-4b64-b595-93c8fbd21719 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:19.268856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f3d6c34d-b6e9-4b64-b595-93c8fbd21719 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:19.269479 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-1446b997-5805-4a01-96de-5aad6ed28c31 req-66335592-8cc3-4418-ac50-383e4e6d7927 service nova] Creating event network-vif-plugged:8c05207c-16a2-409d-a23b-5e308ea71024 for instance f529d0ad-a342-49fc-a7d6-f3279fef0eae on n-h2-839401-11 Aug 29 15:41:19.283823 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-1446b997-5805-4a01-96de-5aad6ed28c31 req-66335592-8cc3-4418-ac50-383e4e6d7927 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068525 Aug 29 15:41:19.286570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3d6c34d-b6e9-4b64-b595-93c8fbd21719 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:19.287437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3d6c34d-b6e9-4b64-b595-93c8fbd21719 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:19.287947 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1940/3952] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:19.289496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3d6c34d-b6e9-4b64-b595-93c8fbd21719 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:19.291635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3d6c34d-b6e9-4b64-b595-93c8fbd21719 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:19.294366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3d6c34d-b6e9-4b64-b595-93c8fbd21719 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:19.296290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3d6c34d-b6e9-4b64-b595-93c8fbd21719 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:19.648938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f3d6c34d-b6e9-4b64-b595-93c8fbd21719 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:19.658440 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f3d6c34d-b6e9-4b64-b595-93c8fbd21719 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1334 microversion: 2.1 time: 0.395686 Aug 29 15:41:19.676395 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2013/3953] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:19 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1334 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:19.853727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-e54e6171-eaf9-4177-8ed9-679bd1fabc9e req-bded36d3-e478-4b6a-99f8-df872f3e7215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1199ee4-c322-4c37-a53e-1bf029c7f14c", "name": "network-vif-deleted", "tag": "b9c1844c-f849-40a4-b1f6-8dffc854044e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:19.882374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e54e6171-eaf9-4177-8ed9-679bd1fabc9e req-bded36d3-e478-4b6a-99f8-df872f3e7215 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:19.885146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e54e6171-eaf9-4177-8ed9-679bd1fabc9e req-bded36d3-e478-4b6a-99f8-df872f3e7215 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:19.885846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e54e6171-eaf9-4177-8ed9-679bd1fabc9e req-bded36d3-e478-4b6a-99f8-df872f3e7215 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:19.911773 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-e54e6171-eaf9-4177-8ed9-679bd1fabc9e req-bded36d3-e478-4b6a-99f8-df872f3e7215 service nova] Creating event network-vif-deleted:b9c1844c-f849-40a4-b1f6-8dffc854044e for instance b1199ee4-c322-4c37-a53e-1bf029c7f14c on n-h2-839401-11 Aug 29 15:41:19.925433 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-e54e6171-eaf9-4177-8ed9-679bd1fabc9e req-bded36d3-e478-4b6a-99f8-df872f3e7215 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084625 Aug 29 15:41:19.928505 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1941/3954] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:19.998702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-620fa04c-f816-4832-853e-d9360afcb4d3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:19.999314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-620fa04c-f816-4832-853e-d9360afcb4d3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:20.007455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-620fa04c-f816-4832-853e-d9360afcb4d3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:20.008533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-620fa04c-f816-4832-853e-d9360afcb4d3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:20.009287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-620fa04c-f816-4832-853e-d9360afcb4d3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:20.022434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-620fa04c-f816-4832-853e-d9360afcb4d3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:20.023107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-620fa04c-f816-4832-853e-d9360afcb4d3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:20.023779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-620fa04c-f816-4832-853e-d9360afcb4d3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:20.100067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-620fa04c-f816-4832-853e-d9360afcb4d3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:20.100810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-620fa04c-f816-4832-853e-d9360afcb4d3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:20.101489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-620fa04c-f816-4832-853e-d9360afcb4d3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:20.102234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-620fa04c-f816-4832-853e-d9360afcb4d3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lazy-loading 'fault' on Instance uuid b1199ee4-c322-4c37-a53e-1bf029c7f14c {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:20.162580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-620fa04c-f816-4832-853e-d9360afcb4d3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fefa09e4bbb4101b5f05a2f20fcb41c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1f33fac61405285832b32e2a5c0b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:20.173233 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-620fa04c-f816-4832-853e-d9360afcb4d3 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 200 len: 1304 microversion: 2.1 time: 0.180190 Aug 29 15:41:20.174373 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2014/3955] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:19 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 1304 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:20.690390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ba8a735a-36a1-45ad-bf65-68ae5e47b963 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:20.692072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ba8a735a-36a1-45ad-bf65-68ae5e47b963 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:20.701677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba8a735a-36a1-45ad-bf65-68ae5e47b963 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:20.703057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba8a735a-36a1-45ad-bf65-68ae5e47b963 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:20.703822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba8a735a-36a1-45ad-bf65-68ae5e47b963 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:20.707735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba8a735a-36a1-45ad-bf65-68ae5e47b963 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:20.708800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba8a735a-36a1-45ad-bf65-68ae5e47b963 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:20.709469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba8a735a-36a1-45ad-bf65-68ae5e47b963 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:21.194456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-74d5946e-eacf-44ca-bb17-60d6c9c9f8e5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:21.195044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-74d5946e-eacf-44ca-bb17-60d6c9c9f8e5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] [instance: b1199ee4-c322-4c37-a53e-1bf029c7f14c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:21.209341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74d5946e-eacf-44ca-bb17-60d6c9c9f8e5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:21.210066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74d5946e-eacf-44ca-bb17-60d6c9c9f8e5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:21.210598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74d5946e-eacf-44ca-bb17-60d6c9c9f8e5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:21.213920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74d5946e-eacf-44ca-bb17-60d6c9c9f8e5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:21.214438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74d5946e-eacf-44ca-bb17-60d6c9c9f8e5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:21.215489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74d5946e-eacf-44ca-bb17-60d6c9c9f8e5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:21.244799 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-74d5946e-eacf-44ca-bb17-60d6c9c9f8e5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] HTTP exception thrown: Instance b1199ee4-c322-4c37-a53e-1bf029c7f14c could not be found. Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-74d5946e-eacf-44ca-bb17-60d6c9c9f8e5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Request method failure captured: Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c HTTP/1.1 Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN17kQX8gyP42unj-MO47TV6oW6b2E58MRSnBGSLus-E-1pnuTD8pRtN7Z7btTzCN-c-qMJAQkarJh9vqJpotlpX_Ax2_UH-s7yS30Ofolf2KdP6XWwq_RUwrvFNRAp-mJXHib9j1V6JFvPkQGptQSg1KSv2M18zJvdO6eJpuvtrs4c Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: f7b1f33fac61405285832b32e2a5c0b4 Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersAdminTestJSON-1468164546 Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f7b1f33fac61405285832b32e2a5c0b4", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f7b1f33fac61405285832b32e2a5c0b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7b1f33fac61405285832b32e2a5c0b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7b1f33fac61405285832b32e2a5c0b4"}]}] Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersAdminTestJSON-1468164546 Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: f7b1f33fac61405285832b32e2a5c0b4 Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersAdminTestJSON-1468164546 Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersAdminTestJSON-1468164546-project Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 0fefa09e4bbb4101b5f05a2f20fcb41c Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersAdminTestJSON-1468164546-project Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance b1199ee4-c322-4c37-a53e-1bf029c7f14c could not be found. Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b1199ee4-c322-4c37-a53e-1bf029c7f14c'} Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1199ee4-c322-4c37-a53e-1bf029c7f14c could not be found. Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1199ee4-c322-4c37-a53e-1bf029c7f14c could not be found. Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:21.248128 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:21.252787 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:21.252787 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:21.252787 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:21.252787 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:21.252787 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:21.252787 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1199ee4-c322-4c37-a53e-1bf029c7f14c could not be found. Aug 29 15:41:21.252787 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:21.258741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-74d5946e-eacf-44ca-bb17-60d6c9c9f8e5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] Returning 404 to user: Instance b1199ee4-c322-4c37-a53e-1bf029c7f14c could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:21.260586 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-74d5946e-eacf-44ca-bb17-60d6c9c9f8e5 tempest-ServersAdminTestJSON-1468164546 tempest-ServersAdminTestJSON-1468164546-project] 10.222.0.62 "GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c" status: 404 len: 111 microversion: 2.1 time: 0.069546 Aug 29 15:41:21.262401 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2015/3956] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:21 2022] GET /compute/v2.1/servers/b1199ee4-c322-4c37-a53e-1bf029c7f14c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:41:21.465119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-22b31947-d17f-4bd6-856b-4c5a8b2f3e1a req-35284376-f907-4133-af3f-2681b06e17ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f529d0ad-a342-49fc-a7d6-f3279fef0eae", "name": "network-vif-plugged", "status": "completed", "tag": "ee4506b6-6fc8-403c-a99d-fbb3e9f20ae4"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:21.486036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-22b31947-d17f-4bd6-856b-4c5a8b2f3e1a req-35284376-f907-4133-af3f-2681b06e17ed service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:21.487687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-22b31947-d17f-4bd6-856b-4c5a8b2f3e1a req-35284376-f907-4133-af3f-2681b06e17ed service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:21.488226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-22b31947-d17f-4bd6-856b-4c5a8b2f3e1a req-35284376-f907-4133-af3f-2681b06e17ed service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:21.496980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ba8a735a-36a1-45ad-bf65-68ae5e47b963 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:21.508305 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ba8a735a-36a1-45ad-bf65-68ae5e47b963 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1334 microversion: 2.1 time: 0.825075 Aug 29 15:41:21.509937 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1942/3957] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:20 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1334 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:21.532534 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-22b31947-d17f-4bd6-856b-4c5a8b2f3e1a req-35284376-f907-4133-af3f-2681b06e17ed service nova] Creating event network-vif-plugged:ee4506b6-6fc8-403c-a99d-fbb3e9f20ae4 for instance f529d0ad-a342-49fc-a7d6-f3279fef0eae on n-h2-839401-11 Aug 29 15:41:21.541288 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-22b31947-d17f-4bd6-856b-4c5a8b2f3e1a req-35284376-f907-4133-af3f-2681b06e17ed service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080372 Aug 29 15:41:21.542388 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2016/3958] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:41:22.529545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b997d7d8-de3f-4282-96c0-60d97a84dfc5 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:22.530929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b997d7d8-de3f-4282-96c0-60d97a84dfc5 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:22.545644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:22.547785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b997d7d8-de3f-4282-96c0-60d97a84dfc5 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:22.548291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b997d7d8-de3f-4282-96c0-60d97a84dfc5 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:22.548737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b997d7d8-de3f-4282-96c0-60d97a84dfc5 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:22.549509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b997d7d8-de3f-4282-96c0-60d97a84dfc5 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:22.549969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b997d7d8-de3f-4282-96c0-60d97a84dfc5 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:22.550590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b997d7d8-de3f-4282-96c0-60d97a84dfc5 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:23.044998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b997d7d8-de3f-4282-96c0-60d97a84dfc5 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:23.059329 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b997d7d8-de3f-4282-96c0-60d97a84dfc5 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1334 microversion: 2.1 time: 0.533705 Aug 29 15:41:23.076893 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1943/3959] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:22 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1334 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:24.084147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b311bd09-41e0-48fa-a762-de05e8dfcf8a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:24.084884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b311bd09-41e0-48fa-a762-de05e8dfcf8a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:24.094490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b311bd09-41e0-48fa-a762-de05e8dfcf8a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.094991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b311bd09-41e0-48fa-a762-de05e8dfcf8a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.095489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b311bd09-41e0-48fa-a762-de05e8dfcf8a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.096220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b311bd09-41e0-48fa-a762-de05e8dfcf8a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.096869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b311bd09-41e0-48fa-a762-de05e8dfcf8a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.097520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b311bd09-41e0-48fa-a762-de05e8dfcf8a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.280240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b311bd09-41e0-48fa-a762-de05e8dfcf8a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:24.292815 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b311bd09-41e0-48fa-a762-de05e8dfcf8a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1671 microversion: 2.1 time: 0.212664 Aug 29 15:41:24.294304 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2017/3960] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:24 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1671 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:24.314408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-60ddd683-c98d-44f5-85e8-892b5083e466 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:24.314907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-60ddd683-c98d-44f5-85e8-892b5083e466 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:24.322517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60ddd683-c98d-44f5-85e8-892b5083e466 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.323541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60ddd683-c98d-44f5-85e8-892b5083e466 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.324146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60ddd683-c98d-44f5-85e8-892b5083e466 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.325018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60ddd683-c98d-44f5-85e8-892b5083e466 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.325789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60ddd683-c98d-44f5-85e8-892b5083e466 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.326380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60ddd683-c98d-44f5-85e8-892b5083e466 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.360270 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-60ddd683-c98d-44f5-85e8-892b5083e466 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae/ips" status: 200 len: 181 microversion: 2.1 time: 0.050083 Aug 29 15:41:24.373413 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1944/3961] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:41:24 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae/ips => generated 181 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:24.385825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f118504c-2cc0-41b9-a063-c54b902e583d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:24.386372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f118504c-2cc0-41b9-a063-c54b902e583d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:24.407727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f118504c-2cc0-41b9-a063-c54b902e583d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.408246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f118504c-2cc0-41b9-a063-c54b902e583d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.412876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f118504c-2cc0-41b9-a063-c54b902e583d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.414297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f118504c-2cc0-41b9-a063-c54b902e583d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.414798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f118504c-2cc0-41b9-a063-c54b902e583d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.415251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f118504c-2cc0-41b9-a063-c54b902e583d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.480076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f118504c-2cc0-41b9-a063-c54b902e583d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:41:24.641281 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f118504c-2cc0-41b9-a063-c54b902e583d tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 204 len: 0 microversion: 2.1 time: 0.267744 Aug 29 15:41:24.642666 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2018/3962] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:24 2022] DELETE /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:24.651948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0cd72751-3472-4bcf-960c-b3958f93400c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:24.653054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0cd72751-3472-4bcf-960c-b3958f93400c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:24.664889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cd72751-3472-4bcf-960c-b3958f93400c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.665676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cd72751-3472-4bcf-960c-b3958f93400c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.666328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cd72751-3472-4bcf-960c-b3958f93400c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.667346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cd72751-3472-4bcf-960c-b3958f93400c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.668201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cd72751-3472-4bcf-960c-b3958f93400c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.668859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cd72751-3472-4bcf-960c-b3958f93400c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:25.023939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0cd72751-3472-4bcf-960c-b3958f93400c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:25.035454 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0cd72751-3472-4bcf-960c-b3958f93400c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1677 microversion: 2.1 time: 0.387067 Aug 29 15:41:25.036072 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1945/3963] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:24 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1677 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:25.923915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-708083801", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "3ac7e564-b250-488a-8919-b9f712fff14c"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:26.033725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] validate_networks() for [('3ac7e564-b250-488a-8919-b9f712fff14c', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:41:26.056540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3d51c96f-ef1f-4c3f-b02e-9df02c681a05 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:26.057073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3d51c96f-ef1f-4c3f-b02e-9df02c681a05 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:26.073867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d51c96f-ef1f-4c3f-b02e-9df02c681a05 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.074575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d51c96f-ef1f-4c3f-b02e-9df02c681a05 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.075202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d51c96f-ef1f-4c3f-b02e-9df02c681a05 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:26.077352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d51c96f-ef1f-4c3f-b02e-9df02c681a05 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.078975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d51c96f-ef1f-4c3f-b02e-9df02c681a05 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.080864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d51c96f-ef1f-4c3f-b02e-9df02c681a05 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:26.241074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3d51c96f-ef1f-4c3f-b02e-9df02c681a05 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:26.252914 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3d51c96f-ef1f-4c3f-b02e-9df02c681a05 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1677 microversion: 2.1 time: 0.200683 Aug 29 15:41:26.253562 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1946/3964] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:26 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1677 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:26.574578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:41:26.575721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:41:26.576546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:41:26.577266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:41:26.577863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:41:26.592423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.593601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.594243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:26.595172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.597002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.597633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:26.624232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Getting quotas for project ad019754b47441d5a286666f8a048b48. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:26.631840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Getting quotas for user 71ae9af4779a4d50b9171ff9ca8b5207 and project ad019754b47441d5a286666f8a048b48. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:26.648215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:41:26.650974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:41:26.700813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-85e95e28-f4cf-4599-95dd-ad33b9e51b2c tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Calling method '.version_select at 0x7fc42bafdb80>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:26.729680 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9263a0aa-7445-4adb-9d75-c81941ba0dfe tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.254342 Aug 29 15:41:26.737937 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2019/3965] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:41:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:41:26.744828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5137b0cd-ee5b-47de-8a2c-c4894436b3bd tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:26.745710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5137b0cd-ee5b-47de-8a2c-c4894436b3bd tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:26.782305 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-85e95e28-f4cf-4599-95dd-ad33b9e51b2c tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "GET /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7" status: 200 len: 637 microversion: 2.1 time: 0.086684 Aug 29 15:41:26.783482 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1947/3966] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:26 2022] GET /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7 => generated 637 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:41:26.803192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5dc7f753-facd-4199-a735-fab07cedaa12 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Action: 'update_all', calling method: .version_select at 0x7fc433aaaee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:26.911965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5dc7f753-facd-4199-a735-fab07cedaa12 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:26.919336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5dc7f753-facd-4199-a735-fab07cedaa12 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for user cea4bcb863454b178681b30222b75639 and project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:27.008937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5137b0cd-ee5b-47de-8a2c-c4894436b3bd tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:27.022301 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5137b0cd-ee5b-47de-8a2c-c4894436b3bd tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 200 len: 1207 microversion: 2.1 time: 0.283169 Aug 29 15:41:27.040792 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2020/3967] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:26 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 1207 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:27.277586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-189f7d32-e130-471c-ac62-3f07dbf73500 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:27.278218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-189f7d32-e130-471c-ac62-3f07dbf73500 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:27.288780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-189f7d32-e130-471c-ac62-3f07dbf73500 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.291207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-189f7d32-e130-471c-ac62-3f07dbf73500 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.293919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-189f7d32-e130-471c-ac62-3f07dbf73500 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.294897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-189f7d32-e130-471c-ac62-3f07dbf73500 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.295716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-189f7d32-e130-471c-ac62-3f07dbf73500 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.298351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-189f7d32-e130-471c-ac62-3f07dbf73500 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.590676 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5dc7f753-facd-4199-a735-fab07cedaa12 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "PUT /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.794194 Aug 29 15:41:27.591954 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1948/3968] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:41:26 2022] PUT /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata => generated 61 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:27.604475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-def89df0-b53d-4f0a-9413-37527a0bdfdb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:27.604996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-def89df0-b53d-4f0a-9413-37527a0bdfdb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:27.631074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def89df0-b53d-4f0a-9413-37527a0bdfdb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.631546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def89df0-b53d-4f0a-9413-37527a0bdfdb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.632099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def89df0-b53d-4f0a-9413-37527a0bdfdb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.638275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def89df0-b53d-4f0a-9413-37527a0bdfdb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.639055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def89df0-b53d-4f0a-9413-37527a0bdfdb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.639926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def89df0-b53d-4f0a-9413-37527a0bdfdb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.687385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-189f7d32-e130-471c-ac62-3f07dbf73500 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:27.699651 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-189f7d32-e130-471c-ac62-3f07dbf73500 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1677 microversion: 2.1 time: 0.425411 Aug 29 15:41:27.701387 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2021/3969] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:27 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1677 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:27.710792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a35025a6-e974-4007-aaeb-96aed7d68466 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Calling method '.version_select at 0x7fc42ac76790>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:27.952426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-def89df0-b53d-4f0a-9413-37527a0bdfdb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lazy-loading 'services' on Instance uuid d1c7ad8e-1ed9-4347-bb61-13e861e30886 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:28.177463 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a35025a6-e974-4007-aaeb-96aed7d68466 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "DELETE /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.473520 Aug 29 15:41:28.178240 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2022/3970] 10.222.0.62 () {58 vars in 1296 bytes} [Mon Aug 29 15:41:27 2022] DELETE /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata/os_version => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:28.185753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-edcef8fa-959d-4244-a93c-5fc14221f756 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:28.186519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-edcef8fa-959d-4244-a93c-5fc14221f756 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:28.216181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edcef8fa-959d-4244-a93c-5fc14221f756 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:28.223151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edcef8fa-959d-4244-a93c-5fc14221f756 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:28.223850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edcef8fa-959d-4244-a93c-5fc14221f756 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:28.224604 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-def89df0-b53d-4f0a-9413-37527a0bdfdb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/os-volume_attachments/470cf3e2-c74e-47ff-a10c-a08d8a3a0c97" status: 202 len: 0 microversion: 2.1 time: 0.629594 Aug 29 15:41:28.224831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edcef8fa-959d-4244-a93c-5fc14221f756 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:28.225451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edcef8fa-959d-4244-a93c-5fc14221f756 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:28.227718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edcef8fa-959d-4244-a93c-5fc14221f756 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:28.232625 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1949/3971] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 15:41:27 2022] DELETE /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/os-volume_attachments/470cf3e2-c74e-47ff-a10c-a08d8a3a0c97 => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:28.247519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d6cddde2-141c-40f3-a4a5-a5fa379ab4b5 req-58f3d8d9-54d6-40a6-910b-61ee8ec98ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f529d0ad-a342-49fc-a7d6-f3279fef0eae", "name": "network-vif-deleted", "tag": "ee4506b6-6fc8-403c-a99d-fbb3e9f20ae4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:28.283729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d6cddde2-141c-40f3-a4a5-a5fa379ab4b5 req-58f3d8d9-54d6-40a6-910b-61ee8ec98ee7 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:28.284465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d6cddde2-141c-40f3-a4a5-a5fa379ab4b5 req-58f3d8d9-54d6-40a6-910b-61ee8ec98ee7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:28.286044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d6cddde2-141c-40f3-a4a5-a5fa379ab4b5 req-58f3d8d9-54d6-40a6-910b-61ee8ec98ee7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:28.350493 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d6cddde2-141c-40f3-a4a5-a5fa379ab4b5 req-58f3d8d9-54d6-40a6-910b-61ee8ec98ee7 service nova] Creating event network-vif-deleted:ee4506b6-6fc8-403c-a99d-fbb3e9f20ae4 for instance f529d0ad-a342-49fc-a7d6-f3279fef0eae on n-h2-839401-11 Aug 29 15:41:28.362437 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d6cddde2-141c-40f3-a4a5-a5fa379ab4b5 req-58f3d8d9-54d6-40a6-910b-61ee8ec98ee7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126732 Aug 29 15:41:28.365973 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1950/3972] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:28.378460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-131a0015-4dce-4952-b417-e04395da63b2 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Calling method '.version_select at 0x7fc42b6da820>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:28.460224 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-131a0015-4dce-4952-b417-e04395da63b2 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "GET /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata" status: 200 len: 37 microversion: 2.1 time: 0.088681 Aug 29 15:41:28.474710 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1951/3973] 10.222.0.62 () {58 vars in 1260 bytes} [Mon Aug 29 15:41:28 2022] GET /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata => generated 37 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:28.486700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0ebaf469-8f25-4bcd-943f-f0bbd8027c35 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Action: 'update_all', calling method: .version_select at 0x7fc433a4b1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:28.500245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-edcef8fa-959d-4244-a93c-5fc14221f756 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:28.532543 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-edcef8fa-959d-4244-a93c-5fc14221f756 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 200 len: 1203 microversion: 2.1 time: 0.351567 Aug 29 15:41:28.535147 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2023/3974] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:28 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 1203 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:28.583176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-0ebaf469-8f25-4bcd-943f-f0bbd8027c35 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:28.590151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-0ebaf469-8f25-4bcd-943f-f0bbd8027c35 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for user cea4bcb863454b178681b30222b75639 and project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:28.726002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bd7cbca9-88fc-47c9-b9f6-5fd4032e3309 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:28.726656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bd7cbca9-88fc-47c9-b9f6-5fd4032e3309 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:28.739195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd7cbca9-88fc-47c9-b9f6-5fd4032e3309 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:28.745099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd7cbca9-88fc-47c9-b9f6-5fd4032e3309 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:28.745714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd7cbca9-88fc-47c9-b9f6-5fd4032e3309 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:28.748027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd7cbca9-88fc-47c9-b9f6-5fd4032e3309 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:28.748529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd7cbca9-88fc-47c9-b9f6-5fd4032e3309 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:28.748948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd7cbca9-88fc-47c9-b9f6-5fd4032e3309 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:29.087690 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0ebaf469-8f25-4bcd-943f-f0bbd8027c35 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "PUT /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.607248 Aug 29 15:41:29.091101 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1952/3975] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:41:28 2022] PUT /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata => generated 61 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:29.100954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5f5c2156-735a-428f-82cf-792b4403856c tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Calling method '.version_select at 0x7fc42b003b80>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:29.129907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bd7cbca9-88fc-47c9-b9f6-5fd4032e3309 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:29.170906 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bd7cbca9-88fc-47c9-b9f6-5fd4032e3309 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1497 microversion: 2.1 time: 0.448303 Aug 29 15:41:29.186690 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2024/3976] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:28 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1497 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:29.198825 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5f5c2156-735a-428f-82cf-792b4403856c tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "GET /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.104250 Aug 29 15:41:29.199536 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1953/3977] 10.222.0.62 () {58 vars in 1290 bytes} [Mon Aug 29 15:41:29 2022] GET /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata/os_distro => generated 33 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:41:29.210813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0113c9c2-0196-4b56-9a4b-a4963575ede6 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Action: 'update_all', calling method: .version_select at 0x7fc433b51550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:29.315830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-0113c9c2-0196-4b56-9a4b-a4963575ede6 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:29.323924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-0113c9c2-0196-4b56-9a4b-a4963575ede6 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for user cea4bcb863454b178681b30222b75639 and project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:29.558924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-158a116c-2b21-4ecf-ac58-0d55bb7179b0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:29.560082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-158a116c-2b21-4ecf-ac58-0d55bb7179b0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:29.575738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-158a116c-2b21-4ecf-ac58-0d55bb7179b0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:29.586085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-158a116c-2b21-4ecf-ac58-0d55bb7179b0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:29.587217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-158a116c-2b21-4ecf-ac58-0d55bb7179b0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:29.598792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-158a116c-2b21-4ecf-ac58-0d55bb7179b0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:29.599768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-158a116c-2b21-4ecf-ac58-0d55bb7179b0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:29.601571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-158a116c-2b21-4ecf-ac58-0d55bb7179b0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:29.690543 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0113c9c2-0196-4b56-9a4b-a4963575ede6 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "PUT /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.484136 Aug 29 15:41:29.691555 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2025/3978] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:41:29 2022] PUT /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata => generated 61 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:29.702569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4565db6c-eee5-497b-804c-d1df75c61a69 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Calling method '.version_select at 0x7fc42a9a94c0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:29.814893 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4565db6c-eee5-497b-804c-d1df75c61a69 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "GET /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.117710 Aug 29 15:41:29.821789 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2026/3979] 10.222.0.62 () {58 vars in 1260 bytes} [Mon Aug 29 15:41:29 2022] GET /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata => generated 61 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:41:29.830723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eb731531-574f-4953-ad8d-688fd145e196 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Action: 'update_all', calling method: .version_select at 0x7fc42ac761f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:29.936473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-eb731531-574f-4953-ad8d-688fd145e196 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:29.965987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-eb731531-574f-4953-ad8d-688fd145e196 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for user cea4bcb863454b178681b30222b75639 and project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:30.253520 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eb731531-574f-4953-ad8d-688fd145e196 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "PUT /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.429855 Aug 29 15:41:30.258662 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2027/3980] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:41:29 2022] PUT /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata => generated 61 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:30.263715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-17655e73-defa-4f1a-b1da-817f616cf53a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:30.264616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-17655e73-defa-4f1a-b1da-817f616cf53a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:30.274557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17655e73-defa-4f1a-b1da-817f616cf53a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:30.278671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17655e73-defa-4f1a-b1da-817f616cf53a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:30.280668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17655e73-defa-4f1a-b1da-817f616cf53a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:30.281662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17655e73-defa-4f1a-b1da-817f616cf53a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:30.283404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17655e73-defa-4f1a-b1da-817f616cf53a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:30.285682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17655e73-defa-4f1a-b1da-817f616cf53a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:30.348908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17655e73-defa-4f1a-b1da-817f616cf53a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:30.351614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17655e73-defa-4f1a-b1da-817f616cf53a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:30.356181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17655e73-defa-4f1a-b1da-817f616cf53a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:30.358827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-17655e73-defa-4f1a-b1da-817f616cf53a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lazy-loading 'fault' on Instance uuid f529d0ad-a342-49fc-a7d6-f3279fef0eae {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:30.443456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-17655e73-defa-4f1a-b1da-817f616cf53a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e450275cc2d49968f2cb7559109fb66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde693c11d6d4af0ba9f31249e778e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:30.451917 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-17655e73-defa-4f1a-b1da-817f616cf53a tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 200 len: 1303 microversion: 2.1 time: 0.192125 Aug 29 15:41:30.452944 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2028/3981] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:30 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 1303 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:30.465583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5a753624-f1f3-4112-851c-95e49f0683c8 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Action: 'update_all', calling method: .version_select at 0x7fc42a9a9310>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:30.535284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-5a753624-f1f3-4112-851c-95e49f0683c8 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:30.541155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-5a753624-f1f3-4112-851c-95e49f0683c8 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for user cea4bcb863454b178681b30222b75639 and project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:30.639132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-158a116c-2b21-4ecf-ac58-0d55bb7179b0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:30.654940 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-158a116c-2b21-4ecf-ac58-0d55bb7179b0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 200 len: 1267 microversion: 2.1 time: 1.101704 Aug 29 15:41:30.655552 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1954/3982] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:29 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 1267 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:30.682570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-43ea117b-ae5f-4343-8893-946787984388 req-948a61d4-7ea4-4b95-92d6-569ea0f38f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f529d0ad-a342-49fc-a7d6-f3279fef0eae", "name": "network-vif-deleted", "tag": "8c05207c-16a2-409d-a23b-5e308ea71024"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:30.699392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-43ea117b-ae5f-4343-8893-946787984388 req-948a61d4-7ea4-4b95-92d6-569ea0f38f5f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:30.699947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-43ea117b-ae5f-4343-8893-946787984388 req-948a61d4-7ea4-4b95-92d6-569ea0f38f5f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:30.700390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-43ea117b-ae5f-4343-8893-946787984388 req-948a61d4-7ea4-4b95-92d6-569ea0f38f5f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:30.713860 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-43ea117b-ae5f-4343-8893-946787984388 req-948a61d4-7ea4-4b95-92d6-569ea0f38f5f service nova] Creating event network-vif-deleted:8c05207c-16a2-409d-a23b-5e308ea71024 for instance f529d0ad-a342-49fc-a7d6-f3279fef0eae on n-h2-839401-11 Aug 29 15:41:30.721299 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-43ea117b-ae5f-4343-8893-946787984388 req-948a61d4-7ea4-4b95-92d6-569ea0f38f5f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050748 Aug 29 15:41:30.722499 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1955/3983] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:31.019725 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5a753624-f1f3-4112-851c-95e49f0683c8 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "PUT /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata" status: 200 len: 64 microversion: 2.1 time: 0.565217 Aug 29 15:41:31.020662 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2029/3984] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:41:30 2022] PUT /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata => generated 64 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:31.032912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-688370cf-75e1-40fe-8f19-3e6320026a4d tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Calling method '.version_select at 0x7fc42bb83040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:31.113399 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-688370cf-75e1-40fe-8f19-3e6320026a4d tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "GET /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata" status: 200 len: 64 microversion: 2.1 time: 0.083701 Aug 29 15:41:31.114057 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1956/3985] 10.222.0.62 () {58 vars in 1260 bytes} [Mon Aug 29 15:41:31 2022] GET /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata => generated 64 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:31.124875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7208e8a-004f-4ba1-aebf-8caa93119c18 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Action: 'update_all', calling method: .version_select at 0x7fc42bbc4af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:31.209881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-f7208e8a-004f-4ba1-aebf-8caa93119c18 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:31.222348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-f7208e8a-004f-4ba1-aebf-8caa93119c18 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for user cea4bcb863454b178681b30222b75639 and project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:31.473132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9c6f0b66-c0e4-4917-9c4a-721d72c6bf56 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:31.478087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9c6f0b66-c0e4-4917-9c4a-721d72c6bf56 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:31.495867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6f0b66-c0e4-4917-9c4a-721d72c6bf56 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:31.496631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6f0b66-c0e4-4917-9c4a-721d72c6bf56 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:31.497860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6f0b66-c0e4-4917-9c4a-721d72c6bf56 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:31.501140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6f0b66-c0e4-4917-9c4a-721d72c6bf56 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:31.501877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6f0b66-c0e4-4917-9c4a-721d72c6bf56 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:31.502500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c6f0b66-c0e4-4917-9c4a-721d72c6bf56 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:31.544238 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-9c6f0b66-c0e4-4917-9c4a-721d72c6bf56 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] HTTP exception thrown: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9c6f0b66-c0e4-4917-9c4a-721d72c6bf56 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Request method failure captured: Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae HTTP/1.1 Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN3FWFArgEBvPjlu2qITakZqoYFOGzaI60wQkIknvEYxgjSag1wqLTwhRsJcuBpHHuL2RR4wAz0Ioln31yTVJs0wyn--sQKLJyd94zVFocEp0EnGsBc-mNEBiImYVtePhjxNLBEgOu1quPa1i_GBaB4KTiqBbKL2Tse1Tkf6SCxifRE Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: cde693c11d6d4af0ba9f31249e778e8b Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersTestMultiNic-295713640 Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cde693c11d6d4af0ba9f31249e778e8b", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cde693c11d6d4af0ba9f31249e778e8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cde693c11d6d4af0ba9f31249e778e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cde693c11d6d4af0ba9f31249e778e8b"}]}] Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersTestMultiNic-295713640 Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: cde693c11d6d4af0ba9f31249e778e8b Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersTestMultiNic-295713640 Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersTestMultiNic-295713640-project Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 5e450275cc2d49968f2cb7559109fb66 Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersTestMultiNic-295713640-project Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'f529d0ad-a342-49fc-a7d6-f3279fef0eae'} Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:31.549995 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:41:31.556181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:31.556181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:31.556181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:31.556181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:31.556181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:31.556181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. Aug 29 15:41:31.556181 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:41:31.559059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9c6f0b66-c0e4-4917-9c4a-721d72c6bf56 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Returning 404 to user: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:31.560621 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9c6f0b66-c0e4-4917-9c4a-721d72c6bf56 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 404 len: 111 microversion: 2.1 time: 0.091736 Aug 29 15:41:31.561522 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1957/3986] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:31 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:41:31.681612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-744155fe-fe4f-4448-8e3d-e8b2a62adaab tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:31.682228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-744155fe-fe4f-4448-8e3d-e8b2a62adaab tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:31.695503 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f7208e8a-004f-4ba1-aebf-8caa93119c18 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "PUT /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.574854 Aug 29 15:41:31.696529 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2030/3987] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:41:31 2022] PUT /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata => generated 61 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:41:31.706278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2e329453-7e65-4fdc-b708-2edb6c4ce0c7 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Action: 'update', calling method: .version_select at 0x7fc42b6b5ee0>, body: {"meta": {"os_version": "alt"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:31.706748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-744155fe-fe4f-4448-8e3d-e8b2a62adaab tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:31.709394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-744155fe-fe4f-4448-8e3d-e8b2a62adaab tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:31.709868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-744155fe-fe4f-4448-8e3d-e8b2a62adaab tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:31.711312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-744155fe-fe4f-4448-8e3d-e8b2a62adaab tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:31.711809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-744155fe-fe4f-4448-8e3d-e8b2a62adaab tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:31.712237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-744155fe-fe4f-4448-8e3d-e8b2a62adaab tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:31.787672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:31.806494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-2e329453-7e65-4fdc-b708-2edb6c4ce0c7 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:31.822188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-2e329453-7e65-4fdc-b708-2edb6c4ce0c7 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for user cea4bcb863454b178681b30222b75639 and project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:32.167412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-744155fe-fe4f-4448-8e3d-e8b2a62adaab tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:32.178893 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-744155fe-fe4f-4448-8e3d-e8b2a62adaab tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 200 len: 1307 microversion: 2.1 time: 0.503063 Aug 29 15:41:32.180435 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1958/3988] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:31 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 1307 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:32.289836 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2e329453-7e65-4fdc-b708-2edb6c4ce0c7 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "PUT /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.587405 Aug 29 15:41:32.291383 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2031/3989] 10.222.0.62 () {60 vars in 1313 bytes} [Mon Aug 29 15:41:31 2022] PUT /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata/os_version => generated 31 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:32.300840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0a191cf0-8bbb-4d14-8e63-8b97d73ccd5f tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Calling method '.version_select at 0x7fc433a520d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:32.370657 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0a191cf0-8bbb-4d14-8e63-8b97d73ccd5f tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "GET /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata" status: 200 len: 58 microversion: 2.1 time: 0.073283 Aug 29 15:41:32.376571 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1959/3990] 10.222.0.62 () {58 vars in 1260 bytes} [Mon Aug 29 15:41:32 2022] GET /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata => generated 58 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:32.387054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-557f8a9f-c1b3-462b-b612-757f3943e1df tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Action: 'update_all', calling method: .version_select at 0x7fc42ac60dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:32.472163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-557f8a9f-c1b3-462b-b612-757f3943e1df tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:32.479171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-557f8a9f-c1b3-462b-b612-757f3943e1df tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for user cea4bcb863454b178681b30222b75639 and project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:32.924597 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-557f8a9f-c1b3-462b-b612-757f3943e1df tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "PUT /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.541460 Aug 29 15:41:32.929643 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2032/3991] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:41:32 2022] PUT /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata => generated 61 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:32.940351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8cd283b2-4756-4714-a16c-6e393a6a90f5 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Action: 'create', calling method: .version_select at 0x7fc42b6f1700>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:33.014879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-8cd283b2-4756-4714-a16c-6e393a6a90f5 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:33.029879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-8cd283b2-4756-4714-a16c-6e393a6a90f5 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Getting quotas for user cea4bcb863454b178681b30222b75639 and project 2ffaf7646f5a485486921df8cc105333. Resources: dict_keys(['metadata_items']) {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:33.181856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-bdf7fd73-d5d6-4e47-9bd0-282e143121e9 req-972f4caf-e891-4f68-bed1-71ce57549c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebc1d9ba-f64b-46cf-9006-0092135d5e7a", "tag": "beb0cebf-6f30-43e5-b747-c99c373def86"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:33.206288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-bdf7fd73-d5d6-4e47-9bd0-282e143121e9 req-972f4caf-e891-4f68-bed1-71ce57549c42 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:33.206780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-bdf7fd73-d5d6-4e47-9bd0-282e143121e9 req-972f4caf-e891-4f68-bed1-71ce57549c42 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:33.207222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-bdf7fd73-d5d6-4e47-9bd0-282e143121e9 req-972f4caf-e891-4f68-bed1-71ce57549c42 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:33.251756 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-bdf7fd73-d5d6-4e47-9bd0-282e143121e9 req-972f4caf-e891-4f68-bed1-71ce57549c42 service nova] Creating event network-changed:beb0cebf-6f30-43e5-b747-c99c373def86 for instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a on n-h1-839401-11 Aug 29 15:41:33.269426 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-bdf7fd73-d5d6-4e47-9bd0-282e143121e9 req-972f4caf-e891-4f68-bed1-71ce57549c42 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091200 Aug 29 15:41:33.272081 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2033/3992] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:41:33.281587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d5315b4e-8ecb-48e8-adef-f048ce5b1e1e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:33.286852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d5315b4e-8ecb-48e8-adef-f048ce5b1e1e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:33.303082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5315b4e-8ecb-48e8-adef-f048ce5b1e1e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:33.305632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5315b4e-8ecb-48e8-adef-f048ce5b1e1e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:33.313668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5315b4e-8ecb-48e8-adef-f048ce5b1e1e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:33.314674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5315b4e-8ecb-48e8-adef-f048ce5b1e1e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:33.315671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5315b4e-8ecb-48e8-adef-f048ce5b1e1e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:33.316299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5315b4e-8ecb-48e8-adef-f048ce5b1e1e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:33.563636 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8cd283b2-4756-4714-a16c-6e393a6a90f5 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "POST /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata" status: 200 len: 85 microversion: 2.1 time: 0.632254 Aug 29 15:41:33.564726 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1960/3993] 10.222.0.62 () {60 vars in 1281 bytes} [Mon Aug 29 15:41:32 2022] POST /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata => generated 85 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:33.574699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a0a53f0f-e473-41a2-ae8a-c5159841f882 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] Calling method '.version_select at 0x7fc42bafd3a0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:33.634363 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a0a53f0f-e473-41a2-ae8a-c5159841f882 tempest-ImagesMetadataTestJSON-621018858 tempest-ImagesMetadataTestJSON-621018858-project] 10.222.0.62 "GET /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata" status: 200 len: 85 microversion: 2.1 time: 0.064003 Aug 29 15:41:33.635231 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1961/3994] 10.222.0.62 () {58 vars in 1260 bytes} [Mon Aug 29 15:41:33 2022] GET /compute/v2.1/images/38984f82-229e-4d54-af8d-e4a4956381b7/metadata => generated 85 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:34.128722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d5315b4e-8ecb-48e8-adef-f048ce5b1e1e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:34.137585 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d5315b4e-8ecb-48e8-adef-f048ce5b1e1e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 200 len: 1307 microversion: 2.1 time: 0.862520 Aug 29 15:41:34.138192 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2034/3995] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:33 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 1307 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:35.164219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a2a121b2-35cf-46b4-8487-b86169c62216 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:35.166375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a2a121b2-35cf-46b4-8487-b86169c62216 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:35.182257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2a121b2-35cf-46b4-8487-b86169c62216 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:35.185618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2a121b2-35cf-46b4-8487-b86169c62216 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:35.186439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2a121b2-35cf-46b4-8487-b86169c62216 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:35.188164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2a121b2-35cf-46b4-8487-b86169c62216 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:35.191344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2a121b2-35cf-46b4-8487-b86169c62216 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:35.191988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2a121b2-35cf-46b4-8487-b86169c62216 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:35.650070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a2a121b2-35cf-46b4-8487-b86169c62216 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:35.657006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:35.664006 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a2a121b2-35cf-46b4-8487-b86169c62216 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 200 len: 1307 microversion: 2.1 time: 0.501908 Aug 29 15:41:35.664752 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1962/3996] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:35 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 1307 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:36.344329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-60999547-fe01-463b-ab4f-1f9df1d0b0e2 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:36.344831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-60999547-fe01-463b-ab4f-1f9df1d0b0e2 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:36.362760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60999547-fe01-463b-ab4f-1f9df1d0b0e2 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:36.363501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60999547-fe01-463b-ab4f-1f9df1d0b0e2 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:36.364120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60999547-fe01-463b-ab4f-1f9df1d0b0e2 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:36.365077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60999547-fe01-463b-ab4f-1f9df1d0b0e2 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:36.365737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60999547-fe01-463b-ab4f-1f9df1d0b0e2 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:36.367824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60999547-fe01-463b-ab4f-1f9df1d0b0e2 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:36.399824 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-60999547-fe01-463b-ab4f-1f9df1d0b0e2 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] HTTP exception thrown: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-60999547-fe01-463b-ab4f-1f9df1d0b0e2 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Request method failure captured: Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae HTTP/1.1 Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN3FWFArgEBvPjlu2qITakZqoYFOGzaI60wQkIknvEYxgjSag1wqLTwhRsJcuBpHHuL2RR4wAz0Ioln31yTVJs0wyn--sQKLJyd94zVFocEp0EnGsBc-mNEBiImYVtePhjxNLBEgOu1quPa1i_GBaB4KTiqBbKL2Tse1Tkf6SCxifRE Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: cde693c11d6d4af0ba9f31249e778e8b Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestMultiNic-295713640 Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cde693c11d6d4af0ba9f31249e778e8b", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cde693c11d6d4af0ba9f31249e778e8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cde693c11d6d4af0ba9f31249e778e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cde693c11d6d4af0ba9f31249e778e8b"}]}] Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestMultiNic-295713640 Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: cde693c11d6d4af0ba9f31249e778e8b Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestMultiNic-295713640 Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestMultiNic-295713640-project Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 5e450275cc2d49968f2cb7559109fb66 Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestMultiNic-295713640-project Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'f529d0ad-a342-49fc-a7d6-f3279fef0eae'} Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:36.407851 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:36.413531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. Aug 29 15:41:36.413531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.413531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:36.413531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.413531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:36.413531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:36.413531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:36.413531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:36.413531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:36.413531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. Aug 29 15:41:36.413531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.415717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-60999547-fe01-463b-ab4f-1f9df1d0b0e2 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Returning 404 to user: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:36.417001 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-60999547-fe01-463b-ab4f-1f9df1d0b0e2 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 404 len: 111 microversion: 2.1 time: 0.076425 Aug 29 15:41:36.417768 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2035/3997] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:36 2022] DELETE /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:36.427122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a34ef209-bb55-41d1-a18d-c349c4519016 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:36.428748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a34ef209-bb55-41d1-a18d-c349c4519016 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: f529d0ad-a342-49fc-a7d6-f3279fef0eae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:36.444921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34ef209-bb55-41d1-a18d-c349c4519016 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:36.445525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34ef209-bb55-41d1-a18d-c349c4519016 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:36.445974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34ef209-bb55-41d1-a18d-c349c4519016 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:36.447837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34ef209-bb55-41d1-a18d-c349c4519016 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:36.448329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34ef209-bb55-41d1-a18d-c349c4519016 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:36.448769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34ef209-bb55-41d1-a18d-c349c4519016 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:36.485995 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-a34ef209-bb55-41d1-a18d-c349c4519016 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] HTTP exception thrown: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a34ef209-bb55-41d1-a18d-c349c4519016 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Request method failure captured: Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae HTTP/1.1 Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN3FWFArgEBvPjlu2qITakZqoYFOGzaI60wQkIknvEYxgjSag1wqLTwhRsJcuBpHHuL2RR4wAz0Ioln31yTVJs0wyn--sQKLJyd94zVFocEp0EnGsBc-mNEBiImYVtePhjxNLBEgOu1quPa1i_GBaB4KTiqBbKL2Tse1Tkf6SCxifRE Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: cde693c11d6d4af0ba9f31249e778e8b Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersTestMultiNic-295713640 Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cde693c11d6d4af0ba9f31249e778e8b", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cde693c11d6d4af0ba9f31249e778e8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cde693c11d6d4af0ba9f31249e778e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cde693c11d6d4af0ba9f31249e778e8b"}]}] Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersTestMultiNic-295713640 Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: cde693c11d6d4af0ba9f31249e778e8b Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersTestMultiNic-295713640 Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersTestMultiNic-295713640-project Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 5e450275cc2d49968f2cb7559109fb66 Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersTestMultiNic-295713640-project Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'f529d0ad-a342-49fc-a7d6-f3279fef0eae'} Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:36.489758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.495343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:36.495343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:36.495343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:36.495343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:36.495343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:36.495343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. Aug 29 15:41:36.495343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.495343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a34ef209-bb55-41d1-a18d-c349c4519016 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Returning 404 to user: Instance f529d0ad-a342-49fc-a7d6-f3279fef0eae could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:36.495343 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a34ef209-bb55-41d1-a18d-c349c4519016 tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae" status: 404 len: 111 microversion: 2.1 time: 0.069124 Aug 29 15:41:36.495343 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1963/3998] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:36 2022] GET /compute/v2.1/servers/f529d0ad-a342-49fc-a7d6-f3279fef0eae => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:36.504670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-54f90cd2-6829-4759-98be-cf058330966c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:36.505694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-54f90cd2-6829-4759-98be-cf058330966c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:36.512827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54f90cd2-6829-4759-98be-cf058330966c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:36.513754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54f90cd2-6829-4759-98be-cf058330966c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:36.514416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54f90cd2-6829-4759-98be-cf058330966c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:36.515399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54f90cd2-6829-4759-98be-cf058330966c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:36.516656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54f90cd2-6829-4759-98be-cf058330966c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:36.517364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54f90cd2-6829-4759-98be-cf058330966c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:36.533820 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-54f90cd2-6829-4759-98be-cf058330966c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] HTTP exception thrown: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-54f90cd2-6829-4759-98be-cf058330966c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Request method failure captured: Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 HTTP/1.1 Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN3FWFArgEBvPjlu2qITakZqoYFOGzaI60wQkIknvEYxgjSag1wqLTwhRsJcuBpHHuL2RR4wAz0Ioln31yTVJs0wyn--sQKLJyd94zVFocEp0EnGsBc-mNEBiImYVtePhjxNLBEgOu1quPa1i_GBaB4KTiqBbKL2Tse1Tkf6SCxifRE Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: cde693c11d6d4af0ba9f31249e778e8b Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestMultiNic-295713640 Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cde693c11d6d4af0ba9f31249e778e8b", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cde693c11d6d4af0ba9f31249e778e8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cde693c11d6d4af0ba9f31249e778e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cde693c11d6d4af0ba9f31249e778e8b"}]}] Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestMultiNic-295713640 Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: cde693c11d6d4af0ba9f31249e778e8b Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestMultiNic-295713640 Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestMultiNic-295713640-project Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 5e450275cc2d49968f2cb7559109fb66 Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestMultiNic-295713640-project Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'bacda764-ffc5-41ff-8e06-a0ba54ecb7f7'} Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:36.535639 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:36.540071 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. Aug 29 15:41:36.540071 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.540071 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:36.540071 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.540071 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:36.540071 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:36.540071 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:36.540071 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:36.540071 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:36.540071 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. Aug 29 15:41:36.540071 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.542535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-54f90cd2-6829-4759-98be-cf058330966c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Returning 404 to user: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:36.543964 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-54f90cd2-6829-4759-98be-cf058330966c tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 404 len: 111 microversion: 2.1 time: 0.044427 Aug 29 15:41:36.544832 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2036/3999] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:36 2022] DELETE /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:36.554001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-66b07e86-56d9-45f9-b021-a254918211ad tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:36.556466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-66b07e86-56d9-45f9-b021-a254918211ad tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] [instance: bacda764-ffc5-41ff-8e06-a0ba54ecb7f7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:36.571816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b07e86-56d9-45f9-b021-a254918211ad tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:36.572632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b07e86-56d9-45f9-b021-a254918211ad tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:36.573680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b07e86-56d9-45f9-b021-a254918211ad tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:36.574420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b07e86-56d9-45f9-b021-a254918211ad tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:36.574893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b07e86-56d9-45f9-b021-a254918211ad tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:36.575327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b07e86-56d9-45f9-b021-a254918211ad tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:36.607609 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-66b07e86-56d9-45f9-b021-a254918211ad tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] HTTP exception thrown: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-66b07e86-56d9-45f9-b021-a254918211ad tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Request method failure captured: Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 HTTP/1.1 Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN3FWFArgEBvPjlu2qITakZqoYFOGzaI60wQkIknvEYxgjSag1wqLTwhRsJcuBpHHuL2RR4wAz0Ioln31yTVJs0wyn--sQKLJyd94zVFocEp0EnGsBc-mNEBiImYVtePhjxNLBEgOu1quPa1i_GBaB4KTiqBbKL2Tse1Tkf6SCxifRE Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: cde693c11d6d4af0ba9f31249e778e8b Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersTestMultiNic-295713640 Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_cde693c11d6d4af0ba9f31249e778e8b", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/cde693c11d6d4af0ba9f31249e778e8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cde693c11d6d4af0ba9f31249e778e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/cde693c11d6d4af0ba9f31249e778e8b"}]}] Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersTestMultiNic-295713640 Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: cde693c11d6d4af0ba9f31249e778e8b Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersTestMultiNic-295713640 Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersTestMultiNic-295713640-project Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 5e450275cc2d49968f2cb7559109fb66 Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersTestMultiNic-295713640-project Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'bacda764-ffc5-41ff-8e06-a0ba54ecb7f7'} Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:36.615383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.623908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:36.623908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:36.623908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:36.623908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:36.623908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:36.623908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. Aug 29 15:41:36.623908 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:41:36.623908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-66b07e86-56d9-45f9-b021-a254918211ad tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] Returning 404 to user: Instance bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:36.623908 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-66b07e86-56d9-45f9-b021-a254918211ad tempest-ServersTestMultiNic-295713640 tempest-ServersTestMultiNic-295713640-project] 10.222.0.62 "GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7" status: 404 len: 111 microversion: 2.1 time: 0.067612 Aug 29 15:41:36.623908 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1964/4000] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:36 2022] GET /compute/v2.1/servers/bacda764-ffc5-41ff-8e06-a0ba54ecb7f7 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:36.685530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-037ae99e-c0b8-4f2d-93f4-3eb29db6bdf3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:36.686152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-037ae99e-c0b8-4f2d-93f4-3eb29db6bdf3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:36.689605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:36.703877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-037ae99e-c0b8-4f2d-93f4-3eb29db6bdf3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:36.704701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-037ae99e-c0b8-4f2d-93f4-3eb29db6bdf3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:36.705321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-037ae99e-c0b8-4f2d-93f4-3eb29db6bdf3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:36.706181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-037ae99e-c0b8-4f2d-93f4-3eb29db6bdf3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:36.706779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-037ae99e-c0b8-4f2d-93f4-3eb29db6bdf3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:36.709991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-037ae99e-c0b8-4f2d-93f4-3eb29db6bdf3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:37.074722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-037ae99e-c0b8-4f2d-93f4-3eb29db6bdf3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:37.088566 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-037ae99e-c0b8-4f2d-93f4-3eb29db6bdf3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 200 len: 1307 microversion: 2.1 time: 0.406570 Aug 29 15:41:37.101966 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2037/4001] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:36 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 1307 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:37.386659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fb767b65-72bf-47fc-97de-0093ef767dfe tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:37.396993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb767b65-72bf-47fc-97de-0093ef767dfe tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:37.398397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb767b65-72bf-47fc-97de-0093ef767dfe tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:37.400312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb767b65-72bf-47fc-97de-0093ef767dfe tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:37.450891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fb767b65-72bf-47fc-97de-0093ef767dfe tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Going to try to stop instance {{(pid=122361) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:41:37.519628 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fb767b65-72bf-47fc-97de-0093ef767dfe tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "POST /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/action" status: 202 len: 0 microversion: 2.1 time: 0.139203 Aug 29 15:41:37.529906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a2713760-dde3-48e0-ab68-787328d98fd0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:37.531149 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1965/4002] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:37 2022] POST /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:37.531635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a2713760-dde3-48e0-ab68-787328d98fd0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:37.549889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2713760-dde3-48e0-ab68-787328d98fd0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:37.550407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2713760-dde3-48e0-ab68-787328d98fd0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:37.550864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2713760-dde3-48e0-ab68-787328d98fd0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:37.551604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2713760-dde3-48e0-ab68-787328d98fd0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:37.552072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2713760-dde3-48e0-ab68-787328d98fd0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:37.552503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2713760-dde3-48e0-ab68-787328d98fd0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:37.902976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a2713760-dde3-48e0-ab68-787328d98fd0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:37.916067 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a2713760-dde3-48e0-ab68-787328d98fd0 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1676 microversion: 2.1 time: 0.390434 Aug 29 15:41:37.923067 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2038/4003] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:37 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1676 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:38.113933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-74a0235c-ae5e-4c22-8953-0fe03a4c09a8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:38.115180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-74a0235c-ae5e-4c22-8953-0fe03a4c09a8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:38.122909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74a0235c-ae5e-4c22-8953-0fe03a4c09a8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:38.123806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74a0235c-ae5e-4c22-8953-0fe03a4c09a8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:38.124418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74a0235c-ae5e-4c22-8953-0fe03a4c09a8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:38.125574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74a0235c-ae5e-4c22-8953-0fe03a4c09a8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:38.126220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74a0235c-ae5e-4c22-8953-0fe03a4c09a8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:38.126816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74a0235c-ae5e-4c22-8953-0fe03a4c09a8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:38.737163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-74a0235c-ae5e-4c22-8953-0fe03a4c09a8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:38.748502 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-74a0235c-ae5e-4c22-8953-0fe03a4c09a8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 200 len: 1307 microversion: 2.1 time: 0.638954 Aug 29 15:41:38.748502 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1966/4004] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:38 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 1307 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:38.944797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-76e314bd-597e-4897-85f2-6e6ada4e0c5b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:38.947485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-76e314bd-597e-4897-85f2-6e6ada4e0c5b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:38.958995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76e314bd-597e-4897-85f2-6e6ada4e0c5b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:38.961375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76e314bd-597e-4897-85f2-6e6ada4e0c5b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:38.962039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76e314bd-597e-4897-85f2-6e6ada4e0c5b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:38.963004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76e314bd-597e-4897-85f2-6e6ada4e0c5b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:38.963685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76e314bd-597e-4897-85f2-6e6ada4e0c5b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:38.964566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76e314bd-597e-4897-85f2-6e6ada4e0c5b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:38.993626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:39.221881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-76e314bd-597e-4897-85f2-6e6ada4e0c5b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:39.238130 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-76e314bd-597e-4897-85f2-6e6ada4e0c5b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1676 microversion: 2.1 time: 0.298294 Aug 29 15:41:39.249131 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2039/4005] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:38 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1676 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:39.779362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-94335e11-fc27-4d64-805f-f9c48a72d2f1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:39.782314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-94335e11-fc27-4d64-805f-f9c48a72d2f1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:39.796493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94335e11-fc27-4d64-805f-f9c48a72d2f1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:39.798312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94335e11-fc27-4d64-805f-f9c48a72d2f1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:39.799584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94335e11-fc27-4d64-805f-f9c48a72d2f1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:39.801613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94335e11-fc27-4d64-805f-f9c48a72d2f1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:39.802758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94335e11-fc27-4d64-805f-f9c48a72d2f1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:39.803997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94335e11-fc27-4d64-805f-f9c48a72d2f1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:40.180165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-94335e11-fc27-4d64-805f-f9c48a72d2f1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:40.190021 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-94335e11-fc27-4d64-805f-f9c48a72d2f1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 200 len: 1307 microversion: 2.1 time: 0.422403 Aug 29 15:41:40.195116 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1967/4006] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:39 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 1307 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:40.261251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f467132b-157b-4982-8906-9501713c8cdc tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:40.261910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f467132b-157b-4982-8906-9501713c8cdc tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:40.276908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f467132b-157b-4982-8906-9501713c8cdc tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:40.280212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f467132b-157b-4982-8906-9501713c8cdc tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:40.280711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f467132b-157b-4982-8906-9501713c8cdc tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:40.281495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f467132b-157b-4982-8906-9501713c8cdc tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:40.286727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f467132b-157b-4982-8906-9501713c8cdc tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:40.287291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f467132b-157b-4982-8906-9501713c8cdc tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:41.216094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ee595227-24f7-4986-a7c7-884dd9821943 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:41.217387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ee595227-24f7-4986-a7c7-884dd9821943 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:41.236642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee595227-24f7-4986-a7c7-884dd9821943 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:41.237610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee595227-24f7-4986-a7c7-884dd9821943 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:41.238276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee595227-24f7-4986-a7c7-884dd9821943 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:41.239061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee595227-24f7-4986-a7c7-884dd9821943 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:41.239592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee595227-24f7-4986-a7c7-884dd9821943 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:41.240110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee595227-24f7-4986-a7c7-884dd9821943 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:41.601620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f467132b-157b-4982-8906-9501713c8cdc tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:41.618515 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f467132b-157b-4982-8906-9501713c8cdc tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1676 microversion: 2.1 time: 1.362127 Aug 29 15:41:41.619612 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2040/4007] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:40 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1676 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:41.736490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ee595227-24f7-4986-a7c7-884dd9821943 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:41.755971 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ee595227-24f7-4986-a7c7-884dd9821943 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 200 len: 1307 microversion: 2.1 time: 0.543701 Aug 29 15:41:41.757222 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1968/4008] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:41 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 1307 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:42.638964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=32 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:42.648680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dde1688f-3371-4434-a7e4-50b826700626 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.651406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dde1688f-3371-4434-a7e4-50b826700626 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:42.680393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde1688f-3371-4434-a7e4-50b826700626 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:42.680919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde1688f-3371-4434-a7e4-50b826700626 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:42.684455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde1688f-3371-4434-a7e4-50b826700626 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:42.686373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde1688f-3371-4434-a7e4-50b826700626 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:42.687093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde1688f-3371-4434-a7e4-50b826700626 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:42.688700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde1688f-3371-4434-a7e4-50b826700626 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:42.782937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b6331a61-29c0-4148-9206-357160a57d35 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.783844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b6331a61-29c0-4148-9206-357160a57d35 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:42.795794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6331a61-29c0-4148-9206-357160a57d35 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:42.842863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6331a61-29c0-4148-9206-357160a57d35 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:42.845518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6331a61-29c0-4148-9206-357160a57d35 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:42.846590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6331a61-29c0-4148-9206-357160a57d35 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:42.857533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6331a61-29c0-4148-9206-357160a57d35 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:42.858582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6331a61-29c0-4148-9206-357160a57d35 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:43.049345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:43.333840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dde1688f-3371-4434-a7e4-50b826700626 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:43.347141 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dde1688f-3371-4434-a7e4-50b826700626 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1676 microversion: 2.1 time: 0.710362 Aug 29 15:41:43.350046 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2041/4009] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1676 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:43.632986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b6331a61-29c0-4148-9206-357160a57d35 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:43.644825 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b6331a61-29c0-4148-9206-357160a57d35 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 200 len: 1307 microversion: 2.1 time: 0.869972 Aug 29 15:41:43.657626 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1969/4010] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 1307 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:44.028491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-b87f0452-af85-42d7-8ba4-5e39087b414b req-a712b188-a292-4fad-a419-f2306b1bf058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc1d9ba-f64b-46cf-9006-0092135d5e7a", "name": "network-vif-plugged", "status": "completed", "tag": "beb0cebf-6f30-43e5-b747-c99c373def86"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:44.051325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b87f0452-af85-42d7-8ba4-5e39087b414b req-a712b188-a292-4fad-a419-f2306b1bf058 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:44.053050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b87f0452-af85-42d7-8ba4-5e39087b414b req-a712b188-a292-4fad-a419-f2306b1bf058 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:44.053731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b87f0452-af85-42d7-8ba4-5e39087b414b req-a712b188-a292-4fad-a419-f2306b1bf058 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:44.075895 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-b87f0452-af85-42d7-8ba4-5e39087b414b req-a712b188-a292-4fad-a419-f2306b1bf058 service nova] Creating event network-vif-plugged:beb0cebf-6f30-43e5-b747-c99c373def86 for instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a on n-h1-839401-11 Aug 29 15:41:44.087881 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-b87f0452-af85-42d7-8ba4-5e39087b414b req-a712b188-a292-4fad-a419-f2306b1bf058 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058356 Aug 29 15:41:44.089579 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2042/4011] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:41:44.380177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-512d53a5-3b24-43a7-8683-092d63d92498 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:44.380784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-512d53a5-3b24-43a7-8683-092d63d92498 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:44.395289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-512d53a5-3b24-43a7-8683-092d63d92498 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:44.395576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-512d53a5-3b24-43a7-8683-092d63d92498 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:44.401423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-512d53a5-3b24-43a7-8683-092d63d92498 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:44.402305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-512d53a5-3b24-43a7-8683-092d63d92498 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:44.402812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-512d53a5-3b24-43a7-8683-092d63d92498 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:44.403457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-512d53a5-3b24-43a7-8683-092d63d92498 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:44.670503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b39e1f3b-6e82-4fc5-a108-6a00bdad762d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:44.671710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b39e1f3b-6e82-4fc5-a108-6a00bdad762d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:44.695404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b39e1f3b-6e82-4fc5-a108-6a00bdad762d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:44.706865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b39e1f3b-6e82-4fc5-a108-6a00bdad762d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:44.707739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b39e1f3b-6e82-4fc5-a108-6a00bdad762d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:44.710163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b39e1f3b-6e82-4fc5-a108-6a00bdad762d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:44.710916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b39e1f3b-6e82-4fc5-a108-6a00bdad762d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:44.717340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b39e1f3b-6e82-4fc5-a108-6a00bdad762d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:45.230466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-512d53a5-3b24-43a7-8683-092d63d92498 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:45.241814 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-512d53a5-3b24-43a7-8683-092d63d92498 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1676 microversion: 2.1 time: 0.865733 Aug 29 15:41:45.244371 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1970/4012] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:44 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1676 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:45.339012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b39e1f3b-6e82-4fc5-a108-6a00bdad762d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:45.349939 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b39e1f3b-6e82-4fc5-a108-6a00bdad762d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 200 len: 1307 microversion: 2.1 time: 0.686365 Aug 29 15:41:45.364662 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2043/4013] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:44 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 1307 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:46.269448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cc9c33a8-2f99-4717-a411-b5076e69e68d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:46.270085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cc9c33a8-2f99-4717-a411-b5076e69e68d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:46.287664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc9c33a8-2f99-4717-a411-b5076e69e68d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:46.289579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc9c33a8-2f99-4717-a411-b5076e69e68d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:46.291224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc9c33a8-2f99-4717-a411-b5076e69e68d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:46.298525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc9c33a8-2f99-4717-a411-b5076e69e68d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:46.299484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc9c33a8-2f99-4717-a411-b5076e69e68d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:46.300496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc9c33a8-2f99-4717-a411-b5076e69e68d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:46.379411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bce7748a-b02d-4676-8578-864beff06761 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:46.394988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bce7748a-b02d-4676-8578-864beff06761 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:46.414158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bce7748a-b02d-4676-8578-864beff06761 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:46.414780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bce7748a-b02d-4676-8578-864beff06761 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:46.415483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bce7748a-b02d-4676-8578-864beff06761 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:46.416639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bce7748a-b02d-4676-8578-864beff06761 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:46.417407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bce7748a-b02d-4676-8578-864beff06761 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:46.418259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bce7748a-b02d-4676-8578-864beff06761 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:46.729806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cc9c33a8-2f99-4717-a411-b5076e69e68d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:46.739076 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cc9c33a8-2f99-4717-a411-b5076e69e68d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1676 microversion: 2.1 time: 0.475861 Aug 29 15:41:46.744922 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1971/4014] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:46 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1676 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:46.833527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bce7748a-b02d-4676-8578-864beff06761 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:46.875416 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bce7748a-b02d-4676-8578-864beff06761 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 200 len: 1307 microversion: 2.1 time: 0.503332 Aug 29 15:41:46.877504 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2044/4015] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:46 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 1307 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:47.768198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c34c07bf-38ac-426f-aa5f-2066d19185d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:47.770083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c34c07bf-38ac-426f-aa5f-2066d19185d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:47.801585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c34c07bf-38ac-426f-aa5f-2066d19185d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:47.804121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c34c07bf-38ac-426f-aa5f-2066d19185d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:47.804977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c34c07bf-38ac-426f-aa5f-2066d19185d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:47.805980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c34c07bf-38ac-426f-aa5f-2066d19185d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:47.806860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c34c07bf-38ac-426f-aa5f-2066d19185d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:47.809431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c34c07bf-38ac-426f-aa5f-2066d19185d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:47.896149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-07331c3c-fe8a-45a1-9c4a-3564b2af1ace tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:47.896740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-07331c3c-fe8a-45a1-9c4a-3564b2af1ace tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:47.919101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07331c3c-fe8a-45a1-9c4a-3564b2af1ace tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:47.919621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07331c3c-fe8a-45a1-9c4a-3564b2af1ace tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:47.920119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07331c3c-fe8a-45a1-9c4a-3564b2af1ace tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:47.925281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07331c3c-fe8a-45a1-9c4a-3564b2af1ace tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:47.926706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07331c3c-fe8a-45a1-9c4a-3564b2af1ace tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:47.928557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07331c3c-fe8a-45a1-9c4a-3564b2af1ace tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:48.354935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-07331c3c-fe8a-45a1-9c4a-3564b2af1ace tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:48.376412 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-07331c3c-fe8a-45a1-9c4a-3564b2af1ace tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 200 len: 1487 microversion: 2.1 time: 0.482012 Aug 29 15:41:48.394950 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2045/4016] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:47 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 1487 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:48.412118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bcd91d01-79c9-4076-90cf-10eba6437b94 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:48.412761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bcd91d01-79c9-4076-90cf-10eba6437b94 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:48.434708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcd91d01-79c9-4076-90cf-10eba6437b94 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:48.439402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c34c07bf-38ac-426f-aa5f-2066d19185d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:48.452847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcd91d01-79c9-4076-90cf-10eba6437b94 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:48.454989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcd91d01-79c9-4076-90cf-10eba6437b94 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:48.458269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcd91d01-79c9-4076-90cf-10eba6437b94 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:48.458798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcd91d01-79c9-4076-90cf-10eba6437b94 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:48.459336 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c34c07bf-38ac-426f-aa5f-2066d19185d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1676 microversion: 2.1 time: 0.693237 Aug 29 15:41:48.460001 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1972/4017] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:47 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1676 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:48.461572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcd91d01-79c9-4076-90cf-10eba6437b94 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:48.644263 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bcd91d01-79c9-4076-90cf-10eba6437b94 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "POST /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a/action" status: 202 len: 0 microversion: 2.1 time: 0.243195 Aug 29 15:41:48.654629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4386506f-152e-454d-8297-0c1cc5b10991 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:48.655272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4386506f-152e-454d-8297-0c1cc5b10991 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:48.663013 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2046/4018] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:48 2022] POST /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:48.669213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4386506f-152e-454d-8297-0c1cc5b10991 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:48.670633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4386506f-152e-454d-8297-0c1cc5b10991 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:48.673749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4386506f-152e-454d-8297-0c1cc5b10991 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:48.675783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4386506f-152e-454d-8297-0c1cc5b10991 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:48.677548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4386506f-152e-454d-8297-0c1cc5b10991 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:48.679775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4386506f-152e-454d-8297-0c1cc5b10991 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:49.046235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4386506f-152e-454d-8297-0c1cc5b10991 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:49.057637 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4386506f-152e-454d-8297-0c1cc5b10991 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 200 len: 1492 microversion: 2.1 time: 0.407804 Aug 29 15:41:49.071305 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1973/4019] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:48 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 1492 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:49.482939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-23b090dd-d946-4ee3-8171-c5252b216c54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:49.495055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-23b090dd-d946-4ee3-8171-c5252b216c54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:49.522385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23b090dd-d946-4ee3-8171-c5252b216c54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:49.523486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23b090dd-d946-4ee3-8171-c5252b216c54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:49.524229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23b090dd-d946-4ee3-8171-c5252b216c54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:49.525396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23b090dd-d946-4ee3-8171-c5252b216c54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:49.526033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23b090dd-d946-4ee3-8171-c5252b216c54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:49.526913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23b090dd-d946-4ee3-8171-c5252b216c54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:49.921661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-23b090dd-d946-4ee3-8171-c5252b216c54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:49.941356 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-23b090dd-d946-4ee3-8171-c5252b216c54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1653 microversion: 2.1 time: 0.455112 Aug 29 15:41:49.953124 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2047/4020] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:49 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1653 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:49.967812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-524ae631-0be1-47c7-b0c9-b4af60900139 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:49.977381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-524ae631-0be1-47c7-b0c9-b4af60900139 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:49.978198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-524ae631-0be1-47c7-b0c9-b4af60900139 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:49.978983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-524ae631-0be1-47c7-b0c9-b4af60900139 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:50.017986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-524ae631-0be1-47c7-b0c9-b4af60900139 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Going to try to start instance {{(pid=122361) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 15:41:50.081594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3be74151-b984-431a-bb25-4dea64719666 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:50.082343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3be74151-b984-431a-bb25-4dea64719666 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:50.095370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3be74151-b984-431a-bb25-4dea64719666 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:50.098964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3be74151-b984-431a-bb25-4dea64719666 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:50.099661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3be74151-b984-431a-bb25-4dea64719666 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:50.100938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3be74151-b984-431a-bb25-4dea64719666 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:50.103459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3be74151-b984-431a-bb25-4dea64719666 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:50.104091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3be74151-b984-431a-bb25-4dea64719666 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:50.105812 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-524ae631-0be1-47c7-b0c9-b4af60900139 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "POST /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/action" status: 202 len: 0 microversion: 2.1 time: 0.139487 Aug 29 15:41:50.111309 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1974/4021] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:49 2022] POST /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:50.126260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-616de468-4512-4927-9d52-ac126f9ce399 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:50.127050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-616de468-4512-4927-9d52-ac126f9ce399 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:50.139927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-616de468-4512-4927-9d52-ac126f9ce399 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:50.142604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-616de468-4512-4927-9d52-ac126f9ce399 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:50.143092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-616de468-4512-4927-9d52-ac126f9ce399 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:50.143823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-616de468-4512-4927-9d52-ac126f9ce399 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:50.144296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-616de468-4512-4927-9d52-ac126f9ce399 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:50.144730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-616de468-4512-4927-9d52-ac126f9ce399 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:50.649640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3be74151-b984-431a-bb25-4dea64719666 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:50.662917 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3be74151-b984-431a-bb25-4dea64719666 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 200 len: 1472 microversion: 2.1 time: 0.585781 Aug 29 15:41:50.664160 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2048/4022] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:50 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 1472 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:50.687700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8e295a3d-b8c5-450d-a3b1-dd2b75af2871 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1119724586"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:50.690414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8e295a3d-b8c5-450d-a3b1-dd2b75af2871 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:50.698824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e295a3d-b8c5-450d-a3b1-dd2b75af2871 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:50.699607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e295a3d-b8c5-450d-a3b1-dd2b75af2871 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:50.702041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e295a3d-b8c5-450d-a3b1-dd2b75af2871 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:50.703374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e295a3d-b8c5-450d-a3b1-dd2b75af2871 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:50.704097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e295a3d-b8c5-450d-a3b1-dd2b75af2871 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:50.704689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e295a3d-b8c5-450d-a3b1-dd2b75af2871 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:51.127810 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8e295a3d-b8c5-450d-a3b1-dd2b75af2871 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "POST /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a/action" status: 202 len: 0 microversion: 2.1 time: 0.442113 Aug 29 15:41:51.138795 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2049/4023] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:50 2022] POST /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:41:51.153981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-564363ea-d062-418a-bff5-028e9e98924a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc433b51b80>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:51.247446 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-564363ea-d062-418a-bff5-028e9e98924a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1414 microversion: 2.1 time: 0.103981 Aug 29 15:41:51.248177 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2050/4024] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:51 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:51.353266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-616de468-4512-4927-9d52-ac126f9ce399 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:51.362460 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-616de468-4512-4927-9d52-ac126f9ce399 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1662 microversion: 2.1 time: 1.249499 Aug 29 15:41:51.367485 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1975/4025] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:50 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1662 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:52.267266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3bb08a86-04a7-4b75-965f-2bec4f1b47b0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a8dc940>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:52.389440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f93ad4dd-97cf-4999-8b23-9325c9b392e8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:52.391034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f93ad4dd-97cf-4999-8b23-9325c9b392e8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:52.408126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f93ad4dd-97cf-4999-8b23-9325c9b392e8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:52.408963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f93ad4dd-97cf-4999-8b23-9325c9b392e8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:52.410763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f93ad4dd-97cf-4999-8b23-9325c9b392e8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:52.416305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f93ad4dd-97cf-4999-8b23-9325c9b392e8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:52.417223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f93ad4dd-97cf-4999-8b23-9325c9b392e8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:52.417678 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3bb08a86-04a7-4b75-965f-2bec4f1b47b0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1414 microversion: 2.1 time: 0.157851 Aug 29 15:41:52.418117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f93ad4dd-97cf-4999-8b23-9325c9b392e8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:52.430653 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2051/4026] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:52 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1414 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:53.438661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1dfff20c-a6a1-42e3-b44d-2fb232bce333 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42adb28b0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:53.463745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f93ad4dd-97cf-4999-8b23-9325c9b392e8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:53.486955 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f93ad4dd-97cf-4999-8b23-9325c9b392e8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1662 microversion: 2.1 time: 1.102323 Aug 29 15:41:53.505155 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1976/4027] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:52 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1662 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:53.530347 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1dfff20c-a6a1-42e3-b44d-2fb232bce333 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1414 microversion: 2.1 time: 0.088858 Aug 29 15:41:53.531018 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2052/4028] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:53 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:54.510240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-90c36b2b-492b-4de2-9d4d-b37cc17fefdd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:54.512700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-90c36b2b-492b-4de2-9d4d-b37cc17fefdd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:54.537964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=74 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:54.548501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4c21c5e5-2482-4494-815c-1efa41e11883 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a8c93a0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:54.560818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90c36b2b-492b-4de2-9d4d-b37cc17fefdd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:54.561393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90c36b2b-492b-4de2-9d4d-b37cc17fefdd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:54.561850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90c36b2b-492b-4de2-9d4d-b37cc17fefdd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:54.569895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90c36b2b-492b-4de2-9d4d-b37cc17fefdd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:54.570336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90c36b2b-492b-4de2-9d4d-b37cc17fefdd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:54.572289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90c36b2b-492b-4de2-9d4d-b37cc17fefdd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:54.635387 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4c21c5e5-2482-4494-815c-1efa41e11883 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1414 microversion: 2.1 time: 0.092326 Aug 29 15:41:54.648644 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2053/4029] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:54 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:54.934899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-90c36b2b-492b-4de2-9d4d-b37cc17fefdd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:54.951192 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-90c36b2b-492b-4de2-9d4d-b37cc17fefdd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1666 microversion: 2.1 time: 0.445655 Aug 29 15:41:54.952122 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1977/4030] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:54 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1666 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:55.653554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-373a1514-ac0b-40c3-b214-1e16be5b8845 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a8c9160>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:55.722480 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-373a1514-ac0b-40c3-b214-1e16be5b8845 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1414 microversion: 2.1 time: 0.073411 Aug 29 15:41:55.723078 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2054/4031] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:55 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1414 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:56.739328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-95bada68-0a04-4e0a-9dc5-64af1ca5cecf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42b6f15e0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:56.809993 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-95bada68-0a04-4e0a-9dc5-64af1ca5cecf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1414 microversion: 2.1 time: 0.075418 Aug 29 15:41:56.818930 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1978/4032] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:56 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1414 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:57.837911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c7f95c54-2b3d-4c35-8526-cc00593dcd0c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42b7b2040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:57.875073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1758888055", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "6715f0d7-20ac-4613-aa14-6e5550638c17"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:57.953900 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c7f95c54-2b3d-4c35-8526-cc00593dcd0c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1414 microversion: 2.1 time: 0.131479 Aug 29 15:41:57.954849 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1979/4033] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:57 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:57.982620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] validate_networks() for [('6715f0d7-20ac-4613-aa14-6e5550638c17', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:41:58.968994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-584c0b18-7ea9-41e6-9964-95429834dce3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a943310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:59.122711 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-584c0b18-7ea9-41e6-9964-95429834dce3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1414 microversion: 2.1 time: 0.158076 Aug 29 15:41:59.123360 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1980/4034] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:58 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1414 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:59.897196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-74227196-1b84-4b6f-aede-70db1ad3078f req-76f4da04-7a3c-41cf-aa6a-1a48e978e2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc1d9ba-f64b-46cf-9006-0092135d5e7a", "name": "network-vif-plugged", "status": "completed", "tag": "beb0cebf-6f30-43e5-b747-c99c373def86"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:59.932981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-74227196-1b84-4b6f-aede-70db1ad3078f req-76f4da04-7a3c-41cf-aa6a-1a48e978e2a9 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:59.939260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-74227196-1b84-4b6f-aede-70db1ad3078f req-76f4da04-7a3c-41cf-aa6a-1a48e978e2a9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:59.939916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-74227196-1b84-4b6f-aede-70db1ad3078f req-76f4da04-7a3c-41cf-aa6a-1a48e978e2a9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:59.974265 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-74227196-1b84-4b6f-aede-70db1ad3078f req-76f4da04-7a3c-41cf-aa6a-1a48e978e2a9 service nova] Creating event network-vif-plugged:beb0cebf-6f30-43e5-b747-c99c373def86 for instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a on n-h1-839401-11 Aug 29 15:41:59.995086 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-74227196-1b84-4b6f-aede-70db1ad3078f req-76f4da04-7a3c-41cf-aa6a-1a48e978e2a9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101645 Aug 29 15:41:59.998547 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1981/4035] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:42:00.094227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:42:00.095728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:42:00.098031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:42:00.098738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:42:00.099331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:42:00.129207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:00.130102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:00.130743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:00.136341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:00.137312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:00.137945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:00.140015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9449c670-52a0-4729-9e64-64ec2f594a11 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42b92adc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:00.201117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Getting quotas for project 2cf3b32adf094715b432dcd75a883966. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:00.218315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Getting quotas for user fada133bdb6a4d0190a3abbadf0c252a and project 2cf3b32adf094715b432dcd75a883966. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:00.283006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Going to run 3 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:42:00.285645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: 6e6f613d-f4fd-4a8b-8a28-f787c3832995] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:42:00.383608 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9449c670-52a0-4729-9e64-64ec2f594a11 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1414 microversion: 2.1 time: 0.249267 Aug 29 15:42:00.384545 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1982/4036] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:00 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1414 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:00.386575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: c2363ee5-1fe6-4753-a6ca-c4a6700cd38b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=6e6f613d-f4fd-4a8b-8a28-f787c3832995,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:42:00.484841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=c2363ee5-1fe6-4753-a6ca-c4a6700cd38b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:42:00.663146 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-40b732d4-08dc-47ad-83af-e595593be082 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.008110 Aug 29 15:42:00.678368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7b132c12-df75-4d6e-8a2a-790c81a98340 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:00.681264 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2055/4037] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:41:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:42:00.683897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7b132c12-df75-4d6e-8a2a-790c81a98340 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:00.693779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7b132c12-df75-4d6e-8a2a-790c81a98340 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Searching by: {'deleted': False, 'project_id': '2cf3b32adf094715b432dcd75a883966'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:42:00.813814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b132c12-df75-4d6e-8a2a-790c81a98340 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:00.814411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b132c12-df75-4d6e-8a2a-790c81a98340 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:00.814866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b132c12-df75-4d6e-8a2a-790c81a98340 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:00.821980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b132c12-df75-4d6e-8a2a-790c81a98340 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:00.822554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b132c12-df75-4d6e-8a2a-790c81a98340 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:00.823012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b132c12-df75-4d6e-8a2a-790c81a98340 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:00.930381 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7b132c12-df75-4d6e-8a2a-790c81a98340 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.259593 Aug 29 15:42:00.943553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7c4fbd9a-5ccd-41c2-9d3a-5edbd4fb7540 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:00.945350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7c4fbd9a-5ccd-41c2-9d3a-5edbd4fb7540 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:00.950259 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1983/4038] 10.222.0.62 () {58 vars in 1125 bytes} [Mon Aug 29 15:42:00 2022] GET /compute/v2.1/servers => generated 1018 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:01.066947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7c4fbd9a-5ccd-41c2-9d3a-5edbd4fb7540 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:01.081232 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7c4fbd9a-5ccd-41c2-9d3a-5edbd4fb7540 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1223 microversion: 2.1 time: 0.141765 Aug 29 15:42:01.083374 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2056/4039] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:00 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1223 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:01.399464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a7765904-37c6-405b-9db7-db7def8e240c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42bbda040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:02.105068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2b808ec9-1562-469e-a5d6-9b508b8d5e19 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:02.105850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2b808ec9-1562-469e-a5d6-9b508b8d5e19 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:02.115915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=9 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:02.361868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2b808ec9-1562-469e-a5d6-9b508b8d5e19 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:02.392650 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2b808ec9-1562-469e-a5d6-9b508b8d5e19 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1223 microversion: 2.1 time: 0.271877 Aug 29 15:42:02.401224 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2057/4040] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:02 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1223 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:03.424960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4319fd49-05ca-42ae-b26f-320d240611d1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:03.425690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4319fd49-05ca-42ae-b26f-320d240611d1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:03.457785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4319fd49-05ca-42ae-b26f-320d240611d1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.473363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4319fd49-05ca-42ae-b26f-320d240611d1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.473832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4319fd49-05ca-42ae-b26f-320d240611d1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.475418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4319fd49-05ca-42ae-b26f-320d240611d1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.475953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4319fd49-05ca-42ae-b26f-320d240611d1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.476398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4319fd49-05ca-42ae-b26f-320d240611d1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.785073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4319fd49-05ca-42ae-b26f-320d240611d1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:03.820374 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4319fd49-05ca-42ae-b26f-320d240611d1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1227 microversion: 2.1 time: 0.405745 Aug 29 15:42:03.825376 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2058/4041] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:03 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1227 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:04.339643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c48a14de-3d4d-4812-aac7-213aa46bf767 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:04.342708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c48a14de-3d4d-4812-aac7-213aa46bf767 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:04.369304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c48a14de-3d4d-4812-aac7-213aa46bf767 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.374423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c48a14de-3d4d-4812-aac7-213aa46bf767 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.375580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c48a14de-3d4d-4812-aac7-213aa46bf767 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.380269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c48a14de-3d4d-4812-aac7-213aa46bf767 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.381946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c48a14de-3d4d-4812-aac7-213aa46bf767 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.384941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c48a14de-3d4d-4812-aac7-213aa46bf767 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.767306 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c48a14de-3d4d-4812-aac7-213aa46bf767 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 202 len: 0 microversion: 2.1 time: 0.427725 Aug 29 15:42:04.771386 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2059/4042] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:42:04 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:42:04.811517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ce055576-6812-4430-8f65-83b4eeb8f63d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:04.812580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ce055576-6812-4430-8f65-83b4eeb8f63d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:04.864387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce055576-6812-4430-8f65-83b4eeb8f63d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.865505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce055576-6812-4430-8f65-83b4eeb8f63d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.871390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce055576-6812-4430-8f65-83b4eeb8f63d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.876879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce055576-6812-4430-8f65-83b4eeb8f63d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.877514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce055576-6812-4430-8f65-83b4eeb8f63d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.877971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce055576-6812-4430-8f65-83b4eeb8f63d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.225713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ce055576-6812-4430-8f65-83b4eeb8f63d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:06.240620 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ce055576-6812-4430-8f65-83b4eeb8f63d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1671 microversion: 2.1 time: 1.467839 Aug 29 15:42:06.241262 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2060/4043] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:04 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1671 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:06.266678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-34940a2b-0d6b-4b1a-af00-5b4bb014303d tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:06.269970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-34940a2b-0d6b-4b1a-af00-5b4bb014303d tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:06.294520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34940a2b-0d6b-4b1a-af00-5b4bb014303d tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.301995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34940a2b-0d6b-4b1a-af00-5b4bb014303d tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.302758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34940a2b-0d6b-4b1a-af00-5b4bb014303d tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.304074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34940a2b-0d6b-4b1a-af00-5b4bb014303d tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.304557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34940a2b-0d6b-4b1a-af00-5b4bb014303d tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.304994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34940a2b-0d6b-4b1a-af00-5b4bb014303d tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.326973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:06.710681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-34940a2b-0d6b-4b1a-af00-5b4bb014303d tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:06.735095 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-34940a2b-0d6b-4b1a-af00-5b4bb014303d tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1281 microversion: 2.1 time: 0.490494 Aug 29 15:42:06.737207 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2061/4044] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:06 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1281 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:07.263972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a69d31c3-899b-4b61-83db-f8a0c5e9add2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:07.266121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a69d31c3-899b-4b61-83db-f8a0c5e9add2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:07.278181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a69d31c3-899b-4b61-83db-f8a0c5e9add2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:07.279007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a69d31c3-899b-4b61-83db-f8a0c5e9add2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:07.281966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a69d31c3-899b-4b61-83db-f8a0c5e9add2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:07.282917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a69d31c3-899b-4b61-83db-f8a0c5e9add2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:07.283575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a69d31c3-899b-4b61-83db-f8a0c5e9add2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:07.284859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a69d31c3-899b-4b61-83db-f8a0c5e9add2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:07.971402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a69d31c3-899b-4b61-83db-f8a0c5e9add2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:07.983605 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a69d31c3-899b-4b61-83db-f8a0c5e9add2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1671 microversion: 2.1 time: 0.724561 Aug 29 15:42:07.989145 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2062/4045] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:07 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1671 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:08.002419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c1ea0607-8447-481f-829f-26b51e559d06 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:08.007032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c1ea0607-8447-481f-829f-26b51e559d06 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:08.020116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ea0607-8447-481f-829f-26b51e559d06 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.022810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ea0607-8447-481f-829f-26b51e559d06 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.024889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ea0607-8447-481f-829f-26b51e559d06 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.025955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ea0607-8447-481f-829f-26b51e559d06 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.029938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ea0607-8447-481f-829f-26b51e559d06 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.038969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ea0607-8447-481f-829f-26b51e559d06 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.143835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c1ea0607-8447-481f-829f-26b51e559d06 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:08.156459 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c1ea0607-8447-481f-829f-26b51e559d06 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1281 microversion: 2.1 time: 0.163534 Aug 29 15:42:08.159998 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2063/4046] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:07 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1281 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:09.013534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a474c75a-0dda-4098-afed-5507053264c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:09.014210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a474c75a-0dda-4098-afed-5507053264c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:09.043037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a474c75a-0dda-4098-afed-5507053264c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:09.043560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a474c75a-0dda-4098-afed-5507053264c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:09.044538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a474c75a-0dda-4098-afed-5507053264c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:09.044826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a474c75a-0dda-4098-afed-5507053264c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:09.045457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a474c75a-0dda-4098-afed-5507053264c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:09.045761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a474c75a-0dda-4098-afed-5507053264c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.132039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a474c75a-0dda-4098-afed-5507053264c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:10.168873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:10.192388 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a474c75a-0dda-4098-afed-5507053264c6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1671 microversion: 2.1 time: 1.187113 Aug 29 15:42:10.214642 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2064/4047] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:09 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1671 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:10.233421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-368b49cb-a011-44f9-86ef-167d0b073fe4 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:10.245343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-368b49cb-a011-44f9-86ef-167d0b073fe4 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:10.260857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-368b49cb-a011-44f9-86ef-167d0b073fe4 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.262617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-368b49cb-a011-44f9-86ef-167d0b073fe4 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.263257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-368b49cb-a011-44f9-86ef-167d0b073fe4 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.264410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-368b49cb-a011-44f9-86ef-167d0b073fe4 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.265486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-368b49cb-a011-44f9-86ef-167d0b073fe4 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.266169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-368b49cb-a011-44f9-86ef-167d0b073fe4 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.596206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-368b49cb-a011-44f9-86ef-167d0b073fe4 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:10.606232 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-368b49cb-a011-44f9-86ef-167d0b073fe4 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1281 microversion: 2.1 time: 0.380813 Aug 29 15:42:10.624284 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2065/4048] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:10 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1281 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:10.714021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=5 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:10.828654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:10.929077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:11.047026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b0d3ea44-43f8-4b44-919f-2ebe2da8003d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:11.047548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b0d3ea44-43f8-4b44-919f-2ebe2da8003d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:11.073364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0d3ea44-43f8-4b44-919f-2ebe2da8003d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.073896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0d3ea44-43f8-4b44-919f-2ebe2da8003d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.074343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0d3ea44-43f8-4b44-919f-2ebe2da8003d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.075089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0d3ea44-43f8-4b44-919f-2ebe2da8003d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.075576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0d3ea44-43f8-4b44-919f-2ebe2da8003d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.075958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0d3ea44-43f8-4b44-919f-2ebe2da8003d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.191256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b0d3ea44-43f8-4b44-919f-2ebe2da8003d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:42:11.372382 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b0d3ea44-43f8-4b44-919f-2ebe2da8003d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "DELETE /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 204 len: 0 microversion: 2.42 time: 0.745637 Aug 29 15:42:11.379289 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2066/4049] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:42:10 2022] DELETE /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:42:11.387397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0d21b4a9-5d7c-41e7-80ff-6949dc3501bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:11.389661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0d21b4a9-5d7c-41e7-80ff-6949dc3501bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:11.398754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d21b4a9-5d7c-41e7-80ff-6949dc3501bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.400590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d21b4a9-5d7c-41e7-80ff-6949dc3501bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.401595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d21b4a9-5d7c-41e7-80ff-6949dc3501bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.403131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d21b4a9-5d7c-41e7-80ff-6949dc3501bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.404883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d21b4a9-5d7c-41e7-80ff-6949dc3501bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.406399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d21b4a9-5d7c-41e7-80ff-6949dc3501bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.090779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0d21b4a9-5d7c-41e7-80ff-6949dc3501bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:12.101302 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0d21b4a9-5d7c-41e7-80ff-6949dc3501bc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1676 microversion: 2.1 time: 0.719105 Aug 29 15:42:12.111922 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2067/4050] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:11 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1676 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:12.123481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0df12108-380b-4395-88c2-df252a7593ed tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.127158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0df12108-380b-4395-88c2-df252a7593ed tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:12.156579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0df12108-380b-4395-88c2-df252a7593ed tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.166140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0df12108-380b-4395-88c2-df252a7593ed tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.166926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0df12108-380b-4395-88c2-df252a7593ed tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.168031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0df12108-380b-4395-88c2-df252a7593ed tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.168685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0df12108-380b-4395-88c2-df252a7593ed tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.172331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0df12108-380b-4395-88c2-df252a7593ed tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.367176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=10 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:12.646158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0df12108-380b-4395-88c2-df252a7593ed tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:12.665184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0df12108-380b-4395-88c2-df252a7593ed tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:12.674928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0df12108-380b-4395-88c2-df252a7593ed tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:12.676295 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0df12108-380b-4395-88c2-df252a7593ed tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2962 microversion: 2.42 time: 0.561186 Aug 29 15:42:12.676863 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2068/4051] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:12 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2962 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:12.689477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f777f032-d061-49ce-8754-4862a1091ffe tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.690396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f777f032-d061-49ce-8754-4862a1091ffe tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:12.705272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f777f032-d061-49ce-8754-4862a1091ffe tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.706107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f777f032-d061-49ce-8754-4862a1091ffe tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.706723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f777f032-d061-49ce-8754-4862a1091ffe tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.707659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f777f032-d061-49ce-8754-4862a1091ffe tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.708911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f777f032-d061-49ce-8754-4862a1091ffe tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.716242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f777f032-d061-49ce-8754-4862a1091ffe tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.929989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f777f032-d061-49ce-8754-4862a1091ffe tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:12.945975 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f777f032-d061-49ce-8754-4862a1091ffe tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1281 microversion: 2.1 time: 0.267867 Aug 29 15:42:12.951360 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2069/4052] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:12 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1281 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:13.137993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a0983789-147c-4ef7-b332-3b5d331235a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:13.139035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a0983789-147c-4ef7-b332-3b5d331235a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:13.166771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0983789-147c-4ef7-b332-3b5d331235a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:13.170190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0983789-147c-4ef7-b332-3b5d331235a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:13.170861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0983789-147c-4ef7-b332-3b5d331235a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:13.174122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0983789-147c-4ef7-b332-3b5d331235a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:13.175646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0983789-147c-4ef7-b332-3b5d331235a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:13.176608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0983789-147c-4ef7-b332-3b5d331235a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:14.349062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a0983789-147c-4ef7-b332-3b5d331235a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:14.367062 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a0983789-147c-4ef7-b332-3b5d331235a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1676 microversion: 2.1 time: 1.234711 Aug 29 15:42:14.369519 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2070/4053] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:13 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1676 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:14.387821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b73e3a50-e4ca-4210-9541-7622ed0352a8 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:14.390294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b73e3a50-e4ca-4210-9541-7622ed0352a8 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:14.412200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73e3a50-e4ca-4210-9541-7622ed0352a8 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:14.413525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73e3a50-e4ca-4210-9541-7622ed0352a8 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:14.415220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73e3a50-e4ca-4210-9541-7622ed0352a8 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:14.416605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73e3a50-e4ca-4210-9541-7622ed0352a8 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:14.418440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73e3a50-e4ca-4210-9541-7622ed0352a8 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:14.419155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73e3a50-e4ca-4210-9541-7622ed0352a8 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:15.790239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b73e3a50-e4ca-4210-9541-7622ed0352a8 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:15.807655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b73e3a50-e4ca-4210-9541-7622ed0352a8 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:15.821253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b73e3a50-e4ca-4210-9541-7622ed0352a8 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:15.823494 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b73e3a50-e4ca-4210-9541-7622ed0352a8 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2962 microversion: 2.42 time: 1.452724 Aug 29 15:42:15.824627 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2071/4054] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:14 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2962 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:15.830980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ad81f68-5da4-48b3-a3c8-4278ffcbd1c8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:15.832107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ad81f68-5da4-48b3-a3c8-4278ffcbd1c8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:15.842570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ad81f68-5da4-48b3-a3c8-4278ffcbd1c8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:15.843483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ad81f68-5da4-48b3-a3c8-4278ffcbd1c8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:15.844179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ad81f68-5da4-48b3-a3c8-4278ffcbd1c8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:15.845316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ad81f68-5da4-48b3-a3c8-4278ffcbd1c8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:15.846985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ad81f68-5da4-48b3-a3c8-4278ffcbd1c8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:15.850086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ad81f68-5da4-48b3-a3c8-4278ffcbd1c8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.582077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5ad81f68-5da4-48b3-a3c8-4278ffcbd1c8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:16.603225 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ad81f68-5da4-48b3-a3c8-4278ffcbd1c8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1323 microversion: 2.1 time: 0.776919 Aug 29 15:42:16.605768 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2072/4055] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:15 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1323 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:16.614455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ba67c4ac-15aa-43d8-833b-d3a06ef11473 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:16.623401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ba67c4ac-15aa-43d8-833b-d3a06ef11473 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:16.648074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba67c4ac-15aa-43d8-833b-d3a06ef11473 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.654960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba67c4ac-15aa-43d8-833b-d3a06ef11473 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.655894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba67c4ac-15aa-43d8-833b-d3a06ef11473 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.658861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba67c4ac-15aa-43d8-833b-d3a06ef11473 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.661694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba67c4ac-15aa-43d8-833b-d3a06ef11473 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.664930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba67c4ac-15aa-43d8-833b-d3a06ef11473 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.301830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ba67c4ac-15aa-43d8-833b-d3a06ef11473 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:17.318337 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ba67c4ac-15aa-43d8-833b-d3a06ef11473 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.711037 Aug 29 15:42:17.319783 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2073/4056] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:16 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:17.343238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-abf175a1-15eb-4b4d-9daf-1134a782a2be tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:17.344269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-abf175a1-15eb-4b4d-9daf-1134a782a2be tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:17.359553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abf175a1-15eb-4b4d-9daf-1134a782a2be tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.363554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abf175a1-15eb-4b4d-9daf-1134a782a2be tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:17.371200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abf175a1-15eb-4b4d-9daf-1134a782a2be tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.372823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abf175a1-15eb-4b4d-9daf-1134a782a2be tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.373665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abf175a1-15eb-4b4d-9daf-1134a782a2be tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:17.374263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abf175a1-15eb-4b4d-9daf-1134a782a2be tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.975158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-abf175a1-15eb-4b4d-9daf-1134a782a2be tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:18.009954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-abf175a1-15eb-4b4d-9daf-1134a782a2be tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:18.012283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-abf175a1-15eb-4b4d-9daf-1134a782a2be tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:18.016039 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-abf175a1-15eb-4b4d-9daf-1134a782a2be tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2962 microversion: 2.42 time: 0.681078 Aug 29 15:42:18.016881 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2074/4057] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:17 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2962 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:18.043061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-39d08c3a-7e59-47f5-ad85-745cf7767681 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:18.044033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-39d08c3a-7e59-47f5-ad85-745cf7767681 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:18.054837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39d08c3a-7e59-47f5-ad85-745cf7767681 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:18.055733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39d08c3a-7e59-47f5-ad85-745cf7767681 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:18.056383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39d08c3a-7e59-47f5-ad85-745cf7767681 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:18.057372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39d08c3a-7e59-47f5-ad85-745cf7767681 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:18.058065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39d08c3a-7e59-47f5-ad85-745cf7767681 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:18.058675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39d08c3a-7e59-47f5-ad85-745cf7767681 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:18.731476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-39d08c3a-7e59-47f5-ad85-745cf7767681 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:18.748740 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-39d08c3a-7e59-47f5-ad85-745cf7767681 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1323 microversion: 2.1 time: 0.716474 Aug 29 15:42:18.763261 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2075/4058] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:18 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1323 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:18.785504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-aa5e4e5e-b1d4-4bfa-b4f1-92571d9f452a req-ed8b748d-e6ac-4ae9-a04c-91063f29dd9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e6f613d-f4fd-4a8b-8a28-f787c3832995", "tag": "4a6e9430-0313-4586-a0ce-1f8a40679121"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:18.823755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-aa5e4e5e-b1d4-4bfa-b4f1-92571d9f452a req-ed8b748d-e6ac-4ae9-a04c-91063f29dd9c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:18.826446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-aa5e4e5e-b1d4-4bfa-b4f1-92571d9f452a req-ed8b748d-e6ac-4ae9-a04c-91063f29dd9c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:18.848504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-aa5e4e5e-b1d4-4bfa-b4f1-92571d9f452a req-ed8b748d-e6ac-4ae9-a04c-91063f29dd9c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:18.861780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:18.895900 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-aa5e4e5e-b1d4-4bfa-b4f1-92571d9f452a req-ed8b748d-e6ac-4ae9-a04c-91063f29dd9c service nova] Creating event network-changed:4a6e9430-0313-4586-a0ce-1f8a40679121 for instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 on n-h2-839401-11 Aug 29 15:42:18.905674 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-aa5e4e5e-b1d4-4bfa-b4f1-92571d9f452a req-ed8b748d-e6ac-4ae9-a04c-91063f29dd9c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138115 Aug 29 15:42:18.909378 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2076/4059] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:19.048350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f5b3f725-a0b4-4e28-b01f-8c73481e4b03 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:19.049232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f5b3f725-a0b4-4e28-b01f-8c73481e4b03 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:19.065708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5b3f725-a0b4-4e28-b01f-8c73481e4b03 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.069802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5b3f725-a0b4-4e28-b01f-8c73481e4b03 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.070516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5b3f725-a0b4-4e28-b01f-8c73481e4b03 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.074052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5b3f725-a0b4-4e28-b01f-8c73481e4b03 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.076569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5b3f725-a0b4-4e28-b01f-8c73481e4b03 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.078504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5b3f725-a0b4-4e28-b01f-8c73481e4b03 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.196612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f5b3f725-a0b4-4e28-b01f-8c73481e4b03 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:20.221544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f5b3f725-a0b4-4e28-b01f-8c73481e4b03 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:20.233229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f5b3f725-a0b4-4e28-b01f-8c73481e4b03 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:20.243472 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f5b3f725-a0b4-4e28-b01f-8c73481e4b03 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2962 microversion: 2.42 time: 1.199768 Aug 29 15:42:20.269115 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2077/4060] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:19 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2962 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:20.301778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-3ae673df-d6fd-4cd4-9369-e0bb062ba593 req-064452c1-bf7a-4cd5-b4f7-bf6bc56c499b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-unplugged", "status": "completed", "tag": "528dfe97-4f5f-4f10-a2cd-7936781f265f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:20.333507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3ae673df-d6fd-4cd4-9369-e0bb062ba593 req-064452c1-bf7a-4cd5-b4f7-bf6bc56c499b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.334235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3ae673df-d6fd-4cd4-9369-e0bb062ba593 req-064452c1-bf7a-4cd5-b4f7-bf6bc56c499b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.342876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3ae673df-d6fd-4cd4-9369-e0bb062ba593 req-064452c1-bf7a-4cd5-b4f7-bf6bc56c499b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.378777 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-3ae673df-d6fd-4cd4-9369-e0bb062ba593 req-064452c1-bf7a-4cd5-b4f7-bf6bc56c499b service nova] Creating event network-vif-unplugged:528dfe97-4f5f-4f10-a2cd-7936781f265f for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:42:20.401326 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-3ae673df-d6fd-4cd4-9369-e0bb062ba593 req-064452c1-bf7a-4cd5-b4f7-bf6bc56c499b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144650 Aug 29 15:42:20.410352 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2078/4061] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:20.426861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d04d53c7-4388-46fe-a270-67b9e8083778 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:20.435281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d04d53c7-4388-46fe-a270-67b9e8083778 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:20.451680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d04d53c7-4388-46fe-a270-67b9e8083778 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.452491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d04d53c7-4388-46fe-a270-67b9e8083778 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.455183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d04d53c7-4388-46fe-a270-67b9e8083778 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.456151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d04d53c7-4388-46fe-a270-67b9e8083778 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.459072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d04d53c7-4388-46fe-a270-67b9e8083778 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.459816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d04d53c7-4388-46fe-a270-67b9e8083778 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:22.043989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d04d53c7-4388-46fe-a270-67b9e8083778 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:22.052588 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d04d53c7-4388-46fe-a270-67b9e8083778 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1323 microversion: 2.1 time: 1.640266 Aug 29 15:42:22.054658 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2079/4062] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:20 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1323 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:22.070458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-92d901aa-b54f-4eda-9699-bfe2f6b0b7da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:22.071108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-92d901aa-b54f-4eda-9699-bfe2f6b0b7da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:22.094724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92d901aa-b54f-4eda-9699-bfe2f6b0b7da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:22.097737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92d901aa-b54f-4eda-9699-bfe2f6b0b7da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:22.102327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92d901aa-b54f-4eda-9699-bfe2f6b0b7da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:22.106518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92d901aa-b54f-4eda-9699-bfe2f6b0b7da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:22.114222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92d901aa-b54f-4eda-9699-bfe2f6b0b7da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:22.115704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92d901aa-b54f-4eda-9699-bfe2f6b0b7da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:22.548822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-92d901aa-b54f-4eda-9699-bfe2f6b0b7da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:22.569742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-92d901aa-b54f-4eda-9699-bfe2f6b0b7da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:22.572010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-92d901aa-b54f-4eda-9699-bfe2f6b0b7da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:22.574953 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-92d901aa-b54f-4eda-9699-bfe2f6b0b7da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2962 microversion: 2.42 time: 0.519306 Aug 29 15:42:22.582206 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2080/4063] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:22 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2962 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:22.586986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-599de51b-56cb-45a1-964b-0ab6fb056002 req-81b5f07a-7d69-4764-91fd-e86139bc85f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b035c3ef-60ac-4572-8ab2-b6d4f50c6138", "tag": "73fe3fed-42da-403c-89bc-cd6d69b3425c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:22.625127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-599de51b-56cb-45a1-964b-0ab6fb056002 req-81b5f07a-7d69-4764-91fd-e86139bc85f4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:22.626005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-599de51b-56cb-45a1-964b-0ab6fb056002 req-81b5f07a-7d69-4764-91fd-e86139bc85f4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:22.626608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-599de51b-56cb-45a1-964b-0ab6fb056002 req-81b5f07a-7d69-4764-91fd-e86139bc85f4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:22.657745 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-599de51b-56cb-45a1-964b-0ab6fb056002 req-81b5f07a-7d69-4764-91fd-e86139bc85f4 service nova] Creating event network-changed:73fe3fed-42da-403c-89bc-cd6d69b3425c for instance b035c3ef-60ac-4572-8ab2-b6d4f50c6138 on n-h1-839401-11 Aug 29 15:42:22.667321 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-599de51b-56cb-45a1-964b-0ab6fb056002 req-81b5f07a-7d69-4764-91fd-e86139bc85f4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083381 Aug 29 15:42:22.668619 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2081/4064] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:22.674011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c9cfcbd6-8b8a-42b3-ab10-21ccc188a236 req-35f8306f-3d2b-4da6-b489-dc10cba40d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-unplugged", "status": "completed", "tag": "c7354a20-9cbe-469c-965c-d5e127f1f1bc"}, {"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-unplugged", "status": "completed", "tag": "a57525af-726d-4159-bf8f-7847df217cc9"}, {"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-unplugged", "status": "completed", "tag": "06aacd47-129b-4ad9-b005-9ae39e561668"}, {"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-unplugged", "status": "completed", "tag": "898c5b2c-e9b1-4662-8491-a1b8d879ce2b"}, {"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-unplugged", "status": "completed", "tag": "aeebdb13-55ba-4836-8aeb-54a484a60db4"}, {"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-unplugged", "status": "completed", "tag": "29a5d995-57d9-450f-ae74-d0d7be314912"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:22.687640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c9cfcbd6-8b8a-42b3-ab10-21ccc188a236 req-35f8306f-3d2b-4da6-b489-dc10cba40d2e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:22.688422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c9cfcbd6-8b8a-42b3-ab10-21ccc188a236 req-35f8306f-3d2b-4da6-b489-dc10cba40d2e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:22.689044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c9cfcbd6-8b8a-42b3-ab10-21ccc188a236 req-35f8306f-3d2b-4da6-b489-dc10cba40d2e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:22.718904 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c9cfcbd6-8b8a-42b3-ab10-21ccc188a236 req-35f8306f-3d2b-4da6-b489-dc10cba40d2e service nova] Creating event network-vif-unplugged:c7354a20-9cbe-469c-965c-d5e127f1f1bc for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:42:22.721303 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c9cfcbd6-8b8a-42b3-ab10-21ccc188a236 req-35f8306f-3d2b-4da6-b489-dc10cba40d2e service nova] Creating event network-vif-unplugged:a57525af-726d-4159-bf8f-7847df217cc9 for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:42:22.722093 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c9cfcbd6-8b8a-42b3-ab10-21ccc188a236 req-35f8306f-3d2b-4da6-b489-dc10cba40d2e service nova] Creating event network-vif-unplugged:06aacd47-129b-4ad9-b005-9ae39e561668 for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:42:22.722830 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c9cfcbd6-8b8a-42b3-ab10-21ccc188a236 req-35f8306f-3d2b-4da6-b489-dc10cba40d2e service nova] Creating event network-vif-unplugged:898c5b2c-e9b1-4662-8491-a1b8d879ce2b for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:42:22.724051 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c9cfcbd6-8b8a-42b3-ab10-21ccc188a236 req-35f8306f-3d2b-4da6-b489-dc10cba40d2e service nova] Creating event network-vif-unplugged:aeebdb13-55ba-4836-8aeb-54a484a60db4 for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:42:22.724805 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c9cfcbd6-8b8a-42b3-ab10-21ccc188a236 req-35f8306f-3d2b-4da6-b489-dc10cba40d2e service nova] Creating event network-vif-unplugged:29a5d995-57d9-450f-ae74-d0d7be314912 for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:42:22.737998 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c9cfcbd6-8b8a-42b3-ab10-21ccc188a236 req-35f8306f-3d2b-4da6-b489-dc10cba40d2e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1050 microversion: 2.1 time: 0.067749 Aug 29 15:42:22.740272 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2082/4065] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 1050 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:23.079018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-14b8a3f5-0a61-41b5-a131-6d85587560a2 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:23.079822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-14b8a3f5-0a61-41b5-a131-6d85587560a2 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:23.104420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14b8a3f5-0a61-41b5-a131-6d85587560a2 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:23.106454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14b8a3f5-0a61-41b5-a131-6d85587560a2 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:23.106928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14b8a3f5-0a61-41b5-a131-6d85587560a2 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:23.156016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14b8a3f5-0a61-41b5-a131-6d85587560a2 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:23.156016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14b8a3f5-0a61-41b5-a131-6d85587560a2 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:23.156016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14b8a3f5-0a61-41b5-a131-6d85587560a2 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:23.642668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-14b8a3f5-0a61-41b5-a131-6d85587560a2 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:23.663113 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-14b8a3f5-0a61-41b5-a131-6d85587560a2 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1323 microversion: 2.1 time: 0.584887 Aug 29 15:42:23.666258 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2083/4066] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:23 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1323 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:23.674527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-783f14a6-9198-4e98-8885-724ff542e9af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:23.675905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-783f14a6-9198-4e98-8885-724ff542e9af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:23.693918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-783f14a6-9198-4e98-8885-724ff542e9af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:23.695525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-783f14a6-9198-4e98-8885-724ff542e9af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:23.696367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-783f14a6-9198-4e98-8885-724ff542e9af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:23.698118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-783f14a6-9198-4e98-8885-724ff542e9af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:23.698781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-783f14a6-9198-4e98-8885-724ff542e9af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:23.699881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-783f14a6-9198-4e98-8885-724ff542e9af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:23.992824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-783f14a6-9198-4e98-8885-724ff542e9af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:24.007185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-783f14a6-9198-4e98-8885-724ff542e9af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:24.017659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-783f14a6-9198-4e98-8885-724ff542e9af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:24.019483 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-783f14a6-9198-4e98-8885-724ff542e9af tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2941 microversion: 2.42 time: 0.351965 Aug 29 15:42:24.020505 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2084/4067] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:23 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2941 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:24.684920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-44c7d39e-f94a-414b-b552-d16f4be07464 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:24.686665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-44c7d39e-f94a-414b-b552-d16f4be07464 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:24.702511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44c7d39e-f94a-414b-b552-d16f4be07464 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:24.710502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44c7d39e-f94a-414b-b552-d16f4be07464 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:24.711185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44c7d39e-f94a-414b-b552-d16f4be07464 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:24.712506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44c7d39e-f94a-414b-b552-d16f4be07464 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:24.715559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44c7d39e-f94a-414b-b552-d16f4be07464 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:24.718626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44c7d39e-f94a-414b-b552-d16f4be07464 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:25.151433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-44c7d39e-f94a-414b-b552-d16f4be07464 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:25.165352 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-44c7d39e-f94a-414b-b552-d16f4be07464 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1323 microversion: 2.1 time: 0.480142 Aug 29 15:42:25.166294 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2085/4068] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:24 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1323 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:25.203458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-51d0ef6d-8ff3-4330-9f57-b082e54fd221 req-1491f7a0-c338-48a0-baee-3bc2d4a08b13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2363ee5-1fe6-4753-a6ca-c4a6700cd38b", "tag": "dd204679-0e5e-4a4b-b477-ccfc910e18df"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:25.217203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-51d0ef6d-8ff3-4330-9f57-b082e54fd221 req-1491f7a0-c338-48a0-baee-3bc2d4a08b13 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:25.218119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-51d0ef6d-8ff3-4330-9f57-b082e54fd221 req-1491f7a0-c338-48a0-baee-3bc2d4a08b13 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:25.218711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-51d0ef6d-8ff3-4330-9f57-b082e54fd221 req-1491f7a0-c338-48a0-baee-3bc2d4a08b13 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:25.230013 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a7765904-37c6-405b-9db7-db7def8e240c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1414 microversion: 2.1 time: 23.834952 Aug 29 15:42:25.238920 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1984/4069] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:01 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1414 bytes in 23845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:25.246128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d750f403-ad21-4acc-b66a-7420758cd029 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:25.247090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d750f403-ad21-4acc-b66a-7420758cd029 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:25.252182 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-51d0ef6d-8ff3-4330-9f57-b082e54fd221 req-1491f7a0-c338-48a0-baee-3bc2d4a08b13 service nova] Creating event network-changed:dd204679-0e5e-4a4b-b477-ccfc910e18df for instance c2363ee5-1fe6-4753-a6ca-c4a6700cd38b on n-h2-839401-11 Aug 29 15:42:25.255131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d750f403-ad21-4acc-b66a-7420758cd029 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:25.255842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d750f403-ad21-4acc-b66a-7420758cd029 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:25.256445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d750f403-ad21-4acc-b66a-7420758cd029 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:25.258605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d750f403-ad21-4acc-b66a-7420758cd029 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:25.259486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d750f403-ad21-4acc-b66a-7420758cd029 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:25.260734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d750f403-ad21-4acc-b66a-7420758cd029 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:25.289143 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-51d0ef6d-8ff3-4330-9f57-b082e54fd221 req-1491f7a0-c338-48a0-baee-3bc2d4a08b13 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114584 Aug 29 15:42:25.289810 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2086/4070] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:26.189396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-18ff09a6-d5ab-4635-b1ca-3349d8562538 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:26.194319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-18ff09a6-d5ab-4635-b1ca-3349d8562538 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:26.206744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18ff09a6-d5ab-4635-b1ca-3349d8562538 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:26.209973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18ff09a6-d5ab-4635-b1ca-3349d8562538 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:26.210603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18ff09a6-d5ab-4635-b1ca-3349d8562538 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:26.213805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18ff09a6-d5ab-4635-b1ca-3349d8562538 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:26.214546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18ff09a6-d5ab-4635-b1ca-3349d8562538 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:26.217703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18ff09a6-d5ab-4635-b1ca-3349d8562538 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:26.602653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-18ff09a6-d5ab-4635-b1ca-3349d8562538 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:26.613602 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-18ff09a6-d5ab-4635-b1ca-3349d8562538 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1323 microversion: 2.1 time: 0.428574 Aug 29 15:42:26.616100 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2087/4071] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:26 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1323 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:26.628880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f880a210-7556-4db1-87b2-28a013b9309d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a8dcc10>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:26.750701 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f880a210-7556-4db1-87b2-28a013b9309d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1414 microversion: 2.1 time: 0.132306 Aug 29 15:42:26.761059 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2088/4072] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:26 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1414 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:27.300668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d750f403-ad21-4acc-b66a-7420758cd029 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:27.312287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d750f403-ad21-4acc-b66a-7420758cd029 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:27.321927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d750f403-ad21-4acc-b66a-7420758cd029 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:27.323449 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d750f403-ad21-4acc-b66a-7420758cd029 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2941 microversion: 2.42 time: 2.082839 Aug 29 15:42:27.345494 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1985/4073] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:25 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2941 bytes in 2106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:27.643666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ca85e268-e878-4dfc-951b-839635836316 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:27.644286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ca85e268-e878-4dfc-951b-839635836316 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:27.664117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca85e268-e878-4dfc-951b-839635836316 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:27.667540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca85e268-e878-4dfc-951b-839635836316 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:27.668320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca85e268-e878-4dfc-951b-839635836316 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:27.670190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca85e268-e878-4dfc-951b-839635836316 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:27.672980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca85e268-e878-4dfc-951b-839635836316 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:27.673655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca85e268-e878-4dfc-951b-839635836316 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:27.775666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-62e367ad-b3d6-4579-ba4a-69c45996f6e7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42b013310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:27.882859 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-62e367ad-b3d6-4579-ba4a-69c45996f6e7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1414 microversion: 2.1 time: 0.111021 Aug 29 15:42:27.883637 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1986/4074] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:27 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:28.271639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ca85e268-e878-4dfc-951b-839635836316 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:28.282633 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ca85e268-e878-4dfc-951b-839635836316 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1323 microversion: 2.1 time: 0.643802 Aug 29 15:42:28.292719 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2089/4075] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:27 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1323 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:28.353794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-36788dab-ec55-40b6-8da0-e5667c9e2378 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:28.354416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-36788dab-ec55-40b6-8da0-e5667c9e2378 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:28.377227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36788dab-ec55-40b6-8da0-e5667c9e2378 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:28.378029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36788dab-ec55-40b6-8da0-e5667c9e2378 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:28.378500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36788dab-ec55-40b6-8da0-e5667c9e2378 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:28.379286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36788dab-ec55-40b6-8da0-e5667c9e2378 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:28.379758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36788dab-ec55-40b6-8da0-e5667c9e2378 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:28.380195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36788dab-ec55-40b6-8da0-e5667c9e2378 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:28.903584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6360be2a-c20b-4a38-bb13-9e445598c6be tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a8dc790>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:28.988519 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6360be2a-c20b-4a38-bb13-9e445598c6be tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1414 microversion: 2.1 time: 0.094062 Aug 29 15:42:28.996042 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2090/4076] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:28 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:29.312487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e2fa9490-3208-4ee4-9d4d-6ef48fa54556 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:29.313340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e2fa9490-3208-4ee4-9d4d-6ef48fa54556 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:29.339146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2fa9490-3208-4ee4-9d4d-6ef48fa54556 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:29.339917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2fa9490-3208-4ee4-9d4d-6ef48fa54556 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:29.340506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2fa9490-3208-4ee4-9d4d-6ef48fa54556 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:29.341859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2fa9490-3208-4ee4-9d4d-6ef48fa54556 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:29.342463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2fa9490-3208-4ee4-9d4d-6ef48fa54556 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:29.343065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2fa9490-3208-4ee4-9d4d-6ef48fa54556 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:29.916775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36788dab-ec55-40b6-8da0-e5667c9e2378 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:29.941652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36788dab-ec55-40b6-8da0-e5667c9e2378 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:29.946812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36788dab-ec55-40b6-8da0-e5667c9e2378 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:29.953005 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-36788dab-ec55-40b6-8da0-e5667c9e2378 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2920 microversion: 2.42 time: 1.603891 Aug 29 15:42:29.962959 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1987/4077] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:28 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2920 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:30.004826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-146d8eb5-35d2-4990-a6e2-20575ffda67f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc433aaaee0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:30.047085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e2fa9490-3208-4ee4-9d4d-6ef48fa54556 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:30.060916 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e2fa9490-3208-4ee4-9d4d-6ef48fa54556 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1323 microversion: 2.1 time: 0.752738 Aug 29 15:42:30.073506 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2091/4078] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:29 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1323 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:30.156447 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-146d8eb5-35d2-4990-a6e2-20575ffda67f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1414 microversion: 2.1 time: 0.155972 Aug 29 15:42:30.175344 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1988/4079] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:29 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1414 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:30.569262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-97a15816-77ff-4335-9fd9-a2e05b1968f6 req-baaf3ce1-ff5b-417d-8e91-7fe19a3461db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-deleted", "tag": "aeebdb13-55ba-4836-8aeb-54a484a60db4"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:30.590565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-97a15816-77ff-4335-9fd9-a2e05b1968f6 req-baaf3ce1-ff5b-417d-8e91-7fe19a3461db service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:30.592889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-97a15816-77ff-4335-9fd9-a2e05b1968f6 req-baaf3ce1-ff5b-417d-8e91-7fe19a3461db service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:30.594914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-97a15816-77ff-4335-9fd9-a2e05b1968f6 req-baaf3ce1-ff5b-417d-8e91-7fe19a3461db service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:30.596624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-8624a701-05e4-478a-935d-65a63c21303a req-60ef05e2-e519-47b5-a036-03154f75561b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6f613d-f4fd-4a8b-8a28-f787c3832995", "name": "network-vif-plugged", "status": "completed", "tag": "4a6e9430-0313-4586-a0ce-1f8a40679121"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:30.615876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8624a701-05e4-478a-935d-65a63c21303a req-60ef05e2-e519-47b5-a036-03154f75561b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:30.620710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8624a701-05e4-478a-935d-65a63c21303a req-60ef05e2-e519-47b5-a036-03154f75561b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:30.621402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8624a701-05e4-478a-935d-65a63c21303a req-60ef05e2-e519-47b5-a036-03154f75561b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:30.630772 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-97a15816-77ff-4335-9fd9-a2e05b1968f6 req-baaf3ce1-ff5b-417d-8e91-7fe19a3461db service nova] Creating event network-vif-deleted:aeebdb13-55ba-4836-8aeb-54a484a60db4 for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:42:30.647871 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-97a15816-77ff-4335-9fd9-a2e05b1968f6 req-baaf3ce1-ff5b-417d-8e91-7fe19a3461db service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082590 Aug 29 15:42:30.649554 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2092/4080] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:30.674463 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-8624a701-05e4-478a-935d-65a63c21303a req-60ef05e2-e519-47b5-a036-03154f75561b service nova] Creating event network-vif-plugged:4a6e9430-0313-4586-a0ce-1f8a40679121 for instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 on n-h2-839401-11 Aug 29 15:42:30.690587 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-8624a701-05e4-478a-935d-65a63c21303a req-60ef05e2-e519-47b5-a036-03154f75561b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097796 Aug 29 15:42:30.693553 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1989/4081] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:42:30.991368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a20c4fde-6710-46c8-91cc-9fdfa16ef1a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:30.993217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a20c4fde-6710-46c8-91cc-9fdfa16ef1a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:31.010854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a20c4fde-6710-46c8-91cc-9fdfa16ef1a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:31.011362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a20c4fde-6710-46c8-91cc-9fdfa16ef1a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:31.011801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a20c4fde-6710-46c8-91cc-9fdfa16ef1a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:31.015820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a20c4fde-6710-46c8-91cc-9fdfa16ef1a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:31.016986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a20c4fde-6710-46c8-91cc-9fdfa16ef1a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:31.018844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a20c4fde-6710-46c8-91cc-9fdfa16ef1a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:31.092927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8006e8c7-99a6-471b-b89c-18eb89e9ec88 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:31.094514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8006e8c7-99a6-471b-b89c-18eb89e9ec88 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:31.126129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8006e8c7-99a6-471b-b89c-18eb89e9ec88 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:31.126754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8006e8c7-99a6-471b-b89c-18eb89e9ec88 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:31.127284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8006e8c7-99a6-471b-b89c-18eb89e9ec88 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:31.128380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8006e8c7-99a6-471b-b89c-18eb89e9ec88 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:31.129976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8006e8c7-99a6-471b-b89c-18eb89e9ec88 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:31.130491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8006e8c7-99a6-471b-b89c-18eb89e9ec88 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:31.277712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a20c4fde-6710-46c8-91cc-9fdfa16ef1a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:31.292508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a20c4fde-6710-46c8-91cc-9fdfa16ef1a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:31.324611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a20c4fde-6710-46c8-91cc-9fdfa16ef1a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:31.324611 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a20c4fde-6710-46c8-91cc-9fdfa16ef1a5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2873 microversion: 2.42 time: 0.314963 Aug 29 15:42:31.324611 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2093/4082] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:30 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2873 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:31.337377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2b1bb0ab-e750-4f4c-8677-da29132f2e26 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a8dc5e0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:31.429705 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2b1bb0ab-e750-4f4c-8677-da29132f2e26 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1414 microversion: 2.1 time: 0.103330 Aug 29 15:42:31.433823 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2094/4083] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:31 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:31.554362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8006e8c7-99a6-471b-b89c-18eb89e9ec88 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:31.566799 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8006e8c7-99a6-471b-b89c-18eb89e9ec88 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1323 microversion: 2.1 time: 0.475872 Aug 29 15:42:31.567895 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1990/4084] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:31 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1323 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:32.331522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-20aa3d00-133c-404d-866a-60ed2ffe49bc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:32.333305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-20aa3d00-133c-404d-866a-60ed2ffe49bc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:32.342066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:32.345521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20aa3d00-133c-404d-866a-60ed2ffe49bc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:32.346202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20aa3d00-133c-404d-866a-60ed2ffe49bc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:32.346916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20aa3d00-133c-404d-866a-60ed2ffe49bc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:32.347801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20aa3d00-133c-404d-866a-60ed2ffe49bc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:32.348503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20aa3d00-133c-404d-866a-60ed2ffe49bc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:32.350106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20aa3d00-133c-404d-866a-60ed2ffe49bc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:32.447182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e6239f32-1ee3-4095-a239-5a0c088edc53 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42bac2b80>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:32.537398 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e6239f32-1ee3-4095-a239-5a0c088edc53 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1423 microversion: 2.1 time: 0.094931 Aug 29 15:42:32.547170 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1991/4085] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:32 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1423 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:32.552564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ae4398db-05d5-4da1-99fd-dc2329835ae0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42b892280>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:32.614481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-20aa3d00-133c-404d-866a-60ed2ffe49bc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:32.636292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-20aa3d00-133c-404d-866a-60ed2ffe49bc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:32.638000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-20aa3d00-133c-404d-866a-60ed2ffe49bc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:32.639959 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-20aa3d00-133c-404d-866a-60ed2ffe49bc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2873 microversion: 2.42 time: 0.312784 Aug 29 15:42:32.640707 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2095/4086] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:32 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2873 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:32.671710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9ee033ec-2c9c-4a59-b917-842c9c049142 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:32.675859 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ae4398db-05d5-4da1-99fd-dc2329835ae0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 200 len: 1423 microversion: 2.1 time: 0.126211 Aug 29 15:42:32.686414 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1992/4087] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:32 2022] GET /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 1423 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:32.687282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9ee033ec-2c9c-4a59-b917-842c9c049142 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:32.691416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-686ee6c7-f1b7-437b-b256-335dc434c1f2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42bac2040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:32.693986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ee033ec-2c9c-4a59-b917-842c9c049142 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:32.694545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ee033ec-2c9c-4a59-b917-842c9c049142 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:32.694992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ee033ec-2c9c-4a59-b917-842c9c049142 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:32.695710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ee033ec-2c9c-4a59-b917-842c9c049142 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:32.696174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ee033ec-2c9c-4a59-b917-842c9c049142 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:32.696606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ee033ec-2c9c-4a59-b917-842c9c049142 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:33.004939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9ee033ec-2c9c-4a59-b917-842c9c049142 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:33.015635 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9ee033ec-2c9c-4a59-b917-842c9c049142 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1323 microversion: 2.1 time: 0.346910 Aug 29 15:42:33.017014 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2096/4088] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:32 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1323 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:33.021828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-367c312c-39b7-4074-a391-1862f91b9f41 req-7e1521ca-eb42-4b3e-9bd0-ea68265059ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b035c3ef-60ac-4572-8ab2-b6d4f50c6138", "name": "network-vif-plugged", "status": "completed", "tag": "73fe3fed-42da-403c-89bc-cd6d69b3425c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:33.031988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-367c312c-39b7-4074-a391-1862f91b9f41 req-7e1521ca-eb42-4b3e-9bd0-ea68265059ac service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:33.032561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-367c312c-39b7-4074-a391-1862f91b9f41 req-7e1521ca-eb42-4b3e-9bd0-ea68265059ac service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:33.033158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-367c312c-39b7-4074-a391-1862f91b9f41 req-7e1521ca-eb42-4b3e-9bd0-ea68265059ac service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:33.045022 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-367c312c-39b7-4074-a391-1862f91b9f41 req-7e1521ca-eb42-4b3e-9bd0-ea68265059ac service nova] Creating event network-vif-plugged:73fe3fed-42da-403c-89bc-cd6d69b3425c for instance b035c3ef-60ac-4572-8ab2-b6d4f50c6138 on n-h1-839401-11 Aug 29 15:42:33.050846 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-367c312c-39b7-4074-a391-1862f91b9f41 req-7e1521ca-eb42-4b3e-9bd0-ea68265059ac service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032515 Aug 29 15:42:33.052067 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2097/4089] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:33.670812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-de96f1bf-bc14-40f7-928e-2a339acf8582 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:33.672165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-de96f1bf-bc14-40f7-928e-2a339acf8582 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:33.679734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de96f1bf-bc14-40f7-928e-2a339acf8582 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:33.680439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de96f1bf-bc14-40f7-928e-2a339acf8582 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:33.681032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de96f1bf-bc14-40f7-928e-2a339acf8582 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:33.681954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de96f1bf-bc14-40f7-928e-2a339acf8582 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:33.682557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de96f1bf-bc14-40f7-928e-2a339acf8582 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:33.683328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de96f1bf-bc14-40f7-928e-2a339acf8582 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:33.946794 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-686ee6c7-f1b7-437b-b256-335dc434c1f2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "DELETE /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 204 len: 0 microversion: 2.1 time: 1.259202 Aug 29 15:42:33.947515 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1993/4090] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:32 2022] DELETE /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 0 bytes in 1261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:33.956188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-09154668-cc71-424d-a3da-6dab8749deee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:33.956838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-09154668-cc71-424d-a3da-6dab8749deee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:33.979915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09154668-cc71-424d-a3da-6dab8749deee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:33.983809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09154668-cc71-424d-a3da-6dab8749deee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:33.984297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09154668-cc71-424d-a3da-6dab8749deee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:33.985176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09154668-cc71-424d-a3da-6dab8749deee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:33.985648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09154668-cc71-424d-a3da-6dab8749deee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:33.986108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09154668-cc71-424d-a3da-6dab8749deee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:34.008856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-de96f1bf-bc14-40f7-928e-2a339acf8582 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:34.021793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-de96f1bf-bc14-40f7-928e-2a339acf8582 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:34.023908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-de96f1bf-bc14-40f7-928e-2a339acf8582 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:34.025765 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-de96f1bf-bc14-40f7-928e-2a339acf8582 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2759 microversion: 2.42 time: 0.359133 Aug 29 15:42:34.027684 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2098/4091] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:33 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2759 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:34.041404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-843f2f6d-0464-4fd2-ab74-3fab5997bb0b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:34.044394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-843f2f6d-0464-4fd2-ab74-3fab5997bb0b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:34.050893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-09154668-cc71-424d-a3da-6dab8749deee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:42:34.058522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-843f2f6d-0464-4fd2-ab74-3fab5997bb0b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:34.061062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-843f2f6d-0464-4fd2-ab74-3fab5997bb0b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:34.064750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-843f2f6d-0464-4fd2-ab74-3fab5997bb0b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:34.065847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-843f2f6d-0464-4fd2-ab74-3fab5997bb0b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:34.066456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-843f2f6d-0464-4fd2-ab74-3fab5997bb0b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:34.066943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-843f2f6d-0464-4fd2-ab74-3fab5997bb0b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:34.197455 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-09154668-cc71-424d-a3da-6dab8749deee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 204 len: 0 microversion: 2.1 time: 0.244741 Aug 29 15:42:34.199085 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1994/4092] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:33 2022] DELETE /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:42:34.358341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1408773516", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "3ac7e564-b250-488a-8919-b9f712fff14c"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:34.442522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-843f2f6d-0464-4fd2-ab74-3fab5997bb0b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:34.468658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] validate_networks() for [('3ac7e564-b250-488a-8919-b9f712fff14c', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:42:34.481422 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-843f2f6d-0464-4fd2-ab74-3fab5997bb0b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1323 microversion: 2.1 time: 0.439224 Aug 29 15:42:34.483798 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2099/4093] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:34 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1323 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:35.015618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-80304ba6-0d40-4999-b0b5-fc7a78831388 req-bed5caea-1313-4e0f-8eee-df2f21ac191b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-deleted", "tag": "06aacd47-129b-4ad9-b005-9ae39e561668"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:35.052358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-80304ba6-0d40-4999-b0b5-fc7a78831388 req-bed5caea-1313-4e0f-8eee-df2f21ac191b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:35.053156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-80304ba6-0d40-4999-b0b5-fc7a78831388 req-bed5caea-1313-4e0f-8eee-df2f21ac191b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:35.053794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-80304ba6-0d40-4999-b0b5-fc7a78831388 req-bed5caea-1313-4e0f-8eee-df2f21ac191b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.087370 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-80304ba6-0d40-4999-b0b5-fc7a78831388 req-bed5caea-1313-4e0f-8eee-df2f21ac191b service nova] Creating event network-vif-deleted:06aacd47-129b-4ad9-b005-9ae39e561668 for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:42:35.098159 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-80304ba6-0d40-4999-b0b5-fc7a78831388 req-bed5caea-1313-4e0f-8eee-df2f21ac191b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084726 Aug 29 15:42:35.102069 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2100/4094] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:35.110009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-decad7f5-13d8-4382-aefb-a1a033fa236a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:35.111230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-decad7f5-13d8-4382-aefb-a1a033fa236a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:35.123936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-decad7f5-13d8-4382-aefb-a1a033fa236a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:35.124833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-decad7f5-13d8-4382-aefb-a1a033fa236a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:35.125717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-decad7f5-13d8-4382-aefb-a1a033fa236a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.126608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-decad7f5-13d8-4382-aefb-a1a033fa236a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:35.127214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-decad7f5-13d8-4382-aefb-a1a033fa236a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:35.127786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-decad7f5-13d8-4382-aefb-a1a033fa236a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.171389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:35.354664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-decad7f5-13d8-4382-aefb-a1a033fa236a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:35.371805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-decad7f5-13d8-4382-aefb-a1a033fa236a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:35.373791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-decad7f5-13d8-4382-aefb-a1a033fa236a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:35.375419 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-decad7f5-13d8-4382-aefb-a1a033fa236a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2712 microversion: 2.42 time: 0.271945 Aug 29 15:42:35.376883 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2101/4095] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:35 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2712 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:35.505560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-527ebb7d-e495-4ca6-922f-835d7fcbdd21 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:35.506543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-527ebb7d-e495-4ca6-922f-835d7fcbdd21 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:35.519128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-527ebb7d-e495-4ca6-922f-835d7fcbdd21 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:35.519585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-527ebb7d-e495-4ca6-922f-835d7fcbdd21 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:35.520029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-527ebb7d-e495-4ca6-922f-835d7fcbdd21 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.520737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-527ebb7d-e495-4ca6-922f-835d7fcbdd21 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:35.521220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-527ebb7d-e495-4ca6-922f-835d7fcbdd21 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:35.521652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-527ebb7d-e495-4ca6-922f-835d7fcbdd21 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.697038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-527ebb7d-e495-4ca6-922f-835d7fcbdd21 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:35.709055 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-527ebb7d-e495-4ca6-922f-835d7fcbdd21 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1323 microversion: 2.1 time: 0.208206 Aug 29 15:42:35.714292 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2102/4096] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:35 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1323 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:36.007831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-9b86bb1a-663d-4d16-be99-dc8290addbf5 req-eb27598f-446a-4caa-a13a-de021e75c533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc1d9ba-f64b-46cf-9006-0092135d5e7a", "name": "network-vif-unplugged", "status": "completed", "tag": "beb0cebf-6f30-43e5-b747-c99c373def86"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:36.026044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9b86bb1a-663d-4d16-be99-dc8290addbf5 req-eb27598f-446a-4caa-a13a-de021e75c533 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.026784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9b86bb1a-663d-4d16-be99-dc8290addbf5 req-eb27598f-446a-4caa-a13a-de021e75c533 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.027019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9b86bb1a-663d-4d16-be99-dc8290addbf5 req-eb27598f-446a-4caa-a13a-de021e75c533 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:36.042264 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-9b86bb1a-663d-4d16-be99-dc8290addbf5 req-eb27598f-446a-4caa-a13a-de021e75c533 service nova] Creating event network-vif-unplugged:beb0cebf-6f30-43e5-b747-c99c373def86 for instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a on n-h1-839401-11 Aug 29 15:42:36.048803 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-9b86bb1a-663d-4d16-be99-dc8290addbf5 req-eb27598f-446a-4caa-a13a-de021e75c533 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052142 Aug 29 15:42:36.049914 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2103/4097] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:42:36.147972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:42:36.150126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:42:36.151404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:42:36.152522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:42:36.153416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:42:36.167551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.170761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.171830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:36.173382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.174190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.175173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:36.219468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Getting quotas for project ad019754b47441d5a286666f8a048b48. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:36.229859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Getting quotas for user 71ae9af4779a4d50b9171ff9ca8b5207 and project ad019754b47441d5a286666f8a048b48. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:36.245632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:42:36.249333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:42:36.334643 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ea9be208-0ea1-4c60-9ae6-0de20685e14d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.982258 Aug 29 15:42:36.336159 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1995/4098] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:42:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:42:36.348360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bd763cb6-9993-41de-ab3f-58380773b9c3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:36.350623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bd763cb6-9993-41de-ab3f-58380773b9c3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:36.403068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f6d0085c-9e69-4373-8f78-28b8e7144e71 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:36.403965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f6d0085c-9e69-4373-8f78-28b8e7144e71 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:36.413107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6d0085c-9e69-4373-8f78-28b8e7144e71 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.417060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6d0085c-9e69-4373-8f78-28b8e7144e71 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.417683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6d0085c-9e69-4373-8f78-28b8e7144e71 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:36.418568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6d0085c-9e69-4373-8f78-28b8e7144e71 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.426617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6d0085c-9e69-4373-8f78-28b8e7144e71 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.427414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6d0085c-9e69-4373-8f78-28b8e7144e71 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:36.482669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bd763cb6-9993-41de-ab3f-58380773b9c3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:36.495466 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bd763cb6-9993-41de-ab3f-58380773b9c3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1208 microversion: 2.1 time: 0.151721 Aug 29 15:42:36.496158 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2104/4099] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:36 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1208 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:36.736656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d81817e0-d6fa-47cb-9531-821e6aec86f5 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:36.737440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d81817e0-d6fa-47cb-9531-821e6aec86f5 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:36.750448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d81817e0-d6fa-47cb-9531-821e6aec86f5 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.752027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d81817e0-d6fa-47cb-9531-821e6aec86f5 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.752450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d81817e0-d6fa-47cb-9531-821e6aec86f5 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:36.753616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d81817e0-d6fa-47cb-9531-821e6aec86f5 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.754459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d81817e0-d6fa-47cb-9531-821e6aec86f5 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.755059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d81817e0-d6fa-47cb-9531-821e6aec86f5 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:36.906888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f6d0085c-9e69-4373-8f78-28b8e7144e71 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:36.919121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f6d0085c-9e69-4373-8f78-28b8e7144e71 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:36.954299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f6d0085c-9e69-4373-8f78-28b8e7144e71 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:36.959457 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f6d0085c-9e69-4373-8f78-28b8e7144e71 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2551 microversion: 2.42 time: 0.559524 Aug 29 15:42:36.961496 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1996/4100] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:36 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2551 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:42:36.993162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d81817e0-d6fa-47cb-9531-821e6aec86f5 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:37.003996 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d81817e0-d6fa-47cb-9531-821e6aec86f5 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1516 microversion: 2.1 time: 0.270835 Aug 29 15:42:37.022293 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2105/4101] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:36 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1516 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:37.029530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6ba833cc-a2c5-4f82-835b-4ce2ae20b5ca tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:37.030973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6ba833cc-a2c5-4f82-835b-4ce2ae20b5ca tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: c2363ee5-1fe6-4753-a6ca-c4a6700cd38b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:37.039618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba833cc-a2c5-4f82-835b-4ce2ae20b5ca tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:37.040106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba833cc-a2c5-4f82-835b-4ce2ae20b5ca tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:37.040686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba833cc-a2c5-4f82-835b-4ce2ae20b5ca tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:37.041432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba833cc-a2c5-4f82-835b-4ce2ae20b5ca tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:37.049730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba833cc-a2c5-4f82-835b-4ce2ae20b5ca tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:37.050606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba833cc-a2c5-4f82-835b-4ce2ae20b5ca tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:37.133455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-0007ef59-f9ec-4744-ba21-244082ffae57 req-9774fc19-9bdb-47c3-a9f6-c75d1dfa07a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-deleted", "tag": "29a5d995-57d9-450f-ae74-d0d7be314912"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:37.153805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0007ef59-f9ec-4744-ba21-244082ffae57 req-9774fc19-9bdb-47c3-a9f6-c75d1dfa07a9 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:37.154765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0007ef59-f9ec-4744-ba21-244082ffae57 req-9774fc19-9bdb-47c3-a9f6-c75d1dfa07a9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:37.155433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0007ef59-f9ec-4744-ba21-244082ffae57 req-9774fc19-9bdb-47c3-a9f6-c75d1dfa07a9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:37.182627 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-0007ef59-f9ec-4744-ba21-244082ffae57 req-9774fc19-9bdb-47c3-a9f6-c75d1dfa07a9 service nova] Creating event network-vif-deleted:29a5d995-57d9-450f-ae74-d0d7be314912 for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:42:37.200199 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-0007ef59-f9ec-4744-ba21-244082ffae57 req-9774fc19-9bdb-47c3-a9f6-c75d1dfa07a9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072675 Aug 29 15:42:37.201229 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2106/4102] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:37.517254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7a727274-7bb2-46ba-9ba4-4590a2c51d16 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:37.518366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7a727274-7bb2-46ba-9ba4-4590a2c51d16 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:37.529130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a727274-7bb2-46ba-9ba4-4590a2c51d16 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:37.529971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a727274-7bb2-46ba-9ba4-4590a2c51d16 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:37.530862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a727274-7bb2-46ba-9ba4-4590a2c51d16 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:37.531855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a727274-7bb2-46ba-9ba4-4590a2c51d16 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:37.532621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a727274-7bb2-46ba-9ba4-4590a2c51d16 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:37.533422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a727274-7bb2-46ba-9ba4-4590a2c51d16 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:37.958006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6ba833cc-a2c5-4f82-835b-4ce2ae20b5ca tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:37.972993 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6ba833cc-a2c5-4f82-835b-4ce2ae20b5ca tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b" status: 200 len: 1323 microversion: 2.1 time: 0.948899 Aug 29 15:42:37.973672 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1997/4103] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:37 2022] GET /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b => generated 1323 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:38.010665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ba1cb03f-8e3d-40ca-b53d-9e0a53ad3a18 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:38.011554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ba1cb03f-8e3d-40ca-b53d-9e0a53ad3a18 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:38.025627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba1cb03f-8e3d-40ca-b53d-9e0a53ad3a18 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:38.026283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba1cb03f-8e3d-40ca-b53d-9e0a53ad3a18 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:38.026858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba1cb03f-8e3d-40ca-b53d-9e0a53ad3a18 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:38.033445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba1cb03f-8e3d-40ca-b53d-9e0a53ad3a18 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:38.034292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba1cb03f-8e3d-40ca-b53d-9e0a53ad3a18 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:38.035834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba1cb03f-8e3d-40ca-b53d-9e0a53ad3a18 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:38.046893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7a727274-7bb2-46ba-9ba4-4590a2c51d16 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:38.068040 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7a727274-7bb2-46ba-9ba4-4590a2c51d16 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1260 microversion: 2.1 time: 0.554998 Aug 29 15:42:38.068935 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2107/4104] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:37 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1260 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:38.083751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-847c950c-581d-448b-8602-87f34c46ec27 req-36f81e42-c8c8-44f2-ae2f-8a0ab088d2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2363ee5-1fe6-4753-a6ca-c4a6700cd38b", "name": "network-vif-plugged", "status": "completed", "tag": "dd204679-0e5e-4a4b-b477-ccfc910e18df"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:38.110715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-847c950c-581d-448b-8602-87f34c46ec27 req-36f81e42-c8c8-44f2-ae2f-8a0ab088d2c1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:38.111552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-847c950c-581d-448b-8602-87f34c46ec27 req-36f81e42-c8c8-44f2-ae2f-8a0ab088d2c1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:38.112076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-847c950c-581d-448b-8602-87f34c46ec27 req-36f81e42-c8c8-44f2-ae2f-8a0ab088d2c1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:38.130978 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-847c950c-581d-448b-8602-87f34c46ec27 req-36f81e42-c8c8-44f2-ae2f-8a0ab088d2c1 service nova] Creating event network-vif-plugged:dd204679-0e5e-4a4b-b477-ccfc910e18df for instance c2363ee5-1fe6-4753-a6ca-c4a6700cd38b on n-h2-839401-11 Aug 29 15:42:38.137955 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-847c950c-581d-448b-8602-87f34c46ec27 req-36f81e42-c8c8-44f2-ae2f-8a0ab088d2c1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067264 Aug 29 15:42:38.138584 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2108/4105] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:38.700689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ba1cb03f-8e3d-40ca-b53d-9e0a53ad3a18 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:38.716100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ba1cb03f-8e3d-40ca-b53d-9e0a53ad3a18 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:38.717990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ba1cb03f-8e3d-40ca-b53d-9e0a53ad3a18 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:38.719553 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ba1cb03f-8e3d-40ca-b53d-9e0a53ad3a18 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2391 microversion: 2.42 time: 0.719767 Aug 29 15:42:38.734687 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1998/4106] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:37 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2391 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:39.002602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ed8049e7-90a1-417b-8d0b-ab3e34453d1e tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:39.003441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ed8049e7-90a1-417b-8d0b-ab3e34453d1e tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: c2363ee5-1fe6-4753-a6ca-c4a6700cd38b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:39.012126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed8049e7-90a1-417b-8d0b-ab3e34453d1e tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:39.012697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed8049e7-90a1-417b-8d0b-ab3e34453d1e tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:39.013234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed8049e7-90a1-417b-8d0b-ab3e34453d1e tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:39.014081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed8049e7-90a1-417b-8d0b-ab3e34453d1e tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:39.014906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed8049e7-90a1-417b-8d0b-ab3e34453d1e tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:39.015509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed8049e7-90a1-417b-8d0b-ab3e34453d1e tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:39.096675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-87027ed8-8573-4a29-b293-be6027000be8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:39.098085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-87027ed8-8573-4a29-b293-be6027000be8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:39.106690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87027ed8-8573-4a29-b293-be6027000be8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:39.107845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87027ed8-8573-4a29-b293-be6027000be8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:39.108543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87027ed8-8573-4a29-b293-be6027000be8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:39.109801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87027ed8-8573-4a29-b293-be6027000be8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:39.110470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87027ed8-8573-4a29-b293-be6027000be8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:39.111144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87027ed8-8573-4a29-b293-be6027000be8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:39.267107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-87027ed8-8573-4a29-b293-be6027000be8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:39.279269 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-87027ed8-8573-4a29-b293-be6027000be8 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1266 microversion: 2.1 time: 0.186054 Aug 29 15:42:39.281287 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 1999/4107] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:39 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:39.288559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-e00f9133-e4d6-4dec-a221-735adcc6ed19 req-898de2cb-f2c7-4f6a-a0b5-5bc5b6955cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-deleted", "tag": "a57525af-726d-4159-bf8f-7847df217cc9"}, {"server_uuid": "ebc1d9ba-f64b-46cf-9006-0092135d5e7a", "name": "network-vif-deleted", "tag": "beb0cebf-6f30-43e5-b747-c99c373def86"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:39.308384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e00f9133-e4d6-4dec-a221-735adcc6ed19 req-898de2cb-f2c7-4f6a-a0b5-5bc5b6955cb3 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:39.309900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e00f9133-e4d6-4dec-a221-735adcc6ed19 req-898de2cb-f2c7-4f6a-a0b5-5bc5b6955cb3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:39.310939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e00f9133-e4d6-4dec-a221-735adcc6ed19 req-898de2cb-f2c7-4f6a-a0b5-5bc5b6955cb3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:39.360488 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-e00f9133-e4d6-4dec-a221-735adcc6ed19 req-898de2cb-f2c7-4f6a-a0b5-5bc5b6955cb3 service nova] Creating event network-vif-deleted:a57525af-726d-4159-bf8f-7847df217cc9 for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:42:39.363342 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-e00f9133-e4d6-4dec-a221-735adcc6ed19 req-898de2cb-f2c7-4f6a-a0b5-5bc5b6955cb3 service nova] Creating event network-vif-deleted:beb0cebf-6f30-43e5-b747-c99c373def86 for instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a on n-h1-839401-11 Aug 29 15:42:39.394110 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-e00f9133-e4d6-4dec-a221-735adcc6ed19 req-898de2cb-f2c7-4f6a-a0b5-5bc5b6955cb3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.110241 Aug 29 15:42:39.395496 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2000/4108] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:39.469049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ed8049e7-90a1-417b-8d0b-ab3e34453d1e tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:39.485627 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ed8049e7-90a1-417b-8d0b-ab3e34453d1e tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b" status: 200 len: 1323 microversion: 2.1 time: 0.490000 Aug 29 15:42:39.494288 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2109/4109] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:38 2022] GET /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b => generated 1323 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:39.751439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ac19eeb7-0993-4aa9-9c5a-50a92956478e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:39.755260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ac19eeb7-0993-4aa9-9c5a-50a92956478e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:39.772573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac19eeb7-0993-4aa9-9c5a-50a92956478e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:39.776549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac19eeb7-0993-4aa9-9c5a-50a92956478e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:39.777168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac19eeb7-0993-4aa9-9c5a-50a92956478e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:39.778305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac19eeb7-0993-4aa9-9c5a-50a92956478e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:39.781723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac19eeb7-0993-4aa9-9c5a-50a92956478e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:39.782396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac19eeb7-0993-4aa9-9c5a-50a92956478e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:39.913043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ac19eeb7-0993-4aa9-9c5a-50a92956478e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:39.929213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ac19eeb7-0993-4aa9-9c5a-50a92956478e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:39.933199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ac19eeb7-0993-4aa9-9c5a-50a92956478e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:39.935110 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ac19eeb7-0993-4aa9-9c5a-50a92956478e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 2323 microversion: 2.42 time: 0.191979 Aug 29 15:42:39.942709 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2001/4110] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:39 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 2323 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:42:40.312245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-39b2251d-b1b2-4063-a29e-5cd227f1f73a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:40.312877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-39b2251d-b1b2-4063-a29e-5cd227f1f73a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:40.331420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b2251d-b1b2-4063-a29e-5cd227f1f73a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:40.331917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b2251d-b1b2-4063-a29e-5cd227f1f73a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:40.332350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b2251d-b1b2-4063-a29e-5cd227f1f73a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:40.333112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b2251d-b1b2-4063-a29e-5cd227f1f73a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:40.355815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b2251d-b1b2-4063-a29e-5cd227f1f73a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:40.356349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b2251d-b1b2-4063-a29e-5cd227f1f73a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:40.515800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-21018454-dd1e-461e-8b1f-7bb5552cd8a8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:40.518815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-21018454-dd1e-461e-8b1f-7bb5552cd8a8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: c2363ee5-1fe6-4753-a6ca-c4a6700cd38b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:40.541388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21018454-dd1e-461e-8b1f-7bb5552cd8a8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:40.543250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21018454-dd1e-461e-8b1f-7bb5552cd8a8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:40.544056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21018454-dd1e-461e-8b1f-7bb5552cd8a8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:40.546299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21018454-dd1e-461e-8b1f-7bb5552cd8a8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:40.547943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21018454-dd1e-461e-8b1f-7bb5552cd8a8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:40.548961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21018454-dd1e-461e-8b1f-7bb5552cd8a8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:40.908098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-39b2251d-b1b2-4063-a29e-5cd227f1f73a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:40.925427 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-39b2251d-b1b2-4063-a29e-5cd227f1f73a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1308 microversion: 2.1 time: 0.623075 Aug 29 15:42:40.928853 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2110/4111] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:40 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1308 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:40.971981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ab503504-4b7b-4605-97b7-062d13db5402 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:40.972796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ab503504-4b7b-4605-97b7-062d13db5402 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:40.987320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab503504-4b7b-4605-97b7-062d13db5402 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:40.989241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab503504-4b7b-4605-97b7-062d13db5402 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:40.990416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab503504-4b7b-4605-97b7-062d13db5402 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:40.993129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab503504-4b7b-4605-97b7-062d13db5402 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:40.993801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab503504-4b7b-4605-97b7-062d13db5402 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:41.008323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab503504-4b7b-4605-97b7-062d13db5402 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:41.028473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-21018454-dd1e-461e-8b1f-7bb5552cd8a8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:41.038243 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-21018454-dd1e-461e-8b1f-7bb5552cd8a8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b" status: 200 len: 1517 microversion: 2.1 time: 0.533997 Aug 29 15:42:41.043559 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2002/4112] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:40 2022] GET /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b => generated 1517 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:41.067700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3fbbb7d0-6d91-4f78-a097-75e4953ae4ea tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:41.068529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3fbbb7d0-6d91-4f78-a097-75e4953ae4ea tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: 6e6f613d-f4fd-4a8b-8a28-f787c3832995] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:41.078563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fbbb7d0-6d91-4f78-a097-75e4953ae4ea tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:41.079418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fbbb7d0-6d91-4f78-a097-75e4953ae4ea tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:41.081602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fbbb7d0-6d91-4f78-a097-75e4953ae4ea tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:41.082581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fbbb7d0-6d91-4f78-a097-75e4953ae4ea tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:41.086058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fbbb7d0-6d91-4f78-a097-75e4953ae4ea tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:41.086708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fbbb7d0-6d91-4f78-a097-75e4953ae4ea tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:41.265773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ab503504-4b7b-4605-97b7-062d13db5402 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:41.295510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ab503504-4b7b-4605-97b7-062d13db5402 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:41.301805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ab503504-4b7b-4605-97b7-062d13db5402 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:41.305800 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ab503504-4b7b-4605-97b7-062d13db5402 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.340229 Aug 29 15:42:41.312685 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2111/4113] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:40 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:42:41.416533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a24fd1dc-3865-401d-8315-dc2c750a9974 req-d757917c-88ba-4773-aece-9af32ec2c176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beba97fc-1a57-48db-9963-36262439e822", "name": "network-vif-deleted", "tag": "528dfe97-4f5f-4f10-a2cd-7936781f265f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:41.419906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3fbbb7d0-6d91-4f78-a097-75e4953ae4ea tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:41.429542 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3fbbb7d0-6d91-4f78-a097-75e4953ae4ea tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995" status: 200 len: 1517 microversion: 2.1 time: 0.366191 Aug 29 15:42:41.430135 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2003/4114] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:41 2022] GET /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995 => generated 1517 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:41.446201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a24fd1dc-3865-401d-8315-dc2c750a9974 req-d757917c-88ba-4773-aece-9af32ec2c176 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:41.447028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a24fd1dc-3865-401d-8315-dc2c750a9974 req-d757917c-88ba-4773-aece-9af32ec2c176 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:41.447532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a24fd1dc-3865-401d-8315-dc2c750a9974 req-d757917c-88ba-4773-aece-9af32ec2c176 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:41.449285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2b7b3ecc-ee11-4c46-81af-919b60011b7b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:41.451086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2b7b3ecc-ee11-4c46-81af-919b60011b7b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: 6e6f613d-f4fd-4a8b-8a28-f787c3832995] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:41.457487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b7b3ecc-ee11-4c46-81af-919b60011b7b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:41.463144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b7b3ecc-ee11-4c46-81af-919b60011b7b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:41.463893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b7b3ecc-ee11-4c46-81af-919b60011b7b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:41.464830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b7b3ecc-ee11-4c46-81af-919b60011b7b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:41.465578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b7b3ecc-ee11-4c46-81af-919b60011b7b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:41.466160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b7b3ecc-ee11-4c46-81af-919b60011b7b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:41.478950 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a24fd1dc-3865-401d-8315-dc2c750a9974 req-d757917c-88ba-4773-aece-9af32ec2c176 service nova] Creating event network-vif-deleted:528dfe97-4f5f-4f10-a2cd-7936781f265f for instance beba97fc-1a57-48db-9963-36262439e822 on n-h2-839401-11 Aug 29 15:42:41.492770 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a24fd1dc-3865-401d-8315-dc2c750a9974 req-d757917c-88ba-4773-aece-9af32ec2c176 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080249 Aug 29 15:42:41.498289 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2112/4115] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:42:41.554271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2b7b3ecc-ee11-4c46-81af-919b60011b7b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: 6e6f613d-f4fd-4a8b-8a28-f787c3832995] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:42:41.755902 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2b7b3ecc-ee11-4c46-81af-919b60011b7b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995" status: 204 len: 0 microversion: 2.1 time: 0.308953 Aug 29 15:42:41.757634 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2004/4116] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:41 2022] DELETE /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:42:41.767644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a38469a9-bf9f-4dd2-85a9-e982ad81adde tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:41.768353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a38469a9-bf9f-4dd2-85a9-e982ad81adde tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: 6e6f613d-f4fd-4a8b-8a28-f787c3832995] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:41.779017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a38469a9-bf9f-4dd2-85a9-e982ad81adde tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:41.782027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a38469a9-bf9f-4dd2-85a9-e982ad81adde tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:41.782602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a38469a9-bf9f-4dd2-85a9-e982ad81adde tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:41.783375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a38469a9-bf9f-4dd2-85a9-e982ad81adde tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:41.783846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a38469a9-bf9f-4dd2-85a9-e982ad81adde tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:41.784275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a38469a9-bf9f-4dd2-85a9-e982ad81adde tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:41.951742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-457fa520-40ff-43b5-bac7-dedae0a97342 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:41.953031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-457fa520-40ff-43b5-bac7-dedae0a97342 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:41.975267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-457fa520-40ff-43b5-bac7-dedae0a97342 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:41.978165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-457fa520-40ff-43b5-bac7-dedae0a97342 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:41.978627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-457fa520-40ff-43b5-bac7-dedae0a97342 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:41.979383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-457fa520-40ff-43b5-bac7-dedae0a97342 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:41.985166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-457fa520-40ff-43b5-bac7-dedae0a97342 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:41.985691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-457fa520-40ff-43b5-bac7-dedae0a97342 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:41.998611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:42.114430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a38469a9-bf9f-4dd2-85a9-e982ad81adde tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:42.123363 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a38469a9-bf9f-4dd2-85a9-e982ad81adde tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995" status: 200 len: 1523 microversion: 2.1 time: 0.360805 Aug 29 15:42:42.129432 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2113/4117] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:41 2022] GET /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995 => generated 1523 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:42.339602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1420d0f7-f7fa-435a-871c-011ba69ef369 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:42.340228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1420d0f7-f7fa-435a-871c-011ba69ef369 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:42.343330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-457fa520-40ff-43b5-bac7-dedae0a97342 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:42.348636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1420d0f7-f7fa-435a-871c-011ba69ef369 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:42.354453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1420d0f7-f7fa-435a-871c-011ba69ef369 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:42.355063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1420d0f7-f7fa-435a-871c-011ba69ef369 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:42.355723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1420d0f7-f7fa-435a-871c-011ba69ef369 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:42.356197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1420d0f7-f7fa-435a-871c-011ba69ef369 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:42.356626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1420d0f7-f7fa-435a-871c-011ba69ef369 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:42.358960 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-457fa520-40ff-43b5-bac7-dedae0a97342 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1308 microversion: 2.1 time: 0.406440 Aug 29 15:42:42.360273 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2005/4118] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:41 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1308 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:42.557039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1420d0f7-f7fa-435a-871c-011ba69ef369 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:42.567844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1420d0f7-f7fa-435a-871c-011ba69ef369 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:42.569329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1420d0f7-f7fa-435a-871c-011ba69ef369 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:42.570589 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1420d0f7-f7fa-435a-871c-011ba69ef369 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.234958 Aug 29 15:42:42.580036 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2114/4119] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:42 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:43.154734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-37d1d24d-3b7a-49a6-9633-bdf76ee7dc22 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:43.155429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-37d1d24d-3b7a-49a6-9633-bdf76ee7dc22 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: 6e6f613d-f4fd-4a8b-8a28-f787c3832995] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:43.167254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37d1d24d-3b7a-49a6-9633-bdf76ee7dc22 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:43.167755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37d1d24d-3b7a-49a6-9633-bdf76ee7dc22 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:43.168191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37d1d24d-3b7a-49a6-9633-bdf76ee7dc22 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:43.168897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37d1d24d-3b7a-49a6-9633-bdf76ee7dc22 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:43.169383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37d1d24d-3b7a-49a6-9633-bdf76ee7dc22 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:43.169804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37d1d24d-3b7a-49a6-9633-bdf76ee7dc22 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:43.380848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aeb097ce-4dfe-483d-b099-5a5ea491f774 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:43.382130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aeb097ce-4dfe-483d-b099-5a5ea491f774 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:43.400304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aeb097ce-4dfe-483d-b099-5a5ea491f774 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:43.400821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aeb097ce-4dfe-483d-b099-5a5ea491f774 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:43.401420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aeb097ce-4dfe-483d-b099-5a5ea491f774 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:43.402333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aeb097ce-4dfe-483d-b099-5a5ea491f774 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:43.403789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aeb097ce-4dfe-483d-b099-5a5ea491f774 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:43.404604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aeb097ce-4dfe-483d-b099-5a5ea491f774 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:43.508123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-37d1d24d-3b7a-49a6-9633-bdf76ee7dc22 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:43.522286 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-37d1d24d-3b7a-49a6-9633-bdf76ee7dc22 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995" status: 200 len: 1523 microversion: 2.1 time: 0.372007 Aug 29 15:42:43.537207 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2006/4120] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:43 2022] GET /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995 => generated 1523 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:43.543265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-047d17bd-8a7f-4873-ba01-48bb57aad3e7 req-c63919b9-edef-4e1d-9283-6e7cd61cf162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81c2d898-9252-4ea9-9186-93605b7b9aa5", "tag": "379cf683-7620-4fec-98ad-247aa9e87ba6"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:43.554959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-047d17bd-8a7f-4873-ba01-48bb57aad3e7 req-c63919b9-edef-4e1d-9283-6e7cd61cf162 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:43.556285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-047d17bd-8a7f-4873-ba01-48bb57aad3e7 req-c63919b9-edef-4e1d-9283-6e7cd61cf162 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:43.557350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-047d17bd-8a7f-4873-ba01-48bb57aad3e7 req-c63919b9-edef-4e1d-9283-6e7cd61cf162 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:43.569953 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-047d17bd-8a7f-4873-ba01-48bb57aad3e7 req-c63919b9-edef-4e1d-9283-6e7cd61cf162 service nova] Creating event network-changed:379cf683-7620-4fec-98ad-247aa9e87ba6 for instance 81c2d898-9252-4ea9-9186-93605b7b9aa5 on n-h1-839401-11 Aug 29 15:42:43.575546 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-047d17bd-8a7f-4873-ba01-48bb57aad3e7 req-c63919b9-edef-4e1d-9283-6e7cd61cf162 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036598 Aug 29 15:42:43.576677 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2007/4121] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:43.594866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b5ae432e-f44e-4214-9514-51c87436826c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:43.595841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b5ae432e-f44e-4214-9514-51c87436826c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:43.609119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5ae432e-f44e-4214-9514-51c87436826c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:43.609552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5ae432e-f44e-4214-9514-51c87436826c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:43.609991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5ae432e-f44e-4214-9514-51c87436826c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:43.610696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5ae432e-f44e-4214-9514-51c87436826c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:43.611152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5ae432e-f44e-4214-9514-51c87436826c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:43.611580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5ae432e-f44e-4214-9514-51c87436826c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:43.695455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b5ae432e-f44e-4214-9514-51c87436826c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:43.711571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b5ae432e-f44e-4214-9514-51c87436826c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:43.714499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b5ae432e-f44e-4214-9514-51c87436826c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:43.716773 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b5ae432e-f44e-4214-9514-51c87436826c tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.126650 Aug 29 15:42:43.718325 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2008/4122] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:43 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:43.875082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aeb097ce-4dfe-483d-b099-5a5ea491f774 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:43.892366 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aeb097ce-4dfe-483d-b099-5a5ea491f774 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1308 microversion: 2.1 time: 0.513760 Aug 29 15:42:43.894591 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2115/4123] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:43 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1308 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:44.544543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c609c696-bd3c-4e35-9d57-8698bfd0b802 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:44.545895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c609c696-bd3c-4e35-9d57-8698bfd0b802 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: 6e6f613d-f4fd-4a8b-8a28-f787c3832995] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:44.563202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c609c696-bd3c-4e35-9d57-8698bfd0b802 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:44.564213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c609c696-bd3c-4e35-9d57-8698bfd0b802 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:44.567109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c609c696-bd3c-4e35-9d57-8698bfd0b802 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:44.569541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c609c696-bd3c-4e35-9d57-8698bfd0b802 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:44.581382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c609c696-bd3c-4e35-9d57-8698bfd0b802 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:44.586567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c609c696-bd3c-4e35-9d57-8698bfd0b802 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:44.743322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5e6aeb83-955a-42b5-b3b6-f6d62ea5be3e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:44.745731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5e6aeb83-955a-42b5-b3b6-f6d62ea5be3e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:44.762052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e6aeb83-955a-42b5-b3b6-f6d62ea5be3e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:44.764278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e6aeb83-955a-42b5-b3b6-f6d62ea5be3e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:44.765112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e6aeb83-955a-42b5-b3b6-f6d62ea5be3e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:44.768018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e6aeb83-955a-42b5-b3b6-f6d62ea5be3e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:44.768538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e6aeb83-955a-42b5-b3b6-f6d62ea5be3e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:44.768989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e6aeb83-955a-42b5-b3b6-f6d62ea5be3e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:45.064391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e6aeb83-955a-42b5-b3b6-f6d62ea5be3e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:45.085790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e6aeb83-955a-42b5-b3b6-f6d62ea5be3e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:45.089209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e6aeb83-955a-42b5-b3b6-f6d62ea5be3e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:45.094396 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5e6aeb83-955a-42b5-b3b6-f6d62ea5be3e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.356258 Aug 29 15:42:45.095595 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2116/4124] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:44 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:45.115091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c120ed8d-44cc-4d15-aefd-f3b7c86d0680 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:45.115980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c120ed8d-44cc-4d15-aefd-f3b7c86d0680 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:45.127371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c120ed8d-44cc-4d15-aefd-f3b7c86d0680 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:45.129288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c120ed8d-44cc-4d15-aefd-f3b7c86d0680 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:45.129896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c120ed8d-44cc-4d15-aefd-f3b7c86d0680 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:45.133868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c120ed8d-44cc-4d15-aefd-f3b7c86d0680 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:45.135327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c120ed8d-44cc-4d15-aefd-f3b7c86d0680 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:45.137020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c120ed8d-44cc-4d15-aefd-f3b7c86d0680 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:45.306329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c609c696-bd3c-4e35-9d57-8698bfd0b802 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:45.316718 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c609c696-bd3c-4e35-9d57-8698bfd0b802 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995" status: 200 len: 1523 microversion: 2.1 time: 0.776726 Aug 29 15:42:45.333933 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2009/4125] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:44 2022] GET /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995 => generated 1523 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:45.626024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c120ed8d-44cc-4d15-aefd-f3b7c86d0680 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:45.640285 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c120ed8d-44cc-4d15-aefd-f3b7c86d0680 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1308 microversion: 2.1 time: 0.541220 Aug 29 15:42:45.642832 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2117/4126] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:45 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1308 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:45.848882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-9746f773-b214-4e65-9d5b-2034cc86c3fc req-7b56a24a-b1d0-4302-8649-4b079538a9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6f613d-f4fd-4a8b-8a28-f787c3832995", "name": "network-vif-deleted", "tag": "4a6e9430-0313-4586-a0ce-1f8a40679121"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:45.872014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9746f773-b214-4e65-9d5b-2034cc86c3fc req-7b56a24a-b1d0-4302-8649-4b079538a9c9 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:45.877655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9746f773-b214-4e65-9d5b-2034cc86c3fc req-7b56a24a-b1d0-4302-8649-4b079538a9c9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:45.878546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9746f773-b214-4e65-9d5b-2034cc86c3fc req-7b56a24a-b1d0-4302-8649-4b079538a9c9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:45.917050 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-9746f773-b214-4e65-9d5b-2034cc86c3fc req-7b56a24a-b1d0-4302-8649-4b079538a9c9 service nova] Creating event network-vif-deleted:4a6e9430-0313-4586-a0ce-1f8a40679121 for instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 on n-h2-839401-11 Aug 29 15:42:45.934375 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-9746f773-b214-4e65-9d5b-2034cc86c3fc req-7b56a24a-b1d0-4302-8649-4b079538a9c9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089784 Aug 29 15:42:45.941278 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2010/4127] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:46.123856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-69b4d657-66e5-411e-b4b7-7a8e254201c5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:46.124686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-69b4d657-66e5-411e-b4b7-7a8e254201c5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:46.133311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69b4d657-66e5-411e-b4b7-7a8e254201c5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.134394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69b4d657-66e5-411e-b4b7-7a8e254201c5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.135119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69b4d657-66e5-411e-b4b7-7a8e254201c5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.136165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69b4d657-66e5-411e-b4b7-7a8e254201c5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.137467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69b4d657-66e5-411e-b4b7-7a8e254201c5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.138246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69b4d657-66e5-411e-b4b7-7a8e254201c5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.259218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-69b4d657-66e5-411e-b4b7-7a8e254201c5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:46.303655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-69b4d657-66e5-411e-b4b7-7a8e254201c5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:46.309630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-69b4d657-66e5-411e-b4b7-7a8e254201c5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:46.311256 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-69b4d657-66e5-411e-b4b7-7a8e254201c5 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.191792 Aug 29 15:42:46.313919 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2118/4128] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:46 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:46.352448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-afd1192e-ba64-472f-9fbd-f4edd1d893b9 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:46.353806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-afd1192e-ba64-472f-9fbd-f4edd1d893b9 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: 6e6f613d-f4fd-4a8b-8a28-f787c3832995] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:46.360972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:46.361870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:46.383015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afd1192e-ba64-472f-9fbd-f4edd1d893b9 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.383660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afd1192e-ba64-472f-9fbd-f4edd1d893b9 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.384889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afd1192e-ba64-472f-9fbd-f4edd1d893b9 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.389111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afd1192e-ba64-472f-9fbd-f4edd1d893b9 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.390127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afd1192e-ba64-472f-9fbd-f4edd1d893b9 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.392563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afd1192e-ba64-472f-9fbd-f4edd1d893b9 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.425312 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-afd1192e-ba64-472f-9fbd-f4edd1d893b9 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] HTTP exception thrown: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-afd1192e-ba64-472f-9fbd-f4edd1d893b9 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Request method failure captured: Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995 HTTP/1.1 Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN5FLYGaqGvpshNSdbU4K3MbLuQBrqoqsf5fQDgxyjyRxXU2pNWqD2maM90zJ9JZLO8jCsYVnGUws0eK-wV5nLhyUbzaLjBewc1WJ3oTIFOwSrEqB3l6u6BTNvqXkkbyQWpc_5hMclQYgNoiSrJjHv1P01TZhFevgKWr9QHhRU0lKB8 Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 2cf3b32adf094715b432dcd75a883966 Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2cf3b32adf094715b432dcd75a883966", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2cf3b32adf094715b432dcd75a883966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2cf3b32adf094715b432dcd75a883966"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2cf3b32adf094715b432dcd75a883966"}]}] Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 2cf3b32adf094715b432dcd75a883966 Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ListServersNegativeTestJSON-406780769-project Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: fada133bdb6a4d0190a3abbadf0c252a Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ListServersNegativeTestJSON-406780769-project Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '6e6f613d-f4fd-4a8b-8a28-f787c3832995'} Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:42:46.427279 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:46.430436 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:42:46.430436 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:46.430436 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:46.430436 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:46.430436 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:46.430436 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:46.430436 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. Aug 29 15:42:46.430436 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:42:46.434881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-afd1192e-ba64-472f-9fbd-f4edd1d893b9 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Returning 404 to user: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:46.441248 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-afd1192e-ba64-472f-9fbd-f4edd1d893b9 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995" status: 404 len: 111 microversion: 2.1 time: 0.104193 Aug 29 15:42:46.446128 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2011/4129] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:46 2022] GET /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:46.455233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4400b586-ac36-4c19-88ec-6d03cf70d109 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:46.467206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4400b586-ac36-4c19-88ec-6d03cf70d109 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:46.468980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4400b586-ac36-4c19-88ec-6d03cf70d109 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '2cf3b32adf094715b432dcd75a883966'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:42:46.487084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4400b586-ac36-4c19-88ec-6d03cf70d109 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.487560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4400b586-ac36-4c19-88ec-6d03cf70d109 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.488000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4400b586-ac36-4c19-88ec-6d03cf70d109 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.488722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4400b586-ac36-4c19-88ec-6d03cf70d109 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.489225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4400b586-ac36-4c19-88ec-6d03cf70d109 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.489630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4400b586-ac36-4c19-88ec-6d03cf70d109 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.554153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:46.666049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-41b2c5e2-a368-4c36-a54c-a4d29b451472 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:46.666813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-41b2c5e2-a368-4c36-a54c-a4d29b451472 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:46.667047 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4400b586-ac36-4c19-88ec-6d03cf70d109 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.219494 Aug 29 15:42:46.671448 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2119/4130] 10.222.0.62 () {58 vars in 1230 bytes} [Mon Aug 29 15:42:46 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:42:46.680244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1830059a-4f54-4ef4-bd3d-7c3138d346dc tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1830059a-4f54-4ef4-bd3d-7c3138d346dc tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Request method failure captured: Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN5FLYGaqGvpshNSdbU4K3MbLuQBrqoqsf5fQDgxyjyRxXU2pNWqD2maM90zJ9JZLO8jCsYVnGUws0eK-wV5nLhyUbzaLjBewc1WJ3oTIFOwSrEqB3l6u6BTNvqXkkbyQWpc_5hMclQYgNoiSrJjHv1P01TZhFevgKWr9QHhRU0lKB8 Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 2cf3b32adf094715b432dcd75a883966 Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2cf3b32adf094715b432dcd75a883966", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2cf3b32adf094715b432dcd75a883966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2cf3b32adf094715b432dcd75a883966"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2cf3b32adf094715b432dcd75a883966"}]}] Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 2cf3b32adf094715b432dcd75a883966 Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ListServersNegativeTestJSON-406780769-project Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: fada133bdb6a4d0190a3abbadf0c252a Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ListServersNegativeTestJSON-406780769-project Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: action_args: {} Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 29 15:42:46.684178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:42:46.688205 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:42:46.688205 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:42:46.688205 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:42:46.688205 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 29 15:42:46.688205 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:46.688205 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:46.688205 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:46.688205 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:46.688205 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:46.688205 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:46.688205 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:42:46.688205 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:42:46.688205 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 29 15:42:46.688205 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:46.688205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1830059a-4f54-4ef4-bd3d-7c3138d346dc tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:46.690471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41b2c5e2-a368-4c36-a54c-a4d29b451472 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.693988 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1830059a-4f54-4ef4-bd3d-7c3138d346dc tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.017670 Aug 29 15:42:46.698573 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2120/4131] 10.222.0.62 () {58 vars in 1182 bytes} [Mon Aug 29 15:42:46 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:42:46.699536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41b2c5e2-a368-4c36-a54c-a4d29b451472 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.700320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41b2c5e2-a368-4c36-a54c-a4d29b451472 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.701308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41b2c5e2-a368-4c36-a54c-a4d29b451472 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.701971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41b2c5e2-a368-4c36-a54c-a4d29b451472 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.702595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41b2c5e2-a368-4c36-a54c-a4d29b451472 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.708768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8d17abe8-b711-4387-90a5-25193d96228b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:46.727636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8d17abe8-b711-4387-90a5-25193d96228b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:46.728607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8d17abe8-b711-4387-90a5-25193d96228b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Searching by: {'deleted': False, 'project_id': '2cf3b32adf094715b432dcd75a883966'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:42:46.736948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d17abe8-b711-4387-90a5-25193d96228b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.737622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d17abe8-b711-4387-90a5-25193d96228b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.738342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d17abe8-b711-4387-90a5-25193d96228b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.739961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d17abe8-b711-4387-90a5-25193d96228b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.742249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d17abe8-b711-4387-90a5-25193d96228b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.742933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d17abe8-b711-4387-90a5-25193d96228b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.879674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-8d17abe8-b711-4387-90a5-25193d96228b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:42:46.976971 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8d17abe8-b711-4387-90a5-25193d96228b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.277005 Aug 29 15:42:46.979796 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2121/4132] 10.222.0.62 () {58 vars in 1125 bytes} [Mon Aug 29 15:42:46 2022] GET /compute/v2.1/servers => generated 683 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:46.989112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cc965ed1-a20d-4b18-8394-3a5426716676 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:47.019935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cc965ed1-a20d-4b18-8394-3a5426716676 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:47.030402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.compute.servers [None req-cc965ed1-a20d-4b18-8394-3a5426716676 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Removing options 'limit' from query {{(pid=122360) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 15:42:47.031262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cc965ed1-a20d-4b18-8394-3a5426716676 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Searching by: {'deleted': False, 'project_id': '2cf3b32adf094715b432dcd75a883966'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:42:47.055641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc965ed1-a20d-4b18-8394-3a5426716676 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.056171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc965ed1-a20d-4b18-8394-3a5426716676 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.056559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc965ed1-a20d-4b18-8394-3a5426716676 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.057318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc965ed1-a20d-4b18-8394-3a5426716676 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.057776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc965ed1-a20d-4b18-8394-3a5426716676 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.066370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc965ed1-a20d-4b18-8394-3a5426716676 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.167016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-cc965ed1-a20d-4b18-8394-3a5426716676 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:42:47.192258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:47.224029 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cc965ed1-a20d-4b18-8394-3a5426716676 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.238911 Aug 29 15:42:47.232384 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2122/4133] 10.222.0.62 () {58 vars in 1144 bytes} [Mon Aug 29 15:42:46 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:47.241190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-475dad87-ca55-4df2-ba99-fd0bde2b180d tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-475dad87-ca55-4df2-ba99-fd0bde2b180d tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Request method failure captured: Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN5FLYGaqGvpshNSdbU4K3MbLuQBrqoqsf5fQDgxyjyRxXU2pNWqD2maM90zJ9JZLO8jCsYVnGUws0eK-wV5nLhyUbzaLjBewc1WJ3oTIFOwSrEqB3l6u6BTNvqXkkbyQWpc_5hMclQYgNoiSrJjHv1P01TZhFevgKWr9QHhRU0lKB8 Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 2cf3b32adf094715b432dcd75a883966 Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2cf3b32adf094715b432dcd75a883966", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2cf3b32adf094715b432dcd75a883966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2cf3b32adf094715b432dcd75a883966"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2cf3b32adf094715b432dcd75a883966"}]}] Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 2cf3b32adf094715b432dcd75a883966 Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ListServersNegativeTestJSON-406780769-project Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: fada133bdb6a4d0190a3abbadf0c252a Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ListServersNegativeTestJSON-406780769-project Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: action_args: {} Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi '-1' Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 29 15:42:47.251766 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 29 15:42:47.256076 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:42:47.256076 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:42:47.256076 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:42:47.256076 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:42:47.256076 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 29 15:42:47.256076 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:47.256076 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:47.256076 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:47.256076 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:47.256076 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:47.256076 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:47.256076 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:42:47.256076 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:42:47.256076 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 29 15:42:47.256076 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:47.256076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-475dad87-ca55-4df2-ba99-fd0bde2b180d tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:47.257123 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-475dad87-ca55-4df2-ba99-fd0bde2b180d tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.019192 Aug 29 15:42:47.257995 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2123/4134] 10.222.0.62 () {58 vars in 1142 bytes} [Mon Aug 29 15:42:47 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:42:47.277716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f9b55261-5fee-4ab9-abbf-2381237be03a tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f9b55261-5fee-4ab9-abbf-2381237be03a tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Request method failure captured: Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN5FLYGaqGvpshNSdbU4K3MbLuQBrqoqsf5fQDgxyjyRxXU2pNWqD2maM90zJ9JZLO8jCsYVnGUws0eK-wV5nLhyUbzaLjBewc1WJ3oTIFOwSrEqB3l6u6BTNvqXkkbyQWpc_5hMclQYgNoiSrJjHv1P01TZhFevgKWr9QHhRU0lKB8 Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 2cf3b32adf094715b432dcd75a883966 Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2cf3b32adf094715b432dcd75a883966", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2cf3b32adf094715b432dcd75a883966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2cf3b32adf094715b432dcd75a883966"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2cf3b32adf094715b432dcd75a883966"}]}] Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 2cf3b32adf094715b432dcd75a883966 Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ListServersNegativeTestJSON-406780769-project Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: fada133bdb6a4d0190a3abbadf0c252a Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ListServersNegativeTestJSON-406780769-project Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: action_args: {} Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'testing' Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 29 15:42:47.281964 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f9b55261-5fee-4ab9-abbf-2381237be03a tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f9b55261-5fee-4ab9-abbf-2381237be03a tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.019264 Aug 29 15:42:47.285668 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2124/4135] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:42:47 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:42:47.302517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9ce39093-b7a5-4604-9570-667a487d5a6b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:47.318892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9ce39093-b7a5-4604-9570-667a487d5a6b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:47.319490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9ce39093-b7a5-4604-9570-667a487d5a6b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '2cf3b32adf094715b432dcd75a883966'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:42:47.329439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.compute.servers [None req-9ce39093-b7a5-4604-9570-667a487d5a6b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Flavor 'non_existing_flavor' could not be found {{(pid=122360) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 29 15:42:47.330517 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9ce39093-b7a5-4604-9570-667a487d5a6b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.032457 Aug 29 15:42:47.336995 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2125/4136] 10.222.0.62 () {58 vars in 1178 bytes} [Mon Aug 29 15:42:47 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:42:47.349045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ecea9573-c1b8-4e8d-a7f9-25818384b00e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:47.353634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ecea9573-c1b8-4e8d-a7f9-25818384b00e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:47.372523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecea9573-c1b8-4e8d-a7f9-25818384b00e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.375728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecea9573-c1b8-4e8d-a7f9-25818384b00e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.376387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecea9573-c1b8-4e8d-a7f9-25818384b00e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.377435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecea9573-c1b8-4e8d-a7f9-25818384b00e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.378670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecea9573-c1b8-4e8d-a7f9-25818384b00e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.379326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecea9573-c1b8-4e8d-a7f9-25818384b00e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.402346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-41b2c5e2-a368-4c36-a54c-a4d29b451472 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:47.428067 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-41b2c5e2-a368-4c36-a54c-a4d29b451472 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1308 microversion: 2.1 time: 0.766372 Aug 29 15:42:47.428767 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2012/4137] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:46 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1308 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:47.453325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-73e3ed49-116c-47eb-809d-8b476d1f7453 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:47.493258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-73e3ed49-116c-47eb-809d-8b476d1f7453 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:47.494498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-73e3ed49-116c-47eb-809d-8b476d1f7453 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '2cf3b32adf094715b432dcd75a883966'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:42:47.516362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73e3ed49-116c-47eb-809d-8b476d1f7453 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.516926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73e3ed49-116c-47eb-809d-8b476d1f7453 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.517375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73e3ed49-116c-47eb-809d-8b476d1f7453 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.518208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73e3ed49-116c-47eb-809d-8b476d1f7453 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.530551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73e3ed49-116c-47eb-809d-8b476d1f7453 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.531003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73e3ed49-116c-47eb-809d-8b476d1f7453 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.640119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ecea9573-c1b8-4e8d-a7f9-25818384b00e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:47.658687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ecea9573-c1b8-4e8d-a7f9-25818384b00e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:47.676555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ecea9573-c1b8-4e8d-a7f9-25818384b00e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:47.678292 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ecea9573-c1b8-4e8d-a7f9-25818384b00e tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.340046 Aug 29 15:42:47.681872 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2126/4138] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:47 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:47.789322 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-73e3ed49-116c-47eb-809d-8b476d1f7453 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.358229 Aug 29 15:42:47.801301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2e46c635-e5d3-48e3-9793-8e9669aaa6b8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:47.803093 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2013/4139] 10.222.0.62 () {58 vars in 1174 bytes} [Mon Aug 29 15:42:47 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:42:47.809289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2e46c635-e5d3-48e3-9793-8e9669aaa6b8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:47.811301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2e46c635-e5d3-48e3-9793-8e9669aaa6b8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '2cf3b32adf094715b432dcd75a883966'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:42:47.826520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e46c635-e5d3-48e3-9793-8e9669aaa6b8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.827860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e46c635-e5d3-48e3-9793-8e9669aaa6b8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.831682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e46c635-e5d3-48e3-9793-8e9669aaa6b8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.832818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e46c635-e5d3-48e3-9793-8e9669aaa6b8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.833520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e46c635-e5d3-48e3-9793-8e9669aaa6b8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.834151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e46c635-e5d3-48e3-9793-8e9669aaa6b8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.059424 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2e46c635-e5d3-48e3-9793-8e9669aaa6b8 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.262693 Aug 29 15:42:48.063956 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2127/4140] 10.222.0.62 () {58 vars in 1184 bytes} [Mon Aug 29 15:42:47 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:42:48.076092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a65c53a6-de74-4e7a-9935-2209529d7ac3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:48.083068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a65c53a6-de74-4e7a-9935-2209529d7ac3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:48.090261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a65c53a6-de74-4e7a-9935-2209529d7ac3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Searching by: {'deleted': False, 'project_id': '2cf3b32adf094715b432dcd75a883966'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:42:48.104299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a65c53a6-de74-4e7a-9935-2209529d7ac3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.108938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a65c53a6-de74-4e7a-9935-2209529d7ac3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.109614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a65c53a6-de74-4e7a-9935-2209529d7ac3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.110950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a65c53a6-de74-4e7a-9935-2209529d7ac3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.111554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a65c53a6-de74-4e7a-9935-2209529d7ac3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.112148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a65c53a6-de74-4e7a-9935-2209529d7ac3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.202129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-a65c53a6-de74-4e7a-9935-2209529d7ac3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:42:48.296849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a65c53a6-de74-4e7a-9935-2209529d7ac3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:48.317973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a65c53a6-de74-4e7a-9935-2209529d7ac3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.319261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a65c53a6-de74-4e7a-9935-2209529d7ac3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.319758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a65c53a6-de74-4e7a-9935-2209529d7ac3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.454269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6bdf4a10-ddd5-42ed-9c34-244263bc2a55 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:48.455698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6bdf4a10-ddd5-42ed-9c34-244263bc2a55 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:48.463358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bdf4a10-ddd5-42ed-9c34-244263bc2a55 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.473628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bdf4a10-ddd5-42ed-9c34-244263bc2a55 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.474473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bdf4a10-ddd5-42ed-9c34-244263bc2a55 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.476425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bdf4a10-ddd5-42ed-9c34-244263bc2a55 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.484999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bdf4a10-ddd5-42ed-9c34-244263bc2a55 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.486033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bdf4a10-ddd5-42ed-9c34-244263bc2a55 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.832875 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a65c53a6-de74-4e7a-9935-2209529d7ac3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.760868 Aug 29 15:42:48.835195 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2014/4141] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:42:48 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:48.840766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-66b74067-1f39-41df-914c-6383a61190fd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:48.841448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-66b74067-1f39-41df-914c-6383a61190fd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:48.872581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b74067-1f39-41df-914c-6383a61190fd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.873116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b74067-1f39-41df-914c-6383a61190fd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.873553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b74067-1f39-41df-914c-6383a61190fd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.874266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b74067-1f39-41df-914c-6383a61190fd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.874729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b74067-1f39-41df-914c-6383a61190fd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.875158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b74067-1f39-41df-914c-6383a61190fd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.181683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-66b74067-1f39-41df-914c-6383a61190fd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:49.207103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-66b74067-1f39-41df-914c-6383a61190fd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:49.209682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-66b74067-1f39-41df-914c-6383a61190fd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:49.236182 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-66b74067-1f39-41df-914c-6383a61190fd tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.375802 Aug 29 15:42:49.240235 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2015/4142] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:48 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:49.252943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b6b4d420-46ea-4da4-93a8-d7517136662c tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:49.280972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b6b4d420-46ea-4da4-93a8-d7517136662c tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:49.282684 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b6b4d420-46ea-4da4-93a8-d7517136662c tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.039714 Aug 29 15:42:49.286484 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2016/4143] 10.222.0.62 () {58 vars in 1178 bytes} [Mon Aug 29 15:42:49 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:42:49.298954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-792946a1-d0f0-43f7-83b4-8fd275fd7251 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:49.322748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-792946a1-d0f0-43f7-83b4-8fd275fd7251 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:49.331176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-792946a1-d0f0-43f7-83b4-8fd275fd7251 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Searching by: {'deleted': False, 'project_id': '2cf3b32adf094715b432dcd75a883966'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:42:49.344954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-792946a1-d0f0-43f7-83b4-8fd275fd7251 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.345716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-792946a1-d0f0-43f7-83b4-8fd275fd7251 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.346305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-792946a1-d0f0-43f7-83b4-8fd275fd7251 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.347465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-792946a1-d0f0-43f7-83b4-8fd275fd7251 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.348196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-792946a1-d0f0-43f7-83b4-8fd275fd7251 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.349720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-792946a1-d0f0-43f7-83b4-8fd275fd7251 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.355604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6bdf4a10-ddd5-42ed-9c34-244263bc2a55 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:49.366504 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6bdf4a10-ddd5-42ed-9c34-244263bc2a55 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1308 microversion: 2.1 time: 0.916043 Aug 29 15:42:49.367110 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2128/4144] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:48 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1308 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:49.471939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-792946a1-d0f0-43f7-83b4-8fd275fd7251 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:42:49.552636 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-792946a1-d0f0-43f7-83b4-8fd275fd7251 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.257930 Aug 29 15:42:49.557779 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2017/4145] 10.222.0.62 () {58 vars in 1125 bytes} [Mon Aug 29 15:42:49 2022] GET /compute/v2.1/servers => generated 683 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:49.568973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7c883c9-036a-4d5d-8f94-d5da457a10c6 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:49.570369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f7c883c9-036a-4d5d-8f94-d5da457a10c6 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: 6e6f613d-f4fd-4a8b-8a28-f787c3832995] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:49.586740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7c883c9-036a-4d5d-8f94-d5da457a10c6 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.592422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7c883c9-036a-4d5d-8f94-d5da457a10c6 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.593224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7c883c9-036a-4d5d-8f94-d5da457a10c6 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.594156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7c883c9-036a-4d5d-8f94-d5da457a10c6 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.595025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7c883c9-036a-4d5d-8f94-d5da457a10c6 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.596537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7c883c9-036a-4d5d-8f94-d5da457a10c6 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.637914 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-f7c883c9-036a-4d5d-8f94-d5da457a10c6 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] HTTP exception thrown: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7c883c9-036a-4d5d-8f94-d5da457a10c6 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Request method failure captured: Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995 HTTP/1.1 Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN5FLYGaqGvpshNSdbU4K3MbLuQBrqoqsf5fQDgxyjyRxXU2pNWqD2maM90zJ9JZLO8jCsYVnGUws0eK-wV5nLhyUbzaLjBewc1WJ3oTIFOwSrEqB3l6u6BTNvqXkkbyQWpc_5hMclQYgNoiSrJjHv1P01TZhFevgKWr9QHhRU0lKB8 Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 2cf3b32adf094715b432dcd75a883966 Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2cf3b32adf094715b432dcd75a883966", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2cf3b32adf094715b432dcd75a883966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2cf3b32adf094715b432dcd75a883966"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2cf3b32adf094715b432dcd75a883966"}]}] Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 2cf3b32adf094715b432dcd75a883966 Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ListServersNegativeTestJSON-406780769-project Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: fada133bdb6a4d0190a3abbadf0c252a Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ListServersNegativeTestJSON-406780769-project Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '6e6f613d-f4fd-4a8b-8a28-f787c3832995'} Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:49.639880 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:49.642979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. Aug 29 15:42:49.642979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:49.642979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:49.642979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:49.642979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:49.642979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:49.642979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:49.642979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:49.642979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:49.642979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. Aug 29 15:42:49.642979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:49.642979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7c883c9-036a-4d5d-8f94-d5da457a10c6 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Returning 404 to user: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:49.642979 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f7c883c9-036a-4d5d-8f94-d5da457a10c6 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995" status: 404 len: 111 microversion: 2.1 time: 0.077512 Aug 29 15:42:49.644731 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2129/4146] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:49 2022] DELETE /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:49.657724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f7526de0-2a49-4554-9560-94dcc1c871fc tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:49.658462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f7526de0-2a49-4554-9560-94dcc1c871fc tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: c2363ee5-1fe6-4753-a6ca-c4a6700cd38b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:49.671576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7526de0-2a49-4554-9560-94dcc1c871fc tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.673426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7526de0-2a49-4554-9560-94dcc1c871fc tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.673961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7526de0-2a49-4554-9560-94dcc1c871fc tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.678480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7526de0-2a49-4554-9560-94dcc1c871fc tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.679327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7526de0-2a49-4554-9560-94dcc1c871fc tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.679468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7526de0-2a49-4554-9560-94dcc1c871fc tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.765167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f7526de0-2a49-4554-9560-94dcc1c871fc tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: c2363ee5-1fe6-4753-a6ca-c4a6700cd38b] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:42:50.053823 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f7526de0-2a49-4554-9560-94dcc1c871fc tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b" status: 204 len: 0 microversion: 2.1 time: 0.403199 Aug 29 15:42:50.059470 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2018/4147] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:49 2022] DELETE /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:50.063996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aa78050d-5ade-4a7a-a569-9b34f03aa295 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:50.064643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aa78050d-5ade-4a7a-a569-9b34f03aa295 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:50.088763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa78050d-5ade-4a7a-a569-9b34f03aa295 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:50.091982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa78050d-5ade-4a7a-a569-9b34f03aa295 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:50.094077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa78050d-5ade-4a7a-a569-9b34f03aa295 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:50.095153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa78050d-5ade-4a7a-a569-9b34f03aa295 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:50.103718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa78050d-5ade-4a7a-a569-9b34f03aa295 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:50.109043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa78050d-5ade-4a7a-a569-9b34f03aa295 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:50.194198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aa78050d-5ade-4a7a-a569-9b34f03aa295 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:42:50.266157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ebd12fb0-ee3f-4560-a592-bc6a2cb31a4a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:50.267436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ebd12fb0-ee3f-4560-a592-bc6a2cb31a4a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:50.279404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebd12fb0-ee3f-4560-a592-bc6a2cb31a4a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:50.280199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebd12fb0-ee3f-4560-a592-bc6a2cb31a4a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:50.280807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebd12fb0-ee3f-4560-a592-bc6a2cb31a4a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:50.314303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebd12fb0-ee3f-4560-a592-bc6a2cb31a4a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:50.315090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebd12fb0-ee3f-4560-a592-bc6a2cb31a4a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:50.315702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebd12fb0-ee3f-4560-a592-bc6a2cb31a4a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:50.418699 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aa78050d-5ade-4a7a-a569-9b34f03aa295 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 204 len: 0 microversion: 2.1 time: 0.359072 Aug 29 15:42:50.422984 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2130/4148] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:50 2022] DELETE /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:50.429110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6cb84e25-08f9-4f69-9779-e045d8743b09 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:50.430148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6cb84e25-08f9-4f69-9779-e045d8743b09 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:50.437717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cb84e25-08f9-4f69-9779-e045d8743b09 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:50.438632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cb84e25-08f9-4f69-9779-e045d8743b09 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:50.439310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cb84e25-08f9-4f69-9779-e045d8743b09 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:50.440245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cb84e25-08f9-4f69-9779-e045d8743b09 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:50.440863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cb84e25-08f9-4f69-9779-e045d8743b09 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:50.441518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cb84e25-08f9-4f69-9779-e045d8743b09 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:50.790467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ebd12fb0-ee3f-4560-a592-bc6a2cb31a4a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:50.800870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ebd12fb0-ee3f-4560-a592-bc6a2cb31a4a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:50.807089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ebd12fb0-ee3f-4560-a592-bc6a2cb31a4a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:50.810672 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ebd12fb0-ee3f-4560-a592-bc6a2cb31a4a tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.549761 Aug 29 15:42:50.814194 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2019/4149] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:50 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:50.820984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fff7c95d-f287-4d7c-8497-7aa5ac5211b3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:50.824323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fff7c95d-f287-4d7c-8497-7aa5ac5211b3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: 6e6f613d-f4fd-4a8b-8a28-f787c3832995] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:50.847025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:50.851613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff7c95d-f287-4d7c-8497-7aa5ac5211b3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:50.853717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff7c95d-f287-4d7c-8497-7aa5ac5211b3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:50.854368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff7c95d-f287-4d7c-8497-7aa5ac5211b3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:50.859654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff7c95d-f287-4d7c-8497-7aa5ac5211b3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:50.860389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff7c95d-f287-4d7c-8497-7aa5ac5211b3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:50.861018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6cb84e25-08f9-4f69-9779-e045d8743b09 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:50.861997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff7c95d-f287-4d7c-8497-7aa5ac5211b3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:50.869948 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6cb84e25-08f9-4f69-9779-e045d8743b09 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1308 microversion: 2.1 time: 0.445262 Aug 29 15:42:50.874250 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2131/4150] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:50 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1308 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:50.925515 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-fff7c95d-f287-4d7c-8497-7aa5ac5211b3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] HTTP exception thrown: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fff7c95d-f287-4d7c-8497-7aa5ac5211b3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Request method failure captured: Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995 HTTP/1.1 Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN5FLYGaqGvpshNSdbU4K3MbLuQBrqoqsf5fQDgxyjyRxXU2pNWqD2maM90zJ9JZLO8jCsYVnGUws0eK-wV5nLhyUbzaLjBewc1WJ3oTIFOwSrEqB3l6u6BTNvqXkkbyQWpc_5hMclQYgNoiSrJjHv1P01TZhFevgKWr9QHhRU0lKB8 Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 2cf3b32adf094715b432dcd75a883966 Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2cf3b32adf094715b432dcd75a883966", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2cf3b32adf094715b432dcd75a883966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2cf3b32adf094715b432dcd75a883966"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2cf3b32adf094715b432dcd75a883966"}]}] Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 2cf3b32adf094715b432dcd75a883966 Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ListServersNegativeTestJSON-406780769-project Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: fada133bdb6a4d0190a3abbadf0c252a Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ListServersNegativeTestJSON-406780769-project Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '6e6f613d-f4fd-4a8b-8a28-f787c3832995'} Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:42:50.934432 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:50.938734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:42:50.938734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:50.938734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:50.938734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:50.938734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:50.938734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:50.938734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. Aug 29 15:42:50.938734 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:42:50.945931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fff7c95d-f287-4d7c-8497-7aa5ac5211b3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Returning 404 to user: Instance 6e6f613d-f4fd-4a8b-8a28-f787c3832995 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:50.947633 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fff7c95d-f287-4d7c-8497-7aa5ac5211b3 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995" status: 404 len: 111 microversion: 2.1 time: 0.132212 Aug 29 15:42:50.949846 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2020/4151] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:50 2022] GET /compute/v2.1/servers/6e6f613d-f4fd-4a8b-8a28-f787c3832995 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:50.956676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bbdbf12c-31e6-44bd-9ae6-140fc19a1bb1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:50.959091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bbdbf12c-31e6-44bd-9ae6-140fc19a1bb1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: c2363ee5-1fe6-4753-a6ca-c4a6700cd38b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:50.976653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbdbf12c-31e6-44bd-9ae6-140fc19a1bb1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:50.978377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbdbf12c-31e6-44bd-9ae6-140fc19a1bb1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:50.978989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbdbf12c-31e6-44bd-9ae6-140fc19a1bb1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:50.979878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbdbf12c-31e6-44bd-9ae6-140fc19a1bb1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:50.980514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbdbf12c-31e6-44bd-9ae6-140fc19a1bb1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:50.981216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbdbf12c-31e6-44bd-9ae6-140fc19a1bb1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:51.191791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-06229b75-09c0-4bc5-96ad-32614dbd4d81 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Action: 'create', calling method: .version_select at 0x7fc42b7b80d0>, body: {"keypair": {"name": "tempest-keypair-856749252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQnmwF5jCfCpqTdGkM5B01okXeVLZPmFt8kSbhJvZoA0n8h3DpwqMqm1+T/5YBKSt03eunz2YH3gawuO6Dd3aa6iUHNTd+JwF6OAG78HIE/+PcRO6xZ6r0wDTaR3gho7w=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:51.247118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-06229b75-09c0-4bc5-96ad-32614dbd4d81 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Getting quotas for project da0582312a80402fb35d3be2a5b4bede. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:51.263016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-06229b75-09c0-4bc5-96ad-32614dbd4d81 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Getting quotas for user 661739c0be874b799a47e2bd8f4fa65d and project da0582312a80402fb35d3be2a5b4bede. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:51.331340 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-06229b75-09c0-4bc5-96ad-32614dbd4d81 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.144246 Aug 29 15:42:51.336111 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2021/4152] 10.222.0.62 () {62 vars in 1200 bytes} [Mon Aug 29 15:42:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 150 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:42:51.385344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bbdbf12c-31e6-44bd-9ae6-140fc19a1bb1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:51.402264 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bbdbf12c-31e6-44bd-9ae6-140fc19a1bb1 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b" status: 200 len: 1523 microversion: 2.1 time: 0.449585 Aug 29 15:42:51.417770 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2132/4153] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:50 2022] GET /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b => generated 1523 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:51.839092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-948e5c7e-aa8d-4ab6-954b-cb98e6073850 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:51.840785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-948e5c7e-aa8d-4ab6-954b-cb98e6073850 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:51.864950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-948e5c7e-aa8d-4ab6-954b-cb98e6073850 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:51.873748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-948e5c7e-aa8d-4ab6-954b-cb98e6073850 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:51.874401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-948e5c7e-aa8d-4ab6-954b-cb98e6073850 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:51.875316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-948e5c7e-aa8d-4ab6-954b-cb98e6073850 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:51.877001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-948e5c7e-aa8d-4ab6-954b-cb98e6073850 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:51.877549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-948e5c7e-aa8d-4ab6-954b-cb98e6073850 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:51.901203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f4b6c7ae-b4db-4bf6-9e88-445dcd5efda1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:51.902367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f4b6c7ae-b4db-4bf6-9e88-445dcd5efda1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:51.916961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4b6c7ae-b4db-4bf6-9e88-445dcd5efda1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:51.920323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4b6c7ae-b4db-4bf6-9e88-445dcd5efda1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:51.923140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4b6c7ae-b4db-4bf6-9e88-445dcd5efda1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:51.924065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4b6c7ae-b4db-4bf6-9e88-445dcd5efda1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:51.924732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4b6c7ae-b4db-4bf6-9e88-445dcd5efda1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:51.925337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4b6c7ae-b4db-4bf6-9e88-445dcd5efda1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.012632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-948e5c7e-aa8d-4ab6-954b-cb98e6073850 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:52.028489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-948e5c7e-aa8d-4ab6-954b-cb98e6073850 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:52.044850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-948e5c7e-aa8d-4ab6-954b-cb98e6073850 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:52.046044 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-948e5c7e-aa8d-4ab6-954b-cb98e6073850 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.213593 Aug 29 15:42:52.046653 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2022/4154] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:51 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:52.425566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-884f7825-5587-40c5-a7b5-2c7efac79682 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:52.426857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-884f7825-5587-40c5-a7b5-2c7efac79682 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: c2363ee5-1fe6-4753-a6ca-c4a6700cd38b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:52.444671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-884f7825-5587-40c5-a7b5-2c7efac79682 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.445441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-884f7825-5587-40c5-a7b5-2c7efac79682 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.446101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-884f7825-5587-40c5-a7b5-2c7efac79682 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.446953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-884f7825-5587-40c5-a7b5-2c7efac79682 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.447556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-884f7825-5587-40c5-a7b5-2c7efac79682 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.448129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-884f7825-5587-40c5-a7b5-2c7efac79682 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.740338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f4b6c7ae-b4db-4bf6-9e88-445dcd5efda1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:52.756715 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f4b6c7ae-b4db-4bf6-9e88-445dcd5efda1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1308 microversion: 2.1 time: 0.864496 Aug 29 15:42:52.775325 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2133/4155] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:51 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1308 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:52.941550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-23ab7aba-cd63-460a-b663-15fbec3f113f req-1f29f580-c560-47c6-8797-7326fe0ee56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81c2d898-9252-4ea9-9186-93605b7b9aa5", "name": "network-vif-plugged", "status": "completed", "tag": "379cf683-7620-4fec-98ad-247aa9e87ba6"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:52.967201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-23ab7aba-cd63-460a-b663-15fbec3f113f req-1f29f580-c560-47c6-8797-7326fe0ee56b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.967981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-23ab7aba-cd63-460a-b663-15fbec3f113f req-1f29f580-c560-47c6-8797-7326fe0ee56b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.970462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-23ab7aba-cd63-460a-b663-15fbec3f113f req-1f29f580-c560-47c6-8797-7326fe0ee56b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.992249 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-23ab7aba-cd63-460a-b663-15fbec3f113f req-1f29f580-c560-47c6-8797-7326fe0ee56b service nova] Creating event network-vif-plugged:379cf683-7620-4fec-98ad-247aa9e87ba6 for instance 81c2d898-9252-4ea9-9186-93605b7b9aa5 on n-h1-839401-11 Aug 29 15:42:52.998660 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-23ab7aba-cd63-460a-b663-15fbec3f113f req-1f29f580-c560-47c6-8797-7326fe0ee56b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061416 Aug 29 15:42:53.000136 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2134/4156] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:42:53.085185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-56c82dbf-98db-4ddc-9519-5dab1bc33a89 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:53.089306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-56c82dbf-98db-4ddc-9519-5dab1bc33a89 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:53.106201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c82dbf-98db-4ddc-9519-5dab1bc33a89 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.106316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c82dbf-98db-4ddc-9519-5dab1bc33a89 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.107902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c82dbf-98db-4ddc-9519-5dab1bc33a89 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.111163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c82dbf-98db-4ddc-9519-5dab1bc33a89 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.111850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c82dbf-98db-4ddc-9519-5dab1bc33a89 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.112302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c82dbf-98db-4ddc-9519-5dab1bc33a89 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.341133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-56c82dbf-98db-4ddc-9519-5dab1bc33a89 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:53.353923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-56c82dbf-98db-4ddc-9519-5dab1bc33a89 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:53.367081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-56c82dbf-98db-4ddc-9519-5dab1bc33a89 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:53.368864 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-56c82dbf-98db-4ddc-9519-5dab1bc33a89 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.292307 Aug 29 15:42:53.385570 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2135/4157] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:53 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:42:53.397422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ab337b93-9953-4105-932f-df9a35f91949 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:53.403082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ab337b93-9953-4105-932f-df9a35f91949 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:53.427083 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab337b93-9953-4105-932f-df9a35f91949 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.427578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab337b93-9953-4105-932f-df9a35f91949 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.428060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab337b93-9953-4105-932f-df9a35f91949 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.428769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab337b93-9953-4105-932f-df9a35f91949 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.429242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab337b93-9953-4105-932f-df9a35f91949 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.429663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab337b93-9953-4105-932f-df9a35f91949 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.498349 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ab337b93-9953-4105-932f-df9a35f91949 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110933 Aug 29 15:42:53.498969 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2136/4158] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:42:53 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:42:53.598465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b97a1c5b-777b-4fd2-98e1-79e78c5fd7ed tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:53.599506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b97a1c5b-777b-4fd2-98e1-79e78c5fd7ed tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:53.611437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b97a1c5b-777b-4fd2-98e1-79e78c5fd7ed tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.612308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b97a1c5b-777b-4fd2-98e1-79e78c5fd7ed tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.613195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b97a1c5b-777b-4fd2-98e1-79e78c5fd7ed tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.614267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b97a1c5b-777b-4fd2-98e1-79e78c5fd7ed tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.614950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b97a1c5b-777b-4fd2-98e1-79e78c5fd7ed tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.615769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b97a1c5b-777b-4fd2-98e1-79e78c5fd7ed tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.658888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b97a1c5b-777b-4fd2-98e1-79e78c5fd7ed tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:42:53.759052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-884f7825-5587-40c5-a7b5-2c7efac79682 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:53.768623 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-884f7825-5587-40c5-a7b5-2c7efac79682 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b" status: 200 len: 1523 microversion: 2.1 time: 1.346917 Aug 29 15:42:53.772943 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2023/4159] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:52 2022] GET /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b => generated 1523 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:53.792793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-39b3af56-00f1-402e-9643-f2687b133964 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:53.793943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-39b3af56-00f1-402e-9643-f2687b133964 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:53.810394 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b97a1c5b-777b-4fd2-98e1-79e78c5fd7ed tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 204 len: 0 microversion: 2.1 time: 0.217513 Aug 29 15:42:53.812449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39b3af56-00f1-402e-9643-f2687b133964 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.813219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39b3af56-00f1-402e-9643-f2687b133964 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.813330 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2137/4160] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:53 2022] DELETE /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:53.813935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39b3af56-00f1-402e-9643-f2687b133964 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.815670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39b3af56-00f1-402e-9643-f2687b133964 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.816606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39b3af56-00f1-402e-9643-f2687b133964 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.817515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39b3af56-00f1-402e-9643-f2687b133964 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.822973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-55cd2770-2bc9-48b6-b84d-e702a4262a61 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:53.829155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-55cd2770-2bc9-48b6-b84d-e702a4262a61 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:53.845218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55cd2770-2bc9-48b6-b84d-e702a4262a61 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.845780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55cd2770-2bc9-48b6-b84d-e702a4262a61 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.846423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55cd2770-2bc9-48b6-b84d-e702a4262a61 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.847488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55cd2770-2bc9-48b6-b84d-e702a4262a61 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.852813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55cd2770-2bc9-48b6-b84d-e702a4262a61 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.852813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55cd2770-2bc9-48b6-b84d-e702a4262a61 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.882939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:54.690522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-55cd2770-2bc9-48b6-b84d-e702a4262a61 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:54.703207 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-55cd2770-2bc9-48b6-b84d-e702a4262a61 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1672 microversion: 2.1 time: 0.885102 Aug 29 15:42:54.705550 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2138/4161] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:53 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1672 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:54.718501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a8dfd451-2400-4b18-8ee8-c9f4b847ccf3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:54.718876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a8dfd451-2400-4b18-8ee8-c9f4b847ccf3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:54.736456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8dfd451-2400-4b18-8ee8-c9f4b847ccf3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.736958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8dfd451-2400-4b18-8ee8-c9f4b847ccf3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.737437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8dfd451-2400-4b18-8ee8-c9f4b847ccf3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.738191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8dfd451-2400-4b18-8ee8-c9f4b847ccf3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.739007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8dfd451-2400-4b18-8ee8-c9f4b847ccf3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.739114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8dfd451-2400-4b18-8ee8-c9f4b847ccf3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.773641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-39b3af56-00f1-402e-9643-f2687b133964 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:54.782046 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-39b3af56-00f1-402e-9643-f2687b133964 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1308 microversion: 2.1 time: 0.993875 Aug 29 15:42:54.786373 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2024/4162] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:53 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1308 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:54.791510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-3e74f9bb-cb4e-4c92-8b37-462d534196b2 req-86d4adf3-a983-4b50-bb39-2ba45f4acff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2363ee5-1fe6-4753-a6ca-c4a6700cd38b", "name": "network-vif-deleted", "tag": "dd204679-0e5e-4a4b-b477-ccfc910e18df"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:54.818535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3e74f9bb-cb4e-4c92-8b37-462d534196b2 req-86d4adf3-a983-4b50-bb39-2ba45f4acff2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.819426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3e74f9bb-cb4e-4c92-8b37-462d534196b2 req-86d4adf3-a983-4b50-bb39-2ba45f4acff2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.820009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3e74f9bb-cb4e-4c92-8b37-462d534196b2 req-86d4adf3-a983-4b50-bb39-2ba45f4acff2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.863982 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-3e74f9bb-cb4e-4c92-8b37-462d534196b2 req-86d4adf3-a983-4b50-bb39-2ba45f4acff2 service nova] Creating event network-vif-deleted:dd204679-0e5e-4a4b-b477-ccfc910e18df for instance c2363ee5-1fe6-4753-a6ca-c4a6700cd38b on n-h2-839401-11 Aug 29 15:42:54.869466 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-3e74f9bb-cb4e-4c92-8b37-462d534196b2 req-86d4adf3-a983-4b50-bb39-2ba45f4acff2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081626 Aug 29 15:42:54.870391 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2025/4163] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:54.875714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f014b309-eedc-4e4a-b85e-89102ade761b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:54.876654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f014b309-eedc-4e4a-b85e-89102ade761b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: c2363ee5-1fe6-4753-a6ca-c4a6700cd38b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:54.884072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f014b309-eedc-4e4a-b85e-89102ade761b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.884865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f014b309-eedc-4e4a-b85e-89102ade761b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.885581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f014b309-eedc-4e4a-b85e-89102ade761b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.886511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f014b309-eedc-4e4a-b85e-89102ade761b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.887180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f014b309-eedc-4e4a-b85e-89102ade761b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.887889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f014b309-eedc-4e4a-b85e-89102ade761b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.927917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f014b309-eedc-4e4a-b85e-89102ade761b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.928822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f014b309-eedc-4e4a-b85e-89102ade761b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.929448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f014b309-eedc-4e4a-b85e-89102ade761b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.930092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-f014b309-eedc-4e4a-b85e-89102ade761b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lazy-loading 'fault' on Instance uuid c2363ee5-1fe6-4753-a6ca-c4a6700cd38b {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:54.933763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a8dfd451-2400-4b18-8ee8-c9f4b847ccf3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:54.945973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a8dfd451-2400-4b18-8ee8-c9f4b847ccf3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:54.948468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a8dfd451-2400-4b18-8ee8-c9f4b847ccf3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:54.950104 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a8dfd451-2400-4b18-8ee8-c9f4b847ccf3 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.243145 Aug 29 15:42:54.950847 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2139/4164] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:54 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:55.160506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f014b309-eedc-4e4a-b85e-89102ade761b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:55.173618 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f014b309-eedc-4e4a-b85e-89102ade761b tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b" status: 200 len: 1313 microversion: 2.1 time: 0.301719 Aug 29 15:42:55.176136 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2026/4165] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:54 2022] GET /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:55.727049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d5eb55d0-e834-44ae-9534-171b36750680 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:55.728285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d5eb55d0-e834-44ae-9534-171b36750680 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:55.740363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5eb55d0-e834-44ae-9534-171b36750680 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:55.740950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5eb55d0-e834-44ae-9534-171b36750680 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:55.743106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5eb55d0-e834-44ae-9534-171b36750680 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:55.744192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5eb55d0-e834-44ae-9534-171b36750680 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:55.746081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5eb55d0-e834-44ae-9534-171b36750680 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:55.747196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5eb55d0-e834-44ae-9534-171b36750680 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:55.814416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-83d814fd-c492-4ec9-9664-319becfc723d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:55.815226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-83d814fd-c492-4ec9-9664-319becfc723d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:55.836265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83d814fd-c492-4ec9-9664-319becfc723d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:55.836778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83d814fd-c492-4ec9-9664-319becfc723d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:55.837460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83d814fd-c492-4ec9-9664-319becfc723d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:55.838136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83d814fd-c492-4ec9-9664-319becfc723d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:55.838598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83d814fd-c492-4ec9-9664-319becfc723d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:55.839130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83d814fd-c492-4ec9-9664-319becfc723d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:55.999940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d5eb55d0-e834-44ae-9534-171b36750680 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:56.008653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:56.015767 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d5eb55d0-e834-44ae-9534-171b36750680 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1672 microversion: 2.1 time: 0.292814 Aug 29 15:42:56.033503 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2140/4166] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:55 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1672 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:56.039329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9cc23051-5478-4f93-85e6-d50eb3dabab9 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:56.040558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9cc23051-5478-4f93-85e6-d50eb3dabab9 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:56.046024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:56.049587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cc23051-5478-4f93-85e6-d50eb3dabab9 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.050918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cc23051-5478-4f93-85e6-d50eb3dabab9 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.051578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cc23051-5478-4f93-85e6-d50eb3dabab9 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:56.052600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cc23051-5478-4f93-85e6-d50eb3dabab9 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.053270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cc23051-5478-4f93-85e6-d50eb3dabab9 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.053843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cc23051-5478-4f93-85e6-d50eb3dabab9 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:56.150912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9cc23051-5478-4f93-85e6-d50eb3dabab9 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:56.163226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9cc23051-5478-4f93-85e6-d50eb3dabab9 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:56.164930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9cc23051-5478-4f93-85e6-d50eb3dabab9 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:56.166402 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9cc23051-5478-4f93-85e6-d50eb3dabab9 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.131566 Aug 29 15:42:56.167558 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2141/4167] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:56 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:56.197675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4f851aae-4815-46fa-9ec6-4b48d8e92b4f tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:56.198585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4f851aae-4815-46fa-9ec6-4b48d8e92b4f tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: c2363ee5-1fe6-4753-a6ca-c4a6700cd38b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:56.213004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-83d814fd-c492-4ec9-9664-319becfc723d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:56.222364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f851aae-4815-46fa-9ec6-4b48d8e92b4f tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.224434 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-83d814fd-c492-4ec9-9664-319becfc723d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1308 microversion: 2.1 time: 0.414149 Aug 29 15:42:56.225254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f851aae-4815-46fa-9ec6-4b48d8e92b4f tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.225872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f851aae-4815-46fa-9ec6-4b48d8e92b4f tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:56.226641 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2027/4168] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:55 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1308 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:56.228012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f851aae-4815-46fa-9ec6-4b48d8e92b4f tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.228760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f851aae-4815-46fa-9ec6-4b48d8e92b4f tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.229372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f851aae-4815-46fa-9ec6-4b48d8e92b4f tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:56.245026 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-4f851aae-4815-46fa-9ec6-4b48d8e92b4f tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] HTTP exception thrown: Instance c2363ee5-1fe6-4753-a6ca-c4a6700cd38b could not be found. Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4f851aae-4815-46fa-9ec6-4b48d8e92b4f tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Request method failure captured: Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b HTTP/1.1 Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN5FLYGaqGvpshNSdbU4K3MbLuQBrqoqsf5fQDgxyjyRxXU2pNWqD2maM90zJ9JZLO8jCsYVnGUws0eK-wV5nLhyUbzaLjBewc1WJ3oTIFOwSrEqB3l6u6BTNvqXkkbyQWpc_5hMclQYgNoiSrJjHv1P01TZhFevgKWr9QHhRU0lKB8 Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 2cf3b32adf094715b432dcd75a883966 Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2cf3b32adf094715b432dcd75a883966", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2cf3b32adf094715b432dcd75a883966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2cf3b32adf094715b432dcd75a883966"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2cf3b32adf094715b432dcd75a883966"}]}] Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 2cf3b32adf094715b432dcd75a883966 Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ListServersNegativeTestJSON-406780769-project Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: fada133bdb6a4d0190a3abbadf0c252a Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ListServersNegativeTestJSON-406780769-project Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance c2363ee5-1fe6-4753-a6ca-c4a6700cd38b could not be found. Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'c2363ee5-1fe6-4753-a6ca-c4a6700cd38b'} Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2363ee5-1fe6-4753-a6ca-c4a6700cd38b could not be found. Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2363ee5-1fe6-4753-a6ca-c4a6700cd38b could not be found. Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:56.247117 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:56.251236 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:56.251236 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:56.251236 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:56.251236 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:56.251236 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:56.251236 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:56.251236 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2363ee5-1fe6-4753-a6ca-c4a6700cd38b could not be found. Aug 29 15:42:56.251236 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:42:56.252849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4f851aae-4815-46fa-9ec6-4b48d8e92b4f tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Returning 404 to user: Instance c2363ee5-1fe6-4753-a6ca-c4a6700cd38b could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:56.253997 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4f851aae-4815-46fa-9ec6-4b48d8e92b4f tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b" status: 404 len: 111 microversion: 2.1 time: 0.060715 Aug 29 15:42:56.255057 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2142/4169] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:56 2022] GET /compute/v2.1/servers/c2363ee5-1fe6-4753-a6ca-c4a6700cd38b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:42:56.263285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4ca013fb-b969-4f37-a588-fa897a02bf13 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:56.264578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4ca013fb-b969-4f37-a588-fa897a02bf13 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:56.283195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ca013fb-b969-4f37-a588-fa897a02bf13 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.283719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ca013fb-b969-4f37-a588-fa897a02bf13 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.284165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ca013fb-b969-4f37-a588-fa897a02bf13 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:56.284893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ca013fb-b969-4f37-a588-fa897a02bf13 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.285385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ca013fb-b969-4f37-a588-fa897a02bf13 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.285991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ca013fb-b969-4f37-a588-fa897a02bf13 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:56.387438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4ca013fb-b969-4f37-a588-fa897a02bf13 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fada133bdb6a4d0190a3abbadf0c252a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf3b32adf094715b432dcd75a883966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:56.400892 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4ca013fb-b969-4f37-a588-fa897a02bf13 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 200 len: 1480 microversion: 2.1 time: 0.141839 Aug 29 15:42:56.410112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1004784354", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "769686a8-e5c7-4dae-a595-5009844505e5"}, {"port": "81163d25-b7c2-48cd-a63a-7bc7148abfaf", "tag": "port-1"}, {"port": "99530e77-db4a-45c6-9205-99f6d2ad4d43", "tag": "port-2"}, {"uuid": "3088d66e-e114-47c1-841c-6949218f198a", "tag": "net-1"}, {"uuid": "3088d66e-e114-47c1-841c-6949218f198a"}, {"uuid": "5b574009-187a-444c-9495-c59dd6278363", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "5b574009-187a-444c-9495-c59dd6278363", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "83e77868-594d-4d7e-aa64-5493279fecc5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "2d9c34c8-1931-45a9-9201-f8fbd1754150", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "9c6ceba4-4b77-4f6e-bf7a-0fc2c656b1bd", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--983396729"}], "key_name": "tempest-keypair-856749252", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:56.414444 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2028/4170] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:56 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 1480 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:56.562498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] validate_networks() for [('769686a8-e5c7-4dae-a595-5009844505e5', None, None, None, None, None), (None, None, '81163d25-b7c2-48cd-a63a-7bc7148abfaf', None, None, None), (None, None, '99530e77-db4a-45c6-9205-99f6d2ad4d43', None, None, None), ('3088d66e-e114-47c1-841c-6949218f198a', None, None, None, None, None), ('3088d66e-e114-47c1-841c-6949218f198a', None, None, None, None, None), ('5b574009-187a-444c-9495-c59dd6278363', '10.2.2.100', None, None, None, None), ('5b574009-187a-444c-9495-c59dd6278363', '10.2.2.200', None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:42:56.951424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-14116df4-88d5-4a74-b808-e3b7cf30cfce req-4d4eaae7-a82b-486d-a907-ed41fb6b4534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b035c3ef-60ac-4572-8ab2-b6d4f50c6138", "name": "network-vif-deleted", "tag": "73fe3fed-42da-403c-89bc-cd6d69b3425c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:56.993941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-14116df4-88d5-4a74-b808-e3b7cf30cfce req-4d4eaae7-a82b-486d-a907-ed41fb6b4534 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.996648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-14116df4-88d5-4a74-b808-e3b7cf30cfce req-4d4eaae7-a82b-486d-a907-ed41fb6b4534 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.997220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-14116df4-88d5-4a74-b808-e3b7cf30cfce req-4d4eaae7-a82b-486d-a907-ed41fb6b4534 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.017311 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-14116df4-88d5-4a74-b808-e3b7cf30cfce req-4d4eaae7-a82b-486d-a907-ed41fb6b4534 service nova] Creating event network-vif-deleted:73fe3fed-42da-403c-89bc-cd6d69b3425c for instance b035c3ef-60ac-4572-8ab2-b6d4f50c6138 on n-h1-839401-11 Aug 29 15:42:57.026449 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-14116df4-88d5-4a74-b808-e3b7cf30cfce req-4d4eaae7-a82b-486d-a907-ed41fb6b4534 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080917 Aug 29 15:42:57.028276 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2029/4171] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:42:57.045911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2c3c4160-4ff6-49ce-8c9a-0b15c107a3ae tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:57.046646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2c3c4160-4ff6-49ce-8c9a-0b15c107a3ae tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:57.055661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c3c4160-4ff6-49ce-8c9a-0b15c107a3ae tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.056640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c3c4160-4ff6-49ce-8c9a-0b15c107a3ae tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.057238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c3c4160-4ff6-49ce-8c9a-0b15c107a3ae tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.058206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c3c4160-4ff6-49ce-8c9a-0b15c107a3ae tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.058805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c3c4160-4ff6-49ce-8c9a-0b15c107a3ae tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.059352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c3c4160-4ff6-49ce-8c9a-0b15c107a3ae tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.420468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2c3c4160-4ff6-49ce-8c9a-0b15c107a3ae tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:57.429486 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2c3c4160-4ff6-49ce-8c9a-0b15c107a3ae tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1672 microversion: 2.1 time: 0.393979 Aug 29 15:42:57.435943 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2030/4172] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:57 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1672 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:57.441135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3bd4e165-b5d1-45ff-a7ee-b51cd3c3079d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:57.449898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3bd4e165-b5d1-45ff-a7ee-b51cd3c3079d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:57.461597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bd4e165-b5d1-45ff-a7ee-b51cd3c3079d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.462356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bd4e165-b5d1-45ff-a7ee-b51cd3c3079d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.468066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bd4e165-b5d1-45ff-a7ee-b51cd3c3079d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.469296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bd4e165-b5d1-45ff-a7ee-b51cd3c3079d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.470069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bd4e165-b5d1-45ff-a7ee-b51cd3c3079d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.470742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bd4e165-b5d1-45ff-a7ee-b51cd3c3079d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.621942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3bd4e165-b5d1-45ff-a7ee-b51cd3c3079d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:57.641733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3bd4e165-b5d1-45ff-a7ee-b51cd3c3079d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:57.652085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3bd4e165-b5d1-45ff-a7ee-b51cd3c3079d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:57.653531 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3bd4e165-b5d1-45ff-a7ee-b51cd3c3079d tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.216476 Aug 29 15:42:57.665108 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2031/4173] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:57 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:57.665108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d3598f55-2aee-474a-b90a-140f30216df5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:57.665369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d3598f55-2aee-474a-b90a-140f30216df5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:57.688652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3598f55-2aee-474a-b90a-140f30216df5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.690322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3598f55-2aee-474a-b90a-140f30216df5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.691002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3598f55-2aee-474a-b90a-140f30216df5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.692006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3598f55-2aee-474a-b90a-140f30216df5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.692669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3598f55-2aee-474a-b90a-140f30216df5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.694566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3598f55-2aee-474a-b90a-140f30216df5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.941838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:58.341499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d3598f55-2aee-474a-b90a-140f30216df5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:58.355724 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d3598f55-2aee-474a-b90a-140f30216df5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1488 microversion: 2.1 time: 0.700401 Aug 29 15:42:58.356723 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2032/4174] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:57 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1488 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:58.374714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-39d5a025-1dea-44dc-b477-c9d9614b6e61 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:58.375696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-39d5a025-1dea-44dc-b477-c9d9614b6e61 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] [instance: b035c3ef-60ac-4572-8ab2-b6d4f50c6138] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:58.387639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39d5a025-1dea-44dc-b477-c9d9614b6e61 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.388408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39d5a025-1dea-44dc-b477-c9d9614b6e61 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.390344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39d5a025-1dea-44dc-b477-c9d9614b6e61 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.391411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39d5a025-1dea-44dc-b477-c9d9614b6e61 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.393848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39d5a025-1dea-44dc-b477-c9d9614b6e61 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.394482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39d5a025-1dea-44dc-b477-c9d9614b6e61 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.426745 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-39d5a025-1dea-44dc-b477-c9d9614b6e61 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] HTTP exception thrown: Instance b035c3ef-60ac-4572-8ab2-b6d4f50c6138 could not be found. Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-39d5a025-1dea-44dc-b477-c9d9614b6e61 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Request method failure captured: Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 HTTP/1.1 Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN5FLYGaqGvpshNSdbU4K3MbLuQBrqoqsf5fQDgxyjyRxXU2pNWqD2maM90zJ9JZLO8jCsYVnGUws0eK-wV5nLhyUbzaLjBewc1WJ3oTIFOwSrEqB3l6u6BTNvqXkkbyQWpc_5hMclQYgNoiSrJjHv1P01TZhFevgKWr9QHhRU0lKB8 Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 2cf3b32adf094715b432dcd75a883966 Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2cf3b32adf094715b432dcd75a883966", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2cf3b32adf094715b432dcd75a883966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2cf3b32adf094715b432dcd75a883966"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2cf3b32adf094715b432dcd75a883966"}]}] Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 2cf3b32adf094715b432dcd75a883966 Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-406780769 Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ListServersNegativeTestJSON-406780769-project Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: fada133bdb6a4d0190a3abbadf0c252a Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ListServersNegativeTestJSON-406780769-project Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance b035c3ef-60ac-4572-8ab2-b6d4f50c6138 could not be found. Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'b035c3ef-60ac-4572-8ab2-b6d4f50c6138'} Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b035c3ef-60ac-4572-8ab2-b6d4f50c6138 could not be found. Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b035c3ef-60ac-4572-8ab2-b6d4f50c6138 could not be found. Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:42:58.428745 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:58.434206 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:42:58.434206 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:58.434206 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:58.434206 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:58.434206 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:58.434206 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:58.434206 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b035c3ef-60ac-4572-8ab2-b6d4f50c6138 could not be found. Aug 29 15:42:58.434206 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:42:58.434206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-39d5a025-1dea-44dc-b477-c9d9614b6e61 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] Returning 404 to user: Instance b035c3ef-60ac-4572-8ab2-b6d4f50c6138 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:58.434206 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-39d5a025-1dea-44dc-b477-c9d9614b6e61 tempest-ListServersNegativeTestJSON-406780769 tempest-ListServersNegativeTestJSON-406780769-project] 10.222.0.62 "GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138" status: 404 len: 111 microversion: 2.1 time: 0.072443 Aug 29 15:42:58.434206 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2033/4175] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:58 2022] GET /compute/v2.1/servers/b035c3ef-60ac-4572-8ab2-b6d4f50c6138 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:58.448402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-67f1477b-c234-4961-a429-b48d8b00693b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:58.462437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67f1477b-c234-4961-a429-b48d8b00693b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.464937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67f1477b-c234-4961-a429-b48d8b00693b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.465432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67f1477b-c234-4961-a429-b48d8b00693b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.537309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-67f1477b-c234-4961-a429-b48d8b00693b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Going to try to stop instance {{(pid=122361) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:42:58.651058 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-67f1477b-c234-4961-a429-b48d8b00693b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "POST /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5/action" status: 202 len: 0 microversion: 2.1 time: 0.215287 Aug 29 15:42:58.651803 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2034/4176] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:42:58 2022] POST /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:42:58.670453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1be20368-0f73-43ea-be29-0325084abab4 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:58.672813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1be20368-0f73-43ea-be29-0325084abab4 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:58.688491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1be20368-0f73-43ea-be29-0325084abab4 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.689225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1be20368-0f73-43ea-be29-0325084abab4 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.689678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1be20368-0f73-43ea-be29-0325084abab4 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.690429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1be20368-0f73-43ea-be29-0325084abab4 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.690894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1be20368-0f73-43ea-be29-0325084abab4 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.691321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1be20368-0f73-43ea-be29-0325084abab4 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.799121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1be20368-0f73-43ea-be29-0325084abab4 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.799632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1be20368-0f73-43ea-be29-0325084abab4 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.800083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1be20368-0f73-43ea-be29-0325084abab4 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.800548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-1be20368-0f73-43ea-be29-0325084abab4 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lazy-loading 'fault' on Instance uuid d1c7ad8e-1ed9-4347-bb61-13e861e30886 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:58.933414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1be20368-0f73-43ea-be29-0325084abab4 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:58.943288 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1be20368-0f73-43ea-be29-0325084abab4 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 200 len: 1326 microversion: 2.1 time: 0.285595 Aug 29 15:42:58.959542 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2035/4177] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:58 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 1326 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:58.970857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c3afadb9-4ffe-4a56-8358-ed379ea3d9c7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:58.971478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c3afadb9-4ffe-4a56-8358-ed379ea3d9c7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:58.994841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3afadb9-4ffe-4a56-8358-ed379ea3d9c7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.995330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3afadb9-4ffe-4a56-8358-ed379ea3d9c7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.995823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3afadb9-4ffe-4a56-8358-ed379ea3d9c7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.996481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3afadb9-4ffe-4a56-8358-ed379ea3d9c7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.996939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3afadb9-4ffe-4a56-8358-ed379ea3d9c7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.000632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3afadb9-4ffe-4a56-8358-ed379ea3d9c7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.395671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:59.427398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c3afadb9-4ffe-4a56-8358-ed379ea3d9c7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:59.440764 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c3afadb9-4ffe-4a56-8358-ed379ea3d9c7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 0.479914 Aug 29 15:42:59.444106 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2036/4178] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:58 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:59.456442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cc5ec66c-bcb1-471d-8c5f-b75993db651b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:59.458337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cc5ec66c-bcb1-471d-8c5f-b75993db651b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:59.474337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc5ec66c-bcb1-471d-8c5f-b75993db651b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.474907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc5ec66c-bcb1-471d-8c5f-b75993db651b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.475324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc5ec66c-bcb1-471d-8c5f-b75993db651b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.476041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc5ec66c-bcb1-471d-8c5f-b75993db651b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.476509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc5ec66c-bcb1-471d-8c5f-b75993db651b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.476941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc5ec66c-bcb1-471d-8c5f-b75993db651b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.638958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cc5ec66c-bcb1-471d-8c5f-b75993db651b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:59.651778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cc5ec66c-bcb1-471d-8c5f-b75993db651b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:59.657186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cc5ec66c-bcb1-471d-8c5f-b75993db651b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:59.658519 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cc5ec66c-bcb1-471d-8c5f-b75993db651b tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.212918 Aug 29 15:42:59.665789 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2037/4179] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:59 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:59.679249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-9c363e63-97c0-4bf7-8ba9-4154dc955289 req-7fa3e704-19e6-496b-ad71-5d6e3d1b57aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c7ad8e-1ed9-4347-bb61-13e861e30886", "name": "network-vif-deleted", "tag": "3b0b56b0-e15e-416f-9d4e-484bdf83401b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:59.692415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9c363e63-97c0-4bf7-8ba9-4154dc955289 req-7fa3e704-19e6-496b-ad71-5d6e3d1b57aa service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.693067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9c363e63-97c0-4bf7-8ba9-4154dc955289 req-7fa3e704-19e6-496b-ad71-5d6e3d1b57aa service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.693854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9c363e63-97c0-4bf7-8ba9-4154dc955289 req-7fa3e704-19e6-496b-ad71-5d6e3d1b57aa service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.709397 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-9c363e63-97c0-4bf7-8ba9-4154dc955289 req-7fa3e704-19e6-496b-ad71-5d6e3d1b57aa service nova] Creating event network-vif-deleted:3b0b56b0-e15e-416f-9d4e-484bdf83401b for instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 on n-h1-839401-11 Aug 29 15:42:59.715369 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-9c363e63-97c0-4bf7-8ba9-4154dc955289 req-7fa3e704-19e6-496b-ad71-5d6e3d1b57aa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048168 Aug 29 15:42:59.716834 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2038/4180] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:59.964810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-660a2d57-a228-4c58-8b7b-9e6cfe444d5c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:59.966462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-660a2d57-a228-4c58-8b7b-9e6cfe444d5c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:59.984688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-660a2d57-a228-4c58-8b7b-9e6cfe444d5c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.985850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-660a2d57-a228-4c58-8b7b-9e6cfe444d5c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.986700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-660a2d57-a228-4c58-8b7b-9e6cfe444d5c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.987571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-660a2d57-a228-4c58-8b7b-9e6cfe444d5c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.989564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-660a2d57-a228-4c58-8b7b-9e6cfe444d5c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.990827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-660a2d57-a228-4c58-8b7b-9e6cfe444d5c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:00.020318 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-660a2d57-a228-4c58-8b7b-9e6cfe444d5c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] HTTP exception thrown: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-660a2d57-a228-4c58-8b7b-9e6cfe444d5c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Request method failure captured: Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 HTTP/1.1 Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN1hzQ3z2U-w-FgTgqHX6rJBPsY0JjEnUe64fPTyeVmgZsBprzTQ1bIdxek9a-vYJQ_HslrhHa9E2P7RvnOg4AfCoJyg0z1_3P2l3RDilU7LN-AayEaJX63yJg3v6qo8LD4c_wIISDZxt3UYbqIe3Yye-nWgNVTo4Tjj1hcQrc45oDU Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 8c81e50c9fdd45919b4d6c8e6682d97d Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8c81e50c9fdd45919b4d6c8e6682d97d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8c81e50c9fdd45919b4d6c8e6682d97d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8c81e50c9fdd45919b4d6c8e6682d97d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8c81e50c9fdd45919b4d6c8e6682d97d"}]}] Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 8c81e50c9fdd45919b4d6c8e6682d97d Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachVolumeTestJSON-1547689605-project Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 77a898d8b4f7477281081a0e4dedf493 Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachVolumeTestJSON-1547689605-project Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'd1c7ad8e-1ed9-4347-bb61-13e861e30886'} Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:00.022617 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:43:00.026764 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:00.026764 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:00.026764 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:00.026764 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:43:00.026764 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:43:00.026764 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. Aug 29 15:43:00.026764 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:43:00.035097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-660a2d57-a228-4c58-8b7b-9e6cfe444d5c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Returning 404 to user: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:43:00.036168 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-660a2d57-a228-4c58-8b7b-9e6cfe444d5c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 404 len: 111 microversion: 2.1 time: 0.075906 Aug 29 15:43:00.037433 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2039/4181] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:59 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:43:00.060332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-13c6c916-0a86-4bc4-bdb8-8efa0a5341a8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '.version_select at 0x7fc42b754310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:00.150293 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-13c6c916-0a86-4bc4-bdb8-8efa0a5341a8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-177554775" status: 202 len: 0 microversion: 2.1 time: 0.102341 Aug 29 15:43:00.151977 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2040/4182] 10.222.0.62 () {58 vars in 1218 bytes} [Mon Aug 29 15:43:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-177554775 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:43:00.472646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a2aaa3dc-b1cd-4356-b601-06999daf37fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:00.473425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a2aaa3dc-b1cd-4356-b601-06999daf37fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:00.491814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2aaa3dc-b1cd-4356-b601-06999daf37fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:00.492798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2aaa3dc-b1cd-4356-b601-06999daf37fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:00.493857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2aaa3dc-b1cd-4356-b601-06999daf37fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:00.496697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2aaa3dc-b1cd-4356-b601-06999daf37fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:00.500695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2aaa3dc-b1cd-4356-b601-06999daf37fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:00.502747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2aaa3dc-b1cd-4356-b601-06999daf37fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:00.970493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a2aaa3dc-b1cd-4356-b601-06999daf37fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:00.980656 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a2aaa3dc-b1cd-4356-b601-06999daf37fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 0.512700 Aug 29 15:43:00.994065 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2041/4183] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:00 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:01.004110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7af7ea69-f1f1-45e9-831d-b73c9bd654da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:01.004955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7af7ea69-f1f1-45e9-831d-b73c9bd654da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:01.012556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7af7ea69-f1f1-45e9-831d-b73c9bd654da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:01.013339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7af7ea69-f1f1-45e9-831d-b73c9bd654da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:01.014458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7af7ea69-f1f1-45e9-831d-b73c9bd654da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.015356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7af7ea69-f1f1-45e9-831d-b73c9bd654da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:01.015982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7af7ea69-f1f1-45e9-831d-b73c9bd654da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:01.016577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7af7ea69-f1f1-45e9-831d-b73c9bd654da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.214714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7af7ea69-f1f1-45e9-831d-b73c9bd654da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:01.230438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7af7ea69-f1f1-45e9-831d-b73c9bd654da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:01.231906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7af7ea69-f1f1-45e9-831d-b73c9bd654da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:01.233132 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7af7ea69-f1f1-45e9-831d-b73c9bd654da tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.237736 Aug 29 15:43:01.233711 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2042/4184] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:00 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:01.375252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:43:01.376386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:43:01.377261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:43:01.377891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:43:01.378591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:43:01.396242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:01.399663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:01.400409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.401422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:01.405552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:01.406490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.448259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Getting quotas for project da0582312a80402fb35d3be2a5b4bede. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:01.464927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Getting quotas for user 661739c0be874b799a47e2bd8f4fa65d and project da0582312a80402fb35d3be2a5b4bede. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:01.926379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:43:01.929522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='83e77868-594d-4d7e-aa64-5493279fecc5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='2d9c34c8-1931-45a9-9201-f8fbd1754150',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c6ceba4-4b77-4f6e-bf7a-0fc2c656b1bd',volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:43:02.010684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1846c30e-dcb2-4b0d-a113-4403c60e057a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:02.013355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1846c30e-dcb2-4b0d-a113-4403c60e057a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:02.016397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:02.053812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1846c30e-dcb2-4b0d-a113-4403c60e057a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.059350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1846c30e-dcb2-4b0d-a113-4403c60e057a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.060021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1846c30e-dcb2-4b0d-a113-4403c60e057a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:02.066217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1846c30e-dcb2-4b0d-a113-4403c60e057a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.067774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1846c30e-dcb2-4b0d-a113-4403c60e057a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.071791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1846c30e-dcb2-4b0d-a113-4403c60e057a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:02.579137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1846c30e-dcb2-4b0d-a113-4403c60e057a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:02.582681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:02.593813 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1846c30e-dcb2-4b0d-a113-4403c60e057a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 0.589691 Aug 29 15:43:02.608531 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2043/4185] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:02 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:02.617524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-05eed9b9-e7c4-4c67-a2e9-3b5d0f21f216 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:02.620348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-05eed9b9-e7c4-4c67-a2e9-3b5d0f21f216 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:02.638710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05eed9b9-e7c4-4c67-a2e9-3b5d0f21f216 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.639792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05eed9b9-e7c4-4c67-a2e9-3b5d0f21f216 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.641179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05eed9b9-e7c4-4c67-a2e9-3b5d0f21f216 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:02.643547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05eed9b9-e7c4-4c67-a2e9-3b5d0f21f216 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.644159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05eed9b9-e7c4-4c67-a2e9-3b5d0f21f216 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.647353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05eed9b9-e7c4-4c67-a2e9-3b5d0f21f216 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:02.726641 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eeb4fa3c-e1b4-4286-a8d6-dfd82b13bcbd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 6.320750 Aug 29 15:43:02.733436 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2143/4186] 10.222.0.62 () {62 vars in 1189 bytes} [Mon Aug 29 15:42:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 6328 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:43:02.755821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d2329585-3476-4759-b188-4139b264526f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:02.756526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d2329585-3476-4759-b188-4139b264526f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:02.828430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-05eed9b9-e7c4-4c67-a2e9-3b5d0f21f216 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:02.876030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-05eed9b9-e7c4-4c67-a2e9-3b5d0f21f216 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:02.878816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-05eed9b9-e7c4-4c67-a2e9-3b5d0f21f216 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:02.883492 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-05eed9b9-e7c4-4c67-a2e9-3b5d0f21f216 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.271271 Aug 29 15:43:02.898132 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2044/4187] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:02 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:02.908711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5c387c5b-0fa4-4fd6-8ef8-c8aa728316f1 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Action: 'create', calling method: .version_select at 0x7fc42b94d1f0>, body: {"keypair": {"name": "tempest-keypair-413777314", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcpzE2CUHuiDAr6CjLEOpKmxwKpfiappQXGulBMGHgwC+ut383/gtqqW+4ZwhFDHNHBBmaMS4hwmDT3iLqBwxbUyEz1sgRR8D/3Ah1ZT4bCj/leQB8ErgbR3jVvk0f8OQ=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:02.953826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5c387c5b-0fa4-4fd6-8ef8-c8aa728316f1 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Getting quotas for project 8c81e50c9fdd45919b4d6c8e6682d97d. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:02.963267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5c387c5b-0fa4-4fd6-8ef8-c8aa728316f1 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Getting quotas for user 77a898d8b4f7477281081a0e4dedf493 and project 8c81e50c9fdd45919b4d6c8e6682d97d. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:03.017816 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5c387c5b-0fa4-4fd6-8ef8-c8aa728316f1 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117522 Aug 29 15:43:03.019597 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2045/4188] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:43:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:03.131230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d2329585-3476-4759-b188-4139b264526f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:03.161544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d2329585-3476-4759-b188-4139b264526f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:03.164645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d2329585-3476-4759-b188-4139b264526f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:03.175594 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d2329585-3476-4759-b188-4139b264526f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1285 microversion: 2.32 time: 0.436606 Aug 29 15:43:03.183294 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2144/4189] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:02 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1285 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:03.616276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-423df5c8-e169-4737-8c33-01a55f9801ea tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:03.616907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-423df5c8-e169-4737-8c33-01a55f9801ea tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:03.629768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-423df5c8-e169-4737-8c33-01a55f9801ea tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:03.629768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-423df5c8-e169-4737-8c33-01a55f9801ea tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:03.630027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-423df5c8-e169-4737-8c33-01a55f9801ea tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:03.630709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-423df5c8-e169-4737-8c33-01a55f9801ea tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:03.641709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-423df5c8-e169-4737-8c33-01a55f9801ea tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:03.642276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-423df5c8-e169-4737-8c33-01a55f9801ea tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:03.918092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5d8f9d03-eff9-4eae-a31e-0fd3a4746fcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:03.919232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5d8f9d03-eff9-4eae-a31e-0fd3a4746fcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:03.929519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-423df5c8-e169-4737-8c33-01a55f9801ea tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:03.944633 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-423df5c8-e169-4737-8c33-01a55f9801ea tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 0.332360 Aug 29 15:43:03.945590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d8f9d03-eff9-4eae-a31e-0fd3a4746fcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:03.946281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d8f9d03-eff9-4eae-a31e-0fd3a4746fcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:03.950097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d8f9d03-eff9-4eae-a31e-0fd3a4746fcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:03.950236 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2046/4190] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:03 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:03.951301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d8f9d03-eff9-4eae-a31e-0fd3a4746fcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:03.951918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d8f9d03-eff9-4eae-a31e-0fd3a4746fcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:03.953485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d8f9d03-eff9-4eae-a31e-0fd3a4746fcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.169738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5d8f9d03-eff9-4eae-a31e-0fd3a4746fcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:04.191816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5d8f9d03-eff9-4eae-a31e-0fd3a4746fcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:04.206451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5e0dc8af-942b-48ab-b803-7d83d1f8bbc3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:04.207076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5e0dc8af-942b-48ab-b803-7d83d1f8bbc3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:04.214671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5d8f9d03-eff9-4eae-a31e-0fd3a4746fcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:04.218397 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5d8f9d03-eff9-4eae-a31e-0fd3a4746fcb tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1604 microversion: 2.42 time: 0.303680 Aug 29 15:43:04.221916 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2145/4191] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:03 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1604 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:43:04.422694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5e0dc8af-942b-48ab-b803-7d83d1f8bbc3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:04.455022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5e0dc8af-942b-48ab-b803-7d83d1f8bbc3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:04.466258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5e0dc8af-942b-48ab-b803-7d83d1f8bbc3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:04.480160 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5e0dc8af-942b-48ab-b803-7d83d1f8bbc3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1285 microversion: 2.32 time: 0.271986 Aug 29 15:43:04.484804 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2047/4192] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:04 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1285 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:43:04.966758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d26ca6fc-357f-4ebb-a77f-dff2b4be822a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:04.969168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d26ca6fc-357f-4ebb-a77f-dff2b4be822a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:04.989901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d26ca6fc-357f-4ebb-a77f-dff2b4be822a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.991290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d26ca6fc-357f-4ebb-a77f-dff2b4be822a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.991741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d26ca6fc-357f-4ebb-a77f-dff2b4be822a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.994139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d26ca6fc-357f-4ebb-a77f-dff2b4be822a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.995636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d26ca6fc-357f-4ebb-a77f-dff2b4be822a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.996438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d26ca6fc-357f-4ebb-a77f-dff2b4be822a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.258574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1fc1861e-9a89-4dcc-b4b8-b6467f527e33 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:05.259255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1fc1861e-9a89-4dcc-b4b8-b6467f527e33 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:05.282904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fc1861e-9a89-4dcc-b4b8-b6467f527e33 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.283872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fc1861e-9a89-4dcc-b4b8-b6467f527e33 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.283872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fc1861e-9a89-4dcc-b4b8-b6467f527e33 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.284556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fc1861e-9a89-4dcc-b4b8-b6467f527e33 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.285104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fc1861e-9a89-4dcc-b4b8-b6467f527e33 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.285560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fc1861e-9a89-4dcc-b4b8-b6467f527e33 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.376003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fc1861e-9a89-4dcc-b4b8-b6467f527e33 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.376698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fc1861e-9a89-4dcc-b4b8-b6467f527e33 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.377333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fc1861e-9a89-4dcc-b4b8-b6467f527e33 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.378010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-1fc1861e-9a89-4dcc-b4b8-b6467f527e33 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lazy-loading 'fault' on Instance uuid beba97fc-1a57-48db-9963-36262439e822 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:43:05.513176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1fc1861e-9a89-4dcc-b4b8-b6467f527e33 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:05.527201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1fc1861e-9a89-4dcc-b4b8-b6467f527e33 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:05.539536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1fc1861e-9a89-4dcc-b4b8-b6467f527e33 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06adfce1215a460d8b289916b806b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64900d09e46d44e58a07e062a419bc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:05.545966 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1fc1861e-9a89-4dcc-b4b8-b6467f527e33 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 200 len: 1609 microversion: 2.42 time: 0.293231 Aug 29 15:43:05.546777 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2048/4193] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:05 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 1609 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:05.555504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-66a6a97f-1f47-45c2-9126-2810e198f63b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:05.556120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-66a6a97f-1f47-45c2-9126-2810e198f63b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:05.591733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66a6a97f-1f47-45c2-9126-2810e198f63b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.595933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66a6a97f-1f47-45c2-9126-2810e198f63b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.596491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66a6a97f-1f47-45c2-9126-2810e198f63b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.597294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66a6a97f-1f47-45c2-9126-2810e198f63b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.597771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66a6a97f-1f47-45c2-9126-2810e198f63b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.598203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66a6a97f-1f47-45c2-9126-2810e198f63b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.700054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-66a6a97f-1f47-45c2-9126-2810e198f63b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:05.727595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d26ca6fc-357f-4ebb-a77f-dff2b4be822a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:05.736524 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d26ca6fc-357f-4ebb-a77f-dff2b4be822a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 0.774458 Aug 29 15:43:05.753901 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2146/4194] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:04 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:05.777351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-66a6a97f-1f47-45c2-9126-2810e198f63b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:05.785366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-66a6a97f-1f47-45c2-9126-2810e198f63b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:05.786796 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-66a6a97f-1f47-45c2-9126-2810e198f63b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1575 microversion: 2.32 time: 0.235366 Aug 29 15:43:05.787956 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2049/4195] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:05 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1575 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:06.570330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-daf928d7-5fe7-47d9-b598-eade110e4746 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:06.570955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-daf928d7-5fe7-47d9-b598-eade110e4746 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:06.583804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-daf928d7-5fe7-47d9-b598-eade110e4746 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:06.590804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-daf928d7-5fe7-47d9-b598-eade110e4746 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:06.591511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-daf928d7-5fe7-47d9-b598-eade110e4746 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:06.592617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-daf928d7-5fe7-47d9-b598-eade110e4746 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:06.593115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-daf928d7-5fe7-47d9-b598-eade110e4746 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:06.593708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-daf928d7-5fe7-47d9-b598-eade110e4746 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:06.627079 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-daf928d7-5fe7-47d9-b598-eade110e4746 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] HTTP exception thrown: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-daf928d7-5fe7-47d9-b598-eade110e4746 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Request method failure captured: Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 HTTP/1.1 Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNzr3ZOtqBrxCE3UJ78CAllQSFk0EeuUpwJH5YqODbaSDPhWh_Z1jT3A3K8JfRzYwY5Jj8tFnCpmFTiMPTSlFoaXg98rivJ5D0n_NnzJOgZS38CsreHl2XZBUtAxZXqJpQFBSQfcNL7qfCmqPxaiuAaa4V_8VaSu2_FVWCVQScg9JgE Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-Openstack-Nova-Api-Version: 2.42 Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 64900d09e46d44e58a07e062a419bc09 Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-156060243 Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_64900d09e46d44e58a07e062a419bc09", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/64900d09e46d44e58a07e062a419bc09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/64900d09e46d44e58a07e062a419bc09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/64900d09e46d44e58a07e062a419bc09"}]}] Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TaggedBootDevicesTest_v242-156060243 Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 64900d09e46d44e58a07e062a419bc09 Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-156060243 Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TaggedBootDevicesTest_v242-156060243-project Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 06adfce1215a460d8b289916b806b0b9 Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TaggedBootDevicesTest_v242-156060243-project Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'beba97fc-1a57-48db-9963-36262439e822'} Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:43:06.632419 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:06.636513 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:43:06.636513 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:06.636513 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:06.636513 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:06.636513 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:43:06.636513 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:43:06.636513 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. Aug 29 15:43:06.636513 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:43:06.637859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-daf928d7-5fe7-47d9-b598-eade110e4746 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Returning 404 to user: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:43:06.641499 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-daf928d7-5fe7-47d9-b598-eade110e4746 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 404 len: 111 microversion: 2.42 time: 0.075607 Aug 29 15:43:06.646082 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2147/4196] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:06 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:43:06.651231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f0bace52-c0fc-46e0-802f-8622b366d499 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '.version_select at 0x7fc42b7b8d30>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:06.687931 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f0bace52-c0fc-46e0-802f-8622b366d499 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1528689471" status: 204 len: 0 microversion: 2.42 time: 0.040601 Aug 29 15:43:06.690707 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2050/4197] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 15:43:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1528689471 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:43:06.764745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-834f548b-2a9c-44d9-aef7-6137a3401e85 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:06.765411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-834f548b-2a9c-44d9-aef7-6137a3401e85 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:06.800415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-834f548b-2a9c-44d9-aef7-6137a3401e85 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:06.802422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-834f548b-2a9c-44d9-aef7-6137a3401e85 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:06.803296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-834f548b-2a9c-44d9-aef7-6137a3401e85 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:06.807847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-834f548b-2a9c-44d9-aef7-6137a3401e85 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:06.808437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-834f548b-2a9c-44d9-aef7-6137a3401e85 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:06.808881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-834f548b-2a9c-44d9-aef7-6137a3401e85 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:06.821721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e3b43978-13bb-4864-a75b-0c6e794824fa tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:06.822394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e3b43978-13bb-4864-a75b-0c6e794824fa tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:06.836454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3b43978-13bb-4864-a75b-0c6e794824fa tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:06.838721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3b43978-13bb-4864-a75b-0c6e794824fa tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:06.839339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3b43978-13bb-4864-a75b-0c6e794824fa tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:06.840247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3b43978-13bb-4864-a75b-0c6e794824fa tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:06.841881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3b43978-13bb-4864-a75b-0c6e794824fa tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:06.842778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3b43978-13bb-4864-a75b-0c6e794824fa tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:07.101225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e3b43978-13bb-4864-a75b-0c6e794824fa tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:07.114053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-834f548b-2a9c-44d9-aef7-6137a3401e85 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:07.117380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e3b43978-13bb-4864-a75b-0c6e794824fa tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:07.123725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e3b43978-13bb-4864-a75b-0c6e794824fa tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:07.126348 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e3b43978-13bb-4864-a75b-0c6e794824fa tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1593 microversion: 2.32 time: 0.314825 Aug 29 15:43:07.126966 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2051/4198] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:06 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1593 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:43:07.128684 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-834f548b-2a9c-44d9-aef7-6137a3401e85 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 0.364148 Aug 29 15:43:07.132634 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2148/4199] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:06 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:07.717649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-17606051", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51e05a82-0321-40a7-a6f5-a305b6e6596c"}], "security_groups": [{"name": "tempest-securitygroup--790863317"}], "key_name": "tempest-keypair-413777314", "user_data": "}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:08.029257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] validate_networks() for [('51e05a82-0321-40a7-a6f5-a305b6e6596c', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:43:08.171734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-55c9299a-9bf4-4606-ac9e-369ac325a01f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:08.172370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-55c9299a-9bf4-4606-ac9e-369ac325a01f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:08.186358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55c9299a-9bf4-4606-ac9e-369ac325a01f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:08.186762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55c9299a-9bf4-4606-ac9e-369ac325a01f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:08.187193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55c9299a-9bf4-4606-ac9e-369ac325a01f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:08.187888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55c9299a-9bf4-4606-ac9e-369ac325a01f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:08.188334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55c9299a-9bf4-4606-ac9e-369ac325a01f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:08.208036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55c9299a-9bf4-4606-ac9e-369ac325a01f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:08.589228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-55c9299a-9bf4-4606-ac9e-369ac325a01f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:08.608226 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-55c9299a-9bf4-4606-ac9e-369ac325a01f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 0.447486 Aug 29 15:43:08.609131 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2149/4200] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:08 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:08.613991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3a526dcd-a7bd-417c-9727-96edd86b62db tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:08.615057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3a526dcd-a7bd-417c-9727-96edd86b62db tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:08.622016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a526dcd-a7bd-417c-9727-96edd86b62db tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:08.622922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a526dcd-a7bd-417c-9727-96edd86b62db tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:08.623608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a526dcd-a7bd-417c-9727-96edd86b62db tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:08.624545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a526dcd-a7bd-417c-9727-96edd86b62db tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:08.625373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a526dcd-a7bd-417c-9727-96edd86b62db tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:08.627189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a526dcd-a7bd-417c-9727-96edd86b62db tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:08.752143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3a526dcd-a7bd-417c-9727-96edd86b62db tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:08.774922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3a526dcd-a7bd-417c-9727-96edd86b62db tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:08.776939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3a526dcd-a7bd-417c-9727-96edd86b62db tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:08.783273 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3a526dcd-a7bd-417c-9727-96edd86b62db tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1593 microversion: 2.32 time: 0.172326 Aug 29 15:43:08.799070 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2150/4201] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:08 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1593 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:09.636361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7461c73e-c34a-44fd-9d81-c4f51da0d4ca tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:09.636989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7461c73e-c34a-44fd-9d81-c4f51da0d4ca tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:09.657207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7461c73e-c34a-44fd-9d81-c4f51da0d4ca tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:09.657733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7461c73e-c34a-44fd-9d81-c4f51da0d4ca tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:09.658175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7461c73e-c34a-44fd-9d81-c4f51da0d4ca tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:09.660790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7461c73e-c34a-44fd-9d81-c4f51da0d4ca tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:09.662473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7461c73e-c34a-44fd-9d81-c4f51da0d4ca tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:09.666567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7461c73e-c34a-44fd-9d81-c4f51da0d4ca tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:09.779384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:43:09.779952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:43:09.780265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:43:09.780983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:43:09.781878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:43:09.787617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:09.814502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:09.818648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:09.819182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:09.819962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:09.820477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:09.820880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:09.900613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Getting quotas for project 8c81e50c9fdd45919b4d6c8e6682d97d. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:09.917132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Getting quotas for user 77a898d8b4f7477281081a0e4dedf493 and project 8c81e50c9fdd45919b4d6c8e6682d97d. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:09.947882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:43:09.950375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:43:10.047403 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5552eb54-b099-4b29-a719-e005a74c8efb tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.334486 Aug 29 15:43:10.056089 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2052/4202] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:43:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 2338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:43:10.056089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ff911417-8037-40b6-a613-bd7a10a0389b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:10.056371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ff911417-8037-40b6-a613-bd7a10a0389b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:10.121120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff911417-8037-40b6-a613-bd7a10a0389b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:10.121916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff911417-8037-40b6-a613-bd7a10a0389b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:10.122379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff911417-8037-40b6-a613-bd7a10a0389b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:10.123180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff911417-8037-40b6-a613-bd7a10a0389b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:10.123647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff911417-8037-40b6-a613-bd7a10a0389b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:10.143631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff911417-8037-40b6-a613-bd7a10a0389b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:10.398917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7461c73e-c34a-44fd-9d81-c4f51da0d4ca tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:10.414978 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7461c73e-c34a-44fd-9d81-c4f51da0d4ca tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 0.785893 Aug 29 15:43:10.434114 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2151/4203] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:09 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:10.557611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ff911417-8037-40b6-a613-bd7a10a0389b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:10.573851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ff911417-8037-40b6-a613-bd7a10a0389b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:10.584650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ff911417-8037-40b6-a613-bd7a10a0389b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:10.589713 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ff911417-8037-40b6-a613-bd7a10a0389b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1660 microversion: 2.32 time: 0.538038 Aug 29 15:43:10.607714 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2053/4204] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:10 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1660 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:11.091921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f5f582fd-b93c-460f-9440-44a6635d1e1c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:11.092639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f5f582fd-b93c-460f-9440-44a6635d1e1c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:11.250811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f5f582fd-b93c-460f-9440-44a6635d1e1c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:11.260888 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f5f582fd-b93c-460f-9440-44a6635d1e1c tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1235 microversion: 2.1 time: 0.823781 Aug 29 15:43:11.272975 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2152/4205] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:10 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1235 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:11.438586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-811836a5-3b9c-42d5-989a-41288777c97d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:11.439222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-811836a5-3b9c-42d5-989a-41288777c97d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:11.486112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811836a5-3b9c-42d5-989a-41288777c97d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.488598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811836a5-3b9c-42d5-989a-41288777c97d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.489120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811836a5-3b9c-42d5-989a-41288777c97d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.489901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811836a5-3b9c-42d5-989a-41288777c97d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.490441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811836a5-3b9c-42d5-989a-41288777c97d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.490876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811836a5-3b9c-42d5-989a-41288777c97d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.621361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cdc9bd36-7d22-4c2d-85f0-ac54cafe3151 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:11.622102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cdc9bd36-7d22-4c2d-85f0-ac54cafe3151 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:11.632828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:11.639729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cdc9bd36-7d22-4c2d-85f0-ac54cafe3151 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.640687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cdc9bd36-7d22-4c2d-85f0-ac54cafe3151 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.641373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cdc9bd36-7d22-4c2d-85f0-ac54cafe3151 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.643816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cdc9bd36-7d22-4c2d-85f0-ac54cafe3151 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.656021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cdc9bd36-7d22-4c2d-85f0-ac54cafe3151 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.657638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cdc9bd36-7d22-4c2d-85f0-ac54cafe3151 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:12.471849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cdc9bd36-7d22-4c2d-85f0-ac54cafe3151 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:12.484983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cdc9bd36-7d22-4c2d-85f0-ac54cafe3151 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:12.494660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cdc9bd36-7d22-4c2d-85f0-ac54cafe3151 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:12.498549 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cdc9bd36-7d22-4c2d-85f0-ac54cafe3151 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1706 microversion: 2.32 time: 0.880155 Aug 29 15:43:12.499722 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2153/4206] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:11 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1706 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:43:12.690044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-811836a5-3b9c-42d5-989a-41288777c97d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:12.705377 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-811836a5-3b9c-42d5-989a-41288777c97d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 1.266142 Aug 29 15:43:12.709243 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2054/4207] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:11 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:12.734448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-507a5556-2aeb-49e0-b0fa-f29de8fb3ea9 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:12.739272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-507a5556-2aeb-49e0-b0fa-f29de8fb3ea9 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:12.757127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-507a5556-2aeb-49e0-b0fa-f29de8fb3ea9 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:12.757637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-507a5556-2aeb-49e0-b0fa-f29de8fb3ea9 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:12.761520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-507a5556-2aeb-49e0-b0fa-f29de8fb3ea9 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:12.762479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-507a5556-2aeb-49e0-b0fa-f29de8fb3ea9 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:12.762985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-507a5556-2aeb-49e0-b0fa-f29de8fb3ea9 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:12.763633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-507a5556-2aeb-49e0-b0fa-f29de8fb3ea9 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:12.852905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1760838946", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": "none"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:12.947753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:43:12.948178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:43:12.948824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:43:12.949406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:43:12.949980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:43:12.956935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-507a5556-2aeb-49e0-b0fa-f29de8fb3ea9 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:12.969583 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-507a5556-2aeb-49e0-b0fa-f29de8fb3ea9 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1295 microversion: 2.1 time: 0.256767 Aug 29 15:43:12.972512 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2055/4208] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:12 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1295 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:12.988548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:12.989060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:12.989526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:12.990327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:12.990786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:12.991881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:13.058994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Getting quotas for project 9af6a2702cb4440f8abe6a4339d2353b. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:13.066298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Getting quotas for user 3fe0ad3a38934b45baa3b0108e0d7635 and project 9af6a2702cb4440f8abe6a4339d2353b. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:13.084995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:43:13.088733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] [instance: 018fb19f-a453-4ad9-addd-7e4286160c6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:43:13.175021 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a4de8414-83e4-470d-9d10-8b3bb0192450 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.673814 Aug 29 15:43:13.176237 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2154/4209] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:43:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:43:13.190109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-387c40ce-b4b9-4811-97ae-9cfd9f35e1e4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:13.191322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-387c40ce-b4b9-4811-97ae-9cfd9f35e1e4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] [instance: 018fb19f-a453-4ad9-addd-7e4286160c6b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:13.528469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9988c080-8dc8-4ad2-9f36-2c2f84253340 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:13.529295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9988c080-8dc8-4ad2-9f36-2c2f84253340 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:13.537763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9988c080-8dc8-4ad2-9f36-2c2f84253340 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:13.539452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9988c080-8dc8-4ad2-9f36-2c2f84253340 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:13.540146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9988c080-8dc8-4ad2-9f36-2c2f84253340 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:13.541216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9988c080-8dc8-4ad2-9f36-2c2f84253340 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:13.542217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9988c080-8dc8-4ad2-9f36-2c2f84253340 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:13.550109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9988c080-8dc8-4ad2-9f36-2c2f84253340 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:13.659442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-387c40ce-b4b9-4811-97ae-9cfd9f35e1e4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:13.671987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-387c40ce-b4b9-4811-97ae-9cfd9f35e1e4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:13.679281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-387c40ce-b4b9-4811-97ae-9cfd9f35e1e4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:13.681402 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-387c40ce-b4b9-4811-97ae-9cfd9f35e1e4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] 10.222.0.62 "GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b" status: 200 len: 1281 microversion: 2.47 time: 0.496471 Aug 29 15:43:13.682052 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2056/4210] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:13 2022] GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b => generated 1281 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:13.729373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bf49f47d-09f7-4796-855c-c64720f5ea03 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:13.731529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bf49f47d-09f7-4796-855c-c64720f5ea03 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:13.740068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf49f47d-09f7-4796-855c-c64720f5ea03 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:13.740898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf49f47d-09f7-4796-855c-c64720f5ea03 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:13.741466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf49f47d-09f7-4796-855c-c64720f5ea03 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:13.742338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf49f47d-09f7-4796-855c-c64720f5ea03 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:13.743178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf49f47d-09f7-4796-855c-c64720f5ea03 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:13.743963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf49f47d-09f7-4796-855c-c64720f5ea03 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:13.888641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9988c080-8dc8-4ad2-9f36-2c2f84253340 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:13.910443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9988c080-8dc8-4ad2-9f36-2c2f84253340 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:13.915084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9988c080-8dc8-4ad2-9f36-2c2f84253340 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:13.922449 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9988c080-8dc8-4ad2-9f36-2c2f84253340 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1706 microversion: 2.32 time: 0.394401 Aug 29 15:43:13.933246 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2155/4211] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:13 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1706 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:14.000673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f039549-72f5-467a-ae1a-82d91babf08f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:14.002141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3f039549-72f5-467a-ae1a-82d91babf08f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:14.020342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f039549-72f5-467a-ae1a-82d91babf08f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:14.021667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f039549-72f5-467a-ae1a-82d91babf08f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:14.024540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f039549-72f5-467a-ae1a-82d91babf08f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:14.026507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f039549-72f5-467a-ae1a-82d91babf08f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:14.027759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f039549-72f5-467a-ae1a-82d91babf08f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:14.028876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f039549-72f5-467a-ae1a-82d91babf08f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:14.226191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3f039549-72f5-467a-ae1a-82d91babf08f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:14.241903 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3f039549-72f5-467a-ae1a-82d91babf08f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1293 microversion: 2.1 time: 0.245646 Aug 29 15:43:14.245720 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2156/4212] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:13 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1293 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:14.707574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-80e32509-d7b8-4326-b59b-ed868dda2fe4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:14.708191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-80e32509-d7b8-4326-b59b-ed868dda2fe4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] [instance: 018fb19f-a453-4ad9-addd-7e4286160c6b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:14.718302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80e32509-d7b8-4326-b59b-ed868dda2fe4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:14.725970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80e32509-d7b8-4326-b59b-ed868dda2fe4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:14.726742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80e32509-d7b8-4326-b59b-ed868dda2fe4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:14.728786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80e32509-d7b8-4326-b59b-ed868dda2fe4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:14.730720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80e32509-d7b8-4326-b59b-ed868dda2fe4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:14.731419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80e32509-d7b8-4326-b59b-ed868dda2fe4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:14.817170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bf49f47d-09f7-4796-855c-c64720f5ea03 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:14.843956 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bf49f47d-09f7-4796-855c-c64720f5ea03 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 1.118712 Aug 29 15:43:14.846105 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2057/4213] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:13 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:14.914086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-80e32509-d7b8-4326-b59b-ed868dda2fe4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:14.938473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-80e32509-d7b8-4326-b59b-ed868dda2fe4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:14.949076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f1412db0-9eb2-4f53-9b95-fdb4692b6bb4 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:14.949735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f1412db0-9eb2-4f53-9b95-fdb4692b6bb4 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:14.958004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-80e32509-d7b8-4326-b59b-ed868dda2fe4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:14.960339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1412db0-9eb2-4f53-9b95-fdb4692b6bb4 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:14.960850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1412db0-9eb2-4f53-9b95-fdb4692b6bb4 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:14.961312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1412db0-9eb2-4f53-9b95-fdb4692b6bb4 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:14.962039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1412db0-9eb2-4f53-9b95-fdb4692b6bb4 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:14.962491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1412db0-9eb2-4f53-9b95-fdb4692b6bb4 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:14.962914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1412db0-9eb2-4f53-9b95-fdb4692b6bb4 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:14.966066 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-80e32509-d7b8-4326-b59b-ed868dda2fe4 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] 10.222.0.62 "GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b" status: 200 len: 1333 microversion: 2.47 time: 0.262558 Aug 29 15:43:14.981593 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2157/4214] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:14 2022] GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b => generated 1333 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:43:15.265503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-35c1a4b4-47ed-4fa5-a332-5df24922aedd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:15.266359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-35c1a4b4-47ed-4fa5-a332-5df24922aedd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:15.277866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35c1a4b4-47ed-4fa5-a332-5df24922aedd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:15.280818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35c1a4b4-47ed-4fa5-a332-5df24922aedd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:15.282395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35c1a4b4-47ed-4fa5-a332-5df24922aedd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:15.284544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35c1a4b4-47ed-4fa5-a332-5df24922aedd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:15.285197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35c1a4b4-47ed-4fa5-a332-5df24922aedd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:15.290221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35c1a4b4-47ed-4fa5-a332-5df24922aedd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:15.428805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f1412db0-9eb2-4f53-9b95-fdb4692b6bb4 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:15.445853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-35c1a4b4-47ed-4fa5-a332-5df24922aedd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:15.453799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f1412db0-9eb2-4f53-9b95-fdb4692b6bb4 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:15.457410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f1412db0-9eb2-4f53-9b95-fdb4692b6bb4 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:15.458642 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f1412db0-9eb2-4f53-9b95-fdb4692b6bb4 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1752 microversion: 2.32 time: 0.515105 Aug 29 15:43:15.458829 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-35c1a4b4-47ed-4fa5-a332-5df24922aedd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1293 microversion: 2.1 time: 0.197125 Aug 29 15:43:15.470821 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2158/4215] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:15 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1293 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:15.471788 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2058/4216] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:14 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1752 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:43:15.871398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bfefd442-9f41-4329-abb7-db31125ff0e2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:15.872119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bfefd442-9f41-4329-abb7-db31125ff0e2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:15.883195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfefd442-9f41-4329-abb7-db31125ff0e2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:15.883687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfefd442-9f41-4329-abb7-db31125ff0e2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:15.884122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfefd442-9f41-4329-abb7-db31125ff0e2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:15.884842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfefd442-9f41-4329-abb7-db31125ff0e2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:15.885315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfefd442-9f41-4329-abb7-db31125ff0e2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:15.885737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bfefd442-9f41-4329-abb7-db31125ff0e2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:15.996762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5e7e8163-45e6-41f3-bac6-48ec3c34a670 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:15.997432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5e7e8163-45e6-41f3-bac6-48ec3c34a670 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] [instance: 018fb19f-a453-4ad9-addd-7e4286160c6b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:16.004997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e7e8163-45e6-41f3-bac6-48ec3c34a670 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:16.015104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e7e8163-45e6-41f3-bac6-48ec3c34a670 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:16.017940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e7e8163-45e6-41f3-bac6-48ec3c34a670 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:16.020905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e7e8163-45e6-41f3-bac6-48ec3c34a670 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:16.027107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e7e8163-45e6-41f3-bac6-48ec3c34a670 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:16.028337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e7e8163-45e6-41f3-bac6-48ec3c34a670 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:16.428284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bfefd442-9f41-4329-abb7-db31125ff0e2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:16.444738 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bfefd442-9f41-4329-abb7-db31125ff0e2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 0.570526 Aug 29 15:43:16.446088 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2159/4217] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:15 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:16.486237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d1a867b5-5ec9-4b03-85cc-c27f4c2ba2b7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:16.487176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d1a867b5-5ec9-4b03-85cc-c27f4c2ba2b7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:16.497940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1a867b5-5ec9-4b03-85cc-c27f4c2ba2b7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:16.505700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1a867b5-5ec9-4b03-85cc-c27f4c2ba2b7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:16.509343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1a867b5-5ec9-4b03-85cc-c27f4c2ba2b7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:16.513138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1a867b5-5ec9-4b03-85cc-c27f4c2ba2b7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:16.514219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1a867b5-5ec9-4b03-85cc-c27f4c2ba2b7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:16.515779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1a867b5-5ec9-4b03-85cc-c27f4c2ba2b7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:16.529095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5e7e8163-45e6-41f3-bac6-48ec3c34a670 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:16.548490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5e7e8163-45e6-41f3-bac6-48ec3c34a670 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:16.553402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5e7e8163-45e6-41f3-bac6-48ec3c34a670 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:16.557586 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5e7e8163-45e6-41f3-bac6-48ec3c34a670 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] 10.222.0.62 "GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b" status: 200 len: 1339 microversion: 2.47 time: 0.564134 Aug 29 15:43:16.583343 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2059/4218] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:15 2022] GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b => generated 1339 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:43:16.602149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b8293ee1-d8b9-45cf-b7e8-2041fe265f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:16.603020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b8293ee1-d8b9-45cf-b7e8-2041fe265f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:16.610462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8293ee1-d8b9-45cf-b7e8-2041fe265f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:16.611163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8293ee1-d8b9-45cf-b7e8-2041fe265f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:16.611749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8293ee1-d8b9-45cf-b7e8-2041fe265f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:16.612883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8293ee1-d8b9-45cf-b7e8-2041fe265f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:16.613612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8293ee1-d8b9-45cf-b7e8-2041fe265f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:16.614183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8293ee1-d8b9-45cf-b7e8-2041fe265f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:16.727065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d1a867b5-5ec9-4b03-85cc-c27f4c2ba2b7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:16.736469 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d1a867b5-5ec9-4b03-85cc-c27f4c2ba2b7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1293 microversion: 2.1 time: 0.254193 Aug 29 15:43:16.753960 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2160/4219] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:16 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1293 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:17.125060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b8293ee1-d8b9-45cf-b7e8-2041fe265f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:17.146725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b8293ee1-d8b9-45cf-b7e8-2041fe265f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:17.149044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b8293ee1-d8b9-45cf-b7e8-2041fe265f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:17.150506 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b8293ee1-d8b9-45cf-b7e8-2041fe265f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1752 microversion: 2.32 time: 0.565607 Aug 29 15:43:17.154449 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2060/4220] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:16 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1752 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:17.472516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-82fcdd81-2968-426b-9294-c004e1750faf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:17.473931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-82fcdd81-2968-426b-9294-c004e1750faf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:17.491410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7aeb3cb8-a79d-474c-98ed-306948b44239 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:17.492338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7aeb3cb8-a79d-474c-98ed-306948b44239 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:17.498323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82fcdd81-2968-426b-9294-c004e1750faf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.500510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82fcdd81-2968-426b-9294-c004e1750faf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.501790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82fcdd81-2968-426b-9294-c004e1750faf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.503761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82fcdd81-2968-426b-9294-c004e1750faf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.504100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7aeb3cb8-a79d-474c-98ed-306948b44239 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.504800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7aeb3cb8-a79d-474c-98ed-306948b44239 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.505506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82fcdd81-2968-426b-9294-c004e1750faf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.506592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82fcdd81-2968-426b-9294-c004e1750faf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.507092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7aeb3cb8-a79d-474c-98ed-306948b44239 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.508057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7aeb3cb8-a79d-474c-98ed-306948b44239 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.510815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7aeb3cb8-a79d-474c-98ed-306948b44239 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.512045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7aeb3cb8-a79d-474c-98ed-306948b44239 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.561125 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-7aeb3cb8-a79d-474c-98ed-306948b44239 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] HTTP exception thrown: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7aeb3cb8-a79d-474c-98ed-306948b44239 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Request method failure captured: Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 HTTP/1.1 Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNzr3ZOtqBrxCE3UJ78CAllQSFk0EeuUpwJH5YqODbaSDPhWh_Z1jT3A3K8JfRzYwY5Jj8tFnCpmFTiMPTSlFoaXg98rivJ5D0n_NnzJOgZS38CsreHl2XZBUtAxZXqJpQFBSQfcNL7qfCmqPxaiuAaa4V_8VaSu2_FVWCVQScg9JgE Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.42 Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 64900d09e46d44e58a07e062a419bc09 Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-156060243 Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_64900d09e46d44e58a07e062a419bc09", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/64900d09e46d44e58a07e062a419bc09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/64900d09e46d44e58a07e062a419bc09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/64900d09e46d44e58a07e062a419bc09"}]}] Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TaggedBootDevicesTest_v242-156060243 Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 64900d09e46d44e58a07e062a419bc09 Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-156060243 Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TaggedBootDevicesTest_v242-156060243-project Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 06adfce1215a460d8b289916b806b0b9 Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TaggedBootDevicesTest_v242-156060243-project Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'beba97fc-1a57-48db-9963-36262439e822'} Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:43:17.562835 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:43:17.566223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. Aug 29 15:43:17.566223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:43:17.566223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:17.566223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:43:17.566223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:17.566223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:17.566223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:17.566223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:43:17.566223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:43:17.566223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. Aug 29 15:43:17.566223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:43:17.566223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7aeb3cb8-a79d-474c-98ed-306948b44239 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Returning 404 to user: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:43:17.566223 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7aeb3cb8-a79d-474c-98ed-306948b44239 tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "DELETE /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 404 len: 111 microversion: 2.42 time: 0.077938 Aug 29 15:43:17.568388 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2061/4221] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:43:17 2022] DELETE /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:43:17.573613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bce7e90a-91b6-42e7-8455-e62fa8663fbc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:17.577426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bce7e90a-91b6-42e7-8455-e62fa8663fbc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] [instance: beba97fc-1a57-48db-9963-36262439e822] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:17.587016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce7e90a-91b6-42e7-8455-e62fa8663fbc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.587016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce7e90a-91b6-42e7-8455-e62fa8663fbc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.587315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce7e90a-91b6-42e7-8455-e62fa8663fbc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.588307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce7e90a-91b6-42e7-8455-e62fa8663fbc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.588769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce7e90a-91b6-42e7-8455-e62fa8663fbc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.589246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce7e90a-91b6-42e7-8455-e62fa8663fbc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.639999 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-bce7e90a-91b6-42e7-8455-e62fa8663fbc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] HTTP exception thrown: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bce7e90a-91b6-42e7-8455-e62fa8663fbc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Request method failure captured: Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 HTTP/1.1 Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDNzr3ZOtqBrxCE3UJ78CAllQSFk0EeuUpwJH5YqODbaSDPhWh_Z1jT3A3K8JfRzYwY5Jj8tFnCpmFTiMPTSlFoaXg98rivJ5D0n_NnzJOgZS38CsreHl2XZBUtAxZXqJpQFBSQfcNL7qfCmqPxaiuAaa4V_8VaSu2_FVWCVQScg9JgE Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.42 Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 64900d09e46d44e58a07e062a419bc09 Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-156060243 Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_64900d09e46d44e58a07e062a419bc09", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/64900d09e46d44e58a07e062a419bc09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/64900d09e46d44e58a07e062a419bc09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/64900d09e46d44e58a07e062a419bc09"}]}] Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TaggedBootDevicesTest_v242-156060243 Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 64900d09e46d44e58a07e062a419bc09 Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-156060243 Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TaggedBootDevicesTest_v242-156060243-project Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 06adfce1215a460d8b289916b806b0b9 Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TaggedBootDevicesTest_v242-156060243-project Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'beba97fc-1a57-48db-9963-36262439e822'} Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:43:17.646043 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:17.650407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:43:17.650407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:17.650407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:17.650407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:17.650407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:43:17.650407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:43:17.650407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. Aug 29 15:43:17.650407 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:43:17.650407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bce7e90a-91b6-42e7-8455-e62fa8663fbc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] Returning 404 to user: Instance beba97fc-1a57-48db-9963-36262439e822 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:43:17.650407 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bce7e90a-91b6-42e7-8455-e62fa8663fbc tempest-TaggedBootDevicesTest_v242-156060243 tempest-TaggedBootDevicesTest_v242-156060243-project] 10.222.0.62 "GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822" status: 404 len: 111 microversion: 2.42 time: 0.079960 Aug 29 15:43:17.657424 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2062/4222] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:17 2022] GET /compute/v2.1/servers/beba97fc-1a57-48db-9963-36262439e822 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:43:17.675444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d11abbf5-6f4d-421b-8a9a-bd868ce59715 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:17.677325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d11abbf5-6f4d-421b-8a9a-bd868ce59715 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] [instance: 018fb19f-a453-4ad9-addd-7e4286160c6b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:17.694921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d11abbf5-6f4d-421b-8a9a-bd868ce59715 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.695513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d11abbf5-6f4d-421b-8a9a-bd868ce59715 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.697324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d11abbf5-6f4d-421b-8a9a-bd868ce59715 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.698438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d11abbf5-6f4d-421b-8a9a-bd868ce59715 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.699905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d11abbf5-6f4d-421b-8a9a-bd868ce59715 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.702609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d11abbf5-6f4d-421b-8a9a-bd868ce59715 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.878310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-82fcdd81-2968-426b-9294-c004e1750faf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:17.898842 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-82fcdd81-2968-426b-9294-c004e1750faf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 0.430635 Aug 29 15:43:17.901714 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2161/4223] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:17 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:17.913867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7600eb8b-6f38-4076-94a4-90a0d19a95fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:17.914753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7600eb8b-6f38-4076-94a4-90a0d19a95fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:17.955939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7600eb8b-6f38-4076-94a4-90a0d19a95fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.956442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7600eb8b-6f38-4076-94a4-90a0d19a95fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.968661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7600eb8b-6f38-4076-94a4-90a0d19a95fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.969377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7600eb8b-6f38-4076-94a4-90a0d19a95fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.969875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7600eb8b-6f38-4076-94a4-90a0d19a95fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.970303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7600eb8b-6f38-4076-94a4-90a0d19a95fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.979543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:18.063298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d11abbf5-6f4d-421b-8a9a-bd868ce59715 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:18.079078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d11abbf5-6f4d-421b-8a9a-bd868ce59715 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:18.081027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d11abbf5-6f4d-421b-8a9a-bd868ce59715 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:18.084568 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d11abbf5-6f4d-421b-8a9a-bd868ce59715 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] 10.222.0.62 "GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b" status: 200 len: 1339 microversion: 2.47 time: 0.429441 Aug 29 15:43:18.087484 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2063/4224] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:17 2022] GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b => generated 1339 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:18.187019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d05cde32-e8ad-42db-839c-e095c8dafe15 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:18.187703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d05cde32-e8ad-42db-839c-e095c8dafe15 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:18.210299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05cde32-e8ad-42db-839c-e095c8dafe15 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:18.211932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05cde32-e8ad-42db-839c-e095c8dafe15 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:18.215763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05cde32-e8ad-42db-839c-e095c8dafe15 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:18.226266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05cde32-e8ad-42db-839c-e095c8dafe15 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:18.228429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05cde32-e8ad-42db-839c-e095c8dafe15 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:18.229610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d05cde32-e8ad-42db-839c-e095c8dafe15 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:18.607763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7600eb8b-6f38-4076-94a4-90a0d19a95fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:18.617836 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7600eb8b-6f38-4076-94a4-90a0d19a95fd tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1360 microversion: 2.1 time: 0.714854 Aug 29 15:43:18.635867 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2162/4225] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:17 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1360 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:18.785553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d05cde32-e8ad-42db-839c-e095c8dafe15 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:18.805984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d05cde32-e8ad-42db-839c-e095c8dafe15 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:18.810130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d05cde32-e8ad-42db-839c-e095c8dafe15 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:18.812565 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d05cde32-e8ad-42db-839c-e095c8dafe15 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1752 microversion: 2.32 time: 0.630694 Aug 29 15:43:18.819076 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2064/4226] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:18 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1752 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:43:18.932074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-12798cce-a968-4a86-a1af-a22470817feb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:18.935039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-12798cce-a968-4a86-a1af-a22470817feb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:18.947189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12798cce-a968-4a86-a1af-a22470817feb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:18.951253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12798cce-a968-4a86-a1af-a22470817feb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:18.952008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12798cce-a968-4a86-a1af-a22470817feb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:18.952964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12798cce-a968-4a86-a1af-a22470817feb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:18.953713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12798cce-a968-4a86-a1af-a22470817feb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:18.954348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12798cce-a968-4a86-a1af-a22470817feb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:19.114619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-af171a7d-edee-4889-9285-17a9135bd39d tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:19.116663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-af171a7d-edee-4889-9285-17a9135bd39d tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] [instance: 018fb19f-a453-4ad9-addd-7e4286160c6b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:19.127206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af171a7d-edee-4889-9285-17a9135bd39d tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:19.133375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af171a7d-edee-4889-9285-17a9135bd39d tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:19.133978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af171a7d-edee-4889-9285-17a9135bd39d tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:19.135455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af171a7d-edee-4889-9285-17a9135bd39d tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:19.135455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af171a7d-edee-4889-9285-17a9135bd39d tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:19.136163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af171a7d-edee-4889-9285-17a9135bd39d tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:19.365891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-af171a7d-edee-4889-9285-17a9135bd39d tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:19.399224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-af171a7d-edee-4889-9285-17a9135bd39d tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:19.411058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-af171a7d-edee-4889-9285-17a9135bd39d tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:19.424139 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-af171a7d-edee-4889-9285-17a9135bd39d tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] 10.222.0.62 "GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b" status: 200 len: 1339 microversion: 2.47 time: 0.312444 Aug 29 15:43:19.427362 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2065/4227] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:19 2022] GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b => generated 1339 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:19.483576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-12798cce-a968-4a86-a1af-a22470817feb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:19.499502 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-12798cce-a968-4a86-a1af-a22470817feb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 0.575039 Aug 29 15:43:19.500087 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2163/4228] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:18 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:19.643207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cff5c30b-7065-44e6-8525-5e46f1d386df tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:19.644137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cff5c30b-7065-44e6-8525-5e46f1d386df tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:19.658570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cff5c30b-7065-44e6-8525-5e46f1d386df tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:19.659457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cff5c30b-7065-44e6-8525-5e46f1d386df tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:19.660423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cff5c30b-7065-44e6-8525-5e46f1d386df tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:19.661498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cff5c30b-7065-44e6-8525-5e46f1d386df tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:19.663394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cff5c30b-7065-44e6-8525-5e46f1d386df tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:19.664256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cff5c30b-7065-44e6-8525-5e46f1d386df tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:19.721313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:19.843340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5fabff59-f7b8-48e9-a0b2-43a51a43df5a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:19.844564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5fabff59-f7b8-48e9-a0b2-43a51a43df5a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:19.859758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fabff59-f7b8-48e9-a0b2-43a51a43df5a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:19.863775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fabff59-f7b8-48e9-a0b2-43a51a43df5a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:19.864391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fabff59-f7b8-48e9-a0b2-43a51a43df5a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:19.866465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fabff59-f7b8-48e9-a0b2-43a51a43df5a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:19.869205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fabff59-f7b8-48e9-a0b2-43a51a43df5a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:19.872652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fabff59-f7b8-48e9-a0b2-43a51a43df5a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:19.873689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:20.438984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5fabff59-f7b8-48e9-a0b2-43a51a43df5a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:20.455701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5fabff59-f7b8-48e9-a0b2-43a51a43df5a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:20.460008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5fabff59-f7b8-48e9-a0b2-43a51a43df5a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:20.461626 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5fabff59-f7b8-48e9-a0b2-43a51a43df5a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1798 microversion: 2.32 time: 0.622388 Aug 29 15:43:20.462784 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2164/4229] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:19 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1798 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:43:20.468530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9445cb23-4945-476a-ab02-0d846cf486fd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:20.470023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9445cb23-4945-476a-ab02-0d846cf486fd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] [instance: 018fb19f-a453-4ad9-addd-7e4286160c6b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:20.478517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9445cb23-4945-476a-ab02-0d846cf486fd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.479309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9445cb23-4945-476a-ab02-0d846cf486fd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:20.480168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9445cb23-4945-476a-ab02-0d846cf486fd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:20.481422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9445cb23-4945-476a-ab02-0d846cf486fd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.482180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9445cb23-4945-476a-ab02-0d846cf486fd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:20.483456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9445cb23-4945-476a-ab02-0d846cf486fd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:20.738712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9445cb23-4945-476a-ab02-0d846cf486fd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:20.748177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9445cb23-4945-476a-ab02-0d846cf486fd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:20.758745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9445cb23-4945-476a-ab02-0d846cf486fd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:20.762930 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9445cb23-4945-476a-ab02-0d846cf486fd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] 10.222.0.62 "GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b" status: 200 len: 1360 microversion: 2.47 time: 0.295747 Aug 29 15:43:20.764388 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2165/4230] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:20 2022] GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b => generated 1360 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:20.774524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a01a40cc-2a9c-470a-9e1c-abe87a5d191a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:20.775624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a01a40cc-2a9c-470a-9e1c-abe87a5d191a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:20.784537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a01a40cc-2a9c-470a-9e1c-abe87a5d191a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.795455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a01a40cc-2a9c-470a-9e1c-abe87a5d191a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:20.796990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a01a40cc-2a9c-470a-9e1c-abe87a5d191a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:20.798055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a01a40cc-2a9c-470a-9e1c-abe87a5d191a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.798667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a01a40cc-2a9c-470a-9e1c-abe87a5d191a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:20.799317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a01a40cc-2a9c-470a-9e1c-abe87a5d191a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:20.938907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cff5c30b-7065-44e6-8525-5e46f1d386df tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:20.954572 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cff5c30b-7065-44e6-8525-5e46f1d386df tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1360 microversion: 2.1 time: 1.316087 Aug 29 15:43:20.969852 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2066/4231] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:19 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1360 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:20.980666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ce1e95ad-cd57-4202-a1ec-f551c867494d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:20.986028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ce1e95ad-cd57-4202-a1ec-f551c867494d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:20.997450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce1e95ad-cd57-4202-a1ec-f551c867494d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:20.998128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce1e95ad-cd57-4202-a1ec-f551c867494d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:21.000093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce1e95ad-cd57-4202-a1ec-f551c867494d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:21.000957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce1e95ad-cd57-4202-a1ec-f551c867494d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:21.003160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce1e95ad-cd57-4202-a1ec-f551c867494d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:21.003861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce1e95ad-cd57-4202-a1ec-f551c867494d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:21.616354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a01a40cc-2a9c-470a-9e1c-abe87a5d191a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:21.629282 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a01a40cc-2a9c-470a-9e1c-abe87a5d191a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 0.859522 Aug 29 15:43:21.637647 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2166/4232] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:20 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:21.643454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-76398e5e-a4eb-4825-a5d4-8a62da983602 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-249632491"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:21.694655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-76398e5e-a4eb-4825-a5d4-8a62da983602 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] [instance: 018fb19f-a453-4ad9-addd-7e4286160c6b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:21.711458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76398e5e-a4eb-4825-a5d4-8a62da983602 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:21.712050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76398e5e-a4eb-4825-a5d4-8a62da983602 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:21.712504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76398e5e-a4eb-4825-a5d4-8a62da983602 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:21.721578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76398e5e-a4eb-4825-a5d4-8a62da983602 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:21.722236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76398e5e-a4eb-4825-a5d4-8a62da983602 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:21.722706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76398e5e-a4eb-4825-a5d4-8a62da983602 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:22.141227 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-76398e5e-a4eb-4825-a5d4-8a62da983602 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] 10.222.0.62 "POST /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b/action" status: 202 len: 52 microversion: 2.47 time: 0.501868 Aug 29 15:43:22.142148 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2167/4233] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 15:43:21 2022] POST /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b/action => generated 52 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:43:22.151472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-17aa5c94-fed2-42e2-a552-b8955f3ec5be tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:22.156863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-17aa5c94-fed2-42e2-a552-b8955f3ec5be tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:22.172697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17aa5c94-fed2-42e2-a552-b8955f3ec5be tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:22.175851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17aa5c94-fed2-42e2-a552-b8955f3ec5be tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:22.176471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17aa5c94-fed2-42e2-a552-b8955f3ec5be tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:22.178038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17aa5c94-fed2-42e2-a552-b8955f3ec5be tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:22.180359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17aa5c94-fed2-42e2-a552-b8955f3ec5be tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:22.181018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17aa5c94-fed2-42e2-a552-b8955f3ec5be tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:22.190086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ce1e95ad-cd57-4202-a1ec-f551c867494d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:22.212194 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ce1e95ad-cd57-4202-a1ec-f551c867494d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 1.239804 Aug 29 15:43:22.305492 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2067/4234] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:20 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:22.335508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e3b59fea-74a4-4fca-822e-9a9d44597fff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:22.337896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e3b59fea-74a4-4fca-822e-9a9d44597fff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:22.365488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3b59fea-74a4-4fca-822e-9a9d44597fff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:22.365999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3b59fea-74a4-4fca-822e-9a9d44597fff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:22.366447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3b59fea-74a4-4fca-822e-9a9d44597fff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:22.367183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3b59fea-74a4-4fca-822e-9a9d44597fff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:22.367644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3b59fea-74a4-4fca-822e-9a9d44597fff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:22.368070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3b59fea-74a4-4fca-822e-9a9d44597fff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:22.947812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-17aa5c94-fed2-42e2-a552-b8955f3ec5be tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:22.964952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-17aa5c94-fed2-42e2-a552-b8955f3ec5be tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:22.966393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-17aa5c94-fed2-42e2-a552-b8955f3ec5be tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:22.989563 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-17aa5c94-fed2-42e2-a552-b8955f3ec5be tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1798 microversion: 2.32 time: 0.823977 Aug 29 15:43:22.990281 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2168/4235] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:22 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1798 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:23.029516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b0c589ea-e90a-41be-a993-f777ec90a448 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:23.030125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b0c589ea-e90a-41be-a993-f777ec90a448 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] [instance: 018fb19f-a453-4ad9-addd-7e4286160c6b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:23.043372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:23.049047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0c589ea-e90a-41be-a993-f777ec90a448 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:23.049986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0c589ea-e90a-41be-a993-f777ec90a448 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:23.050579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0c589ea-e90a-41be-a993-f777ec90a448 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:23.051447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0c589ea-e90a-41be-a993-f777ec90a448 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:23.052051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0c589ea-e90a-41be-a993-f777ec90a448 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:23.053239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0c589ea-e90a-41be-a993-f777ec90a448 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:23.081682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=16 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:23.088448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b0c589ea-e90a-41be-a993-f777ec90a448 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] [instance: 018fb19f-a453-4ad9-addd-7e4286160c6b] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:43:23.288055 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b0c589ea-e90a-41be-a993-f777ec90a448 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] 10.222.0.62 "DELETE /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b" status: 204 len: 0 microversion: 2.47 time: 0.270891 Aug 29 15:43:23.292899 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2169/4236] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:43:22 2022] DELETE /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:43:23.317350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-74ac979a-cc33-46ba-b05a-b048ca6a1166 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:23.318180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-74ac979a-cc33-46ba-b05a-b048ca6a1166 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:23.346606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74ac979a-cc33-46ba-b05a-b048ca6a1166 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:23.347117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74ac979a-cc33-46ba-b05a-b048ca6a1166 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:23.347561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74ac979a-cc33-46ba-b05a-b048ca6a1166 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:23.348283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74ac979a-cc33-46ba-b05a-b048ca6a1166 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:23.348754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74ac979a-cc33-46ba-b05a-b048ca6a1166 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:23.349730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74ac979a-cc33-46ba-b05a-b048ca6a1166 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:23.663739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=14 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:24.347357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-74ac979a-cc33-46ba-b05a-b048ca6a1166 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:24.376283 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-74ac979a-cc33-46ba-b05a-b048ca6a1166 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 1.084666 Aug 29 15:43:24.394737 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2170/4237] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:23 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:24.421532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-007e7b78-9951-4a45-8abe-1cc80b29f2bb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:24.422179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-007e7b78-9951-4a45-8abe-1cc80b29f2bb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:24.431532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:24.464042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-007e7b78-9951-4a45-8abe-1cc80b29f2bb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:24.465064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-007e7b78-9951-4a45-8abe-1cc80b29f2bb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:24.466122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-007e7b78-9951-4a45-8abe-1cc80b29f2bb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:24.466990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-007e7b78-9951-4a45-8abe-1cc80b29f2bb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:24.467593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-007e7b78-9951-4a45-8abe-1cc80b29f2bb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:24.468326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-007e7b78-9951-4a45-8abe-1cc80b29f2bb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:25.059368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e3b59fea-74a4-4fca-822e-9a9d44597fff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:25.070072 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e3b59fea-74a4-4fca-822e-9a9d44597fff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1360 microversion: 2.1 time: 2.763056 Aug 29 15:43:25.070671 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2068/4238] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:22 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1360 bytes in 2764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:25.096024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-398590bd-eed8-41d5-b611-7ad278580e4b req-09e91228-6278-438f-8474-f3e660971f53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89dfeae0-3079-4a17-bc65-7ad03318e731", "tag": "bd7ed4b6-e125-48ac-8d8c-adae31bfdf56"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:25.125137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-398590bd-eed8-41d5-b611-7ad278580e4b req-09e91228-6278-438f-8474-f3e660971f53 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:25.125815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-398590bd-eed8-41d5-b611-7ad278580e4b req-09e91228-6278-438f-8474-f3e660971f53 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:25.127541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-398590bd-eed8-41d5-b611-7ad278580e4b req-09e91228-6278-438f-8474-f3e660971f53 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:25.164276 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-398590bd-eed8-41d5-b611-7ad278580e4b req-09e91228-6278-438f-8474-f3e660971f53 service nova] Creating event network-changed:bd7ed4b6-e125-48ac-8d8c-adae31bfdf56 for instance 89dfeae0-3079-4a17-bc65-7ad03318e731 on n-h2-839401-11 Aug 29 15:43:25.194909 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-398590bd-eed8-41d5-b611-7ad278580e4b req-09e91228-6278-438f-8474-f3e660971f53 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115401 Aug 29 15:43:25.197061 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2069/4239] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:25.244506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-82c0005d-87b3-4a5e-9e20-51b00cb5fa4b tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:25.248887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-82c0005d-87b3-4a5e-9e20-51b00cb5fa4b tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] [instance: 018fb19f-a453-4ad9-addd-7e4286160c6b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:25.275374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82c0005d-87b3-4a5e-9e20-51b00cb5fa4b tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:25.275928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82c0005d-87b3-4a5e-9e20-51b00cb5fa4b tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:25.279460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82c0005d-87b3-4a5e-9e20-51b00cb5fa4b tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:25.282307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82c0005d-87b3-4a5e-9e20-51b00cb5fa4b tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:25.286106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82c0005d-87b3-4a5e-9e20-51b00cb5fa4b tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:25.286577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82c0005d-87b3-4a5e-9e20-51b00cb5fa4b tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:25.554110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-007e7b78-9951-4a45-8abe-1cc80b29f2bb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:25.570676 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-007e7b78-9951-4a45-8abe-1cc80b29f2bb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 1.174414 Aug 29 15:43:25.584265 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2171/4240] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:24 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:25.584265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2245b711-86a8-4f39-88fb-56daa1c222cc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:25.584265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2245b711-86a8-4f39-88fb-56daa1c222cc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:25.620617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2245b711-86a8-4f39-88fb-56daa1c222cc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:25.621143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2245b711-86a8-4f39-88fb-56daa1c222cc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:25.621594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2245b711-86a8-4f39-88fb-56daa1c222cc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:25.622329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2245b711-86a8-4f39-88fb-56daa1c222cc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:25.622797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2245b711-86a8-4f39-88fb-56daa1c222cc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:25.623236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2245b711-86a8-4f39-88fb-56daa1c222cc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:25.972892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-82c0005d-87b3-4a5e-9e20-51b00cb5fa4b tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:25.988316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-82c0005d-87b3-4a5e-9e20-51b00cb5fa4b tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:25.989852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-82c0005d-87b3-4a5e-9e20-51b00cb5fa4b tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:25.991427 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-82c0005d-87b3-4a5e-9e20-51b00cb5fa4b tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] 10.222.0.62 "GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b" status: 200 len: 1366 microversion: 2.47 time: 0.787532 Aug 29 15:43:26.002058 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2070/4241] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:25 2022] GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b => generated 1366 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:26.020351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5cad8fe7-608f-44df-a1df-90502f716e83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:26.022733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5cad8fe7-608f-44df-a1df-90502f716e83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:26.038856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cad8fe7-608f-44df-a1df-90502f716e83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.039416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cad8fe7-608f-44df-a1df-90502f716e83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.040173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cad8fe7-608f-44df-a1df-90502f716e83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.040906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cad8fe7-608f-44df-a1df-90502f716e83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.041381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cad8fe7-608f-44df-a1df-90502f716e83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.041975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5cad8fe7-608f-44df-a1df-90502f716e83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.329300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2245b711-86a8-4f39-88fb-56daa1c222cc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:26.345029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2245b711-86a8-4f39-88fb-56daa1c222cc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:26.355104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2245b711-86a8-4f39-88fb-56daa1c222cc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:26.356561 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2245b711-86a8-4f39-88fb-56daa1c222cc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1798 microversion: 2.32 time: 0.782550 Aug 29 15:43:26.369934 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2172/4242] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:25 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1798 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:26.383378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c32a9ebb-6907-4471-8c4e-9b56f0cda2aa tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:26.384297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c32a9ebb-6907-4471-8c4e-9b56f0cda2aa tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:26.393625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c32a9ebb-6907-4471-8c4e-9b56f0cda2aa tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.394456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c32a9ebb-6907-4471-8c4e-9b56f0cda2aa tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.395130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c32a9ebb-6907-4471-8c4e-9b56f0cda2aa tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.396201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c32a9ebb-6907-4471-8c4e-9b56f0cda2aa tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.396933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c32a9ebb-6907-4471-8c4e-9b56f0cda2aa tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.398572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c32a9ebb-6907-4471-8c4e-9b56f0cda2aa tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.603195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5cad8fe7-608f-44df-a1df-90502f716e83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:26.624981 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5cad8fe7-608f-44df-a1df-90502f716e83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.620260 Aug 29 15:43:26.626594 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2071/4243] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:26 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:26.636364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-93d23b27-1f8a-4b52-ae8b-795978839167 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:26.637941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-93d23b27-1f8a-4b52-ae8b-795978839167 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:26.645306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93d23b27-1f8a-4b52-ae8b-795978839167 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.647090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93d23b27-1f8a-4b52-ae8b-795978839167 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.647801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93d23b27-1f8a-4b52-ae8b-795978839167 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.648733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93d23b27-1f8a-4b52-ae8b-795978839167 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.649444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93d23b27-1f8a-4b52-ae8b-795978839167 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.650097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93d23b27-1f8a-4b52-ae8b-795978839167 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:27.045879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-93d23b27-1f8a-4b52-ae8b-795978839167 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:27.062385 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-93d23b27-1f8a-4b52-ae8b-795978839167 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 0.432220 Aug 29 15:43:27.085117 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2072/4244] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:26 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:27.094866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2da5b4cc-5e3d-474f-bede-750178a659bf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:27.098571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2da5b4cc-5e3d-474f-bede-750178a659bf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:27.132550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2da5b4cc-5e3d-474f-bede-750178a659bf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:27.135767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2da5b4cc-5e3d-474f-bede-750178a659bf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:27.137305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2da5b4cc-5e3d-474f-bede-750178a659bf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:27.140367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2da5b4cc-5e3d-474f-bede-750178a659bf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:27.140993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2da5b4cc-5e3d-474f-bede-750178a659bf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:27.143458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2da5b4cc-5e3d-474f-bede-750178a659bf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:27.182623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c32a9ebb-6907-4471-8c4e-9b56f0cda2aa tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:27.193146 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c32a9ebb-6907-4471-8c4e-9b56f0cda2aa tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1360 microversion: 2.1 time: 0.821457 Aug 29 15:43:27.193888 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2173/4245] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:26 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1360 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:27.206938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cca43323-959a-4956-97c4-b82f4a71c6dd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:27.206938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cca43323-959a-4956-97c4-b82f4a71c6dd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] [instance: 018fb19f-a453-4ad9-addd-7e4286160c6b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:27.210595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cca43323-959a-4956-97c4-b82f4a71c6dd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:27.211388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cca43323-959a-4956-97c4-b82f4a71c6dd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:27.212074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cca43323-959a-4956-97c4-b82f4a71c6dd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:27.212914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cca43323-959a-4956-97c4-b82f4a71c6dd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:27.213528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cca43323-959a-4956-97c4-b82f4a71c6dd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:27.214066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cca43323-959a-4956-97c4-b82f4a71c6dd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:27.347678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cca43323-959a-4956-97c4-b82f4a71c6dd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:27.357921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cca43323-959a-4956-97c4-b82f4a71c6dd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:27.361187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cca43323-959a-4956-97c4-b82f4a71c6dd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:27.362775 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cca43323-959a-4956-97c4-b82f4a71c6dd tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] 10.222.0.62 "GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b" status: 200 len: 1366 microversion: 2.47 time: 0.167790 Aug 29 15:43:27.377599 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2174/4246] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:27 2022] GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:27.395565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5b91b902-7889-4054-a0f4-fd521d853c52 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:27.396432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5b91b902-7889-4054-a0f4-fd521d853c52 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:27.409269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b91b902-7889-4054-a0f4-fd521d853c52 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:27.409802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b91b902-7889-4054-a0f4-fd521d853c52 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:27.410250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b91b902-7889-4054-a0f4-fd521d853c52 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:27.410966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b91b902-7889-4054-a0f4-fd521d853c52 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:27.411429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b91b902-7889-4054-a0f4-fd521d853c52 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:27.411911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b91b902-7889-4054-a0f4-fd521d853c52 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:27.519513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2da5b4cc-5e3d-474f-bede-750178a659bf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:27.533719 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2da5b4cc-5e3d-474f-bede-750178a659bf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.457911 Aug 29 15:43:27.536105 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2073/4247] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:27 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:27.753324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5b91b902-7889-4054-a0f4-fd521d853c52 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:27.758127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:27.764918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1773407272", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "d1ac0823-5377-4aa5-8e1a-80f39f87d37f"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:27.776355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5b91b902-7889-4054-a0f4-fd521d853c52 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:27.777361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5b91b902-7889-4054-a0f4-fd521d853c52 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:27.778863 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5b91b902-7889-4054-a0f4-fd521d853c52 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1844 microversion: 2.32 time: 0.394852 Aug 29 15:43:27.793777 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2175/4248] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:27 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1844 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:27.857678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] validate_networks() for [('d1ac0823-5377-4aa5-8e1a-80f39f87d37f', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:43:28.105499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-38271276-2884-4433-bd2c-b0611ebc711e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:28.106394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-38271276-2884-4433-bd2c-b0611ebc711e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:28.118173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38271276-2884-4433-bd2c-b0611ebc711e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.120466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38271276-2884-4433-bd2c-b0611ebc711e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.122536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38271276-2884-4433-bd2c-b0611ebc711e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.124923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38271276-2884-4433-bd2c-b0611ebc711e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.126390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38271276-2884-4433-bd2c-b0611ebc711e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.128708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38271276-2884-4433-bd2c-b0611ebc711e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.334470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-38271276-2884-4433-bd2c-b0611ebc711e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:28.356530 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-38271276-2884-4433-bd2c-b0611ebc711e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1498 microversion: 2.1 time: 0.262140 Aug 29 15:43:28.357181 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2176/4249] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:28 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1498 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:28.385368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5723b8c0-8186-4a07-a95e-8caba0fcb779 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:28.392266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5723b8c0-8186-4a07-a95e-8caba0fcb779 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:28.414555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5723b8c0-8186-4a07-a95e-8caba0fcb779 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.417385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5723b8c0-8186-4a07-a95e-8caba0fcb779 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.419872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5723b8c0-8186-4a07-a95e-8caba0fcb779 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.423048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5723b8c0-8186-4a07-a95e-8caba0fcb779 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.425781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5723b8c0-8186-4a07-a95e-8caba0fcb779 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.428375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5723b8c0-8186-4a07-a95e-8caba0fcb779 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.805371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5723b8c0-8186-4a07-a95e-8caba0fcb779 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:28.809367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:43:28.810450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:43:28.812363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:43:28.812949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:43:28.815207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:43:28.850815 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5723b8c0-8186-4a07-a95e-8caba0fcb779 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1360 microversion: 2.1 time: 0.482378 Aug 29 15:43:28.851648 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2177/4250] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:28 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1360 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:28.857452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.861280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-047f21fc-89e5-4c22-9c5a-f706a92a1101 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:28.861936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.862567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.863470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.864140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.864725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.865673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-047f21fc-89e5-4c22-9c5a-f706a92a1101 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] [instance: 018fb19f-a453-4ad9-addd-7e4286160c6b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:28.890507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-047f21fc-89e5-4c22-9c5a-f706a92a1101 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.891441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-047f21fc-89e5-4c22-9c5a-f706a92a1101 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.892038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-047f21fc-89e5-4c22-9c5a-f706a92a1101 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.892933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-047f21fc-89e5-4c22-9c5a-f706a92a1101 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.893598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-047f21fc-89e5-4c22-9c5a-f706a92a1101 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.894347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-047f21fc-89e5-4c22-9c5a-f706a92a1101 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.908536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Getting quotas for project 990c752c7bb141c1bf496c98fbc3c9a7. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:28.915315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Getting quotas for user 51efa71a8bfe457982698a5755ae3cc6 and project 990c752c7bb141c1bf496c98fbc3c9a7. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:28.931533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:43:28.934751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:43:28.940837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-047f21fc-89e5-4c22-9c5a-f706a92a1101 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.941359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-047f21fc-89e5-4c22-9c5a-f706a92a1101 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.941797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-047f21fc-89e5-4c22-9c5a-f706a92a1101 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.942507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-047f21fc-89e5-4c22-9c5a-f706a92a1101 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lazy-loading 'fault' on Instance uuid 018fb19f-a453-4ad9-addd-7e4286160c6b {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:43:28.997615 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4e048e73-8401-4ae7-8c08-11d935623c48 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.237870 Aug 29 15:43:28.999098 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2074/4251] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:43:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:43:29.004268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-36578a93-6044-4f06-87a3-6375f1cb6364 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:29.005871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-36578a93-6044-4f06-87a3-6375f1cb6364 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:29.011544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-047f21fc-89e5-4c22-9c5a-f706a92a1101 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:29.018569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36578a93-6044-4f06-87a3-6375f1cb6364 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:29.019371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36578a93-6044-4f06-87a3-6375f1cb6364 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:29.020003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36578a93-6044-4f06-87a3-6375f1cb6364 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:29.020911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36578a93-6044-4f06-87a3-6375f1cb6364 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:29.021659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36578a93-6044-4f06-87a3-6375f1cb6364 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:29.022249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36578a93-6044-4f06-87a3-6375f1cb6364 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:29.055712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-047f21fc-89e5-4c22-9c5a-f706a92a1101 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:29.058675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-047f21fc-89e5-4c22-9c5a-f706a92a1101 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fe0ad3a38934b45baa3b0108e0d7635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af6a2702cb4440f8abe6a4339d2353b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:29.062248 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-047f21fc-89e5-4c22-9c5a-f706a92a1101 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] 10.222.0.62 "GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b" status: 200 len: 1371 microversion: 2.47 time: 0.209799 Aug 29 15:43:29.094905 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2178/4252] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:28 2022] GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:29.104421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7417e6d4-e52a-4f5f-be86-05150f10a2a4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:29.112668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7417e6d4-e52a-4f5f-be86-05150f10a2a4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:29.184373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7417e6d4-e52a-4f5f-be86-05150f10a2a4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:29.192765 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7417e6d4-e52a-4f5f-be86-05150f10a2a4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1215 microversion: 2.1 time: 0.096736 Aug 29 15:43:29.203850 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2179/4253] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:29 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:29.382230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b3a6ba6f-7637-4e1b-9015-283c3fb99fcc tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:29.384444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b3a6ba6f-7637-4e1b-9015-283c3fb99fcc tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:29.402691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3a6ba6f-7637-4e1b-9015-283c3fb99fcc tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:29.405143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3a6ba6f-7637-4e1b-9015-283c3fb99fcc tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:29.405964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3a6ba6f-7637-4e1b-9015-283c3fb99fcc tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:29.407027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3a6ba6f-7637-4e1b-9015-283c3fb99fcc tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:29.408550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3a6ba6f-7637-4e1b-9015-283c3fb99fcc tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:29.412981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3a6ba6f-7637-4e1b-9015-283c3fb99fcc tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:29.612158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b3a6ba6f-7637-4e1b-9015-283c3fb99fcc tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:29.630374 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b3a6ba6f-7637-4e1b-9015-283c3fb99fcc tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 200 len: 1475 microversion: 2.1 time: 0.250731 Aug 29 15:43:29.651910 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2180/4254] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:29 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 1475 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:29.666168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b6ecac48-74a7-4f4d-bf21-130315ddc705 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1886856541"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:29.671740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b6ecac48-74a7-4f4d-bf21-130315ddc705 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:29.689337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6ecac48-74a7-4f4d-bf21-130315ddc705 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:29.690202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6ecac48-74a7-4f4d-bf21-130315ddc705 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:29.692168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6ecac48-74a7-4f4d-bf21-130315ddc705 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:29.694674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6ecac48-74a7-4f4d-bf21-130315ddc705 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:29.696943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6ecac48-74a7-4f4d-bf21-130315ddc705 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:29.697645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6ecac48-74a7-4f4d-bf21-130315ddc705 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:29.887017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36578a93-6044-4f06-87a3-6375f1cb6364 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:29.906199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36578a93-6044-4f06-87a3-6375f1cb6364 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:29.911462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36578a93-6044-4f06-87a3-6375f1cb6364 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:29.915203 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-36578a93-6044-4f06-87a3-6375f1cb6364 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1844 microversion: 2.32 time: 0.912785 Aug 29 15:43:29.917789 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2075/4255] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:28 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1844 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:29.926123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-43f6a2a1-f48b-44e0-aa20-200529d8b7ff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:29.927757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-43f6a2a1-f48b-44e0-aa20-200529d8b7ff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:29.947188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43f6a2a1-f48b-44e0-aa20-200529d8b7ff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:29.949260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43f6a2a1-f48b-44e0-aa20-200529d8b7ff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:29.950292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43f6a2a1-f48b-44e0-aa20-200529d8b7ff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:29.951804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43f6a2a1-f48b-44e0-aa20-200529d8b7ff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:29.966527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43f6a2a1-f48b-44e0-aa20-200529d8b7ff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:29.967027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43f6a2a1-f48b-44e0-aa20-200529d8b7ff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:30.269840 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b6ecac48-74a7-4f4d-bf21-130315ddc705 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "POST /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5/action" status: 202 len: 0 microversion: 2.1 time: 0.615718 Aug 29 15:43:30.279407 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2181/4256] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:43:29 2022] POST /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5/action => generated 0 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:43:30.286162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c76333b-f5b2-45b2-860a-218557019f03 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:30.297411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5c76333b-f5b2-45b2-860a-218557019f03 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] [instance: 018fb19f-a453-4ad9-addd-7e4286160c6b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:30.337385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c76333b-f5b2-45b2-860a-218557019f03 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:30.344703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c76333b-f5b2-45b2-860a-218557019f03 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:30.345478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c76333b-f5b2-45b2-860a-218557019f03 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:30.346380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c76333b-f5b2-45b2-860a-218557019f03 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:30.346988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c76333b-f5b2-45b2-860a-218557019f03 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:30.347585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c76333b-f5b2-45b2-860a-218557019f03 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:30.378597 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-5c76333b-f5b2-45b2-860a-218557019f03 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] HTTP exception thrown: Instance 018fb19f-a453-4ad9-addd-7e4286160c6b could not be found. Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c76333b-f5b2-45b2-860a-218557019f03 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Request method failure captured: Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b HTTP/1.1 Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN6PlXSfnRMd_J-KQTO8TIxGg2vcDlmza0bpxzeljafXlYf6gw38cwkt1pIruSYmfF9cyrs7repd-1065690v1Smd7jnIj9bo_NG5A5_n8FTgB1POVddPeMskRo7QvpBd99SuRHCKJM4LHbb2fIui_DibFqad6hOhMhcFLrmULO-Ub0 Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-Openstack-Nova-Api-Version: 2.47 Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 9af6a2702cb4440f8abe6a4339d2353b Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersAaction247Test-649952553 Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9af6a2702cb4440f8abe6a4339d2353b", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9af6a2702cb4440f8abe6a4339d2353b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9af6a2702cb4440f8abe6a4339d2353b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9af6a2702cb4440f8abe6a4339d2353b"}]}] Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersAaction247Test-649952553 Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 9af6a2702cb4440f8abe6a4339d2353b Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersAaction247Test-649952553 Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersAaction247Test-649952553-project Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 3fe0ad3a38934b45baa3b0108e0d7635 Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersAaction247Test-649952553-project Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 018fb19f-a453-4ad9-addd-7e4286160c6b could not be found. Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '018fb19f-a453-4ad9-addd-7e4286160c6b'} Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 018fb19f-a453-4ad9-addd-7e4286160c6b could not be found. Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 018fb19f-a453-4ad9-addd-7e4286160c6b could not be found. Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:30.387400 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:43:30.393692 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:30.393692 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:30.393692 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:30.393692 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:43:30.393692 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:43:30.393692 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 018fb19f-a453-4ad9-addd-7e4286160c6b could not be found. Aug 29 15:43:30.393692 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:43:30.396716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c76333b-f5b2-45b2-860a-218557019f03 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] Returning 404 to user: Instance 018fb19f-a453-4ad9-addd-7e4286160c6b could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:43:30.398234 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5c76333b-f5b2-45b2-860a-218557019f03 tempest-ServersAaction247Test-649952553 tempest-ServersAaction247Test-649952553-project] 10.222.0.62 "GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b" status: 404 len: 111 microversion: 2.47 time: 0.117404 Aug 29 15:43:30.408727 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2182/4257] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:30 2022] GET /compute/v2.1/servers/018fb19f-a453-4ad9-addd-7e4286160c6b => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:43:30.415238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b7ed53b-8eec-4901-8c06-42d5c0612744 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:30.427004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8b7ed53b-8eec-4901-8c06-42d5c0612744 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:30.440408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b7ed53b-8eec-4901-8c06-42d5c0612744 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:30.441208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b7ed53b-8eec-4901-8c06-42d5c0612744 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:30.441840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b7ed53b-8eec-4901-8c06-42d5c0612744 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:30.442849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b7ed53b-8eec-4901-8c06-42d5c0612744 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:30.444413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b7ed53b-8eec-4901-8c06-42d5c0612744 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:30.445132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b7ed53b-8eec-4901-8c06-42d5c0612744 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:30.624371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8b7ed53b-8eec-4901-8c06-42d5c0612744 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:30.640301 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8b7ed53b-8eec-4901-8c06-42d5c0612744 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1219 microversion: 2.1 time: 0.229821 Aug 29 15:43:30.643483 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2183/4258] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:30 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1219 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:30.656796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-085381a2-db69-439a-b4e9-6fb1fe59ff88 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a70ddc0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:30.810077 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-085381a2-db69-439a-b4e9-6fb1fe59ff88 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.164593 Aug 29 15:43:30.810825 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2184/4259] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:30 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:30.946376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e2337ff8-40db-447e-a7e0-7787a835f38d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:30.947556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e2337ff8-40db-447e-a7e0-7787a835f38d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:30.961984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2337ff8-40db-447e-a7e0-7787a835f38d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:30.963267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2337ff8-40db-447e-a7e0-7787a835f38d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:30.963957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2337ff8-40db-447e-a7e0-7787a835f38d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:30.965914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2337ff8-40db-447e-a7e0-7787a835f38d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:30.967883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2337ff8-40db-447e-a7e0-7787a835f38d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:30.968754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2337ff8-40db-447e-a7e0-7787a835f38d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:31.159162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-43f6a2a1-f48b-44e0-aa20-200529d8b7ff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:31.184735 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-43f6a2a1-f48b-44e0-aa20-200529d8b7ff tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1360 microversion: 2.1 time: 1.263757 Aug 29 15:43:31.201323 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2076/4260] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:29 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1360 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:31.669466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a34edbe2-0d9c-4a12-9df8-10dda6807e58 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:31.670161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a34edbe2-0d9c-4a12-9df8-10dda6807e58 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:31.691530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34edbe2-0d9c-4a12-9df8-10dda6807e58 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:31.713303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34edbe2-0d9c-4a12-9df8-10dda6807e58 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:31.714244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34edbe2-0d9c-4a12-9df8-10dda6807e58 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:31.715159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34edbe2-0d9c-4a12-9df8-10dda6807e58 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:31.715799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34edbe2-0d9c-4a12-9df8-10dda6807e58 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:31.716428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34edbe2-0d9c-4a12-9df8-10dda6807e58 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:32.253678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a34edbe2-0d9c-4a12-9df8-10dda6807e58 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:32.267303 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a34edbe2-0d9c-4a12-9df8-10dda6807e58 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1267 microversion: 2.1 time: 0.606750 Aug 29 15:43:32.267904 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2077/4261] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:31 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1267 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:32.292092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-370222d8-c96e-47e5-9070-1d2de509f592 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc433a82940>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:32.405529 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-370222d8-c96e-47e5-9070-1d2de509f592 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.131426 Aug 29 15:43:32.413539 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2078/4262] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:32 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:32.432960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-290bffd4-52e0-4331-a366-2dc492201629 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:32.436773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-290bffd4-52e0-4331-a366-2dc492201629 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:32.465206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-290bffd4-52e0-4331-a366-2dc492201629 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:32.466003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-290bffd4-52e0-4331-a366-2dc492201629 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:32.467815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-290bffd4-52e0-4331-a366-2dc492201629 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:32.472040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-290bffd4-52e0-4331-a366-2dc492201629 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:32.476210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-290bffd4-52e0-4331-a366-2dc492201629 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:32.478009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-290bffd4-52e0-4331-a366-2dc492201629 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:32.611472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e2337ff8-40db-447e-a7e0-7787a835f38d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:32.630068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e2337ff8-40db-447e-a7e0-7787a835f38d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:32.631548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e2337ff8-40db-447e-a7e0-7787a835f38d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:32.643950 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e2337ff8-40db-447e-a7e0-7787a835f38d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1844 microversion: 2.32 time: 1.693494 Aug 29 15:43:32.644641 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2185/4263] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:30 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1844 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:33.289315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-75a615aa-5dac-4c02-a434-da3e1fb05b15 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:33.289548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-75a615aa-5dac-4c02-a434-da3e1fb05b15 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:33.309106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75a615aa-5dac-4c02-a434-da3e1fb05b15 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:33.332476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75a615aa-5dac-4c02-a434-da3e1fb05b15 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:33.332926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75a615aa-5dac-4c02-a434-da3e1fb05b15 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:33.333844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75a615aa-5dac-4c02-a434-da3e1fb05b15 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:33.334319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75a615aa-5dac-4c02-a434-da3e1fb05b15 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:33.334743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75a615aa-5dac-4c02-a434-da3e1fb05b15 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:33.639898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-75a615aa-5dac-4c02-a434-da3e1fb05b15 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:33.657762 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-75a615aa-5dac-4c02-a434-da3e1fb05b15 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1273 microversion: 2.1 time: 0.366613 Aug 29 15:43:33.658658 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2186/4264] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:33 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1273 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:33.680928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4b96b6da-d21e-44e3-8db2-395d8cd5d12e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a70dca0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:33.742956 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4b96b6da-d21e-44e3-8db2-395d8cd5d12e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.071147 Aug 29 15:43:33.751358 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2187/4265] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:33 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:33.758997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b9b83e68-79b7-45a5-86ee-60a4e2d311a9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:33.759921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b9b83e68-79b7-45a5-86ee-60a4e2d311a9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:33.767788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9b83e68-79b7-45a5-86ee-60a4e2d311a9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:33.768568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9b83e68-79b7-45a5-86ee-60a4e2d311a9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:33.769302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9b83e68-79b7-45a5-86ee-60a4e2d311a9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:33.770241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9b83e68-79b7-45a5-86ee-60a4e2d311a9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:33.770957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9b83e68-79b7-45a5-86ee-60a4e2d311a9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:33.771884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9b83e68-79b7-45a5-86ee-60a4e2d311a9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:34.198201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b9b83e68-79b7-45a5-86ee-60a4e2d311a9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:34.232053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b9b83e68-79b7-45a5-86ee-60a4e2d311a9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:34.238278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b9b83e68-79b7-45a5-86ee-60a4e2d311a9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:34.242405 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b9b83e68-79b7-45a5-86ee-60a4e2d311a9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1844 microversion: 2.32 time: 0.488719 Aug 29 15:43:34.243566 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2188/4266] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:33 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1844 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:34.688936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d78d3210-a818-488c-830f-cb0162ad7e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:34.689712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d78d3210-a818-488c-830f-cb0162ad7e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:34.716454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d78d3210-a818-488c-830f-cb0162ad7e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:34.720864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d78d3210-a818-488c-830f-cb0162ad7e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:34.721492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d78d3210-a818-488c-830f-cb0162ad7e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:34.722267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d78d3210-a818-488c-830f-cb0162ad7e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:34.722751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d78d3210-a818-488c-830f-cb0162ad7e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:34.745435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d78d3210-a818-488c-830f-cb0162ad7e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:34.994416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d78d3210-a818-488c-830f-cb0162ad7e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:35.011614 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d78d3210-a818-488c-830f-cb0162ad7e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1273 microversion: 2.1 time: 0.325803 Aug 29 15:43:35.012256 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2189/4267] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:34 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1273 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:35.039230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6a136dd1-5f25-4327-819b-532bd56bb458 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a84fc10>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:35.174768 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6a136dd1-5f25-4327-819b-532bd56bb458 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.157017 Aug 29 15:43:35.175848 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2190/4268] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:35 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:35.196674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-513cbef1-2d46-470c-b24c-7674fed71168 req-0b364d69-f40a-4d3e-af6c-3c1ac96b64a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "tag": "a1dbac3e-d33f-459b-8975-e740294ef068"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:35.234480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-513cbef1-2d46-470c-b24c-7674fed71168 req-0b364d69-f40a-4d3e-af6c-3c1ac96b64a4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:35.237694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-513cbef1-2d46-470c-b24c-7674fed71168 req-0b364d69-f40a-4d3e-af6c-3c1ac96b64a4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:35.240176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-513cbef1-2d46-470c-b24c-7674fed71168 req-0b364d69-f40a-4d3e-af6c-3c1ac96b64a4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:35.294896 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-513cbef1-2d46-470c-b24c-7674fed71168 req-0b364d69-f40a-4d3e-af6c-3c1ac96b64a4 service nova] Creating event network-changed:a1dbac3e-d33f-459b-8975-e740294ef068 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:43:35.310649 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-513cbef1-2d46-470c-b24c-7674fed71168 req-0b364d69-f40a-4d3e-af6c-3c1ac96b64a4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130802 Aug 29 15:43:35.312998 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2191/4269] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:35.345445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6eea8b94-80f4-4d2d-b8fa-2138359f0e3c tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:35.346166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6eea8b94-80f4-4d2d-b8fa-2138359f0e3c tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:35.401191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eea8b94-80f4-4d2d-b8fa-2138359f0e3c tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:35.401771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eea8b94-80f4-4d2d-b8fa-2138359f0e3c tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:35.406828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eea8b94-80f4-4d2d-b8fa-2138359f0e3c tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:35.413299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eea8b94-80f4-4d2d-b8fa-2138359f0e3c tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:35.413936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eea8b94-80f4-4d2d-b8fa-2138359f0e3c tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:35.414408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eea8b94-80f4-4d2d-b8fa-2138359f0e3c tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:35.834283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-290bffd4-52e0-4331-a366-2dc492201629 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:35.865480 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-290bffd4-52e0-4331-a366-2dc492201629 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1360 microversion: 2.1 time: 3.445657 Aug 29 15:43:35.878293 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2079/4270] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:32 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1360 bytes in 3454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:36.039112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-20f08557-56ab-4851-abfd-7a217a2c0d38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:36.039986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-20f08557-56ab-4851-abfd-7a217a2c0d38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:36.057141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6eea8b94-80f4-4d2d-b8fa-2138359f0e3c tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:36.059682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20f08557-56ab-4851-abfd-7a217a2c0d38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:36.062434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20f08557-56ab-4851-abfd-7a217a2c0d38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:36.067247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20f08557-56ab-4851-abfd-7a217a2c0d38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:36.075175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6eea8b94-80f4-4d2d-b8fa-2138359f0e3c tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:36.075686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20f08557-56ab-4851-abfd-7a217a2c0d38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:36.076431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20f08557-56ab-4851-abfd-7a217a2c0d38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:36.077543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20f08557-56ab-4851-abfd-7a217a2c0d38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:36.081303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6eea8b94-80f4-4d2d-b8fa-2138359f0e3c tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:36.086875 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6eea8b94-80f4-4d2d-b8fa-2138359f0e3c tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1844 microversion: 2.32 time: 0.768257 Aug 29 15:43:36.089631 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2192/4271] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:35 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1844 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:36.137897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c4aca3b8-e797-4d03-9a91-b3520f7adf2f req-b868e13c-0b78-42a3-8518-652378c64053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89dfeae0-3079-4a17-bc65-7ad03318e731", "name": "network-vif-plugged", "status": "completed", "tag": "bd7ed4b6-e125-48ac-8d8c-adae31bfdf56"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:36.170309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c4aca3b8-e797-4d03-9a91-b3520f7adf2f req-b868e13c-0b78-42a3-8518-652378c64053 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:36.171481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c4aca3b8-e797-4d03-9a91-b3520f7adf2f req-b868e13c-0b78-42a3-8518-652378c64053 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:36.171929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c4aca3b8-e797-4d03-9a91-b3520f7adf2f req-b868e13c-0b78-42a3-8518-652378c64053 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:36.245526 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c4aca3b8-e797-4d03-9a91-b3520f7adf2f req-b868e13c-0b78-42a3-8518-652378c64053 service nova] Creating event network-vif-plugged:bd7ed4b6-e125-48ac-8d8c-adae31bfdf56 for instance 89dfeae0-3079-4a17-bc65-7ad03318e731 on n-h2-839401-11 Aug 29 15:43:36.265107 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c4aca3b8-e797-4d03-9a91-b3520f7adf2f req-b868e13c-0b78-42a3-8518-652378c64053 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132642 Aug 29 15:43:36.272519 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2193/4272] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:36.287715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-18d85587-a292-439d-bed2-d439c0afc08a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a890670>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:36.418906 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-18d85587-a292-439d-bed2-d439c0afc08a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.144927 Aug 29 15:43:36.419741 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2194/4273] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:36 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:36.847142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-20f08557-56ab-4851-abfd-7a217a2c0d38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:36.861952 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-20f08557-56ab-4851-abfd-7a217a2c0d38 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1273 microversion: 2.1 time: 0.826035 Aug 29 15:43:36.866041 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2080/4274] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:36 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1273 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:36.904874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6e144561-581a-4c1d-a594-617ceac1271d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:36.906047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6e144561-581a-4c1d-a594-617ceac1271d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:36.919097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e144561-581a-4c1d-a594-617ceac1271d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:36.922861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e144561-581a-4c1d-a594-617ceac1271d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:36.923477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e144561-581a-4c1d-a594-617ceac1271d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:36.924598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e144561-581a-4c1d-a594-617ceac1271d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:36.925238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e144561-581a-4c1d-a594-617ceac1271d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:36.927989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e144561-581a-4c1d-a594-617ceac1271d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:37.121911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-69a9ad39-854c-469f-acb2-1029a007546f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:37.122673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-69a9ad39-854c-469f-acb2-1029a007546f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:37.137055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69a9ad39-854c-469f-acb2-1029a007546f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:37.137596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69a9ad39-854c-469f-acb2-1029a007546f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:37.144427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69a9ad39-854c-469f-acb2-1029a007546f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:37.145493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69a9ad39-854c-469f-acb2-1029a007546f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:37.151276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69a9ad39-854c-469f-acb2-1029a007546f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:37.154963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69a9ad39-854c-469f-acb2-1029a007546f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:37.631671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6e144561-581a-4c1d-a594-617ceac1271d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:37.682106 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6e144561-581a-4c1d-a594-617ceac1271d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1360 microversion: 2.1 time: 0.786837 Aug 29 15:43:37.683836 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2195/4275] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:36 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1360 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:37.704434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-09ab7c36-8f1e-4522-a73d-58badf226660 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a8904c0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:37.983234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-69a9ad39-854c-469f-acb2-1029a007546f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:38.009270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-69a9ad39-854c-469f-acb2-1029a007546f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:38.011349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-69a9ad39-854c-469f-acb2-1029a007546f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:38.015356 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-69a9ad39-854c-469f-acb2-1029a007546f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1865 microversion: 2.32 time: 0.899291 Aug 29 15:43:38.027244 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2081/4276] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:37 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1865 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:43:38.036275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4db98953-ac3d-4e2c-9eee-b43338c772e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:38.037060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4db98953-ac3d-4e2c-9eee-b43338c772e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:38.058814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4db98953-ac3d-4e2c-9eee-b43338c772e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:38.063856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4db98953-ac3d-4e2c-9eee-b43338c772e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:38.064327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4db98953-ac3d-4e2c-9eee-b43338c772e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:38.065329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4db98953-ac3d-4e2c-9eee-b43338c772e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:38.066928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4db98953-ac3d-4e2c-9eee-b43338c772e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:38.073001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4db98953-ac3d-4e2c-9eee-b43338c772e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:38.404884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4db98953-ac3d-4e2c-9eee-b43338c772e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:38.415197 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4db98953-ac3d-4e2c-9eee-b43338c772e1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1273 microversion: 2.1 time: 0.386637 Aug 29 15:43:38.415816 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2082/4277] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:38 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1273 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:38.429954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-aeef2aa4-6955-4628-b3da-a5a13bc3cc84 req-f2dd8aee-0728-4a5f-9a02-38e51a6e7a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "tag": "81163d25-b7c2-48cd-a63a-7bc7148abfaf"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:38.472479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-aeef2aa4-6955-4628-b3da-a5a13bc3cc84 req-f2dd8aee-0728-4a5f-9a02-38e51a6e7a4d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:38.472983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-aeef2aa4-6955-4628-b3da-a5a13bc3cc84 req-f2dd8aee-0728-4a5f-9a02-38e51a6e7a4d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:38.473462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-aeef2aa4-6955-4628-b3da-a5a13bc3cc84 req-f2dd8aee-0728-4a5f-9a02-38e51a6e7a4d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:38.502849 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-aeef2aa4-6955-4628-b3da-a5a13bc3cc84 req-f2dd8aee-0728-4a5f-9a02-38e51a6e7a4d service nova] Creating event network-changed:81163d25-b7c2-48cd-a63a-7bc7148abfaf for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:43:38.529163 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-aeef2aa4-6955-4628-b3da-a5a13bc3cc84 req-f2dd8aee-0728-4a5f-9a02-38e51a6e7a4d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096928 Aug 29 15:43:38.530729 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2083/4278] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:43:38.704743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7518c238-ab89-420f-aa9d-9b3be384f87d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:38.705984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7518c238-ab89-420f-aa9d-9b3be384f87d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:38.727486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7518c238-ab89-420f-aa9d-9b3be384f87d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:38.737971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7518c238-ab89-420f-aa9d-9b3be384f87d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:38.738687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7518c238-ab89-420f-aa9d-9b3be384f87d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:38.739877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7518c238-ab89-420f-aa9d-9b3be384f87d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:38.740503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7518c238-ab89-420f-aa9d-9b3be384f87d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:38.741131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7518c238-ab89-420f-aa9d-9b3be384f87d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:38.885857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:38.925820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:39.194761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:40.772173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7518c238-ab89-420f-aa9d-9b3be384f87d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:40.785497 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7518c238-ab89-420f-aa9d-9b3be384f87d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1360 microversion: 2.1 time: 2.083720 Aug 29 15:43:40.788602 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2084/4279] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:38 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1360 bytes in 2089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:40.805721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-84c1e0d2-9c82-4f7b-bb79-db31aab88a84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:40.807605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-84c1e0d2-9c82-4f7b-bb79-db31aab88a84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:40.818273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:40.822922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84c1e0d2-9c82-4f7b-bb79-db31aab88a84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:40.826029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84c1e0d2-9c82-4f7b-bb79-db31aab88a84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:40.840263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84c1e0d2-9c82-4f7b-bb79-db31aab88a84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:40.852266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84c1e0d2-9c82-4f7b-bb79-db31aab88a84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:40.858162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84c1e0d2-9c82-4f7b-bb79-db31aab88a84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:40.858904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84c1e0d2-9c82-4f7b-bb79-db31aab88a84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:42.527653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-84c1e0d2-9c82-4f7b-bb79-db31aab88a84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:42.547836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:42.558326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-84c1e0d2-9c82-4f7b-bb79-db31aab88a84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:42.571118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-84c1e0d2-9c82-4f7b-bb79-db31aab88a84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:42.572442 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-84c1e0d2-9c82-4f7b-bb79-db31aab88a84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1886 microversion: 2.32 time: 1.782713 Aug 29 15:43:42.576858 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2085/4280] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:40 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1886 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:42.587119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ffc18d51-037e-4a29-b27f-78770dc680fd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:42.595596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ffc18d51-037e-4a29-b27f-78770dc680fd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:42.616889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffc18d51-037e-4a29-b27f-78770dc680fd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:42.617457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffc18d51-037e-4a29-b27f-78770dc680fd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:42.617907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffc18d51-037e-4a29-b27f-78770dc680fd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:42.619002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffc18d51-037e-4a29-b27f-78770dc680fd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:42.631063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffc18d51-037e-4a29-b27f-78770dc680fd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:42.631852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffc18d51-037e-4a29-b27f-78770dc680fd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:43.367345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ffc18d51-037e-4a29-b27f-78770dc680fd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:43.379249 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ffc18d51-037e-4a29-b27f-78770dc680fd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1315 microversion: 2.1 time: 0.800658 Aug 29 15:43:43.383111 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2086/4281] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:42 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1315 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:43.403113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-832017d7-9146-473a-8d3d-db9595fc96b5 req-ae214012-bb3b-4c42-9048-f5c4465963b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81c2d898-9252-4ea9-9186-93605b7b9aa5", "name": "network-vif-plugged", "status": "completed", "tag": "379cf683-7620-4fec-98ad-247aa9e87ba6"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:43.422969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-832017d7-9146-473a-8d3d-db9595fc96b5 req-ae214012-bb3b-4c42-9048-f5c4465963b3 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:43.425802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-832017d7-9146-473a-8d3d-db9595fc96b5 req-ae214012-bb3b-4c42-9048-f5c4465963b3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:43.428865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-832017d7-9146-473a-8d3d-db9595fc96b5 req-ae214012-bb3b-4c42-9048-f5c4465963b3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:43.460839 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-832017d7-9146-473a-8d3d-db9595fc96b5 req-ae214012-bb3b-4c42-9048-f5c4465963b3 service nova] Creating event network-vif-plugged:379cf683-7620-4fec-98ad-247aa9e87ba6 for instance 81c2d898-9252-4ea9-9186-93605b7b9aa5 on n-h1-839401-11 Aug 29 15:43:43.476110 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-832017d7-9146-473a-8d3d-db9595fc96b5 req-ae214012-bb3b-4c42-9048-f5c4465963b3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090927 Aug 29 15:43:43.477339 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2087/4282] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:43.490799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-760337d8-cc83-45ee-ad4f-35b2cf172082 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:43.491669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-760337d8-cc83-45ee-ad4f-35b2cf172082 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:43.501203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-760337d8-cc83-45ee-ad4f-35b2cf172082 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:43.504707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-760337d8-cc83-45ee-ad4f-35b2cf172082 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:43.505543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-760337d8-cc83-45ee-ad4f-35b2cf172082 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:43.509923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-760337d8-cc83-45ee-ad4f-35b2cf172082 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:43.510738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-760337d8-cc83-45ee-ad4f-35b2cf172082 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:43.511418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-760337d8-cc83-45ee-ad4f-35b2cf172082 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:45.485394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-760337d8-cc83-45ee-ad4f-35b2cf172082 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:45.500280 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-760337d8-cc83-45ee-ad4f-35b2cf172082 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1546 microversion: 2.1 time: 2.021381 Aug 29 15:43:45.502428 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2088/4283] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:43 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1546 bytes in 2024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:45.518913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e37d6cc3-54e3-480b-bf80-d6a5879cca84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:45.522032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e37d6cc3-54e3-480b-bf80-d6a5879cca84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:45.535140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e37d6cc3-54e3-480b-bf80-d6a5879cca84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:45.540810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e37d6cc3-54e3-480b-bf80-d6a5879cca84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:45.541718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e37d6cc3-54e3-480b-bf80-d6a5879cca84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:45.542698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e37d6cc3-54e3-480b-bf80-d6a5879cca84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:45.545746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e37d6cc3-54e3-480b-bf80-d6a5879cca84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:45.546412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e37d6cc3-54e3-480b-bf80-d6a5879cca84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:46.343869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e37d6cc3-54e3-480b-bf80-d6a5879cca84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:46.359352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e37d6cc3-54e3-480b-bf80-d6a5879cca84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:46.362673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e37d6cc3-54e3-480b-bf80-d6a5879cca84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:46.365344 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e37d6cc3-54e3-480b-bf80-d6a5879cca84 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.857902 Aug 29 15:43:46.368438 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2089/4284] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:45 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:46.378613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4ea9652d-3edb-4c49-8292-83bf7de5f69e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:46.383968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4ea9652d-3edb-4c49-8292-83bf7de5f69e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:46.399242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ea9652d-3edb-4c49-8292-83bf7de5f69e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:46.400313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ea9652d-3edb-4c49-8292-83bf7de5f69e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:46.400937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ea9652d-3edb-4c49-8292-83bf7de5f69e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:46.401973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ea9652d-3edb-4c49-8292-83bf7de5f69e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:46.405821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ea9652d-3edb-4c49-8292-83bf7de5f69e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:46.406487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ea9652d-3edb-4c49-8292-83bf7de5f69e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:46.918172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=45 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:47.115306 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-09ab7c36-8f1e-4522-a73d-58badf226660 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 9.415564 Aug 29 15:43:47.118196 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2196/4285] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:37 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 9419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:47.144977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-9d6cd0a4-5e8d-4cb3-a1d5-d9b1d506e50e req-ad01a666-2d94-4fe1-848a-f03ef1431ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "tag": "99530e77-db4a-45c6-9205-99f6d2ad4d43"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:47.165074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9d6cd0a4-5e8d-4cb3-a1d5-d9b1d506e50e req-ad01a666-2d94-4fe1-848a-f03ef1431ffd service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:47.165860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9d6cd0a4-5e8d-4cb3-a1d5-d9b1d506e50e req-ad01a666-2d94-4fe1-848a-f03ef1431ffd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:47.166735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9d6cd0a4-5e8d-4cb3-a1d5-d9b1d506e50e req-ad01a666-2d94-4fe1-848a-f03ef1431ffd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:47.188525 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-9d6cd0a4-5e8d-4cb3-a1d5-d9b1d506e50e req-ad01a666-2d94-4fe1-848a-f03ef1431ffd service nova] Creating event network-changed:99530e77-db4a-45c6-9205-99f6d2ad4d43 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:43:47.199442 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-9d6cd0a4-5e8d-4cb3-a1d5-d9b1d506e50e req-ad01a666-2d94-4fe1-848a-f03ef1431ffd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070504 Aug 29 15:43:47.200587 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2197/4286] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:47.206926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d5d7c4b4-26ab-47e3-b2b5-2fe48ec468b1 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:47.207741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d5d7c4b4-26ab-47e3-b2b5-2fe48ec468b1 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:47.221861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5d7c4b4-26ab-47e3-b2b5-2fe48ec468b1 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:47.222982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5d7c4b4-26ab-47e3-b2b5-2fe48ec468b1 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:47.223672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5d7c4b4-26ab-47e3-b2b5-2fe48ec468b1 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:47.225164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5d7c4b4-26ab-47e3-b2b5-2fe48ec468b1 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:47.226126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5d7c4b4-26ab-47e3-b2b5-2fe48ec468b1 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:47.226711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5d7c4b4-26ab-47e3-b2b5-2fe48ec468b1 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:47.332340 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d5d7c4b4-26ab-47e3-b2b5-2fe48ec468b1 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130017 Aug 29 15:43:47.339660 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2198/4287] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:43:47 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:47.397246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-92953cdf-f5f5-40ec-825d-e4df278350d5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:47.397819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-92953cdf-f5f5-40ec-825d-e4df278350d5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:47.409231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92953cdf-f5f5-40ec-825d-e4df278350d5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:47.409727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92953cdf-f5f5-40ec-825d-e4df278350d5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:47.413772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92953cdf-f5f5-40ec-825d-e4df278350d5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:47.416646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92953cdf-f5f5-40ec-825d-e4df278350d5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:47.418970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92953cdf-f5f5-40ec-825d-e4df278350d5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:47.420099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92953cdf-f5f5-40ec-825d-e4df278350d5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:47.643038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4ea9652d-3edb-4c49-8292-83bf7de5f69e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:47.663658 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4ea9652d-3edb-4c49-8292-83bf7de5f69e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1315 microversion: 2.1 time: 1.292998 Aug 29 15:43:47.665135 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2090/4288] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:46 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1315 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:48.135133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-646ecdef-8a2f-4e00-a2c8-2438f23e1aeb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42aa75a60>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:48.219685 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-646ecdef-8a2f-4e00-a2c8-2438f23e1aeb tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.090107 Aug 29 15:43:48.220712 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2091/4289] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:48 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:48.491897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-92953cdf-f5f5-40ec-825d-e4df278350d5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:48.498659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:48.526874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-92953cdf-f5f5-40ec-825d-e4df278350d5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:48.528347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-92953cdf-f5f5-40ec-825d-e4df278350d5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:48.529624 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-92953cdf-f5f5-40ec-825d-e4df278350d5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 1.137642 Aug 29 15:43:48.530207 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2199/4290] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:47 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:48.708492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-039257c6-e501-421b-bad2-609d6bec2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:48.709834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-039257c6-e501-421b-bad2-609d6bec2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:48.740765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-039257c6-e501-421b-bad2-609d6bec2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:48.741582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-039257c6-e501-421b-bad2-609d6bec2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:48.742188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-039257c6-e501-421b-bad2-609d6bec2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:48.743142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-039257c6-e501-421b-bad2-609d6bec2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:48.745711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-039257c6-e501-421b-bad2-609d6bec2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:48.747622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-039257c6-e501-421b-bad2-609d6bec2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.237403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d56750a9-0341-4f8f-a9e9-7c16efff5b7b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a797d30>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:49.364844 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d56750a9-0341-4f8f-a9e9-7c16efff5b7b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.133633 Aug 29 15:43:49.369754 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2200/4291] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:49 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:49.393152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-f48c55bc-45e9-47dd-b8b1-8d61d175ae2a req-c4c4a66d-ad1d-4424-8036-a63af7dcbdb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea38e358-61dd-41e2-a08f-10e9f4711489", "tag": "61c1d158-dd30-47f3-9abd-0a32e7fb20a2"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:49.445121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f48c55bc-45e9-47dd-b8b1-8d61d175ae2a req-c4c4a66d-ad1d-4424-8036-a63af7dcbdb0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:49.447943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f48c55bc-45e9-47dd-b8b1-8d61d175ae2a req-c4c4a66d-ad1d-4424-8036-a63af7dcbdb0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:49.448409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f48c55bc-45e9-47dd-b8b1-8d61d175ae2a req-c4c4a66d-ad1d-4424-8036-a63af7dcbdb0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.502801 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-f48c55bc-45e9-47dd-b8b1-8d61d175ae2a req-c4c4a66d-ad1d-4424-8036-a63af7dcbdb0 service nova] Creating event network-changed:61c1d158-dd30-47f3-9abd-0a32e7fb20a2 for instance ea38e358-61dd-41e2-a08f-10e9f4711489 on n-h1-839401-11 Aug 29 15:43:49.521777 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-f48c55bc-45e9-47dd-b8b1-8d61d175ae2a req-c4c4a66d-ad1d-4424-8036-a63af7dcbdb0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133765 Aug 29 15:43:49.526353 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2201/4292] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:49.556451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a9656511-0204-4324-953d-5e120af27387 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:49.558698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a9656511-0204-4324-953d-5e120af27387 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:49.575798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9656511-0204-4324-953d-5e120af27387 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:49.578719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9656511-0204-4324-953d-5e120af27387 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:49.579510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9656511-0204-4324-953d-5e120af27387 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.581148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9656511-0204-4324-953d-5e120af27387 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:49.586717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9656511-0204-4324-953d-5e120af27387 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:49.594319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9656511-0204-4324-953d-5e120af27387 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:50.093956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a9656511-0204-4324-953d-5e120af27387 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:50.107654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a9656511-0204-4324-953d-5e120af27387 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:50.119056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a9656511-0204-4324-953d-5e120af27387 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:50.120444 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a9656511-0204-4324-953d-5e120af27387 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.568719 Aug 29 15:43:50.127574 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2202/4293] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:49 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:50.384898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ebf2b94a-a0bd-4ffc-af97-5e596f5bb994 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a8ee8b0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:50.494800 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ebf2b94a-a0bd-4ffc-af97-5e596f5bb994 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.114367 Aug 29 15:43:50.499807 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2203/4294] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:50 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:50.637106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-039257c6-e501-421b-bad2-609d6bec2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:50.651613 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-039257c6-e501-421b-bad2-609d6bec2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1315 microversion: 2.1 time: 1.963696 Aug 29 15:43:50.662656 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2092/4295] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:48 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1315 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:50.886185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-51a63485-6664-45bb-a1e3-307efba8db95 req-156bd2fb-3372-413b-9673-04c9d1fe1405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89dfeae0-3079-4a17-bc65-7ad03318e731", "tag": "bd7ed4b6-e125-48ac-8d8c-adae31bfdf56"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:50.914026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-51a63485-6664-45bb-a1e3-307efba8db95 req-156bd2fb-3372-413b-9673-04c9d1fe1405 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:50.914622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-51a63485-6664-45bb-a1e3-307efba8db95 req-156bd2fb-3372-413b-9673-04c9d1fe1405 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:50.915056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-51a63485-6664-45bb-a1e3-307efba8db95 req-156bd2fb-3372-413b-9673-04c9d1fe1405 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:50.953294 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-51a63485-6664-45bb-a1e3-307efba8db95 req-156bd2fb-3372-413b-9673-04c9d1fe1405 service nova] Creating event network-changed:bd7ed4b6-e125-48ac-8d8c-adae31bfdf56 for instance 89dfeae0-3079-4a17-bc65-7ad03318e731 on n-h2-839401-11 Aug 29 15:43:50.965907 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-51a63485-6664-45bb-a1e3-307efba8db95 req-156bd2fb-3372-413b-9673-04c9d1fe1405 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.394202 Aug 29 15:43:50.970743 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2204/4296] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:51.148771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8f7dd69e-2700-4a85-96d7-2da44d35a638 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:51.149683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8f7dd69e-2700-4a85-96d7-2da44d35a638 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:51.165108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f7dd69e-2700-4a85-96d7-2da44d35a638 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:51.167558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f7dd69e-2700-4a85-96d7-2da44d35a638 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:51.168191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f7dd69e-2700-4a85-96d7-2da44d35a638 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:51.174691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f7dd69e-2700-4a85-96d7-2da44d35a638 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:51.175365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f7dd69e-2700-4a85-96d7-2da44d35a638 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:51.175949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f7dd69e-2700-4a85-96d7-2da44d35a638 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:51.526202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-585902bf-38a2-4375-8568-ed074cf662a4 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a87fb80>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:51.632722 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-585902bf-38a2-4375-8568-ed074cf662a4 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.123124 Aug 29 15:43:51.633886 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2205/4297] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:51 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:51.675702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ce10cf9a-059b-4d75-b323-581ed31d0768 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:51.676546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ce10cf9a-059b-4d75-b323-581ed31d0768 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:51.698014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce10cf9a-059b-4d75-b323-581ed31d0768 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:51.698697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce10cf9a-059b-4d75-b323-581ed31d0768 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:51.699227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce10cf9a-059b-4d75-b323-581ed31d0768 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:51.700039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce10cf9a-059b-4d75-b323-581ed31d0768 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:51.701599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce10cf9a-059b-4d75-b323-581ed31d0768 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:51.703043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce10cf9a-059b-4d75-b323-581ed31d0768 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:52.253678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8f7dd69e-2700-4a85-96d7-2da44d35a638 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:52.267787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8f7dd69e-2700-4a85-96d7-2da44d35a638 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:52.273416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8f7dd69e-2700-4a85-96d7-2da44d35a638 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:52.274878 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8f7dd69e-2700-4a85-96d7-2da44d35a638 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 1.131006 Aug 29 15:43:52.294643 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2093/4298] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:51 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:52.359786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ce10cf9a-059b-4d75-b323-581ed31d0768 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:52.373074 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ce10cf9a-059b-4d75-b323-581ed31d0768 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1315 microversion: 2.1 time: 0.701874 Aug 29 15:43:52.386111 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2206/4299] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:51 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:52.651071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4a5a6d59-4211-4c6e-bd53-9942a5296779 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a9eee50>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:52.746667 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4a5a6d59-4211-4c6e-bd53-9942a5296779 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.101168 Aug 29 15:43:52.749324 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2094/4300] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:52 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:53.310415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-66c4589a-ad7c-4e4f-a7e0-6ba58d0ecf18 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:53.311546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-66c4589a-ad7c-4e4f-a7e0-6ba58d0ecf18 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:53.327512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66c4589a-ad7c-4e4f-a7e0-6ba58d0ecf18 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:53.330514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66c4589a-ad7c-4e4f-a7e0-6ba58d0ecf18 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:53.334055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66c4589a-ad7c-4e4f-a7e0-6ba58d0ecf18 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:53.335015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66c4589a-ad7c-4e4f-a7e0-6ba58d0ecf18 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:53.335633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66c4589a-ad7c-4e4f-a7e0-6ba58d0ecf18 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:53.336641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66c4589a-ad7c-4e4f-a7e0-6ba58d0ecf18 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:53.398791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e4b6c705-e42a-4513-8cc2-45ec7b297005 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:53.400115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e4b6c705-e42a-4513-8cc2-45ec7b297005 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:53.408724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4b6c705-e42a-4513-8cc2-45ec7b297005 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:53.412872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4b6c705-e42a-4513-8cc2-45ec7b297005 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:53.414568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4b6c705-e42a-4513-8cc2-45ec7b297005 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:53.416275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4b6c705-e42a-4513-8cc2-45ec7b297005 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:53.419490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4b6c705-e42a-4513-8cc2-45ec7b297005 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:53.422183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4b6c705-e42a-4513-8cc2-45ec7b297005 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:54.305353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-66c4589a-ad7c-4e4f-a7e0-6ba58d0ecf18 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:54.330016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-66c4589a-ad7c-4e4f-a7e0-6ba58d0ecf18 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:54.335167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-66c4589a-ad7c-4e4f-a7e0-6ba58d0ecf18 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:54.337035 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-66c4589a-ad7c-4e4f-a7e0-6ba58d0ecf18 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 1.037462 Aug 29 15:43:54.338802 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2207/4301] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:53 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:54.353377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-70e3b6b3-bd00-47ce-9c58-e8f06a352f6a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a8904c0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:54.428417 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-70e3b6b3-bd00-47ce-9c58-e8f06a352f6a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.088162 Aug 29 15:43:54.429594 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2208/4302] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:54 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:54.434334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-194af1b9-7450-456c-bfdc-26c7b8a51015 req-9b4b73a6-5f4a-4576-8ad8-a187642de149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "tag": "af34d60f-3508-498b-8136-1aa1dd422ab9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:54.459382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-194af1b9-7450-456c-bfdc-26c7b8a51015 req-9b4b73a6-5f4a-4576-8ad8-a187642de149 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:54.461801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-194af1b9-7450-456c-bfdc-26c7b8a51015 req-9b4b73a6-5f4a-4576-8ad8-a187642de149 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:54.462426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-194af1b9-7450-456c-bfdc-26c7b8a51015 req-9b4b73a6-5f4a-4576-8ad8-a187642de149 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:54.528585 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-194af1b9-7450-456c-bfdc-26c7b8a51015 req-9b4b73a6-5f4a-4576-8ad8-a187642de149 service nova] Creating event network-changed:af34d60f-3508-498b-8136-1aa1dd422ab9 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:43:54.539133 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-194af1b9-7450-456c-bfdc-26c7b8a51015 req-9b4b73a6-5f4a-4576-8ad8-a187642de149 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108022 Aug 29 15:43:54.540025 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2209/4303] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:55.321195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e4b6c705-e42a-4513-8cc2-45ec7b297005 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:55.329521 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e4b6c705-e42a-4513-8cc2-45ec7b297005 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1315 microversion: 2.1 time: 1.934980 Aug 29 15:43:55.333447 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2095/4304] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:53 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1315 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:55.360849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b2d96049-0497-436f-bf90-2f3abbd388f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:55.361602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b2d96049-0497-436f-bf90-2f3abbd388f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:55.371465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2d96049-0497-436f-bf90-2f3abbd388f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:55.373754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2d96049-0497-436f-bf90-2f3abbd388f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:55.377789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2d96049-0497-436f-bf90-2f3abbd388f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:55.378871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2d96049-0497-436f-bf90-2f3abbd388f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:55.379566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2d96049-0497-436f-bf90-2f3abbd388f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:55.380279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2d96049-0497-436f-bf90-2f3abbd388f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:55.443386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a1e19c9b-c8a1-4750-8583-9fd0696791a1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42aa753a0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:55.525550 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a1e19c9b-c8a1-4750-8583-9fd0696791a1 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.085813 Aug 29 15:43:55.526343 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2096/4305] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:55 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:56.164285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b2d96049-0497-436f-bf90-2f3abbd388f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:56.181443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b2d96049-0497-436f-bf90-2f3abbd388f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:56.183535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b2d96049-0497-436f-bf90-2f3abbd388f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:56.185041 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b2d96049-0497-436f-bf90-2f3abbd388f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.828588 Aug 29 15:43:56.199653 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2210/4306] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:55 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:56.350965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2f623fd9-f5b7-45cb-9019-276985f490f4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:56.351605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2f623fd9-f5b7-45cb-9019-276985f490f4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:56.369150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f623fd9-f5b7-45cb-9019-276985f490f4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:56.369595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f623fd9-f5b7-45cb-9019-276985f490f4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:56.370033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f623fd9-f5b7-45cb-9019-276985f490f4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:56.370752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f623fd9-f5b7-45cb-9019-276985f490f4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:56.371209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f623fd9-f5b7-45cb-9019-276985f490f4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:56.371644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f623fd9-f5b7-45cb-9019-276985f490f4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:56.542310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ba898dd5-2323-43d2-b975-ddb422684b81 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a770790>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:56.622580 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ba898dd5-2323-43d2-b975-ddb422684b81 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.085336 Aug 29 15:43:56.626329 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2211/4307] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:56 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:57.191039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-ab0e550a-58f6-4f12-8a40-56318997b5c5 req-f644a8d5-4957-454e-b381-f9931ce97039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "tag": "1a543716-cc66-4d75-84e9-429e6bbf56a0"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:57.218520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ab0e550a-58f6-4f12-8a40-56318997b5c5 req-f644a8d5-4957-454e-b381-f9931ce97039 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.219022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ab0e550a-58f6-4f12-8a40-56318997b5c5 req-f644a8d5-4957-454e-b381-f9931ce97039 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.219472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ab0e550a-58f6-4f12-8a40-56318997b5c5 req-f644a8d5-4957-454e-b381-f9931ce97039 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.243500 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-ab0e550a-58f6-4f12-8a40-56318997b5c5 req-f644a8d5-4957-454e-b381-f9931ce97039 service nova] Creating event network-changed:1a543716-cc66-4d75-84e9-429e6bbf56a0 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:43:57.250297 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-ab0e550a-58f6-4f12-8a40-56318997b5c5 req-f644a8d5-4957-454e-b381-f9931ce97039 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062730 Aug 29 15:43:57.251770 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2212/4308] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:43:57.257867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bbe8a166-f402-4596-a995-3e956e0c506f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:57.258916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bbe8a166-f402-4596-a995-3e956e0c506f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:57.269466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbe8a166-f402-4596-a995-3e956e0c506f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.270766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbe8a166-f402-4596-a995-3e956e0c506f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.271583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbe8a166-f402-4596-a995-3e956e0c506f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.272753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbe8a166-f402-4596-a995-3e956e0c506f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.273488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbe8a166-f402-4596-a995-3e956e0c506f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.274165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bbe8a166-f402-4596-a995-3e956e0c506f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.554347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2f623fd9-f5b7-45cb-9019-276985f490f4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:57.571176 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2f623fd9-f5b7-45cb-9019-276985f490f4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1315 microversion: 2.1 time: 1.224493 Aug 29 15:43:57.577512 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2097/4309] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:56 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1315 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:57.637714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-53f7720d-13c2-418d-b80d-821970fd1dd9 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42aaab1f0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:57.710270 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-53f7720d-13c2-418d-b80d-821970fd1dd9 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.076417 Aug 29 15:43:57.711115 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2098/4310] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:57 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:58.600881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-95307218-0aae-4771-95f8-a080f13441fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:58.601717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-95307218-0aae-4771-95f8-a080f13441fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:58.634094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95307218-0aae-4771-95f8-a080f13441fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.641695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95307218-0aae-4771-95f8-a080f13441fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.642504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95307218-0aae-4771-95f8-a080f13441fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.643596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95307218-0aae-4771-95f8-a080f13441fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.644371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95307218-0aae-4771-95f8-a080f13441fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.645018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95307218-0aae-4771-95f8-a080f13441fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.028067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bbe8a166-f402-4596-a995-3e956e0c506f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:59.049141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bbe8a166-f402-4596-a995-3e956e0c506f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:59.051549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bbe8a166-f402-4596-a995-3e956e0c506f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:59.052851 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bbe8a166-f402-4596-a995-3e956e0c506f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 1.799733 Aug 29 15:43:59.058334 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2213/4311] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:43:57 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:43:59.076335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-228fc1fd-7066-4a2c-b475-83f7de519466 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42ac60160>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:59.185972 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-228fc1fd-7066-4a2c-b475-83f7de519466 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.124606 Aug 29 15:43:59.194326 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2214/4312] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:59 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:00.091293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5e4f37f8-788c-44f6-b294-aee1e2f79055 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:00.091979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5e4f37f8-788c-44f6-b294-aee1e2f79055 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:00.111012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e4f37f8-788c-44f6-b294-aee1e2f79055 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.111737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e4f37f8-788c-44f6-b294-aee1e2f79055 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.112436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e4f37f8-788c-44f6-b294-aee1e2f79055 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.113308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-95307218-0aae-4771-95f8-a080f13441fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:00.114548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e4f37f8-788c-44f6-b294-aee1e2f79055 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.119576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e4f37f8-788c-44f6-b294-aee1e2f79055 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.120838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e4f37f8-788c-44f6-b294-aee1e2f79055 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.127827 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-95307218-0aae-4771-95f8-a080f13441fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1315 microversion: 2.1 time: 1.531675 Aug 29 15:44:00.131995 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2099/4313] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:58 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1315 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:00.201346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-88d2d66f-3cbb-4f6d-a966-7ed7facb19b0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42b76fd30>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:00.307636 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-88d2d66f-3cbb-4f6d-a966-7ed7facb19b0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.110548 Aug 29 15:44:00.316856 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2100/4314] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:00 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:00.665861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e4f37f8-788c-44f6-b294-aee1e2f79055 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:00.685958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e4f37f8-788c-44f6-b294-aee1e2f79055 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:00.687934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e4f37f8-788c-44f6-b294-aee1e2f79055 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:00.689388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-26395e8a-3da0-49b4-8eeb-ca10af0ca453 req-7ac22fc2-d028-4088-a582-4ae94c62f8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "tag": "740841a2-402d-46f7-999f-b5beab53ba4a"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:00.691211 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5e4f37f8-788c-44f6-b294-aee1e2f79055 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.611260 Aug 29 15:44:00.692631 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2215/4315] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:00 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:00.720981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-26395e8a-3da0-49b4-8eeb-ca10af0ca453 req-7ac22fc2-d028-4088-a582-4ae94c62f8b8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.731287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-26395e8a-3da0-49b4-8eeb-ca10af0ca453 req-7ac22fc2-d028-4088-a582-4ae94c62f8b8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.741459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-26395e8a-3da0-49b4-8eeb-ca10af0ca453 req-7ac22fc2-d028-4088-a582-4ae94c62f8b8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.768300 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-26395e8a-3da0-49b4-8eeb-ca10af0ca453 req-7ac22fc2-d028-4088-a582-4ae94c62f8b8 service nova] Creating event network-changed:740841a2-402d-46f7-999f-b5beab53ba4a for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:44:00.783106 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-26395e8a-3da0-49b4-8eeb-ca10af0ca453 req-7ac22fc2-d028-4088-a582-4ae94c62f8b8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099469 Aug 29 15:44:00.785391 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2101/4316] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 29 15:44:01.176485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-27a92741-c661-4785-9be4-5b45dc452e32 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:01.177845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-27a92741-c661-4785-9be4-5b45dc452e32 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:01.202223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27a92741-c661-4785-9be4-5b45dc452e32 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.203025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27a92741-c661-4785-9be4-5b45dc452e32 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.203667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27a92741-c661-4785-9be4-5b45dc452e32 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.204565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27a92741-c661-4785-9be4-5b45dc452e32 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.205249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27a92741-c661-4785-9be4-5b45dc452e32 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.205834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27a92741-c661-4785-9be4-5b45dc452e32 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.324928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e9bc13ce-fead-478e-996c-fc79c7daf681 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42b76f040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:01.410286 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e9bc13ce-fead-478e-996c-fc79c7daf681 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.089788 Aug 29 15:44:01.411891 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2102/4317] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:01 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:01.606627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-27a92741-c661-4785-9be4-5b45dc452e32 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:01.629255 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-27a92741-c661-4785-9be4-5b45dc452e32 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1315 microversion: 2.1 time: 0.480922 Aug 29 15:44:01.641926 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2216/4318] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:01 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:01.731575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bbc8b963-527b-4830-861a-466c3560a896 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:01.737152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bbc8b963-527b-4830-861a-466c3560a896 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:01.774275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbc8b963-527b-4830-861a-466c3560a896 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.775821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbc8b963-527b-4830-861a-466c3560a896 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.777672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbc8b963-527b-4830-861a-466c3560a896 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.780096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbc8b963-527b-4830-861a-466c3560a896 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.780785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbc8b963-527b-4830-861a-466c3560a896 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.783869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbc8b963-527b-4830-861a-466c3560a896 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:02.425674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cc9ce512-42de-42e2-b768-ee78eb25fa15 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a8f04c0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:02.513967 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cc9ce512-42de-42e2-b768-ee78eb25fa15 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.090496 Aug 29 15:44:02.522744 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2217/4319] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:02 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:02.666400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2c202bb2-58d1-43c9-b1a2-5d327b5ea871 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:02.670776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2c202bb2-58d1-43c9-b1a2-5d327b5ea871 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:02.692579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c202bb2-58d1-43c9-b1a2-5d327b5ea871 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:02.693620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c202bb2-58d1-43c9-b1a2-5d327b5ea871 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:02.695102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c202bb2-58d1-43c9-b1a2-5d327b5ea871 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:02.695912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c202bb2-58d1-43c9-b1a2-5d327b5ea871 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:02.697145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c202bb2-58d1-43c9-b1a2-5d327b5ea871 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:02.697985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c202bb2-58d1-43c9-b1a2-5d327b5ea871 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:03.030432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bbc8b963-527b-4830-861a-466c3560a896 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:03.045680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bbc8b963-527b-4830-861a-466c3560a896 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:03.055906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bbc8b963-527b-4830-861a-466c3560a896 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:03.057804 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bbc8b963-527b-4830-861a-466c3560a896 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 1.345185 Aug 29 15:44:03.058658 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2103/4320] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:01 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:03.506372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2c202bb2-58d1-43c9-b1a2-5d327b5ea871 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:03.521782 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2c202bb2-58d1-43c9-b1a2-5d327b5ea871 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1315 microversion: 2.1 time: 0.858255 Aug 29 15:44:03.531704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f5a77caf-ce3a-4854-8c39-2a595265c220 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42aa4c310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:03.538563 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2218/4321] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:02 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1315 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:03.600403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-9ad99153-86d8-40e3-a39b-776be3b4cc1e req-3673b51e-031f-45d0-96cd-13ad1849df82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea38e358-61dd-41e2-a08f-10e9f4711489", "name": "network-vif-plugged", "status": "completed", "tag": "61c1d158-dd30-47f3-9abd-0a32e7fb20a2"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:03.618594 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f5a77caf-ce3a-4854-8c39-2a595265c220 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.091173 Aug 29 15:44:03.619649 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2104/4322] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:03 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:03.628854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9ad99153-86d8-40e3-a39b-776be3b4cc1e req-3673b51e-031f-45d0-96cd-13ad1849df82 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.631257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9ad99153-86d8-40e3-a39b-776be3b4cc1e req-3673b51e-031f-45d0-96cd-13ad1849df82 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.631877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9ad99153-86d8-40e3-a39b-776be3b4cc1e req-3673b51e-031f-45d0-96cd-13ad1849df82 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:03.656788 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-9ad99153-86d8-40e3-a39b-776be3b4cc1e req-3673b51e-031f-45d0-96cd-13ad1849df82 service nova] Creating event network-vif-plugged:61c1d158-dd30-47f3-9abd-0a32e7fb20a2 for instance ea38e358-61dd-41e2-a08f-10e9f4711489 on n-h1-839401-11 Aug 29 15:44:03.670488 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-9ad99153-86d8-40e3-a39b-776be3b4cc1e req-3673b51e-031f-45d0-96cd-13ad1849df82 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072768 Aug 29 15:44:03.671672 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2219/4323] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:04.090449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8049974d-1e8c-4a81-a3ba-15a68d56955b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:04.091351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8049974d-1e8c-4a81-a3ba-15a68d56955b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:04.106304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8049974d-1e8c-4a81-a3ba-15a68d56955b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.107480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8049974d-1e8c-4a81-a3ba-15a68d56955b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.109442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8049974d-1e8c-4a81-a3ba-15a68d56955b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.110645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8049974d-1e8c-4a81-a3ba-15a68d56955b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.112113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8049974d-1e8c-4a81-a3ba-15a68d56955b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.113589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8049974d-1e8c-4a81-a3ba-15a68d56955b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.545788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0b9ef8a4-953f-44ab-8da7-ff1ad6400ad0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:04.547466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0b9ef8a4-953f-44ab-8da7-ff1ad6400ad0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:04.564151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b9ef8a4-953f-44ab-8da7-ff1ad6400ad0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.564992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b9ef8a4-953f-44ab-8da7-ff1ad6400ad0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.567203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b9ef8a4-953f-44ab-8da7-ff1ad6400ad0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.568321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b9ef8a4-953f-44ab-8da7-ff1ad6400ad0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:04.572090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b9ef8a4-953f-44ab-8da7-ff1ad6400ad0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:04.574023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b9ef8a4-953f-44ab-8da7-ff1ad6400ad0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.743828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8049974d-1e8c-4a81-a3ba-15a68d56955b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:04.758351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8049974d-1e8c-4a81-a3ba-15a68d56955b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:04.767513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8049974d-1e8c-4a81-a3ba-15a68d56955b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:04.769487 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8049974d-1e8c-4a81-a3ba-15a68d56955b tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.685407 Aug 29 15:44:04.774412 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2105/4324] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:04 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:04.788991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bf59af01-b178-412a-a126-a8f9b6ab35e6 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42aa12790>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:04.900178 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bf59af01-b178-412a-a126-a8f9b6ab35e6 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1414 microversion: 2.1 time: 0.121592 Aug 29 15:44:04.906803 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2106/4325] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:04 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1414 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:05.052827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0b9ef8a4-953f-44ab-8da7-ff1ad6400ad0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:05.073347 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0b9ef8a4-953f-44ab-8da7-ff1ad6400ad0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1315 microversion: 2.1 time: 0.533466 Aug 29 15:44:05.093292 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2220/4326] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:04 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:05.248775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-2e6a7c81-24aa-4597-bb3a-9fc64945a633 req-4193c5f0-d6ab-4c63-b8db-1e3f5402f9be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "tag": "cd9c6b22-3b08-4c43-9df9-680021211414"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:05.291203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2e6a7c81-24aa-4597-bb3a-9fc64945a633 req-4193c5f0-d6ab-4c63-b8db-1e3f5402f9be service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.295073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2e6a7c81-24aa-4597-bb3a-9fc64945a633 req-4193c5f0-d6ab-4c63-b8db-1e3f5402f9be service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.295570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2e6a7c81-24aa-4597-bb3a-9fc64945a633 req-4193c5f0-d6ab-4c63-b8db-1e3f5402f9be service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.321528 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-2e6a7c81-24aa-4597-bb3a-9fc64945a633 req-4193c5f0-d6ab-4c63-b8db-1e3f5402f9be service nova] Creating event network-changed:cd9c6b22-3b08-4c43-9df9-680021211414 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:44:05.333376 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-2e6a7c81-24aa-4597-bb3a-9fc64945a633 req-4193c5f0-d6ab-4c63-b8db-1e3f5402f9be service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091374 Aug 29 15:44:05.334723 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2107/4327] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:05.796746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3ca509a4-42c9-405e-83d3-f22c2daeacf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:05.799368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3ca509a4-42c9-405e-83d3-f22c2daeacf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:05.807875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ca509a4-42c9-405e-83d3-f22c2daeacf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.808543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ca509a4-42c9-405e-83d3-f22c2daeacf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.808994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ca509a4-42c9-405e-83d3-f22c2daeacf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.809920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ca509a4-42c9-405e-83d3-f22c2daeacf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.810389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ca509a4-42c9-405e-83d3-f22c2daeacf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.810824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ca509a4-42c9-405e-83d3-f22c2daeacf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.917279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-55ef80b2-7a98-43ed-9728-ae712fc5e7c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a9cb5e0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:05.973529 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-55ef80b2-7a98-43ed-9728-ae712fc5e7c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1423 microversion: 2.1 time: 0.061618 Aug 29 15:44:05.989163 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2108/4328] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:05 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1423 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:05.996119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a7e098e5-f385-4787-9548-67e201a3373f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42aa4c0d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:06.061366 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a7e098e5-f385-4787-9548-67e201a3373f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 200 len: 1423 microversion: 2.1 time: 0.070584 Aug 29 15:44:06.062457 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2109/4329] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:05 2022] GET /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 1423 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:06.067874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3ca509a4-42c9-405e-83d3-f22c2daeacf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:06.080097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-97644e0e-4630-428a-bfd3-3c6e3d473911 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc433a82a60>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:06.081913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3ca509a4-42c9-405e-83d3-f22c2daeacf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:06.084401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3ca509a4-42c9-405e-83d3-f22c2daeacf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:06.089457 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3ca509a4-42c9-405e-83d3-f22c2daeacf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.296096 Aug 29 15:44:06.090565 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2221/4330] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:05 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:06.102780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7d4fe2e4-e73b-49e3-9f78-7bea9d140197 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:06.103620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7d4fe2e4-e73b-49e3-9f78-7bea9d140197 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:06.112867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d4fe2e4-e73b-49e3-9f78-7bea9d140197 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.113640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d4fe2e4-e73b-49e3-9f78-7bea9d140197 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.114223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d4fe2e4-e73b-49e3-9f78-7bea9d140197 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.115116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d4fe2e4-e73b-49e3-9f78-7bea9d140197 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.116342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d4fe2e4-e73b-49e3-9f78-7bea9d140197 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.117434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d4fe2e4-e73b-49e3-9f78-7bea9d140197 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.308554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7d4fe2e4-e73b-49e3-9f78-7bea9d140197 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:06.317843 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7d4fe2e4-e73b-49e3-9f78-7bea9d140197 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1501 microversion: 2.1 time: 0.219506 Aug 29 15:44:06.321370 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2222/4331] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:06 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1501 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:06.343229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-da9aa38f-5030-48ae-8576-9b9bc8cb44eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:06.346157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-da9aa38f-5030-48ae-8576-9b9bc8cb44eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:06.367216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9aa38f-5030-48ae-8576-9b9bc8cb44eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.369228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9aa38f-5030-48ae-8576-9b9bc8cb44eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.370090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9aa38f-5030-48ae-8576-9b9bc8cb44eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.372068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9aa38f-5030-48ae-8576-9b9bc8cb44eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.377529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9aa38f-5030-48ae-8576-9b9bc8cb44eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.380529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9aa38f-5030-48ae-8576-9b9bc8cb44eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.643048 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.network.security_group_api [None req-da9aa38f-5030-48ae-8576-9b9bc8cb44eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Removing security group 15fcf112-8f56-4991-b8fd-bbecb2b72647 from port 61c1d158-dd30-47f3-9abd-0a32e7fb20a2 Aug 29 15:44:06.775678 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-97644e0e-4630-428a-bfd3-3c6e3d473911 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "DELETE /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 204 len: 0 microversion: 2.1 time: 0.701099 Aug 29 15:44:06.776512 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2110/4332] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:06 2022] DELETE /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 0 bytes in 703 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:06.784791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6ec71761-e1f5-4d10-980f-e47c27998888 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:06.786942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6ec71761-e1f5-4d10-980f-e47c27998888 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:06.799882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ec71761-e1f5-4d10-980f-e47c27998888 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.807939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ec71761-e1f5-4d10-980f-e47c27998888 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.808757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ec71761-e1f5-4d10-980f-e47c27998888 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.809818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ec71761-e1f5-4d10-980f-e47c27998888 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.810517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ec71761-e1f5-4d10-980f-e47c27998888 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.811195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ec71761-e1f5-4d10-980f-e47c27998888 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.862564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6ec71761-e1f5-4d10-980f-e47c27998888 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:44:07.004402 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6ec71761-e1f5-4d10-980f-e47c27998888 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "DELETE /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 204 len: 0 microversion: 2.1 time: 0.222365 Aug 29 15:44:07.006915 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2111/4333] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:44:06 2022] DELETE /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:44:07.116035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b9efabc0-5ce4-4894-9597-fc418e56bcdd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:07.116831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b9efabc0-5ce4-4894-9597-fc418e56bcdd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:07.128663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9efabc0-5ce4-4894-9597-fc418e56bcdd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.137438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9efabc0-5ce4-4894-9597-fc418e56bcdd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.138451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9efabc0-5ce4-4894-9597-fc418e56bcdd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.139411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9efabc0-5ce4-4894-9597-fc418e56bcdd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.140023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9efabc0-5ce4-4894-9597-fc418e56bcdd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.140595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9efabc0-5ce4-4894-9597-fc418e56bcdd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.219839 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-da9aa38f-5030-48ae-8576-9b9bc8cb44eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489/action" status: 202 len: 0 microversion: 2.1 time: 0.881305 Aug 29 15:44:07.220532 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2223/4334] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:44:06 2022] POST /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489/action => generated 0 bytes in 883 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:44:07.226445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-322573513", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "3ac7e564-b250-488a-8919-b9f712fff14c"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:07.326624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] validate_networks() for [('3ac7e564-b250-488a-8919-b9f712fff14c', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:07.853634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b9efabc0-5ce4-4894-9597-fc418e56bcdd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:07.868560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:07.869486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:07.870162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:07.872627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:07.873714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:07.885040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b9efabc0-5ce4-4894-9597-fc418e56bcdd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:07.887138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b9efabc0-5ce4-4894-9597-fc418e56bcdd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:07.888790 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b9efabc0-5ce4-4894-9597-fc418e56bcdd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.778979 Aug 29 15:44:07.891713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.892775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.893476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.894456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.895100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.895764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.901758 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2112/4335] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:07 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:07.913522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-949c1ec2-4650-40c3-9818-1783e88684f7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:07.914055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-949c1ec2-4650-40c3-9818-1783e88684f7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:07.924259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Getting quotas for project ad019754b47441d5a286666f8a048b48. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:07.932646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-949c1ec2-4650-40c3-9818-1783e88684f7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.933299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Getting quotas for user 71ae9af4779a4d50b9171ff9ca8b5207 and project ad019754b47441d5a286666f8a048b48. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:07.933433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-949c1ec2-4650-40c3-9818-1783e88684f7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.933788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-949c1ec2-4650-40c3-9818-1783e88684f7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.934683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-949c1ec2-4650-40c3-9818-1783e88684f7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.935285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-949c1ec2-4650-40c3-9818-1783e88684f7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.935856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-949c1ec2-4650-40c3-9818-1783e88684f7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.953048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:07.955973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:08.042311 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f6dbf663-b004-4b50-839a-193f379e44c0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820021 Aug 29 15:44:08.042974 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2224/4336] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:44:08.047931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-75b96ab6-ecd9-4980-815b-a1d5f4c1696b req-7182210c-51b2-489e-98b1-48286278eb01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea38e358-61dd-41e2-a08f-10e9f4711489", "tag": "61c1d158-dd30-47f3-9abd-0a32e7fb20a2"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:08.062908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-75b96ab6-ecd9-4980-815b-a1d5f4c1696b req-7182210c-51b2-489e-98b1-48286278eb01 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:08.063360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-75b96ab6-ecd9-4980-815b-a1d5f4c1696b req-7182210c-51b2-489e-98b1-48286278eb01 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:08.063969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-75b96ab6-ecd9-4980-815b-a1d5f4c1696b req-7182210c-51b2-489e-98b1-48286278eb01 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:08.076369 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-75b96ab6-ecd9-4980-815b-a1d5f4c1696b req-7182210c-51b2-489e-98b1-48286278eb01 service nova] Creating event network-changed:61c1d158-dd30-47f3-9abd-0a32e7fb20a2 for instance ea38e358-61dd-41e2-a08f-10e9f4711489 on n-h1-839401-11 Aug 29 15:44:08.083013 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-75b96ab6-ecd9-4980-815b-a1d5f4c1696b req-7182210c-51b2-489e-98b1-48286278eb01 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037592 Aug 29 15:44:08.083939 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2225/4337] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:08.107493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-237903ad-dbd9-4bad-b5d1-d41bf0bc8f78 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:08.110564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-237903ad-dbd9-4bad-b5d1-d41bf0bc8f78 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:08.167360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-949c1ec2-4650-40c3-9818-1783e88684f7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:08.171768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:08.187359 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-949c1ec2-4650-40c3-9818-1783e88684f7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1459 microversion: 2.1 time: 0.284156 Aug 29 15:44:08.188136 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2113/4338] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:07 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1459 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:08.212853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f92728f0-bc63-4920-ba59-6688941d6e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:08.213778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f92728f0-bc63-4920-ba59-6688941d6e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:08.232620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f92728f0-bc63-4920-ba59-6688941d6e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:08.233186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f92728f0-bc63-4920-ba59-6688941d6e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:08.233644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f92728f0-bc63-4920-ba59-6688941d6e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:08.234377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f92728f0-bc63-4920-ba59-6688941d6e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:08.234859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f92728f0-bc63-4920-ba59-6688941d6e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:08.235286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f92728f0-bc63-4920-ba59-6688941d6e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:08.394511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-237903ad-dbd9-4bad-b5d1-d41bf0bc8f78 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:08.404592 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-237903ad-dbd9-4bad-b5d1-d41bf0bc8f78 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 200 len: 1207 microversion: 2.1 time: 0.302285 Aug 29 15:44:08.422130 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2226/4339] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:08 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 1207 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:08.916572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0e38176a-9a53-428e-863e-24c362d43d5e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:08.917388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0e38176a-9a53-428e-863e-24c362d43d5e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:08.948148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e38176a-9a53-428e-863e-24c362d43d5e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:08.958155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e38176a-9a53-428e-863e-24c362d43d5e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:08.959140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e38176a-9a53-428e-863e-24c362d43d5e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:08.961641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e38176a-9a53-428e-863e-24c362d43d5e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:08.965793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e38176a-9a53-428e-863e-24c362d43d5e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:08.966518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e38176a-9a53-428e-863e-24c362d43d5e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.417078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f92728f0-bc63-4920-ba59-6688941d6e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:09.430215 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f92728f0-bc63-4920-ba59-6688941d6e07 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 1.224338 Aug 29 15:44:09.433521 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2114/4340] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:08 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:09.451342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-47ac8bd9-0128-4e67-8353-509d01f0d4bf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:09.452497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-47ac8bd9-0128-4e67-8353-509d01f0d4bf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:09.469768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47ac8bd9-0128-4e67-8353-509d01f0d4bf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.470942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47ac8bd9-0128-4e67-8353-509d01f0d4bf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.475925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47ac8bd9-0128-4e67-8353-509d01f0d4bf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.477637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47ac8bd9-0128-4e67-8353-509d01f0d4bf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.478130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47ac8bd9-0128-4e67-8353-509d01f0d4bf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.480915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47ac8bd9-0128-4e67-8353-509d01f0d4bf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.676079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0e38176a-9a53-428e-863e-24c362d43d5e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:09.689073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0e38176a-9a53-428e-863e-24c362d43d5e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:09.698469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0e38176a-9a53-428e-863e-24c362d43d5e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:09.699809 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0e38176a-9a53-428e-863e-24c362d43d5e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.788264 Aug 29 15:44:09.705520 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2227/4341] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:08 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:09.720720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5482fdac-12b5-4df4-87cb-e6491703d877 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:09.721782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5482fdac-12b5-4df4-87cb-e6491703d877 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:09.731425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-47ac8bd9-0128-4e67-8353-509d01f0d4bf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:09.735051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5482fdac-12b5-4df4-87cb-e6491703d877 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.738327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5482fdac-12b5-4df4-87cb-e6491703d877 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.739149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5482fdac-12b5-4df4-87cb-e6491703d877 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.741022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5482fdac-12b5-4df4-87cb-e6491703d877 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.742687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5482fdac-12b5-4df4-87cb-e6491703d877 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.743243 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-47ac8bd9-0128-4e67-8353-509d01f0d4bf tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 200 len: 1259 microversion: 2.1 time: 0.307753 Aug 29 15:44:09.744190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5482fdac-12b5-4df4-87cb-e6491703d877 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.753512 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2115/4342] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:09 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 1259 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:10.531580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1860991615", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:10.567136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5482fdac-12b5-4df4-87cb-e6491703d877 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:10.581543 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5482fdac-12b5-4df4-87cb-e6491703d877 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.872244 Aug 29 15:44:10.582926 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2228/4343] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:09 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:10.604915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a7a8d8cf-7a4b-46c4-9359-e4630e173bcf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:10.612711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a7a8d8cf-7a4b-46c4-9359-e4630e173bcf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:10.638664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7a8d8cf-7a4b-46c4-9359-e4630e173bcf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.640489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7a8d8cf-7a4b-46c4-9359-e4630e173bcf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:10.642991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7a8d8cf-7a4b-46c4-9359-e4630e173bcf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.643937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7a8d8cf-7a4b-46c4-9359-e4630e173bcf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.660201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] validate_networks() for [('a4a05318-3609-40ff-8b4b-df5c0059b0de', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:10.660441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7a8d8cf-7a4b-46c4-9359-e4630e173bcf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:10.662110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a7a8d8cf-7a4b-46c4-9359-e4630e173bcf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.729984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:11.263860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a7a8d8cf-7a4b-46c4-9359-e4630e173bcf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:11.271924 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a7a8d8cf-7a4b-46c4-9359-e4630e173bcf tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.670859 Aug 29 15:44:11.272536 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2229/4344] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:10 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:11.283856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f022025a-689b-408d-8843-64086540cdcd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:11.284486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f022025a-689b-408d-8843-64086540cdcd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:11.311676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f022025a-689b-408d-8843-64086540cdcd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.312188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f022025a-689b-408d-8843-64086540cdcd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.312642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f022025a-689b-408d-8843-64086540cdcd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.313410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f022025a-689b-408d-8843-64086540cdcd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.313883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f022025a-689b-408d-8843-64086540cdcd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.314321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f022025a-689b-408d-8843-64086540cdcd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:13.381410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:13.381922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:13.382494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:13.383022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:13.384323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:13.388607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:13.407075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:13.409536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:13.410325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:13.412794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:13.413580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:13.414431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:13.437753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Getting quotas for project eccbf3aa74064e6abad669b285e7614d. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:13.444357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Getting quotas for user 332348822e194b488606b04ea4107de7 and project eccbf3aa74064e6abad669b285e7614d. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:13.464452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:13.468397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:13.469262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f022025a-689b-408d-8843-64086540cdcd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:13.486199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f022025a-689b-408d-8843-64086540cdcd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:13.489619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f022025a-689b-408d-8843-64086540cdcd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:13.497653 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f022025a-689b-408d-8843-64086540cdcd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 2.223526 Aug 29 15:44:13.498915 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2230/4345] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:11 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 2226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:13.504248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3e45c264-5592-4489-bef9-7bb17569767c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:13.510012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3e45c264-5592-4489-bef9-7bb17569767c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:13.525116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e45c264-5592-4489-bef9-7bb17569767c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:13.526076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e45c264-5592-4489-bef9-7bb17569767c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:13.527258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e45c264-5592-4489-bef9-7bb17569767c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:13.530878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e45c264-5592-4489-bef9-7bb17569767c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:13.531861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e45c264-5592-4489-bef9-7bb17569767c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:13.532466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e45c264-5592-4489-bef9-7bb17569767c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:13.554337 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cca1e7cb-a536-4a9e-9af2-953c6475aed0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.178504 Aug 29 15:44:13.555916 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2116/4346] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 3181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:44:13.562711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-53df878d-4401-4df4-9b05-f808070ccbd4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:13.563744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-53df878d-4401-4df4-9b05-f808070ccbd4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:13.573069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53df878d-4401-4df4-9b05-f808070ccbd4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:13.574015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53df878d-4401-4df4-9b05-f808070ccbd4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:13.574711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53df878d-4401-4df4-9b05-f808070ccbd4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:13.575743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53df878d-4401-4df4-9b05-f808070ccbd4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:13.576519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53df878d-4401-4df4-9b05-f808070ccbd4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:13.577181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53df878d-4401-4df4-9b05-f808070ccbd4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:14.205789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3e45c264-5592-4489-bef9-7bb17569767c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:14.235603 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3e45c264-5592-4489-bef9-7bb17569767c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 200 len: 1307 microversion: 2.1 time: 0.735227 Aug 29 15:44:14.242993 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2231/4347] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:13 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 1307 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:14.271650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-411adf49-8c02-4fa4-a4f8-09dc69b39f02 req-a4325955-8f1c-4aa1-8957-729f76797c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81c2d898-9252-4ea9-9186-93605b7b9aa5", "name": "network-vif-deleted", "tag": "379cf683-7620-4fec-98ad-247aa9e87ba6"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:14.332536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-411adf49-8c02-4fa4-a4f8-09dc69b39f02 req-a4325955-8f1c-4aa1-8957-729f76797c79 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:14.336394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-411adf49-8c02-4fa4-a4f8-09dc69b39f02 req-a4325955-8f1c-4aa1-8957-729f76797c79 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:14.340337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-411adf49-8c02-4fa4-a4f8-09dc69b39f02 req-a4325955-8f1c-4aa1-8957-729f76797c79 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:14.389586 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-411adf49-8c02-4fa4-a4f8-09dc69b39f02 req-a4325955-8f1c-4aa1-8957-729f76797c79 service nova] Creating event network-vif-deleted:379cf683-7620-4fec-98ad-247aa9e87ba6 for instance 81c2d898-9252-4ea9-9186-93605b7b9aa5 on n-h1-839401-11 Aug 29 15:44:14.410001 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-411adf49-8c02-4fa4-a4f8-09dc69b39f02 req-a4325955-8f1c-4aa1-8957-729f76797c79 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162184 Aug 29 15:44:14.416512 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2232/4348] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:14.439918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b35500bd-3f7b-4356-bd57-d4fd35d7d8e4 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:14.443961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b35500bd-3f7b-4356-bd57-d4fd35d7d8e4 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:14.576519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-53df878d-4401-4df4-9b05-f808070ccbd4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:14.592429 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-53df878d-4401-4df4-9b05-f808070ccbd4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 1.035120 Aug 29 15:44:14.593732 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2117/4349] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:13 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:14.598919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-75711d40-815c-4c53-a4f4-ef4d21661bc5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:14.610275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-75711d40-815c-4c53-a4f4-ef4d21661bc5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:14.624567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75711d40-815c-4c53-a4f4-ef4d21661bc5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:14.625798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75711d40-815c-4c53-a4f4-ef4d21661bc5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:14.626959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75711d40-815c-4c53-a4f4-ef4d21661bc5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:14.628874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75711d40-815c-4c53-a4f4-ef4d21661bc5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:14.634486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75711d40-815c-4c53-a4f4-ef4d21661bc5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:14.634963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75711d40-815c-4c53-a4f4-ef4d21661bc5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:14.756607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b35500bd-3f7b-4356-bd57-d4fd35d7d8e4 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:14.771403 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b35500bd-3f7b-4356-bd57-d4fd35d7d8e4 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1214 microversion: 2.1 time: 0.352153 Aug 29 15:44:14.774289 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2233/4350] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:14 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1214 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:14.948507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-675383620", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "d1ac0823-5377-4aa5-8e1a-80f39f87d37f"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:15.081401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] validate_networks() for [('d1ac0823-5377-4aa5-8e1a-80f39f87d37f', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:15.789984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-75711d40-815c-4c53-a4f4-ef4d21661bc5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:15.820643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-75711d40-815c-4c53-a4f4-ef4d21661bc5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:15.822475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-75711d40-815c-4c53-a4f4-ef4d21661bc5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:15.828214 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-75711d40-815c-4c53-a4f4-ef4d21661bc5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 1.231776 Aug 29 15:44:15.845762 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2118/4351] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:14 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:15.869590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-94826aca-fcca-48ca-a349-bcb4cb572728 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:15.872286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-94826aca-fcca-48ca-a349-bcb4cb572728 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:15.882873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94826aca-fcca-48ca-a349-bcb4cb572728 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:15.883741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94826aca-fcca-48ca-a349-bcb4cb572728 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:15.885680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94826aca-fcca-48ca-a349-bcb4cb572728 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:15.886844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94826aca-fcca-48ca-a349-bcb4cb572728 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:15.887946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94826aca-fcca-48ca-a349-bcb4cb572728 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:15.889000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94826aca-fcca-48ca-a349-bcb4cb572728 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:16.728052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:16.728587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:16.729325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:16.729921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:16.730465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:16.752396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:16.753214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:16.753828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:16.761904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:16.763408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:16.764036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:16.812497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Getting quotas for project 990c752c7bb141c1bf496c98fbc3c9a7. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:16.822313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Getting quotas for user 51efa71a8bfe457982698a5755ae3cc6 and project 990c752c7bb141c1bf496c98fbc3c9a7. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:16.842665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:16.845847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:16.947316 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-861848d4-031b-4858-bdfe-04d75c1bfc24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.003112 Aug 29 15:44:16.953562 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2234/4352] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:44:16.966478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c36a0a52-39bf-4d53-8092-98330f8f9722 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:16.967647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c36a0a52-39bf-4d53-8092-98330f8f9722 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:17.013412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:17.014799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c36a0a52-39bf-4d53-8092-98330f8f9722 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.015675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c36a0a52-39bf-4d53-8092-98330f8f9722 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.016397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c36a0a52-39bf-4d53-8092-98330f8f9722 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.017491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c36a0a52-39bf-4d53-8092-98330f8f9722 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.018103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c36a0a52-39bf-4d53-8092-98330f8f9722 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.018731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c36a0a52-39bf-4d53-8092-98330f8f9722 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.124091 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-94826aca-fcca-48ca-a349-bcb4cb572728 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:17.134847 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-94826aca-fcca-48ca-a349-bcb4cb572728 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 200 len: 1307 microversion: 2.1 time: 1.287600 Aug 29 15:44:17.135472 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2119/4353] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:15 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 1307 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:17.157728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a778b5ee-b00a-41c7-9dca-c17bf5e2e04f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:17.158375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a778b5ee-b00a-41c7-9dca-c17bf5e2e04f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:17.167141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a778b5ee-b00a-41c7-9dca-c17bf5e2e04f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.167656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a778b5ee-b00a-41c7-9dca-c17bf5e2e04f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.168104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a778b5ee-b00a-41c7-9dca-c17bf5e2e04f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.168903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a778b5ee-b00a-41c7-9dca-c17bf5e2e04f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.169891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a778b5ee-b00a-41c7-9dca-c17bf5e2e04f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.170493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a778b5ee-b00a-41c7-9dca-c17bf5e2e04f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.188027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c36a0a52-39bf-4d53-8092-98330f8f9722 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:17.197049 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c36a0a52-39bf-4d53-8092-98330f8f9722 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1272 microversion: 2.1 time: 0.241803 Aug 29 15:44:17.207170 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2235/4354] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:16 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1272 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:17.212569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-48e12ab3-4edb-45be-a1c1-48daf06bbf1d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:17.213275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-48e12ab3-4edb-45be-a1c1-48daf06bbf1d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:17.385623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-48e12ab3-4edb-45be-a1c1-48daf06bbf1d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:17.402475 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-48e12ab3-4edb-45be-a1c1-48daf06bbf1d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1214 microversion: 2.1 time: 0.194129 Aug 29 15:44:17.420642 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2236/4355] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:17 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1214 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:17.441265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-fd3d2418-1e12-4ae9-a138-679cdc741809 req-ed74b7be-77ec-4ecb-9f59-0cf84efff357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5219eda0-3ed8-4c6e-ba04-19ed69930d86", "tag": "eef1db13-8722-4bfa-a4c5-4d45002ee03b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:17.453846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fd3d2418-1e12-4ae9-a138-679cdc741809 req-ed74b7be-77ec-4ecb-9f59-0cf84efff357 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.454694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fd3d2418-1e12-4ae9-a138-679cdc741809 req-ed74b7be-77ec-4ecb-9f59-0cf84efff357 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.457424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fd3d2418-1e12-4ae9-a138-679cdc741809 req-ed74b7be-77ec-4ecb-9f59-0cf84efff357 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.471794 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-fd3d2418-1e12-4ae9-a138-679cdc741809 req-ed74b7be-77ec-4ecb-9f59-0cf84efff357 service nova] Creating event network-changed:eef1db13-8722-4bfa-a4c5-4d45002ee03b for instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 on n-h1-839401-11 Aug 29 15:44:17.499730 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-fd3d2418-1e12-4ae9-a138-679cdc741809 req-ed74b7be-77ec-4ecb-9f59-0cf84efff357 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076363 Aug 29 15:44:17.505464 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2237/4356] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:18.166815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-88d41c58-0211-494a-aeb3-97b2788ff8fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:18.167460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-88d41c58-0211-494a-aeb3-97b2788ff8fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:18.189820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88d41c58-0211-494a-aeb3-97b2788ff8fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.193276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88d41c58-0211-494a-aeb3-97b2788ff8fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.195703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88d41c58-0211-494a-aeb3-97b2788ff8fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:18.197731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88d41c58-0211-494a-aeb3-97b2788ff8fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.200150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88d41c58-0211-494a-aeb3-97b2788ff8fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.202841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88d41c58-0211-494a-aeb3-97b2788ff8fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.012441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-88d41c58-0211-494a-aeb3-97b2788ff8fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:19.023596 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-88d41c58-0211-494a-aeb3-97b2788ff8fa tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 200 len: 1307 microversion: 2.1 time: 0.867363 Aug 29 15:44:19.037367 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2238/4357] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:18 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 1307 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:19.048467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-57e1798d-aa52-4aa2-8534-a3fd4d4a0f65 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:19.049739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-57e1798d-aa52-4aa2-8534-a3fd4d4a0f65 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:19.103544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57e1798d-aa52-4aa2-8534-a3fd4d4a0f65 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.106838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57e1798d-aa52-4aa2-8534-a3fd4d4a0f65 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.107558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57e1798d-aa52-4aa2-8534-a3fd4d4a0f65 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.108794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57e1798d-aa52-4aa2-8534-a3fd4d4a0f65 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.111132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57e1798d-aa52-4aa2-8534-a3fd4d4a0f65 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.111739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57e1798d-aa52-4aa2-8534-a3fd4d4a0f65 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.342364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a778b5ee-b00a-41c7-9dca-c17bf5e2e04f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:19.368657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a778b5ee-b00a-41c7-9dca-c17bf5e2e04f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:19.376052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a778b5ee-b00a-41c7-9dca-c17bf5e2e04f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:19.377539 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a778b5ee-b00a-41c7-9dca-c17bf5e2e04f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 2.241132 Aug 29 15:44:19.393554 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2120/4358] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:17 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 2257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:19.410030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cdd7cf18-36ac-4f82-8cd3-21d052af1e78 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:19.410828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cdd7cf18-36ac-4f82-8cd3-21d052af1e78 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:19.418030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdd7cf18-36ac-4f82-8cd3-21d052af1e78 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.418770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdd7cf18-36ac-4f82-8cd3-21d052af1e78 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.419363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdd7cf18-36ac-4f82-8cd3-21d052af1e78 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.420490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdd7cf18-36ac-4f82-8cd3-21d052af1e78 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.421125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdd7cf18-36ac-4f82-8cd3-21d052af1e78 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.421697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdd7cf18-36ac-4f82-8cd3-21d052af1e78 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.476333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-57e1798d-aa52-4aa2-8534-a3fd4d4a0f65 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:19.497076 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-57e1798d-aa52-4aa2-8534-a3fd4d4a0f65 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1272 microversion: 2.1 time: 0.458505 Aug 29 15:44:19.502915 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2239/4359] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:19 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1272 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:19.706915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cdd7cf18-36ac-4f82-8cd3-21d052af1e78 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:19.726318 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cdd7cf18-36ac-4f82-8cd3-21d052af1e78 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1284 microversion: 2.1 time: 0.326007 Aug 29 15:44:19.727455 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2121/4360] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:19 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1284 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:20.044426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0739e03c-06ad-48f9-8164-d8b2a1e836b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:20.045341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0739e03c-06ad-48f9-8164-d8b2a1e836b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:20.053707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0739e03c-06ad-48f9-8164-d8b2a1e836b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.054600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0739e03c-06ad-48f9-8164-d8b2a1e836b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.055187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0739e03c-06ad-48f9-8164-d8b2a1e836b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.056070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0739e03c-06ad-48f9-8164-d8b2a1e836b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.056597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0739e03c-06ad-48f9-8164-d8b2a1e836b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.057112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0739e03c-06ad-48f9-8164-d8b2a1e836b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.405729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-605b3b3a-aba2-4649-9c0b-b15fb5748027 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:20.407592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-605b3b3a-aba2-4649-9c0b-b15fb5748027 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:20.417853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605b3b3a-aba2-4649-9c0b-b15fb5748027 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.418604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605b3b3a-aba2-4649-9c0b-b15fb5748027 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.419272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605b3b3a-aba2-4649-9c0b-b15fb5748027 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.420310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605b3b3a-aba2-4649-9c0b-b15fb5748027 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.420986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605b3b3a-aba2-4649-9c0b-b15fb5748027 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.421641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605b3b3a-aba2-4649-9c0b-b15fb5748027 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.643613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0739e03c-06ad-48f9-8164-d8b2a1e836b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:20.667983 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0739e03c-06ad-48f9-8164-d8b2a1e836b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 200 len: 1307 microversion: 2.1 time: 0.627713 Aug 29 15:44:20.671408 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2240/4361] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:20 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 1307 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:20.691748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8d6834d2-33cf-4201-bb55-492d4d5c7fef tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:20.692916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8d6834d2-33cf-4201-bb55-492d4d5c7fef tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:20.704275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d6834d2-33cf-4201-bb55-492d4d5c7fef tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.705072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d6834d2-33cf-4201-bb55-492d4d5c7fef tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.705815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d6834d2-33cf-4201-bb55-492d4d5c7fef tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.706582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d6834d2-33cf-4201-bb55-492d4d5c7fef tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.707945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d6834d2-33cf-4201-bb55-492d4d5c7fef tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.708918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d6834d2-33cf-4201-bb55-492d4d5c7fef tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.884474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-605b3b3a-aba2-4649-9c0b-b15fb5748027 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:20.896058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-605b3b3a-aba2-4649-9c0b-b15fb5748027 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:20.899387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-605b3b3a-aba2-4649-9c0b-b15fb5748027 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:20.901218 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-605b3b3a-aba2-4649-9c0b-b15fb5748027 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.500179 Aug 29 15:44:20.913115 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2122/4362] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:20 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:20.913115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-32f4a195-61be-427a-8fd7-2f22b02af016 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:20.913115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-32f4a195-61be-427a-8fd7-2f22b02af016 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:20.940613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32f4a195-61be-427a-8fd7-2f22b02af016 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.942365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32f4a195-61be-427a-8fd7-2f22b02af016 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.942822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32f4a195-61be-427a-8fd7-2f22b02af016 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.944490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32f4a195-61be-427a-8fd7-2f22b02af016 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.944990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32f4a195-61be-427a-8fd7-2f22b02af016 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.945707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32f4a195-61be-427a-8fd7-2f22b02af016 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.122794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8d6834d2-33cf-4201-bb55-492d4d5c7fef tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:21.132476 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8d6834d2-33cf-4201-bb55-492d4d5c7fef tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1314 microversion: 2.1 time: 0.459764 Aug 29 15:44:21.133417 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2241/4363] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:20 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:21.179883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-32f4a195-61be-427a-8fd7-2f22b02af016 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:21.189920 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-32f4a195-61be-427a-8fd7-2f22b02af016 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1272 microversion: 2.1 time: 0.286350 Aug 29 15:44:21.191116 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2123/4364] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:20 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1272 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:21.693851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-392c2ffa-8a3c-4935-b214-0225a6549af2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:21.694456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-392c2ffa-8a3c-4935-b214-0225a6549af2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:21.703836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392c2ffa-8a3c-4935-b214-0225a6549af2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.704452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392c2ffa-8a3c-4935-b214-0225a6549af2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.705012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392c2ffa-8a3c-4935-b214-0225a6549af2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.705860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392c2ffa-8a3c-4935-b214-0225a6549af2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.707069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392c2ffa-8a3c-4935-b214-0225a6549af2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.709494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-392c2ffa-8a3c-4935-b214-0225a6549af2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.933290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1479f500-2cb1-462a-9fc9-e0ca085add48 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:21.934528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1479f500-2cb1-462a-9fc9-e0ca085add48 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:21.943622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1479f500-2cb1-462a-9fc9-e0ca085add48 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.944308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1479f500-2cb1-462a-9fc9-e0ca085add48 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.944908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1479f500-2cb1-462a-9fc9-e0ca085add48 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.945923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1479f500-2cb1-462a-9fc9-e0ca085add48 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.946540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1479f500-2cb1-462a-9fc9-e0ca085add48 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.947139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1479f500-2cb1-462a-9fc9-e0ca085add48 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:22.272238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-392c2ffa-8a3c-4935-b214-0225a6549af2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:22.292670 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-392c2ffa-8a3c-4935-b214-0225a6549af2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 200 len: 1307 microversion: 2.1 time: 0.604194 Aug 29 15:44:22.294953 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2242/4365] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:21 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 1307 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:22.303440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-34e874d9-ee8d-42e8-96b9-dfc925d30b0d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:22.305613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-34e874d9-ee8d-42e8-96b9-dfc925d30b0d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:22.321967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34e874d9-ee8d-42e8-96b9-dfc925d30b0d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:22.322733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34e874d9-ee8d-42e8-96b9-dfc925d30b0d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:22.323487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34e874d9-ee8d-42e8-96b9-dfc925d30b0d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:22.324417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34e874d9-ee8d-42e8-96b9-dfc925d30b0d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:22.325204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34e874d9-ee8d-42e8-96b9-dfc925d30b0d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:22.325822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34e874d9-ee8d-42e8-96b9-dfc925d30b0d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:22.511758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-34e874d9-ee8d-42e8-96b9-dfc925d30b0d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:22.520619 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-34e874d9-ee8d-42e8-96b9-dfc925d30b0d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1314 microversion: 2.1 time: 0.223784 Aug 29 15:44:22.521260 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2243/4366] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:22 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:22.534442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4f706f6d-f0cc-4242-9997-f778c4d4f2de tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:22.535417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4f706f6d-f0cc-4242-9997-f778c4d4f2de tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:22.542915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f706f6d-f0cc-4242-9997-f778c4d4f2de tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:22.544287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f706f6d-f0cc-4242-9997-f778c4d4f2de tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:22.545008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f706f6d-f0cc-4242-9997-f778c4d4f2de tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:22.545890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f706f6d-f0cc-4242-9997-f778c4d4f2de tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:22.546434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f706f6d-f0cc-4242-9997-f778c4d4f2de tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:22.546868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f706f6d-f0cc-4242-9997-f778c4d4f2de tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:22.783061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4f706f6d-f0cc-4242-9997-f778c4d4f2de tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:22.793777 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4f706f6d-f0cc-4242-9997-f778c4d4f2de tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1314 microversion: 2.1 time: 0.270851 Aug 29 15:44:22.812545 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2244/4367] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:22 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:22.821170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1039476016", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:22.896002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] validate_networks() for None {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:23.059590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1479f500-2cb1-462a-9fc9-e0ca085add48 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:23.069469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1479f500-2cb1-462a-9fc9-e0ca085add48 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:23.070927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1479f500-2cb1-462a-9fc9-e0ca085add48 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:23.072130 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1479f500-2cb1-462a-9fc9-e0ca085add48 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 1.144171 Aug 29 15:44:23.081182 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2124/4368] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:21 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:23.317978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e6abda59-207a-40de-b77b-02ad10b3fe75 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:23.318431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:23.319146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e6abda59-207a-40de-b77b-02ad10b3fe75 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:23.319559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:23.320816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:23.322661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:23.323315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:23.328441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6abda59-207a-40de-b77b-02ad10b3fe75 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.328949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6abda59-207a-40de-b77b-02ad10b3fe75 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.329622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6abda59-207a-40de-b77b-02ad10b3fe75 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.330942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6abda59-207a-40de-b77b-02ad10b3fe75 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.331662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6abda59-207a-40de-b77b-02ad10b3fe75 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.332136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6abda59-207a-40de-b77b-02ad10b3fe75 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.337391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.338365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.338921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.340110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.341104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.342023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.366463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Getting quotas for project be72bf0bb09f48bc9df6ee8e6be4c936. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:23.372740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Getting quotas for user 2cab6d2924ff4befbb84e9c88ddc196b and project be72bf0bb09f48bc9df6ee8e6be4c936. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:23.419350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:23.422423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:23.426824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:23.455359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:23.505388 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c65ec51b-26ee-48f8-8ed0-e90a444caa7a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690417 Aug 29 15:44:23.507164 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2245/4369] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:44:23.518851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1c18dfa8-8ce8-400e-b395-ebe497bca3ad tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:23.519636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1c18dfa8-8ce8-400e-b395-ebe497bca3ad tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:23.702035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1c18dfa8-8ce8-400e-b395-ebe497bca3ad tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:23.715149 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1c18dfa8-8ce8-400e-b395-ebe497bca3ad tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1215 microversion: 2.1 time: 0.199399 Aug 29 15:44:23.717168 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2246/4370] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:23 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:23.723329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9909e596-8666-4116-bf1b-08481164bcc1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:23.724134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9909e596-8666-4116-bf1b-08481164bcc1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:23.732016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9909e596-8666-4116-bf1b-08481164bcc1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.732522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9909e596-8666-4116-bf1b-08481164bcc1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.734248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9909e596-8666-4116-bf1b-08481164bcc1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.734991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9909e596-8666-4116-bf1b-08481164bcc1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.735469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9909e596-8666-4116-bf1b-08481164bcc1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.735901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9909e596-8666-4116-bf1b-08481164bcc1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.931937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9909e596-8666-4116-bf1b-08481164bcc1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:23.943264 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9909e596-8666-4116-bf1b-08481164bcc1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1314 microversion: 2.1 time: 0.223711 Aug 29 15:44:23.957664 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2247/4371] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:23 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:23.965930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-2679a9bb-e39c-45ec-b2ea-c22eee40283b req-c6e283a4-820b-477a-ad0f-95b3115a0dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dcc1f7c-211b-4ed6-a898-31dd9cdb5228", "tag": "f90231df-2485-49aa-844b-2ef5dad9a761"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:23.977680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2679a9bb-e39c-45ec-b2ea-c22eee40283b req-c6e283a4-820b-477a-ad0f-95b3115a0dc1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.978499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2679a9bb-e39c-45ec-b2ea-c22eee40283b req-c6e283a4-820b-477a-ad0f-95b3115a0dc1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.979133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2679a9bb-e39c-45ec-b2ea-c22eee40283b req-c6e283a4-820b-477a-ad0f-95b3115a0dc1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.994023 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-2679a9bb-e39c-45ec-b2ea-c22eee40283b req-c6e283a4-820b-477a-ad0f-95b3115a0dc1 service nova] Creating event network-changed:f90231df-2485-49aa-844b-2ef5dad9a761 for instance 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 on n-h2-839401-11 Aug 29 15:44:24.001623 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-2679a9bb-e39c-45ec-b2ea-c22eee40283b req-c6e283a4-820b-477a-ad0f-95b3115a0dc1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042137 Aug 29 15:44:24.002707 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2248/4372] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:24.009298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c1361f69-94e0-4240-b551-ed44b80a0ad4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:24.010444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c1361f69-94e0-4240-b551-ed44b80a0ad4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:24.018683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1361f69-94e0-4240-b551-ed44b80a0ad4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.019486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1361f69-94e0-4240-b551-ed44b80a0ad4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.020258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1361f69-94e0-4240-b551-ed44b80a0ad4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.021357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1361f69-94e0-4240-b551-ed44b80a0ad4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.022073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1361f69-94e0-4240-b551-ed44b80a0ad4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.022691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1361f69-94e0-4240-b551-ed44b80a0ad4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.190074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c1361f69-94e0-4240-b551-ed44b80a0ad4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:24.198951 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c1361f69-94e0-4240-b551-ed44b80a0ad4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1314 microversion: 2.1 time: 0.194643 Aug 29 15:44:24.199653 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2249/4373] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:24 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:24.204647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d5153a8d-38a1-4eda-aeae-7ad04c3e09c9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:24.205401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d5153a8d-38a1-4eda-aeae-7ad04c3e09c9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:24.211634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5153a8d-38a1-4eda-aeae-7ad04c3e09c9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.212227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5153a8d-38a1-4eda-aeae-7ad04c3e09c9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.212680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5153a8d-38a1-4eda-aeae-7ad04c3e09c9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.213411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5153a8d-38a1-4eda-aeae-7ad04c3e09c9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.213880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5153a8d-38a1-4eda-aeae-7ad04c3e09c9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.214310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5153a8d-38a1-4eda-aeae-7ad04c3e09c9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.293669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e6abda59-207a-40de-b77b-02ad10b3fe75 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:24.310296 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e6abda59-207a-40de-b77b-02ad10b3fe75 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 200 len: 1307 microversion: 2.1 time: 0.996722 Aug 29 15:44:24.311995 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2125/4374] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:23 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 1307 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:24.468364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-49e541f3-9872-442b-aef2-182e5045756a tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-815779923", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:24.474211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d5153a8d-38a1-4eda-aeae-7ad04c3e09c9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:24.475257 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-49e541f3-9872-442b-aef2-182e5045756a tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] HTTP exception thrown: min_count must be <= max_count Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-49e541f3-9872-442b-aef2-182e5045756a tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] Request method failure captured: Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 183 Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN7XaScauideEJmBgn47k4AXYKmuV4MGiBtd6IUAtEbjSsxXCBRCb4LtUV4w96XzPDy7D7lDxx0F5ZckAFEOlKS-CCdh9a-kun7uhtv5Qvc8fhWKaSqTvWaZSCtGTy0mgNRREJlrSXEH2VPnTez1sbYMOhJflMi0v-Czq-yryBqx3bg Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: c8912313055044499f3d525b3927a6f3 Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-65538209 Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c8912313055044499f3d525b3927a6f3", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c8912313055044499f3d525b3927a6f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c8912313055044499f3d525b3927a6f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c8912313055044499f3d525b3927a6f3"}]}] Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-65538209 Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: c8912313055044499f3d525b3927a6f3 Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-65538209 Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-MultipleCreateNegativeTestJSON-65538209-project Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 8a3751b1484449e8b8d92441a5345a82 Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-65538209-project Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-815779923", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: exception: min_count must be <= max_count Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-815779923', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 29 15:44:24.477234 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.486544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d5153a8d-38a1-4eda-aeae-7ad04c3e09c9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:24.488244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d5153a8d-38a1-4eda-aeae-7ad04c3e09c9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:24.489509 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d5153a8d-38a1-4eda-aeae-7ad04c3e09c9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.288775 Aug 29 15:44:24.493735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-49e541f3-9872-442b-aef2-182e5045756a tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] Returning 400 to user: min_count must be <= max_count {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:24.495471 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-49e541f3-9872-442b-aef2-182e5045756a tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.182256 Aug 29 15:44:24.496306 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2126/4375] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:24 2022] POST /compute/v2.1/servers => generated 74 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:44:24.502089 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2250/4376] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:24 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:24.558108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-10fb26a6-3178-490a-af87-ee3382fefd3d tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1964857840", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "max_count": 0}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-10fb26a6-3178-490a-af87-ee3382fefd3d tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] Request method failure captured: Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 168 Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN7XaScauideEJmBgn47k4AXYKmuV4MGiBtd6IUAtEbjSsxXCBRCb4LtUV4w96XzPDy7D7lDxx0F5ZckAFEOlKS-CCdh9a-kun7uhtv5Qvc8fhWKaSqTvWaZSCtGTy0mgNRREJlrSXEH2VPnTez1sbYMOhJflMi0v-Czq-yryBqx3bg Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: c8912313055044499f3d525b3927a6f3 Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-65538209 Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c8912313055044499f3d525b3927a6f3", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c8912313055044499f3d525b3927a6f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c8912313055044499f3d525b3927a6f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c8912313055044499f3d525b3927a6f3"}]}] Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-65538209 Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: c8912313055044499f3d525b3927a6f3 Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-65538209 Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-MultipleCreateNegativeTestJSON-65538209-project Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 8a3751b1484449e8b8d92441a5345a82 Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-65538209-project Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1964857840", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "max_count": 0}} Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1964857840', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'max_count': 0}}} Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 0 Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:44:24.562183 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-10fb26a6-3178-490a-af87-ee3382fefd3d tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-10fb26a6-3178-490a-af87-ee3382fefd3d tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009506 Aug 29 15:44:24.566623 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2127/4377] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:24 2022] POST /compute/v2.1/servers => generated 130 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:44:24.620639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8c3cf607-2806-449c-8d56-8fc291aac295 tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-292171012", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "max_count": 2.5}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8c3cf607-2806-449c-8d56-8fc291aac295 tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] Request method failure captured: Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 169 Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN7XaScauideEJmBgn47k4AXYKmuV4MGiBtd6IUAtEbjSsxXCBRCb4LtUV4w96XzPDy7D7lDxx0F5ZckAFEOlKS-CCdh9a-kun7uhtv5Qvc8fhWKaSqTvWaZSCtGTy0mgNRREJlrSXEH2VPnTez1sbYMOhJflMi0v-Czq-yryBqx3bg Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: c8912313055044499f3d525b3927a6f3 Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-65538209 Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c8912313055044499f3d525b3927a6f3", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c8912313055044499f3d525b3927a6f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c8912313055044499f3d525b3927a6f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c8912313055044499f3d525b3927a6f3"}]}] Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-65538209 Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: c8912313055044499f3d525b3927a6f3 Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-65538209 Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-MultipleCreateNegativeTestJSON-65538209-project Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 8a3751b1484449e8b8d92441a5345a82 Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-65538209-project Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-292171012", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "max_count": 2.5}} Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-292171012', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'max_count': 2.5}}} Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 2.5 Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:44:24.624952 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8c3cf607-2806-449c-8d56-8fc291aac295 tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8c3cf607-2806-449c-8d56-8fc291aac295 tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010232 Aug 29 15:44:24.635238 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2251/4378] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:24 2022] POST /compute/v2.1/servers => generated 139 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:44:24.681838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-868ce87f-0fb1-4cb6-9a79-66f5bc6b5fca tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-333997752", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "min_count": 0}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-868ce87f-0fb1-4cb6-9a79-66f5bc6b5fca tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] Request method failure captured: Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 167 Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN7XaScauideEJmBgn47k4AXYKmuV4MGiBtd6IUAtEbjSsxXCBRCb4LtUV4w96XzPDy7D7lDxx0F5ZckAFEOlKS-CCdh9a-kun7uhtv5Qvc8fhWKaSqTvWaZSCtGTy0mgNRREJlrSXEH2VPnTez1sbYMOhJflMi0v-Czq-yryBqx3bg Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: c8912313055044499f3d525b3927a6f3 Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-65538209 Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c8912313055044499f3d525b3927a6f3", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c8912313055044499f3d525b3927a6f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c8912313055044499f3d525b3927a6f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c8912313055044499f3d525b3927a6f3"}]}] Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-65538209 Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: c8912313055044499f3d525b3927a6f3 Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-65538209 Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-MultipleCreateNegativeTestJSON-65538209-project Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 8a3751b1484449e8b8d92441a5345a82 Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-65538209-project Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-333997752", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "min_count": 0}} Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-333997752', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'min_count': 0}}} Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 0 Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:44:24.686122 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-868ce87f-0fb1-4cb6-9a79-66f5bc6b5fca tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-868ce87f-0fb1-4cb6-9a79-66f5bc6b5fca tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.010297 Aug 29 15:44:24.690152 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2128/4379] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:24 2022] POST /compute/v2.1/servers => generated 130 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:44:24.742406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7f79fe22-0b44-4982-bc3c-1f993eee708f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:24.743246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7f79fe22-0b44-4982-bc3c-1f993eee708f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:24.758775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f79fe22-0b44-4982-bc3c-1f993eee708f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.759909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f79fe22-0b44-4982-bc3c-1f993eee708f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.760387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f79fe22-0b44-4982-bc3c-1f993eee708f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.761227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f79fe22-0b44-4982-bc3c-1f993eee708f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.761714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f79fe22-0b44-4982-bc3c-1f993eee708f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.762154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f79fe22-0b44-4982-bc3c-1f993eee708f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.839534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fe7181a9-48e7-4865-956a-a33042272d7f tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1838363150", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "min_count": 2.5}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fe7181a9-48e7-4865-956a-a33042272d7f tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] Request method failure captured: Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 170 Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN7XaScauideEJmBgn47k4AXYKmuV4MGiBtd6IUAtEbjSsxXCBRCb4LtUV4w96XzPDy7D7lDxx0F5ZckAFEOlKS-CCdh9a-kun7uhtv5Qvc8fhWKaSqTvWaZSCtGTy0mgNRREJlrSXEH2VPnTez1sbYMOhJflMi0v-Czq-yryBqx3bg Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: c8912313055044499f3d525b3927a6f3 Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-65538209 Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c8912313055044499f3d525b3927a6f3", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c8912313055044499f3d525b3927a6f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c8912313055044499f3d525b3927a6f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c8912313055044499f3d525b3927a6f3"}]}] Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-65538209 Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: c8912313055044499f3d525b3927a6f3 Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-65538209 Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-MultipleCreateNegativeTestJSON-65538209-project Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 8a3751b1484449e8b8d92441a5345a82 Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-65538209-project Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1838363150", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "min_count": 2.5}} Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1838363150', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'min_count': 2.5}}} Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 2.5 Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:44:24.850678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fe7181a9-48e7-4865-956a-a33042272d7f tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fe7181a9-48e7-4865-956a-a33042272d7f tempest-MultipleCreateNegativeTestJSON-65538209 tempest-MultipleCreateNegativeTestJSON-65538209-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017500 Aug 29 15:44:24.859214 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2129/4380] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:24 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:44:24.874740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7f79fe22-0b44-4982-bc3c-1f993eee708f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:24.884872 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7f79fe22-0b44-4982-bc3c-1f993eee708f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1267 microversion: 2.1 time: 0.149561 Aug 29 15:44:24.890143 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2252/4381] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:24 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:24.971849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5d14adb9-7056-49bd-9e04-a6e507b75838 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:24.972485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5d14adb9-7056-49bd-9e04-a6e507b75838 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:24.984561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d14adb9-7056-49bd-9e04-a6e507b75838 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.985503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d14adb9-7056-49bd-9e04-a6e507b75838 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.985987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d14adb9-7056-49bd-9e04-a6e507b75838 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.988268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d14adb9-7056-49bd-9e04-a6e507b75838 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.988755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d14adb9-7056-49bd-9e04-a6e507b75838 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.989274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d14adb9-7056-49bd-9e04-a6e507b75838 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.222466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1eb6edc8-eb75-4b22-8986-f13414d525c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:25.223824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1eb6edc8-eb75-4b22-8986-f13414d525c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:25.236961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1eb6edc8-eb75-4b22-8986-f13414d525c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.237822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1eb6edc8-eb75-4b22-8986-f13414d525c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.238619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1eb6edc8-eb75-4b22-8986-f13414d525c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.239653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1eb6edc8-eb75-4b22-8986-f13414d525c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.240742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1eb6edc8-eb75-4b22-8986-f13414d525c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.241514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1eb6edc8-eb75-4b22-8986-f13414d525c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.264679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:25.413456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1eb6edc8-eb75-4b22-8986-f13414d525c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:25.422758 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1eb6edc8-eb75-4b22-8986-f13414d525c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1314 microversion: 2.1 time: 0.206641 Aug 29 15:44:25.423555 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2253/4382] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:25 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:25.429354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f8fa32ec-8f36-4140-9d7f-59ca086d3e1a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:25.430538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f8fa32ec-8f36-4140-9d7f-59ca086d3e1a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:25.438034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8fa32ec-8f36-4140-9d7f-59ca086d3e1a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.438556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8fa32ec-8f36-4140-9d7f-59ca086d3e1a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.438988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8fa32ec-8f36-4140-9d7f-59ca086d3e1a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.439679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8fa32ec-8f36-4140-9d7f-59ca086d3e1a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.440128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8fa32ec-8f36-4140-9d7f-59ca086d3e1a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.440657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8fa32ec-8f36-4140-9d7f-59ca086d3e1a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.637121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f8fa32ec-8f36-4140-9d7f-59ca086d3e1a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:25.650360 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f8fa32ec-8f36-4140-9d7f-59ca086d3e1a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 200 len: 1307 microversion: 2.1 time: 0.225148 Aug 29 15:44:25.669263 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2254/4383] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:25 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 1307 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:25.677199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a2390e63-f2bf-4372-bfb0-90021b81a275 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:25.678178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a2390e63-f2bf-4372-bfb0-90021b81a275 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:25.685979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2390e63-f2bf-4372-bfb0-90021b81a275 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.686860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2390e63-f2bf-4372-bfb0-90021b81a275 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.687989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2390e63-f2bf-4372-bfb0-90021b81a275 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.689070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2390e63-f2bf-4372-bfb0-90021b81a275 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.692537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2390e63-f2bf-4372-bfb0-90021b81a275 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.693051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2390e63-f2bf-4372-bfb0-90021b81a275 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.093187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a2390e63-f2bf-4372-bfb0-90021b81a275 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:26.111788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5d14adb9-7056-49bd-9e04-a6e507b75838 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:26.119816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a2390e63-f2bf-4372-bfb0-90021b81a275 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:26.125516 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5d14adb9-7056-49bd-9e04-a6e507b75838 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1314 microversion: 2.1 time: 1.161409 Aug 29 15:44:26.126652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a2390e63-f2bf-4372-bfb0-90021b81a275 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:26.127532 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2130/4384] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:24 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1314 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:26.137424 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a2390e63-f2bf-4372-bfb0-90021b81a275 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.460388 Aug 29 15:44:26.138800 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2255/4385] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:25 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:26.143605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d9f9fc1d-c6e9-4f5d-9ba4-0179782aca4f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:26.144236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d9f9fc1d-c6e9-4f5d-9ba4-0179782aca4f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:26.175404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-7593270e-e943-44a0-8225-a6af57bb9a36 req-7c4a0d70-a5dd-4bc6-a60a-12057e21b50f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824db4a3-47bf-494c-b490-d7631b6d9d54", "tag": "98e91a7f-1a84-4261-8c1b-359bdbdb9f7e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:26.177640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9f9fc1d-c6e9-4f5d-9ba4-0179782aca4f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.179326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9f9fc1d-c6e9-4f5d-9ba4-0179782aca4f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.179787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9f9fc1d-c6e9-4f5d-9ba4-0179782aca4f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.184207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9f9fc1d-c6e9-4f5d-9ba4-0179782aca4f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.184207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9f9fc1d-c6e9-4f5d-9ba4-0179782aca4f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.184510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9f9fc1d-c6e9-4f5d-9ba4-0179782aca4f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.196572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7593270e-e943-44a0-8225-a6af57bb9a36 req-7c4a0d70-a5dd-4bc6-a60a-12057e21b50f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.197074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7593270e-e943-44a0-8225-a6af57bb9a36 req-7c4a0d70-a5dd-4bc6-a60a-12057e21b50f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.197705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7593270e-e943-44a0-8225-a6af57bb9a36 req-7c4a0d70-a5dd-4bc6-a60a-12057e21b50f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.215435 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-7593270e-e943-44a0-8225-a6af57bb9a36 req-7c4a0d70-a5dd-4bc6-a60a-12057e21b50f service nova] Creating event network-changed:98e91a7f-1a84-4261-8c1b-359bdbdb9f7e for instance 824db4a3-47bf-494c-b490-d7631b6d9d54 on n-h1-839401-11 Aug 29 15:44:26.223171 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-7593270e-e943-44a0-8225-a6af57bb9a36 req-7c4a0d70-a5dd-4bc6-a60a-12057e21b50f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057225 Aug 29 15:44:26.224639 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2131/4386] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:26.297693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d9f9fc1d-c6e9-4f5d-9ba4-0179782aca4f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:26.307778 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d9f9fc1d-c6e9-4f5d-9ba4-0179782aca4f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1273 microversion: 2.1 time: 0.168013 Aug 29 15:44:26.308371 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2256/4387] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:26 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:26.444720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c07b760e-2770-4ac6-a29a-af7dbbca5537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:26.445969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c07b760e-2770-4ac6-a29a-af7dbbca5537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:26.452269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c07b760e-2770-4ac6-a29a-af7dbbca5537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.452923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c07b760e-2770-4ac6-a29a-af7dbbca5537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.453451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c07b760e-2770-4ac6-a29a-af7dbbca5537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.454184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c07b760e-2770-4ac6-a29a-af7dbbca5537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.454646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c07b760e-2770-4ac6-a29a-af7dbbca5537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.455279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c07b760e-2770-4ac6-a29a-af7dbbca5537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.673511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-182b6e63-4691-4b92-9014-1b033f3bcaee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:26.674132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-182b6e63-4691-4b92-9014-1b033f3bcaee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:26.680574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-182b6e63-4691-4b92-9014-1b033f3bcaee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.681074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-182b6e63-4691-4b92-9014-1b033f3bcaee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.681574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-182b6e63-4691-4b92-9014-1b033f3bcaee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.682279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-182b6e63-4691-4b92-9014-1b033f3bcaee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.682773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-182b6e63-4691-4b92-9014-1b033f3bcaee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.683206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-182b6e63-4691-4b92-9014-1b033f3bcaee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.805076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c07b760e-2770-4ac6-a29a-af7dbbca5537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:26.814777 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c07b760e-2770-4ac6-a29a-af7dbbca5537 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1314 microversion: 2.1 time: 0.374748 Aug 29 15:44:26.828857 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2132/4388] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:26 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:26.876582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-182b6e63-4691-4b92-9014-1b033f3bcaee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:26.885775 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-182b6e63-4691-4b92-9014-1b033f3bcaee tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 200 len: 1307 microversion: 2.1 time: 0.216224 Aug 29 15:44:26.900201 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2257/4389] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:26 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 1307 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:27.069902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-60ad597f-ee76-4f9d-89d1-ca97146bd56d req-1a42df34-da84-4930-aead-a3dc6f43aa48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5219eda0-3ed8-4c6e-ba04-19ed69930d86", "name": "network-vif-plugged", "status": "completed", "tag": "eef1db13-8722-4bfa-a4c5-4d45002ee03b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:27.083084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-60ad597f-ee76-4f9d-89d1-ca97146bd56d req-1a42df34-da84-4930-aead-a3dc6f43aa48 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.083918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-60ad597f-ee76-4f9d-89d1-ca97146bd56d req-1a42df34-da84-4930-aead-a3dc6f43aa48 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.084579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-60ad597f-ee76-4f9d-89d1-ca97146bd56d req-1a42df34-da84-4930-aead-a3dc6f43aa48 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.098233 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-60ad597f-ee76-4f9d-89d1-ca97146bd56d req-1a42df34-da84-4930-aead-a3dc6f43aa48 service nova] Creating event network-vif-plugged:eef1db13-8722-4bfa-a4c5-4d45002ee03b for instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 on n-h1-839401-11 Aug 29 15:44:27.104480 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-60ad597f-ee76-4f9d-89d1-ca97146bd56d req-1a42df34-da84-4930-aead-a3dc6f43aa48 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040522 Aug 29 15:44:27.106378 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2133/4390] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:27.166213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f19bd7a2-c2b2-4e1a-90d9-67a639105432 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.167816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f19bd7a2-c2b2-4e1a-90d9-67a639105432 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:27.168587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5264279a-9548-4273-8617-8c9346ea2abc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.169510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5264279a-9548-4273-8617-8c9346ea2abc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:27.180819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f19bd7a2-c2b2-4e1a-90d9-67a639105432 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.181065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5264279a-9548-4273-8617-8c9346ea2abc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.181822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5264279a-9548-4273-8617-8c9346ea2abc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.182276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5264279a-9548-4273-8617-8c9346ea2abc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.183049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5264279a-9548-4273-8617-8c9346ea2abc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.183514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5264279a-9548-4273-8617-8c9346ea2abc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.183946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5264279a-9548-4273-8617-8c9346ea2abc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.184062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f19bd7a2-c2b2-4e1a-90d9-67a639105432 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.185437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f19bd7a2-c2b2-4e1a-90d9-67a639105432 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.187534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f19bd7a2-c2b2-4e1a-90d9-67a639105432 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.188134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f19bd7a2-c2b2-4e1a-90d9-67a639105432 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.190334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f19bd7a2-c2b2-4e1a-90d9-67a639105432 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.400533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f19bd7a2-c2b2-4e1a-90d9-67a639105432 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.410661 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f19bd7a2-c2b2-4e1a-90d9-67a639105432 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1314 microversion: 2.1 time: 0.249967 Aug 29 15:44:27.411659 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2258/4391] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:27 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:27.417119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-994bac69-72a3-4d5d-ac36-bdf6df2e3f4b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.417739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-994bac69-72a3-4d5d-ac36-bdf6df2e3f4b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:27.425920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-994bac69-72a3-4d5d-ac36-bdf6df2e3f4b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.426774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-994bac69-72a3-4d5d-ac36-bdf6df2e3f4b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.427872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-994bac69-72a3-4d5d-ac36-bdf6df2e3f4b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.429576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-994bac69-72a3-4d5d-ac36-bdf6df2e3f4b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.430581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-994bac69-72a3-4d5d-ac36-bdf6df2e3f4b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.431338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-994bac69-72a3-4d5d-ac36-bdf6df2e3f4b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.522110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5264279a-9548-4273-8617-8c9346ea2abc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.528434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-994bac69-72a3-4d5d-ac36-bdf6df2e3f4b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.541595 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-994bac69-72a3-4d5d-ac36-bdf6df2e3f4b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1273 microversion: 2.1 time: 0.128392 Aug 29 15:44:27.545629 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2259/4392] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:27 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:27.546605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5264279a-9548-4273-8617-8c9346ea2abc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.548111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5264279a-9548-4273-8617-8c9346ea2abc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.549670 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5264279a-9548-4273-8617-8c9346ea2abc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.386032 Aug 29 15:44:27.550302 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2134/4393] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:27 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:27.842097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f8da9e97-c4af-4bd1-8505-56c404fcb3fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.843109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f8da9e97-c4af-4bd1-8505-56c404fcb3fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:27.856777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8da9e97-c4af-4bd1-8505-56c404fcb3fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.857412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8da9e97-c4af-4bd1-8505-56c404fcb3fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.857928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8da9e97-c4af-4bd1-8505-56c404fcb3fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.858859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8da9e97-c4af-4bd1-8505-56c404fcb3fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.859390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8da9e97-c4af-4bd1-8505-56c404fcb3fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.860044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8da9e97-c4af-4bd1-8505-56c404fcb3fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.912689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-744b49af-66be-4448-9c45-0065714e97e5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.913617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-744b49af-66be-4448-9c45-0065714e97e5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:27.920807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-744b49af-66be-4448-9c45-0065714e97e5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.921372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-744b49af-66be-4448-9c45-0065714e97e5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.921812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-744b49af-66be-4448-9c45-0065714e97e5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.922572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-744b49af-66be-4448-9c45-0065714e97e5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.923220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-744b49af-66be-4448-9c45-0065714e97e5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.923649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-744b49af-66be-4448-9c45-0065714e97e5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.001787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f8da9e97-c4af-4bd1-8505-56c404fcb3fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.014388 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f8da9e97-c4af-4bd1-8505-56c404fcb3fc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1314 microversion: 2.1 time: 0.181301 Aug 29 15:44:28.015798 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2260/4394] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:27 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:28.331146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-744b49af-66be-4448-9c45-0065714e97e5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.342820 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-744b49af-66be-4448-9c45-0065714e97e5 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 200 len: 1307 microversion: 2.1 time: 0.438724 Aug 29 15:44:28.344239 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2135/4395] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:27 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 1307 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:28.435036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f8361240-a0af-46a1-8cd2-13d13da681a5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.435679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f8361240-a0af-46a1-8cd2-13d13da681a5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:28.442760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8361240-a0af-46a1-8cd2-13d13da681a5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.443273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8361240-a0af-46a1-8cd2-13d13da681a5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.443783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8361240-a0af-46a1-8cd2-13d13da681a5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.444552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8361240-a0af-46a1-8cd2-13d13da681a5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.445213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8361240-a0af-46a1-8cd2-13d13da681a5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.445871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8361240-a0af-46a1-8cd2-13d13da681a5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.569749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4997f7a0-faf4-4547-a04e-47ac0d54447a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.570779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4997f7a0-faf4-4547-a04e-47ac0d54447a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:28.590134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4997f7a0-faf4-4547-a04e-47ac0d54447a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.590730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4997f7a0-faf4-4547-a04e-47ac0d54447a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.591186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4997f7a0-faf4-4547-a04e-47ac0d54447a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.591952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4997f7a0-faf4-4547-a04e-47ac0d54447a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.592418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4997f7a0-faf4-4547-a04e-47ac0d54447a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.596168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4997f7a0-faf4-4547-a04e-47ac0d54447a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.655369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:28.712288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f8361240-a0af-46a1-8cd2-13d13da681a5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.776242 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f8361240-a0af-46a1-8cd2-13d13da681a5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1314 microversion: 2.1 time: 0.290251 Aug 29 15:44:28.777133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4997f7a0-faf4-4547-a04e-47ac0d54447a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.778083 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2261/4396] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:28 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:28.789006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e961163f-dde0-4bcc-a5b8-0e6adb5704d2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.797843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e961163f-dde0-4bcc-a5b8-0e6adb5704d2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:28.801129 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4997f7a0-faf4-4547-a04e-47ac0d54447a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1273 microversion: 2.1 time: 0.237614 Aug 29 15:44:28.809507 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2136/4397] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:28 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1273 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:28.820093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e961163f-dde0-4bcc-a5b8-0e6adb5704d2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.820667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e961163f-dde0-4bcc-a5b8-0e6adb5704d2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.821141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e961163f-dde0-4bcc-a5b8-0e6adb5704d2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.822195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e961163f-dde0-4bcc-a5b8-0e6adb5704d2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.822827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e961163f-dde0-4bcc-a5b8-0e6adb5704d2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.823413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e961163f-dde0-4bcc-a5b8-0e6adb5704d2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.035999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-02223ba2-8f35-4ee1-ae8e-b4d2461af12d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:29.038385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-02223ba2-8f35-4ee1-ae8e-b4d2461af12d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:29.046317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02223ba2-8f35-4ee1-ae8e-b4d2461af12d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.047162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02223ba2-8f35-4ee1-ae8e-b4d2461af12d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.047806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02223ba2-8f35-4ee1-ae8e-b4d2461af12d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.048759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02223ba2-8f35-4ee1-ae8e-b4d2461af12d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.049612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02223ba2-8f35-4ee1-ae8e-b4d2461af12d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.050246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02223ba2-8f35-4ee1-ae8e-b4d2461af12d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.174625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e961163f-dde0-4bcc-a5b8-0e6adb5704d2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:29.211007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e961163f-dde0-4bcc-a5b8-0e6adb5704d2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:29.215757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e961163f-dde0-4bcc-a5b8-0e6adb5704d2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:29.218758 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e961163f-dde0-4bcc-a5b8-0e6adb5704d2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.438916 Aug 29 15:44:29.219778 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2262/4398] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:28 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:29.364343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5bb1c321-b1b4-48be-b6d5-0a358320784c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:29.365377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5bb1c321-b1b4-48be-b6d5-0a358320784c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:29.372873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bb1c321-b1b4-48be-b6d5-0a358320784c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.374116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bb1c321-b1b4-48be-b6d5-0a358320784c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.375130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bb1c321-b1b4-48be-b6d5-0a358320784c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.376638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bb1c321-b1b4-48be-b6d5-0a358320784c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.377173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bb1c321-b1b4-48be-b6d5-0a358320784c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.377851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bb1c321-b1b4-48be-b6d5-0a358320784c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.707635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5bb1c321-b1b4-48be-b6d5-0a358320784c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:29.717589 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5bb1c321-b1b4-48be-b6d5-0a358320784c tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 200 len: 1307 microversion: 2.1 time: 0.357428 Aug 29 15:44:29.729471 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2263/4399] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:29 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 1307 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:29.797624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c16043aa-baec-4be6-98cd-8aee58388623 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:29.798279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c16043aa-baec-4be6-98cd-8aee58388623 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:29.808964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c16043aa-baec-4be6-98cd-8aee58388623 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.812800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c16043aa-baec-4be6-98cd-8aee58388623 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.813338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c16043aa-baec-4be6-98cd-8aee58388623 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.814153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c16043aa-baec-4be6-98cd-8aee58388623 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.814653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c16043aa-baec-4be6-98cd-8aee58388623 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.815094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c16043aa-baec-4be6-98cd-8aee58388623 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.123718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c16043aa-baec-4be6-98cd-8aee58388623 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.133501 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c16043aa-baec-4be6-98cd-8aee58388623 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1314 microversion: 2.1 time: 0.339664 Aug 29 15:44:30.134722 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2264/4400] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:29 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:30.141664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b5c04ecf-c0b3-4536-81e8-4cd259237443 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:30.142498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b5c04ecf-c0b3-4536-81e8-4cd259237443 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:30.151936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5c04ecf-c0b3-4536-81e8-4cd259237443 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.152441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5c04ecf-c0b3-4536-81e8-4cd259237443 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.152887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5c04ecf-c0b3-4536-81e8-4cd259237443 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.153629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5c04ecf-c0b3-4536-81e8-4cd259237443 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.154313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5c04ecf-c0b3-4536-81e8-4cd259237443 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.155457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5c04ecf-c0b3-4536-81e8-4cd259237443 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.250868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b5c04ecf-c0b3-4536-81e8-4cd259237443 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.259962 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b5c04ecf-c0b3-4536-81e8-4cd259237443 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1273 microversion: 2.1 time: 0.123604 Aug 29 15:44:30.261218 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2265/4401] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:30 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:30.273356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3e5df6ff-68c8-4613-8cbb-f350cc0a4b1e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:30.273356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3e5df6ff-68c8-4613-8cbb-f350cc0a4b1e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:30.281835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e5df6ff-68c8-4613-8cbb-f350cc0a4b1e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.282973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e5df6ff-68c8-4613-8cbb-f350cc0a4b1e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.282973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e5df6ff-68c8-4613-8cbb-f350cc0a4b1e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.283565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e5df6ff-68c8-4613-8cbb-f350cc0a4b1e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.284793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e5df6ff-68c8-4613-8cbb-f350cc0a4b1e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.285258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e5df6ff-68c8-4613-8cbb-f350cc0a4b1e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.318575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-02223ba2-8f35-4ee1-ae8e-b4d2461af12d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.336300 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-02223ba2-8f35-4ee1-ae8e-b4d2461af12d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1314 microversion: 2.1 time: 1.304388 Aug 29 15:44:30.337238 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2137/4402] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:29 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1314 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:30.573650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3e5df6ff-68c8-4613-8cbb-f350cc0a4b1e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.584550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3e5df6ff-68c8-4613-8cbb-f350cc0a4b1e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.586420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3e5df6ff-68c8-4613-8cbb-f350cc0a4b1e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.587763 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3e5df6ff-68c8-4613-8cbb-f350cc0a4b1e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.325284 Aug 29 15:44:30.593698 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2266/4403] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:30 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:30.749675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c4302d0c-226d-4751-874c-cfdaca8aaed0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:30.750949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c4302d0c-226d-4751-874c-cfdaca8aaed0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:30.762345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4302d0c-226d-4751-874c-cfdaca8aaed0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.766632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4302d0c-226d-4751-874c-cfdaca8aaed0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.767372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4302d0c-226d-4751-874c-cfdaca8aaed0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.769215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4302d0c-226d-4751-874c-cfdaca8aaed0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.770337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4302d0c-226d-4751-874c-cfdaca8aaed0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.771604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4302d0c-226d-4751-874c-cfdaca8aaed0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.782113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-16e04acf-09fb-48c9-b29d-8bc6d6e536af req-648586fc-8692-4dc6-b32d-d0cc80c7cfec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcc1f7c-211b-4ed6-a898-31dd9cdb5228", "name": "network-vif-plugged", "status": "completed", "tag": "f90231df-2485-49aa-844b-2ef5dad9a761"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:30.796782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-16e04acf-09fb-48c9-b29d-8bc6d6e536af req-648586fc-8692-4dc6-b32d-d0cc80c7cfec service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.797869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-16e04acf-09fb-48c9-b29d-8bc6d6e536af req-648586fc-8692-4dc6-b32d-d0cc80c7cfec service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.798566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-16e04acf-09fb-48c9-b29d-8bc6d6e536af req-648586fc-8692-4dc6-b32d-d0cc80c7cfec service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.815844 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-16e04acf-09fb-48c9-b29d-8bc6d6e536af req-648586fc-8692-4dc6-b32d-d0cc80c7cfec service nova] Creating event network-vif-plugged:f90231df-2485-49aa-844b-2ef5dad9a761 for instance 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 on n-h2-839401-11 Aug 29 15:44:30.824060 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-16e04acf-09fb-48c9-b29d-8bc6d6e536af req-648586fc-8692-4dc6-b32d-d0cc80c7cfec service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048003 Aug 29 15:44:30.825355 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2267/4404] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:44:31.157872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3d736d08-9df0-4e1c-8058-706f4f958231 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:31.159550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3d736d08-9df0-4e1c-8058-706f4f958231 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:31.172877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d736d08-9df0-4e1c-8058-706f4f958231 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.174759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d736d08-9df0-4e1c-8058-706f4f958231 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.177111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d736d08-9df0-4e1c-8058-706f4f958231 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.178287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d736d08-9df0-4e1c-8058-706f4f958231 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.178996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d736d08-9df0-4e1c-8058-706f4f958231 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.179901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d736d08-9df0-4e1c-8058-706f4f958231 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.329209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c4302d0c-226d-4751-874c-cfdaca8aaed0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.344688 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c4302d0c-226d-4751-874c-cfdaca8aaed0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 200 len: 1307 microversion: 2.1 time: 0.602313 Aug 29 15:44:31.350967 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2138/4405] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:30 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 1307 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:31.371206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-13cf1965-21ac-4518-ac52-93d7e42f9c2f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:31.372565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3d736d08-9df0-4e1c-8058-706f4f958231 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.377688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-13cf1965-21ac-4518-ac52-93d7e42f9c2f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:31.391115 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3d736d08-9df0-4e1c-8058-706f4f958231 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1314 microversion: 2.1 time: 0.238290 Aug 29 15:44:31.401468 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2268/4406] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:31 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:31.401862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-13cf1965-21ac-4518-ac52-93d7e42f9c2f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.401862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-13cf1965-21ac-4518-ac52-93d7e42f9c2f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.401862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-13cf1965-21ac-4518-ac52-93d7e42f9c2f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.401862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-13cf1965-21ac-4518-ac52-93d7e42f9c2f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.401862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-13cf1965-21ac-4518-ac52-93d7e42f9c2f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.401862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-13cf1965-21ac-4518-ac52-93d7e42f9c2f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.404642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-411eff4a-cec7-4493-a6e0-e30e5006f2d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:31.405448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-411eff4a-cec7-4493-a6e0-e30e5006f2d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:31.412128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-411eff4a-cec7-4493-a6e0-e30e5006f2d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.412641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-411eff4a-cec7-4493-a6e0-e30e5006f2d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.413112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-411eff4a-cec7-4493-a6e0-e30e5006f2d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.413862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-411eff4a-cec7-4493-a6e0-e30e5006f2d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.414330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-411eff4a-cec7-4493-a6e0-e30e5006f2d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.414758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-411eff4a-cec7-4493-a6e0-e30e5006f2d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.648757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-411eff4a-cec7-4493-a6e0-e30e5006f2d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.657799 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-411eff4a-cec7-4493-a6e0-e30e5006f2d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1314 microversion: 2.1 time: 0.264499 Aug 29 15:44:31.658610 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2269/4407] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:31 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:31.663393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1739f4fa-a997-4315-a2db-57b92ccdd61d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:31.664021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1739f4fa-a997-4315-a2db-57b92ccdd61d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:31.676738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1739f4fa-a997-4315-a2db-57b92ccdd61d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.677291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1739f4fa-a997-4315-a2db-57b92ccdd61d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.677747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1739f4fa-a997-4315-a2db-57b92ccdd61d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.679631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1739f4fa-a997-4315-a2db-57b92ccdd61d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.679631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1739f4fa-a997-4315-a2db-57b92ccdd61d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.679631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1739f4fa-a997-4315-a2db-57b92ccdd61d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.937390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1739f4fa-a997-4315-a2db-57b92ccdd61d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.941771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:31.948811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1739f4fa-a997-4315-a2db-57b92ccdd61d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.950567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1739f4fa-a997-4315-a2db-57b92ccdd61d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.951773 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1739f4fa-a997-4315-a2db-57b92ccdd61d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.292351 Aug 29 15:44:31.952373 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2270/4408] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:31 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:32.004818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-13cf1965-21ac-4518-ac52-93d7e42f9c2f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:32.016684 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-13cf1965-21ac-4518-ac52-93d7e42f9c2f tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1315 microversion: 2.1 time: 0.653160 Aug 29 15:44:32.017748 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2139/4409] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:31 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:32.376586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c6392394-f3f2-460b-a47b-94cb8e82b778 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:32.377436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c6392394-f3f2-460b-a47b-94cb8e82b778 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:32.385047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6392394-f3f2-460b-a47b-94cb8e82b778 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.389828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6392394-f3f2-460b-a47b-94cb8e82b778 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.390615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6392394-f3f2-460b-a47b-94cb8e82b778 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.391582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6392394-f3f2-460b-a47b-94cb8e82b778 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.392261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6392394-f3f2-460b-a47b-94cb8e82b778 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.393050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6392394-f3f2-460b-a47b-94cb8e82b778 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.414421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3ac10b79-fb94-452e-a48f-85e0b6544cf3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:32.415800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3ac10b79-fb94-452e-a48f-85e0b6544cf3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:32.432703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ac10b79-fb94-452e-a48f-85e0b6544cf3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.433455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ac10b79-fb94-452e-a48f-85e0b6544cf3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.436554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ac10b79-fb94-452e-a48f-85e0b6544cf3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.437479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ac10b79-fb94-452e-a48f-85e0b6544cf3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.438047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ac10b79-fb94-452e-a48f-85e0b6544cf3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.438580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ac10b79-fb94-452e-a48f-85e0b6544cf3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.627772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c6392394-f3f2-460b-a47b-94cb8e82b778 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:32.638941 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c6392394-f3f2-460b-a47b-94cb8e82b778 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 200 len: 1487 microversion: 2.1 time: 0.266779 Aug 29 15:44:32.656394 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2271/4410] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:32 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 1487 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:32.662882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f696ebb6-bcd7-4ae8-9b88-9979b0cfc74f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:32.664360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f696ebb6-bcd7-4ae8-9b88-9979b0cfc74f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:32.678147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f696ebb6-bcd7-4ae8-9b88-9979b0cfc74f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.685316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f696ebb6-bcd7-4ae8-9b88-9979b0cfc74f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.686605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f696ebb6-bcd7-4ae8-9b88-9979b0cfc74f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.688068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f696ebb6-bcd7-4ae8-9b88-9979b0cfc74f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.688764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f696ebb6-bcd7-4ae8-9b88-9979b0cfc74f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.689489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f696ebb6-bcd7-4ae8-9b88-9979b0cfc74f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.754467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-f696ebb6-bcd7-4ae8-9b88-9979b0cfc74f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lazy-loading 'flavor' on Instance uuid 5219eda0-3ed8-4c6e-ba04-19ed69930d86 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:44:32.897661 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f696ebb6-bcd7-4ae8-9b88-9979b0cfc74f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "POST /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86/action" status: 202 len: 0 microversion: 2.1 time: 0.239229 Aug 29 15:44:32.899621 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2272/4411] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:44:32 2022] POST /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:44:32.913354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9c335890-b7a4-447e-98ba-4e9ad4fa7a19 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:32.914226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9c335890-b7a4-447e-98ba-4e9ad4fa7a19 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:32.947692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c335890-b7a4-447e-98ba-4e9ad4fa7a19 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.949164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c335890-b7a4-447e-98ba-4e9ad4fa7a19 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.949778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c335890-b7a4-447e-98ba-4e9ad4fa7a19 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.950717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c335890-b7a4-447e-98ba-4e9ad4fa7a19 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.951350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c335890-b7a4-447e-98ba-4e9ad4fa7a19 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.951958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c335890-b7a4-447e-98ba-4e9ad4fa7a19 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.221235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3ac10b79-fb94-452e-a48f-85e0b6544cf3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:33.238404 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3ac10b79-fb94-452e-a48f-85e0b6544cf3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1314 microversion: 2.1 time: 0.829366 Aug 29 15:44:33.239830 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2140/4412] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:32 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1314 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:33.258253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f1ec207f-2d89-448a-9cb1-c9c7cb5c8a3f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:33.259296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f1ec207f-2d89-448a-9cb1-c9c7cb5c8a3f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:33.269251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1ec207f-2d89-448a-9cb1-c9c7cb5c8a3f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.270325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1ec207f-2d89-448a-9cb1-c9c7cb5c8a3f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.271197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1ec207f-2d89-448a-9cb1-c9c7cb5c8a3f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.272168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1ec207f-2d89-448a-9cb1-c9c7cb5c8a3f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.272818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1ec207f-2d89-448a-9cb1-c9c7cb5c8a3f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.273508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1ec207f-2d89-448a-9cb1-c9c7cb5c8a3f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.356851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:33.676998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f1ec207f-2d89-448a-9cb1-c9c7cb5c8a3f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:33.679804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9c335890-b7a4-447e-98ba-4e9ad4fa7a19 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:33.692693 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9c335890-b7a4-447e-98ba-4e9ad4fa7a19 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1314 microversion: 2.1 time: 0.790254 Aug 29 15:44:33.694852 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2273/4413] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:32 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1314 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:33.708261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f01ef1ce-79fe-4306-91f1-9a55c9426945 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:33.709197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f01ef1ce-79fe-4306-91f1-9a55c9426945 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:33.717893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=26 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:33.718643 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f1ec207f-2d89-448a-9cb1-c9c7cb5c8a3f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 200 len: 1495 microversion: 2.1 time: 0.476914 Aug 29 15:44:33.719055 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2141/4414] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:33 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 1495 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:33.720076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f01ef1ce-79fe-4306-91f1-9a55c9426945 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.720688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f01ef1ce-79fe-4306-91f1-9a55c9426945 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.721169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f01ef1ce-79fe-4306-91f1-9a55c9426945 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.721881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f01ef1ce-79fe-4306-91f1-9a55c9426945 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.722392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f01ef1ce-79fe-4306-91f1-9a55c9426945 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.723743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f01ef1ce-79fe-4306-91f1-9a55c9426945 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.726992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-71c73705-ece7-44e1-93e3-15d7266e6957 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:33.727801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-71c73705-ece7-44e1-93e3-15d7266e6957 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:33.744247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71c73705-ece7-44e1-93e3-15d7266e6957 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.745746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71c73705-ece7-44e1-93e3-15d7266e6957 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.746271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71c73705-ece7-44e1-93e3-15d7266e6957 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.747072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71c73705-ece7-44e1-93e3-15d7266e6957 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.747615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71c73705-ece7-44e1-93e3-15d7266e6957 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.748119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71c73705-ece7-44e1-93e3-15d7266e6957 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.065995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f01ef1ce-79fe-4306-91f1-9a55c9426945 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:34.096825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f01ef1ce-79fe-4306-91f1-9a55c9426945 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:34.101452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f01ef1ce-79fe-4306-91f1-9a55c9426945 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:34.105646 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f01ef1ce-79fe-4306-91f1-9a55c9426945 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.409496 Aug 29 15:44:34.106868 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2274/4415] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:33 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:34.121901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-71c73705-ece7-44e1-93e3-15d7266e6957 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:34.139164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-cc69d2f2-2cfe-4e9e-921b-db609a210318 req-dc5f3b44-08f3-4f77-86ad-e27ed2500efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824db4a3-47bf-494c-b490-d7631b6d9d54", "name": "network-vif-plugged", "status": "completed", "tag": "98e91a7f-1a84-4261-8c1b-359bdbdb9f7e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:34.161872 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-71c73705-ece7-44e1-93e3-15d7266e6957 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1315 microversion: 2.1 time: 0.441167 Aug 29 15:44:34.164912 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2142/4416] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:33 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:34.178839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d0008e88-3bd0-42db-8a76-60949e2c1c73 req-2bb09194-87be-4caa-a517-5f5e3584ac26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a6a627-cf39-45a2-ab54-9a1ffecbb57a", "tag": "de519f02-032e-441c-9cfd-0481b24fe996"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:34.194913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cc69d2f2-2cfe-4e9e-921b-db609a210318 req-dc5f3b44-08f3-4f77-86ad-e27ed2500efd service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.195634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cc69d2f2-2cfe-4e9e-921b-db609a210318 req-dc5f3b44-08f3-4f77-86ad-e27ed2500efd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.196253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cc69d2f2-2cfe-4e9e-921b-db609a210318 req-dc5f3b44-08f3-4f77-86ad-e27ed2500efd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.197368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d0008e88-3bd0-42db-8a76-60949e2c1c73 req-2bb09194-87be-4caa-a517-5f5e3584ac26 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.197875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d0008e88-3bd0-42db-8a76-60949e2c1c73 req-2bb09194-87be-4caa-a517-5f5e3584ac26 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.198326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d0008e88-3bd0-42db-8a76-60949e2c1c73 req-2bb09194-87be-4caa-a517-5f5e3584ac26 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.213601 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-cc69d2f2-2cfe-4e9e-921b-db609a210318 req-dc5f3b44-08f3-4f77-86ad-e27ed2500efd service nova] Creating event network-vif-plugged:98e91a7f-1a84-4261-8c1b-359bdbdb9f7e for instance 824db4a3-47bf-494c-b490-d7631b6d9d54 on n-h1-839401-11 Aug 29 15:44:34.228957 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d0008e88-3bd0-42db-8a76-60949e2c1c73 req-2bb09194-87be-4caa-a517-5f5e3584ac26 service nova] Creating event network-changed:de519f02-032e-441c-9cfd-0481b24fe996 for instance c9a6a627-cf39-45a2-ab54-9a1ffecbb57a on n-h2-839401-11 Aug 29 15:44:34.238258 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d0008e88-3bd0-42db-8a76-60949e2c1c73 req-2bb09194-87be-4caa-a517-5f5e3584ac26 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071499 Aug 29 15:44:34.238743 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-cc69d2f2-2cfe-4e9e-921b-db609a210318 req-dc5f3b44-08f3-4f77-86ad-e27ed2500efd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127867 Aug 29 15:44:34.240302 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2275/4417] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:34.244429 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2143/4418] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:34.260215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d4d11130-173c-4f7c-9004-8d4372edb5e8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:34.260943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d4d11130-173c-4f7c-9004-8d4372edb5e8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:34.267719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4d11130-173c-4f7c-9004-8d4372edb5e8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.268214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4d11130-173c-4f7c-9004-8d4372edb5e8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.268664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4d11130-173c-4f7c-9004-8d4372edb5e8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.269398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4d11130-173c-4f7c-9004-8d4372edb5e8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.269865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4d11130-173c-4f7c-9004-8d4372edb5e8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.270367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4d11130-173c-4f7c-9004-8d4372edb5e8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.602417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d4d11130-173c-4f7c-9004-8d4372edb5e8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:34.615359 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d4d11130-173c-4f7c-9004-8d4372edb5e8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1500 microversion: 2.1 time: 0.358384 Aug 29 15:44:34.622575 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2276/4419] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:34 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1500 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:34.640379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-85ef9850-a49c-424b-b33f-bdad90f7afc3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:34.644587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-85ef9850-a49c-424b-b33f-bdad90f7afc3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:34.655454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85ef9850-a49c-424b-b33f-bdad90f7afc3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.656289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85ef9850-a49c-424b-b33f-bdad90f7afc3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.656935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85ef9850-a49c-424b-b33f-bdad90f7afc3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.658086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85ef9850-a49c-424b-b33f-bdad90f7afc3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.658742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85ef9850-a49c-424b-b33f-bdad90f7afc3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.659505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85ef9850-a49c-424b-b33f-bdad90f7afc3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.688272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-85ef9850-a49c-424b-b33f-bdad90f7afc3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lazy-loading 'flavor' on Instance uuid 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:44:34.715339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-422c75ee-3760-44e7-b0ca-6d52ae2483ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:34.716372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-422c75ee-3760-44e7-b0ca-6d52ae2483ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:34.721181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:34.743554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-422c75ee-3760-44e7-b0ca-6d52ae2483ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.748203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-422c75ee-3760-44e7-b0ca-6d52ae2483ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.749517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-422c75ee-3760-44e7-b0ca-6d52ae2483ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.750407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-422c75ee-3760-44e7-b0ca-6d52ae2483ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.756433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-422c75ee-3760-44e7-b0ca-6d52ae2483ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.757038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-422c75ee-3760-44e7-b0ca-6d52ae2483ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.883104 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-85ef9850-a49c-424b-b33f-bdad90f7afc3 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "POST /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228/action" status: 200 len: 32 microversion: 2.1 time: 0.248588 Aug 29 15:44:34.889810 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2144/4420] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:44:34 2022] POST /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228/action => generated 32 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:44:34.897674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8ef0dcb8-ff38-4b20-b13b-3ac39f20063d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:34.898807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8ef0dcb8-ff38-4b20-b13b-3ac39f20063d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:34.907568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ef0dcb8-ff38-4b20-b13b-3ac39f20063d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.908609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ef0dcb8-ff38-4b20-b13b-3ac39f20063d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.909347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ef0dcb8-ff38-4b20-b13b-3ac39f20063d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.910326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ef0dcb8-ff38-4b20-b13b-3ac39f20063d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.911102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ef0dcb8-ff38-4b20-b13b-3ac39f20063d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.911781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ef0dcb8-ff38-4b20-b13b-3ac39f20063d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.104995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-422c75ee-3760-44e7-b0ca-6d52ae2483ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.115177 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-422c75ee-3760-44e7-b0ca-6d52ae2483ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1314 microversion: 2.1 time: 0.403913 Aug 29 15:44:35.115800 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2277/4421] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:34 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:35.127815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2dd28e46-76d2-459c-86a7-e3bbaa9924b7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:35.135792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2dd28e46-76d2-459c-86a7-e3bbaa9924b7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:35.144713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dd28e46-76d2-459c-86a7-e3bbaa9924b7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.146836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dd28e46-76d2-459c-86a7-e3bbaa9924b7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.147309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dd28e46-76d2-459c-86a7-e3bbaa9924b7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.148127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dd28e46-76d2-459c-86a7-e3bbaa9924b7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.150991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dd28e46-76d2-459c-86a7-e3bbaa9924b7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.151459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dd28e46-76d2-459c-86a7-e3bbaa9924b7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.417234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2dd28e46-76d2-459c-86a7-e3bbaa9924b7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.426975 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2dd28e46-76d2-459c-86a7-e3bbaa9924b7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.310123 Aug 29 15:44:35.431975 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2278/4422] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:35 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:35.447401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b72367d-3ef1-4b1a-b6cd-5fde33baef1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:35.448290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6b72367d-3ef1-4b1a-b6cd-5fde33baef1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:35.454993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b72367d-3ef1-4b1a-b6cd-5fde33baef1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.455753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b72367d-3ef1-4b1a-b6cd-5fde33baef1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.456374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b72367d-3ef1-4b1a-b6cd-5fde33baef1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.457517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b72367d-3ef1-4b1a-b6cd-5fde33baef1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.458114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b72367d-3ef1-4b1a-b6cd-5fde33baef1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.458808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b72367d-3ef1-4b1a-b6cd-5fde33baef1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.517144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8ef0dcb8-ff38-4b20-b13b-3ac39f20063d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.527286 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8ef0dcb8-ff38-4b20-b13b-3ac39f20063d tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 200 len: 1478 microversion: 2.1 time: 0.634938 Aug 29 15:44:35.548862 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2145/4423] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:34 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 1478 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:35.556472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-347b9354-9a99-4462-9909-a58b8097a701 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:35.557547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-347b9354-9a99-4462-9909-a58b8097a701 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:35.568211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-347b9354-9a99-4462-9909-a58b8097a701 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.569602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-347b9354-9a99-4462-9909-a58b8097a701 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.570356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-347b9354-9a99-4462-9909-a58b8097a701 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.573308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-347b9354-9a99-4462-9909-a58b8097a701 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.573308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-347b9354-9a99-4462-9909-a58b8097a701 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.573308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-347b9354-9a99-4462-9909-a58b8097a701 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.774239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b72367d-3ef1-4b1a-b6cd-5fde33baef1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.787119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b72367d-3ef1-4b1a-b6cd-5fde33baef1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.788864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b72367d-3ef1-4b1a-b6cd-5fde33baef1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.807170 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6b72367d-3ef1-4b1a-b6cd-5fde33baef1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.372540 Aug 29 15:44:35.807805 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2279/4424] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:35 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:35.829179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fd9f6944-6e1f-4876-905b-90bdd3df3084 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-999766205"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:35.833032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fd9f6944-6e1f-4876-905b-90bdd3df3084 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:35.859292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd9f6944-6e1f-4876-905b-90bdd3df3084 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.859899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd9f6944-6e1f-4876-905b-90bdd3df3084 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.860654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd9f6944-6e1f-4876-905b-90bdd3df3084 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.863619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd9f6944-6e1f-4876-905b-90bdd3df3084 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.863619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd9f6944-6e1f-4876-905b-90bdd3df3084 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.863886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd9f6944-6e1f-4876-905b-90bdd3df3084 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.872578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-347b9354-9a99-4462-9909-a58b8097a701 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.890632 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-347b9354-9a99-4462-9909-a58b8097a701 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1315 microversion: 2.1 time: 0.339807 Aug 29 15:44:35.894718 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2146/4425] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:35 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:36.136339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aaf9395c-6225-471d-a47d-e0fbdbb23b6f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:36.138554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aaf9395c-6225-471d-a47d-e0fbdbb23b6f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:36.170491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aaf9395c-6225-471d-a47d-e0fbdbb23b6f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.194646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aaf9395c-6225-471d-a47d-e0fbdbb23b6f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.195300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aaf9395c-6225-471d-a47d-e0fbdbb23b6f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.196259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aaf9395c-6225-471d-a47d-e0fbdbb23b6f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.196822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aaf9395c-6225-471d-a47d-e0fbdbb23b6f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.197689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aaf9395c-6225-471d-a47d-e0fbdbb23b6f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.309764 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fd9f6944-6e1f-4876-905b-90bdd3df3084 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "POST /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86/action" status: 202 len: 0 microversion: 2.1 time: 0.499525 Aug 29 15:44:36.312136 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2280/4426] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:44:35 2022] POST /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:44:36.324444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2a1dbde7-9767-400f-8371-c0127ecabb58 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a8e6e50>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:36.398111 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2a1dbde7-9767-400f-8371-c0127ecabb58 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998" status: 200 len: 1439 microversion: 2.1 time: 0.078925 Aug 29 15:44:36.400124 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2281/4427] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:36 2022] GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 => generated 1439 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:36.451964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-34077636-3c6b-4a0e-81ea-db2a749d81e9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:36.452775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-34077636-3c6b-4a0e-81ea-db2a749d81e9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:36.461952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34077636-3c6b-4a0e-81ea-db2a749d81e9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.462650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34077636-3c6b-4a0e-81ea-db2a749d81e9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.463411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34077636-3c6b-4a0e-81ea-db2a749d81e9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.464138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34077636-3c6b-4a0e-81ea-db2a749d81e9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.464617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34077636-3c6b-4a0e-81ea-db2a749d81e9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.465050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34077636-3c6b-4a0e-81ea-db2a749d81e9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.537365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aaf9395c-6225-471d-a47d-e0fbdbb23b6f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:36.546087 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aaf9395c-6225-471d-a47d-e0fbdbb23b6f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1500 microversion: 2.1 time: 0.413847 Aug 29 15:44:36.549570 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2147/4428] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:36 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1500 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:36.576002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4a453259-8e4a-442b-b78a-dc980d91a4a2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:36.576828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4a453259-8e4a-442b-b78a-dc980d91a4a2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:36.588998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a453259-8e4a-442b-b78a-dc980d91a4a2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.589543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a453259-8e4a-442b-b78a-dc980d91a4a2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.589984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a453259-8e4a-442b-b78a-dc980d91a4a2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.594129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a453259-8e4a-442b-b78a-dc980d91a4a2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.594909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a453259-8e4a-442b-b78a-dc980d91a4a2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.595452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a453259-8e4a-442b-b78a-dc980d91a4a2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.724719 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4a453259-8e4a-442b-b78a-dc980d91a4a2 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54/action" status: 202 len: 0 microversion: 2.1 time: 0.152356 Aug 29 15:44:36.729361 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2148/4429] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:44:36 2022] POST /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:44:36.737793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5b2297be-7588-4609-bfc4-2a2b57be617b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:36.738692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5b2297be-7588-4609-bfc4-2a2b57be617b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:36.748821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b2297be-7588-4609-bfc4-2a2b57be617b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.749813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b2297be-7588-4609-bfc4-2a2b57be617b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.750855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b2297be-7588-4609-bfc4-2a2b57be617b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.751791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b2297be-7588-4609-bfc4-2a2b57be617b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.752550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b2297be-7588-4609-bfc4-2a2b57be617b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.753271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b2297be-7588-4609-bfc4-2a2b57be617b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.830414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-34077636-3c6b-4a0e-81ea-db2a749d81e9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:36.838910 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-34077636-3c6b-4a0e-81ea-db2a749d81e9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.392518 Aug 29 15:44:36.839536 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2282/4430] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:36 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:36.853476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1d643c56-7f45-4965-8fea-4e01632e7c3a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:36.854135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1d643c56-7f45-4965-8fea-4e01632e7c3a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:36.868512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d643c56-7f45-4965-8fea-4e01632e7c3a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.869027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d643c56-7f45-4965-8fea-4e01632e7c3a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.871570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d643c56-7f45-4965-8fea-4e01632e7c3a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.872342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d643c56-7f45-4965-8fea-4e01632e7c3a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.872828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d643c56-7f45-4965-8fea-4e01632e7c3a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.873307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d643c56-7f45-4965-8fea-4e01632e7c3a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.155695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5b2297be-7588-4609-bfc4-2a2b57be617b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:37.167342 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5b2297be-7588-4609-bfc4-2a2b57be617b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1505 microversion: 2.1 time: 0.436332 Aug 29 15:44:37.168080 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2149/4431] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:36 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:37.193339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1bca1ba8-b72e-4b7e-9a43-718555aa856b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:37.194547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1bca1ba8-b72e-4b7e-9a43-718555aa856b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:37.203543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1bca1ba8-b72e-4b7e-9a43-718555aa856b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.204401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1bca1ba8-b72e-4b7e-9a43-718555aa856b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.205279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1bca1ba8-b72e-4b7e-9a43-718555aa856b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.206227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1bca1ba8-b72e-4b7e-9a43-718555aa856b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.207562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1bca1ba8-b72e-4b7e-9a43-718555aa856b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.208716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1bca1ba8-b72e-4b7e-9a43-718555aa856b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.267163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1d643c56-7f45-4965-8fea-4e01632e7c3a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:37.298456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1d643c56-7f45-4965-8fea-4e01632e7c3a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:37.304560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1d643c56-7f45-4965-8fea-4e01632e7c3a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:37.306822 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1d643c56-7f45-4965-8fea-4e01632e7c3a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.462395 Aug 29 15:44:37.308193 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2283/4432] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:36 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:37.414883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-95f8d06e-ea39-4077-80ce-4e3d5a207f65 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a7975e0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:37.465736 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-95f8d06e-ea39-4077-80ce-4e3d5a207f65 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998" status: 200 len: 1439 microversion: 2.1 time: 0.054982 Aug 29 15:44:37.466329 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2284/4433] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:37 2022] GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 => generated 1439 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:37.539546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1bca1ba8-b72e-4b7e-9a43-718555aa856b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:37.544129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:37.549914 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1bca1ba8-b72e-4b7e-9a43-718555aa856b tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1315 microversion: 2.1 time: 0.366727 Aug 29 15:44:37.550504 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2150/4434] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:37 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:37.602327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-948715806", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:37.660367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] validate_networks() for [('483f7ce2-772f-4261-94f5-2fcba159cdb8', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:37.863080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4a89645a-a514-4e87-850e-36c842217b5c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:37.863720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4a89645a-a514-4e87-850e-36c842217b5c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:37.880476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a89645a-a514-4e87-850e-36c842217b5c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.880995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a89645a-a514-4e87-850e-36c842217b5c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.881460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a89645a-a514-4e87-850e-36c842217b5c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.882171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a89645a-a514-4e87-850e-36c842217b5c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.882634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a89645a-a514-4e87-850e-36c842217b5c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.883049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a89645a-a514-4e87-850e-36c842217b5c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:38.224801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:38.225483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:38.226137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:38.226710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:38.227318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:38.238776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:38.239592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:38.240752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:38.241758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:38.242419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:38.244336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:38.267693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Getting quotas for project 601b0333e91644768c5f6d7f4f717108. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:38.274896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Getting quotas for user 98f81a0a727d4a3c9274213715d7735d and project 601b0333e91644768c5f6d7f4f717108. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:38.293579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:38.296642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:38.376492 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e3cc2d9a-4868-47c9-8e0e-8bcf09e96d6a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.908778 Aug 29 15:44:38.383074 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2285/4435] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:44:38.393287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-164342f5-9461-42a4-a3bf-c605cc172769 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:38.395592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-164342f5-9461-42a4-a3bf-c605cc172769 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:38.406205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-164342f5-9461-42a4-a3bf-c605cc172769 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:38.406725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-164342f5-9461-42a4-a3bf-c605cc172769 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:38.407174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-164342f5-9461-42a4-a3bf-c605cc172769 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:38.408265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-164342f5-9461-42a4-a3bf-c605cc172769 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:38.408884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-164342f5-9461-42a4-a3bf-c605cc172769 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:38.409707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-164342f5-9461-42a4-a3bf-c605cc172769 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:38.630609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-164342f5-9461-42a4-a3bf-c605cc172769 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:38.647081 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-164342f5-9461-42a4-a3bf-c605cc172769 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1485 microversion: 2.1 time: 0.265534 Aug 29 15:44:38.647908 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2286/4436] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:38 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1485 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:38.654627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dffa94fc-2660-46a6-9df6-8f1d81aeecf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:38.655908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dffa94fc-2660-46a6-9df6-8f1d81aeecf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:38.664779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dffa94fc-2660-46a6-9df6-8f1d81aeecf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:38.665600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dffa94fc-2660-46a6-9df6-8f1d81aeecf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:38.666726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dffa94fc-2660-46a6-9df6-8f1d81aeecf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:38.667911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dffa94fc-2660-46a6-9df6-8f1d81aeecf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:38.668781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dffa94fc-2660-46a6-9df6-8f1d81aeecf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:38.669500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dffa94fc-2660-46a6-9df6-8f1d81aeecf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:38.994887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4a89645a-a514-4e87-850e-36c842217b5c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:39.006969 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4a89645a-a514-4e87-850e-36c842217b5c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 1.150330 Aug 29 15:44:39.026468 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2151/4437] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:37 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:39.034580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-02cd741b-d98e-4f78-8446-46385723ae24 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:39.036876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-02cd741b-d98e-4f78-8446-46385723ae24 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:39.070329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dffa94fc-2660-46a6-9df6-8f1d81aeecf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:39.081244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:39.091225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dffa94fc-2660-46a6-9df6-8f1d81aeecf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:39.093411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dffa94fc-2660-46a6-9df6-8f1d81aeecf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:39.096335 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dffa94fc-2660-46a6-9df6-8f1d81aeecf7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.447029 Aug 29 15:44:39.110120 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2287/4438] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:38 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:39.126895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c235be6-54de-4d0c-8f45-74be8a1ebd18 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42ac02430>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:39.165344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-02cd741b-d98e-4f78-8446-46385723ae24 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:39.177850 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-02cd741b-d98e-4f78-8446-46385723ae24 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1222 microversion: 2.1 time: 0.147959 Aug 29 15:44:39.181437 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2152/4439] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:39 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1222 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:39.191930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8667edb1-a47e-49b0-9ab6-2ebd5ffb1acc tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:39.200089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8667edb1-a47e-49b0-9ab6-2ebd5ffb1acc tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:39.215429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8667edb1-a47e-49b0-9ab6-2ebd5ffb1acc tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.216594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8667edb1-a47e-49b0-9ab6-2ebd5ffb1acc tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.217677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8667edb1-a47e-49b0-9ab6-2ebd5ffb1acc tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.219053 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5c235be6-54de-4d0c-8f45-74be8a1ebd18 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998" status: 200 len: 1439 microversion: 2.1 time: 0.107579 Aug 29 15:44:39.220192 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2288/4440] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:39 2022] GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 => generated 1439 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:39.220332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8667edb1-a47e-49b0-9ab6-2ebd5ffb1acc tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.221353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8667edb1-a47e-49b0-9ab6-2ebd5ffb1acc tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.222418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8667edb1-a47e-49b0-9ab6-2ebd5ffb1acc tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.226986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7626ca3-78a8-4c89-ad50-3086d578c5c7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:39.227898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f7626ca3-78a8-4c89-ad50-3086d578c5c7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:39.235260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7626ca3-78a8-4c89-ad50-3086d578c5c7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.236106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7626ca3-78a8-4c89-ad50-3086d578c5c7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.236777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7626ca3-78a8-4c89-ad50-3086d578c5c7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.239517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7626ca3-78a8-4c89-ad50-3086d578c5c7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.240348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7626ca3-78a8-4c89-ad50-3086d578c5c7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.241030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7626ca3-78a8-4c89-ad50-3086d578c5c7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.289342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-f7626ca3-78a8-4c89-ad50-3086d578c5c7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lazy-loading 'flavor' on Instance uuid 824db4a3-47bf-494c-b490-d7631b6d9d54 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:44:39.576032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8667edb1-a47e-49b0-9ab6-2ebd5ffb1acc tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:39.595527 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8667edb1-a47e-49b0-9ab6-2ebd5ffb1acc tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1315 microversion: 2.1 time: 0.412619 Aug 29 15:44:39.620714 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2153/4441] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:39 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:39.634015 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f7626ca3-78a8-4c89-ad50-3086d578c5c7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54/action" status: 202 len: 0 microversion: 2.1 time: 0.411421 Aug 29 15:44:39.638569 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2289/4442] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:44:39 2022] POST /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:44:39.644051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-73871ae9-e196-4742-84ee-905135d1765d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:39.644690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-73871ae9-e196-4742-84ee-905135d1765d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:39.657379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73871ae9-e196-4742-84ee-905135d1765d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.658257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73871ae9-e196-4742-84ee-905135d1765d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.658758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73871ae9-e196-4742-84ee-905135d1765d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.661547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73871ae9-e196-4742-84ee-905135d1765d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.662047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73871ae9-e196-4742-84ee-905135d1765d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.662492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73871ae9-e196-4742-84ee-905135d1765d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.828127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-73871ae9-e196-4742-84ee-905135d1765d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:39.837761 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-73871ae9-e196-4742-84ee-905135d1765d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1491 microversion: 2.1 time: 0.197929 Aug 29 15:44:39.842831 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2154/4443] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:39 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1491 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:40.033807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4fc9b8e8-19ca-4f2f-aa49-682c73d82a81 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:40.034444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4fc9b8e8-19ca-4f2f-aa49-682c73d82a81 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:40.041215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fc9b8e8-19ca-4f2f-aa49-682c73d82a81 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.046049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fc9b8e8-19ca-4f2f-aa49-682c73d82a81 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.046049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fc9b8e8-19ca-4f2f-aa49-682c73d82a81 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.046049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fc9b8e8-19ca-4f2f-aa49-682c73d82a81 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.046049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fc9b8e8-19ca-4f2f-aa49-682c73d82a81 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.046049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fc9b8e8-19ca-4f2f-aa49-682c73d82a81 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.128635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d7282a7b-563e-4d02-8e38-a7c38251ac94 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:40.129429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d7282a7b-563e-4d02-8e38-a7c38251ac94 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:40.145026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7282a7b-563e-4d02-8e38-a7c38251ac94 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.145921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7282a7b-563e-4d02-8e38-a7c38251ac94 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.147915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7282a7b-563e-4d02-8e38-a7c38251ac94 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.150662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7282a7b-563e-4d02-8e38-a7c38251ac94 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.151255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7282a7b-563e-4d02-8e38-a7c38251ac94 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.151803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d7282a7b-563e-4d02-8e38-a7c38251ac94 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.270427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4fc9b8e8-19ca-4f2f-aa49-682c73d82a81 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:40.279012 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4fc9b8e8-19ca-4f2f-aa49-682c73d82a81 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.250601 Aug 29 15:44:40.279617 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2290/4444] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:40 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:40.297599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1c5f0479-a9be-4b7e-87f7-47c3df913bd1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:40.298521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1c5f0479-a9be-4b7e-87f7-47c3df913bd1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:40.306241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c5f0479-a9be-4b7e-87f7-47c3df913bd1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.307010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c5f0479-a9be-4b7e-87f7-47c3df913bd1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.307740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c5f0479-a9be-4b7e-87f7-47c3df913bd1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.308865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c5f0479-a9be-4b7e-87f7-47c3df913bd1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.309582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c5f0479-a9be-4b7e-87f7-47c3df913bd1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.310237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c5f0479-a9be-4b7e-87f7-47c3df913bd1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.405518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1c5f0479-a9be-4b7e-87f7-47c3df913bd1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:40.416920 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1c5f0479-a9be-4b7e-87f7-47c3df913bd1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1274 microversion: 2.1 time: 0.135644 Aug 29 15:44:40.417966 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2291/4445] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:40 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:40.422935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-92c21c47-baeb-4fa0-a19f-f8f64cb2b7f4 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc433b74b80>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:40.441669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d7282a7b-563e-4d02-8e38-a7c38251ac94 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:40.476268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d7282a7b-563e-4d02-8e38-a7c38251ac94 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:40.481005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d7282a7b-563e-4d02-8e38-a7c38251ac94 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:40.481806 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-92c21c47-baeb-4fa0-a19f-f8f64cb2b7f4 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998" status: 200 len: 1439 microversion: 2.1 time: 0.062432 Aug 29 15:44:40.482634 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2292/4446] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:40 2022] GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 => generated 1439 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:40.486558 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d7282a7b-563e-4d02-8e38-a7c38251ac94 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.360308 Aug 29 15:44:40.493228 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2155/4447] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:40 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:40.625847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b73f19ea-1a7e-4ebe-b7e5-d4d9b8edc69d tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:40.626484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b73f19ea-1a7e-4ebe-b7e5-d4d9b8edc69d tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:40.640565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73f19ea-1a7e-4ebe-b7e5-d4d9b8edc69d tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.641483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73f19ea-1a7e-4ebe-b7e5-d4d9b8edc69d tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.641888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73f19ea-1a7e-4ebe-b7e5-d4d9b8edc69d tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.648761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73f19ea-1a7e-4ebe-b7e5-d4d9b8edc69d tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.651357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73f19ea-1a7e-4ebe-b7e5-d4d9b8edc69d tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.654374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b73f19ea-1a7e-4ebe-b7e5-d4d9b8edc69d tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.860063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ab401886-1610-4e0e-9e11-f2430287cc8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:40.861122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ab401886-1610-4e0e-9e11-f2430287cc8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:40.867794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab401886-1610-4e0e-9e11-f2430287cc8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.868341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab401886-1610-4e0e-9e11-f2430287cc8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.868974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab401886-1610-4e0e-9e11-f2430287cc8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.869897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab401886-1610-4e0e-9e11-f2430287cc8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.870935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab401886-1610-4e0e-9e11-f2430287cc8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.870935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab401886-1610-4e0e-9e11-f2430287cc8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.879049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b73f19ea-1a7e-4ebe-b7e5-d4d9b8edc69d tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:40.896375 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b73f19ea-1a7e-4ebe-b7e5-d4d9b8edc69d tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1315 microversion: 2.1 time: 0.274750 Aug 29 15:44:40.896986 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2293/4448] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:40 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:41.091651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ab401886-1610-4e0e-9e11-f2430287cc8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.101749 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ab401886-1610-4e0e-9e11-f2430287cc8d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1491 microversion: 2.1 time: 0.246205 Aug 29 15:44:41.108078 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2156/4449] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:40 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1491 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:41.300732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7000003a-bd96-414e-85f6-56bc8c7347ea tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:41.301778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7000003a-bd96-414e-85f6-56bc8c7347ea tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:41.324057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7000003a-bd96-414e-85f6-56bc8c7347ea tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.324813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7000003a-bd96-414e-85f6-56bc8c7347ea tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.325318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7000003a-bd96-414e-85f6-56bc8c7347ea tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.326279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7000003a-bd96-414e-85f6-56bc8c7347ea tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.327067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7000003a-bd96-414e-85f6-56bc8c7347ea tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.327753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7000003a-bd96-414e-85f6-56bc8c7347ea tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.445185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-30b63626-3f22-4b0d-9566-3e995f824d62 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:41.447627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-30b63626-3f22-4b0d-9566-3e995f824d62 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:41.478578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30b63626-3f22-4b0d-9566-3e995f824d62 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.481059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30b63626-3f22-4b0d-9566-3e995f824d62 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.482751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30b63626-3f22-4b0d-9566-3e995f824d62 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.487060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30b63626-3f22-4b0d-9566-3e995f824d62 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.488382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30b63626-3f22-4b0d-9566-3e995f824d62 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.489825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30b63626-3f22-4b0d-9566-3e995f824d62 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.527236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7000003a-bd96-414e-85f6-56bc8c7347ea tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.536834 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7000003a-bd96-414e-85f6-56bc8c7347ea tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.240426 Aug 29 15:44:41.538599 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2294/4450] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:41 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:41.543926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7fb46298-c2e5-4091-86bc-419bd664f8e7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a87f4c0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:41.602996 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7fb46298-c2e5-4091-86bc-419bd664f8e7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998" status: 200 len: 1439 microversion: 2.1 time: 0.062992 Aug 29 15:44:41.607148 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2295/4451] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:41 2022] GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 => generated 1439 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:41.617809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0cfbdeaf-0fba-45f2-97b0-db3a94a9415e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:41.618780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0cfbdeaf-0fba-45f2-97b0-db3a94a9415e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:41.632265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cfbdeaf-0fba-45f2-97b0-db3a94a9415e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.633459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cfbdeaf-0fba-45f2-97b0-db3a94a9415e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.634125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cfbdeaf-0fba-45f2-97b0-db3a94a9415e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.635111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cfbdeaf-0fba-45f2-97b0-db3a94a9415e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.635774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cfbdeaf-0fba-45f2-97b0-db3a94a9415e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.636395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cfbdeaf-0fba-45f2-97b0-db3a94a9415e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.668834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-30b63626-3f22-4b0d-9566-3e995f824d62 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.680425 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-30b63626-3f22-4b0d-9566-3e995f824d62 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1280 microversion: 2.1 time: 0.242768 Aug 29 15:44:41.685341 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2157/4452] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:41 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1280 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:41.917795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-48629376-a51c-47c8-8762-42717b7781ee tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:41.918649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-48629376-a51c-47c8-8762-42717b7781ee tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:41.925572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48629376-a51c-47c8-8762-42717b7781ee tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.926063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48629376-a51c-47c8-8762-42717b7781ee tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.926599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48629376-a51c-47c8-8762-42717b7781ee tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.927335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48629376-a51c-47c8-8762-42717b7781ee tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.927812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48629376-a51c-47c8-8762-42717b7781ee tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.928219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48629376-a51c-47c8-8762-42717b7781ee tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.963659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0cfbdeaf-0fba-45f2-97b0-db3a94a9415e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.975346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0cfbdeaf-0fba-45f2-97b0-db3a94a9415e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.976967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0cfbdeaf-0fba-45f2-97b0-db3a94a9415e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.978345 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0cfbdeaf-0fba-45f2-97b0-db3a94a9415e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.369926 Aug 29 15:44:41.978999 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2296/4453] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:41 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:42.126330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9bc0fd21-a3c5-412b-a36b-9e524e1f0dd1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:42.126954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9bc0fd21-a3c5-412b-a36b-9e524e1f0dd1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:42.140532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bc0fd21-a3c5-412b-a36b-9e524e1f0dd1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.141326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bc0fd21-a3c5-412b-a36b-9e524e1f0dd1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.141915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bc0fd21-a3c5-412b-a36b-9e524e1f0dd1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.142825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bc0fd21-a3c5-412b-a36b-9e524e1f0dd1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.143798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bc0fd21-a3c5-412b-a36b-9e524e1f0dd1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.146931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9bc0fd21-a3c5-412b-a36b-9e524e1f0dd1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.167609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-48629376-a51c-47c8-8762-42717b7781ee tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:42.179085 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-48629376-a51c-47c8-8762-42717b7781ee tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1315 microversion: 2.1 time: 0.265407 Aug 29 15:44:42.179581 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2158/4454] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:41 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:42.368369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9bc0fd21-a3c5-412b-a36b-9e524e1f0dd1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:42.378486 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9bc0fd21-a3c5-412b-a36b-9e524e1f0dd1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1491 microversion: 2.1 time: 0.256988 Aug 29 15:44:42.380293 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2297/4455] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:42 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1491 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:42.560116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-95c93d02-29b4-4cb3-8de3-f56b094d5840 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:42.560960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-95c93d02-29b4-4cb3-8de3-f56b094d5840 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:42.574111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95c93d02-29b4-4cb3-8de3-f56b094d5840 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.574949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95c93d02-29b4-4cb3-8de3-f56b094d5840 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.575604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95c93d02-29b4-4cb3-8de3-f56b094d5840 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.577392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95c93d02-29b4-4cb3-8de3-f56b094d5840 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.577979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95c93d02-29b4-4cb3-8de3-f56b094d5840 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.578503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95c93d02-29b4-4cb3-8de3-f56b094d5840 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.630615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-02f9d18c-ea41-497a-bbab-eee68c7f631e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc433b8adc0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:42.703206 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-02f9d18c-ea41-497a-bbab-eee68c7f631e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998" status: 200 len: 1439 microversion: 2.1 time: 0.085636 Aug 29 15:44:42.704355 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2298/4456] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:42 2022] GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 => generated 1439 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:42.709802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eaca6261-1bc5-4ae3-91f0-80e49ce4b4e0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:42.714270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eaca6261-1bc5-4ae3-91f0-80e49ce4b4e0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:42.730092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaca6261-1bc5-4ae3-91f0-80e49ce4b4e0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.730820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaca6261-1bc5-4ae3-91f0-80e49ce4b4e0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.731566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaca6261-1bc5-4ae3-91f0-80e49ce4b4e0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.732518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaca6261-1bc5-4ae3-91f0-80e49ce4b4e0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.733252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaca6261-1bc5-4ae3-91f0-80e49ce4b4e0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.733870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaca6261-1bc5-4ae3-91f0-80e49ce4b4e0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.947551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-95c93d02-29b4-4cb3-8de3-f56b094d5840 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:42.958245 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-95c93d02-29b4-4cb3-8de3-f56b094d5840 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.402672 Aug 29 15:44:42.958847 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2159/4457] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:42 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:42.961965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eaca6261-1bc5-4ae3-91f0-80e49ce4b4e0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:42.970566 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eaca6261-1bc5-4ae3-91f0-80e49ce4b4e0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1322 microversion: 2.1 time: 0.264795 Aug 29 15:44:42.974314 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2299/4458] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:42 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:43.005813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0cdaf6c3-6f1a-4cee-9505-fc84f1e07bb7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:43.006510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0cdaf6c3-6f1a-4cee-9505-fc84f1e07bb7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:43.014688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cdaf6c3-6f1a-4cee-9505-fc84f1e07bb7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.015259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cdaf6c3-6f1a-4cee-9505-fc84f1e07bb7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.015900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cdaf6c3-6f1a-4cee-9505-fc84f1e07bb7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.053602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cdaf6c3-6f1a-4cee-9505-fc84f1e07bb7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.055089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cdaf6c3-6f1a-4cee-9505-fc84f1e07bb7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.055819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0cdaf6c3-6f1a-4cee-9505-fc84f1e07bb7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.113265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e16b9b9b-4fb7-47cd-99b3-a345961ac8d6 req-c3ad771f-a924-4cfd-b730-c634ff8b9417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb6aed9-8901-4e68-8a40-21dc9e2f690c", "tag": "9dad9642-2fa5-4f48-9928-cc4aebbe2498"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:43.134455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e16b9b9b-4fb7-47cd-99b3-a345961ac8d6 req-c3ad771f-a924-4cfd-b730-c634ff8b9417 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.134941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e16b9b9b-4fb7-47cd-99b3-a345961ac8d6 req-c3ad771f-a924-4cfd-b730-c634ff8b9417 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.135375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e16b9b9b-4fb7-47cd-99b3-a345961ac8d6 req-c3ad771f-a924-4cfd-b730-c634ff8b9417 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.148952 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e16b9b9b-4fb7-47cd-99b3-a345961ac8d6 req-c3ad771f-a924-4cfd-b730-c634ff8b9417 service nova] Creating event network-changed:9dad9642-2fa5-4f48-9928-cc4aebbe2498 for instance 4cb6aed9-8901-4e68-8a40-21dc9e2f690c on n-h1-839401-11 Aug 29 15:44:43.159256 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e16b9b9b-4fb7-47cd-99b3-a345961ac8d6 req-c3ad771f-a924-4cfd-b730-c634ff8b9417 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060227 Aug 29 15:44:43.160270 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2300/4459] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:43.199830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-329890ed-b387-4666-89f7-a89389ad4f2a req-f2f2cc22-5c82-4976-9765-8a5b514d71e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a6a627-cf39-45a2-ab54-9a1ffecbb57a", "name": "network-vif-plugged", "status": "completed", "tag": "de519f02-032e-441c-9cfd-0481b24fe996"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:43.213076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-329890ed-b387-4666-89f7-a89389ad4f2a req-f2f2cc22-5c82-4976-9765-8a5b514d71e4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.214069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-329890ed-b387-4666-89f7-a89389ad4f2a req-f2f2cc22-5c82-4976-9765-8a5b514d71e4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.215149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-329890ed-b387-4666-89f7-a89389ad4f2a req-f2f2cc22-5c82-4976-9765-8a5b514d71e4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.233911 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-329890ed-b387-4666-89f7-a89389ad4f2a req-f2f2cc22-5c82-4976-9765-8a5b514d71e4 service nova] Creating event network-vif-plugged:de519f02-032e-441c-9cfd-0481b24fe996 for instance c9a6a627-cf39-45a2-ab54-9a1ffecbb57a on n-h2-839401-11 Aug 29 15:44:43.243176 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-329890ed-b387-4666-89f7-a89389ad4f2a req-f2f2cc22-5c82-4976-9765-8a5b514d71e4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053798 Aug 29 15:44:43.245118 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2301/4460] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:44:43.258998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-932aa7f5-fb2b-45fe-bb99-958687140db2 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:43.259717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-932aa7f5-fb2b-45fe-bb99-958687140db2 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:43.267110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-932aa7f5-fb2b-45fe-bb99-958687140db2 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.267605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-932aa7f5-fb2b-45fe-bb99-958687140db2 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.268164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-932aa7f5-fb2b-45fe-bb99-958687140db2 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.269655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-932aa7f5-fb2b-45fe-bb99-958687140db2 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.270495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-932aa7f5-fb2b-45fe-bb99-958687140db2 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.271261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-932aa7f5-fb2b-45fe-bb99-958687140db2 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.390059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0cdaf6c3-6f1a-4cee-9505-fc84f1e07bb7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:43.401285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0cdaf6c3-6f1a-4cee-9505-fc84f1e07bb7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:43.403264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0cdaf6c3-6f1a-4cee-9505-fc84f1e07bb7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:43.405116 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0cdaf6c3-6f1a-4cee-9505-fc84f1e07bb7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.405108 Aug 29 15:44:43.418025 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2160/4461] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:42 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:43.428856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3ed329aa-aeaa-4f98-8ab6-3fc89d0c5223 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:43.429980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3ed329aa-aeaa-4f98-8ab6-3fc89d0c5223 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:43.432118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:43.441932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ed329aa-aeaa-4f98-8ab6-3fc89d0c5223 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.442800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ed329aa-aeaa-4f98-8ab6-3fc89d0c5223 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.443448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ed329aa-aeaa-4f98-8ab6-3fc89d0c5223 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.444357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ed329aa-aeaa-4f98-8ab6-3fc89d0c5223 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.445141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ed329aa-aeaa-4f98-8ab6-3fc89d0c5223 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.445782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ed329aa-aeaa-4f98-8ab6-3fc89d0c5223 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.497532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-932aa7f5-fb2b-45fe-bb99-958687140db2 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:43.513343 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-932aa7f5-fb2b-45fe-bb99-958687140db2 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1315 microversion: 2.1 time: 0.262764 Aug 29 15:44:43.514702 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2302/4462] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:43 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:43.722260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-68991d39-55e4-4b22-a903-8c06ecea5a44 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a87f820>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:43.769049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3ed329aa-aeaa-4f98-8ab6-3fc89d0c5223 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:43.781619 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3ed329aa-aeaa-4f98-8ab6-3fc89d0c5223 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1512 microversion: 2.1 time: 0.359935 Aug 29 15:44:43.782880 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2161/4463] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:43 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1512 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:43.791765 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-68991d39-55e4-4b22-a903-8c06ecea5a44 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998" status: 200 len: 1439 microversion: 2.1 time: 0.075927 Aug 29 15:44:43.800928 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2303/4464] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:43 2022] GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 => generated 1439 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:43.979712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-79a28b18-be18-4ac1-8a01-6b53ee2e7a1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:43.980331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-79a28b18-be18-4ac1-8a01-6b53ee2e7a1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:43.994590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-be8c7d0c-2f40-436d-842b-97daae7a6785 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:43.995862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-be8c7d0c-2f40-436d-842b-97daae7a6785 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:43.997915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79a28b18-be18-4ac1-8a01-6b53ee2e7a1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.998599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79a28b18-be18-4ac1-8a01-6b53ee2e7a1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.004286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be8c7d0c-2f40-436d-842b-97daae7a6785 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.004831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be8c7d0c-2f40-436d-842b-97daae7a6785 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.005336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be8c7d0c-2f40-436d-842b-97daae7a6785 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.006066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be8c7d0c-2f40-436d-842b-97daae7a6785 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.006515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be8c7d0c-2f40-436d-842b-97daae7a6785 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.006974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be8c7d0c-2f40-436d-842b-97daae7a6785 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.015884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79a28b18-be18-4ac1-8a01-6b53ee2e7a1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.017473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79a28b18-be18-4ac1-8a01-6b53ee2e7a1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.021696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79a28b18-be18-4ac1-8a01-6b53ee2e7a1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.022537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79a28b18-be18-4ac1-8a01-6b53ee2e7a1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.175129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-be8c7d0c-2f40-436d-842b-97daae7a6785 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:44.185549 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-be8c7d0c-2f40-436d-842b-97daae7a6785 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1322 microversion: 2.1 time: 0.194958 Aug 29 15:44:44.186028 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2304/4465] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:43 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:44.261452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-79a28b18-be18-4ac1-8a01-6b53ee2e7a1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:44.272298 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-79a28b18-be18-4ac1-8a01-6b53ee2e7a1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.296544 Aug 29 15:44:44.273282 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2162/4466] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:43 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:44.434754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4a37cd96-8686-456a-b31f-6ad7e3dbeb3e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:44.435699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4a37cd96-8686-456a-b31f-6ad7e3dbeb3e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:44.443648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a37cd96-8686-456a-b31f-6ad7e3dbeb3e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.444461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a37cd96-8686-456a-b31f-6ad7e3dbeb3e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.444842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a37cd96-8686-456a-b31f-6ad7e3dbeb3e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.445633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a37cd96-8686-456a-b31f-6ad7e3dbeb3e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.446727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a37cd96-8686-456a-b31f-6ad7e3dbeb3e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.446727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a37cd96-8686-456a-b31f-6ad7e3dbeb3e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.541296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0d4a387a-46dc-4b8b-a973-2813aa854f0a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:44.542938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0d4a387a-46dc-4b8b-a973-2813aa854f0a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:44.557688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d4a387a-46dc-4b8b-a973-2813aa854f0a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.558395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d4a387a-46dc-4b8b-a973-2813aa854f0a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.558987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d4a387a-46dc-4b8b-a973-2813aa854f0a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.560210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d4a387a-46dc-4b8b-a973-2813aa854f0a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.560864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d4a387a-46dc-4b8b-a973-2813aa854f0a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.561525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d4a387a-46dc-4b8b-a973-2813aa854f0a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.721419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4a37cd96-8686-456a-b31f-6ad7e3dbeb3e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:44.733720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4a37cd96-8686-456a-b31f-6ad7e3dbeb3e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:44.740495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4a37cd96-8686-456a-b31f-6ad7e3dbeb3e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:44.742570 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4a37cd96-8686-456a-b31f-6ad7e3dbeb3e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.312624 Aug 29 15:44:44.743576 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2305/4467] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:44 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:44.758345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0d4a387a-46dc-4b8b-a973-2813aa854f0a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:44.767643 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0d4a387a-46dc-4b8b-a973-2813aa854f0a tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1315 microversion: 2.1 time: 0.231852 Aug 29 15:44:44.780876 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2163/4468] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:44 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:44.806016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dbc6cd21-ad1e-4c19-980a-9fa8b9873056 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:44.809373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dbc6cd21-ad1e-4c19-980a-9fa8b9873056 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:44.816241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-68a288ee-82bc-4e32-9634-5c273b2d1df0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a639e50>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:44.822528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbc6cd21-ad1e-4c19-980a-9fa8b9873056 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.827686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbc6cd21-ad1e-4c19-980a-9fa8b9873056 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.828858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbc6cd21-ad1e-4c19-980a-9fa8b9873056 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.830321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbc6cd21-ad1e-4c19-980a-9fa8b9873056 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.830937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbc6cd21-ad1e-4c19-980a-9fa8b9873056 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.832147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbc6cd21-ad1e-4c19-980a-9fa8b9873056 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.891888 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-68a288ee-82bc-4e32-9634-5c273b2d1df0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998" status: 200 len: 1439 microversion: 2.1 time: 0.084350 Aug 29 15:44:44.892764 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2164/4469] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:44 2022] GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 => generated 1439 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:45.030304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dbc6cd21-ad1e-4c19-980a-9fa8b9873056 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:45.041900 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dbc6cd21-ad1e-4c19-980a-9fa8b9873056 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1512 microversion: 2.1 time: 0.240450 Aug 29 15:44:45.042524 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2306/4470] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:44 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1512 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:45.213000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bce01a99-6a60-4cf6-9ba4-360928a9ce57 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:45.215705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bce01a99-6a60-4cf6-9ba4-360928a9ce57 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:45.234445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce01a99-6a60-4cf6-9ba4-360928a9ce57 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.237304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce01a99-6a60-4cf6-9ba4-360928a9ce57 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.237937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce01a99-6a60-4cf6-9ba4-360928a9ce57 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.242177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce01a99-6a60-4cf6-9ba4-360928a9ce57 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.246345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce01a99-6a60-4cf6-9ba4-360928a9ce57 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.247651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce01a99-6a60-4cf6-9ba4-360928a9ce57 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.293863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-292a268a-118c-41b2-85d3-30debbc6d354 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:45.294826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-292a268a-118c-41b2-85d3-30debbc6d354 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:45.317073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-292a268a-118c-41b2-85d3-30debbc6d354 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.317887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-292a268a-118c-41b2-85d3-30debbc6d354 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.318656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-292a268a-118c-41b2-85d3-30debbc6d354 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.319931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-292a268a-118c-41b2-85d3-30debbc6d354 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.320489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-292a268a-118c-41b2-85d3-30debbc6d354 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.323205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-292a268a-118c-41b2-85d3-30debbc6d354 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.550887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bce01a99-6a60-4cf6-9ba4-360928a9ce57 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:45.566086 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bce01a99-6a60-4cf6-9ba4-360928a9ce57 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1322 microversion: 2.1 time: 0.362609 Aug 29 15:44:45.566741 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2165/4471] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:45 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:45.575438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-70231cf1-3d54-4075-a698-00acaea62f21 req-78b0b55d-07e4-4d5a-a6e2-2fdbf3b1a260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5219eda0-3ed8-4c6e-ba04-19ed69930d86", "name": "network-vif-plugged", "status": "completed", "tag": "eef1db13-8722-4bfa-a4c5-4d45002ee03b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:45.594797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-70231cf1-3d54-4075-a698-00acaea62f21 req-78b0b55d-07e4-4d5a-a6e2-2fdbf3b1a260 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.596019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-70231cf1-3d54-4075-a698-00acaea62f21 req-78b0b55d-07e4-4d5a-a6e2-2fdbf3b1a260 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.597478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-70231cf1-3d54-4075-a698-00acaea62f21 req-78b0b55d-07e4-4d5a-a6e2-2fdbf3b1a260 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.621489 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-70231cf1-3d54-4075-a698-00acaea62f21 req-78b0b55d-07e4-4d5a-a6e2-2fdbf3b1a260 service nova] Creating event network-vif-plugged:eef1db13-8722-4bfa-a4c5-4d45002ee03b for instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 on n-h1-839401-11 Aug 29 15:44:45.628008 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-70231cf1-3d54-4075-a698-00acaea62f21 req-78b0b55d-07e4-4d5a-a6e2-2fdbf3b1a260 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057189 Aug 29 15:44:45.629684 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2166/4472] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:45.723949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-292a268a-118c-41b2-85d3-30debbc6d354 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:45.743501 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-292a268a-118c-41b2-85d3-30debbc6d354 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.453544 Aug 29 15:44:45.745153 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2307/4473] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:45 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:45.772904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-db8df9c2-8bce-4b67-af5e-872e1f496713 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:45.773910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-db8df9c2-8bce-4b67-af5e-872e1f496713 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:45.789158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c700f070-9928-4598-8aea-7fe4fae98620 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:45.790838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c700f070-9928-4598-8aea-7fe4fae98620 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:45.809927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db8df9c2-8bce-4b67-af5e-872e1f496713 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.810584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db8df9c2-8bce-4b67-af5e-872e1f496713 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.812881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db8df9c2-8bce-4b67-af5e-872e1f496713 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.814320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c700f070-9928-4598-8aea-7fe4fae98620 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.815351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db8df9c2-8bce-4b67-af5e-872e1f496713 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.819388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c700f070-9928-4598-8aea-7fe4fae98620 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.820719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c700f070-9928-4598-8aea-7fe4fae98620 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.820943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db8df9c2-8bce-4b67-af5e-872e1f496713 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.822079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db8df9c2-8bce-4b67-af5e-872e1f496713 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.823018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c700f070-9928-4598-8aea-7fe4fae98620 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.831378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c700f070-9928-4598-8aea-7fe4fae98620 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.832741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c700f070-9928-4598-8aea-7fe4fae98620 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.191171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c700f070-9928-4598-8aea-7fe4fae98620 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.201612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:46.207676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-db8df9c2-8bce-4b67-af5e-872e1f496713 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.216105 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c700f070-9928-4598-8aea-7fe4fae98620 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1465 microversion: 2.1 time: 0.430931 Aug 29 15:44:46.226075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-db8df9c2-8bce-4b67-af5e-872e1f496713 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.227927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-db8df9c2-8bce-4b67-af5e-872e1f496713 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.233173 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-db8df9c2-8bce-4b67-af5e-872e1f496713 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.466920 Aug 29 15:44:46.235283 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2167/4474] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:45 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:46.235654 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2308/4475] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:45 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1465 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:46.268541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-89082c42-58fe-481c-a3cb-c27c97199a8b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a976a60>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:46.331584 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-89082c42-58fe-481c-a3cb-c27c97199a8b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998" status: 200 len: 1439 microversion: 2.1 time: 0.094688 Aug 29 15:44:46.332184 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2168/4476] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:46 2022] GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 => generated 1439 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:46.344550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7b20d5a2-cf3a-45fe-b76e-5fe1e6bc0dbe tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:46.345075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7b20d5a2-cf3a-45fe-b76e-5fe1e6bc0dbe tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:46.351903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b20d5a2-cf3a-45fe-b76e-5fe1e6bc0dbe tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.352333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b20d5a2-cf3a-45fe-b76e-5fe1e6bc0dbe tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.352782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b20d5a2-cf3a-45fe-b76e-5fe1e6bc0dbe tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.353523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b20d5a2-cf3a-45fe-b76e-5fe1e6bc0dbe tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.354042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b20d5a2-cf3a-45fe-b76e-5fe1e6bc0dbe tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.354461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b20d5a2-cf3a-45fe-b76e-5fe1e6bc0dbe tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.383611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7b20d5a2-cf3a-45fe-b76e-5fe1e6bc0dbe tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:44:46.444522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:46.503655 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7b20d5a2-cf3a-45fe-b76e-5fe1e6bc0dbe tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 204 len: 0 microversion: 2.1 time: 0.162951 Aug 29 15:44:46.504691 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2169/4477] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:44:46 2022] DELETE /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:46.516451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-45625b54-5e80-4203-ba37-a972d0fd501d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:46.517462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-45625b54-5e80-4203-ba37-a972d0fd501d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:46.522011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-95e79724-7644-48a8-a127-2cdc38ee0a44 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:46.522737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-95e79724-7644-48a8-a127-2cdc38ee0a44 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:46.525879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45625b54-5e80-4203-ba37-a972d0fd501d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.526583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45625b54-5e80-4203-ba37-a972d0fd501d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.527271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45625b54-5e80-4203-ba37-a972d0fd501d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.528820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45625b54-5e80-4203-ba37-a972d0fd501d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.529231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95e79724-7644-48a8-a127-2cdc38ee0a44 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.529729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95e79724-7644-48a8-a127-2cdc38ee0a44 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.530014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45625b54-5e80-4203-ba37-a972d0fd501d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.530156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95e79724-7644-48a8-a127-2cdc38ee0a44 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.530899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45625b54-5e80-4203-ba37-a972d0fd501d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.531224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95e79724-7644-48a8-a127-2cdc38ee0a44 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.531841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95e79724-7644-48a8-a127-2cdc38ee0a44 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.532415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95e79724-7644-48a8-a127-2cdc38ee0a44 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.742463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-95e79724-7644-48a8-a127-2cdc38ee0a44 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.752058 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-95e79724-7644-48a8-a127-2cdc38ee0a44 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1471 microversion: 2.1 time: 0.241067 Aug 29 15:44:46.753309 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2170/4478] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:46 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1471 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:46.756139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-45625b54-5e80-4203-ba37-a972d0fd501d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.759891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0eb11a74-6ad2-48bb-bb20-7116eaef58d5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:46.760699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0eb11a74-6ad2-48bb-bb20-7116eaef58d5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:46.769077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eb11a74-6ad2-48bb-bb20-7116eaef58d5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.769709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eb11a74-6ad2-48bb-bb20-7116eaef58d5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.770943 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-45625b54-5e80-4203-ba37-a972d0fd501d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1512 microversion: 2.1 time: 0.533927 Aug 29 15:44:46.771463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eb11a74-6ad2-48bb-bb20-7116eaef58d5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.772309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eb11a74-6ad2-48bb-bb20-7116eaef58d5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.773754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eb11a74-6ad2-48bb-bb20-7116eaef58d5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.774068 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2309/4479] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:46 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1512 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:46.776671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eb11a74-6ad2-48bb-bb20-7116eaef58d5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.782382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f41b377-3cab-464b-85da-b64527f3e6d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:46.783949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3f41b377-3cab-464b-85da-b64527f3e6d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:46.796805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f41b377-3cab-464b-85da-b64527f3e6d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.797919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f41b377-3cab-464b-85da-b64527f3e6d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.798627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f41b377-3cab-464b-85da-b64527f3e6d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.799946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f41b377-3cab-464b-85da-b64527f3e6d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.800788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f41b377-3cab-464b-85da-b64527f3e6d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.801538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f41b377-3cab-464b-85da-b64527f3e6d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.012260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0eb11a74-6ad2-48bb-bb20-7116eaef58d5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:47.025517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3f41b377-3cab-464b-85da-b64527f3e6d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:47.048589 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3f41b377-3cab-464b-85da-b64527f3e6d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.273113 Aug 29 15:44:47.051731 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0eb11a74-6ad2-48bb-bb20-7116eaef58d5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1322 microversion: 2.1 time: 0.297150 Aug 29 15:44:47.052687 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2310/4480] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:46 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:47.053840 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2171/4481] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:46 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:47.261857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-78d1007f-edae-4d05-b026-0e3a5ac7dce8 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:47.264906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-78d1007f-edae-4d05-b026-0e3a5ac7dce8 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:47.281736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d1007f-edae-4d05-b026-0e3a5ac7dce8 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.282921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d1007f-edae-4d05-b026-0e3a5ac7dce8 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.283448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d1007f-edae-4d05-b026-0e3a5ac7dce8 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.287939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d1007f-edae-4d05-b026-0e3a5ac7dce8 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.289563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d1007f-edae-4d05-b026-0e3a5ac7dce8 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.291916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78d1007f-edae-4d05-b026-0e3a5ac7dce8 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.356980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-220d8916-cc28-458c-aaa1-9e2fd93ef087 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a759280>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:47.433623 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-220d8916-cc28-458c-aaa1-9e2fd93ef087 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998" status: 200 len: 1439 microversion: 2.1 time: 0.086948 Aug 29 15:44:47.439651 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2172/4482] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:47 2022] GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 => generated 1439 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:47.680709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-754341bb-a7e6-4d6e-ac04-7a1ef65ac56a req-89ee9d2f-0368-45dc-a0f3-92fa8c2fcbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824db4a3-47bf-494c-b490-d7631b6d9d54", "name": "network-vif-plugged", "status": "completed", "tag": "98e91a7f-1a84-4261-8c1b-359bdbdb9f7e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:47.729293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-754341bb-a7e6-4d6e-ac04-7a1ef65ac56a req-89ee9d2f-0368-45dc-a0f3-92fa8c2fcbf8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.729911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-754341bb-a7e6-4d6e-ac04-7a1ef65ac56a req-89ee9d2f-0368-45dc-a0f3-92fa8c2fcbf8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.730371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-754341bb-a7e6-4d6e-ac04-7a1ef65ac56a req-89ee9d2f-0368-45dc-a0f3-92fa8c2fcbf8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.754193 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-754341bb-a7e6-4d6e-ac04-7a1ef65ac56a req-89ee9d2f-0368-45dc-a0f3-92fa8c2fcbf8 service nova] Creating event network-vif-plugged:98e91a7f-1a84-4261-8c1b-359bdbdb9f7e for instance 824db4a3-47bf-494c-b490-d7631b6d9d54 on n-h1-839401-11 Aug 29 15:44:47.771059 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-754341bb-a7e6-4d6e-ac04-7a1ef65ac56a req-89ee9d2f-0368-45dc-a0f3-92fa8c2fcbf8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096492 Aug 29 15:44:47.776617 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2173/4483] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:44:47.782349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-40bc069c-62f5-4330-b7ec-8f2b6078a911 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:47.783316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-40bc069c-62f5-4330-b7ec-8f2b6078a911 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:47.794330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-78d1007f-edae-4d05-b026-0e3a5ac7dce8 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:47.803681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40bc069c-62f5-4330-b7ec-8f2b6078a911 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.804197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40bc069c-62f5-4330-b7ec-8f2b6078a911 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.804645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40bc069c-62f5-4330-b7ec-8f2b6078a911 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.807699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-78d1007f-edae-4d05-b026-0e3a5ac7dce8 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:47.809788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-78d1007f-edae-4d05-b026-0e3a5ac7dce8 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:47.811415 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-78d1007f-edae-4d05-b026-0e3a5ac7dce8 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.557063 Aug 29 15:44:47.811848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40bc069c-62f5-4330-b7ec-8f2b6078a911 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.812379 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2311/4484] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:47 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:47.812491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40bc069c-62f5-4330-b7ec-8f2b6078a911 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.812840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40bc069c-62f5-4330-b7ec-8f2b6078a911 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.839770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e5427f5d-ab35-4775-a255-2a6a6b294e1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:47.852690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e5427f5d-ab35-4775-a255-2a6a6b294e1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:47.865106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5427f5d-ab35-4775-a255-2a6a6b294e1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.865709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5427f5d-ab35-4775-a255-2a6a6b294e1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.866265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5427f5d-ab35-4775-a255-2a6a6b294e1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.867085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5427f5d-ab35-4775-a255-2a6a6b294e1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.867870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5427f5d-ab35-4775-a255-2a6a6b294e1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.868497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5427f5d-ab35-4775-a255-2a6a6b294e1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.066692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e5427f5d-ab35-4775-a255-2a6a6b294e1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:48.082032 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e5427f5d-ab35-4775-a255-2a6a6b294e1f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1512 microversion: 2.1 time: 0.268013 Aug 29 15:44:48.096307 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2312/4485] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:47 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:48.105139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d2fefec-46cc-4541-8201-c315bc1bad5f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:48.105779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9d2fefec-46cc-4541-8201-c315bc1bad5f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:48.112483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d2fefec-46cc-4541-8201-c315bc1bad5f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.113111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d2fefec-46cc-4541-8201-c315bc1bad5f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.113700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d2fefec-46cc-4541-8201-c315bc1bad5f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.114478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d2fefec-46cc-4541-8201-c315bc1bad5f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.114939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d2fefec-46cc-4541-8201-c315bc1bad5f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.115377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d2fefec-46cc-4541-8201-c315bc1bad5f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.147805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-40bc069c-62f5-4330-b7ec-8f2b6078a911 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:48.156855 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-40bc069c-62f5-4330-b7ec-8f2b6078a911 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1471 microversion: 2.1 time: 0.378721 Aug 29 15:44:48.159793 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2174/4486] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:47 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:48.167765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-45441f11-4bca-4349-9a00-e155073f8316 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:48.173698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-45441f11-4bca-4349-9a00-e155073f8316 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:48.182270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45441f11-4bca-4349-9a00-e155073f8316 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.182780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45441f11-4bca-4349-9a00-e155073f8316 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.183223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45441f11-4bca-4349-9a00-e155073f8316 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.184788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45441f11-4bca-4349-9a00-e155073f8316 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.185288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45441f11-4bca-4349-9a00-e155073f8316 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.185730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45441f11-4bca-4349-9a00-e155073f8316 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.258037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:48.284970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:48.341255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9d2fefec-46cc-4541-8201-c315bc1bad5f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:48.350431 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d2fefec-46cc-4541-8201-c315bc1bad5f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1322 microversion: 2.1 time: 0.258258 Aug 29 15:44:48.358799 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2313/4487] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:48 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:48.390218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-45441f11-4bca-4349-9a00-e155073f8316 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:48.400727 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-45441f11-4bca-4349-9a00-e155073f8316 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.236852 Aug 29 15:44:48.414621 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2175/4488] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:48 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:48.453301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d005c06-7452-46ed-a4fe-926e4e3fc22f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a8eed30>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:48.501550 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d005c06-7452-46ed-a4fe-926e4e3fc22f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998" status: 200 len: 1439 microversion: 2.1 time: 0.052243 Aug 29 15:44:48.502838 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2314/4489] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:48 2022] GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 => generated 1439 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:48.840220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bd33f147-fd4e-4236-a81b-6a08ad482745 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:48.840870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bd33f147-fd4e-4236-a81b-6a08ad482745 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:48.856880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd33f147-fd4e-4236-a81b-6a08ad482745 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.858731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd33f147-fd4e-4236-a81b-6a08ad482745 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.859582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd33f147-fd4e-4236-a81b-6a08ad482745 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.864609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd33f147-fd4e-4236-a81b-6a08ad482745 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.867617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd33f147-fd4e-4236-a81b-6a08ad482745 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.870053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd33f147-fd4e-4236-a81b-6a08ad482745 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.118251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-91f1f04f-04cc-4208-a5ca-e5e18bb4e28c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:49.128272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-91f1f04f-04cc-4208-a5ca-e5e18bb4e28c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:49.182212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91f1f04f-04cc-4208-a5ca-e5e18bb4e28c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.183157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91f1f04f-04cc-4208-a5ca-e5e18bb4e28c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.184462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91f1f04f-04cc-4208-a5ca-e5e18bb4e28c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.193038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91f1f04f-04cc-4208-a5ca-e5e18bb4e28c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.195559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91f1f04f-04cc-4208-a5ca-e5e18bb4e28c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.200891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91f1f04f-04cc-4208-a5ca-e5e18bb4e28c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.211315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:49.508676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bd33f147-fd4e-4236-a81b-6a08ad482745 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:49.559447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bd33f147-fd4e-4236-a81b-6a08ad482745 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:49.568061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bd33f147-fd4e-4236-a81b-6a08ad482745 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:49.593042 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bd33f147-fd4e-4236-a81b-6a08ad482745 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.756471 Aug 29 15:44:49.615452 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2176/4490] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:48 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:49.661640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9c2d1dc8-3233-4ddf-9f03-50418aa02803 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:49.665491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9c2d1dc8-3233-4ddf-9f03-50418aa02803 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:49.670050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-91f1f04f-04cc-4208-a5ca-e5e18bb4e28c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:49.712537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c2d1dc8-3233-4ddf-9f03-50418aa02803 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.713817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c2d1dc8-3233-4ddf-9f03-50418aa02803 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.716127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c2d1dc8-3233-4ddf-9f03-50418aa02803 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.718645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c2d1dc8-3233-4ddf-9f03-50418aa02803 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.728049 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-91f1f04f-04cc-4208-a5ca-e5e18bb4e28c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1507 microversion: 2.1 time: 0.625674 Aug 29 15:44:49.729131 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2315/4491] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:49 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1507 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:49.729584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c2d1dc8-3233-4ddf-9f03-50418aa02803 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.733108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c2d1dc8-3233-4ddf-9f03-50418aa02803 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.783895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2958fb63-5944-4f3d-b943-e942c2af0df4 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:49.786668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2958fb63-5944-4f3d-b943-e942c2af0df4 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:49.844502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2958fb63-5944-4f3d-b943-e942c2af0df4 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.850350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2958fb63-5944-4f3d-b943-e942c2af0df4 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.850994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2958fb63-5944-4f3d-b943-e942c2af0df4 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.851770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2958fb63-5944-4f3d-b943-e942c2af0df4 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.852245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2958fb63-5944-4f3d-b943-e942c2af0df4 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.852684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2958fb63-5944-4f3d-b943-e942c2af0df4 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.082522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9c2d1dc8-3233-4ddf-9f03-50418aa02803 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cab6d2924ff4befbb84e9c88ddc196b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72bf0bb09f48bc9df6ee8e6be4c936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:50.127146 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9c2d1dc8-3233-4ddf-9f03-50418aa02803 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 200 len: 1429 microversion: 2.1 time: 0.503259 Aug 29 15:44:50.128614 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2177/4492] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:49 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 1429 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:50.141831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cc8076a5-72b6-4186-952c-35d6f5d8cc0a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:50.143228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cc8076a5-72b6-4186-952c-35d6f5d8cc0a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:50.157681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc8076a5-72b6-4186-952c-35d6f5d8cc0a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.159082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc8076a5-72b6-4186-952c-35d6f5d8cc0a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.160035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc8076a5-72b6-4186-952c-35d6f5d8cc0a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.161527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc8076a5-72b6-4186-952c-35d6f5d8cc0a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.162526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc8076a5-72b6-4186-952c-35d6f5d8cc0a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.163788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc8076a5-72b6-4186-952c-35d6f5d8cc0a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.372454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2958fb63-5944-4f3d-b943-e942c2af0df4 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:50.406217 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2958fb63-5944-4f3d-b943-e942c2af0df4 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1322 microversion: 2.1 time: 0.664685 Aug 29 15:44:50.408941 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2316/4493] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:49 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1322 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:50.418072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-31a92a8b-9909-4310-b99e-54f7831fb95b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a77fee0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:50.730648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cc8076a5-72b6-4186-952c-35d6f5d8cc0a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:50.752653 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cc8076a5-72b6-4186-952c-35d6f5d8cc0a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.615878 Aug 29 15:44:50.756903 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2178/4494] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:50 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:50.768382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-00215c0f-c261-4f19-bdf3-dab1157d185d req-5706c5c9-ff40-4011-957b-bbe285cec814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a6a627-cf39-45a2-ab54-9a1ffecbb57a", "name": "network-vif-deleted", "tag": "de519f02-032e-441c-9cfd-0481b24fe996"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:50.781981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-00215c0f-c261-4f19-bdf3-dab1157d185d req-5706c5c9-ff40-4011-957b-bbe285cec814 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.787039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-00215c0f-c261-4f19-bdf3-dab1157d185d req-5706c5c9-ff40-4011-957b-bbe285cec814 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.792467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-00215c0f-c261-4f19-bdf3-dab1157d185d req-5706c5c9-ff40-4011-957b-bbe285cec814 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.815344 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-00215c0f-c261-4f19-bdf3-dab1157d185d req-5706c5c9-ff40-4011-957b-bbe285cec814 service nova] Creating event network-vif-deleted:de519f02-032e-441c-9cfd-0481b24fe996 for instance c9a6a627-cf39-45a2-ab54-9a1ffecbb57a on n-h2-839401-11 Aug 29 15:44:50.852376 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-00215c0f-c261-4f19-bdf3-dab1157d185d req-5706c5c9-ff40-4011-957b-bbe285cec814 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093234 Aug 29 15:44:50.857116 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2179/4495] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:50.871990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7015c668-70a5-488b-bae2-e2a6588a684e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:50.872894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7015c668-70a5-488b-bae2-e2a6588a684e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:50.883357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7015c668-70a5-488b-bae2-e2a6588a684e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.883800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7015c668-70a5-488b-bae2-e2a6588a684e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.884592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7015c668-70a5-488b-bae2-e2a6588a684e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.886027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7015c668-70a5-488b-bae2-e2a6588a684e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.887340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7015c668-70a5-488b-bae2-e2a6588a684e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.888330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7015c668-70a5-488b-bae2-e2a6588a684e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.414376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7015c668-70a5-488b-bae2-e2a6588a684e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:51.440194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7015c668-70a5-488b-bae2-e2a6588a684e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:51.441917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7015c668-70a5-488b-bae2-e2a6588a684e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:51.443719 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7015c668-70a5-488b-bae2-e2a6588a684e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.585345 Aug 29 15:44:51.447098 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2180/4496] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:50 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:51.469734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-63e545a2-8735-4e50-aa8a-53f01cfbf20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:51.470536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-63e545a2-8735-4e50-aa8a-53f01cfbf20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:51.491302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63e545a2-8735-4e50-aa8a-53f01cfbf20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.493556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63e545a2-8735-4e50-aa8a-53f01cfbf20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.502035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63e545a2-8735-4e50-aa8a-53f01cfbf20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.503189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63e545a2-8735-4e50-aa8a-53f01cfbf20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.503762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63e545a2-8735-4e50-aa8a-53f01cfbf20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.506400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63e545a2-8735-4e50-aa8a-53f01cfbf20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.726305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-63e545a2-8735-4e50-aa8a-53f01cfbf20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:51.747669 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-63e545a2-8735-4e50-aa8a-53f01cfbf20b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1507 microversion: 2.1 time: 0.288942 Aug 29 15:44:51.749177 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2181/4497] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:51 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1507 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:51.754982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7cc61f2a-540a-47ba-9dae-b78c520f51a7 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:51.756727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7cc61f2a-540a-47ba-9dae-b78c520f51a7 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] [instance: c9a6a627-cf39-45a2-ab54-9a1ffecbb57a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:51.765569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cc61f2a-540a-47ba-9dae-b78c520f51a7 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.766578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cc61f2a-540a-47ba-9dae-b78c520f51a7 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.779006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cc61f2a-540a-47ba-9dae-b78c520f51a7 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.780431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cc61f2a-540a-47ba-9dae-b78c520f51a7 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.781230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cc61f2a-540a-47ba-9dae-b78c520f51a7 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.781914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cc61f2a-540a-47ba-9dae-b78c520f51a7 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.825028 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-7cc61f2a-540a-47ba-9dae-b78c520f51a7 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] HTTP exception thrown: Instance c9a6a627-cf39-45a2-ab54-9a1ffecbb57a could not be found. Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7cc61f2a-540a-47ba-9dae-b78c520f51a7 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Request method failure captured: Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a HTTP/1.1 Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN7TNTXZfcMePiVDEs9H8GfYgGjLWVojQ1gJBsp9Ido58YoAxKejXKpqBdrnFc4MIzIft4-n8Ot0wQoYZwt8DBBp6Gu_18VsX4L4q3iF4CKrQYT_Po2aiEtNqREmea_gaw2zMWS1Q3XoD3gRUs5deAau0VJDe4YpNAwhKxi_yGos5ak Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: be72bf0bb09f48bc9df6ee8e6be4c936 Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-VolumesNegativeTest-848947344 Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_be72bf0bb09f48bc9df6ee8e6be4c936", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/be72bf0bb09f48bc9df6ee8e6be4c936"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/be72bf0bb09f48bc9df6ee8e6be4c936"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/be72bf0bb09f48bc9df6ee8e6be4c936"}]}] Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-VolumesNegativeTest-848947344 Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: be72bf0bb09f48bc9df6ee8e6be4c936 Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-VolumesNegativeTest-848947344 Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-VolumesNegativeTest-848947344-project Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 2cab6d2924ff4befbb84e9c88ddc196b Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-VolumesNegativeTest-848947344-project Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance c9a6a627-cf39-45a2-ab54-9a1ffecbb57a could not be found. Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'c9a6a627-cf39-45a2-ab54-9a1ffecbb57a'} Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a6a627-cf39-45a2-ab54-9a1ffecbb57a could not be found. Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a6a627-cf39-45a2-ab54-9a1ffecbb57a could not be found. Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:51.828153 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:51.838691 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:51.838691 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:51.838691 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:51.838691 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:51.838691 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:51.838691 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a6a627-cf39-45a2-ab54-9a1ffecbb57a could not be found. Aug 29 15:44:51.838691 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:44:51.842247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7cc61f2a-540a-47ba-9dae-b78c520f51a7 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] Returning 404 to user: Instance c9a6a627-cf39-45a2-ab54-9a1ffecbb57a could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:51.843397 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7cc61f2a-540a-47ba-9dae-b78c520f51a7 tempest-VolumesNegativeTest-848947344 tempest-VolumesNegativeTest-848947344-project] 10.222.0.62 "GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a" status: 404 len: 111 microversion: 2.1 time: 0.093072 Aug 29 15:44:51.860207 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2182/4498] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:51 2022] GET /compute/v2.1/servers/c9a6a627-cf39-45a2-ab54-9a1ffecbb57a => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:51.869569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eec4236b-7c46-485e-91ce-475064681671 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:51.870633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eec4236b-7c46-485e-91ce-475064681671 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:51.882719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eec4236b-7c46-485e-91ce-475064681671 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.883584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eec4236b-7c46-485e-91ce-475064681671 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.884256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eec4236b-7c46-485e-91ce-475064681671 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.885265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eec4236b-7c46-485e-91ce-475064681671 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.886018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eec4236b-7c46-485e-91ce-475064681671 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.886729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eec4236b-7c46-485e-91ce-475064681671 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.092939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eec4236b-7c46-485e-91ce-475064681671 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:52.104830 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eec4236b-7c46-485e-91ce-475064681671 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1322 microversion: 2.1 time: 0.242591 Aug 29 15:44:52.106036 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2183/4499] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:51 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:52.113567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d1bff1c7-2737-439f-9041-c612abd81993 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:52.114590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d1bff1c7-2737-439f-9041-c612abd81993 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:52.122441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1bff1c7-2737-439f-9041-c612abd81993 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.123175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1bff1c7-2737-439f-9041-c612abd81993 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.123820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1bff1c7-2737-439f-9041-c612abd81993 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.125106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1bff1c7-2737-439f-9041-c612abd81993 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.126345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1bff1c7-2737-439f-9041-c612abd81993 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.127501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1bff1c7-2737-439f-9041-c612abd81993 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.425202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d1bff1c7-2737-439f-9041-c612abd81993 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:52.436770 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d1bff1c7-2737-439f-9041-c612abd81993 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.328895 Aug 29 15:44:52.438126 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2184/4500] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:52 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:52.478989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c4c54a4f-ce49-4d4f-9e08-72d35ddc00ae tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:52.480341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c4c54a4f-ce49-4d4f-9e08-72d35ddc00ae tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:52.492527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c54a4f-ce49-4d4f-9e08-72d35ddc00ae tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.493693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c54a4f-ce49-4d4f-9e08-72d35ddc00ae tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.494539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c54a4f-ce49-4d4f-9e08-72d35ddc00ae tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.496966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c54a4f-ce49-4d4f-9e08-72d35ddc00ae tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.498122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c54a4f-ce49-4d4f-9e08-72d35ddc00ae tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.499117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4c54a4f-ce49-4d4f-9e08-72d35ddc00ae tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.899090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c4c54a4f-ce49-4d4f-9e08-72d35ddc00ae tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:52.910541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c4c54a4f-ce49-4d4f-9e08-72d35ddc00ae tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:52.912109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c4c54a4f-ce49-4d4f-9e08-72d35ddc00ae tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:52.913683 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c4c54a4f-ce49-4d4f-9e08-72d35ddc00ae tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.441205 Aug 29 15:44:52.914714 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2185/4501] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:52 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:52.922455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8e9154d8-ed2f-4dfb-8920-6b04df7ad5eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:52.923842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8e9154d8-ed2f-4dfb-8920-6b04df7ad5eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:52.931646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e9154d8-ed2f-4dfb-8920-6b04df7ad5eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.932414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e9154d8-ed2f-4dfb-8920-6b04df7ad5eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.933326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e9154d8-ed2f-4dfb-8920-6b04df7ad5eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.934710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e9154d8-ed2f-4dfb-8920-6b04df7ad5eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.936725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e9154d8-ed2f-4dfb-8920-6b04df7ad5eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.937558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e9154d8-ed2f-4dfb-8920-6b04df7ad5eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.293137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8e9154d8-ed2f-4dfb-8920-6b04df7ad5eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:53.311856 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8e9154d8-ed2f-4dfb-8920-6b04df7ad5eb tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1507 microversion: 2.1 time: 0.395638 Aug 29 15:44:53.317434 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2186/4502] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:52 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1507 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:53.341894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-06b6ccb6-28e7-4440-86a6-368b69c55ccf tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:53.343089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-06b6ccb6-28e7-4440-86a6-368b69c55ccf tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:53.360543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06b6ccb6-28e7-4440-86a6-368b69c55ccf tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.361329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06b6ccb6-28e7-4440-86a6-368b69c55ccf tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.371305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06b6ccb6-28e7-4440-86a6-368b69c55ccf tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.372630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06b6ccb6-28e7-4440-86a6-368b69c55ccf tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.373789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06b6ccb6-28e7-4440-86a6-368b69c55ccf tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.375056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06b6ccb6-28e7-4440-86a6-368b69c55ccf tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.661874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-06b6ccb6-28e7-4440-86a6-368b69c55ccf tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:53.672446 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-06b6ccb6-28e7-4440-86a6-368b69c55ccf tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1322 microversion: 2.1 time: 0.345341 Aug 29 15:44:53.673690 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2187/4503] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:53 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:53.679376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-ea287215-5736-40ae-8761-e305f88b5737 req-bf231658-e0ad-4c89-bd54-7b6d554413d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb6aed9-8901-4e68-8a40-21dc9e2f690c", "name": "network-vif-plugged", "status": "completed", "tag": "9dad9642-2fa5-4f48-9928-cc4aebbe2498"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:53.693895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ea287215-5736-40ae-8761-e305f88b5737 req-bf231658-e0ad-4c89-bd54-7b6d554413d4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.694850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ea287215-5736-40ae-8761-e305f88b5737 req-bf231658-e0ad-4c89-bd54-7b6d554413d4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.695907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ea287215-5736-40ae-8761-e305f88b5737 req-bf231658-e0ad-4c89-bd54-7b6d554413d4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.720896 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-ea287215-5736-40ae-8761-e305f88b5737 req-bf231658-e0ad-4c89-bd54-7b6d554413d4 service nova] Creating event network-vif-plugged:9dad9642-2fa5-4f48-9928-cc4aebbe2498 for instance 4cb6aed9-8901-4e68-8a40-21dc9e2f690c on n-h1-839401-11 Aug 29 15:44:53.728818 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-ea287215-5736-40ae-8761-e305f88b5737 req-bf231658-e0ad-4c89-bd54-7b6d554413d4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053487 Aug 29 15:44:53.734937 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2188/4504] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:53.743179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-92917b4e-7c79-4001-9422-a8329e1a3835 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:53.744972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-92917b4e-7c79-4001-9422-a8329e1a3835 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:53.754269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92917b4e-7c79-4001-9422-a8329e1a3835 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.755128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92917b4e-7c79-4001-9422-a8329e1a3835 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.755793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92917b4e-7c79-4001-9422-a8329e1a3835 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.756717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92917b4e-7c79-4001-9422-a8329e1a3835 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.757429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92917b4e-7c79-4001-9422-a8329e1a3835 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.758355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92917b4e-7c79-4001-9422-a8329e1a3835 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.024242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-92917b4e-7c79-4001-9422-a8329e1a3835 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:54.032703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:54.039508 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-92917b4e-7c79-4001-9422-a8329e1a3835 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.303078 Aug 29 15:44:54.040665 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2189/4505] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:53 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:54.066942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4f010180-c5e5-48a1-8d63-64b91711cac5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:54.071193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4f010180-c5e5-48a1-8d63-64b91711cac5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:54.088882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f010180-c5e5-48a1-8d63-64b91711cac5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.089417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f010180-c5e5-48a1-8d63-64b91711cac5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.089869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f010180-c5e5-48a1-8d63-64b91711cac5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.090619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f010180-c5e5-48a1-8d63-64b91711cac5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.091681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f010180-c5e5-48a1-8d63-64b91711cac5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.092164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f010180-c5e5-48a1-8d63-64b91711cac5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.428454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4f010180-c5e5-48a1-8d63-64b91711cac5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:54.441777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4f010180-c5e5-48a1-8d63-64b91711cac5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:54.443387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4f010180-c5e5-48a1-8d63-64b91711cac5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:54.447023 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4f010180-c5e5-48a1-8d63-64b91711cac5 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.403855 Aug 29 15:44:54.447980 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2190/4506] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:54 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:54.454301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1bbedb0b-b74f-4648-8a1b-a7e3ef9dd91e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:54.454928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1bbedb0b-b74f-4648-8a1b-a7e3ef9dd91e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:54.464644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1bbedb0b-b74f-4648-8a1b-a7e3ef9dd91e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.465161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1bbedb0b-b74f-4648-8a1b-a7e3ef9dd91e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.465601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1bbedb0b-b74f-4648-8a1b-a7e3ef9dd91e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.467042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1bbedb0b-b74f-4648-8a1b-a7e3ef9dd91e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.467512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1bbedb0b-b74f-4648-8a1b-a7e3ef9dd91e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.467940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1bbedb0b-b74f-4648-8a1b-a7e3ef9dd91e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.752594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1bbedb0b-b74f-4648-8a1b-a7e3ef9dd91e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:54.776995 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1bbedb0b-b74f-4648-8a1b-a7e3ef9dd91e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1507 microversion: 2.1 time: 0.327782 Aug 29 15:44:54.789181 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2191/4507] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:54 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1507 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:54.794115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-63c4171c-3596-43da-9d4c-1c42e4b048e3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:54.794115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-63c4171c-3596-43da-9d4c-1c42e4b048e3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:54.819065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63c4171c-3596-43da-9d4c-1c42e4b048e3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.819893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63c4171c-3596-43da-9d4c-1c42e4b048e3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.820765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63c4171c-3596-43da-9d4c-1c42e4b048e3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.823854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63c4171c-3596-43da-9d4c-1c42e4b048e3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.826070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63c4171c-3596-43da-9d4c-1c42e4b048e3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.826554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63c4171c-3596-43da-9d4c-1c42e4b048e3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.235249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-63c4171c-3596-43da-9d4c-1c42e4b048e3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.252827 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-63c4171c-3596-43da-9d4c-1c42e4b048e3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1322 microversion: 2.1 time: 0.470672 Aug 29 15:44:55.254891 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2192/4508] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:54 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:55.272653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e13092a0-85a7-4253-88e9-6fe284fedc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:55.273061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e13092a0-85a7-4253-88e9-6fe284fedc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:55.291769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e13092a0-85a7-4253-88e9-6fe284fedc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.292840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e13092a0-85a7-4253-88e9-6fe284fedc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.293470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e13092a0-85a7-4253-88e9-6fe284fedc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.300592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e13092a0-85a7-4253-88e9-6fe284fedc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.303952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e13092a0-85a7-4253-88e9-6fe284fedc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.304750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e13092a0-85a7-4253-88e9-6fe284fedc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.365665 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 15:44:56.366647 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 15:44:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 (ip 10.222.0.62) !!! Aug 29 15:44:56.526971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e13092a0-85a7-4253-88e9-6fe284fedc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:56.540961 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e13092a0-85a7-4253-88e9-6fe284fedc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 1.285429 Aug 29 15:44:56.542804 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2193/4509] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:55 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:56.549534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-315fcda2-0aae-43e6-a481-d20c16975bd0 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:56.550981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-315fcda2-0aae-43e6-a481-d20c16975bd0 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:56.559658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-315fcda2-0aae-43e6-a481-d20c16975bd0 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.560257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-315fcda2-0aae-43e6-a481-d20c16975bd0 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.560788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-315fcda2-0aae-43e6-a481-d20c16975bd0 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.563045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-315fcda2-0aae-43e6-a481-d20c16975bd0 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.563619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-315fcda2-0aae-43e6-a481-d20c16975bd0 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.564384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-315fcda2-0aae-43e6-a481-d20c16975bd0 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.889460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-315fcda2-0aae-43e6-a481-d20c16975bd0 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:56.910775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-315fcda2-0aae-43e6-a481-d20c16975bd0 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:56.913125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-315fcda2-0aae-43e6-a481-d20c16975bd0 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:56.914598 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-315fcda2-0aae-43e6-a481-d20c16975bd0 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.370424 Aug 29 15:44:56.932617 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2194/4510] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:56 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:56.938875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-91754b1a-89e8-476c-9f29-b1ecb676485e req-a9cb346f-431f-4ee2-b2c9-894a612b4531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "name": "network-vif-plugged", "status": "completed", "tag": "1a543716-cc66-4d75-84e9-429e6bbf56a0"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:56.959070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-91754b1a-89e8-476c-9f29-b1ecb676485e req-a9cb346f-431f-4ee2-b2c9-894a612b4531 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.959635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-91754b1a-89e8-476c-9f29-b1ecb676485e req-a9cb346f-431f-4ee2-b2c9-894a612b4531 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.960067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-91754b1a-89e8-476c-9f29-b1ecb676485e req-a9cb346f-431f-4ee2-b2c9-894a612b4531 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.973485 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-91754b1a-89e8-476c-9f29-b1ecb676485e req-a9cb346f-431f-4ee2-b2c9-894a612b4531 service nova] Creating event network-vif-plugged:1a543716-cc66-4d75-84e9-429e6bbf56a0 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:44:56.979561 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-91754b1a-89e8-476c-9f29-b1ecb676485e req-a9cb346f-431f-4ee2-b2c9-894a612b4531 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045489 Aug 29 15:44:56.981143 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2195/4511] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:56.986733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-15437ed4-cf22-4535-a581-e7e04c37ac03 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:56.988134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-15437ed4-cf22-4535-a581-e7e04c37ac03 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:56.995781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15437ed4-cf22-4535-a581-e7e04c37ac03 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.996289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15437ed4-cf22-4535-a581-e7e04c37ac03 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.996717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15437ed4-cf22-4535-a581-e7e04c37ac03 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.997739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15437ed4-cf22-4535-a581-e7e04c37ac03 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.998205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15437ed4-cf22-4535-a581-e7e04c37ac03 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.998628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-15437ed4-cf22-4535-a581-e7e04c37ac03 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.265595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-15437ed4-cf22-4535-a581-e7e04c37ac03 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:57.284159 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-15437ed4-cf22-4535-a581-e7e04c37ac03 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1507 microversion: 2.1 time: 0.301895 Aug 29 15:44:57.284966 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2196/4512] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:56 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:57.304141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-92f4413b-d171-4d48-bafe-9e6743a3ab1b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:57.304825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-92f4413b-d171-4d48-bafe-9e6743a3ab1b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:57.318370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92f4413b-d171-4d48-bafe-9e6743a3ab1b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.318909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92f4413b-d171-4d48-bafe-9e6743a3ab1b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.321508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92f4413b-d171-4d48-bafe-9e6743a3ab1b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.322310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92f4413b-d171-4d48-bafe-9e6743a3ab1b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.322775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92f4413b-d171-4d48-bafe-9e6743a3ab1b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.325175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92f4413b-d171-4d48-bafe-9e6743a3ab1b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.679248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-92f4413b-d171-4d48-bafe-9e6743a3ab1b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:57.698887 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-92f4413b-d171-4d48-bafe-9e6743a3ab1b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1517 microversion: 2.1 time: 0.410536 Aug 29 15:44:57.700013 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2197/4513] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:57 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1517 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:57.704874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d50da3b4-b4e7-4d78-aafb-3dcbaca3966a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:57.705796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d50da3b4-b4e7-4d78-aafb-3dcbaca3966a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:57.718943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50da3b4-b4e7-4d78-aafb-3dcbaca3966a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.720100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50da3b4-b4e7-4d78-aafb-3dcbaca3966a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.721566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50da3b4-b4e7-4d78-aafb-3dcbaca3966a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.722713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50da3b4-b4e7-4d78-aafb-3dcbaca3966a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.723303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50da3b4-b4e7-4d78-aafb-3dcbaca3966a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.723873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50da3b4-b4e7-4d78-aafb-3dcbaca3966a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.996992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d50da3b4-b4e7-4d78-aafb-3dcbaca3966a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:58.013534 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d50da3b4-b4e7-4d78-aafb-3dcbaca3966a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.312392 Aug 29 15:44:58.026548 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2198/4514] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:57 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:58.026548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c470f869-ac0a-4f88-ac9a-222ad93831c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:58.049506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c470f869-ac0a-4f88-ac9a-222ad93831c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:58.059232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c470f869-ac0a-4f88-ac9a-222ad93831c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:58.060208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c470f869-ac0a-4f88-ac9a-222ad93831c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:58.060908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c470f869-ac0a-4f88-ac9a-222ad93831c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:58.061656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c470f869-ac0a-4f88-ac9a-222ad93831c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:58.062111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c470f869-ac0a-4f88-ac9a-222ad93831c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:58.062535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c470f869-ac0a-4f88-ac9a-222ad93831c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:58.129605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-c470f869-ac0a-4f88-ac9a-222ad93831c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lazy-loading 'flavor' on Instance uuid 4cb6aed9-8901-4e68-8a40-21dc9e2f690c {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:44:58.280678 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c470f869-ac0a-4f88-ac9a-222ad93831c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "POST /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c/action" status: 200 len: 32 microversion: 2.1 time: 0.262970 Aug 29 15:44:58.282595 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2199/4515] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:44:58 2022] POST /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c/action => generated 32 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:44:58.305026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c1b84ed5-4314-4f74-8028-866ab1350b98 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:58.310426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c1b84ed5-4314-4f74-8028-866ab1350b98 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:58.335281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1b84ed5-4314-4f74-8028-866ab1350b98 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:58.338057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1b84ed5-4314-4f74-8028-866ab1350b98 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:58.344971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1b84ed5-4314-4f74-8028-866ab1350b98 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:58.345822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1b84ed5-4314-4f74-8028-866ab1350b98 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:58.347069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1b84ed5-4314-4f74-8028-866ab1350b98 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:58.349297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1b84ed5-4314-4f74-8028-866ab1350b98 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:58.901943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c1b84ed5-4314-4f74-8028-866ab1350b98 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:58.917003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c1b84ed5-4314-4f74-8028-866ab1350b98 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:58.927988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c1b84ed5-4314-4f74-8028-866ab1350b98 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:58.932958 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c1b84ed5-4314-4f74-8028-866ab1350b98 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.645449 Aug 29 15:44:58.940191 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2200/4516] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:58 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:58.973382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-95d5e4fc-5ce2-403a-9b4e-add7b70fcc3c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:58.979988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-95d5e4fc-5ce2-403a-9b4e-add7b70fcc3c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:59.002679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95d5e4fc-5ce2-403a-9b4e-add7b70fcc3c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:59.003206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95d5e4fc-5ce2-403a-9b4e-add7b70fcc3c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:59.003659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95d5e4fc-5ce2-403a-9b4e-add7b70fcc3c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.004480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95d5e4fc-5ce2-403a-9b4e-add7b70fcc3c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:59.005011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95d5e4fc-5ce2-403a-9b4e-add7b70fcc3c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:59.005468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95d5e4fc-5ce2-403a-9b4e-add7b70fcc3c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.511273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-95d5e4fc-5ce2-403a-9b4e-add7b70fcc3c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:59.544999 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-95d5e4fc-5ce2-403a-9b4e-add7b70fcc3c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.601677 Aug 29 15:44:59.548740 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2201/4517] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:58 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:59.587582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f69ecb58-c093-4396-93a7-d4b93d0f621d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:59.588711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f69ecb58-c093-4396-93a7-d4b93d0f621d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:59.625195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f69ecb58-c093-4396-93a7-d4b93d0f621d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:59.627858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f69ecb58-c093-4396-93a7-d4b93d0f621d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:59.629813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f69ecb58-c093-4396-93a7-d4b93d0f621d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.630679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f69ecb58-c093-4396-93a7-d4b93d0f621d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:59.634108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f69ecb58-c093-4396-93a7-d4b93d0f621d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:59.635222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f69ecb58-c093-4396-93a7-d4b93d0f621d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.905380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:00.086601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f69ecb58-c093-4396-93a7-d4b93d0f621d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:00.097328 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f69ecb58-c093-4396-93a7-d4b93d0f621d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1507 microversion: 2.1 time: 0.533080 Aug 29 15:45:00.099999 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2202/4518] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:59 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1507 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:00.105892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-43765c11-13d1-4c00-92c6-f3461da4e6df req-b1b3d99d-8b63-4d25-a697-8eae9be97e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "name": "network-vif-plugged", "status": "completed", "tag": "af34d60f-3508-498b-8136-1aa1dd422ab9"}, {"server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "name": "network-vif-plugged", "status": "completed", "tag": "81163d25-b7c2-48cd-a63a-7bc7148abfaf"}, {"server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "name": "network-vif-plugged", "status": "completed", "tag": "a1dbac3e-d33f-459b-8975-e740294ef068"}, {"server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "name": "network-vif-plugged", "status": "completed", "tag": "99530e77-db4a-45c6-9205-99f6d2ad4d43"}, {"server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "name": "network-vif-plugged", "status": "completed", "tag": "740841a2-402d-46f7-999f-b5beab53ba4a"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:00.118330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-43765c11-13d1-4c00-92c6-f3461da4e6df req-b1b3d99d-8b63-4d25-a697-8eae9be97e92 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.119060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-43765c11-13d1-4c00-92c6-f3461da4e6df req-b1b3d99d-8b63-4d25-a697-8eae9be97e92 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.119812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-43765c11-13d1-4c00-92c6-f3461da4e6df req-b1b3d99d-8b63-4d25-a697-8eae9be97e92 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.135065 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-43765c11-13d1-4c00-92c6-f3461da4e6df req-b1b3d99d-8b63-4d25-a697-8eae9be97e92 service nova] Creating event network-vif-plugged:af34d60f-3508-498b-8136-1aa1dd422ab9 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:45:00.135890 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-43765c11-13d1-4c00-92c6-f3461da4e6df req-b1b3d99d-8b63-4d25-a697-8eae9be97e92 service nova] Creating event network-vif-plugged:81163d25-b7c2-48cd-a63a-7bc7148abfaf for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:45:00.137167 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-43765c11-13d1-4c00-92c6-f3461da4e6df req-b1b3d99d-8b63-4d25-a697-8eae9be97e92 service nova] Creating event network-vif-plugged:a1dbac3e-d33f-459b-8975-e740294ef068 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:45:00.138035 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-43765c11-13d1-4c00-92c6-f3461da4e6df req-b1b3d99d-8b63-4d25-a697-8eae9be97e92 service nova] Creating event network-vif-plugged:99530e77-db4a-45c6-9205-99f6d2ad4d43 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:45:00.138540 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-43765c11-13d1-4c00-92c6-f3461da4e6df req-b1b3d99d-8b63-4d25-a697-8eae9be97e92 service nova] Creating event network-vif-plugged:740841a2-402d-46f7-999f-b5beab53ba4a for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:45:00.146092 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-43765c11-13d1-4c00-92c6-f3461da4e6df req-b1b3d99d-8b63-4d25-a697-8eae9be97e92 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.044470 Aug 29 15:45:00.146915 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2203/4519] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:00.158796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-36b5fc13-6618-4b9a-be06-9b6ab0a71880 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:00.159517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-36b5fc13-6618-4b9a-be06-9b6ab0a71880 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:00.167151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36b5fc13-6618-4b9a-be06-9b6ab0a71880 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.167667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36b5fc13-6618-4b9a-be06-9b6ab0a71880 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.168093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36b5fc13-6618-4b9a-be06-9b6ab0a71880 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.168804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36b5fc13-6618-4b9a-be06-9b6ab0a71880 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.169325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36b5fc13-6618-4b9a-be06-9b6ab0a71880 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.169746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36b5fc13-6618-4b9a-be06-9b6ab0a71880 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.388682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=42 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:00.395960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36b5fc13-6618-4b9a-be06-9b6ab0a71880 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:00.412430 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-36b5fc13-6618-4b9a-be06-9b6ab0a71880 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.258002 Aug 29 15:45:00.414516 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2204/4520] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:00 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:00.434038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7e38e3b4-97cd-405b-98ec-d87f45f851fe tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:00.434484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7e38e3b4-97cd-405b-98ec-d87f45f851fe tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:00.455788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e38e3b4-97cd-405b-98ec-d87f45f851fe tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.462806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e38e3b4-97cd-405b-98ec-d87f45f851fe tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.463546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e38e3b4-97cd-405b-98ec-d87f45f851fe tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.464487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e38e3b4-97cd-405b-98ec-d87f45f851fe tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.469668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e38e3b4-97cd-405b-98ec-d87f45f851fe tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.470469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e38e3b4-97cd-405b-98ec-d87f45f851fe tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.506921 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7e38e3b4-97cd-405b-98ec-d87f45f851fe tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/ips" status: 200 len: 145 microversion: 2.1 time: 0.087972 Aug 29 15:45:00.526650 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2205/4521] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:45:00 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/ips => generated 145 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:00.535636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8339cbe2-dbe7-4f29-871c-0e0d4a02fa67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:00.542741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8339cbe2-dbe7-4f29-871c-0e0d4a02fa67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:00.561405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8339cbe2-dbe7-4f29-871c-0e0d4a02fa67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.563030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8339cbe2-dbe7-4f29-871c-0e0d4a02fa67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.565298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8339cbe2-dbe7-4f29-871c-0e0d4a02fa67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.567275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8339cbe2-dbe7-4f29-871c-0e0d4a02fa67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.569186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8339cbe2-dbe7-4f29-871c-0e0d4a02fa67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.570756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8339cbe2-dbe7-4f29-871c-0e0d4a02fa67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.582958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:01.140591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8339cbe2-dbe7-4f29-871c-0e0d4a02fa67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:01.154120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8339cbe2-dbe7-4f29-871c-0e0d4a02fa67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:01.155460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8339cbe2-dbe7-4f29-871c-0e0d4a02fa67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:01.162301 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8339cbe2-dbe7-4f29-871c-0e0d4a02fa67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.632511 Aug 29 15:45:01.162919 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2206/4522] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:00 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:01.181077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-27e90412-b6f9-407e-b7e9-c38f4fc9b837 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:01.192195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-27e90412-b6f9-407e-b7e9-c38f4fc9b837 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.209907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27e90412-b6f9-407e-b7e9-c38f4fc9b837 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.212179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27e90412-b6f9-407e-b7e9-c38f4fc9b837 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.212689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27e90412-b6f9-407e-b7e9-c38f4fc9b837 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.214802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27e90412-b6f9-407e-b7e9-c38f4fc9b837 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.215283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27e90412-b6f9-407e-b7e9-c38f4fc9b837 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.215710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27e90412-b6f9-407e-b7e9-c38f4fc9b837 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.502028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-27e90412-b6f9-407e-b7e9-c38f4fc9b837 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:01.520776 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-27e90412-b6f9-407e-b7e9-c38f4fc9b837 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.343737 Aug 29 15:45:01.521511 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2207/4523] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:01 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:01.541902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bcae8ea7-96ea-42fa-baec-13d891060fd6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:01.542874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bcae8ea7-96ea-42fa-baec-13d891060fd6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.549917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcae8ea7-96ea-42fa-baec-13d891060fd6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.550666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcae8ea7-96ea-42fa-baec-13d891060fd6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.551232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcae8ea7-96ea-42fa-baec-13d891060fd6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.552745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcae8ea7-96ea-42fa-baec-13d891060fd6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.553539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcae8ea7-96ea-42fa-baec-13d891060fd6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.554205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcae8ea7-96ea-42fa-baec-13d891060fd6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.750074 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-31a92a8b-9909-4310-b99e-54f7831fb95b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998" status: 200 len: 1448 microversion: 2.1 time: 11.339606 Aug 29 15:45:01.750739 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2317/4524] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:50 2022] GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 => generated 1448 bytes in 11341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:01.766846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bcaa9e1a-f1fa-475f-8d70-1f8301340d5b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:01.767721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bcaa9e1a-f1fa-475f-8d70-1f8301340d5b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.789477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcaa9e1a-f1fa-475f-8d70-1f8301340d5b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.804064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcaa9e1a-f1fa-475f-8d70-1f8301340d5b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.813782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bcae8ea7-96ea-42fa-baec-13d891060fd6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:01.819893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcaa9e1a-f1fa-475f-8d70-1f8301340d5b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.822904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcaa9e1a-f1fa-475f-8d70-1f8301340d5b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.825825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcaa9e1a-f1fa-475f-8d70-1f8301340d5b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.828317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcaa9e1a-f1fa-475f-8d70-1f8301340d5b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.831930 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bcae8ea7-96ea-42fa-baec-13d891060fd6 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1507 microversion: 2.1 time: 0.293843 Aug 29 15:45:01.837850 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2208/4525] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:01 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:01.843472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e6e1ada1-b37d-483e-bb6d-2aeee707d33f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a7f6ca0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:02.122327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bcaa9e1a-f1fa-475f-8d70-1f8301340d5b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:02.132857 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bcaa9e1a-f1fa-475f-8d70-1f8301340d5b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.379011 Aug 29 15:45:02.134359 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2318/4526] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:01 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:02.177829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a5d6fe97-db4e-49f0-82a0-f2bd27a506fa req-404b652c-bd55-48d4-bf67-078d1a6e1483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "name": "network-vif-plugged", "status": "completed", "tag": "cd9c6b22-3b08-4c43-9df9-680021211414"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:02.225468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a5d6fe97-db4e-49f0-82a0-f2bd27a506fa req-404b652c-bd55-48d4-bf67-078d1a6e1483 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.227097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a5d6fe97-db4e-49f0-82a0-f2bd27a506fa req-404b652c-bd55-48d4-bf67-078d1a6e1483 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.227915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a5d6fe97-db4e-49f0-82a0-f2bd27a506fa req-404b652c-bd55-48d4-bf67-078d1a6e1483 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.251498 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a5d6fe97-db4e-49f0-82a0-f2bd27a506fa req-404b652c-bd55-48d4-bf67-078d1a6e1483 service nova] Creating event network-vif-plugged:cd9c6b22-3b08-4c43-9df9-680021211414 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:45:02.259236 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a5d6fe97-db4e-49f0-82a0-f2bd27a506fa req-404b652c-bd55-48d4-bf67-078d1a6e1483 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093363 Aug 29 15:45:02.260939 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2319/4527] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:02.269487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5e38350c-0388-4f93-a225-a8732fe353a2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:02.273564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5e38350c-0388-4f93-a225-a8732fe353a2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:02.284485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e38350c-0388-4f93-a225-a8732fe353a2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.285886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e38350c-0388-4f93-a225-a8732fe353a2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.286350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e38350c-0388-4f93-a225-a8732fe353a2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.287106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e38350c-0388-4f93-a225-a8732fe353a2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.287566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e38350c-0388-4f93-a225-a8732fe353a2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.288006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e38350c-0388-4f93-a225-a8732fe353a2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.720565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e38350c-0388-4f93-a225-a8732fe353a2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:02.732766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e38350c-0388-4f93-a225-a8732fe353a2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:02.734530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e38350c-0388-4f93-a225-a8732fe353a2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:02.736338 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5e38350c-0388-4f93-a225-a8732fe353a2 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.474031 Aug 29 15:45:02.749107 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2320/4528] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:02 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:02.749107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-852f3f79-f429-41a5-a90b-fd6a0eb66a3d tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:02.749107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-852f3f79-f429-41a5-a90b-fd6a0eb66a3d tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:02.760022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852f3f79-f429-41a5-a90b-fd6a0eb66a3d tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.760690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852f3f79-f429-41a5-a90b-fd6a0eb66a3d tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.760982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852f3f79-f429-41a5-a90b-fd6a0eb66a3d tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.761761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852f3f79-f429-41a5-a90b-fd6a0eb66a3d tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.762222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852f3f79-f429-41a5-a90b-fd6a0eb66a3d tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.763001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-852f3f79-f429-41a5-a90b-fd6a0eb66a3d tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.765930 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e6e1ada1-b37d-483e-bb6d-2aeee707d33f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998" status: 200 len: 1448 microversion: 2.1 time: 0.926658 Aug 29 15:45:02.766676 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2209/4529] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:01 2022] GET /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 => generated 1448 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:02.782923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5eeaf19c-5410-4b9b-bf9b-20e82f9c809e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a5c90d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:02.951402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-852f3f79-f429-41a5-a90b-fd6a0eb66a3d tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:02.961308 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-852f3f79-f429-41a5-a90b-fd6a0eb66a3d tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.222924 Aug 29 15:45:02.962498 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2321/4530] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:02 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:02.967899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-34f72ee4-01b7-4768-9fca-4d1cf22342ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:02.968768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-34f72ee4-01b7-4768-9fca-4d1cf22342ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:02.977839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34f72ee4-01b7-4768-9fca-4d1cf22342ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.978670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34f72ee4-01b7-4768-9fca-4d1cf22342ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.981015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34f72ee4-01b7-4768-9fca-4d1cf22342ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.982007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34f72ee4-01b7-4768-9fca-4d1cf22342ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.982633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34f72ee4-01b7-4768-9fca-4d1cf22342ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.983223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34f72ee4-01b7-4768-9fca-4d1cf22342ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.192553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-34f72ee4-01b7-4768-9fca-4d1cf22342ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:03.205014 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-34f72ee4-01b7-4768-9fca-4d1cf22342ce tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1507 microversion: 2.1 time: 0.241035 Aug 29 15:45:03.205852 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2322/4531] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:02 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:03.211509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-748508b9-ad36-4b03-914e-1e8bc3b34cc5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:03.212813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-748508b9-ad36-4b03-914e-1e8bc3b34cc5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:03.222611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-748508b9-ad36-4b03-914e-1e8bc3b34cc5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:03.223482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-748508b9-ad36-4b03-914e-1e8bc3b34cc5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:03.224149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-748508b9-ad36-4b03-914e-1e8bc3b34cc5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.225834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-748508b9-ad36-4b03-914e-1e8bc3b34cc5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:03.226764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-748508b9-ad36-4b03-914e-1e8bc3b34cc5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:03.235947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-748508b9-ad36-4b03-914e-1e8bc3b34cc5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.432581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-748508b9-ad36-4b03-914e-1e8bc3b34cc5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:03.445901 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-748508b9-ad36-4b03-914e-1e8bc3b34cc5 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.238393 Aug 29 15:45:03.446755 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2323/4532] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:03 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:03.463256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d3a9cf55-2407-4a8a-b5a2-cfa7b17c298b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c85eb566-c662-4e34-897d-efb6bae317b3"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:03.466597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d3a9cf55-2407-4a8a-b5a2-cfa7b17c298b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:03.486098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3a9cf55-2407-4a8a-b5a2-cfa7b17c298b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:03.487027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3a9cf55-2407-4a8a-b5a2-cfa7b17c298b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:03.487554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3a9cf55-2407-4a8a-b5a2-cfa7b17c298b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.488346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3a9cf55-2407-4a8a-b5a2-cfa7b17c298b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:03.488928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3a9cf55-2407-4a8a-b5a2-cfa7b17c298b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:03.489464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3a9cf55-2407-4a8a-b5a2-cfa7b17c298b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.788914 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5eeaf19c-5410-4b9b-bf9b-20e82f9c809e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "DELETE /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998" status: 204 len: 0 microversion: 2.1 time: 1.012014 Aug 29 15:45:03.790645 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2210/4533] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:02 2022] DELETE /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 => generated 0 bytes in 1015 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:45:03.809628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-350fcc76-061f-4ba8-ba4e-536ca5962e6e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:03.810726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-350fcc76-061f-4ba8-ba4e-536ca5962e6e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:03.830783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-350fcc76-061f-4ba8-ba4e-536ca5962e6e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:03.831475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-350fcc76-061f-4ba8-ba4e-536ca5962e6e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:03.832092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-350fcc76-061f-4ba8-ba4e-536ca5962e6e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.833038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-350fcc76-061f-4ba8-ba4e-536ca5962e6e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:03.833703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-350fcc76-061f-4ba8-ba4e-536ca5962e6e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:03.834305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-350fcc76-061f-4ba8-ba4e-536ca5962e6e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.059701 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d3a9cf55-2407-4a8a-b5a2-cfa7b17c298b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "POST /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.611356 Aug 29 15:45:04.066978 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2324/4534] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 15:45:03 2022] POST /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments => generated 194 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:04.077147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-901435cc-1b81-4599-b5e4-6cd69239e271 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:04.078932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-901435cc-1b81-4599-b5e4-6cd69239e271 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:04.098594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-901435cc-1b81-4599-b5e4-6cd69239e271 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.101564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-901435cc-1b81-4599-b5e4-6cd69239e271 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.102314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-901435cc-1b81-4599-b5e4-6cd69239e271 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.104493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-901435cc-1b81-4599-b5e4-6cd69239e271 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.105166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-901435cc-1b81-4599-b5e4-6cd69239e271 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.108307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-901435cc-1b81-4599-b5e4-6cd69239e271 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.187380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-350fcc76-061f-4ba8-ba4e-536ca5962e6e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:04.199287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-901435cc-1b81-4599-b5e4-6cd69239e271 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:04.235072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-350fcc76-061f-4ba8-ba4e-536ca5962e6e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:04.236861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-350fcc76-061f-4ba8-ba4e-536ca5962e6e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:04.238232 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-350fcc76-061f-4ba8-ba4e-536ca5962e6e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1874 microversion: 2.32 time: 0.446428 Aug 29 15:45:04.239339 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2211/4535] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:03 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1874 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:04.243958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6d5f8c02-551d-4692-aa9a-c4e2c616156b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:04.245302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6d5f8c02-551d-4692-aa9a-c4e2c616156b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:04.251703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d5f8c02-551d-4692-aa9a-c4e2c616156b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.252432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d5f8c02-551d-4692-aa9a-c4e2c616156b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.253018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d5f8c02-551d-4692-aa9a-c4e2c616156b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.253906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d5f8c02-551d-4692-aa9a-c4e2c616156b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.256982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d5f8c02-551d-4692-aa9a-c4e2c616156b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.257995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d5f8c02-551d-4692-aa9a-c4e2c616156b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.443751 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-901435cc-1b81-4599-b5e4-6cd69239e271 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 204 len: 0 microversion: 2.1 time: 0.374744 Aug 29 15:45:04.444856 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2325/4536] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:04 2022] DELETE /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:45:04.459469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-75004074-5362-42c5-8aab-6dd2f80b45dd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:04.459469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-75004074-5362-42c5-8aab-6dd2f80b45dd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:04.489865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75004074-5362-42c5-8aab-6dd2f80b45dd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.490404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75004074-5362-42c5-8aab-6dd2f80b45dd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.490867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75004074-5362-42c5-8aab-6dd2f80b45dd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.491597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75004074-5362-42c5-8aab-6dd2f80b45dd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.494898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75004074-5362-42c5-8aab-6dd2f80b45dd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.495349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75004074-5362-42c5-8aab-6dd2f80b45dd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.664592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6d5f8c02-551d-4692-aa9a-c4e2c616156b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:04.691939 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6d5f8c02-551d-4692-aa9a-c4e2c616156b tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.451217 Aug 29 15:45:04.699111 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2212/4537] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:04 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:04.722444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2f4ba571-c47d-4676-9199-4d557f9c5a31 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:04.723649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2f4ba571-c47d-4676-9199-4d557f9c5a31 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:04.733800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:04.738623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f4ba571-c47d-4676-9199-4d557f9c5a31 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.739359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f4ba571-c47d-4676-9199-4d557f9c5a31 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.740139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f4ba571-c47d-4676-9199-4d557f9c5a31 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.742243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f4ba571-c47d-4676-9199-4d557f9c5a31 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.742985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f4ba571-c47d-4676-9199-4d557f9c5a31 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.743808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f4ba571-c47d-4676-9199-4d557f9c5a31 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.895842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-75004074-5362-42c5-8aab-6dd2f80b45dd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:04.914407 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-75004074-5362-42c5-8aab-6dd2f80b45dd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1507 microversion: 2.1 time: 0.467978 Aug 29 15:45:04.915352 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2326/4538] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:04 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1507 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:04.920279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1571526770", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "3ac7e564-b250-488a-8919-b9f712fff14c"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:05.106165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2f4ba571-c47d-4676-9199-4d557f9c5a31 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:05.116822 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2f4ba571-c47d-4676-9199-4d557f9c5a31 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.404399 Aug 29 15:45:05.137754 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2213/4539] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:04 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:05.270470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a97601ab-ed75-4017-98d5-b369389f7ccc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:05.271092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a97601ab-ed75-4017-98d5-b369389f7ccc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:05.285021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a97601ab-ed75-4017-98d5-b369389f7ccc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:05.285658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a97601ab-ed75-4017-98d5-b369389f7ccc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:05.286283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a97601ab-ed75-4017-98d5-b369389f7ccc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:05.287294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a97601ab-ed75-4017-98d5-b369389f7ccc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:05.287792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a97601ab-ed75-4017-98d5-b369389f7ccc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:05.288416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a97601ab-ed75-4017-98d5-b369389f7ccc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:05.651841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a97601ab-ed75-4017-98d5-b369389f7ccc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:05.665144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a97601ab-ed75-4017-98d5-b369389f7ccc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:05.666773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a97601ab-ed75-4017-98d5-b369389f7ccc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:05.668053 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a97601ab-ed75-4017-98d5-b369389f7ccc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 2828 microversion: 2.32 time: 0.401992 Aug 29 15:45:05.668776 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2214/4540] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:05 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 2828 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:05.686547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] validate_networks() for [('3ac7e564-b250-488a-8919-b9f712fff14c', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:45:05.696668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f8d14f49-7550-4d82-9050-9b35447fb2ef tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:05.697723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f8d14f49-7550-4d82-9050-9b35447fb2ef tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:05.717378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8d14f49-7550-4d82-9050-9b35447fb2ef tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:05.718908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8d14f49-7550-4d82-9050-9b35447fb2ef tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:05.720773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8d14f49-7550-4d82-9050-9b35447fb2ef tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:05.723573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8d14f49-7550-4d82-9050-9b35447fb2ef tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:05.724468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8d14f49-7550-4d82-9050-9b35447fb2ef tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:05.725195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8d14f49-7550-4d82-9050-9b35447fb2ef tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:05.924166 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f8d14f49-7550-4d82-9050-9b35447fb2ef tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.231444 Aug 29 15:45:05.924987 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2215/4541] 10.222.0.62 () {60 vars in 1316 bytes} [Mon Aug 29 15:45:05 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae/os-interface => generated 1831 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:05.942991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f3bfae91-bd52-4e84-9e49-0e45cec50b63 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:05.943691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f3bfae91-bd52-4e84-9e49-0e45cec50b63 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:05.958525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3bfae91-bd52-4e84-9e49-0e45cec50b63 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:05.959326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3bfae91-bd52-4e84-9e49-0e45cec50b63 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:05.960165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3bfae91-bd52-4e84-9e49-0e45cec50b63 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:05.961207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3bfae91-bd52-4e84-9e49-0e45cec50b63 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:05.961997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3bfae91-bd52-4e84-9e49-0e45cec50b63 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:05.963074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3bfae91-bd52-4e84-9e49-0e45cec50b63 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:06.332689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f3bfae91-bd52-4e84-9e49-0e45cec50b63 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:06.362639 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f3bfae91-bd52-4e84-9e49-0e45cec50b63 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.435783 Aug 29 15:45:06.364032 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2216/4542] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:05 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:06.384886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b0c0d497-4258-42ed-a8a9-5d6cf604395e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:06.386288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b0c0d497-4258-42ed-a8a9-5d6cf604395e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:06.411109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0c0d497-4258-42ed-a8a9-5d6cf604395e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:06.412695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0c0d497-4258-42ed-a8a9-5d6cf604395e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:06.413534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0c0d497-4258-42ed-a8a9-5d6cf604395e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:06.414532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0c0d497-4258-42ed-a8a9-5d6cf604395e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:06.416264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0c0d497-4258-42ed-a8a9-5d6cf604395e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:06.416790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0c0d497-4258-42ed-a8a9-5d6cf604395e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:06.515221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:45:06.516292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:45:06.517183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:45:06.517748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:45:06.518752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:45:06.532040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:06.532723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:06.533361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:06.534898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:06.535543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:06.536126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:06.563740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Getting quotas for project ad019754b47441d5a286666f8a048b48. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:45:06.572735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Getting quotas for user 71ae9af4779a4d50b9171ff9ca8b5207 and project ad019754b47441d5a286666f8a048b48. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:45:06.602088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:45:06.605282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:45:06.701393 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-086180eb-69f9-4c85-a731-b8d83e786a7a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.784788 Aug 29 15:45:06.711647 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2327/4543] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:45:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:45:06.740538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2c409a3d-94bc-4bcd-adb0-7ba561b48740 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:06.741304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2c409a3d-94bc-4bcd-adb0-7ba561b48740 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:06.770427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c409a3d-94bc-4bcd-adb0-7ba561b48740 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:06.774492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c409a3d-94bc-4bcd-adb0-7ba561b48740 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:06.775103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c409a3d-94bc-4bcd-adb0-7ba561b48740 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:06.775977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c409a3d-94bc-4bcd-adb0-7ba561b48740 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:06.779188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c409a3d-94bc-4bcd-adb0-7ba561b48740 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:06.779792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c409a3d-94bc-4bcd-adb0-7ba561b48740 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:07.069473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2c409a3d-94bc-4bcd-adb0-7ba561b48740 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:07.086670 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2c409a3d-94bc-4bcd-adb0-7ba561b48740 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.373737 Aug 29 15:45:07.107916 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2328/4544] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:06 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:07.117240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d5fe227f-118a-4ae4-8765-bcf4d70b8258 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:07.122293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d5fe227f-118a-4ae4-8765-bcf4d70b8258 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:07.271536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d5fe227f-118a-4ae4-8765-bcf4d70b8258 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:07.275729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b0c0d497-4258-42ed-a8a9-5d6cf604395e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:07.280993 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d5fe227f-118a-4ae4-8765-bcf4d70b8258 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1208 microversion: 2.1 time: 0.169808 Aug 29 15:45:07.285872 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2329/4545] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:07 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1208 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:07.306566 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b0c0d497-4258-42ed-a8a9-5d6cf604395e tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1507 microversion: 2.1 time: 0.938587 Aug 29 15:45:07.322435 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2217/4546] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:06 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1507 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:07.407657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2ad81b0a-1dcc-402f-8140-c5ad4af7cca5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:07.408465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2ad81b0a-1dcc-402f-8140-c5ad4af7cca5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:07.416785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ad81b0a-1dcc-402f-8140-c5ad4af7cca5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:07.417333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ad81b0a-1dcc-402f-8140-c5ad4af7cca5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:07.428255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ad81b0a-1dcc-402f-8140-c5ad4af7cca5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:07.429051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ad81b0a-1dcc-402f-8140-c5ad4af7cca5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:07.429632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ad81b0a-1dcc-402f-8140-c5ad4af7cca5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:07.430072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ad81b0a-1dcc-402f-8140-c5ad4af7cca5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:07.549987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-39c4e7a5-3087-4dd1-9e08-a0c22715eb07 req-aebc9c1b-b528-4667-8e07-2abdd98d03fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5219eda0-3ed8-4c6e-ba04-19ed69930d86", "name": "network-vif-unplugged", "status": "completed", "tag": "eef1db13-8722-4bfa-a4c5-4d45002ee03b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:07.607056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-39c4e7a5-3087-4dd1-9e08-a0c22715eb07 req-aebc9c1b-b528-4667-8e07-2abdd98d03fd service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:07.613672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-39c4e7a5-3087-4dd1-9e08-a0c22715eb07 req-aebc9c1b-b528-4667-8e07-2abdd98d03fd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:07.621851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-39c4e7a5-3087-4dd1-9e08-a0c22715eb07 req-aebc9c1b-b528-4667-8e07-2abdd98d03fd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:07.669652 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-39c4e7a5-3087-4dd1-9e08-a0c22715eb07 req-aebc9c1b-b528-4667-8e07-2abdd98d03fd service nova] Creating event network-vif-unplugged:eef1db13-8722-4bfa-a4c5-4d45002ee03b for instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 on n-h1-839401-11 Aug 29 15:45:07.682884 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-39c4e7a5-3087-4dd1-9e08-a0c22715eb07 req-aebc9c1b-b528-4667-8e07-2abdd98d03fd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138094 Aug 29 15:45:07.684539 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2218/4547] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:45:07.831886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2ad81b0a-1dcc-402f-8140-c5ad4af7cca5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:07.858980 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2ad81b0a-1dcc-402f-8140-c5ad4af7cca5 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.455186 Aug 29 15:45:07.860264 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2330/4548] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:07 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:08.123337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f6190e4f-9bca-469b-a0f8-62ecc139157a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:08.124214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f6190e4f-9bca-469b-a0f8-62ecc139157a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:08.145333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6190e4f-9bca-469b-a0f8-62ecc139157a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.147189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6190e4f-9bca-469b-a0f8-62ecc139157a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.148421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6190e4f-9bca-469b-a0f8-62ecc139157a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.149364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6190e4f-9bca-469b-a0f8-62ecc139157a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.149976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6190e4f-9bca-469b-a0f8-62ecc139157a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.150549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f6190e4f-9bca-469b-a0f8-62ecc139157a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.311073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cfc17a80-edf5-48f9-9c29-f14ae5bb2bb7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:08.312134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cfc17a80-edf5-48f9-9c29-f14ae5bb2bb7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:08.332308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfc17a80-edf5-48f9-9c29-f14ae5bb2bb7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.332912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfc17a80-edf5-48f9-9c29-f14ae5bb2bb7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.333977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfc17a80-edf5-48f9-9c29-f14ae5bb2bb7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.337204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfc17a80-edf5-48f9-9c29-f14ae5bb2bb7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.337750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfc17a80-edf5-48f9-9c29-f14ae5bb2bb7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.342744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfc17a80-edf5-48f9-9c29-f14ae5bb2bb7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.524073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cfc17a80-edf5-48f9-9c29-f14ae5bb2bb7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:08.534323 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cfc17a80-edf5-48f9-9c29-f14ae5bb2bb7 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1260 microversion: 2.1 time: 0.227275 Aug 29 15:45:08.538537 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2331/4549] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:08 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:08.558036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ce71139-ce39-4de9-9895-74902aa3d640 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:08.559204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ce71139-ce39-4de9-9895-74902aa3d640 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:08.572956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce71139-ce39-4de9-9895-74902aa3d640 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.609220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce71139-ce39-4de9-9895-74902aa3d640 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.609220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce71139-ce39-4de9-9895-74902aa3d640 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.609220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce71139-ce39-4de9-9895-74902aa3d640 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.609220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce71139-ce39-4de9-9895-74902aa3d640 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.609220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce71139-ce39-4de9-9895-74902aa3d640 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.843645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f6190e4f-9bca-469b-a0f8-62ecc139157a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:08.854611 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f6190e4f-9bca-469b-a0f8-62ecc139157a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.746437 Aug 29 15:45:08.860606 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2219/4550] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:08 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:08.883463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e75ff505-eaa4-4440-b6e3-86cd13792b2f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:08.884450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e75ff505-eaa4-4440-b6e3-86cd13792b2f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:08.896636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e75ff505-eaa4-4440-b6e3-86cd13792b2f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.897492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e75ff505-eaa4-4440-b6e3-86cd13792b2f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.898160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e75ff505-eaa4-4440-b6e3-86cd13792b2f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.899116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e75ff505-eaa4-4440-b6e3-86cd13792b2f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.903640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e75ff505-eaa4-4440-b6e3-86cd13792b2f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.904358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e75ff505-eaa4-4440-b6e3-86cd13792b2f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:09.206905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e75ff505-eaa4-4440-b6e3-86cd13792b2f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:09.216643 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e75ff505-eaa4-4440-b6e3-86cd13792b2f tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.337391 Aug 29 15:45:09.222036 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2220/4551] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:08 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:09.517502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-801b18a2-e43c-4028-a115-12944d0b5432 req-f988573d-d744-4cb5-96bb-8518c8cca970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5219eda0-3ed8-4c6e-ba04-19ed69930d86", "name": "network-vif-deleted", "tag": "eef1db13-8722-4bfa-a4c5-4d45002ee03b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:09.528493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-801b18a2-e43c-4028-a115-12944d0b5432 req-f988573d-d744-4cb5-96bb-8518c8cca970 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:09.528996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-801b18a2-e43c-4028-a115-12944d0b5432 req-f988573d-d744-4cb5-96bb-8518c8cca970 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:09.534590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-801b18a2-e43c-4028-a115-12944d0b5432 req-f988573d-d744-4cb5-96bb-8518c8cca970 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:09.570883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5ce71139-ce39-4de9-9895-74902aa3d640 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:09.580076 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-801b18a2-e43c-4028-a115-12944d0b5432 req-f988573d-d744-4cb5-96bb-8518c8cca970 service nova] Creating event network-vif-deleted:eef1db13-8722-4bfa-a4c5-4d45002ee03b for instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 on n-h1-839401-11 Aug 29 15:45:09.583922 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ce71139-ce39-4de9-9895-74902aa3d640 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1507 microversion: 2.1 time: 1.043987 Aug 29 15:45:09.584536 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2332/4552] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:08 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1507 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:09.601001 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-801b18a2-e43c-4028-a115-12944d0b5432 req-f988573d-d744-4cb5-96bb-8518c8cca970 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087316 Aug 29 15:45:09.604313 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2221/4553] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:09.611916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8df31666-2869-41b7-ba9e-fba475dee279 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:09.612857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8df31666-2869-41b7-ba9e-fba475dee279 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:09.637869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8df31666-2869-41b7-ba9e-fba475dee279 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:09.640901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8df31666-2869-41b7-ba9e-fba475dee279 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:09.641782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8df31666-2869-41b7-ba9e-fba475dee279 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:09.644995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8df31666-2869-41b7-ba9e-fba475dee279 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:09.649714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8df31666-2869-41b7-ba9e-fba475dee279 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:09.650321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8df31666-2869-41b7-ba9e-fba475dee279 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:09.851748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8df31666-2869-41b7-ba9e-fba475dee279 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:09.855670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:09.877499 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8df31666-2869-41b7-ba9e-fba475dee279 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1266 microversion: 2.1 time: 0.276999 Aug 29 15:45:09.878113 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2333/4554] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:09 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:09.891645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5db1239a-0f17-4e28-a25b-24a9e0485ce8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:09.892390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5db1239a-0f17-4e28-a25b-24a9e0485ce8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:09.902629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5db1239a-0f17-4e28-a25b-24a9e0485ce8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:09.903438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5db1239a-0f17-4e28-a25b-24a9e0485ce8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:09.910768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5db1239a-0f17-4e28-a25b-24a9e0485ce8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:09.925441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5db1239a-0f17-4e28-a25b-24a9e0485ce8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:09.925441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5db1239a-0f17-4e28-a25b-24a9e0485ce8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:09.925441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5db1239a-0f17-4e28-a25b-24a9e0485ce8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:10.243808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dc90d323-f59a-4379-bd6f-954f08339b4c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:10.244679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dc90d323-f59a-4379-bd6f-954f08339b4c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:10.265168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc90d323-f59a-4379-bd6f-954f08339b4c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.270765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc90d323-f59a-4379-bd6f-954f08339b4c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.271619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc90d323-f59a-4379-bd6f-954f08339b4c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:10.272519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc90d323-f59a-4379-bd6f-954f08339b4c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.273425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc90d323-f59a-4379-bd6f-954f08339b4c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.274441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc90d323-f59a-4379-bd6f-954f08339b4c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:10.601147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dc90d323-f59a-4379-bd6f-954f08339b4c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:10.615299 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dc90d323-f59a-4379-bd6f-954f08339b4c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.376681 Aug 29 15:45:10.618955 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2334/4555] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:10 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:10.627993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a5f1ac5-718f-47d2-a8ac-e297e11b8af3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:10.661680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9a5f1ac5-718f-47d2-a8ac-e297e11b8af3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:10.690774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a5f1ac5-718f-47d2-a8ac-e297e11b8af3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.691279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a5f1ac5-718f-47d2-a8ac-e297e11b8af3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.691799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a5f1ac5-718f-47d2-a8ac-e297e11b8af3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:10.692564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a5f1ac5-718f-47d2-a8ac-e297e11b8af3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.693034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a5f1ac5-718f-47d2-a8ac-e297e11b8af3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.698272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a5f1ac5-718f-47d2-a8ac-e297e11b8af3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:11.042551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9a5f1ac5-718f-47d2-a8ac-e297e11b8af3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:11.068742 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a5f1ac5-718f-47d2-a8ac-e297e11b8af3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1504 microversion: 2.1 time: 0.448450 Aug 29 15:45:11.075088 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2335/4556] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:10 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1504 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:11.082319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-83650911-c4a6-4189-a78c-f1655216e2e0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:11.082964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-83650911-c4a6-4189-a78c-f1655216e2e0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:11.118177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83650911-c4a6-4189-a78c-f1655216e2e0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:11.131610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83650911-c4a6-4189-a78c-f1655216e2e0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:11.134511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83650911-c4a6-4189-a78c-f1655216e2e0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:11.135461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83650911-c4a6-4189-a78c-f1655216e2e0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:11.136103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83650911-c4a6-4189-a78c-f1655216e2e0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:11.139528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83650911-c4a6-4189-a78c-f1655216e2e0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:11.290917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-83650911-c4a6-4189-a78c-f1655216e2e0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:11.299163 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-83650911-c4a6-4189-a78c-f1655216e2e0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1266 microversion: 2.1 time: 0.222989 Aug 29 15:45:11.304854 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2336/4557] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:11 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:11.564497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5db1239a-0f17-4e28-a25b-24a9e0485ce8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:11.602156 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5db1239a-0f17-4e28-a25b-24a9e0485ce8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 1.717400 Aug 29 15:45:11.606892 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2222/4558] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:09 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:11.644617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eae39c85-ffd2-429a-8728-3f920c1b7a92 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:11.646817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eae39c85-ffd2-429a-8728-3f920c1b7a92 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:11.660748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eae39c85-ffd2-429a-8728-3f920c1b7a92 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:11.661725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eae39c85-ffd2-429a-8728-3f920c1b7a92 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:11.662522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eae39c85-ffd2-429a-8728-3f920c1b7a92 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:11.663537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eae39c85-ffd2-429a-8728-3f920c1b7a92 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:11.664262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eae39c85-ffd2-429a-8728-3f920c1b7a92 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:11.664923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eae39c85-ffd2-429a-8728-3f920c1b7a92 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:11.794025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-ca919e2e-7cb0-43df-843e-9d0890f74bc1 req-2bef7981-9f9d-4b41-b1c0-0485d65ebf83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "tag": "a1dbac3e-d33f-459b-8975-e740294ef068"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:11.833491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ca919e2e-7cb0-43df-843e-9d0890f74bc1 req-2bef7981-9f9d-4b41-b1c0-0485d65ebf83 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:11.837888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ca919e2e-7cb0-43df-843e-9d0890f74bc1 req-2bef7981-9f9d-4b41-b1c0-0485d65ebf83 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:11.841700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ca919e2e-7cb0-43df-843e-9d0890f74bc1 req-2bef7981-9f9d-4b41-b1c0-0485d65ebf83 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:11.896552 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-ca919e2e-7cb0-43df-843e-9d0890f74bc1 req-2bef7981-9f9d-4b41-b1c0-0485d65ebf83 service nova] Creating event network-changed:a1dbac3e-d33f-459b-8975-e740294ef068 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:45:11.912965 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-ca919e2e-7cb0-43df-843e-9d0890f74bc1 req-2bef7981-9f9d-4b41-b1c0-0485d65ebf83 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120820 Aug 29 15:45:11.915522 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2223/4559] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:45:12.079305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eae39c85-ffd2-429a-8728-3f920c1b7a92 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:12.095855 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eae39c85-ffd2-429a-8728-3f920c1b7a92 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.452208 Aug 29 15:45:12.097896 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2337/4560] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:11 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:12.098831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-16a03873-ee35-4588-9bd7-052ff57867a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:12.099869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-16a03873-ee35-4588-9bd7-052ff57867a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:12.123089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16a03873-ee35-4588-9bd7-052ff57867a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.130312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16a03873-ee35-4588-9bd7-052ff57867a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.135665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16a03873-ee35-4588-9bd7-052ff57867a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.136615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16a03873-ee35-4588-9bd7-052ff57867a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.140087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16a03873-ee35-4588-9bd7-052ff57867a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.140812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16a03873-ee35-4588-9bd7-052ff57867a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.324426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-457501e7-ec58-4595-be39-676b1c0f43a6 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:12.326979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-457501e7-ec58-4595-be39-676b1c0f43a6 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:12.350228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-457501e7-ec58-4595-be39-676b1c0f43a6 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.351880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-457501e7-ec58-4595-be39-676b1c0f43a6 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.354309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-457501e7-ec58-4595-be39-676b1c0f43a6 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.355242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-457501e7-ec58-4595-be39-676b1c0f43a6 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.356885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-457501e7-ec58-4595-be39-676b1c0f43a6 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.359825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-457501e7-ec58-4595-be39-676b1c0f43a6 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.694374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-457501e7-ec58-4595-be39-676b1c0f43a6 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:12.706572 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-457501e7-ec58-4595-be39-676b1c0f43a6 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1308 microversion: 2.1 time: 0.383877 Aug 29 15:45:12.709750 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2338/4561] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:12 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1308 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:12.715980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8d620971-a5d2-4107-bac5-7048cd491670 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:12.716790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8d620971-a5d2-4107-bac5-7048cd491670 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:12.735261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d620971-a5d2-4107-bac5-7048cd491670 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.737164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d620971-a5d2-4107-bac5-7048cd491670 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.737942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d620971-a5d2-4107-bac5-7048cd491670 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.739442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d620971-a5d2-4107-bac5-7048cd491670 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.741352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d620971-a5d2-4107-bac5-7048cd491670 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.741957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d620971-a5d2-4107-bac5-7048cd491670 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.216301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8d620971-a5d2-4107-bac5-7048cd491670 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:13.225743 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8d620971-a5d2-4107-bac5-7048cd491670 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.514729 Aug 29 15:45:13.226400 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2339/4562] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:12 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:13.264231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f2786d4a-a390-43db-959c-408442ac0bfb tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:13.269355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f2786d4a-a390-43db-959c-408442ac0bfb tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:13.293907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2786d4a-a390-43db-959c-408442ac0bfb tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.294613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2786d4a-a390-43db-959c-408442ac0bfb tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.295096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2786d4a-a390-43db-959c-408442ac0bfb tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.296402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2786d4a-a390-43db-959c-408442ac0bfb tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.297897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2786d4a-a390-43db-959c-408442ac0bfb tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.298578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2786d4a-a390-43db-959c-408442ac0bfb tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.546822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-16a03873-ee35-4588-9bd7-052ff57867a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:13.557837 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-16a03873-ee35-4588-9bd7-052ff57867a9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1504 microversion: 2.1 time: 1.465181 Aug 29 15:45:13.570417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f2786d4a-a390-43db-959c-408442ac0bfb tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:13.575250 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2224/4563] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:12 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1504 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:13.592745 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f2786d4a-a390-43db-959c-408442ac0bfb tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.344704 Aug 29 15:45:13.593862 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2340/4564] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:13 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:13.724565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-083ec703-49ab-4c54-b9a3-38904435031f req-d9f2d911-1d43-4b24-a1ad-a50d7f254ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824db4a3-47bf-494c-b490-d7631b6d9d54", "name": "network-vif-unplugged", "status": "completed", "tag": "98e91a7f-1a84-4261-8c1b-359bdbdb9f7e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:13.728305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9f05a9c0-c893-4ef4-a715-b8384eafc38f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:13.729102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9f05a9c0-c893-4ef4-a715-b8384eafc38f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:13.747944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f05a9c0-c893-4ef4-a715-b8384eafc38f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.748463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f05a9c0-c893-4ef4-a715-b8384eafc38f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.748780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-083ec703-49ab-4c54-b9a3-38904435031f req-d9f2d911-1d43-4b24-a1ad-a50d7f254ad7 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.748896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f05a9c0-c893-4ef4-a715-b8384eafc38f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.749318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-083ec703-49ab-4c54-b9a3-38904435031f req-d9f2d911-1d43-4b24-a1ad-a50d7f254ad7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.749681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f05a9c0-c893-4ef4-a715-b8384eafc38f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.749818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-083ec703-49ab-4c54-b9a3-38904435031f req-d9f2d911-1d43-4b24-a1ad-a50d7f254ad7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.750131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f05a9c0-c893-4ef4-a715-b8384eafc38f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.758465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f05a9c0-c893-4ef4-a715-b8384eafc38f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.785917 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-083ec703-49ab-4c54-b9a3-38904435031f req-d9f2d911-1d43-4b24-a1ad-a50d7f254ad7 service nova] Creating event network-vif-unplugged:98e91a7f-1a84-4261-8c1b-359bdbdb9f7e for instance 824db4a3-47bf-494c-b490-d7631b6d9d54 on n-h1-839401-11 Aug 29 15:45:13.803410 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-083ec703-49ab-4c54-b9a3-38904435031f req-d9f2d911-1d43-4b24-a1ad-a50d7f254ad7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082788 Aug 29 15:45:13.807508 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2225/4565] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:14.127061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9f05a9c0-c893-4ef4-a715-b8384eafc38f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:14.138707 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9f05a9c0-c893-4ef4-a715-b8384eafc38f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1308 microversion: 2.1 time: 0.414756 Aug 29 15:45:14.154657 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2341/4566] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:13 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1308 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:14.248758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-487d2915-7e3c-4bc3-b2b8-d5d0b027da6d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:14.249592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-487d2915-7e3c-4bc3-b2b8-d5d0b027da6d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:14.263816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487d2915-7e3c-4bc3-b2b8-d5d0b027da6d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.264507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487d2915-7e3c-4bc3-b2b8-d5d0b027da6d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.265170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487d2915-7e3c-4bc3-b2b8-d5d0b027da6d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.268214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487d2915-7e3c-4bc3-b2b8-d5d0b027da6d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.268889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487d2915-7e3c-4bc3-b2b8-d5d0b027da6d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.271701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487d2915-7e3c-4bc3-b2b8-d5d0b027da6d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.584430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9fe53c39-c13a-4f0d-86f2-0230975811d7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:14.585486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9fe53c39-c13a-4f0d-86f2-0230975811d7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:14.595352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9fe53c39-c13a-4f0d-86f2-0230975811d7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.599620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9fe53c39-c13a-4f0d-86f2-0230975811d7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.600571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9fe53c39-c13a-4f0d-86f2-0230975811d7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.602798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9fe53c39-c13a-4f0d-86f2-0230975811d7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.605809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9fe53c39-c13a-4f0d-86f2-0230975811d7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.608176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9fe53c39-c13a-4f0d-86f2-0230975811d7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.871807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-487d2915-7e3c-4bc3-b2b8-d5d0b027da6d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:14.890267 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-487d2915-7e3c-4bc3-b2b8-d5d0b027da6d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1506 microversion: 2.1 time: 0.645198 Aug 29 15:45:14.909441 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2226/4567] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:14 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1506 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:14.912714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3b03bf21-f7e1-40be-a308-a67b1c470ed0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:14.913616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3b03bf21-f7e1-40be-a308-a67b1c470ed0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:14.923089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b03bf21-f7e1-40be-a308-a67b1c470ed0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.923821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b03bf21-f7e1-40be-a308-a67b1c470ed0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.924321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b03bf21-f7e1-40be-a308-a67b1c470ed0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.925955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b03bf21-f7e1-40be-a308-a67b1c470ed0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.927134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b03bf21-f7e1-40be-a308-a67b1c470ed0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.927579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b03bf21-f7e1-40be-a308-a67b1c470ed0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.939867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9fe53c39-c13a-4f0d-86f2-0230975811d7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:14.948399 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9fe53c39-c13a-4f0d-86f2-0230975811d7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1504 microversion: 2.1 time: 0.368474 Aug 29 15:45:14.954736 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2342/4568] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:14 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1504 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:15.160598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-70f719fe-bf57-4089-9ed4-1ff54f1f76ce tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:15.161561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-70f719fe-bf57-4089-9ed4-1ff54f1f76ce tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:15.171224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70f719fe-bf57-4089-9ed4-1ff54f1f76ce tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.176272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70f719fe-bf57-4089-9ed4-1ff54f1f76ce tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.176953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70f719fe-bf57-4089-9ed4-1ff54f1f76ce tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.177748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70f719fe-bf57-4089-9ed4-1ff54f1f76ce tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.178221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70f719fe-bf57-4089-9ed4-1ff54f1f76ce tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.178658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70f719fe-bf57-4089-9ed4-1ff54f1f76ce tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.328193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3b03bf21-f7e1-40be-a308-a67b1c470ed0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:15.332190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:15.347798 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3b03bf21-f7e1-40be-a308-a67b1c470ed0 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.447942 Aug 29 15:45:15.349517 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2227/4569] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:14 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:15.549927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-5bd701bd-6abc-4737-8876-6f4fec1b5a0b req-de85f800-ddb4-4b5e-891a-63eaeeaf1325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc51544d-3049-416e-a24a-7ff7d4c7f9bb", "tag": "4eb9ac0d-4191-4691-8a98-8ea99acebfaf"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:15.583901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5bd701bd-6abc-4737-8876-6f4fec1b5a0b req-de85f800-ddb4-4b5e-891a-63eaeeaf1325 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.585897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5bd701bd-6abc-4737-8876-6f4fec1b5a0b req-de85f800-ddb4-4b5e-891a-63eaeeaf1325 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.589039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5bd701bd-6abc-4737-8876-6f4fec1b5a0b req-de85f800-ddb4-4b5e-891a-63eaeeaf1325 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.608908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-70f719fe-bf57-4089-9ed4-1ff54f1f76ce tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:15.622281 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-70f719fe-bf57-4089-9ed4-1ff54f1f76ce tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1308 microversion: 2.1 time: 0.465739 Aug 29 15:45:15.629229 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5bd701bd-6abc-4737-8876-6f4fec1b5a0b req-de85f800-ddb4-4b5e-891a-63eaeeaf1325 service nova] Creating event network-changed:4eb9ac0d-4191-4691-8a98-8ea99acebfaf for instance fc51544d-3049-416e-a24a-7ff7d4c7f9bb on n-h2-839401-11 Aug 29 15:45:15.636303 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2343/4570] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:15 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1308 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:15.640033 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-5bd701bd-6abc-4737-8876-6f4fec1b5a0b req-de85f800-ddb4-4b5e-891a-63eaeeaf1325 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094908 Aug 29 15:45:15.641005 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2228/4571] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:45:15.916866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a13bac01-a11f-48ed-978a-5ec31b0e493b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:15.917663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a13bac01-a11f-48ed-978a-5ec31b0e493b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:15.931296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a13bac01-a11f-48ed-978a-5ec31b0e493b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.931924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a13bac01-a11f-48ed-978a-5ec31b0e493b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.932353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a13bac01-a11f-48ed-978a-5ec31b0e493b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.933072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a13bac01-a11f-48ed-978a-5ec31b0e493b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.933637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a13bac01-a11f-48ed-978a-5ec31b0e493b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.934069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a13bac01-a11f-48ed-978a-5ec31b0e493b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.975989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b5761938-176c-4a74-867b-ea311c197826 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:15.977277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b5761938-176c-4a74-867b-ea311c197826 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:15.984859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5761938-176c-4a74-867b-ea311c197826 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.985646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5761938-176c-4a74-867b-ea311c197826 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.986241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5761938-176c-4a74-867b-ea311c197826 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.987152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5761938-176c-4a74-867b-ea311c197826 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.987757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5761938-176c-4a74-867b-ea311c197826 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.988365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5761938-176c-4a74-867b-ea311c197826 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:16.161863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a13bac01-a11f-48ed-978a-5ec31b0e493b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:16.171057 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a13bac01-a11f-48ed-978a-5ec31b0e493b tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1486 microversion: 2.1 time: 0.258255 Aug 29 15:45:16.171979 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2344/4572] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:15 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1486 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:16.258309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b5761938-176c-4a74-867b-ea311c197826 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:16.267383 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b5761938-176c-4a74-867b-ea311c197826 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1504 microversion: 2.1 time: 0.295724 Aug 29 15:45:16.268235 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2229/4573] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:15 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:16.328712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-380231110", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:16.370586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cf110639-a181-449d-abe2-1bf4ecfcfe30 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:16.371411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cf110639-a181-449d-abe2-1bf4ecfcfe30 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:16.380633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf110639-a181-449d-abe2-1bf4ecfcfe30 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:16.381165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf110639-a181-449d-abe2-1bf4ecfcfe30 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:16.381798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf110639-a181-449d-abe2-1bf4ecfcfe30 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:16.382874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf110639-a181-449d-abe2-1bf4ecfcfe30 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:16.383852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf110639-a181-449d-abe2-1bf4ecfcfe30 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:16.384300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf110639-a181-449d-abe2-1bf4ecfcfe30 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:16.403737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] validate_networks() for [('a4a05318-3609-40ff-8b4b-df5c0059b0de', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:45:16.548827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:16.559564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cf110639-a181-449d-abe2-1bf4ecfcfe30 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:16.572976 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cf110639-a181-449d-abe2-1bf4ecfcfe30 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.206449 Aug 29 15:45:16.578251 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2230/4574] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:16 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:16.653444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cb698b8e-9259-4af0-8f05-846566723fd0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:16.656721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cb698b8e-9259-4af0-8f05-846566723fd0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:16.667519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb698b8e-9259-4af0-8f05-846566723fd0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:16.668278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb698b8e-9259-4af0-8f05-846566723fd0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:16.668901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb698b8e-9259-4af0-8f05-846566723fd0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:16.669973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb698b8e-9259-4af0-8f05-846566723fd0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:16.670437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb698b8e-9259-4af0-8f05-846566723fd0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:16.671029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb698b8e-9259-4af0-8f05-846566723fd0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:16.858349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cb698b8e-9259-4af0-8f05-846566723fd0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:16.869774 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cb698b8e-9259-4af0-8f05-846566723fd0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1308 microversion: 2.1 time: 0.230136 Aug 29 15:45:16.873497 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2231/4575] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:16 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1308 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:16.945732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:45:16.946167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:45:16.946655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:45:16.947072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:45:16.947736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:45:16.957996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:16.958673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:16.959288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:16.960412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:16.961016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:16.961597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:16.982449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Getting quotas for project eccbf3aa74064e6abad669b285e7614d. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:45:16.989317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Getting quotas for user 332348822e194b488606b04ea4107de7 and project eccbf3aa74064e6abad669b285e7614d. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:45:17.003979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:45:17.006512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:45:17.059705 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-474f6aa4-5cfc-4062-bfb9-7d3df74f9afe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.736029 Aug 29 15:45:17.061232 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2345/4576] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:45:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:45:17.073259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4afd0664-cf40-41be-8c41-0afcd109f36f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:17.075628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4afd0664-cf40-41be-8c41-0afcd109f36f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:17.160939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4afd0664-cf40-41be-8c41-0afcd109f36f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:17.172161 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4afd0664-cf40-41be-8c41-0afcd109f36f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1213 microversion: 2.1 time: 0.103286 Aug 29 15:45:17.173471 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2232/4577] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:17 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:17.291562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b1eed550-c1e7-470b-9573-4780fa26d196 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:17.292320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b1eed550-c1e7-470b-9573-4780fa26d196 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:17.304704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1eed550-c1e7-470b-9573-4780fa26d196 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.304984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1eed550-c1e7-470b-9573-4780fa26d196 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.306430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1eed550-c1e7-470b-9573-4780fa26d196 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:17.307508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1eed550-c1e7-470b-9573-4780fa26d196 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.310075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1eed550-c1e7-470b-9573-4780fa26d196 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.310688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1eed550-c1e7-470b-9573-4780fa26d196 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:17.595880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fc28179a-0db9-40b0-a9e4-60dccb0e7634 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:17.596420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fc28179a-0db9-40b0-a9e4-60dccb0e7634 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:17.607614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc28179a-0db9-40b0-a9e4-60dccb0e7634 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.608232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc28179a-0db9-40b0-a9e4-60dccb0e7634 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.609280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc28179a-0db9-40b0-a9e4-60dccb0e7634 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:17.609607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b1eed550-c1e7-470b-9573-4780fa26d196 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:17.611009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc28179a-0db9-40b0-a9e4-60dccb0e7634 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.611959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc28179a-0db9-40b0-a9e4-60dccb0e7634 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.612915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc28179a-0db9-40b0-a9e4-60dccb0e7634 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:17.622211 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b1eed550-c1e7-470b-9573-4780fa26d196 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 200 len: 1507 microversion: 2.1 time: 0.335006 Aug 29 15:45:17.623976 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2346/4578] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:17 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 1507 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:17.646012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a0ce8221-e7c3-4d5f-b54a-d8e02bef9a83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:17.646944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a0ce8221-e7c3-4d5f-b54a-d8e02bef9a83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:17.656878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0ce8221-e7c3-4d5f-b54a-d8e02bef9a83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.662104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0ce8221-e7c3-4d5f-b54a-d8e02bef9a83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.662549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0ce8221-e7c3-4d5f-b54a-d8e02bef9a83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:17.663301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0ce8221-e7c3-4d5f-b54a-d8e02bef9a83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.663878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0ce8221-e7c3-4d5f-b54a-d8e02bef9a83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.664318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0ce8221-e7c3-4d5f-b54a-d8e02bef9a83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:17.865399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fc28179a-0db9-40b0-a9e4-60dccb0e7634 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:17.877896 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fc28179a-0db9-40b0-a9e4-60dccb0e7634 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.286118 Aug 29 15:45:17.894741 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2233/4579] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:17 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:17.907411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c93f18a0-2741-4299-bb41-e6550de4888f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:17.908356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c93f18a0-2741-4299-bb41-e6550de4888f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:17.915899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c93f18a0-2741-4299-bb41-e6550de4888f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.917108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c93f18a0-2741-4299-bb41-e6550de4888f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.918016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c93f18a0-2741-4299-bb41-e6550de4888f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:17.919241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c93f18a0-2741-4299-bb41-e6550de4888f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.920046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c93f18a0-2741-4299-bb41-e6550de4888f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.920738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c93f18a0-2741-4299-bb41-e6550de4888f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.089857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a0ce8221-e7c3-4d5f-b54a-d8e02bef9a83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:18.094383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c93f18a0-2741-4299-bb41-e6550de4888f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:18.104637 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a0ce8221-e7c3-4d5f-b54a-d8e02bef9a83 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.463514 Aug 29 15:45:18.104824 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c93f18a0-2741-4299-bb41-e6550de4888f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1308 microversion: 2.1 time: 0.206153 Aug 29 15:45:18.106955 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2347/4580] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:17 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:18.118947 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2234/4581] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:17 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1308 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:18.133832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-503f31cb-2694-4f3e-924a-f162294a5fd0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:18.134652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-503f31cb-2694-4f3e-924a-f162294a5fd0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:18.142015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-503f31cb-2694-4f3e-924a-f162294a5fd0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.142901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-503f31cb-2694-4f3e-924a-f162294a5fd0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.144422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-503f31cb-2694-4f3e-924a-f162294a5fd0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.145489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-503f31cb-2694-4f3e-924a-f162294a5fd0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.145954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-503f31cb-2694-4f3e-924a-f162294a5fd0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.146385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-503f31cb-2694-4f3e-924a-f162294a5fd0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.193655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3801dc2f-f299-457e-831e-fe28260c055e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:18.194284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3801dc2f-f299-457e-831e-fe28260c055e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:18.203648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3801dc2f-f299-457e-831e-fe28260c055e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.204154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3801dc2f-f299-457e-831e-fe28260c055e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.204635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3801dc2f-f299-457e-831e-fe28260c055e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.205529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3801dc2f-f299-457e-831e-fe28260c055e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.205995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3801dc2f-f299-457e-831e-fe28260c055e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.206430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3801dc2f-f299-457e-831e-fe28260c055e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.290753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3801dc2f-f299-457e-831e-fe28260c055e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:18.300726 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3801dc2f-f299-457e-831e-fe28260c055e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1265 microversion: 2.1 time: 0.110375 Aug 29 15:45:18.301849 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2235/4582] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:18 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:18.393238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-503f31cb-2694-4f3e-924a-f162294a5fd0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:18.402907 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-503f31cb-2694-4f3e-924a-f162294a5fd0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.274211 Aug 29 15:45:18.403516 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2348/4583] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:18 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:18.425533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ec72528d-b17f-472f-8d16-47a83ec87f7c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:18.438288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ec72528d-b17f-472f-8d16-47a83ec87f7c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:18.449918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec72528d-b17f-472f-8d16-47a83ec87f7c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.452419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec72528d-b17f-472f-8d16-47a83ec87f7c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.452942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec72528d-b17f-472f-8d16-47a83ec87f7c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.453698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec72528d-b17f-472f-8d16-47a83ec87f7c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.454162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec72528d-b17f-472f-8d16-47a83ec87f7c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.454592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec72528d-b17f-472f-8d16-47a83ec87f7c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.662720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ec72528d-b17f-472f-8d16-47a83ec87f7c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:18.674572 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ec72528d-b17f-472f-8d16-47a83ec87f7c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.254622 Aug 29 15:45:18.690913 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2236/4584] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:18 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:18.699476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a5333f0f-16ee-4cf7-b63c-1b42969cc4ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:18.701223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a5333f0f-16ee-4cf7-b63c-1b42969cc4ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:18.710494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:18.713617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5333f0f-16ee-4cf7-b63c-1b42969cc4ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.714429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5333f0f-16ee-4cf7-b63c-1b42969cc4ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.715128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5333f0f-16ee-4cf7-b63c-1b42969cc4ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.716069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5333f0f-16ee-4cf7-b63c-1b42969cc4ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.717570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5333f0f-16ee-4cf7-b63c-1b42969cc4ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.718225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5333f0f-16ee-4cf7-b63c-1b42969cc4ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.905236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-334e5772-dc7a-4f66-8fbd-96c53f19e1c2 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:18.906772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-334e5772-dc7a-4f66-8fbd-96c53f19e1c2 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:18.945901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-334e5772-dc7a-4f66-8fbd-96c53f19e1c2 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.946975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-334e5772-dc7a-4f66-8fbd-96c53f19e1c2 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.947739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-334e5772-dc7a-4f66-8fbd-96c53f19e1c2 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.948867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-334e5772-dc7a-4f66-8fbd-96c53f19e1c2 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.949659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-334e5772-dc7a-4f66-8fbd-96c53f19e1c2 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.950329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-334e5772-dc7a-4f66-8fbd-96c53f19e1c2 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.205198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a5333f0f-16ee-4cf7-b63c-1b42969cc4ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:19.216787 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a5333f0f-16ee-4cf7-b63c-1b42969cc4ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.522473 Aug 29 15:45:19.217996 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2349/4585] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:18 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:19.224044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2db8b9ad-4dfa-4c6d-a0a9-df2421ca8387 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:19.225011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2db8b9ad-4dfa-4c6d-a0a9-df2421ca8387 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:19.232307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2db8b9ad-4dfa-4c6d-a0a9-df2421ca8387 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.232905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2db8b9ad-4dfa-4c6d-a0a9-df2421ca8387 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.233910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2db8b9ad-4dfa-4c6d-a0a9-df2421ca8387 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.234828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2db8b9ad-4dfa-4c6d-a0a9-df2421ca8387 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.235478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2db8b9ad-4dfa-4c6d-a0a9-df2421ca8387 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.236091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2db8b9ad-4dfa-4c6d-a0a9-df2421ca8387 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.392023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-334e5772-dc7a-4f66-8fbd-96c53f19e1c2 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:19.404184 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-334e5772-dc7a-4f66-8fbd-96c53f19e1c2 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.504710 Aug 29 15:45:19.407383 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2237/4586] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:18 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:19.427511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7bfba541-8b69-473f-862a-f5b65adf8c24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:19.437876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bfba541-8b69-473f-862a-f5b65adf8c24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.438716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bfba541-8b69-473f-862a-f5b65adf8c24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.439386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bfba541-8b69-473f-862a-f5b65adf8c24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.472433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7bfba541-8b69-473f-862a-f5b65adf8c24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Going to try to stop instance {{(pid=122361) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:45:19.531856 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7bfba541-8b69-473f-862a-f5b65adf8c24 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 202 len: 0 microversion: 2.1 time: 0.122471 Aug 29 15:45:19.532950 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2238/4587] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:19 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:19.540744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a6d5645f-41ea-4ee3-94f3-604a7d255633 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:19.542024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a6d5645f-41ea-4ee3-94f3-604a7d255633 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:19.550567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6d5645f-41ea-4ee3-94f3-604a7d255633 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.551414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6d5645f-41ea-4ee3-94f3-604a7d255633 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.552267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6d5645f-41ea-4ee3-94f3-604a7d255633 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.553544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6d5645f-41ea-4ee3-94f3-604a7d255633 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.554559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6d5645f-41ea-4ee3-94f3-604a7d255633 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.555298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6d5645f-41ea-4ee3-94f3-604a7d255633 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.557461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2db8b9ad-4dfa-4c6d-a0a9-df2421ca8387 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:19.591439 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2db8b9ad-4dfa-4c6d-a0a9-df2421ca8387 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1308 microversion: 2.1 time: 0.356221 Aug 29 15:45:19.592649 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2350/4588] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:19 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1308 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:19.599996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4eae61f9-0761-4e44-ab59-1b86b23202d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:19.600661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4eae61f9-0761-4e44-ab59-1b86b23202d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:19.618345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4eae61f9-0761-4e44-ab59-1b86b23202d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.618840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4eae61f9-0761-4e44-ab59-1b86b23202d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.619277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4eae61f9-0761-4e44-ab59-1b86b23202d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.619979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4eae61f9-0761-4e44-ab59-1b86b23202d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.621818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4eae61f9-0761-4e44-ab59-1b86b23202d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.622323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4eae61f9-0761-4e44-ab59-1b86b23202d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.629612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:19.976363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4eae61f9-0761-4e44-ab59-1b86b23202d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:19.985686 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4eae61f9-0761-4e44-ab59-1b86b23202d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.391361 Aug 29 15:45:19.986247 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2351/4589] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:19 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:20.043554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a6d5645f-41ea-4ee3-94f3-604a7d255633 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:20.059200 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a6d5645f-41ea-4ee3-94f3-604a7d255633 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1271 microversion: 2.1 time: 0.523234 Aug 29 15:45:20.062376 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2239/4590] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:19 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1271 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:20.429181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0757d311-a077-421b-bbc5-b330f4ac7b0a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:20.429858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0757d311-a077-421b-bbc5-b330f4ac7b0a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:20.447344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0757d311-a077-421b-bbc5-b330f4ac7b0a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:20.448589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0757d311-a077-421b-bbc5-b330f4ac7b0a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:20.450601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0757d311-a077-421b-bbc5-b330f4ac7b0a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:20.451596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0757d311-a077-421b-bbc5-b330f4ac7b0a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:20.453451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0757d311-a077-421b-bbc5-b330f4ac7b0a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:20.457700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0757d311-a077-421b-bbc5-b330f4ac7b0a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:20.614418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e67cdf68-cf11-445f-b0d6-ed419ce278ae tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:20.615160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e67cdf68-cf11-445f-b0d6-ed419ce278ae tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:20.632754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e67cdf68-cf11-445f-b0d6-ed419ce278ae tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:20.633521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e67cdf68-cf11-445f-b0d6-ed419ce278ae tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:20.634046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e67cdf68-cf11-445f-b0d6-ed419ce278ae tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:20.635072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e67cdf68-cf11-445f-b0d6-ed419ce278ae tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:20.635712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e67cdf68-cf11-445f-b0d6-ed419ce278ae tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:20.636537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e67cdf68-cf11-445f-b0d6-ed419ce278ae tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:20.838241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e67cdf68-cf11-445f-b0d6-ed419ce278ae tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:20.853015 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e67cdf68-cf11-445f-b0d6-ed419ce278ae tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1308 microversion: 2.1 time: 0.243822 Aug 29 15:45:20.853661 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2240/4591] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:20 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:20.902203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0757d311-a077-421b-bbc5-b330f4ac7b0a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:20.911245 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0757d311-a077-421b-bbc5-b330f4ac7b0a tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.487616 Aug 29 15:45:20.911951 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2352/4592] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:20 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:21.008440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b5568f0-97ab-473d-8f41-0200167c5ce1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:21.009528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4b5568f0-97ab-473d-8f41-0200167c5ce1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:21.022165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b5568f0-97ab-473d-8f41-0200167c5ce1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.023374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b5568f0-97ab-473d-8f41-0200167c5ce1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.024975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b5568f0-97ab-473d-8f41-0200167c5ce1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.030521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b5568f0-97ab-473d-8f41-0200167c5ce1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.031239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b5568f0-97ab-473d-8f41-0200167c5ce1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.031876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b5568f0-97ab-473d-8f41-0200167c5ce1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.094929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-46f28395-f66f-466f-9b71-67a29e0a9f30 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:21.096967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-46f28395-f66f-466f-9b71-67a29e0a9f30 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:21.119234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46f28395-f66f-466f-9b71-67a29e0a9f30 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.123777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46f28395-f66f-466f-9b71-67a29e0a9f30 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.124714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46f28395-f66f-466f-9b71-67a29e0a9f30 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.126323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46f28395-f66f-466f-9b71-67a29e0a9f30 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.128798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46f28395-f66f-466f-9b71-67a29e0a9f30 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.129436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46f28395-f66f-466f-9b71-67a29e0a9f30 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.361363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4b5568f0-97ab-473d-8f41-0200167c5ce1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:21.372404 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4b5568f0-97ab-473d-8f41-0200167c5ce1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.368536 Aug 29 15:45:21.384615 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2241/4593] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:21 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:21.560375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-46f28395-f66f-466f-9b71-67a29e0a9f30 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:21.575170 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-46f28395-f66f-466f-9b71-67a29e0a9f30 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1313 microversion: 2.1 time: 0.495352 Aug 29 15:45:21.576105 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2353/4594] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:21 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:21.705787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1441681593", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "cc8e36f9-c27b-4c26-9fb1-e0ff255632c6"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:21.732398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-910e60c0-e69a-4b1a-ae35-410e356c905c req-1c88684d-c060-4e23-b0bf-7677c6318e20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da85002f-e41a-4518-98e0-ee129e44af23", "tag": "01dc6e29-d11a-4c10-8730-a6565b174ea3"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:21.745144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-910e60c0-e69a-4b1a-ae35-410e356c905c req-1c88684d-c060-4e23-b0bf-7677c6318e20 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.747576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-910e60c0-e69a-4b1a-ae35-410e356c905c req-1c88684d-c060-4e23-b0bf-7677c6318e20 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.748474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-910e60c0-e69a-4b1a-ae35-410e356c905c req-1c88684d-c060-4e23-b0bf-7677c6318e20 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.769103 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-910e60c0-e69a-4b1a-ae35-410e356c905c req-1c88684d-c060-4e23-b0bf-7677c6318e20 service nova] Creating event network-changed:01dc6e29-d11a-4c10-8730-a6565b174ea3 for instance da85002f-e41a-4518-98e0-ee129e44af23 on n-h1-839401-11 Aug 29 15:45:21.775662 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-910e60c0-e69a-4b1a-ae35-410e356c905c req-1c88684d-c060-4e23-b0bf-7677c6318e20 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047200 Aug 29 15:45:21.776669 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2354/4595] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:21.799789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] validate_networks() for [('cc8e36f9-c27b-4c26-9fb1-e0ff255632c6', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:45:21.874748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-938515c0-1fc5-4ab1-99a8-aa1bc2e7726f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:21.876155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-938515c0-1fc5-4ab1-99a8-aa1bc2e7726f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:21.884345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-938515c0-1fc5-4ab1-99a8-aa1bc2e7726f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.885073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-938515c0-1fc5-4ab1-99a8-aa1bc2e7726f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.885732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-938515c0-1fc5-4ab1-99a8-aa1bc2e7726f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.886599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-938515c0-1fc5-4ab1-99a8-aa1bc2e7726f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.888577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-938515c0-1fc5-4ab1-99a8-aa1bc2e7726f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.889363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-938515c0-1fc5-4ab1-99a8-aa1bc2e7726f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.271556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-938515c0-1fc5-4ab1-99a8-aa1bc2e7726f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:22.287236 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-938515c0-1fc5-4ab1-99a8-aa1bc2e7726f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1308 microversion: 2.1 time: 0.414042 Aug 29 15:45:22.288191 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2355/4596] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:21 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1308 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:22.305868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-46d29e58-1c8f-4883-958f-b4e117ff08e1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:22.306834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-46d29e58-1c8f-4883-958f-b4e117ff08e1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:22.317985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d29e58-1c8f-4883-958f-b4e117ff08e1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.318530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d29e58-1c8f-4883-958f-b4e117ff08e1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.318977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d29e58-1c8f-4883-958f-b4e117ff08e1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.320030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d29e58-1c8f-4883-958f-b4e117ff08e1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.320547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d29e58-1c8f-4883-958f-b4e117ff08e1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.320986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d29e58-1c8f-4883-958f-b4e117ff08e1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.407935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:45:22.408541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:45:22.409209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:45:22.409791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:45:22.410644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:45:22.427368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.427368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.427368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.427368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.427368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.427368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.482683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Getting quotas for project d24b8beb3a5446dcaffdc209c0e513b2. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:45:22.488619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Getting quotas for user c1ef354b84754383853e87e78de55c56 and project d24b8beb3a5446dcaffdc209c0e513b2. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:45:22.519363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:45:22.522416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:45:22.574006 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c7c410b9-a7b8-4636-b7d7-0e13d7de68dc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.086047 Aug 29 15:45:22.577271 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2242/4597] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:45:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:45:22.583998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1df0b280-0aaf-4daf-9825-3cf5a3e9f926 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:22.584861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1df0b280-0aaf-4daf-9825-3cf5a3e9f926 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:22.596326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1df0b280-0aaf-4daf-9825-3cf5a3e9f926 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.596820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1df0b280-0aaf-4daf-9825-3cf5a3e9f926 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.598860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1df0b280-0aaf-4daf-9825-3cf5a3e9f926 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.599156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1df0b280-0aaf-4daf-9825-3cf5a3e9f926 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.601272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1df0b280-0aaf-4daf-9825-3cf5a3e9f926 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.601817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1df0b280-0aaf-4daf-9825-3cf5a3e9f926 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.663539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-46d29e58-1c8f-4883-958f-b4e117ff08e1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:22.674536 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-46d29e58-1c8f-4883-958f-b4e117ff08e1 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.384773 Aug 29 15:45:22.675472 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2356/4598] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:22 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:22.694644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0e387ca5-a0ff-415e-bf4a-cc8dda1ba231 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:22.702091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0e387ca5-a0ff-415e-bf4a-cc8dda1ba231 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:22.710666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e387ca5-a0ff-415e-bf4a-cc8dda1ba231 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.711355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e387ca5-a0ff-415e-bf4a-cc8dda1ba231 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.711796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e387ca5-a0ff-415e-bf4a-cc8dda1ba231 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.713067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e387ca5-a0ff-415e-bf4a-cc8dda1ba231 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.713688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e387ca5-a0ff-415e-bf4a-cc8dda1ba231 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.714178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e387ca5-a0ff-415e-bf4a-cc8dda1ba231 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.762786 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0e387ca5-a0ff-415e-bf4a-cc8dda1ba231 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085295 Aug 29 15:45:22.763652 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2357/4599] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:45:22 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:22.769600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-60cbc0c1-5055-44a8-98e0-44ee3f7171e4 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:22.770346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-60cbc0c1-5055-44a8-98e0-44ee3f7171e4 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:22.801835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1df0b280-0aaf-4daf-9825-3cf5a3e9f926 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:22.815080 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1df0b280-0aaf-4daf-9825-3cf5a3e9f926 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.236691 Aug 29 15:45:22.815884 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2243/4600] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:22 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:22.822400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0daf56a4-1e35-484c-88b3-b6350d482e4f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:22.823493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0daf56a4-1e35-484c-88b3-b6350d482e4f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:22.830396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0daf56a4-1e35-484c-88b3-b6350d482e4f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.831062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0daf56a4-1e35-484c-88b3-b6350d482e4f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.831679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0daf56a4-1e35-484c-88b3-b6350d482e4f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.832831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0daf56a4-1e35-484c-88b3-b6350d482e4f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.833765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0daf56a4-1e35-484c-88b3-b6350d482e4f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.834407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0daf56a4-1e35-484c-88b3-b6350d482e4f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.892342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-60cbc0c1-5055-44a8-98e0-44ee3f7171e4 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:22.909982 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-60cbc0c1-5055-44a8-98e0-44ee3f7171e4 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1215 microversion: 2.1 time: 0.143890 Aug 29 15:45:22.911051 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2358/4601] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:22 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1215 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:22.925028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bcf29eec-b11b-44ff-b8f5-b4b1a4e510ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:22.926106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bcf29eec-b11b-44ff-b8f5-b4b1a4e510ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:22.946588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcf29eec-b11b-44ff-b8f5-b4b1a4e510ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.947934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcf29eec-b11b-44ff-b8f5-b4b1a4e510ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.949348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcf29eec-b11b-44ff-b8f5-b4b1a4e510ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.951137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcf29eec-b11b-44ff-b8f5-b4b1a4e510ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.953572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcf29eec-b11b-44ff-b8f5-b4b1a4e510ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.954897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcf29eec-b11b-44ff-b8f5-b4b1a4e510ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.028107 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bcf29eec-b11b-44ff-b8f5-b4b1a4e510ad tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments/c85eb566-c662-4e34-897d-efb6bae317b3" status: 200 len: 194 microversion: 2.1 time: 0.115323 Aug 29 15:45:23.029285 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2359/4602] 10.222.0.62 () {58 vars in 1413 bytes} [Mon Aug 29 15:45:22 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments/c85eb566-c662-4e34-897d-efb6bae317b3 => generated 194 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:23.045137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0daf56a4-1e35-484c-88b3-b6350d482e4f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:23.055148 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0daf56a4-1e35-484c-88b3-b6350d482e4f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1313 microversion: 2.1 time: 0.237848 Aug 29 15:45:23.055882 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2244/4603] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:22 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:23.060653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c6f01219-74a9-404c-a699-94390b3bb58f req-1ef4a424-bee6-4845-b587-2ab5f9a30d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc51544d-3049-416e-a24a-7ff7d4c7f9bb", "name": "network-vif-plugged", "status": "completed", "tag": "4eb9ac0d-4191-4691-8a98-8ea99acebfaf"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:23.083330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c6f01219-74a9-404c-a699-94390b3bb58f req-1ef4a424-bee6-4845-b587-2ab5f9a30d60 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.083832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c6f01219-74a9-404c-a699-94390b3bb58f req-1ef4a424-bee6-4845-b587-2ab5f9a30d60 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.084362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c6f01219-74a9-404c-a699-94390b3bb58f req-1ef4a424-bee6-4845-b587-2ab5f9a30d60 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.100247 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c6f01219-74a9-404c-a699-94390b3bb58f req-1ef4a424-bee6-4845-b587-2ab5f9a30d60 service nova] Creating event network-vif-plugged:4eb9ac0d-4191-4691-8a98-8ea99acebfaf for instance fc51544d-3049-416e-a24a-7ff7d4c7f9bb on n-h2-839401-11 Aug 29 15:45:23.106687 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c6f01219-74a9-404c-a699-94390b3bb58f req-1ef4a424-bee6-4845-b587-2ab5f9a30d60 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050961 Aug 29 15:45:23.107441 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2360/4604] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:23.310116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b925cc26-e7e9-48a6-9c82-5df47f056873 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:23.311548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b925cc26-e7e9-48a6-9c82-5df47f056873 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:23.321415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b925cc26-e7e9-48a6-9c82-5df47f056873 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.322495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b925cc26-e7e9-48a6-9c82-5df47f056873 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.323136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b925cc26-e7e9-48a6-9c82-5df47f056873 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.323914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b925cc26-e7e9-48a6-9c82-5df47f056873 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.324465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b925cc26-e7e9-48a6-9c82-5df47f056873 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.325044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b925cc26-e7e9-48a6-9c82-5df47f056873 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.548191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b925cc26-e7e9-48a6-9c82-5df47f056873 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:23.552771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:23.563896 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b925cc26-e7e9-48a6-9c82-5df47f056873 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1308 microversion: 2.1 time: 0.259073 Aug 29 15:45:23.564775 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2245/4605] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:23 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:23.697547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b58b2381-7378-466f-806c-1f1ec635ecc3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:23.698981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b58b2381-7378-466f-806c-1f1ec635ecc3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:23.706716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b58b2381-7378-466f-806c-1f1ec635ecc3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.707501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b58b2381-7378-466f-806c-1f1ec635ecc3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.708103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b58b2381-7378-466f-806c-1f1ec635ecc3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.709255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b58b2381-7378-466f-806c-1f1ec635ecc3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.710203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b58b2381-7378-466f-806c-1f1ec635ecc3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.710791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b58b2381-7378-466f-806c-1f1ec635ecc3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.837601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-47db45df-65bc-4aee-aff9-6f308bd3b7ea tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:23.838854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-47db45df-65bc-4aee-aff9-6f308bd3b7ea tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:23.847279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47db45df-65bc-4aee-aff9-6f308bd3b7ea tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.848036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47db45df-65bc-4aee-aff9-6f308bd3b7ea tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.848663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47db45df-65bc-4aee-aff9-6f308bd3b7ea tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.849610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47db45df-65bc-4aee-aff9-6f308bd3b7ea tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.850323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47db45df-65bc-4aee-aff9-6f308bd3b7ea tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.850469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47db45df-65bc-4aee-aff9-6f308bd3b7ea tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.888819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b58b2381-7378-466f-806c-1f1ec635ecc3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:23.907910 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b58b2381-7378-466f-806c-1f1ec635ecc3 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.214926 Aug 29 15:45:23.924573 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2361/4606] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:23 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:23.933418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-267abf55-ae69-4eb5-8978-f9f4756ef968 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:23.934929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-267abf55-ae69-4eb5-8978-f9f4756ef968 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:23.942644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-267abf55-ae69-4eb5-8978-f9f4756ef968 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.943393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-267abf55-ae69-4eb5-8978-f9f4756ef968 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.944673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-267abf55-ae69-4eb5-8978-f9f4756ef968 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.945629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-267abf55-ae69-4eb5-8978-f9f4756ef968 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.946375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-267abf55-ae69-4eb5-8978-f9f4756ef968 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.946950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-267abf55-ae69-4eb5-8978-f9f4756ef968 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.010197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-47db45df-65bc-4aee-aff9-6f308bd3b7ea tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.028987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-267abf55-ae69-4eb5-8978-f9f4756ef968 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.030625 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-47db45df-65bc-4aee-aff9-6f308bd3b7ea tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.197340 Aug 29 15:45:24.031751 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2246/4607] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:23 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:24.039147 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-267abf55-ae69-4eb5-8978-f9f4756ef968 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1211 microversion: 2.1 time: 0.110522 Aug 29 15:45:24.041241 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2362/4608] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:23 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1211 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:24.078817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4ab6e4b6-2813-4ad3-bb81-8e3b83eee21e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:24.079775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4ab6e4b6-2813-4ad3-bb81-8e3b83eee21e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:24.087318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ab6e4b6-2813-4ad3-bb81-8e3b83eee21e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.088095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ab6e4b6-2813-4ad3-bb81-8e3b83eee21e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.088752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ab6e4b6-2813-4ad3-bb81-8e3b83eee21e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.089771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ab6e4b6-2813-4ad3-bb81-8e3b83eee21e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.090438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ab6e4b6-2813-4ad3-bb81-8e3b83eee21e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.091062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ab6e4b6-2813-4ad3-bb81-8e3b83eee21e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.255520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4ab6e4b6-2813-4ad3-bb81-8e3b83eee21e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.267407 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4ab6e4b6-2813-4ad3-bb81-8e3b83eee21e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1313 microversion: 2.1 time: 0.193923 Aug 29 15:45:24.268294 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2247/4609] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:24 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:24.539661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-31f77ddc-9bc9-4974-b902-10211495c003 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df7a8b8d-ae22-4bfb-9cb6-803efccce96c"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:24.542364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-31f77ddc-9bc9-4974-b902-10211495c003 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:24.548996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31f77ddc-9bc9-4974-b902-10211495c003 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.549534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31f77ddc-9bc9-4974-b902-10211495c003 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.549978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31f77ddc-9bc9-4974-b902-10211495c003 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.550680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31f77ddc-9bc9-4974-b902-10211495c003 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.551258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31f77ddc-9bc9-4974-b902-10211495c003 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.551677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31f77ddc-9bc9-4974-b902-10211495c003 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.586319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1c1fc9ec-0f97-4052-8da4-3a07b8dd7584 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:24.587172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1c1fc9ec-0f97-4052-8da4-3a07b8dd7584 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:24.594155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c1fc9ec-0f97-4052-8da4-3a07b8dd7584 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.594651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c1fc9ec-0f97-4052-8da4-3a07b8dd7584 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.595118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c1fc9ec-0f97-4052-8da4-3a07b8dd7584 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.595824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c1fc9ec-0f97-4052-8da4-3a07b8dd7584 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.596281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c1fc9ec-0f97-4052-8da4-3a07b8dd7584 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.596704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c1fc9ec-0f97-4052-8da4-3a07b8dd7584 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.730597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1c1fc9ec-0f97-4052-8da4-3a07b8dd7584 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.739087 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1c1fc9ec-0f97-4052-8da4-3a07b8dd7584 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1308 microversion: 2.1 time: 0.157141 Aug 29 15:45:24.739695 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2248/4610] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:24 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1308 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:24.930020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-632d740d-151a-4b0f-8b09-3ad487c43503 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:24.930678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-632d740d-151a-4b0f-8b09-3ad487c43503 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:24.937704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-632d740d-151a-4b0f-8b09-3ad487c43503 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.938201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-632d740d-151a-4b0f-8b09-3ad487c43503 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.938652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-632d740d-151a-4b0f-8b09-3ad487c43503 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.939376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-632d740d-151a-4b0f-8b09-3ad487c43503 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.940005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-632d740d-151a-4b0f-8b09-3ad487c43503 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.940589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-632d740d-151a-4b0f-8b09-3ad487c43503 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.212109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-632d740d-151a-4b0f-8b09-3ad487c43503 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:25.224654 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-632d740d-151a-4b0f-8b09-3ad487c43503 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.298656 Aug 29 15:45:25.226200 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2249/4611] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:24 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:25.232060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a1b89ee-59aa-4716-8b88-c3e2939c7496 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:25.232688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a1b89ee-59aa-4716-8b88-c3e2939c7496 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:25.239947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a1b89ee-59aa-4716-8b88-c3e2939c7496 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.240689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a1b89ee-59aa-4716-8b88-c3e2939c7496 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.241816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a1b89ee-59aa-4716-8b88-c3e2939c7496 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.242732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a1b89ee-59aa-4716-8b88-c3e2939c7496 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.243366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a1b89ee-59aa-4716-8b88-c3e2939c7496 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.243960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a1b89ee-59aa-4716-8b88-c3e2939c7496 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.272040 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-31f77ddc-9bc9-4974-b902-10211495c003 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "POST /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.736659 Aug 29 15:45:25.272718 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2363/4612] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 15:45:24 2022] POST /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments => generated 194 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:25.286199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7a634718-2af7-498e-a07d-adc6eaa1122f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:25.287334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7a634718-2af7-498e-a07d-adc6eaa1122f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:25.297070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a634718-2af7-498e-a07d-adc6eaa1122f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.298140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a634718-2af7-498e-a07d-adc6eaa1122f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.298785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a634718-2af7-498e-a07d-adc6eaa1122f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.300681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a634718-2af7-498e-a07d-adc6eaa1122f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.301558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a634718-2af7-498e-a07d-adc6eaa1122f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.302211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a634718-2af7-498e-a07d-adc6eaa1122f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.467254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7a634718-2af7-498e-a07d-adc6eaa1122f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:25.480595 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7a634718-2af7-498e-a07d-adc6eaa1122f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1267 microversion: 2.1 time: 0.200715 Aug 29 15:45:25.494326 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2364/4613] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:25 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:25.505653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24dbea6a-ef50-437b-bbfd-d0c1965edc71 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:25.507425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-24dbea6a-ef50-437b-bbfd-d0c1965edc71 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:25.519446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24dbea6a-ef50-437b-bbfd-d0c1965edc71 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.521403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24dbea6a-ef50-437b-bbfd-d0c1965edc71 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.522643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24dbea6a-ef50-437b-bbfd-d0c1965edc71 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.523734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24dbea6a-ef50-437b-bbfd-d0c1965edc71 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.524448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24dbea6a-ef50-437b-bbfd-d0c1965edc71 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.525632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24dbea6a-ef50-437b-bbfd-d0c1965edc71 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.587592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5a1b89ee-59aa-4716-8b88-c3e2939c7496 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:25.595642 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5a1b89ee-59aa-4716-8b88-c3e2939c7496 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.368198 Aug 29 15:45:25.596231 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2250/4614] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:25 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:25.740815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-24dbea6a-ef50-437b-bbfd-d0c1965edc71 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:25.749553 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-24dbea6a-ef50-437b-bbfd-d0c1965edc71 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1313 microversion: 2.1 time: 0.251395 Aug 29 15:45:25.750182 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2365/4615] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:25 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:25.760042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-171529bd-6ee7-4b18-9a04-570042752c79 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:25.760927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-171529bd-6ee7-4b18-9a04-570042752c79 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:25.768261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-171529bd-6ee7-4b18-9a04-570042752c79 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.768748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-171529bd-6ee7-4b18-9a04-570042752c79 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.769220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-171529bd-6ee7-4b18-9a04-570042752c79 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.769968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-171529bd-6ee7-4b18-9a04-570042752c79 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.770428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-171529bd-6ee7-4b18-9a04-570042752c79 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.770857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-171529bd-6ee7-4b18-9a04-570042752c79 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.912266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-171529bd-6ee7-4b18-9a04-570042752c79 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:25.920692 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-171529bd-6ee7-4b18-9a04-570042752c79 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1488 microversion: 2.1 time: 0.164666 Aug 29 15:45:25.921351 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2251/4616] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:25 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1488 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:25.943206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1b3420fc-dc25-4f13-8d77-826d8e5a7bb4 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1404263095"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:25.946292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1b3420fc-dc25-4f13-8d77-826d8e5a7bb4 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:25.952943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b3420fc-dc25-4f13-8d77-826d8e5a7bb4 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.953477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b3420fc-dc25-4f13-8d77-826d8e5a7bb4 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.953909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b3420fc-dc25-4f13-8d77-826d8e5a7bb4 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.954569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b3420fc-dc25-4f13-8d77-826d8e5a7bb4 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.955016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b3420fc-dc25-4f13-8d77-826d8e5a7bb4 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.955432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b3420fc-dc25-4f13-8d77-826d8e5a7bb4 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:26.228849 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1b3420fc-dc25-4f13-8d77-826d8e5a7bb4 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "POST /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb/action" status: 202 len: 0 microversion: 2.1 time: 0.289524 Aug 29 15:45:26.229963 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2366/4617] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:25 2022] POST /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 29 15:45:26.242922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-58d61d5e-2fa3-40a0-9c63-7154aa6ab109 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a582820>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:26.250469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-19c4c705-4ee3-4d6a-b4f5-f0e90767fe09 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:26.251157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-19c4c705-4ee3-4d6a-b4f5-f0e90767fe09 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:26.271315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19c4c705-4ee3-4d6a-b4f5-f0e90767fe09 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:26.274129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19c4c705-4ee3-4d6a-b4f5-f0e90767fe09 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:26.275201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19c4c705-4ee3-4d6a-b4f5-f0e90767fe09 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:26.282276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19c4c705-4ee3-4d6a-b4f5-f0e90767fe09 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:26.282726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19c4c705-4ee3-4d6a-b4f5-f0e90767fe09 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:26.283350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19c4c705-4ee3-4d6a-b4f5-f0e90767fe09 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:26.330370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:26.331019 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-58d61d5e-2fa3-40a0-9c63-7154aa6ab109 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/b79b6796-86d1-4d95-b236-623bc2fcb9a2" status: 200 len: 1414 microversion: 2.1 time: 0.093558 Aug 29 15:45:26.333808 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2252/4618] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:26 2022] GET /compute/v2.1/images/b79b6796-86d1-4d95-b236-623bc2fcb9a2 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:26.360998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-317f3fb4-d253-4771-b40a-a0f5d62f9d57 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a593d30>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:26.456187 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-317f3fb4-d253-4771-b40a-a0f5d62f9d57 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/b79b6796-86d1-4d95-b236-623bc2fcb9a2" status: 200 len: 1414 microversion: 2.1 time: 0.110678 Aug 29 15:45:26.466124 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2253/4619] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:26 2022] GET /compute/v2.1/images/b79b6796-86d1-4d95-b236-623bc2fcb9a2 => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:26.473829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4ee901e3-e619-4354-bf00-1d6c5aa7955f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a6395e0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:26.588100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-19c4c705-4ee3-4d6a-b4f5-f0e90767fe09 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:26.596402 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-19c4c705-4ee3-4d6a-b4f5-f0e90767fe09 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.350437 Aug 29 15:45:26.613545 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2367/4620] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:26 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:26.622478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-86289622-598a-4f3e-8cce-a9468330f5d3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:26.623107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-86289622-598a-4f3e-8cce-a9468330f5d3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:26.645192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86289622-598a-4f3e-8cce-a9468330f5d3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:26.645710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86289622-598a-4f3e-8cce-a9468330f5d3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:26.646163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86289622-598a-4f3e-8cce-a9468330f5d3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:26.646890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86289622-598a-4f3e-8cce-a9468330f5d3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:26.647429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86289622-598a-4f3e-8cce-a9468330f5d3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:26.647862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86289622-598a-4f3e-8cce-a9468330f5d3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:26.692262 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4ee901e3-e619-4354-bf00-1d6c5aa7955f tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "DELETE /compute/v2.1/images/b79b6796-86d1-4d95-b236-623bc2fcb9a2" status: 204 len: 0 microversion: 2.1 time: 0.224872 Aug 29 15:45:26.693445 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2254/4621] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:26 2022] DELETE /compute/v2.1/images/b79b6796-86d1-4d95-b236-623bc2fcb9a2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:45:26.703688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a2d11f2c-4bf8-4a72-b652-42a1c6e54abd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:26.704641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a2d11f2c-4bf8-4a72-b652-42a1c6e54abd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:26.721895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2d11f2c-4bf8-4a72-b652-42a1c6e54abd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:26.723209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2d11f2c-4bf8-4a72-b652-42a1c6e54abd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:26.724805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2d11f2c-4bf8-4a72-b652-42a1c6e54abd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:26.725689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2d11f2c-4bf8-4a72-b652-42a1c6e54abd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:26.727070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2d11f2c-4bf8-4a72-b652-42a1c6e54abd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:26.727522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2d11f2c-4bf8-4a72-b652-42a1c6e54abd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:26.769507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-86289622-598a-4f3e-8cce-a9468330f5d3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:26.782099 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-86289622-598a-4f3e-8cce-a9468330f5d3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1273 microversion: 2.1 time: 0.165756 Aug 29 15:45:26.782724 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2368/4622] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:26 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:26.797210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec6ee22a-0356-49de-b378-1404434c8355 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42b7120d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:26.851793 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-ec6ee22a-0356-49de-b378-1404434c8355 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] HTTP exception thrown: Image not found. Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec6ee22a-0356-49de-b378-1404434c8355 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Request method failure captured: Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/images/b79b6796-86d1-4d95-b236-623bc2fcb9a2 HTTP/1.1 Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN4lGjWuBtP7IMH8HSwk8IArAW2Un5TRnhuxsWrM673TJoSMK_36MEx-0fGUi2H0QEZHaMoPWKZQoTLRYuljaJekjHyJMy7MOQAjg3gAnm3ahDfQDf2YzCRY-_mF_ajbSnqzHiKL4fgX0md_3rXTolDzVII-XHo4hByRxDyQdobEoY8 Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ad019754b47441d5a286666f8a048b48", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ad019754b47441d5a286666f8a048b48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}] Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 71ae9af4779a4d50b9171ff9ca8b5207 Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: exception: Image not found. Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b79b6796-86d1-4d95-b236-623bc2fcb9a2'} Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b79b6796-86d1-4d95-b236-623bc2fcb9a2 Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:45:26.856869 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b79b6796-86d1-4d95-b236-623bc2fcb9a2 could not be found. Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:26.861278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec6ee22a-0356-49de-b378-1404434c8355 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Returning 404 to user: Image not found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:26.864415 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ec6ee22a-0356-49de-b378-1404434c8355 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/images/b79b6796-86d1-4d95-b236-623bc2fcb9a2" status: 404 len: 62 microversion: 2.1 time: 0.074763 Aug 29 15:45:26.864415 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2369/4623] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:26 2022] GET /compute/v2.1/images/b79b6796-86d1-4d95-b236-623bc2fcb9a2 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:45:26.882570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bb198b7b-2cae-45ad-a400-59f22b658d64 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:26.883200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bb198b7b-2cae-45ad-a400-59f22b658d64 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:26.893146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb198b7b-2cae-45ad-a400-59f22b658d64 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:26.893655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb198b7b-2cae-45ad-a400-59f22b658d64 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:26.894185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb198b7b-2cae-45ad-a400-59f22b658d64 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:26.895107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb198b7b-2cae-45ad-a400-59f22b658d64 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:26.895774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb198b7b-2cae-45ad-a400-59f22b658d64 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:26.896239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb198b7b-2cae-45ad-a400-59f22b658d64 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:26.973475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:27.094626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bb198b7b-2cae-45ad-a400-59f22b658d64 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:27.104350 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bb198b7b-2cae-45ad-a400-59f22b658d64 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1313 microversion: 2.1 time: 0.234723 Aug 29 15:45:27.108691 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2370/4624] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:26 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:27.115936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4ed01a5e-9e07-4925-8719-6b185a05ad83 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:27.117010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4ed01a5e-9e07-4925-8719-6b185a05ad83 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:27.127831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ed01a5e-9e07-4925-8719-6b185a05ad83 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:27.141699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ed01a5e-9e07-4925-8719-6b185a05ad83 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:27.142572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ed01a5e-9e07-4925-8719-6b185a05ad83 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:27.143754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ed01a5e-9e07-4925-8719-6b185a05ad83 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:27.145628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ed01a5e-9e07-4925-8719-6b185a05ad83 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:27.146300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ed01a5e-9e07-4925-8719-6b185a05ad83 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:27.189859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a2d11f2c-4bf8-4a72-b652-42a1c6e54abd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:27.202479 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a2d11f2c-4bf8-4a72-b652-42a1c6e54abd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.507663 Aug 29 15:45:27.220641 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2255/4625] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:26 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:27.440688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4ed01a5e-9e07-4925-8719-6b185a05ad83 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:27.450408 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4ed01a5e-9e07-4925-8719-6b185a05ad83 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1500 microversion: 2.1 time: 0.339452 Aug 29 15:45:27.462627 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2371/4626] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:27 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1500 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:27.631064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6304118e-7705-4351-9cc3-3f01d18a242c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:27.633631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6304118e-7705-4351-9cc3-3f01d18a242c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:27.643526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6304118e-7705-4351-9cc3-3f01d18a242c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:27.644253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6304118e-7705-4351-9cc3-3f01d18a242c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:27.644811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6304118e-7705-4351-9cc3-3f01d18a242c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:27.645879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6304118e-7705-4351-9cc3-3f01d18a242c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:27.646410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6304118e-7705-4351-9cc3-3f01d18a242c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:27.646901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6304118e-7705-4351-9cc3-3f01d18a242c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:27.808242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-38b2215e-9501-42af-b634-c8348eabb848 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:27.809151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-38b2215e-9501-42af-b634-c8348eabb848 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:27.820713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38b2215e-9501-42af-b634-c8348eabb848 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:27.822140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38b2215e-9501-42af-b634-c8348eabb848 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:27.822781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38b2215e-9501-42af-b634-c8348eabb848 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:27.823835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38b2215e-9501-42af-b634-c8348eabb848 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:27.825164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38b2215e-9501-42af-b634-c8348eabb848 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:27.826058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-38b2215e-9501-42af-b634-c8348eabb848 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:27.985690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-38b2215e-9501-42af-b634-c8348eabb848 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:27.986825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6304118e-7705-4351-9cc3-3f01d18a242c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:27.995238 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-38b2215e-9501-42af-b634-c8348eabb848 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1315 microversion: 2.1 time: 0.191478 Aug 29 15:45:28.008845 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2372/4627] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:27 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:28.029634 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6304118e-7705-4351-9cc3-3f01d18a242c tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.411537 Aug 29 15:45:28.031717 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2256/4628] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:27 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:28.136223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c5596c9-36a2-4602-96e4-2d131b5a42ee tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:28.137662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5c5596c9-36a2-4602-96e4-2d131b5a42ee tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:28.146202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c5596c9-36a2-4602-96e4-2d131b5a42ee tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.147619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c5596c9-36a2-4602-96e4-2d131b5a42ee tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.148372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c5596c9-36a2-4602-96e4-2d131b5a42ee tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.150198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c5596c9-36a2-4602-96e4-2d131b5a42ee tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.151108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c5596c9-36a2-4602-96e4-2d131b5a42ee tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.151791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c5596c9-36a2-4602-96e4-2d131b5a42ee tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.228844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e8b6e1a4-5ae2-42e0-b2a5-57f77041d738 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:28.229943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e8b6e1a4-5ae2-42e0-b2a5-57f77041d738 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:28.236874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8b6e1a4-5ae2-42e0-b2a5-57f77041d738 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.237766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8b6e1a4-5ae2-42e0-b2a5-57f77041d738 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.238531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8b6e1a4-5ae2-42e0-b2a5-57f77041d738 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.239685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8b6e1a4-5ae2-42e0-b2a5-57f77041d738 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.240439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8b6e1a4-5ae2-42e0-b2a5-57f77041d738 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.241165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8b6e1a4-5ae2-42e0-b2a5-57f77041d738 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.321416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5c5596c9-36a2-4602-96e4-2d131b5a42ee tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:28.330152 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5c5596c9-36a2-4602-96e4-2d131b5a42ee tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1313 microversion: 2.1 time: 0.198008 Aug 29 15:45:28.343806 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2373/4629] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:28 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:28.475754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6708e6ab-b74d-4cdf-8107-e30e71c575ff tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:28.476839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6708e6ab-b74d-4cdf-8107-e30e71c575ff tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:28.488860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6708e6ab-b74d-4cdf-8107-e30e71c575ff tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.489757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6708e6ab-b74d-4cdf-8107-e30e71c575ff tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.490525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6708e6ab-b74d-4cdf-8107-e30e71c575ff tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.492563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6708e6ab-b74d-4cdf-8107-e30e71c575ff tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.493434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6708e6ab-b74d-4cdf-8107-e30e71c575ff tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.494157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6708e6ab-b74d-4cdf-8107-e30e71c575ff tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.537490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e8b6e1a4-5ae2-42e0-b2a5-57f77041d738 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:28.547247 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e8b6e1a4-5ae2-42e0-b2a5-57f77041d738 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.322434 Aug 29 15:45:28.552339 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2257/4630] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:28 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:28.651508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6708e6ab-b74d-4cdf-8107-e30e71c575ff tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:28.662873 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6708e6ab-b74d-4cdf-8107-e30e71c575ff tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1500 microversion: 2.1 time: 0.194400 Aug 29 15:45:28.664169 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2374/4631] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:28 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1500 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:28.982610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-4e10484f-8faf-4bdb-9a14-dc16e415c837 req-a8bac05e-a1de-48a2-8c8f-b56529cb9f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd640d6c-9838-43b8-b1ab-d38a1b38b757", "tag": "4db4c016-f20a-4d1c-a933-0c7dc37021b4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:29.005100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:29.008183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4e10484f-8faf-4bdb-9a14-dc16e415c837 req-a8bac05e-a1de-48a2-8c8f-b56529cb9f4c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.008774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4e10484f-8faf-4bdb-9a14-dc16e415c837 req-a8bac05e-a1de-48a2-8c8f-b56529cb9f4c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.011000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4e10484f-8faf-4bdb-9a14-dc16e415c837 req-a8bac05e-a1de-48a2-8c8f-b56529cb9f4c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.018044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-58a427de-5e9b-4c77-8e44-08c29ad2c31b tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:29.018729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-58a427de-5e9b-4c77-8e44-08c29ad2c31b tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:29.027207 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-4e10484f-8faf-4bdb-9a14-dc16e415c837 req-a8bac05e-a1de-48a2-8c8f-b56529cb9f4c service nova] Creating event network-changed:4db4c016-f20a-4d1c-a933-0c7dc37021b4 for instance cd640d6c-9838-43b8-b1ab-d38a1b38b757 on n-h2-839401-11 Aug 29 15:45:29.029785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58a427de-5e9b-4c77-8e44-08c29ad2c31b tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.032840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58a427de-5e9b-4c77-8e44-08c29ad2c31b tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.033706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58a427de-5e9b-4c77-8e44-08c29ad2c31b tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.035296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58a427de-5e9b-4c77-8e44-08c29ad2c31b tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.035945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58a427de-5e9b-4c77-8e44-08c29ad2c31b tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.036910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-58a427de-5e9b-4c77-8e44-08c29ad2c31b tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.039911 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-4e10484f-8faf-4bdb-9a14-dc16e415c837 req-a8bac05e-a1de-48a2-8c8f-b56529cb9f4c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062324 Aug 29 15:45:29.041065 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2258/4632] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:29.054558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-11a7bb32-5d2d-413f-ac02-6c41c9e08972 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:29.055270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-11a7bb32-5d2d-413f-ac02-6c41c9e08972 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:29.069525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11a7bb32-5d2d-413f-ac02-6c41c9e08972 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.070375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11a7bb32-5d2d-413f-ac02-6c41c9e08972 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.070830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11a7bb32-5d2d-413f-ac02-6c41c9e08972 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.071551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11a7bb32-5d2d-413f-ac02-6c41c9e08972 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.072506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11a7bb32-5d2d-413f-ac02-6c41c9e08972 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.073123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11a7bb32-5d2d-413f-ac02-6c41c9e08972 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.231778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-58a427de-5e9b-4c77-8e44-08c29ad2c31b tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:29.241725 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-58a427de-5e9b-4c77-8e44-08c29ad2c31b tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1315 microversion: 2.1 time: 0.229360 Aug 29 15:45:29.242873 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2375/4633] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:29 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:29.354501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-babd4c21-00b6-4d31-b9d5-f5f6e68fbb00 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:29.354796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-11a7bb32-5d2d-413f-ac02-6c41c9e08972 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:29.355156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-babd4c21-00b6-4d31-b9d5-f5f6e68fbb00 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:29.363369 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-11a7bb32-5d2d-413f-ac02-6c41c9e08972 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.316051 Aug 29 15:45:29.363595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-babd4c21-00b6-4d31-b9d5-f5f6e68fbb00 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.364047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-babd4c21-00b6-4d31-b9d5-f5f6e68fbb00 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.364598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-babd4c21-00b6-4d31-b9d5-f5f6e68fbb00 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.364966 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2259/4634] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:29 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:29.382646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-babd4c21-00b6-4d31-b9d5-f5f6e68fbb00 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.383551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-babd4c21-00b6-4d31-b9d5-f5f6e68fbb00 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.385071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-babd4c21-00b6-4d31-b9d5-f5f6e68fbb00 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.482179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-788394da-1e05-47c5-b754-5e9bf9faefa5 req-d6636292-22ef-45e0-898a-05ea38f6839a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da85002f-e41a-4518-98e0-ee129e44af23", "name": "network-vif-plugged", "status": "completed", "tag": "01dc6e29-d11a-4c10-8730-a6565b174ea3"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:29.509913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-788394da-1e05-47c5-b754-5e9bf9faefa5 req-d6636292-22ef-45e0-898a-05ea38f6839a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.511035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-788394da-1e05-47c5-b754-5e9bf9faefa5 req-d6636292-22ef-45e0-898a-05ea38f6839a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.513166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-788394da-1e05-47c5-b754-5e9bf9faefa5 req-d6636292-22ef-45e0-898a-05ea38f6839a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.541660 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-788394da-1e05-47c5-b754-5e9bf9faefa5 req-d6636292-22ef-45e0-898a-05ea38f6839a service nova] Creating event network-vif-plugged:01dc6e29-d11a-4c10-8730-a6565b174ea3 for instance da85002f-e41a-4518-98e0-ee129e44af23 on n-h1-839401-11 Aug 29 15:45:29.549360 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-788394da-1e05-47c5-b754-5e9bf9faefa5 req-d6636292-22ef-45e0-898a-05ea38f6839a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072539 Aug 29 15:45:29.550493 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2260/4635] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:29.578697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-00be1df2-87fc-4626-ae44-2645f25f2b3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:29.579733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-00be1df2-87fc-4626-ae44-2645f25f2b3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:29.593871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00be1df2-87fc-4626-ae44-2645f25f2b3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.595636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00be1df2-87fc-4626-ae44-2645f25f2b3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.596095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00be1df2-87fc-4626-ae44-2645f25f2b3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.599373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00be1df2-87fc-4626-ae44-2645f25f2b3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.599896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00be1df2-87fc-4626-ae44-2645f25f2b3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.600351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00be1df2-87fc-4626-ae44-2645f25f2b3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.915341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-00be1df2-87fc-4626-ae44-2645f25f2b3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:29.940645 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-00be1df2-87fc-4626-ae44-2645f25f2b3b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.364944 Aug 29 15:45:29.941662 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2261/4636] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:29 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:29.947370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cdf3c38f-a4ff-424b-956e-bc9a1bbab2f0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:29.947978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cdf3c38f-a4ff-424b-956e-bc9a1bbab2f0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:29.968060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdf3c38f-a4ff-424b-956e-bc9a1bbab2f0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.971457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdf3c38f-a4ff-424b-956e-bc9a1bbab2f0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.972145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdf3c38f-a4ff-424b-956e-bc9a1bbab2f0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.972938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdf3c38f-a4ff-424b-956e-bc9a1bbab2f0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.973456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdf3c38f-a4ff-424b-956e-bc9a1bbab2f0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.973893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdf3c38f-a4ff-424b-956e-bc9a1bbab2f0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:30.142834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cdf3c38f-a4ff-424b-956e-bc9a1bbab2f0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:30.154606 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cdf3c38f-a4ff-424b-956e-bc9a1bbab2f0 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1506 microversion: 2.1 time: 0.211675 Aug 29 15:45:30.155276 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2262/4637] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:29 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:30.173730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-babd4c21-00b6-4d31-b9d5-f5f6e68fbb00 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:30.182374 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-babd4c21-00b6-4d31-b9d5-f5f6e68fbb00 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1313 microversion: 2.1 time: 0.835457 Aug 29 15:45:30.182965 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2376/4638] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:29 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1313 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:30.263293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7664dfd2-2249-47dd-ab5b-919c97dc7671 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:30.263908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7664dfd2-2249-47dd-ab5b-919c97dc7671 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:30.271424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7664dfd2-2249-47dd-ab5b-919c97dc7671 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:30.271424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7664dfd2-2249-47dd-ab5b-919c97dc7671 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:30.271693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7664dfd2-2249-47dd-ab5b-919c97dc7671 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:30.272402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7664dfd2-2249-47dd-ab5b-919c97dc7671 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:30.272912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7664dfd2-2249-47dd-ab5b-919c97dc7671 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:30.273314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7664dfd2-2249-47dd-ab5b-919c97dc7671 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:30.386294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b9500dc2-f977-4a41-bdc5-6a46fbf3b339 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:30.387593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b9500dc2-f977-4a41-bdc5-6a46fbf3b339 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:30.394354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9500dc2-f977-4a41-bdc5-6a46fbf3b339 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:30.394998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9500dc2-f977-4a41-bdc5-6a46fbf3b339 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:30.395536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9500dc2-f977-4a41-bdc5-6a46fbf3b339 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:30.396506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9500dc2-f977-4a41-bdc5-6a46fbf3b339 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:30.397234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9500dc2-f977-4a41-bdc5-6a46fbf3b339 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:30.397685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9500dc2-f977-4a41-bdc5-6a46fbf3b339 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:30.441694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7664dfd2-2249-47dd-ab5b-919c97dc7671 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:30.450992 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7664dfd2-2249-47dd-ab5b-919c97dc7671 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1315 microversion: 2.1 time: 0.191749 Aug 29 15:45:30.459674 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2263/4639] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:30 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:30.556692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b9500dc2-f977-4a41-bdc5-6a46fbf3b339 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:30.569130 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b9500dc2-f977-4a41-bdc5-6a46fbf3b339 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.187330 Aug 29 15:45:30.570353 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2377/4640] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:30 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:30.968188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7d551493-0318-4b25-a2d8-fd05d7459a8b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:30.969647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7d551493-0318-4b25-a2d8-fd05d7459a8b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:30.976677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d551493-0318-4b25-a2d8-fd05d7459a8b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:30.977536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d551493-0318-4b25-a2d8-fd05d7459a8b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:30.978265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d551493-0318-4b25-a2d8-fd05d7459a8b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:30.979123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d551493-0318-4b25-a2d8-fd05d7459a8b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:30.979992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d551493-0318-4b25-a2d8-fd05d7459a8b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:30.980651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7d551493-0318-4b25-a2d8-fd05d7459a8b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.177976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d9783169-7369-4421-baab-1c6b05b83e25 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:31.179281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d9783169-7369-4421-baab-1c6b05b83e25 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:31.189692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9783169-7369-4421-baab-1c6b05b83e25 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:31.191175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9783169-7369-4421-baab-1c6b05b83e25 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:31.192068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9783169-7369-4421-baab-1c6b05b83e25 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.193069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9783169-7369-4421-baab-1c6b05b83e25 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:31.193626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9783169-7369-4421-baab-1c6b05b83e25 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:31.194259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9783169-7369-4421-baab-1c6b05b83e25 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.194724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7d551493-0318-4b25-a2d8-fd05d7459a8b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:31.213197 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7d551493-0318-4b25-a2d8-fd05d7459a8b tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.250566 Aug 29 15:45:31.214541 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2264/4641] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:30 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:31.223705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d9f4e824-6311-4d45-844e-96bdd355ebc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:31.224517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d9f4e824-6311-4d45-844e-96bdd355ebc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:31.233575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9f4e824-6311-4d45-844e-96bdd355ebc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:31.234350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9f4e824-6311-4d45-844e-96bdd355ebc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:31.235112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9f4e824-6311-4d45-844e-96bdd355ebc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.236336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9f4e824-6311-4d45-844e-96bdd355ebc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:31.236958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9f4e824-6311-4d45-844e-96bdd355ebc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:31.237836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9f4e824-6311-4d45-844e-96bdd355ebc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.409252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d9783169-7369-4421-baab-1c6b05b83e25 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:31.418594 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d9783169-7369-4421-baab-1c6b05b83e25 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1506 microversion: 2.1 time: 0.246346 Aug 29 15:45:31.419835 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2378/4642] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:31 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:31.455445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d9f4e824-6311-4d45-844e-96bdd355ebc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:31.465265 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d9f4e824-6311-4d45-844e-96bdd355ebc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1313 microversion: 2.1 time: 0.246232 Aug 29 15:45:31.478075 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2265/4643] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:31 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:31.480700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e51330f0-51c9-4cd4-b436-5a37681b7fe3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:31.481550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e51330f0-51c9-4cd4-b436-5a37681b7fe3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:31.492182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e51330f0-51c9-4cd4-b436-5a37681b7fe3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:31.493632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e51330f0-51c9-4cd4-b436-5a37681b7fe3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:31.494141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e51330f0-51c9-4cd4-b436-5a37681b7fe3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.495013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e51330f0-51c9-4cd4-b436-5a37681b7fe3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:31.496472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e51330f0-51c9-4cd4-b436-5a37681b7fe3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:31.496923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e51330f0-51c9-4cd4-b436-5a37681b7fe3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.590894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a84ee705-5c6a-49a0-92c9-933db0f016df tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:31.591516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a84ee705-5c6a-49a0-92c9-933db0f016df tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:31.605718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a84ee705-5c6a-49a0-92c9-933db0f016df tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:31.606452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a84ee705-5c6a-49a0-92c9-933db0f016df tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:31.607052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a84ee705-5c6a-49a0-92c9-933db0f016df tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.607916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a84ee705-5c6a-49a0-92c9-933db0f016df tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:31.608516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a84ee705-5c6a-49a0-92c9-933db0f016df tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:31.609167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a84ee705-5c6a-49a0-92c9-933db0f016df tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.669051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e51330f0-51c9-4cd4-b436-5a37681b7fe3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:31.678182 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e51330f0-51c9-4cd4-b436-5a37681b7fe3 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1315 microversion: 2.1 time: 0.202311 Aug 29 15:45:31.679161 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2379/4644] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:31 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:31.768789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a84ee705-5c6a-49a0-92c9-933db0f016df tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:31.772639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:31.778730 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a84ee705-5c6a-49a0-92c9-933db0f016df tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.192189 Aug 29 15:45:31.779667 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2266/4645] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:31 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:32.237536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7a4038ff-dbc3-4f5c-882a-4d1008fd5555 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:32.238600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7a4038ff-dbc3-4f5c-882a-4d1008fd5555 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:32.247791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a4038ff-dbc3-4f5c-882a-4d1008fd5555 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.248302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a4038ff-dbc3-4f5c-882a-4d1008fd5555 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.248919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a4038ff-dbc3-4f5c-882a-4d1008fd5555 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.250185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a4038ff-dbc3-4f5c-882a-4d1008fd5555 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.250820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a4038ff-dbc3-4f5c-882a-4d1008fd5555 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.251293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a4038ff-dbc3-4f5c-882a-4d1008fd5555 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.427914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7a4038ff-dbc3-4f5c-882a-4d1008fd5555 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:32.440833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-35fe26c9-7442-4566-b6ff-e8adbc9fdf43 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:32.441565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-35fe26c9-7442-4566-b6ff-e8adbc9fdf43 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:32.446290 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7a4038ff-dbc3-4f5c-882a-4d1008fd5555 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.214485 Aug 29 15:45:32.448975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35fe26c9-7442-4566-b6ff-e8adbc9fdf43 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.449827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35fe26c9-7442-4566-b6ff-e8adbc9fdf43 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.450271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35fe26c9-7442-4566-b6ff-e8adbc9fdf43 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.451111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35fe26c9-7442-4566-b6ff-e8adbc9fdf43 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.451755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35fe26c9-7442-4566-b6ff-e8adbc9fdf43 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.452306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35fe26c9-7442-4566-b6ff-e8adbc9fdf43 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.456903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:32.457740 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2380/4646] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:32 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:32.493832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-57dd7ce2-3fd1-46ae-8e24-5462ea9975a7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:32.494472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-57dd7ce2-3fd1-46ae-8e24-5462ea9975a7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:32.501715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57dd7ce2-3fd1-46ae-8e24-5462ea9975a7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.502217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57dd7ce2-3fd1-46ae-8e24-5462ea9975a7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.511153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=8 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:32.524926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57dd7ce2-3fd1-46ae-8e24-5462ea9975a7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.525923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57dd7ce2-3fd1-46ae-8e24-5462ea9975a7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.526744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57dd7ce2-3fd1-46ae-8e24-5462ea9975a7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.527219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-57dd7ce2-3fd1-46ae-8e24-5462ea9975a7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.619843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-35fe26c9-7442-4566-b6ff-e8adbc9fdf43 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:32.630822 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-35fe26c9-7442-4566-b6ff-e8adbc9fdf43 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1506 microversion: 2.1 time: 0.194183 Aug 29 15:45:32.631469 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2267/4647] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:32 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:32.699591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fa5c6c01-c1cd-443d-b288-4110d90983a9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:32.700360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fa5c6c01-c1cd-443d-b288-4110d90983a9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:32.706589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa5c6c01-c1cd-443d-b288-4110d90983a9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.707262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa5c6c01-c1cd-443d-b288-4110d90983a9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.707695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa5c6c01-c1cd-443d-b288-4110d90983a9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.708403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa5c6c01-c1cd-443d-b288-4110d90983a9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.708853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa5c6c01-c1cd-443d-b288-4110d90983a9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.709283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa5c6c01-c1cd-443d-b288-4110d90983a9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.740763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-57dd7ce2-3fd1-46ae-8e24-5462ea9975a7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:32.750026 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-57dd7ce2-3fd1-46ae-8e24-5462ea9975a7 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1313 microversion: 2.1 time: 0.263808 Aug 29 15:45:32.751338 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2381/4648] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:32 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:32.803168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1a4844b1-4709-433c-ae50-baa93bebbc4e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:32.803951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1a4844b1-4709-433c-ae50-baa93bebbc4e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:32.825711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a4844b1-4709-433c-ae50-baa93bebbc4e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.826241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a4844b1-4709-433c-ae50-baa93bebbc4e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.826700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a4844b1-4709-433c-ae50-baa93bebbc4e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.830371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a4844b1-4709-433c-ae50-baa93bebbc4e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.831407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a4844b1-4709-433c-ae50-baa93bebbc4e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.832515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a4844b1-4709-433c-ae50-baa93bebbc4e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.869369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fa5c6c01-c1cd-443d-b288-4110d90983a9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:32.883339 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fa5c6c01-c1cd-443d-b288-4110d90983a9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1315 microversion: 2.1 time: 0.187636 Aug 29 15:45:32.899858 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2268/4649] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:32 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:32.911605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=16 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:33.114189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1a4844b1-4709-433c-ae50-baa93bebbc4e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:33.122766 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1a4844b1-4709-433c-ae50-baa93bebbc4e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.326038 Aug 29 15:45:33.123930 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2382/4650] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:32 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:33.258231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-0db5a1ba-8bf8-4f13-8a62-70b50b37fe65 req-293bfeda-84a0-4215-8154-c9edc2a5d2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc51544d-3049-416e-a24a-7ff7d4c7f9bb", "name": "network-vif-plugged", "status": "completed", "tag": "4eb9ac0d-4191-4691-8a98-8ea99acebfaf"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:33.269194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0db5a1ba-8bf8-4f13-8a62-70b50b37fe65 req-293bfeda-84a0-4215-8154-c9edc2a5d2d4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.269933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0db5a1ba-8bf8-4f13-8a62-70b50b37fe65 req-293bfeda-84a0-4215-8154-c9edc2a5d2d4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.270590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0db5a1ba-8bf8-4f13-8a62-70b50b37fe65 req-293bfeda-84a0-4215-8154-c9edc2a5d2d4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.290512 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-0db5a1ba-8bf8-4f13-8a62-70b50b37fe65 req-293bfeda-84a0-4215-8154-c9edc2a5d2d4 service nova] Creating event network-vif-plugged:4eb9ac0d-4191-4691-8a98-8ea99acebfaf for instance fc51544d-3049-416e-a24a-7ff7d4c7f9bb on n-h2-839401-11 Aug 29 15:45:33.296031 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-0db5a1ba-8bf8-4f13-8a62-70b50b37fe65 req-293bfeda-84a0-4215-8154-c9edc2a5d2d4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232285 Aug 29 15:45:33.297003 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2269/4651] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:33.468922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-902db49a-a6de-4917-a63e-2968de379300 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:33.469703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-902db49a-a6de-4917-a63e-2968de379300 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:33.476576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-902db49a-a6de-4917-a63e-2968de379300 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.477066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-902db49a-a6de-4917-a63e-2968de379300 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.477556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-902db49a-a6de-4917-a63e-2968de379300 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.478252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-902db49a-a6de-4917-a63e-2968de379300 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.479142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-902db49a-a6de-4917-a63e-2968de379300 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.479490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-902db49a-a6de-4917-a63e-2968de379300 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.632645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-902db49a-a6de-4917-a63e-2968de379300 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:33.646241 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-902db49a-a6de-4917-a63e-2968de379300 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1679 microversion: 2.1 time: 0.181402 Aug 29 15:45:33.646848 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2383/4652] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:33 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:33.658288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-61a0d124-ba02-46b1-9f1f-d190a67ba658 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:33.658288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-61a0d124-ba02-46b1-9f1f-d190a67ba658 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:33.665878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61a0d124-ba02-46b1-9f1f-d190a67ba658 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.666685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61a0d124-ba02-46b1-9f1f-d190a67ba658 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.667350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61a0d124-ba02-46b1-9f1f-d190a67ba658 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.668072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61a0d124-ba02-46b1-9f1f-d190a67ba658 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.668660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61a0d124-ba02-46b1-9f1f-d190a67ba658 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.669182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61a0d124-ba02-46b1-9f1f-d190a67ba658 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.775017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4b83f067-8cb7-4a87-b01d-6c727fd9f2cc tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:33.775938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4b83f067-8cb7-4a87-b01d-6c727fd9f2cc tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:33.783362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b83f067-8cb7-4a87-b01d-6c727fd9f2cc tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.785608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b83f067-8cb7-4a87-b01d-6c727fd9f2cc tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.786057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b83f067-8cb7-4a87-b01d-6c727fd9f2cc tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.786858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b83f067-8cb7-4a87-b01d-6c727fd9f2cc tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.787334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b83f067-8cb7-4a87-b01d-6c727fd9f2cc tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.797328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b83f067-8cb7-4a87-b01d-6c727fd9f2cc tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.942538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-61a0d124-ba02-46b1-9f1f-d190a67ba658 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:33.952700 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-61a0d124-ba02-46b1-9f1f-d190a67ba658 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1506 microversion: 2.1 time: 0.301806 Aug 29 15:45:33.953510 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2270/4653] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:33 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:33.971465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e53fcf32-b0a3-4dec-8c35-f079ec268432 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:33.972987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e53fcf32-b0a3-4dec-8c35-f079ec268432 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:33.981774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e53fcf32-b0a3-4dec-8c35-f079ec268432 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.982655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e53fcf32-b0a3-4dec-8c35-f079ec268432 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.983883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e53fcf32-b0a3-4dec-8c35-f079ec268432 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.984764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e53fcf32-b0a3-4dec-8c35-f079ec268432 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.985429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e53fcf32-b0a3-4dec-8c35-f079ec268432 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.986467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e53fcf32-b0a3-4dec-8c35-f079ec268432 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:34.018796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4b83f067-8cb7-4a87-b01d-6c727fd9f2cc tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:34.029894 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4b83f067-8cb7-4a87-b01d-6c727fd9f2cc tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1498 microversion: 2.1 time: 0.259428 Aug 29 15:45:34.031106 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2384/4654] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:33 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1498 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:34.058447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fb832608-5bf4-4d84-a3da-2ecc611ddf47 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:34.061179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fb832608-5bf4-4d84-a3da-2ecc611ddf47 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:34.068537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb832608-5bf4-4d84-a3da-2ecc611ddf47 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:34.069306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb832608-5bf4-4d84-a3da-2ecc611ddf47 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:34.069939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb832608-5bf4-4d84-a3da-2ecc611ddf47 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:34.070870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb832608-5bf4-4d84-a3da-2ecc611ddf47 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:34.071519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb832608-5bf4-4d84-a3da-2ecc611ddf47 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:34.072133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb832608-5bf4-4d84-a3da-2ecc611ddf47 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:34.076856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:34.105548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-fb832608-5bf4-4d84-a3da-2ecc611ddf47 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lazy-loading 'flavor' on Instance uuid da85002f-e41a-4518-98e0-ee129e44af23 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:34.195218 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fb832608-5bf4-4d84-a3da-2ecc611ddf47 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "POST /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23/action" status: 200 len: 32 microversion: 2.1 time: 0.141615 Aug 29 15:45:34.195796 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2385/4655] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:34 2022] POST /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23/action => generated 32 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:45:34.205263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bc676b80-b80d-49e3-93fd-9f4e95bf1f49 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:34.206068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bc676b80-b80d-49e3-93fd-9f4e95bf1f49 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:34.214830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc676b80-b80d-49e3-93fd-9f4e95bf1f49 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:34.215487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc676b80-b80d-49e3-93fd-9f4e95bf1f49 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:34.216107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc676b80-b80d-49e3-93fd-9f4e95bf1f49 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:34.216986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc676b80-b80d-49e3-93fd-9f4e95bf1f49 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:34.217597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc676b80-b80d-49e3-93fd-9f4e95bf1f49 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:34.218082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc676b80-b80d-49e3-93fd-9f4e95bf1f49 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:34.218381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e53fcf32-b0a3-4dec-8c35-f079ec268432 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:34.231371 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e53fcf32-b0a3-4dec-8c35-f079ec268432 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1315 microversion: 2.1 time: 0.276695 Aug 29 15:45:34.247098 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2271/4656] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:33 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:34.255424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b2db42b5-2b46-49af-b29a-00e16894f406 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:34.256942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b2db42b5-2b46-49af-b29a-00e16894f406 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:34.263446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2db42b5-2b46-49af-b29a-00e16894f406 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:34.264136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2db42b5-2b46-49af-b29a-00e16894f406 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:34.264756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2db42b5-2b46-49af-b29a-00e16894f406 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:34.265643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2db42b5-2b46-49af-b29a-00e16894f406 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:34.266470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2db42b5-2b46-49af-b29a-00e16894f406 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:34.267327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2db42b5-2b46-49af-b29a-00e16894f406 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:34.408375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bc676b80-b80d-49e3-93fd-9f4e95bf1f49 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:34.418322 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bc676b80-b80d-49e3-93fd-9f4e95bf1f49 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1523 microversion: 2.1 time: 0.221010 Aug 29 15:45:34.418928 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2386/4657] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:34 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:34.489811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b2db42b5-2b46-49af-b29a-00e16894f406 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:34.499006 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b2db42b5-2b46-49af-b29a-00e16894f406 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.250331 Aug 29 15:45:34.499849 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2272/4658] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:34 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:34.672183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-27907894-7fc6-4836-ab5c-182be53ebfe9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:34.672825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-27907894-7fc6-4836-ab5c-182be53ebfe9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:34.680868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27907894-7fc6-4836-ab5c-182be53ebfe9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:34.681633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27907894-7fc6-4836-ab5c-182be53ebfe9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:34.682144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27907894-7fc6-4836-ab5c-182be53ebfe9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:34.682936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27907894-7fc6-4836-ab5c-182be53ebfe9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:34.683453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27907894-7fc6-4836-ab5c-182be53ebfe9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:34.683949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27907894-7fc6-4836-ab5c-182be53ebfe9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:34.923469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-27907894-7fc6-4836-ab5c-182be53ebfe9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:34.931740 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-27907894-7fc6-4836-ab5c-182be53ebfe9 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1656 microversion: 2.1 time: 0.264049 Aug 29 15:45:34.946129 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2387/4659] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:34 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1656 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:34.955071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0a2312ca-91bc-4951-82ba-173be4775bf3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:34.962281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a2312ca-91bc-4951-82ba-173be4775bf3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:34.963028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a2312ca-91bc-4951-82ba-173be4775bf3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:34.963690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a2312ca-91bc-4951-82ba-173be4775bf3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:34.976586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-239ed4a8-7138-4e68-a0aa-b306ef710a4e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:34.977291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-239ed4a8-7138-4e68-a0aa-b306ef710a4e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:35.001772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-239ed4a8-7138-4e68-a0aa-b306ef710a4e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.002324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-239ed4a8-7138-4e68-a0aa-b306ef710a4e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.003104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-239ed4a8-7138-4e68-a0aa-b306ef710a4e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.004361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-239ed4a8-7138-4e68-a0aa-b306ef710a4e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.005029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-239ed4a8-7138-4e68-a0aa-b306ef710a4e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.005841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-239ed4a8-7138-4e68-a0aa-b306ef710a4e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.048352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0a2312ca-91bc-4951-82ba-173be4775bf3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Going to try to start instance {{(pid=122361) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 15:45:35.175322 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0a2312ca-91bc-4951-82ba-173be4775bf3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 202 len: 0 microversion: 2.1 time: 0.223438 Aug 29 15:45:35.188927 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2273/4660] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:34 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:35.199811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8452ca55-6e63-4d4a-8bec-3bcbb218e138 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:35.200598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8452ca55-6e63-4d4a-8bec-3bcbb218e138 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:35.207766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8452ca55-6e63-4d4a-8bec-3bcbb218e138 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.208931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8452ca55-6e63-4d4a-8bec-3bcbb218e138 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.209645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8452ca55-6e63-4d4a-8bec-3bcbb218e138 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.210536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8452ca55-6e63-4d4a-8bec-3bcbb218e138 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.211156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8452ca55-6e63-4d4a-8bec-3bcbb218e138 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.211835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8452ca55-6e63-4d4a-8bec-3bcbb218e138 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.326293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-239ed4a8-7138-4e68-a0aa-b306ef710a4e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:35.348435 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-239ed4a8-7138-4e68-a0aa-b306ef710a4e tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1506 microversion: 2.1 time: 0.377056 Aug 29 15:45:35.353254 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2388/4661] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:34 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:35.369325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4de838e8-55de-46ec-9199-9cf65b2174c6 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:35.370041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4de838e8-55de-46ec-9199-9cf65b2174c6 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:35.377742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4de838e8-55de-46ec-9199-9cf65b2174c6 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.378321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4de838e8-55de-46ec-9199-9cf65b2174c6 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.379783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4de838e8-55de-46ec-9199-9cf65b2174c6 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.380726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4de838e8-55de-46ec-9199-9cf65b2174c6 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.381541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4de838e8-55de-46ec-9199-9cf65b2174c6 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.382257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4de838e8-55de-46ec-9199-9cf65b2174c6 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.532150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4de838e8-55de-46ec-9199-9cf65b2174c6 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:35.541393 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4de838e8-55de-46ec-9199-9cf65b2174c6 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1315 microversion: 2.1 time: 0.186762 Aug 29 15:45:35.542169 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2389/4662] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:35 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:35.548281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0efc5967-613b-4637-b8e1-f9efd00f94ed tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:35.549119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0efc5967-613b-4637-b8e1-f9efd00f94ed tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:35.556311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0efc5967-613b-4637-b8e1-f9efd00f94ed tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.557197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0efc5967-613b-4637-b8e1-f9efd00f94ed tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.557864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0efc5967-613b-4637-b8e1-f9efd00f94ed tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.558773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0efc5967-613b-4637-b8e1-f9efd00f94ed tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.559456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0efc5967-613b-4637-b8e1-f9efd00f94ed tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.560128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0efc5967-613b-4637-b8e1-f9efd00f94ed tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.716926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0efc5967-613b-4637-b8e1-f9efd00f94ed tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:35.725933 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0efc5967-613b-4637-b8e1-f9efd00f94ed tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1503 microversion: 2.1 time: 0.182456 Aug 29 15:45:35.726797 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2390/4663] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:35 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:35.733986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d0206d63-ec32-4de2-a7e4-d103242a53ec tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:35.735038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d0206d63-ec32-4de2-a7e4-d103242a53ec tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:35.745757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0206d63-ec32-4de2-a7e4-d103242a53ec tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.746583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0206d63-ec32-4de2-a7e4-d103242a53ec tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.747045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0206d63-ec32-4de2-a7e4-d103242a53ec tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.747796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0206d63-ec32-4de2-a7e4-d103242a53ec tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.748409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0206d63-ec32-4de2-a7e4-d103242a53ec tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.748855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d0206d63-ec32-4de2-a7e4-d103242a53ec tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.825556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8452ca55-6e63-4d4a-8bec-3bcbb218e138 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:35.845847 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8452ca55-6e63-4d4a-8bec-3bcbb218e138 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1665 microversion: 2.1 time: 0.646609 Aug 29 15:45:35.846070 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2274/4664] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:35 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1665 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:35.859220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fe5255ea-5c8d-405f-a633-11721dd7534d tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Action: 'create', calling method: .version_select at 0x7fc42a58ae50>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1520536578", "description": "tempest-description-1382615675"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:35.959507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d0206d63-ec32-4de2-a7e4-d103242a53ec tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:35.972897 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d0206d63-ec32-4de2-a7e4-d103242a53ec tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.244786 Aug 29 15:45:35.987718 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2391/4665] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:35 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:36.178678 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fe5255ea-5c8d-405f-a633-11721dd7534d tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.329283 Aug 29 15:45:36.180011 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2275/4666] 10.222.0.62 () {60 vars in 1180 bytes} [Mon Aug 29 15:45:35 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:36.196450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ae33e7e2-0df7-4901-99fb-b1acd4a1d1b7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1520536578"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:36.203103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ae33e7e2-0df7-4901-99fb-b1acd4a1d1b7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:36.210170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae33e7e2-0df7-4901-99fb-b1acd4a1d1b7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.210816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae33e7e2-0df7-4901-99fb-b1acd4a1d1b7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.211390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae33e7e2-0df7-4901-99fb-b1acd4a1d1b7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.212108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae33e7e2-0df7-4901-99fb-b1acd4a1d1b7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.212565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae33e7e2-0df7-4901-99fb-b1acd4a1d1b7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.212995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae33e7e2-0df7-4901-99fb-b1acd4a1d1b7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.354275 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.network.security_group_api [None req-ae33e7e2-0df7-4901-99fb-b1acd4a1d1b7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Adding security group 37e33f07-866a-4502-a0bb-c05f1f840cea to port 9dad9642-2fa5-4f48-9928-cc4aebbe2498 Aug 29 15:45:36.374885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f8318db7-4d00-4fae-a876-918b96ed5447 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:36.375857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f8318db7-4d00-4fae-a876-918b96ed5447 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:36.383044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8318db7-4d00-4fae-a876-918b96ed5447 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.383875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8318db7-4d00-4fae-a876-918b96ed5447 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.384529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8318db7-4d00-4fae-a876-918b96ed5447 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.385327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8318db7-4d00-4fae-a876-918b96ed5447 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.386007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8318db7-4d00-4fae-a876-918b96ed5447 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.386633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8318db7-4d00-4fae-a876-918b96ed5447 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.589647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f8318db7-4d00-4fae-a876-918b96ed5447 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:36.606215 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f8318db7-4d00-4fae-a876-918b96ed5447 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1501 microversion: 2.1 time: 0.236694 Aug 29 15:45:36.607661 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2276/4667] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:36 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1501 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:36.638284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d9bf1b61-76c7-45d8-bc43-d84e31308dd9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:36.639711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d9bf1b61-76c7-45d8-bc43-d84e31308dd9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:36.685747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9bf1b61-76c7-45d8-bc43-d84e31308dd9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.687121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9bf1b61-76c7-45d8-bc43-d84e31308dd9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.687689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9bf1b61-76c7-45d8-bc43-d84e31308dd9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.688534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9bf1b61-76c7-45d8-bc43-d84e31308dd9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.689023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9bf1b61-76c7-45d8-bc43-d84e31308dd9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.689532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9bf1b61-76c7-45d8-bc43-d84e31308dd9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.829783 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ae33e7e2-0df7-4901-99fb-b1acd4a1d1b7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "POST /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c/action" status: 202 len: 0 microversion: 2.1 time: 0.641080 Aug 29 15:45:36.834455 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2392/4668] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:36 2022] POST /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c/action => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:36.842351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-032112ed-7a18-4c94-a6cf-7dead4937806 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1520536578"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:36.843906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-032112ed-7a18-4c94-a6cf-7dead4937806 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:36.851570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-032112ed-7a18-4c94-a6cf-7dead4937806 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.852706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-032112ed-7a18-4c94-a6cf-7dead4937806 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.853524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-032112ed-7a18-4c94-a6cf-7dead4937806 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.854497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-032112ed-7a18-4c94-a6cf-7dead4937806 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.855061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-032112ed-7a18-4c94-a6cf-7dead4937806 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.855651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-032112ed-7a18-4c94-a6cf-7dead4937806 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.950228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d9bf1b61-76c7-45d8-bc43-d84e31308dd9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:36.967737 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d9bf1b61-76c7-45d8-bc43-d84e31308dd9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1315 microversion: 2.1 time: 0.358761 Aug 29 15:45:36.976289 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2277/4669] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:36 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:36.998783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-e52f8f96-8acd-488d-ac86-0a7a187f531f req-ed16bf1c-e95f-4334-b13e-39bed78cc6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb6aed9-8901-4e68-8a40-21dc9e2f690c", "tag": "9dad9642-2fa5-4f48-9928-cc4aebbe2498"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:37.015128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e52f8f96-8acd-488d-ac86-0a7a187f531f req-ed16bf1c-e95f-4334-b13e-39bed78cc6d0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.016294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e52f8f96-8acd-488d-ac86-0a7a187f531f req-ed16bf1c-e95f-4334-b13e-39bed78cc6d0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.016964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e52f8f96-8acd-488d-ac86-0a7a187f531f req-ed16bf1c-e95f-4334-b13e-39bed78cc6d0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.033163 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-e52f8f96-8acd-488d-ac86-0a7a187f531f req-ed16bf1c-e95f-4334-b13e-39bed78cc6d0 service nova] Creating event network-changed:9dad9642-2fa5-4f48-9928-cc4aebbe2498 for instance 4cb6aed9-8901-4e68-8a40-21dc9e2f690c on n-h1-839401-11 Aug 29 15:45:37.038547 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-e52f8f96-8acd-488d-ac86-0a7a187f531f req-ed16bf1c-e95f-4334-b13e-39bed78cc6d0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048241 Aug 29 15:45:37.039407 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2278/4670] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:37.044791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2a40d369-d37d-4b47-98ea-8b8f3f09bc66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:37.045502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2a40d369-d37d-4b47-98ea-8b8f3f09bc66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:37.052102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a40d369-d37d-4b47-98ea-8b8f3f09bc66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.052585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a40d369-d37d-4b47-98ea-8b8f3f09bc66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.053015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a40d369-d37d-4b47-98ea-8b8f3f09bc66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.054023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a40d369-d37d-4b47-98ea-8b8f3f09bc66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.054543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a40d369-d37d-4b47-98ea-8b8f3f09bc66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.055156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a40d369-d37d-4b47-98ea-8b8f3f09bc66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.080046 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.network.security_group_api [None req-032112ed-7a18-4c94-a6cf-7dead4937806 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Removing security group 37e33f07-866a-4502-a0bb-c05f1f840cea from port 9dad9642-2fa5-4f48-9928-cc4aebbe2498 Aug 29 15:45:37.229615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2a40d369-d37d-4b47-98ea-8b8f3f09bc66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:37.240433 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2a40d369-d37d-4b47-98ea-8b8f3f09bc66 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1665 microversion: 2.1 time: 0.199480 Aug 29 15:45:37.241954 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2279/4671] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:37 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1665 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:37.247877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cffb0e18-8905-44a5-b876-ed265fdc0c74 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:37.248793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cffb0e18-8905-44a5-b876-ed265fdc0c74 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:37.256623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffb0e18-8905-44a5-b876-ed265fdc0c74 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.257625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffb0e18-8905-44a5-b876-ed265fdc0c74 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.258458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffb0e18-8905-44a5-b876-ed265fdc0c74 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.259528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffb0e18-8905-44a5-b876-ed265fdc0c74 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.260210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffb0e18-8905-44a5-b876-ed265fdc0c74 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.260888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffb0e18-8905-44a5-b876-ed265fdc0c74 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.490000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cffb0e18-8905-44a5-b876-ed265fdc0c74 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:37.500034 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cffb0e18-8905-44a5-b876-ed265fdc0c74 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.256553 Aug 29 15:45:37.501222 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2280/4672] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:37 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:37.628941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aa3fb0fd-7827-4f47-a625-239926d69d5a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:37.629593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aa3fb0fd-7827-4f47-a625-239926d69d5a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:37.638770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa3fb0fd-7827-4f47-a625-239926d69d5a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.639264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa3fb0fd-7827-4f47-a625-239926d69d5a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.639703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa3fb0fd-7827-4f47-a625-239926d69d5a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.640433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa3fb0fd-7827-4f47-a625-239926d69d5a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.640890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa3fb0fd-7827-4f47-a625-239926d69d5a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.641344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa3fb0fd-7827-4f47-a625-239926d69d5a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.794837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aa3fb0fd-7827-4f47-a625-239926d69d5a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:37.803880 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aa3fb0fd-7827-4f47-a625-239926d69d5a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1488 microversion: 2.1 time: 0.179016 Aug 29 15:45:37.809136 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2281/4673] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:37 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1488 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:37.829730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5d09a3df-1509-4815-9c10-b19e2e706434 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:37.830293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5d09a3df-1509-4815-9c10-b19e2e706434 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:37.845260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d09a3df-1509-4815-9c10-b19e2e706434 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.845260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d09a3df-1509-4815-9c10-b19e2e706434 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.845260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d09a3df-1509-4815-9c10-b19e2e706434 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.845260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d09a3df-1509-4815-9c10-b19e2e706434 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.845260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d09a3df-1509-4815-9c10-b19e2e706434 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.845260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d09a3df-1509-4815-9c10-b19e2e706434 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.852341 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-032112ed-7a18-4c94-a6cf-7dead4937806 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "POST /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c/action" status: 202 len: 0 microversion: 2.1 time: 1.017122 Aug 29 15:45:37.853548 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2393/4674] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:36 2022] POST /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c/action => generated 0 bytes in 1019 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:37.863910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b8706e61-4f72-476a-932d-3e6ae5118fe6 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Action: 'create', calling method: .version_select at 0x7fc433b6ce50>, body: {"pool": null} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:37.881982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5d09a3df-1509-4815-9c10-b19e2e706434 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:38.045113 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5d09a3df-1509-4815-9c10-b19e2e706434 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "DELETE /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 204 len: 0 microversion: 2.1 time: 0.219262 Aug 29 15:45:38.046631 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2282/4675] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:37 2022] DELETE /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:45:38.055728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1f7204cb-46de-4371-89c7-30fd2ea9dcf1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:38.058079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1f7204cb-46de-4371-89c7-30fd2ea9dcf1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:38.066883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f7204cb-46de-4371-89c7-30fd2ea9dcf1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:38.068617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f7204cb-46de-4371-89c7-30fd2ea9dcf1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.069474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f7204cb-46de-4371-89c7-30fd2ea9dcf1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.071008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f7204cb-46de-4371-89c7-30fd2ea9dcf1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:38.071833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f7204cb-46de-4371-89c7-30fd2ea9dcf1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.072473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f7204cb-46de-4371-89c7-30fd2ea9dcf1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.145808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:38.340464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1f7204cb-46de-4371-89c7-30fd2ea9dcf1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:38.357982 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1f7204cb-46de-4371-89c7-30fd2ea9dcf1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1315 microversion: 2.1 time: 0.308867 Aug 29 15:45:38.358580 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2283/4676] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:38 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:38.391253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e4f34524-82b9-457b-a137-dd617fe2716a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42aa971f0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:38.436552 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-e4f34524-82b9-457b-a137-dd617fe2716a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] HTTP exception thrown: Image not found. Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e4f34524-82b9-457b-a137-dd617fe2716a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Request method failure captured: Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/images/b79b6796-86d1-4d95-b236-623bc2fcb9a2 HTTP/1.1 Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN4lGjWuBtP7IMH8HSwk8IArAW2Un5TRnhuxsWrM673TJoSMK_36MEx-0fGUi2H0QEZHaMoPWKZQoTLRYuljaJekjHyJMy7MOQAjg3gAnm3ahDfQDf2YzCRY-_mF_ajbSnqzHiKL4fgX0md_3rXTolDzVII-XHo4hByRxDyQdobEoY8 Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ad019754b47441d5a286666f8a048b48", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ad019754b47441d5a286666f8a048b48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}] Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 71ae9af4779a4d50b9171ff9ca8b5207 Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: exception: Image not found. Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'b79b6796-86d1-4d95-b236-623bc2fcb9a2'} Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b79b6796-86d1-4d95-b236-623bc2fcb9a2 to delete Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b79b6796-86d1-4d95-b236-623bc2fcb9a2 could not be found. Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:38.438478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e4f34524-82b9-457b-a137-dd617fe2716a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Returning 404 to user: Image not found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:38.442423 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e4f34524-82b9-457b-a137-dd617fe2716a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "DELETE /compute/v2.1/images/b79b6796-86d1-4d95-b236-623bc2fcb9a2" status: 404 len: 62 microversion: 2.1 time: 0.080405 Aug 29 15:45:38.444333 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2284/4677] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:38 2022] DELETE /compute/v2.1/images/b79b6796-86d1-4d95-b236-623bc2fcb9a2 => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:45:38.462213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5c64b39a-c4f9-4b07-b0f8-25284afa6446 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:38.462896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5c64b39a-c4f9-4b07-b0f8-25284afa6446 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:38.470957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c64b39a-c4f9-4b07-b0f8-25284afa6446 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:38.471475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c64b39a-c4f9-4b07-b0f8-25284afa6446 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.471913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c64b39a-c4f9-4b07-b0f8-25284afa6446 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.472690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c64b39a-c4f9-4b07-b0f8-25284afa6446 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:38.473182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c64b39a-c4f9-4b07-b0f8-25284afa6446 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.473633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c64b39a-c4f9-4b07-b0f8-25284afa6446 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.692329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5c64b39a-c4f9-4b07-b0f8-25284afa6446 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:38.702692 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5c64b39a-c4f9-4b07-b0f8-25284afa6446 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.256794 Aug 29 15:45:38.702962 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2285/4678] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:38 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:38.707961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-6689dd1e-3770-4370-a333-e0d8fb63774f req-f51951e3-add9-4f1d-8b70-be63bcdd7263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd640d6c-9838-43b8-b1ab-d38a1b38b757", "name": "network-vif-plugged", "status": "completed", "tag": "4db4c016-f20a-4d1c-a933-0c7dc37021b4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:38.718915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6689dd1e-3770-4370-a333-e0d8fb63774f req-f51951e3-add9-4f1d-8b70-be63bcdd7263 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:38.719410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6689dd1e-3770-4370-a333-e0d8fb63774f req-f51951e3-add9-4f1d-8b70-be63bcdd7263 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.719883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6689dd1e-3770-4370-a333-e0d8fb63774f req-f51951e3-add9-4f1d-8b70-be63bcdd7263 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.736583 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-6689dd1e-3770-4370-a333-e0d8fb63774f req-f51951e3-add9-4f1d-8b70-be63bcdd7263 service nova] Creating event network-vif-plugged:4db4c016-f20a-4d1c-a933-0c7dc37021b4 for instance cd640d6c-9838-43b8-b1ab-d38a1b38b757 on n-h2-839401-11 Aug 29 15:45:38.743644 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-6689dd1e-3770-4370-a333-e0d8fb63774f req-f51951e3-add9-4f1d-8b70-be63bcdd7263 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039438 Aug 29 15:45:38.744844 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2286/4679] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:38.750432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-34133f14-beb2-4820-9630-0522472529db tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:38.751036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-34133f14-beb2-4820-9630-0522472529db tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:38.758926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34133f14-beb2-4820-9630-0522472529db tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:38.759434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34133f14-beb2-4820-9630-0522472529db tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.759892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34133f14-beb2-4820-9630-0522472529db tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.760599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34133f14-beb2-4820-9630-0522472529db tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:38.761054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34133f14-beb2-4820-9630-0522472529db tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.761562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34133f14-beb2-4820-9630-0522472529db tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.791355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-34133f14-beb2-4820-9630-0522472529db tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:38.874859 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.compute.api [None req-34133f14-beb2-4820-9630-0522472529db tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Instance is already in deleting state, ignoring this request Aug 29 15:45:38.875805 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-34133f14-beb2-4820-9630-0522472529db tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "DELETE /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 204 len: 0 microversion: 2.1 time: 0.130075 Aug 29 15:45:38.876792 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2287/4680] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:38 2022] DELETE /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:45:38.881958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ad4e164e-4100-4e52-8662-7cdf2809df15 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:38.882623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ad4e164e-4100-4e52-8662-7cdf2809df15 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:38.890462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad4e164e-4100-4e52-8662-7cdf2809df15 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:38.890999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad4e164e-4100-4e52-8662-7cdf2809df15 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.891443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad4e164e-4100-4e52-8662-7cdf2809df15 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.892462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad4e164e-4100-4e52-8662-7cdf2809df15 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:38.892790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad4e164e-4100-4e52-8662-7cdf2809df15 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.893250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad4e164e-4100-4e52-8662-7cdf2809df15 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.080007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ad4e164e-4100-4e52-8662-7cdf2809df15 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.094056 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ad4e164e-4100-4e52-8662-7cdf2809df15 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.215984 Aug 29 15:45:39.095204 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2288/4681] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:38 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:39.101283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e1804493-07db-4ce6-a8e4-e53fc17a96d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:39.102046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e1804493-07db-4ce6-a8e4-e53fc17a96d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:39.109703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1804493-07db-4ce6-a8e4-e53fc17a96d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.110199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1804493-07db-4ce6-a8e4-e53fc17a96d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.110814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1804493-07db-4ce6-a8e4-e53fc17a96d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.111559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1804493-07db-4ce6-a8e4-e53fc17a96d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.112216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1804493-07db-4ce6-a8e4-e53fc17a96d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.112640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1804493-07db-4ce6-a8e4-e53fc17a96d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.271592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e1804493-07db-4ce6-a8e4-e53fc17a96d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.281320 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e1804493-07db-4ce6-a8e4-e53fc17a96d3 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.184932 Aug 29 15:45:39.282204 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2289/4682] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:39 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:39.287811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-12ac6ca1-f5b1-4d67-aaeb-fa2b90991606 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:39.288454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-12ac6ca1-f5b1-4d67-aaeb-fa2b90991606 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:39.295011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12ac6ca1-f5b1-4d67-aaeb-fa2b90991606 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.295510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12ac6ca1-f5b1-4d67-aaeb-fa2b90991606 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.295948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12ac6ca1-f5b1-4d67-aaeb-fa2b90991606 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.296673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12ac6ca1-f5b1-4d67-aaeb-fa2b90991606 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.297359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12ac6ca1-f5b1-4d67-aaeb-fa2b90991606 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.297805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12ac6ca1-f5b1-4d67-aaeb-fa2b90991606 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.458348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-12ac6ca1-f5b1-4d67-aaeb-fa2b90991606 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.486887 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-12ac6ca1-f5b1-4d67-aaeb-fa2b90991606 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1494 microversion: 2.1 time: 0.202916 Aug 29 15:45:39.489189 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2290/4683] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:39 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1494 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:39.507762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-1e7600e4-1a16-4664-8078-63c067f6ab56 req-4da2df78-a00c-45ff-9c94-fb71000abda5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb6aed9-8901-4e68-8a40-21dc9e2f690c", "tag": "9dad9642-2fa5-4f48-9928-cc4aebbe2498"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:39.521892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1e7600e4-1a16-4664-8078-63c067f6ab56 req-4da2df78-a00c-45ff-9c94-fb71000abda5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.524115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1e7600e4-1a16-4664-8078-63c067f6ab56 req-4da2df78-a00c-45ff-9c94-fb71000abda5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.524719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1e7600e4-1a16-4664-8078-63c067f6ab56 req-4da2df78-a00c-45ff-9c94-fb71000abda5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.551302 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-1e7600e4-1a16-4664-8078-63c067f6ab56 req-4da2df78-a00c-45ff-9c94-fb71000abda5 service nova] Creating event network-changed:9dad9642-2fa5-4f48-9928-cc4aebbe2498 for instance 4cb6aed9-8901-4e68-8a40-21dc9e2f690c on n-h1-839401-11 Aug 29 15:45:39.562547 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-1e7600e4-1a16-4664-8078-63c067f6ab56 req-4da2df78-a00c-45ff-9c94-fb71000abda5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063622 Aug 29 15:45:39.564669 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2291/4684] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:39.571229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a7316969-e10d-4af1-bfcb-27ddd79ed8cc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:39.571990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a7316969-e10d-4af1-bfcb-27ddd79ed8cc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:39.579418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7316969-e10d-4af1-bfcb-27ddd79ed8cc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.580022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7316969-e10d-4af1-bfcb-27ddd79ed8cc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.580469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7316969-e10d-4af1-bfcb-27ddd79ed8cc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.581261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7316969-e10d-4af1-bfcb-27ddd79ed8cc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.581726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7316969-e10d-4af1-bfcb-27ddd79ed8cc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.582351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7316969-e10d-4af1-bfcb-27ddd79ed8cc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.718768 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b8706e61-4f72-476a-932d-3e6ae5118fe6 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.858539 Aug 29 15:45:39.728198 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2394/4685] 10.222.0.62 () {60 vars in 1170 bytes} [Mon Aug 29 15:45:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:39.734669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-275e3ada-6a7d-4c9f-b77f-072576586a14 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:39.735290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-275e3ada-6a7d-4c9f-b77f-072576586a14 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:39.743554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-275e3ada-6a7d-4c9f-b77f-072576586a14 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.744370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-275e3ada-6a7d-4c9f-b77f-072576586a14 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.745154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-275e3ada-6a7d-4c9f-b77f-072576586a14 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.745624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-275e3ada-6a7d-4c9f-b77f-072576586a14 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.746132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-275e3ada-6a7d-4c9f-b77f-072576586a14 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.746564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-275e3ada-6a7d-4c9f-b77f-072576586a14 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.760992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a7316969-e10d-4af1-bfcb-27ddd79ed8cc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.772537 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a7316969-e10d-4af1-bfcb-27ddd79ed8cc tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.204254 Aug 29 15:45:39.777392 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2292/4686] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:39 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:39.785839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-44640617-860b-42e9-b4ec-12df70677b19 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.220"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:39.791788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-44640617-860b-42e9-b4ec-12df70677b19 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:39.804226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44640617-860b-42e9-b4ec-12df70677b19 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.804713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44640617-860b-42e9-b4ec-12df70677b19 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.805173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44640617-860b-42e9-b4ec-12df70677b19 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.809463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44640617-860b-42e9-b4ec-12df70677b19 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.810376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44640617-860b-42e9-b4ec-12df70677b19 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.810852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44640617-860b-42e9-b4ec-12df70677b19 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.852628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44640617-860b-42e9-b4ec-12df70677b19 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "refresh_cache-4cb6aed9-8901-4e68-8a40-21dc9e2f690c" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:45:39.852841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44640617-860b-42e9-b4ec-12df70677b19 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquired lock "refresh_cache-4cb6aed9-8901-4e68-8a40-21dc9e2f690c" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:45:40.008513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-275e3ada-6a7d-4c9f-b77f-072576586a14 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:40.017851 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-275e3ada-6a7d-4c9f-b77f-072576586a14 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1315 microversion: 2.1 time: 0.287977 Aug 29 15:45:40.019096 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2395/4687] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:39 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:40.024233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2204223c-b01f-4c40-b601-6b8cbd90e7c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:40.025143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2204223c-b01f-4c40-b601-6b8cbd90e7c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:40.033795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2204223c-b01f-4c40-b601-6b8cbd90e7c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.034284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2204223c-b01f-4c40-b601-6b8cbd90e7c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.034717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2204223c-b01f-4c40-b601-6b8cbd90e7c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:40.035451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2204223c-b01f-4c40-b601-6b8cbd90e7c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.035907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2204223c-b01f-4c40-b601-6b8cbd90e7c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.036330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2204223c-b01f-4c40-b601-6b8cbd90e7c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:40.294108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2204223c-b01f-4c40-b601-6b8cbd90e7c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:40.300655 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2204223c-b01f-4c40-b601-6b8cbd90e7c1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.280076 Aug 29 15:45:40.312221 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2396/4688] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:40 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:40.326221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-af7535ea-42a3-4edb-bd4f-d266b9a4d73c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:40.327438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-af7535ea-42a3-4edb-bd4f-d266b9a4d73c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:40.336246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af7535ea-42a3-4edb-bd4f-d266b9a4d73c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.337183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af7535ea-42a3-4edb-bd4f-d266b9a4d73c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.337836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af7535ea-42a3-4edb-bd4f-d266b9a4d73c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:40.338822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af7535ea-42a3-4edb-bd4f-d266b9a4d73c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.339489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af7535ea-42a3-4edb-bd4f-d266b9a4d73c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.340140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af7535ea-42a3-4edb-bd4f-d266b9a4d73c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:40.542925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-af7535ea-42a3-4edb-bd4f-d266b9a4d73c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:40.553379 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-af7535ea-42a3-4edb-bd4f-d266b9a4d73c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.239433 Aug 29 15:45:40.553989 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2397/4689] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:40 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:40.559496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-686d947b-3c95-4f7e-975d-791e910ba126 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:40.560304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-686d947b-3c95-4f7e-975d-791e910ba126 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:40.569170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-686d947b-3c95-4f7e-975d-791e910ba126 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.570194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-686d947b-3c95-4f7e-975d-791e910ba126 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.570788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-686d947b-3c95-4f7e-975d-791e910ba126 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:40.571560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-686d947b-3c95-4f7e-975d-791e910ba126 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.572171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-686d947b-3c95-4f7e-975d-791e910ba126 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.572604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-686d947b-3c95-4f7e-975d-791e910ba126 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:40.733361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-686d947b-3c95-4f7e-975d-791e910ba126 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:40.742547 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-686d947b-3c95-4f7e-975d-791e910ba126 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.186919 Aug 29 15:45:40.743482 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2398/4690] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:40 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:40.759664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-799f4029-b269-455c-9ac5-cda9eba18c3b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:40.760781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-799f4029-b269-455c-9ac5-cda9eba18c3b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:40.767933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-799f4029-b269-455c-9ac5-cda9eba18c3b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.769007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-799f4029-b269-455c-9ac5-cda9eba18c3b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.769183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-799f4029-b269-455c-9ac5-cda9eba18c3b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:40.770312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-799f4029-b269-455c-9ac5-cda9eba18c3b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.770854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-799f4029-b269-455c-9ac5-cda9eba18c3b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.771705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-799f4029-b269-455c-9ac5-cda9eba18c3b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:40.940354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-799f4029-b269-455c-9ac5-cda9eba18c3b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:40.949594 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-799f4029-b269-455c-9ac5-cda9eba18c3b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1494 microversion: 2.1 time: 0.194363 Aug 29 15:45:40.950438 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2399/4691] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:40 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1494 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:40.965484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b6c410de-3765-4223-b0e5-697c248c9278 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:40.966540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b6c410de-3765-4223-b0e5-697c248c9278 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:40.970392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:40.975751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6c410de-3765-4223-b0e5-697c248c9278 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.976814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6c410de-3765-4223-b0e5-697c248c9278 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.978367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6c410de-3765-4223-b0e5-697c248c9278 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:40.979337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6c410de-3765-4223-b0e5-697c248c9278 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.980245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6c410de-3765-4223-b0e5-697c248c9278 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.980882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6c410de-3765-4223-b0e5-697c248c9278 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:41.009489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-b6c410de-3765-4223-b0e5-697c248c9278 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lazy-loading 'flavor' on Instance uuid 2af95f7c-5362-4cf9-b80e-38cd6a518783 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:41.043867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:41.104744 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b6c410de-3765-4223-b0e5-697c248c9278 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 202 len: 0 microversion: 2.1 time: 0.146138 Aug 29 15:45:41.105484 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2400/4692] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:40 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:41.110864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65cbacec-aa1e-47fa-9eb2-9ee98201efb7 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:41.111744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-65cbacec-aa1e-47fa-9eb2-9ee98201efb7 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:41.118753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65cbacec-aa1e-47fa-9eb2-9ee98201efb7 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:41.119486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65cbacec-aa1e-47fa-9eb2-9ee98201efb7 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:41.120180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65cbacec-aa1e-47fa-9eb2-9ee98201efb7 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:41.120813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65cbacec-aa1e-47fa-9eb2-9ee98201efb7 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:41.121457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65cbacec-aa1e-47fa-9eb2-9ee98201efb7 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:41.122044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65cbacec-aa1e-47fa-9eb2-9ee98201efb7 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:41.301068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-44640617-860b-42e9-b4ec-12df70677b19 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Building network info cache for instance {{(pid=122361) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:45:41.317412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-65cbacec-aa1e-47fa-9eb2-9ee98201efb7 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:41.328167 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-65cbacec-aa1e-47fa-9eb2-9ee98201efb7 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1315 microversion: 2.1 time: 0.219232 Aug 29 15:45:41.328806 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2401/4693] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:41 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:41.333864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6eaeb1b8-b6fa-45bc-be7e-8ac6befd2495 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:41.334711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6eaeb1b8-b6fa-45bc-be7e-8ac6befd2495 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:41.346524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eaeb1b8-b6fa-45bc-be7e-8ac6befd2495 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:41.347580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eaeb1b8-b6fa-45bc-be7e-8ac6befd2495 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:41.348306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eaeb1b8-b6fa-45bc-be7e-8ac6befd2495 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:41.349189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eaeb1b8-b6fa-45bc-be7e-8ac6befd2495 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:41.349794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eaeb1b8-b6fa-45bc-be7e-8ac6befd2495 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:41.350411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eaeb1b8-b6fa-45bc-be7e-8ac6befd2495 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:41.558669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6eaeb1b8-b6fa-45bc-be7e-8ac6befd2495 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:41.573009 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6eaeb1b8-b6fa-45bc-be7e-8ac6befd2495 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1677 microversion: 2.1 time: 0.242914 Aug 29 15:45:41.574037 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2402/4694] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:41 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1677 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:41.718777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-7730633d-b153-4df6-ab21-241e3a40081e req-f4de216a-9550-474a-9805-6712f0d31425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb6aed9-8901-4e68-8a40-21dc9e2f690c", "tag": "9dad9642-2fa5-4f48-9928-cc4aebbe2498"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:41.770624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7730633d-b153-4df6-ab21-241e3a40081e req-f4de216a-9550-474a-9805-6712f0d31425 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:41.776104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7730633d-b153-4df6-ab21-241e3a40081e req-f4de216a-9550-474a-9805-6712f0d31425 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:41.790581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7730633d-b153-4df6-ab21-241e3a40081e req-f4de216a-9550-474a-9805-6712f0d31425 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:41.818179 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-7730633d-b153-4df6-ab21-241e3a40081e req-f4de216a-9550-474a-9805-6712f0d31425 service nova] Creating event network-changed:9dad9642-2fa5-4f48-9928-cc4aebbe2498 for instance 4cb6aed9-8901-4e68-8a40-21dc9e2f690c on n-h1-839401-11 Aug 29 15:45:41.831145 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-7730633d-b153-4df6-ab21-241e3a40081e req-f4de216a-9550-474a-9805-6712f0d31425 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255738 Aug 29 15:45:41.837939 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2403/4695] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:41.892592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-75424914-9ea3-416f-8f7c-6685b8c709c6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:41.897164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-75424914-9ea3-416f-8f7c-6685b8c709c6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:41.923403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75424914-9ea3-416f-8f7c-6685b8c709c6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:41.930481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75424914-9ea3-416f-8f7c-6685b8c709c6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:41.931068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75424914-9ea3-416f-8f7c-6685b8c709c6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:41.934088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75424914-9ea3-416f-8f7c-6685b8c709c6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:41.935320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75424914-9ea3-416f-8f7c-6685b8c709c6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:41.935320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75424914-9ea3-416f-8f7c-6685b8c709c6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.360882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-75424914-9ea3-416f-8f7c-6685b8c709c6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:42.396865 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-75424914-9ea3-416f-8f7c-6685b8c709c6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.548596 Aug 29 15:45:42.402473 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2404/4696] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:41 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:42.421056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eabe40a1-5079-4e0f-9827-081ad034e1da tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:42.423773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eabe40a1-5079-4e0f-9827-081ad034e1da tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:42.451413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eabe40a1-5079-4e0f-9827-081ad034e1da tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.453972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eabe40a1-5079-4e0f-9827-081ad034e1da tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.454537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eabe40a1-5079-4e0f-9827-081ad034e1da tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.455541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eabe40a1-5079-4e0f-9827-081ad034e1da tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.456433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eabe40a1-5079-4e0f-9827-081ad034e1da tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.459215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eabe40a1-5079-4e0f-9827-081ad034e1da tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.469977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-44640617-860b-42e9-b4ec-12df70677b19 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Updating instance_info_cache with network_info: [{"id": "9dad9642-2fa5-4f48-9928-cc4aebbe2498", "address": "fa:16:3e:f8:f7:73", "network": {"id": "483f7ce2-772f-4261-94f5-2fcba159cdb8", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1247782711-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "601b0333e91644768c5f6d7f4f717108", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9dad9642-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122361) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:45:42.488469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44640617-860b-42e9-b4ec-12df70677b19 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Releasing lock "refresh_cache-4cb6aed9-8901-4e68-8a40-21dc9e2f690c" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:45:42.493363 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-44640617-860b-42e9-b4ec-12df70677b19 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "POST /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c/action" status: 202 len: 0 microversion: 2.1 time: 2.713784 Aug 29 15:45:42.498023 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2293/4697] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:39 2022] POST /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c/action => generated 0 bytes in 2721 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:45:42.512959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d2a08695-a793-4bdc-ad3b-92d89b20f2b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:42.513819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d2a08695-a793-4bdc-ad3b-92d89b20f2b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:42.519737 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eabe40a1-5079-4e0f-9827-081ad034e1da tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.113190 Aug 29 15:45:42.520347 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2405/4698] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:45:42 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments => generated 371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:42.533416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2a08695-a793-4bdc-ad3b-92d89b20f2b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.534449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2a08695-a793-4bdc-ad3b-92d89b20f2b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.537166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2a08695-a793-4bdc-ad3b-92d89b20f2b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.538200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2a08695-a793-4bdc-ad3b-92d89b20f2b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.539061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2a08695-a793-4bdc-ad3b-92d89b20f2b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.540840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2a08695-a793-4bdc-ad3b-92d89b20f2b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.542453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-288d463a-c2aa-42b1-a1f4-7d254350fdff req-bbf93394-a914-4647-8b1f-47dbc19fbab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc51544d-3049-416e-a24a-7ff7d4c7f9bb", "name": "network-vif-unplugged", "status": "completed", "tag": "4eb9ac0d-4191-4691-8a98-8ea99acebfaf"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:42.580320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-288d463a-c2aa-42b1-a1f4-7d254350fdff req-bbf93394-a914-4647-8b1f-47dbc19fbab4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.580615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-288d463a-c2aa-42b1-a1f4-7d254350fdff req-bbf93394-a914-4647-8b1f-47dbc19fbab4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.581216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-288d463a-c2aa-42b1-a1f4-7d254350fdff req-bbf93394-a914-4647-8b1f-47dbc19fbab4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.634629 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-288d463a-c2aa-42b1-a1f4-7d254350fdff req-bbf93394-a914-4647-8b1f-47dbc19fbab4 service nova] Creating event network-vif-unplugged:4eb9ac0d-4191-4691-8a98-8ea99acebfaf for instance fc51544d-3049-416e-a24a-7ff7d4c7f9bb on n-h2-839401-11 Aug 29 15:45:42.642131 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-288d463a-c2aa-42b1-a1f4-7d254350fdff req-bbf93394-a914-4647-8b1f-47dbc19fbab4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110435 Aug 29 15:45:42.666087 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2406/4699] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:42.673019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-79eb87f9-b815-43cf-b5c7-f51223ab7f40 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:42.673981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-79eb87f9-b815-43cf-b5c7-f51223ab7f40 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:42.683017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79eb87f9-b815-43cf-b5c7-f51223ab7f40 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.683521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79eb87f9-b815-43cf-b5c7-f51223ab7f40 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.684067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79eb87f9-b815-43cf-b5c7-f51223ab7f40 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.684777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79eb87f9-b815-43cf-b5c7-f51223ab7f40 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.685437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79eb87f9-b815-43cf-b5c7-f51223ab7f40 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.686505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79eb87f9-b815-43cf-b5c7-f51223ab7f40 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.742521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d2a08695-a793-4bdc-ad3b-92d89b20f2b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:42.771548 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d2a08695-a793-4bdc-ad3b-92d89b20f2b3 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1452 microversion: 2.1 time: 0.271311 Aug 29 15:45:42.771548 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2294/4700] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:42 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1452 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:42.789907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-929436de-8dbd-4300-88fa-a447218320c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.220"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:43.012995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-929436de-8dbd-4300-88fa-a447218320c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:43.021732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-929436de-8dbd-4300-88fa-a447218320c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:43.021951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-929436de-8dbd-4300-88fa-a447218320c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:43.023522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-929436de-8dbd-4300-88fa-a447218320c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:43.024684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-929436de-8dbd-4300-88fa-a447218320c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:43.025686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-929436de-8dbd-4300-88fa-a447218320c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:43.026178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-929436de-8dbd-4300-88fa-a447218320c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:43.470281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-79eb87f9-b815-43cf-b5c7-f51223ab7f40 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:43.481422 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-79eb87f9-b815-43cf-b5c7-f51223ab7f40 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1315 microversion: 2.1 time: 0.813421 Aug 29 15:45:43.482389 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2407/4701] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:42 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1315 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:43.488414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-72a6c8df-f167-449b-b335-c2d8c00a4430 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:43.489361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-72a6c8df-f167-449b-b335-c2d8c00a4430 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:43.496289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72a6c8df-f167-449b-b335-c2d8c00a4430 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:43.497228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72a6c8df-f167-449b-b335-c2d8c00a4430 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:43.497876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72a6c8df-f167-449b-b335-c2d8c00a4430 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:43.498755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72a6c8df-f167-449b-b335-c2d8c00a4430 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:43.499368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72a6c8df-f167-449b-b335-c2d8c00a4430 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:43.499958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72a6c8df-f167-449b-b335-c2d8c00a4430 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:43.759348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-929436de-8dbd-4300-88fa-a447218320c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "refresh_cache-4cb6aed9-8901-4e68-8a40-21dc9e2f690c" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:45:43.760415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-929436de-8dbd-4300-88fa-a447218320c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquired lock "refresh_cache-4cb6aed9-8901-4e68-8a40-21dc9e2f690c" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:45:43.813163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-72a6c8df-f167-449b-b335-c2d8c00a4430 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:43.822622 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-72a6c8df-f167-449b-b335-c2d8c00a4430 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1660 microversion: 2.1 time: 0.338983 Aug 29 15:45:43.823393 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2408/4702] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:43 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1660 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:43.844531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c1ccbc38-336c-45a6-866d-13fac6f31494 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:43.854305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c1ccbc38-336c-45a6-866d-13fac6f31494 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:43.873896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ccbc38-336c-45a6-866d-13fac6f31494 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:43.874674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ccbc38-336c-45a6-866d-13fac6f31494 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:43.875423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ccbc38-336c-45a6-866d-13fac6f31494 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:43.876553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ccbc38-336c-45a6-866d-13fac6f31494 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:43.877308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ccbc38-336c-45a6-866d-13fac6f31494 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:43.878126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ccbc38-336c-45a6-866d-13fac6f31494 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:43.928495 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c1ccbc38-336c-45a6-866d-13fac6f31494 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments/c85eb566-c662-4e34-897d-efb6bae317b3" status: 200 len: 194 microversion: 2.1 time: 0.089589 Aug 29 15:45:43.929397 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2409/4703] 10.222.0.62 () {58 vars in 1413 bytes} [Mon Aug 29 15:45:43 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments/c85eb566-c662-4e34-897d-efb6bae317b3 => generated 194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:43.933720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-01f3f708-6d46-4246-a28f-00f346f6be7f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:43.934413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-01f3f708-6d46-4246-a28f-00f346f6be7f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:43.949188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01f3f708-6d46-4246-a28f-00f346f6be7f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:43.949575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01f3f708-6d46-4246-a28f-00f346f6be7f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:43.950015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01f3f708-6d46-4246-a28f-00f346f6be7f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:43.950805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01f3f708-6d46-4246-a28f-00f346f6be7f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:43.951274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01f3f708-6d46-4246-a28f-00f346f6be7f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:43.951706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01f3f708-6d46-4246-a28f-00f346f6be7f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.116983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-01f3f708-6d46-4246-a28f-00f346f6be7f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:44.125142 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-01f3f708-6d46-4246-a28f-00f346f6be7f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.194839 Aug 29 15:45:44.142759 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2410/4704] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:43 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:44.151880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cdb1d7f7-b1f5-4e78-8dd8-84d44f26afe2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:44.153241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cdb1d7f7-b1f5-4e78-8dd8-84d44f26afe2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:44.159185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cdb1d7f7-b1f5-4e78-8dd8-84d44f26afe2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.159626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cdb1d7f7-b1f5-4e78-8dd8-84d44f26afe2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.160156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cdb1d7f7-b1f5-4e78-8dd8-84d44f26afe2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.160821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cdb1d7f7-b1f5-4e78-8dd8-84d44f26afe2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.161493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cdb1d7f7-b1f5-4e78-8dd8-84d44f26afe2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.161792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cdb1d7f7-b1f5-4e78-8dd8-84d44f26afe2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.204944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cdb1d7f7-b1f5-4e78-8dd8-84d44f26afe2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.205831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cdb1d7f7-b1f5-4e78-8dd8-84d44f26afe2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.205831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cdb1d7f7-b1f5-4e78-8dd8-84d44f26afe2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.206080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-cdb1d7f7-b1f5-4e78-8dd8-84d44f26afe2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lazy-loading 'fault' on Instance uuid fc51544d-3049-416e-a24a-7ff7d4c7f9bb {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:44.262293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cdb1d7f7-b1f5-4e78-8dd8-84d44f26afe2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ae9af4779a4d50b9171ff9ca8b5207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad019754b47441d5a286666f8a048b48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:44.270939 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cdb1d7f7-b1f5-4e78-8dd8-84d44f26afe2 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 200 len: 1298 microversion: 2.1 time: 0.127031 Aug 29 15:45:44.273208 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2411/4705] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:44 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:44.278200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f65a9efd-192f-400e-814a-45ba8be3a15a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:44.278845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f65a9efd-192f-400e-814a-45ba8be3a15a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:44.293613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65a9efd-192f-400e-814a-45ba8be3a15a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.294285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65a9efd-192f-400e-814a-45ba8be3a15a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.295066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65a9efd-192f-400e-814a-45ba8be3a15a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.295850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65a9efd-192f-400e-814a-45ba8be3a15a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.296436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65a9efd-192f-400e-814a-45ba8be3a15a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.296958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65a9efd-192f-400e-814a-45ba8be3a15a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.388103 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f65a9efd-192f-400e-814a-45ba8be3a15a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action" status: 202 len: 0 microversion: 2.1 time: 0.113389 Aug 29 15:45:44.389026 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2412/4706] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:44 2022] POST /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:44.394348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-1133db8e-2e72-40b4-9b8b-7ecfc61c1899 req-331a1319-8e59-4547-813b-b1db55ca2921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc51544d-3049-416e-a24a-7ff7d4c7f9bb", "name": "network-vif-deleted", "tag": "4eb9ac0d-4191-4691-8a98-8ea99acebfaf"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:44.406484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1133db8e-2e72-40b4-9b8b-7ecfc61c1899 req-331a1319-8e59-4547-813b-b1db55ca2921 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.406971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1133db8e-2e72-40b4-9b8b-7ecfc61c1899 req-331a1319-8e59-4547-813b-b1db55ca2921 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.407627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1133db8e-2e72-40b4-9b8b-7ecfc61c1899 req-331a1319-8e59-4547-813b-b1db55ca2921 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.444031 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-1133db8e-2e72-40b4-9b8b-7ecfc61c1899 req-331a1319-8e59-4547-813b-b1db55ca2921 service nova] Creating event network-vif-deleted:4eb9ac0d-4191-4691-8a98-8ea99acebfaf for instance fc51544d-3049-416e-a24a-7ff7d4c7f9bb on n-h2-839401-11 Aug 29 15:45:44.455763 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-1133db8e-2e72-40b4-9b8b-7ecfc61c1899 req-331a1319-8e59-4547-813b-b1db55ca2921 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065056 Aug 29 15:45:44.457067 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2413/4707] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:44.462776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-66e24f8d-a39e-4ca6-b061-eb6750a90001 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:44.463725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-66e24f8d-a39e-4ca6-b061-eb6750a90001 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:44.473188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66e24f8d-a39e-4ca6-b061-eb6750a90001 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.474696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66e24f8d-a39e-4ca6-b061-eb6750a90001 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.475469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66e24f8d-a39e-4ca6-b061-eb6750a90001 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.476457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66e24f8d-a39e-4ca6-b061-eb6750a90001 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.476944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66e24f8d-a39e-4ca6-b061-eb6750a90001 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.477410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66e24f8d-a39e-4ca6-b061-eb6750a90001 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.607938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-66e24f8d-a39e-4ca6-b061-eb6750a90001 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lazy-loading 'services' on Instance uuid 89dfeae0-3079-4a17-bc65-7ad03318e731 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:44.770443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-929436de-8dbd-4300-88fa-a447218320c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Building network info cache for instance {{(pid=122361) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:45:44.794192 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-66e24f8d-a39e-4ca6-b061-eb6750a90001 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "DELETE /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments/c85eb566-c662-4e34-897d-efb6bae317b3" status: 202 len: 0 microversion: 2.1 time: 0.332826 Aug 29 15:45:44.837507 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2414/4708] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 15:45:44 2022] DELETE /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments/c85eb566-c662-4e34-897d-efb6bae317b3 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:44.862042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7b1376a-9013-4184-9733-7b813353b95d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:44.866101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f7b1376a-9013-4184-9733-7b813353b95d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:44.879984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7b1376a-9013-4184-9733-7b813353b95d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.880481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7b1376a-9013-4184-9733-7b813353b95d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.880923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7b1376a-9013-4184-9733-7b813353b95d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.881976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7b1376a-9013-4184-9733-7b813353b95d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.882431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7b1376a-9013-4184-9733-7b813353b95d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.882860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7b1376a-9013-4184-9733-7b813353b95d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.138742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f7b1376a-9013-4184-9733-7b813353b95d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:45.153663 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f7b1376a-9013-4184-9733-7b813353b95d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1666 microversion: 2.1 time: 0.314556 Aug 29 15:45:45.154265 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2415/4709] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:44 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1666 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:45.163932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c5625b1a-aa7d-450c-ad30-c67a76dd6499 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:45.164547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c5625b1a-aa7d-450c-ad30-c67a76dd6499 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:45.186932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5625b1a-aa7d-450c-ad30-c67a76dd6499 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.187498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5625b1a-aa7d-450c-ad30-c67a76dd6499 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.189548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5625b1a-aa7d-450c-ad30-c67a76dd6499 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.189548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5625b1a-aa7d-450c-ad30-c67a76dd6499 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.189548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5625b1a-aa7d-450c-ad30-c67a76dd6499 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.189548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5625b1a-aa7d-450c-ad30-c67a76dd6499 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.233076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:45.428055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c5625b1a-aa7d-450c-ad30-c67a76dd6499 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:45.436852 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c5625b1a-aa7d-450c-ad30-c67a76dd6499 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1502 microversion: 2.1 time: 0.281570 Aug 29 15:45:45.437734 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2416/4710] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:45 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1502 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:45.443087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4e00b6bf-427d-4b70-abae-a21254997852 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:45.443974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4e00b6bf-427d-4b70-abae-a21254997852 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:45.450159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e00b6bf-427d-4b70-abae-a21254997852 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.450906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e00b6bf-427d-4b70-abae-a21254997852 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.451540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e00b6bf-427d-4b70-abae-a21254997852 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.452613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e00b6bf-427d-4b70-abae-a21254997852 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.453317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e00b6bf-427d-4b70-abae-a21254997852 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.453937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e00b6bf-427d-4b70-abae-a21254997852 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.673689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4e00b6bf-427d-4b70-abae-a21254997852 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:45.693595 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4e00b6bf-427d-4b70-abae-a21254997852 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.254520 Aug 29 15:45:45.710887 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2417/4711] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:45 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:45.716904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-03f993d3-cfc1-4bc2-b84a-cc541ea5573b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:45.717764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-03f993d3-cfc1-4bc2-b84a-cc541ea5573b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: fc51544d-3049-416e-a24a-7ff7d4c7f9bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:45.726790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03f993d3-cfc1-4bc2-b84a-cc541ea5573b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.727579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03f993d3-cfc1-4bc2-b84a-cc541ea5573b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.728245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03f993d3-cfc1-4bc2-b84a-cc541ea5573b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.730035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03f993d3-cfc1-4bc2-b84a-cc541ea5573b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.731524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03f993d3-cfc1-4bc2-b84a-cc541ea5573b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.732229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03f993d3-cfc1-4bc2-b84a-cc541ea5573b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.751074 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-03f993d3-cfc1-4bc2-b84a-cc541ea5573b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] HTTP exception thrown: Instance fc51544d-3049-416e-a24a-7ff7d4c7f9bb could not be found. Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-03f993d3-cfc1-4bc2-b84a-cc541ea5573b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Request method failure captured: Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb HTTP/1.1 Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN4lGjWuBtP7IMH8HSwk8IArAW2Un5TRnhuxsWrM673TJoSMK_36MEx-0fGUi2H0QEZHaMoPWKZQoTLRYuljaJekjHyJMy7MOQAjg3gAnm3ahDfQDf2YzCRY-_mF_ajbSnqzHiKL4fgX0md_3rXTolDzVII-XHo4hByRxDyQdobEoY8 Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ad019754b47441d5a286666f8a048b48", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ad019754b47441d5a286666f8a048b48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}] Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 71ae9af4779a4d50b9171ff9ca8b5207 Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance fc51544d-3049-416e-a24a-7ff7d4c7f9bb could not be found. Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'fc51544d-3049-416e-a24a-7ff7d4c7f9bb'} Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc51544d-3049-416e-a24a-7ff7d4c7f9bb could not be found. Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc51544d-3049-416e-a24a-7ff7d4c7f9bb could not be found. Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:45.753380 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:45.758022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:45.758022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:45.758022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:45.758022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:45.758022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc51544d-3049-416e-a24a-7ff7d4c7f9bb could not be found. Aug 29 15:45:45.758022 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:45.758022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-03f993d3-cfc1-4bc2-b84a-cc541ea5573b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Returning 404 to user: Instance fc51544d-3049-416e-a24a-7ff7d4c7f9bb could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:45.759274 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-03f993d3-cfc1-4bc2-b84a-cc541ea5573b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb" status: 404 len: 111 microversion: 2.1 time: 0.046863 Aug 29 15:45:45.760643 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2418/4712] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:45 2022] GET /compute/v2.1/servers/fc51544d-3049-416e-a24a-7ff7d4c7f9bb => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:45.766568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-60e68b9e-6724-40c2-ad3e-cff8f63428db tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:45.767342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-60e68b9e-6724-40c2-ad3e-cff8f63428db tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:45.782917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60e68b9e-6724-40c2-ad3e-cff8f63428db tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.787270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60e68b9e-6724-40c2-ad3e-cff8f63428db tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.787989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60e68b9e-6724-40c2-ad3e-cff8f63428db tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.788620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60e68b9e-6724-40c2-ad3e-cff8f63428db tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.789251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60e68b9e-6724-40c2-ad3e-cff8f63428db tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.789712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60e68b9e-6724-40c2-ad3e-cff8f63428db tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.919501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-929436de-8dbd-4300-88fa-a447218320c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Updating instance_info_cache with network_info: [{"id": "9dad9642-2fa5-4f48-9928-cc4aebbe2498", "address": "fa:16:3e:f8:f7:73", "network": {"id": "483f7ce2-772f-4261-94f5-2fcba159cdb8", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1247782711-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "601b0333e91644768c5f6d7f4f717108", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9dad9642-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122361) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:45:45.934058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-929436de-8dbd-4300-88fa-a447218320c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Releasing lock "refresh_cache-4cb6aed9-8901-4e68-8a40-21dc9e2f690c" {{(pid=122361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:45:45.935405 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-929436de-8dbd-4300-88fa-a447218320c7 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "POST /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c/action" status: 202 len: 0 microversion: 2.1 time: 3.153275 Aug 29 15:45:45.937154 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2295/4713] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:42 2022] POST /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c/action => generated 0 bytes in 3165 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:45:45.951992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d72ab078-b013-4ced-9317-45050ba65ddc tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42a562310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:46.011107 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-d72ab078-b013-4ced-9317-45050ba65ddc tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] HTTP exception thrown: Image not found. Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d72ab078-b013-4ced-9317-45050ba65ddc tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Request method failure captured: Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 HTTP/1.1 Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN4lGjWuBtP7IMH8HSwk8IArAW2Un5TRnhuxsWrM673TJoSMK_36MEx-0fGUi2H0QEZHaMoPWKZQoTLRYuljaJekjHyJMy7MOQAjg3gAnm3ahDfQDf2YzCRY-_mF_ajbSnqzHiKL4fgX0md_3rXTolDzVII-XHo4hByRxDyQdobEoY8 Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ad019754b47441d5a286666f8a048b48", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ad019754b47441d5a286666f8a048b48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}] Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 71ae9af4779a4d50b9171ff9ca8b5207 Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: exception: Image not found. Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '8ea7e8b0-7048-4247-b0b7-622e5d4d5998'} Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8ea7e8b0-7048-4247-b0b7-622e5d4d5998 to delete Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8ea7e8b0-7048-4247-b0b7-622e5d4d5998 could not be found. Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.015642 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:45:46.019453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.025298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d72ab078-b013-4ced-9317-45050ba65ddc tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Returning 404 to user: Image not found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:46.039950 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d72ab078-b013-4ced-9317-45050ba65ddc tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "DELETE /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998" status: 404 len: 62 microversion: 2.1 time: 0.095501 Aug 29 15:45:46.069753 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2296/4714] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:45 2022] DELETE /compute/v2.1/images/8ea7e8b0-7048-4247-b0b7-622e5d4d5998 => generated 62 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:45:46.109336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0e4f02ac-ab61-4891-88b4-53faba96c685 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '.version_select at 0x7fc42a540dc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:46.131294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-60e68b9e-6724-40c2-ad3e-cff8f63428db tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:46.140147 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-60e68b9e-6724-40c2-ad3e-cff8f63428db tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1502 microversion: 2.1 time: 0.378107 Aug 29 15:45:46.149181 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2419/4715] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:45 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1502 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:46.149181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e1248dcd-ae6d-4763-ae98-da8b38f53e6b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:46.150225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e1248dcd-ae6d-4763-ae98-da8b38f53e6b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:46.164296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1248dcd-ae6d-4763-ae98-da8b38f53e6b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.164797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1248dcd-ae6d-4763-ae98-da8b38f53e6b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.165273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1248dcd-ae6d-4763-ae98-da8b38f53e6b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.165987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1248dcd-ae6d-4763-ae98-da8b38f53e6b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.166448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1248dcd-ae6d-4763-ae98-da8b38f53e6b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.171331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1248dcd-ae6d-4763-ae98-da8b38f53e6b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.191291 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-e1248dcd-ae6d-4763-ae98-da8b38f53e6b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] HTTP exception thrown: Instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 could not be found. Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e1248dcd-ae6d-4763-ae98-da8b38f53e6b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Request method failure captured: Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 HTTP/1.1 Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN4lGjWuBtP7IMH8HSwk8IArAW2Un5TRnhuxsWrM673TJoSMK_36MEx-0fGUi2H0QEZHaMoPWKZQoTLRYuljaJekjHyJMy7MOQAjg3gAnm3ahDfQDf2YzCRY-_mF_ajbSnqzHiKL4fgX0md_3rXTolDzVII-XHo4hByRxDyQdobEoY8 Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ad019754b47441d5a286666f8a048b48", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ad019754b47441d5a286666f8a048b48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}] Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 71ae9af4779a4d50b9171ff9ca8b5207 Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 could not be found. Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '5219eda0-3ed8-4c6e-ba04-19ed69930d86'} Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 could not be found. Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:46.192867 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 could not be found. Aug 29 15:45:46.196764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.196764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:46.196764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.196764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:46.196764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:46.196764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:46.196764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:46.196764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:46.196764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 could not be found. Aug 29 15:45:46.196764 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.196764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e1248dcd-ae6d-4763-ae98-da8b38f53e6b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Returning 404 to user: Instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:46.196764 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e1248dcd-ae6d-4763-ae98-da8b38f53e6b tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 404 len: 111 microversion: 2.1 time: 0.051790 Aug 29 15:45:46.201715 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2420/4716] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:46 2022] DELETE /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:46.211605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9c455751-bcd2-4b31-bcec-d4d1e5fd2483 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:46.212136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9c455751-bcd2-4b31-bcec-d4d1e5fd2483 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:46.219384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c455751-bcd2-4b31-bcec-d4d1e5fd2483 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.219870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c455751-bcd2-4b31-bcec-d4d1e5fd2483 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.220321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c455751-bcd2-4b31-bcec-d4d1e5fd2483 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.222360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c455751-bcd2-4b31-bcec-d4d1e5fd2483 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.222830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c455751-bcd2-4b31-bcec-d4d1e5fd2483 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.223269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c455751-bcd2-4b31-bcec-d4d1e5fd2483 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.248621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-9c455751-bcd2-4b31-bcec-d4d1e5fd2483 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lazy-loading 'flavor' on Instance uuid cd640d6c-9838-43b8-b1ab-d38a1b38b757 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:46.417872 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9c455751-bcd2-4b31-bcec-d4d1e5fd2483 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "POST /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757/action" status: 202 len: 0 microversion: 2.1 time: 0.214542 Aug 29 15:45:46.422668 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2421/4717] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:46 2022] POST /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:46.440254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6197af68-9073-43a5-8a26-be3b0828705c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:46.444883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6197af68-9073-43a5-8a26-be3b0828705c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:46.452384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6197af68-9073-43a5-8a26-be3b0828705c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.453180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6197af68-9073-43a5-8a26-be3b0828705c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.453925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6197af68-9073-43a5-8a26-be3b0828705c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.454794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6197af68-9073-43a5-8a26-be3b0828705c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.455411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6197af68-9073-43a5-8a26-be3b0828705c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.456160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6197af68-9073-43a5-8a26-be3b0828705c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.680580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6197af68-9073-43a5-8a26-be3b0828705c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:46.703584 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6197af68-9073-43a5-8a26-be3b0828705c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1666 microversion: 2.1 time: 0.275168 Aug 29 15:45:46.704713 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2422/4718] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:46 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1666 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:46.712747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c27a6668-db2d-4266-afb8-adf10cc3266a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:46.713649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c27a6668-db2d-4266-afb8-adf10cc3266a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 5219eda0-3ed8-4c6e-ba04-19ed69930d86] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:46.729695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c27a6668-db2d-4266-afb8-adf10cc3266a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.730466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c27a6668-db2d-4266-afb8-adf10cc3266a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.731103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c27a6668-db2d-4266-afb8-adf10cc3266a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.732279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c27a6668-db2d-4266-afb8-adf10cc3266a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.732882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c27a6668-db2d-4266-afb8-adf10cc3266a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.733532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c27a6668-db2d-4266-afb8-adf10cc3266a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.751137 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-c27a6668-db2d-4266-afb8-adf10cc3266a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] HTTP exception thrown: Instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 could not be found. Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c27a6668-db2d-4266-afb8-adf10cc3266a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Request method failure captured: Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 HTTP/1.1 Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN4lGjWuBtP7IMH8HSwk8IArAW2Un5TRnhuxsWrM673TJoSMK_36MEx-0fGUi2H0QEZHaMoPWKZQoTLRYuljaJekjHyJMy7MOQAjg3gAnm3ahDfQDf2YzCRY-_mF_ajbSnqzHiKL4fgX0md_3rXTolDzVII-XHo4hByRxDyQdobEoY8 Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ad019754b47441d5a286666f8a048b48", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ad019754b47441d5a286666f8a048b48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}] Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 71ae9af4779a4d50b9171ff9ca8b5207 Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 could not be found. Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '5219eda0-3ed8-4c6e-ba04-19ed69930d86'} Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 could not be found. Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 could not be found. Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.754530 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:46.758716 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:46.758716 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:46.758716 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:46.758716 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:46.758716 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 could not be found. Aug 29 15:45:46.758716 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:46.760705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c27a6668-db2d-4266-afb8-adf10cc3266a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Returning 404 to user: Instance 5219eda0-3ed8-4c6e-ba04-19ed69930d86 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:46.762231 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c27a6668-db2d-4266-afb8-adf10cc3266a tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86" status: 404 len: 111 microversion: 2.1 time: 0.055968 Aug 29 15:45:46.763702 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2423/4719] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:46 2022] GET /compute/v2.1/servers/5219eda0-3ed8-4c6e-ba04-19ed69930d86 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:46.768786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-63261e41-c8e5-42c2-9673-dd9ff2fd5d9c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:46.769700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-63261e41-c8e5-42c2-9673-dd9ff2fd5d9c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:46.776913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63261e41-c8e5-42c2-9673-dd9ff2fd5d9c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.777631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63261e41-c8e5-42c2-9673-dd9ff2fd5d9c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.778222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63261e41-c8e5-42c2-9673-dd9ff2fd5d9c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.779119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63261e41-c8e5-42c2-9673-dd9ff2fd5d9c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.779710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63261e41-c8e5-42c2-9673-dd9ff2fd5d9c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.780495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63261e41-c8e5-42c2-9673-dd9ff2fd5d9c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.016643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-63261e41-c8e5-42c2-9673-dd9ff2fd5d9c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:47.026742 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-63261e41-c8e5-42c2-9673-dd9ff2fd5d9c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1510 microversion: 2.1 time: 0.261725 Aug 29 15:45:47.027643 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2424/4720] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:46 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:47.032694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-fbaa740f-2cb5-4a91-a8d7-877599e33bd0 req-e935ccc5-d4d0-4f46-89a5-0f0cdcb3f8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb6aed9-8901-4e68-8a40-21dc9e2f690c", "tag": "9dad9642-2fa5-4f48-9928-cc4aebbe2498"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:47.042990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fbaa740f-2cb5-4a91-a8d7-877599e33bd0 req-e935ccc5-d4d0-4f46-89a5-0f0cdcb3f8f4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.043568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fbaa740f-2cb5-4a91-a8d7-877599e33bd0 req-e935ccc5-d4d0-4f46-89a5-0f0cdcb3f8f4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.044156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fbaa740f-2cb5-4a91-a8d7-877599e33bd0 req-e935ccc5-d4d0-4f46-89a5-0f0cdcb3f8f4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.072466 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-fbaa740f-2cb5-4a91-a8d7-877599e33bd0 req-e935ccc5-d4d0-4f46-89a5-0f0cdcb3f8f4 service nova] Creating event network-changed:9dad9642-2fa5-4f48-9928-cc4aebbe2498 for instance 4cb6aed9-8901-4e68-8a40-21dc9e2f690c on n-h1-839401-11 Aug 29 15:45:47.078599 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-fbaa740f-2cb5-4a91-a8d7-877599e33bd0 req-e935ccc5-d4d0-4f46-89a5-0f0cdcb3f8f4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049289 Aug 29 15:45:47.079587 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2425/4721] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:47.086623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9e0f2483-e8d5-4b02-b6c0-d790f8489a09 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:47.087372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9e0f2483-e8d5-4b02-b6c0-d790f8489a09 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:47.109524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0f2483-e8d5-4b02-b6c0-d790f8489a09 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.109524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0f2483-e8d5-4b02-b6c0-d790f8489a09 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.109524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0f2483-e8d5-4b02-b6c0-d790f8489a09 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.109524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0f2483-e8d5-4b02-b6c0-d790f8489a09 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.109956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0f2483-e8d5-4b02-b6c0-d790f8489a09 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.110233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e0f2483-e8d5-4b02-b6c0-d790f8489a09 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.379777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e0f2483-e8d5-4b02-b6c0-d790f8489a09 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:47.388752 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9e0f2483-e8d5-4b02-b6c0-d790f8489a09 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.307872 Aug 29 15:45:47.389402 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2426/4722] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:47 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:47.398526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9356510b-2be5-4a2f-8de9-2643f0f32a34 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42bc24430>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:47.446355 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-9356510b-2be5-4a2f-8de9-2643f0f32a34 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] HTTP exception thrown: Image not found. Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9356510b-2be5-4a2f-8de9-2643f0f32a34 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Request method failure captured: Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d HTTP/1.1 Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN4lGjWuBtP7IMH8HSwk8IArAW2Un5TRnhuxsWrM673TJoSMK_36MEx-0fGUi2H0QEZHaMoPWKZQoTLRYuljaJekjHyJMy7MOQAjg3gAnm3ahDfQDf2YzCRY-_mF_ajbSnqzHiKL4fgX0md_3rXTolDzVII-XHo4hByRxDyQdobEoY8 Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ad019754b47441d5a286666f8a048b48", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ad019754b47441d5a286666f8a048b48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}] Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 71ae9af4779a4d50b9171ff9ca8b5207 Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: exception: Image not found. Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '3197a104-0448-4a22-b136-f4f96928433d'} Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3197a104-0448-4a22-b136-f4f96928433d to delete Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3197a104-0448-4a22-b136-f4f96928433d could not be found. Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.448584 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:45:47.453557 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.455881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9356510b-2be5-4a2f-8de9-2643f0f32a34 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Returning 404 to user: Image not found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:47.457052 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9356510b-2be5-4a2f-8de9-2643f0f32a34 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "DELETE /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d" status: 404 len: 62 microversion: 2.1 time: 0.062504 Aug 29 15:45:47.457856 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2427/4723] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:47 2022] DELETE /compute/v2.1/images/3197a104-0448-4a22-b136-f4f96928433d => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:45:47.468572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-46d3ebd1-b0a0-4826-b976-1b28da7b7919 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:47.469371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-46d3ebd1-b0a0-4826-b976-1b28da7b7919 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:47.482883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d3ebd1-b0a0-4826-b976-1b28da7b7919 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.486552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d3ebd1-b0a0-4826-b976-1b28da7b7919 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.487447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d3ebd1-b0a0-4826-b976-1b28da7b7919 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.488442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d3ebd1-b0a0-4826-b976-1b28da7b7919 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.489077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d3ebd1-b0a0-4826-b976-1b28da7b7919 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.489736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46d3ebd1-b0a0-4826-b976-1b28da7b7919 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.506843 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-46d3ebd1-b0a0-4826-b976-1b28da7b7919 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] HTTP exception thrown: Instance 81c2d898-9252-4ea9-9186-93605b7b9aa5 could not be found. Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-46d3ebd1-b0a0-4826-b976-1b28da7b7919 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Request method failure captured: Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 HTTP/1.1 Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN4lGjWuBtP7IMH8HSwk8IArAW2Un5TRnhuxsWrM673TJoSMK_36MEx-0fGUi2H0QEZHaMoPWKZQoTLRYuljaJekjHyJMy7MOQAjg3gAnm3ahDfQDf2YzCRY-_mF_ajbSnqzHiKL4fgX0md_3rXTolDzVII-XHo4hByRxDyQdobEoY8 Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ad019754b47441d5a286666f8a048b48", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ad019754b47441d5a286666f8a048b48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}] Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 71ae9af4779a4d50b9171ff9ca8b5207 Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 81c2d898-9252-4ea9-9186-93605b7b9aa5 could not be found. Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '81c2d898-9252-4ea9-9186-93605b7b9aa5'} Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81c2d898-9252-4ea9-9186-93605b7b9aa5 could not be found. Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:47.509023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81c2d898-9252-4ea9-9186-93605b7b9aa5 could not be found. Aug 29 15:45:47.514067 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.514067 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:47.514067 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.514067 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.514067 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:47.514067 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:47.514067 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:47.514067 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:47.514067 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81c2d898-9252-4ea9-9186-93605b7b9aa5 could not be found. Aug 29 15:45:47.514067 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.516054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-46d3ebd1-b0a0-4826-b976-1b28da7b7919 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Returning 404 to user: Instance 81c2d898-9252-4ea9-9186-93605b7b9aa5 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:47.517329 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-46d3ebd1-b0a0-4826-b976-1b28da7b7919 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "DELETE /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 404 len: 111 microversion: 2.1 time: 0.054577 Aug 29 15:45:47.518437 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2428/4724] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:47 2022] DELETE /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:47.528330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4793b8a8-a4c1-4229-b942-fcc3c6e7bf73 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:47.529733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4793b8a8-a4c1-4229-b942-fcc3c6e7bf73 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: 81c2d898-9252-4ea9-9186-93605b7b9aa5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:47.536623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4793b8a8-a4c1-4229-b942-fcc3c6e7bf73 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.537669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4793b8a8-a4c1-4229-b942-fcc3c6e7bf73 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.538294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4793b8a8-a4c1-4229-b942-fcc3c6e7bf73 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.539382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4793b8a8-a4c1-4229-b942-fcc3c6e7bf73 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.540306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4793b8a8-a4c1-4229-b942-fcc3c6e7bf73 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.540909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4793b8a8-a4c1-4229-b942-fcc3c6e7bf73 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.560970 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-4793b8a8-a4c1-4229-b942-fcc3c6e7bf73 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] HTTP exception thrown: Instance 81c2d898-9252-4ea9-9186-93605b7b9aa5 could not be found. Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4793b8a8-a4c1-4229-b942-fcc3c6e7bf73 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Request method failure captured: Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 HTTP/1.1 Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN4lGjWuBtP7IMH8HSwk8IArAW2Un5TRnhuxsWrM673TJoSMK_36MEx-0fGUi2H0QEZHaMoPWKZQoTLRYuljaJekjHyJMy7MOQAjg3gAnm3ahDfQDf2YzCRY-_mF_ajbSnqzHiKL4fgX0md_3rXTolDzVII-XHo4hByRxDyQdobEoY8 Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ad019754b47441d5a286666f8a048b48", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ad019754b47441d5a286666f8a048b48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}] Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 71ae9af4779a4d50b9171ff9ca8b5207 Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 81c2d898-9252-4ea9-9186-93605b7b9aa5 could not be found. Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '81c2d898-9252-4ea9-9186-93605b7b9aa5'} Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81c2d898-9252-4ea9-9186-93605b7b9aa5 could not be found. Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81c2d898-9252-4ea9-9186-93605b7b9aa5 could not be found. Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.563815 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.569598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:47.569598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:47.569598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:47.569598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:47.569598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81c2d898-9252-4ea9-9186-93605b7b9aa5 could not be found. Aug 29 15:45:47.569598 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.571816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4793b8a8-a4c1-4229-b942-fcc3c6e7bf73 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Returning 404 to user: Instance 81c2d898-9252-4ea9-9186-93605b7b9aa5 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:47.572736 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0e4f02ac-ab61-4891-88b4-53faba96c685 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "DELETE /compute/v2.1/os-floating-ips/3f99f8ab-edde-44c1-b19e-d5f63ddb69d8" status: 202 len: 0 microversion: 2.1 time: 1.473883 Aug 29 15:45:47.573518 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4793b8a8-a4c1-4229-b942-fcc3c6e7bf73 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5" status: 404 len: 111 microversion: 2.1 time: 0.048934 Aug 29 15:45:47.574341 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2297/4725] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:45:46 2022] DELETE /compute/v2.1/os-floating-ips/3f99f8ab-edde-44c1-b19e-d5f63ddb69d8 => generated 0 bytes in 1504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:47.575009 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2429/4726] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:47 2022] GET /compute/v2.1/servers/81c2d898-9252-4ea9-9186-93605b7b9aa5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:47.583036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-caee217b-8816-4022-a89f-7222e0c6be06 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '.version_select at 0x7fc42a558ca0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:47.585796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec2ec491-3f4e-4863-96dd-1ec1298c6824 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '.version_select at 0x7fc42b5b1550>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:47.614812 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-ec2ec491-3f4e-4863-96dd-1ec1298c6824 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] HTTP exception thrown: Image not found. Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec2ec491-3f4e-4863-96dd-1ec1298c6824 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Request method failure captured: Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e HTTP/1.1 Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN4lGjWuBtP7IMH8HSwk8IArAW2Un5TRnhuxsWrM673TJoSMK_36MEx-0fGUi2H0QEZHaMoPWKZQoTLRYuljaJekjHyJMy7MOQAjg3gAnm3ahDfQDf2YzCRY-_mF_ajbSnqzHiKL4fgX0md_3rXTolDzVII-XHo4hByRxDyQdobEoY8 Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ad019754b47441d5a286666f8a048b48", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ad019754b47441d5a286666f8a048b48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}] Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 71ae9af4779a4d50b9171ff9ca8b5207 Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: exception: Image not found. Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '8f8beaa7-f2c7-4c29-9e82-c6d70f93067e'} Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8f8beaa7-f2c7-4c29-9e82-c6d70f93067e to delete Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8f8beaa7-f2c7-4c29-9e82-c6d70f93067e could not be found. Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.616818 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:45:47.621322 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.623710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec2ec491-3f4e-4863-96dd-1ec1298c6824 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Returning 404 to user: Image not found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:47.624874 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ec2ec491-3f4e-4863-96dd-1ec1298c6824 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "DELETE /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e" status: 404 len: 62 microversion: 2.1 time: 0.043069 Aug 29 15:45:47.630371 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2430/4727] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:47 2022] DELETE /compute/v2.1/images/8f8beaa7-f2c7-4c29-9e82-c6d70f93067e => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:45:47.635715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6e96583c-a566-4b62-bb6f-aa0b3d010491 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:47.637955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6e96583c-a566-4b62-bb6f-aa0b3d010491 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:47.652679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e96583c-a566-4b62-bb6f-aa0b3d010491 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.655894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e96583c-a566-4b62-bb6f-aa0b3d010491 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.657616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e96583c-a566-4b62-bb6f-aa0b3d010491 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.659304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e96583c-a566-4b62-bb6f-aa0b3d010491 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.661072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e96583c-a566-4b62-bb6f-aa0b3d010491 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.663698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e96583c-a566-4b62-bb6f-aa0b3d010491 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.683489 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-6e96583c-a566-4b62-bb6f-aa0b3d010491 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] HTTP exception thrown: Instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a could not be found. Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6e96583c-a566-4b62-bb6f-aa0b3d010491 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Request method failure captured: Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a HTTP/1.1 Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN4lGjWuBtP7IMH8HSwk8IArAW2Un5TRnhuxsWrM673TJoSMK_36MEx-0fGUi2H0QEZHaMoPWKZQoTLRYuljaJekjHyJMy7MOQAjg3gAnm3ahDfQDf2YzCRY-_mF_ajbSnqzHiKL4fgX0md_3rXTolDzVII-XHo4hByRxDyQdobEoY8 Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ad019754b47441d5a286666f8a048b48", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ad019754b47441d5a286666f8a048b48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}] Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 71ae9af4779a4d50b9171ff9ca8b5207 Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a could not be found. Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'ebc1d9ba-f64b-46cf-9006-0092135d5e7a'} Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a could not be found. Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:47.687057 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a could not be found. Aug 29 15:45:47.691761 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.691761 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:47.691761 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.691761 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.691761 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:47.691761 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:47.691761 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:47.691761 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:47.691761 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a could not be found. Aug 29 15:45:47.691761 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.693097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6e96583c-a566-4b62-bb6f-aa0b3d010491 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Returning 404 to user: Instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:47.694946 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6e96583c-a566-4b62-bb6f-aa0b3d010491 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 404 len: 111 microversion: 2.1 time: 0.062479 Aug 29 15:45:47.699891 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2431/4728] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:47 2022] DELETE /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:47.705489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7ca77504-2409-4366-8cc1-f0229afba363 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:47.706371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7ca77504-2409-4366-8cc1-f0229afba363 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] [instance: ebc1d9ba-f64b-46cf-9006-0092135d5e7a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:47.713037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ca77504-2409-4366-8cc1-f0229afba363 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.714275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ca77504-2409-4366-8cc1-f0229afba363 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.714838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ca77504-2409-4366-8cc1-f0229afba363 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.715649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ca77504-2409-4366-8cc1-f0229afba363 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.716491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ca77504-2409-4366-8cc1-f0229afba363 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.717151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ca77504-2409-4366-8cc1-f0229afba363 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.752475 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-7ca77504-2409-4366-8cc1-f0229afba363 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] HTTP exception thrown: Instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a could not be found. Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7ca77504-2409-4366-8cc1-f0229afba363 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Request method failure captured: Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a HTTP/1.1 Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN4lGjWuBtP7IMH8HSwk8IArAW2Un5TRnhuxsWrM673TJoSMK_36MEx-0fGUi2H0QEZHaMoPWKZQoTLRYuljaJekjHyJMy7MOQAjg3gAnm3ahDfQDf2YzCRY-_mF_ajbSnqzHiKL4fgX0md_3rXTolDzVII-XHo4hByRxDyQdobEoY8 Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ad019754b47441d5a286666f8a048b48", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ad019754b47441d5a286666f8a048b48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad019754b47441d5a286666f8a048b48"}]}] Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: ad019754b47441d5a286666f8a048b48 Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ImagesTestJSON-1294850799 Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 71ae9af4779a4d50b9171ff9ca8b5207 Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ImagesTestJSON-1294850799-project Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a could not be found. Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'ebc1d9ba-f64b-46cf-9006-0092135d5e7a'} Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a could not be found. Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a could not be found. Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.758987 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:47.764136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:47.764136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:47.764136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:47.764136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:47.764136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a could not be found. Aug 29 15:45:47.764136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:47.764136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7ca77504-2409-4366-8cc1-f0229afba363 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] Returning 404 to user: Instance ebc1d9ba-f64b-46cf-9006-0092135d5e7a could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:47.767161 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7ca77504-2409-4366-8cc1-f0229afba363 tempest-ImagesTestJSON-1294850799 tempest-ImagesTestJSON-1294850799-project] 10.222.0.62 "GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a" status: 404 len: 111 microversion: 2.1 time: 0.064445 Aug 29 15:45:47.774467 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2432/4729] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:47 2022] GET /compute/v2.1/servers/ebc1d9ba-f64b-46cf-9006-0092135d5e7a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:47.783096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-279d908d-7802-4749-a57e-438b2b5e2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:47.783886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-279d908d-7802-4749-a57e-438b2b5e2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:47.793807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-279d908d-7802-4749-a57e-438b2b5e2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.794476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-279d908d-7802-4749-a57e-438b2b5e2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.795795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-279d908d-7802-4749-a57e-438b2b5e2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.796660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-279d908d-7802-4749-a57e-438b2b5e2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.797263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-279d908d-7802-4749-a57e-438b2b5e2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.797809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-279d908d-7802-4749-a57e-438b2b5e2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.928001 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-caee217b-8816-4022-a89f-7222e0c6be06 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "DELETE /compute/v2.1/os-security-groups/37e33f07-866a-4502-a0bb-c05f1f840cea" status: 202 len: 0 microversion: 2.1 time: 0.348962 Aug 29 15:45:47.928606 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2298/4730] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 15:45:47 2022] DELETE /compute/v2.1/os-security-groups/37e33f07-866a-4502-a0bb-c05f1f840cea => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:45:47.936706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cd822388-0574-4ec6-80b5-6b436577a3e6 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:47.937265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cd822388-0574-4ec6-80b5-6b436577a3e6 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:47.951661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd822388-0574-4ec6-80b5-6b436577a3e6 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.952185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd822388-0574-4ec6-80b5-6b436577a3e6 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.952643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd822388-0574-4ec6-80b5-6b436577a3e6 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.953635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd822388-0574-4ec6-80b5-6b436577a3e6 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.954098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd822388-0574-4ec6-80b5-6b436577a3e6 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.954527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd822388-0574-4ec6-80b5-6b436577a3e6 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.988636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cd822388-0574-4ec6-80b5-6b436577a3e6 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:48.157908 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cd822388-0574-4ec6-80b5-6b436577a3e6 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 204 len: 0 microversion: 2.1 time: 0.224589 Aug 29 15:45:48.158963 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2299/4731] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:47 2022] DELETE /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:45:48.177280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b372edf8-b4b4-416a-91ef-5635c1e9d287 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:48.179049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b372edf8-b4b4-416a-91ef-5635c1e9d287 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:48.188685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b372edf8-b4b4-416a-91ef-5635c1e9d287 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.189655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b372edf8-b4b4-416a-91ef-5635c1e9d287 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.190424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b372edf8-b4b4-416a-91ef-5635c1e9d287 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.191904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b372edf8-b4b4-416a-91ef-5635c1e9d287 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.192585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b372edf8-b4b4-416a-91ef-5635c1e9d287 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.193569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b372edf8-b4b4-416a-91ef-5635c1e9d287 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.239292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-279d908d-7802-4749-a57e-438b2b5e2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:48.253246 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-279d908d-7802-4749-a57e-438b2b5e2934 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1666 microversion: 2.1 time: 0.473891 Aug 29 15:45:48.255787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:48.256004 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2433/4732] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:47 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1666 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:48.271535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bf771154-068e-47e0-9e2d-615f2b0f1417 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:48.272473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bf771154-068e-47e0-9e2d-615f2b0f1417 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:48.284690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf771154-068e-47e0-9e2d-615f2b0f1417 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.285406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf771154-068e-47e0-9e2d-615f2b0f1417 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.286602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf771154-068e-47e0-9e2d-615f2b0f1417 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.287338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf771154-068e-47e0-9e2d-615f2b0f1417 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.287822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf771154-068e-47e0-9e2d-615f2b0f1417 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.288280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf771154-068e-47e0-9e2d-615f2b0f1417 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.448215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b372edf8-b4b4-416a-91ef-5635c1e9d287 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:48.457723 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b372edf8-b4b4-416a-91ef-5635c1e9d287 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1493 microversion: 2.1 time: 0.296648 Aug 29 15:45:48.477218 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2300/4733] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:48 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1493 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:48.483799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a0d4d120-a60b-447c-8f00-dec0836a5c68 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:48.485809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a0d4d120-a60b-447c-8f00-dec0836a5c68 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:48.493967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0d4d120-a60b-447c-8f00-dec0836a5c68 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.494735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0d4d120-a60b-447c-8f00-dec0836a5c68 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.495405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0d4d120-a60b-447c-8f00-dec0836a5c68 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.496442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0d4d120-a60b-447c-8f00-dec0836a5c68 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.497166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0d4d120-a60b-447c-8f00-dec0836a5c68 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.497808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0d4d120-a60b-447c-8f00-dec0836a5c68 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.619063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bf771154-068e-47e0-9e2d-615f2b0f1417 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:48.629046 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bf771154-068e-47e0-9e2d-615f2b0f1417 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1509 microversion: 2.1 time: 0.370628 Aug 29 15:45:48.630213 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2434/4734] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:48 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1509 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:48.635433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0bbddc2e-8cf5-41e1-8fa1-4e8869de0c8c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:48.635995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0bbddc2e-8cf5-41e1-8fa1-4e8869de0c8c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:48.642765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bbddc2e-8cf5-41e1-8fa1-4e8869de0c8c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.643549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bbddc2e-8cf5-41e1-8fa1-4e8869de0c8c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.644036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bbddc2e-8cf5-41e1-8fa1-4e8869de0c8c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.644833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bbddc2e-8cf5-41e1-8fa1-4e8869de0c8c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.645408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bbddc2e-8cf5-41e1-8fa1-4e8869de0c8c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.646030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0bbddc2e-8cf5-41e1-8fa1-4e8869de0c8c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.701203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a0d4d120-a60b-447c-8f00-dec0836a5c68 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:48.712640 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a0d4d120-a60b-447c-8f00-dec0836a5c68 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.233769 Aug 29 15:45:48.713803 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2301/4735] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:48 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:48.730133 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0bbddc2e-8cf5-41e1-8fa1-4e8869de0c8c tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "POST /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757/action" status: 202 len: 0 microversion: 2.1 time: 0.098271 Aug 29 15:45:48.731193 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2435/4736] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:48 2022] POST /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:48.741795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c29bc9c2-2152-42bc-9b09-51171997cd0d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:48.742788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c29bc9c2-2152-42bc-9b09-51171997cd0d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:48.749982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c29bc9c2-2152-42bc-9b09-51171997cd0d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.751053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c29bc9c2-2152-42bc-9b09-51171997cd0d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.751709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c29bc9c2-2152-42bc-9b09-51171997cd0d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.752881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c29bc9c2-2152-42bc-9b09-51171997cd0d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.753705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c29bc9c2-2152-42bc-9b09-51171997cd0d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.754531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c29bc9c2-2152-42bc-9b09-51171997cd0d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.980801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c29bc9c2-2152-42bc-9b09-51171997cd0d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:48.993481 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c29bc9c2-2152-42bc-9b09-51171997cd0d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1499 microversion: 2.1 time: 0.254428 Aug 29 15:45:48.994211 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2302/4737] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:48 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1499 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:49.282439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5416773e-9199-4844-a82a-63a8df4c3079 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:49.283446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5416773e-9199-4844-a82a-63a8df4c3079 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:49.299522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5416773e-9199-4844-a82a-63a8df4c3079 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.301700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5416773e-9199-4844-a82a-63a8df4c3079 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.307416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5416773e-9199-4844-a82a-63a8df4c3079 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.308376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5416773e-9199-4844-a82a-63a8df4c3079 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.309037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5416773e-9199-4844-a82a-63a8df4c3079 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.311115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5416773e-9199-4844-a82a-63a8df4c3079 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.611992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5416773e-9199-4844-a82a-63a8df4c3079 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:49.625947 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5416773e-9199-4844-a82a-63a8df4c3079 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.348560 Aug 29 15:45:49.627344 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2436/4738] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:49 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:49.651727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e8120f2b-2218-4f02-b4a2-e14cad6414d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:49.653159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-764f21e0-6573-4477-93c8-9fed42e07279 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:49.653994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-764f21e0-6573-4477-93c8-9fed42e07279 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:49.654824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e8120f2b-2218-4f02-b4a2-e14cad6414d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:49.669584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-764f21e0-6573-4477-93c8-9fed42e07279 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.671858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8120f2b-2218-4f02-b4a2-e14cad6414d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.672811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-764f21e0-6573-4477-93c8-9fed42e07279 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.673569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-764f21e0-6573-4477-93c8-9fed42e07279 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.675072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-764f21e0-6573-4477-93c8-9fed42e07279 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.675461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8120f2b-2218-4f02-b4a2-e14cad6414d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.676047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8120f2b-2218-4f02-b4a2-e14cad6414d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.676631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-764f21e0-6573-4477-93c8-9fed42e07279 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.677595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8120f2b-2218-4f02-b4a2-e14cad6414d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.678163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-764f21e0-6573-4477-93c8-9fed42e07279 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.686551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8120f2b-2218-4f02-b4a2-e14cad6414d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.687175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8120f2b-2218-4f02-b4a2-e14cad6414d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.908123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e8120f2b-2218-4f02-b4a2-e14cad6414d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:49.917305 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e8120f2b-2218-4f02-b4a2-e14cad6414d5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1669 microversion: 2.1 time: 0.273700 Aug 29 15:45:49.918315 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2303/4739] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:49 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1669 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:49.923187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1def365d-fce3-479f-a74f-5211ec97c2da tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:49.924024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1def365d-fce3-479f-a74f-5211ec97c2da tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:49.931058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1def365d-fce3-479f-a74f-5211ec97c2da tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.931951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1def365d-fce3-479f-a74f-5211ec97c2da tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.932521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1def365d-fce3-479f-a74f-5211ec97c2da tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.933981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1def365d-fce3-479f-a74f-5211ec97c2da tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.934950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1def365d-fce3-479f-a74f-5211ec97c2da tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.936921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1def365d-fce3-479f-a74f-5211ec97c2da tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.102667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1def365d-fce3-479f-a74f-5211ec97c2da tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.116229 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1def365d-fce3-479f-a74f-5211ec97c2da tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.196445 Aug 29 15:45:50.130229 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2304/4740] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:49 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:50.138587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:50.139359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:50.154021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:50.154808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:50.156368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.157166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:50.157640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:50.158379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.183592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-764f21e0-6573-4477-93c8-9fed42e07279 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.187702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:50.196339 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-764f21e0-6573-4477-93c8-9fed42e07279 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1509 microversion: 2.1 time: 0.549263 Aug 29 15:45:50.210447 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2437/4741] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:49 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1509 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:50.216445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c09e31d7-6280-4dbd-b5ac-089741d60f5d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:50.220700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c09e31d7-6280-4dbd-b5ac-089741d60f5d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:50.220856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:50.232506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c09e31d7-6280-4dbd-b5ac-089741d60f5d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:50.233315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c09e31d7-6280-4dbd-b5ac-089741d60f5d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:50.233959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c09e31d7-6280-4dbd-b5ac-089741d60f5d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.234861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c09e31d7-6280-4dbd-b5ac-089741d60f5d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:50.235493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c09e31d7-6280-4dbd-b5ac-089741d60f5d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:50.236372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c09e31d7-6280-4dbd-b5ac-089741d60f5d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.239311 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.compute.api [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Working on deleting snapshot 0a8da707-76cb-4dc5-b7de-7d8b2ae7183d from shelved instance... Aug 29 15:45:50.588185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c09e31d7-6280-4dbd-b5ac-089741d60f5d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.604267 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c09e31d7-6280-4dbd-b5ac-089741d60f5d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1499 microversion: 2.1 time: 0.392394 Aug 29 15:45:50.604871 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2438/4742] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:50 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1499 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:51.094506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Doing local delete in cell dcf211bc-da73-4d63-b885-2b9e7c1e329b(cell1) {{(pid=122361) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 29 15:45:51.096010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.096659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.097353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.097964 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.compute.api [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 29 15:45:51.102163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] deallocate_for_instance() {{(pid=122361) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 29 15:45:51.154309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8c8da07d-b67a-4aeb-a796-264ae7ccadbf tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:51.157383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8c8da07d-b67a-4aeb-a796-264ae7ccadbf tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:51.170221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c8da07d-b67a-4aeb-a796-264ae7ccadbf tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.171560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c8da07d-b67a-4aeb-a796-264ae7ccadbf tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.172307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c8da07d-b67a-4aeb-a796-264ae7ccadbf tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.173502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c8da07d-b67a-4aeb-a796-264ae7ccadbf tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.174230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c8da07d-b67a-4aeb-a796-264ae7ccadbf tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.175890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c8da07d-b67a-4aeb-a796-264ae7ccadbf tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.535967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8c8da07d-b67a-4aeb-a796-264ae7ccadbf tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:51.550687 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8c8da07d-b67a-4aeb-a796-264ae7ccadbf tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.411744 Aug 29 15:45:51.553437 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2439/4743] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:51 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:51.561480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-45cb6463-a2a4-4565-9dce-a306bef1ec1e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:51.565367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-45cb6463-a2a4-4565-9dce-a306bef1ec1e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:51.584747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cb6463-a2a4-4565-9dce-a306bef1ec1e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.586561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cb6463-a2a4-4565-9dce-a306bef1ec1e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.602200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cb6463-a2a4-4565-9dce-a306bef1ec1e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.604623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cb6463-a2a4-4565-9dce-a306bef1ec1e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.605510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cb6463-a2a4-4565-9dce-a306bef1ec1e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.607104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cb6463-a2a4-4565-9dce-a306bef1ec1e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.955441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Updating instance_info_cache with network_info: [] {{(pid=122361) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:45:52.050468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-45cb6463-a2a4-4565-9dce-a306bef1ec1e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.078450 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-45cb6463-a2a4-4565-9dce-a306bef1ec1e tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1509 microversion: 2.1 time: 0.517869 Aug 29 15:45:52.082871 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2440/4744] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:51 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1509 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:52.095979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7b540598-7b7b-45dc-b9da-0c5eb040969d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:52.107228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7b540598-7b7b-45dc-b9da-0c5eb040969d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:52.138380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b540598-7b7b-45dc-b9da-0c5eb040969d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.140354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b540598-7b7b-45dc-b9da-0c5eb040969d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.141526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b540598-7b7b-45dc-b9da-0c5eb040969d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.143676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b540598-7b7b-45dc-b9da-0c5eb040969d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.146112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b540598-7b7b-45dc-b9da-0c5eb040969d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.148367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b540598-7b7b-45dc-b9da-0c5eb040969d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.457651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:52.557512 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c6cb329c-3ba7-4261-b9ca-ac473b1ae41f tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "DELETE /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 204 len: 0 microversion: 2.1 time: 2.425240 Aug 29 15:45:52.558369 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2305/4745] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:50 2022] DELETE /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 0 bytes in 2427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:45:52.560645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7b540598-7b7b-45dc-b9da-0c5eb040969d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.565173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b17c87dd-ea94-4fa9-87c0-a43592fd8524 req-ab084ae7-db70-4340-ab95-c174d4109acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824db4a3-47bf-494c-b490-d7631b6d9d54", "name": "network-vif-deleted", "tag": "98e91a7f-1a84-4261-8c1b-359bdbdb9f7e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:52.572945 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7b540598-7b7b-45dc-b9da-0c5eb040969d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1502 microversion: 2.1 time: 0.484583 Aug 29 15:45:52.573643 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2441/4746] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:52 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1502 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:52.583390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b17c87dd-ea94-4fa9-87c0-a43592fd8524 req-ab084ae7-db70-4340-ab95-c174d4109acf service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.583390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b17c87dd-ea94-4fa9-87c0-a43592fd8524 req-ab084ae7-db70-4340-ab95-c174d4109acf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.583390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b17c87dd-ea94-4fa9-87c0-a43592fd8524 req-ab084ae7-db70-4340-ab95-c174d4109acf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.583674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24d24f74-9be4-4258-b846-d071a98f1c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:52.583674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-24d24f74-9be4-4258-b846-d071a98f1c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 824db4a3-47bf-494c-b490-d7631b6d9d54] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:52.588067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24d24f74-9be4-4258-b846-d071a98f1c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.588766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24d24f74-9be4-4258-b846-d071a98f1c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.589484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24d24f74-9be4-4258-b846-d071a98f1c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.590621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24d24f74-9be4-4258-b846-d071a98f1c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.591093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24d24f74-9be4-4258-b846-d071a98f1c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.591595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24d24f74-9be4-4258-b846-d071a98f1c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.608233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.compute.server_external_events [req-b17c87dd-ea94-4fa9-87c0-a43592fd8524 req-ab084ae7-db70-4340-ab95-c174d4109acf service nova] Unable to find a host for instance 824db4a3-47bf-494c-b490-d7631b6d9d54. Dropping event network-vif-deleted {{(pid=122361) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 15:45:52.609198 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b17c87dd-ea94-4fa9-87c0-a43592fd8524 req-ab084ae7-db70-4340-ab95-c174d4109acf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.049528 Aug 29 15:45:52.612937 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2306/4747] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 15:45:52.618619 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-24d24f74-9be4-4258-b846-d071a98f1c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] HTTP exception thrown: Instance 824db4a3-47bf-494c-b490-d7631b6d9d54 could not be found. Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24d24f74-9be4-4258-b846-d071a98f1c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Request method failure captured: Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 HTTP/1.1 Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNyVUDTEVho31pZrDnlkVTpcEwslkOPd4iXBEcswKKT8qNvwbqvdNTz64d_m2JkSIgvffpQavLVnlSeN63E26PHHp1t69vN5c_7nv_4r8WgVQdv00nmt_4DxArl83JZzGr3H5WvWvTPBCc47knjE4WwZ8pU378_W4AEE4iwO_16SxpM Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 990c752c7bb141c1bf496c98fbc3c9a7 Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_990c752c7bb141c1bf496c98fbc3c9a7", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/990c752c7bb141c1bf496c98fbc3c9a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/990c752c7bb141c1bf496c98fbc3c9a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/990c752c7bb141c1bf496c98fbc3c9a7"}]}] Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 990c752c7bb141c1bf496c98fbc3c9a7 Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerActionsTestJSON-1192262438-project Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 51efa71a8bfe457982698a5755ae3cc6 Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerActionsTestJSON-1192262438-project Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 824db4a3-47bf-494c-b490-d7631b6d9d54 could not be found. Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '824db4a3-47bf-494c-b490-d7631b6d9d54'} Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824db4a3-47bf-494c-b490-d7631b6d9d54 could not be found. Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824db4a3-47bf-494c-b490-d7631b6d9d54 could not be found. Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:52.620430 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:52.625276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:52.625276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:52.625276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:52.625276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:52.625276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:52.625276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824db4a3-47bf-494c-b490-d7631b6d9d54 could not be found. Aug 29 15:45:52.625276 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:52.625276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24d24f74-9be4-4258-b846-d071a98f1c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Returning 404 to user: Instance 824db4a3-47bf-494c-b490-d7631b6d9d54 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:52.629117 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-24d24f74-9be4-4258-b846-d071a98f1c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54" status: 404 len: 111 microversion: 2.1 time: 0.049090 Aug 29 15:45:52.630497 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2442/4748] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:52 2022] GET /compute/v2.1/servers/824db4a3-47bf-494c-b490-d7631b6d9d54 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:52.631061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-582de7d7-3a07-42b1-96d6-f4ac625aed87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:52.633373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-582de7d7-3a07-42b1-96d6-f4ac625aed87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:52.643129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-582de7d7-3a07-42b1-96d6-f4ac625aed87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.643862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-582de7d7-3a07-42b1-96d6-f4ac625aed87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.644704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-582de7d7-3a07-42b1-96d6-f4ac625aed87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.645977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-582de7d7-3a07-42b1-96d6-f4ac625aed87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.652697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c1bcf626-925b-4e47-9aa8-d25e79235e57 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:52.653552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c1bcf626-925b-4e47-9aa8-d25e79235e57 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:52.658871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-582de7d7-3a07-42b1-96d6-f4ac625aed87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.659433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-582de7d7-3a07-42b1-96d6-f4ac625aed87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.664493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bcf626-925b-4e47-9aa8-d25e79235e57 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.665856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bcf626-925b-4e47-9aa8-d25e79235e57 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.666989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bcf626-925b-4e47-9aa8-d25e79235e57 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.668923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bcf626-925b-4e47-9aa8-d25e79235e57 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.669697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bcf626-925b-4e47-9aa8-d25e79235e57 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.670313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bcf626-925b-4e47-9aa8-d25e79235e57 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.740057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-c1bcf626-925b-4e47-9aa8-d25e79235e57 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lazy-loading 'flavor' on Instance uuid cd640d6c-9838-43b8-b1ab-d38a1b38b757 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:52.869226 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c1bcf626-925b-4e47-9aa8-d25e79235e57 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "POST /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757/action" status: 202 len: 0 microversion: 2.1 time: 0.236551 Aug 29 15:45:52.874998 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2443/4749] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:52 2022] POST /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:52.884146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dac21ddb-2274-47e3-87f8-251d1abc746d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:52.885529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dac21ddb-2274-47e3-87f8-251d1abc746d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:52.894080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dac21ddb-2274-47e3-87f8-251d1abc746d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.894552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dac21ddb-2274-47e3-87f8-251d1abc746d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.895233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dac21ddb-2274-47e3-87f8-251d1abc746d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.896157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dac21ddb-2274-47e3-87f8-251d1abc746d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.897279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dac21ddb-2274-47e3-87f8-251d1abc746d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.899776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dac21ddb-2274-47e3-87f8-251d1abc746d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.942166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dac21ddb-2274-47e3-87f8-251d1abc746d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:52.955066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-582de7d7-3a07-42b1-96d6-f4ac625aed87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.981509 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-582de7d7-3a07-42b1-96d6-f4ac625aed87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.366918 Aug 29 15:45:52.995512 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2307/4750] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:52 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:53.007224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c4719564-b97b-4a21-a199-c2464026d3a7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:53.008532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c4719564-b97b-4a21-a199-c2464026d3a7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:53.029738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4719564-b97b-4a21-a199-c2464026d3a7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.030555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4719564-b97b-4a21-a199-c2464026d3a7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.031158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4719564-b97b-4a21-a199-c2464026d3a7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.032126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4719564-b97b-4a21-a199-c2464026d3a7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.032773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4719564-b97b-4a21-a199-c2464026d3a7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.033512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c4719564-b97b-4a21-a199-c2464026d3a7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.088852 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c4719564-b97b-4a21-a199-c2464026d3a7 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments/df7a8b8d-ae22-4bfb-9cb6-803efccce96c" status: 200 len: 194 microversion: 2.1 time: 0.087034 Aug 29 15:45:53.090223 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2308/4751] 10.222.0.62 () {58 vars in 1413 bytes} [Mon Aug 29 15:45:52 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments/df7a8b8d-ae22-4bfb-9cb6-803efccce96c => generated 194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:53.124502 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dac21ddb-2274-47e3-87f8-251d1abc746d tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 204 len: 0 microversion: 2.1 time: 0.246904 Aug 29 15:45:53.125599 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2444/4752] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:52 2022] DELETE /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:45:53.131421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-57800b43-6bd2-4851-9751-82e009f7bd88 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:53.132476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-57800b43-6bd2-4851-9751-82e009f7bd88 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:53.135277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-045706e0-c626-46e1-913b-087247bed056 req-e0403991-0701-4206-ac2d-685e38bcc50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb6aed9-8901-4e68-8a40-21dc9e2f690c", "name": "network-vif-deleted", "tag": "9dad9642-2fa5-4f48-9928-cc4aebbe2498"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:53.148808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57800b43-6bd2-4851-9751-82e009f7bd88 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.149294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57800b43-6bd2-4851-9751-82e009f7bd88 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.149748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57800b43-6bd2-4851-9751-82e009f7bd88 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.150559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57800b43-6bd2-4851-9751-82e009f7bd88 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.151035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57800b43-6bd2-4851-9751-82e009f7bd88 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.151521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57800b43-6bd2-4851-9751-82e009f7bd88 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.153241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-045706e0-c626-46e1-913b-087247bed056 req-e0403991-0701-4206-ac2d-685e38bcc50d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.154339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-045706e0-c626-46e1-913b-087247bed056 req-e0403991-0701-4206-ac2d-685e38bcc50d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.155067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-045706e0-c626-46e1-913b-087247bed056 req-e0403991-0701-4206-ac2d-685e38bcc50d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.172174 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-045706e0-c626-46e1-913b-087247bed056 req-e0403991-0701-4206-ac2d-685e38bcc50d service nova] Creating event network-vif-deleted:9dad9642-2fa5-4f48-9928-cc4aebbe2498 for instance 4cb6aed9-8901-4e68-8a40-21dc9e2f690c on n-h1-839401-11 Aug 29 15:45:53.179823 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-045706e0-c626-46e1-913b-087247bed056 req-e0403991-0701-4206-ac2d-685e38bcc50d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048959 Aug 29 15:45:53.180737 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2445/4753] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:53.186987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b8482426-c64c-4e50-935c-8909ae5dca9d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:53.187580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b8482426-c64c-4e50-935c-8909ae5dca9d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:53.197636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8482426-c64c-4e50-935c-8909ae5dca9d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.198138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8482426-c64c-4e50-935c-8909ae5dca9d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.198582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8482426-c64c-4e50-935c-8909ae5dca9d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.199362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8482426-c64c-4e50-935c-8909ae5dca9d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.199831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8482426-c64c-4e50-935c-8909ae5dca9d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.200571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8482426-c64c-4e50-935c-8909ae5dca9d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.316939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-b8482426-c64c-4e50-935c-8909ae5dca9d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lazy-loading 'services' on Instance uuid 89dfeae0-3079-4a17-bc65-7ad03318e731 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:53.360466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-57800b43-6bd2-4851-9751-82e009f7bd88 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:53.370505 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-57800b43-6bd2-4851-9751-82e009f7bd88 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1510 microversion: 2.1 time: 0.277165 Aug 29 15:45:53.381896 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2309/4754] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:53 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1510 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:53.393180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d1395c35-8bca-40f8-8743-5cdafa0bd257 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:53.394196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d1395c35-8bca-40f8-8743-5cdafa0bd257 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:53.402180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1395c35-8bca-40f8-8743-5cdafa0bd257 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.402978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1395c35-8bca-40f8-8743-5cdafa0bd257 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.403771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1395c35-8bca-40f8-8743-5cdafa0bd257 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.404845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1395c35-8bca-40f8-8743-5cdafa0bd257 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.405637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1395c35-8bca-40f8-8743-5cdafa0bd257 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.406437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1395c35-8bca-40f8-8743-5cdafa0bd257 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.438855 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b8482426-c64c-4e50-935c-8909ae5dca9d tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "DELETE /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments/df7a8b8d-ae22-4bfb-9cb6-803efccce96c" status: 202 len: 0 microversion: 2.1 time: 0.256076 Aug 29 15:45:53.440837 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2446/4755] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 15:45:53 2022] DELETE /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments/df7a8b8d-ae22-4bfb-9cb6-803efccce96c => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:53.449690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-510729c1-426c-463e-925f-2a7ae61d0143 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:53.450902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-510729c1-426c-463e-925f-2a7ae61d0143 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:53.459000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-510729c1-426c-463e-925f-2a7ae61d0143 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.459648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-510729c1-426c-463e-925f-2a7ae61d0143 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.460208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-510729c1-426c-463e-925f-2a7ae61d0143 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.461141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-510729c1-426c-463e-925f-2a7ae61d0143 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.461672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-510729c1-426c-463e-925f-2a7ae61d0143 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.462244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-510729c1-426c-463e-925f-2a7ae61d0143 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.517123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d1395c35-8bca-40f8-8743-5cdafa0bd257 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:53.528412 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d1395c35-8bca-40f8-8743-5cdafa0bd257 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1293 microversion: 2.1 time: 0.140367 Aug 29 15:45:53.530020 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2310/4756] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:53 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1293 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:53.656924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-510729c1-426c-463e-925f-2a7ae61d0143 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:53.667554 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-510729c1-426c-463e-925f-2a7ae61d0143 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1465 microversion: 2.1 time: 0.224517 Aug 29 15:45:53.668173 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2447/4757] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:53 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1465 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:54.007912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-df878c03-7662-41b0-b768-dccfb10056fb tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:54.008540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-df878c03-7662-41b0-b768-dccfb10056fb tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:54.019660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df878c03-7662-41b0-b768-dccfb10056fb tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.021368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df878c03-7662-41b0-b768-dccfb10056fb tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.022096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df878c03-7662-41b0-b768-dccfb10056fb tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.022983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df878c03-7662-41b0-b768-dccfb10056fb tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.023669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df878c03-7662-41b0-b768-dccfb10056fb tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.024258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df878c03-7662-41b0-b768-dccfb10056fb tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.053484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:54.292608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-df878c03-7662-41b0-b768-dccfb10056fb tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:54.303972 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-df878c03-7662-41b0-b768-dccfb10056fb tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.302060 Aug 29 15:45:54.318754 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2311/4758] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:54 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:54.394275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2ba493bd-d9be-4bb1-bfb0-c5a6142b7ae9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:54.394896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2ba493bd-d9be-4bb1-bfb0-c5a6142b7ae9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:54.409313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:54.411360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ba493bd-d9be-4bb1-bfb0-c5a6142b7ae9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.411929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ba493bd-d9be-4bb1-bfb0-c5a6142b7ae9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.413035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ba493bd-d9be-4bb1-bfb0-c5a6142b7ae9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.413905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ba493bd-d9be-4bb1-bfb0-c5a6142b7ae9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.414380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ba493bd-d9be-4bb1-bfb0-c5a6142b7ae9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.414855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ba493bd-d9be-4bb1-bfb0-c5a6142b7ae9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.556771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5744ecb7-bda5-42c0-bd33-4a6c30edde79 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:54.558713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5744ecb7-bda5-42c0-bd33-4a6c30edde79 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:54.572111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5744ecb7-bda5-42c0-bd33-4a6c30edde79 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.573966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5744ecb7-bda5-42c0-bd33-4a6c30edde79 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.575548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5744ecb7-bda5-42c0-bd33-4a6c30edde79 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.576315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5744ecb7-bda5-42c0-bd33-4a6c30edde79 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.576797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5744ecb7-bda5-42c0-bd33-4a6c30edde79 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.577264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5744ecb7-bda5-42c0-bd33-4a6c30edde79 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.670328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5744ecb7-bda5-42c0-bd33-4a6c30edde79 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.671036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5744ecb7-bda5-42c0-bd33-4a6c30edde79 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.671483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5744ecb7-bda5-42c0-bd33-4a6c30edde79 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.672659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-5744ecb7-bda5-42c0-bd33-4a6c30edde79 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lazy-loading 'fault' on Instance uuid 4cb6aed9-8901-4e68-8a40-21dc9e2f690c {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:54.735963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5744ecb7-bda5-42c0-bd33-4a6c30edde79 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f81a0a727d4a3c9274213715d7735d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601b0333e91644768c5f6d7f4f717108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:54.744606 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5744ecb7-bda5-42c0-bd33-4a6c30edde79 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 200 len: 1312 microversion: 2.1 time: 0.194252 Aug 29 15:45:54.750486 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2312/4759] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:54 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 1312 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:54.758036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bc8c7549-9119-4610-a662-5763833513b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:54.759863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bc8c7549-9119-4610-a662-5763833513b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:54.776480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc8c7549-9119-4610-a662-5763833513b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.777204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc8c7549-9119-4610-a662-5763833513b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.777794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc8c7549-9119-4610-a662-5763833513b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.778915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc8c7549-9119-4610-a662-5763833513b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.779613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc8c7549-9119-4610-a662-5763833513b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.780148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bc8c7549-9119-4610-a662-5763833513b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.838048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2ba493bd-d9be-4bb1-bfb0-c5a6142b7ae9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:54.860218 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2ba493bd-d9be-4bb1-bfb0-c5a6142b7ae9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1493 microversion: 2.1 time: 0.469514 Aug 29 15:45:54.861422 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2448/4760] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:54 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1493 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:54.887902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ce04c469-539c-4f8e-a774-b7deed32b7c1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:54.888750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ce04c469-539c-4f8e-a774-b7deed32b7c1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:54.920235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce04c469-539c-4f8e-a774-b7deed32b7c1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.923936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce04c469-539c-4f8e-a774-b7deed32b7c1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.924871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce04c469-539c-4f8e-a774-b7deed32b7c1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.927406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce04c469-539c-4f8e-a774-b7deed32b7c1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.928141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce04c469-539c-4f8e-a774-b7deed32b7c1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.930308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce04c469-539c-4f8e-a774-b7deed32b7c1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.933757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bc8c7549-9119-4610-a662-5763833513b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:54.944366 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bc8c7549-9119-4610-a662-5763833513b4 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1465 microversion: 2.1 time: 0.191699 Aug 29 15:45:54.947791 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2313/4761] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:54 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1465 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:55.026187 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ce04c469-539c-4f8e-a774-b7deed32b7c1 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "POST /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757/action" status: 202 len: 0 microversion: 2.1 time: 0.144271 Aug 29 15:45:55.027343 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2449/4762] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:54 2022] POST /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:55.035944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1e0cabd8-f58d-4f67-989d-00dff53f4cdc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:55.036561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1e0cabd8-f58d-4f67-989d-00dff53f4cdc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:55.050021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e0cabd8-f58d-4f67-989d-00dff53f4cdc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:55.050659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e0cabd8-f58d-4f67-989d-00dff53f4cdc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:55.051228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e0cabd8-f58d-4f67-989d-00dff53f4cdc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:55.053391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e0cabd8-f58d-4f67-989d-00dff53f4cdc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:55.054324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e0cabd8-f58d-4f67-989d-00dff53f4cdc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:55.055283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e0cabd8-f58d-4f67-989d-00dff53f4cdc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:55.352513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e3fb76d0-08b0-4bc7-9604-d48bb058a555 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:55.353904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e3fb76d0-08b0-4bc7-9604-d48bb058a555 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:55.366415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3fb76d0-08b0-4bc7-9604-d48bb058a555 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:55.367862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3fb76d0-08b0-4bc7-9604-d48bb058a555 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:55.368514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3fb76d0-08b0-4bc7-9604-d48bb058a555 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:55.370619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3fb76d0-08b0-4bc7-9604-d48bb058a555 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:55.375989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3fb76d0-08b0-4bc7-9604-d48bb058a555 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:55.377541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3fb76d0-08b0-4bc7-9604-d48bb058a555 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:55.393298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1e0cabd8-f58d-4f67-989d-00dff53f4cdc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:55.405310 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1e0cabd8-f58d-4f67-989d-00dff53f4cdc tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1499 microversion: 2.1 time: 0.373408 Aug 29 15:45:55.407619 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2314/4763] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:55 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1499 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:55.780362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2ba34cbb-1307-473e-a1f4-c202ce5ca502 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:55.783430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2ba34cbb-1307-473e-a1f4-c202ce5ca502 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] [instance: 4cb6aed9-8901-4e68-8a40-21dc9e2f690c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:55.794113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ba34cbb-1307-473e-a1f4-c202ce5ca502 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:55.795013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ba34cbb-1307-473e-a1f4-c202ce5ca502 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:55.795870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ba34cbb-1307-473e-a1f4-c202ce5ca502 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:55.797851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ba34cbb-1307-473e-a1f4-c202ce5ca502 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:55.798578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ba34cbb-1307-473e-a1f4-c202ce5ca502 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:55.799474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ba34cbb-1307-473e-a1f4-c202ce5ca502 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:55.833374 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-2ba34cbb-1307-473e-a1f4-c202ce5ca502 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] HTTP exception thrown: Instance 4cb6aed9-8901-4e68-8a40-21dc9e2f690c could not be found. Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2ba34cbb-1307-473e-a1f4-c202ce5ca502 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Request method failure captured: Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c HTTP/1.1 Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN7l3U9Hplwn2KLvJgUjJmBNa_FEIGMsGB1zyZKQ1vRO7du9DrzfWbuRdgnOuAwo2_gXfdl316A6C9AVP5abvood3pl0ovGxyzTbOStPawOOoogqszBOornjq49SW4I-QqSFbgMtU7nI2gDI-AkN-Uluj-zER6WevL3ZfUKijcUW7YM Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 601b0333e91644768c5f6d7f4f717108 Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2133347346 Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_601b0333e91644768c5f6d7f4f717108", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/601b0333e91644768c5f6d7f4f717108"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/601b0333e91644768c5f6d7f4f717108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/601b0333e91644768c5f6d7f4f717108"}]}] Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2133347346 Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 601b0333e91644768c5f6d7f4f717108 Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2133347346 Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerRescueTestJSONUnderV235-2133347346-project Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 98f81a0a727d4a3c9274213715d7735d Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2133347346-project Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 4cb6aed9-8901-4e68-8a40-21dc9e2f690c could not be found. Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '4cb6aed9-8901-4e68-8a40-21dc9e2f690c'} Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cb6aed9-8901-4e68-8a40-21dc9e2f690c could not be found. Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cb6aed9-8901-4e68-8a40-21dc9e2f690c could not be found. Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:55.835773 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:55.841337 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:55.841337 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:55.841337 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:55.841337 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:55.841337 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:55.841337 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:55.841337 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cb6aed9-8901-4e68-8a40-21dc9e2f690c could not be found. Aug 29 15:45:55.841337 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:45:55.844951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2ba34cbb-1307-473e-a1f4-c202ce5ca502 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] Returning 404 to user: Instance 4cb6aed9-8901-4e68-8a40-21dc9e2f690c could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:55.846184 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2ba34cbb-1307-473e-a1f4-c202ce5ca502 tempest-ServerRescueTestJSONUnderV235-2133347346 tempest-ServerRescueTestJSONUnderV235-2133347346-project] 10.222.0.62 "GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c" status: 404 len: 111 microversion: 2.1 time: 0.072402 Aug 29 15:45:55.851121 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2315/4764] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:55 2022] GET /compute/v2.1/servers/4cb6aed9-8901-4e68-8a40-21dc9e2f690c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:45:55.972351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4f3f87bf-ddd7-43b9-b31b-3576abcb2075 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:55.973609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4f3f87bf-ddd7-43b9-b31b-3576abcb2075 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:55.983977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f3f87bf-ddd7-43b9-b31b-3576abcb2075 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:55.984934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f3f87bf-ddd7-43b9-b31b-3576abcb2075 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:55.985937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f3f87bf-ddd7-43b9-b31b-3576abcb2075 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:55.993903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e3fb76d0-08b0-4bc7-9604-d48bb058a555 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.002699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:56.006098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f3f87bf-ddd7-43b9-b31b-3576abcb2075 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.007654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f3f87bf-ddd7-43b9-b31b-3576abcb2075 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.010059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f3f87bf-ddd7-43b9-b31b-3576abcb2075 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.024219 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e3fb76d0-08b0-4bc7-9604-d48bb058a555 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.685356 Aug 29 15:45:56.026200 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2450/4765] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:55 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:56.246862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4f3f87bf-ddd7-43b9-b31b-3576abcb2075 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.255133 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4f3f87bf-ddd7-43b9-b31b-3576abcb2075 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1465 microversion: 2.1 time: 0.288851 Aug 29 15:45:56.269496 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2316/4766] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:55 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1465 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:56.430957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f2b73957-d248-46c1-b037-af154d5d19e9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:56.432187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f2b73957-d248-46c1-b037-af154d5d19e9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:56.443019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2b73957-d248-46c1-b037-af154d5d19e9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.443848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2b73957-d248-46c1-b037-af154d5d19e9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.444498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2b73957-d248-46c1-b037-af154d5d19e9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.445567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2b73957-d248-46c1-b037-af154d5d19e9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.447426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2b73957-d248-46c1-b037-af154d5d19e9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.448075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2b73957-d248-46c1-b037-af154d5d19e9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.883080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f2b73957-d248-46c1-b037-af154d5d19e9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.901044 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f2b73957-d248-46c1-b037-af154d5d19e9 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1499 microversion: 2.1 time: 0.476820 Aug 29 15:45:56.915718 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2451/4767] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:56 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1499 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:56.924663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-327e3cd4-b695-4e89-8454-a6b661604ca3 req-f99acf01-5e44-40d5-8a77-bd428682aced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea38e358-61dd-41e2-a08f-10e9f4711489", "name": "network-vif-deleted", "tag": "61c1d158-dd30-47f3-9abd-0a32e7fb20a2"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:56.941215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-327e3cd4-b695-4e89-8454-a6b661604ca3 req-f99acf01-5e44-40d5-8a77-bd428682aced service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.941865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-327e3cd4-b695-4e89-8454-a6b661604ca3 req-f99acf01-5e44-40d5-8a77-bd428682aced service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.942555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-327e3cd4-b695-4e89-8454-a6b661604ca3 req-f99acf01-5e44-40d5-8a77-bd428682aced service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.956443 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-327e3cd4-b695-4e89-8454-a6b661604ca3 req-f99acf01-5e44-40d5-8a77-bd428682aced service nova] Creating event network-vif-deleted:61c1d158-dd30-47f3-9abd-0a32e7fb20a2 for instance ea38e358-61dd-41e2-a08f-10e9f4711489 on n-h1-839401-11 Aug 29 15:45:56.967362 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-327e3cd4-b695-4e89-8454-a6b661604ca3 req-f99acf01-5e44-40d5-8a77-bd428682aced service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048595 Aug 29 15:45:56.968140 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2317/4768] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:45:57.048890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c0b0960d-e31f-4c75-bc08-60f121512bfa tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:57.050416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c0b0960d-e31f-4c75-bc08-60f121512bfa tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:57.061226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0b0960d-e31f-4c75-bc08-60f121512bfa tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.061956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0b0960d-e31f-4c75-bc08-60f121512bfa tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.062612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0b0960d-e31f-4c75-bc08-60f121512bfa tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.064040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0b0960d-e31f-4c75-bc08-60f121512bfa tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.064514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0b0960d-e31f-4c75-bc08-60f121512bfa tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.065564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0b0960d-e31f-4c75-bc08-60f121512bfa tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.279432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-af299063-1f4e-4c0d-b650-7020545bb6ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:57.280238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-af299063-1f4e-4c0d-b650-7020545bb6ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:57.294905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af299063-1f4e-4c0d-b650-7020545bb6ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.298799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af299063-1f4e-4c0d-b650-7020545bb6ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.299804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af299063-1f4e-4c0d-b650-7020545bb6ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.302485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af299063-1f4e-4c0d-b650-7020545bb6ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.302979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af299063-1f4e-4c0d-b650-7020545bb6ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.305935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af299063-1f4e-4c0d-b650-7020545bb6ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.332401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c0b0960d-e31f-4c75-bc08-60f121512bfa tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:57.343010 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c0b0960d-e31f-4c75-bc08-60f121512bfa tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.299539 Aug 29 15:45:57.346569 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2452/4769] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:57 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:57.370054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af299063-1f4e-4c0d-b650-7020545bb6ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.371001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af299063-1f4e-4c0d-b650-7020545bb6ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.371608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af299063-1f4e-4c0d-b650-7020545bb6ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.372878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-af299063-1f4e-4c0d-b650-7020545bb6ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lazy-loading 'fault' on Instance uuid ea38e358-61dd-41e2-a08f-10e9f4711489 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:57.431463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-af299063-1f4e-4c0d-b650-7020545bb6ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:57.447721 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-af299063-1f4e-4c0d-b650-7020545bb6ac tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 200 len: 1305 microversion: 2.1 time: 0.173521 Aug 29 15:45:57.449061 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2318/4770] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:57 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 1305 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:57.922353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-11ac9ada-de7d-4981-8f48-6ebcbcfc151d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:57.922981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-11ac9ada-de7d-4981-8f48-6ebcbcfc151d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:57.934101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11ac9ada-de7d-4981-8f48-6ebcbcfc151d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.934611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11ac9ada-de7d-4981-8f48-6ebcbcfc151d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.935060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11ac9ada-de7d-4981-8f48-6ebcbcfc151d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.935781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11ac9ada-de7d-4981-8f48-6ebcbcfc151d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.936241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11ac9ada-de7d-4981-8f48-6ebcbcfc151d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.936674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11ac9ada-de7d-4981-8f48-6ebcbcfc151d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.187436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-11ac9ada-de7d-4981-8f48-6ebcbcfc151d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:58.198154 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-11ac9ada-de7d-4981-8f48-6ebcbcfc151d tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1502 microversion: 2.1 time: 0.279743 Aug 29 15:45:58.200837 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2453/4771] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:57 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1502 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:58.228209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bf2159ef-d7eb-4bd9-bd9b-bca6474bdb59 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:58.229536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bf2159ef-d7eb-4bd9-bd9b-bca6474bdb59 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:58.238705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf2159ef-d7eb-4bd9-bd9b-bca6474bdb59 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.239547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf2159ef-d7eb-4bd9-bd9b-bca6474bdb59 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.240064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf2159ef-d7eb-4bd9-bd9b-bca6474bdb59 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.240879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf2159ef-d7eb-4bd9-bd9b-bca6474bdb59 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.241374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf2159ef-d7eb-4bd9-bd9b-bca6474bdb59 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.242020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf2159ef-d7eb-4bd9-bd9b-bca6474bdb59 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.270175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bf2159ef-d7eb-4bd9-bd9b-bca6474bdb59 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:58.365950 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bf2159ef-d7eb-4bd9-bd9b-bca6474bdb59 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 204 len: 0 microversion: 2.1 time: 0.145171 Aug 29 15:45:58.367091 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2319/4772] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:58 2022] DELETE /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:45:58.370969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b1549b3f-377b-4652-a0b9-4cd770e67b2c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:58.371600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b1549b3f-377b-4652-a0b9-4cd770e67b2c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:58.379396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dab1cedc-bdad-4540-aa87-97993a86d306 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:58.380416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1549b3f-377b-4652-a0b9-4cd770e67b2c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.380609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dab1cedc-bdad-4540-aa87-97993a86d306 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:58.381121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1549b3f-377b-4652-a0b9-4cd770e67b2c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.381724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1549b3f-377b-4652-a0b9-4cd770e67b2c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.382447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1549b3f-377b-4652-a0b9-4cd770e67b2c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.388192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dab1cedc-bdad-4540-aa87-97993a86d306 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.388805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dab1cedc-bdad-4540-aa87-97993a86d306 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.389477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dab1cedc-bdad-4540-aa87-97993a86d306 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.390213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dab1cedc-bdad-4540-aa87-97993a86d306 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.390679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dab1cedc-bdad-4540-aa87-97993a86d306 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.391107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dab1cedc-bdad-4540-aa87-97993a86d306 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.393883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1549b3f-377b-4652-a0b9-4cd770e67b2c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.394631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1549b3f-377b-4652-a0b9-4cd770e67b2c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.586064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b1549b3f-377b-4652-a0b9-4cd770e67b2c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:58.595586 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b1549b3f-377b-4652-a0b9-4cd770e67b2c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.229862 Aug 29 15:45:58.609260 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2454/4773] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:58 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:58.614598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1a7c0a30-f70b-401b-9087-44c5c89e3c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:58.615402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1a7c0a30-f70b-401b-9087-44c5c89e3c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: ea38e358-61dd-41e2-a08f-10e9f4711489] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:58.622203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a7c0a30-f70b-401b-9087-44c5c89e3c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.622962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a7c0a30-f70b-401b-9087-44c5c89e3c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.623563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a7c0a30-f70b-401b-9087-44c5c89e3c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.624473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a7c0a30-f70b-401b-9087-44c5c89e3c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.625165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a7c0a30-f70b-401b-9087-44c5c89e3c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.625762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a7c0a30-f70b-401b-9087-44c5c89e3c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.649523 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-1a7c0a30-f70b-401b-9087-44c5c89e3c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] HTTP exception thrown: Instance ea38e358-61dd-41e2-a08f-10e9f4711489 could not be found. Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1a7c0a30-f70b-401b-9087-44c5c89e3c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Request method failure captured: Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 HTTP/1.1 Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNyVUDTEVho31pZrDnlkVTpcEwslkOPd4iXBEcswKKT8qNvwbqvdNTz64d_m2JkSIgvffpQavLVnlSeN63E26PHHp1t69vN5c_7nv_4r8WgVQdv00nmt_4DxArl83JZzGr3H5WvWvTPBCc47knjE4WwZ8pU378_W4AEE4iwO_16SxpM Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 990c752c7bb141c1bf496c98fbc3c9a7 Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_990c752c7bb141c1bf496c98fbc3c9a7", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/990c752c7bb141c1bf496c98fbc3c9a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/990c752c7bb141c1bf496c98fbc3c9a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/990c752c7bb141c1bf496c98fbc3c9a7"}]}] Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 990c752c7bb141c1bf496c98fbc3c9a7 Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerActionsTestJSON-1192262438-project Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 51efa71a8bfe457982698a5755ae3cc6 Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerActionsTestJSON-1192262438-project Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance ea38e358-61dd-41e2-a08f-10e9f4711489 could not be found. Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'ea38e358-61dd-41e2-a08f-10e9f4711489'} Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea38e358-61dd-41e2-a08f-10e9f4711489 could not be found. Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea38e358-61dd-41e2-a08f-10e9f4711489 could not be found. Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:58.651496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:58.655999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:58.655999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:58.655999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:58.655999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:58.655999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:58.655999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea38e358-61dd-41e2-a08f-10e9f4711489 could not be found. Aug 29 15:45:58.655999 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:45:58.657404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1a7c0a30-f70b-401b-9087-44c5c89e3c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Returning 404 to user: Instance ea38e358-61dd-41e2-a08f-10e9f4711489 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:58.658462 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1a7c0a30-f70b-401b-9087-44c5c89e3c31 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489" status: 404 len: 111 microversion: 2.1 time: 0.047889 Aug 29 15:45:58.663133 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2455/4774] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:58 2022] GET /compute/v2.1/servers/ea38e358-61dd-41e2-a08f-10e9f4711489 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:58.668874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ab236710-cb05-4141-a215-230f13c5c46a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:58.669689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ab236710-cb05-4141-a215-230f13c5c46a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:58.677309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab236710-cb05-4141-a215-230f13c5c46a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.678132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab236710-cb05-4141-a215-230f13c5c46a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.678747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab236710-cb05-4141-a215-230f13c5c46a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.679733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab236710-cb05-4141-a215-230f13c5c46a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.680371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab236710-cb05-4141-a215-230f13c5c46a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.680972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab236710-cb05-4141-a215-230f13c5c46a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.712884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ab236710-cb05-4141-a215-230f13c5c46a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:58.823156 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ab236710-cb05-4141-a215-230f13c5c46a tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6" status: 204 len: 0 microversion: 2.1 time: 0.157399 Aug 29 15:45:58.824388 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2456/4775] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:58 2022] DELETE /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:45:58.841660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dab1cedc-bdad-4540-aa87-97993a86d306 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:58.853645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-286cde77-ca12-4850-af52-7586614b23ae tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:58.854764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-286cde77-ca12-4850-af52-7586614b23ae tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:58.855673 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dab1cedc-bdad-4540-aa87-97993a86d306 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1508 microversion: 2.1 time: 0.481256 Aug 29 15:45:58.856527 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2320/4776] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:58 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1508 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:58.865041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-286cde77-ca12-4850-af52-7586614b23ae tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.865598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-286cde77-ca12-4850-af52-7586614b23ae tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.866057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-286cde77-ca12-4850-af52-7586614b23ae tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.866997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-286cde77-ca12-4850-af52-7586614b23ae tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.867536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-286cde77-ca12-4850-af52-7586614b23ae tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.867974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-286cde77-ca12-4850-af52-7586614b23ae tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.156893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-286cde77-ca12-4850-af52-7586614b23ae tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:59.176458 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-286cde77-ca12-4850-af52-7586614b23ae tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6" status: 200 len: 1506 microversion: 2.1 time: 0.343978 Aug 29 15:45:59.192603 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2457/4777] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:58 2022] GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:59.505499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f0d4ccbe-6a5b-463d-8e1d-59a1ba2d1200 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a540d30>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:59.550330 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f0d4ccbe-6a5b-463d-8e1d-59a1ba2d1200 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/73176341-e197-48db-9c96-7c0955a3a390" status: 200 len: 661 microversion: 2.1 time: 0.048887 Aug 29 15:45:59.550945 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2321/4778] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:59 2022] GET /compute/v2.1/images/73176341-e197-48db-9c96-7c0955a3a390 => generated 661 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:59.564543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-74a7a335-acfc-4862-9347-7d3ae0e2ec90 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc433a51af0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:59.609955 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-74a7a335-acfc-4862-9347-7d3ae0e2ec90 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/73176341-e197-48db-9c96-7c0955a3a390" status: 200 len: 661 microversion: 2.1 time: 0.049369 Aug 29 15:45:59.610778 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2458/4779] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:45:59 2022] GET /compute/v2.1/images/73176341-e197-48db-9c96-7c0955a3a390 => generated 661 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:59.616519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7f7cb569-64a4-4131-8405-e78cc5149e11 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:59.617164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7f7cb569-64a4-4131-8405-e78cc5149e11 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:59.624589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f7cb569-64a4-4131-8405-e78cc5149e11 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.625172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f7cb569-64a4-4131-8405-e78cc5149e11 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.625622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f7cb569-64a4-4131-8405-e78cc5149e11 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.626331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f7cb569-64a4-4131-8405-e78cc5149e11 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.626786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f7cb569-64a4-4131-8405-e78cc5149e11 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.627209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f7cb569-64a4-4131-8405-e78cc5149e11 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.800545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7f7cb569-64a4-4131-8405-e78cc5149e11 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:59.815597 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7f7cb569-64a4-4131-8405-e78cc5149e11 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.202950 Aug 29 15:45:59.816617 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2322/4780] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:59 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:59.892473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0f63c16f-4b7a-4fe7-851c-f4e0b255462f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:59.893417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0f63c16f-4b7a-4fe7-851c-f4e0b255462f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:59.900802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f63c16f-4b7a-4fe7-851c-f4e0b255462f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.901596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f63c16f-4b7a-4fe7-851c-f4e0b255462f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.902226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f63c16f-4b7a-4fe7-851c-f4e0b255462f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.903097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f63c16f-4b7a-4fe7-851c-f4e0b255462f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.903725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f63c16f-4b7a-4fe7-851c-f4e0b255462f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.904315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f63c16f-4b7a-4fe7-851c-f4e0b255462f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.200605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0f63c16f-4b7a-4fe7-851c-f4e0b255462f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:00.208968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-782825ec-aa95-4ab6-8431-eceeb92a5032 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:00.208968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-782825ec-aa95-4ab6-8431-eceeb92a5032 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:00.223153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-782825ec-aa95-4ab6-8431-eceeb92a5032 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.224320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-782825ec-aa95-4ab6-8431-eceeb92a5032 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.224896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-782825ec-aa95-4ab6-8431-eceeb92a5032 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.225945 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0f63c16f-4b7a-4fe7-851c-f4e0b255462f tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1508 microversion: 2.1 time: 0.337452 Aug 29 15:46:00.227677 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2459/4781] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:59 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1508 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:00.233804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-782825ec-aa95-4ab6-8431-eceeb92a5032 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.235654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-782825ec-aa95-4ab6-8431-eceeb92a5032 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.237231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-782825ec-aa95-4ab6-8431-eceeb92a5032 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.545808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-cd8ff97a-a645-456f-b232-7bbdd5b5fa83 req-015d824c-d878-4492-b395-2877a14c791e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a492671-236f-4e97-a6dc-a3021953eac6", "name": "network-vif-deleted", "tag": "b7a99e88-d298-4599-8588-e6bdf652e49a"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:00.586368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cd8ff97a-a645-456f-b232-7bbdd5b5fa83 req-015d824c-d878-4492-b395-2877a14c791e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.587204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cd8ff97a-a645-456f-b232-7bbdd5b5fa83 req-015d824c-d878-4492-b395-2877a14c791e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.587843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cd8ff97a-a645-456f-b232-7bbdd5b5fa83 req-015d824c-d878-4492-b395-2877a14c791e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.621574 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-cd8ff97a-a645-456f-b232-7bbdd5b5fa83 req-015d824c-d878-4492-b395-2877a14c791e service nova] Creating event network-vif-deleted:b7a99e88-d298-4599-8588-e6bdf652e49a for instance 8a492671-236f-4e97-a6dc-a3021953eac6 on n-h1-839401-11 Aug 29 15:46:00.639013 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-cd8ff97a-a645-456f-b232-7bbdd5b5fa83 req-015d824c-d878-4492-b395-2877a14c791e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098537 Aug 29 15:46:00.640376 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2460/4782] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:00.652360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-782825ec-aa95-4ab6-8431-eceeb92a5032 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:00.672384 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-782825ec-aa95-4ab6-8431-eceeb92a5032 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6" status: 200 len: 1506 microversion: 2.1 time: 0.475754 Aug 29 15:46:00.687284 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2323/4783] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:00 2022] GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:00.852286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-020606db-8fb1-4b6a-9547-1aae102e9b1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:00.853033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-020606db-8fb1-4b6a-9547-1aae102e9b1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:00.868339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-020606db-8fb1-4b6a-9547-1aae102e9b1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.871672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-020606db-8fb1-4b6a-9547-1aae102e9b1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.875112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-020606db-8fb1-4b6a-9547-1aae102e9b1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.875928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-020606db-8fb1-4b6a-9547-1aae102e9b1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.876433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-020606db-8fb1-4b6a-9547-1aae102e9b1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.878829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-020606db-8fb1-4b6a-9547-1aae102e9b1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.100172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-020606db-8fb1-4b6a-9547-1aae102e9b1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:01.111393 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-020606db-8fb1-4b6a-9547-1aae102e9b1f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.273184 Aug 29 15:46:01.113250 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2461/4784] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:00 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:01.166315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6cc9fc30-98a5-441f-b823-c2e93ece71d5 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a5f5790>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:01.234552 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6cc9fc30-98a5-441f-b823-c2e93ece71d5 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/637ddd4b-d1c4-451e-813b-73ca44135f96" status: 200 len: 662 microversion: 2.1 time: 0.071976 Aug 29 15:46:01.251339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-afdab115-21a1-4d6f-86a9-bb1a3705e308 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:01.252863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-afdab115-21a1-4d6f-86a9-bb1a3705e308 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:01.257098 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2324/4785] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:01 2022] GET /compute/v2.1/images/637ddd4b-d1c4-451e-813b-73ca44135f96 => generated 662 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:01.260469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afdab115-21a1-4d6f-86a9-bb1a3705e308 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.264935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-99f3742c-db51-4ae4-ab73-25185b2d8936 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a557820>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:01.278904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afdab115-21a1-4d6f-86a9-bb1a3705e308 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.280694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afdab115-21a1-4d6f-86a9-bb1a3705e308 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.285072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afdab115-21a1-4d6f-86a9-bb1a3705e308 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.285613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afdab115-21a1-4d6f-86a9-bb1a3705e308 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.286053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afdab115-21a1-4d6f-86a9-bb1a3705e308 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.314061 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-99f3742c-db51-4ae4-ab73-25185b2d8936 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/637ddd4b-d1c4-451e-813b-73ca44135f96" status: 200 len: 662 microversion: 2.1 time: 0.055120 Aug 29 15:46:01.314832 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2325/4786] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:01 2022] GET /compute/v2.1/images/637ddd4b-d1c4-451e-813b-73ca44135f96 => generated 662 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:01.334880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0479e865-ac02-4c0b-a68a-7db76baee7ab tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:01.338053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0479e865-ac02-4c0b-a68a-7db76baee7ab tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:01.351920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0479e865-ac02-4c0b-a68a-7db76baee7ab tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.353308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0479e865-ac02-4c0b-a68a-7db76baee7ab tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.356130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0479e865-ac02-4c0b-a68a-7db76baee7ab tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.356918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0479e865-ac02-4c0b-a68a-7db76baee7ab tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.357504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0479e865-ac02-4c0b-a68a-7db76baee7ab tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.360112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0479e865-ac02-4c0b-a68a-7db76baee7ab tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.423628 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0479e865-ac02-4c0b-a68a-7db76baee7ab tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098678 Aug 29 15:46:01.425329 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2326/4787] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:46:01 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:46:01.554216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-afdab115-21a1-4d6f-86a9-bb1a3705e308 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:01.566793 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-afdab115-21a1-4d6f-86a9-bb1a3705e308 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1508 microversion: 2.1 time: 0.319269 Aug 29 15:46:01.574286 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2462/4788] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:01 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1508 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:01.618942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dbfdedcc-d6a3-4f02-87f3-ce7ff1877da8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:01.621855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dbfdedcc-d6a3-4f02-87f3-ce7ff1877da8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:01.629512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbfdedcc-d6a3-4f02-87f3-ce7ff1877da8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.630127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbfdedcc-d6a3-4f02-87f3-ce7ff1877da8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.630699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbfdedcc-d6a3-4f02-87f3-ce7ff1877da8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.631667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbfdedcc-d6a3-4f02-87f3-ce7ff1877da8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.632241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbfdedcc-d6a3-4f02-87f3-ce7ff1877da8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.632770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbfdedcc-d6a3-4f02-87f3-ce7ff1877da8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.669492 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dbfdedcc-d6a3-4f02-87f3-ce7ff1877da8 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054700 Aug 29 15:46:01.670992 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2327/4789] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:46:01 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:46:01.712339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f407c4b2-ad46-483c-8890-451bbdc0c4a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:01.712809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f407c4b2-ad46-483c-8890-451bbdc0c4a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 8a492671-236f-4e97-a6dc-a3021953eac6] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:01.722842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f407c4b2-ad46-483c-8890-451bbdc0c4a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.723380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f407c4b2-ad46-483c-8890-451bbdc0c4a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.723818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f407c4b2-ad46-483c-8890-451bbdc0c4a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.724535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f407c4b2-ad46-483c-8890-451bbdc0c4a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.724990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f407c4b2-ad46-483c-8890-451bbdc0c4a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.725611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f407c4b2-ad46-483c-8890-451bbdc0c4a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.744338 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-f407c4b2-ad46-483c-8890-451bbdc0c4a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] HTTP exception thrown: Instance 8a492671-236f-4e97-a6dc-a3021953eac6 could not be found. Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f407c4b2-ad46-483c-8890-451bbdc0c4a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Request method failure captured: Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 HTTP/1.1 Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNyVUDTEVho31pZrDnlkVTpcEwslkOPd4iXBEcswKKT8qNvwbqvdNTz64d_m2JkSIgvffpQavLVnlSeN63E26PHHp1t69vN5c_7nv_4r8WgVQdv00nmt_4DxArl83JZzGr3H5WvWvTPBCc47knjE4WwZ8pU378_W4AEE4iwO_16SxpM Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 990c752c7bb141c1bf496c98fbc3c9a7 Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_990c752c7bb141c1bf496c98fbc3c9a7", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/990c752c7bb141c1bf496c98fbc3c9a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/990c752c7bb141c1bf496c98fbc3c9a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/990c752c7bb141c1bf496c98fbc3c9a7"}]}] Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 990c752c7bb141c1bf496c98fbc3c9a7 Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerActionsTestJSON-1192262438-project Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 51efa71a8bfe457982698a5755ae3cc6 Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerActionsTestJSON-1192262438-project Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 8a492671-236f-4e97-a6dc-a3021953eac6 could not be found. Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '8a492671-236f-4e97-a6dc-a3021953eac6'} Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a492671-236f-4e97-a6dc-a3021953eac6 could not be found. Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a492671-236f-4e97-a6dc-a3021953eac6 could not be found. Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:01.746586 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:01.750990 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:01.750990 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:01.750990 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:01.750990 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:01.750990 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:01.750990 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a492671-236f-4e97-a6dc-a3021953eac6 could not be found. Aug 29 15:46:01.750990 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:01.755415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f407c4b2-ad46-483c-8890-451bbdc0c4a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Returning 404 to user: Instance 8a492671-236f-4e97-a6dc-a3021953eac6 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:01.756938 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f407c4b2-ad46-483c-8890-451bbdc0c4a7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6" status: 404 len: 111 microversion: 2.1 time: 0.050188 Aug 29 15:46:01.758257 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2463/4790] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:01 2022] GET /compute/v2.1/servers/8a492671-236f-4e97-a6dc-a3021953eac6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:01.777664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-081917aa-be92-4a5a-a581-38e3a680cce7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:01.778570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-440796fa-c582-437f-b2d6-57969fe3bebf tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:01.779076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-440796fa-c582-437f-b2d6-57969fe3bebf tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:01.786202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-440796fa-c582-437f-b2d6-57969fe3bebf tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.787008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-440796fa-c582-437f-b2d6-57969fe3bebf tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.787697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-440796fa-c582-437f-b2d6-57969fe3bebf tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.788659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-440796fa-c582-437f-b2d6-57969fe3bebf tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.789394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-440796fa-c582-437f-b2d6-57969fe3bebf tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.789555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-081917aa-be92-4a5a-a581-38e3a680cce7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:01.790467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-440796fa-c582-437f-b2d6-57969fe3bebf tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.818773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-081917aa-be92-4a5a-a581-38e3a680cce7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.822534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-081917aa-be92-4a5a-a581-38e3a680cce7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.824350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-081917aa-be92-4a5a-a581-38e3a680cce7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.824726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-440796fa-c582-437f-b2d6-57969fe3bebf tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:01.825363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-081917aa-be92-4a5a-a581-38e3a680cce7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.825856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-081917aa-be92-4a5a-a581-38e3a680cce7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.831100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-081917aa-be92-4a5a-a581-38e3a680cce7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.879403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-081917aa-be92-4a5a-a581-38e3a680cce7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:01.976020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:01.988950 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-440796fa-c582-437f-b2d6-57969fe3bebf tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "DELETE /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 204 len: 0 microversion: 2.1 time: 0.210654 Aug 29 15:46:01.992175 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2464/4791] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:01 2022] DELETE /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:46:02.010813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-13b822fa-7b67-4a3e-93a0-df4d4f0c03f2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:02.013602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-13b822fa-7b67-4a3e-93a0-df4d4f0c03f2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:02.022435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13b822fa-7b67-4a3e-93a0-df4d4f0c03f2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.023326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13b822fa-7b67-4a3e-93a0-df4d4f0c03f2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.024182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13b822fa-7b67-4a3e-93a0-df4d4f0c03f2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.025072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13b822fa-7b67-4a3e-93a0-df4d4f0c03f2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.026476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13b822fa-7b67-4a3e-93a0-df4d4f0c03f2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.027121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13b822fa-7b67-4a3e-93a0-df4d4f0c03f2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.052792 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-081917aa-be92-4a5a-a581-38e3a680cce7 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 204 len: 0 microversion: 2.1 time: 0.285369 Aug 29 15:46:02.053991 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2328/4792] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:01 2022] DELETE /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:02.068821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-25d50a3f-5c51-4edd-a084-248552d7b832 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:02.073002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-25d50a3f-5c51-4edd-a084-248552d7b832 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:02.084921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25d50a3f-5c51-4edd-a084-248552d7b832 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.090317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25d50a3f-5c51-4edd-a084-248552d7b832 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.090958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25d50a3f-5c51-4edd-a084-248552d7b832 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.093359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25d50a3f-5c51-4edd-a084-248552d7b832 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.096706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25d50a3f-5c51-4edd-a084-248552d7b832 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.097480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25d50a3f-5c51-4edd-a084-248552d7b832 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.223465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-13b822fa-7b67-4a3e-93a0-df4d4f0c03f2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:02.233712 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-13b822fa-7b67-4a3e-93a0-df4d4f0c03f2 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1670 microversion: 2.1 time: 0.235889 Aug 29 15:46:02.245227 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2465/4793] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:01 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1670 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:02.245227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cf87609e-c3a3-4ed1-bbd8-dff908ccc140 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:02.245227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cf87609e-c3a3-4ed1-bbd8-dff908ccc140 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:02.260311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf87609e-c3a3-4ed1-bbd8-dff908ccc140 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.262231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf87609e-c3a3-4ed1-bbd8-dff908ccc140 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.268436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf87609e-c3a3-4ed1-bbd8-dff908ccc140 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.269660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf87609e-c3a3-4ed1-bbd8-dff908ccc140 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.270454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf87609e-c3a3-4ed1-bbd8-dff908ccc140 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.271110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf87609e-c3a3-4ed1-bbd8-dff908ccc140 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.496265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-25d50a3f-5c51-4edd-a084-248552d7b832 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:02.526416 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-25d50a3f-5c51-4edd-a084-248552d7b832 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1493 microversion: 2.1 time: 0.467412 Aug 29 15:46:02.529273 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2329/4794] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:02 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1493 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:02.542479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-35f0cc71-dbeb-482b-b9bb-e2e343dc03da req-1e5a6ab0-6761-4dcd-b5bc-d8f755fe25e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd640d6c-9838-43b8-b1ab-d38a1b38b757", "name": "network-vif-deleted", "tag": "4db4c016-f20a-4d1c-a933-0c7dc37021b4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:02.566632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-35f0cc71-dbeb-482b-b9bb-e2e343dc03da req-1e5a6ab0-6761-4dcd-b5bc-d8f755fe25e1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.568959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-35f0cc71-dbeb-482b-b9bb-e2e343dc03da req-1e5a6ab0-6761-4dcd-b5bc-d8f755fe25e1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.569578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-35f0cc71-dbeb-482b-b9bb-e2e343dc03da req-1e5a6ab0-6761-4dcd-b5bc-d8f755fe25e1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.596877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cf87609e-c3a3-4ed1-bbd8-dff908ccc140 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:02.619182 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-35f0cc71-dbeb-482b-b9bb-e2e343dc03da req-1e5a6ab0-6761-4dcd-b5bc-d8f755fe25e1 service nova] Creating event network-vif-deleted:4db4c016-f20a-4d1c-a933-0c7dc37021b4 for instance cd640d6c-9838-43b8-b1ab-d38a1b38b757 on n-h2-839401-11 Aug 29 15:46:02.621847 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cf87609e-c3a3-4ed1-bbd8-dff908ccc140 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.384753 Aug 29 15:46:02.626326 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2466/4795] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:02 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:02.638057 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-35f0cc71-dbeb-482b-b9bb-e2e343dc03da req-1e5a6ab0-6761-4dcd-b5bc-d8f755fe25e1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106650 Aug 29 15:46:02.641724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3cf5be1a-19d0-466b-804c-e9290549af82 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:02.641863 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2330/4796] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:02.643305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3cf5be1a-19d0-466b-804c-e9290549af82 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:02.654840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cf5be1a-19d0-466b-804c-e9290549af82 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.655692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cf5be1a-19d0-466b-804c-e9290549af82 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.656363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cf5be1a-19d0-466b-804c-e9290549af82 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.657322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cf5be1a-19d0-466b-804c-e9290549af82 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.659520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cf5be1a-19d0-466b-804c-e9290549af82 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.660295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cf5be1a-19d0-466b-804c-e9290549af82 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.674925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:02.994710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1844932493", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": "none"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:03.061200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3cf5be1a-19d0-466b-804c-e9290549af82 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:03.071998 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3cf5be1a-19d0-466b-804c-e9290549af82 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1466 microversion: 2.1 time: 0.444367 Aug 29 15:46:03.077182 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2467/4797] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:02 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1466 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:03.085987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:46:03.086550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:46:03.087175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:46:03.087601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:46:03.088020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:46:03.098904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0ad8f941-1f0c-431c-ab41-7463c64f4896 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b5ae790>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:03.102880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.103375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.103817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.104561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.105026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.106262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.143176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Getting quotas for project e63d9b71dac2423fabf4e4d38b7b543f. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:46:03.151326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Getting quotas for user e702f756d9684796bb85b184d2d3c80d and project e63d9b71dac2423fabf4e4d38b7b543f. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:46:03.169475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:46:03.172095 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0ad8f941-1f0c-431c-ab41-7463c64f4896 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/391227c5-2b1a-445d-a25e-e4ce655fe055" status: 200 len: 662 microversion: 2.1 time: 0.077658 Aug 29 15:46:03.172637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:46:03.172996 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2468/4798] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:03 2022] GET /compute/v2.1/images/391227c5-2b1a-445d-a25e-e4ce655fe055 => generated 662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:03.186943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ddd04667-b5fc-41b1-9bf7-24e36759b079 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc433a5f820>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:03.231920 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7e95a784-8892-4b0f-af8d-d810c481befc tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.386967 Aug 29 15:46:03.233147 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2331/4799] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:46:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:46:03.246217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b1cdc1bf-8442-4c29-ba43-c8a07f2dddb7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:03.247270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b1cdc1bf-8442-4c29-ba43-c8a07f2dddb7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:03.276833 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ddd04667-b5fc-41b1-9bf7-24e36759b079 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/391227c5-2b1a-445d-a25e-e4ce655fe055" status: 200 len: 662 microversion: 2.1 time: 0.093891 Aug 29 15:46:03.279534 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2469/4800] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:03 2022] GET /compute/v2.1/images/391227c5-2b1a-445d-a25e-e4ce655fe055 => generated 662 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:03.285307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-42b38292-bd6d-4e97-b493-1ec340636d1b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:03.286432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-42b38292-bd6d-4e97-b493-1ec340636d1b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:03.295218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42b38292-bd6d-4e97-b493-1ec340636d1b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.296236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42b38292-bd6d-4e97-b493-1ec340636d1b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.296959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42b38292-bd6d-4e97-b493-1ec340636d1b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.297704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42b38292-bd6d-4e97-b493-1ec340636d1b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.298168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42b38292-bd6d-4e97-b493-1ec340636d1b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.298717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42b38292-bd6d-4e97-b493-1ec340636d1b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.339477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b1cdc1bf-8442-4c29-ba43-c8a07f2dddb7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:03.348957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b1cdc1bf-8442-4c29-ba43-c8a07f2dddb7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:03.351559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b1cdc1bf-8442-4c29-ba43-c8a07f2dddb7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:03.358769 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b1cdc1bf-8442-4c29-ba43-c8a07f2dddb7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1278 microversion: 2.57 time: 0.117106 Aug 29 15:46:03.360015 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2332/4801] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:03 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1278 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:46:03.491685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-539996498", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:03.572461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:46:03.632896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-42b38292-bd6d-4e97-b493-1ec340636d1b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:03.650301 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-42b38292-bd6d-4e97-b493-1ec340636d1b tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1670 microversion: 2.1 time: 0.369446 Aug 29 15:46:03.650926 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2470/4802] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:03 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1670 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:03.663096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7e690387-f88b-46fc-bbf9-4f35e7cca1d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:03.663722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7e690387-f88b-46fc-bbf9-4f35e7cca1d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:03.677497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e690387-f88b-46fc-bbf9-4f35e7cca1d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.680576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e690387-f88b-46fc-bbf9-4f35e7cca1d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.681038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e690387-f88b-46fc-bbf9-4f35e7cca1d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.681810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e690387-f88b-46fc-bbf9-4f35e7cca1d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.690651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e690387-f88b-46fc-bbf9-4f35e7cca1d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.691250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e690387-f88b-46fc-bbf9-4f35e7cca1d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.823924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7e690387-f88b-46fc-bbf9-4f35e7cca1d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:03.835417 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7e690387-f88b-46fc-bbf9-4f35e7cca1d0 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 200 len: 1286 microversion: 2.1 time: 0.183272 Aug 29 15:46:03.836335 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2471/4803] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:03 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 1286 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:03.843846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-8c8b736c-2f01-407a-9474-ffacf79997b7 req-33db619e-0c86-4710-9b40-ab91faf6adaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a392ebb-7660-40af-aba2-c868f57678ce", "name": "network-vif-deleted", "tag": "97f1d98b-81b5-4056-ab03-28adf09ab996"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:03.854924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8c8b736c-2f01-407a-9474-ffacf79997b7 req-33db619e-0c86-4710-9b40-ab91faf6adaf service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.855859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8c8b736c-2f01-407a-9474-ffacf79997b7 req-33db619e-0c86-4710-9b40-ab91faf6adaf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.856475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8c8b736c-2f01-407a-9474-ffacf79997b7 req-33db619e-0c86-4710-9b40-ab91faf6adaf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.882756 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-8c8b736c-2f01-407a-9474-ffacf79997b7 req-33db619e-0c86-4710-9b40-ab91faf6adaf service nova] Creating event network-vif-deleted:97f1d98b-81b5-4056-ab03-28adf09ab996 for instance 0a392ebb-7660-40af-aba2-c868f57678ce on n-h1-839401-11 Aug 29 15:46:03.907867 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-8c8b736c-2f01-407a-9474-ffacf79997b7 req-33db619e-0c86-4710-9b40-ab91faf6adaf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068057 Aug 29 15:46:03.908711 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2472/4804] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:03.921555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b491c8a7-82c9-4a55-b13f-8088870c07ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:03.922359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b491c8a7-82c9-4a55-b13f-8088870c07ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:03.926061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:46:03.926061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:46:03.926061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:46:03.926061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:46:03.926459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:46:03.930692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b491c8a7-82c9-4a55-b13f-8088870c07ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.931733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b491c8a7-82c9-4a55-b13f-8088870c07ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.932429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b491c8a7-82c9-4a55-b13f-8088870c07ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.933284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b491c8a7-82c9-4a55-b13f-8088870c07ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.933859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b491c8a7-82c9-4a55-b13f-8088870c07ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.934438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b491c8a7-82c9-4a55-b13f-8088870c07ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.936888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.937759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.938197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.938934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.939383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.939805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.996227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Getting quotas for project 06f4a9e6921444c1ac60c7f661b14eb6. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:46:04.004781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Getting quotas for user 3f8cf49a144a413e98c4b14bf468f8e6 and project 06f4a9e6921444c1ac60c7f661b14eb6. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:46:04.019661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:46:04.022243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: cea653ef-b11d-4341-a1cf-e941b5f3e570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:46:04.045421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=5 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:04.074508 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ad139438-00c3-440f-89df-677c080a7cba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587327 Aug 29 15:46:04.076321 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2333/4805] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:46:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:46:04.094689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-622b22c8-2cf4-4211-93e3-1d9e1af2bf58 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:04.095310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-622b22c8-2cf4-4211-93e3-1d9e1af2bf58 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:04.106398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-622b22c8-2cf4-4211-93e3-1d9e1af2bf58 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.106898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-622b22c8-2cf4-4211-93e3-1d9e1af2bf58 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.110707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-622b22c8-2cf4-4211-93e3-1d9e1af2bf58 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.111468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-622b22c8-2cf4-4211-93e3-1d9e1af2bf58 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.111938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-622b22c8-2cf4-4211-93e3-1d9e1af2bf58 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.112367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-622b22c8-2cf4-4211-93e3-1d9e1af2bf58 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.117173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b491c8a7-82c9-4a55-b13f-8088870c07ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:04.128844 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b491c8a7-82c9-4a55-b13f-8088870c07ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.215940 Aug 29 15:46:04.143772 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2473/4806] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:03 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:04.163705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-940781184", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:04.227054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-622b22c8-2cf4-4211-93e3-1d9e1af2bf58 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:04.236737 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-622b22c8-2cf4-4211-93e3-1d9e1af2bf58 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1466 microversion: 2.1 time: 0.146007 Aug 29 15:46:04.237455 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2334/4807] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:04 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1466 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:04.243291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] validate_networks() for None {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:46:04.385934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0540f5fe-7cfb-46e2-8af4-fb39febd8f33 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:04.387012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0540f5fe-7cfb-46e2-8af4-fb39febd8f33 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:04.397541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0540f5fe-7cfb-46e2-8af4-fb39febd8f33 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.398501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0540f5fe-7cfb-46e2-8af4-fb39febd8f33 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.399359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0540f5fe-7cfb-46e2-8af4-fb39febd8f33 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.402235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0540f5fe-7cfb-46e2-8af4-fb39febd8f33 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.403136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0540f5fe-7cfb-46e2-8af4-fb39febd8f33 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.403835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0540f5fe-7cfb-46e2-8af4-fb39febd8f33 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.499438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0540f5fe-7cfb-46e2-8af4-fb39febd8f33 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:04.510823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0540f5fe-7cfb-46e2-8af4-fb39febd8f33 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:04.512938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0540f5fe-7cfb-46e2-8af4-fb39febd8f33 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:04.519023 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0540f5fe-7cfb-46e2-8af4-fb39febd8f33 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1282 microversion: 2.57 time: 0.138475 Aug 29 15:46:04.522410 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2335/4808] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:04 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1282 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:46:04.576818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:46:04.577329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:46:04.577736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:46:04.578135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:46:04.578551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:46:04.599478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.600318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.600837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.601831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.602530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.603284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.633330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Getting quotas for project 06f4a9e6921444c1ac60c7f661b14eb6. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:46:04.639978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Getting quotas for user 3f8cf49a144a413e98c4b14bf468f8e6 and project 06f4a9e6921444c1ac60c7f661b14eb6. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:46:04.656527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:46:04.658935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:46:04.676635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-71f7ed76-c95b-4695-ae5f-e153ebd8545e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:04.677269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-71f7ed76-c95b-4695-ae5f-e153ebd8545e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:04.685568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71f7ed76-c95b-4695-ae5f-e153ebd8545e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.686074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71f7ed76-c95b-4695-ae5f-e153ebd8545e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.686522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71f7ed76-c95b-4695-ae5f-e153ebd8545e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.687775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71f7ed76-c95b-4695-ae5f-e153ebd8545e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.694330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71f7ed76-c95b-4695-ae5f-e153ebd8545e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.695182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-71f7ed76-c95b-4695-ae5f-e153ebd8545e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.736939 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-63ab953e-12c1-4b06-8683-06055a1b95ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577611 Aug 29 15:46:04.741336 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2474/4809] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:46:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:46:04.763158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bddabb8e-1071-4133-a02b-da603ee95361 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:04.764119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bddabb8e-1071-4133-a02b-da603ee95361 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:04.885021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bddabb8e-1071-4133-a02b-da603ee95361 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:04.902514 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bddabb8e-1071-4133-a02b-da603ee95361 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1217 microversion: 2.1 time: 0.145405 Aug 29 15:46:04.904258 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2475/4810] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:04 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:04.913610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-14f2313f-7a92-4ed4-9efb-8a0d39cb7137 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:04.917454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-14f2313f-7a92-4ed4-9efb-8a0d39cb7137 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 0a392ebb-7660-40af-aba2-c868f57678ce] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:04.926654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-71f7ed76-c95b-4695-ae5f-e153ebd8545e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:04.931095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14f2313f-7a92-4ed4-9efb-8a0d39cb7137 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.932253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14f2313f-7a92-4ed4-9efb-8a0d39cb7137 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.933256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14f2313f-7a92-4ed4-9efb-8a0d39cb7137 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.934505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14f2313f-7a92-4ed4-9efb-8a0d39cb7137 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.935391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14f2313f-7a92-4ed4-9efb-8a0d39cb7137 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.936173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14f2313f-7a92-4ed4-9efb-8a0d39cb7137 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.943944 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-71f7ed76-c95b-4695-ae5f-e153ebd8545e tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1670 microversion: 2.1 time: 0.271219 Aug 29 15:46:04.945335 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2336/4811] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:04 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1670 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:04.963071 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-14f2313f-7a92-4ed4-9efb-8a0d39cb7137 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] HTTP exception thrown: Instance 0a392ebb-7660-40af-aba2-c868f57678ce could not be found. Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-14f2313f-7a92-4ed4-9efb-8a0d39cb7137 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Request method failure captured: Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce HTTP/1.1 Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNyVUDTEVho31pZrDnlkVTpcEwslkOPd4iXBEcswKKT8qNvwbqvdNTz64d_m2JkSIgvffpQavLVnlSeN63E26PHHp1t69vN5c_7nv_4r8WgVQdv00nmt_4DxArl83JZzGr3H5WvWvTPBCc47knjE4WwZ8pU378_W4AEE4iwO_16SxpM Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 990c752c7bb141c1bf496c98fbc3c9a7 Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_990c752c7bb141c1bf496c98fbc3c9a7", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/990c752c7bb141c1bf496c98fbc3c9a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/990c752c7bb141c1bf496c98fbc3c9a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/990c752c7bb141c1bf496c98fbc3c9a7"}]}] Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 990c752c7bb141c1bf496c98fbc3c9a7 Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerActionsTestJSON-1192262438-project Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 51efa71a8bfe457982698a5755ae3cc6 Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerActionsTestJSON-1192262438-project Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 0a392ebb-7660-40af-aba2-c868f57678ce could not be found. Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '0a392ebb-7660-40af-aba2-c868f57678ce'} Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a392ebb-7660-40af-aba2-c868f57678ce could not be found. Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a392ebb-7660-40af-aba2-c868f57678ce could not be found. Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:04.967392 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:04.971908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:04.971908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:04.971908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:04.971908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:04.971908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:04.971908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a392ebb-7660-40af-aba2-c868f57678ce could not be found. Aug 29 15:46:04.971908 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:04.972641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-14f2313f-7a92-4ed4-9efb-8a0d39cb7137 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Returning 404 to user: Instance 0a392ebb-7660-40af-aba2-c868f57678ce could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:04.974275 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-14f2313f-7a92-4ed4-9efb-8a0d39cb7137 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce" status: 404 len: 111 microversion: 2.1 time: 0.068054 Aug 29 15:46:04.975289 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2476/4812] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:04 2022] GET /compute/v2.1/servers/0a392ebb-7660-40af-aba2-c868f57678ce => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:04.985347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aa2862d7-8d35-434d-8af7-5e9e41173bdd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:04.986294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aa2862d7-8d35-434d-8af7-5e9e41173bdd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:04.998104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa2862d7-8d35-434d-8af7-5e9e41173bdd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.998752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa2862d7-8d35-434d-8af7-5e9e41173bdd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.999422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa2862d7-8d35-434d-8af7-5e9e41173bdd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.000320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa2862d7-8d35-434d-8af7-5e9e41173bdd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.001048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa2862d7-8d35-434d-8af7-5e9e41173bdd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.001689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa2862d7-8d35-434d-8af7-5e9e41173bdd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.151305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3e722633-0648-43c8-8d61-ec9b3ae3c758 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:05.152022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3e722633-0648-43c8-8d61-ec9b3ae3c758 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:05.162402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e722633-0648-43c8-8d61-ec9b3ae3c758 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.163431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e722633-0648-43c8-8d61-ec9b3ae3c758 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.164495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e722633-0648-43c8-8d61-ec9b3ae3c758 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.165591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e722633-0648-43c8-8d61-ec9b3ae3c758 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.166322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e722633-0648-43c8-8d61-ec9b3ae3c758 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.166974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e722633-0648-43c8-8d61-ec9b3ae3c758 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.514369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3e722633-0648-43c8-8d61-ec9b3ae3c758 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:05.525582 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3e722633-0648-43c8-8d61-ec9b3ae3c758 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.378540 Aug 29 15:46:05.529613 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2477/4813] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:05 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:05.534692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-32548a71-22be-41b1-9378-df7bca00ba62 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:05.536864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-32548a71-22be-41b1-9378-df7bca00ba62 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:05.552260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aa2862d7-8d35-434d-8af7-5e9e41173bdd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:05.560377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32548a71-22be-41b1-9378-df7bca00ba62 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.561377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32548a71-22be-41b1-9378-df7bca00ba62 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.561865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32548a71-22be-41b1-9378-df7bca00ba62 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.563265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32548a71-22be-41b1-9378-df7bca00ba62 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.564132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32548a71-22be-41b1-9378-df7bca00ba62 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.564753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32548a71-22be-41b1-9378-df7bca00ba62 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.647713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32548a71-22be-41b1-9378-df7bca00ba62 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.652044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32548a71-22be-41b1-9378-df7bca00ba62 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.652557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32548a71-22be-41b1-9378-df7bca00ba62 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.653063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-32548a71-22be-41b1-9378-df7bca00ba62 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lazy-loading 'fault' on Instance uuid cd640d6c-9838-43b8-b1ab-d38a1b38b757 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:05.688784 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aa2862d7-8d35-434d-8af7-5e9e41173bdd tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 204 len: 0 microversion: 2.1 time: 0.708827 Aug 29 15:46:05.690317 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2337/4814] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:04 2022] DELETE /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:05.697859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8129080e-9d46-405f-afd8-550302098fc5 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:05.699386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8129080e-9d46-405f-afd8-550302098fc5 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:05.704810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-32548a71-22be-41b1-9378-df7bca00ba62 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:05.707486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8129080e-9d46-405f-afd8-550302098fc5 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.708068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8129080e-9d46-405f-afd8-550302098fc5 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.708749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8129080e-9d46-405f-afd8-550302098fc5 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.710763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8129080e-9d46-405f-afd8-550302098fc5 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.711651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8129080e-9d46-405f-afd8-550302098fc5 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.712290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8129080e-9d46-405f-afd8-550302098fc5 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.713729 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-32548a71-22be-41b1-9378-df7bca00ba62 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1305 microversion: 2.1 time: 0.182775 Aug 29 15:46:05.714328 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2478/4815] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:05 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1305 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:05.718947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3c486990-bc69-4ed1-9983-a22a5c282629 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:05.719533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3c486990-bc69-4ed1-9983-a22a5c282629 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:05.725642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c486990-bc69-4ed1-9983-a22a5c282629 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.726138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c486990-bc69-4ed1-9983-a22a5c282629 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.726570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c486990-bc69-4ed1-9983-a22a5c282629 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.727262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c486990-bc69-4ed1-9983-a22a5c282629 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.727713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c486990-bc69-4ed1-9983-a22a5c282629 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.728135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c486990-bc69-4ed1-9983-a22a5c282629 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.801556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8129080e-9d46-405f-afd8-550302098fc5 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:05.811755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8129080e-9d46-405f-afd8-550302098fc5 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:05.813711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8129080e-9d46-405f-afd8-550302098fc5 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:05.815001 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8129080e-9d46-405f-afd8-550302098fc5 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1336 microversion: 2.57 time: 0.122854 Aug 29 15:46:05.815963 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2338/4816] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:05 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1336 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:05.939665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3c486990-bc69-4ed1-9983-a22a5c282629 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:05.942217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c9357345-83b0-4031-b497-87c8cc67e9ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:05.943122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c9357345-83b0-4031-b497-87c8cc67e9ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:05.948783 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3c486990-bc69-4ed1-9983-a22a5c282629 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1675 microversion: 2.1 time: 0.233254 Aug 29 15:46:05.951431 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2479/4817] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:05 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1675 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:05.958536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9357345-83b0-4031-b497-87c8cc67e9ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.961032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9357345-83b0-4031-b497-87c8cc67e9ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.962546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9357345-83b0-4031-b497-87c8cc67e9ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.964666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9357345-83b0-4031-b497-87c8cc67e9ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.966179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9357345-83b0-4031-b497-87c8cc67e9ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.967212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9357345-83b0-4031-b497-87c8cc67e9ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.970874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5fec6c39-320b-460b-abbb-9ee5d036893f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:05.971560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5fec6c39-320b-460b-abbb-9ee5d036893f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:05.978923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fec6c39-320b-460b-abbb-9ee5d036893f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.979865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fec6c39-320b-460b-abbb-9ee5d036893f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.982544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fec6c39-320b-460b-abbb-9ee5d036893f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.984140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fec6c39-320b-460b-abbb-9ee5d036893f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.985003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fec6c39-320b-460b-abbb-9ee5d036893f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.985706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fec6c39-320b-460b-abbb-9ee5d036893f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.101504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c9357345-83b0-4031-b497-87c8cc67e9ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:06.121809 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c9357345-83b0-4031-b497-87c8cc67e9ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1221 microversion: 2.1 time: 0.183476 Aug 29 15:46:06.124399 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2339/4818] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:05 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1221 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:06.194752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5fec6c39-320b-460b-abbb-9ee5d036893f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:06.206915 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5fec6c39-320b-460b-abbb-9ee5d036893f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1670 microversion: 2.1 time: 0.241055 Aug 29 15:46:06.207518 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2480/4819] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:05 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1670 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:06.554874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-83fcc016-1b4c-41fb-bc0f-cd6f5a61920e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:06.555794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-83fcc016-1b4c-41fb-bc0f-cd6f5a61920e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:06.568421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83fcc016-1b4c-41fb-bc0f-cd6f5a61920e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.569319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83fcc016-1b4c-41fb-bc0f-cd6f5a61920e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.569779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83fcc016-1b4c-41fb-bc0f-cd6f5a61920e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.570728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83fcc016-1b4c-41fb-bc0f-cd6f5a61920e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.571608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83fcc016-1b4c-41fb-bc0f-cd6f5a61920e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.572417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83fcc016-1b4c-41fb-bc0f-cd6f5a61920e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.603651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-32389da8-d763-498c-848e-42026cdd3be3 req-9ea06d0e-9c1e-4cdb-a431-304b5e543bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89dfeae0-3079-4a17-bc65-7ad03318e731", "name": "network-vif-deleted", "tag": "bd7ed4b6-e125-48ac-8d8c-adae31bfdf56"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:06.621232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-32389da8-d763-498c-848e-42026cdd3be3 req-9ea06d0e-9c1e-4cdb-a431-304b5e543bf4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.621961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-32389da8-d763-498c-848e-42026cdd3be3 req-9ea06d0e-9c1e-4cdb-a431-304b5e543bf4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.622514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-32389da8-d763-498c-848e-42026cdd3be3 req-9ea06d0e-9c1e-4cdb-a431-304b5e543bf4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.652886 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-32389da8-d763-498c-848e-42026cdd3be3 req-9ea06d0e-9c1e-4cdb-a431-304b5e543bf4 service nova] Creating event network-vif-deleted:bd7ed4b6-e125-48ac-8d8c-adae31bfdf56 for instance 89dfeae0-3079-4a17-bc65-7ad03318e731 on n-h2-839401-11 Aug 29 15:46:06.661317 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-32389da8-d763-498c-848e-42026cdd3be3 req-9ea06d0e-9c1e-4cdb-a431-304b5e543bf4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060944 Aug 29 15:46:06.664317 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2481/4820] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:06.737126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ab815427-0ceb-49d2-a040-8c83e9e3e150 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:06.739746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ab815427-0ceb-49d2-a040-8c83e9e3e150 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:06.743341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-83fcc016-1b4c-41fb-bc0f-cd6f5a61920e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:06.754492 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-83fcc016-1b4c-41fb-bc0f-cd6f5a61920e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.203659 Aug 29 15:46:06.754820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab815427-0ceb-49d2-a040-8c83e9e3e150 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.755557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab815427-0ceb-49d2-a040-8c83e9e3e150 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.755815 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2340/4821] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:06 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:06.756071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab815427-0ceb-49d2-a040-8c83e9e3e150 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.757023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab815427-0ceb-49d2-a040-8c83e9e3e150 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.757519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab815427-0ceb-49d2-a040-8c83e9e3e150 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.758234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab815427-0ceb-49d2-a040-8c83e9e3e150 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.800672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab815427-0ceb-49d2-a040-8c83e9e3e150 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.801199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab815427-0ceb-49d2-a040-8c83e9e3e150 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.801645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab815427-0ceb-49d2-a040-8c83e9e3e150 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.802131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-ab815427-0ceb-49d2-a040-8c83e9e3e150 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lazy-loading 'fault' on Instance uuid cd640d6c-9838-43b8-b1ab-d38a1b38b757 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:06.844934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c746aee3-2ce9-4d9f-a528-8b526af9c2cf tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:06.846155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c746aee3-2ce9-4d9f-a528-8b526af9c2cf tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:06.857001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c746aee3-2ce9-4d9f-a528-8b526af9c2cf tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.857920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c746aee3-2ce9-4d9f-a528-8b526af9c2cf tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.858622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c746aee3-2ce9-4d9f-a528-8b526af9c2cf tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.859688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c746aee3-2ce9-4d9f-a528-8b526af9c2cf tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.860399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c746aee3-2ce9-4d9f-a528-8b526af9c2cf tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.861300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c746aee3-2ce9-4d9f-a528-8b526af9c2cf tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.913358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ab815427-0ceb-49d2-a040-8c83e9e3e150 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ef354b84754383853e87e78de55c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24b8beb3a5446dcaffdc209c0e513b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:06.923413 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ab815427-0ceb-49d2-a040-8c83e9e3e150 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 200 len: 1305 microversion: 2.1 time: 0.190958 Aug 29 15:46:06.929629 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2482/4822] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:06 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 1305 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:06.946019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c746aee3-2ce9-4d9f-a528-8b526af9c2cf tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:06.954443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c746aee3-2ce9-4d9f-a528-8b526af9c2cf tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:06.955882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c746aee3-2ce9-4d9f-a528-8b526af9c2cf tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:06.957058 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c746aee3-2ce9-4d9f-a528-8b526af9c2cf tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1336 microversion: 2.57 time: 0.119709 Aug 29 15:46:06.957662 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2341/4823] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:06 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1336 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:06.972024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6f7a1717-7ed7-40ca-976f-bbd6c4c25f59 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:06.973168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6f7a1717-7ed7-40ca-976f-bbd6c4c25f59 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:06.980033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f7a1717-7ed7-40ca-976f-bbd6c4c25f59 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.980885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f7a1717-7ed7-40ca-976f-bbd6c4c25f59 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.981518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f7a1717-7ed7-40ca-976f-bbd6c4c25f59 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.982420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f7a1717-7ed7-40ca-976f-bbd6c4c25f59 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.982888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f7a1717-7ed7-40ca-976f-bbd6c4c25f59 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.983327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f7a1717-7ed7-40ca-976f-bbd6c4c25f59 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.141639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6f7a1717-7ed7-40ca-976f-bbd6c4c25f59 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:07.148026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ed2d33ae-a944-43f4-bbee-13032bdf10d2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:07.150540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ed2d33ae-a944-43f4-bbee-13032bdf10d2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:07.157329 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6f7a1717-7ed7-40ca-976f-bbd6c4c25f59 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1675 microversion: 2.1 time: 0.189187 Aug 29 15:46:07.170383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed2d33ae-a944-43f4-bbee-13032bdf10d2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.175926 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2483/4824] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:06 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1675 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:07.177924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed2d33ae-a944-43f4-bbee-13032bdf10d2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.178543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed2d33ae-a944-43f4-bbee-13032bdf10d2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.180574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed2d33ae-a944-43f4-bbee-13032bdf10d2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.184752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed2d33ae-a944-43f4-bbee-13032bdf10d2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.192964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed2d33ae-a944-43f4-bbee-13032bdf10d2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.236329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b4fa5cd8-2c03-44b9-ab35-8df26fcf23b5 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:07.237629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b4fa5cd8-2c03-44b9-ab35-8df26fcf23b5 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:07.259698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4fa5cd8-2c03-44b9-ab35-8df26fcf23b5 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.260578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4fa5cd8-2c03-44b9-ab35-8df26fcf23b5 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.261298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4fa5cd8-2c03-44b9-ab35-8df26fcf23b5 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.262760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4fa5cd8-2c03-44b9-ab35-8df26fcf23b5 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.264938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4fa5cd8-2c03-44b9-ab35-8df26fcf23b5 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.266366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4fa5cd8-2c03-44b9-ab35-8df26fcf23b5 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.345385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ed2d33ae-a944-43f4-bbee-13032bdf10d2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:07.357984 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ed2d33ae-a944-43f4-bbee-13032bdf10d2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1221 microversion: 2.1 time: 0.217889 Aug 29 15:46:07.371839 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2342/4825] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:07 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1221 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:07.389519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b4fa5cd8-2c03-44b9-ab35-8df26fcf23b5 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:07.401656 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b4fa5cd8-2c03-44b9-ab35-8df26fcf23b5 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1320 microversion: 2.1 time: 0.169284 Aug 29 15:46:07.405650 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2484/4826] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:07 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1320 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:07.784261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9c746230-11a0-447b-a29c-3244fe92ffc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:07.785295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9c746230-11a0-447b-a29c-3244fe92ffc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:07.792680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c746230-11a0-447b-a29c-3244fe92ffc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.793598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c746230-11a0-447b-a29c-3244fe92ffc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.794299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c746230-11a0-447b-a29c-3244fe92ffc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.795490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c746230-11a0-447b-a29c-3244fe92ffc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.796171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c746230-11a0-447b-a29c-3244fe92ffc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.796812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9c746230-11a0-447b-a29c-3244fe92ffc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.947414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-59ba1a4e-3889-4482-af9d-e2aa6e0ce419 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:07.954008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-59ba1a4e-3889-4482-af9d-e2aa6e0ce419 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] [instance: cd640d6c-9838-43b8-b1ab-d38a1b38b757] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:07.957915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:07.966137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59ba1a4e-3889-4482-af9d-e2aa6e0ce419 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.968560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59ba1a4e-3889-4482-af9d-e2aa6e0ce419 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.971923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59ba1a4e-3889-4482-af9d-e2aa6e0ce419 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.974721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59ba1a4e-3889-4482-af9d-e2aa6e0ce419 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.985297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59ba1a4e-3889-4482-af9d-e2aa6e0ce419 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.986155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59ba1a4e-3889-4482-af9d-e2aa6e0ce419 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.048517 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-59ba1a4e-3889-4482-af9d-e2aa6e0ce419 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] HTTP exception thrown: Instance cd640d6c-9838-43b8-b1ab-d38a1b38b757 could not be found. Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-59ba1a4e-3889-4482-af9d-e2aa6e0ce419 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Request method failure captured: Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 HTTP/1.1 Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN8OgoM7Hj3QYdwA0NyQJAtFh_VGtPCnbB2LjlTYQ73IpUVJHgb0fwVWHBe39XBQiAQ3VzJXKPN2NgWXe_wUd45L5Pg1HGuR2xralwYYAgaPKeCid2zvi-tIn3n65lDruIShsras1zc5IXkITVrnSLBa585g-wmqe16eHj75XbCps3w Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d24b8beb3a5446dcaffdc209c0e513b2 Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestServerAdvancedOps-1353110497 Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d24b8beb3a5446dcaffdc209c0e513b2", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d24b8beb3a5446dcaffdc209c0e513b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d24b8beb3a5446dcaffdc209c0e513b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d24b8beb3a5446dcaffdc209c0e513b2"}]}] Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestServerAdvancedOps-1353110497 Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d24b8beb3a5446dcaffdc209c0e513b2 Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestServerAdvancedOps-1353110497 Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestServerAdvancedOps-1353110497-project Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: c1ef354b84754383853e87e78de55c56 Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestServerAdvancedOps-1353110497-project Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance cd640d6c-9838-43b8-b1ab-d38a1b38b757 could not be found. Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'cd640d6c-9838-43b8-b1ab-d38a1b38b757'} Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd640d6c-9838-43b8-b1ab-d38a1b38b757 could not be found. Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd640d6c-9838-43b8-b1ab-d38a1b38b757 could not be found. Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:08.056496 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:08.060691 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:08.060691 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:08.060691 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:08.060691 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:08.060691 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:08.060691 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd640d6c-9838-43b8-b1ab-d38a1b38b757 could not be found. Aug 29 15:46:08.060691 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:08.064801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-59ba1a4e-3889-4482-af9d-e2aa6e0ce419 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] Returning 404 to user: Instance cd640d6c-9838-43b8-b1ab-d38a1b38b757 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:08.082395 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-59ba1a4e-3889-4482-af9d-e2aa6e0ce419 tempest-TestServerAdvancedOps-1353110497 tempest-TestServerAdvancedOps-1353110497-project] 10.222.0.62 "GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757" status: 404 len: 111 microversion: 2.1 time: 0.139072 Aug 29 15:46:08.083017 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2485/4827] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:07 2022] GET /compute/v2.1/servers/cd640d6c-9838-43b8-b1ab-d38a1b38b757 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:08.107036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c36c47e0-402e-465f-be9a-dea850ae83d0 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:08.111967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c36c47e0-402e-465f-be9a-dea850ae83d0 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:08.128063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c36c47e0-402e-465f-be9a-dea850ae83d0 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.135715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c36c47e0-402e-465f-be9a-dea850ae83d0 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.137321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c36c47e0-402e-465f-be9a-dea850ae83d0 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.138303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c36c47e0-402e-465f-be9a-dea850ae83d0 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.138941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c36c47e0-402e-465f-be9a-dea850ae83d0 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.142448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c36c47e0-402e-465f-be9a-dea850ae83d0 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.284429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9c746230-11a0-447b-a29c-3244fe92ffc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:08.296760 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9c746230-11a0-447b-a29c-3244fe92ffc9 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.516609 Aug 29 15:46:08.302386 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2343/4828] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:07 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:08.312325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-927bdb1f-a144-49e9-83ef-2f6092fa1a57 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:08.316633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-927bdb1f-a144-49e9-83ef-2f6092fa1a57 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:08.333663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-927bdb1f-a144-49e9-83ef-2f6092fa1a57 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.334182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-927bdb1f-a144-49e9-83ef-2f6092fa1a57 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.334621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-927bdb1f-a144-49e9-83ef-2f6092fa1a57 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.335388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-927bdb1f-a144-49e9-83ef-2f6092fa1a57 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.335939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-927bdb1f-a144-49e9-83ef-2f6092fa1a57 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.336388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-927bdb1f-a144-49e9-83ef-2f6092fa1a57 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.365778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c36c47e0-402e-465f-be9a-dea850ae83d0 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:08.377504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c36c47e0-402e-465f-be9a-dea850ae83d0 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:08.379044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c36c47e0-402e-465f-be9a-dea850ae83d0 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:08.380236 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c36c47e0-402e-465f-be9a-dea850ae83d0 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1336 microversion: 2.57 time: 0.286311 Aug 29 15:46:08.380802 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2486/4829] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:08 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1336 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:08.404782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4f569825-9d07-4101-9134-a4082e76c826 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:08.405933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4f569825-9d07-4101-9134-a4082e76c826 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:08.416246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f569825-9d07-4101-9134-a4082e76c826 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.418446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f569825-9d07-4101-9134-a4082e76c826 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.419765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f569825-9d07-4101-9134-a4082e76c826 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.422971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f569825-9d07-4101-9134-a4082e76c826 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.424218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f569825-9d07-4101-9134-a4082e76c826 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.424934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f569825-9d07-4101-9134-a4082e76c826 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.587809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4f569825-9d07-4101-9134-a4082e76c826 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:08.596040 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4f569825-9d07-4101-9134-a4082e76c826 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1269 microversion: 2.1 time: 0.208076 Aug 29 15:46:08.596653 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2487/4830] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:08 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1269 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:08.616419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-94ed66f1-43bc-4529-98de-ba86f917f035 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:08.617357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-94ed66f1-43bc-4529-98de-ba86f917f035 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:08.624794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ed66f1-43bc-4529-98de-ba86f917f035 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.625613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ed66f1-43bc-4529-98de-ba86f917f035 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.626120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ed66f1-43bc-4529-98de-ba86f917f035 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.627358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ed66f1-43bc-4529-98de-ba86f917f035 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.628237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ed66f1-43bc-4529-98de-ba86f917f035 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.629037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ed66f1-43bc-4529-98de-ba86f917f035 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.665465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ed66f1-43bc-4529-98de-ba86f917f035 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.666053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ed66f1-43bc-4529-98de-ba86f917f035 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.666596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ed66f1-43bc-4529-98de-ba86f917f035 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.667114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-94ed66f1-43bc-4529-98de-ba86f917f035 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lazy-loading 'fault' on Instance uuid 89dfeae0-3079-4a17-bc65-7ad03318e731 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:08.717390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-94ed66f1-43bc-4529-98de-ba86f917f035 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a898d8b4f7477281081a0e4dedf493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c81e50c9fdd45919b4d6c8e6682d97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:08.726472 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-94ed66f1-43bc-4529-98de-ba86f917f035 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 200 len: 1325 microversion: 2.1 time: 0.115225 Aug 29 15:46:08.727791 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2488/4831] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:08 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 1325 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:08.760579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-927bdb1f-a144-49e9-83ef-2f6092fa1a57 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:08.770737 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-927bdb1f-a144-49e9-83ef-2f6092fa1a57 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1675 microversion: 2.1 time: 0.465001 Aug 29 15:46:08.771355 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2344/4832] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:08 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1675 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:09.324577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-14a73e1a-9e8f-4db7-98a0-de2243ba88d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:09.325262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-14a73e1a-9e8f-4db7-98a0-de2243ba88d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:09.334064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14a73e1a-9e8f-4db7-98a0-de2243ba88d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.340258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14a73e1a-9e8f-4db7-98a0-de2243ba88d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.341321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14a73e1a-9e8f-4db7-98a0-de2243ba88d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.343455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14a73e1a-9e8f-4db7-98a0-de2243ba88d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.351923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14a73e1a-9e8f-4db7-98a0-de2243ba88d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.352664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14a73e1a-9e8f-4db7-98a0-de2243ba88d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.357668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:09.408354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4f2808e5-7c6c-4c6a-b63f-0386f2526d45 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:09.410031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4f2808e5-7c6c-4c6a-b63f-0386f2526d45 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:09.419482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f2808e5-7c6c-4c6a-b63f-0386f2526d45 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.438084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f2808e5-7c6c-4c6a-b63f-0386f2526d45 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.438850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f2808e5-7c6c-4c6a-b63f-0386f2526d45 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.439837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f2808e5-7c6c-4c6a-b63f-0386f2526d45 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.440665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f2808e5-7c6c-4c6a-b63f-0386f2526d45 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.441396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f2808e5-7c6c-4c6a-b63f-0386f2526d45 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.787581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-14a73e1a-9e8f-4db7-98a0-de2243ba88d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:09.806490 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-14a73e1a-9e8f-4db7-98a0-de2243ba88d6 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.486012 Aug 29 15:46:09.807889 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2489/4833] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:09 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:09.813841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a70ec5ca-b464-4c84-b808-e1e78b9bf038 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:09.814672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a70ec5ca-b464-4c84-b808-e1e78b9bf038 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:09.821541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a70ec5ca-b464-4c84-b808-e1e78b9bf038 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.823931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a70ec5ca-b464-4c84-b808-e1e78b9bf038 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.824729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a70ec5ca-b464-4c84-b808-e1e78b9bf038 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.825687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a70ec5ca-b464-4c84-b808-e1e78b9bf038 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.826447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a70ec5ca-b464-4c84-b808-e1e78b9bf038 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.827060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a70ec5ca-b464-4c84-b808-e1e78b9bf038 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.012714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a70ec5ca-b464-4c84-b808-e1e78b9bf038 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:10.027543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4f2808e5-7c6c-4c6a-b63f-0386f2526d45 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:10.030938 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a70ec5ca-b464-4c84-b808-e1e78b9bf038 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1275 microversion: 2.1 time: 0.221667 Aug 29 15:46:10.032249 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2490/4834] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:09 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1275 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:10.039379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c1ce508c-022b-41d6-80ee-6bdef8e46a54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:10.040467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4f2808e5-7c6c-4c6a-b63f-0386f2526d45 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:10.041119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c1ce508c-022b-41d6-80ee-6bdef8e46a54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:10.046811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4f2808e5-7c6c-4c6a-b63f-0386f2526d45 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:10.048694 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4f2808e5-7c6c-4c6a-b63f-0386f2526d45 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1336 microversion: 2.57 time: 0.644473 Aug 29 15:46:10.049930 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2345/4835] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:09 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1336 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:10.055891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8aa2153e-201b-40c5-ac88-ac04f77320f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:10.056173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ce508c-022b-41d6-80ee-6bdef8e46a54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.056654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ce508c-022b-41d6-80ee-6bdef8e46a54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.057114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ce508c-022b-41d6-80ee-6bdef8e46a54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.057766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8aa2153e-201b-40c5-ac88-ac04f77320f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:10.063183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ce508c-022b-41d6-80ee-6bdef8e46a54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.063928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ce508c-022b-41d6-80ee-6bdef8e46a54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.064717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1ce508c-022b-41d6-80ee-6bdef8e46a54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.066604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8aa2153e-201b-40c5-ac88-ac04f77320f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.068491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8aa2153e-201b-40c5-ac88-ac04f77320f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.069247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8aa2153e-201b-40c5-ac88-ac04f77320f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.072406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8aa2153e-201b-40c5-ac88-ac04f77320f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.072916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8aa2153e-201b-40c5-ac88-ac04f77320f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.075079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8aa2153e-201b-40c5-ac88-ac04f77320f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.106803 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-c1ce508c-022b-41d6-80ee-6bdef8e46a54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] HTTP exception thrown: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c1ce508c-022b-41d6-80ee-6bdef8e46a54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Request method failure captured: Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 HTTP/1.1 Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN1hzQ3z2U-w-FgTgqHX6rJBPsY0JjEnUe64fPTyeVmgZsBprzTQ1bIdxek9a-vYJQ_HslrhHa9E2P7RvnOg4AfCoJyg0z1_3P2l3RDilU7LN-AayEaJX63yJg3v6qo8LD4c_wIISDZxt3UYbqIe3Yye-nWgNVTo4Tjj1hcQrc45oDU Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 8c81e50c9fdd45919b4d6c8e6682d97d Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8c81e50c9fdd45919b4d6c8e6682d97d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8c81e50c9fdd45919b4d6c8e6682d97d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8c81e50c9fdd45919b4d6c8e6682d97d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8c81e50c9fdd45919b4d6c8e6682d97d"}]}] Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 8c81e50c9fdd45919b4d6c8e6682d97d Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AttachVolumeTestJSON-1547689605-project Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 77a898d8b4f7477281081a0e4dedf493 Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AttachVolumeTestJSON-1547689605-project Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '89dfeae0-3079-4a17-bc65-7ad03318e731'} Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:10.108687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:10.112709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:10.112709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:10.112709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:10.112709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:10.112709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:10.112709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. Aug 29 15:46:10.112709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:10.112709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c1ce508c-022b-41d6-80ee-6bdef8e46a54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Returning 404 to user: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:10.112709 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c1ce508c-022b-41d6-80ee-6bdef8e46a54 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 404 len: 111 microversion: 2.1 time: 0.076607 Aug 29 15:46:10.112709 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2491/4836] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:10 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:10.120102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-27e1f92c-4f40-4f8f-93e6-7cae24459cc5 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '.version_select at 0x7fc42b5b1af0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:10.121655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:10.175417 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-27e1f92c-4f40-4f8f-93e6-7cae24459cc5 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-413777314" status: 202 len: 0 microversion: 2.1 time: 0.058763 Aug 29 15:46:10.183800 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2492/4837] 10.222.0.62 () {58 vars in 1218 bytes} [Mon Aug 29 15:46:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-413777314 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:46:10.219981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8aa2153e-201b-40c5-ac88-ac04f77320f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51efa71a8bfe457982698a5755ae3cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c752c7bb141c1bf496c98fbc3c9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:10.228534 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8aa2153e-201b-40c5-ac88-ac04f77320f1 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 200 len: 1607 microversion: 2.1 time: 0.177152 Aug 29 15:46:10.229171 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2346/4838] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:10 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 1607 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:10.413033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-7b426153-da30-4b8b-84a1-4e4b50391b9b req-f640e4ac-02e7-4716-89a0-06a6b7162a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af95f7c-5362-4cf9-b80e-38cd6a518783", "name": "network-vif-deleted", "tag": "2984ebfd-8f23-4f8e-83af-0a164bd8c5aa"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:10.430364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7b426153-da30-4b8b-84a1-4e4b50391b9b req-f640e4ac-02e7-4716-89a0-06a6b7162a7f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.431183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7b426153-da30-4b8b-84a1-4e4b50391b9b req-f640e4ac-02e7-4716-89a0-06a6b7162a7f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.431812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7b426153-da30-4b8b-84a1-4e4b50391b9b req-f640e4ac-02e7-4716-89a0-06a6b7162a7f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.444510 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-7b426153-da30-4b8b-84a1-4e4b50391b9b req-f640e4ac-02e7-4716-89a0-06a6b7162a7f service nova] Creating event network-vif-deleted:2984ebfd-8f23-4f8e-83af-0a164bd8c5aa for instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 on n-h2-839401-11 Aug 29 15:46:10.450488 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-7b426153-da30-4b8b-84a1-4e4b50391b9b req-f640e4ac-02e7-4716-89a0-06a6b7162a7f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042438 Aug 29 15:46:10.453953 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2493/4839] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:10.837999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9ce08f14-4bd9-4f87-aaa0-3a8e4aae2ae0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:10.839292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9ce08f14-4bd9-4f87-aaa0-3a8e4aae2ae0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:10.870132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ce08f14-4bd9-4f87-aaa0-3a8e4aae2ae0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.872947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ce08f14-4bd9-4f87-aaa0-3a8e4aae2ae0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.875021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ce08f14-4bd9-4f87-aaa0-3a8e4aae2ae0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.875937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ce08f14-4bd9-4f87-aaa0-3a8e4aae2ae0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.882357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ce08f14-4bd9-4f87-aaa0-3a8e4aae2ae0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.883212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ce08f14-4bd9-4f87-aaa0-3a8e4aae2ae0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.053775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d6a67b01-9cca-4d3c-a73a-78629210ad12 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:11.054522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d6a67b01-9cca-4d3c-a73a-78629210ad12 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:11.109274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6a67b01-9cca-4d3c-a73a-78629210ad12 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.111326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6a67b01-9cca-4d3c-a73a-78629210ad12 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.112493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6a67b01-9cca-4d3c-a73a-78629210ad12 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.113933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6a67b01-9cca-4d3c-a73a-78629210ad12 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.117412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6a67b01-9cca-4d3c-a73a-78629210ad12 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.120711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6a67b01-9cca-4d3c-a73a-78629210ad12 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.338827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9ce08f14-4bd9-4f87-aaa0-3a8e4aae2ae0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:11.371139 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9ce08f14-4bd9-4f87-aaa0-3a8e4aae2ae0 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.543826 Aug 29 15:46:11.374182 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2347/4840] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:10 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:11.401508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-89955ce1-66cb-4ca9-a422-c3b3266d5868 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:11.407453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-89955ce1-66cb-4ca9-a422-c3b3266d5868 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:11.429681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89955ce1-66cb-4ca9-a422-c3b3266d5868 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.432308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89955ce1-66cb-4ca9-a422-c3b3266d5868 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.436803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89955ce1-66cb-4ca9-a422-c3b3266d5868 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.437980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89955ce1-66cb-4ca9-a422-c3b3266d5868 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.440472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89955ce1-66cb-4ca9-a422-c3b3266d5868 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.441259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89955ce1-66cb-4ca9-a422-c3b3266d5868 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.563006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d6a67b01-9cca-4d3c-a73a-78629210ad12 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:11.588993 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d6a67b01-9cca-4d3c-a73a-78629210ad12 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1275 microversion: 2.1 time: 0.534963 Aug 29 15:46:11.594026 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2494/4841] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:11 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1275 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:11.621803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1ca0d57b-a1b1-4325-9337-55a60deaf38c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:11.624977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1ca0d57b-a1b1-4325-9337-55a60deaf38c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] [instance: 2af95f7c-5362-4cf9-b80e-38cd6a518783] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:11.668534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ca0d57b-a1b1-4325-9337-55a60deaf38c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.669056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ca0d57b-a1b1-4325-9337-55a60deaf38c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.673070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ca0d57b-a1b1-4325-9337-55a60deaf38c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.674625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ca0d57b-a1b1-4325-9337-55a60deaf38c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.675321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ca0d57b-a1b1-4325-9337-55a60deaf38c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.676049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ca0d57b-a1b1-4325-9337-55a60deaf38c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.695116 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-1ca0d57b-a1b1-4325-9337-55a60deaf38c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] HTTP exception thrown: Instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 could not be found. Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1ca0d57b-a1b1-4325-9337-55a60deaf38c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Request method failure captured: Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 HTTP/1.1 Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDNyVUDTEVho31pZrDnlkVTpcEwslkOPd4iXBEcswKKT8qNvwbqvdNTz64d_m2JkSIgvffpQavLVnlSeN63E26PHHp1t69vN5c_7nv_4r8WgVQdv00nmt_4DxArl83JZzGr3H5WvWvTPBCc47knjE4WwZ8pU378_W4AEE4iwO_16SxpM Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 990c752c7bb141c1bf496c98fbc3c9a7 Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_990c752c7bb141c1bf496c98fbc3c9a7", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/990c752c7bb141c1bf496c98fbc3c9a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/990c752c7bb141c1bf496c98fbc3c9a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/990c752c7bb141c1bf496c98fbc3c9a7"}]}] Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 990c752c7bb141c1bf496c98fbc3c9a7 Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerActionsTestJSON-1192262438 Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerActionsTestJSON-1192262438-project Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 51efa71a8bfe457982698a5755ae3cc6 Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerActionsTestJSON-1192262438-project Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 could not be found. Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '2af95f7c-5362-4cf9-b80e-38cd6a518783'} Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 could not be found. Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 could not be found. Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:11.698836 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:11.706870 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:11.706870 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:11.706870 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:11.706870 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:11.706870 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:11.706870 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 could not be found. Aug 29 15:46:11.706870 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:11.709146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1ca0d57b-a1b1-4325-9337-55a60deaf38c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Returning 404 to user: Instance 2af95f7c-5362-4cf9-b80e-38cd6a518783 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:11.710767 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1ca0d57b-a1b1-4325-9337-55a60deaf38c tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783" status: 404 len: 111 microversion: 2.1 time: 0.112433 Aug 29 15:46:11.716618 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2495/4842] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:11 2022] GET /compute/v2.1/servers/2af95f7c-5362-4cf9-b80e-38cd6a518783 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:11.723446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d30e277a-b60d-409c-82ee-7cd68970c0f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] Calling method '.version_select at 0x7fc42aa84f70>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:11.764775 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d30e277a-b60d-409c-82ee-7cd68970c0f5 tempest-ServerActionsTestJSON-1192262438 tempest-ServerActionsTestJSON-1192262438-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877837348" status: 202 len: 0 microversion: 2.1 time: 0.046032 Aug 29 15:46:11.772808 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2496/4843] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 15:46:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877837348 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:46:11.917989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-89955ce1-66cb-4ca9-a422-c3b3266d5868 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:11.942275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-89955ce1-66cb-4ca9-a422-c3b3266d5868 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:11.944260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-89955ce1-66cb-4ca9-a422-c3b3266d5868 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:11.945784 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-89955ce1-66cb-4ca9-a422-c3b3266d5868 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1357 microversion: 2.57 time: 0.569319 Aug 29 15:46:11.957481 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2348/4844] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:11 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1357 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:11.976506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:11.993730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:12.013987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.014540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.016089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.021235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.029331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.032735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.197582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:46:12.197839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:46:12.198325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:46:12.198732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:46:12.203555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:46:12.366365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:12.375542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.376163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.376670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.377593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.378095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.379126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.397212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1f3e2760-885f-44e4-8b2d-15400378159e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:12.397816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1f3e2760-885f-44e4-8b2d-15400378159e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:12.409697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f3e2760-885f-44e4-8b2d-15400378159e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.410218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f3e2760-885f-44e4-8b2d-15400378159e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.410667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f3e2760-885f-44e4-8b2d-15400378159e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.411397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f3e2760-885f-44e4-8b2d-15400378159e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.411866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f3e2760-885f-44e4-8b2d-15400378159e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.412299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f3e2760-885f-44e4-8b2d-15400378159e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.418169 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bc130bb7-157f-4f75-bc05-3d709dcdb3c7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "POST /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142/action" status: 202 len: 1138 microversion: 2.57 time: 0.448637 Aug 29 15:46:12.419626 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2497/4845] 10.222.0.62 () {62 vars in 1320 bytes} [Mon Aug 29 15:46:11 2022] POST /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142/action => generated 1138 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 15:46:12.447670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0cfec7a5-eb8f-458a-81a3-48c64407a09e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:12.449727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0cfec7a5-eb8f-458a-81a3-48c64407a09e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:12.471215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cfec7a5-eb8f-458a-81a3-48c64407a09e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.472062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cfec7a5-eb8f-458a-81a3-48c64407a09e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.472810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cfec7a5-eb8f-458a-81a3-48c64407a09e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.474345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cfec7a5-eb8f-458a-81a3-48c64407a09e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.475083 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cfec7a5-eb8f-458a-81a3-48c64407a09e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.476072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cfec7a5-eb8f-458a-81a3-48c64407a09e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.918193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0cfec7a5-eb8f-458a-81a3-48c64407a09e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:12.962175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0cfec7a5-eb8f-458a-81a3-48c64407a09e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:12.971430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0cfec7a5-eb8f-458a-81a3-48c64407a09e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:12.976284 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0cfec7a5-eb8f-458a-81a3-48c64407a09e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.540915 Aug 29 15:46:12.981607 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2498/4846] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:12 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:12.996449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-daee998b-0aab-414e-82b7-07a63c8c5bdf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.006345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-daee998b-0aab-414e-82b7-07a63c8c5bdf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.087984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-daee998b-0aab-414e-82b7-07a63c8c5bdf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.089269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-daee998b-0aab-414e-82b7-07a63c8c5bdf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.091292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-daee998b-0aab-414e-82b7-07a63c8c5bdf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.094682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-daee998b-0aab-414e-82b7-07a63c8c5bdf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.096412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-daee998b-0aab-414e-82b7-07a63c8c5bdf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.097685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-daee998b-0aab-414e-82b7-07a63c8c5bdf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.528471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-daee998b-0aab-414e-82b7-07a63c8c5bdf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:13.541453 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-daee998b-0aab-414e-82b7-07a63c8c5bdf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1317 microversion: 2.1 time: 0.558049 Aug 29 15:46:13.542633 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2499/4847] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:12 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1317 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:13.555647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-35a20ac4-764e-4e38-a31b-8afaab787c86 req-860e0531-10e1-4a60-ad57-8e516e1e1376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea653ef-b11d-4341-a1cf-e941b5f3e570", "tag": "efc5b7ae-1aab-49aa-938d-1d74e0bd4507"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:13.563668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1f3e2760-885f-44e4-8b2d-15400378159e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:13.570614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-35a20ac4-764e-4e38-a31b-8afaab787c86 req-860e0531-10e1-4a60-ad57-8e516e1e1376 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.571596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-35a20ac4-764e-4e38-a31b-8afaab787c86 req-860e0531-10e1-4a60-ad57-8e516e1e1376 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.572353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-35a20ac4-764e-4e38-a31b-8afaab787c86 req-860e0531-10e1-4a60-ad57-8e516e1e1376 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.577701 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1f3e2760-885f-44e4-8b2d-15400378159e tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1484 microversion: 2.1 time: 1.184366 Aug 29 15:46:13.582910 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2349/4848] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:12 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1484 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:13.587522 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-35a20ac4-764e-4e38-a31b-8afaab787c86 req-860e0531-10e1-4a60-ad57-8e516e1e1376 service nova] Creating event network-changed:efc5b7ae-1aab-49aa-938d-1d74e0bd4507 for instance cea653ef-b11d-4341-a1cf-e941b5f3e570 on n-h1-839401-11 Aug 29 15:46:13.596562 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-35a20ac4-764e-4e38-a31b-8afaab787c86 req-860e0531-10e1-4a60-ad57-8e516e1e1376 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049823 Aug 29 15:46:13.598112 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2500/4849] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:13.607782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b186155b-ddc3-4d08-9db0-a9d9f7e173f1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:13.608692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b186155b-ddc3-4d08-9db0-a9d9f7e173f1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.616805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b186155b-ddc3-4d08-9db0-a9d9f7e173f1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.617583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b186155b-ddc3-4d08-9db0-a9d9f7e173f1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.618194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b186155b-ddc3-4d08-9db0-a9d9f7e173f1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.619106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b186155b-ddc3-4d08-9db0-a9d9f7e173f1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.619944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b186155b-ddc3-4d08-9db0-a9d9f7e173f1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.620538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b186155b-ddc3-4d08-9db0-a9d9f7e173f1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.686749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2f212e2c-872b-435c-940b-303e032f74ff tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.687483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2f212e2c-872b-435c-940b-303e032f74ff tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.719987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f212e2c-872b-435c-940b-303e032f74ff tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.723725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f212e2c-872b-435c-940b-303e032f74ff tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.724336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f212e2c-872b-435c-940b-303e032f74ff tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.725283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f212e2c-872b-435c-940b-303e032f74ff tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.726066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f212e2c-872b-435c-940b-303e032f74ff tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.726707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f212e2c-872b-435c-940b-303e032f74ff tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.728800 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b186155b-ddc3-4d08-9db0-a9d9f7e173f1 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "POST /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23/action" status: 202 len: 0 microversion: 2.1 time: 0.126636 Aug 29 15:46:13.746125 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2350/4850] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:46:13 2022] POST /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:46:13.765978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1f08fe7d-0bc9-4ad9-9703-52c2cd6e3b87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.767326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1f08fe7d-0bc9-4ad9-9703-52c2cd6e3b87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.782174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f08fe7d-0bc9-4ad9-9703-52c2cd6e3b87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.783542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f08fe7d-0bc9-4ad9-9703-52c2cd6e3b87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.784281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f08fe7d-0bc9-4ad9-9703-52c2cd6e3b87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.785741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f08fe7d-0bc9-4ad9-9703-52c2cd6e3b87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.786566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f08fe7d-0bc9-4ad9-9703-52c2cd6e3b87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.787366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f08fe7d-0bc9-4ad9-9703-52c2cd6e3b87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.959690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:14.012823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=14 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:14.134398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2f212e2c-872b-435c-940b-303e032f74ff tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:14.168976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2f212e2c-872b-435c-940b-303e032f74ff tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:14.171509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2f212e2c-872b-435c-940b-303e032f74ff tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:14.175725 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2f212e2c-872b-435c-940b-303e032f74ff tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 2947 microversion: 2.32 time: 0.494223 Aug 29 15:46:14.178743 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2501/4851] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:13 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 2947 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:46:14.185579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3b1ae155-822d-47ff-b879-b654f59a1c98 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:14.187267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3b1ae155-822d-47ff-b879-b654f59a1c98 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:14.197057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b1ae155-822d-47ff-b879-b654f59a1c98 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.198098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b1ae155-822d-47ff-b879-b654f59a1c98 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.198719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b1ae155-822d-47ff-b879-b654f59a1c98 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.199745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b1ae155-822d-47ff-b879-b654f59a1c98 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.201995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b1ae155-822d-47ff-b879-b654f59a1c98 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.202585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b1ae155-822d-47ff-b879-b654f59a1c98 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.337770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3b1ae155-822d-47ff-b879-b654f59a1c98 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:14.350484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3b1ae155-822d-47ff-b879-b654f59a1c98 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:14.356860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3b1ae155-822d-47ff-b879-b654f59a1c98 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:14.382751 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3b1ae155-822d-47ff-b879-b654f59a1c98 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.178845 Aug 29 15:46:14.382751 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2502/4852] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:14 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:14.382751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3792f025-f60a-41fb-a9ed-45c3b6709462 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:14.382751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3792f025-f60a-41fb-a9ed-45c3b6709462 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:14.401989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3792f025-f60a-41fb-a9ed-45c3b6709462 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.402646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3792f025-f60a-41fb-a9ed-45c3b6709462 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.403124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3792f025-f60a-41fb-a9ed-45c3b6709462 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.403952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3792f025-f60a-41fb-a9ed-45c3b6709462 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.404429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3792f025-f60a-41fb-a9ed-45c3b6709462 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.404946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3792f025-f60a-41fb-a9ed-45c3b6709462 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.562514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1f08fe7d-0bc9-4ad9-9703-52c2cd6e3b87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:14.575056 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1f08fe7d-0bc9-4ad9-9703-52c2cd6e3b87 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1492 microversion: 2.1 time: 0.820238 Aug 29 15:46:14.575748 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2351/4853] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:13 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1492 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:14.593760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-59059e01-8fff-4848-a7ad-df701badee9f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:14.594626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-59059e01-8fff-4848-a7ad-df701badee9f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:14.601811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59059e01-8fff-4848-a7ad-df701badee9f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.602320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59059e01-8fff-4848-a7ad-df701badee9f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.602767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59059e01-8fff-4848-a7ad-df701badee9f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.603501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59059e01-8fff-4848-a7ad-df701badee9f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.603961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59059e01-8fff-4848-a7ad-df701badee9f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.604390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59059e01-8fff-4848-a7ad-df701badee9f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.621961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:14.900071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:15.031718 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3792f025-f60a-41fb-a9ed-45c3b6709462 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.665311 Aug 29 15:46:15.032916 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2503/4854] 10.222.0.62 () {60 vars in 1316 bytes} [Mon Aug 29 15:46:14 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae/os-interface => generated 1831 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:15.059647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-59059e01-8fff-4848-a7ad-df701badee9f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:15.060950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-93351cea-8142-4db3-9f60-5598cd38414f req-ba71a3e3-3ad7-4efd-bcdb-b993b743083d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698e4c74-b063-4ffc-bbd9-9154af832815", "tag": "5917d456-8dc9-4d37-9614-af0759e075a5"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:15.071625 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-59059e01-8fff-4848-a7ad-df701badee9f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1317 microversion: 2.1 time: 0.494815 Aug 29 15:46:15.083553 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2352/4855] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:14 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:15.102246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-93351cea-8142-4db3-9f60-5598cd38414f req-ba71a3e3-3ad7-4efd-bcdb-b993b743083d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.102952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-93351cea-8142-4db3-9f60-5598cd38414f req-ba71a3e3-3ad7-4efd-bcdb-b993b743083d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.103561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-93351cea-8142-4db3-9f60-5598cd38414f req-ba71a3e3-3ad7-4efd-bcdb-b993b743083d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.149556 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-93351cea-8142-4db3-9f60-5598cd38414f req-ba71a3e3-3ad7-4efd-bcdb-b993b743083d service nova] Creating event network-changed:5917d456-8dc9-4d37-9614-af0759e075a5 for instance 698e4c74-b063-4ffc-bbd9-9154af832815 on n-h2-839401-11 Aug 29 15:46:15.169922 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-93351cea-8142-4db3-9f60-5598cd38414f req-ba71a3e3-3ad7-4efd-bcdb-b993b743083d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113843 Aug 29 15:46:15.172112 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2504/4856] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:46:15.391429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e61cadcb-f025-4c2c-bef1-ac69a221769b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:15.392514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e61cadcb-f025-4c2c-bef1-ac69a221769b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:15.454706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e61cadcb-f025-4c2c-bef1-ac69a221769b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.455746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e61cadcb-f025-4c2c-bef1-ac69a221769b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.456724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e61cadcb-f025-4c2c-bef1-ac69a221769b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.457728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e61cadcb-f025-4c2c-bef1-ac69a221769b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.458469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e61cadcb-f025-4c2c-bef1-ac69a221769b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.459465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e61cadcb-f025-4c2c-bef1-ac69a221769b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.597981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-68670ddf-e8f2-44c7-85a0-0cea7a51498f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:15.599268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-68670ddf-e8f2-44c7-85a0-0cea7a51498f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:15.608182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68670ddf-e8f2-44c7-85a0-0cea7a51498f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.609380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68670ddf-e8f2-44c7-85a0-0cea7a51498f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.610072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68670ddf-e8f2-44c7-85a0-0cea7a51498f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.611606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68670ddf-e8f2-44c7-85a0-0cea7a51498f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.612292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68670ddf-e8f2-44c7-85a0-0cea7a51498f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.613126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68670ddf-e8f2-44c7-85a0-0cea7a51498f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.953510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e61cadcb-f025-4c2c-bef1-ac69a221769b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:15.977676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e61cadcb-f025-4c2c-bef1-ac69a221769b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:15.982245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e61cadcb-f025-4c2c-bef1-ac69a221769b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:15.985526 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e61cadcb-f025-4c2c-bef1-ac69a221769b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.598144 Aug 29 15:46:15.999079 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2353/4857] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:15 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:46:16.103345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-25739a32-7283-483f-a31d-4404f8cf2dcf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:16.104498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-25739a32-7283-483f-a31d-4404f8cf2dcf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:16.121679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25739a32-7283-483f-a31d-4404f8cf2dcf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.124997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25739a32-7283-483f-a31d-4404f8cf2dcf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.125716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25739a32-7283-483f-a31d-4404f8cf2dcf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.128640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25739a32-7283-483f-a31d-4404f8cf2dcf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.131324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25739a32-7283-483f-a31d-4404f8cf2dcf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.131976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25739a32-7283-483f-a31d-4404f8cf2dcf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.322089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-68670ddf-e8f2-44c7-85a0-0cea7a51498f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:16.331022 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-68670ddf-e8f2-44c7-85a0-0cea7a51498f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1492 microversion: 2.1 time: 0.738256 Aug 29 15:46:16.331711 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2505/4858] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:15 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1492 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:16.415653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-25739a32-7283-483f-a31d-4404f8cf2dcf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:16.428133 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-25739a32-7283-483f-a31d-4404f8cf2dcf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1317 microversion: 2.1 time: 0.329037 Aug 29 15:46:16.429632 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2354/4859] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:16 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:17.017001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6fc029cb-c83c-485e-933a-8f3180668303 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:17.017996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6fc029cb-c83c-485e-933a-8f3180668303 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:17.031087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fc029cb-c83c-485e-933a-8f3180668303 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.038132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fc029cb-c83c-485e-933a-8f3180668303 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.038467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fc029cb-c83c-485e-933a-8f3180668303 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.041223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fc029cb-c83c-485e-933a-8f3180668303 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.042409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fc029cb-c83c-485e-933a-8f3180668303 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.048176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fc029cb-c83c-485e-933a-8f3180668303 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.225804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6fc029cb-c83c-485e-933a-8f3180668303 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:17.246804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6fc029cb-c83c-485e-933a-8f3180668303 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:17.248307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6fc029cb-c83c-485e-933a-8f3180668303 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:17.249575 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6fc029cb-c83c-485e-933a-8f3180668303 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.236770 Aug 29 15:46:17.250511 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2506/4860] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:17 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:17.352619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5ff82e06-9e65-4343-973f-721f6f5fd3ce tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:17.353218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5ff82e06-9e65-4343-973f-721f6f5fd3ce tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:17.373203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ff82e06-9e65-4343-973f-721f6f5fd3ce tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.373715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ff82e06-9e65-4343-973f-721f6f5fd3ce tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.374162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ff82e06-9e65-4343-973f-721f6f5fd3ce tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.374900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ff82e06-9e65-4343-973f-721f6f5fd3ce tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.375357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ff82e06-9e65-4343-973f-721f6f5fd3ce tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.375791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ff82e06-9e65-4343-973f-721f6f5fd3ce tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.450789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-296b61b1-403b-4af5-acec-167f68ab9b32 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:17.451329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-296b61b1-403b-4af5-acec-167f68ab9b32 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:17.468631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-296b61b1-403b-4af5-acec-167f68ab9b32 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.469224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-296b61b1-403b-4af5-acec-167f68ab9b32 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.469609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-296b61b1-403b-4af5-acec-167f68ab9b32 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.470325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-296b61b1-403b-4af5-acec-167f68ab9b32 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.470792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-296b61b1-403b-4af5-acec-167f68ab9b32 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.471220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-296b61b1-403b-4af5-acec-167f68ab9b32 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.880847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-296b61b1-403b-4af5-acec-167f68ab9b32 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:17.899398 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-296b61b1-403b-4af5-acec-167f68ab9b32 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1317 microversion: 2.1 time: 0.452544 Aug 29 15:46:17.918264 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2507/4861] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:17 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:17.976890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5ff82e06-9e65-4343-973f-721f6f5fd3ce tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:17.987097 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5ff82e06-9e65-4343-973f-721f6f5fd3ce tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1492 microversion: 2.1 time: 0.638438 Aug 29 15:46:18.000411 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2355/4862] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:17 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1492 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:18.289782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-46ca6bc8-645e-46e8-9376-1ec6b532f634 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:18.290413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-46ca6bc8-645e-46e8-9376-1ec6b532f634 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:18.304386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46ca6bc8-645e-46e8-9376-1ec6b532f634 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.304877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46ca6bc8-645e-46e8-9376-1ec6b532f634 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.307691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46ca6bc8-645e-46e8-9376-1ec6b532f634 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:18.308430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46ca6bc8-645e-46e8-9376-1ec6b532f634 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.309466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46ca6bc8-645e-46e8-9376-1ec6b532f634 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.309888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46ca6bc8-645e-46e8-9376-1ec6b532f634 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:18.420450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-46ca6bc8-645e-46e8-9376-1ec6b532f634 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:18.434322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-46ca6bc8-645e-46e8-9376-1ec6b532f634 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:18.447393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-46ca6bc8-645e-46e8-9376-1ec6b532f634 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:18.449280 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-46ca6bc8-645e-46e8-9376-1ec6b532f634 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.163776 Aug 29 15:46:18.466628 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2508/4863] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:18 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:18.920242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9248bccb-9f3a-4ba3-a9a3-0a108ef90a6f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:18.920902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9248bccb-9f3a-4ba3-a9a3-0a108ef90a6f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:18.930667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9248bccb-9f3a-4ba3-a9a3-0a108ef90a6f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.931165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9248bccb-9f3a-4ba3-a9a3-0a108ef90a6f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.931610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9248bccb-9f3a-4ba3-a9a3-0a108ef90a6f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:18.932346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9248bccb-9f3a-4ba3-a9a3-0a108ef90a6f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.932809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9248bccb-9f3a-4ba3-a9a3-0a108ef90a6f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.933271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9248bccb-9f3a-4ba3-a9a3-0a108ef90a6f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:19.008149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ab0d4c1e-90f7-4393-8220-fd5cec947f16 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:19.008671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ab0d4c1e-90f7-4393-8220-fd5cec947f16 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:19.019199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab0d4c1e-90f7-4393-8220-fd5cec947f16 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:19.020446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab0d4c1e-90f7-4393-8220-fd5cec947f16 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:19.020446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab0d4c1e-90f7-4393-8220-fd5cec947f16 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:19.021124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab0d4c1e-90f7-4393-8220-fd5cec947f16 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:19.023104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab0d4c1e-90f7-4393-8220-fd5cec947f16 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:19.023104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab0d4c1e-90f7-4393-8220-fd5cec947f16 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:19.066188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:19.275900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ab0d4c1e-90f7-4393-8220-fd5cec947f16 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:19.286583 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ab0d4c1e-90f7-4393-8220-fd5cec947f16 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1492 microversion: 2.1 time: 0.282450 Aug 29 15:46:19.287704 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2509/4864] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:19 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1492 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:19.467991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9248bccb-9f3a-4ba3-a9a3-0a108ef90a6f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:19.476912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5e665b1b-5c81-4ebd-a508-bfce9328e4b9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:19.484752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5e665b1b-5c81-4ebd-a508-bfce9328e4b9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:19.485202 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9248bccb-9f3a-4ba3-a9a3-0a108ef90a6f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1317 microversion: 2.1 time: 0.561447 Aug 29 15:46:19.486105 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2356/4865] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:18 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1317 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:19.503618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e665b1b-5c81-4ebd-a508-bfce9328e4b9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:19.504114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e665b1b-5c81-4ebd-a508-bfce9328e4b9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:19.504601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e665b1b-5c81-4ebd-a508-bfce9328e4b9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:19.505357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e665b1b-5c81-4ebd-a508-bfce9328e4b9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:19.505827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e665b1b-5c81-4ebd-a508-bfce9328e4b9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:19.506230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e665b1b-5c81-4ebd-a508-bfce9328e4b9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:19.686772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e665b1b-5c81-4ebd-a508-bfce9328e4b9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:19.717203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e665b1b-5c81-4ebd-a508-bfce9328e4b9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:19.723578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e665b1b-5c81-4ebd-a508-bfce9328e4b9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:19.729582 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5e665b1b-5c81-4ebd-a508-bfce9328e4b9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.255035 Aug 29 15:46:19.730808 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2510/4866] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:19 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:20.308123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ad664e5a-0b19-4ee8-9f54-20ebfef4bdfe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:20.309233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ad664e5a-0b19-4ee8-9f54-20ebfef4bdfe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:20.352981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad664e5a-0b19-4ee8-9f54-20ebfef4bdfe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.355360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad664e5a-0b19-4ee8-9f54-20ebfef4bdfe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.357261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad664e5a-0b19-4ee8-9f54-20ebfef4bdfe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.358291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad664e5a-0b19-4ee8-9f54-20ebfef4bdfe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.363235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad664e5a-0b19-4ee8-9f54-20ebfef4bdfe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.364332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad664e5a-0b19-4ee8-9f54-20ebfef4bdfe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.519588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3fa7122f-f116-491e-8a74-2ff296e48cee tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:20.520870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3fa7122f-f116-491e-8a74-2ff296e48cee tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:20.540323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3fa7122f-f116-491e-8a74-2ff296e48cee tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.542934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3fa7122f-f116-491e-8a74-2ff296e48cee tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.543452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3fa7122f-f116-491e-8a74-2ff296e48cee tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.547148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3fa7122f-f116-491e-8a74-2ff296e48cee tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.547872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3fa7122f-f116-491e-8a74-2ff296e48cee tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.549411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3fa7122f-f116-491e-8a74-2ff296e48cee tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.893594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ad664e5a-0b19-4ee8-9f54-20ebfef4bdfe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:20.905382 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ad664e5a-0b19-4ee8-9f54-20ebfef4bdfe tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1492 microversion: 2.1 time: 0.601854 Aug 29 15:46:20.916748 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2357/4867] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:20 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1492 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:20.926610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-26497af5-3716-4bd2-8db8-73d0ce025d37 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:20.927429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-26497af5-3716-4bd2-8db8-73d0ce025d37 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:20.940077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26497af5-3716-4bd2-8db8-73d0ce025d37 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.944039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26497af5-3716-4bd2-8db8-73d0ce025d37 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.944641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26497af5-3716-4bd2-8db8-73d0ce025d37 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.945560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26497af5-3716-4bd2-8db8-73d0ce025d37 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.948826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26497af5-3716-4bd2-8db8-73d0ce025d37 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.949534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26497af5-3716-4bd2-8db8-73d0ce025d37 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:21.018477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3fa7122f-f116-491e-8a74-2ff296e48cee tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:21.029825 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3fa7122f-f116-491e-8a74-2ff296e48cee tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1317 microversion: 2.1 time: 0.514525 Aug 29 15:46:21.042946 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2511/4868] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:20 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:21.087200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-26497af5-3716-4bd2-8db8-73d0ce025d37 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:21.109454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-26497af5-3716-4bd2-8db8-73d0ce025d37 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:21.111534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-26497af5-3716-4bd2-8db8-73d0ce025d37 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:21.112998 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-26497af5-3716-4bd2-8db8-73d0ce025d37 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.194925 Aug 29 15:46:21.113883 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2358/4869] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:20 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:21.937188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-88621ec5-6fe4-43d8-bd4f-0fd4820b70c8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:21.937884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-88621ec5-6fe4-43d8-bd4f-0fd4820b70c8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:21.946648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88621ec5-6fe4-43d8-bd4f-0fd4820b70c8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:21.947297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88621ec5-6fe4-43d8-bd4f-0fd4820b70c8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:21.947966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88621ec5-6fe4-43d8-bd4f-0fd4820b70c8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:21.948792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88621ec5-6fe4-43d8-bd4f-0fd4820b70c8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:21.949352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88621ec5-6fe4-43d8-bd4f-0fd4820b70c8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:21.949847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88621ec5-6fe4-43d8-bd4f-0fd4820b70c8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.054339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e94b01b2-332c-4df8-a374-cb23d7b1a812 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:22.055176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e94b01b2-332c-4df8-a374-cb23d7b1a812 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:22.072358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e94b01b2-332c-4df8-a374-cb23d7b1a812 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.074239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e94b01b2-332c-4df8-a374-cb23d7b1a812 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.074239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e94b01b2-332c-4df8-a374-cb23d7b1a812 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.075312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e94b01b2-332c-4df8-a374-cb23d7b1a812 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.076028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e94b01b2-332c-4df8-a374-cb23d7b1a812 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.076906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e94b01b2-332c-4df8-a374-cb23d7b1a812 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.230349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-88621ec5-6fe4-43d8-bd4f-0fd4820b70c8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:22.261391 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-88621ec5-6fe4-43d8-bd4f-0fd4820b70c8 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1498 microversion: 2.1 time: 0.328180 Aug 29 15:46:22.274397 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2512/4870] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:21 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1498 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:22.287412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-101e868d-d9fb-42c1-a011-38c98e6d63f7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:22.288832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-101e868d-d9fb-42c1-a011-38c98e6d63f7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:22.311691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-101e868d-d9fb-42c1-a011-38c98e6d63f7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.313341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-101e868d-d9fb-42c1-a011-38c98e6d63f7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.314617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-101e868d-d9fb-42c1-a011-38c98e6d63f7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.319332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-101e868d-d9fb-42c1-a011-38c98e6d63f7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.320006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-101e868d-d9fb-42c1-a011-38c98e6d63f7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.322010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-101e868d-d9fb-42c1-a011-38c98e6d63f7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.343131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e94b01b2-332c-4df8-a374-cb23d7b1a812 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:22.353602 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e94b01b2-332c-4df8-a374-cb23d7b1a812 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1317 microversion: 2.1 time: 0.303605 Aug 29 15:46:22.355155 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2359/4871] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:22 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:22.359961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cc4cda29-8adb-4eb4-8b15-e3a6805a884c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:22.360724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cc4cda29-8adb-4eb4-8b15-e3a6805a884c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:22.367799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc4cda29-8adb-4eb4-8b15-e3a6805a884c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.368724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc4cda29-8adb-4eb4-8b15-e3a6805a884c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.369526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc4cda29-8adb-4eb4-8b15-e3a6805a884c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.370422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc4cda29-8adb-4eb4-8b15-e3a6805a884c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.371046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc4cda29-8adb-4eb4-8b15-e3a6805a884c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.371644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc4cda29-8adb-4eb4-8b15-e3a6805a884c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.422718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cc4cda29-8adb-4eb4-8b15-e3a6805a884c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:22.483189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-101e868d-d9fb-42c1-a011-38c98e6d63f7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:22.504950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-101e868d-d9fb-42c1-a011-38c98e6d63f7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:22.506667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-101e868d-d9fb-42c1-a011-38c98e6d63f7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:22.510463 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-101e868d-d9fb-42c1-a011-38c98e6d63f7 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.232171 Aug 29 15:46:22.515116 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2513/4872] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:22 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:22.549493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:22.567006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-4e0b3721-f7b3-492d-8ec0-278389b8d776 req-a7ff6e1e-fe78-45eb-9cb4-f12d8f74d3ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea653ef-b11d-4341-a1cf-e941b5f3e570", "name": "network-vif-plugged", "status": "completed", "tag": "efc5b7ae-1aab-49aa-938d-1d74e0bd4507"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:22.610770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4e0b3721-f7b3-492d-8ec0-278389b8d776 req-a7ff6e1e-fe78-45eb-9cb4-f12d8f74d3ee service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.619442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4e0b3721-f7b3-492d-8ec0-278389b8d776 req-a7ff6e1e-fe78-45eb-9cb4-f12d8f74d3ee service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.620586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4e0b3721-f7b3-492d-8ec0-278389b8d776 req-a7ff6e1e-fe78-45eb-9cb4-f12d8f74d3ee service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.651371 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cc4cda29-8adb-4eb4-8b15-e3a6805a884c tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "DELETE /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 204 len: 0 microversion: 2.1 time: 0.294433 Aug 29 15:46:22.655528 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2360/4873] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:22 2022] DELETE /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:22.662166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0a81bfb9-6be4-4363-9da8-02f91e8d3f36 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:22.663158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0a81bfb9-6be4-4363-9da8-02f91e8d3f36 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:22.670650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a81bfb9-6be4-4363-9da8-02f91e8d3f36 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.671476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a81bfb9-6be4-4363-9da8-02f91e8d3f36 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.672120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a81bfb9-6be4-4363-9da8-02f91e8d3f36 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.672990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a81bfb9-6be4-4363-9da8-02f91e8d3f36 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.673667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a81bfb9-6be4-4363-9da8-02f91e8d3f36 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.674354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a81bfb9-6be4-4363-9da8-02f91e8d3f36 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.680192 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-4e0b3721-f7b3-492d-8ec0-278389b8d776 req-a7ff6e1e-fe78-45eb-9cb4-f12d8f74d3ee service nova] Creating event network-vif-plugged:efc5b7ae-1aab-49aa-938d-1d74e0bd4507 for instance cea653ef-b11d-4341-a1cf-e941b5f3e570 on n-h1-839401-11 Aug 29 15:46:22.694640 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-4e0b3721-f7b3-492d-8ec0-278389b8d776 req-a7ff6e1e-fe78-45eb-9cb4-f12d8f74d3ee service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132921 Aug 29 15:46:22.697510 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2514/4874] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:46:22.906254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0a81bfb9-6be4-4363-9da8-02f91e8d3f36 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:22.920650 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0a81bfb9-6be4-4363-9da8-02f91e8d3f36 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.257965 Aug 29 15:46:22.934297 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2361/4875] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:22 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:23.383090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6d032b70-d693-473a-8d2e-7acedfbae625 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:23.384338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6d032b70-d693-473a-8d2e-7acedfbae625 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:23.403969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d032b70-d693-473a-8d2e-7acedfbae625 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.404437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d032b70-d693-473a-8d2e-7acedfbae625 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.405067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d032b70-d693-473a-8d2e-7acedfbae625 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.405981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d032b70-d693-473a-8d2e-7acedfbae625 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.406596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d032b70-d693-473a-8d2e-7acedfbae625 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.407180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d032b70-d693-473a-8d2e-7acedfbae625 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.536056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6e1069e1-ddbf-42f1-a8bd-54fd671ffa43 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:23.536650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6e1069e1-ddbf-42f1-a8bd-54fd671ffa43 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:23.548626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e1069e1-ddbf-42f1-a8bd-54fd671ffa43 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.549036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e1069e1-ddbf-42f1-a8bd-54fd671ffa43 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.549505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e1069e1-ddbf-42f1-a8bd-54fd671ffa43 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.550258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e1069e1-ddbf-42f1-a8bd-54fd671ffa43 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.550709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e1069e1-ddbf-42f1-a8bd-54fd671ffa43 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.555769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e1069e1-ddbf-42f1-a8bd-54fd671ffa43 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.677202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6d032b70-d693-473a-8d2e-7acedfbae625 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:23.686164 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6d032b70-d693-473a-8d2e-7acedfbae625 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1317 microversion: 2.1 time: 0.311443 Aug 29 15:46:23.689157 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2515/4876] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:23 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:23.804598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6e1069e1-ddbf-42f1-a8bd-54fd671ffa43 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:23.820792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6e1069e1-ddbf-42f1-a8bd-54fd671ffa43 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:23.826449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6e1069e1-ddbf-42f1-a8bd-54fd671ffa43 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:23.835685 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6e1069e1-ddbf-42f1-a8bd-54fd671ffa43 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.303888 Aug 29 15:46:23.836671 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2362/4877] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:23 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:23.941305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-67c9b112-7a5c-46a0-b64c-fbca3511d9ba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:23.941942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-67c9b112-7a5c-46a0-b64c-fbca3511d9ba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:23.950901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67c9b112-7a5c-46a0-b64c-fbca3511d9ba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.954697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67c9b112-7a5c-46a0-b64c-fbca3511d9ba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.955345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67c9b112-7a5c-46a0-b64c-fbca3511d9ba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.956801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67c9b112-7a5c-46a0-b64c-fbca3511d9ba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.958229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67c9b112-7a5c-46a0-b64c-fbca3511d9ba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.958683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67c9b112-7a5c-46a0-b64c-fbca3511d9ba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.177015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-67c9b112-7a5c-46a0-b64c-fbca3511d9ba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:24.186024 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-67c9b112-7a5c-46a0-b64c-fbca3511d9ba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.248715 Aug 29 15:46:24.200419 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2516/4878] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:23 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:24.709434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-70d11e0c-aef6-4ec2-b57d-5c4d4208fc4d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:24.710169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-70d11e0c-aef6-4ec2-b57d-5c4d4208fc4d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:24.723984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70d11e0c-aef6-4ec2-b57d-5c4d4208fc4d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.724493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70d11e0c-aef6-4ec2-b57d-5c4d4208fc4d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.724941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70d11e0c-aef6-4ec2-b57d-5c4d4208fc4d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.725711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70d11e0c-aef6-4ec2-b57d-5c4d4208fc4d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.726183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70d11e0c-aef6-4ec2-b57d-5c4d4208fc4d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.726616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70d11e0c-aef6-4ec2-b57d-5c4d4208fc4d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.769947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-8bcb4217-6dfc-4c65-9d3f-3484005c9b0d req-d3f3d313-94ca-4102-91a3-7c2d3990c68c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698e4c74-b063-4ffc-bbd9-9154af832815", "name": "network-vif-plugged", "status": "completed", "tag": "5917d456-8dc9-4d37-9614-af0759e075a5"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:24.785819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8bcb4217-6dfc-4c65-9d3f-3484005c9b0d req-d3f3d313-94ca-4102-91a3-7c2d3990c68c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.786500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8bcb4217-6dfc-4c65-9d3f-3484005c9b0d req-d3f3d313-94ca-4102-91a3-7c2d3990c68c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.787630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8bcb4217-6dfc-4c65-9d3f-3484005c9b0d req-d3f3d313-94ca-4102-91a3-7c2d3990c68c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.837357 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-8bcb4217-6dfc-4c65-9d3f-3484005c9b0d req-d3f3d313-94ca-4102-91a3-7c2d3990c68c service nova] Creating event network-vif-plugged:5917d456-8dc9-4d37-9614-af0759e075a5 for instance 698e4c74-b063-4ffc-bbd9-9154af832815 on n-h2-839401-11 Aug 29 15:46:24.852724 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-8bcb4217-6dfc-4c65-9d3f-3484005c9b0d req-d3f3d313-94ca-4102-91a3-7c2d3990c68c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086757 Aug 29 15:46:24.853757 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2517/4879] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:46:24.863200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-761951ba-85d3-4cdd-a161-d3f88a41732e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:24.863932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-761951ba-85d3-4cdd-a161-d3f88a41732e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:24.882614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-761951ba-85d3-4cdd-a161-d3f88a41732e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.883115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-761951ba-85d3-4cdd-a161-d3f88a41732e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.883554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-761951ba-85d3-4cdd-a161-d3f88a41732e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.888805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-761951ba-85d3-4cdd-a161-d3f88a41732e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.890233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-761951ba-85d3-4cdd-a161-d3f88a41732e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.890864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-761951ba-85d3-4cdd-a161-d3f88a41732e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.003074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-761951ba-85d3-4cdd-a161-d3f88a41732e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:25.018783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-761951ba-85d3-4cdd-a161-d3f88a41732e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:25.021398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-761951ba-85d3-4cdd-a161-d3f88a41732e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:25.023565 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-761951ba-85d3-4cdd-a161-d3f88a41732e tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.166844 Aug 29 15:46:25.024962 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2518/4880] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:24 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:46:25.044340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-33a4665d-563e-4b5c-8aaf-68eaab9eb4d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:25.046550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-33a4665d-563e-4b5c-8aaf-68eaab9eb4d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:25.057407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33a4665d-563e-4b5c-8aaf-68eaab9eb4d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.058652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33a4665d-563e-4b5c-8aaf-68eaab9eb4d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.059275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33a4665d-563e-4b5c-8aaf-68eaab9eb4d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.060745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33a4665d-563e-4b5c-8aaf-68eaab9eb4d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.064487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33a4665d-563e-4b5c-8aaf-68eaab9eb4d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.065208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33a4665d-563e-4b5c-8aaf-68eaab9eb4d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.075618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-70d11e0c-aef6-4ec2-b57d-5c4d4208fc4d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:25.090913 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-70d11e0c-aef6-4ec2-b57d-5c4d4208fc4d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1317 microversion: 2.1 time: 0.385715 Aug 29 15:46:25.093917 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2363/4881] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:24 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:25.102442 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-33a4665d-563e-4b5c-8aaf-68eaab9eb4d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] HTTP exception thrown: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-33a4665d-563e-4b5c-8aaf-68eaab9eb4d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Request method failure captured: Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 HTTP/1.1 Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN1hzQ3z2U-w-FgTgqHX6rJBPsY0JjEnUe64fPTyeVmgZsBprzTQ1bIdxek9a-vYJQ_HslrhHa9E2P7RvnOg4AfCoJyg0z1_3P2l3RDilU7LN-AayEaJX63yJg3v6qo8LD4c_wIISDZxt3UYbqIe3Yye-nWgNVTo4Tjj1hcQrc45oDU Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 8c81e50c9fdd45919b4d6c8e6682d97d Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8c81e50c9fdd45919b4d6c8e6682d97d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8c81e50c9fdd45919b4d6c8e6682d97d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8c81e50c9fdd45919b4d6c8e6682d97d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8c81e50c9fdd45919b4d6c8e6682d97d"}]}] Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 8c81e50c9fdd45919b4d6c8e6682d97d Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AttachVolumeTestJSON-1547689605-project Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 77a898d8b4f7477281081a0e4dedf493 Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AttachVolumeTestJSON-1547689605-project Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '89dfeae0-3079-4a17-bc65-7ad03318e731'} Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:25.105828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:25.110500 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. Aug 29 15:46:25.110500 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:25.110500 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:25.110500 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:25.110500 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:25.110500 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:25.110500 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:25.110500 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:25.110500 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:25.110500 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. Aug 29 15:46:25.110500 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:25.112855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-33a4665d-563e-4b5c-8aaf-68eaab9eb4d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Returning 404 to user: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:25.114338 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-33a4665d-563e-4b5c-8aaf-68eaab9eb4d6 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "DELETE /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 404 len: 111 microversion: 2.1 time: 0.088190 Aug 29 15:46:25.115162 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2519/4882] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:25 2022] DELETE /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:25.143231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-be92afa0-8300-496c-a4d0-e79b3a95a994 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:25.144032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-be92afa0-8300-496c-a4d0-e79b3a95a994 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: 89dfeae0-3079-4a17-bc65-7ad03318e731] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:25.172326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be92afa0-8300-496c-a4d0-e79b3a95a994 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.172840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be92afa0-8300-496c-a4d0-e79b3a95a994 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.173333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be92afa0-8300-496c-a4d0-e79b3a95a994 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.174065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be92afa0-8300-496c-a4d0-e79b3a95a994 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.174531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be92afa0-8300-496c-a4d0-e79b3a95a994 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.174967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be92afa0-8300-496c-a4d0-e79b3a95a994 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.203389 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-be92afa0-8300-496c-a4d0-e79b3a95a994 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] HTTP exception thrown: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. Aug 29 15:46:25.211237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-92972dec-1905-4925-a0b7-3a6b7fb90e69 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:25.213063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-92972dec-1905-4925-a0b7-3a6b7fb90e69 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-be92afa0-8300-496c-a4d0-e79b3a95a994 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Request method failure captured: Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 HTTP/1.1 Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN1hzQ3z2U-w-FgTgqHX6rJBPsY0JjEnUe64fPTyeVmgZsBprzTQ1bIdxek9a-vYJQ_HslrhHa9E2P7RvnOg4AfCoJyg0z1_3P2l3RDilU7LN-AayEaJX63yJg3v6qo8LD4c_wIISDZxt3UYbqIe3Yye-nWgNVTo4Tjj1hcQrc45oDU Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 8c81e50c9fdd45919b4d6c8e6682d97d Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8c81e50c9fdd45919b4d6c8e6682d97d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8c81e50c9fdd45919b4d6c8e6682d97d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8c81e50c9fdd45919b4d6c8e6682d97d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8c81e50c9fdd45919b4d6c8e6682d97d"}]}] Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 8c81e50c9fdd45919b4d6c8e6682d97d Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachVolumeTestJSON-1547689605-project Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 77a898d8b4f7477281081a0e4dedf493 Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachVolumeTestJSON-1547689605-project Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '89dfeae0-3079-4a17-bc65-7ad03318e731'} Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:25.213868 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:25.218656 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:25.218656 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:25.218656 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:25.218656 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:25.218656 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:25.218656 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. Aug 29 15:46:25.218656 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:25.220550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-be92afa0-8300-496c-a4d0-e79b3a95a994 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Returning 404 to user: Instance 89dfeae0-3079-4a17-bc65-7ad03318e731 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:25.222207 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-be92afa0-8300-496c-a4d0-e79b3a95a994 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731" status: 404 len: 111 microversion: 2.1 time: 0.098923 Aug 29 15:46:25.222808 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2364/4883] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:25 2022] GET /compute/v2.1/servers/89dfeae0-3079-4a17-bc65-7ad03318e731 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:25.224629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92972dec-1905-4925-a0b7-3a6b7fb90e69 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.225383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92972dec-1905-4925-a0b7-3a6b7fb90e69 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.226094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92972dec-1905-4925-a0b7-3a6b7fb90e69 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.227081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92972dec-1905-4925-a0b7-3a6b7fb90e69 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.227978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92972dec-1905-4925-a0b7-3a6b7fb90e69 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.228567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92972dec-1905-4925-a0b7-3a6b7fb90e69 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.555206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-92972dec-1905-4925-a0b7-3a6b7fb90e69 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:25.567155 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-92972dec-1905-4925-a0b7-3a6b7fb90e69 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.363912 Aug 29 15:46:25.586870 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2520/4884] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:25 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:26.046669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-94314831-ec23-4794-9e2f-50fec01d7d04 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:26.050560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-94314831-ec23-4794-9e2f-50fec01d7d04 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:26.062283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94314831-ec23-4794-9e2f-50fec01d7d04 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.065925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94314831-ec23-4794-9e2f-50fec01d7d04 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.067554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94314831-ec23-4794-9e2f-50fec01d7d04 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.068446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94314831-ec23-4794-9e2f-50fec01d7d04 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.070659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94314831-ec23-4794-9e2f-50fec01d7d04 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.073175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94314831-ec23-4794-9e2f-50fec01d7d04 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.121344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cc8ee7ec-0e10-445a-9c09-4a446f5d0060 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:26.121967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cc8ee7ec-0e10-445a-9c09-4a446f5d0060 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:26.140202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc8ee7ec-0e10-445a-9c09-4a446f5d0060 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.140702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc8ee7ec-0e10-445a-9c09-4a446f5d0060 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.141182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc8ee7ec-0e10-445a-9c09-4a446f5d0060 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.142664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc8ee7ec-0e10-445a-9c09-4a446f5d0060 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.143132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc8ee7ec-0e10-445a-9c09-4a446f5d0060 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.143729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc8ee7ec-0e10-445a-9c09-4a446f5d0060 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.244642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-94314831-ec23-4794-9e2f-50fec01d7d04 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:26.258025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-94314831-ec23-4794-9e2f-50fec01d7d04 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:26.259501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-94314831-ec23-4794-9e2f-50fec01d7d04 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:26.260709 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-94314831-ec23-4794-9e2f-50fec01d7d04 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.218324 Aug 29 15:46:26.261319 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2365/4885] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:26 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:26.432370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cc8ee7ec-0e10-445a-9c09-4a446f5d0060 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:26.442098 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cc8ee7ec-0e10-445a-9c09-4a446f5d0060 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1317 microversion: 2.1 time: 0.327494 Aug 29 15:46:26.455731 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2521/4886] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:26 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:26.597827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5e62f44f-5cef-4e30-9d9c-afa9e280fc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:26.598453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5e62f44f-5cef-4e30-9d9c-afa9e280fc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:26.606429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e62f44f-5cef-4e30-9d9c-afa9e280fc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.606936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e62f44f-5cef-4e30-9d9c-afa9e280fc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.607392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e62f44f-5cef-4e30-9d9c-afa9e280fc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.608135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e62f44f-5cef-4e30-9d9c-afa9e280fc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.608594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e62f44f-5cef-4e30-9d9c-afa9e280fc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.613887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e62f44f-5cef-4e30-9d9c-afa9e280fc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.289691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-42559c7f-fb75-4168-8229-36cf53e684d1 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:27.291734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-42559c7f-fb75-4168-8229-36cf53e684d1 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:27.300764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42559c7f-fb75-4168-8229-36cf53e684d1 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.301694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42559c7f-fb75-4168-8229-36cf53e684d1 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.302403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42559c7f-fb75-4168-8229-36cf53e684d1 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.305207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42559c7f-fb75-4168-8229-36cf53e684d1 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.306385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42559c7f-fb75-4168-8229-36cf53e684d1 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.307349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42559c7f-fb75-4168-8229-36cf53e684d1 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.439990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-42559c7f-fb75-4168-8229-36cf53e684d1 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:27.456801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-42559c7f-fb75-4168-8229-36cf53e684d1 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:27.457302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5e62f44f-5cef-4e30-9d9c-afa9e280fc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:27.458358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-42559c7f-fb75-4168-8229-36cf53e684d1 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:27.459651 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-42559c7f-fb75-4168-8229-36cf53e684d1 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.174179 Aug 29 15:46:27.470035 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5e62f44f-5cef-4e30-9d9c-afa9e280fc61 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1504 microversion: 2.1 time: 0.880048 Aug 29 15:46:27.474968 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2522/4887] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:27 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:27.484031 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2366/4888] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:26 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1504 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:27.493869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-974f9632-973d-45c5-a4e0-8bced3dacdf0 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:27.496552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-974f9632-973d-45c5-a4e0-8bced3dacdf0 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:27.508519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-974f9632-973d-45c5-a4e0-8bced3dacdf0 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.510171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-974f9632-973d-45c5-a4e0-8bced3dacdf0 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.511905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-974f9632-973d-45c5-a4e0-8bced3dacdf0 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.513177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-974f9632-973d-45c5-a4e0-8bced3dacdf0 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.514937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-974f9632-973d-45c5-a4e0-8bced3dacdf0 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.515661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-974f9632-973d-45c5-a4e0-8bced3dacdf0 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.787511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-974f9632-973d-45c5-a4e0-8bced3dacdf0 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:27.796275 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-974f9632-973d-45c5-a4e0-8bced3dacdf0 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1467 microversion: 2.1 time: 0.319979 Aug 29 15:46:27.797640 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2523/4889] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:27 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1467 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:27.819011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3533d11c-2444-4acf-b3d6-2be4b070801d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:27.820303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3533d11c-2444-4acf-b3d6-2be4b070801d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: cea653ef-b11d-4341-a1cf-e941b5f3e570] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:27.828571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3533d11c-2444-4acf-b3d6-2be4b070801d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.829343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3533d11c-2444-4acf-b3d6-2be4b070801d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.830461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3533d11c-2444-4acf-b3d6-2be4b070801d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.831400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3533d11c-2444-4acf-b3d6-2be4b070801d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.832009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3533d11c-2444-4acf-b3d6-2be4b070801d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.832583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3533d11c-2444-4acf-b3d6-2be4b070801d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.202832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-099c345a-a68e-47f3-8f73-6450b423f86b req-1b2ce4cf-2679-4559-9174-787b7211d412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da85002f-e41a-4518-98e0-ee129e44af23", "name": "network-vif-deleted", "tag": "01dc6e29-d11a-4c10-8730-a6565b174ea3"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:28.219084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-099c345a-a68e-47f3-8f73-6450b423f86b req-1b2ce4cf-2679-4559-9174-787b7211d412 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.219561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-099c345a-a68e-47f3-8f73-6450b423f86b req-1b2ce4cf-2679-4559-9174-787b7211d412 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.220030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-099c345a-a68e-47f3-8f73-6450b423f86b req-1b2ce4cf-2679-4559-9174-787b7211d412 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.258833 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-099c345a-a68e-47f3-8f73-6450b423f86b req-1b2ce4cf-2679-4559-9174-787b7211d412 service nova] Creating event network-vif-deleted:01dc6e29-d11a-4c10-8730-a6565b174ea3 for instance da85002f-e41a-4518-98e0-ee129e44af23 on n-h1-839401-11 Aug 29 15:46:28.268061 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-099c345a-a68e-47f3-8f73-6450b423f86b req-1b2ce4cf-2679-4559-9174-787b7211d412 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069644 Aug 29 15:46:28.277764 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2524/4890] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:46:28.497116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4df29512-bce6-419b-8419-7dfeaed65dba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:28.499196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4df29512-bce6-419b-8419-7dfeaed65dba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:28.509022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4df29512-bce6-419b-8419-7dfeaed65dba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.509714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4df29512-bce6-419b-8419-7dfeaed65dba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.510284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4df29512-bce6-419b-8419-7dfeaed65dba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.511166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4df29512-bce6-419b-8419-7dfeaed65dba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.512037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4df29512-bce6-419b-8419-7dfeaed65dba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.512564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4df29512-bce6-419b-8419-7dfeaed65dba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.552927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4df29512-bce6-419b-8419-7dfeaed65dba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.553858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4df29512-bce6-419b-8419-7dfeaed65dba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.554557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4df29512-bce6-419b-8419-7dfeaed65dba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.555226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-4df29512-bce6-419b-8419-7dfeaed65dba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lazy-loading 'fault' on Instance uuid da85002f-e41a-4518-98e0-ee129e44af23 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:28.638605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4df29512-bce6-419b-8419-7dfeaed65dba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:28.650037 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4df29512-bce6-419b-8419-7dfeaed65dba tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 200 len: 1303 microversion: 2.1 time: 0.157634 Aug 29 15:46:28.660097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3533d11c-2444-4acf-b3d6-2be4b070801d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:28.667468 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2525/4891] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:28 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 1303 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:28.675801 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3533d11c-2444-4acf-b3d6-2be4b070801d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570" status: 200 len: 1467 microversion: 2.1 time: 0.861595 Aug 29 15:46:28.677389 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2367/4892] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:27 2022] GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570 => generated 1467 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:28.681056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0939d34d-4df7-449d-be36-55697874b00d tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:28.684727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0939d34d-4df7-449d-be36-55697874b00d tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:28.700725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1e766e90-6673-4340-8717-ed4672a7169d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-178995889"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:28.702381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0939d34d-4df7-449d-be36-55697874b00d tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.702778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0939d34d-4df7-449d-be36-55697874b00d tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.703240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0939d34d-4df7-449d-be36-55697874b00d tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.704540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1e766e90-6673-4340-8717-ed4672a7169d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: cea653ef-b11d-4341-a1cf-e941b5f3e570] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:28.706362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0939d34d-4df7-449d-be36-55697874b00d tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.706873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0939d34d-4df7-449d-be36-55697874b00d tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.708673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0939d34d-4df7-449d-be36-55697874b00d tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.722943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e766e90-6673-4340-8717-ed4672a7169d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.723436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e766e90-6673-4340-8717-ed4672a7169d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.723870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e766e90-6673-4340-8717-ed4672a7169d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.724580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e766e90-6673-4340-8717-ed4672a7169d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.725032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e766e90-6673-4340-8717-ed4672a7169d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.725497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e766e90-6673-4340-8717-ed4672a7169d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.970709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0939d34d-4df7-449d-be36-55697874b00d tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:28.983868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0939d34d-4df7-449d-be36-55697874b00d tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:28.994303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0939d34d-4df7-449d-be36-55697874b00d tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:28.997942 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0939d34d-4df7-449d-be36-55697874b00d tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.326502 Aug 29 15:46:28.999807 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2526/4893] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:28 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:29.093548 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1e766e90-6673-4340-8717-ed4672a7169d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "POST /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570/action" status: 202 len: 0 microversion: 2.1 time: 0.395851 Aug 29 15:46:29.096894 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2368/4894] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:46:28 2022] POST /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 29 15:46:29.110600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85abc5d4-0e93-4035-8364-a14932a54095 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42aaeeee0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:29.191171 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85abc5d4-0e93-4035-8364-a14932a54095 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.087277 Aug 29 15:46:29.192416 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2527/4895] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:29 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:29.674850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8b666719-1bc7-40c1-aba1-0e8f628dda75 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:29.676477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8b666719-1bc7-40c1-aba1-0e8f628dda75 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: da85002f-e41a-4518-98e0-ee129e44af23] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:29.689709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b666719-1bc7-40c1-aba1-0e8f628dda75 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.691161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b666719-1bc7-40c1-aba1-0e8f628dda75 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.695123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b666719-1bc7-40c1-aba1-0e8f628dda75 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:29.697254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b666719-1bc7-40c1-aba1-0e8f628dda75 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.699887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b666719-1bc7-40c1-aba1-0e8f628dda75 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.701038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b666719-1bc7-40c1-aba1-0e8f628dda75 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:29.743032 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-8b666719-1bc7-40c1-aba1-0e8f628dda75 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] HTTP exception thrown: Instance da85002f-e41a-4518-98e0-ee129e44af23 could not be found. Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8b666719-1bc7-40c1-aba1-0e8f628dda75 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Request method failure captured: Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 HTTP/1.1 Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN7JkbZPbGfWGN5wCTl1d8oPZtHw0wvuGkWXH2O3WhCVCjIiM60Hmx3_CdEM3tciSEZwnhOGXwvbo8aQyPB6XMB3ZEHJ8nU7zX4vNEM1PHvRGNaUvJQ4L-yDqQyo2x4DGo3_N3YHuXXfWleiWJtMB4Q5sUPb0jZYdqPAdDwVtbX8tNo Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: eccbf3aa74064e6abad669b285e7614d Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerRescueTestJSON-1671151142 Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eccbf3aa74064e6abad669b285e7614d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eccbf3aa74064e6abad669b285e7614d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eccbf3aa74064e6abad669b285e7614d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eccbf3aa74064e6abad669b285e7614d"}]}] Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerRescueTestJSON-1671151142 Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: eccbf3aa74064e6abad669b285e7614d Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerRescueTestJSON-1671151142 Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerRescueTestJSON-1671151142-project Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 332348822e194b488606b04ea4107de7 Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerRescueTestJSON-1671151142-project Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance da85002f-e41a-4518-98e0-ee129e44af23 could not be found. Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'da85002f-e41a-4518-98e0-ee129e44af23'} Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da85002f-e41a-4518-98e0-ee129e44af23 could not be found. Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da85002f-e41a-4518-98e0-ee129e44af23 could not be found. Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:29.748833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:29.752842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:29.752842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:29.752842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:29.752842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:29.752842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:29.752842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da85002f-e41a-4518-98e0-ee129e44af23 could not be found. Aug 29 15:46:29.752842 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:29.752842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8b666719-1bc7-40c1-aba1-0e8f628dda75 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Returning 404 to user: Instance da85002f-e41a-4518-98e0-ee129e44af23 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:29.752842 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8b666719-1bc7-40c1-aba1-0e8f628dda75 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23" status: 404 len: 111 microversion: 2.1 time: 0.081606 Aug 29 15:46:29.757496 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2369/4896] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:29 2022] GET /compute/v2.1/servers/da85002f-e41a-4518-98e0-ee129e44af23 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:29.760412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6a0de853-8bd3-42c9-aca3-74cfabd414ac tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:29.760924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6a0de853-8bd3-42c9-aca3-74cfabd414ac tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:29.787369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0de853-8bd3-42c9-aca3-74cfabd414ac tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.793657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0de853-8bd3-42c9-aca3-74cfabd414ac tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.795654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0de853-8bd3-42c9-aca3-74cfabd414ac tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:29.796637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0de853-8bd3-42c9-aca3-74cfabd414ac tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.800379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0de853-8bd3-42c9-aca3-74cfabd414ac tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.801026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0de853-8bd3-42c9-aca3-74cfabd414ac tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:29.812254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bd6c5a4d-40cb-40c4-94cb-d23c6d06480f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:29.812771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bd6c5a4d-40cb-40c4-94cb-d23c6d06480f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:29.821456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd6c5a4d-40cb-40c4-94cb-d23c6d06480f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.824498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd6c5a4d-40cb-40c4-94cb-d23c6d06480f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.825033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd6c5a4d-40cb-40c4-94cb-d23c6d06480f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:29.825854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd6c5a4d-40cb-40c4-94cb-d23c6d06480f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.834992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd6c5a4d-40cb-40c4-94cb-d23c6d06480f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.835665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd6c5a4d-40cb-40c4-94cb-d23c6d06480f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:29.861843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6a0de853-8bd3-42c9-aca3-74cfabd414ac tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:29.891959 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-bd6c5a4d-40cb-40c4-94cb-d23c6d06480f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] HTTP exception thrown: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bd6c5a4d-40cb-40c4-94cb-d23c6d06480f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Request method failure captured: Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 HTTP/1.1 Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN1hzQ3z2U-w-FgTgqHX6rJBPsY0JjEnUe64fPTyeVmgZsBprzTQ1bIdxek9a-vYJQ_HslrhHa9E2P7RvnOg4AfCoJyg0z1_3P2l3RDilU7LN-AayEaJX63yJg3v6qo8LD4c_wIISDZxt3UYbqIe3Yye-nWgNVTo4Tjj1hcQrc45oDU Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 8c81e50c9fdd45919b4d6c8e6682d97d Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8c81e50c9fdd45919b4d6c8e6682d97d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8c81e50c9fdd45919b4d6c8e6682d97d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8c81e50c9fdd45919b4d6c8e6682d97d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8c81e50c9fdd45919b4d6c8e6682d97d"}]}] Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 8c81e50c9fdd45919b4d6c8e6682d97d Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachVolumeTestJSON-1547689605-project Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 77a898d8b4f7477281081a0e4dedf493 Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachVolumeTestJSON-1547689605-project Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'd1c7ad8e-1ed9-4347-bb61-13e861e30886'} Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:29.894083 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:29.898650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. Aug 29 15:46:29.898650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:29.898650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:29.898650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:29.898650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:29.898650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:29.898650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:29.898650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:29.898650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:29.898650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. Aug 29 15:46:29.898650 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:29.898650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bd6c5a4d-40cb-40c4-94cb-d23c6d06480f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Returning 404 to user: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:29.898650 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bd6c5a4d-40cb-40c4-94cb-d23c6d06480f tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 404 len: 111 microversion: 2.1 time: 0.088227 Aug 29 15:46:29.906193 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2370/4897] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:29 2022] DELETE /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:46:29.913430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-601be17d-14cc-4763-a3bd-7362db0efc65 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:29.919275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-601be17d-14cc-4763-a3bd-7362db0efc65 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] [instance: d1c7ad8e-1ed9-4347-bb61-13e861e30886] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:29.930382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:29.942937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601be17d-14cc-4763-a3bd-7362db0efc65 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.948006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601be17d-14cc-4763-a3bd-7362db0efc65 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.948582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601be17d-14cc-4763-a3bd-7362db0efc65 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:29.950270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601be17d-14cc-4763-a3bd-7362db0efc65 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.960667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601be17d-14cc-4763-a3bd-7362db0efc65 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.961263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601be17d-14cc-4763-a3bd-7362db0efc65 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:30.044385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:30.048975 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-601be17d-14cc-4763-a3bd-7362db0efc65 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] HTTP exception thrown: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. Aug 29 15:46:30.052539 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6a0de853-8bd3-42c9-aca3-74cfabd414ac tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 204 len: 0 microversion: 2.1 time: 0.296623 Aug 29 15:46:30.055850 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2528/4898] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:29 2022] DELETE /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-601be17d-14cc-4763-a3bd-7362db0efc65 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Request method failure captured: Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 HTTP/1.1 Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN1hzQ3z2U-w-FgTgqHX6rJBPsY0JjEnUe64fPTyeVmgZsBprzTQ1bIdxek9a-vYJQ_HslrhHa9E2P7RvnOg4AfCoJyg0z1_3P2l3RDilU7LN-AayEaJX63yJg3v6qo8LD4c_wIISDZxt3UYbqIe3Yye-nWgNVTo4Tjj1hcQrc45oDU Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 8c81e50c9fdd45919b4d6c8e6682d97d Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8c81e50c9fdd45919b4d6c8e6682d97d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8c81e50c9fdd45919b4d6c8e6682d97d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8c81e50c9fdd45919b4d6c8e6682d97d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8c81e50c9fdd45919b4d6c8e6682d97d"}]}] Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 8c81e50c9fdd45919b4d6c8e6682d97d Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1547689605 Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachVolumeTestJSON-1547689605-project Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 77a898d8b4f7477281081a0e4dedf493 Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachVolumeTestJSON-1547689605-project Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'd1c7ad8e-1ed9-4347-bb61-13e861e30886'} Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:30.062267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:30.066828 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:30.066828 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:30.066828 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:30.066828 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:30.066828 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:30.066828 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. Aug 29 15:46:30.066828 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:30.068164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-601be17d-14cc-4763-a3bd-7362db0efc65 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] Returning 404 to user: Instance d1c7ad8e-1ed9-4347-bb61-13e861e30886 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:30.069272 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-601be17d-14cc-4763-a3bd-7362db0efc65 tempest-AttachVolumeTestJSON-1547689605 tempest-AttachVolumeTestJSON-1547689605-project] 10.222.0.62 "GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886" status: 404 len: 111 microversion: 2.1 time: 0.161488 Aug 29 15:46:30.070958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5b852c9f-13e6-463f-83f9-2dacc3c791f6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:30.074251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5b852c9f-13e6-463f-83f9-2dacc3c791f6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:30.074412 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2371/4899] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:29 2022] GET /compute/v2.1/servers/d1c7ad8e-1ed9-4347-bb61-13e861e30886 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:30.080799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-661ad665-abeb-4df0-8e5a-2d77ce83f36d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:30.081481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-661ad665-abeb-4df0-8e5a-2d77ce83f36d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:30.086653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b852c9f-13e6-463f-83f9-2dacc3c791f6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:30.089868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-661ad665-abeb-4df0-8e5a-2d77ce83f36d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:30.090144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b852c9f-13e6-463f-83f9-2dacc3c791f6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:30.090712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-661ad665-abeb-4df0-8e5a-2d77ce83f36d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:30.090837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b852c9f-13e6-463f-83f9-2dacc3c791f6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:30.091412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-661ad665-abeb-4df0-8e5a-2d77ce83f36d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:30.092231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b852c9f-13e6-463f-83f9-2dacc3c791f6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:30.092419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-661ad665-abeb-4df0-8e5a-2d77ce83f36d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:30.093019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-661ad665-abeb-4df0-8e5a-2d77ce83f36d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:30.093749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-661ad665-abeb-4df0-8e5a-2d77ce83f36d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:30.093943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b852c9f-13e6-463f-83f9-2dacc3c791f6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:30.095912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b852c9f-13e6-463f-83f9-2dacc3c791f6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:30.230439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5b852c9f-13e6-463f-83f9-2dacc3c791f6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:30.241616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5b852c9f-13e6-463f-83f9-2dacc3c791f6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:30.245482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5b852c9f-13e6-463f-83f9-2dacc3c791f6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:30.249504 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5b852c9f-13e6-463f-83f9-2dacc3c791f6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.192120 Aug 29 15:46:30.251897 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2529/4900] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:30 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:30.263139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2a4a837a-48bf-4db3-9cc6-21cf3bca7c76 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a9a9430>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:30.344193 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2a4a837a-48bf-4db3-9cc6-21cf3bca7c76 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.090742 Aug 29 15:46:30.344999 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2530/4901] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:30 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:30.751134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-661ad665-abeb-4df0-8e5a-2d77ce83f36d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:30.760098 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-661ad665-abeb-4df0-8e5a-2d77ce83f36d tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1492 microversion: 2.1 time: 0.684626 Aug 29 15:46:30.760690 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2372/4902] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:30 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1492 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:31.279462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1817531b-587c-47e7-b0a7-fe32b2580a1b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:31.280274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1817531b-587c-47e7-b0a7-fe32b2580a1b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:31.293594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1817531b-587c-47e7-b0a7-fe32b2580a1b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:31.294499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1817531b-587c-47e7-b0a7-fe32b2580a1b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:31.295330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1817531b-587c-47e7-b0a7-fe32b2580a1b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:31.298071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1817531b-587c-47e7-b0a7-fe32b2580a1b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:31.300827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1817531b-587c-47e7-b0a7-fe32b2580a1b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:31.301457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1817531b-587c-47e7-b0a7-fe32b2580a1b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:31.360110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e7fd2c76-9072-494d-8117-a4ad09c8a233 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a5770d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:31.463530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1817531b-587c-47e7-b0a7-fe32b2580a1b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:31.473638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1817531b-587c-47e7-b0a7-fe32b2580a1b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:31.478003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1817531b-587c-47e7-b0a7-fe32b2580a1b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:31.482649 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1817531b-587c-47e7-b0a7-fe32b2580a1b tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.204477 Aug 29 15:46:31.483027 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e7fd2c76-9072-494d-8117-a4ad09c8a233 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.127293 Aug 29 15:46:31.483717 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2373/4903] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:31 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:31.503981 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2531/4904] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:31 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:31.785486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-59ba4161-6830-442c-bc16-47f11074f29f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:31.786143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-59ba4161-6830-442c-bc16-47f11074f29f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:31.797245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59ba4161-6830-442c-bc16-47f11074f29f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:31.799716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59ba4161-6830-442c-bc16-47f11074f29f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:31.800204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59ba4161-6830-442c-bc16-47f11074f29f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:31.800930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59ba4161-6830-442c-bc16-47f11074f29f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:31.801428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59ba4161-6830-442c-bc16-47f11074f29f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:31.801854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-59ba4161-6830-442c-bc16-47f11074f29f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:32.337663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-59ba4161-6830-442c-bc16-47f11074f29f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:32.347160 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-59ba4161-6830-442c-bc16-47f11074f29f tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1492 microversion: 2.1 time: 0.566909 Aug 29 15:46:32.347798 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2374/4905] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:31 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1492 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:32.499005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-44f038b2-4969-431a-9674-8a9d18551435 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a93f550>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:32.509559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6f7b335e-e890-4136-a5b6-c05b16684c2f tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:32.518286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6f7b335e-e890-4136-a5b6-c05b16684c2f tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:32.551778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f7b335e-e890-4136-a5b6-c05b16684c2f tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:32.552285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f7b335e-e890-4136-a5b6-c05b16684c2f tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:32.554105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f7b335e-e890-4136-a5b6-c05b16684c2f tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:32.556044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f7b335e-e890-4136-a5b6-c05b16684c2f tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:32.557181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f7b335e-e890-4136-a5b6-c05b16684c2f tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:32.557828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f7b335e-e890-4136-a5b6-c05b16684c2f tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:32.603025 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-44f038b2-4969-431a-9674-8a9d18551435 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.107815 Aug 29 15:46:32.618032 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2532/4906] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:32 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:32.798370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6f7b335e-e890-4136-a5b6-c05b16684c2f tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:32.814509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6f7b335e-e890-4136-a5b6-c05b16684c2f tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:32.822007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6f7b335e-e890-4136-a5b6-c05b16684c2f tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:32.823469 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6f7b335e-e890-4136-a5b6-c05b16684c2f tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.320897 Aug 29 15:46:32.824591 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2375/4907] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:32 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:32.862146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1202133268", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "9336cdb0-b897-49ca-bae3-4d94cb6760e8"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:32.934222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] validate_networks() for [('9336cdb0-b897-49ca-bae3-4d94cb6760e8', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:46:33.379528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-381fec60-69af-40ef-b745-ec4b6be2be94 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:33.380156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-381fec60-69af-40ef-b745-ec4b6be2be94 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:33.406037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-381fec60-69af-40ef-b745-ec4b6be2be94 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:33.406610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-381fec60-69af-40ef-b745-ec4b6be2be94 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:33.407621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-381fec60-69af-40ef-b745-ec4b6be2be94 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:33.408881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-381fec60-69af-40ef-b745-ec4b6be2be94 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:33.412825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-381fec60-69af-40ef-b745-ec4b6be2be94 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:33.413390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-381fec60-69af-40ef-b745-ec4b6be2be94 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:33.682024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:46:33.683119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:46:33.683760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:46:33.684316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:46:33.684879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:46:33.697810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:33.698912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:33.699543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:33.700594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:33.701573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:33.702179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:33.732049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Getting quotas for project ad3598383c5942fea06ea4d4127e3bae. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:46:33.739555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Getting quotas for user 10666298a76745c7bada4de3653cdc91 and project ad3598383c5942fea06ea4d4127e3bae. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:46:33.754673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:46:33.757806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:46:33.845199 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1e17f4b3-6f3f-46f9-907b-6a132a789775 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.210229 Aug 29 15:46:33.845199 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2533/4908] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:46:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:46:33.852758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f2c1dd4d-f20e-41db-98a6-0b5834e89bfa tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a9a93a0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:33.917431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-381fec60-69af-40ef-b745-ec4b6be2be94 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:33.933116 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-381fec60-69af-40ef-b745-ec4b6be2be94 tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1492 microversion: 2.1 time: 0.567978 Aug 29 15:46:33.935823 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2376/4909] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:33 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1492 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:33.941071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c292eb53-7b2f-4e93-bae8-06f9a4a36c29 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:33.942449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c292eb53-7b2f-4e93-bae8-06f9a4a36c29 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:33.948976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c292eb53-7b2f-4e93-bae8-06f9a4a36c29 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:33.950465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c292eb53-7b2f-4e93-bae8-06f9a4a36c29 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:33.951102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c292eb53-7b2f-4e93-bae8-06f9a4a36c29 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:33.951984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c292eb53-7b2f-4e93-bae8-06f9a4a36c29 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:33.952606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c292eb53-7b2f-4e93-bae8-06f9a4a36c29 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:33.953229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c292eb53-7b2f-4e93-bae8-06f9a4a36c29 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:33.961605 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f2c1dd4d-f20e-41db-98a6-0b5834e89bfa tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.116554 Aug 29 15:46:33.962205 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2534/4910] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:33 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:33.978766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d292241-301b-44c8-8b5c-ed6eb127467c tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:33.981254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9d292241-301b-44c8-8b5c-ed6eb127467c tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:34.079162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9d292241-301b-44c8-8b5c-ed6eb127467c tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:34.086923 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d292241-301b-44c8-8b5c-ed6eb127467c tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1217 microversion: 2.1 time: 0.122043 Aug 29 15:46:34.088169 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2535/4911] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:33 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:34.107628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c292eb53-7b2f-4e93-bae8-06f9a4a36c29 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:34.120874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c292eb53-7b2f-4e93-bae8-06f9a4a36c29 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:34.123045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c292eb53-7b2f-4e93-bae8-06f9a4a36c29 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:34.125807 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c292eb53-7b2f-4e93-bae8-06f9a4a36c29 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.188711 Aug 29 15:46:34.126986 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2377/4912] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:33 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:34.490732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-3b301c71-c6c3-4fbb-9849-c49c174a4fbc req-ce59bffb-6e47-453a-a0a2-fb1e9f641532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcc1f7c-211b-4ed6-a898-31dd9cdb5228", "name": "network-vif-deleted", "tag": "f90231df-2485-49aa-844b-2ef5dad9a761"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:34.495914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d40ffd98-1a97-4f29-a5df-e9fe3e4990f6 req-94f5e172-66f8-4e50-8a57-f89c8ba93168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea653ef-b11d-4341-a1cf-e941b5f3e570", "name": "network-vif-plugged", "status": "completed", "tag": "efc5b7ae-1aab-49aa-938d-1d74e0bd4507"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:34.517898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:34.520492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d40ffd98-1a97-4f29-a5df-e9fe3e4990f6 req-94f5e172-66f8-4e50-8a57-f89c8ba93168 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:34.521164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d40ffd98-1a97-4f29-a5df-e9fe3e4990f6 req-94f5e172-66f8-4e50-8a57-f89c8ba93168 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:34.521641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d40ffd98-1a97-4f29-a5df-e9fe3e4990f6 req-94f5e172-66f8-4e50-8a57-f89c8ba93168 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:34.542937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3b301c71-c6c3-4fbb-9849-c49c174a4fbc req-ce59bffb-6e47-453a-a0a2-fb1e9f641532 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:34.544774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3b301c71-c6c3-4fbb-9849-c49c174a4fbc req-ce59bffb-6e47-453a-a0a2-fb1e9f641532 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:34.545454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3b301c71-c6c3-4fbb-9849-c49c174a4fbc req-ce59bffb-6e47-453a-a0a2-fb1e9f641532 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:34.575012 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d40ffd98-1a97-4f29-a5df-e9fe3e4990f6 req-94f5e172-66f8-4e50-8a57-f89c8ba93168 service nova] Creating event network-vif-plugged:efc5b7ae-1aab-49aa-938d-1d74e0bd4507 for instance cea653ef-b11d-4341-a1cf-e941b5f3e570 on n-h1-839401-11 Aug 29 15:46:34.591968 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d40ffd98-1a97-4f29-a5df-e9fe3e4990f6 req-94f5e172-66f8-4e50-8a57-f89c8ba93168 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098603 Aug 29 15:46:34.595061 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2378/4913] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:46:34.607222 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-3b301c71-c6c3-4fbb-9849-c49c174a4fbc req-ce59bffb-6e47-453a-a0a2-fb1e9f641532 service nova] Creating event network-vif-deleted:f90231df-2485-49aa-844b-2ef5dad9a761 for instance 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 on n-h2-839401-11 Aug 29 15:46:34.618937 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-3b301c71-c6c3-4fbb-9849-c49c174a4fbc req-ce59bffb-6e47-453a-a0a2-fb1e9f641532 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132807 Aug 29 15:46:34.620176 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2536/4914] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:34.957605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e11759f-db9b-472b-80af-0a4ad8bf0d7a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:34.959211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9e11759f-db9b-472b-80af-0a4ad8bf0d7a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:34.977737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9dec7849-9776-486a-874c-9b45e68e8388 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42aaf39d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:34.988014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e11759f-db9b-472b-80af-0a4ad8bf0d7a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:34.991318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e11759f-db9b-472b-80af-0a4ad8bf0d7a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:34.992923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e11759f-db9b-472b-80af-0a4ad8bf0d7a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:34.995244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e11759f-db9b-472b-80af-0a4ad8bf0d7a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:35.000623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e11759f-db9b-472b-80af-0a4ad8bf0d7a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:35.001203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e11759f-db9b-472b-80af-0a4ad8bf0d7a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:35.085225 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9dec7849-9776-486a-874c-9b45e68e8388 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.110094 Aug 29 15:46:35.087027 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2537/4915] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:34 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:35.095815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e11759f-db9b-472b-80af-0a4ad8bf0d7a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:35.096650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e11759f-db9b-472b-80af-0a4ad8bf0d7a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:35.097407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e11759f-db9b-472b-80af-0a4ad8bf0d7a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:35.098105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-9e11759f-db9b-472b-80af-0a4ad8bf0d7a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lazy-loading 'fault' on Instance uuid 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:35.107916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ac59be82-84d4-40e5-af6a-23b14f008643 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:35.109027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ac59be82-84d4-40e5-af6a-23b14f008643 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:35.124155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac59be82-84d4-40e5-af6a-23b14f008643 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:35.125238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac59be82-84d4-40e5-af6a-23b14f008643 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:35.125925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac59be82-84d4-40e5-af6a-23b14f008643 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:35.126875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac59be82-84d4-40e5-af6a-23b14f008643 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:35.127579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac59be82-84d4-40e5-af6a-23b14f008643 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:35.128279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac59be82-84d4-40e5-af6a-23b14f008643 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:35.207603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9e11759f-db9b-472b-80af-0a4ad8bf0d7a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332348822e194b488606b04ea4107de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccbf3aa74064e6abad669b285e7614d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:35.215346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:35.227324 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9e11759f-db9b-472b-80af-0a4ad8bf0d7a tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 200 len: 1304 microversion: 2.1 time: 0.275375 Aug 29 15:46:35.232148 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2379/4916] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:34 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 1304 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:35.245650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0a9985ac-0825-4f65-9e92-5f875ec57a64 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:35.246777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0a9985ac-0825-4f65-9e92-5f875ec57a64 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:35.263068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a9985ac-0825-4f65-9e92-5f875ec57a64 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:35.263578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a9985ac-0825-4f65-9e92-5f875ec57a64 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:35.264018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a9985ac-0825-4f65-9e92-5f875ec57a64 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:35.265321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a9985ac-0825-4f65-9e92-5f875ec57a64 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:35.266254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a9985ac-0825-4f65-9e92-5f875ec57a64 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:35.267214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a9985ac-0825-4f65-9e92-5f875ec57a64 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:35.372564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0a9985ac-0825-4f65-9e92-5f875ec57a64 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:35.384782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0a9985ac-0825-4f65-9e92-5f875ec57a64 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:35.386297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0a9985ac-0825-4f65-9e92-5f875ec57a64 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:35.387882 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0a9985ac-0825-4f65-9e92-5f875ec57a64 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.154217 Aug 29 15:46:35.388491 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2380/4917] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:35 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:35.604168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ac59be82-84d4-40e5-af6a-23b14f008643 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:35.627893 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ac59be82-84d4-40e5-af6a-23b14f008643 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1213 microversion: 2.1 time: 0.523773 Aug 29 15:46:35.631503 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2538/4918] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:35 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1213 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:36.100211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3a4c39a5-91c9-4420-8ffa-1849157774c1 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42aa12e50>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:36.181507 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3a4c39a5-91c9-4420-8ffa-1849157774c1 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.085396 Aug 29 15:46:36.182125 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2381/4919] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:36 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:36.252853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0afcbfed-8364-4d50-9c3a-d4087a9091ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:36.253580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0afcbfed-8364-4d50-9c3a-d4087a9091ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] [instance: 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:36.264952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0afcbfed-8364-4d50-9c3a-d4087a9091ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:36.272301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0afcbfed-8364-4d50-9c3a-d4087a9091ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:36.284000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0afcbfed-8364-4d50-9c3a-d4087a9091ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:36.285492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0afcbfed-8364-4d50-9c3a-d4087a9091ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:36.297663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0afcbfed-8364-4d50-9c3a-d4087a9091ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:36.298549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0afcbfed-8364-4d50-9c3a-d4087a9091ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:36.338052 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-0afcbfed-8364-4d50-9c3a-d4087a9091ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] HTTP exception thrown: Instance 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 could not be found. Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0afcbfed-8364-4d50-9c3a-d4087a9091ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Request method failure captured: Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 HTTP/1.1 Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN7JkbZPbGfWGN5wCTl1d8oPZtHw0wvuGkWXH2O3WhCVCjIiM60Hmx3_CdEM3tciSEZwnhOGXwvbo8aQyPB6XMB3ZEHJ8nU7zX4vNEM1PHvRGNaUvJQ4L-yDqQyo2x4DGo3_N3YHuXXfWleiWJtMB4Q5sUPb0jZYdqPAdDwVtbX8tNo Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: eccbf3aa74064e6abad669b285e7614d Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerRescueTestJSON-1671151142 Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eccbf3aa74064e6abad669b285e7614d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eccbf3aa74064e6abad669b285e7614d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eccbf3aa74064e6abad669b285e7614d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eccbf3aa74064e6abad669b285e7614d"}]}] Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerRescueTestJSON-1671151142 Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: eccbf3aa74064e6abad669b285e7614d Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerRescueTestJSON-1671151142 Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerRescueTestJSON-1671151142-project Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 332348822e194b488606b04ea4107de7 Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerRescueTestJSON-1671151142-project Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 could not be found. Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '0dcc1f7c-211b-4ed6-a898-31dd9cdb5228'} Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 could not be found. Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 could not be found. Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:36.340456 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:36.345569 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:36.345569 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:36.345569 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:36.345569 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:36.345569 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:36.345569 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 could not be found. Aug 29 15:46:36.345569 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:46:36.349935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0afcbfed-8364-4d50-9c3a-d4087a9091ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] Returning 404 to user: Instance 0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:36.350846 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0afcbfed-8364-4d50-9c3a-d4087a9091ae tempest-ServerRescueTestJSON-1671151142 tempest-ServerRescueTestJSON-1671151142-project] 10.222.0.62 "GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228" status: 404 len: 111 microversion: 2.1 time: 0.102024 Aug 29 15:46:36.355265 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2539/4920] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:36 2022] GET /compute/v2.1/servers/0dcc1f7c-211b-4ed6-a898-31dd9cdb5228 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:36.418407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8c06eebf-c517-4b2f-bb58-8b065ba15ac2 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:36.419945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8c06eebf-c517-4b2f-bb58-8b065ba15ac2 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:36.440980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c06eebf-c517-4b2f-bb58-8b065ba15ac2 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:36.441546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c06eebf-c517-4b2f-bb58-8b065ba15ac2 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:36.447589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c06eebf-c517-4b2f-bb58-8b065ba15ac2 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:36.452502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c06eebf-c517-4b2f-bb58-8b065ba15ac2 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:36.453106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c06eebf-c517-4b2f-bb58-8b065ba15ac2 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:36.453564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c06eebf-c517-4b2f-bb58-8b065ba15ac2 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:36.611853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8c06eebf-c517-4b2f-bb58-8b065ba15ac2 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:36.620939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8c06eebf-c517-4b2f-bb58-8b065ba15ac2 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:36.622364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8c06eebf-c517-4b2f-bb58-8b065ba15ac2 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:36.629556 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8c06eebf-c517-4b2f-bb58-8b065ba15ac2 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.209824 Aug 29 15:46:36.633818 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2382/4921] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:36 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:36.656002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-17c05d53-e55e-4365-8be7-1943bc63a1ee tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:36.656965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-17c05d53-e55e-4365-8be7-1943bc63a1ee tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:36.684992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17c05d53-e55e-4365-8be7-1943bc63a1ee tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:36.686144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17c05d53-e55e-4365-8be7-1943bc63a1ee tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:36.688990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17c05d53-e55e-4365-8be7-1943bc63a1ee tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:36.691333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17c05d53-e55e-4365-8be7-1943bc63a1ee tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:36.693977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17c05d53-e55e-4365-8be7-1943bc63a1ee tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:36.695838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17c05d53-e55e-4365-8be7-1943bc63a1ee tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:36.940709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-17c05d53-e55e-4365-8be7-1943bc63a1ee tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:36.951752 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-17c05d53-e55e-4365-8be7-1943bc63a1ee tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1275 microversion: 2.1 time: 0.299592 Aug 29 15:46:36.952573 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2540/4922] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:36 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1275 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:37.197574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f43551a1-7ef0-4660-adcd-b3661ccfb155 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a5f39d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:37.299130 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f43551a1-7ef0-4660-adcd-b3661ccfb155 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.106552 Aug 29 15:46:37.299493 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2383/4923] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:37 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:37.657415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8ce02788-6694-4227-9f95-741597326007 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:37.658110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8ce02788-6694-4227-9f95-741597326007 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:37.678953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ce02788-6694-4227-9f95-741597326007 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.679457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ce02788-6694-4227-9f95-741597326007 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.679917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ce02788-6694-4227-9f95-741597326007 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.680637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ce02788-6694-4227-9f95-741597326007 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.681121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ce02788-6694-4227-9f95-741597326007 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.681581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ce02788-6694-4227-9f95-741597326007 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.829129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8ce02788-6694-4227-9f95-741597326007 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:37.848775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8ce02788-6694-4227-9f95-741597326007 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:37.857555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8ce02788-6694-4227-9f95-741597326007 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:37.860713 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8ce02788-6694-4227-9f95-741597326007 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.206270 Aug 29 15:46:37.884397 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2541/4924] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:37 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:37.975687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0a8f63f3-fc2b-434f-9cd2-426f7ca48f7a tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:37.976454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0a8f63f3-fc2b-434f-9cd2-426f7ca48f7a tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:37.992176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a8f63f3-fc2b-434f-9cd2-426f7ca48f7a tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.992855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a8f63f3-fc2b-434f-9cd2-426f7ca48f7a tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.994223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a8f63f3-fc2b-434f-9cd2-426f7ca48f7a tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.997213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a8f63f3-fc2b-434f-9cd2-426f7ca48f7a tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.998841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a8f63f3-fc2b-434f-9cd2-426f7ca48f7a tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:38.000376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a8f63f3-fc2b-434f-9cd2-426f7ca48f7a tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:38.318309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2f024a66-b98a-48bc-9bfd-8922c7b3095b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a739160>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:38.430359 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2f024a66-b98a-48bc-9bfd-8922c7b3095b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.120224 Aug 29 15:46:38.432639 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2542/4925] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:38 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:38.609127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0a8f63f3-fc2b-434f-9cd2-426f7ca48f7a tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:38.627458 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0a8f63f3-fc2b-434f-9cd2-426f7ca48f7a tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1275 microversion: 2.1 time: 0.656975 Aug 29 15:46:38.628635 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2384/4926] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:37 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1275 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:38.890471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-72730561-594e-48c3-8817-95cdc146047c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:38.891730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-72730561-594e-48c3-8817-95cdc146047c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:38.910419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72730561-594e-48c3-8817-95cdc146047c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:38.913529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72730561-594e-48c3-8817-95cdc146047c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:38.914219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72730561-594e-48c3-8817-95cdc146047c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:38.917249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72730561-594e-48c3-8817-95cdc146047c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:38.917926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72730561-594e-48c3-8817-95cdc146047c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:38.919384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72730561-594e-48c3-8817-95cdc146047c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:39.179255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-72730561-594e-48c3-8817-95cdc146047c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:39.194356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-72730561-594e-48c3-8817-95cdc146047c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:39.195816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-72730561-594e-48c3-8817-95cdc146047c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:39.197030 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-72730561-594e-48c3-8817-95cdc146047c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.310794 Aug 29 15:46:39.220314 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2543/4927] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:38 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:39.447201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9bd3eaed-8337-49eb-ab66-3bea3e98888a tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a5f34c0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:39.554542 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9bd3eaed-8337-49eb-ab66-3bea3e98888a tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.108342 Aug 29 15:46:39.554542 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2385/4928] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:39 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:39.650353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4e15fa84-ea79-49de-9bf9-8ae8c6882fa6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:39.651262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4e15fa84-ea79-49de-9bf9-8ae8c6882fa6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:39.671094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e15fa84-ea79-49de-9bf9-8ae8c6882fa6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:39.671860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e15fa84-ea79-49de-9bf9-8ae8c6882fa6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:39.672324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e15fa84-ea79-49de-9bf9-8ae8c6882fa6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:39.673333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e15fa84-ea79-49de-9bf9-8ae8c6882fa6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:39.674073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e15fa84-ea79-49de-9bf9-8ae8c6882fa6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:39.674508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e15fa84-ea79-49de-9bf9-8ae8c6882fa6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:39.967141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4e15fa84-ea79-49de-9bf9-8ae8c6882fa6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:39.975796 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4e15fa84-ea79-49de-9bf9-8ae8c6882fa6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1317 microversion: 2.1 time: 0.331268 Aug 29 15:46:39.989516 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2544/4929] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:39 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:40.233805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-21951775-0bfc-43b5-aef4-36fac5258650 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:40.235122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-21951775-0bfc-43b5-aef4-36fac5258650 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:40.247121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21951775-0bfc-43b5-aef4-36fac5258650 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:40.247633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21951775-0bfc-43b5-aef4-36fac5258650 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:40.250756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21951775-0bfc-43b5-aef4-36fac5258650 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:40.252291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21951775-0bfc-43b5-aef4-36fac5258650 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:40.254369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21951775-0bfc-43b5-aef4-36fac5258650 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:40.256738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21951775-0bfc-43b5-aef4-36fac5258650 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:40.463966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-21951775-0bfc-43b5-aef4-36fac5258650 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:40.475972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-21951775-0bfc-43b5-aef4-36fac5258650 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:40.480136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-21951775-0bfc-43b5-aef4-36fac5258650 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:40.483671 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-21951775-0bfc-43b5-aef4-36fac5258650 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.254946 Aug 29 15:46:40.487942 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2386/4930] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:40 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:40.569663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3014af0f-25c3-4504-971f-0812cc4d2a21 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b7e35e0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:40.649284 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3014af0f-25c3-4504-971f-0812cc4d2a21 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.084760 Aug 29 15:46:40.650053 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2545/4931] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:40 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:40.996765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a37ba212-d98b-4a35-befa-5cc77852cd22 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:40.997847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a37ba212-d98b-4a35-befa-5cc77852cd22 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:41.017638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a37ba212-d98b-4a35-befa-5cc77852cd22 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:41.018440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a37ba212-d98b-4a35-befa-5cc77852cd22 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:41.019218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a37ba212-d98b-4a35-befa-5cc77852cd22 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:41.021692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a37ba212-d98b-4a35-befa-5cc77852cd22 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:41.022681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a37ba212-d98b-4a35-befa-5cc77852cd22 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:41.023368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a37ba212-d98b-4a35-befa-5cc77852cd22 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:41.464953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a37ba212-d98b-4a35-befa-5cc77852cd22 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:41.474477 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a37ba212-d98b-4a35-befa-5cc77852cd22 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1317 microversion: 2.1 time: 0.482320 Aug 29 15:46:41.489894 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2387/4932] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:40 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:41.520320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-94992bd1-cf7c-4f3e-bfc8-09e0f81d5593 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:41.521849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-94992bd1-cf7c-4f3e-bfc8-09e0f81d5593 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:41.542616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94992bd1-cf7c-4f3e-bfc8-09e0f81d5593 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:41.546543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94992bd1-cf7c-4f3e-bfc8-09e0f81d5593 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:41.547217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94992bd1-cf7c-4f3e-bfc8-09e0f81d5593 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:41.547985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94992bd1-cf7c-4f3e-bfc8-09e0f81d5593 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:41.548470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94992bd1-cf7c-4f3e-bfc8-09e0f81d5593 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:41.548914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94992bd1-cf7c-4f3e-bfc8-09e0f81d5593 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:41.665530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-25de748b-bc74-49dd-ae01-f714939f959e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b76faf0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:41.674371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-94992bd1-cf7c-4f3e-bfc8-09e0f81d5593 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:41.691168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-94992bd1-cf7c-4f3e-bfc8-09e0f81d5593 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:41.696538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-94992bd1-cf7c-4f3e-bfc8-09e0f81d5593 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:41.699584 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-94992bd1-cf7c-4f3e-bfc8-09e0f81d5593 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.185130 Aug 29 15:46:41.711070 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2546/4933] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:41 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:41.763786 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-25de748b-bc74-49dd-ae01-f714939f959e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.103061 Aug 29 15:46:41.766781 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2388/4934] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:41 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:42.150876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-05ec30a8-353f-45f7-a5b1-76c53c48fcf5 req-74814c13-7e5d-4cfb-aeb7-e40675beab5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fee4956-a06f-41b3-8b67-712e6252803e", "tag": "c620ed5a-89c3-4f49-b011-3604621dc438"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:42.171209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-05ec30a8-353f-45f7-a5b1-76c53c48fcf5 req-74814c13-7e5d-4cfb-aeb7-e40675beab5b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:42.178005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-05ec30a8-353f-45f7-a5b1-76c53c48fcf5 req-74814c13-7e5d-4cfb-aeb7-e40675beab5b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:42.178472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-05ec30a8-353f-45f7-a5b1-76c53c48fcf5 req-74814c13-7e5d-4cfb-aeb7-e40675beab5b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:42.209737 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-05ec30a8-353f-45f7-a5b1-76c53c48fcf5 req-74814c13-7e5d-4cfb-aeb7-e40675beab5b service nova] Creating event network-changed:c620ed5a-89c3-4f49-b011-3604621dc438 for instance 5fee4956-a06f-41b3-8b67-712e6252803e on n-h2-839401-11 Aug 29 15:46:42.219486 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-05ec30a8-353f-45f7-a5b1-76c53c48fcf5 req-74814c13-7e5d-4cfb-aeb7-e40675beab5b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074154 Aug 29 15:46:42.220144 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2547/4935] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:42.514345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4f5b6f7a-5a4e-4fce-b4d0-8f14c8c12943 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:42.514981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4f5b6f7a-5a4e-4fce-b4d0-8f14c8c12943 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:42.533733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f5b6f7a-5a4e-4fce-b4d0-8f14c8c12943 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:42.534595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f5b6f7a-5a4e-4fce-b4d0-8f14c8c12943 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:42.535215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f5b6f7a-5a4e-4fce-b4d0-8f14c8c12943 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:42.536101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f5b6f7a-5a4e-4fce-b4d0-8f14c8c12943 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:42.536720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f5b6f7a-5a4e-4fce-b4d0-8f14c8c12943 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:42.539727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f5b6f7a-5a4e-4fce-b4d0-8f14c8c12943 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:42.731407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d857002-fe44-4a4e-87e6-b423f36057a8 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:42.733280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9d857002-fe44-4a4e-87e6-b423f36057a8 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:42.744783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d857002-fe44-4a4e-87e6-b423f36057a8 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:42.748927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d857002-fe44-4a4e-87e6-b423f36057a8 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:42.749658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d857002-fe44-4a4e-87e6-b423f36057a8 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:42.750659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d857002-fe44-4a4e-87e6-b423f36057a8 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:42.752585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d857002-fe44-4a4e-87e6-b423f36057a8 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:42.756342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d857002-fe44-4a4e-87e6-b423f36057a8 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:42.990024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4f5b6f7a-5a4e-4fce-b4d0-8f14c8c12943 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:42.991163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9d857002-fe44-4a4e-87e6-b423f36057a8 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:42.998427 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4f5b6f7a-5a4e-4fce-b4d0-8f14c8c12943 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1317 microversion: 2.1 time: 0.490207 Aug 29 15:46:42.999369 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2389/4936] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:42 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:43.004293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1a1fbada-d8b1-48fa-975d-546cdc774d5b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a50eca0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:43.020354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9d857002-fe44-4a4e-87e6-b423f36057a8 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:43.031218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9d857002-fe44-4a4e-87e6-b423f36057a8 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:43.038985 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d857002-fe44-4a4e-87e6-b423f36057a8 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.313345 Aug 29 15:46:43.039979 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2548/4937] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:42 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:43.098620 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1a1fbada-d8b1-48fa-975d-546cdc774d5b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.098010 Aug 29 15:46:43.099225 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2390/4938] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:42 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:44.019858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5a82d3f9-1188-48d8-91fd-519ab6a2408d tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:44.020741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5a82d3f9-1188-48d8-91fd-519ab6a2408d tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:44.022899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:44.034893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a82d3f9-1188-48d8-91fd-519ab6a2408d tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:44.037348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a82d3f9-1188-48d8-91fd-519ab6a2408d tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:44.038097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a82d3f9-1188-48d8-91fd-519ab6a2408d tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:44.039042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a82d3f9-1188-48d8-91fd-519ab6a2408d tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:44.040701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a82d3f9-1188-48d8-91fd-519ab6a2408d tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:44.043789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a82d3f9-1188-48d8-91fd-519ab6a2408d tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:44.072710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1fefee09-85d7-4afe-b41a-79e587bd73ac tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:44.073539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1fefee09-85d7-4afe-b41a-79e587bd73ac tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:44.090145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fefee09-85d7-4afe-b41a-79e587bd73ac tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:44.090599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fefee09-85d7-4afe-b41a-79e587bd73ac tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:44.091040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fefee09-85d7-4afe-b41a-79e587bd73ac tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:44.091755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fefee09-85d7-4afe-b41a-79e587bd73ac tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:44.092214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fefee09-85d7-4afe-b41a-79e587bd73ac tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:44.092638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1fefee09-85d7-4afe-b41a-79e587bd73ac tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:44.119163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:44.242878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1fefee09-85d7-4afe-b41a-79e587bd73ac tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:44.261773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1fefee09-85d7-4afe-b41a-79e587bd73ac tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:44.265296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1fefee09-85d7-4afe-b41a-79e587bd73ac tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:44.269872 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1fefee09-85d7-4afe-b41a-79e587bd73ac tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.201704 Aug 29 15:46:44.274188 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2391/4939] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:44 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:46:44.296670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a5b9a297-bb3b-41e3-9f89-5433d8282323 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b92d1f0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:44.381363 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a5b9a297-bb3b-41e3-9f89-5433d8282323 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.105935 Aug 29 15:46:44.382345 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2392/4940] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:44 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:44.877727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5a82d3f9-1188-48d8-91fd-519ab6a2408d tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:44.900751 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5a82d3f9-1188-48d8-91fd-519ab6a2408d tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1317 microversion: 2.1 time: 0.880203 Aug 29 15:46:44.902231 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2549/4941] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:44 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1317 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:45.306813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-02c10831-9225-4f73-96b2-7356d21c64c6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:45.312604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-02c10831-9225-4f73-96b2-7356d21c64c6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:45.322899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02c10831-9225-4f73-96b2-7356d21c64c6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:45.323584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02c10831-9225-4f73-96b2-7356d21c64c6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:45.324189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02c10831-9225-4f73-96b2-7356d21c64c6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:45.325121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02c10831-9225-4f73-96b2-7356d21c64c6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:45.334720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02c10831-9225-4f73-96b2-7356d21c64c6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:45.335412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02c10831-9225-4f73-96b2-7356d21c64c6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:45.397775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7b26b587-fc06-4eee-a60d-58a09a130bc5 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42aa898b0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:45.487090 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7b26b587-fc06-4eee-a60d-58a09a130bc5 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.093740 Aug 29 15:46:45.487795 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2550/4942] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:45 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:45.569748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-02c10831-9225-4f73-96b2-7356d21c64c6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:45.580397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-02c10831-9225-4f73-96b2-7356d21c64c6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:45.583862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-02c10831-9225-4f73-96b2-7356d21c64c6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:45.585893 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-02c10831-9225-4f73-96b2-7356d21c64c6 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.289008 Aug 29 15:46:45.587645 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2393/4943] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:45 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:45.930208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b4021084-9b48-43bc-968e-2008b854ceb4 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:45.930912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b4021084-9b48-43bc-968e-2008b854ceb4 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:45.949860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4021084-9b48-43bc-968e-2008b854ceb4 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:45.952454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4021084-9b48-43bc-968e-2008b854ceb4 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:45.954262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4021084-9b48-43bc-968e-2008b854ceb4 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:45.956905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4021084-9b48-43bc-968e-2008b854ceb4 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:45.958150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4021084-9b48-43bc-968e-2008b854ceb4 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:45.959994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4021084-9b48-43bc-968e-2008b854ceb4 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:46.503263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-772a2090-c5c7-4f47-b44a-3e83d9e37131 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a50e160>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:46.540145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b4021084-9b48-43bc-968e-2008b854ceb4 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:46.557363 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b4021084-9b48-43bc-968e-2008b854ceb4 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1317 microversion: 2.1 time: 0.639223 Aug 29 15:46:46.562507 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2551/4944] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:45 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1317 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:46.611126 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-772a2090-c5c7-4f47-b44a-3e83d9e37131 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.111928 Aug 29 15:46:46.611750 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2394/4945] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:46 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:46.615957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-af23207c-0895-4a35-ad67-bfaf75d8e1e9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:46.616803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-af23207c-0895-4a35-ad67-bfaf75d8e1e9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:46.626096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af23207c-0895-4a35-ad67-bfaf75d8e1e9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:46.631173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af23207c-0895-4a35-ad67-bfaf75d8e1e9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:46.631896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af23207c-0895-4a35-ad67-bfaf75d8e1e9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:46.632865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af23207c-0895-4a35-ad67-bfaf75d8e1e9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:46.635174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af23207c-0895-4a35-ad67-bfaf75d8e1e9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:46.637698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af23207c-0895-4a35-ad67-bfaf75d8e1e9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:46.854325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-af23207c-0895-4a35-ad67-bfaf75d8e1e9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:46.869999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-af23207c-0895-4a35-ad67-bfaf75d8e1e9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:46.873697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-af23207c-0895-4a35-ad67-bfaf75d8e1e9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:46.875020 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-af23207c-0895-4a35-ad67-bfaf75d8e1e9 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1366 microversion: 2.57 time: 0.266769 Aug 29 15:46:46.878626 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2552/4946] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:46 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:47.589587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-04a6c011-afd0-4fce-9560-6ab2299da7a6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:47.591059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-04a6c011-afd0-4fce-9560-6ab2299da7a6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:47.614315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a6c011-afd0-4fce-9560-6ab2299da7a6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:47.616797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a6c011-afd0-4fce-9560-6ab2299da7a6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:47.618371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a6c011-afd0-4fce-9560-6ab2299da7a6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:47.623312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a6c011-afd0-4fce-9560-6ab2299da7a6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:47.626829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85fa83c2-a33c-445f-b7fe-13410de910d5 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a71f160>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:47.628408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a6c011-afd0-4fce-9560-6ab2299da7a6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:47.629116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a6c011-afd0-4fce-9560-6ab2299da7a6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:47.731218 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85fa83c2-a33c-445f-b7fe-13410de910d5 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.108216 Aug 29 15:46:47.732628 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2553/4947] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:47 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:47.903647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-90aacb6b-2a25-41d4-bb50-03470b06f805 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:47.904635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-90aacb6b-2a25-41d4-bb50-03470b06f805 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:47.933546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90aacb6b-2a25-41d4-bb50-03470b06f805 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:47.935933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90aacb6b-2a25-41d4-bb50-03470b06f805 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:47.939658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90aacb6b-2a25-41d4-bb50-03470b06f805 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:47.944805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90aacb6b-2a25-41d4-bb50-03470b06f805 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:47.946199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90aacb6b-2a25-41d4-bb50-03470b06f805 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:47.947031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90aacb6b-2a25-41d4-bb50-03470b06f805 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:47.995388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-04a6c011-afd0-4fce-9560-6ab2299da7a6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:48.003936 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-04a6c011-afd0-4fce-9560-6ab2299da7a6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1317 microversion: 2.1 time: 0.424219 Aug 29 15:46:48.006266 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2395/4948] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:47 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:48.213800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-90aacb6b-2a25-41d4-bb50-03470b06f805 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:48.230993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-90aacb6b-2a25-41d4-bb50-03470b06f805 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:48.234962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-90aacb6b-2a25-41d4-bb50-03470b06f805 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:48.240560 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-90aacb6b-2a25-41d4-bb50-03470b06f805 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1372 microversion: 2.57 time: 0.340017 Aug 29 15:46:48.242204 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2554/4949] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:47 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1372 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:46:48.750040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-19a7a5eb-769d-4a2a-8eed-dbaafa51576b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a50e040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:48.894100 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-19a7a5eb-769d-4a2a-8eed-dbaafa51576b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.146302 Aug 29 15:46:48.896312 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2396/4950] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:48 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:49.029196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ef96cfd2-2ac1-408d-af4b-97f277f99ed6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:49.029869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ef96cfd2-2ac1-408d-af4b-97f277f99ed6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:49.049056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef96cfd2-2ac1-408d-af4b-97f277f99ed6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:49.058880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef96cfd2-2ac1-408d-af4b-97f277f99ed6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:49.059495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef96cfd2-2ac1-408d-af4b-97f277f99ed6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:49.060373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef96cfd2-2ac1-408d-af4b-97f277f99ed6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:49.060950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef96cfd2-2ac1-408d-af4b-97f277f99ed6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:49.061512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef96cfd2-2ac1-408d-af4b-97f277f99ed6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:49.270715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e3e1e08c-0929-43a9-99fb-9c068f10242a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:49.271463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e3e1e08c-0929-43a9-99fb-9c068f10242a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:49.286600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3e1e08c-0929-43a9-99fb-9c068f10242a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:49.287470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3e1e08c-0929-43a9-99fb-9c068f10242a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:49.288808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3e1e08c-0929-43a9-99fb-9c068f10242a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:49.307242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3e1e08c-0929-43a9-99fb-9c068f10242a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:49.308123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3e1e08c-0929-43a9-99fb-9c068f10242a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:49.312918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3e1e08c-0929-43a9-99fb-9c068f10242a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:49.379758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ef96cfd2-2ac1-408d-af4b-97f277f99ed6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:49.399868 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ef96cfd2-2ac1-408d-af4b-97f277f99ed6 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1317 microversion: 2.1 time: 0.374869 Aug 29 15:46:49.410481 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2555/4951] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:49 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:49.473020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e3e1e08c-0929-43a9-99fb-9c068f10242a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:49.486496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e3e1e08c-0929-43a9-99fb-9c068f10242a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:49.498493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e3e1e08c-0929-43a9-99fb-9c068f10242a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:49.511940 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e3e1e08c-0929-43a9-99fb-9c068f10242a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1372 microversion: 2.57 time: 0.250088 Aug 29 15:46:49.531900 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2397/4952] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:49 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1372 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:49.910266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0b6db70b-5b22-41d4-b1f8-accfb1a4113b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a7f6040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:49.982650 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0b6db70b-5b22-41d4-b1f8-accfb1a4113b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.076528 Aug 29 15:46:49.983967 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2398/4953] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:49 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:49.997858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-750853164", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": "none"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:50.088223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:46:50.088951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:46:50.089109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:46:50.089518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:46:50.095759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:46:50.131199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:50.132104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:50.132807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:50.133890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:50.134612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:50.135271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:50.160951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:50.200712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Getting quotas for project 701b776a3adc417d8b384540ef66a933. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:46:50.211862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Getting quotas for user 2327fa7098644c30b3d7dd5c11850701 and project 701b776a3adc417d8b384540ef66a933. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:46:50.249241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:46:50.251841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 17a799dd-7544-4219-8d6b-6902ed8be544] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:46:50.373236 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f5e8fa45-3fad-4aa9-a008-44c630fe698c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.632588 Aug 29 15:46:50.374540 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2556/4954] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:46:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:46:50.388111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9d40e0d4-4a65-425f-b684-dc5f76bdd8fb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:50.389168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9d40e0d4-4a65-425f-b684-dc5f76bdd8fb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 17a799dd-7544-4219-8d6b-6902ed8be544] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:50.423082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3e03259e-2a22-4787-989c-8e984eaf91d9 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:50.424762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3e03259e-2a22-4787-989c-8e984eaf91d9 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:50.444927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e03259e-2a22-4787-989c-8e984eaf91d9 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:50.446692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e03259e-2a22-4787-989c-8e984eaf91d9 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:50.447245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e03259e-2a22-4787-989c-8e984eaf91d9 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:50.448359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e03259e-2a22-4787-989c-8e984eaf91d9 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:50.453634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e03259e-2a22-4787-989c-8e984eaf91d9 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:50.455178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3e03259e-2a22-4787-989c-8e984eaf91d9 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:50.796922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9d40e0d4-4a65-425f-b684-dc5f76bdd8fb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:50.813768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9d40e0d4-4a65-425f-b684-dc5f76bdd8fb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:50.816679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9d40e0d4-4a65-425f-b684-dc5f76bdd8fb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:50.822507 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9d40e0d4-4a65-425f-b684-dc5f76bdd8fb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/17a799dd-7544-4219-8d6b-6902ed8be544" status: 200 len: 1277 microversion: 2.47 time: 0.439134 Aug 29 15:46:50.824675 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2399/4955] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:50 2022] GET /compute/v2.1/servers/17a799dd-7544-4219-8d6b-6902ed8be544 => generated 1277 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:50.859660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4ecf024b-41e4-4664-9375-8288527aab02 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:50.860219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4ecf024b-41e4-4664-9375-8288527aab02 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:50.885466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ecf024b-41e4-4664-9375-8288527aab02 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:50.886822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ecf024b-41e4-4664-9375-8288527aab02 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:50.887849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ecf024b-41e4-4664-9375-8288527aab02 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:50.891080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ecf024b-41e4-4664-9375-8288527aab02 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:50.892262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ecf024b-41e4-4664-9375-8288527aab02 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:50.893957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ecf024b-41e4-4664-9375-8288527aab02 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:50.913024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3e03259e-2a22-4787-989c-8e984eaf91d9 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:50.925937 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3e03259e-2a22-4787-989c-8e984eaf91d9 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1317 microversion: 2.1 time: 0.507099 Aug 29 15:46:50.946441 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2557/4956] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:50 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:50.952878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1642865693", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": "none"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:51.060224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4ecf024b-41e4-4664-9375-8288527aab02 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:51.086440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4ecf024b-41e4-4664-9375-8288527aab02 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:51.089590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4ecf024b-41e4-4664-9375-8288527aab02 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:51.091714 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4ecf024b-41e4-4664-9375-8288527aab02 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1372 microversion: 2.57 time: 0.265326 Aug 29 15:46:51.092687 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2400/4957] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:50 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1372 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:51.109988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:46:51.111238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:46:51.111972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:46:51.112638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:46:51.113427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:46:51.142305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:51.143152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:51.143953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:51.144951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:51.145821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:51.146619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:51.152904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d69e6934-4373-4ba5-bb46-8145bb4b5bf0 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a9ee430>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:51.218313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Getting quotas for project 701b776a3adc417d8b384540ef66a933. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:46:51.227007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Getting quotas for user 2327fa7098644c30b3d7dd5c11850701 and project 701b776a3adc417d8b384540ef66a933. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:46:51.259629 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d69e6934-4373-4ba5-bb46-8145bb4b5bf0 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.165205 Aug 29 15:46:51.260541 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2401/4958] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:51 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:51.267345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:46:51.277379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:46:51.392417 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f37fec7a-4ccc-44da-8776-3a988e2805ea tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.444429 Aug 29 15:46:51.398024 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2558/4959] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:46:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:46:51.414172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a18c9b78-1e98-43aa-9d4e-2f97eedaed4e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:51.421369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a18c9b78-1e98-43aa-9d4e-2f97eedaed4e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:51.529064 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a18c9b78-1e98-43aa-9d4e-2f97eedaed4e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "PUT /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 992 microversion: 2.47 time: 0.121717 Aug 29 15:46:51.544445 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2402/4960] 10.222.0.62 () {62 vars in 1297 bytes} [Mon Aug 29 15:46:51 2022] PUT /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 992 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:46:51.554719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-41f7efe4-b257-49e4-929f-31b60141595b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:51.555676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-41f7efe4-b257-49e4-929f-31b60141595b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:51.668369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-41f7efe4-b257-49e4-929f-31b60141595b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:51.681979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-41f7efe4-b257-49e4-929f-31b60141595b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:51.684093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-41f7efe4-b257-49e4-929f-31b60141595b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:51.686063 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-41f7efe4-b257-49e4-929f-31b60141595b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1278 microversion: 2.47 time: 0.141194 Aug 29 15:46:51.698447 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2559/4961] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:51 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:46:51.845468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-e0104806-7e43-455f-a258-81096fd88dcd req-5d87af2e-a19f-40a7-b870-c6e16840be87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fee4956-a06f-41b3-8b67-712e6252803e", "name": "network-vif-plugged", "status": "completed", "tag": "c620ed5a-89c3-4f49-b011-3604621dc438"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:51.877641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e0104806-7e43-455f-a258-81096fd88dcd req-5d87af2e-a19f-40a7-b870-c6e16840be87 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:51.878219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e0104806-7e43-455f-a258-81096fd88dcd req-5d87af2e-a19f-40a7-b870-c6e16840be87 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:51.878671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e0104806-7e43-455f-a258-81096fd88dcd req-5d87af2e-a19f-40a7-b870-c6e16840be87 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:51.909827 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-e0104806-7e43-455f-a258-81096fd88dcd req-5d87af2e-a19f-40a7-b870-c6e16840be87 service nova] Creating event network-vif-plugged:c620ed5a-89c3-4f49-b011-3604621dc438 for instance 5fee4956-a06f-41b3-8b67-712e6252803e on n-h2-839401-11 Aug 29 15:46:51.917114 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-e0104806-7e43-455f-a258-81096fd88dcd req-5d87af2e-a19f-40a7-b870-c6e16840be87 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080249 Aug 29 15:46:51.918230 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2403/4962] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:51.946804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6149e7dd-f48b-4b33-87ae-d48ada72a0b1 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:51.947571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6149e7dd-f48b-4b33-87ae-d48ada72a0b1 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:51.964298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6149e7dd-f48b-4b33-87ae-d48ada72a0b1 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:51.964827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6149e7dd-f48b-4b33-87ae-d48ada72a0b1 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:51.965680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6149e7dd-f48b-4b33-87ae-d48ada72a0b1 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:51.966256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6149e7dd-f48b-4b33-87ae-d48ada72a0b1 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:51.966737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6149e7dd-f48b-4b33-87ae-d48ada72a0b1 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:51.973102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6149e7dd-f48b-4b33-87ae-d48ada72a0b1 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:52.125121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-11ff776d-a040-4621-a770-3dfec893b7ee tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:52.126665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-11ff776d-a040-4621-a770-3dfec893b7ee tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:52.153458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11ff776d-a040-4621-a770-3dfec893b7ee tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:52.153972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11ff776d-a040-4621-a770-3dfec893b7ee tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:52.154417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11ff776d-a040-4621-a770-3dfec893b7ee tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:52.163126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11ff776d-a040-4621-a770-3dfec893b7ee tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:52.163686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11ff776d-a040-4621-a770-3dfec893b7ee tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:52.164130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11ff776d-a040-4621-a770-3dfec893b7ee tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:52.460521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6149e7dd-f48b-4b33-87ae-d48ada72a0b1 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:52.472377 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6149e7dd-f48b-4b33-87ae-d48ada72a0b1 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1317 microversion: 2.1 time: 0.530032 Aug 29 15:46:52.473656 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2560/4963] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:51 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:52.492963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9ff6caf9-9fa7-4cfb-9283-58458d4ae2f1 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a7ee280>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:52.596604 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9ff6caf9-9fa7-4cfb-9283-58458d4ae2f1 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.121390 Aug 29 15:46:52.598982 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2561/4964] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:52 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:52.636785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-11ff776d-a040-4621-a770-3dfec893b7ee tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:52.653424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-11ff776d-a040-4621-a770-3dfec893b7ee tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:52.663579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-11ff776d-a040-4621-a770-3dfec893b7ee tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:52.664985 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-11ff776d-a040-4621-a770-3dfec893b7ee tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1357 microversion: 2.57 time: 0.545320 Aug 29 15:46:52.665744 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2404/4965] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:52 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1357 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:52.698866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e5a2737a-5316-4b96-a128-879d70b5c358 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:52.700626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e5a2737a-5316-4b96-a128-879d70b5c358 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:52.720775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-316707f3-71c7-47fa-831d-1846df5203da tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:52.724093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5a2737a-5316-4b96-a128-879d70b5c358 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:52.737199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-316707f3-71c7-47fa-831d-1846df5203da tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:52.743661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5a2737a-5316-4b96-a128-879d70b5c358 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:52.746165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5a2737a-5316-4b96-a128-879d70b5c358 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:52.749731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5a2737a-5316-4b96-a128-879d70b5c358 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:52.756583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5a2737a-5316-4b96-a128-879d70b5c358 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:52.759175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5a2737a-5316-4b96-a128-879d70b5c358 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:52.772515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-316707f3-71c7-47fa-831d-1846df5203da tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:52.776402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-316707f3-71c7-47fa-831d-1846df5203da tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:52.778038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-316707f3-71c7-47fa-831d-1846df5203da tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:52.780742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-316707f3-71c7-47fa-831d-1846df5203da tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:52.784216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-316707f3-71c7-47fa-831d-1846df5203da tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:52.787259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-316707f3-71c7-47fa-831d-1846df5203da tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:52.838676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e5a2737a-5316-4b96-a128-879d70b5c358 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:52.995981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=90,nova_api:INSERT=9 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:53.010469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-316707f3-71c7-47fa-831d-1846df5203da tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:53.022341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-316707f3-71c7-47fa-831d-1846df5203da tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:53.023579 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e5a2737a-5316-4b96-a128-879d70b5c358 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 204 len: 0 microversion: 2.57 time: 0.329014 Aug 29 15:46:53.024742 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2562/4966] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:46:52 2022] DELETE /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:46:53.031110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-316707f3-71c7-47fa-831d-1846df5203da tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:53.037632 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-316707f3-71c7-47fa-831d-1846df5203da tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1282 microversion: 2.47 time: 0.329507 Aug 29 15:46:53.046657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6ed55629-630d-4e51-a749-4b8e0c9e9888 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:53.047680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6ed55629-630d-4e51-a749-4b8e0c9e9888 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:53.057502 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2405/4967] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:52 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1282 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:53.061228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ed55629-630d-4e51-a749-4b8e0c9e9888 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:53.062770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ed55629-630d-4e51-a749-4b8e0c9e9888 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:53.063576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ed55629-630d-4e51-a749-4b8e0c9e9888 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:53.064707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ed55629-630d-4e51-a749-4b8e0c9e9888 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:53.065448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ed55629-630d-4e51-a749-4b8e0c9e9888 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:53.066058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ed55629-630d-4e51-a749-4b8e0c9e9888 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:53.261121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6ed55629-630d-4e51-a749-4b8e0c9e9888 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:53.285938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6ed55629-630d-4e51-a749-4b8e0c9e9888 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:53.290801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6ed55629-630d-4e51-a749-4b8e0c9e9888 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:53.292540 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6ed55629-630d-4e51-a749-4b8e0c9e9888 tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1363 microversion: 2.57 time: 0.263142 Aug 29 15:46:53.309809 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2563/4968] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:53 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:53.500466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e5035bdb-b888-4c53-870d-79e3acb00791 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:53.503624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e5035bdb-b888-4c53-870d-79e3acb00791 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:53.524838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5035bdb-b888-4c53-870d-79e3acb00791 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:53.526229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5035bdb-b888-4c53-870d-79e3acb00791 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:53.526943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5035bdb-b888-4c53-870d-79e3acb00791 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:53.527998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5035bdb-b888-4c53-870d-79e3acb00791 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:53.528662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5035bdb-b888-4c53-870d-79e3acb00791 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:53.529641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5035bdb-b888-4c53-870d-79e3acb00791 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:53.546004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-472f66a6-b477-4a3e-a8f5-ceaf1eb10708 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Action: 'create', calling method: .version_select at 0x7fc42a9ee1f0>, body: {"keypair": {"name": "tempest-keypair-1547085070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsFplE2OcJqUb0jwTPjj5lHHdr6DOJQOtaXEOELZfXdFpcYzlP+0uPI6fUFLSBm49TEMAg/TjH9dmCHgfM4HBiXKIssCrqxJ/lXzbFx9cujeEGl+HxogLfzkTrWQwveAw=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:53.594620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-472f66a6-b477-4a3e-a8f5-ceaf1eb10708 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Getting quotas for project 90cd659e27ab4f5b9c926a11221a8d80. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:46:53.604400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-472f66a6-b477-4a3e-a8f5-ceaf1eb10708 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Getting quotas for user a27d353043364e838b7b6db2c5e97215 and project 90cd659e27ab4f5b9c926a11221a8d80. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:46:53.649593 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-472f66a6-b477-4a3e-a8f5-ceaf1eb10708 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.244885 Aug 29 15:46:53.650270 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2406/4969] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:46:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:53.668442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-51bfaabb-673b-4c12-abe7-b353ecdb6613 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a9ee3a0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:53.785849 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-51bfaabb-673b-4c12-abe7-b353ecdb6613 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.123799 Aug 29 15:46:53.786530 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2407/4970] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:53 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:53.821001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e5035bdb-b888-4c53-870d-79e3acb00791 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:53.832240 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e5035bdb-b888-4c53-870d-79e3acb00791 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1317 microversion: 2.1 time: 0.338516 Aug 29 15:46:53.849342 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2564/4971] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:53 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:54.063999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f5fe6d10-6d9d-43c9-8480-99f8895a51a6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:54.064803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f5fe6d10-6d9d-43c9-8480-99f8895a51a6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:54.083981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5fe6d10-6d9d-43c9-8480-99f8895a51a6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:54.085380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5fe6d10-6d9d-43c9-8480-99f8895a51a6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:54.090785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5fe6d10-6d9d-43c9-8480-99f8895a51a6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:54.092126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5fe6d10-6d9d-43c9-8480-99f8895a51a6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:54.093989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5fe6d10-6d9d-43c9-8480-99f8895a51a6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:54.096793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5fe6d10-6d9d-43c9-8480-99f8895a51a6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:54.306012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f5fe6d10-6d9d-43c9-8480-99f8895a51a6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:54.322018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f5fe6d10-6d9d-43c9-8480-99f8895a51a6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:54.322868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1da6bcd6-f993-4ffd-98ee-5ff46ec3424c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:54.323513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f5fe6d10-6d9d-43c9-8480-99f8895a51a6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:54.323778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1da6bcd6-f993-4ffd-98ee-5ff46ec3424c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:54.327843 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f5fe6d10-6d9d-43c9-8480-99f8895a51a6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1330 microversion: 2.47 time: 0.266363 Aug 29 15:46:54.333759 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2408/4972] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:54 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1330 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:46:54.341113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1da6bcd6-f993-4ffd-98ee-5ff46ec3424c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:54.343724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1da6bcd6-f993-4ffd-98ee-5ff46ec3424c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:54.344177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1da6bcd6-f993-4ffd-98ee-5ff46ec3424c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:54.344903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1da6bcd6-f993-4ffd-98ee-5ff46ec3424c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:54.348759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1da6bcd6-f993-4ffd-98ee-5ff46ec3424c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:54.348759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1da6bcd6-f993-4ffd-98ee-5ff46ec3424c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:54.482431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1da6bcd6-f993-4ffd-98ee-5ff46ec3424c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:54.492053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1da6bcd6-f993-4ffd-98ee-5ff46ec3424c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:54.501703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1da6bcd6-f993-4ffd-98ee-5ff46ec3424c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:54.503991 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1da6bcd6-f993-4ffd-98ee-5ff46ec3424c tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1363 microversion: 2.57 time: 0.185351 Aug 29 15:46:54.517316 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2565/4973] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:54 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:46:54.807392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7ccd6d2c-c4c4-4bf1-9b34-c48ea59303c4 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a5408b0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:54.857681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f158ee8-0214-4f5a-a7ba-3ac542717f8c tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:54.859414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3f158ee8-0214-4f5a-a7ba-3ac542717f8c tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:54.898594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f158ee8-0214-4f5a-a7ba-3ac542717f8c tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:54.900417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f158ee8-0214-4f5a-a7ba-3ac542717f8c tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:54.900906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f158ee8-0214-4f5a-a7ba-3ac542717f8c tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:54.901726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f158ee8-0214-4f5a-a7ba-3ac542717f8c tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:54.906932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f158ee8-0214-4f5a-a7ba-3ac542717f8c tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:54.907443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f158ee8-0214-4f5a-a7ba-3ac542717f8c tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:54.916694 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7ccd6d2c-c4c4-4bf1-9b34-c48ea59303c4 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.119252 Aug 29 15:46:54.930563 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2409/4974] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:54 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:55.201719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3f158ee8-0214-4f5a-a7ba-3ac542717f8c tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:55.216335 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3f158ee8-0214-4f5a-a7ba-3ac542717f8c tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1507 microversion: 2.1 time: 0.365017 Aug 29 15:46:55.217899 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2566/4975] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:54 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:55.240413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-273cc92d-2191-436b-9a35-36ca6b0c16bf tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:55.240960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-273cc92d-2191-436b-9a35-36ca6b0c16bf tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:55.260765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-273cc92d-2191-436b-9a35-36ca6b0c16bf tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.262726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-273cc92d-2191-436b-9a35-36ca6b0c16bf tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.262726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-273cc92d-2191-436b-9a35-36ca6b0c16bf tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.262726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-273cc92d-2191-436b-9a35-36ca6b0c16bf tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.263056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-273cc92d-2191-436b-9a35-36ca6b0c16bf tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.263470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-273cc92d-2191-436b-9a35-36ca6b0c16bf tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.342525 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-273cc92d-2191-436b-9a35-36ca6b0c16bf tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e/ips" status: 200 len: 110 microversion: 2.1 time: 0.105896 Aug 29 15:46:55.355332 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2410/4976] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:46:55 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e/ips => generated 110 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:55.357900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-969f1ea3-66b5-4853-a7cc-f3cb71c699cd tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:55.358599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-969f1ea3-66b5-4853-a7cc-f3cb71c699cd tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:55.373017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-26a57295-f193-4a2e-bc36-1a8d0e6b0ddf tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:55.373689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-26a57295-f193-4a2e-bc36-1a8d0e6b0ddf tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:55.383851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-969f1ea3-66b5-4853-a7cc-f3cb71c699cd tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.384947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-969f1ea3-66b5-4853-a7cc-f3cb71c699cd tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.391413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-969f1ea3-66b5-4853-a7cc-f3cb71c699cd tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.393060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-969f1ea3-66b5-4853-a7cc-f3cb71c699cd tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.394612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-969f1ea3-66b5-4853-a7cc-f3cb71c699cd tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.395354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-969f1ea3-66b5-4853-a7cc-f3cb71c699cd tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.398783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26a57295-f193-4a2e-bc36-1a8d0e6b0ddf tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.399289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26a57295-f193-4a2e-bc36-1a8d0e6b0ddf tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.399731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26a57295-f193-4a2e-bc36-1a8d0e6b0ddf tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.400447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26a57295-f193-4a2e-bc36-1a8d0e6b0ddf tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.400902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26a57295-f193-4a2e-bc36-1a8d0e6b0ddf tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.405469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26a57295-f193-4a2e-bc36-1a8d0e6b0ddf tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.468913 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-969f1ea3-66b5-4853-a7cc-f3cb71c699cd tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e/ips" status: 200 len: 110 microversion: 2.1 time: 0.115871 Aug 29 15:46:55.480901 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2567/4977] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:46:55 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e/ips => generated 110 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:55.498054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fe4ef5de-cbbf-4b64-af3e-fa5811cb3e51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:55.501023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fe4ef5de-cbbf-4b64-af3e-fa5811cb3e51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:55.518998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe4ef5de-cbbf-4b64-af3e-fa5811cb3e51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.522645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe4ef5de-cbbf-4b64-af3e-fa5811cb3e51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.523797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe4ef5de-cbbf-4b64-af3e-fa5811cb3e51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.525306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe4ef5de-cbbf-4b64-af3e-fa5811cb3e51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.530333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe4ef5de-cbbf-4b64-af3e-fa5811cb3e51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.531835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe4ef5de-cbbf-4b64-af3e-fa5811cb3e51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.555302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-26a57295-f193-4a2e-bc36-1a8d0e6b0ddf tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:55.564263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-26a57295-f193-4a2e-bc36-1a8d0e6b0ddf tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:55.569351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-26a57295-f193-4a2e-bc36-1a8d0e6b0ddf tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:55.570297 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-26a57295-f193-4a2e-bc36-1a8d0e6b0ddf tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1348 microversion: 2.47 time: 0.213843 Aug 29 15:46:55.587553 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2411/4978] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:55 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1348 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:55.598455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2269933c-852f-4301-bdbb-c64acb18c07a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:55.606585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2269933c-852f-4301-bdbb-c64acb18c07a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:55.623964 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fe4ef5de-cbbf-4b64-af3e-fa5811cb3e51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e/ips/tempest-ServerAddressesTestJSON-1112573938-network" status: 200 len: 95 microversion: 2.1 time: 0.139871 Aug 29 15:46:55.628477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2269933c-852f-4301-bdbb-c64acb18c07a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.633240 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2568/4979] 10.222.0.62 () {58 vars in 1401 bytes} [Mon Aug 29 15:46:55 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e/ips/tempest-ServerAddressesTestJSON-1112573938-network => generated 95 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:46:55.633513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2269933c-852f-4301-bdbb-c64acb18c07a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.633990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2269933c-852f-4301-bdbb-c64acb18c07a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.634752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2269933c-852f-4301-bdbb-c64acb18c07a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.635218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2269933c-852f-4301-bdbb-c64acb18c07a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.635651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2269933c-852f-4301-bdbb-c64acb18c07a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.642479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ba1cf46c-3808-4729-ae18-bd062546ff61 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:55.643527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ba1cf46c-3808-4729-ae18-bd062546ff61 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:55.652393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba1cf46c-3808-4729-ae18-bd062546ff61 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.653398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba1cf46c-3808-4729-ae18-bd062546ff61 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.655065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba1cf46c-3808-4729-ae18-bd062546ff61 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.656516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba1cf46c-3808-4729-ae18-bd062546ff61 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.657609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba1cf46c-3808-4729-ae18-bd062546ff61 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.658306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba1cf46c-3808-4729-ae18-bd062546ff61 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.691807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:55.730212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2269933c-852f-4301-bdbb-c64acb18c07a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.730212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2269933c-852f-4301-bdbb-c64acb18c07a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.732164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2269933c-852f-4301-bdbb-c64acb18c07a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.732651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-2269933c-852f-4301-bdbb-c64acb18c07a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lazy-loading 'fault' on Instance uuid b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:55.740376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ba1cf46c-3808-4729-ae18-bd062546ff61 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:55.823184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2269933c-852f-4301-bdbb-c64acb18c07a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:55.880036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2269933c-852f-4301-bdbb-c64acb18c07a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:55.883809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2269933c-852f-4301-bdbb-c64acb18c07a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e702f756d9684796bb85b184d2d3c80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63d9b71dac2423fabf4e4d38b7b543f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:55.885555 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2269933c-852f-4301-bdbb-c64acb18c07a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 200 len: 1368 microversion: 2.57 time: 0.296656 Aug 29 15:46:55.891423 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2412/4980] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:55 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 1368 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:55.932274 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ba1cf46c-3808-4729-ae18-bd062546ff61 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 204 len: 0 microversion: 2.1 time: 0.296494 Aug 29 15:46:55.938254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b30eb261-c189-495a-8ef7-5d3acee26d71 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a5f3820>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:55.943961 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2569/4981] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:55 2022] DELETE /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:55.962740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-da9b3358-6554-416c-8a7d-60f249336b88 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:55.963993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-da9b3358-6554-416c-8a7d-60f249336b88 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:55.972604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9b3358-6554-416c-8a7d-60f249336b88 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.973376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9b3358-6554-416c-8a7d-60f249336b88 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.973979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9b3358-6554-416c-8a7d-60f249336b88 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.974922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9b3358-6554-416c-8a7d-60f249336b88 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.975543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9b3358-6554-416c-8a7d-60f249336b88 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.976313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9b3358-6554-416c-8a7d-60f249336b88 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:56.006430 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b30eb261-c189-495a-8ef7-5d3acee26d71 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.072266 Aug 29 15:46:56.014465 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2413/4982] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:55 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:56.223803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-da9b3358-6554-416c-8a7d-60f249336b88 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:56.241697 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-da9b3358-6554-416c-8a7d-60f249336b88 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1513 microversion: 2.1 time: 0.284287 Aug 29 15:46:56.242639 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2570/4983] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:55 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1513 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:56.603205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8cb427e3-2e38-485e-bd1e-8deffca13c9f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:56.604009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8cb427e3-2e38-485e-bd1e-8deffca13c9f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:56.619394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cb427e3-2e38-485e-bd1e-8deffca13c9f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:56.620271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cb427e3-2e38-485e-bd1e-8deffca13c9f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:56.620991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cb427e3-2e38-485e-bd1e-8deffca13c9f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:56.622229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cb427e3-2e38-485e-bd1e-8deffca13c9f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:56.623652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cb427e3-2e38-485e-bd1e-8deffca13c9f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:56.624314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cb427e3-2e38-485e-bd1e-8deffca13c9f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:56.790693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8cb427e3-2e38-485e-bd1e-8deffca13c9f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:56.790845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-57342994", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ebda995-e90a-4f2e-b960-05df0b4c22d1"}], "security_groups": [{"name": "tempest-securitygroup--816013390"}], "key_name": "tempest-keypair-1547085070", "user_data": "}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:56.807729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8cb427e3-2e38-485e-bd1e-8deffca13c9f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:56.827293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8cb427e3-2e38-485e-bd1e-8deffca13c9f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:56.841395 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8cb427e3-2e38-485e-bd1e-8deffca13c9f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1336 microversion: 2.47 time: 0.244814 Aug 29 15:46:56.842009 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2414/4984] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:56 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1336 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:56.912323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-abc03cbd-3f10-47ae-9cd0-04581a7a6d1a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:56.919681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-abc03cbd-3f10-47ae-9cd0-04581a7a6d1a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] [instance: b610c1ff-ff4b-4bd5-babc-29f2e3a5e142] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:56.948145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abc03cbd-3f10-47ae-9cd0-04581a7a6d1a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:56.952119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abc03cbd-3f10-47ae-9cd0-04581a7a6d1a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:56.955677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abc03cbd-3f10-47ae-9cd0-04581a7a6d1a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:56.956981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abc03cbd-3f10-47ae-9cd0-04581a7a6d1a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:56.957687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abc03cbd-3f10-47ae-9cd0-04581a7a6d1a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:56.958337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abc03cbd-3f10-47ae-9cd0-04581a7a6d1a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:56.975700 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-abc03cbd-3f10-47ae-9cd0-04581a7a6d1a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] HTTP exception thrown: Instance b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 could not be found. Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-abc03cbd-3f10-47ae-9cd0-04581a7a6d1a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Request method failure captured: Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 HTTP/1.1 Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN86VAc__CTQVgUfxF7REXgqxDhLTSJUA24BGPU9E2Zo6g0gLGBbaGgh1C2-TnqFr7XddUXKTwr7vVx6OzWNbOtITbCiHjzq_caHOHaGaJFqgMzD9JPqMLxOEqUZGA_OJBq7v2oa7mjcrCHf1deG9QqMctOYqd6caogRTnziQFT-d2g Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.57 Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: e63d9b71dac2423fabf4e4d38b7b543f Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerShowV257Test-328209432 Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e63d9b71dac2423fabf4e4d38b7b543f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e63d9b71dac2423fabf4e4d38b7b543f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e63d9b71dac2423fabf4e4d38b7b543f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e63d9b71dac2423fabf4e4d38b7b543f"}]}] Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerShowV257Test-328209432 Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: e63d9b71dac2423fabf4e4d38b7b543f Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerShowV257Test-328209432 Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerShowV257Test-328209432-project Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e702f756d9684796bb85b184d2d3c80d Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerShowV257Test-328209432-project Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 could not be found. Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'b610c1ff-ff4b-4bd5-babc-29f2e3a5e142'} Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 could not be found. Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 could not be found. Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:56.977757 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:56.982497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:56.982497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:56.982497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:56.982497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:56.982497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:56.982497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 could not be found. Aug 29 15:46:56.982497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:46:56.983804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-abc03cbd-3f10-47ae-9cd0-04581a7a6d1a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] Returning 404 to user: Instance b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:56.984847 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-abc03cbd-3f10-47ae-9cd0-04581a7a6d1a tempest-ServerShowV257Test-328209432 tempest-ServerShowV257Test-328209432-project] 10.222.0.62 "GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142" status: 404 len: 111 microversion: 2.57 time: 0.076925 Aug 29 15:46:56.989061 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2415/4985] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:56 2022] GET /compute/v2.1/servers/b610c1ff-ff4b-4bd5-babc-29f2e3a5e142 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:46:57.029699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] validate_networks() for [('0ebda995-e90a-4f2e-b960-05df0b4c22d1', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:46:57.041407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-87e7631c-a416-40f3-8814-1c6f99c9819a tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b8594c0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:57.116208 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-87e7631c-a416-40f3-8814-1c6f99c9819a tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.092705 Aug 29 15:46:57.123844 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2416/4986] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:57 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:57.266583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-716d9c99-d7a3-406f-b5f1-0f43354bbc51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:57.267599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-716d9c99-d7a3-406f-b5f1-0f43354bbc51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:57.301619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-716d9c99-d7a3-406f-b5f1-0f43354bbc51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:57.302552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-716d9c99-d7a3-406f-b5f1-0f43354bbc51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:57.303320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-716d9c99-d7a3-406f-b5f1-0f43354bbc51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:57.304270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-716d9c99-d7a3-406f-b5f1-0f43354bbc51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:57.304994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-716d9c99-d7a3-406f-b5f1-0f43354bbc51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:57.305881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-716d9c99-d7a3-406f-b5f1-0f43354bbc51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:57.683188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-716d9c99-d7a3-406f-b5f1-0f43354bbc51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:57.698838 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-716d9c99-d7a3-406f-b5f1-0f43354bbc51 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1513 microversion: 2.1 time: 0.439224 Aug 29 15:46:57.699772 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2417/4987] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:57 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1513 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:57.800244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:46:57.801502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:46:57.802551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:46:57.803238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:46:57.803880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:46:57.820785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:57.823074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:57.823882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:57.825991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:57.827292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:57.829008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:57.868941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6e3f55b1-d410-4395-a848-15de55838293 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:57.870579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6e3f55b1-d410-4395-a848-15de55838293 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:57.874863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Getting quotas for project 90cd659e27ab4f5b9c926a11221a8d80. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:46:57.881788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e3f55b1-d410-4395-a848-15de55838293 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:57.889656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Getting quotas for user a27d353043364e838b7b6db2c5e97215 and project 90cd659e27ab4f5b9c926a11221a8d80. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:46:57.890884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e3f55b1-d410-4395-a848-15de55838293 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:57.891445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e3f55b1-d410-4395-a848-15de55838293 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:57.892196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e3f55b1-d410-4395-a848-15de55838293 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:57.892669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e3f55b1-d410-4395-a848-15de55838293 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:57.893114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e3f55b1-d410-4395-a848-15de55838293 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:57.912794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:46:57.915661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:46:57.983495 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-65161289-a596-405f-ad45-59bd0086b66c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.199783 Aug 29 15:46:57.984557 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2571/4988] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:46:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:46:57.996986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c959269f-db3a-4888-935d-a3c34fb95360 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:57.997793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c959269f-db3a-4888-935d-a3c34fb95360 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:58.065425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6e3f55b1-d410-4395-a848-15de55838293 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:58.074760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6e3f55b1-d410-4395-a848-15de55838293 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:58.081075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6e3f55b1-d410-4395-a848-15de55838293 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:58.082427 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6e3f55b1-d410-4395-a848-15de55838293 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1336 microversion: 2.47 time: 0.218416 Aug 29 15:46:58.083017 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2418/4989] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:57 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1336 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:58.087412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c959269f-db3a-4888-935d-a3c34fb95360 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:58.097334 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c959269f-db3a-4888-935d-a3c34fb95360 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1240 microversion: 2.1 time: 0.104884 Aug 29 15:46:58.114042 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2572/4990] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:57 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1240 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:58.130484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-97cb04c5-3e00-4331-b45b-dc97d8d48f5d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a50e160>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:58.216453 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-97cb04c5-3e00-4331-b45b-dc97d8d48f5d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.089881 Aug 29 15:46:58.217322 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2419/4991] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:58 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:58.726057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-176e9b41-1b95-4aab-90bc-f8c29172a007 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:58.726896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-176e9b41-1b95-4aab-90bc-f8c29172a007 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:58.742780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-176e9b41-1b95-4aab-90bc-f8c29172a007 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:58.743669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-176e9b41-1b95-4aab-90bc-f8c29172a007 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:58.746316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-176e9b41-1b95-4aab-90bc-f8c29172a007 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:58.748746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-176e9b41-1b95-4aab-90bc-f8c29172a007 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:58.750731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-176e9b41-1b95-4aab-90bc-f8c29172a007 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:58.753433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-176e9b41-1b95-4aab-90bc-f8c29172a007 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:59.107913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a3379d69-0d92-41f5-a8ef-7aebc8a2dd89 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:59.109335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a3379d69-0d92-41f5-a8ef-7aebc8a2dd89 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:59.123361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3379d69-0d92-41f5-a8ef-7aebc8a2dd89 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:59.125413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3379d69-0d92-41f5-a8ef-7aebc8a2dd89 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:59.125856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3379d69-0d92-41f5-a8ef-7aebc8a2dd89 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:59.127288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3379d69-0d92-41f5-a8ef-7aebc8a2dd89 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:59.127828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-176e9b41-1b95-4aab-90bc-f8c29172a007 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:59.128686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3379d69-0d92-41f5-a8ef-7aebc8a2dd89 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:59.129796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3379d69-0d92-41f5-a8ef-7aebc8a2dd89 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:59.152856 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-176e9b41-1b95-4aab-90bc-f8c29172a007 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1513 microversion: 2.1 time: 0.429366 Aug 29 15:46:59.156607 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2573/4992] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:58 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1513 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:59.167924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-382c7a01-3620-435a-9b1d-62e14a17da91 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:59.176150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-382c7a01-3620-435a-9b1d-62e14a17da91 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:59.211535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a3379d69-0d92-41f5-a8ef-7aebc8a2dd89 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:59.220944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a3379d69-0d92-41f5-a8ef-7aebc8a2dd89 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:59.224642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a3379d69-0d92-41f5-a8ef-7aebc8a2dd89 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:59.226231 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a3379d69-0d92-41f5-a8ef-7aebc8a2dd89 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1336 microversion: 2.47 time: 0.124604 Aug 29 15:46:59.228005 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2420/4993] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:59 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1336 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:59.232967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d797278e-7162-4946-af95-386a5f80222c tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b76f040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:59.344749 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d797278e-7162-4946-af95-386a5f80222c tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1454 microversion: 2.1 time: 0.115382 Aug 29 15:46:59.347946 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2421/4994] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:46:59 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:59.357264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-382c7a01-3620-435a-9b1d-62e14a17da91 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:59.368998 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-382c7a01-3620-435a-9b1d-62e14a17da91 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1240 microversion: 2.1 time: 0.207492 Aug 29 15:46:59.371577 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2574/4995] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:59 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1240 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:00.181969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6a68d86c-8474-49fb-9053-aa0eff457f29 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:00.182545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6a68d86c-8474-49fb-9053-aa0eff457f29 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:00.200559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a68d86c-8474-49fb-9053-aa0eff457f29 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:00.202953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a68d86c-8474-49fb-9053-aa0eff457f29 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:00.205903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a68d86c-8474-49fb-9053-aa0eff457f29 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:00.206794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a68d86c-8474-49fb-9053-aa0eff457f29 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:00.211579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a68d86c-8474-49fb-9053-aa0eff457f29 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:00.212454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a68d86c-8474-49fb-9053-aa0eff457f29 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:00.263030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9be6bf58-14c2-4708-8220-d64a6cc4881e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:00.264420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9be6bf58-14c2-4708-8220-d64a6cc4881e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:00.289386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9be6bf58-14c2-4708-8220-d64a6cc4881e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:00.291504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9be6bf58-14c2-4708-8220-d64a6cc4881e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:00.293966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9be6bf58-14c2-4708-8220-d64a6cc4881e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:00.296503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9be6bf58-14c2-4708-8220-d64a6cc4881e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:00.297180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9be6bf58-14c2-4708-8220-d64a6cc4881e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:00.300906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9be6bf58-14c2-4708-8220-d64a6cc4881e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:00.464972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9be6bf58-14c2-4708-8220-d64a6cc4881e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:00.477475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9be6bf58-14c2-4708-8220-d64a6cc4881e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:00.479323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9be6bf58-14c2-4708-8220-d64a6cc4881e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:00.480780 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9be6bf58-14c2-4708-8220-d64a6cc4881e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1336 microversion: 2.47 time: 0.226906 Aug 29 15:47:00.494119 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2575/4996] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:00 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1336 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:00.506035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-135434f7-1e6d-4992-8122-8c4626135fc8 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a7ad790>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:00.571497 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-135434f7-1e6d-4992-8122-8c4626135fc8 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1463 microversion: 2.1 time: 0.073896 Aug 29 15:47:00.573861 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2576/4997] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:00 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1463 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:00.591628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0df26512-8ba4-4490-8309-3343eaf23e0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:00.594965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0df26512-8ba4-4490-8309-3343eaf23e0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:00.613937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0df26512-8ba4-4490-8309-3343eaf23e0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:00.614526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0df26512-8ba4-4490-8309-3343eaf23e0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:00.615069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0df26512-8ba4-4490-8309-3343eaf23e0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:00.618010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0df26512-8ba4-4490-8309-3343eaf23e0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:00.618714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0df26512-8ba4-4490-8309-3343eaf23e0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:00.619368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0df26512-8ba4-4490-8309-3343eaf23e0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:00.638329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:00.728969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0df26512-8ba4-4490-8309-3343eaf23e0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:00.741981 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0df26512-8ba4-4490-8309-3343eaf23e0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1298 microversion: 2.1 time: 0.165049 Aug 29 15:47:00.742803 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2577/4998] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:00 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1298 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:00.749423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-40677705-0220-44bb-9bb0-79f710ec223e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42aa89700>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:00.819824 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-40677705-0220-44bb-9bb0-79f710ec223e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 200 len: 1463 microversion: 2.1 time: 0.075319 Aug 29 15:47:00.820428 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2578/4999] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:00 2022] GET /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 1463 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:00.835291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-20fe5187-08d6-4280-b342-2353bd8bbd2e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:00.836354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-20fe5187-08d6-4280-b342-2353bd8bbd2e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: cea653ef-b11d-4341-a1cf-e941b5f3e570] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:00.846316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20fe5187-08d6-4280-b342-2353bd8bbd2e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:00.847376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20fe5187-08d6-4280-b342-2353bd8bbd2e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:00.850849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20fe5187-08d6-4280-b342-2353bd8bbd2e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:00.851939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20fe5187-08d6-4280-b342-2353bd8bbd2e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:00.852564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20fe5187-08d6-4280-b342-2353bd8bbd2e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:00.853198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20fe5187-08d6-4280-b342-2353bd8bbd2e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:01.000633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6a68d86c-8474-49fb-9053-aa0eff457f29 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:01.013922 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6a68d86c-8474-49fb-9053-aa0eff457f29 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1513 microversion: 2.1 time: 0.837720 Aug 29 15:47:01.014450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-20fe5187-08d6-4280-b342-2353bd8bbd2e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:01.024592 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-20fe5187-08d6-4280-b342-2353bd8bbd2e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570" status: 200 len: 1480 microversion: 2.1 time: 0.194278 Aug 29 15:47:01.025516 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2579/5000] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:00 2022] GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570 => generated 1480 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:01.033486 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2422/5001] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:00 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1513 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:01.508327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c4b99bf6-c111-4144-8120-6d341e0f091d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:01.509685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c4b99bf6-c111-4144-8120-6d341e0f091d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:01.521606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4b99bf6-c111-4144-8120-6d341e0f091d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:01.525005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4b99bf6-c111-4144-8120-6d341e0f091d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:01.526220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4b99bf6-c111-4144-8120-6d341e0f091d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:01.537264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4b99bf6-c111-4144-8120-6d341e0f091d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:01.537985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4b99bf6-c111-4144-8120-6d341e0f091d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:01.538535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4b99bf6-c111-4144-8120-6d341e0f091d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:01.668379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c4b99bf6-c111-4144-8120-6d341e0f091d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:01.678848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-589fd065-9449-4b07-92a3-3f4025f1dbd6 req-8b91f163-3761-44c6-b939-98d0d0ad899b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fee4956-a06f-41b3-8b67-712e6252803e", "name": "network-vif-deleted", "tag": "c620ed5a-89c3-4f49-b011-3604621dc438"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:01.693039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c4b99bf6-c111-4144-8120-6d341e0f091d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:01.703620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c4b99bf6-c111-4144-8120-6d341e0f091d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:01.706947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-589fd065-9449-4b07-92a3-3f4025f1dbd6 req-8b91f163-3761-44c6-b939-98d0d0ad899b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:01.707432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-589fd065-9449-4b07-92a3-3f4025f1dbd6 req-8b91f163-3761-44c6-b939-98d0d0ad899b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:01.710958 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c4b99bf6-c111-4144-8120-6d341e0f091d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1336 microversion: 2.47 time: 0.205026 Aug 29 15:47:01.711601 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2580/5002] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:01 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1336 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:01.713239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-589fd065-9449-4b07-92a3-3f4025f1dbd6 req-8b91f163-3761-44c6-b939-98d0d0ad899b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:01.744635 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-589fd065-9449-4b07-92a3-3f4025f1dbd6 req-8b91f163-3761-44c6-b939-98d0d0ad899b service nova] Creating event network-vif-deleted:c620ed5a-89c3-4f49-b011-3604621dc438 for instance 5fee4956-a06f-41b3-8b67-712e6252803e on n-h2-839401-11 Aug 29 15:47:01.750559 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-589fd065-9449-4b07-92a3-3f4025f1dbd6 req-8b91f163-3761-44c6-b939-98d0d0ad899b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077682 Aug 29 15:47:01.752033 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2423/5003] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:01.762682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-89fbbe65-f5d5-4175-9b62-2b5ea960af1b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:01.763631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-89fbbe65-f5d5-4175-9b62-2b5ea960af1b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:01.773149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89fbbe65-f5d5-4175-9b62-2b5ea960af1b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:01.782486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89fbbe65-f5d5-4175-9b62-2b5ea960af1b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:01.783245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89fbbe65-f5d5-4175-9b62-2b5ea960af1b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:01.784416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89fbbe65-f5d5-4175-9b62-2b5ea960af1b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:01.785110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89fbbe65-f5d5-4175-9b62-2b5ea960af1b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:01.785731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89fbbe65-f5d5-4175-9b62-2b5ea960af1b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:01.862323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-89fbbe65-f5d5-4175-9b62-2b5ea960af1b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:01.876787 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-89fbbe65-f5d5-4175-9b62-2b5ea960af1b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1298 microversion: 2.1 time: 0.118556 Aug 29 15:47:01.887040 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2581/5004] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:01 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1298 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:02.047876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-afc7dd91-48b0-4df2-bb9b-f11a79f31afc tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:02.050945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fc2583e3-30e1-41f3-bd74-604def53664b tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:02.052051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-afc7dd91-48b0-4df2-bb9b-f11a79f31afc tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: cea653ef-b11d-4341-a1cf-e941b5f3e570] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:02.058060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fc2583e3-30e1-41f3-bd74-604def53664b tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:02.068926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afc7dd91-48b0-4df2-bb9b-f11a79f31afc tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:02.071206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc2583e3-30e1-41f3-bd74-604def53664b tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:02.072007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afc7dd91-48b0-4df2-bb9b-f11a79f31afc tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:02.072687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afc7dd91-48b0-4df2-bb9b-f11a79f31afc tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:02.073680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afc7dd91-48b0-4df2-bb9b-f11a79f31afc tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:02.074427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc2583e3-30e1-41f3-bd74-604def53664b tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:02.075104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afc7dd91-48b0-4df2-bb9b-f11a79f31afc tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:02.075755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc2583e3-30e1-41f3-bd74-604def53664b tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:02.076604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afc7dd91-48b0-4df2-bb9b-f11a79f31afc tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:02.077832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc2583e3-30e1-41f3-bd74-604def53664b tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:02.082401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc2583e3-30e1-41f3-bd74-604def53664b tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:02.083156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc2583e3-30e1-41f3-bd74-604def53664b tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:02.635198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-afc7dd91-48b0-4df2-bb9b-f11a79f31afc tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:02.666348 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-afc7dd91-48b0-4df2-bb9b-f11a79f31afc tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570" status: 200 len: 1467 microversion: 2.1 time: 0.623821 Aug 29 15:47:02.670743 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2582/5005] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:02 2022] GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570 => generated 1467 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:02.700193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aa4767da-41f6-438d-a693-518f74e4df31 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1985262666"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:02.703725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aa4767da-41f6-438d-a693-518f74e4df31 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:02.721408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa4767da-41f6-438d-a693-518f74e4df31 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:02.722188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa4767da-41f6-438d-a693-518f74e4df31 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:02.722836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa4767da-41f6-438d-a693-518f74e4df31 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:02.724860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa4767da-41f6-438d-a693-518f74e4df31 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:02.734129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa4767da-41f6-438d-a693-518f74e4df31 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:02.745337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa4767da-41f6-438d-a693-518f74e4df31 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:03.172587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fc2583e3-30e1-41f3-bd74-604def53664b tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:03.185023 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fc2583e3-30e1-41f3-bd74-604def53664b tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1471 microversion: 2.1 time: 1.146418 Aug 29 15:47:03.189204 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2424/5006] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:02 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1471 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:03.208954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7c8c14c6-27e2-4549-ba52-dbe78ca2fbd3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:03.210853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7c8c14c6-27e2-4549-ba52-dbe78ca2fbd3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:03.242915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8c14c6-27e2-4549-ba52-dbe78ca2fbd3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:03.243420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8c14c6-27e2-4549-ba52-dbe78ca2fbd3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:03.243879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8c14c6-27e2-4549-ba52-dbe78ca2fbd3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:03.244571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8c14c6-27e2-4549-ba52-dbe78ca2fbd3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:03.245022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8c14c6-27e2-4549-ba52-dbe78ca2fbd3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:03.245471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8c14c6-27e2-4549-ba52-dbe78ca2fbd3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:03.307135 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aa4767da-41f6-438d-a693-518f74e4df31 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "POST /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815/action" status: 202 len: 0 microversion: 2.1 time: 0.611801 Aug 29 15:47:03.309639 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2583/5007] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:47:02 2022] POST /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 29 15:47:03.332000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-09742030-364b-4877-ba41-e9165da22b66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:03.332965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-09742030-364b-4877-ba41-e9165da22b66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:03.348201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09742030-364b-4877-ba41-e9165da22b66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:03.357548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09742030-364b-4877-ba41-e9165da22b66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:03.358044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09742030-364b-4877-ba41-e9165da22b66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:03.358817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09742030-364b-4877-ba41-e9165da22b66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:03.359466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09742030-364b-4877-ba41-e9165da22b66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:03.360061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09742030-364b-4877-ba41-e9165da22b66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:03.439547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7c8c14c6-27e2-4549-ba52-dbe78ca2fbd3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:03.455290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7c8c14c6-27e2-4549-ba52-dbe78ca2fbd3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:03.467894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7c8c14c6-27e2-4549-ba52-dbe78ca2fbd3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:03.469498 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7c8c14c6-27e2-4549-ba52-dbe78ca2fbd3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1336 microversion: 2.47 time: 0.271926 Aug 29 15:47:03.485123 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2425/5008] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:03 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1336 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:03.485123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6a1261a5-d7e4-4ec6-a73d-ed4d8c867276 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42aa97e50>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:03.567325 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6a1261a5-d7e4-4ec6-a73d-ed4d8c867276 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.092599 Aug 29 15:47:03.569272 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2426/5009] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:03 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:04.061326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-09742030-364b-4877-ba41-e9165da22b66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:04.094909 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-09742030-364b-4877-ba41-e9165da22b66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1365 microversion: 2.1 time: 0.783678 Aug 29 15:47:04.103859 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2584/5010] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:03 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1365 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:04.206499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:04.218387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e3fe2f76-9bef-436f-a56e-d07c78f6d406 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:04.219075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e3fe2f76-9bef-436f-a56e-d07c78f6d406 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:04.259478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3fe2f76-9bef-436f-a56e-d07c78f6d406 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:04.260349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3fe2f76-9bef-436f-a56e-d07c78f6d406 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:04.261902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3fe2f76-9bef-436f-a56e-d07c78f6d406 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:04.262812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3fe2f76-9bef-436f-a56e-d07c78f6d406 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:04.268757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3fe2f76-9bef-436f-a56e-d07c78f6d406 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:04.269739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3fe2f76-9bef-436f-a56e-d07c78f6d406 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:04.313473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3fe2f76-9bef-436f-a56e-d07c78f6d406 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:04.314220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3fe2f76-9bef-436f-a56e-d07c78f6d406 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:04.314867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3fe2f76-9bef-436f-a56e-d07c78f6d406 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:04.315648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-e3fe2f76-9bef-436f-a56e-d07c78f6d406 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lazy-loading 'fault' on Instance uuid 5fee4956-a06f-41b3-8b67-712e6252803e {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:04.385017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e3fe2f76-9bef-436f-a56e-d07c78f6d406 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10666298a76745c7bada4de3653cdc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3598383c5942fea06ea4d4127e3bae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:04.395939 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e3fe2f76-9bef-436f-a56e-d07c78f6d406 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 200 len: 1307 microversion: 2.1 time: 0.190539 Aug 29 15:47:04.410047 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2427/5011] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:04 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 1307 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:04.500397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-12c23cbb-5ddc-4362-8dbe-1ef5ff36d67f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:04.501105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-12c23cbb-5ddc-4362-8dbe-1ef5ff36d67f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:04.510662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-9e9d5334-c27e-44d7-b58b-3d90e1014325 req-b06ad14a-44d6-4e85-858e-19dfbf7a54a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "646846a6-56c9-4370-8435-da5ae0466afb", "tag": "98c9ec0b-ac20-402a-9542-f7e5af3d086c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:04.531408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9e9d5334-c27e-44d7-b58b-3d90e1014325 req-b06ad14a-44d6-4e85-858e-19dfbf7a54a0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:04.534476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12c23cbb-5ddc-4362-8dbe-1ef5ff36d67f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:04.534807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9e9d5334-c27e-44d7-b58b-3d90e1014325 req-b06ad14a-44d6-4e85-858e-19dfbf7a54a0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:04.535510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9e9d5334-c27e-44d7-b58b-3d90e1014325 req-b06ad14a-44d6-4e85-858e-19dfbf7a54a0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:04.535668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12c23cbb-5ddc-4362-8dbe-1ef5ff36d67f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:04.536625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12c23cbb-5ddc-4362-8dbe-1ef5ff36d67f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:04.540700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12c23cbb-5ddc-4362-8dbe-1ef5ff36d67f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:04.544442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12c23cbb-5ddc-4362-8dbe-1ef5ff36d67f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:04.545217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12c23cbb-5ddc-4362-8dbe-1ef5ff36d67f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:04.575372 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-9e9d5334-c27e-44d7-b58b-3d90e1014325 req-b06ad14a-44d6-4e85-858e-19dfbf7a54a0 service nova] Creating event network-changed:98c9ec0b-ac20-402a-9542-f7e5af3d086c for instance 646846a6-56c9-4370-8435-da5ae0466afb on n-h1-839401-11 Aug 29 15:47:04.588286 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-9e9d5334-c27e-44d7-b58b-3d90e1014325 req-b06ad14a-44d6-4e85-858e-19dfbf7a54a0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086371 Aug 29 15:47:04.591785 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2428/5012] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:04.603410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3c2258bd-11ee-4eb7-9f27-45d3bd524859 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a7f60d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:04.711421 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3c2258bd-11ee-4eb7-9f27-45d3bd524859 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.118200 Aug 29 15:47:04.713956 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2429/5013] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:04 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:04.794250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-12873b2d-c50a-4539-9a7b-f2a9d1307352 req-c7f9d777-6627-489e-81a2-a95b9b2c7d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea653ef-b11d-4341-a1cf-e941b5f3e570", "name": "network-vif-unplugged", "status": "completed", "tag": "efc5b7ae-1aab-49aa-938d-1d74e0bd4507"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:04.804045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-12c23cbb-5ddc-4362-8dbe-1ef5ff36d67f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:04.818996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-12c23cbb-5ddc-4362-8dbe-1ef5ff36d67f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:04.829780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-12873b2d-c50a-4539-9a7b-f2a9d1307352 req-c7f9d777-6627-489e-81a2-a95b9b2c7d77 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:04.837661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-12873b2d-c50a-4539-9a7b-f2a9d1307352 req-c7f9d777-6627-489e-81a2-a95b9b2c7d77 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:04.838589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-12873b2d-c50a-4539-9a7b-f2a9d1307352 req-c7f9d777-6627-489e-81a2-a95b9b2c7d77 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:04.854839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-12c23cbb-5ddc-4362-8dbe-1ef5ff36d67f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:04.856206 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-12c23cbb-5ddc-4362-8dbe-1ef5ff36d67f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1336 microversion: 2.47 time: 0.360227 Aug 29 15:47:04.871721 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2585/5014] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:04 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1336 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:04.909260 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-12873b2d-c50a-4539-9a7b-f2a9d1307352 req-c7f9d777-6627-489e-81a2-a95b9b2c7d77 service nova] Creating event network-vif-unplugged:efc5b7ae-1aab-49aa-938d-1d74e0bd4507 for instance cea653ef-b11d-4341-a1cf-e941b5f3e570 on n-h1-839401-11 Aug 29 15:47:04.937147 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-12873b2d-c50a-4539-9a7b-f2a9d1307352 req-c7f9d777-6627-489e-81a2-a95b9b2c7d77 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145506 Aug 29 15:47:04.940565 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2430/5015] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:05.135081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f5217f2a-6553-4292-8c98-125217d993e6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:05.137041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f5217f2a-6553-4292-8c98-125217d993e6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:05.170826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5217f2a-6553-4292-8c98-125217d993e6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.172423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5217f2a-6553-4292-8c98-125217d993e6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.178744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5217f2a-6553-4292-8c98-125217d993e6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.179618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5217f2a-6553-4292-8c98-125217d993e6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.180974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5217f2a-6553-4292-8c98-125217d993e6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.182531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f5217f2a-6553-4292-8c98-125217d993e6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.441392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2eb375a3-d4d3-4198-be3c-c60d0bd7b734 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:05.446158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2eb375a3-d4d3-4198-be3c-c60d0bd7b734 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] [instance: 5fee4956-a06f-41b3-8b67-712e6252803e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:05.487511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:05.494288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eb375a3-d4d3-4198-be3c-c60d0bd7b734 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.494288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eb375a3-d4d3-4198-be3c-c60d0bd7b734 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.494698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eb375a3-d4d3-4198-be3c-c60d0bd7b734 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.495465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eb375a3-d4d3-4198-be3c-c60d0bd7b734 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.495940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eb375a3-d4d3-4198-be3c-c60d0bd7b734 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.496405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2eb375a3-d4d3-4198-be3c-c60d0bd7b734 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.543987 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-2eb375a3-d4d3-4198-be3c-c60d0bd7b734 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] HTTP exception thrown: Instance 5fee4956-a06f-41b3-8b67-712e6252803e could not be found. Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2eb375a3-d4d3-4198-be3c-c60d0bd7b734 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Request method failure captured: Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e HTTP/1.1 Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN9Yod7gaKrAF04VCazXZ0VkfufBZpZMnct5LJcngScFHHSuWlkMo0QQXiXNjF-PFT55LWtuCZyWWkyEZm7oHvctuu-JPj_SfjCQZ0b6JRINyQNaJtgJfwVBiDmv6b60O2C_m2OrDqRbiWO2X7-vTTSB4TW0C0Oh7LgJ1CnYXnzgUfc Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: ad3598383c5942fea06ea4d4127e3bae Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerAddressesTestJSON-553581893 Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ad3598383c5942fea06ea4d4127e3bae", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ad3598383c5942fea06ea4d4127e3bae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad3598383c5942fea06ea4d4127e3bae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ad3598383c5942fea06ea4d4127e3bae"}]}] Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerAddressesTestJSON-553581893 Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: ad3598383c5942fea06ea4d4127e3bae Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerAddressesTestJSON-553581893 Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerAddressesTestJSON-553581893-project Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 10666298a76745c7bada4de3653cdc91 Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerAddressesTestJSON-553581893-project Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 5fee4956-a06f-41b3-8b67-712e6252803e could not be found. Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '5fee4956-a06f-41b3-8b67-712e6252803e'} Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fee4956-a06f-41b3-8b67-712e6252803e could not be found. Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fee4956-a06f-41b3-8b67-712e6252803e could not be found. Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:05.547343 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:05.552682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:05.552682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:05.552682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:05.552682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:05.552682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:05.552682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fee4956-a06f-41b3-8b67-712e6252803e could not be found. Aug 29 15:47:05.552682 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:05.552682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2eb375a3-d4d3-4198-be3c-c60d0bd7b734 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] Returning 404 to user: Instance 5fee4956-a06f-41b3-8b67-712e6252803e could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:05.552682 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2eb375a3-d4d3-4198-be3c-c60d0bd7b734 tempest-ServerAddressesTestJSON-553581893 tempest-ServerAddressesTestJSON-553581893-project] 10.222.0.62 "GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e" status: 404 len: 111 microversion: 2.1 time: 0.135160 Aug 29 15:47:05.552682 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2431/5016] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:05 2022] GET /compute/v2.1/servers/5fee4956-a06f-41b3-8b67-712e6252803e => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:47:05.583005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f5217f2a-6553-4292-8c98-125217d993e6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:05.613727 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f5217f2a-6553-4292-8c98-125217d993e6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1365 microversion: 2.1 time: 0.490726 Aug 29 15:47:05.617704 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2586/5017] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:05 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1365 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:05.728307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2b10ae01-ab0d-429b-b7bd-63b9aa2c808a tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a540430>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:05.813751 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2b10ae01-ab0d-429b-b7bd-63b9aa2c808a tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.089536 Aug 29 15:47:05.818881 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2432/5018] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:05 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:05.896673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f996b243-748d-411f-b83c-7a679f12a913 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:05.897236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f996b243-748d-411f-b83c-7a679f12a913 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:05.909146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f996b243-748d-411f-b83c-7a679f12a913 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.911118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f996b243-748d-411f-b83c-7a679f12a913 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.911632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f996b243-748d-411f-b83c-7a679f12a913 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.916156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f996b243-748d-411f-b83c-7a679f12a913 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.916893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f996b243-748d-411f-b83c-7a679f12a913 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.918531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f996b243-748d-411f-b83c-7a679f12a913 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.090501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f996b243-748d-411f-b83c-7a679f12a913 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:06.106694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f996b243-748d-411f-b83c-7a679f12a913 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:06.116038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f996b243-748d-411f-b83c-7a679f12a913 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:06.124077 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f996b243-748d-411f-b83c-7a679f12a913 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1357 microversion: 2.47 time: 0.228294 Aug 29 15:47:06.124683 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2587/5019] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:05 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:06.155506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:06.158500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:06.186711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.187224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.187670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.188428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.188895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.189932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.357017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:47:06.364904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:47:06.365587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:47:06.366086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:47:06.366515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:47:06.503595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:06.516431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.516932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.517407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.520288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.520863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.521451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.591343 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-84f853f3-40ab-4d89-aa21-1f7f74440649 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "POST /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd/action" status: 202 len: 1079 microversion: 2.47 time: 0.440891 Aug 29 15:47:06.593199 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2433/5020] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 15:47:06 2022] POST /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd/action => generated 1079 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 15:47:06.612262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c0b3498a-6847-4bc4-a9a1-64c366b245cb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:06.612919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c0b3498a-6847-4bc4-a9a1-64c366b245cb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:06.639570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0b3498a-6847-4bc4-a9a1-64c366b245cb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.640235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d747dd2e-2a1b-49c9-bd4c-c4323e28130f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:06.640854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d747dd2e-2a1b-49c9-bd4c-c4323e28130f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:06.643032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0b3498a-6847-4bc4-a9a1-64c366b245cb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.643922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0b3498a-6847-4bc4-a9a1-64c366b245cb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.647079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0b3498a-6847-4bc4-a9a1-64c366b245cb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.647879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0b3498a-6847-4bc4-a9a1-64c366b245cb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.648537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d747dd2e-2a1b-49c9-bd4c-c4323e28130f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.649032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d747dd2e-2a1b-49c9-bd4c-c4323e28130f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.649518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0b3498a-6847-4bc4-a9a1-64c366b245cb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.649634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d747dd2e-2a1b-49c9-bd4c-c4323e28130f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.650298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d747dd2e-2a1b-49c9-bd4c-c4323e28130f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:06.650775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d747dd2e-2a1b-49c9-bd4c-c4323e28130f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:06.651209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d747dd2e-2a1b-49c9-bd4c-c4323e28130f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.942746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c0b3498a-6847-4bc4-a9a1-64c366b245cb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:06.959972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c0b3498a-6847-4bc4-a9a1-64c366b245cb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:06.965049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c0b3498a-6847-4bc4-a9a1-64c366b245cb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:06.966677 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c0b3498a-6847-4bc4-a9a1-64c366b245cb tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.358846 Aug 29 15:47:06.969784 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2588/5021] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:06 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:06.976996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-978b9d6f-6202-42b7-8db2-1a395b14b9ed tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a71fdc0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:07.099289 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-978b9d6f-6202-42b7-8db2-1a395b14b9ed tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.126704 Aug 29 15:47:07.107630 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2589/5022] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:06 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:07.241724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d747dd2e-2a1b-49c9-bd4c-c4323e28130f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:07.250261 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d747dd2e-2a1b-49c9-bd4c-c4323e28130f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1365 microversion: 2.1 time: 0.616859 Aug 29 15:47:07.255046 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2434/5023] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:06 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1365 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:07.943661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:07.948842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1144741045", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "48e6dc18-7b5d-41fd-8cc3-71b7c7ea3176"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:08.002246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1b781555-85f4-4cc6-800f-3ebf018e8f16 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:08.003695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1b781555-85f4-4cc6-800f-3ebf018e8f16 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:08.012724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b781555-85f4-4cc6-800f-3ebf018e8f16 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.020737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b781555-85f4-4cc6-800f-3ebf018e8f16 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.021679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b781555-85f4-4cc6-800f-3ebf018e8f16 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.022615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b781555-85f4-4cc6-800f-3ebf018e8f16 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.023226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b781555-85f4-4cc6-800f-3ebf018e8f16 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.023971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b781555-85f4-4cc6-800f-3ebf018e8f16 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.040087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] validate_networks() for [('48e6dc18-7b5d-41fd-8cc3-71b7c7ea3176', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:47:08.141207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1b781555-85f4-4cc6-800f-3ebf018e8f16 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:08.154381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1b781555-85f4-4cc6-800f-3ebf018e8f16 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:08.156181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1b781555-85f4-4cc6-800f-3ebf018e8f16 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:08.158028 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1b781555-85f4-4cc6-800f-3ebf018e8f16 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.160134 Aug 29 15:47:08.159283 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2435/5024] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:07 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:08.164582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a3a7476a-0688-45ae-8890-eedbf834a39e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a540310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:08.219891 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a3a7476a-0688-45ae-8890-eedbf834a39e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.059226 Aug 29 15:47:08.220495 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2436/5025] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:08 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:08.276513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-605cd57d-f7e0-4b59-a531-afd69f450fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:08.277194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-605cd57d-f7e0-4b59-a531-afd69f450fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:08.285891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605cd57d-f7e0-4b59-a531-afd69f450fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.286657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605cd57d-f7e0-4b59-a531-afd69f450fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.288565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605cd57d-f7e0-4b59-a531-afd69f450fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.289678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605cd57d-f7e0-4b59-a531-afd69f450fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.290582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605cd57d-f7e0-4b59-a531-afd69f450fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.291353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605cd57d-f7e0-4b59-a531-afd69f450fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.630235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-605cd57d-f7e0-4b59-a531-afd69f450fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:08.645406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:08.652458 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-605cd57d-f7e0-4b59-a531-afd69f450fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1365 microversion: 2.1 time: 0.380382 Aug 29 15:47:08.653186 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2437/5026] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:08 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1365 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:09.184768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2404d3a0-e419-466b-a362-7971ae4e3965 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:09.186643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2404d3a0-e419-466b-a362-7971ae4e3965 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:09.217760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2404d3a0-e419-466b-a362-7971ae4e3965 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.218682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2404d3a0-e419-466b-a362-7971ae4e3965 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.220098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2404d3a0-e419-466b-a362-7971ae4e3965 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.225516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2404d3a0-e419-466b-a362-7971ae4e3965 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.226261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2404d3a0-e419-466b-a362-7971ae4e3965 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.226927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2404d3a0-e419-466b-a362-7971ae4e3965 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.290837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:47:09.291460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:47:09.291885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:47:09.292299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:47:09.292714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:47:09.312477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.320250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.321170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.322384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.323068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.323744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.364267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Getting quotas for project 9f9a115c069d424caee396c6dfd3fa50. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:47:09.374679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Getting quotas for user 53af5a51f87647d0ae78531c72554ca6 and project 9f9a115c069d424caee396c6dfd3fa50. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:47:09.409074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:47:09.414364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:47:09.556725 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-388dba0c-dba0-475e-bcbd-7a367ccc9e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.610713 Aug 29 15:47:09.564902 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2590/5027] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:47:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:47:09.577137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2404d3a0-e419-466b-a362-7971ae4e3965 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:09.593894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2404d3a0-e419-466b-a362-7971ae4e3965 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:09.599464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2404d3a0-e419-466b-a362-7971ae4e3965 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:09.600932 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2404d3a0-e419-466b-a362-7971ae4e3965 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.420685 Aug 29 15:47:09.601498 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2438/5028] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:09 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:09.604513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-563c2257-a27e-4eda-9c51-9d22927cbef6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a7a7f70>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:09.616998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ac54f320-0749-4044-bc96-548e87cc86f1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:09.621895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ac54f320-0749-4044-bc96-548e87cc86f1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:09.745688 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-563c2257-a27e-4eda-9c51-9d22927cbef6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.177263 Aug 29 15:47:09.745841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ac54f320-0749-4044-bc96-548e87cc86f1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:09.746392 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2591/5029] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:09 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:09.753286 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ac54f320-0749-4044-bc96-548e87cc86f1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1219 microversion: 2.1 time: 0.148861 Aug 29 15:47:09.756647 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2439/5030] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:09 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:09.783330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-deaaa4db-4eaf-424c-b7a1-cf533804373e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:09.784035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-deaaa4db-4eaf-424c-b7a1-cf533804373e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:09.791571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-deaaa4db-4eaf-424c-b7a1-cf533804373e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.792392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-deaaa4db-4eaf-424c-b7a1-cf533804373e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.792860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-deaaa4db-4eaf-424c-b7a1-cf533804373e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.793888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-deaaa4db-4eaf-424c-b7a1-cf533804373e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.794353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-deaaa4db-4eaf-424c-b7a1-cf533804373e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.794793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-deaaa4db-4eaf-424c-b7a1-cf533804373e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:10.101922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-deaaa4db-4eaf-424c-b7a1-cf533804373e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:10.114009 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-deaaa4db-4eaf-424c-b7a1-cf533804373e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1365 microversion: 2.1 time: 0.358927 Aug 29 15:47:10.114854 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2592/5031] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:09 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1365 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:10.628824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5514ec58-f766-45ff-b7df-ca07e46ff893 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:10.630197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5514ec58-f766-45ff-b7df-ca07e46ff893 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:10.651929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5514ec58-f766-45ff-b7df-ca07e46ff893 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:10.653599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5514ec58-f766-45ff-b7df-ca07e46ff893 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:10.656961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5514ec58-f766-45ff-b7df-ca07e46ff893 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:10.658060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5514ec58-f766-45ff-b7df-ca07e46ff893 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:10.659724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5514ec58-f766-45ff-b7df-ca07e46ff893 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:10.660355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5514ec58-f766-45ff-b7df-ca07e46ff893 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:10.762035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-648e4df6-0658-4e23-9e65-13193231663e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42aa70670>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:10.856774 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-648e4df6-0658-4e23-9e65-13193231663e tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.099429 Aug 29 15:47:10.866193 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2593/5032] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:10 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:10.880082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c38c1a02-958e-4238-8cc7-72cc396acab1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:10.881170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c38c1a02-958e-4238-8cc7-72cc396acab1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:10.921381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5514ec58-f766-45ff-b7df-ca07e46ff893 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:10.933630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c38c1a02-958e-4238-8cc7-72cc396acab1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:10.945068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c38c1a02-958e-4238-8cc7-72cc396acab1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:10.947984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c38c1a02-958e-4238-8cc7-72cc396acab1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:10.949338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c38c1a02-958e-4238-8cc7-72cc396acab1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:10.954980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c38c1a02-958e-4238-8cc7-72cc396acab1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:10.956159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c38c1a02-958e-4238-8cc7-72cc396acab1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:10.981691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5514ec58-f766-45ff-b7df-ca07e46ff893 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:10.987862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5514ec58-f766-45ff-b7df-ca07e46ff893 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:10.993800 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5514ec58-f766-45ff-b7df-ca07e46ff893 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.367142 Aug 29 15:47:11.007586 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2440/5033] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:10 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:11.140660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cc5e9b63-c5ed-4118-b609-0e63687fad19 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:11.141542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cc5e9b63-c5ed-4118-b609-0e63687fad19 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:11.152813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc5e9b63-c5ed-4118-b609-0e63687fad19 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:11.153379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc5e9b63-c5ed-4118-b609-0e63687fad19 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:11.153897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc5e9b63-c5ed-4118-b609-0e63687fad19 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:11.154685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc5e9b63-c5ed-4118-b609-0e63687fad19 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:11.164512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc5e9b63-c5ed-4118-b609-0e63687fad19 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:11.166160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc5e9b63-c5ed-4118-b609-0e63687fad19 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:11.187890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c38c1a02-958e-4238-8cc7-72cc396acab1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:11.203837 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c38c1a02-958e-4238-8cc7-72cc396acab1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1271 microversion: 2.1 time: 0.336125 Aug 29 15:47:11.206164 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2594/5034] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:10 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1271 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:11.597482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-427ef6a7-575b-481c-97c0-49c0a3a3997d req-21c7838c-034c-46b4-b6ff-0acb60049aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698e4c74-b063-4ffc-bbd9-9154af832815", "name": "network-vif-plugged", "status": "completed", "tag": "5917d456-8dc9-4d37-9614-af0759e075a5"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:11.629731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:11.642546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-427ef6a7-575b-481c-97c0-49c0a3a3997d req-21c7838c-034c-46b4-b6ff-0acb60049aaf service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:11.643078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-427ef6a7-575b-481c-97c0-49c0a3a3997d req-21c7838c-034c-46b4-b6ff-0acb60049aaf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:11.643556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-427ef6a7-575b-481c-97c0-49c0a3a3997d req-21c7838c-034c-46b4-b6ff-0acb60049aaf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:11.679196 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-427ef6a7-575b-481c-97c0-49c0a3a3997d req-21c7838c-034c-46b4-b6ff-0acb60049aaf service nova] Creating event network-vif-plugged:5917d456-8dc9-4d37-9614-af0759e075a5 for instance 698e4c74-b063-4ffc-bbd9-9154af832815 on n-h2-839401-11 Aug 29 15:47:11.695753 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-427ef6a7-575b-481c-97c0-49c0a3a3997d req-21c7838c-034c-46b4-b6ff-0acb60049aaf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109388 Aug 29 15:47:11.697497 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2595/5035] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:11.872874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-733b83e7-c222-4f1a-b6a3-fcfbce22a20a tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a7631f0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:12.009238 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-733b83e7-c222-4f1a-b6a3-fcfbce22a20a tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.111100 Aug 29 15:47:12.011568 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2596/5036] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:11 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:12.025565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c8a1cd04-ea67-4534-bca5-bbedb8a6a626 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:12.026378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c8a1cd04-ea67-4534-bca5-bbedb8a6a626 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:12.049708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8a1cd04-ea67-4534-bca5-bbedb8a6a626 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:12.050505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8a1cd04-ea67-4534-bca5-bbedb8a6a626 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:12.051316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8a1cd04-ea67-4534-bca5-bbedb8a6a626 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:12.052228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8a1cd04-ea67-4534-bca5-bbedb8a6a626 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:12.053052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8a1cd04-ea67-4534-bca5-bbedb8a6a626 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:12.053691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8a1cd04-ea67-4534-bca5-bbedb8a6a626 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:12.209406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c8a1cd04-ea67-4534-bca5-bbedb8a6a626 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:12.226499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c8a1cd04-ea67-4534-bca5-bbedb8a6a626 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:12.233357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c8a1cd04-ea67-4534-bca5-bbedb8a6a626 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:12.239806 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c8a1cd04-ea67-4534-bca5-bbedb8a6a626 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.220409 Aug 29 15:47:12.241683 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2597/5037] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:12 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:12.252248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-96f08ac5-6dd0-4126-a799-82275087d4a7 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:12.256572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-96f08ac5-6dd0-4126-a799-82275087d4a7 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:12.273488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96f08ac5-6dd0-4126-a799-82275087d4a7 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:12.274266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96f08ac5-6dd0-4126-a799-82275087d4a7 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:12.276147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96f08ac5-6dd0-4126-a799-82275087d4a7 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:12.280657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96f08ac5-6dd0-4126-a799-82275087d4a7 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:12.281530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96f08ac5-6dd0-4126-a799-82275087d4a7 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:12.282608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96f08ac5-6dd0-4126-a799-82275087d4a7 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:12.396447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-96f08ac5-6dd0-4126-a799-82275087d4a7 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:12.400448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:12.406805 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-96f08ac5-6dd0-4126-a799-82275087d4a7 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1277 microversion: 2.1 time: 0.163756 Aug 29 15:47:12.408132 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2598/5038] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:12 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:12.426157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cc5e9b63-c5ed-4118-b609-0e63687fad19 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:12.439636 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cc5e9b63-c5ed-4118-b609-0e63687fad19 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1365 microversion: 2.1 time: 1.307122 Aug 29 15:47:12.454672 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2441/5039] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:11 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1365 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:13.026290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f9d9ff5e-5b31-4def-80f2-02ffc5088fbe tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42aa89d30>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:13.085946 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f9d9ff5e-5b31-4def-80f2-02ffc5088fbe tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.064109 Aug 29 15:47:13.086845 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2599/5040] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:13 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:13.265710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b514f7f-9360-4537-96c5-be29f64aeeba tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:13.266666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4b514f7f-9360-4537-96c5-be29f64aeeba tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:13.290379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b514f7f-9360-4537-96c5-be29f64aeeba tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:13.295331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b514f7f-9360-4537-96c5-be29f64aeeba tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:13.295806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b514f7f-9360-4537-96c5-be29f64aeeba tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:13.296579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b514f7f-9360-4537-96c5-be29f64aeeba tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:13.297052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b514f7f-9360-4537-96c5-be29f64aeeba tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:13.297902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b514f7f-9360-4537-96c5-be29f64aeeba tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:13.428075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9328fc42-648d-4932-ba1d-2db878754e55 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:13.428714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9328fc42-648d-4932-ba1d-2db878754e55 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:13.448224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9328fc42-648d-4932-ba1d-2db878754e55 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:13.448745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9328fc42-648d-4932-ba1d-2db878754e55 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:13.449242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9328fc42-648d-4932-ba1d-2db878754e55 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:13.449966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9328fc42-648d-4932-ba1d-2db878754e55 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:13.457116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9328fc42-648d-4932-ba1d-2db878754e55 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:13.457872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9328fc42-648d-4932-ba1d-2db878754e55 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:13.531623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4b514f7f-9360-4537-96c5-be29f64aeeba tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:13.546374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4b514f7f-9360-4537-96c5-be29f64aeeba tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:13.553699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4b514f7f-9360-4537-96c5-be29f64aeeba tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:13.561126 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4b514f7f-9360-4537-96c5-be29f64aeeba tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.298798 Aug 29 15:47:13.564502 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2442/5041] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:13 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:13.574081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0698de83-53a5-41fa-a46e-7e73cfa2abfe tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:13.579361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0698de83-53a5-41fa-a46e-7e73cfa2abfe tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:13.593699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0698de83-53a5-41fa-a46e-7e73cfa2abfe tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:13.595772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0698de83-53a5-41fa-a46e-7e73cfa2abfe tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:13.597565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0698de83-53a5-41fa-a46e-7e73cfa2abfe tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:13.599265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0698de83-53a5-41fa-a46e-7e73cfa2abfe tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:13.601078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0698de83-53a5-41fa-a46e-7e73cfa2abfe tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:13.601994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0698de83-53a5-41fa-a46e-7e73cfa2abfe tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:13.884630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9328fc42-648d-4932-ba1d-2db878754e55 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:13.899780 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9328fc42-648d-4932-ba1d-2db878754e55 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1319 microversion: 2.1 time: 0.475301 Aug 29 15:47:13.900386 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2600/5042] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:13 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1319 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:14.075404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0698de83-53a5-41fa-a46e-7e73cfa2abfe tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:14.095417 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0698de83-53a5-41fa-a46e-7e73cfa2abfe tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1365 microversion: 2.1 time: 0.528260 Aug 29 15:47:14.119877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-66b1a5b3-b49b-4fef-a600-6adcf12215fe tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a739a60>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:14.126429 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2443/5043] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:13 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1365 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:14.212937 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-66b1a5b3-b49b-4fef-a600-6adcf12215fe tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.098447 Aug 29 15:47:14.213617 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2601/5044] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:14 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:14.586647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3268d1a8-8967-4ac4-ae91-a82625e95464 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:14.587921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3268d1a8-8967-4ac4-ae91-a82625e95464 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:14.603054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3268d1a8-8967-4ac4-ae91-a82625e95464 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:14.605365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3268d1a8-8967-4ac4-ae91-a82625e95464 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:14.613015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3268d1a8-8967-4ac4-ae91-a82625e95464 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:14.619744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3268d1a8-8967-4ac4-ae91-a82625e95464 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:14.620556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3268d1a8-8967-4ac4-ae91-a82625e95464 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:14.623184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3268d1a8-8967-4ac4-ae91-a82625e95464 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:14.923219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a6acc34d-b9eb-43b8-a802-6ac9cbb66db8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:14.924327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a6acc34d-b9eb-43b8-a802-6ac9cbb66db8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:14.938853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6acc34d-b9eb-43b8-a802-6ac9cbb66db8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:14.939917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6acc34d-b9eb-43b8-a802-6ac9cbb66db8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:14.941615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6acc34d-b9eb-43b8-a802-6ac9cbb66db8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:14.945720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6acc34d-b9eb-43b8-a802-6ac9cbb66db8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:14.946899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6acc34d-b9eb-43b8-a802-6ac9cbb66db8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:14.947590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6acc34d-b9eb-43b8-a802-6ac9cbb66db8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:14.974889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3268d1a8-8967-4ac4-ae91-a82625e95464 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:14.993772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3268d1a8-8967-4ac4-ae91-a82625e95464 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:14.996647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3268d1a8-8967-4ac4-ae91-a82625e95464 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:14.998615 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3268d1a8-8967-4ac4-ae91-a82625e95464 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.416796 Aug 29 15:47:15.013989 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2444/5045] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:14 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:15.118332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7780d9f2-abd1-411c-a17c-7b5038293c30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:15.118957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7780d9f2-abd1-411c-a17c-7b5038293c30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:15.161997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7780d9f2-abd1-411c-a17c-7b5038293c30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:15.162530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7780d9f2-abd1-411c-a17c-7b5038293c30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:15.163191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7780d9f2-abd1-411c-a17c-7b5038293c30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:15.164274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7780d9f2-abd1-411c-a17c-7b5038293c30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:15.164900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7780d9f2-abd1-411c-a17c-7b5038293c30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:15.165511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7780d9f2-abd1-411c-a17c-7b5038293c30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:15.548542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7780d9f2-abd1-411c-a17c-7b5038293c30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:15.561914 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7780d9f2-abd1-411c-a17c-7b5038293c30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1365 microversion: 2.1 time: 0.447680 Aug 29 15:47:15.564300 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2445/5046] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:15 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1365 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:15.580180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f79fb7ed-9a83-48be-8b57-a10a718a7c44 req-78489c7b-98ac-4472-8ae4-958715aeff50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646846a6-56c9-4370-8435-da5ae0466afb", "name": "network-vif-plugged", "status": "completed", "tag": "98c9ec0b-ac20-402a-9542-f7e5af3d086c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:15.619965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a6acc34d-b9eb-43b8-a802-6ac9cbb66db8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:15.620761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f79fb7ed-9a83-48be-8b57-a10a718a7c44 req-78489c7b-98ac-4472-8ae4-958715aeff50 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:15.621390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f79fb7ed-9a83-48be-8b57-a10a718a7c44 req-78489c7b-98ac-4472-8ae4-958715aeff50 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:15.621853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f79fb7ed-9a83-48be-8b57-a10a718a7c44 req-78489c7b-98ac-4472-8ae4-958715aeff50 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:15.633586 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a6acc34d-b9eb-43b8-a802-6ac9cbb66db8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1319 microversion: 2.1 time: 0.713225 Aug 29 15:47:15.649304 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2602/5047] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:14 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1319 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:15.653710 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f79fb7ed-9a83-48be-8b57-a10a718a7c44 req-78489c7b-98ac-4472-8ae4-958715aeff50 service nova] Creating event network-vif-plugged:98c9ec0b-ac20-402a-9542-f7e5af3d086c for instance 646846a6-56c9-4370-8435-da5ae0466afb on n-h1-839401-11 Aug 29 15:47:15.659061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e9aebf39-23ed-48f1-ab5d-ef165674b00c tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42aa84790>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:15.664580 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f79fb7ed-9a83-48be-8b57-a10a718a7c44 req-78489c7b-98ac-4472-8ae4-958715aeff50 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098753 Aug 29 15:47:15.671739 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2446/5048] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:15.855539 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e9aebf39-23ed-48f1-ab5d-ef165674b00c tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.216130 Aug 29 15:47:15.856471 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2603/5049] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:15 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:16.028155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bd1e2152-a85b-4277-9488-c13fa4c4646e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:16.029458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bd1e2152-a85b-4277-9488-c13fa4c4646e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:16.060061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd1e2152-a85b-4277-9488-c13fa4c4646e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:16.061675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd1e2152-a85b-4277-9488-c13fa4c4646e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:16.062140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd1e2152-a85b-4277-9488-c13fa4c4646e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:16.062899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd1e2152-a85b-4277-9488-c13fa4c4646e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:16.064483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd1e2152-a85b-4277-9488-c13fa4c4646e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:16.068493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd1e2152-a85b-4277-9488-c13fa4c4646e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:16.467562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-82a01f15-bf32-44ea-8752-21c42544adf3 req-1a018fd5-cb12-4156-afcc-c9b2eeb5db47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44", "tag": "87e08bf9-d9b6-4981-9e30-6dc0b19954d5"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:16.501555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-82a01f15-bf32-44ea-8752-21c42544adf3 req-1a018fd5-cb12-4156-afcc-c9b2eeb5db47 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:16.502423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-82a01f15-bf32-44ea-8752-21c42544adf3 req-1a018fd5-cb12-4156-afcc-c9b2eeb5db47 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:16.503116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-82a01f15-bf32-44ea-8752-21c42544adf3 req-1a018fd5-cb12-4156-afcc-c9b2eeb5db47 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:16.538602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bd1e2152-a85b-4277-9488-c13fa4c4646e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:16.542718 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-82a01f15-bf32-44ea-8752-21c42544adf3 req-1a018fd5-cb12-4156-afcc-c9b2eeb5db47 service nova] Creating event network-changed:87e08bf9-d9b6-4981-9e30-6dc0b19954d5 for instance 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 on n-h1-839401-11 Aug 29 15:47:16.552983 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-82a01f15-bf32-44ea-8752-21c42544adf3 req-1a018fd5-cb12-4156-afcc-c9b2eeb5db47 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089546 Aug 29 15:47:16.555693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bd1e2152-a85b-4277-9488-c13fa4c4646e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:16.558661 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2604/5050] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:16.560541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bd1e2152-a85b-4277-9488-c13fa4c4646e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:16.565395 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bd1e2152-a85b-4277-9488-c13fa4c4646e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.541525 Aug 29 15:47:16.580852 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2447/5051] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:16 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:16.591463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5d1e7090-5913-44d9-a0e1-43ad271af463 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:16.592828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5d1e7090-5913-44d9-a0e1-43ad271af463 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:16.607249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d1e7090-5913-44d9-a0e1-43ad271af463 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:16.609181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d1e7090-5913-44d9-a0e1-43ad271af463 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:16.612046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d1e7090-5913-44d9-a0e1-43ad271af463 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:16.613633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d1e7090-5913-44d9-a0e1-43ad271af463 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:16.614505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d1e7090-5913-44d9-a0e1-43ad271af463 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:16.615163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d1e7090-5913-44d9-a0e1-43ad271af463 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:16.660330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8aa7cad5-a722-4f32-922e-314325cffc2f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:16.661122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8aa7cad5-a722-4f32-922e-314325cffc2f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:16.674614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8aa7cad5-a722-4f32-922e-314325cffc2f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:16.679129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8aa7cad5-a722-4f32-922e-314325cffc2f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:16.679777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8aa7cad5-a722-4f32-922e-314325cffc2f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:16.682319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8aa7cad5-a722-4f32-922e-314325cffc2f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:16.682925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8aa7cad5-a722-4f32-922e-314325cffc2f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:16.683975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8aa7cad5-a722-4f32-922e-314325cffc2f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:17.442500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8aa7cad5-a722-4f32-922e-314325cffc2f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:17.458541 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8aa7cad5-a722-4f32-922e-314325cffc2f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1319 microversion: 2.1 time: 0.802340 Aug 29 15:47:17.477776 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2448/5052] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:16 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1319 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:17.494363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d88100be-dd71-4189-bf23-b4f7c914cbd8 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a50e280>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:17.611884 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d88100be-dd71-4189-bf23-b4f7c914cbd8 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.132077 Aug 29 15:47:17.626038 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2449/5053] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:17 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:17.636875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eb79a450-332e-457a-a389-393caaf454f3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:17.637530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eb79a450-332e-457a-a389-393caaf454f3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:17.656667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb79a450-332e-457a-a389-393caaf454f3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:17.666931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb79a450-332e-457a-a389-393caaf454f3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:17.668140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb79a450-332e-457a-a389-393caaf454f3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:17.669789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb79a450-332e-457a-a389-393caaf454f3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:17.670457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb79a450-332e-457a-a389-393caaf454f3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:17.672463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb79a450-332e-457a-a389-393caaf454f3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:17.846768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5d1e7090-5913-44d9-a0e1-43ad271af463 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:17.866607 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5d1e7090-5913-44d9-a0e1-43ad271af463 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1365 microversion: 2.1 time: 1.274667 Aug 29 15:47:17.873141 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2605/5054] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:16 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1365 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:17.921154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eb79a450-332e-457a-a389-393caaf454f3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:17.942570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eb79a450-332e-457a-a389-393caaf454f3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:17.946270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eb79a450-332e-457a-a389-393caaf454f3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:17.953262 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eb79a450-332e-457a-a389-393caaf454f3 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.325905 Aug 29 15:47:17.959022 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2450/5055] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:17 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:18.483862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24004850-5f71-4a89-ad39-1b8f6f1586ec tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:18.484730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-24004850-5f71-4a89-ad39-1b8f6f1586ec tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:18.500333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24004850-5f71-4a89-ad39-1b8f6f1586ec tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:18.501209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24004850-5f71-4a89-ad39-1b8f6f1586ec tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:18.503237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24004850-5f71-4a89-ad39-1b8f6f1586ec tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:18.504382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24004850-5f71-4a89-ad39-1b8f6f1586ec tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:18.507279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24004850-5f71-4a89-ad39-1b8f6f1586ec tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:18.508082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24004850-5f71-4a89-ad39-1b8f6f1586ec tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:18.627008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b0fd602-4457-40f1-99dc-6bfe6661f48b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b68a670>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:18.689801 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4b0fd602-4457-40f1-99dc-6bfe6661f48b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.066665 Aug 29 15:47:18.691114 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2451/5056] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:18 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:18.841758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-24004850-5f71-4a89-ad39-1b8f6f1586ec tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:18.878266 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-24004850-5f71-4a89-ad39-1b8f6f1586ec tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1319 microversion: 2.1 time: 0.399559 Aug 29 15:47:18.899211 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2606/5057] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:18 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:18.899574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ef386d01-d562-4a9d-8e7a-f221e867d4e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:18.899574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ef386d01-d562-4a9d-8e7a-f221e867d4e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:18.912831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef386d01-d562-4a9d-8e7a-f221e867d4e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:18.922038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef386d01-d562-4a9d-8e7a-f221e867d4e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:18.922840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef386d01-d562-4a9d-8e7a-f221e867d4e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:18.924133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef386d01-d562-4a9d-8e7a-f221e867d4e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:18.925006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef386d01-d562-4a9d-8e7a-f221e867d4e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:18.925819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef386d01-d562-4a9d-8e7a-f221e867d4e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:18.987421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-202a303f-498f-47ba-8297-44f8b8e38af4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:18.988471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-202a303f-498f-47ba-8297-44f8b8e38af4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:19.015221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-202a303f-498f-47ba-8297-44f8b8e38af4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:19.015723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-202a303f-498f-47ba-8297-44f8b8e38af4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:19.016167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-202a303f-498f-47ba-8297-44f8b8e38af4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:19.016899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-202a303f-498f-47ba-8297-44f8b8e38af4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:19.033747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-202a303f-498f-47ba-8297-44f8b8e38af4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:19.034626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-202a303f-498f-47ba-8297-44f8b8e38af4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:19.194464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-202a303f-498f-47ba-8297-44f8b8e38af4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:19.208580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-202a303f-498f-47ba-8297-44f8b8e38af4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:19.212070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-202a303f-498f-47ba-8297-44f8b8e38af4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:19.213330 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-202a303f-498f-47ba-8297-44f8b8e38af4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.233065 Aug 29 15:47:19.214106 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2607/5058] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:18 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:19.289344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ef386d01-d562-4a9d-8e7a-f221e867d4e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:19.301227 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ef386d01-d562-4a9d-8e7a-f221e867d4e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1554 microversion: 2.1 time: 0.413843 Aug 29 15:47:19.304382 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2452/5059] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:18 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1554 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:19.324390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8c355a61-2a08-4e4d-aec0-7b2dce36b9a2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:19.324884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8c355a61-2a08-4e4d-aec0-7b2dce36b9a2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:19.341123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c355a61-2a08-4e4d-aec0-7b2dce36b9a2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:19.341123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c355a61-2a08-4e4d-aec0-7b2dce36b9a2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:19.341123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c355a61-2a08-4e4d-aec0-7b2dce36b9a2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:19.341123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c355a61-2a08-4e4d-aec0-7b2dce36b9a2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:19.341123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c355a61-2a08-4e4d-aec0-7b2dce36b9a2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:19.341123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c355a61-2a08-4e4d-aec0-7b2dce36b9a2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:19.392324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:19.423522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=30 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:19.543769 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8c355a61-2a08-4e4d-aec0-7b2dce36b9a2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.222677 Aug 29 15:47:19.545132 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2608/5060] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:47:19 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-interface => generated 284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:19.706581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-95c8b572-e62e-4ee2-8194-ae9f8feadf1d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a9cbe50>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:19.750113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:19.828628 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-95c8b572-e62e-4ee2-8194-ae9f8feadf1d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.126124 Aug 29 15:47:19.829293 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2453/5061] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:19 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:19.908231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cb456bf3-6d4d-4b5d-85a9-d4fd78b57d26 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:19.909594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cb456bf3-6d4d-4b5d-85a9-d4fd78b57d26 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:19.920683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb456bf3-6d4d-4b5d-85a9-d4fd78b57d26 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:19.925976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb456bf3-6d4d-4b5d-85a9-d4fd78b57d26 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:19.933857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb456bf3-6d4d-4b5d-85a9-d4fd78b57d26 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:19.934638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb456bf3-6d4d-4b5d-85a9-d4fd78b57d26 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:19.935142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb456bf3-6d4d-4b5d-85a9-d4fd78b57d26 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:19.935575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb456bf3-6d4d-4b5d-85a9-d4fd78b57d26 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:20.236374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-125050f7-d234-4c2c-8ba6-e4ebf1c5f56e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:20.237066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-125050f7-d234-4c2c-8ba6-e4ebf1c5f56e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:20.252120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125050f7-d234-4c2c-8ba6-e4ebf1c5f56e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:20.252639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125050f7-d234-4c2c-8ba6-e4ebf1c5f56e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:20.253103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125050f7-d234-4c2c-8ba6-e4ebf1c5f56e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:20.253844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125050f7-d234-4c2c-8ba6-e4ebf1c5f56e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:20.254309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125050f7-d234-4c2c-8ba6-e4ebf1c5f56e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:20.254741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-125050f7-d234-4c2c-8ba6-e4ebf1c5f56e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:20.574393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-125050f7-d234-4c2c-8ba6-e4ebf1c5f56e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:20.593115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-125050f7-d234-4c2c-8ba6-e4ebf1c5f56e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:20.599265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-125050f7-d234-4c2c-8ba6-e4ebf1c5f56e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:20.602910 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-125050f7-d234-4c2c-8ba6-e4ebf1c5f56e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.370634 Aug 29 15:47:20.603575 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2454/5062] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:20 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:20.853200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cc324fea-f352-4c6b-acb7-6455600d45ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b86cdc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:20.924237 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cc324fea-f352-4c6b-acb7-6455600d45ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.078654 Aug 29 15:47:20.925164 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2455/5063] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:20 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:20.956025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cb456bf3-6d4d-4b5d-85a9-d4fd78b57d26 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:20.971220 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cb456bf3-6d4d-4b5d-85a9-d4fd78b57d26 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1319 microversion: 2.1 time: 1.061902 Aug 29 15:47:20.982386 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2609/5064] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:19 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1319 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:21.501365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d84ee141-e3eb-48cc-87c9-51771ba1608f req-67d161cd-9ba3-419c-b190-e2353e7772a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "646846a6-56c9-4370-8435-da5ae0466afb", "tag": "98c9ec0b-ac20-402a-9542-f7e5af3d086c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:21.554712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d84ee141-e3eb-48cc-87c9-51771ba1608f req-67d161cd-9ba3-419c-b190-e2353e7772a0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:21.555926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d84ee141-e3eb-48cc-87c9-51771ba1608f req-67d161cd-9ba3-419c-b190-e2353e7772a0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:21.556736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d84ee141-e3eb-48cc-87c9-51771ba1608f req-67d161cd-9ba3-419c-b190-e2353e7772a0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:21.569749 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d84ee141-e3eb-48cc-87c9-51771ba1608f req-67d161cd-9ba3-419c-b190-e2353e7772a0 service nova] Creating event network-changed:98c9ec0b-ac20-402a-9542-f7e5af3d086c for instance 646846a6-56c9-4370-8435-da5ae0466afb on n-h1-839401-11 Aug 29 15:47:21.583368 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d84ee141-e3eb-48cc-87c9-51771ba1608f req-67d161cd-9ba3-419c-b190-e2353e7772a0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089833 Aug 29 15:47:21.584982 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2456/5065] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:21.632194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-738e1388-eee7-4474-ba67-2c0291816379 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:21.634131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-738e1388-eee7-4474-ba67-2c0291816379 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:21.658502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-738e1388-eee7-4474-ba67-2c0291816379 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:21.658957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-738e1388-eee7-4474-ba67-2c0291816379 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:21.660681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-738e1388-eee7-4474-ba67-2c0291816379 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:21.662692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-738e1388-eee7-4474-ba67-2c0291816379 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:21.664416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-738e1388-eee7-4474-ba67-2c0291816379 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:21.665634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-738e1388-eee7-4474-ba67-2c0291816379 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:21.810569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-738e1388-eee7-4474-ba67-2c0291816379 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:21.826402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-738e1388-eee7-4474-ba67-2c0291816379 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:21.838864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-738e1388-eee7-4474-ba67-2c0291816379 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:21.840137 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-738e1388-eee7-4474-ba67-2c0291816379 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.216451 Aug 29 15:47:21.861185 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2610/5066] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:21 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:21.947163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bc0f6dc1-3c8d-4a59-9e0a-1342b7a743a7 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42bdb9790>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:21.995902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e788d129-1cde-4f31-a517-82ebf05e0523 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:21.997173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e788d129-1cde-4f31-a517-82ebf05e0523 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:22.007673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e788d129-1cde-4f31-a517-82ebf05e0523 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:22.008412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e788d129-1cde-4f31-a517-82ebf05e0523 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:22.009022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e788d129-1cde-4f31-a517-82ebf05e0523 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:22.009923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e788d129-1cde-4f31-a517-82ebf05e0523 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:22.021856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e788d129-1cde-4f31-a517-82ebf05e0523 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:22.022655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e788d129-1cde-4f31-a517-82ebf05e0523 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:22.047623 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bc0f6dc1-3c8d-4a59-9e0a-1342b7a743a7 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.111500 Aug 29 15:47:22.058089 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2457/5067] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:21 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:22.505843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e788d129-1cde-4f31-a517-82ebf05e0523 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:22.522140 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e788d129-1cde-4f31-a517-82ebf05e0523 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1319 microversion: 2.1 time: 0.529896 Aug 29 15:47:22.523412 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2611/5068] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:21 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:22.868716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f4ed47b0-6861-4af5-a1f7-88ae322491d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:22.869881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f4ed47b0-6861-4af5-a1f7-88ae322491d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:22.885508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4ed47b0-6861-4af5-a1f7-88ae322491d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:22.886377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4ed47b0-6861-4af5-a1f7-88ae322491d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:22.890572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4ed47b0-6861-4af5-a1f7-88ae322491d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:22.893908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4ed47b0-6861-4af5-a1f7-88ae322491d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:22.894830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4ed47b0-6861-4af5-a1f7-88ae322491d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:22.897951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4ed47b0-6861-4af5-a1f7-88ae322491d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:23.063792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c8ec75eb-c004-4790-b927-400a35bfa2d3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a74d9d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:23.165518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f4ed47b0-6861-4af5-a1f7-88ae322491d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:23.170849 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c8ec75eb-c004-4790-b927-400a35bfa2d3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.111341 Aug 29 15:47:23.171928 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2612/5069] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:23 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:23.187486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f4ed47b0-6861-4af5-a1f7-88ae322491d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:23.189183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f4ed47b0-6861-4af5-a1f7-88ae322491d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:23.191719 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f4ed47b0-6861-4af5-a1f7-88ae322491d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.327698 Aug 29 15:47:23.194817 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2458/5070] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:22 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:23.544053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d3c7b737-590b-45e1-bb92-0013f9c3ce95 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:23.545558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d3c7b737-590b-45e1-bb92-0013f9c3ce95 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:23.563772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3c7b737-590b-45e1-bb92-0013f9c3ce95 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:23.564280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3c7b737-590b-45e1-bb92-0013f9c3ce95 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:23.564985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3c7b737-590b-45e1-bb92-0013f9c3ce95 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:23.565846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3c7b737-590b-45e1-bb92-0013f9c3ce95 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:23.566556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3c7b737-590b-45e1-bb92-0013f9c3ce95 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:23.567495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3c7b737-590b-45e1-bb92-0013f9c3ce95 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:23.944490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d3c7b737-590b-45e1-bb92-0013f9c3ce95 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:23.959190 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d3c7b737-590b-45e1-bb92-0013f9c3ce95 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1319 microversion: 2.1 time: 0.419032 Aug 29 15:47:23.969421 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2613/5071] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:23 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1319 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:24.190996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-05af89b7-0bb0-46d7-8e7d-26e7522cb423 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a780ee0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:24.319120 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-05af89b7-0bb0-46d7-8e7d-26e7522cb423 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.114397 Aug 29 15:47:24.320880 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2614/5072] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:24 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:24.326776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a5e73440-8f6f-4372-81c9-f2798bfc52c1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:24.327662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a5e73440-8f6f-4372-81c9-f2798bfc52c1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:24.354357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5e73440-8f6f-4372-81c9-f2798bfc52c1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:24.356247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5e73440-8f6f-4372-81c9-f2798bfc52c1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:24.357557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5e73440-8f6f-4372-81c9-f2798bfc52c1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:24.358657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5e73440-8f6f-4372-81c9-f2798bfc52c1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:24.359294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5e73440-8f6f-4372-81c9-f2798bfc52c1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:24.359889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5e73440-8f6f-4372-81c9-f2798bfc52c1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:24.425069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-521604244", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "b54a598f-8870-4986-a213-02d6857c1270"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:24.497188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a5e73440-8f6f-4372-81c9-f2798bfc52c1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:24.508177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a5e73440-8f6f-4372-81c9-f2798bfc52c1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:24.510840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a5e73440-8f6f-4372-81c9-f2798bfc52c1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:24.512822 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a5e73440-8f6f-4372-81c9-f2798bfc52c1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.190584 Aug 29 15:47:24.513937 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2615/5073] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:24 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:24.553304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] validate_networks() for [('b54a598f-8870-4986-a213-02d6857c1270', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:47:24.981004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b51723c3-0a57-4073-9ecf-cc30eeee9d58 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:24.981664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b51723c3-0a57-4073-9ecf-cc30eeee9d58 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:24.989282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b51723c3-0a57-4073-9ecf-cc30eeee9d58 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:24.994049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b51723c3-0a57-4073-9ecf-cc30eeee9d58 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:24.997632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b51723c3-0a57-4073-9ecf-cc30eeee9d58 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:24.998716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b51723c3-0a57-4073-9ecf-cc30eeee9d58 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:25.002090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b51723c3-0a57-4073-9ecf-cc30eeee9d58 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:25.002894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b51723c3-0a57-4073-9ecf-cc30eeee9d58 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:25.399071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b51723c3-0a57-4073-9ecf-cc30eeee9d58 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:25.415594 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b51723c3-0a57-4073-9ecf-cc30eeee9d58 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1319 microversion: 2.1 time: 0.436463 Aug 29 15:47:25.416218 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2616/5074] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:24 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:25.434109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-232d3843-b8f3-4c23-9492-17f2978313f2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a7ada60>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:25.513829 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-232d3843-b8f3-4c23-9492-17f2978313f2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.090234 Aug 29 15:47:25.515356 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2617/5075] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:25 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:25.539146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-348c2574-6467-4e8b-98bb-d95fec7393a1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:25.540488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-348c2574-6467-4e8b-98bb-d95fec7393a1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:25.548810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:47:25.550095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:47:25.550761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:47:25.551338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:47:25.552126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:47:25.571421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-348c2574-6467-4e8b-98bb-d95fec7393a1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:25.571846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-348c2574-6467-4e8b-98bb-d95fec7393a1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:25.574703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-348c2574-6467-4e8b-98bb-d95fec7393a1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:25.575672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-348c2574-6467-4e8b-98bb-d95fec7393a1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:25.577330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:25.578001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-348c2574-6467-4e8b-98bb-d95fec7393a1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:25.580769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:25.581034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-348c2574-6467-4e8b-98bb-d95fec7393a1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:25.583314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:25.584495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:25.586886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:25.588435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:25.638157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Getting quotas for project 5e77ba7832194690a192c182a2a30c2c. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:47:25.655647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Getting quotas for user 18a288ca90d04ea18382c282ffe0e083 and project 5e77ba7832194690a192c182a2a30c2c. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:47:25.704032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:47:25.710893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:47:25.742998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-348c2574-6467-4e8b-98bb-d95fec7393a1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:25.755424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-348c2574-6467-4e8b-98bb-d95fec7393a1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:25.765969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-348c2574-6467-4e8b-98bb-d95fec7393a1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:25.772546 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-348c2574-6467-4e8b-98bb-d95fec7393a1 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.237508 Aug 29 15:47:25.773536 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2618/5076] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:25 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:25.871992 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2bff8b93-e36d-4f63-8c2a-780550d366fb tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.856585 Aug 29 15:47:25.880721 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2459/5077] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:47:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:47:25.891303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85633b81-02a8-4218-a168-68edbba89e27 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:25.892010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-85633b81-02a8-4218-a168-68edbba89e27 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:26.286679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-85633b81-02a8-4218-a168-68edbba89e27 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:26.297608 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85633b81-02a8-4218-a168-68edbba89e27 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1227 microversion: 2.1 time: 0.410286 Aug 29 15:47:26.299432 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2619/5078] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:25 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1227 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:26.442233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a980a76c-ca31-473c-8644-5beb4fb7e89a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:26.443255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a980a76c-ca31-473c-8644-5beb4fb7e89a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:26.473322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a980a76c-ca31-473c-8644-5beb4fb7e89a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:26.477415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a980a76c-ca31-473c-8644-5beb4fb7e89a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:26.478109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a980a76c-ca31-473c-8644-5beb4fb7e89a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:26.479677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a980a76c-ca31-473c-8644-5beb4fb7e89a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:26.480846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a980a76c-ca31-473c-8644-5beb4fb7e89a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:26.482305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a980a76c-ca31-473c-8644-5beb4fb7e89a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:26.532641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a4881332-aee6-43de-8ffa-43c7a37aae29 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc433c45b80>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:26.668254 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a4881332-aee6-43de-8ffa-43c7a37aae29 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.142152 Aug 29 15:47:26.675141 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2620/5079] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:26 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:26.797309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b1afad0b-095f-444a-950e-4796f7bb34ee tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:26.798239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b1afad0b-095f-444a-950e-4796f7bb34ee tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:26.813212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1afad0b-095f-444a-950e-4796f7bb34ee tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:26.814908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1afad0b-095f-444a-950e-4796f7bb34ee tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:26.816927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1afad0b-095f-444a-950e-4796f7bb34ee tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:26.819906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1afad0b-095f-444a-950e-4796f7bb34ee tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:26.822379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1afad0b-095f-444a-950e-4796f7bb34ee tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:26.823070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1afad0b-095f-444a-950e-4796f7bb34ee tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:26.987739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a980a76c-ca31-473c-8644-5beb4fb7e89a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:27.002026 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a980a76c-ca31-473c-8644-5beb4fb7e89a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1319 microversion: 2.1 time: 0.569108 Aug 29 15:47:27.025161 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2460/5080] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:26 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1319 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:27.038725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-5e2c0708-8aa8-4e02-895b-7ab15dd33b15 req-b2715387-f64f-4911-af59-c29636f6c383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44", "name": "network-vif-plugged", "status": "completed", "tag": "87e08bf9-d9b6-4981-9e30-6dc0b19954d5"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:27.064464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5e2c0708-8aa8-4e02-895b-7ab15dd33b15 req-b2715387-f64f-4911-af59-c29636f6c383 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:27.065047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5e2c0708-8aa8-4e02-895b-7ab15dd33b15 req-b2715387-f64f-4911-af59-c29636f6c383 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:27.079540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5e2c0708-8aa8-4e02-895b-7ab15dd33b15 req-b2715387-f64f-4911-af59-c29636f6c383 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:27.107054 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5e2c0708-8aa8-4e02-895b-7ab15dd33b15 req-b2715387-f64f-4911-af59-c29636f6c383 service nova] Creating event network-vif-plugged:87e08bf9-d9b6-4981-9e30-6dc0b19954d5 for instance 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 on n-h1-839401-11 Aug 29 15:47:27.121662 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-5e2c0708-8aa8-4e02-895b-7ab15dd33b15 req-b2715387-f64f-4911-af59-c29636f6c383 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095004 Aug 29 15:47:27.126047 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2461/5081] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:27.331627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6aa3be40-b0ab-4c96-9e9b-e5704754479e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:27.332993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6aa3be40-b0ab-4c96-9e9b-e5704754479e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:27.356554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa3be40-b0ab-4c96-9e9b-e5704754479e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:27.357112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa3be40-b0ab-4c96-9e9b-e5704754479e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:27.357572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa3be40-b0ab-4c96-9e9b-e5704754479e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:27.358319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa3be40-b0ab-4c96-9e9b-e5704754479e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:27.358775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa3be40-b0ab-4c96-9e9b-e5704754479e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:27.362084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa3be40-b0ab-4c96-9e9b-e5704754479e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:27.668404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b1afad0b-095f-444a-950e-4796f7bb34ee tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:27.684343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b1afad0b-095f-444a-950e-4796f7bb34ee tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:27.686110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b1afad0b-095f-444a-950e-4796f7bb34ee tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:27.694832 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b1afad0b-095f-444a-950e-4796f7bb34ee tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.901906 Aug 29 15:47:27.695763 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2621/5082] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:26 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:27.722296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fe122d0e-6bb4-40b6-8a4b-c42f9dd4f9b7 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a71f9d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:27.801424 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fe122d0e-6bb4-40b6-8a4b-c42f9dd4f9b7 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.082943 Aug 29 15:47:27.809896 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2622/5083] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:27 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:28.023769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6855ebbb-c44e-4df1-9cac-60b449a6b8d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:28.024724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6855ebbb-c44e-4df1-9cac-60b449a6b8d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:28.035475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6855ebbb-c44e-4df1-9cac-60b449a6b8d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:28.039539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6855ebbb-c44e-4df1-9cac-60b449a6b8d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:28.040271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6855ebbb-c44e-4df1-9cac-60b449a6b8d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:28.041242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6855ebbb-c44e-4df1-9cac-60b449a6b8d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:28.042402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6855ebbb-c44e-4df1-9cac-60b449a6b8d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:28.043762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6855ebbb-c44e-4df1-9cac-60b449a6b8d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:28.254947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6aa3be40-b0ab-4c96-9e9b-e5704754479e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:28.266621 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6aa3be40-b0ab-4c96-9e9b-e5704754479e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1279 microversion: 2.1 time: 0.950694 Aug 29 15:47:28.269766 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2462/5084] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:27 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1279 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:28.619327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6855ebbb-c44e-4df1-9cac-60b449a6b8d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:28.630553 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6855ebbb-c44e-4df1-9cac-60b449a6b8d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1319 microversion: 2.1 time: 0.610517 Aug 29 15:47:28.642488 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2623/5085] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:28 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1319 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:28.719161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-11437b13-ae8b-45d1-bc0a-d9b1874e87d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:28.720032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-11437b13-ae8b-45d1-bc0a-d9b1874e87d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:28.733920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11437b13-ae8b-45d1-bc0a-d9b1874e87d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:28.734822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11437b13-ae8b-45d1-bc0a-d9b1874e87d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:28.738031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11437b13-ae8b-45d1-bc0a-d9b1874e87d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:28.739570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11437b13-ae8b-45d1-bc0a-d9b1874e87d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:28.741877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11437b13-ae8b-45d1-bc0a-d9b1874e87d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:28.742852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11437b13-ae8b-45d1-bc0a-d9b1874e87d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:28.755538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:28.825435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f97bb456-ecd8-4159-877a-9e894bb4c383 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a7a7940>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:28.889478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-11437b13-ae8b-45d1-bc0a-d9b1874e87d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:28.902583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-11437b13-ae8b-45d1-bc0a-d9b1874e87d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:28.904377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-11437b13-ae8b-45d1-bc0a-d9b1874e87d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:28.906064 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-11437b13-ae8b-45d1-bc0a-d9b1874e87d0 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.191576 Aug 29 15:47:28.906954 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2463/5086] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:28 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:28.908545 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f97bb456-ecd8-4159-877a-9e894bb4c383 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.088004 Aug 29 15:47:28.909574 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2624/5087] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:28 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:29.298547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-28d8e4e6-3cb1-4696-9311-8dff479d8f92 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:29.299347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-28d8e4e6-3cb1-4696-9311-8dff479d8f92 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:29.325489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28d8e4e6-3cb1-4696-9311-8dff479d8f92 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.325489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28d8e4e6-3cb1-4696-9311-8dff479d8f92 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.325489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28d8e4e6-3cb1-4696-9311-8dff479d8f92 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.325489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28d8e4e6-3cb1-4696-9311-8dff479d8f92 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.325489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28d8e4e6-3cb1-4696-9311-8dff479d8f92 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.325489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28d8e4e6-3cb1-4696-9311-8dff479d8f92 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.442828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-28d8e4e6-3cb1-4696-9311-8dff479d8f92 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:29.454019 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-28d8e4e6-3cb1-4696-9311-8dff479d8f92 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1285 microversion: 2.1 time: 0.160772 Aug 29 15:47:29.454626 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2464/5088] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:29 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:29.667054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b3bd8b52-911b-488e-899e-8e7c448b9311 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:29.668882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b3bd8b52-911b-488e-899e-8e7c448b9311 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:29.708647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3bd8b52-911b-488e-899e-8e7c448b9311 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.709197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3bd8b52-911b-488e-899e-8e7c448b9311 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.709650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3bd8b52-911b-488e-899e-8e7c448b9311 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.710390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3bd8b52-911b-488e-899e-8e7c448b9311 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.710849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3bd8b52-911b-488e-899e-8e7c448b9311 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.711272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3bd8b52-911b-488e-899e-8e7c448b9311 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.927188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d69dc937-aab0-4801-ab6c-ce06fc7b9077 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42bdb9e50>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:30.012046 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d69dc937-aab0-4801-ab6c-ce06fc7b9077 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.092067 Aug 29 15:47:30.013278 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2465/5089] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:29 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:30.018901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e0f7f0ed-f5cf-459f-8245-579f4e9d113c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:30.019961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e0f7f0ed-f5cf-459f-8245-579f4e9d113c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:30.035098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0f7f0ed-f5cf-459f-8245-579f4e9d113c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:30.037665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0f7f0ed-f5cf-459f-8245-579f4e9d113c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:30.039435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0f7f0ed-f5cf-459f-8245-579f4e9d113c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:30.040599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0f7f0ed-f5cf-459f-8245-579f4e9d113c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:30.041799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0f7f0ed-f5cf-459f-8245-579f4e9d113c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:30.042891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0f7f0ed-f5cf-459f-8245-579f4e9d113c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:30.141392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e0f7f0ed-f5cf-459f-8245-579f4e9d113c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:30.165295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e0f7f0ed-f5cf-459f-8245-579f4e9d113c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:30.184538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e0f7f0ed-f5cf-459f-8245-579f4e9d113c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:30.192415 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e0f7f0ed-f5cf-459f-8245-579f4e9d113c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.177037 Aug 29 15:47:30.210485 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2466/5090] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:30 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:30.268398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b3bd8b52-911b-488e-899e-8e7c448b9311 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:30.281290 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b3bd8b52-911b-488e-899e-8e7c448b9311 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1319 microversion: 2.1 time: 0.626670 Aug 29 15:47:30.295841 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2625/5091] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:29 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1319 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:30.477752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e3c9b664-dd8c-4889-9ab5-85d66bdd477d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:30.478729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e3c9b664-dd8c-4889-9ab5-85d66bdd477d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:30.500256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3c9b664-dd8c-4889-9ab5-85d66bdd477d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:30.501316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3c9b664-dd8c-4889-9ab5-85d66bdd477d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:30.502031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3c9b664-dd8c-4889-9ab5-85d66bdd477d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:30.502844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3c9b664-dd8c-4889-9ab5-85d66bdd477d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:30.503307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3c9b664-dd8c-4889-9ab5-85d66bdd477d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:30.503738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3c9b664-dd8c-4889-9ab5-85d66bdd477d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:30.842505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e3c9b664-dd8c-4889-9ab5-85d66bdd477d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:30.849437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2113242750", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:30.858846 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e3c9b664-dd8c-4889-9ab5-85d66bdd477d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1327 microversion: 2.1 time: 0.387069 Aug 29 15:47:30.859940 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2467/5092] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:30 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1327 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:30.931127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] validate_networks() for [('4a56719a-8d81-464a-905c-2cbd572b7318', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:47:31.038714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8a791bd6-da59-4951-8881-25823bdf27cb tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b6f1040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:31.133804 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8a791bd6-da59-4951-8881-25823bdf27cb tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.108929 Aug 29 15:47:31.137025 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2468/5093] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:31 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:31.219765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e659686e-c546-4063-9cf9-c1cf1a131de4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:31.221437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e659686e-c546-4063-9cf9-c1cf1a131de4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:31.243031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e659686e-c546-4063-9cf9-c1cf1a131de4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.243582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e659686e-c546-4063-9cf9-c1cf1a131de4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.244100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e659686e-c546-4063-9cf9-c1cf1a131de4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.244920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e659686e-c546-4063-9cf9-c1cf1a131de4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.245520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e659686e-c546-4063-9cf9-c1cf1a131de4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.246408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e659686e-c546-4063-9cf9-c1cf1a131de4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.371924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e659686e-c546-4063-9cf9-c1cf1a131de4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:31.394334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e659686e-c546-4063-9cf9-c1cf1a131de4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:31.396445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e659686e-c546-4063-9cf9-c1cf1a131de4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:31.397741 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e659686e-c546-4063-9cf9-c1cf1a131de4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.185600 Aug 29 15:47:31.401533 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2469/5094] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:31 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:31.419632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b8585070-9f09-43d0-96ff-aa6991453c80 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:31.420585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b8585070-9f09-43d0-96ff-aa6991453c80 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:31.429478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8585070-9f09-43d0-96ff-aa6991453c80 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.430461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8585070-9f09-43d0-96ff-aa6991453c80 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.431206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8585070-9f09-43d0-96ff-aa6991453c80 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.433317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8585070-9f09-43d0-96ff-aa6991453c80 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.433966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8585070-9f09-43d0-96ff-aa6991453c80 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.434621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8585070-9f09-43d0-96ff-aa6991453c80 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.648971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b8585070-9f09-43d0-96ff-aa6991453c80 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:31.661966 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b8585070-9f09-43d0-96ff-aa6991453c80 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1508 microversion: 2.1 time: 0.255323 Aug 29 15:47:31.662159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:47:31.662626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:47:31.662860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:47:31.663717 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2470/5095] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:31 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:31.664081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:47:31.664505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:47:31.688275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.690629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.693026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.694653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.696706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.697357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.736287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Getting quotas for project bb5330327389417995f14947be334a04. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:47:31.742809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Getting quotas for user e75a8c66c5304e608e2f3120c1192534 and project bb5330327389417995f14947be334a04. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:47:31.784639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:47:31.789017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:47:31.861886 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9601d541-09eb-422e-b26f-e2a64bee16f4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.105367 Aug 29 15:47:31.863700 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2626/5096] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:47:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:47:31.883920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2e81f600-0ade-4a86-8f7b-9075e38f1a56 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:31.884254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-96fbe62a-7f6b-4dc4-853f-639c780ab0bb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:31.884551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2e81f600-0ade-4a86-8f7b-9075e38f1a56 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:31.884953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-96fbe62a-7f6b-4dc4-853f-639c780ab0bb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:31.915523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e81f600-0ade-4a86-8f7b-9075e38f1a56 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.918173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e81f600-0ade-4a86-8f7b-9075e38f1a56 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.918521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e81f600-0ade-4a86-8f7b-9075e38f1a56 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.919256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e81f600-0ade-4a86-8f7b-9075e38f1a56 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.919769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e81f600-0ade-4a86-8f7b-9075e38f1a56 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.920152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e81f600-0ade-4a86-8f7b-9075e38f1a56 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.936148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:31.990529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-96fbe62a-7f6b-4dc4-853f-639c780ab0bb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:32.006133 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-96fbe62a-7f6b-4dc4-853f-639c780ab0bb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1222 microversion: 2.1 time: 0.135597 Aug 29 15:47:32.011294 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2471/5097] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:31 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1222 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:32.033266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-cf1b9d18-8868-49a7-9439-9928d25cadc3 req-cdab6227-5314-4f7b-954d-0cfcd241ae19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29fe16f2-4b7e-4654-9ccb-d03b46aa6a06", "tag": "c02faba4-9bd2-405a-8c5f-c098e67e31ed"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:32.081903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cf1b9d18-8868-49a7-9439-9928d25cadc3 req-cdab6227-5314-4f7b-954d-0cfcd241ae19 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:32.083970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cf1b9d18-8868-49a7-9439-9928d25cadc3 req-cdab6227-5314-4f7b-954d-0cfcd241ae19 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:32.084938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cf1b9d18-8868-49a7-9439-9928d25cadc3 req-cdab6227-5314-4f7b-954d-0cfcd241ae19 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:32.116714 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-cf1b9d18-8868-49a7-9439-9928d25cadc3 req-cdab6227-5314-4f7b-954d-0cfcd241ae19 service nova] Creating event network-changed:c02faba4-9bd2-405a-8c5f-c098e67e31ed for instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 on n-h1-839401-11 Aug 29 15:47:32.126210 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-cf1b9d18-8868-49a7-9439-9928d25cadc3 req-cdab6227-5314-4f7b-954d-0cfcd241ae19 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112442 Aug 29 15:47:32.127215 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2472/5098] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:32.135180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-403752154", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:32.222857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] validate_networks() for [('4a56719a-8d81-464a-905c-2cbd572b7318', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:47:32.439392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2e81f600-0ade-4a86-8f7b-9075e38f1a56 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:32.454459 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2e81f600-0ade-4a86-8f7b-9075e38f1a56 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1327 microversion: 2.1 time: 0.578460 Aug 29 15:47:32.457206 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2627/5099] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:31 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1327 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:32.474071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0030dbb2-8198-42a2-b83d-2439a124c0ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a71fdc0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:32.565586 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0030dbb2-8198-42a2-b83d-2439a124c0ea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1455 microversion: 2.1 time: 0.106468 Aug 29 15:47:32.566706 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2628/5100] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:32 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:32.572517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1b636e9b-f31f-4445-8032-45813b8af9b9 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:32.573655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1b636e9b-f31f-4445-8032-45813b8af9b9 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:32.582752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b636e9b-f31f-4445-8032-45813b8af9b9 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:32.584862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b636e9b-f31f-4445-8032-45813b8af9b9 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:32.585492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b636e9b-f31f-4445-8032-45813b8af9b9 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:32.586389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b636e9b-f31f-4445-8032-45813b8af9b9 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:32.587030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b636e9b-f31f-4445-8032-45813b8af9b9 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:32.587625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b636e9b-f31f-4445-8032-45813b8af9b9 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:32.804079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1b636e9b-f31f-4445-8032-45813b8af9b9 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:32.813795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1b636e9b-f31f-4445-8032-45813b8af9b9 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:32.815289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1b636e9b-f31f-4445-8032-45813b8af9b9 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:32.827256 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1b636e9b-f31f-4445-8032-45813b8af9b9 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.258435 Aug 29 15:47:32.833255 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2629/5101] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:32 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:33.044589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:47:33.045031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:47:33.045537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:47:33.045954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:47:33.047981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:47:33.065830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.067239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.069227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.070357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.072097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.074233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.101463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Getting quotas for project bb5330327389417995f14947be334a04. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:47:33.108890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Getting quotas for user e75a8c66c5304e608e2f3120c1192534 and project bb5330327389417995f14947be334a04. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:47:33.132891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:47:33.139352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:47:33.202900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:33.224441 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f1a9c1e5-4b3b-4315-8702-5d3a48332ca7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.095628 Aug 29 15:47:33.225220 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2473/5102] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:47:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:47:33.238247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-63eaa991-d9c5-43ef-a1f1-9ff4af20190f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:33.239162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-63eaa991-d9c5-43ef-a1f1-9ff4af20190f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:33.388947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-63eaa991-d9c5-43ef-a1f1-9ff4af20190f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:33.406242 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-63eaa991-d9c5-43ef-a1f1-9ff4af20190f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1221 microversion: 2.1 time: 0.166592 Aug 29 15:47:33.406931 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2630/5103] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:33 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1221 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:33.483165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3bbce486-9845-4177-911a-0221561af66e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:33.483777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3bbce486-9845-4177-911a-0221561af66e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:33.503892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bbce486-9845-4177-911a-0221561af66e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.507480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bbce486-9845-4177-911a-0221561af66e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.511605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bbce486-9845-4177-911a-0221561af66e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.512911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bbce486-9845-4177-911a-0221561af66e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.513735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bbce486-9845-4177-911a-0221561af66e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.517197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3bbce486-9845-4177-911a-0221561af66e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.587897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-836fe075-8b56-486d-8821-21ca4fbeeb74 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a9ca0d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:33.984787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3bbce486-9845-4177-911a-0221561af66e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:33.998277 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3bbce486-9845-4177-911a-0221561af66e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1327 microversion: 2.1 time: 0.521200 Aug 29 15:47:33.999460 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2474/5104] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:33 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1327 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:34.004714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-433ff0c5-0326-4aff-a931-097002066c7f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:34.006199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-433ff0c5-0326-4aff-a931-097002066c7f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:34.029171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-433ff0c5-0326-4aff-a931-097002066c7f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:34.029697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-433ff0c5-0326-4aff-a931-097002066c7f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:34.030129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-433ff0c5-0326-4aff-a931-097002066c7f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:34.030853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-433ff0c5-0326-4aff-a931-097002066c7f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:34.031319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-433ff0c5-0326-4aff-a931-097002066c7f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:34.037950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-433ff0c5-0326-4aff-a931-097002066c7f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:34.183602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-433ff0c5-0326-4aff-a931-097002066c7f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:34.195268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-433ff0c5-0326-4aff-a931-097002066c7f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:34.197115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-433ff0c5-0326-4aff-a931-097002066c7f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:34.198550 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-433ff0c5-0326-4aff-a931-097002066c7f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.197862 Aug 29 15:47:34.199124 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2475/5105] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:33 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:34.428132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6ba9ce59-3bab-4f73-8c83-4e4da7bf6a33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:34.429452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6ba9ce59-3bab-4f73-8c83-4e4da7bf6a33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:34.442394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba9ce59-3bab-4f73-8c83-4e4da7bf6a33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:34.443496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba9ce59-3bab-4f73-8c83-4e4da7bf6a33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:34.445967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba9ce59-3bab-4f73-8c83-4e4da7bf6a33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:34.453248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba9ce59-3bab-4f73-8c83-4e4da7bf6a33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:34.454129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba9ce59-3bab-4f73-8c83-4e4da7bf6a33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:34.457646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba9ce59-3bab-4f73-8c83-4e4da7bf6a33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:34.611471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6ba9ce59-3bab-4f73-8c83-4e4da7bf6a33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:34.624973 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6ba9ce59-3bab-4f73-8c83-4e4da7bf6a33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1225 microversion: 2.1 time: 0.201206 Aug 29 15:47:34.634054 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2476/5106] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:34 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1225 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:35.019896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d698c89e-108c-46a2-884f-8c45aad1830f tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:35.020521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d698c89e-108c-46a2-884f-8c45aad1830f tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:35.028075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d698c89e-108c-46a2-884f-8c45aad1830f tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:35.039218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d698c89e-108c-46a2-884f-8c45aad1830f tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:35.039682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d698c89e-108c-46a2-884f-8c45aad1830f tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:35.044713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d698c89e-108c-46a2-884f-8c45aad1830f tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:35.047979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d698c89e-108c-46a2-884f-8c45aad1830f tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:35.048444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d698c89e-108c-46a2-884f-8c45aad1830f tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:35.554258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d698c89e-108c-46a2-884f-8c45aad1830f tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:35.566705 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d698c89e-108c-46a2-884f-8c45aad1830f tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1327 microversion: 2.1 time: 0.550504 Aug 29 15:47:35.567319 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2477/5107] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:35 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1327 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:35.578597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c04293de-d4fb-4752-9ea6-39b8bd60c755 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:35.580044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c04293de-d4fb-4752-9ea6-39b8bd60c755 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:35.593606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c04293de-d4fb-4752-9ea6-39b8bd60c755 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:35.594458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c04293de-d4fb-4752-9ea6-39b8bd60c755 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:35.597894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c04293de-d4fb-4752-9ea6-39b8bd60c755 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:35.598889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c04293de-d4fb-4752-9ea6-39b8bd60c755 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:35.599560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c04293de-d4fb-4752-9ea6-39b8bd60c755 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:35.600376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c04293de-d4fb-4752-9ea6-39b8bd60c755 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:35.745043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c04293de-d4fb-4752-9ea6-39b8bd60c755 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:35.755982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c04293de-d4fb-4752-9ea6-39b8bd60c755 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:35.758755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c04293de-d4fb-4752-9ea6-39b8bd60c755 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:35.760583 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c04293de-d4fb-4752-9ea6-39b8bd60c755 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.190625 Aug 29 15:47:35.773499 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2478/5108] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:35 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:35.803508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6d8a1678-68f1-47de-9732-5063e1f6b403 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:35.804502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6d8a1678-68f1-47de-9732-5063e1f6b403 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:35.815309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d8a1678-68f1-47de-9732-5063e1f6b403 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:35.816072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d8a1678-68f1-47de-9732-5063e1f6b403 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:35.817621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d8a1678-68f1-47de-9732-5063e1f6b403 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:35.820562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d8a1678-68f1-47de-9732-5063e1f6b403 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:35.821374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d8a1678-68f1-47de-9732-5063e1f6b403 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:35.822055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d8a1678-68f1-47de-9732-5063e1f6b403 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:35.960660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6d8a1678-68f1-47de-9732-5063e1f6b403 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:35.971384 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6d8a1678-68f1-47de-9732-5063e1f6b403 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1273 microversion: 2.1 time: 0.196261 Aug 29 15:47:35.977168 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2479/5109] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:35 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:36.587548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5eed8388-83b5-4979-aa68-cc1bd99e8d08 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:36.589260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5eed8388-83b5-4979-aa68-cc1bd99e8d08 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:36.609322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eed8388-83b5-4979-aa68-cc1bd99e8d08 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:36.609996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eed8388-83b5-4979-aa68-cc1bd99e8d08 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:36.610461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eed8388-83b5-4979-aa68-cc1bd99e8d08 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:36.611220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eed8388-83b5-4979-aa68-cc1bd99e8d08 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:36.611715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eed8388-83b5-4979-aa68-cc1bd99e8d08 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:36.612177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5eed8388-83b5-4979-aa68-cc1bd99e8d08 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:37.062470 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-836fe075-8b56-486d-8821-21ca4fbeeb74 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1464 microversion: 2.1 time: 3.483795 Aug 29 15:47:37.063383 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2631/5110] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:33 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1464 bytes in 3486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:37.069218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b76d82df-f3f2-4155-baf9-e653033c3883 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:37.070016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b76d82df-f3f2-4155-baf9-e653033c3883 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:37.077614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b76d82df-f3f2-4155-baf9-e653033c3883 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:37.078334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b76d82df-f3f2-4155-baf9-e653033c3883 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:37.078960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b76d82df-f3f2-4155-baf9-e653033c3883 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:37.083067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b76d82df-f3f2-4155-baf9-e653033c3883 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:37.083674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b76d82df-f3f2-4155-baf9-e653033c3883 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:37.084126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b76d82df-f3f2-4155-baf9-e653033c3883 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:37.165998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b76d82df-f3f2-4155-baf9-e653033c3883 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:37.175813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b76d82df-f3f2-4155-baf9-e653033c3883 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:37.177576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b76d82df-f3f2-4155-baf9-e653033c3883 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:37.178874 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b76d82df-f3f2-4155-baf9-e653033c3883 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.114193 Aug 29 15:47:37.179470 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2632/5111] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:37 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:37.184347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec0c6f55-093c-4348-a443-4924f0f957c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:37.185155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ec0c6f55-093c-4348-a443-4924f0f957c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:37.191826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec0c6f55-093c-4348-a443-4924f0f957c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:37.192315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec0c6f55-093c-4348-a443-4924f0f957c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:37.192749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec0c6f55-093c-4348-a443-4924f0f957c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:37.193478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec0c6f55-093c-4348-a443-4924f0f957c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:37.194088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec0c6f55-093c-4348-a443-4924f0f957c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:37.194679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec0c6f55-093c-4348-a443-4924f0f957c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:37.203851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5eed8388-83b5-4979-aa68-cc1bd99e8d08 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:37.224053 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5eed8388-83b5-4979-aa68-cc1bd99e8d08 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1327 microversion: 2.1 time: 0.634449 Aug 29 15:47:37.225101 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2480/5112] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:36 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1327 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:37.232976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f608c29b-0a2c-4fc9-9650-20b312386797 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b86c940>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:37.269626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ec0c6f55-093c-4348-a443-4924f0f957c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:37.279411 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ec0c6f55-093c-4348-a443-4924f0f957c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1279 microversion: 2.1 time: 0.098701 Aug 29 15:47:37.279989 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2633/5113] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:37 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:37.295274 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f608c29b-0a2c-4fc9-9650-20b312386797 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 200 len: 1464 microversion: 2.1 time: 0.068488 Aug 29 15:47:37.306203 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2481/5114] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:37 2022] GET /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 1464 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:37.310820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e1a8ef68-4fdc-4a0a-ab48-cbf399be7906 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:37.311646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e1a8ef68-4fdc-4a0a-ab48-cbf399be7906 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:37.319173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1a8ef68-4fdc-4a0a-ab48-cbf399be7906 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:37.319670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1a8ef68-4fdc-4a0a-ab48-cbf399be7906 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:37.320128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1a8ef68-4fdc-4a0a-ab48-cbf399be7906 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:37.320849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1a8ef68-4fdc-4a0a-ab48-cbf399be7906 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:37.321428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1a8ef68-4fdc-4a0a-ab48-cbf399be7906 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:37.322036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e1a8ef68-4fdc-4a0a-ab48-cbf399be7906 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:37.501398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e1a8ef68-4fdc-4a0a-ab48-cbf399be7906 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:37.515459 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e1a8ef68-4fdc-4a0a-ab48-cbf399be7906 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1480 microversion: 2.1 time: 0.208922 Aug 29 15:47:37.516320 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2634/5115] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:37 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1480 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:38.205733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c83676bb-56ba-41d2-9931-a4f3d2e28eae tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:38.206375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c83676bb-56ba-41d2-9931-a4f3d2e28eae tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:38.215853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-1fa62dec-7409-44f1-9e15-796a15141813 req-a3d79a2e-2a82-4d5b-83f5-8fbb44842f3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0", "tag": "b30b57e6-adcb-4234-b03e-865b3516daa4"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:38.226082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c83676bb-56ba-41d2-9931-a4f3d2e28eae tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.226656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c83676bb-56ba-41d2-9931-a4f3d2e28eae tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.227094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c83676bb-56ba-41d2-9931-a4f3d2e28eae tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.227810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c83676bb-56ba-41d2-9931-a4f3d2e28eae tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.228435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c83676bb-56ba-41d2-9931-a4f3d2e28eae tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.229002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c83676bb-56ba-41d2-9931-a4f3d2e28eae tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.231145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1fa62dec-7409-44f1-9e15-796a15141813 req-a3d79a2e-2a82-4d5b-83f5-8fbb44842f3b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.231643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1fa62dec-7409-44f1-9e15-796a15141813 req-a3d79a2e-2a82-4d5b-83f5-8fbb44842f3b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.237119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1fa62dec-7409-44f1-9e15-796a15141813 req-a3d79a2e-2a82-4d5b-83f5-8fbb44842f3b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.270224 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-1fa62dec-7409-44f1-9e15-796a15141813 req-a3d79a2e-2a82-4d5b-83f5-8fbb44842f3b service nova] Creating event network-changed:b30b57e6-adcb-4234-b03e-865b3516daa4 for instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 on n-h2-839401-11 Aug 29 15:47:38.276283 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-1fa62dec-7409-44f1-9e15-796a15141813 req-a3d79a2e-2a82-4d5b-83f5-8fbb44842f3b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064805 Aug 29 15:47:38.277658 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2635/5116] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:38.283876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-497bc26a-e583-4217-bf52-9b4c5ca71852 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:38.284637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-497bc26a-e583-4217-bf52-9b4c5ca71852 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:38.296800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-497bc26a-e583-4217-bf52-9b4c5ca71852 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.297632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-497bc26a-e583-4217-bf52-9b4c5ca71852 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.298081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-497bc26a-e583-4217-bf52-9b4c5ca71852 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.298911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-497bc26a-e583-4217-bf52-9b4c5ca71852 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.299438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-497bc26a-e583-4217-bf52-9b4c5ca71852 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.300059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-497bc26a-e583-4217-bf52-9b4c5ca71852 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.345192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c83676bb-56ba-41d2-9931-a4f3d2e28eae tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:38.356936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c83676bb-56ba-41d2-9931-a4f3d2e28eae tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:38.358420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c83676bb-56ba-41d2-9931-a4f3d2e28eae tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:38.359607 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c83676bb-56ba-41d2-9931-a4f3d2e28eae tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1366 microversion: 2.47 time: 0.160583 Aug 29 15:47:38.360191 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2482/5117] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:38 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:38.364694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9eeb4c10-207e-49bf-b43f-e946cb8c28b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:38.365326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9eeb4c10-207e-49bf-b43f-e946cb8c28b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:38.372157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eeb4c10-207e-49bf-b43f-e946cb8c28b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.372916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eeb4c10-207e-49bf-b43f-e946cb8c28b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.373466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eeb4c10-207e-49bf-b43f-e946cb8c28b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.374195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eeb4c10-207e-49bf-b43f-e946cb8c28b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.374654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eeb4c10-207e-49bf-b43f-e946cb8c28b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.375085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eeb4c10-207e-49bf-b43f-e946cb8c28b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.490563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-497bc26a-e583-4217-bf52-9b4c5ca71852 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:38.499635 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-497bc26a-e583-4217-bf52-9b4c5ca71852 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1327 microversion: 2.1 time: 0.220528 Aug 29 15:47:38.500486 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2636/5118] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:38 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1327 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:38.526911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9eeb4c10-207e-49bf-b43f-e946cb8c28b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:38.536181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-93338623-ca6d-4e67-ba07-413ecbf38a37 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:38.536920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-93338623-ca6d-4e67-ba07-413ecbf38a37 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:38.543822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93338623-ca6d-4e67-ba07-413ecbf38a37 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.544450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93338623-ca6d-4e67-ba07-413ecbf38a37 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.545106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93338623-ca6d-4e67-ba07-413ecbf38a37 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.545844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93338623-ca6d-4e67-ba07-413ecbf38a37 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.546312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93338623-ca6d-4e67-ba07-413ecbf38a37 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.546759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93338623-ca6d-4e67-ba07-413ecbf38a37 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.547344 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9eeb4c10-207e-49bf-b43f-e946cb8c28b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1321 microversion: 2.1 time: 0.186066 Aug 29 15:47:38.548135 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2483/5119] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:38 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:38.711595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-93338623-ca6d-4e67-ba07-413ecbf38a37 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:38.720556 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-93338623-ca6d-4e67-ba07-413ecbf38a37 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1467 microversion: 2.1 time: 0.188567 Aug 29 15:47:38.721308 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2637/5120] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:38 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1467 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:38.821285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-60975f53-92f6-4967-b308-6831a5e664ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-484410751"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:38.824112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-60975f53-92f6-4967-b308-6831a5e664ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: cea653ef-b11d-4341-a1cf-e941b5f3e570] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:38.831515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60975f53-92f6-4967-b308-6831a5e664ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.832010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60975f53-92f6-4967-b308-6831a5e664ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.832444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60975f53-92f6-4967-b308-6831a5e664ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.833253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60975f53-92f6-4967-b308-6831a5e664ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.833971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60975f53-92f6-4967-b308-6831a5e664ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.834448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60975f53-92f6-4967-b308-6831a5e664ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.995986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:39.045616 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-60975f53-92f6-4967-b308-6831a5e664ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "POST /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570/action" status: 202 len: 0 microversion: 2.1 time: 0.228047 Aug 29 15:47:39.046917 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2484/5121] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:47:38 2022] POST /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:47:39.061747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8395c0b4-bb08-459d-91fb-1f87bd06b5cf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42aa84790>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:39.138132 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8395c0b4-bb08-459d-91fb-1f87bd06b5cf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.082923 Aug 29 15:47:39.139226 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2638/5122] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:39 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:39.385100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-baca22b3-7ed5-49c2-922d-be5e2beb1497 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:39.386809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-baca22b3-7ed5-49c2-922d-be5e2beb1497 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:39.394850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-baca22b3-7ed5-49c2-922d-be5e2beb1497 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:39.395459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-baca22b3-7ed5-49c2-922d-be5e2beb1497 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:39.395990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-baca22b3-7ed5-49c2-922d-be5e2beb1497 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:39.396752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-baca22b3-7ed5-49c2-922d-be5e2beb1497 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:39.397214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-baca22b3-7ed5-49c2-922d-be5e2beb1497 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:39.397635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-baca22b3-7ed5-49c2-922d-be5e2beb1497 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:39.523052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0c51729e-d0d1-4214-ae37-4e6c52071bec tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:39.524399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0c51729e-d0d1-4214-ae37-4e6c52071bec tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:39.531602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c51729e-d0d1-4214-ae37-4e6c52071bec tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:39.532440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c51729e-d0d1-4214-ae37-4e6c52071bec tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:39.533131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c51729e-d0d1-4214-ae37-4e6c52071bec tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:39.534155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c51729e-d0d1-4214-ae37-4e6c52071bec tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:39.534823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c51729e-d0d1-4214-ae37-4e6c52071bec tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:39.535477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c51729e-d0d1-4214-ae37-4e6c52071bec tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:39.551718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-baca22b3-7ed5-49c2-922d-be5e2beb1497 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:39.575562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-baca22b3-7ed5-49c2-922d-be5e2beb1497 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:39.577322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-baca22b3-7ed5-49c2-922d-be5e2beb1497 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:39.579665 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-baca22b3-7ed5-49c2-922d-be5e2beb1497 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1372 microversion: 2.47 time: 0.200206 Aug 29 15:47:39.580464 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2485/5123] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:39 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:39.585362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f21c60c9-12ee-4a5e-9c13-ded39e8643e8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:39.586165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f21c60c9-12ee-4a5e-9c13-ded39e8643e8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:39.597149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21c60c9-12ee-4a5e-9c13-ded39e8643e8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:39.597827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21c60c9-12ee-4a5e-9c13-ded39e8643e8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:39.598612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21c60c9-12ee-4a5e-9c13-ded39e8643e8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:39.599555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21c60c9-12ee-4a5e-9c13-ded39e8643e8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:39.600142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21c60c9-12ee-4a5e-9c13-ded39e8643e8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:39.600585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21c60c9-12ee-4a5e-9c13-ded39e8643e8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:39.704976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0c51729e-d0d1-4214-ae37-4e6c52071bec tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:39.719992 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0c51729e-d0d1-4214-ae37-4e6c52071bec tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1327 microversion: 2.1 time: 0.201994 Aug 29 15:47:39.723789 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2639/5124] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:39 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1327 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:39.908825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f21c60c9-12ee-4a5e-9c13-ded39e8643e8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:39.919711 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f21c60c9-12ee-4a5e-9c13-ded39e8643e8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1321 microversion: 2.1 time: 0.337861 Aug 29 15:47:39.932983 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2486/5125] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:39 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:40.153381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ebcfbeab-c773-4997-bc7b-6afcb7988225 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42aa70b80>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:40.203919 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ebcfbeab-c773-4997-bc7b-6afcb7988225 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.054368 Aug 29 15:47:40.204810 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2640/5126] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:40 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:40.292111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-a08fa525-a42a-441c-9467-f2e3f3c6fe2f req-14df6be9-79e7-4af7-bdfa-89f60f125cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb8465e-a1d5-450b-b8e7-bb5f0c154504", "tag": "b736d3f3-b308-4ab8-a145-f2ee28009c2e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:40.302090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a08fa525-a42a-441c-9467-f2e3f3c6fe2f req-14df6be9-79e7-4af7-bdfa-89f60f125cc3 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.302654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a08fa525-a42a-441c-9467-f2e3f3c6fe2f req-14df6be9-79e7-4af7-bdfa-89f60f125cc3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.303166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a08fa525-a42a-441c-9467-f2e3f3c6fe2f req-14df6be9-79e7-4af7-bdfa-89f60f125cc3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.322482 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-a08fa525-a42a-441c-9467-f2e3f3c6fe2f req-14df6be9-79e7-4af7-bdfa-89f60f125cc3 service nova] Creating event network-changed:b736d3f3-b308-4ab8-a145-f2ee28009c2e for instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 on n-h2-839401-11 Aug 29 15:47:40.328535 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-a08fa525-a42a-441c-9467-f2e3f3c6fe2f req-14df6be9-79e7-4af7-bdfa-89f60f125cc3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040140 Aug 29 15:47:40.329186 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2487/5127] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:40.605682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7eb9eaf8-9e84-480b-a22f-007349427472 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:40.606447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7eb9eaf8-9e84-480b-a22f-007349427472 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:40.615369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eb9eaf8-9e84-480b-a22f-007349427472 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.615840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eb9eaf8-9e84-480b-a22f-007349427472 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.616275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eb9eaf8-9e84-480b-a22f-007349427472 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.617062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eb9eaf8-9e84-480b-a22f-007349427472 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.617547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eb9eaf8-9e84-480b-a22f-007349427472 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.617967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eb9eaf8-9e84-480b-a22f-007349427472 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.687491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7eb9eaf8-9e84-480b-a22f-007349427472 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:40.701789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7eb9eaf8-9e84-480b-a22f-007349427472 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:40.703449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7eb9eaf8-9e84-480b-a22f-007349427472 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:40.704938 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7eb9eaf8-9e84-480b-a22f-007349427472 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1372 microversion: 2.47 time: 0.104670 Aug 29 15:47:40.709139 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2641/5128] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:40 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:40.740750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c3d47601-7320-46f1-9a28-03a6a0666ff2 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:40.741595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c3d47601-7320-46f1-9a28-03a6a0666ff2 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:40.749374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3d47601-7320-46f1-9a28-03a6a0666ff2 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.750120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3d47601-7320-46f1-9a28-03a6a0666ff2 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.750555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3d47601-7320-46f1-9a28-03a6a0666ff2 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.751641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3d47601-7320-46f1-9a28-03a6a0666ff2 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.752109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3d47601-7320-46f1-9a28-03a6a0666ff2 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.752773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3d47601-7320-46f1-9a28-03a6a0666ff2 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.808896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-59aa8aa5-97fe-42a3-8c7b-6d436f0b0f7a req-634a24ad-19db-44fe-ab60-d2835f626f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29fe16f2-4b7e-4654-9ccb-d03b46aa6a06", "name": "network-vif-plugged", "status": "completed", "tag": "c02faba4-9bd2-405a-8c5f-c098e67e31ed"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:40.831094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-59aa8aa5-97fe-42a3-8c7b-6d436f0b0f7a req-634a24ad-19db-44fe-ab60-d2835f626f87 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.832040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-59aa8aa5-97fe-42a3-8c7b-6d436f0b0f7a req-634a24ad-19db-44fe-ab60-d2835f626f87 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.832473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-59aa8aa5-97fe-42a3-8c7b-6d436f0b0f7a req-634a24ad-19db-44fe-ab60-d2835f626f87 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.851639 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-59aa8aa5-97fe-42a3-8c7b-6d436f0b0f7a req-634a24ad-19db-44fe-ab60-d2835f626f87 service nova] Creating event network-vif-plugged:c02faba4-9bd2-405a-8c5f-c098e67e31ed for instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 on n-h1-839401-11 Aug 29 15:47:40.857320 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-59aa8aa5-97fe-42a3-8c7b-6d436f0b0f7a req-634a24ad-19db-44fe-ab60-d2835f626f87 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051975 Aug 29 15:47:40.858490 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2642/5129] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:40.940148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c3d47601-7320-46f1-9a28-03a6a0666ff2 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:40.945303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a1d2209d-c367-48f7-8847-d1d367101663 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:40.946011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a1d2209d-c367-48f7-8847-d1d367101663 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:40.952979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1d2209d-c367-48f7-8847-d1d367101663 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.953524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1d2209d-c367-48f7-8847-d1d367101663 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.953681 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c3d47601-7320-46f1-9a28-03a6a0666ff2 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1327 microversion: 2.1 time: 0.217278 Aug 29 15:47:40.953966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1d2209d-c367-48f7-8847-d1d367101663 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.954205 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2488/5130] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:40 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1327 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:40.954881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1d2209d-c367-48f7-8847-d1d367101663 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.955541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1d2209d-c367-48f7-8847-d1d367101663 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.955909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1d2209d-c367-48f7-8847-d1d367101663 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:41.148029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a1d2209d-c367-48f7-8847-d1d367101663 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:41.158073 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a1d2209d-c367-48f7-8847-d1d367101663 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1321 microversion: 2.1 time: 0.219419 Aug 29 15:47:41.158073 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2643/5131] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:40 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:41.219735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-803788d6-4eb7-4fb5-b647-b4e656df8802 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b892700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:41.281621 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-803788d6-4eb7-4fb5-b647-b4e656df8802 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.066105 Aug 29 15:47:41.282213 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2489/5132] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:41 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:41.727967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d6f080bf-c377-42c6-bba1-df338505fee5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:41.729208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d6f080bf-c377-42c6-bba1-df338505fee5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:41.732160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:41.737762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6f080bf-c377-42c6-bba1-df338505fee5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:41.738245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6f080bf-c377-42c6-bba1-df338505fee5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:41.738677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6f080bf-c377-42c6-bba1-df338505fee5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:41.739381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6f080bf-c377-42c6-bba1-df338505fee5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:41.739827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6f080bf-c377-42c6-bba1-df338505fee5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:41.740249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d6f080bf-c377-42c6-bba1-df338505fee5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:41.816931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d6f080bf-c377-42c6-bba1-df338505fee5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:41.825387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d6f080bf-c377-42c6-bba1-df338505fee5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:41.826866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d6f080bf-c377-42c6-bba1-df338505fee5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:41.828050 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d6f080bf-c377-42c6-bba1-df338505fee5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1372 microversion: 2.47 time: 0.104055 Aug 29 15:47:41.841701 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2644/5133] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:41 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1372 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:41.975227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d5cdbcb6-063a-4b80-9736-3f414af49d76 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:41.975943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d5cdbcb6-063a-4b80-9736-3f414af49d76 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:41.983183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5cdbcb6-063a-4b80-9736-3f414af49d76 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:41.983679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5cdbcb6-063a-4b80-9736-3f414af49d76 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:41.984186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5cdbcb6-063a-4b80-9736-3f414af49d76 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:41.984958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5cdbcb6-063a-4b80-9736-3f414af49d76 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:41.985547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5cdbcb6-063a-4b80-9736-3f414af49d76 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:41.986042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5cdbcb6-063a-4b80-9736-3f414af49d76 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:42.177238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bd93e4ad-3886-402d-b943-e4ff7207a848 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:42.177887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bd93e4ad-3886-402d-b943-e4ff7207a848 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:42.180711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:42.187071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd93e4ad-3886-402d-b943-e4ff7207a848 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:42.187722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd93e4ad-3886-402d-b943-e4ff7207a848 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:42.188157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd93e4ad-3886-402d-b943-e4ff7207a848 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:42.188869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd93e4ad-3886-402d-b943-e4ff7207a848 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:42.189355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd93e4ad-3886-402d-b943-e4ff7207a848 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:42.189835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd93e4ad-3886-402d-b943-e4ff7207a848 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:42.203365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d5cdbcb6-063a-4b80-9736-3f414af49d76 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:42.213987 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d5cdbcb6-063a-4b80-9736-3f414af49d76 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1327 microversion: 2.1 time: 0.243587 Aug 29 15:47:42.227763 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2490/5134] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:41 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1327 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:42.297363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-209242bf-b40b-41ff-a7ba-4071db38fa70 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b8929d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:42.351520 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-209242bf-b40b-41ff-a7ba-4071db38fa70 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.058562 Aug 29 15:47:42.352557 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2491/5135] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:42 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:42.379431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bd93e4ad-3886-402d-b943-e4ff7207a848 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:42.388299 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bd93e4ad-3886-402d-b943-e4ff7207a848 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1321 microversion: 2.1 time: 0.216021 Aug 29 15:47:42.388972 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2645/5136] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:42 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:42.852205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c84006c2-5ba1-41c0-a79e-27cc8ae55594 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:42.852847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c84006c2-5ba1-41c0-a79e-27cc8ae55594 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:42.860091 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c84006c2-5ba1-41c0-a79e-27cc8ae55594 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:42.860561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c84006c2-5ba1-41c0-a79e-27cc8ae55594 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:42.861023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c84006c2-5ba1-41c0-a79e-27cc8ae55594 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:42.861757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c84006c2-5ba1-41c0-a79e-27cc8ae55594 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:42.862330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c84006c2-5ba1-41c0-a79e-27cc8ae55594 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:42.862614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c84006c2-5ba1-41c0-a79e-27cc8ae55594 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:42.879045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-dedcd330-f3bf-4dbd-b521-e79b64aaa7d5 req-8e9d252c-9d6a-4e95-aa39-3ab9732e6b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698e4c74-b063-4ffc-bbd9-9154af832815", "name": "network-vif-unplugged", "status": "completed", "tag": "5917d456-8dc9-4d37-9614-af0759e075a5"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:42.893893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dedcd330-f3bf-4dbd-b521-e79b64aaa7d5 req-8e9d252c-9d6a-4e95-aa39-3ab9732e6b72 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:42.894656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dedcd330-f3bf-4dbd-b521-e79b64aaa7d5 req-8e9d252c-9d6a-4e95-aa39-3ab9732e6b72 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:42.895380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dedcd330-f3bf-4dbd-b521-e79b64aaa7d5 req-8e9d252c-9d6a-4e95-aa39-3ab9732e6b72 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:42.913964 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-dedcd330-f3bf-4dbd-b521-e79b64aaa7d5 req-8e9d252c-9d6a-4e95-aa39-3ab9732e6b72 service nova] Creating event network-vif-unplugged:5917d456-8dc9-4d37-9614-af0759e075a5 for instance 698e4c74-b063-4ffc-bbd9-9154af832815 on n-h2-839401-11 Aug 29 15:47:42.919163 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-dedcd330-f3bf-4dbd-b521-e79b64aaa7d5 req-8e9d252c-9d6a-4e95-aa39-3ab9732e6b72 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044734 Aug 29 15:47:42.920749 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2646/5137] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:42.941839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c84006c2-5ba1-41c0-a79e-27cc8ae55594 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:42.950672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c84006c2-5ba1-41c0-a79e-27cc8ae55594 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:42.952218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c84006c2-5ba1-41c0-a79e-27cc8ae55594 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:42.953432 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c84006c2-5ba1-41c0-a79e-27cc8ae55594 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1372 microversion: 2.47 time: 0.105378 Aug 29 15:47:42.959832 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2492/5138] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:42 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:43.236171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a0dd8c1a-4066-4b35-a11d-0b6a56063806 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:43.237120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a0dd8c1a-4066-4b35-a11d-0b6a56063806 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:43.244450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0dd8c1a-4066-4b35-a11d-0b6a56063806 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:43.245270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0dd8c1a-4066-4b35-a11d-0b6a56063806 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:43.245911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0dd8c1a-4066-4b35-a11d-0b6a56063806 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:43.246986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0dd8c1a-4066-4b35-a11d-0b6a56063806 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:43.247636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0dd8c1a-4066-4b35-a11d-0b6a56063806 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:43.248249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a0dd8c1a-4066-4b35-a11d-0b6a56063806 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:43.367036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-beed3803-42e4-4bf4-91b8-15e27587d317 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b6a0430>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:43.376391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:43.377576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=14 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:43.394208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=10 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:43.424386 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-beed3803-42e4-4bf4-91b8-15e27587d317 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.061250 Aug 29 15:47:43.425331 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2493/5139] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:43 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:43.431047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-24d4bac8-2124-4973-9cad-4ae2cb5b09db tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:43.431970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-24d4bac8-2124-4973-9cad-4ae2cb5b09db tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:43.440313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24d4bac8-2124-4973-9cad-4ae2cb5b09db tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:43.441288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24d4bac8-2124-4973-9cad-4ae2cb5b09db tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:43.441940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24d4bac8-2124-4973-9cad-4ae2cb5b09db tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:43.443579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24d4bac8-2124-4973-9cad-4ae2cb5b09db tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:43.444912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24d4bac8-2124-4973-9cad-4ae2cb5b09db tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:43.445674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24d4bac8-2124-4973-9cad-4ae2cb5b09db tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:43.476828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a0dd8c1a-4066-4b35-a11d-0b6a56063806 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:43.489120 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a0dd8c1a-4066-4b35-a11d-0b6a56063806 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1327 microversion: 2.1 time: 0.257513 Aug 29 15:47:43.490278 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2647/5140] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:43 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1327 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:43.715854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-24d4bac8-2124-4973-9cad-4ae2cb5b09db tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:43.726600 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-24d4bac8-2124-4973-9cad-4ae2cb5b09db tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1321 microversion: 2.1 time: 0.300136 Aug 29 15:47:43.727322 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2494/5141] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:43 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:43.976166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-02663a03-4f11-4c4d-87c4-0baa00e27327 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:43.976818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-02663a03-4f11-4c4d-87c4-0baa00e27327 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:43.984304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02663a03-4f11-4c4d-87c4-0baa00e27327 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:43.984939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02663a03-4f11-4c4d-87c4-0baa00e27327 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:43.985516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02663a03-4f11-4c4d-87c4-0baa00e27327 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:43.986328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02663a03-4f11-4c4d-87c4-0baa00e27327 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:43.986919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02663a03-4f11-4c4d-87c4-0baa00e27327 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:43.987416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02663a03-4f11-4c4d-87c4-0baa00e27327 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.054427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-02663a03-4f11-4c4d-87c4-0baa00e27327 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.063383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-02663a03-4f11-4c4d-87c4-0baa00e27327 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.064999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-02663a03-4f11-4c4d-87c4-0baa00e27327 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.066318 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-02663a03-4f11-4c4d-87c4-0baa00e27327 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1357 microversion: 2.47 time: 0.094267 Aug 29 15:47:44.067054 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2648/5142] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:43 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1357 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:44.088656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:44.093502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.094401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Searching by: {'deleted': False, 'project_id': '701b776a3adc417d8b384540ef66a933'} {{(pid=122361) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:47:44.099953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.100437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.100875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.101649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.102107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.102545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.222044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.multi_cell_list [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122361) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:47:44.302183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.308789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.309304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.309745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.321139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.322580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.360828 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-818f7d9e-5a39-48e7-86ba-87b476c00f63 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.276016 Aug 29 15:47:44.361497 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2495/5143] 10.222.0.62 () {60 vars in 1187 bytes} [Mon Aug 29 15:47:44 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:44.392978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cad509a7-2ee5-49d6-9e4a-8e881ed28af7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:44.393520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cad509a7-2ee5-49d6-9e4a-8e881ed28af7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:44.400309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cad509a7-2ee5-49d6-9e4a-8e881ed28af7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.400797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cad509a7-2ee5-49d6-9e4a-8e881ed28af7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.401398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cad509a7-2ee5-49d6-9e4a-8e881ed28af7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.402126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cad509a7-2ee5-49d6-9e4a-8e881ed28af7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.402605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cad509a7-2ee5-49d6-9e4a-8e881ed28af7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.403026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cad509a7-2ee5-49d6-9e4a-8e881ed28af7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.429959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cad509a7-2ee5-49d6-9e4a-8e881ed28af7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:47:44.438721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e9db7fa5-1228-4683-b3d6-de05c10ee954 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc433a82dc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:44.487679 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e9db7fa5-1228-4683-b3d6-de05c10ee954 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.052791 Aug 29 15:47:44.490386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:44.495883 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2496/5144] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:44 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:44.511660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dcda7e84-8b36-40b7-9500-ada17ec50053 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:44.512382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dcda7e84-8b36-40b7-9500-ada17ec50053 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:44.519149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcda7e84-8b36-40b7-9500-ada17ec50053 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.519800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcda7e84-8b36-40b7-9500-ada17ec50053 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.520637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcda7e84-8b36-40b7-9500-ada17ec50053 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.521444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcda7e84-8b36-40b7-9500-ada17ec50053 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.521970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcda7e84-8b36-40b7-9500-ada17ec50053 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.522657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcda7e84-8b36-40b7-9500-ada17ec50053 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.548153 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cad509a7-2ee5-49d6-9e4a-8e881ed28af7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "DELETE /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 204 len: 0 microversion: 2.47 time: 0.159046 Aug 29 15:47:44.551911 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2649/5145] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:47:44 2022] DELETE /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:47:44.561211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-12c93109-d348-4644-88ac-49f107209e57 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:44.562176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-12c93109-d348-4644-88ac-49f107209e57 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:44.570759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12c93109-d348-4644-88ac-49f107209e57 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.571329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12c93109-d348-4644-88ac-49f107209e57 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.571768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12c93109-d348-4644-88ac-49f107209e57 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.578663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12c93109-d348-4644-88ac-49f107209e57 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.579502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12c93109-d348-4644-88ac-49f107209e57 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.580017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12c93109-d348-4644-88ac-49f107209e57 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.655931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-12c93109-d348-4644-88ac-49f107209e57 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.666195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-12c93109-d348-4644-88ac-49f107209e57 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.667884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-12c93109-d348-4644-88ac-49f107209e57 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.669128 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-12c93109-d348-4644-88ac-49f107209e57 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1363 microversion: 2.47 time: 0.115668 Aug 29 15:47:44.670030 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2650/5146] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:44 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1363 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:44.672227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dcda7e84-8b36-40b7-9500-ada17ec50053 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.680646 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dcda7e84-8b36-40b7-9500-ada17ec50053 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1528 microversion: 2.1 time: 0.173873 Aug 29 15:47:44.696303 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2497/5147] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:44 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1528 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:44.702149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dbf29f45-0ce9-4659-95eb-23a97b872c01 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:44.704931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dbf29f45-0ce9-4659-95eb-23a97b872c01 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:44.709652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbf29f45-0ce9-4659-95eb-23a97b872c01 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.710232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbf29f45-0ce9-4659-95eb-23a97b872c01 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.710745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbf29f45-0ce9-4659-95eb-23a97b872c01 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.711535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbf29f45-0ce9-4659-95eb-23a97b872c01 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.712077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbf29f45-0ce9-4659-95eb-23a97b872c01 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.712631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbf29f45-0ce9-4659-95eb-23a97b872c01 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.748531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b2984804-7e50-436a-829b-12afe140916d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:44.749183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b2984804-7e50-436a-829b-12afe140916d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:44.756400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2984804-7e50-436a-829b-12afe140916d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.757110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2984804-7e50-436a-829b-12afe140916d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.757958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2984804-7e50-436a-829b-12afe140916d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.758914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2984804-7e50-436a-829b-12afe140916d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.759588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2984804-7e50-436a-829b-12afe140916d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.760214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2984804-7e50-436a-829b-12afe140916d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.893372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dbf29f45-0ce9-4659-95eb-23a97b872c01 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.903551 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dbf29f45-0ce9-4659-95eb-23a97b872c01 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1528 microversion: 2.1 time: 0.206110 Aug 29 15:47:44.904155 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2651/5148] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:44 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1528 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:44.934933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b2984804-7e50-436a-829b-12afe140916d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.943517 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b2984804-7e50-436a-829b-12afe140916d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1321 microversion: 2.1 time: 0.199350 Aug 29 15:47:44.957027 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2498/5149] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:44 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:44.979268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d1e2c2d-fea9-4584-b263-37e5216731c9 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:44.979787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9d1e2c2d-fea9-4584-b263-37e5216731c9 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:44.986353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d1e2c2d-fea9-4584-b263-37e5216731c9 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.986896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d1e2c2d-fea9-4584-b263-37e5216731c9 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.987330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d1e2c2d-fea9-4584-b263-37e5216731c9 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.988027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d1e2c2d-fea9-4584-b263-37e5216731c9 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.988481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d1e2c2d-fea9-4584-b263-37e5216731c9 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.988903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d1e2c2d-fea9-4584-b263-37e5216731c9 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.007673 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-9d1e2c2d-fea9-4584-b263-37e5216731c9 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] HTTP exception thrown: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d1e2c2d-fea9-4584-b263-37e5216731c9 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Request method failure captured: Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 HTTP/1.1 Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-LE6XmT8ownT-uzDEn4rdO52UoZoAKoDCIqAbK_O4UlrVt8OjYWaKoz-4iMVDV0UpLJfAzh-VTaTDVRqB0y3bxLjyrgdRcm2bDDIgBlY-NC1W_0-tG9kIXAP0ueqfpkwgkIwqJvjPJeo_0t7QeDHS9soOxKmRqFNTNoRcjplPK6Gc Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: fbda5a6b3d6b465ebe6debf2d439b89c Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-200294215 Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fbda5a6b3d6b465ebe6debf2d439b89c", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fbda5a6b3d6b465ebe6debf2d439b89c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fbda5a6b3d6b465ebe6debf2d439b89c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fbda5a6b3d6b465ebe6debf2d439b89c"}]}] Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-200294215 Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: fbda5a6b3d6b465ebe6debf2d439b89c Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-200294215 Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestMultiTenantJSON-200294215-project Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e429e553f83844508aadf52fbbbfa419 Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-200294215-project Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '29fe16f2-4b7e-4654-9ccb-d03b46aa6a06'} Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:47:45.009329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:47:45.014687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. Aug 29 15:47:45.014687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.014687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:45.014687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.014687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.014687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:45.014687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:45.014687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:45.014687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:45.014687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. Aug 29 15:47:45.014687 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.014687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d1e2c2d-fea9-4584-b263-37e5216731c9 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Returning 404 to user: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:45.014687 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d1e2c2d-fea9-4584-b263-37e5216731c9 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] 10.222.0.62 "DELETE /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 404 len: 111 microversion: 2.1 time: 0.090839 Aug 29 15:47:45.014687 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2652/5150] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:47:44 2022] DELETE /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:47:45.020873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-da55a848-4e8e-4bee-abb8-8a690e32c67e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:45.021551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-da55a848-4e8e-4bee-abb8-8a690e32c67e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:45.027773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da55a848-4e8e-4bee-abb8-8a690e32c67e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.028255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da55a848-4e8e-4bee-abb8-8a690e32c67e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.028691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da55a848-4e8e-4bee-abb8-8a690e32c67e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.029413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da55a848-4e8e-4bee-abb8-8a690e32c67e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.029972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da55a848-4e8e-4bee-abb8-8a690e32c67e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.030435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da55a848-4e8e-4bee-abb8-8a690e32c67e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.183573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-da55a848-4e8e-4bee-abb8-8a690e32c67e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:45.193568 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-da55a848-4e8e-4bee-abb8-8a690e32c67e tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1528 microversion: 2.1 time: 0.176626 Aug 29 15:47:45.194162 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2499/5151] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:45 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1528 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:45.213570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9576e715-9c08-479e-96a6-3875b248ded2 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Action: 'update', calling method: >, body: {"server": {"name": "29fe16f2-4b7e-4654-9ccb-d03b46aa6a06_new"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:45.216206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9576e715-9c08-479e-96a6-3875b248ded2 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:45.222383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9576e715-9c08-479e-96a6-3875b248ded2 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.222859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9576e715-9c08-479e-96a6-3875b248ded2 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.223488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9576e715-9c08-479e-96a6-3875b248ded2 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.224173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9576e715-9c08-479e-96a6-3875b248ded2 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.224626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9576e715-9c08-479e-96a6-3875b248ded2 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.225043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9576e715-9c08-479e-96a6-3875b248ded2 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.239022 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-9576e715-9c08-479e-96a6-3875b248ded2 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] HTTP exception thrown: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9576e715-9c08-479e-96a6-3875b248ded2 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Request method failure captured: Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: request: PUT /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 HTTP/1.1 Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 64 Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-LE6XmT8ownT-uzDEn4rdO52UoZoAKoDCIqAbK_O4UlrVt8OjYWaKoz-4iMVDV0UpLJfAzh-VTaTDVRqB0y3bxLjyrgdRcm2bDDIgBlY-NC1W_0-tG9kIXAP0ueqfpkwgkIwqJvjPJeo_0t7QeDHS9soOxKmRqFNTNoRcjplPK6Gc Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: fbda5a6b3d6b465ebe6debf2d439b89c Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-200294215 Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fbda5a6b3d6b465ebe6debf2d439b89c", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fbda5a6b3d6b465ebe6debf2d439b89c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fbda5a6b3d6b465ebe6debf2d439b89c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fbda5a6b3d6b465ebe6debf2d439b89c"}]}] Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-200294215 Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: fbda5a6b3d6b465ebe6debf2d439b89c Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-200294215 Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestMultiTenantJSON-200294215-project Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e429e553f83844508aadf52fbbbfa419 Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-200294215-project Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: {"server": {"name": "29fe16f2-4b7e-4654-9ccb-d03b46aa6a06_new"}} Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '29fe16f2-4b7e-4654-9ccb-d03b46aa6a06', 'body': {'server': {'name': '29fe16f2-4b7e-4654-9ccb-d03b46aa6a06_new'}}} Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:47:45.240915 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9576e715-9c08-479e-96a6-3875b248ded2 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] Returning 404 to user: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9576e715-9c08-479e-96a6-3875b248ded2 tempest-ServersNegativeTestMultiTenantJSON-200294215 tempest-ServersNegativeTestMultiTenantJSON-200294215-project] 10.222.0.62 "PUT /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 404 len: 111 microversion: 2.1 time: 0.032846 Aug 29 15:47:45.245970 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2653/5152] 10.222.0.62 () {60 vars in 1256 bytes} [Mon Aug 29 15:47:45 2022] PUT /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:47:45.253132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fc8874e1-7906-4740-a25f-a0bf5a7ec4cf tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:45.253773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fc8874e1-7906-4740-a25f-a0bf5a7ec4cf tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:45.260461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc8874e1-7906-4740-a25f-a0bf5a7ec4cf tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.261390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc8874e1-7906-4740-a25f-a0bf5a7ec4cf tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.261889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc8874e1-7906-4740-a25f-a0bf5a7ec4cf tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.262665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc8874e1-7906-4740-a25f-a0bf5a7ec4cf tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.263181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc8874e1-7906-4740-a25f-a0bf5a7ec4cf tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.263810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc8874e1-7906-4740-a25f-a0bf5a7ec4cf tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.290659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fc8874e1-7906-4740-a25f-a0bf5a7ec4cf tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:47:45.370690 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fc8874e1-7906-4740-a25f-a0bf5a7ec4cf tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "DELETE /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 204 len: 0 microversion: 2.1 time: 0.121129 Aug 29 15:47:45.371435 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2500/5153] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:47:45 2022] DELETE /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:47:45.380384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6ac8cede-501e-4722-a181-a9eaa3fad1c9 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:45.380977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6ac8cede-501e-4722-a181-a9eaa3fad1c9 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:45.387862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ac8cede-501e-4722-a181-a9eaa3fad1c9 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.388335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ac8cede-501e-4722-a181-a9eaa3fad1c9 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.388760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ac8cede-501e-4722-a181-a9eaa3fad1c9 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.389658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ac8cede-501e-4722-a181-a9eaa3fad1c9 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.390116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ac8cede-501e-4722-a181-a9eaa3fad1c9 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.390545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ac8cede-501e-4722-a181-a9eaa3fad1c9 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.505267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-87f72350-f648-4143-918f-6f7a6d2d299f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b94d0d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:45.546589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6ac8cede-501e-4722-a181-a9eaa3fad1c9 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:45.558528 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-87f72350-f648-4143-918f-6f7a6d2d299f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.058785 Aug 29 15:47:45.566185 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2501/5154] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:45 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:45.566473 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6ac8cede-501e-4722-a181-a9eaa3fad1c9 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1534 microversion: 2.1 time: 0.183226 Aug 29 15:47:45.566473 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2654/5155] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:45 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1534 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:45.692562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7c506282-4f5e-4114-90c0-8d2d65caef15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:45.693487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7c506282-4f5e-4114-90c0-8d2d65caef15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:45.699780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c506282-4f5e-4114-90c0-8d2d65caef15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.700265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c506282-4f5e-4114-90c0-8d2d65caef15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.700705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c506282-4f5e-4114-90c0-8d2d65caef15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.701474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c506282-4f5e-4114-90c0-8d2d65caef15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.701936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c506282-4f5e-4114-90c0-8d2d65caef15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.702368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c506282-4f5e-4114-90c0-8d2d65caef15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.768703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7c506282-4f5e-4114-90c0-8d2d65caef15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:45.777322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7c506282-4f5e-4114-90c0-8d2d65caef15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:45.778804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7c506282-4f5e-4114-90c0-8d2d65caef15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:45.779982 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7c506282-4f5e-4114-90c0-8d2d65caef15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1363 microversion: 2.47 time: 0.091444 Aug 29 15:47:45.780530 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2502/5156] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:45 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:45.964759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ac21755e-719f-46c1-a659-a2a53710e779 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:45.965438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ac21755e-719f-46c1-a659-a2a53710e779 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:45.972096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac21755e-719f-46c1-a659-a2a53710e779 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.972609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac21755e-719f-46c1-a659-a2a53710e779 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.973033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac21755e-719f-46c1-a659-a2a53710e779 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.973787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac21755e-719f-46c1-a659-a2a53710e779 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.974259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac21755e-719f-46c1-a659-a2a53710e779 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.974685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac21755e-719f-46c1-a659-a2a53710e779 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:46.108408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ac21755e-719f-46c1-a659-a2a53710e779 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:46.116728 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ac21755e-719f-46c1-a659-a2a53710e779 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1321 microversion: 2.1 time: 0.156055 Aug 29 15:47:46.117385 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2655/5157] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:45 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:46.575298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb06d8ed-3b4d-498f-8023-33a744107c31 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b859160>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:46.589634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d72488bd-696e-4d9a-a550-9d9749cedf36 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:46.594280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d72488bd-696e-4d9a-a550-9d9749cedf36 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:46.623438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d72488bd-696e-4d9a-a550-9d9749cedf36 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.624849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d72488bd-696e-4d9a-a550-9d9749cedf36 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.625332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d72488bd-696e-4d9a-a550-9d9749cedf36 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:46.628460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d72488bd-696e-4d9a-a550-9d9749cedf36 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.628950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d72488bd-696e-4d9a-a550-9d9749cedf36 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.635377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d72488bd-696e-4d9a-a550-9d9749cedf36 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:46.665651 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bb06d8ed-3b4d-498f-8023-33a744107c31 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.094634 Aug 29 15:47:46.666942 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2503/5158] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:46 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:46.805060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a0877fb1-1a0c-4c7f-91f6-a87168c6a76c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:46.805715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a0877fb1-1a0c-4c7f-91f6-a87168c6a76c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:46.816496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0877fb1-1a0c-4c7f-91f6-a87168c6a76c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.818379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d72488bd-696e-4d9a-a550-9d9749cedf36 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:46.818960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0877fb1-1a0c-4c7f-91f6-a87168c6a76c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.819458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0877fb1-1a0c-4c7f-91f6-a87168c6a76c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:46.821772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0877fb1-1a0c-4c7f-91f6-a87168c6a76c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.824562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0877fb1-1a0c-4c7f-91f6-a87168c6a76c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.826087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0877fb1-1a0c-4c7f-91f6-a87168c6a76c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:46.828780 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d72488bd-696e-4d9a-a550-9d9749cedf36 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1534 microversion: 2.1 time: 0.250149 Aug 29 15:47:46.841265 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2656/5159] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:46 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1534 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:46.853322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-3699a7d3-479c-4389-8499-bc831bbf2370 req-109d8afd-e5a9-4771-90ea-2b5fe3e35939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea653ef-b11d-4341-a1cf-e941b5f3e570", "name": "network-vif-plugged", "status": "completed", "tag": "efc5b7ae-1aab-49aa-938d-1d74e0bd4507"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:46.869654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3699a7d3-479c-4389-8499-bc831bbf2370 req-109d8afd-e5a9-4771-90ea-2b5fe3e35939 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.871081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3699a7d3-479c-4389-8499-bc831bbf2370 req-109d8afd-e5a9-4771-90ea-2b5fe3e35939 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.871853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-3699a7d3-479c-4389-8499-bc831bbf2370 req-109d8afd-e5a9-4771-90ea-2b5fe3e35939 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:46.892298 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-3699a7d3-479c-4389-8499-bc831bbf2370 req-109d8afd-e5a9-4771-90ea-2b5fe3e35939 service nova] Creating event network-vif-plugged:efc5b7ae-1aab-49aa-938d-1d74e0bd4507 for instance cea653ef-b11d-4341-a1cf-e941b5f3e570 on n-h1-839401-11 Aug 29 15:47:46.899161 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-3699a7d3-479c-4389-8499-bc831bbf2370 req-109d8afd-e5a9-4771-90ea-2b5fe3e35939 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053810 Aug 29 15:47:46.900148 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2657/5160] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:46.969423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a0877fb1-1a0c-4c7f-91f6-a87168c6a76c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:46.973107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:46.981008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a0877fb1-1a0c-4c7f-91f6-a87168c6a76c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:46.982793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a0877fb1-1a0c-4c7f-91f6-a87168c6a76c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:46.984623 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a0877fb1-1a0c-4c7f-91f6-a87168c6a76c tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1363 microversion: 2.47 time: 0.184645 Aug 29 15:47:46.985613 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2504/5161] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:46 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:47.138614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-93ebeb16-8ff8-490b-b5e3-57a711fefac1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:47.139428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-93ebeb16-8ff8-490b-b5e3-57a711fefac1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:47.147195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ebeb16-8ff8-490b-b5e3-57a711fefac1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:47.147775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ebeb16-8ff8-490b-b5e3-57a711fefac1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:47.148280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ebeb16-8ff8-490b-b5e3-57a711fefac1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:47.149110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ebeb16-8ff8-490b-b5e3-57a711fefac1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:47.149634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ebeb16-8ff8-490b-b5e3-57a711fefac1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:47.150118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ebeb16-8ff8-490b-b5e3-57a711fefac1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:47.287787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-93ebeb16-8ff8-490b-b5e3-57a711fefac1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:47.296532 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-93ebeb16-8ff8-490b-b5e3-57a711fefac1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1321 microversion: 2.1 time: 0.162417 Aug 29 15:47:47.297491 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2658/5162] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:47 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:47.683085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f917ee14-2fde-471b-8611-27b470dfd581 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b859160>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:47.740440 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f917ee14-2fde-471b-8611-27b470dfd581 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.061196 Aug 29 15:47:47.741340 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2505/5163] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:47 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:47.854010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6521f356-63c8-44d5-a6fb-a91cde7051d6 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:47.854908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6521f356-63c8-44d5-a6fb-a91cde7051d6 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:47.861466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6521f356-63c8-44d5-a6fb-a91cde7051d6 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:47.862296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6521f356-63c8-44d5-a6fb-a91cde7051d6 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:47.862735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6521f356-63c8-44d5-a6fb-a91cde7051d6 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:47.863579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6521f356-63c8-44d5-a6fb-a91cde7051d6 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:47.864282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6521f356-63c8-44d5-a6fb-a91cde7051d6 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:47.864818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6521f356-63c8-44d5-a6fb-a91cde7051d6 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:48.009142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f7eb7583-38fa-42a4-a71b-b51fae3b7fb5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:48.009991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f7eb7583-38fa-42a4-a71b-b51fae3b7fb5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:48.018878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7eb7583-38fa-42a4-a71b-b51fae3b7fb5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:48.019805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7eb7583-38fa-42a4-a71b-b51fae3b7fb5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:48.020457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7eb7583-38fa-42a4-a71b-b51fae3b7fb5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:48.021535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7eb7583-38fa-42a4-a71b-b51fae3b7fb5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:48.022291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7eb7583-38fa-42a4-a71b-b51fae3b7fb5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:48.022904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7eb7583-38fa-42a4-a71b-b51fae3b7fb5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:48.110727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6521f356-63c8-44d5-a6fb-a91cde7051d6 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a288ca90d04ea18382c282ffe0e083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e77ba7832194690a192c182a2a30c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:48.124550 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6521f356-63c8-44d5-a6fb-a91cde7051d6 tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 200 len: 1534 microversion: 2.1 time: 0.276430 Aug 29 15:47:48.138297 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2659/5164] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:47 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 1534 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:48.207571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f7eb7583-38fa-42a4-a71b-b51fae3b7fb5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:48.208177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-1801cb6f-9cdc-4f3f-aa2d-25cab77f91a2 req-f63ebd67-341d-40a2-9ad0-0f643546e8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29fe16f2-4b7e-4654-9ccb-d03b46aa6a06", "name": "network-vif-deleted", "tag": "c02faba4-9bd2-405a-8c5f-c098e67e31ed"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:48.217669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f7eb7583-38fa-42a4-a71b-b51fae3b7fb5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:48.219215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f7eb7583-38fa-42a4-a71b-b51fae3b7fb5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:48.220311 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f7eb7583-38fa-42a4-a71b-b51fae3b7fb5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1363 microversion: 2.47 time: 0.216816 Aug 29 15:47:48.227246 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2506/5165] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:48 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:48.236184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1801cb6f-9cdc-4f3f-aa2d-25cab77f91a2 req-f63ebd67-341d-40a2-9ad0-0f643546e8d5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:48.236708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1801cb6f-9cdc-4f3f-aa2d-25cab77f91a2 req-f63ebd67-341d-40a2-9ad0-0f643546e8d5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:48.237181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1801cb6f-9cdc-4f3f-aa2d-25cab77f91a2 req-f63ebd67-341d-40a2-9ad0-0f643546e8d5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:48.250206 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-1801cb6f-9cdc-4f3f-aa2d-25cab77f91a2 req-f63ebd67-341d-40a2-9ad0-0f643546e8d5 service nova] Creating event network-vif-deleted:c02faba4-9bd2-405a-8c5f-c098e67e31ed for instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 on n-h1-839401-11 Aug 29 15:47:48.256051 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-1801cb6f-9cdc-4f3f-aa2d-25cab77f91a2 req-f63ebd67-341d-40a2-9ad0-0f643546e8d5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055389 Aug 29 15:47:48.257437 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2660/5166] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:48.317387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-44e1d4f1-df17-4c6e-84b3-bef90b614352 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:48.318105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-44e1d4f1-df17-4c6e-84b3-bef90b614352 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:48.325690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44e1d4f1-df17-4c6e-84b3-bef90b614352 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:48.326288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44e1d4f1-df17-4c6e-84b3-bef90b614352 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:48.327297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44e1d4f1-df17-4c6e-84b3-bef90b614352 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:48.328086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44e1d4f1-df17-4c6e-84b3-bef90b614352 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:48.328624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44e1d4f1-df17-4c6e-84b3-bef90b614352 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:48.329149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44e1d4f1-df17-4c6e-84b3-bef90b614352 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:48.485799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-44e1d4f1-df17-4c6e-84b3-bef90b614352 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:48.494678 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-44e1d4f1-df17-4c6e-84b3-bef90b614352 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1321 microversion: 2.1 time: 0.181288 Aug 29 15:47:48.495703 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2507/5167] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:48 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:48.756028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d0b3e94b-9716-4955-9fc1-63006604e78b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a7a7550>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:48.800883 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d0b3e94b-9716-4955-9fc1-63006604e78b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.049059 Aug 29 15:47:48.802569 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2661/5168] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:48 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:49.146069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-60f2db2f-d577-4d37-b59e-08cc38ad2b1d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:49.146706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-60f2db2f-d577-4d37-b59e-08cc38ad2b1d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] [instance: 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:49.154209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60f2db2f-d577-4d37-b59e-08cc38ad2b1d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:49.154702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60f2db2f-d577-4d37-b59e-08cc38ad2b1d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:49.155144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60f2db2f-d577-4d37-b59e-08cc38ad2b1d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:49.155860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60f2db2f-d577-4d37-b59e-08cc38ad2b1d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:49.156326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60f2db2f-d577-4d37-b59e-08cc38ad2b1d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:49.156751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60f2db2f-d577-4d37-b59e-08cc38ad2b1d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:49.172052 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-60f2db2f-d577-4d37-b59e-08cc38ad2b1d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] HTTP exception thrown: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-60f2db2f-d577-4d37-b59e-08cc38ad2b1d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Request method failure captured: Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 HTTP/1.1 Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN99HCVCKuF-04rr0MoP5D9AGA3GmQftRYnT5y4jXHL-unXfo2hJZzN0oS8WTQad7d7jtrvNNekCdQWm5KY3GA_JbQ81plAt0FAp8ATbMd1rJtuhHIDEHmc1UL6XubKF0_ZqCaIoq8QJpxTk3szMn2BaSMuk2R1FalKmyR_WeMPoGa0 Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 5e77ba7832194690a192c182a2a30c2c Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-952160492 Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5e77ba7832194690a192c182a2a30c2c", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5e77ba7832194690a192c182a2a30c2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5e77ba7832194690a192c182a2a30c2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5e77ba7832194690a192c182a2a30c2c"}]}] Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-952160492 Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 5e77ba7832194690a192c182a2a30c2c Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-952160492 Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestMultiTenantJSON-952160492-project Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 18a288ca90d04ea18382c282ffe0e083 Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-952160492-project Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '29fe16f2-4b7e-4654-9ccb-d03b46aa6a06'} Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. Aug 29 15:47:49.173795 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:49.178612 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:49.178612 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:49.178612 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:49.178612 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:49.178612 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:49.178612 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:49.178612 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:49.178612 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. Aug 29 15:47:49.178612 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:49.178612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-60f2db2f-d577-4d37-b59e-08cc38ad2b1d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] Returning 404 to user: Instance 29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:49.178612 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-60f2db2f-d577-4d37-b59e-08cc38ad2b1d tempest-ServersNegativeTestMultiTenantJSON-952160492 tempest-ServersNegativeTestMultiTenantJSON-952160492-project] 10.222.0.62 "GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06" status: 404 len: 111 microversion: 2.1 time: 0.033412 Aug 29 15:47:49.178612 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2508/5169] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:49 2022] GET /compute/v2.1/servers/29fe16f2-4b7e-4654-9ccb-d03b46aa6a06 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:47:49.249662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-26694012-1b26-4b5d-a79a-cab039e7663e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:49.250576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-26694012-1b26-4b5d-a79a-cab039e7663e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:49.257433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26694012-1b26-4b5d-a79a-cab039e7663e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:49.258011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26694012-1b26-4b5d-a79a-cab039e7663e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:49.258460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26694012-1b26-4b5d-a79a-cab039e7663e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:49.259168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26694012-1b26-4b5d-a79a-cab039e7663e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:49.259630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26694012-1b26-4b5d-a79a-cab039e7663e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:49.260061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26694012-1b26-4b5d-a79a-cab039e7663e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:49.332616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-26694012-1b26-4b5d-a79a-cab039e7663e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:49.341144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-26694012-1b26-4b5d-a79a-cab039e7663e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:49.342688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-26694012-1b26-4b5d-a79a-cab039e7663e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:49.344031 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-26694012-1b26-4b5d-a79a-cab039e7663e tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1363 microversion: 2.47 time: 0.099900 Aug 29 15:47:49.344764 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2662/5170] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:49 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1363 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:49.516241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-052b5a2d-9fcc-497e-9b0a-36ddffe6b2ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:49.516959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-052b5a2d-9fcc-497e-9b0a-36ddffe6b2ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:49.523765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-052b5a2d-9fcc-497e-9b0a-36ddffe6b2ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:49.524474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-052b5a2d-9fcc-497e-9b0a-36ddffe6b2ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:49.525160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-052b5a2d-9fcc-497e-9b0a-36ddffe6b2ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:49.525864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-052b5a2d-9fcc-497e-9b0a-36ddffe6b2ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:49.526745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-052b5a2d-9fcc-497e-9b0a-36ddffe6b2ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:49.527338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-052b5a2d-9fcc-497e-9b0a-36ddffe6b2ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:49.760113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-052b5a2d-9fcc-497e-9b0a-36ddffe6b2ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:49.770160 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-052b5a2d-9fcc-497e-9b0a-36ddffe6b2ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1321 microversion: 2.1 time: 0.257444 Aug 29 15:47:49.789462 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2509/5171] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:49 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:49.812224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-eb5e39a2-5cee-40fe-b76c-1370d1cd81cf req-b9389c40-7124-4d9d-afd2-7349fbaabf57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0", "name": "network-vif-plugged", "status": "completed", "tag": "b30b57e6-adcb-4234-b03e-865b3516daa4"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:49.823061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-effe66a3-69e9-435e-83ff-9510b6527be8 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b8958b0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:49.823272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-eb5e39a2-5cee-40fe-b76c-1370d1cd81cf req-b9389c40-7124-4d9d-afd2-7349fbaabf57 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:49.823822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-eb5e39a2-5cee-40fe-b76c-1370d1cd81cf req-b9389c40-7124-4d9d-afd2-7349fbaabf57 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:49.824335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-eb5e39a2-5cee-40fe-b76c-1370d1cd81cf req-b9389c40-7124-4d9d-afd2-7349fbaabf57 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:49.859098 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-eb5e39a2-5cee-40fe-b76c-1370d1cd81cf req-b9389c40-7124-4d9d-afd2-7349fbaabf57 service nova] Creating event network-vif-plugged:b30b57e6-adcb-4234-b03e-865b3516daa4 for instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 on n-h2-839401-11 Aug 29 15:47:49.864570 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-eb5e39a2-5cee-40fe-b76c-1370d1cd81cf req-b9389c40-7124-4d9d-afd2-7349fbaabf57 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058203 Aug 29 15:47:49.865343 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2663/5172] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:49.883805 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-effe66a3-69e9-435e-83ff-9510b6527be8 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.064882 Aug 29 15:47:49.891674 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2510/5173] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:49 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:50.369575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5aecc121-1498-4361-8fb5-1bec664009ef tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:50.371553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5aecc121-1498-4361-8fb5-1bec664009ef tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:50.380362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5aecc121-1498-4361-8fb5-1bec664009ef tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:50.382769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5aecc121-1498-4361-8fb5-1bec664009ef tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:50.383445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5aecc121-1498-4361-8fb5-1bec664009ef tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:50.384404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5aecc121-1498-4361-8fb5-1bec664009ef tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:50.385122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5aecc121-1498-4361-8fb5-1bec664009ef tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:50.386388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5aecc121-1498-4361-8fb5-1bec664009ef tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:50.483627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5aecc121-1498-4361-8fb5-1bec664009ef tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:50.499998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5aecc121-1498-4361-8fb5-1bec664009ef tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:50.502069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5aecc121-1498-4361-8fb5-1bec664009ef tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:50.503830 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5aecc121-1498-4361-8fb5-1bec664009ef tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1363 microversion: 2.47 time: 0.139853 Aug 29 15:47:50.518861 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2664/5174] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:50 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:50.791892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dc27fcc2-efb5-4cc7-9c2c-4382ed7ca217 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:50.792630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dc27fcc2-efb5-4cc7-9c2c-4382ed7ca217 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:50.807085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc27fcc2-efb5-4cc7-9c2c-4382ed7ca217 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:50.807626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc27fcc2-efb5-4cc7-9c2c-4382ed7ca217 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:50.808163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc27fcc2-efb5-4cc7-9c2c-4382ed7ca217 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:50.809290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc27fcc2-efb5-4cc7-9c2c-4382ed7ca217 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:50.809917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc27fcc2-efb5-4cc7-9c2c-4382ed7ca217 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:50.810577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc27fcc2-efb5-4cc7-9c2c-4382ed7ca217 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:50.906724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ba268268-096b-4953-bee8-5d5c3e0603f0 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a6eff70>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:51.001366 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ba268268-096b-4953-bee8-5d5c3e0603f0 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.106969 Aug 29 15:47:51.011594 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2665/5175] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:50 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:51.053915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dc27fcc2-efb5-4cc7-9c2c-4382ed7ca217 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:51.065197 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dc27fcc2-efb5-4cc7-9c2c-4382ed7ca217 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1321 microversion: 2.1 time: 0.278421 Aug 29 15:47:51.067662 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2511/5176] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:50 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:51.534983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d012b9eb-ee58-4af5-bc73-9389dee0d76b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:51.537027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d012b9eb-ee58-4af5-bc73-9389dee0d76b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:51.568453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d012b9eb-ee58-4af5-bc73-9389dee0d76b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:51.569433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d012b9eb-ee58-4af5-bc73-9389dee0d76b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:51.570986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d012b9eb-ee58-4af5-bc73-9389dee0d76b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:51.574095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d012b9eb-ee58-4af5-bc73-9389dee0d76b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:51.575098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d012b9eb-ee58-4af5-bc73-9389dee0d76b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:51.575981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d012b9eb-ee58-4af5-bc73-9389dee0d76b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:51.622151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d012b9eb-ee58-4af5-bc73-9389dee0d76b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:51.622905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d012b9eb-ee58-4af5-bc73-9389dee0d76b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:51.623501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d012b9eb-ee58-4af5-bc73-9389dee0d76b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:51.624154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-d012b9eb-ee58-4af5-bc73-9389dee0d76b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lazy-loading 'fault' on Instance uuid 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:51.707287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d012b9eb-ee58-4af5-bc73-9389dee0d76b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:51.723942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d012b9eb-ee58-4af5-bc73-9389dee0d76b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:51.732801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d012b9eb-ee58-4af5-bc73-9389dee0d76b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:51.740510 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d012b9eb-ee58-4af5-bc73-9389dee0d76b tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1368 microversion: 2.47 time: 0.211574 Aug 29 15:47:51.742922 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2666/5177] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:51 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:52.019468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dafd3aac-c50a-4118-817f-e8dc34f371a9 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b6f1040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:52.087798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d95de972-cf67-4486-8e7f-4faab7bc96ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:52.088592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d95de972-cf67-4486-8e7f-4faab7bc96ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:52.121526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d95de972-cf67-4486-8e7f-4faab7bc96ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:52.122038 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dafd3aac-c50a-4118-817f-e8dc34f371a9 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.102803 Aug 29 15:47:52.125760 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2512/5178] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:52 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:52.129171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d95de972-cf67-4486-8e7f-4faab7bc96ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:52.132674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d95de972-cf67-4486-8e7f-4faab7bc96ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:52.138570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d95de972-cf67-4486-8e7f-4faab7bc96ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:52.139306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d95de972-cf67-4486-8e7f-4faab7bc96ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:52.143006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d95de972-cf67-4486-8e7f-4faab7bc96ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:52.517481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d95de972-cf67-4486-8e7f-4faab7bc96ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:52.528496 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d95de972-cf67-4486-8e7f-4faab7bc96ff tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1321 microversion: 2.1 time: 0.444839 Aug 29 15:47:52.529022 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2667/5179] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:52 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1321 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:52.768931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b19dbb05-232f-40b0-98d3-f6f2b410b80d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:52.769851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b19dbb05-232f-40b0-98d3-f6f2b410b80d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:52.783667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b19dbb05-232f-40b0-98d3-f6f2b410b80d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:52.797668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b19dbb05-232f-40b0-98d3-f6f2b410b80d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:52.798612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b19dbb05-232f-40b0-98d3-f6f2b410b80d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:52.800632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b19dbb05-232f-40b0-98d3-f6f2b410b80d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:52.801363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b19dbb05-232f-40b0-98d3-f6f2b410b80d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:52.802123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b19dbb05-232f-40b0-98d3-f6f2b410b80d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:52.892015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b19dbb05-232f-40b0-98d3-f6f2b410b80d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:52.892857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b19dbb05-232f-40b0-98d3-f6f2b410b80d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:52.895473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b19dbb05-232f-40b0-98d3-f6f2b410b80d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:52.897021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-b19dbb05-232f-40b0-98d3-f6f2b410b80d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lazy-loading 'fault' on Instance uuid 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:52.996049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b19dbb05-232f-40b0-98d3-f6f2b410b80d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:53.007316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b19dbb05-232f-40b0-98d3-f6f2b410b80d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:53.035070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b19dbb05-232f-40b0-98d3-f6f2b410b80d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:53.037793 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b19dbb05-232f-40b0-98d3-f6f2b410b80d tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 200 len: 1368 microversion: 2.47 time: 0.275224 Aug 29 15:47:53.041802 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2513/5180] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:52 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 1368 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:53.146176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f4380e28-d4c0-4c7d-9516-af856b3de6f3 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0117d32-b0da-4eef-ac9f-d09679946a97", "device": "/dev/sdb"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:53.149290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f4380e28-d4c0-4c7d-9516-af856b3de6f3 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:53.149473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-911bca75-4c0c-472e-b147-2309e3f147cc tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a6ef8b0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:53.169017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4380e28-d4c0-4c7d-9516-af856b3de6f3 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:53.181522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4380e28-d4c0-4c7d-9516-af856b3de6f3 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:53.199686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4380e28-d4c0-4c7d-9516-af856b3de6f3 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:53.200765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4380e28-d4c0-4c7d-9516-af856b3de6f3 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:53.201630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4380e28-d4c0-4c7d-9516-af856b3de6f3 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:53.203597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4380e28-d4c0-4c7d-9516-af856b3de6f3 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:53.252544 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-911bca75-4c0c-472e-b147-2309e3f147cc tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.115740 Aug 29 15:47:53.253917 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2668/5181] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:53 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:53.549746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e6623970-d204-4279-9a88-ded5c9270f4c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:53.550365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e6623970-d204-4279-9a88-ded5c9270f4c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:53.560257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6623970-d204-4279-9a88-ded5c9270f4c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:53.562784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6623970-d204-4279-9a88-ded5c9270f4c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:53.565592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6623970-d204-4279-9a88-ded5c9270f4c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:53.568797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6623970-d204-4279-9a88-ded5c9270f4c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:53.571760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6623970-d204-4279-9a88-ded5c9270f4c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:53.576018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e6623970-d204-4279-9a88-ded5c9270f4c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:53.697673 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f4380e28-d4c0-4c7d-9516-af856b3de6f3 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "POST /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555331 Aug 29 15:47:53.699316 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2514/5182] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 15:47:53 2022] POST /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44/os-volume_attachments => generated 194 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:53.875217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e6623970-d204-4279-9a88-ded5c9270f4c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:53.886114 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e6623970-d204-4279-9a88-ded5c9270f4c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1321 microversion: 2.1 time: 0.339842 Aug 29 15:47:53.901359 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2669/5183] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:53 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:54.066647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9eb657c5-de23-43ed-9e62-6cc51884d72f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:54.068191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9eb657c5-de23-43ed-9e62-6cc51884d72f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:54.083521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eb657c5-de23-43ed-9e62-6cc51884d72f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.084415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eb657c5-de23-43ed-9e62-6cc51884d72f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.085075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eb657c5-de23-43ed-9e62-6cc51884d72f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.086037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eb657c5-de23-43ed-9e62-6cc51884d72f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.086692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eb657c5-de23-43ed-9e62-6cc51884d72f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.087313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eb657c5-de23-43ed-9e62-6cc51884d72f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.112610 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-9eb657c5-de23-43ed-9e62-6cc51884d72f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] HTTP exception thrown: Instance 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd could not be found. Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9eb657c5-de23-43ed-9e62-6cc51884d72f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Request method failure captured: Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd HTTP/1.1 Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN9pOEgB0LDgGrFoINL-tPsJcoCXvJri52fIpLbAK4Rc1WDq7rL4eiEnKDbxBZA-v9qrDh3WZPPHp4wYg1nPY5JzYNIIP2IKucvuaZ0GXb27y7UMtqvWtxNyegf-lB3LZnlP0ewES183m4Y7LfTiwhIhmLCqDXBYQZDbBIWs9UOoG5o Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.47 Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 701b776a3adc417d8b384540ef66a933 Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerShowV247Test-1309628816 Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_701b776a3adc417d8b384540ef66a933", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/701b776a3adc417d8b384540ef66a933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/701b776a3adc417d8b384540ef66a933"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/701b776a3adc417d8b384540ef66a933"}]}] Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerShowV247Test-1309628816 Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 701b776a3adc417d8b384540ef66a933 Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerShowV247Test-1309628816 Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerShowV247Test-1309628816-project Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 2327fa7098644c30b3d7dd5c11850701 Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerShowV247Test-1309628816-project Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd could not be found. Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd'} Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd could not be found. Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd could not be found. Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:54.114604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:54.118812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:54.118812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:54.118812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:54.118812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:54.118812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:54.118812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd could not be found. Aug 29 15:47:54.118812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:54.120888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9eb657c5-de23-43ed-9e62-6cc51884d72f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Returning 404 to user: Instance 54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:54.122160 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9eb657c5-de23-43ed-9e62-6cc51884d72f tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd" status: 404 len: 111 microversion: 2.47 time: 0.060671 Aug 29 15:47:54.132409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-26d0cc99-f30e-4949-badd-63e8a8737642 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:54.133333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-26d0cc99-f30e-4949-badd-63e8a8737642 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 17a799dd-7544-4219-8d6b-6902ed8be544] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:54.136711 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2515/5184] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:54 2022] GET /compute/v2.1/servers/54b5e61c-4e46-4e5b-bc2a-ef722e36fbdd => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:47:54.140254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26d0cc99-f30e-4949-badd-63e8a8737642 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.141358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26d0cc99-f30e-4949-badd-63e8a8737642 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.142143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26d0cc99-f30e-4949-badd-63e8a8737642 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.143107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26d0cc99-f30e-4949-badd-63e8a8737642 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.144031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26d0cc99-f30e-4949-badd-63e8a8737642 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.144675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-26d0cc99-f30e-4949-badd-63e8a8737642 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.179116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-26d0cc99-f30e-4949-badd-63e8a8737642 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 17a799dd-7544-4219-8d6b-6902ed8be544] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:47:54.226038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:54.269621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2fcf5b67-da07-428b-96bc-498f203c899d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b6f1700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:54.288033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:54.299893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:54.348308 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2fcf5b67-da07-428b-96bc-498f203c899d tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.083376 Aug 29 15:47:54.349575 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2516/5185] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:54 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:54.358604 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-26d0cc99-f30e-4949-badd-63e8a8737642 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "DELETE /compute/v2.1/servers/17a799dd-7544-4219-8d6b-6902ed8be544" status: 204 len: 0 microversion: 2.47 time: 0.230773 Aug 29 15:47:54.359565 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2670/5186] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:47:54 2022] DELETE /compute/v2.1/servers/17a799dd-7544-4219-8d6b-6902ed8be544 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:47:54.368347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-45a19801-b224-4ead-9436-eeaed9df92d6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:54.370265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-45a19801-b224-4ead-9436-eeaed9df92d6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 17a799dd-7544-4219-8d6b-6902ed8be544] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:54.391038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45a19801-b224-4ead-9436-eeaed9df92d6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.404297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45a19801-b224-4ead-9436-eeaed9df92d6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.407657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45a19801-b224-4ead-9436-eeaed9df92d6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.408877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45a19801-b224-4ead-9436-eeaed9df92d6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.411757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45a19801-b224-4ead-9436-eeaed9df92d6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.413144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45a19801-b224-4ead-9436-eeaed9df92d6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.431486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e248b024-0db9-4ae4-93bc-21efdac61535 req-12abb236-e6d3-4218-9125-84a693d3d162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb8465e-a1d5-450b-b8e7-bb5f0c154504", "name": "network-vif-plugged", "status": "completed", "tag": "b736d3f3-b308-4ab8-a145-f2ee28009c2e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:54.453394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e248b024-0db9-4ae4-93bc-21efdac61535 req-12abb236-e6d3-4218-9125-84a693d3d162 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.453888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e248b024-0db9-4ae4-93bc-21efdac61535 req-12abb236-e6d3-4218-9125-84a693d3d162 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.454326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e248b024-0db9-4ae4-93bc-21efdac61535 req-12abb236-e6d3-4218-9125-84a693d3d162 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.492796 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e248b024-0db9-4ae4-93bc-21efdac61535 req-12abb236-e6d3-4218-9125-84a693d3d162 service nova] Creating event network-vif-plugged:b736d3f3-b308-4ab8-a145-f2ee28009c2e for instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 on n-h2-839401-11 Aug 29 15:47:54.499970 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e248b024-0db9-4ae4-93bc-21efdac61535 req-12abb236-e6d3-4218-9125-84a693d3d162 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073526 Aug 29 15:47:54.503670 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2671/5187] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:54.594951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-45a19801-b224-4ead-9436-eeaed9df92d6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:54.620588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-45a19801-b224-4ead-9436-eeaed9df92d6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:54.622058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-45a19801-b224-4ead-9436-eeaed9df92d6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:54.627559 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-45a19801-b224-4ead-9436-eeaed9df92d6 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/17a799dd-7544-4219-8d6b-6902ed8be544" status: 200 len: 1362 microversion: 2.47 time: 0.259445 Aug 29 15:47:54.637920 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2517/5188] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:54 2022] GET /compute/v2.1/servers/17a799dd-7544-4219-8d6b-6902ed8be544 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:54.909936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8c04dde7-6891-425b-a27d-39699e255d98 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:54.910965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8c04dde7-6891-425b-a27d-39699e255d98 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:54.927106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c04dde7-6891-425b-a27d-39699e255d98 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.930360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c04dde7-6891-425b-a27d-39699e255d98 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.932669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c04dde7-6891-425b-a27d-39699e255d98 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.933681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c04dde7-6891-425b-a27d-39699e255d98 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.937137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c04dde7-6891-425b-a27d-39699e255d98 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.940243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8c04dde7-6891-425b-a27d-39699e255d98 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:55.238453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8c04dde7-6891-425b-a27d-39699e255d98 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:55.276028 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8c04dde7-6891-425b-a27d-39699e255d98 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1321 microversion: 2.1 time: 0.369976 Aug 29 15:47:55.279033 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2672/5189] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:54 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:55.364021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-629ef80d-82e5-4a43-bb1a-a8a80cd0c1d6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b92d1f0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:55.420338 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-629ef80d-82e5-4a43-bb1a-a8a80cd0c1d6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.060380 Aug 29 15:47:55.426827 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2518/5190] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:55 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:55.662266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-61f27c9e-81d6-4d27-b422-998b9a88dda7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:55.663150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-61f27c9e-81d6-4d27-b422-998b9a88dda7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 17a799dd-7544-4219-8d6b-6902ed8be544] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:55.672665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61f27c9e-81d6-4d27-b422-998b9a88dda7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:55.673328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61f27c9e-81d6-4d27-b422-998b9a88dda7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:55.673989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61f27c9e-81d6-4d27-b422-998b9a88dda7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:55.674810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61f27c9e-81d6-4d27-b422-998b9a88dda7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:55.675292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61f27c9e-81d6-4d27-b422-998b9a88dda7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:55.675796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61f27c9e-81d6-4d27-b422-998b9a88dda7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:55.771146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-61f27c9e-81d6-4d27-b422-998b9a88dda7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:55.780196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-61f27c9e-81d6-4d27-b422-998b9a88dda7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:55.795212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-61f27c9e-81d6-4d27-b422-998b9a88dda7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:55.796885 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-61f27c9e-81d6-4d27-b422-998b9a88dda7 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/17a799dd-7544-4219-8d6b-6902ed8be544" status: 200 len: 1362 microversion: 2.47 time: 0.145405 Aug 29 15:47:55.812569 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2673/5191] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:55 2022] GET /compute/v2.1/servers/17a799dd-7544-4219-8d6b-6902ed8be544 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:56.296452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-19e0aade-9d6e-4e8d-baf2-a9bae6f810a7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:56.297076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-19e0aade-9d6e-4e8d-baf2-a9bae6f810a7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:56.303975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19e0aade-9d6e-4e8d-baf2-a9bae6f810a7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.304490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19e0aade-9d6e-4e8d-baf2-a9bae6f810a7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.304935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19e0aade-9d6e-4e8d-baf2-a9bae6f810a7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:56.305741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19e0aade-9d6e-4e8d-baf2-a9bae6f810a7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.306220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19e0aade-9d6e-4e8d-baf2-a9bae6f810a7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.306668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19e0aade-9d6e-4e8d-baf2-a9bae6f810a7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:56.436611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-411fc493-a981-4a9f-99b6-2062f9da799a tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a7ad9d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:56.498863 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-411fc493-a981-4a9f-99b6-2062f9da799a tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.063524 Aug 29 15:47:56.509022 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2674/5192] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:56 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:56.820259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-284bc865-a7d7-4f20-b02f-87efa111e2b5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:56.821589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-284bc865-a7d7-4f20-b02f-87efa111e2b5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 17a799dd-7544-4219-8d6b-6902ed8be544] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:56.857668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-284bc865-a7d7-4f20-b02f-87efa111e2b5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.885959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-284bc865-a7d7-4f20-b02f-87efa111e2b5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.886478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-284bc865-a7d7-4f20-b02f-87efa111e2b5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:56.887339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-284bc865-a7d7-4f20-b02f-87efa111e2b5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.887806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-284bc865-a7d7-4f20-b02f-87efa111e2b5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.888542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-284bc865-a7d7-4f20-b02f-87efa111e2b5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:56.888659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-19e0aade-9d6e-4e8d-baf2-a9bae6f810a7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:56.910158 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-19e0aade-9d6e-4e8d-baf2-a9bae6f810a7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1321 microversion: 2.1 time: 0.607567 Aug 29 15:47:56.925254 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2519/5193] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:56 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1321 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:57.037779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-284bc865-a7d7-4f20-b02f-87efa111e2b5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:57.061835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-284bc865-a7d7-4f20-b02f-87efa111e2b5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:57.064072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-284bc865-a7d7-4f20-b02f-87efa111e2b5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:57.066802 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-284bc865-a7d7-4f20-b02f-87efa111e2b5 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/17a799dd-7544-4219-8d6b-6902ed8be544" status: 200 len: 1362 microversion: 2.47 time: 0.250583 Aug 29 15:47:57.088592 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2675/5194] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:56 2022] GET /compute/v2.1/servers/17a799dd-7544-4219-8d6b-6902ed8be544 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:57.516136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a5e8f5c6-d54d-4818-a907-2b1e151d3e65 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b8958b0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:57.632811 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a5e8f5c6-d54d-4818-a907-2b1e151d3e65 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.121047 Aug 29 15:47:57.654891 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2520/5195] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:57 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:57.937849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-15c7daf2-95e5-4c92-bb3c-3e5605e7df56 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:57.937849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-15c7daf2-95e5-4c92-bb3c-3e5605e7df56 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:57.951001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15c7daf2-95e5-4c92-bb3c-3e5605e7df56 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:57.951804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15c7daf2-95e5-4c92-bb3c-3e5605e7df56 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:57.952872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15c7daf2-95e5-4c92-bb3c-3e5605e7df56 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:57.955011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15c7daf2-95e5-4c92-bb3c-3e5605e7df56 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:57.956424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15c7daf2-95e5-4c92-bb3c-3e5605e7df56 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:57.962663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15c7daf2-95e5-4c92-bb3c-3e5605e7df56 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.092368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-64e4e9b8-dbba-4932-a802-80d26e61c5f4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:58.093682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-64e4e9b8-dbba-4932-a802-80d26e61c5f4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 17a799dd-7544-4219-8d6b-6902ed8be544] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:58.112693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64e4e9b8-dbba-4932-a802-80d26e61c5f4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:58.113578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64e4e9b8-dbba-4932-a802-80d26e61c5f4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:58.114371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64e4e9b8-dbba-4932-a802-80d26e61c5f4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.115585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64e4e9b8-dbba-4932-a802-80d26e61c5f4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:58.116261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64e4e9b8-dbba-4932-a802-80d26e61c5f4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:58.116898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64e4e9b8-dbba-4932-a802-80d26e61c5f4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.204117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64e4e9b8-dbba-4932-a802-80d26e61c5f4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:58.205666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64e4e9b8-dbba-4932-a802-80d26e61c5f4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:58.206161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64e4e9b8-dbba-4932-a802-80d26e61c5f4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.208785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-64e4e9b8-dbba-4932-a802-80d26e61c5f4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lazy-loading 'fault' on Instance uuid 17a799dd-7544-4219-8d6b-6902ed8be544 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:58.293601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-64e4e9b8-dbba-4932-a802-80d26e61c5f4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:58.304837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-64e4e9b8-dbba-4932-a802-80d26e61c5f4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:58.306800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-64e4e9b8-dbba-4932-a802-80d26e61c5f4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2327fa7098644c30b3d7dd5c11850701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701b776a3adc417d8b384540ef66a933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:58.308879 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-64e4e9b8-dbba-4932-a802-80d26e61c5f4 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/17a799dd-7544-4219-8d6b-6902ed8be544" status: 200 len: 1367 microversion: 2.47 time: 0.220855 Aug 29 15:47:58.310021 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2521/5196] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:58 2022] GET /compute/v2.1/servers/17a799dd-7544-4219-8d6b-6902ed8be544 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:58.371447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-15c7daf2-95e5-4c92-bb3c-3e5605e7df56 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:58.385075 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-15c7daf2-95e5-4c92-bb3c-3e5605e7df56 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1514 microversion: 2.1 time: 0.452008 Aug 29 15:47:58.397542 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2676/5197] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:57 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1514 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:58.412146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-51a670e7-25ff-4119-9b98-2d89894d1fd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:58.414873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-51a670e7-25ff-4119-9b98-2d89894d1fd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:58.423780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51a670e7-25ff-4119-9b98-2d89894d1fd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:58.424592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51a670e7-25ff-4119-9b98-2d89894d1fd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:58.425323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51a670e7-25ff-4119-9b98-2d89894d1fd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.426192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51a670e7-25ff-4119-9b98-2d89894d1fd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:58.427055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51a670e7-25ff-4119-9b98-2d89894d1fd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:58.427651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51a670e7-25ff-4119-9b98-2d89894d1fd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.462261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-51a670e7-25ff-4119-9b98-2d89894d1fd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lazy-loading 'flavor' on Instance uuid 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:47:58.593277 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-51a670e7-25ff-4119-9b98-2d89894d1fd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504/action" status: 200 len: 32 microversion: 2.1 time: 0.187463 Aug 29 15:47:58.601897 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2522/5198] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:47:58 2022] POST /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:47:58.614206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5fa0af67-a304-4041-bef3-3060e5df5c7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:58.615223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5fa0af67-a304-4041-bef3-3060e5df5c7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:58.623330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fa0af67-a304-4041-bef3-3060e5df5c7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:58.623973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fa0af67-a304-4041-bef3-3060e5df5c7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:58.625169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fa0af67-a304-4041-bef3-3060e5df5c7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.626057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fa0af67-a304-4041-bef3-3060e5df5c7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:58.626588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fa0af67-a304-4041-bef3-3060e5df5c7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:58.627197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fa0af67-a304-4041-bef3-3060e5df5c7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.670957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cbe346cc-ef39-411b-be22-dd854883bb6b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a577c10>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:58.787198 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cbe346cc-ef39-411b-be22-dd854883bb6b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.121366 Aug 29 15:47:58.789580 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2523/5199] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:58 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:59.012399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5fa0af67-a304-4041-bef3-3060e5df5c7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:59.027811 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5fa0af67-a304-4041-bef3-3060e5df5c7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.416904 Aug 29 15:47:59.032390 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2677/5200] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:58 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:59.334290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b8315552-37ce-4e95-9085-5a1a6ca71b15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:59.335698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b8315552-37ce-4e95-9085-5a1a6ca71b15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] [instance: 17a799dd-7544-4219-8d6b-6902ed8be544] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:59.346511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8315552-37ce-4e95-9085-5a1a6ca71b15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:59.347591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8315552-37ce-4e95-9085-5a1a6ca71b15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:59.351169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8315552-37ce-4e95-9085-5a1a6ca71b15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:59.352151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8315552-37ce-4e95-9085-5a1a6ca71b15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:59.354616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8315552-37ce-4e95-9085-5a1a6ca71b15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:59.355304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8315552-37ce-4e95-9085-5a1a6ca71b15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:59.376583 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-b8315552-37ce-4e95-9085-5a1a6ca71b15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] HTTP exception thrown: Instance 17a799dd-7544-4219-8d6b-6902ed8be544 could not be found. Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b8315552-37ce-4e95-9085-5a1a6ca71b15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Request method failure captured: Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/17a799dd-7544-4219-8d6b-6902ed8be544 HTTP/1.1 Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN9pOEgB0LDgGrFoINL-tPsJcoCXvJri52fIpLbAK4Rc1WDq7rL4eiEnKDbxBZA-v9qrDh3WZPPHp4wYg1nPY5JzYNIIP2IKucvuaZ0GXb27y7UMtqvWtxNyegf-lB3LZnlP0ewES183m4Y7LfTiwhIhmLCqDXBYQZDbBIWs9UOoG5o Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.47 Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 701b776a3adc417d8b384540ef66a933 Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerShowV247Test-1309628816 Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_701b776a3adc417d8b384540ef66a933", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/701b776a3adc417d8b384540ef66a933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/701b776a3adc417d8b384540ef66a933"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/701b776a3adc417d8b384540ef66a933"}]}] Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerShowV247Test-1309628816 Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 701b776a3adc417d8b384540ef66a933 Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerShowV247Test-1309628816 Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerShowV247Test-1309628816-project Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 2327fa7098644c30b3d7dd5c11850701 Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerShowV247Test-1309628816-project Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 17a799dd-7544-4219-8d6b-6902ed8be544 could not be found. Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '17a799dd-7544-4219-8d6b-6902ed8be544'} Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a799dd-7544-4219-8d6b-6902ed8be544 could not be found. Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a799dd-7544-4219-8d6b-6902ed8be544 could not be found. Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:59.379569 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:59.383758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:59.383758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:59.383758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:59.383758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:59.383758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:59.383758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a799dd-7544-4219-8d6b-6902ed8be544 could not be found. Aug 29 15:47:59.383758 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:47:59.386430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b8315552-37ce-4e95-9085-5a1a6ca71b15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] Returning 404 to user: Instance 17a799dd-7544-4219-8d6b-6902ed8be544 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:59.387798 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b8315552-37ce-4e95-9085-5a1a6ca71b15 tempest-ServerShowV247Test-1309628816 tempest-ServerShowV247Test-1309628816-project] 10.222.0.62 "GET /compute/v2.1/servers/17a799dd-7544-4219-8d6b-6902ed8be544" status: 404 len: 111 microversion: 2.47 time: 0.058035 Aug 29 15:47:59.389156 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2524/5201] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:59 2022] GET /compute/v2.1/servers/17a799dd-7544-4219-8d6b-6902ed8be544 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:47:59.804667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c638539f-b257-4435-b5da-e352790cdf3f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a692b80>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:59.899786 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c638539f-b257-4435-b5da-e352790cdf3f tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.098790 Aug 29 15:47:59.904597 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2678/5202] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:59 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:00.055126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3be0f16f-f488-464a-bd83-91da3f755a5f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:00.056475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3be0f16f-f488-464a-bd83-91da3f755a5f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:00.078815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3be0f16f-f488-464a-bd83-91da3f755a5f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:00.079568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3be0f16f-f488-464a-bd83-91da3f755a5f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:00.084741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3be0f16f-f488-464a-bd83-91da3f755a5f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:00.086611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3be0f16f-f488-464a-bd83-91da3f755a5f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:00.088557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3be0f16f-f488-464a-bd83-91da3f755a5f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:00.089228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3be0f16f-f488-464a-bd83-91da3f755a5f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:00.305171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3be0f16f-f488-464a-bd83-91da3f755a5f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:00.316123 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3be0f16f-f488-464a-bd83-91da3f755a5f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.266066 Aug 29 15:48:00.328023 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2525/5203] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:00 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:00.922219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-deb6a987-c9db-4593-a988-9db505353688 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a6ef1f0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:01.031391 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-deb6a987-c9db-4593-a988-9db505353688 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.117318 Aug 29 15:48:01.033408 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2679/5204] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:00 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:01.337886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-26ff18ab-8a44-416d-a222-cc5b3205ef8c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:01.338835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-26ff18ab-8a44-416d-a222-cc5b3205ef8c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:01.351859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26ff18ab-8a44-416d-a222-cc5b3205ef8c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:01.354176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26ff18ab-8a44-416d-a222-cc5b3205ef8c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:01.354880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26ff18ab-8a44-416d-a222-cc5b3205ef8c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:01.357508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26ff18ab-8a44-416d-a222-cc5b3205ef8c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:01.358137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26ff18ab-8a44-416d-a222-cc5b3205ef8c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:01.360731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26ff18ab-8a44-416d-a222-cc5b3205ef8c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:01.411939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:01.671563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-26ff18ab-8a44-416d-a222-cc5b3205ef8c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:01.692341 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-26ff18ab-8a44-416d-a222-cc5b3205ef8c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.358961 Aug 29 15:48:01.706001 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2526/5205] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:01 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:02.049177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d2312946-360b-400c-ad1b-f5ac8919cddc tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc433c335e0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:02.132164 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d2312946-360b-400c-ad1b-f5ac8919cddc tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.088614 Aug 29 15:48:02.142533 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2680/5206] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:02 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:02.717348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-23bf2503-193a-40a7-897d-2c32e7b49267 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:02.718896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-23bf2503-193a-40a7-897d-2c32e7b49267 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:02.746289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23bf2503-193a-40a7-897d-2c32e7b49267 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:02.747718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23bf2503-193a-40a7-897d-2c32e7b49267 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:02.749211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23bf2503-193a-40a7-897d-2c32e7b49267 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:02.751477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23bf2503-193a-40a7-897d-2c32e7b49267 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:02.753477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23bf2503-193a-40a7-897d-2c32e7b49267 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:02.754511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23bf2503-193a-40a7-897d-2c32e7b49267 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:02.991032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-23bf2503-193a-40a7-897d-2c32e7b49267 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:03.015368 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-23bf2503-193a-40a7-897d-2c32e7b49267 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.302053 Aug 29 15:48:03.018102 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2527/5207] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:02 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:03.152729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fc1d5a20-744c-41ec-8777-ed5026264a83 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a692e50>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:03.221759 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fc1d5a20-744c-41ec-8777-ed5026264a83 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.073104 Aug 29 15:48:03.222342 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2681/5208] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:03 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:04.043016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dd9ac826-e093-472f-b787-675d764f9060 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:04.043644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dd9ac826-e093-472f-b787-675d764f9060 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:04.047192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:04.063272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd9ac826-e093-472f-b787-675d764f9060 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:04.063929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd9ac826-e093-472f-b787-675d764f9060 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:04.064388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd9ac826-e093-472f-b787-675d764f9060 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:04.070898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd9ac826-e093-472f-b787-675d764f9060 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:04.073691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd9ac826-e093-472f-b787-675d764f9060 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:04.076876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd9ac826-e093-472f-b787-675d764f9060 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:04.251728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-79f9cd35-200e-401a-be98-edd0542c571b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42ad0d310>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:04.323040 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-79f9cd35-200e-401a-be98-edd0542c571b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.086135 Aug 29 15:48:04.324419 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2682/5209] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:04 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:04.402562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dd9ac826-e093-472f-b787-675d764f9060 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:04.418089 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dd9ac826-e093-472f-b787-675d764f9060 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.379884 Aug 29 15:48:04.418702 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2528/5210] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:04 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:05.343138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8cba49e3-4eb8-4728-9485-0107befe6287 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a684ca0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:05.429533 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8cba49e3-4eb8-4728-9485-0107befe6287 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.091862 Aug 29 15:48:05.430136 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2683/5211] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:05 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:05.444134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d35920de-d60c-4447-9721-d34df964c71b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:05.444991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d35920de-d60c-4447-9721-d34df964c71b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:05.456317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d35920de-d60c-4447-9721-d34df964c71b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:05.465261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d35920de-d60c-4447-9721-d34df964c71b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:05.465878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d35920de-d60c-4447-9721-d34df964c71b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:05.466666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d35920de-d60c-4447-9721-d34df964c71b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:05.467172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d35920de-d60c-4447-9721-d34df964c71b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:05.467614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d35920de-d60c-4447-9721-d34df964c71b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:05.716049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d35920de-d60c-4447-9721-d34df964c71b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:05.730208 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d35920de-d60c-4447-9721-d34df964c71b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.290296 Aug 29 15:48:05.745189 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2529/5212] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:05 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:06.446466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9add8ef8-797c-4fe0-83ae-70c9a56992f6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a6fe9d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:06.542429 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9add8ef8-797c-4fe0-83ae-70c9a56992f6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.100514 Aug 29 15:48:06.547101 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2684/5213] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:06 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:06.769418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f165cbf7-3454-4b19-a6d2-5bdaac48cda1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:06.770958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f165cbf7-3454-4b19-a6d2-5bdaac48cda1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:06.798783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f165cbf7-3454-4b19-a6d2-5bdaac48cda1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:06.802474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f165cbf7-3454-4b19-a6d2-5bdaac48cda1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:06.803157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f165cbf7-3454-4b19-a6d2-5bdaac48cda1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:06.806315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f165cbf7-3454-4b19-a6d2-5bdaac48cda1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:06.809733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f165cbf7-3454-4b19-a6d2-5bdaac48cda1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:06.810733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f165cbf7-3454-4b19-a6d2-5bdaac48cda1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:07.317328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f165cbf7-3454-4b19-a6d2-5bdaac48cda1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:07.344919 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f165cbf7-3454-4b19-a6d2-5bdaac48cda1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.582694 Aug 29 15:48:07.347224 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2530/5214] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:06 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:07.561013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bcf071dc-4983-494c-9de6-c74c4e0556c2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a692d30>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:07.652738 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bcf071dc-4983-494c-9de6-c74c4e0556c2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.095751 Aug 29 15:48:07.653942 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2685/5215] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:07 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:08.383556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5ced0e33-113f-454b-9d60-bdfbe207193d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:08.384945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5ced0e33-113f-454b-9d60-bdfbe207193d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:08.417544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ced0e33-113f-454b-9d60-bdfbe207193d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:08.418050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ced0e33-113f-454b-9d60-bdfbe207193d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:08.418495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ced0e33-113f-454b-9d60-bdfbe207193d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:08.436351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ced0e33-113f-454b-9d60-bdfbe207193d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:08.437436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ced0e33-113f-454b-9d60-bdfbe207193d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:08.451935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ced0e33-113f-454b-9d60-bdfbe207193d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:08.665673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:08.672312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4dabeaa2-2290-47a0-a128-7e49f4dab6f7 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a6fee50>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:08.764359 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4dabeaa2-2290-47a0-a128-7e49f4dab6f7 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1454 microversion: 2.1 time: 0.100361 Aug 29 15:48:08.766599 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2686/5216] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:08 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:08.853555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5ced0e33-113f-454b-9d60-bdfbe207193d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:08.863979 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5ced0e33-113f-454b-9d60-bdfbe207193d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.497203 Aug 29 15:48:08.882281 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2531/5217] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:08 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:09.059693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:09.308586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-814772261", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:09.483272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] validate_networks() for [('74eea137-7f8c-43e1-bd42-582bf8562b2a', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:48:09.781899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-63fcf184-5514-4788-ae9d-d7d7930585dd tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a50e700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:09.838482 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-63fcf184-5514-4788-ae9d-d7d7930585dd tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1463 microversion: 2.1 time: 0.060392 Aug 29 15:48:09.845574 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2532/5218] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:09 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1463 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:09.856167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d07d1437-3df0-4084-bd45-630f25781257 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc4301304c0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:09.954067 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d07d1437-3df0-4084-bd45-630f25781257 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 200 len: 1463 microversion: 2.1 time: 0.096879 Aug 29 15:48:09.955815 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2533/5219] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:09 2022] GET /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 1463 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:09.974318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f946fb94-be1b-4b2a-a204-3e82810f149d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:09.975518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f946fb94-be1b-4b2a-a204-3e82810f149d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:09.983406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f946fb94-be1b-4b2a-a204-3e82810f149d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:09.984985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f946fb94-be1b-4b2a-a204-3e82810f149d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:09.985744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f946fb94-be1b-4b2a-a204-3e82810f149d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:09.987228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f946fb94-be1b-4b2a-a204-3e82810f149d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:09.988183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f946fb94-be1b-4b2a-a204-3e82810f149d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:09.990256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f946fb94-be1b-4b2a-a204-3e82810f149d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:10.159669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f946fb94-be1b-4b2a-a204-3e82810f149d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:10.160540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:48:10.161019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:48:10.161467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:48:10.161880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:48:10.162294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:48:10.168214 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f946fb94-be1b-4b2a-a204-3e82810f149d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.210915 Aug 29 15:48:10.168834 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2534/5220] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:09 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:10.172430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:10.172942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:10.173425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:10.174219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:10.174681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:10.175114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:10.175789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-916cfe03-192b-4a5b-a102-d3527d42894b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:10.176664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-916cfe03-192b-4a5b-a102-d3527d42894b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: cea653ef-b11d-4341-a1cf-e941b5f3e570] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:10.184077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-916cfe03-192b-4a5b-a102-d3527d42894b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:10.184501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-916cfe03-192b-4a5b-a102-d3527d42894b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:10.184940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-916cfe03-192b-4a5b-a102-d3527d42894b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:10.185947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-916cfe03-192b-4a5b-a102-d3527d42894b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:10.186407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-916cfe03-192b-4a5b-a102-d3527d42894b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:10.187007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-916cfe03-192b-4a5b-a102-d3527d42894b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:10.195387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Getting quotas for project d28bb9d84c3a4fa2b0ea86fc70720d13. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:10.201268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Getting quotas for user b3d1e88d25a04cfe93fdc728736b0e2d and project d28bb9d84c3a4fa2b0ea86fc70720d13. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:10.216895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:48:10.219238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:48:10.276105 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-36ec3d41-2e3b-4acb-b9a3-df3a7d44de04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.217261 Aug 29 15:48:10.276785 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2687/5221] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:48:10.288753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-50bea51e-0f79-4341-a35c-abc629b3ad26 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:10.289388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-50bea51e-0f79-4341-a35c-abc629b3ad26 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:10.386778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-50bea51e-0f79-4341-a35c-abc629b3ad26 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:10.395453 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-50bea51e-0f79-4341-a35c-abc629b3ad26 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1216 microversion: 2.1 time: 0.110247 Aug 29 15:48:10.397425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-916cfe03-192b-4a5b-a102-d3527d42894b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:10.406716 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-916cfe03-192b-4a5b-a102-d3527d42894b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570" status: 200 len: 1480 microversion: 2.1 time: 0.236627 Aug 29 15:48:10.407405 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2535/5222] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:10 2022] GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570 => generated 1480 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:10.409600 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2688/5223] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:10 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1216 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:11.190160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7bb8d127-c9a2-45a7-8e02-648661fc6b3a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:11.190866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7bb8d127-c9a2-45a7-8e02-648661fc6b3a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:11.211237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bb8d127-c9a2-45a7-8e02-648661fc6b3a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:11.212683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bb8d127-c9a2-45a7-8e02-648661fc6b3a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:11.213426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bb8d127-c9a2-45a7-8e02-648661fc6b3a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:11.214374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bb8d127-c9a2-45a7-8e02-648661fc6b3a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:11.214972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bb8d127-c9a2-45a7-8e02-648661fc6b3a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:11.215586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bb8d127-c9a2-45a7-8e02-648661fc6b3a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:11.417097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2abc0579-dcc4-4646-b020-231b07a033a5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:11.418656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2abc0579-dcc4-4646-b020-231b07a033a5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:11.433644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2abc0579-dcc4-4646-b020-231b07a033a5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:11.434306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2abc0579-dcc4-4646-b020-231b07a033a5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:11.436185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2abc0579-dcc4-4646-b020-231b07a033a5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:11.437248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2abc0579-dcc4-4646-b020-231b07a033a5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:11.440526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2abc0579-dcc4-4646-b020-231b07a033a5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:11.441292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2abc0579-dcc4-4646-b020-231b07a033a5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:11.478185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7bb8d127-c9a2-45a7-8e02-648661fc6b3a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:11.490036 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7bb8d127-c9a2-45a7-8e02-648661fc6b3a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.303852 Aug 29 15:48:11.493803 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2536/5224] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:11 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:11.502153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-63d4eb2e-b466-4922-9715-ca1a6d8a47a8 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:11.503145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-63d4eb2e-b466-4922-9715-ca1a6d8a47a8 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: cea653ef-b11d-4341-a1cf-e941b5f3e570] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:11.512668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63d4eb2e-b466-4922-9715-ca1a6d8a47a8 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:11.513731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63d4eb2e-b466-4922-9715-ca1a6d8a47a8 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:11.515350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63d4eb2e-b466-4922-9715-ca1a6d8a47a8 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:11.516581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63d4eb2e-b466-4922-9715-ca1a6d8a47a8 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:11.517494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63d4eb2e-b466-4922-9715-ca1a6d8a47a8 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:11.518292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63d4eb2e-b466-4922-9715-ca1a6d8a47a8 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:11.596772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2abc0579-dcc4-4646-b020-231b07a033a5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:11.615941 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2abc0579-dcc4-4646-b020-231b07a033a5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1268 microversion: 2.1 time: 0.203324 Aug 29 15:48:11.616608 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2689/5225] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:11 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1268 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:11.768798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-63d4eb2e-b466-4922-9715-ca1a6d8a47a8 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:11.819217 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-63d4eb2e-b466-4922-9715-ca1a6d8a47a8 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570" status: 200 len: 1467 microversion: 2.1 time: 0.319373 Aug 29 15:48:11.821020 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2537/5226] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:11 2022] GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570 => generated 1467 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:11.850942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7bd7df0e-897e-4f1f-bb2d-c36cb275f8ca tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a684af0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:12.053391 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7bd7df0e-897e-4f1f-bb2d-c36cb275f8ca tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images?changes-since=2022-08-29T15%3A46%3A01Z" status: 200 len: 2375 microversion: 2.1 time: 0.214631 Aug 29 15:48:12.064014 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2690/5227] 10.222.0.62 () {58 vars in 1199 bytes} [Mon Aug 29 15:48:11 2022] GET /compute/v2.1/images?changes-since=2022-08-29T15%3A46%3A01Z => generated 2375 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:12.071640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6f29f863-9e3d-48fa-9a46-f2d3919d1dac tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b013820>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:12.199588 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6f29f863-9e3d-48fa-9a46-f2d3919d1dac tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-422687931" status: 200 len: 484 microversion: 2.1 time: 0.134954 Aug 29 15:48:12.202705 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2538/5228] 10.222.0.62 () {58 vars in 1229 bytes} [Mon Aug 29 15:48:12 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-422687931 => generated 484 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:48:12.217909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0f28f169-2301-48b6-9c45-10182590ecea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a6b51f0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:12.350603 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0f28f169-2301-48b6-9c45-10182590ecea tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images?server=cea653ef-b11d-4341-a1cf-e941b5f3e570" status: 200 len: 956 microversion: 2.1 time: 0.140221 Aug 29 15:48:12.351934 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2691/5229] 10.222.0.62 () {58 vars in 1209 bytes} [Mon Aug 29 15:48:12 2022] GET /compute/v2.1/images?server=cea653ef-b11d-4341-a1cf-e941b5f3e570 => generated 956 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:12.366340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-872616cc-29c5-44f7-8aa1-6dd24f3d25d5 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b6f1ee0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:12.434446 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-872616cc-29c5-44f7-8aa1-6dd24f3d25d5 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.62%2Fcompute%2Fv2.1%2Fservers%2F698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 485 microversion: 2.1 time: 0.071835 Aug 29 15:48:12.435814 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2539/5230] 10.222.0.62 () {58 vars in 1317 bytes} [Mon Aug 29 15:48:12 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.62%2Fcompute%2Fv2.1%2Fservers%2F698e4c74-b063-4ffc-bbd9-9154af832815 => generated 485 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:48:12.454770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bf10a924-30de-47fe-a9ad-cedb898f34d3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a6e5700>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:12.519017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-adeb59b1-4ff0-4f5f-9a56-e7c05cabea77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:12.519971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-adeb59b1-4ff0-4f5f-9a56-e7c05cabea77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:12.532732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adeb59b1-4ff0-4f5f-9a56-e7c05cabea77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:12.536647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adeb59b1-4ff0-4f5f-9a56-e7c05cabea77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:12.537677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adeb59b1-4ff0-4f5f-9a56-e7c05cabea77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:12.538460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adeb59b1-4ff0-4f5f-9a56-e7c05cabea77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:12.540116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adeb59b1-4ff0-4f5f-9a56-e7c05cabea77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:12.540756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adeb59b1-4ff0-4f5f-9a56-e7c05cabea77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:12.585207 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bf10a924-30de-47fe-a9ad-cedb898f34d3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.62%2Fcompute%2Fservers%2F698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 485 microversion: 2.1 time: 0.137188 Aug 29 15:48:12.586096 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2692/5231] 10.222.0.62 () {58 vars in 1303 bytes} [Mon Aug 29 15:48:12 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.62%2Fcompute%2Fservers%2F698e4c74-b063-4ffc-bbd9-9154af832815 => generated 485 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:12.599834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-81b174ab-caf2-4462-a353-feb4ea07909c tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a6b5f70>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:12.742619 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-81b174ab-caf2-4462-a353-feb4ea07909c tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.146849 Aug 29 15:48:12.743557 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2693/5232] 10.222.0.62 () {58 vars in 1149 bytes} [Mon Aug 29 15:48:12 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:12.749108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-99309485-ee98-4a58-b82e-2bb10d08e1a7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:12.750047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-99309485-ee98-4a58-b82e-2bb10d08e1a7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:12.762764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99309485-ee98-4a58-b82e-2bb10d08e1a7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:12.763848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99309485-ee98-4a58-b82e-2bb10d08e1a7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:12.764479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99309485-ee98-4a58-b82e-2bb10d08e1a7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:12.765702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99309485-ee98-4a58-b82e-2bb10d08e1a7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:12.766347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99309485-ee98-4a58-b82e-2bb10d08e1a7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:12.766996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99309485-ee98-4a58-b82e-2bb10d08e1a7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:12.872015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-adeb59b1-4ff0-4f5f-9a56-e7c05cabea77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:12.897691 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-adeb59b1-4ff0-4f5f-9a56-e7c05cabea77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.382854 Aug 29 15:48:12.898903 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2540/5233] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:12 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:12.905016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-df26b431-f1e2-477d-adf0-63817dba29c9 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42ba451f0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:13.050766 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-df26b431-f1e2-477d-adf0-63817dba29c9 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.150356 Aug 29 15:48:13.051466 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2541/5234] 10.222.0.62 () {58 vars in 1149 bytes} [Mon Aug 29 15:48:12 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:13.065714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7f0254ac-1cae-429c-94c7-c03458f5e693 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42aa12e50>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:13.272422 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7f0254ac-1cae-429c-94c7-c03458f5e693 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.211158 Aug 29 15:48:13.274090 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2542/5235] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:48:13 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:48:13.287973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e59561e6-3a68-49cb-a94d-9d212c94dfbd tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b745790>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:13.442696 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e59561e6-3a68-49cb-a94d-9d212c94dfbd tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/detail?changes-since=2022-08-29T15%3A45%3A58Z" status: 200 len: 6333 microversion: 2.1 time: 0.159291 Aug 29 15:48:13.443306 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2543/5236] 10.222.0.62 () {58 vars in 1220 bytes} [Mon Aug 29 15:48:13 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-29T15%3A45%3A58Z => generated 6333 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:13.468607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2d5c43a5-cd24-42f6-8b98-f66c293992fd tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b013820>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:13.469517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-99309485-ee98-4a58-b82e-2bb10d08e1a7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:13.484665 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-99309485-ee98-4a58-b82e-2bb10d08e1a7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1274 microversion: 2.1 time: 0.737384 Aug 29 15:48:13.485189 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2694/5237] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:12 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1274 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:13.600636 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2d5c43a5-cd24-42f6-8b98-f66c293992fd tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-422687931" status: 200 len: 664 microversion: 2.1 time: 0.139880 Aug 29 15:48:13.601767 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2544/5238] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Aug 29 15:48:13 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-422687931 => generated 664 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:13.620838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b7de37a-1f6c-4535-bbad-0410db35cf94 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a6e5820>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:13.693942 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8b7de37a-1f6c-4535-bbad-0410db35cf94 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.62%2Fcompute%2Fv2.1%2Fservers%2F698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1467 microversion: 2.1 time: 0.077378 Aug 29 15:48:13.694508 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2695/5239] 10.222.0.62 () {58 vars in 1338 bytes} [Mon Aug 29 15:48:13 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.62%2Fcompute%2Fv2.1%2Fservers%2F698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1467 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:13.710276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-73969668-d6ff-4469-99af-d6ad892104de tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42ba6fee0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:13.794245 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-73969668-d6ff-4469-99af-d6ad892104de tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.62%2Fcompute%2Fservers%2F698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1467 microversion: 2.1 time: 0.087989 Aug 29 15:48:13.813404 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2545/5240] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Aug 29 15:48:13 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.62%2Fcompute%2Fservers%2F698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1467 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:13.817043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5f7592b2-b306-4fff-a201-1f1bca270221 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b5475e0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:13.922251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-565f702c-96b9-4a18-8cf9-84616b37de77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:13.923124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-565f702c-96b9-4a18-8cf9-84616b37de77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:13.951198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-565f702c-96b9-4a18-8cf9-84616b37de77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.952767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-565f702c-96b9-4a18-8cf9-84616b37de77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.954136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-565f702c-96b9-4a18-8cf9-84616b37de77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.955808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-565f702c-96b9-4a18-8cf9-84616b37de77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.959094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-565f702c-96b9-4a18-8cf9-84616b37de77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.961375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-565f702c-96b9-4a18-8cf9-84616b37de77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.970958 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5f7592b2-b306-4fff-a201-1f1bca270221 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.159649 Aug 29 15:48:13.993714 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2696/5241] 10.222.0.62 () {58 vars in 1170 bytes} [Mon Aug 29 15:48:13 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:14.000706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-56160483-e399-453f-96ba-d4f6950d2cb6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a6e5280>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:14.116452 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-56160483-e399-453f-96ba-d4f6950d2cb6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.119664 Aug 29 15:48:14.128196 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2697/5242] 10.222.0.62 () {58 vars in 1170 bytes} [Mon Aug 29 15:48:13 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:14.137364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7c1eb1ec-46b7-4432-8503-955149c51891 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a6afc10>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:14.190080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-565f702c-96b9-4a18-8cf9-84616b37de77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:14.199505 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-565f702c-96b9-4a18-8cf9-84616b37de77 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.282001 Aug 29 15:48:14.207235 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7c1eb1ec-46b7-4432-8503-955149c51891 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/2c042d4c-e5f7-47c3-ac9e-1fb093df192c" status: 200 len: 784 microversion: 2.1 time: 0.075092 Aug 29 15:48:14.219418 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2546/5243] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:13 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:14.220229 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2698/5244] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:14 2022] GET /compute/v2.1/images/2c042d4c-e5f7-47c3-ac9e-1fb093df192c => generated 784 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:48:14.236000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fea4282c-0019-4441-b367-23df5a1c19a4 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42badb4c0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:14.304863 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fea4282c-0019-4441-b367-23df5a1c19a4 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.072697 Aug 29 15:48:14.310232 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2547/5245] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 15:48:14 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:14.321973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7bb7192d-caac-4ccd-ad11-8e8c52b27b5b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a6af4c0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:14.509905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e4815179-52ce-4bc2-91f1-b4cea2088dbe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:14.511451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e4815179-52ce-4bc2-91f1-b4cea2088dbe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:14.520353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4815179-52ce-4bc2-91f1-b4cea2088dbe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:14.521418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4815179-52ce-4bc2-91f1-b4cea2088dbe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:14.522246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4815179-52ce-4bc2-91f1-b4cea2088dbe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:14.524077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4815179-52ce-4bc2-91f1-b4cea2088dbe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:14.525219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4815179-52ce-4bc2-91f1-b4cea2088dbe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:14.526507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4815179-52ce-4bc2-91f1-b4cea2088dbe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:14.706849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e4815179-52ce-4bc2-91f1-b4cea2088dbe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:14.721346 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e4815179-52ce-4bc2-91f1-b4cea2088dbe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1316 microversion: 2.1 time: 0.217190 Aug 29 15:48:14.722519 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2548/5246] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:14 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:14.901169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-e3a9c28e-5d91-4411-b117-a3025d8bf3db req-3d4594fa-79eb-4e4a-a9ab-c13b058441e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea653ef-b11d-4341-a1cf-e941b5f3e570", "name": "network-vif-unplugged", "status": "completed", "tag": "efc5b7ae-1aab-49aa-938d-1d74e0bd4507"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:14.917290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e3a9c28e-5d91-4411-b117-a3025d8bf3db req-3d4594fa-79eb-4e4a-a9ab-c13b058441e8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:14.917801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e3a9c28e-5d91-4411-b117-a3025d8bf3db req-3d4594fa-79eb-4e4a-a9ab-c13b058441e8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:14.924215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e3a9c28e-5d91-4411-b117-a3025d8bf3db req-3d4594fa-79eb-4e4a-a9ab-c13b058441e8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:14.952503 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-e3a9c28e-5d91-4411-b117-a3025d8bf3db req-3d4594fa-79eb-4e4a-a9ab-c13b058441e8 service nova] Creating event network-vif-unplugged:efc5b7ae-1aab-49aa-938d-1d74e0bd4507 for instance cea653ef-b11d-4341-a1cf-e941b5f3e570 on n-h1-839401-11 Aug 29 15:48:14.960994 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-e3a9c28e-5d91-4411-b117-a3025d8bf3db req-3d4594fa-79eb-4e4a-a9ab-c13b058441e8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063888 Aug 29 15:48:14.963861 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2549/5247] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:15.178899 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7bb7192d-caac-4ccd-ad11-8e8c52b27b5b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "DELETE /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d" status: 204 len: 0 microversion: 2.1 time: 0.860507 Aug 29 15:48:15.181392 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2699/5248] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:14 2022] DELETE /compute/v2.1/images/194a6d6f-0bc2-4d29-a7fc-0d7117c7d49d => generated 0 bytes in 864 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:48:15.207558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b610171a-5ae9-460b-bb22-0ab74492ffbe tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42b86c940>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:15.218620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-aa064b07-7fba-4c15-ab99-9b3fcfe95878 req-5f8328da-bd48-4a06-b0dd-10b05040623b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0fd8c4a-7225-496b-a071-6fd8f37dc60a", "tag": "8dc04ade-2041-4d24-bbaf-7f8f25a7e827"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:15.259545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-aa064b07-7fba-4c15-ab99-9b3fcfe95878 req-5f8328da-bd48-4a06-b0dd-10b05040623b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:15.263691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-aa064b07-7fba-4c15-ab99-9b3fcfe95878 req-5f8328da-bd48-4a06-b0dd-10b05040623b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:15.264155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-aa064b07-7fba-4c15-ab99-9b3fcfe95878 req-5f8328da-bd48-4a06-b0dd-10b05040623b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:15.285487 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-aa064b07-7fba-4c15-ab99-9b3fcfe95878 req-5f8328da-bd48-4a06-b0dd-10b05040623b service nova] Creating event network-changed:8dc04ade-2041-4d24-bbaf-7f8f25a7e827 for instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a on n-h1-839401-11 Aug 29 15:48:15.299566 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-aa064b07-7fba-4c15-ab99-9b3fcfe95878 req-5f8328da-bd48-4a06-b0dd-10b05040623b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098689 Aug 29 15:48:15.300963 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2700/5249] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:15.306810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d8dc5307-0159-4147-b814-70415168f65e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:15.307729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d8dc5307-0159-4147-b814-70415168f65e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:15.314914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8dc5307-0159-4147-b814-70415168f65e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:15.315809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8dc5307-0159-4147-b814-70415168f65e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:15.316438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8dc5307-0159-4147-b814-70415168f65e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:15.317370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8dc5307-0159-4147-b814-70415168f65e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:15.317996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8dc5307-0159-4147-b814-70415168f65e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:15.318592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8dc5307-0159-4147-b814-70415168f65e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:15.828758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d8dc5307-0159-4147-b814-70415168f65e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:15.840763 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d8dc5307-0159-4147-b814-70415168f65e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.538389 Aug 29 15:48:15.843168 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2701/5250] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:15 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:15.848608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3c2bb192-3f4a-4ac7-a942-f033f25ef479 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:15.851284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3c2bb192-3f4a-4ac7-a942-f033f25ef479 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:15.857815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c2bb192-3f4a-4ac7-a942-f033f25ef479 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:15.858487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c2bb192-3f4a-4ac7-a942-f033f25ef479 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:15.859098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c2bb192-3f4a-4ac7-a942-f033f25ef479 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:15.859960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c2bb192-3f4a-4ac7-a942-f033f25ef479 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:15.860573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c2bb192-3f4a-4ac7-a942-f033f25ef479 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:15.873510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3c2bb192-3f4a-4ac7-a942-f033f25ef479 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:16.110919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3c2bb192-3f4a-4ac7-a942-f033f25ef479 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:16.121922 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3c2bb192-3f4a-4ac7-a942-f033f25ef479 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1316 microversion: 2.1 time: 0.276345 Aug 29 15:48:16.123096 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2702/5251] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:15 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:16.153752 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b610171a-5ae9-460b-bb22-0ab74492ffbe tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "DELETE /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba" status: 204 len: 0 microversion: 2.1 time: 0.965004 Aug 29 15:48:16.154471 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2550/5252] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:15 2022] DELETE /compute/v2.1/images/d47e6259-9554-4a38-b6f0-f901ce2c4aba => generated 0 bytes in 970 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:48:16.163415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fa7753de-5689-44ba-a808-9dcc557113b9 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42a6e51f0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:16.877722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a6f21873-f46c-41d1-b350-7489b66f6e50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:16.878443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a6f21873-f46c-41d1-b350-7489b66f6e50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:16.884937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6f21873-f46c-41d1-b350-7489b66f6e50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:16.885869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6f21873-f46c-41d1-b350-7489b66f6e50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:16.886305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6f21873-f46c-41d1-b350-7489b66f6e50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:16.886992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6f21873-f46c-41d1-b350-7489b66f6e50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:16.887515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6f21873-f46c-41d1-b350-7489b66f6e50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:16.887967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6f21873-f46c-41d1-b350-7489b66f6e50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:16.982480 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fa7753de-5689-44ba-a808-9dcc557113b9 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "DELETE /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a" status: 204 len: 0 microversion: 2.1 time: 0.823572 Aug 29 15:48:16.983108 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2703/5253] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:16 2022] DELETE /compute/v2.1/images/384d4cf4-0782-4385-88e8-89fb6d94865a => generated 0 bytes in 825 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:48:16.991526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-335751bf-6946-4345-856e-0a5010451969 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:16.992034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-335751bf-6946-4345-856e-0a5010451969 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:16.998821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-335751bf-6946-4345-856e-0a5010451969 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:16.999308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-335751bf-6946-4345-856e-0a5010451969 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:16.999753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-335751bf-6946-4345-856e-0a5010451969 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:17.000461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-335751bf-6946-4345-856e-0a5010451969 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:17.000922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-335751bf-6946-4345-856e-0a5010451969 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:17.001603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-335751bf-6946-4345-856e-0a5010451969 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:17.029284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-335751bf-6946-4345-856e-0a5010451969 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:48:17.037273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a6f21873-f46c-41d1-b350-7489b66f6e50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:17.044745 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a6f21873-f46c-41d1-b350-7489b66f6e50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.171628 Aug 29 15:48:17.045468 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2551/5254] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:16 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:17.117481 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-335751bf-6946-4345-856e-0a5010451969 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "DELETE /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 204 len: 0 microversion: 2.1 time: 0.129340 Aug 29 15:48:17.118235 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2704/5255] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:48:16 2022] DELETE /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:48:17.128714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-91a90ed3-0554-456a-9d84-6eaa32285f6b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:17.129375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-91a90ed3-0554-456a-9d84-6eaa32285f6b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:17.136442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91a90ed3-0554-456a-9d84-6eaa32285f6b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:17.136940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91a90ed3-0554-456a-9d84-6eaa32285f6b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:17.137411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91a90ed3-0554-456a-9d84-6eaa32285f6b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:17.138215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91a90ed3-0554-456a-9d84-6eaa32285f6b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:17.138677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91a90ed3-0554-456a-9d84-6eaa32285f6b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:17.139100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91a90ed3-0554-456a-9d84-6eaa32285f6b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:17.144561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-30959351-c8ee-4407-b33d-3255df059a4c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:17.145294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-30959351-c8ee-4407-b33d-3255df059a4c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:17.151437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30959351-c8ee-4407-b33d-3255df059a4c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:17.152124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30959351-c8ee-4407-b33d-3255df059a4c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:17.152571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30959351-c8ee-4407-b33d-3255df059a4c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:17.153570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30959351-c8ee-4407-b33d-3255df059a4c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:17.154430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30959351-c8ee-4407-b33d-3255df059a4c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:17.154855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30959351-c8ee-4407-b33d-3255df059a4c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:17.289639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-91a90ed3-0554-456a-9d84-6eaa32285f6b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:17.295205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-30959351-c8ee-4407-b33d-3255df059a4c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:17.298438 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-91a90ed3-0554-456a-9d84-6eaa32285f6b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1473 microversion: 2.1 time: 0.175241 Aug 29 15:48:17.299643 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2552/5256] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:17 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1473 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:17.305314 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-30959351-c8ee-4407-b33d-3255df059a4c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1316 microversion: 2.1 time: 0.165436 Aug 29 15:48:17.309279 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2705/5257] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:17 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:18.066503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-63b64b37-f4b4-4b34-8048-a619a0cff9dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:18.067117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-63b64b37-f4b4-4b34-8048-a619a0cff9dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:18.073791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63b64b37-f4b4-4b34-8048-a619a0cff9dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.074736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63b64b37-f4b4-4b34-8048-a619a0cff9dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.075459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63b64b37-f4b4-4b34-8048-a619a0cff9dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.076271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63b64b37-f4b4-4b34-8048-a619a0cff9dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.076833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63b64b37-f4b4-4b34-8048-a619a0cff9dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.077656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63b64b37-f4b4-4b34-8048-a619a0cff9dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.231128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-63b64b37-f4b4-4b34-8048-a619a0cff9dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:18.239709 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-63b64b37-f4b4-4b34-8048-a619a0cff9dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.177667 Aug 29 15:48:18.240536 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2553/5258] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:18 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:18.322269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a33607a8-b671-4aec-9f62-6f88739156c9 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:18.323310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a33607a8-b671-4aec-9f62-6f88739156c9 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:18.328883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-38e1b2ae-75fc-4648-922d-ee98e4a4342a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:18.330159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-38e1b2ae-75fc-4648-922d-ee98e4a4342a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:18.332610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a33607a8-b671-4aec-9f62-6f88739156c9 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.333404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a33607a8-b671-4aec-9f62-6f88739156c9 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.334896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a33607a8-b671-4aec-9f62-6f88739156c9 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.335722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a33607a8-b671-4aec-9f62-6f88739156c9 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.336333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a33607a8-b671-4aec-9f62-6f88739156c9 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.337012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a33607a8-b671-4aec-9f62-6f88739156c9 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.338708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e1b2ae-75fc-4648-922d-ee98e4a4342a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.339487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e1b2ae-75fc-4648-922d-ee98e4a4342a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.340180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e1b2ae-75fc-4648-922d-ee98e4a4342a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.341077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e1b2ae-75fc-4648-922d-ee98e4a4342a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.342465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e1b2ae-75fc-4648-922d-ee98e4a4342a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.343098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e1b2ae-75fc-4648-922d-ee98e4a4342a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.549622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-38e1b2ae-75fc-4648-922d-ee98e4a4342a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:18.554469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:18.560278 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-38e1b2ae-75fc-4648-922d-ee98e4a4342a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1316 microversion: 2.1 time: 0.237581 Aug 29 15:48:18.560913 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2554/5259] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:18 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1316 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:18.592321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a33607a8-b671-4aec-9f62-6f88739156c9 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:18.600897 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a33607a8-b671-4aec-9f62-6f88739156c9 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1473 microversion: 2.1 time: 0.284753 Aug 29 15:48:18.601526 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2706/5260] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:18 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1473 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:19.017815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cb7a73a1-3268-41f0-a47d-a52b68fb22b7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:19.018367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cb7a73a1-3268-41f0-a47d-a52b68fb22b7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:19.026503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb7a73a1-3268-41f0-a47d-a52b68fb22b7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.027249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb7a73a1-3268-41f0-a47d-a52b68fb22b7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.027853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb7a73a1-3268-41f0-a47d-a52b68fb22b7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.028762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb7a73a1-3268-41f0-a47d-a52b68fb22b7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.029428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb7a73a1-3268-41f0-a47d-a52b68fb22b7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.030011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb7a73a1-3268-41f0-a47d-a52b68fb22b7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.060181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cb7a73a1-3268-41f0-a47d-a52b68fb22b7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:48:19.166341 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cb7a73a1-3268-41f0-a47d-a52b68fb22b7 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 204 len: 0 microversion: 2.32 time: 0.430722 Aug 29 15:48:19.167283 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2555/5261] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:48:18 2022] DELETE /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:48:19.176668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e222775d-6f3c-4cee-87e0-2ba790835267 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:19.178968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e222775d-6f3c-4cee-87e0-2ba790835267 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:19.202265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e222775d-6f3c-4cee-87e0-2ba790835267 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.203463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e222775d-6f3c-4cee-87e0-2ba790835267 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.204523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e222775d-6f3c-4cee-87e0-2ba790835267 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.205917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e222775d-6f3c-4cee-87e0-2ba790835267 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.206744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e222775d-6f3c-4cee-87e0-2ba790835267 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.207783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e222775d-6f3c-4cee-87e0-2ba790835267 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.265965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e295247-8ef1-4ffc-9f2b-9660cd492aa7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:19.267003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9e295247-8ef1-4ffc-9f2b-9660cd492aa7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:19.283593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e295247-8ef1-4ffc-9f2b-9660cd492aa7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.284422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e295247-8ef1-4ffc-9f2b-9660cd492aa7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.284970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e295247-8ef1-4ffc-9f2b-9660cd492aa7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.286104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e295247-8ef1-4ffc-9f2b-9660cd492aa7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.286763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e295247-8ef1-4ffc-9f2b-9660cd492aa7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.287296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e295247-8ef1-4ffc-9f2b-9660cd492aa7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.458291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e222775d-6f3c-4cee-87e0-2ba790835267 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:19.471099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9e295247-8ef1-4ffc-9f2b-9660cd492aa7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:19.480243 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9e295247-8ef1-4ffc-9f2b-9660cd492aa7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.220971 Aug 29 15:48:19.484628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e222775d-6f3c-4cee-87e0-2ba790835267 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:19.486103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e222775d-6f3c-4cee-87e0-2ba790835267 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:19.487978 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2556/5262] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:19 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:19.488400 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e222775d-6f3c-4cee-87e0-2ba790835267 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 2953 microversion: 2.32 time: 0.315504 Aug 29 15:48:19.489615 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2707/5263] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:19 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 2953 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:19.584070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d6fcd106-f79e-4f16-858e-8a8a4fd24bdd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:19.585138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d6fcd106-f79e-4f16-858e-8a8a4fd24bdd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:19.593038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6fcd106-f79e-4f16-858e-8a8a4fd24bdd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.594085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6fcd106-f79e-4f16-858e-8a8a4fd24bdd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.594579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6fcd106-f79e-4f16-858e-8a8a4fd24bdd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.595396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6fcd106-f79e-4f16-858e-8a8a4fd24bdd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.596403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6fcd106-f79e-4f16-858e-8a8a4fd24bdd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.597213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6fcd106-f79e-4f16-858e-8a8a4fd24bdd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.623630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cfe4683b-9e9c-488d-88de-3596792a58b4 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:19.624514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cfe4683b-9e9c-488d-88de-3596792a58b4 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:19.633010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfe4683b-9e9c-488d-88de-3596792a58b4 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.633540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfe4683b-9e9c-488d-88de-3596792a58b4 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.634155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfe4683b-9e9c-488d-88de-3596792a58b4 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.635058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfe4683b-9e9c-488d-88de-3596792a58b4 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.635838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfe4683b-9e9c-488d-88de-3596792a58b4 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.636267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cfe4683b-9e9c-488d-88de-3596792a58b4 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.757984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d6fcd106-f79e-4f16-858e-8a8a4fd24bdd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:19.766341 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d6fcd106-f79e-4f16-858e-8a8a4fd24bdd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1316 microversion: 2.1 time: 0.187398 Aug 29 15:48:19.766928 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2557/5264] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:19 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:19.848889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cfe4683b-9e9c-488d-88de-3596792a58b4 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:19.857272 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cfe4683b-9e9c-488d-88de-3596792a58b4 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1473 microversion: 2.1 time: 0.237681 Aug 29 15:48:19.858306 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2708/5265] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:19 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1473 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:20.514951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-496cf520-fbad-4132-82b4-598d20b8fa55 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:20.519351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9a193ffe-b05c-4e48-82c3-ec3a99888452 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:20.520248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9a193ffe-b05c-4e48-82c3-ec3a99888452 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:20.524724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-496cf520-fbad-4132-82b4-598d20b8fa55 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:20.526894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:20.528424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:20.535365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a193ffe-b05c-4e48-82c3-ec3a99888452 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:20.535864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a193ffe-b05c-4e48-82c3-ec3a99888452 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:20.538145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a193ffe-b05c-4e48-82c3-ec3a99888452 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.540047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-496cf520-fbad-4132-82b4-598d20b8fa55 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:20.540529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-496cf520-fbad-4132-82b4-598d20b8fa55 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:20.541464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a193ffe-b05c-4e48-82c3-ec3a99888452 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:20.541927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a193ffe-b05c-4e48-82c3-ec3a99888452 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:20.542362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9a193ffe-b05c-4e48-82c3-ec3a99888452 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.547036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-496cf520-fbad-4132-82b4-598d20b8fa55 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.547760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-496cf520-fbad-4132-82b4-598d20b8fa55 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:20.548402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-496cf520-fbad-4132-82b4-598d20b8fa55 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:20.549000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-496cf520-fbad-4132-82b4-598d20b8fa55 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.701250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9a193ffe-b05c-4e48-82c3-ec3a99888452 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:20.709962 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9a193ffe-b05c-4e48-82c3-ec3a99888452 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.194373 Aug 29 15:48:20.711158 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2558/5266] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:20 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:20.768117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-496cf520-fbad-4132-82b4-598d20b8fa55 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:20.777407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-496cf520-fbad-4132-82b4-598d20b8fa55 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:20.778839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-496cf520-fbad-4132-82b4-598d20b8fa55 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:20.780123 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-496cf520-fbad-4132-82b4-598d20b8fa55 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 2953 microversion: 2.32 time: 0.269496 Aug 29 15:48:20.780861 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2709/5267] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:20 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 2953 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:20.790297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-272e3ec7-2b96-4e9c-8528-5a6698773303 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:20.790297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-272e3ec7-2b96-4e9c-8528-5a6698773303 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:20.798694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-272e3ec7-2b96-4e9c-8528-5a6698773303 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:20.798694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-272e3ec7-2b96-4e9c-8528-5a6698773303 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:20.798694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-272e3ec7-2b96-4e9c-8528-5a6698773303 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.798995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-272e3ec7-2b96-4e9c-8528-5a6698773303 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:20.799341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-272e3ec7-2b96-4e9c-8528-5a6698773303 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:20.799763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-272e3ec7-2b96-4e9c-8528-5a6698773303 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.882077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-16ba6453-e3ba-4f67-a21a-94073c9c5a66 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:20.882797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-16ba6453-e3ba-4f67-a21a-94073c9c5a66 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:20.891527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ba6453-e3ba-4f67-a21a-94073c9c5a66 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:20.892206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ba6453-e3ba-4f67-a21a-94073c9c5a66 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:20.892876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ba6453-e3ba-4f67-a21a-94073c9c5a66 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.893771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ba6453-e3ba-4f67-a21a-94073c9c5a66 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:20.894375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ba6453-e3ba-4f67-a21a-94073c9c5a66 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:20.894956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16ba6453-e3ba-4f67-a21a-94073c9c5a66 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.948715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-272e3ec7-2b96-4e9c-8528-5a6698773303 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:20.958365 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-272e3ec7-2b96-4e9c-8528-5a6698773303 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1316 microversion: 2.1 time: 0.175579 Aug 29 15:48:20.965533 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2559/5268] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:20 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:21.044963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-16ba6453-e3ba-4f67-a21a-94073c9c5a66 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:21.060358 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-16ba6453-e3ba-4f67-a21a-94073c9c5a66 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1473 microversion: 2.1 time: 0.184104 Aug 29 15:48:21.060961 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2710/5269] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:20 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1473 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:21.732076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b498d504-e072-4a36-a9cb-932c5c5a2f31 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:21.732748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b498d504-e072-4a36-a9cb-932c5c5a2f31 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:21.740374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b498d504-e072-4a36-a9cb-932c5c5a2f31 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.740934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b498d504-e072-4a36-a9cb-932c5c5a2f31 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.741468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b498d504-e072-4a36-a9cb-932c5c5a2f31 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.742185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b498d504-e072-4a36-a9cb-932c5c5a2f31 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.742710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b498d504-e072-4a36-a9cb-932c5c5a2f31 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.743118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b498d504-e072-4a36-a9cb-932c5c5a2f31 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.806265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4454a991-baea-47a0-bc2a-d9b3a38abc8f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:21.807521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4454a991-baea-47a0-bc2a-d9b3a38abc8f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:21.815902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4454a991-baea-47a0-bc2a-d9b3a38abc8f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.816635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4454a991-baea-47a0-bc2a-d9b3a38abc8f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.817070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4454a991-baea-47a0-bc2a-d9b3a38abc8f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.817799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4454a991-baea-47a0-bc2a-d9b3a38abc8f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.818247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4454a991-baea-47a0-bc2a-d9b3a38abc8f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.818692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4454a991-baea-47a0-bc2a-d9b3a38abc8f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.886912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b498d504-e072-4a36-a9cb-932c5c5a2f31 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:21.896049 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b498d504-e072-4a36-a9cb-932c5c5a2f31 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.167932 Aug 29 15:48:21.896904 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2560/5270] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:21 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:21.982145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-167cbef3-bb02-447b-af63-f93a28722406 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:21.982785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-167cbef3-bb02-447b-af63-f93a28722406 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:21.991969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-167cbef3-bb02-447b-af63-f93a28722406 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.992765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-167cbef3-bb02-447b-af63-f93a28722406 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.993973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-167cbef3-bb02-447b-af63-f93a28722406 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.994962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-167cbef3-bb02-447b-af63-f93a28722406 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.996143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-167cbef3-bb02-447b-af63-f93a28722406 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.996786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-167cbef3-bb02-447b-af63-f93a28722406 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:22.048804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4454a991-baea-47a0-bc2a-d9b3a38abc8f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:22.062358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4454a991-baea-47a0-bc2a-d9b3a38abc8f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:22.063846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4454a991-baea-47a0-bc2a-d9b3a38abc8f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:22.065152 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4454a991-baea-47a0-bc2a-d9b3a38abc8f tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 2953 microversion: 2.32 time: 0.262974 Aug 29 15:48:22.065761 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2711/5271] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:21 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 2953 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:22.082259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2dfa4946-5ed3-4975-acea-8f4900240ef6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:22.082923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2dfa4946-5ed3-4975-acea-8f4900240ef6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:22.089685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dfa4946-5ed3-4975-acea-8f4900240ef6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:22.090408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dfa4946-5ed3-4975-acea-8f4900240ef6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:22.091277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dfa4946-5ed3-4975-acea-8f4900240ef6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:22.091986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dfa4946-5ed3-4975-acea-8f4900240ef6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:22.092913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dfa4946-5ed3-4975-acea-8f4900240ef6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:22.092913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dfa4946-5ed3-4975-acea-8f4900240ef6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:22.155584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-167cbef3-bb02-447b-af63-f93a28722406 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:22.165898 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-167cbef3-bb02-447b-af63-f93a28722406 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1316 microversion: 2.1 time: 0.190502 Aug 29 15:48:22.169780 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2561/5272] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:21 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:22.270917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2dfa4946-5ed3-4975-acea-8f4900240ef6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:22.279340 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2dfa4946-5ed3-4975-acea-8f4900240ef6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1473 microversion: 2.1 time: 0.201960 Aug 29 15:48:22.279918 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2712/5273] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:22 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1473 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:22.911698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-ed8ba6bd-4a07-49be-8881-39619509a662 req-8de53200-2b58-4177-83b9-962d3ee105de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0fd8c4a-7225-496b-a071-6fd8f37dc60a", "name": "network-vif-plugged", "status": "completed", "tag": "8dc04ade-2041-4d24-bbaf-7f8f25a7e827"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:22.922369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0b857f9c-8c5c-4b46-bce5-2f999a5b7cb5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:22.923086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0b857f9c-8c5c-4b46-bce5-2f999a5b7cb5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:22.923205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ed8ba6bd-4a07-49be-8881-39619509a662 req-8de53200-2b58-4177-83b9-962d3ee105de service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:22.923695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ed8ba6bd-4a07-49be-8881-39619509a662 req-8de53200-2b58-4177-83b9-962d3ee105de service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:22.924449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ed8ba6bd-4a07-49be-8881-39619509a662 req-8de53200-2b58-4177-83b9-962d3ee105de service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:22.934150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b857f9c-8c5c-4b46-bce5-2f999a5b7cb5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:22.934826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b857f9c-8c5c-4b46-bce5-2f999a5b7cb5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:22.935658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b857f9c-8c5c-4b46-bce5-2f999a5b7cb5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:22.937177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b857f9c-8c5c-4b46-bce5-2f999a5b7cb5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:22.938149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b857f9c-8c5c-4b46-bce5-2f999a5b7cb5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:22.938650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b857f9c-8c5c-4b46-bce5-2f999a5b7cb5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:22.941648 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-ed8ba6bd-4a07-49be-8881-39619509a662 req-8de53200-2b58-4177-83b9-962d3ee105de service nova] Creating event network-vif-plugged:8dc04ade-2041-4d24-bbaf-7f8f25a7e827 for instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a on n-h1-839401-11 Aug 29 15:48:22.947195 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-ed8ba6bd-4a07-49be-8881-39619509a662 req-8de53200-2b58-4177-83b9-962d3ee105de service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039517 Aug 29 15:48:22.948138 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2562/5274] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:23.091556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7847fc71-71ea-475a-9b46-6dcbabab6f6a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:23.092869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7847fc71-71ea-475a-9b46-6dcbabab6f6a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:23.101874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7847fc71-71ea-475a-9b46-6dcbabab6f6a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:23.102355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7847fc71-71ea-475a-9b46-6dcbabab6f6a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:23.102808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7847fc71-71ea-475a-9b46-6dcbabab6f6a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:23.103534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7847fc71-71ea-475a-9b46-6dcbabab6f6a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:23.104031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7847fc71-71ea-475a-9b46-6dcbabab6f6a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:23.104438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7847fc71-71ea-475a-9b46-6dcbabab6f6a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:23.186788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0b857f9c-8c5c-4b46-bce5-2f999a5b7cb5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:23.201037 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0b857f9c-8c5c-4b46-bce5-2f999a5b7cb5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.282253 Aug 29 15:48:23.210766 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2713/5275] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:22 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:23.219251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d51059f4-8c45-4116-8190-5a31356f4f5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:23.219251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d51059f4-8c45-4116-8190-5a31356f4f5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:23.232589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d51059f4-8c45-4116-8190-5a31356f4f5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:23.233123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d51059f4-8c45-4116-8190-5a31356f4f5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:23.234536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d51059f4-8c45-4116-8190-5a31356f4f5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:23.237040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d51059f4-8c45-4116-8190-5a31356f4f5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:23.239184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d51059f4-8c45-4116-8190-5a31356f4f5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:23.249030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d51059f4-8c45-4116-8190-5a31356f4f5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:23.280770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:23.416366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d51059f4-8c45-4116-8190-5a31356f4f5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:23.424368 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d51059f4-8c45-4116-8190-5a31356f4f5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1316 microversion: 2.1 time: 0.216340 Aug 29 15:48:23.424952 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2714/5276] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:23 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1316 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:23.430136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cbb61eba-3b0f-4505-a481-02e7b2135baf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:23.430972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cbb61eba-3b0f-4505-a481-02e7b2135baf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:23.438455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbb61eba-3b0f-4505-a481-02e7b2135baf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:23.438943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbb61eba-3b0f-4505-a481-02e7b2135baf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:23.439375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbb61eba-3b0f-4505-a481-02e7b2135baf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:23.440075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbb61eba-3b0f-4505-a481-02e7b2135baf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:23.440524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbb61eba-3b0f-4505-a481-02e7b2135baf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:23.441247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbb61eba-3b0f-4505-a481-02e7b2135baf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:23.596739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7847fc71-71ea-475a-9b46-6dcbabab6f6a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:23.607063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7847fc71-71ea-475a-9b46-6dcbabab6f6a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:23.608943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7847fc71-71ea-475a-9b46-6dcbabab6f6a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:23.610701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cbb61eba-3b0f-4505-a481-02e7b2135baf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:23.620399 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7847fc71-71ea-475a-9b46-6dcbabab6f6a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 2953 microversion: 2.32 time: 0.533146 Aug 29 15:48:23.622840 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cbb61eba-3b0f-4505-a481-02e7b2135baf tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1473 microversion: 2.1 time: 0.196307 Aug 29 15:48:23.624542 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2715/5277] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:23 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1473 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:23.634395 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2563/5278] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:23 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 2953 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:24.226825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6a45f4e0-ce5c-47bc-8ffa-5f522b4a2713 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:24.228452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6a45f4e0-ce5c-47bc-8ffa-5f522b4a2713 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:24.236474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a45f4e0-ce5c-47bc-8ffa-5f522b4a2713 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.237277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a45f4e0-ce5c-47bc-8ffa-5f522b4a2713 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.237919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a45f4e0-ce5c-47bc-8ffa-5f522b4a2713 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.239769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a45f4e0-ce5c-47bc-8ffa-5f522b4a2713 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.240095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a45f4e0-ce5c-47bc-8ffa-5f522b4a2713 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.240522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a45f4e0-ce5c-47bc-8ffa-5f522b4a2713 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.248127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-798912ed-8800-4a43-b51a-8f15bd516c56 req-c69bb061-78fb-4903-91e1-c23569a8a7af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698e4c74-b063-4ffc-bbd9-9154af832815", "name": "network-vif-deleted", "tag": "5917d456-8dc9-4d37-9614-af0759e075a5"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:24.272260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-798912ed-8800-4a43-b51a-8f15bd516c56 req-c69bb061-78fb-4903-91e1-c23569a8a7af service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.273872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-798912ed-8800-4a43-b51a-8f15bd516c56 req-c69bb061-78fb-4903-91e1-c23569a8a7af service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.277678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-798912ed-8800-4a43-b51a-8f15bd516c56 req-c69bb061-78fb-4903-91e1-c23569a8a7af service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.292066 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-798912ed-8800-4a43-b51a-8f15bd516c56 req-c69bb061-78fb-4903-91e1-c23569a8a7af service nova] Creating event network-vif-deleted:5917d456-8dc9-4d37-9614-af0759e075a5 for instance 698e4c74-b063-4ffc-bbd9-9154af832815 on n-h2-839401-11 Aug 29 15:48:24.298208 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-798912ed-8800-4a43-b51a-8f15bd516c56 req-c69bb061-78fb-4903-91e1-c23569a8a7af service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057192 Aug 29 15:48:24.299277 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2564/5279] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:24.316375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bbe31e92-fc46-41f9-a6f1-44f4bd25e8a6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:24.317173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bbe31e92-fc46-41f9-a6f1-44f4bd25e8a6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:24.324613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbe31e92-fc46-41f9-a6f1-44f4bd25e8a6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.325254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbe31e92-fc46-41f9-a6f1-44f4bd25e8a6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.325799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbe31e92-fc46-41f9-a6f1-44f4bd25e8a6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.326710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbe31e92-fc46-41f9-a6f1-44f4bd25e8a6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.334286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbe31e92-fc46-41f9-a6f1-44f4bd25e8a6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.334901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbe31e92-fc46-41f9-a6f1-44f4bd25e8a6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.436515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-bbe31e92-fc46-41f9-a6f1-44f4bd25e8a6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lazy-loading 'services' on Instance uuid 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:48:24.532570 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bbe31e92-fc46-41f9-a6f1-44f4bd25e8a6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "DELETE /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44/os-volume_attachments/c0117d32-b0da-4eef-ac9f-d09679946a97" status: 202 len: 0 microversion: 2.1 time: 0.220839 Aug 29 15:48:24.536431 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2565/5280] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 15:48:24 2022] DELETE /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44/os-volume_attachments/c0117d32-b0da-4eef-ac9f-d09679946a97 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:48:24.554022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-234b3c98-3624-4d61-9025-03236b85aa0d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:24.561684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-234b3c98-3624-4d61-9025-03236b85aa0d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:24.581970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-234b3c98-3624-4d61-9025-03236b85aa0d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.582602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-234b3c98-3624-4d61-9025-03236b85aa0d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.583349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-234b3c98-3624-4d61-9025-03236b85aa0d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.587000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-234b3c98-3624-4d61-9025-03236b85aa0d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.587623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-234b3c98-3624-4d61-9025-03236b85aa0d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.590482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-234b3c98-3624-4d61-9025-03236b85aa0d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.609276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6a45f4e0-ce5c-47bc-8ffa-5f522b4a2713 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:24.620344 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6a45f4e0-ce5c-47bc-8ffa-5f522b4a2713 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.397408 Aug 29 15:48:24.623125 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2716/5281] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:24 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:24.648019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-470255eb-722f-43ca-86d5-4277c002bfd2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:24.649049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-470255eb-722f-43ca-86d5-4277c002bfd2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:24.657310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-470255eb-722f-43ca-86d5-4277c002bfd2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.658265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-470255eb-722f-43ca-86d5-4277c002bfd2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.658877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-470255eb-722f-43ca-86d5-4277c002bfd2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.659617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-470255eb-722f-43ca-86d5-4277c002bfd2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.660259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-470255eb-722f-43ca-86d5-4277c002bfd2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.660898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-470255eb-722f-43ca-86d5-4277c002bfd2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.715882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-470255eb-722f-43ca-86d5-4277c002bfd2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.716748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-470255eb-722f-43ca-86d5-4277c002bfd2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.717398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-470255eb-722f-43ca-86d5-4277c002bfd2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.718021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-470255eb-722f-43ca-86d5-4277c002bfd2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lazy-loading 'fault' on Instance uuid 698e4c74-b063-4ffc-bbd9-9154af832815 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:48:24.775247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-470255eb-722f-43ca-86d5-4277c002bfd2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:24.784681 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-470255eb-722f-43ca-86d5-4277c002bfd2 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 200 len: 1307 microversion: 2.1 time: 0.142723 Aug 29 15:48:24.785298 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2717/5282] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:24 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 1307 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:24.789802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-09f47c4a-10c2-46f8-8716-b5e44972f216 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:24.790408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-09f47c4a-10c2-46f8-8716-b5e44972f216 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:24.796252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09f47c4a-10c2-46f8-8716-b5e44972f216 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.796734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09f47c4a-10c2-46f8-8716-b5e44972f216 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.797268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09f47c4a-10c2-46f8-8716-b5e44972f216 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.797887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09f47c4a-10c2-46f8-8716-b5e44972f216 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.798368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09f47c4a-10c2-46f8-8716-b5e44972f216 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.798797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09f47c4a-10c2-46f8-8716-b5e44972f216 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.900931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-234b3c98-3624-4d61-9025-03236b85aa0d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:24.917623 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-234b3c98-3624-4d61-9025-03236b85aa0d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1316 microversion: 2.1 time: 0.382562 Aug 29 15:48:24.920488 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2566/5283] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:24 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:25.058722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-09f47c4a-10c2-46f8-8716-b5e44972f216 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:25.072780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-09f47c4a-10c2-46f8-8716-b5e44972f216 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:25.079312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-09f47c4a-10c2-46f8-8716-b5e44972f216 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:25.082115 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-09f47c4a-10c2-46f8-8716-b5e44972f216 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 2932 microversion: 2.32 time: 0.295667 Aug 29 15:48:25.083825 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2718/5284] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:24 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 2932 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:25.650456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ba5e5c94-aa2e-4191-922d-a78e3ba575ed tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:25.652381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ba5e5c94-aa2e-4191-922d-a78e3ba575ed tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:25.661054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba5e5c94-aa2e-4191-922d-a78e3ba575ed tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.661480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba5e5c94-aa2e-4191-922d-a78e3ba575ed tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.661916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba5e5c94-aa2e-4191-922d-a78e3ba575ed tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.662614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba5e5c94-aa2e-4191-922d-a78e3ba575ed tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.663228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba5e5c94-aa2e-4191-922d-a78e3ba575ed tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.663822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba5e5c94-aa2e-4191-922d-a78e3ba575ed tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.807662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c4fb7085-f6a3-4f38-ac60-4ffe83b9a9b3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:25.809349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c4fb7085-f6a3-4f38-ac60-4ffe83b9a9b3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: 698e4c74-b063-4ffc-bbd9-9154af832815] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:25.818292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4fb7085-f6a3-4f38-ac60-4ffe83b9a9b3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.819543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4fb7085-f6a3-4f38-ac60-4ffe83b9a9b3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.820240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4fb7085-f6a3-4f38-ac60-4ffe83b9a9b3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.821393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4fb7085-f6a3-4f38-ac60-4ffe83b9a9b3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.822075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4fb7085-f6a3-4f38-ac60-4ffe83b9a9b3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.823339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4fb7085-f6a3-4f38-ac60-4ffe83b9a9b3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.840179 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-c4fb7085-f6a3-4f38-ac60-4ffe83b9a9b3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] HTTP exception thrown: Instance 698e4c74-b063-4ffc-bbd9-9154af832815 could not be found. Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c4fb7085-f6a3-4f38-ac60-4ffe83b9a9b3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Request method failure captured: Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 HTTP/1.1 Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN81pscwpvqO3IjaO-aWE5fxrllPeGYmC3KHUu9UekpWE8LfRDVMSqUZj4KqImOL2m3G4FLVMlNkzURH0yV4qKIedvd0YuTQD2c1BdBKTuRGSvsWaRLtRt9IUeW85WzAX2o0jKk3gsW5ii2AVH1JE252yJHNv-FF74LV7QLmmfjcJTM Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 06f4a9e6921444c1ac60c7f661b14eb6 Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ListImageFiltersTestJSON-1236945166 Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_06f4a9e6921444c1ac60c7f661b14eb6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/06f4a9e6921444c1ac60c7f661b14eb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/06f4a9e6921444c1ac60c7f661b14eb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/06f4a9e6921444c1ac60c7f661b14eb6"}]}] Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ListImageFiltersTestJSON-1236945166 Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 06f4a9e6921444c1ac60c7f661b14eb6 Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1236945166 Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ListImageFiltersTestJSON-1236945166-project Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 3f8cf49a144a413e98c4b14bf468f8e6 Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ListImageFiltersTestJSON-1236945166-project Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 698e4c74-b063-4ffc-bbd9-9154af832815 could not be found. Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '698e4c74-b063-4ffc-bbd9-9154af832815'} Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698e4c74-b063-4ffc-bbd9-9154af832815 could not be found. Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698e4c74-b063-4ffc-bbd9-9154af832815 could not be found. Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:25.842482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:25.848555 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:25.848555 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:25.848555 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:25.848555 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:25.848555 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:25.848555 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698e4c74-b063-4ffc-bbd9-9154af832815 could not be found. Aug 29 15:48:25.848555 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:25.851617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c4fb7085-f6a3-4f38-ac60-4ffe83b9a9b3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Returning 404 to user: Instance 698e4c74-b063-4ffc-bbd9-9154af832815 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:25.854172 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c4fb7085-f6a3-4f38-ac60-4ffe83b9a9b3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815" status: 404 len: 111 microversion: 2.1 time: 0.050452 Aug 29 15:48:25.855058 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2719/5285] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:25 2022] GET /compute/v2.1/servers/698e4c74-b063-4ffc-bbd9-9154af832815 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:48:25.864878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5abcc482-5961-406d-a7c5-bdeb9af0c5d7 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:25.865776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5abcc482-5961-406d-a7c5-bdeb9af0c5d7 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: cea653ef-b11d-4341-a1cf-e941b5f3e570] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:25.875133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5abcc482-5961-406d-a7c5-bdeb9af0c5d7 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.876003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5abcc482-5961-406d-a7c5-bdeb9af0c5d7 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.876838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5abcc482-5961-406d-a7c5-bdeb9af0c5d7 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.877952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5abcc482-5961-406d-a7c5-bdeb9af0c5d7 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.878963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5abcc482-5961-406d-a7c5-bdeb9af0c5d7 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.879587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5abcc482-5961-406d-a7c5-bdeb9af0c5d7 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.935870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5abcc482-5961-406d-a7c5-bdeb9af0c5d7 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: cea653ef-b11d-4341-a1cf-e941b5f3e570] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:48:25.957832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ba5e5c94-aa2e-4191-922d-a78e3ba575ed tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:25.981622 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ba5e5c94-aa2e-4191-922d-a78e3ba575ed tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.336892 Aug 29 15:48:25.984651 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2567/5286] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:25 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:25.997235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8cc4d3f9-a626-467f-846c-c262af0fdd98 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:25.998118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8cc4d3f9-a626-467f-846c-c262af0fdd98 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:26.017262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cc4d3f9-a626-467f-846c-c262af0fdd98 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:26.019650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cc4d3f9-a626-467f-846c-c262af0fdd98 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:26.020280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cc4d3f9-a626-467f-846c-c262af0fdd98 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.021933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cc4d3f9-a626-467f-846c-c262af0fdd98 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:26.022770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cc4d3f9-a626-467f-846c-c262af0fdd98 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:26.024630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8cc4d3f9-a626-467f-846c-c262af0fdd98 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.121865 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5abcc482-5961-406d-a7c5-bdeb9af0c5d7 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570" status: 204 len: 0 microversion: 2.1 time: 0.260623 Aug 29 15:48:26.123400 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2720/5287] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:48:25 2022] DELETE /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:48:26.137417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-11d3aff4-eedb-4f59-ae6a-87a70c8dc1dc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:26.140552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-11d3aff4-eedb-4f59-ae6a-87a70c8dc1dc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:26.150964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11d3aff4-eedb-4f59-ae6a-87a70c8dc1dc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:26.153145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11d3aff4-eedb-4f59-ae6a-87a70c8dc1dc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:26.153145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11d3aff4-eedb-4f59-ae6a-87a70c8dc1dc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.153495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11d3aff4-eedb-4f59-ae6a-87a70c8dc1dc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:26.153949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11d3aff4-eedb-4f59-ae6a-87a70c8dc1dc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:26.154381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11d3aff4-eedb-4f59-ae6a-87a70c8dc1dc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.391571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-11d3aff4-eedb-4f59-ae6a-87a70c8dc1dc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:26.407165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-11d3aff4-eedb-4f59-ae6a-87a70c8dc1dc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:26.408621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-11d3aff4-eedb-4f59-ae6a-87a70c8dc1dc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:26.410617 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-11d3aff4-eedb-4f59-ae6a-87a70c8dc1dc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 2865 microversion: 2.32 time: 0.284630 Aug 29 15:48:26.411736 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2721/5288] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:26 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 2865 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:26.427159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-71bcff7c-41ce-466a-9d54-902d5c8f7fe6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:26.427779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-71bcff7c-41ce-466a-9d54-902d5c8f7fe6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: cea653ef-b11d-4341-a1cf-e941b5f3e570] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:26.445748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71bcff7c-41ce-466a-9d54-902d5c8f7fe6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:26.446262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71bcff7c-41ce-466a-9d54-902d5c8f7fe6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:26.446716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71bcff7c-41ce-466a-9d54-902d5c8f7fe6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.447448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71bcff7c-41ce-466a-9d54-902d5c8f7fe6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:26.447913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71bcff7c-41ce-466a-9d54-902d5c8f7fe6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:26.448502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71bcff7c-41ce-466a-9d54-902d5c8f7fe6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.479575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8cc4d3f9-a626-467f-846c-c262af0fdd98 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:26.492871 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8cc4d3f9-a626-467f-846c-c262af0fdd98 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.504638 Aug 29 15:48:26.493843 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2568/5289] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:25 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:26.518114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d5b3f9f3-9bf4-45d8-9b89-d713f8d7baab req-64d53d62-d449-4307-88d9-6164344e725d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "name": "network-vif-unplugged", "status": "completed", "tag": "a1dbac3e-d33f-459b-8975-e740294ef068"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:26.540580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d5b3f9f3-9bf4-45d8-9b89-d713f8d7baab req-64d53d62-d449-4307-88d9-6164344e725d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:26.541209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d5b3f9f3-9bf4-45d8-9b89-d713f8d7baab req-64d53d62-d449-4307-88d9-6164344e725d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:26.541677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d5b3f9f3-9bf4-45d8-9b89-d713f8d7baab req-64d53d62-d449-4307-88d9-6164344e725d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.577219 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d5b3f9f3-9bf4-45d8-9b89-d713f8d7baab req-64d53d62-d449-4307-88d9-6164344e725d service nova] Creating event network-vif-unplugged:a1dbac3e-d33f-459b-8975-e740294ef068 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:48:26.587648 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d5b3f9f3-9bf4-45d8-9b89-d713f8d7baab req-64d53d62-d449-4307-88d9-6164344e725d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084648 Aug 29 15:48:26.589904 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2569/5290] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:26.603812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-c83caa64-8b58-4d40-b92b-8470820a8250 req-7cf32043-771d-4c0e-84a9-ba7548dc3349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "name": "network-vif-deleted", "tag": "af34d60f-3508-498b-8136-1aa1dd422ab9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:26.632543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c83caa64-8b58-4d40-b92b-8470820a8250 req-7cf32043-771d-4c0e-84a9-ba7548dc3349 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:26.633876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c83caa64-8b58-4d40-b92b-8470820a8250 req-7cf32043-771d-4c0e-84a9-ba7548dc3349 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:26.634526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c83caa64-8b58-4d40-b92b-8470820a8250 req-7cf32043-771d-4c0e-84a9-ba7548dc3349 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.670975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-71bcff7c-41ce-466a-9d54-902d5c8f7fe6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:26.675782 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-c83caa64-8b58-4d40-b92b-8470820a8250 req-7cf32043-771d-4c0e-84a9-ba7548dc3349 service nova] Creating event network-vif-deleted:af34d60f-3508-498b-8136-1aa1dd422ab9 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:48:26.680559 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-71bcff7c-41ce-466a-9d54-902d5c8f7fe6 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570" status: 200 len: 1473 microversion: 2.1 time: 0.267733 Aug 29 15:48:26.693700 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2722/5291] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:26 2022] GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570 => generated 1473 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:26.697665 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-c83caa64-8b58-4d40-b92b-8470820a8250 req-7cf32043-771d-4c0e-84a9-ba7548dc3349 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105638 Aug 29 15:48:26.701030 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2570/5292] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:26.701196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-266686610", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:26.763733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] validate_networks() for [('74eea137-7f8c-43e1-bd42-582bf8562b2a', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:48:27.018256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-35193803-5cbb-4dd2-b6ee-68e99c15291e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:27.022321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-35193803-5cbb-4dd2-b6ee-68e99c15291e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:27.030072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35193803-5cbb-4dd2-b6ee-68e99c15291e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.031486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35193803-5cbb-4dd2-b6ee-68e99c15291e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.032143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35193803-5cbb-4dd2-b6ee-68e99c15291e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.033235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35193803-5cbb-4dd2-b6ee-68e99c15291e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.033914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35193803-5cbb-4dd2-b6ee-68e99c15291e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.034889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35193803-5cbb-4dd2-b6ee-68e99c15291e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.292485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:48:27.294133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:48:27.296502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:48:27.297152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:48:27.297727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:48:27.308104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.308814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.309474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.310897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.311517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.312097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.335669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Getting quotas for project d28bb9d84c3a4fa2b0ea86fc70720d13. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:27.354688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Getting quotas for user b3d1e88d25a04cfe93fdc728736b0e2d and project d28bb9d84c3a4fa2b0ea86fc70720d13. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:27.374470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:48:27.376851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:48:27.383374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-35193803-5cbb-4dd2-b6ee-68e99c15291e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:27.390492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:27.393470 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-35193803-5cbb-4dd2-b6ee-68e99c15291e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.388275 Aug 29 15:48:27.405656 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2571/5293] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:27 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:27.424639 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6fe8f810-8ded-4630-b37e-9d0ca74c97cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729749 Aug 29 15:48:27.425687 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2723/5294] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:48:27.436299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d4b9641-2334-46a1-a903-4cbb5f5cae33 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:27.436806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2d4b9641-2334-46a1-a903-4cbb5f5cae33 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:27.440055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:27.447670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-390bcbbc-76b3-411b-91ab-c7ad59ab8ec9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:27.449861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-390bcbbc-76b3-411b-91ab-c7ad59ab8ec9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:27.462162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-390bcbbc-76b3-411b-91ab-c7ad59ab8ec9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.463533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-390bcbbc-76b3-411b-91ab-c7ad59ab8ec9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.464545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-390bcbbc-76b3-411b-91ab-c7ad59ab8ec9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.465204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-390bcbbc-76b3-411b-91ab-c7ad59ab8ec9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.466989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-390bcbbc-76b3-411b-91ab-c7ad59ab8ec9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.467712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-390bcbbc-76b3-411b-91ab-c7ad59ab8ec9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.537996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d4b9641-2334-46a1-a903-4cbb5f5cae33 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:27.547361 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d4b9641-2334-46a1-a903-4cbb5f5cae33 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1216 microversion: 2.1 time: 0.115160 Aug 29 15:48:27.548619 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2724/5295] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:27 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1216 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:27.718923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0ab4c76b-89b6-46ce-96dc-dcd07edfb26c tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:27.719759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0ab4c76b-89b6-46ce-96dc-dcd07edfb26c tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: cea653ef-b11d-4341-a1cf-e941b5f3e570] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:27.739354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ab4c76b-89b6-46ce-96dc-dcd07edfb26c tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.740062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ab4c76b-89b6-46ce-96dc-dcd07edfb26c tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.740625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ab4c76b-89b6-46ce-96dc-dcd07edfb26c tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.741506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ab4c76b-89b6-46ce-96dc-dcd07edfb26c tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.743421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ab4c76b-89b6-46ce-96dc-dcd07edfb26c tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.744005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ab4c76b-89b6-46ce-96dc-dcd07edfb26c tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.829932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-390bcbbc-76b3-411b-91ab-c7ad59ab8ec9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:27.846452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-390bcbbc-76b3-411b-91ab-c7ad59ab8ec9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:27.848503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-390bcbbc-76b3-411b-91ab-c7ad59ab8ec9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:27.852692 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-390bcbbc-76b3-411b-91ab-c7ad59ab8ec9 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 2705 microversion: 2.32 time: 0.419161 Aug 29 15:48:27.875414 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2572/5296] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:27 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 2705 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:28.124850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0ab4c76b-89b6-46ce-96dc-dcd07edfb26c tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:28.134865 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0ab4c76b-89b6-46ce-96dc-dcd07edfb26c tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570" status: 200 len: 1473 microversion: 2.1 time: 0.431224 Aug 29 15:48:28.149880 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2725/5297] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:27 2022] GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570 => generated 1473 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:28.418766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a8760e6c-4d91-43a3-b58c-868c16bb02d9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:28.419691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a8760e6c-4d91-43a3-b58c-868c16bb02d9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:28.446207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8760e6c-4d91-43a3-b58c-868c16bb02d9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.446999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8760e6c-4d91-43a3-b58c-868c16bb02d9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.447442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8760e6c-4d91-43a3-b58c-868c16bb02d9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.448154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8760e6c-4d91-43a3-b58c-868c16bb02d9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.448610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8760e6c-4d91-43a3-b58c-868c16bb02d9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.449037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8760e6c-4d91-43a3-b58c-868c16bb02d9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.569401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6a696503-4293-4adb-aa1a-65bda85cc34b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:28.571132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6a696503-4293-4adb-aa1a-65bda85cc34b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:28.584829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a696503-4293-4adb-aa1a-65bda85cc34b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.585991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a696503-4293-4adb-aa1a-65bda85cc34b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.586826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a696503-4293-4adb-aa1a-65bda85cc34b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.588202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a696503-4293-4adb-aa1a-65bda85cc34b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.589279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a696503-4293-4adb-aa1a-65bda85cc34b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.590081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a696503-4293-4adb-aa1a-65bda85cc34b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.692513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6a696503-4293-4adb-aa1a-65bda85cc34b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:28.705216 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6a696503-4293-4adb-aa1a-65bda85cc34b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1212 microversion: 2.1 time: 0.141125 Aug 29 15:48:28.706835 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2726/5298] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:28 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1212 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:28.712684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-69acdc3e-46dd-4874-994e-ad2e982966e4 req-96ee6cb2-0688-4c60-968b-ea5f074a2810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "name": "network-vif-unplugged", "status": "completed", "tag": "1a543716-cc66-4d75-84e9-429e6bbf56a0"}, {"server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "name": "network-vif-unplugged", "status": "completed", "tag": "cd9c6b22-3b08-4c43-9df9-680021211414"}, {"server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "name": "network-vif-unplugged", "status": "completed", "tag": "740841a2-402d-46f7-999f-b5beab53ba4a"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:28.739999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-69acdc3e-46dd-4874-994e-ad2e982966e4 req-96ee6cb2-0688-4c60-968b-ea5f074a2810 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.740814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-69acdc3e-46dd-4874-994e-ad2e982966e4 req-96ee6cb2-0688-4c60-968b-ea5f074a2810 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.743108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-69acdc3e-46dd-4874-994e-ad2e982966e4 req-96ee6cb2-0688-4c60-968b-ea5f074a2810 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.802592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a8760e6c-4d91-43a3-b58c-868c16bb02d9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:28.814526 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a8760e6c-4d91-43a3-b58c-868c16bb02d9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.402206 Aug 29 15:48:28.817699 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2573/5299] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:28 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:28.822598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b991f476-0b81-41a9-9e5e-904263456a3d req-f37fa550-d279-4fc9-9aa3-4317833ae9fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "name": "network-vif-deleted", "tag": "a1dbac3e-d33f-459b-8975-e740294ef068"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:28.859776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b991f476-0b81-41a9-9e5e-904263456a3d req-f37fa550-d279-4fc9-9aa3-4317833ae9fb service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.860356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b991f476-0b81-41a9-9e5e-904263456a3d req-f37fa550-d279-4fc9-9aa3-4317833ae9fb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.860757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b991f476-0b81-41a9-9e5e-904263456a3d req-f37fa550-d279-4fc9-9aa3-4317833ae9fb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.875076 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b991f476-0b81-41a9-9e5e-904263456a3d req-f37fa550-d279-4fc9-9aa3-4317833ae9fb service nova] Creating event network-vif-deleted:a1dbac3e-d33f-459b-8975-e740294ef068 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:48:28.881066 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b991f476-0b81-41a9-9e5e-904263456a3d req-f37fa550-d279-4fc9-9aa3-4317833ae9fb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062104 Aug 29 15:48:28.882506 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2574/5300] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:28.901216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4aa43941-9975-47bb-9982-d1875c1f99bd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:28.901947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4aa43941-9975-47bb-9982-d1875c1f99bd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:28.916147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4aa43941-9975-47bb-9982-d1875c1f99bd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.916652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4aa43941-9975-47bb-9982-d1875c1f99bd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.917116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4aa43941-9975-47bb-9982-d1875c1f99bd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.917863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4aa43941-9975-47bb-9982-d1875c1f99bd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.918323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4aa43941-9975-47bb-9982-d1875c1f99bd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.918755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4aa43941-9975-47bb-9982-d1875c1f99bd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:29.259743 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-69acdc3e-46dd-4874-994e-ad2e982966e4 req-96ee6cb2-0688-4c60-968b-ea5f074a2810 service nova] Creating event network-vif-unplugged:1a543716-cc66-4d75-84e9-429e6bbf56a0 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:48:29.260860 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-69acdc3e-46dd-4874-994e-ad2e982966e4 req-96ee6cb2-0688-4c60-968b-ea5f074a2810 service nova] Creating event network-vif-unplugged:cd9c6b22-3b08-4c43-9df9-680021211414 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:48:29.261797 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-69acdc3e-46dd-4874-994e-ad2e982966e4 req-96ee6cb2-0688-4c60-968b-ea5f074a2810 service nova] Creating event network-vif-unplugged:740841a2-402d-46f7-999f-b5beab53ba4a for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:48:29.269244 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-69acdc3e-46dd-4874-994e-ad2e982966e4 req-96ee6cb2-0688-4c60-968b-ea5f074a2810 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.560439 Aug 29 15:48:29.274661 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2727/5301] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:29.280593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-60a6f38a-81c4-4d5b-a92c-32e139d4b2ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:29.286218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-60a6f38a-81c4-4d5b-a92c-32e139d4b2ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: cea653ef-b11d-4341-a1cf-e941b5f3e570] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:29.303247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60a6f38a-81c4-4d5b-a92c-32e139d4b2ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:29.303741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60a6f38a-81c4-4d5b-a92c-32e139d4b2ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:29.304365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60a6f38a-81c4-4d5b-a92c-32e139d4b2ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:29.305261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60a6f38a-81c4-4d5b-a92c-32e139d4b2ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:29.313972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60a6f38a-81c4-4d5b-a92c-32e139d4b2ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:29.314649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60a6f38a-81c4-4d5b-a92c-32e139d4b2ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:29.507285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4aa43941-9975-47bb-9982-d1875c1f99bd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:29.556351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4aa43941-9975-47bb-9982-d1875c1f99bd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:29.563594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4aa43941-9975-47bb-9982-d1875c1f99bd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:29.570379 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4aa43941-9975-47bb-9982-d1875c1f99bd tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 2659 microversion: 2.32 time: 0.686505 Aug 29 15:48:29.570993 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2575/5302] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:28 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 2659 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:29.726868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-20c380f0-b659-4f9a-9700-05e35817106c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:29.728226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-20c380f0-b659-4f9a-9700-05e35817106c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:29.736050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20c380f0-b659-4f9a-9700-05e35817106c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:29.736869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20c380f0-b659-4f9a-9700-05e35817106c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:29.737582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20c380f0-b659-4f9a-9700-05e35817106c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:29.738540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20c380f0-b659-4f9a-9700-05e35817106c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:29.739313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20c380f0-b659-4f9a-9700-05e35817106c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:29.739963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20c380f0-b659-4f9a-9700-05e35817106c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:29.749844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-60a6f38a-81c4-4d5b-a92c-32e139d4b2ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:29.759056 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-60a6f38a-81c4-4d5b-a92c-32e139d4b2ba tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570" status: 200 len: 1473 microversion: 2.1 time: 0.482866 Aug 29 15:48:29.761390 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2728/5303] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:29 2022] GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570 => generated 1473 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:29.836735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e871b46b-99df-4214-872c-a36037bd7485 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:29.837657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e871b46b-99df-4214-872c-a36037bd7485 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:29.851506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e871b46b-99df-4214-872c-a36037bd7485 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:29.852089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e871b46b-99df-4214-872c-a36037bd7485 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:29.852544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e871b46b-99df-4214-872c-a36037bd7485 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:29.853418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e871b46b-99df-4214-872c-a36037bd7485 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:29.859257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e871b46b-99df-4214-872c-a36037bd7485 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:29.860717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e871b46b-99df-4214-872c-a36037bd7485 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:29.872555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-20c380f0-b659-4f9a-9700-05e35817106c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:29.886084 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-20c380f0-b659-4f9a-9700-05e35817106c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1268 microversion: 2.1 time: 0.159111 Aug 29 15:48:29.900845 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2576/5304] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:29 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:29.972839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-fd51d733-f8bd-4bab-a500-c5e3876d2db2 req-bb61e358-8f86-488c-88bb-fe7f7b6564b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea653ef-b11d-4341-a1cf-e941b5f3e570", "name": "network-vif-deleted", "tag": "efc5b7ae-1aab-49aa-938d-1d74e0bd4507"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:29.998203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fd51d733-f8bd-4bab-a500-c5e3876d2db2 req-bb61e358-8f86-488c-88bb-fe7f7b6564b5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:29.999444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fd51d733-f8bd-4bab-a500-c5e3876d2db2 req-bb61e358-8f86-488c-88bb-fe7f7b6564b5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:30.000031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fd51d733-f8bd-4bab-a500-c5e3876d2db2 req-bb61e358-8f86-488c-88bb-fe7f7b6564b5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:30.048800 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-fd51d733-f8bd-4bab-a500-c5e3876d2db2 req-bb61e358-8f86-488c-88bb-fe7f7b6564b5 service nova] Creating event network-vif-deleted:efc5b7ae-1aab-49aa-938d-1d74e0bd4507 for instance cea653ef-b11d-4341-a1cf-e941b5f3e570 on n-h1-839401-11 Aug 29 15:48:30.061188 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-fd51d733-f8bd-4bab-a500-c5e3876d2db2 req-bb61e358-8f86-488c-88bb-fe7f7b6564b5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087641 Aug 29 15:48:30.062458 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2577/5305] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:48:30.170179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e871b46b-99df-4214-872c-a36037bd7485 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:30.182710 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e871b46b-99df-4214-872c-a36037bd7485 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.350304 Aug 29 15:48:30.183601 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2729/5306] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:29 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:30.598411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1cc60b0d-3a36-4fa3-a16b-c149200ba8df tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:30.599123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1cc60b0d-3a36-4fa3-a16b-c149200ba8df tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:30.615235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cc60b0d-3a36-4fa3-a16b-c149200ba8df tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:30.618119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cc60b0d-3a36-4fa3-a16b-c149200ba8df tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:30.618904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cc60b0d-3a36-4fa3-a16b-c149200ba8df tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:30.620111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cc60b0d-3a36-4fa3-a16b-c149200ba8df tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:30.620800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cc60b0d-3a36-4fa3-a16b-c149200ba8df tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:30.627242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cc60b0d-3a36-4fa3-a16b-c149200ba8df tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:30.781281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-815b2f65-b8f3-4b1a-a4b1-bb503db8c456 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:30.781983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-815b2f65-b8f3-4b1a-a4b1-bb503db8c456 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: cea653ef-b11d-4341-a1cf-e941b5f3e570] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:30.790082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-815b2f65-b8f3-4b1a-a4b1-bb503db8c456 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:30.790942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-815b2f65-b8f3-4b1a-a4b1-bb503db8c456 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:30.791580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-815b2f65-b8f3-4b1a-a4b1-bb503db8c456 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:30.792515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-815b2f65-b8f3-4b1a-a4b1-bb503db8c456 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:30.793865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-815b2f65-b8f3-4b1a-a4b1-bb503db8c456 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:30.794673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-815b2f65-b8f3-4b1a-a4b1-bb503db8c456 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:30.832330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-815b2f65-b8f3-4b1a-a4b1-bb503db8c456 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:30.833367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-815b2f65-b8f3-4b1a-a4b1-bb503db8c456 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:30.834426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-815b2f65-b8f3-4b1a-a4b1-bb503db8c456 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:30.835504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-815b2f65-b8f3-4b1a-a4b1-bb503db8c456 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lazy-loading 'fault' on Instance uuid cea653ef-b11d-4341-a1cf-e941b5f3e570 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:48:30.838389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1cc60b0d-3a36-4fa3-a16b-c149200ba8df tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:30.848373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1cc60b0d-3a36-4fa3-a16b-c149200ba8df tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:30.857705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1cc60b0d-3a36-4fa3-a16b-c149200ba8df tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:30.860915 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1cc60b0d-3a36-4fa3-a16b-c149200ba8df tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 2325 microversion: 2.32 time: 0.265651 Aug 29 15:48:30.861714 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2578/5307] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:30 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 2325 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:30.907790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5ae55f58-477a-42a3-843e-97e17725c322 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:30.908455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5ae55f58-477a-42a3-843e-97e17725c322 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:30.920148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ae55f58-477a-42a3-843e-97e17725c322 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:30.920723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ae55f58-477a-42a3-843e-97e17725c322 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:30.921210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ae55f58-477a-42a3-843e-97e17725c322 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:30.921938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ae55f58-477a-42a3-843e-97e17725c322 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:30.922398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ae55f58-477a-42a3-843e-97e17725c322 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:30.922830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ae55f58-477a-42a3-843e-97e17725c322 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.027271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5ae55f58-477a-42a3-843e-97e17725c322 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:31.036655 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5ae55f58-477a-42a3-843e-97e17725c322 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1274 microversion: 2.1 time: 0.133407 Aug 29 15:48:31.037606 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2579/5308] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:30 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:31.042405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-dd71f965-f0b8-417b-bd9e-dc6de17ef7d2 req-69da0322-b0c9-4b72-b969-500d21d9d4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "name": "network-vif-deleted", "tag": "740841a2-402d-46f7-999f-b5beab53ba4a"}, {"server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "name": "network-vif-deleted", "tag": "cd9c6b22-3b08-4c43-9df9-680021211414"}, {"server_uuid": "4a0e3960-ddb0-4c89-b821-7eb8379391ae", "name": "network-vif-deleted", "tag": "1a543716-cc66-4d75-84e9-429e6bbf56a0"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:31.052977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-dd71f965-f0b8-417b-bd9e-dc6de17ef7d2 req-69da0322-b0c9-4b72-b969-500d21d9d4c8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.054517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-dd71f965-f0b8-417b-bd9e-dc6de17ef7d2 req-69da0322-b0c9-4b72-b969-500d21d9d4c8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.055328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-dd71f965-f0b8-417b-bd9e-dc6de17ef7d2 req-69da0322-b0c9-4b72-b969-500d21d9d4c8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.071928 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-dd71f965-f0b8-417b-bd9e-dc6de17ef7d2 req-69da0322-b0c9-4b72-b969-500d21d9d4c8 service nova] Creating event network-vif-deleted:740841a2-402d-46f7-999f-b5beab53ba4a for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:48:31.072830 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-dd71f965-f0b8-417b-bd9e-dc6de17ef7d2 req-69da0322-b0c9-4b72-b969-500d21d9d4c8 service nova] Creating event network-vif-deleted:cd9c6b22-3b08-4c43-9df9-680021211414 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:48:31.073603 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-dd71f965-f0b8-417b-bd9e-dc6de17ef7d2 req-69da0322-b0c9-4b72-b969-500d21d9d4c8 service nova] Creating event network-vif-deleted:1a543716-cc66-4d75-84e9-429e6bbf56a0 for instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae on n-h2-839401-11 Aug 29 15:48:31.080242 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-dd71f965-f0b8-417b-bd9e-dc6de17ef7d2 req-69da0322-b0c9-4b72-b969-500d21d9d4c8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.041245 Aug 29 15:48:31.081628 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2580/5309] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:31.136468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-815b2f65-b8f3-4b1a-a4b1-bb503db8c456 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8cf49a144a413e98c4b14bf468f8e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f4a9e6921444c1ac60c7f661b14eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:31.147885 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-815b2f65-b8f3-4b1a-a4b1-bb503db8c456 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570" status: 200 len: 1307 microversion: 2.1 time: 0.368948 Aug 29 15:48:31.148722 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2730/5310] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:30 2022] GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570 => generated 1307 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:31.204585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-634597f6-46ec-40dc-beb1-ae1ed5c1e2a2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:31.205324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-634597f6-46ec-40dc-beb1-ae1ed5c1e2a2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:31.211951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-634597f6-46ec-40dc-beb1-ae1ed5c1e2a2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.212447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-634597f6-46ec-40dc-beb1-ae1ed5c1e2a2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.212894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-634597f6-46ec-40dc-beb1-ae1ed5c1e2a2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.213629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-634597f6-46ec-40dc-beb1-ae1ed5c1e2a2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.214323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-634597f6-46ec-40dc-beb1-ae1ed5c1e2a2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.214744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-634597f6-46ec-40dc-beb1-ae1ed5c1e2a2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.491522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-634597f6-46ec-40dc-beb1-ae1ed5c1e2a2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:31.502960 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-634597f6-46ec-40dc-beb1-ae1ed5c1e2a2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.302675 Aug 29 15:48:31.515761 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2581/5311] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:31 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:31.852224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e5ff4ecf-72d5-46f4-a42c-7df8ccfd69ed tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:31.852730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e5ff4ecf-72d5-46f4-a42c-7df8ccfd69ed tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:31.860933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5ff4ecf-72d5-46f4-a42c-7df8ccfd69ed tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.861594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5ff4ecf-72d5-46f4-a42c-7df8ccfd69ed tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.862776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5ff4ecf-72d5-46f4-a42c-7df8ccfd69ed tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.864303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5ff4ecf-72d5-46f4-a42c-7df8ccfd69ed tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.865131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5ff4ecf-72d5-46f4-a42c-7df8ccfd69ed tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.865879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5ff4ecf-72d5-46f4-a42c-7df8ccfd69ed tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.889133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-36a6ae5d-707f-41aa-9d2a-dfed554c9f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:31.889887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-36a6ae5d-707f-41aa-9d2a-dfed554c9f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:31.892696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:31.899950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36a6ae5d-707f-41aa-9d2a-dfed554c9f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.900614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36a6ae5d-707f-41aa-9d2a-dfed554c9f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.901152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36a6ae5d-707f-41aa-9d2a-dfed554c9f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.902136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36a6ae5d-707f-41aa-9d2a-dfed554c9f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.902674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36a6ae5d-707f-41aa-9d2a-dfed554c9f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.903082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e5ff4ecf-72d5-46f4-a42c-7df8ccfd69ed tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:48:31.903232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36a6ae5d-707f-41aa-9d2a-dfed554c9f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.009325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36a6ae5d-707f-41aa-9d2a-dfed554c9f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:32.026645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36a6ae5d-707f-41aa-9d2a-dfed554c9f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:32.031005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36a6ae5d-707f-41aa-9d2a-dfed554c9f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:32.032444 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-36a6ae5d-707f-41aa-9d2a-dfed554c9f1d tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1872 microversion: 2.32 time: 0.150170 Aug 29 15:48:32.033146 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2582/5312] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:31 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1872 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:32.048349 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e5ff4ecf-72d5-46f4-a42c-7df8ccfd69ed tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "DELETE /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 204 len: 0 microversion: 2.1 time: 0.199760 Aug 29 15:48:32.053142 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2731/5313] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:48:31 2022] DELETE /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:48:32.059456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5f2ad801-1ce5-41d5-bfb2-6df144ad1e37 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:32.060720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5f2ad801-1ce5-41d5-bfb2-6df144ad1e37 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:32.061569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d250af07-b938-45b5-b5fe-49dd828bd778 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:32.062506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d250af07-b938-45b5-b5fe-49dd828bd778 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:32.068984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d250af07-b938-45b5-b5fe-49dd828bd778 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.069456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d250af07-b938-45b5-b5fe-49dd828bd778 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.070121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d250af07-b938-45b5-b5fe-49dd828bd778 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.070933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d250af07-b938-45b5-b5fe-49dd828bd778 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.071503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d250af07-b938-45b5-b5fe-49dd828bd778 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.072063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d250af07-b938-45b5-b5fe-49dd828bd778 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.076635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f2ad801-1ce5-41d5-bfb2-6df144ad1e37 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.077135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f2ad801-1ce5-41d5-bfb2-6df144ad1e37 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.077571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f2ad801-1ce5-41d5-bfb2-6df144ad1e37 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.078456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f2ad801-1ce5-41d5-bfb2-6df144ad1e37 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.079111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f2ad801-1ce5-41d5-bfb2-6df144ad1e37 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.079864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f2ad801-1ce5-41d5-bfb2-6df144ad1e37 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.232519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5f2ad801-1ce5-41d5-bfb2-6df144ad1e37 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:32.241457 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5f2ad801-1ce5-41d5-bfb2-6df144ad1e37 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1514 microversion: 2.1 time: 0.187223 Aug 29 15:48:32.242058 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2583/5314] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:32 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:32.247180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a24bd01a-fcd7-466e-9dbb-e97fbc1ce0df tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:32.247801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a24bd01a-fcd7-466e-9dbb-e97fbc1ce0df tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] [instance: cea653ef-b11d-4341-a1cf-e941b5f3e570] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:32.254002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a24bd01a-fcd7-466e-9dbb-e97fbc1ce0df tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.254694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a24bd01a-fcd7-466e-9dbb-e97fbc1ce0df tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.255500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a24bd01a-fcd7-466e-9dbb-e97fbc1ce0df tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.256476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a24bd01a-fcd7-466e-9dbb-e97fbc1ce0df tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.256939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a24bd01a-fcd7-466e-9dbb-e97fbc1ce0df tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.257405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a24bd01a-fcd7-466e-9dbb-e97fbc1ce0df tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.273288 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-a24bd01a-fcd7-466e-9dbb-e97fbc1ce0df tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] HTTP exception thrown: Instance cea653ef-b11d-4341-a1cf-e941b5f3e570 could not be found. Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a24bd01a-fcd7-466e-9dbb-e97fbc1ce0df tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Request method failure captured: Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570 HTTP/1.1 Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN81pscwpvqO3IjaO-aWE5fxrllPeGYmC3KHUu9UekpWE8LfRDVMSqUZj4KqImOL2m3G4FLVMlNkzURH0yV4qKIedvd0YuTQD2c1BdBKTuRGSvsWaRLtRt9IUeW85WzAX2o0jKk3gsW5ii2AVH1JE252yJHNv-FF74LV7QLmmfjcJTM Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 06f4a9e6921444c1ac60c7f661b14eb6 Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ListImageFiltersTestJSON-1236945166 Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_06f4a9e6921444c1ac60c7f661b14eb6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/06f4a9e6921444c1ac60c7f661b14eb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/06f4a9e6921444c1ac60c7f661b14eb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/06f4a9e6921444c1ac60c7f661b14eb6"}]}] Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ListImageFiltersTestJSON-1236945166 Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 06f4a9e6921444c1ac60c7f661b14eb6 Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1236945166 Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ListImageFiltersTestJSON-1236945166-project Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 3f8cf49a144a413e98c4b14bf468f8e6 Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ListImageFiltersTestJSON-1236945166-project Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance cea653ef-b11d-4341-a1cf-e941b5f3e570 could not be found. Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'cea653ef-b11d-4341-a1cf-e941b5f3e570'} Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea653ef-b11d-4341-a1cf-e941b5f3e570 could not be found. Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea653ef-b11d-4341-a1cf-e941b5f3e570 could not be found. Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:32.275103 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:32.281468 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:32.281468 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:32.281468 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:32.281468 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:32.281468 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:32.281468 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea653ef-b11d-4341-a1cf-e941b5f3e570 could not be found. Aug 29 15:48:32.281468 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:32.281468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a24bd01a-fcd7-466e-9dbb-e97fbc1ce0df tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Returning 404 to user: Instance cea653ef-b11d-4341-a1cf-e941b5f3e570 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:32.281468 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a24bd01a-fcd7-466e-9dbb-e97fbc1ce0df tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570" status: 404 len: 111 microversion: 2.1 time: 0.033381 Aug 29 15:48:32.281468 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2584/5315] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:32 2022] GET /compute/v2.1/servers/cea653ef-b11d-4341-a1cf-e941b5f3e570 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:48:32.285136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-c7a11952-adc9-42b2-a4a6-0bc378c739d9 req-bcc586a7-8bd2-4b2f-8a3d-a8e81c4abc8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3c27d9-2596-4f58-80ab-0df600408845", "tag": "76327392-0461-484e-a4a6-480d5748b8bc"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:32.294875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c7a11952-adc9-42b2-a4a6-0bc378c739d9 req-bcc586a7-8bd2-4b2f-8a3d-a8e81c4abc8e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.295362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c7a11952-adc9-42b2-a4a6-0bc378c739d9 req-bcc586a7-8bd2-4b2f-8a3d-a8e81c4abc8e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.296100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c7a11952-adc9-42b2-a4a6-0bc378c739d9 req-bcc586a7-8bd2-4b2f-8a3d-a8e81c4abc8e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.299335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d250af07-b938-45b5-b5fe-49dd828bd778 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:32.311255 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-c7a11952-adc9-42b2-a4a6-0bc378c739d9 req-bcc586a7-8bd2-4b2f-8a3d-a8e81c4abc8e service nova] Creating event network-changed:76327392-0461-484e-a4a6-480d5748b8bc for instance bf3c27d9-2596-4f58-80ab-0df600408845 on n-h1-839401-11 Aug 29 15:48:32.316051 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-c7a11952-adc9-42b2-a4a6-0bc378c739d9 req-bcc586a7-8bd2-4b2f-8a3d-a8e81c4abc8e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034490 Aug 29 15:48:32.317475 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2585/5316] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:32.319321 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d250af07-b938-45b5-b5fe-49dd828bd778 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1316 microversion: 2.1 time: 0.262145 Aug 29 15:48:32.320641 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2732/5317] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:32 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:32.321887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-257c443c-005c-4f55-b700-669a437e87ff tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42bc48af0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:32.524034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c0de5b37-1e58-4c54-8bc6-c79b84257efa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:32.524860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c0de5b37-1e58-4c54-8bc6-c79b84257efa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:32.531697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0de5b37-1e58-4c54-8bc6-c79b84257efa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.533008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0de5b37-1e58-4c54-8bc6-c79b84257efa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.533811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0de5b37-1e58-4c54-8bc6-c79b84257efa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.535022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0de5b37-1e58-4c54-8bc6-c79b84257efa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.535805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0de5b37-1e58-4c54-8bc6-c79b84257efa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.536568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0de5b37-1e58-4c54-8bc6-c79b84257efa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.670024 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-257c443c-005c-4f55-b700-669a437e87ff tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "DELETE /compute/v2.1/images/391227c5-2b1a-445d-a25e-e4ce655fe055" status: 204 len: 0 microversion: 2.1 time: 0.351805 Aug 29 15:48:32.670916 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2586/5318] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:32 2022] DELETE /compute/v2.1/images/391227c5-2b1a-445d-a25e-e4ce655fe055 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:48:32.679571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-029ffa1d-ca21-4d5a-abd4-547741fa160b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc4302b6430>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:32.696918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c0de5b37-1e58-4c54-8bc6-c79b84257efa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:32.704923 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c0de5b37-1e58-4c54-8bc6-c79b84257efa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.184888 Aug 29 15:48:32.705744 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2733/5319] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:32 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:32.915626 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-029ffa1d-ca21-4d5a-abd4-547741fa160b tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "DELETE /compute/v2.1/images/637ddd4b-d1c4-451e-813b-73ca44135f96" status: 204 len: 0 microversion: 2.1 time: 0.240145 Aug 29 15:48:32.916215 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2587/5320] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:32 2022] DELETE /compute/v2.1/images/637ddd4b-d1c4-451e-813b-73ca44135f96 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:48:32.924388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-02840731-7e22-4e25-a47c-0ee1e1d81de3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] Calling method '.version_select at 0x7fc42aa73550>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:33.058328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d532717a-f540-418c-8fd5-200abe08d732 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:33.059724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d532717a-f540-418c-8fd5-200abe08d732 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:33.062123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:33.070260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d532717a-f540-418c-8fd5-200abe08d732 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.070899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d532717a-f540-418c-8fd5-200abe08d732 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.071392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d532717a-f540-418c-8fd5-200abe08d732 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.072091 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d532717a-f540-418c-8fd5-200abe08d732 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.072589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d532717a-f540-418c-8fd5-200abe08d732 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.073116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d532717a-f540-418c-8fd5-200abe08d732 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.153300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d532717a-f540-418c-8fd5-200abe08d732 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:33.154173 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-02840731-7e22-4e25-a47c-0ee1e1d81de3 tempest-ListImageFiltersTestJSON-1236945166 tempest-ListImageFiltersTestJSON-1236945166-project] 10.222.0.62 "DELETE /compute/v2.1/images/73176341-e197-48db-9c96-7c0955a3a390" status: 204 len: 0 microversion: 2.1 time: 0.233676 Aug 29 15:48:33.154789 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2734/5321] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:32 2022] DELETE /compute/v2.1/images/73176341-e197-48db-9c96-7c0955a3a390 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:48:33.163787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d532717a-f540-418c-8fd5-200abe08d732 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:33.165302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d532717a-f540-418c-8fd5-200abe08d732 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:33.167187 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d532717a-f540-418c-8fd5-200abe08d732 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1872 microversion: 2.32 time: 0.113651 Aug 29 15:48:33.169146 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2588/5322] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:33 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1872 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:33.267673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-292d01bc-5293-47e6-b7c6-0457925912ba tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:33.268363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-292d01bc-5293-47e6-b7c6-0457925912ba tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:33.275702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-292d01bc-5293-47e6-b7c6-0457925912ba tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.276211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-292d01bc-5293-47e6-b7c6-0457925912ba tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.276654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-292d01bc-5293-47e6-b7c6-0457925912ba tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.277430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-292d01bc-5293-47e6-b7c6-0457925912ba tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.277893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-292d01bc-5293-47e6-b7c6-0457925912ba tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.278330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-292d01bc-5293-47e6-b7c6-0457925912ba tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.339757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5dd88e9e-d02e-44d3-b5ad-07fc52122c31 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:33.340413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5dd88e9e-d02e-44d3-b5ad-07fc52122c31 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:33.347746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5dd88e9e-d02e-44d3-b5ad-07fc52122c31 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.348458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5dd88e9e-d02e-44d3-b5ad-07fc52122c31 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.349593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5dd88e9e-d02e-44d3-b5ad-07fc52122c31 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.350499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5dd88e9e-d02e-44d3-b5ad-07fc52122c31 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.351127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5dd88e9e-d02e-44d3-b5ad-07fc52122c31 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.351721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5dd88e9e-d02e-44d3-b5ad-07fc52122c31 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.451430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-292d01bc-5293-47e6-b7c6-0457925912ba tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:33.462754 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-292d01bc-5293-47e6-b7c6-0457925912ba tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1514 microversion: 2.1 time: 0.200779 Aug 29 15:48:33.468320 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2735/5323] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:33 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:33.530914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5dd88e9e-d02e-44d3-b5ad-07fc52122c31 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:33.539900 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5dd88e9e-d02e-44d3-b5ad-07fc52122c31 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1316 microversion: 2.1 time: 0.204123 Aug 29 15:48:33.543707 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2589/5324] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:33 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:33.726388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d31a90a-7e83-4e4d-afd0-f6c5f4c5e9f6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:33.727159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9d31a90a-7e83-4e4d-afd0-f6c5f4c5e9f6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:33.736667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d31a90a-7e83-4e4d-afd0-f6c5f4c5e9f6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.737328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d31a90a-7e83-4e4d-afd0-f6c5f4c5e9f6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.738051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d31a90a-7e83-4e4d-afd0-f6c5f4c5e9f6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.739072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d31a90a-7e83-4e4d-afd0-f6c5f4c5e9f6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.739707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d31a90a-7e83-4e4d-afd0-f6c5f4c5e9f6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.740294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d31a90a-7e83-4e4d-afd0-f6c5f4c5e9f6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:34.058315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9d31a90a-7e83-4e4d-afd0-f6c5f4c5e9f6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:34.091053 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d31a90a-7e83-4e4d-afd0-f6c5f4c5e9f6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.368605 Aug 29 15:48:34.101890 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2736/5325] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:33 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:34.191622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-53ca5884-a886-4a39-9776-6c187227a784 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:34.192432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-53ca5884-a886-4a39-9776-6c187227a784 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:34.208104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53ca5884-a886-4a39-9776-6c187227a784 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:34.208596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53ca5884-a886-4a39-9776-6c187227a784 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:34.209032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53ca5884-a886-4a39-9776-6c187227a784 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:34.209764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53ca5884-a886-4a39-9776-6c187227a784 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:34.210214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53ca5884-a886-4a39-9776-6c187227a784 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:34.210640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53ca5884-a886-4a39-9776-6c187227a784 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:34.366905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-53ca5884-a886-4a39-9776-6c187227a784 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:34.384982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-53ca5884-a886-4a39-9776-6c187227a784 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:34.386308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-53ca5884-a886-4a39-9776-6c187227a784 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:34.387538 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-53ca5884-a886-4a39-9776-6c187227a784 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1872 microversion: 2.32 time: 0.200834 Aug 29 15:48:34.392584 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2590/5326] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:34 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1872 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:34.488895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3cccaebb-4f5f-4cd0-8c62-8a8e23237bff tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:34.489732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3cccaebb-4f5f-4cd0-8c62-8a8e23237bff tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:34.504123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cccaebb-4f5f-4cd0-8c62-8a8e23237bff tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:34.504932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cccaebb-4f5f-4cd0-8c62-8a8e23237bff tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:34.505419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cccaebb-4f5f-4cd0-8c62-8a8e23237bff tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:34.506155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cccaebb-4f5f-4cd0-8c62-8a8e23237bff tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:34.506623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cccaebb-4f5f-4cd0-8c62-8a8e23237bff tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:34.507036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3cccaebb-4f5f-4cd0-8c62-8a8e23237bff tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:34.563102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2649671a-c47d-4d7c-bd82-cb4db05c0298 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:34.563725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2649671a-c47d-4d7c-bd82-cb4db05c0298 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:34.582128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2649671a-c47d-4d7c-bd82-cb4db05c0298 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:34.582466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2649671a-c47d-4d7c-bd82-cb4db05c0298 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:34.582908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2649671a-c47d-4d7c-bd82-cb4db05c0298 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:34.583645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2649671a-c47d-4d7c-bd82-cb4db05c0298 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:34.584098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2649671a-c47d-4d7c-bd82-cb4db05c0298 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:34.584600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2649671a-c47d-4d7c-bd82-cb4db05c0298 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:34.792105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3cccaebb-4f5f-4cd0-8c62-8a8e23237bff tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:34.802329 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3cccaebb-4f5f-4cd0-8c62-8a8e23237bff tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1514 microversion: 2.1 time: 0.317529 Aug 29 15:48:34.807823 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2737/5327] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:34 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1514 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:34.833426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2649671a-c47d-4d7c-bd82-cb4db05c0298 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:34.839093 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2649671a-c47d-4d7c-bd82-cb4db05c0298 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1316 microversion: 2.1 time: 0.279896 Aug 29 15:48:34.851527 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2591/5328] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:34 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:35.114509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c1bfa43f-2cc5-4269-9dab-28f40963e341 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:35.115739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c1bfa43f-2cc5-4269-9dab-28f40963e341 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:35.123263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bfa43f-2cc5-4269-9dab-28f40963e341 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:35.123750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bfa43f-2cc5-4269-9dab-28f40963e341 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:35.124394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bfa43f-2cc5-4269-9dab-28f40963e341 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:35.126081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bfa43f-2cc5-4269-9dab-28f40963e341 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:35.126704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bfa43f-2cc5-4269-9dab-28f40963e341 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:35.127296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bfa43f-2cc5-4269-9dab-28f40963e341 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:35.346998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c1bfa43f-2cc5-4269-9dab-28f40963e341 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:35.360872 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c1bfa43f-2cc5-4269-9dab-28f40963e341 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1520 microversion: 2.1 time: 0.249319 Aug 29 15:48:35.374677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-2d205150-03fc-4a1b-9460-e6272806a500 req-ef411f57-364f-451a-b748-ea8e54651b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44", "name": "network-vif-deleted", "tag": "87e08bf9-d9b6-4981-9e30-6dc0b19954d5"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:35.375560 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2738/5329] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:35 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:35.384129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2d205150-03fc-4a1b-9460-e6272806a500 req-ef411f57-364f-451a-b748-ea8e54651b17 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:35.384656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2d205150-03fc-4a1b-9460-e6272806a500 req-ef411f57-364f-451a-b748-ea8e54651b17 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:35.385123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2d205150-03fc-4a1b-9460-e6272806a500 req-ef411f57-364f-451a-b748-ea8e54651b17 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:35.397803 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-2d205150-03fc-4a1b-9460-e6272806a500 req-ef411f57-364f-451a-b748-ea8e54651b17 service nova] Creating event network-vif-deleted:87e08bf9-d9b6-4981-9e30-6dc0b19954d5 for instance 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 on n-h1-839401-11 Aug 29 15:48:35.403395 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-2d205150-03fc-4a1b-9460-e6272806a500 req-ef411f57-364f-451a-b748-ea8e54651b17 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035870 Aug 29 15:48:35.404256 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2592/5330] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:35.418853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-46cac7d6-9807-4679-b8a1-a9b22ebecf42 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:35.419475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-46cac7d6-9807-4679-b8a1-a9b22ebecf42 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:35.426814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46cac7d6-9807-4679-b8a1-a9b22ebecf42 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:35.427312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46cac7d6-9807-4679-b8a1-a9b22ebecf42 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:35.427753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46cac7d6-9807-4679-b8a1-a9b22ebecf42 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:35.428472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46cac7d6-9807-4679-b8a1-a9b22ebecf42 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:35.428929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46cac7d6-9807-4679-b8a1-a9b22ebecf42 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:35.429382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46cac7d6-9807-4679-b8a1-a9b22ebecf42 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:35.515351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-46cac7d6-9807-4679-b8a1-a9b22ebecf42 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:35.525882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-46cac7d6-9807-4679-b8a1-a9b22ebecf42 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:35.527365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-46cac7d6-9807-4679-b8a1-a9b22ebecf42 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:35.528632 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-46cac7d6-9807-4679-b8a1-a9b22ebecf42 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1872 microversion: 2.32 time: 0.114208 Aug 29 15:48:35.529430 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2739/5331] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:35 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1872 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:35.823933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4f0fd00d-108f-4f12-b2e4-c3fb8b161d34 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:35.824811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4f0fd00d-108f-4f12-b2e4-c3fb8b161d34 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:35.849304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0fd00d-108f-4f12-b2e4-c3fb8b161d34 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:35.852516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0fd00d-108f-4f12-b2e4-c3fb8b161d34 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:35.853315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0fd00d-108f-4f12-b2e4-c3fb8b161d34 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:35.854173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0fd00d-108f-4f12-b2e4-c3fb8b161d34 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:35.854731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0fd00d-108f-4f12-b2e4-c3fb8b161d34 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:35.855262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0fd00d-108f-4f12-b2e4-c3fb8b161d34 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:35.863074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6007c649-f090-41a2-8227-a3b60ecfc492 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:35.864037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6007c649-f090-41a2-8227-a3b60ecfc492 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:35.871984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6007c649-f090-41a2-8227-a3b60ecfc492 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:35.872467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6007c649-f090-41a2-8227-a3b60ecfc492 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:35.873071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6007c649-f090-41a2-8227-a3b60ecfc492 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:35.874107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6007c649-f090-41a2-8227-a3b60ecfc492 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:35.874725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6007c649-f090-41a2-8227-a3b60ecfc492 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:35.875585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6007c649-f090-41a2-8227-a3b60ecfc492 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:35.953426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4f0fd00d-108f-4f12-b2e4-c3fb8b161d34 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:35.961812 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4f0fd00d-108f-4f12-b2e4-c3fb8b161d34 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1472 microversion: 2.1 time: 0.142200 Aug 29 15:48:35.962832 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2593/5332] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:35 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1472 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:36.090578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6007c649-f090-41a2-8227-a3b60ecfc492 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:36.099946 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6007c649-f090-41a2-8227-a3b60ecfc492 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1316 microversion: 2.1 time: 0.240736 Aug 29 15:48:36.117126 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2740/5333] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:35 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:36.383705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0af9d35d-b89a-4fd2-96fc-d1a63225cd62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:36.384491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0af9d35d-b89a-4fd2-96fc-d1a63225cd62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:36.395574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0af9d35d-b89a-4fd2-96fc-d1a63225cd62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.396629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0af9d35d-b89a-4fd2-96fc-d1a63225cd62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.398339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0af9d35d-b89a-4fd2-96fc-d1a63225cd62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.400147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0af9d35d-b89a-4fd2-96fc-d1a63225cd62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.400971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0af9d35d-b89a-4fd2-96fc-d1a63225cd62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.402656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0af9d35d-b89a-4fd2-96fc-d1a63225cd62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.430006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:36.554794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2995ef40-a94d-413f-9429-86b48c3983f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:36.555862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2995ef40-a94d-413f-9429-86b48c3983f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:36.563846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2995ef40-a94d-413f-9429-86b48c3983f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.564632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2995ef40-a94d-413f-9429-86b48c3983f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.565318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2995ef40-a94d-413f-9429-86b48c3983f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.566465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2995ef40-a94d-413f-9429-86b48c3983f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.567133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2995ef40-a94d-413f-9429-86b48c3983f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.567764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2995ef40-a94d-413f-9429-86b48c3983f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.600619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0af9d35d-b89a-4fd2-96fc-d1a63225cd62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:36.610142 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0af9d35d-b89a-4fd2-96fc-d1a63225cd62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1500 microversion: 2.1 time: 0.230402 Aug 29 15:48:36.611230 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2594/5334] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:36 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1500 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:36.631734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dad34722-0d50-475e-ac37-b643d2ef6e58 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:36.632694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dad34722-0d50-475e-ac37-b643d2ef6e58 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:36.642894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dad34722-0d50-475e-ac37-b643d2ef6e58 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.651585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dad34722-0d50-475e-ac37-b643d2ef6e58 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.652998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dad34722-0d50-475e-ac37-b643d2ef6e58 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.654662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dad34722-0d50-475e-ac37-b643d2ef6e58 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.655501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dad34722-0d50-475e-ac37-b643d2ef6e58 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.656160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dad34722-0d50-475e-ac37-b643d2ef6e58 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.681050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2995ef40-a94d-413f-9429-86b48c3983f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:36.700929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2995ef40-a94d-413f-9429-86b48c3983f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:36.705620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2995ef40-a94d-413f-9429-86b48c3983f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:36.709327 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2995ef40-a94d-413f-9429-86b48c3983f3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1872 microversion: 2.32 time: 0.158756 Aug 29 15:48:36.710542 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2741/5335] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:36 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1872 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:36.865612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dad34722-0d50-475e-ac37-b643d2ef6e58 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:36.876501 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dad34722-0d50-475e-ac37-b643d2ef6e58 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1515 microversion: 2.1 time: 0.248794 Aug 29 15:48:36.878288 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2595/5336] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:36 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1515 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:36.901754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3a995c19-3548-46fc-a049-281103f0fa3c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:36.904607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3a995c19-3548-46fc-a049-281103f0fa3c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 6a614515-3d6d-460b-a410-e7a9d6b53071] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:36.911645 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-3a995c19-3548-46fc-a049-281103f0fa3c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] HTTP exception thrown: Instance 6a614515-3d6d-460b-a410-e7a9d6b53071 could not be found. Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3a995c19-3548-46fc-a049-281103f0fa3c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Request method failure captured: Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/6a614515-3d6d-460b-a410-e7a9d6b53071/action HTTP/1.1 Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 14 Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-Shrbl2HxkaYnOtK2CNdk6iJsrlpI7x2pEvqbwalbEhQTR6sDfV2Wu55DTc75O-bivlxXAmF3HFspNNYPdndfOjtbIQTsROFO0VNl42_MzCePBgIneIUPTQCeXIdrBxJJnQjgsKhXk98T5RKZXMNgJMbL43_mClT_pNirw55OB0CI Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bb5330327389417995f14947be334a04 Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bb5330327389417995f14947be334a04", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bb5330327389417995f14947be334a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}] Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bb5330327389417995f14947be334a04 Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e75a8c66c5304e608e2f3120c1192534 Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: {"rescue": {}} Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 6a614515-3d6d-460b-a410-e7a9d6b53071 could not be found. Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '6a614515-3d6d-460b-a410-e7a9d6b53071', 'body': {'rescue': {}}} Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a614515-3d6d-460b-a410-e7a9d6b53071 could not be found. Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a614515-3d6d-460b-a410-e7a9d6b53071 could not be found. Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:36.915941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:36.920372 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:36.920372 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:36.920372 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:36.920372 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:36.920372 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a614515-3d6d-460b-a410-e7a9d6b53071 could not be found. Aug 29 15:48:36.920372 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:36.922530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3a995c19-3548-46fc-a049-281103f0fa3c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Returning 404 to user: Instance 6a614515-3d6d-460b-a410-e7a9d6b53071 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:36.923858 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3a995c19-3548-46fc-a049-281103f0fa3c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/servers/6a614515-3d6d-460b-a410-e7a9d6b53071/action" status: 404 len: 111 microversion: 2.1 time: 0.028327 Aug 29 15:48:36.929592 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2742/5337] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:36 2022] POST /compute/v2.1/servers/6a614515-3d6d-460b-a410-e7a9d6b53071/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:48:36.938465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ffb73f58-d33d-4646-b6e6-436026ba8883 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:36.938951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ffb73f58-d33d-4646-b6e6-436026ba8883 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:36.948905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffb73f58-d33d-4646-b6e6-436026ba8883 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.949555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffb73f58-d33d-4646-b6e6-436026ba8883 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.950726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffb73f58-d33d-4646-b6e6-436026ba8883 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.951692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffb73f58-d33d-4646-b6e6-436026ba8883 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.952351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffb73f58-d33d-4646-b6e6-436026ba8883 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.953704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffb73f58-d33d-4646-b6e6-436026ba8883 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.983321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5d7791d8-e1eb-49b9-a499-b6e81bb55592 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:36.983939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5d7791d8-e1eb-49b9-a499-b6e81bb55592 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:36.991539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d7791d8-e1eb-49b9-a499-b6e81bb55592 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.996385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d7791d8-e1eb-49b9-a499-b6e81bb55592 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.996908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d7791d8-e1eb-49b9-a499-b6e81bb55592 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.997827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d7791d8-e1eb-49b9-a499-b6e81bb55592 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.998327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d7791d8-e1eb-49b9-a499-b6e81bb55592 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.998765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d7791d8-e1eb-49b9-a499-b6e81bb55592 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:37.052525 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ffb73f58-d33d-4646-b6e6-436026ba8883 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0/action" status: 202 len: 0 microversion: 2.1 time: 0.121611 Aug 29 15:48:37.056343 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2596/5338] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:36 2022] POST /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:48:37.066033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6eabdc53-83d7-48fb-af13-968f837dadd5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:37.066033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6eabdc53-83d7-48fb-af13-968f837dadd5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:37.073958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6eabdc53-83d7-48fb-af13-968f837dadd5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:37.074526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6eabdc53-83d7-48fb-af13-968f837dadd5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:37.074967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6eabdc53-83d7-48fb-af13-968f837dadd5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:37.075679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6eabdc53-83d7-48fb-af13-968f837dadd5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:37.076283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6eabdc53-83d7-48fb-af13-968f837dadd5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:37.076717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6eabdc53-83d7-48fb-af13-968f837dadd5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:37.099620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5d7791d8-e1eb-49b9-a499-b6e81bb55592 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:37.141363 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5d7791d8-e1eb-49b9-a499-b6e81bb55592 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 200 len: 1472 microversion: 2.1 time: 0.161890 Aug 29 15:48:37.165276 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2743/5339] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:36 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 1472 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:37.181021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9f278bd7-3a09-4e1e-aad4-e03cee8eee28 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:37.181681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9f278bd7-3a09-4e1e-aad4-e03cee8eee28 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:37.194821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f278bd7-3a09-4e1e-aad4-e03cee8eee28 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:37.196282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f278bd7-3a09-4e1e-aad4-e03cee8eee28 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:37.198004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f278bd7-3a09-4e1e-aad4-e03cee8eee28 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:37.200549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f278bd7-3a09-4e1e-aad4-e03cee8eee28 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:37.206466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f278bd7-3a09-4e1e-aad4-e03cee8eee28 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:37.208153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f278bd7-3a09-4e1e-aad4-e03cee8eee28 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:37.314432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6eabdc53-83d7-48fb-af13-968f837dadd5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:37.323297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:37.324171 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6eabdc53-83d7-48fb-af13-968f837dadd5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1520 microversion: 2.1 time: 0.264837 Aug 29 15:48:37.346485 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2597/5340] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:37 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:37.543789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:37.635960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9f278bd7-3a09-4e1e-aad4-e03cee8eee28 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:37.644361 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9f278bd7-3a09-4e1e-aad4-e03cee8eee28 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1316 microversion: 2.1 time: 0.477801 Aug 29 15:48:37.645320 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2744/5341] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:37 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:37.739495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2d8afc8f-4b61-411e-8455-5d2b5fb1c96e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:37.742974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2d8afc8f-4b61-411e-8455-5d2b5fb1c96e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:37.752955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d8afc8f-4b61-411e-8455-5d2b5fb1c96e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:37.753769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d8afc8f-4b61-411e-8455-5d2b5fb1c96e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:37.754576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d8afc8f-4b61-411e-8455-5d2b5fb1c96e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:37.755478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d8afc8f-4b61-411e-8455-5d2b5fb1c96e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:37.756130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d8afc8f-4b61-411e-8455-5d2b5fb1c96e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:37.756564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d8afc8f-4b61-411e-8455-5d2b5fb1c96e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:37.839958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2d8afc8f-4b61-411e-8455-5d2b5fb1c96e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:37.851906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2d8afc8f-4b61-411e-8455-5d2b5fb1c96e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:37.853394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2d8afc8f-4b61-411e-8455-5d2b5fb1c96e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:37.855940 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2d8afc8f-4b61-411e-8455-5d2b5fb1c96e tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1872 microversion: 2.32 time: 0.121235 Aug 29 15:48:37.861424 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2598/5342] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:37 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1872 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:38.162228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65797159-5ef2-469d-9dc6-8a759120c687 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:38.163001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-65797159-5ef2-469d-9dc6-8a759120c687 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:38.174558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65797159-5ef2-469d-9dc6-8a759120c687 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.175041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65797159-5ef2-469d-9dc6-8a759120c687 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.175499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65797159-5ef2-469d-9dc6-8a759120c687 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.182187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65797159-5ef2-469d-9dc6-8a759120c687 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.182779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65797159-5ef2-469d-9dc6-8a759120c687 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.185540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65797159-5ef2-469d-9dc6-8a759120c687 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.215514 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-65797159-5ef2-469d-9dc6-8a759120c687 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] HTTP exception thrown: Instance 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 could not be found. Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65797159-5ef2-469d-9dc6-8a759120c687 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Request method failure captured: Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 HTTP/1.1 Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN8d45lCidmdLz0ugzp-JQiPaohSsTYvE-yC23Y5T3cGSGEfM26ahWch4pPQyEWtaKSd_P_KMocgTTR6nWOAaz90J5viCtxdRLL8Juq9VYCzWIOeBez0w2x2TqgRcOuHupbsER01P6G2C7LoJVeqjfLDh30QLVw34axUcOOyKodddzo Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 9f9a115c069d424caee396c6dfd3fa50 Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-VolumesSnapshotTestJSON-388071742 Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9f9a115c069d424caee396c6dfd3fa50", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9f9a115c069d424caee396c6dfd3fa50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9f9a115c069d424caee396c6dfd3fa50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9f9a115c069d424caee396c6dfd3fa50"}]}] Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-VolumesSnapshotTestJSON-388071742 Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 9f9a115c069d424caee396c6dfd3fa50 Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-388071742 Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-VolumesSnapshotTestJSON-388071742-project Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 53af5a51f87647d0ae78531c72554ca6 Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-VolumesSnapshotTestJSON-388071742-project Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 could not be found. Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44'} Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 could not be found. Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 could not be found. Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:38.217398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:38.221861 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:38.221861 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:38.221861 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:38.221861 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:38.221861 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:38.221861 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 could not be found. Aug 29 15:48:38.221861 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:38.221861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65797159-5ef2-469d-9dc6-8a759120c687 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Returning 404 to user: Instance 91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:38.221861 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-65797159-5ef2-469d-9dc6-8a759120c687 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44" status: 404 len: 111 microversion: 2.1 time: 0.061302 Aug 29 15:48:38.223691 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2745/5343] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:38 2022] GET /compute/v2.1/servers/91aeeb9a-5dc3-4a28-8dd4-d6071bdbdc44 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:48:38.351839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-50d2863f-3bfb-4688-8e79-20d516969b5b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:38.352457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-50d2863f-3bfb-4688-8e79-20d516969b5b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:38.364643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d2863f-3bfb-4688-8e79-20d516969b5b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.365430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d2863f-3bfb-4688-8e79-20d516969b5b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.366050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d2863f-3bfb-4688-8e79-20d516969b5b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.366959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d2863f-3bfb-4688-8e79-20d516969b5b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.367582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d2863f-3bfb-4688-8e79-20d516969b5b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.368178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50d2863f-3bfb-4688-8e79-20d516969b5b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.642380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-50d2863f-3bfb-4688-8e79-20d516969b5b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:38.654365 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-50d2863f-3bfb-4688-8e79-20d516969b5b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1500 microversion: 2.1 time: 0.305720 Aug 29 15:48:38.656078 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2599/5344] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:38 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1500 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:38.671106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-83e4af3e-c6c0-4678-b0d1-7d6fb63f4c26 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:38.671106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-83e4af3e-c6c0-4678-b0d1-7d6fb63f4c26 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:38.676871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c63002af-49e2-4696-8d1b-942c30c1d2a9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:38.683524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c63002af-49e2-4696-8d1b-942c30c1d2a9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:38.688565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e4af3e-c6c0-4678-b0d1-7d6fb63f4c26 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.689325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e4af3e-c6c0-4678-b0d1-7d6fb63f4c26 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.691287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c63002af-49e2-4696-8d1b-942c30c1d2a9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.691792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c63002af-49e2-4696-8d1b-942c30c1d2a9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.692183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e4af3e-c6c0-4678-b0d1-7d6fb63f4c26 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.693143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e4af3e-c6c0-4678-b0d1-7d6fb63f4c26 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.693779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e4af3e-c6c0-4678-b0d1-7d6fb63f4c26 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.694021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c63002af-49e2-4696-8d1b-942c30c1d2a9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.694939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c63002af-49e2-4696-8d1b-942c30c1d2a9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.695430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c63002af-49e2-4696-8d1b-942c30c1d2a9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.695745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e4af3e-c6c0-4678-b0d1-7d6fb63f4c26 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.696275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c63002af-49e2-4696-8d1b-942c30c1d2a9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.726437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-c63002af-49e2-4696-8d1b-942c30c1d2a9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lazy-loading 'flavor' on Instance uuid 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:48:38.740594 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-c63002af-49e2-4696-8d1b-942c30c1d2a9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] HTTP exception thrown: Cannot 'rescue' instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 while it is in vm_state paused Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c63002af-49e2-4696-8d1b-942c30c1d2a9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Request method failure captured: Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0/action HTTP/1.1 Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 14 Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-Shrbl2HxkaYnOtK2CNdk6iJsrlpI7x2pEvqbwalbEhQTR6sDfV2Wu55DTc75O-bivlxXAmF3HFspNNYPdndfOjtbIQTsROFO0VNl42_MzCePBgIneIUPTQCeXIdrBxJJnQjgsKhXk98T5RKZXMNgJMbL43_mClT_pNirw55OB0CI Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bb5330327389417995f14947be334a04 Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bb5330327389417995f14947be334a04", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bb5330327389417995f14947be334a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}] Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bb5330327389417995f14947be334a04 Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e75a8c66c5304e608e2f3120c1192534 Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: {"rescue": {}} Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: exception: Cannot 'rescue' instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 while it is in vm_state paused Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0', 'body': {'rescue': {}}} Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 in vm_state paused. Cannot rescue while the instance is in this state. Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 while it is in vm_state paused Aug 29 15:48:38.743323 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:38.747881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:38.747881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:38.747881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:38.747881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:38.747881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:38.747881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:38.747881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:38.747881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 while it is in vm_state paused Aug 29 15:48:38.747881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:38.750149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c63002af-49e2-4696-8d1b-942c30c1d2a9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Returning 409 to user: Cannot 'rescue' instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 while it is in vm_state paused {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:38.751724 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c63002af-49e2-4696-8d1b-942c30c1d2a9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0/action" status: 409 len: 144 microversion: 2.1 time: 0.078849 Aug 29 15:48:38.752471 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2600/5345] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:38 2022] POST /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0/action => generated 144 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:48:38.763420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a3f69941-604d-4453-96e2-7e28b0a8b762 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:38.763970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a3f69941-604d-4453-96e2-7e28b0a8b762 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:38.782475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f69941-604d-4453-96e2-7e28b0a8b762 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.783856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f69941-604d-4453-96e2-7e28b0a8b762 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.784582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f69941-604d-4453-96e2-7e28b0a8b762 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.790451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f69941-604d-4453-96e2-7e28b0a8b762 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.797908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f69941-604d-4453-96e2-7e28b0a8b762 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.798823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f69941-604d-4453-96e2-7e28b0a8b762 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:39.013580 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a3f69941-604d-4453-96e2-7e28b0a8b762 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0/action" status: 202 len: 0 microversion: 2.1 time: 0.254625 Aug 29 15:48:39.014395 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2601/5346] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:38 2022] POST /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:48:39.022665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-83e4af3e-c6c0-4678-b0d1-7d6fb63f4c26 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:39.035004 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-83e4af3e-c6c0-4678-b0d1-7d6fb63f4c26 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1316 microversion: 2.1 time: 0.370337 Aug 29 15:48:39.038976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cbe5be15-e62d-4f6e-a658-61d7755ce182 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:39.039444 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2746/5347] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:38 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:39.040792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cbe5be15-e62d-4f6e-a658-61d7755ce182 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:39.048999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-23765b1b-cfcf-495b-a62f-33b11840d9aa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:39.050035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-23765b1b-cfcf-495b-a62f-33b11840d9aa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:39.054376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbe5be15-e62d-4f6e-a658-61d7755ce182 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:39.059284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbe5be15-e62d-4f6e-a658-61d7755ce182 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:39.059835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbe5be15-e62d-4f6e-a658-61d7755ce182 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:39.061130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbe5be15-e62d-4f6e-a658-61d7755ce182 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:39.061524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbe5be15-e62d-4f6e-a658-61d7755ce182 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:39.062580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbe5be15-e62d-4f6e-a658-61d7755ce182 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:39.080834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23765b1b-cfcf-495b-a62f-33b11840d9aa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:39.088827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23765b1b-cfcf-495b-a62f-33b11840d9aa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:39.092890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23765b1b-cfcf-495b-a62f-33b11840d9aa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:39.093978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23765b1b-cfcf-495b-a62f-33b11840d9aa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:39.094621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23765b1b-cfcf-495b-a62f-33b11840d9aa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:39.095223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23765b1b-cfcf-495b-a62f-33b11840d9aa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:39.304493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cbe5be15-e62d-4f6e-a658-61d7755ce182 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:39.328227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cbe5be15-e62d-4f6e-a658-61d7755ce182 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:39.338039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cbe5be15-e62d-4f6e-a658-61d7755ce182 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:39.339400 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cbe5be15-e62d-4f6e-a658-61d7755ce182 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1872 microversion: 2.32 time: 0.323090 Aug 29 15:48:39.339913 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2602/5348] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:39 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1872 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:39.356805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a72f8b03-43be-4695-b8b5-12bd1e11ae71 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:39.362409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a72f8b03-43be-4695-b8b5-12bd1e11ae71 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:39.377803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a72f8b03-43be-4695-b8b5-12bd1e11ae71 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:39.385736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a72f8b03-43be-4695-b8b5-12bd1e11ae71 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:39.386277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a72f8b03-43be-4695-b8b5-12bd1e11ae71 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:39.387044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a72f8b03-43be-4695-b8b5-12bd1e11ae71 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:39.387523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a72f8b03-43be-4695-b8b5-12bd1e11ae71 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:39.387968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a72f8b03-43be-4695-b8b5-12bd1e11ae71 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:39.466781 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a72f8b03-43be-4695-b8b5-12bd1e11ae71 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/ips" status: 200 len: 149 microversion: 2.1 time: 0.125770 Aug 29 15:48:39.480930 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2603/5349] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:48:39 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/ips => generated 149 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:39.523157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-23765b1b-cfcf-495b-a62f-33b11840d9aa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:39.531070 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-23765b1b-cfcf-495b-a62f-33b11840d9aa tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1507 microversion: 2.1 time: 0.490233 Aug 29 15:48:39.548996 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2747/5350] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:39 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1507 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:40.057929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a032c865-065c-4d94-ad88-870480021abb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:40.059537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a032c865-065c-4d94-ad88-870480021abb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:40.074684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a032c865-065c-4d94-ad88-870480021abb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:40.076072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a032c865-065c-4d94-ad88-870480021abb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:40.076761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a032c865-065c-4d94-ad88-870480021abb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:40.078291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a032c865-065c-4d94-ad88-870480021abb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:40.079059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a032c865-065c-4d94-ad88-870480021abb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:40.079676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a032c865-065c-4d94-ad88-870480021abb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:40.367628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-22c0d0a0-b512-4262-8cd8-a0e32aeac670 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:40.368634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-22c0d0a0-b512-4262-8cd8-a0e32aeac670 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:40.379177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22c0d0a0-b512-4262-8cd8-a0e32aeac670 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:40.385245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22c0d0a0-b512-4262-8cd8-a0e32aeac670 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:40.386367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22c0d0a0-b512-4262-8cd8-a0e32aeac670 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:40.390376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22c0d0a0-b512-4262-8cd8-a0e32aeac670 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:40.391245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22c0d0a0-b512-4262-8cd8-a0e32aeac670 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:40.393876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22c0d0a0-b512-4262-8cd8-a0e32aeac670 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:40.444829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a032c865-065c-4d94-ad88-870480021abb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:40.453427 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a032c865-065c-4d94-ad88-870480021abb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1316 microversion: 2.1 time: 0.399229 Aug 29 15:48:40.468506 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2604/5351] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:40 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:40.553625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-35f72e6e-3020-4a66-ace8-4caac9b51975 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:40.554399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-35f72e6e-3020-4a66-ace8-4caac9b51975 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:40.566466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35f72e6e-3020-4a66-ace8-4caac9b51975 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:40.568353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35f72e6e-3020-4a66-ace8-4caac9b51975 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:40.569731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35f72e6e-3020-4a66-ace8-4caac9b51975 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:40.571139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35f72e6e-3020-4a66-ace8-4caac9b51975 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:40.573518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35f72e6e-3020-4a66-ace8-4caac9b51975 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:40.575283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35f72e6e-3020-4a66-ace8-4caac9b51975 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:40.587455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-22c0d0a0-b512-4262-8cd8-a0e32aeac670 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:40.598708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-22c0d0a0-b512-4262-8cd8-a0e32aeac670 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:40.615653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-22c0d0a0-b512-4262-8cd8-a0e32aeac670 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:40.618001 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-22c0d0a0-b512-4262-8cd8-a0e32aeac670 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1872 microversion: 2.32 time: 0.255457 Aug 29 15:48:40.623797 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2748/5352] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:40 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1872 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:41.281347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-35f72e6e-3020-4a66-ace8-4caac9b51975 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:41.291012 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-35f72e6e-3020-4a66-ace8-4caac9b51975 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1515 microversion: 2.1 time: 0.743021 Aug 29 15:48:41.295012 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2605/5353] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:40 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1515 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:41.474141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-791a7e68-6128-4646-a0b6-a0363cf3dc43 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:41.475113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-791a7e68-6128-4646-a0b6-a0363cf3dc43 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:41.488931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-791a7e68-6128-4646-a0b6-a0363cf3dc43 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:41.493393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-791a7e68-6128-4646-a0b6-a0363cf3dc43 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:41.494061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-791a7e68-6128-4646-a0b6-a0363cf3dc43 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:41.495000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-791a7e68-6128-4646-a0b6-a0363cf3dc43 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:41.495809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-791a7e68-6128-4646-a0b6-a0363cf3dc43 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:41.496461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-791a7e68-6128-4646-a0b6-a0363cf3dc43 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:41.512520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:41.649715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e3635369-d914-4923-bfc9-f6fceb7a1e2a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:41.650350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e3635369-d914-4923-bfc9-f6fceb7a1e2a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:41.664200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3635369-d914-4923-bfc9-f6fceb7a1e2a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:41.664816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3635369-d914-4923-bfc9-f6fceb7a1e2a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:41.669394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3635369-d914-4923-bfc9-f6fceb7a1e2a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:41.670702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3635369-d914-4923-bfc9-f6fceb7a1e2a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:41.671199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3635369-d914-4923-bfc9-f6fceb7a1e2a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:41.671645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3635369-d914-4923-bfc9-f6fceb7a1e2a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:41.769807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-791a7e68-6128-4646-a0b6-a0363cf3dc43 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:41.782485 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-791a7e68-6128-4646-a0b6-a0363cf3dc43 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1316 microversion: 2.1 time: 0.311684 Aug 29 15:48:41.796598 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2749/5354] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:41 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:41.821246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e3635369-d914-4923-bfc9-f6fceb7a1e2a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:41.835027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e3635369-d914-4923-bfc9-f6fceb7a1e2a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:41.836999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e3635369-d914-4923-bfc9-f6fceb7a1e2a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:41.840587 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e3635369-d914-4923-bfc9-f6fceb7a1e2a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1872 microversion: 2.32 time: 0.195452 Aug 29 15:48:41.841866 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2606/5355] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:41 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1872 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:42.332905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8a902bcb-b194-4439-a5d5-2dc64240754d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bb27947-74bd-4ae1-bd40-b98be696387c"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:42.336006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8a902bcb-b194-4439-a5d5-2dc64240754d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:42.349525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a902bcb-b194-4439-a5d5-2dc64240754d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:42.354880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a902bcb-b194-4439-a5d5-2dc64240754d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:42.355470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a902bcb-b194-4439-a5d5-2dc64240754d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:42.356344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a902bcb-b194-4439-a5d5-2dc64240754d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:42.356916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a902bcb-b194-4439-a5d5-2dc64240754d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:42.358212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8a902bcb-b194-4439-a5d5-2dc64240754d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:42.807403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-81b02bfc-1afe-489f-84ce-e029ab6db596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:42.808512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-81b02bfc-1afe-489f-84ce-e029ab6db596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:42.821291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81b02bfc-1afe-489f-84ce-e029ab6db596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:42.822073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81b02bfc-1afe-489f-84ce-e029ab6db596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:42.823103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81b02bfc-1afe-489f-84ce-e029ab6db596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:42.824334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81b02bfc-1afe-489f-84ce-e029ab6db596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:42.826513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81b02bfc-1afe-489f-84ce-e029ab6db596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:42.835103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81b02bfc-1afe-489f-84ce-e029ab6db596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:43.011964 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8a902bcb-b194-4439-a5d5-2dc64240754d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "POST /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.683171 Aug 29 15:48:43.022296 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2750/5356] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 15:48:42 2022] POST /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments => generated 194 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:43.048493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-033525cf-b5a5-4ee3-b7ea-8bdc20b490af tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:43.050434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-033525cf-b5a5-4ee3-b7ea-8bdc20b490af tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:43.072044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-033525cf-b5a5-4ee3-b7ea-8bdc20b490af tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:43.082977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-033525cf-b5a5-4ee3-b7ea-8bdc20b490af tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:43.084984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-033525cf-b5a5-4ee3-b7ea-8bdc20b490af tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:43.087083 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-033525cf-b5a5-4ee3-b7ea-8bdc20b490af tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:43.087758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-033525cf-b5a5-4ee3-b7ea-8bdc20b490af tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:43.089727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-033525cf-b5a5-4ee3-b7ea-8bdc20b490af tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:43.245017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-81b02bfc-1afe-489f-84ce-e029ab6db596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:43.260623 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-81b02bfc-1afe-489f-84ce-e029ab6db596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1316 microversion: 2.1 time: 0.459194 Aug 29 15:48:43.277256 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2607/5357] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:42 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:43.324330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-033525cf-b5a5-4ee3-b7ea-8bdc20b490af tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:43.342463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-033525cf-b5a5-4ee3-b7ea-8bdc20b490af tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:43.344343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-033525cf-b5a5-4ee3-b7ea-8bdc20b490af tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:43.347671 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-033525cf-b5a5-4ee3-b7ea-8bdc20b490af tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1872 microversion: 2.32 time: 0.319560 Aug 29 15:48:43.349691 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2751/5358] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:43 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1872 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:43.354613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e4b19262-b9ec-4240-8a4e-2417f408ca74 req-5077f22c-09fc-4d39-9dd0-19e4759815ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3c27d9-2596-4f58-80ab-0df600408845", "name": "network-vif-plugged", "status": "completed", "tag": "76327392-0461-484e-a4a6-480d5748b8bc"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:43.381974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e4b19262-b9ec-4240-8a4e-2417f408ca74 req-5077f22c-09fc-4d39-9dd0-19e4759815ae service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:43.384330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e4b19262-b9ec-4240-8a4e-2417f408ca74 req-5077f22c-09fc-4d39-9dd0-19e4759815ae service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:43.388516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e4b19262-b9ec-4240-8a4e-2417f408ca74 req-5077f22c-09fc-4d39-9dd0-19e4759815ae service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:43.443853 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e4b19262-b9ec-4240-8a4e-2417f408ca74 req-5077f22c-09fc-4d39-9dd0-19e4759815ae service nova] Creating event network-vif-plugged:76327392-0461-484e-a4a6-480d5748b8bc for instance bf3c27d9-2596-4f58-80ab-0df600408845 on n-h1-839401-11 Aug 29 15:48:43.463496 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e4b19262-b9ec-4240-8a4e-2417f408ca74 req-5077f22c-09fc-4d39-9dd0-19e4759815ae service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112166 Aug 29 15:48:43.467064 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2752/5359] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:43.579221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-40386f9e-b7ad-4892-879f-e3aa03480001 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] Action: 'create', calling method: .version_select at 0x7fc4304e7af0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:43.604869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-40386f9e-b7ad-4892-879f-e3aa03480001 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] Getting quotas for project d20b7fe383d24d4bae9e028678733202. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:43.611595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-40386f9e-b7ad-4892-879f-e3aa03480001 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] Getting quotas for user dfdc41169f934c62a14242ebaa7f0ae0 and project d20b7fe383d24d4bae9e028678733202. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:43.669537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-40386f9e-b7ad-4892-879f-e3aa03480001 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] Getting quotas for project d20b7fe383d24d4bae9e028678733202. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:43.676370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-40386f9e-b7ad-4892-879f-e3aa03480001 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] Getting quotas for user dfdc41169f934c62a14242ebaa7f0ae0 and project d20b7fe383d24d4bae9e028678733202. Resources: {'server_groups'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:43.693414 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-40386f9e-b7ad-4892-879f-e3aa03480001 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] 10.222.0.62 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.414682 Aug 29 15:48:43.695286 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2608/5360] 10.222.0.62 () {62 vars in 1214 bytes} [Mon Aug 29 15:48:43 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:48:43.706767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-34a254c1-915b-411e-87a8-18081711c880 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:43.742098 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-34a254c1-915b-411e-87a8-18081711c880 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] 10.222.0.62 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.039907 Aug 29 15:48:43.744823 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2753/5361] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Aug 29 15:48:43 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:48:43.754665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5c58da69-bbb4-431f-b1f5-d940f2f2ee64 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:43.774193 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5c58da69-bbb4-431f-b1f5-d940f2f2ee64 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] 10.222.0.62 "GET /compute/v2.1/os-server-groups/43b1dab7-9f83-4513-be84-a3413215cbf1" status: 200 len: 235 microversion: 2.64 time: 0.023816 Aug 29 15:48:43.774783 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2609/5362] 10.222.0.62 () {60 vars in 1304 bytes} [Mon Aug 29 15:48:43 2022] GET /compute/v2.1/os-server-groups/43b1dab7-9f83-4513-be84-a3413215cbf1 => generated 235 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:48:43.787081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0c81cac1-1afa-4777-a9fd-c82205702297 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:43.880600 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0c81cac1-1afa-4777-a9fd-c82205702297 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] 10.222.0.62 "DELETE /compute/v2.1/os-server-groups/43b1dab7-9f83-4513-be84-a3413215cbf1" status: 204 len: 0 microversion: 2.64 time: 0.098171 Aug 29 15:48:43.881218 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2754/5363] 10.222.0.62 () {60 vars in 1307 bytes} [Mon Aug 29 15:48:43 2022] DELETE /compute/v2.1/os-server-groups/43b1dab7-9f83-4513-be84-a3413215cbf1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:48:43.891050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8fc7c73c-8019-4452-91cc-fb3e72abbf65 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:43.898463 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-8fc7c73c-8019-4452-91cc-fb3e72abbf65 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] HTTP exception thrown: Instance group 43b1dab7-9f83-4513-be84-a3413215cbf1 could not be found. Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8fc7c73c-8019-4452-91cc-fb3e72abbf65 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] Request method failure captured: Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/os-server-groups/43b1dab7-9f83-4513-be84-a3413215cbf1 HTTP/1.1 Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN_aD4W9UH4yzoW6SGC__EPeV4eKLKbGq_A1PXKm2tRwpp4E2tHSNG68f6S-oH5y_Y46F8TsESksa4sn_KSx2esLbzGV54hyl7DnaGzwMbJ823NYFQQa9arn5KMmmTX4zhjmV5NSWl40SMOkiwjKTovAbk6TAvgldKEe_57crYNbNjs Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.64 Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d20b7fe383d24d4bae9e028678733202 Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerGroup264TestJSON-974204617 Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d20b7fe383d24d4bae9e028678733202", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d20b7fe383d24d4bae9e028678733202"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d20b7fe383d24d4bae9e028678733202"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d20b7fe383d24d4bae9e028678733202"}]}] Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerGroup264TestJSON-974204617 Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d20b7fe383d24d4bae9e028678733202 Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerGroup264TestJSON-974204617 Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerGroup264TestJSON-974204617-project Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: dfdc41169f934c62a14242ebaa7f0ae0 Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerGroup264TestJSON-974204617-project Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance group 43b1dab7-9f83-4513-be84-a3413215cbf1 could not be found. Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '43b1dab7-9f83-4513-be84-a3413215cbf1'} Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 43b1dab7-9f83-4513-be84-a3413215cbf1 could not be found. Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 43b1dab7-9f83-4513-be84-a3413215cbf1 could not be found. Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:43.900104 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:43.905066 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:43.905066 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:43.905066 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:43.905066 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:43.905066 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 43b1dab7-9f83-4513-be84-a3413215cbf1 could not be found. Aug 29 15:48:43.905066 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:43.905066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8fc7c73c-8019-4452-91cc-fb3e72abbf65 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] Returning 404 to user: Instance group 43b1dab7-9f83-4513-be84-a3413215cbf1 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:43.905066 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8fc7c73c-8019-4452-91cc-fb3e72abbf65 tempest-ServerGroup264TestJSON-974204617 tempest-ServerGroup264TestJSON-974204617-project] 10.222.0.62 "DELETE /compute/v2.1/os-server-groups/43b1dab7-9f83-4513-be84-a3413215cbf1" status: 404 len: 117 microversion: 2.64 time: 0.014389 Aug 29 15:48:43.918202 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2610/5364] 10.222.0.62 () {60 vars in 1307 bytes} [Mon Aug 29 15:48:43 2022] DELETE /compute/v2.1/os-server-groups/43b1dab7-9f83-4513-be84-a3413215cbf1 => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:48:44.285753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-27c0c76b-adef-4b57-961b-6599913a999b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:44.287094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-27c0c76b-adef-4b57-961b-6599913a999b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:44.297984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27c0c76b-adef-4b57-961b-6599913a999b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:44.299613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27c0c76b-adef-4b57-961b-6599913a999b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:44.300485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27c0c76b-adef-4b57-961b-6599913a999b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:44.305013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27c0c76b-adef-4b57-961b-6599913a999b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:44.305811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27c0c76b-adef-4b57-961b-6599913a999b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:44.309799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27c0c76b-adef-4b57-961b-6599913a999b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:44.376568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8d0cc3c7-bad0-4cbb-95d6-dc9b9001fb41 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:44.376859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8d0cc3c7-bad0-4cbb-95d6-dc9b9001fb41 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:44.390916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d0cc3c7-bad0-4cbb-95d6-dc9b9001fb41 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:44.394625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d0cc3c7-bad0-4cbb-95d6-dc9b9001fb41 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:44.395402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d0cc3c7-bad0-4cbb-95d6-dc9b9001fb41 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:44.397609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d0cc3c7-bad0-4cbb-95d6-dc9b9001fb41 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:44.398279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d0cc3c7-bad0-4cbb-95d6-dc9b9001fb41 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:44.398909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d0cc3c7-bad0-4cbb-95d6-dc9b9001fb41 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:44.522777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-27c0c76b-adef-4b57-961b-6599913a999b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:44.532244 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-27c0c76b-adef-4b57-961b-6599913a999b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1316 microversion: 2.1 time: 0.251865 Aug 29 15:48:44.533782 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2755/5365] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:44 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:44.619271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8d0cc3c7-bad0-4cbb-95d6-dc9b9001fb41 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:44.634079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8d0cc3c7-bad0-4cbb-95d6-dc9b9001fb41 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:44.644123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8d0cc3c7-bad0-4cbb-95d6-dc9b9001fb41 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:44.648206 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8d0cc3c7-bad0-4cbb-95d6-dc9b9001fb41 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1872 microversion: 2.32 time: 0.275865 Aug 29 15:48:44.655201 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2611/5366] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:44 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1872 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:45.562068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d27b1cb-09b7-443b-bbed-e4dacb816482 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:45.564013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9d27b1cb-09b7-443b-bbed-e4dacb816482 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:45.572924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d27b1cb-09b7-443b-bbed-e4dacb816482 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:45.573931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d27b1cb-09b7-443b-bbed-e4dacb816482 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:45.574753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d27b1cb-09b7-443b-bbed-e4dacb816482 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:45.575945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d27b1cb-09b7-443b-bbed-e4dacb816482 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:45.576675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d27b1cb-09b7-443b-bbed-e4dacb816482 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:45.577513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d27b1cb-09b7-443b-bbed-e4dacb816482 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:45.681333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-50824c67-fc1a-4ad7-80d0-794e1eaef200 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:45.682916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-50824c67-fc1a-4ad7-80d0-794e1eaef200 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:45.690032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50824c67-fc1a-4ad7-80d0-794e1eaef200 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:45.690895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50824c67-fc1a-4ad7-80d0-794e1eaef200 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:45.691549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50824c67-fc1a-4ad7-80d0-794e1eaef200 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:45.692475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50824c67-fc1a-4ad7-80d0-794e1eaef200 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:45.693187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50824c67-fc1a-4ad7-80d0-794e1eaef200 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:45.693849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50824c67-fc1a-4ad7-80d0-794e1eaef200 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:45.718140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9d27b1cb-09b7-443b-bbed-e4dacb816482 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:45.718529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:45.727098 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d27b1cb-09b7-443b-bbed-e4dacb816482 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1504 microversion: 2.1 time: 0.169714 Aug 29 15:48:45.742375 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2756/5367] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:45 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:45.747603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-64a2ed58-1709-4c83-ae0d-d981e685d5ac tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:45.748106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-64a2ed58-1709-4c83-ae0d-d981e685d5ac tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:45.754538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64a2ed58-1709-4c83-ae0d-d981e685d5ac tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:45.755104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64a2ed58-1709-4c83-ae0d-d981e685d5ac tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:45.755817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64a2ed58-1709-4c83-ae0d-d981e685d5ac tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:45.756793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64a2ed58-1709-4c83-ae0d-d981e685d5ac tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:45.757448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64a2ed58-1709-4c83-ae0d-d981e685d5ac tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:45.758059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64a2ed58-1709-4c83-ae0d-d981e685d5ac tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:45.783188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-50824c67-fc1a-4ad7-80d0-794e1eaef200 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:45.785383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-64a2ed58-1709-4c83-ae0d-d981e685d5ac tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:48:45.815301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-50824c67-fc1a-4ad7-80d0-794e1eaef200 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:45.821171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-50824c67-fc1a-4ad7-80d0-794e1eaef200 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:45.822525 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-50824c67-fc1a-4ad7-80d0-794e1eaef200 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1872 microversion: 2.32 time: 0.145103 Aug 29 15:48:45.832584 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2612/5368] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:45 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1872 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:45.907982 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-64a2ed58-1709-4c83-ae0d-d981e685d5ac tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 204 len: 0 microversion: 2.1 time: 0.163973 Aug 29 15:48:45.909133 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2757/5369] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:48:45 2022] DELETE /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:48:45.918251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-093065c8-4c7f-4571-9b45-fe96eccf40e3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:45.919174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-093065c8-4c7f-4571-9b45-fe96eccf40e3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:45.932691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-093065c8-4c7f-4571-9b45-fe96eccf40e3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:45.933665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-093065c8-4c7f-4571-9b45-fe96eccf40e3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:45.934487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-093065c8-4c7f-4571-9b45-fe96eccf40e3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:45.935418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-093065c8-4c7f-4571-9b45-fe96eccf40e3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:45.936025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-093065c8-4c7f-4571-9b45-fe96eccf40e3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:45.936734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-093065c8-4c7f-4571-9b45-fe96eccf40e3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:46.101072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-093065c8-4c7f-4571-9b45-fe96eccf40e3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:46.110207 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-093065c8-4c7f-4571-9b45-fe96eccf40e3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1510 microversion: 2.1 time: 0.196126 Aug 29 15:48:46.123265 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2613/5370] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:45 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:46.847891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-75dbc4ac-8991-4081-b500-fd0ba4d28a67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:46.848492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-75dbc4ac-8991-4081-b500-fd0ba4d28a67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:46.869673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75dbc4ac-8991-4081-b500-fd0ba4d28a67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:46.870688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75dbc4ac-8991-4081-b500-fd0ba4d28a67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:46.871358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75dbc4ac-8991-4081-b500-fd0ba4d28a67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:46.873284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75dbc4ac-8991-4081-b500-fd0ba4d28a67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:46.873995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75dbc4ac-8991-4081-b500-fd0ba4d28a67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:46.874854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75dbc4ac-8991-4081-b500-fd0ba4d28a67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:46.968374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-75dbc4ac-8991-4081-b500-fd0ba4d28a67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:46.978614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-75dbc4ac-8991-4081-b500-fd0ba4d28a67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:46.980551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-75dbc4ac-8991-4081-b500-fd0ba4d28a67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:46.982153 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-75dbc4ac-8991-4081-b500-fd0ba4d28a67 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1872 microversion: 2.32 time: 0.139082 Aug 29 15:48:46.988086 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2758/5371] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:46 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1872 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:47.131795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-75baed80-743c-449f-bf34-160412703ade tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:47.132584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-75baed80-743c-449f-bf34-160412703ade tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:47.142547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75baed80-743c-449f-bf34-160412703ade tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:47.143116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75baed80-743c-449f-bf34-160412703ade tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:47.144098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75baed80-743c-449f-bf34-160412703ade tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:47.145043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75baed80-743c-449f-bf34-160412703ade tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:47.145623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75baed80-743c-449f-bf34-160412703ade tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:47.146550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75baed80-743c-449f-bf34-160412703ade tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:47.612217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-75baed80-743c-449f-bf34-160412703ade tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:47.620913 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-75baed80-743c-449f-bf34-160412703ade tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1510 microversion: 2.1 time: 0.493582 Aug 29 15:48:47.636107 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2614/5372] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:47 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1510 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:48.012179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8e5844b9-4f76-4c98-96cd-f9e84b5c417a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:48.012946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8e5844b9-4f76-4c98-96cd-f9e84b5c417a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:48.027418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e5844b9-4f76-4c98-96cd-f9e84b5c417a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:48.029571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e5844b9-4f76-4c98-96cd-f9e84b5c417a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:48.033863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e5844b9-4f76-4c98-96cd-f9e84b5c417a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.035003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e5844b9-4f76-4c98-96cd-f9e84b5c417a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:48.035587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e5844b9-4f76-4c98-96cd-f9e84b5c417a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:48.036125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e5844b9-4f76-4c98-96cd-f9e84b5c417a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.215019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8e5844b9-4f76-4c98-96cd-f9e84b5c417a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:48.235623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8e5844b9-4f76-4c98-96cd-f9e84b5c417a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:48.238045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8e5844b9-4f76-4c98-96cd-f9e84b5c417a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:48.239888 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8e5844b9-4f76-4c98-96cd-f9e84b5c417a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1872 microversion: 2.32 time: 0.232166 Aug 29 15:48:48.241241 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2759/5373] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:48 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1872 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:48.413938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-60f684f7-cfce-4694-bb59-d2c537e1c82c req-b754404b-6a1d-41b1-9910-1b1225e4ec54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3c27d9-2596-4f58-80ab-0df600408845", "name": "network-vif-deleted", "tag": "76327392-0461-484e-a4a6-480d5748b8bc"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:48.453823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-60f684f7-cfce-4694-bb59-d2c537e1c82c req-b754404b-6a1d-41b1-9910-1b1225e4ec54 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:48.454329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-60f684f7-cfce-4694-bb59-d2c537e1c82c req-b754404b-6a1d-41b1-9910-1b1225e4ec54 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:48.454765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-60f684f7-cfce-4694-bb59-d2c537e1c82c req-b754404b-6a1d-41b1-9910-1b1225e4ec54 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.494604 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-60f684f7-cfce-4694-bb59-d2c537e1c82c req-b754404b-6a1d-41b1-9910-1b1225e4ec54 service nova] Creating event network-vif-deleted:76327392-0461-484e-a4a6-480d5748b8bc for instance bf3c27d9-2596-4f58-80ab-0df600408845 on n-h1-839401-11 Aug 29 15:48:48.526484 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-60f684f7-cfce-4694-bb59-d2c537e1c82c req-b754404b-6a1d-41b1-9910-1b1225e4ec54 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112739 Aug 29 15:48:48.527539 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2615/5374] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:48.641556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1cce2eed-9531-4fea-ba90-90167b2aa535 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:48.642193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1cce2eed-9531-4fea-ba90-90167b2aa535 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:48.657160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cce2eed-9531-4fea-ba90-90167b2aa535 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:48.657669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cce2eed-9531-4fea-ba90-90167b2aa535 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:48.658123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cce2eed-9531-4fea-ba90-90167b2aa535 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.660364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cce2eed-9531-4fea-ba90-90167b2aa535 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:48.660848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cce2eed-9531-4fea-ba90-90167b2aa535 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:48.661322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cce2eed-9531-4fea-ba90-90167b2aa535 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.728987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cce2eed-9531-4fea-ba90-90167b2aa535 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:48.729521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cce2eed-9531-4fea-ba90-90167b2aa535 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:48.733063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cce2eed-9531-4fea-ba90-90167b2aa535 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.733573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-1cce2eed-9531-4fea-ba90-90167b2aa535 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lazy-loading 'fault' on Instance uuid bf3c27d9-2596-4f58-80ab-0df600408845 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:48:48.815869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1cce2eed-9531-4fea-ba90-90167b2aa535 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:48.825179 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1cce2eed-9531-4fea-ba90-90167b2aa535 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 200 len: 1306 microversion: 2.1 time: 0.187456 Aug 29 15:48:48.831471 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2760/5375] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:48 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 1306 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:49.265753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7cb7695e-f671-49b0-8df2-3c4f990a5644 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:49.266466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7cb7695e-f671-49b0-8df2-3c4f990a5644 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:49.277424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cb7695e-f671-49b0-8df2-3c4f990a5644 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.288143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cb7695e-f671-49b0-8df2-3c4f990a5644 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.289442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cb7695e-f671-49b0-8df2-3c4f990a5644 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.290231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cb7695e-f671-49b0-8df2-3c4f990a5644 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.296853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cb7695e-f671-49b0-8df2-3c4f990a5644 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.297705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cb7695e-f671-49b0-8df2-3c4f990a5644 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.396498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7cb7695e-f671-49b0-8df2-3c4f990a5644 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:49.407908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7cb7695e-f671-49b0-8df2-3c4f990a5644 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:49.409849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7cb7695e-f671-49b0-8df2-3c4f990a5644 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:49.411453 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7cb7695e-f671-49b0-8df2-3c4f990a5644 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1872 microversion: 2.32 time: 0.150930 Aug 29 15:48:49.412320 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2616/5376] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:49 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1872 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:49.683325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-065f7f93-40a2-4bb1-b8b5-fb9bad486b7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:49.686402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-065f7f93-40a2-4bb1-b8b5-fb9bad486b7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:49.703573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-065f7f93-40a2-4bb1-b8b5-fb9bad486b7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.706413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-065f7f93-40a2-4bb1-b8b5-fb9bad486b7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.707109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-065f7f93-40a2-4bb1-b8b5-fb9bad486b7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.712240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-065f7f93-40a2-4bb1-b8b5-fb9bad486b7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.713115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-065f7f93-40a2-4bb1-b8b5-fb9bad486b7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.713853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-065f7f93-40a2-4bb1-b8b5-fb9bad486b7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.761770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-065f7f93-40a2-4bb1-b8b5-fb9bad486b7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lazy-loading 'flavor' on Instance uuid 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:48:49.855358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c5c61ce3-3a74-46c3-a571-c723c84e9f1c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:49.855996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c5c61ce3-3a74-46c3-a571-c723c84e9f1c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:49.871681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5c61ce3-3a74-46c3-a571-c723c84e9f1c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.872507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5c61ce3-3a74-46c3-a571-c723c84e9f1c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.875629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5c61ce3-3a74-46c3-a571-c723c84e9f1c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.876592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5c61ce3-3a74-46c3-a571-c723c84e9f1c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.877362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5c61ce3-3a74-46c3-a571-c723c84e9f1c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.886489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5c61ce3-3a74-46c3-a571-c723c84e9f1c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.923041 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-c5c61ce3-3a74-46c3-a571-c723c84e9f1c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c5c61ce3-3a74-46c3-a571-c723c84e9f1c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 HTTP/1.1 Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'bf3c27d9-2596-4f58-80ab-0df600408845'} Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:49.928141 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:49.932600 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:49.932600 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:49.932600 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:49.932600 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:49.932600 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:49.932600 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:48:49.932600 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:49.939021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c5c61ce3-3a74-46c3-a571-c723c84e9f1c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:49.941495 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c5c61ce3-3a74-46c3-a571-c723c84e9f1c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 404 len: 111 microversion: 2.1 time: 0.098946 Aug 29 15:48:49.944438 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2617/5377] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:49 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:48:49.955476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ada43357-39bb-444c-bc70-5cc9817a812b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:49.958939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ada43357-39bb-444c-bc70-5cc9817a812b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:49.973416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ada43357-39bb-444c-bc70-5cc9817a812b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.973975 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-065f7f93-40a2-4bb1-b8b5-fb9bad486b7b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0/action" status: 200 len: 32 microversion: 2.1 time: 0.291542 Aug 29 15:48:49.974721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ada43357-39bb-444c-bc70-5cc9817a812b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.975490 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2761/5378] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:49 2022] POST /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0/action => generated 32 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:48:49.976947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ada43357-39bb-444c-bc70-5cc9817a812b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.979017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ada43357-39bb-444c-bc70-5cc9817a812b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.980181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ada43357-39bb-444c-bc70-5cc9817a812b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.980858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ada43357-39bb-444c-bc70-5cc9817a812b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.990785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4f0e9199-c79b-4827-a743-cff5fd720151 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:49.991522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4f0e9199-c79b-4827-a743-cff5fd720151 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:50.008380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f0e9199-c79b-4827-a743-cff5fd720151 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.008894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f0e9199-c79b-4827-a743-cff5fd720151 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.011878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f0e9199-c79b-4827-a743-cff5fd720151 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.017547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f0e9199-c79b-4827-a743-cff5fd720151 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.017887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f0e9199-c79b-4827-a743-cff5fd720151 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.018347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f0e9199-c79b-4827-a743-cff5fd720151 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.220564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ada43357-39bb-444c-bc70-5cc9817a812b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:50.231975 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ada43357-39bb-444c-bc70-5cc9817a812b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.282466 Aug 29 15:48:50.236768 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2618/5379] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:49 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:50.273205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4f0e9199-c79b-4827-a743-cff5fd720151 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:50.283458 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4f0e9199-c79b-4827-a743-cff5fd720151 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1521 microversion: 2.1 time: 0.297817 Aug 29 15:48:50.284707 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2762/5380] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:49 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:50.434948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a2f5dc95-f00f-4864-b274-ff3c50cf48e3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:50.435568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a2f5dc95-f00f-4864-b274-ff3c50cf48e3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:50.462763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2f5dc95-f00f-4864-b274-ff3c50cf48e3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.463268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2f5dc95-f00f-4864-b274-ff3c50cf48e3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.463719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2f5dc95-f00f-4864-b274-ff3c50cf48e3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.464442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2f5dc95-f00f-4864-b274-ff3c50cf48e3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.464905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2f5dc95-f00f-4864-b274-ff3c50cf48e3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.465367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2f5dc95-f00f-4864-b274-ff3c50cf48e3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.488776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7205993c-8ce7-4daa-a5b7-e3828be1025f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7205993c-8ce7-4daa-a5b7-e3828be1025f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 163 Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: {"server": {"name": 12345, "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'networks': [{'uuid': '74eea137-7f8c-43e1-bd42-582bf8562b2a'}]}}} Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 12345 Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:48:50.501831 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:48:50.506938 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:48:50.506938 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 29 15:48:50.506938 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:50.506938 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:50.506938 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:50.506938 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:50.506938 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:50.506938 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:50.506938 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:48:50.506938 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:48:50.506938 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 29 15:48:50.506938 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:48:50.509652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7205993c-8ce7-4daa-a5b7-e3828be1025f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:50.512217 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7205993c-8ce7-4daa-a5b7-e3828be1025f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.027728 Aug 29 15:48:50.516963 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2763/5381] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:50 2022] POST /compute/v2.1/servers => generated 127 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:48:50.523293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2a864c6f-96a6-456d-8827-9bd36538282a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:50.524465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2a864c6f-96a6-456d-8827-9bd36538282a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:50.538312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:50.543193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a864c6f-96a6-456d-8827-9bd36538282a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.543803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a864c6f-96a6-456d-8827-9bd36538282a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.544989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a864c6f-96a6-456d-8827-9bd36538282a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.546278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a864c6f-96a6-456d-8827-9bd36538282a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.547725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a864c6f-96a6-456d-8827-9bd36538282a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.548352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a864c6f-96a6-456d-8827-9bd36538282a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.582883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2f5dc95-f00f-4864-b274-ff3c50cf48e3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.583683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2f5dc95-f00f-4864-b274-ff3c50cf48e3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.584432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2f5dc95-f00f-4864-b274-ff3c50cf48e3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.585057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-a2f5dc95-f00f-4864-b274-ff3c50cf48e3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lazy-loading 'fault' on Instance uuid 4a0e3960-ddb0-4c89-b821-7eb8379391ae {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:48:50.622750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:50.686092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a2f5dc95-f00f-4864-b274-ff3c50cf48e3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:50.695086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a2f5dc95-f00f-4864-b274-ff3c50cf48e3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:50.700860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a2f5dc95-f00f-4864-b274-ff3c50cf48e3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '661739c0be874b799a47e2bd8f4fa65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0582312a80402fb35d3be2a5b4bede', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:50.702364 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a2f5dc95-f00f-4864-b274-ff3c50cf48e3 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 200 len: 1639 microversion: 2.32 time: 0.271404 Aug 29 15:48:50.717346 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2619/5382] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:50 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 1639 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:50.799211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2a864c6f-96a6-456d-8827-9bd36538282a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:50.809651 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2a864c6f-96a6-456d-8827-9bd36538282a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.291281 Aug 29 15:48:50.825546 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2764/5383] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:50 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:50.835892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7f95e9a2-bb0d-41f9-b97e-9608cb4a2584 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:50.837319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7f95e9a2-bb0d-41f9-b97e-9608cb4a2584 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:50.867361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f95e9a2-bb0d-41f9-b97e-9608cb4a2584 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.869444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f95e9a2-bb0d-41f9-b97e-9608cb4a2584 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.872008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f95e9a2-bb0d-41f9-b97e-9608cb4a2584 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.873063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f95e9a2-bb0d-41f9-b97e-9608cb4a2584 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.873716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f95e9a2-bb0d-41f9-b97e-9608cb4a2584 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.874312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f95e9a2-bb0d-41f9-b97e-9608cb4a2584 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:51.250709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7f95e9a2-bb0d-41f9-b97e-9608cb4a2584 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:51.263259 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7f95e9a2-bb0d-41f9-b97e-9608cb4a2584 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.432261 Aug 29 15:48:51.278959 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2620/5384] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:50 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:51.311050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a15d9997-d845-499a-b636-4f694b848d62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:51.312333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a15d9997-d845-499a-b636-4f694b848d62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:51.318996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a15d9997-d845-499a-b636-4f694b848d62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:51.319706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a15d9997-d845-499a-b636-4f694b848d62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:51.320338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a15d9997-d845-499a-b636-4f694b848d62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:51.321713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a15d9997-d845-499a-b636-4f694b848d62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:51.322513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a15d9997-d845-499a-b636-4f694b848d62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:51.323101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a15d9997-d845-499a-b636-4f694b848d62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:51.713707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a15d9997-d845-499a-b636-4f694b848d62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:51.730652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-045cf83c-6c35-4e96-8c22-8b8a14d804f6 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:51.731272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-045cf83c-6c35-4e96-8c22-8b8a14d804f6 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:51.731404 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a15d9997-d845-499a-b636-4f694b848d62 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1521 microversion: 2.1 time: 0.424451 Aug 29 15:48:51.732655 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2765/5385] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:51 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:51.750708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-045cf83c-6c35-4e96-8c22-8b8a14d804f6 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:51.751288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-045cf83c-6c35-4e96-8c22-8b8a14d804f6 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:51.751931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-045cf83c-6c35-4e96-8c22-8b8a14d804f6 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:51.753140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-045cf83c-6c35-4e96-8c22-8b8a14d804f6 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:51.753623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-045cf83c-6c35-4e96-8c22-8b8a14d804f6 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:51.768855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-045cf83c-6c35-4e96-8c22-8b8a14d804f6 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:51.816008 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-045cf83c-6c35-4e96-8c22-8b8a14d804f6 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] HTTP exception thrown: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-045cf83c-6c35-4e96-8c22-8b8a14d804f6 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Request method failure captured: Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae HTTP/1.1 Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN46WDzbhapi0CPAoZBDq0TC0RPtx4uP7G-wLtcD-dC2UWCmDCpGVO7Dmj0a9StcYE_C5DftQ14oD8wOfX1ZdUaoUcJi_OdhcjObse0fG3yc5fL6xWg7CRUODPQcweqKf20pn-uh-es7UQGUAT7mLp-EiYvM5jUlsYWJdPK4T3EnZiI Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.32 Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: da0582312a80402fb35d3be2a5b4bede Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TaggedBootDevicesTest-1338434355 Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_da0582312a80402fb35d3be2a5b4bede", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/da0582312a80402fb35d3be2a5b4bede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/da0582312a80402fb35d3be2a5b4bede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/da0582312a80402fb35d3be2a5b4bede"}]}] Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TaggedBootDevicesTest-1338434355 Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: da0582312a80402fb35d3be2a5b4bede Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1338434355 Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TaggedBootDevicesTest-1338434355-project Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 661739c0be874b799a47e2bd8f4fa65d Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TaggedBootDevicesTest-1338434355-project Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '4a0e3960-ddb0-4c89-b821-7eb8379391ae'} Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:51.822987 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:51.828294 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:51.828294 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:51.828294 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:51.828294 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:51.828294 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:51.828294 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:51.828294 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. Aug 29 15:48:51.828294 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:51.843041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-045cf83c-6c35-4e96-8c22-8b8a14d804f6 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Returning 404 to user: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:51.843041 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-045cf83c-6c35-4e96-8c22-8b8a14d804f6 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 404 len: 111 microversion: 2.32 time: 0.109151 Aug 29 15:48:51.844986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-185f21a9-d2ee-4098-8ca5-6d5de9fe198a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '.version_select at 0x7fc42a93fd30>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:51.849967 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2621/5386] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:51 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:48:51.870070 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-185f21a9-d2ee-4098-8ca5-6d5de9fe198a tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-856749252" status: 204 len: 0 microversion: 2.32 time: 0.029987 Aug 29 15:48:51.875584 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2766/5387] 10.222.0.62 () {60 vars in 1259 bytes} [Mon Aug 29 15:48:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-856749252 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:48:52.774004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-47fae99f-1312-4874-a742-f20119446ffd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:52.777530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-47fae99f-1312-4874-a742-f20119446ffd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:52.800019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47fae99f-1312-4874-a742-f20119446ffd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:52.805258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47fae99f-1312-4874-a742-f20119446ffd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:52.806040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47fae99f-1312-4874-a742-f20119446ffd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:52.807900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47fae99f-1312-4874-a742-f20119446ffd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:52.809795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47fae99f-1312-4874-a742-f20119446ffd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:52.811606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47fae99f-1312-4874-a742-f20119446ffd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:53.427331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-47fae99f-1312-4874-a742-f20119446ffd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:53.440515 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-47fae99f-1312-4874-a742-f20119446ffd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1521 microversion: 2.1 time: 0.690125 Aug 29 15:48:53.441871 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2622/5388] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:52 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1521 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:53.534134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-778894300", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "48e6dc18-7b5d-41fd-8cc3-71b7c7ea3176"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:53.707366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] validate_networks() for [('48e6dc18-7b5d-41fd-8cc3-71b7c7ea3176', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:48:54.482543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0a0911cb-ba7f-4820-9bdf-bae95a9bf064 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:54.483279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0a0911cb-ba7f-4820-9bdf-bae95a9bf064 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:54.490619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=8 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:54.516134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a0911cb-ba7f-4820-9bdf-bae95a9bf064 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:54.516540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a0911cb-ba7f-4820-9bdf-bae95a9bf064 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:54.516977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a0911cb-ba7f-4820-9bdf-bae95a9bf064 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:54.517750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a0911cb-ba7f-4820-9bdf-bae95a9bf064 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:54.518204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a0911cb-ba7f-4820-9bdf-bae95a9bf064 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:54.518685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a0911cb-ba7f-4820-9bdf-bae95a9bf064 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:54.921067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0a0911cb-ba7f-4820-9bdf-bae95a9bf064 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:54.946780 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0a0911cb-ba7f-4820-9bdf-bae95a9bf064 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1521 microversion: 2.1 time: 0.476195 Aug 29 15:48:54.959988 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2623/5389] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:54 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:54.968425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-56701bc7-9dee-4c8c-ab2e-6eb2b292dfb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-958477384", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "12f3ef1b-f3b7-4af7-b4fe-717512f6bbd3", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:54.983963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:55.116810 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-56701bc7-9dee-4c8c-ab2e-6eb2b292dfb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Block Device 12f3ef1b-f3b7-4af7-b4fe-717512f6bbd3 is not bootable. Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-56701bc7-9dee-4c8c-ab2e-6eb2b292dfb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 357 Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-958477384", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "12f3ef1b-f3b7-4af7-b4fe-717512f6bbd3", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: exception: Block Device 12f3ef1b-f3b7-4af7-b4fe-717512f6bbd3 is not bootable. Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-958477384', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '12f3ef1b-f3b7-4af7-b4fe-717512f6bbd3'}], 'networks': [{'uuid': '74eea137-7f8c-43e1-bd42-582bf8562b2a'}]}}} Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 12f3ef1b-f3b7-4af7-b4fe-717512f6bbd3 is not bootable. Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:48:55.128504 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 12f3ef1b-f3b7-4af7-b4fe-717512f6bbd3 is not bootable. Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 12f3ef1b-f3b7-4af7-b4fe-717512f6bbd3 is not bootable. Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-56701bc7-9dee-4c8c-ab2e-6eb2b292dfb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 400 to user: Block Device 12f3ef1b-f3b7-4af7-b4fe-717512f6bbd3 is not bootable. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-56701bc7-9dee-4c8c-ab2e-6eb2b292dfb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.169169 Aug 29 15:48:55.138970 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2624/5390] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:54 2022] POST /compute/v2.1/servers => generated 110 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:48:55.140661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-34e76094-6a14-4f40-84ed-8be841e3fb64 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:55.142150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-34e76094-6a14-4f40-84ed-8be841e3fb64 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:55.173423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34e76094-6a14-4f40-84ed-8be841e3fb64 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:55.174331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34e76094-6a14-4f40-84ed-8be841e3fb64 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:55.176714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34e76094-6a14-4f40-84ed-8be841e3fb64 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:55.181307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34e76094-6a14-4f40-84ed-8be841e3fb64 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:55.181880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34e76094-6a14-4f40-84ed-8be841e3fb64 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:55.182340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34e76094-6a14-4f40-84ed-8be841e3fb64 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:55.622883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:48:55.623378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:48:55.623862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:48:55.624554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:48:55.625256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:48:55.650147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:55.650586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-34e76094-6a14-4f40-84ed-8be841e3fb64 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:55.651051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:55.651051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:55.651792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:55.652250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:55.652678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:55.658950 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-34e76094-6a14-4f40-84ed-8be841e3fb64 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.523769 Aug 29 15:48:55.663981 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2625/5391] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:55 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:55.684873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-30f9ef1f-890d-4d67-9530-ba8f0e0a75ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:55.686313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-30f9ef1f-890d-4d67-9530-ba8f0e0a75ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:55.706590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30f9ef1f-890d-4d67-9530-ba8f0e0a75ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:55.707224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30f9ef1f-890d-4d67-9530-ba8f0e0a75ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:55.713820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30f9ef1f-890d-4d67-9530-ba8f0e0a75ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:55.715382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30f9ef1f-890d-4d67-9530-ba8f0e0a75ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:55.715884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30f9ef1f-890d-4d67-9530-ba8f0e0a75ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:55.716322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30f9ef1f-890d-4d67-9530-ba8f0e0a75ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:55.734262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Getting quotas for project 9f9a115c069d424caee396c6dfd3fa50. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:55.749735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Getting quotas for user 53af5a51f87647d0ae78531c72554ca6 and project 9f9a115c069d424caee396c6dfd3fa50. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:55.789263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:48:55.791648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:48:55.904148 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7c75a8f2-6d33-4e5a-924b-ec38a04e5f3f tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.375775 Aug 29 15:48:55.920607 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2767/5392] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:48:55.949731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-39b2f583-3188-4d54-ad85-2d29a4d92a28 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:55.950535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-39b2f583-3188-4d54-ad85-2d29a4d92a28 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:56.252549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-39b2f583-3188-4d54-ad85-2d29a4d92a28 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:56.266309 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-39b2f583-3188-4d54-ad85-2d29a4d92a28 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1218 microversion: 2.1 time: 0.344201 Aug 29 15:48:56.279911 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2768/5393] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:55 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1218 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:56.286295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0ef7bebe-0dc5-444e-b4b6-ce36bb31bc28 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:56.286915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0ef7bebe-0dc5-444e-b4b6-ce36bb31bc28 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:56.308498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef7bebe-0dc5-444e-b4b6-ce36bb31bc28 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:56.309078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef7bebe-0dc5-444e-b4b6-ce36bb31bc28 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:56.311033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef7bebe-0dc5-444e-b4b6-ce36bb31bc28 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:56.318355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef7bebe-0dc5-444e-b4b6-ce36bb31bc28 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:56.319367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef7bebe-0dc5-444e-b4b6-ce36bb31bc28 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:56.320006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef7bebe-0dc5-444e-b4b6-ce36bb31bc28 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:56.426438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-30f9ef1f-890d-4d67-9530-ba8f0e0a75ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:56.443552 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-30f9ef1f-890d-4d67-9530-ba8f0e0a75ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.765789 Aug 29 15:48:56.461726 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2626/5394] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:55 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:56.851946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0ef7bebe-0dc5-444e-b4b6-ce36bb31bc28 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:56.860799 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0ef7bebe-0dc5-444e-b4b6-ce36bb31bc28 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1521 microversion: 2.1 time: 0.579448 Aug 29 15:48:56.865243 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2769/5395] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:56 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1521 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:57.291202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-57067378-691c-4f7d-a83a-921639946ef9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:57.292389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-57067378-691c-4f7d-a83a-921639946ef9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:57.308478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57067378-691c-4f7d-a83a-921639946ef9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:57.309298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57067378-691c-4f7d-a83a-921639946ef9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:57.310886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57067378-691c-4f7d-a83a-921639946ef9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:57.317990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57067378-691c-4f7d-a83a-921639946ef9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:57.320934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57067378-691c-4f7d-a83a-921639946ef9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:57.321773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57067378-691c-4f7d-a83a-921639946ef9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:57.545459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-57067378-691c-4f7d-a83a-921639946ef9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:57.569045 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-57067378-691c-4f7d-a83a-921639946ef9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1214 microversion: 2.1 time: 0.282893 Aug 29 15:48:57.573963 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2627/5396] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:57 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1214 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:57.903660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-800cce2e-ba5c-49bf-a5cd-afa09d860387 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:57.908741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-800cce2e-ba5c-49bf-a5cd-afa09d860387 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:57.920232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-800cce2e-ba5c-49bf-a5cd-afa09d860387 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:57.925708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-800cce2e-ba5c-49bf-a5cd-afa09d860387 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:57.928239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-800cce2e-ba5c-49bf-a5cd-afa09d860387 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:57.929905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-800cce2e-ba5c-49bf-a5cd-afa09d860387 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:57.930506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-800cce2e-ba5c-49bf-a5cd-afa09d860387 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:57.932024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-800cce2e-ba5c-49bf-a5cd-afa09d860387 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:58.326920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-800cce2e-ba5c-49bf-a5cd-afa09d860387 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:58.340259 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-800cce2e-ba5c-49bf-a5cd-afa09d860387 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1521 microversion: 2.1 time: 0.450258 Aug 29 15:48:58.353486 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2770/5397] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:57 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1521 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:58.596525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b8b4ed49-9717-4aff-8081-20fa1074f23a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:58.597454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b8b4ed49-9717-4aff-8081-20fa1074f23a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:58.608658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8b4ed49-9717-4aff-8081-20fa1074f23a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:58.609180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8b4ed49-9717-4aff-8081-20fa1074f23a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:58.613819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8b4ed49-9717-4aff-8081-20fa1074f23a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:58.614582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8b4ed49-9717-4aff-8081-20fa1074f23a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:58.615226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8b4ed49-9717-4aff-8081-20fa1074f23a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:58.616028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8b4ed49-9717-4aff-8081-20fa1074f23a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:58.818104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b8b4ed49-9717-4aff-8081-20fa1074f23a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:58.831260 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b8b4ed49-9717-4aff-8081-20fa1074f23a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1276 microversion: 2.1 time: 0.242467 Aug 29 15:48:58.836840 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2628/5398] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:58 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1276 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:59.366893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a226f2f-72bf-4821-9038-787826bbfe63 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:59.367524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9a226f2f-72bf-4821-9038-787826bbfe63 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:59.392571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a226f2f-72bf-4821-9038-787826bbfe63 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.395742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a226f2f-72bf-4821-9038-787826bbfe63 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.398880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a226f2f-72bf-4821-9038-787826bbfe63 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:59.401464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a226f2f-72bf-4821-9038-787826bbfe63 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.403244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a226f2f-72bf-4821-9038-787826bbfe63 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.403702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a226f2f-72bf-4821-9038-787826bbfe63 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:59.657720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4c08af9b-82e4-4f97-a3c7-0877a82b517f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2095668840", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "destination_type": "local"}, {"source_type": "volume", "uuid": "2747e0ba-d1ca-4538-be40-13201b6a4248", "destination_type": "invalid"}], "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4c08af9b-82e4-4f97-a3c7-0877a82b517f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 495 Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2095668840", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "destination_type": "local"}, {"source_type": "volume", "uuid": "2747e0ba-d1ca-4538-be40-13201b6a4248", "destination_type": "invalid"}], "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2095668840', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '2747e0ba-d1ca-4538-be40-13201b6a4248', 'destination_type': 'invalid'}], 'networks': [{'uuid': '74eea137-7f8c-43e1-bd42-582bf8562b2a'}]}}} Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:59.663394 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 29 15:48:59.668281 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:48:59.676312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4c08af9b-82e4-4f97-a3c7-0877a82b517f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:59.677551 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4c08af9b-82e4-4f97-a3c7-0877a82b517f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.024360 Aug 29 15:48:59.678696 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2629/5399] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:59 2022] POST /compute/v2.1/servers => generated 155 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:48:59.688000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-50329181-298c-4c43-8b77-2161f1073db4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:59.688938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-50329181-298c-4c43-8b77-2161f1073db4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:59.696916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50329181-298c-4c43-8b77-2161f1073db4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.697740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50329181-298c-4c43-8b77-2161f1073db4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.698462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50329181-298c-4c43-8b77-2161f1073db4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:59.699494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50329181-298c-4c43-8b77-2161f1073db4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.700120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50329181-298c-4c43-8b77-2161f1073db4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.700944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-50329181-298c-4c43-8b77-2161f1073db4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:59.792915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9a226f2f-72bf-4821-9038-787826bbfe63 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:59.836316 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a226f2f-72bf-4821-9038-787826bbfe63 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1521 microversion: 2.1 time: 0.472222 Aug 29 15:48:59.839986 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2771/5400] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:59 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:59.859058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a8b17051-da93-4fee-82ca-55edc25b34f8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:59.859719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a8b17051-da93-4fee-82ca-55edc25b34f8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:59.875197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8b17051-da93-4fee-82ca-55edc25b34f8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.876565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8b17051-da93-4fee-82ca-55edc25b34f8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.877262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8b17051-da93-4fee-82ca-55edc25b34f8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:59.879560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8b17051-da93-4fee-82ca-55edc25b34f8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.880308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8b17051-da93-4fee-82ca-55edc25b34f8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.881311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8b17051-da93-4fee-82ca-55edc25b34f8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:00.028947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-50329181-298c-4c43-8b77-2161f1073db4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:00.054571 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-50329181-298c-4c43-8b77-2161f1073db4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.371705 Aug 29 15:49:00.056166 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2630/5401] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:59 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:00.099456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a2c6d645-9eab-4676-b475-af8f66d9147d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:00.100709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a2c6d645-9eab-4676-b475-af8f66d9147d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:00.107110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a8b17051-da93-4fee-82ca-55edc25b34f8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:00.116668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2c6d645-9eab-4676-b475-af8f66d9147d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:00.117213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2c6d645-9eab-4676-b475-af8f66d9147d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:00.117652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2c6d645-9eab-4676-b475-af8f66d9147d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:00.118353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2c6d645-9eab-4676-b475-af8f66d9147d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:00.118912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2c6d645-9eab-4676-b475-af8f66d9147d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:00.119358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2c6d645-9eab-4676-b475-af8f66d9147d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:00.119642 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a8b17051-da93-4fee-82ca-55edc25b34f8 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1276 microversion: 2.1 time: 0.263150 Aug 29 15:49:00.133456 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2772/5402] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:59 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1276 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:00.460176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a2c6d645-9eab-4676-b475-af8f66d9147d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:00.477917 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a2c6d645-9eab-4676-b475-af8f66d9147d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.397744 Aug 29 15:49:00.478828 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2631/5403] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:00 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:00.559988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-327d8266-ee09-4ad0-b4b0-878da0c01177 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-180001999", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-327d8266-ee09-4ad0-b4b0-878da0c01177 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 491 Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-180001999", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-180001999', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '74eea137-7f8c-43e1-bd42-582bf8562b2a'}]}}} Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:00.567077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:00.570410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-327d8266-ee09-4ad0-b4b0-878da0c01177 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:00.578396 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-327d8266-ee09-4ad0-b4b0-878da0c01177 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.017590 Aug 29 15:49:00.578396 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2773/5404] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:00 2022] POST /compute/v2.1/servers => generated 624 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:00.583342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-46567ca0-e090-406b-973b-6dc368642b21 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:00.585514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-46567ca0-e090-406b-973b-6dc368642b21 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:00.597656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46567ca0-e090-406b-973b-6dc368642b21 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:00.599934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46567ca0-e090-406b-973b-6dc368642b21 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:00.601650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46567ca0-e090-406b-973b-6dc368642b21 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:00.603202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46567ca0-e090-406b-973b-6dc368642b21 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:00.604018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46567ca0-e090-406b-973b-6dc368642b21 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:00.604781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46567ca0-e090-406b-973b-6dc368642b21 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:00.806783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-477dd4de-f4fb-4f3d-99ab-fc41406ea511 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:00.807674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-477dd4de-f4fb-4f3d-99ab-fc41406ea511 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:00.858476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-477dd4de-f4fb-4f3d-99ab-fc41406ea511 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:00.858994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-477dd4de-f4fb-4f3d-99ab-fc41406ea511 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:00.859437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-477dd4de-f4fb-4f3d-99ab-fc41406ea511 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:00.866936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-477dd4de-f4fb-4f3d-99ab-fc41406ea511 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:00.868286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-477dd4de-f4fb-4f3d-99ab-fc41406ea511 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:00.872127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-477dd4de-f4fb-4f3d-99ab-fc41406ea511 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:00.942558 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-477dd4de-f4fb-4f3d-99ab-fc41406ea511 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] HTTP exception thrown: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-477dd4de-f4fb-4f3d-99ab-fc41406ea511 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Request method failure captured: Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae HTTP/1.1 Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN46WDzbhapi0CPAoZBDq0TC0RPtx4uP7G-wLtcD-dC2UWCmDCpGVO7Dmj0a9StcYE_C5DftQ14oD8wOfX1ZdUaoUcJi_OdhcjObse0fG3yc5fL6xWg7CRUODPQcweqKf20pn-uh-es7UQGUAT7mLp-EiYvM5jUlsYWJdPK4T3EnZiI Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-Openstack-Nova-Api-Version: 2.32 Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: da0582312a80402fb35d3be2a5b4bede Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TaggedBootDevicesTest-1338434355 Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_da0582312a80402fb35d3be2a5b4bede", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/da0582312a80402fb35d3be2a5b4bede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/da0582312a80402fb35d3be2a5b4bede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/da0582312a80402fb35d3be2a5b4bede"}]}] Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TaggedBootDevicesTest-1338434355 Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: da0582312a80402fb35d3be2a5b4bede Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1338434355 Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TaggedBootDevicesTest-1338434355-project Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 661739c0be874b799a47e2bd8f4fa65d Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TaggedBootDevicesTest-1338434355-project Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '4a0e3960-ddb0-4c89-b821-7eb8379391ae'} Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:00.944760 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:00.950201 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. Aug 29 15:49:00.950201 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:00.950201 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:00.950201 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:00.950201 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:00.950201 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:00.950201 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:00.950201 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:00.950201 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:00.950201 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. Aug 29 15:49:00.950201 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:00.951487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-477dd4de-f4fb-4f3d-99ab-fc41406ea511 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Returning 404 to user: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:00.952250 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-477dd4de-f4fb-4f3d-99ab-fc41406ea511 tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 404 len: 111 microversion: 2.32 time: 0.152157 Aug 29 15:49:00.953445 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2774/5405] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:49:00 2022] DELETE /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:00.960036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b4840fa9-bae9-425f-a5c2-ec5a1327a853 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:00.961000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b4840fa9-bae9-425f-a5c2-ec5a1327a853 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:00.968896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4840fa9-bae9-425f-a5c2-ec5a1327a853 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:00.969775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4840fa9-bae9-425f-a5c2-ec5a1327a853 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:00.970398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4840fa9-bae9-425f-a5c2-ec5a1327a853 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:00.972665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4840fa9-bae9-425f-a5c2-ec5a1327a853 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:00.973376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4840fa9-bae9-425f-a5c2-ec5a1327a853 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:00.974045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4840fa9-bae9-425f-a5c2-ec5a1327a853 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.110515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-46567ca0-e090-406b-973b-6dc368642b21 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:01.114394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:01.120169 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-46567ca0-e090-406b-973b-6dc368642b21 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.541823 Aug 29 15:49:01.120763 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2632/5406] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:00 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:01.142888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1cd60525-4ca4-4013-9b0e-5515ec7e5fdc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:01.156677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1cd60525-4ca4-4013-9b0e-5515ec7e5fdc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] [instance: 4a0e3960-ddb0-4c89-b821-7eb8379391ae] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:01.173032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cd60525-4ca4-4013-9b0e-5515ec7e5fdc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:01.175447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cd60525-4ca4-4013-9b0e-5515ec7e5fdc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:01.176620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cd60525-4ca4-4013-9b0e-5515ec7e5fdc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.182300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cd60525-4ca4-4013-9b0e-5515ec7e5fdc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:01.183177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cd60525-4ca4-4013-9b0e-5515ec7e5fdc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:01.184450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cd60525-4ca4-4013-9b0e-5515ec7e5fdc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.221540 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-1cd60525-4ca4-4013-9b0e-5515ec7e5fdc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] HTTP exception thrown: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1cd60525-4ca4-4013-9b0e-5515ec7e5fdc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Request method failure captured: Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae HTTP/1.1 Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN46WDzbhapi0CPAoZBDq0TC0RPtx4uP7G-wLtcD-dC2UWCmDCpGVO7Dmj0a9StcYE_C5DftQ14oD8wOfX1ZdUaoUcJi_OdhcjObse0fG3yc5fL6xWg7CRUODPQcweqKf20pn-uh-es7UQGUAT7mLp-EiYvM5jUlsYWJdPK4T3EnZiI Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.32 Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: da0582312a80402fb35d3be2a5b4bede Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TaggedBootDevicesTest-1338434355 Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_da0582312a80402fb35d3be2a5b4bede", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/da0582312a80402fb35d3be2a5b4bede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/da0582312a80402fb35d3be2a5b4bede"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/da0582312a80402fb35d3be2a5b4bede"}]}] Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TaggedBootDevicesTest-1338434355 Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: da0582312a80402fb35d3be2a5b4bede Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1338434355 Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TaggedBootDevicesTest-1338434355-project Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 661739c0be874b799a47e2bd8f4fa65d Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TaggedBootDevicesTest-1338434355-project Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '4a0e3960-ddb0-4c89-b821-7eb8379391ae'} Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:01.223312 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:01.228948 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:01.228948 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:01.228948 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:01.228948 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:01.228948 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:01.228948 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:01.228948 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. Aug 29 15:49:01.228948 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:01.228948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1cd60525-4ca4-4013-9b0e-5515ec7e5fdc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] Returning 404 to user: Instance 4a0e3960-ddb0-4c89-b821-7eb8379391ae could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:01.228948 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1cd60525-4ca4-4013-9b0e-5515ec7e5fdc tempest-TaggedBootDevicesTest-1338434355 tempest-TaggedBootDevicesTest-1338434355-project] 10.222.0.62 "GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae" status: 404 len: 111 microversion: 2.32 time: 0.101774 Aug 29 15:49:01.228948 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2633/5407] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:01 2022] GET /compute/v2.1/servers/4a0e3960-ddb0-4c89-b821-7eb8379391ae => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:01.244423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-900f48a3-304c-4277-a306-3e248353361e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:01.250631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-900f48a3-304c-4277-a306-3e248353361e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:01.260846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-900f48a3-304c-4277-a306-3e248353361e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:01.261395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-900f48a3-304c-4277-a306-3e248353361e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:01.261852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-900f48a3-304c-4277-a306-3e248353361e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.262591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-900f48a3-304c-4277-a306-3e248353361e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:01.265134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-900f48a3-304c-4277-a306-3e248353361e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:01.267605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-900f48a3-304c-4277-a306-3e248353361e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.651604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b4840fa9-bae9-425f-a5c2-ec5a1327a853 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:01.665697 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b4840fa9-bae9-425f-a5c2-ec5a1327a853 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1521 microversion: 2.1 time: 0.710842 Aug 29 15:49:01.666745 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2775/5408] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:00 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1521 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:01.671914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ac221162-f309-4e2a-99f4-a1c4f1ce787e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:01.672534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ac221162-f309-4e2a-99f4-a1c4f1ce787e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:01.684843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac221162-f309-4e2a-99f4-a1c4f1ce787e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:01.685375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac221162-f309-4e2a-99f4-a1c4f1ce787e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:01.686132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac221162-f309-4e2a-99f4-a1c4f1ce787e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.687017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac221162-f309-4e2a-99f4-a1c4f1ce787e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:01.687656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac221162-f309-4e2a-99f4-a1c4f1ce787e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:01.688076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac221162-f309-4e2a-99f4-a1c4f1ce787e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.760070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-900f48a3-304c-4277-a306-3e248353361e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:01.774303 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-900f48a3-304c-4277-a306-3e248353361e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1318 microversion: 2.1 time: 0.547588 Aug 29 15:49:01.774954 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2634/5409] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:01 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1318 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:01.900360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ac221162-f309-4e2a-99f4-a1c4f1ce787e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:01.909452 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ac221162-f309-4e2a-99f4-a1c4f1ce787e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.241436 Aug 29 15:49:01.910038 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2776/5410] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:01 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:02.139625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4d51eedd-051c-4835-9e05-eada24816787 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4d51eedd-051c-4835-9e05-eada24816787 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 416 Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'networks': [{'uuid': '74eea137-7f8c-43e1-bd42-582bf8562b2a'}]}}} Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.146468 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:49:02.152182 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.159453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4d51eedd-051c-4835-9e05-eada24816787 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:02.161720 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4d51eedd-051c-4835-9e05-eada24816787 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.027339 Aug 29 15:49:02.163243 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2777/5411] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:02 2022] POST /compute/v2.1/servers => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:49:02.173919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b18e9eb8-72e0-45f5-99d6-2252a383a63b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:02.175023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b18e9eb8-72e0-45f5-99d6-2252a383a63b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:02.195159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b18e9eb8-72e0-45f5-99d6-2252a383a63b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.196538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b18e9eb8-72e0-45f5-99d6-2252a383a63b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.198399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b18e9eb8-72e0-45f5-99d6-2252a383a63b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.201304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b18e9eb8-72e0-45f5-99d6-2252a383a63b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.201855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b18e9eb8-72e0-45f5-99d6-2252a383a63b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.203996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b18e9eb8-72e0-45f5-99d6-2252a383a63b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.210055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1774765340", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "e7e1a9e7-4d7f-4958-9bd4-e4039baa5a12"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:02.307444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] validate_networks() for [('e7e1a9e7-4d7f-4958-9bd4-e4039baa5a12', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:49:02.360225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b18e9eb8-72e0-45f5-99d6-2252a383a63b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:02.372155 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b18e9eb8-72e0-45f5-99d6-2252a383a63b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.203534 Aug 29 15:49:02.374063 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2778/5412] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:02 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:02.396700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-46a41d3c-a167-44da-91b1-7627087c3a5c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:02.397895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-46a41d3c-a167-44da-91b1-7627087c3a5c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:02.411181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46a41d3c-a167-44da-91b1-7627087c3a5c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.411707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46a41d3c-a167-44da-91b1-7627087c3a5c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.412148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46a41d3c-a167-44da-91b1-7627087c3a5c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.412863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46a41d3c-a167-44da-91b1-7627087c3a5c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.413412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46a41d3c-a167-44da-91b1-7627087c3a5c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.413862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46a41d3c-a167-44da-91b1-7627087c3a5c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.653413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-46a41d3c-a167-44da-91b1-7627087c3a5c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:02.663371 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-46a41d3c-a167-44da-91b1-7627087c3a5c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.271062 Aug 29 15:49:02.664497 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2779/5413] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:02 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:02.692155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4ecca145-3c35-429c-a7c5-5ced0500fbdd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:02.693783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4ecca145-3c35-429c-a7c5-5ced0500fbdd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:02.700858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ecca145-3c35-429c-a7c5-5ced0500fbdd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.701506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ecca145-3c35-429c-a7c5-5ced0500fbdd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.702016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ecca145-3c35-429c-a7c5-5ced0500fbdd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.702814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ecca145-3c35-429c-a7c5-5ced0500fbdd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.703522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ecca145-3c35-429c-a7c5-5ced0500fbdd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.704088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ecca145-3c35-429c-a7c5-5ced0500fbdd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.958642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4ecca145-3c35-429c-a7c5-5ced0500fbdd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:02.967199 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4ecca145-3c35-429c-a7c5-5ced0500fbdd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1521 microversion: 2.1 time: 0.281986 Aug 29 15:49:02.967783 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2780/5414] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:02 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:02.972838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-31f89b82-0bf9-4802-9813-eeb64cbf3d28 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:02.973859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-31f89b82-0bf9-4802-9813-eeb64cbf3d28 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:02.980530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31f89b82-0bf9-4802-9813-eeb64cbf3d28 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.981441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31f89b82-0bf9-4802-9813-eeb64cbf3d28 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.982058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31f89b82-0bf9-4802-9813-eeb64cbf3d28 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.982915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31f89b82-0bf9-4802-9813-eeb64cbf3d28 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.983539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31f89b82-0bf9-4802-9813-eeb64cbf3d28 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.984117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31f89b82-0bf9-4802-9813-eeb64cbf3d28 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.176483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-31f89b82-0bf9-4802-9813-eeb64cbf3d28 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:03.202735 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-31f89b82-0bf9-4802-9813-eeb64cbf3d28 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1318 microversion: 2.1 time: 0.233722 Aug 29 15:49:03.203948 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2781/5415] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:02 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:03.215576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6760619a-5691-4ed3-b2fd-c9f510a4ef32 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-225430933", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": -1, "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:03.232794 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-6760619a-5691-4ed3-b2fd-c9f510a4ef32 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Flavor -1 could not be found. Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6760619a-5691-4ed3-b2fd-c9f510a4ef32 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 205 Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-225430933", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": -1, "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: exception: Flavor -1 could not be found. Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-225430933', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': -1, 'networks': [{'uuid': '74eea137-7f8c-43e1-bd42-582bf8562b2a'}]}}} Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:03.235482 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 29 15:49:03.241023 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.253105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6760619a-5691-4ed3-b2fd-c9f510a4ef32 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:03.253105 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6760619a-5691-4ed3-b2fd-c9f510a4ef32 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.042451 Aug 29 15:49:03.253105 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2782/5416] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:03 2022] POST /compute/v2.1/servers => generated 73 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:03.254617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-2f50c755-e101-4910-921a-db6a506d41a8 req-8c24689e-3368-4ccf-8dfb-8017d5474670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c86c100-b9bb-4ec4-b849-672fa3a330b5", "tag": "3ca29955-4579-41d9-b420-15076a70bb0b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:03.292622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2f50c755-e101-4910-921a-db6a506d41a8 req-8c24689e-3368-4ccf-8dfb-8017d5474670 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.293560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2f50c755-e101-4910-921a-db6a506d41a8 req-8c24689e-3368-4ccf-8dfb-8017d5474670 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.295038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2f50c755-e101-4910-921a-db6a506d41a8 req-8c24689e-3368-4ccf-8dfb-8017d5474670 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.310494 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-2f50c755-e101-4910-921a-db6a506d41a8 req-8c24689e-3368-4ccf-8dfb-8017d5474670 service nova] Creating event network-changed:3ca29955-4579-41d9-b420-15076a70bb0b for instance 3c86c100-b9bb-4ec4-b849-672fa3a330b5 on n-h2-839401-11 Aug 29 15:49:03.319492 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-2f50c755-e101-4910-921a-db6a506d41a8 req-8c24689e-3368-4ccf-8dfb-8017d5474670 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068453 Aug 29 15:49:03.320527 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2783/5417] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:03.329578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7fd9749-691f-4ea1-bde8-1067c6281251 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:03.330687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f7fd9749-691f-4ea1-bde8-1067c6281251 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:03.350796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7fd9749-691f-4ea1-bde8-1067c6281251 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.352234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7fd9749-691f-4ea1-bde8-1067c6281251 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.353017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7fd9749-691f-4ea1-bde8-1067c6281251 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.354177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7fd9749-691f-4ea1-bde8-1067c6281251 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.355089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7fd9749-691f-4ea1-bde8-1067c6281251 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.355729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7fd9749-691f-4ea1-bde8-1067c6281251 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.360675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:03.361207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:03.361762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:03.362413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:03.362834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:03.384042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.384542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.384978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.386061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.386530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.397706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.452769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:03.490151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for user db3e87dfe49444f886b7a9ac5d22bda1 and project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:03.526053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:49:03.536524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:49:03.754474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f7fd9749-691f-4ea1-bde8-1067c6281251 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:03.768348 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f7fd9749-691f-4ea1-bde8-1067c6281251 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.445882 Aug 29 15:49:03.775404 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2784/5418] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:03 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:03.778826 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-17725a70-b2cf-42ec-8c07-6b4bcafc890a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.831369 Aug 29 15:49:03.781762 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2635/5419] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:49:03.801583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-59d8b60d-e78f-4d9c-90bd-1c9ccc03212e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:03.806201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-59d8b60d-e78f-4d9c-90bd-1c9ccc03212e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:03.807779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7474b0b8-4af2-4cc3-b0a4-128a9903171d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:03.811244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7474b0b8-4af2-4cc3-b0a4-128a9903171d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:03.828183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7474b0b8-4af2-4cc3-b0a4-128a9903171d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.829735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7474b0b8-4af2-4cc3-b0a4-128a9903171d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.831947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7474b0b8-4af2-4cc3-b0a4-128a9903171d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.835324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7474b0b8-4af2-4cc3-b0a4-128a9903171d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.836077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7474b0b8-4af2-4cc3-b0a4-128a9903171d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.837797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7474b0b8-4af2-4cc3-b0a4-128a9903171d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.946580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-59d8b60d-e78f-4d9c-90bd-1c9ccc03212e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:03.957206 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-59d8b60d-e78f-4d9c-90bd-1c9ccc03212e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 200 len: 1193 microversion: 2.1 time: 0.167538 Aug 29 15:49:03.966294 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2785/5420] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:03 2022] GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 1193 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:03.989154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b5907f88-7c59-447c-9775-423d37a59baf tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:03.989885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b5907f88-7c59-447c-9775-423d37a59baf tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:04.017408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5907f88-7c59-447c-9775-423d37a59baf tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.018562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5907f88-7c59-447c-9775-423d37a59baf tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.019305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5907f88-7c59-447c-9775-423d37a59baf tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.020310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5907f88-7c59-447c-9775-423d37a59baf tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.020997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5907f88-7c59-447c-9775-423d37a59baf tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.021825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5907f88-7c59-447c-9775-423d37a59baf tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.327639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b5907f88-7c59-447c-9775-423d37a59baf tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:04.347552 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b5907f88-7c59-447c-9775-423d37a59baf tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1521 microversion: 2.1 time: 0.363514 Aug 29 15:49:04.349192 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2786/5421] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:03 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:04.368205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-76b0f051-54ee-4545-8d58-6aa5bfe248d1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:04.369388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-76b0f051-54ee-4545-8d58-6aa5bfe248d1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:04.377016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76b0f051-54ee-4545-8d58-6aa5bfe248d1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.377991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76b0f051-54ee-4545-8d58-6aa5bfe248d1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.378670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76b0f051-54ee-4545-8d58-6aa5bfe248d1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.379628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76b0f051-54ee-4545-8d58-6aa5bfe248d1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.380831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76b0f051-54ee-4545-8d58-6aa5bfe248d1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.381807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-76b0f051-54ee-4545-8d58-6aa5bfe248d1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.498768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7474b0b8-4af2-4cc3-b0a4-128a9903171d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:04.507741 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7474b0b8-4af2-4cc3-b0a4-128a9903171d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.711959 Aug 29 15:49:04.513930 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2636/5422] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:03 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:04.600070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-76b0f051-54ee-4545-8d58-6aa5bfe248d1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:04.611410 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-76b0f051-54ee-4545-8d58-6aa5bfe248d1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1318 microversion: 2.1 time: 0.260264 Aug 29 15:49:04.612425 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2787/5423] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:04 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:04.699979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4584de6d-d3e7-421f-89e1-2ae9222e77d9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1203465836", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4584de6d-d3e7-421f-89e1-2ae9222e77d9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 173 Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1203465836", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1203465836', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '74eea137-7f8c-43e1-bd42-582bf8562b2a'}]}}} Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi -1 Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:49:04.704408 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4584de6d-d3e7-421f-89e1-2ae9222e77d9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4584de6d-d3e7-421f-89e1-2ae9222e77d9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.009973 Aug 29 15:49:04.709662 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2637/5424] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:04 2022] POST /compute/v2.1/servers => generated 145 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:04.714848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-241126c9-e614-4a81-b943-b1838c03c8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:04.715516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-241126c9-e614-4a81-b943-b1838c03c8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:04.728473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-241126c9-e614-4a81-b943-b1838c03c8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.728984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-241126c9-e614-4a81-b943-b1838c03c8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.729471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-241126c9-e614-4a81-b943-b1838c03c8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.737448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-241126c9-e614-4a81-b943-b1838c03c8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.738302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-241126c9-e614-4a81-b943-b1838c03c8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.738822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-241126c9-e614-4a81-b943-b1838c03c8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.912029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-241126c9-e614-4a81-b943-b1838c03c8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:04.915848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:04.928969 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-241126c9-e614-4a81-b943-b1838c03c8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.213317 Aug 29 15:49:04.930458 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2788/5425] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:04 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:04.956694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1265a376-1a78-4125-b424-b693e616294c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:04.957379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1265a376-1a78-4125-b424-b693e616294c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:04.969514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1265a376-1a78-4125-b424-b693e616294c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.970743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1265a376-1a78-4125-b424-b693e616294c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.971397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1265a376-1a78-4125-b424-b693e616294c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.972459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1265a376-1a78-4125-b424-b693e616294c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.974273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1265a376-1a78-4125-b424-b693e616294c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.974990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1265a376-1a78-4125-b424-b693e616294c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.003182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bd6597e7-5979-410b-ac64-b5dfeb8007c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:05.004023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bd6597e7-5979-410b-ac64-b5dfeb8007c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:05.012705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd6597e7-5979-410b-ac64-b5dfeb8007c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.013530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd6597e7-5979-410b-ac64-b5dfeb8007c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.014137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd6597e7-5979-410b-ac64-b5dfeb8007c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.015024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd6597e7-5979-410b-ac64-b5dfeb8007c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.015646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd6597e7-5979-410b-ac64-b5dfeb8007c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.018057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd6597e7-5979-410b-ac64-b5dfeb8007c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.132867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bd6597e7-5979-410b-ac64-b5dfeb8007c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:05.147638 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bd6597e7-5979-410b-ac64-b5dfeb8007c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 200 len: 1189 microversion: 2.1 time: 0.159286 Aug 29 15:49:05.149056 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2789/5426] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:04 2022] GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 1189 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:05.180490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85060498-3660-4ccf-ae9b-4b888c6e0a5a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Action: 'create', calling method: .version_select at 0x7fc433b6b940>, body: {"keypair": {"name": "tempest-keypair-226488096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJH9+62VLFju9Zekw7j6roPZuZCxWH/NmFMnebJouHFQe9z1lKdGYds2FhPPg5IbPBiXb0kXE+rwQWj7iOucC37uRRKnonn/P5uMEmz+Dea12JRaLiYsrnwj94qohJOn9Q=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:05.226021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-85060498-3660-4ccf-ae9b-4b888c6e0a5a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Getting quotas for project 90cd659e27ab4f5b9c926a11221a8d80. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:05.232304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-85060498-3660-4ccf-ae9b-4b888c6e0a5a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Getting quotas for user a27d353043364e838b7b6db2c5e97215 and project 90cd659e27ab4f5b9c926a11221a8d80. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:05.234881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1265a376-1a78-4125-b424-b693e616294c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:05.247213 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1265a376-1a78-4125-b424-b693e616294c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.295401 Aug 29 15:49:05.258314 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2638/5427] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:04 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:05.288536 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85060498-3660-4ccf-ae9b-4b888c6e0a5a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.136015 Aug 29 15:49:05.296363 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2790/5428] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:49:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:05.350133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-389216db-179d-46de-a168-571a38ed5bcd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1569999237", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:05.357648 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-389216db-179d-46de-a168-571a38ed5bcd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-389216db-179d-46de-a168-571a38ed5bcd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 216 Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1569999237", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1569999237', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.359608 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:05.364137 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.364137 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:05.364137 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:05.364137 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:05.364137 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:05.364137 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:05.364137 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 15:49:05.364137 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.365840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-389216db-179d-46de-a168-571a38ed5bcd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:05.369607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e08a9678-b40b-4941-a616-dffc2b8b9a49 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:05.370478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e08a9678-b40b-4941-a616-dffc2b8b9a49 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:05.371112 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-389216db-179d-46de-a168-571a38ed5bcd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.025442 Aug 29 15:49:05.371737 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2639/5429] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:05 2022] POST /compute/v2.1/servers => generated 123 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:05.383566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e08a9678-b40b-4941-a616-dffc2b8b9a49 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.384084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e08a9678-b40b-4941-a616-dffc2b8b9a49 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.384539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e08a9678-b40b-4941-a616-dffc2b8b9a49 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.385616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e08a9678-b40b-4941-a616-dffc2b8b9a49 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.387225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-583edf62-5ccb-4951-995c-4ec6c677f163 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:05.387846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-583edf62-5ccb-4951-995c-4ec6c677f163 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:05.392846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e08a9678-b40b-4941-a616-dffc2b8b9a49 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.393459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e08a9678-b40b-4941-a616-dffc2b8b9a49 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.405275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-583edf62-5ccb-4951-995c-4ec6c677f163 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.411896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-583edf62-5ccb-4951-995c-4ec6c677f163 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.412698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-583edf62-5ccb-4951-995c-4ec6c677f163 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.414056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-583edf62-5ccb-4951-995c-4ec6c677f163 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.415046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-583edf62-5ccb-4951-995c-4ec6c677f163 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.426315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-583edf62-5ccb-4951-995c-4ec6c677f163 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.693653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:05.726475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e08a9678-b40b-4941-a616-dffc2b8b9a49 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:05.741782 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e08a9678-b40b-4941-a616-dffc2b8b9a49 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1521 microversion: 2.1 time: 0.375535 Aug 29 15:49:05.771175 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2791/5430] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:05 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:05.794959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3ffb58e2-0fd4-493a-a9e1-85eafc5adbcb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:05.802698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3ffb58e2-0fd4-493a-a9e1-85eafc5adbcb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:05.824410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ffb58e2-0fd4-493a-a9e1-85eafc5adbcb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.825280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-583edf62-5ccb-4951-995c-4ec6c677f163 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:05.835763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ffb58e2-0fd4-493a-a9e1-85eafc5adbcb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.837006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ffb58e2-0fd4-493a-a9e1-85eafc5adbcb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.837955 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-583edf62-5ccb-4951-995c-4ec6c677f163 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.456007 Aug 29 15:49:05.838762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ffb58e2-0fd4-493a-a9e1-85eafc5adbcb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.842594 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2640/5431] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:05 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:05.849171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ffb58e2-0fd4-493a-a9e1-85eafc5adbcb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.851167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ffb58e2-0fd4-493a-a9e1-85eafc5adbcb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.868411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aa6f5f76-ac7b-4472-bfc8-5dfa97b43978 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:05.869132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aa6f5f76-ac7b-4472-bfc8-5dfa97b43978 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:05.883320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa6f5f76-ac7b-4472-bfc8-5dfa97b43978 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.883834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa6f5f76-ac7b-4472-bfc8-5dfa97b43978 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.884280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa6f5f76-ac7b-4472-bfc8-5dfa97b43978 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.909768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa6f5f76-ac7b-4472-bfc8-5dfa97b43978 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.910297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa6f5f76-ac7b-4472-bfc8-5dfa97b43978 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.910760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa6f5f76-ac7b-4472-bfc8-5dfa97b43978 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.277808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3ffb58e2-0fd4-493a-a9e1-85eafc5adbcb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:06.289380 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3ffb58e2-0fd4-493a-a9e1-85eafc5adbcb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1318 microversion: 2.1 time: 0.513021 Aug 29 15:49:06.303259 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2792/5432] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:05 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:06.309045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-952ee3a8-6e22-450e-a02e-c9bc0d606fb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:06.310247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-952ee3a8-6e22-450e-a02e-c9bc0d606fb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:06.319996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-952ee3a8-6e22-450e-a02e-c9bc0d606fb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.320996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-952ee3a8-6e22-450e-a02e-c9bc0d606fb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.321766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-952ee3a8-6e22-450e-a02e-c9bc0d606fb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.323303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-952ee3a8-6e22-450e-a02e-c9bc0d606fb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.324096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-952ee3a8-6e22-450e-a02e-c9bc0d606fb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.325298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-952ee3a8-6e22-450e-a02e-c9bc0d606fb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.441400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-952ee3a8-6e22-450e-a02e-c9bc0d606fb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:06.467817 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-952ee3a8-6e22-450e-a02e-c9bc0d606fb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 200 len: 1251 microversion: 2.1 time: 0.162753 Aug 29 15:49:06.468424 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2793/5433] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:06 2022] GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 1251 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:06.627591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aa6f5f76-ac7b-4472-bfc8-5dfa97b43978 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:06.655232 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aa6f5f76-ac7b-4472-bfc8-5dfa97b43978 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.784256 Aug 29 15:49:06.656519 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2641/5434] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:05 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:06.764221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a3db2c93-8c17-4740-9846-b58da85c00eb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:06.764826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a3db2c93-8c17-4740-9846-b58da85c00eb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:06.784796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3db2c93-8c17-4740-9846-b58da85c00eb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.787926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3db2c93-8c17-4740-9846-b58da85c00eb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.789385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3db2c93-8c17-4740-9846-b58da85c00eb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.790954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3db2c93-8c17-4740-9846-b58da85c00eb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.792472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3db2c93-8c17-4740-9846-b58da85c00eb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.794100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3db2c93-8c17-4740-9846-b58da85c00eb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.945508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-79459c77-ea4c-4f98-8219-b796ce4c3391 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-748806381", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "key_name": "tempest-key-2106527431", "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:07.059676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-79459c77-ea4c-4f98-8219-b796ce4c3391 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] validate_networks() for [('74eea137-7f8c-43e1-bd42-582bf8562b2a', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:49:07.379759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a3db2c93-8c17-4740-9846-b58da85c00eb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:07.391535 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a3db2c93-8c17-4740-9846-b58da85c00eb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1501 microversion: 2.1 time: 0.632211 Aug 29 15:49:07.395474 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2794/5435] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:06 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1501 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:07.420228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d174e4ab-bbc9-4c91-a45d-9704dcc2b63d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:07.421626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d174e4ab-bbc9-4c91-a45d-9704dcc2b63d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:07.432708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d174e4ab-bbc9-4c91-a45d-9704dcc2b63d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:07.433530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d174e4ab-bbc9-4c91-a45d-9704dcc2b63d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:07.434141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d174e4ab-bbc9-4c91-a45d-9704dcc2b63d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:07.435055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d174e4ab-bbc9-4c91-a45d-9704dcc2b63d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:07.438304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d174e4ab-bbc9-4c91-a45d-9704dcc2b63d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:07.438997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d174e4ab-bbc9-4c91-a45d-9704dcc2b63d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:07.759959 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-79459c77-ea4c-4f98-8219-b796ce4c3391 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Invalid key_name provided. Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-79459c77-ea4c-4f98-8219-b796ce4c3391 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 246 Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-748806381", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "key_name": "tempest-key-2106527431", "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid key_name provided. Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-748806381', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'key_name': 'tempest-key-2106527431', 'networks': [{'uuid': '74eea137-7f8c-43e1-bd42-582bf8562b2a'}]}}} Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-2106527431 not found for user b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:07.762412 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-79459c77-ea4c-4f98-8219-b796ce4c3391 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 400 to user: Invalid key_name provided. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-79459c77-ea4c-4f98-8219-b796ce4c3391 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.823337 Aug 29 15:49:07.770515 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2642/5436] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:06 2022] POST /compute/v2.1/servers => generated 70 bytes in 828 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 29 15:49:07.778378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0b6e6f5d-1dc3-46a2-a302-8daaa1b78d6b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7477706f-b96e-44f6-963b-f89c64af736d"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:07.781562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0b6e6f5d-1dc3-46a2-a302-8daaa1b78d6b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:07.798201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b6e6f5d-1dc3-46a2-a302-8daaa1b78d6b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:07.798706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b6e6f5d-1dc3-46a2-a302-8daaa1b78d6b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:07.799148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b6e6f5d-1dc3-46a2-a302-8daaa1b78d6b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:07.799922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b6e6f5d-1dc3-46a2-a302-8daaa1b78d6b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:07.800387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b6e6f5d-1dc3-46a2-a302-8daaa1b78d6b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:07.800813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b6e6f5d-1dc3-46a2-a302-8daaa1b78d6b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:07.876594 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-0b6e6f5d-1dc3-46a2-a302-8daaa1b78d6b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] HTTP exception thrown: Cannot 'attach_volume' instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 while it is in vm_state rescued Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0b6e6f5d-1dc3-46a2-a302-8daaa1b78d6b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Request method failure captured: Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0/os-volume_attachments HTTP/1.1 Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 74 Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-Shrbl2HxkaYnOtK2CNdk6iJsrlpI7x2pEvqbwalbEhQTR6sDfV2Wu55DTc75O-bivlxXAmF3HFspNNYPdndfOjtbIQTsROFO0VNl42_MzCePBgIneIUPTQCeXIdrBxJJnQjgsKhXk98T5RKZXMNgJMbL43_mClT_pNirw55OB0CI Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bb5330327389417995f14947be334a04 Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bb5330327389417995f14947be334a04", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bb5330327389417995f14947be334a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}] Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bb5330327389417995f14947be334a04 Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e75a8c66c5304e608e2f3120c1192534 Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: {"volumeAttachment": {"volumeId": "7477706f-b96e-44f6-963b-f89c64af736d"}} Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: exception: Cannot 'attach_volume' instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 while it is in vm_state rescued Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'server_id': '56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0', 'body': {'volumeAttachment': {'volumeId': '7477706f-b96e-44f6-963b-f89c64af736d'}}} Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 15:49:07.890953 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:49:07.895300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:49:07.895300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:49:07.895300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 while it is in vm_state rescued Aug 29 15:49:07.895300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:07.895300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:07.895300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:07.895300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:07.895300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:07.895300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:07.895300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:07.895300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:07.895300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 while it is in vm_state rescued Aug 29 15:49:07.895300 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:07.898796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0b6e6f5d-1dc3-46a2-a302-8daaa1b78d6b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Returning 409 to user: Cannot 'attach_volume' instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 while it is in vm_state rescued {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:07.899875 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0b6e6f5d-1dc3-46a2-a302-8daaa1b78d6b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.130920 Aug 29 15:49:07.901007 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2643/5437] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 15:49:07 2022] POST /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0/os-volume_attachments => generated 152 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:49:07.914183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a14439ed-38b2-45b2-b7ad-141f60f4dfa1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:07.915277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a14439ed-38b2-45b2-b7ad-141f60f4dfa1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:07.938521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a14439ed-38b2-45b2-b7ad-141f60f4dfa1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:07.939390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a14439ed-38b2-45b2-b7ad-141f60f4dfa1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:07.940043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a14439ed-38b2-45b2-b7ad-141f60f4dfa1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:07.941264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a14439ed-38b2-45b2-b7ad-141f60f4dfa1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:07.943795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a14439ed-38b2-45b2-b7ad-141f60f4dfa1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:07.944463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a14439ed-38b2-45b2-b7ad-141f60f4dfa1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.028931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d174e4ab-bbc9-4c91-a45d-9704dcc2b63d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:08.042826 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d174e4ab-bbc9-4c91-a45d-9704dcc2b63d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1318 microversion: 2.1 time: 0.645875 Aug 29 15:49:08.043538 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2795/5438] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:07 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1318 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:08.049424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3bde4341-eb92-41af-bbba-5c4de350909f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:08.050371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3bde4341-eb92-41af-bbba-5c4de350909f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:08.058360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3bde4341-eb92-41af-bbba-5c4de350909f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.059333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3bde4341-eb92-41af-bbba-5c4de350909f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.059995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3bde4341-eb92-41af-bbba-5c4de350909f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.060959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3bde4341-eb92-41af-bbba-5c4de350909f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.061802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3bde4341-eb92-41af-bbba-5c4de350909f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.062448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3bde4341-eb92-41af-bbba-5c4de350909f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.285021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a14439ed-38b2-45b2-b7ad-141f60f4dfa1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:08.296268 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a14439ed-38b2-45b2-b7ad-141f60f4dfa1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 200 len: 1293 microversion: 2.1 time: 0.390757 Aug 29 15:49:08.297004 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2644/5439] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:07 2022] GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 1293 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:08.314286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-968e4fd5-d6fa-426b-a215-cb97eb5e4569 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:08.314819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-968e4fd5-d6fa-426b-a215-cb97eb5e4569 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:08.334402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-968e4fd5-d6fa-426b-a215-cb97eb5e4569 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.334901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-968e4fd5-d6fa-426b-a215-cb97eb5e4569 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.335344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-968e4fd5-d6fa-426b-a215-cb97eb5e4569 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.336055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-968e4fd5-d6fa-426b-a215-cb97eb5e4569 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.339295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-968e4fd5-d6fa-426b-a215-cb97eb5e4569 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.339926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-968e4fd5-d6fa-426b-a215-cb97eb5e4569 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.441575 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-968e4fd5-d6fa-426b-a215-cb97eb5e4569 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0/action" status: 202 len: 0 microversion: 2.1 time: 0.130901 Aug 29 15:49:08.445030 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2645/5440] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:08 2022] POST /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:49:08.452246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b3b545d6-14e1-4fe4-adda-a47a645d7b50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:08.452961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b3b545d6-14e1-4fe4-adda-a47a645d7b50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:08.465628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3bde4341-eb92-41af-bbba-5c4de350909f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:08.469460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3b545d6-14e1-4fe4-adda-a47a645d7b50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.469952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3b545d6-14e1-4fe4-adda-a47a645d7b50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.470569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3b545d6-14e1-4fe4-adda-a47a645d7b50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.471479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3b545d6-14e1-4fe4-adda-a47a645d7b50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.472231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3b545d6-14e1-4fe4-adda-a47a645d7b50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.472877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3b545d6-14e1-4fe4-adda-a47a645d7b50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.476834 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3bde4341-eb92-41af-bbba-5c4de350909f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.431507 Aug 29 15:49:08.484240 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2796/5441] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:08 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:08.508663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d96be1b-65dd-4f60-96e8-fdb57ccb0115 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:08.509531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9d96be1b-65dd-4f60-96e8-fdb57ccb0115 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:08.525285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d96be1b-65dd-4f60-96e8-fdb57ccb0115 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.526363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d96be1b-65dd-4f60-96e8-fdb57ccb0115 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.527057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d96be1b-65dd-4f60-96e8-fdb57ccb0115 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.529208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d96be1b-65dd-4f60-96e8-fdb57ccb0115 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.529881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d96be1b-65dd-4f60-96e8-fdb57ccb0115 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.531617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d96be1b-65dd-4f60-96e8-fdb57ccb0115 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.738986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b3b545d6-14e1-4fe4-adda-a47a645d7b50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:08.751749 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b3b545d6-14e1-4fe4-adda-a47a645d7b50 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1509 microversion: 2.1 time: 0.303744 Aug 29 15:49:08.752345 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2646/5442] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:08 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1509 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:08.915750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9d96be1b-65dd-4f60-96e8-fdb57ccb0115 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:08.939014 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d96be1b-65dd-4f60-96e8-fdb57ccb0115 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.428417 Aug 29 15:49:08.942452 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2797/5443] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:08 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:09.066147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ff32a03b-0fe1-4f3b-8976-3ce9ef4fa123 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:09.067027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ff32a03b-0fe1-4f3b-8976-3ce9ef4fa123 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:09.082960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff32a03b-0fe1-4f3b-8976-3ce9ef4fa123 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.083695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff32a03b-0fe1-4f3b-8976-3ce9ef4fa123 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.085979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff32a03b-0fe1-4f3b-8976-3ce9ef4fa123 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.087220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff32a03b-0fe1-4f3b-8976-3ce9ef4fa123 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.089511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff32a03b-0fe1-4f3b-8976-3ce9ef4fa123 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.093003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff32a03b-0fe1-4f3b-8976-3ce9ef4fa123 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.173363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3fc9fba1-b442-4b8b-935b-10c8b6903f5d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1449985318", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:09.400066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.security_group_api [None req-3fc9fba1-b442-4b8b-935b-10c8b6903f5d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Neutron security group does_not_exist not found {{(pid=122360) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 29 15:49:09.400664 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-3fc9fba1-b442-4b8b-935b-10c8b6903f5d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3fc9fba1-b442-4b8b-935b-10c8b6903f5d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 258 Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1449985318", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1449985318', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '74eea137-7f8c-43e1-bd42-582bf8562b2a'}]}}} Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 29 15:49:09.413241 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:49:09.418000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:09.425156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3fc9fba1-b442-4b8b-935b-10c8b6903f5d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:09.425678 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3fc9fba1-b442-4b8b-935b-10c8b6903f5d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.256208 Aug 29 15:49:09.426839 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2798/5444] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:09 2022] POST /compute/v2.1/servers => generated 106 bytes in 258 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:49:09.431805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-def6fd39-c367-47a9-98aa-aa13894a89da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:09.433744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-def6fd39-c367-47a9-98aa-aa13894a89da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:09.451207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def6fd39-c367-47a9-98aa-aa13894a89da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.451900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def6fd39-c367-47a9-98aa-aa13894a89da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.453707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def6fd39-c367-47a9-98aa-aa13894a89da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.455484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def6fd39-c367-47a9-98aa-aa13894a89da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.456142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def6fd39-c367-47a9-98aa-aa13894a89da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.456721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-def6fd39-c367-47a9-98aa-aa13894a89da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.640388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-def6fd39-c367-47a9-98aa-aa13894a89da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:09.650347 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-def6fd39-c367-47a9-98aa-aa13894a89da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 200 len: 1293 microversion: 2.1 time: 0.222207 Aug 29 15:49:09.651058 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2799/5445] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:09 2022] GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 1293 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:09.655870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fa2e1c98-e39c-4dba-a4df-b44f3c5e66f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:09.656563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fa2e1c98-e39c-4dba-a4df-b44f3c5e66f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:09.663660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa2e1c98-e39c-4dba-a4df-b44f3c5e66f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.664440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa2e1c98-e39c-4dba-a4df-b44f3c5e66f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.665172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa2e1c98-e39c-4dba-a4df-b44f3c5e66f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.666129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa2e1c98-e39c-4dba-a4df-b44f3c5e66f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.666750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa2e1c98-e39c-4dba-a4df-b44f3c5e66f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.667410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa2e1c98-e39c-4dba-a4df-b44f3c5e66f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.765426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ff32a03b-0fe1-4f3b-8976-3ce9ef4fa123 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:09.783591 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ff32a03b-0fe1-4f3b-8976-3ce9ef4fa123 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1318 microversion: 2.1 time: 0.722332 Aug 29 15:49:09.786778 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2647/5446] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:09 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1318 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:09.795605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2001328177", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ebda995-e90a-4f2e-b960-05df0b4c22d1"}], "security_groups": [{"name": "tempest-securitygroup--1481967810"}], "key_name": "tempest-keypair-226488096", "user_data": "}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:09.895565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fa2e1c98-e39c-4dba-a4df-b44f3c5e66f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:09.905576 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fa2e1c98-e39c-4dba-a4df-b44f3c5e66f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.252389 Aug 29 15:49:09.906381 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2800/5447] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:09 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:09.911134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7d5e38b-ee6f-4fd5-9f25-5ecc159a3f84 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:09.911753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f7d5e38b-ee6f-4fd5-9f25-5ecc159a3f84 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:09.922908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:09.931339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7d5e38b-ee6f-4fd5-9f25-5ecc159a3f84 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.931733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7d5e38b-ee6f-4fd5-9f25-5ecc159a3f84 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.932209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7d5e38b-ee6f-4fd5-9f25-5ecc159a3f84 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.932998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7d5e38b-ee6f-4fd5-9f25-5ecc159a3f84 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.933480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7d5e38b-ee6f-4fd5-9f25-5ecc159a3f84 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.933916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7d5e38b-ee6f-4fd5-9f25-5ecc159a3f84 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.098996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f7d5e38b-ee6f-4fd5-9f25-5ecc159a3f84 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:10.107974 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f7d5e38b-ee6f-4fd5-9f25-5ecc159a3f84 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1509 microversion: 2.1 time: 0.200491 Aug 29 15:49:10.110133 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2801/5448] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:09 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:10.115312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-353e4491-14f5-4c73-a693-fafb0d3c9dd2 req-0e665a2f-b6a1-47d5-958e-8fa22d6a4e58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e021dd0-d5dc-4600-b577-27abfc1282bb", "tag": "37037bd8-6ee9-4555-a34d-b0d12a0a8cc1"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:10.126916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-353e4491-14f5-4c73-a693-fafb0d3c9dd2 req-0e665a2f-b6a1-47d5-958e-8fa22d6a4e58 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.127519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-353e4491-14f5-4c73-a693-fafb0d3c9dd2 req-0e665a2f-b6a1-47d5-958e-8fa22d6a4e58 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.128094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-353e4491-14f5-4c73-a693-fafb0d3c9dd2 req-0e665a2f-b6a1-47d5-958e-8fa22d6a4e58 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.141624 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-353e4491-14f5-4c73-a693-fafb0d3c9dd2 req-0e665a2f-b6a1-47d5-958e-8fa22d6a4e58 service nova] Creating event network-changed:37037bd8-6ee9-4555-a34d-b0d12a0a8cc1 for instance 0e021dd0-d5dc-4600-b577-27abfc1282bb on n-h1-839401-11 Aug 29 15:49:10.147680 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-353e4491-14f5-4c73-a693-fafb0d3c9dd2 req-0e665a2f-b6a1-47d5-958e-8fa22d6a4e58 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035985 Aug 29 15:49:10.148635 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2802/5449] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:10.155202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e8d88668-11f2-4101-ae4c-52afe83f5a18 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:10.156226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e8d88668-11f2-4101-ae4c-52afe83f5a18 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:10.163104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8d88668-11f2-4101-ae4c-52afe83f5a18 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.163648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8d88668-11f2-4101-ae4c-52afe83f5a18 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.164087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8d88668-11f2-4101-ae4c-52afe83f5a18 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.164896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8d88668-11f2-4101-ae4c-52afe83f5a18 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.165397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8d88668-11f2-4101-ae4c-52afe83f5a18 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.165826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8d88668-11f2-4101-ae4c-52afe83f5a18 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.324669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e8d88668-11f2-4101-ae4c-52afe83f5a18 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:10.335820 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e8d88668-11f2-4101-ae4c-52afe83f5a18 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.185284 Aug 29 15:49:10.337051 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2803/5450] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:10 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:10.360186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b3fbe0e2-2e5b-4012-965e-30042f82cc59 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:10.361057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b3fbe0e2-2e5b-4012-965e-30042f82cc59 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: 7af0abd5-729c-4d6a-bb5b-14c6b066a72b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:10.369272 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-b3fbe0e2-2e5b-4012-965e-30042f82cc59 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance 7af0abd5-729c-4d6a-bb5b-14c6b066a72b could not be found. Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b3fbe0e2-2e5b-4012-965e-30042f82cc59 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/7af0abd5-729c-4d6a-bb5b-14c6b066a72b HTTP/1.1 Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 7af0abd5-729c-4d6a-bb5b-14c6b066a72b could not be found. Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7af0abd5-729c-4d6a-bb5b-14c6b066a72b'} Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7af0abd5-729c-4d6a-bb5b-14c6b066a72b could not be found. Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7af0abd5-729c-4d6a-bb5b-14c6b066a72b could not be found. Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:10.371460 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:10.376050 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:10.376050 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:10.376050 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:10.376050 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:10.376050 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:10.376050 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:10.376050 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7af0abd5-729c-4d6a-bb5b-14c6b066a72b could not be found. Aug 29 15:49:10.376050 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:10.376050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b3fbe0e2-2e5b-4012-965e-30042f82cc59 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance 7af0abd5-729c-4d6a-bb5b-14c6b066a72b could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:10.376050 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b3fbe0e2-2e5b-4012-965e-30042f82cc59 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7af0abd5-729c-4d6a-bb5b-14c6b066a72b" status: 404 len: 111 microversion: 2.1 time: 0.017278 Aug 29 15:49:10.377350 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2804/5451] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:10 2022] DELETE /compute/v2.1/servers/7af0abd5-729c-4d6a-bb5b-14c6b066a72b => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:10.384977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-17d1f7b8-2266-498f-8c95-2703d07863e1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:10.386222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-17d1f7b8-2266-498f-8c95-2703d07863e1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:10.393361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17d1f7b8-2266-498f-8c95-2703d07863e1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.394161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17d1f7b8-2266-498f-8c95-2703d07863e1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.394786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17d1f7b8-2266-498f-8c95-2703d07863e1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.395659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17d1f7b8-2266-498f-8c95-2703d07863e1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.396856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17d1f7b8-2266-498f-8c95-2703d07863e1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.397500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17d1f7b8-2266-498f-8c95-2703d07863e1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.589245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] validate_networks() for [('0ebda995-e90a-4f2e-b960-05df0b4c22d1', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:49:10.663083 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-17d1f7b8-2266-498f-8c95-2703d07863e1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:10.673468 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-17d1f7b8-2266-498f-8c95-2703d07863e1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.294277 Aug 29 15:49:10.674861 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2805/5452] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:10 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:10.681719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-494aab6a-b387-4e54-ae7b-076775035268 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:10.682764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-494aab6a-b387-4e54-ae7b-076775035268 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:10.689884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-494aab6a-b387-4e54-ae7b-076775035268 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.690872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-494aab6a-b387-4e54-ae7b-076775035268 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.691529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-494aab6a-b387-4e54-ae7b-076775035268 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.692721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-494aab6a-b387-4e54-ae7b-076775035268 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.693503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-494aab6a-b387-4e54-ae7b-076775035268 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.694432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-494aab6a-b387-4e54-ae7b-076775035268 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.978973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-494aab6a-b387-4e54-ae7b-076775035268 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:10.988999 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-494aab6a-b387-4e54-ae7b-076775035268 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 200 len: 1293 microversion: 2.1 time: 0.312496 Aug 29 15:49:10.990626 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2806/5453] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:10 2022] GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 1293 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:11.024383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-045686ef-c25f-4001-9a4b-7dcf93eb1fcc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:11.027428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-045686ef-c25f-4001-9a4b-7dcf93eb1fcc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:11.042058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-045686ef-c25f-4001-9a4b-7dcf93eb1fcc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.042621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-045686ef-c25f-4001-9a4b-7dcf93eb1fcc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.043073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-045686ef-c25f-4001-9a4b-7dcf93eb1fcc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.044048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-045686ef-c25f-4001-9a4b-7dcf93eb1fcc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.044527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-045686ef-c25f-4001-9a4b-7dcf93eb1fcc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.045229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-045686ef-c25f-4001-9a4b-7dcf93eb1fcc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.267674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-045686ef-c25f-4001-9a4b-7dcf93eb1fcc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:11.284236 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-045686ef-c25f-4001-9a4b-7dcf93eb1fcc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.265553 Aug 29 15:49:11.287269 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2807/5454] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:11 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:11.307721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-90761809-75ed-48c8-9f5a-6f74d1998235 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:11.308846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-90761809-75ed-48c8-9f5a-6f74d1998235 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:11.317659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90761809-75ed-48c8-9f5a-6f74d1998235 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.319017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90761809-75ed-48c8-9f5a-6f74d1998235 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.319805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90761809-75ed-48c8-9f5a-6f74d1998235 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.320830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90761809-75ed-48c8-9f5a-6f74d1998235 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.321776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90761809-75ed-48c8-9f5a-6f74d1998235 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.323449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90761809-75ed-48c8-9f5a-6f74d1998235 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.666721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-90761809-75ed-48c8-9f5a-6f74d1998235 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:11.681729 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-90761809-75ed-48c8-9f5a-6f74d1998235 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1318 microversion: 2.1 time: 0.378127 Aug 29 15:49:11.681729 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2808/5455] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:11 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:11.703273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0d684a96-3ded-4ec1-a6ed-e6462516e7b2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:11.706996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0d684a96-3ded-4ec1-a6ed-e6462516e7b2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:11.747301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d684a96-3ded-4ec1-a6ed-e6462516e7b2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.748125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d684a96-3ded-4ec1-a6ed-e6462516e7b2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.748651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d684a96-3ded-4ec1-a6ed-e6462516e7b2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.749837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d684a96-3ded-4ec1-a6ed-e6462516e7b2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.768830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d684a96-3ded-4ec1-a6ed-e6462516e7b2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.769357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d684a96-3ded-4ec1-a6ed-e6462516e7b2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.788314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:11.892163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:11.893325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:11.894214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:11.895628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:11.896291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:11.907168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.908146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.908905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.909924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.910668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.911586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.933955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Getting quotas for project 90cd659e27ab4f5b9c926a11221a8d80. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:11.940072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Getting quotas for user a27d353043364e838b7b6db2c5e97215 and project 90cd659e27ab4f5b9c926a11221a8d80. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:11.957404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:49:11.960629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:49:12.032793 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-863f2d8d-6c23-4764-bd28-48e810f2bf88 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.244500 Aug 29 15:49:12.034546 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2648/5456] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 2246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:49:12.054902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cd0984c6-e5ec-4572-9eed-22db79234a5d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:12.057862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cd0984c6-e5ec-4572-9eed-22db79234a5d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:49:12.058727 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-cd0984c6-e5ec-4572-9eed-22db79234a5d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cd0984c6-e5ec-4572-9eed-22db79234a5d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 9223372036854775808 could not be found. Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '9223372036854775808'} Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:12.061469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:12.066338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:12.066338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:12.066338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:12.066338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 29 15:49:12.066338 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:12.067842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cd0984c6-e5ec-4572-9eed-22db79234a5d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:12.068900 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cd0984c6-e5ec-4572-9eed-22db79234a5d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.033181 Aug 29 15:49:12.069692 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2649/5457] 10.222.0.62 () {58 vars in 1188 bytes} [Mon Aug 29 15:49:12 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:49:12.082540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-adf08e88-d700-4d6e-8084-8340f9a6ce53 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:12.083365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-adf08e88-d700-4d6e-8084-8340f9a6ce53 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:12.114863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf08e88-d700-4d6e-8084-8340f9a6ce53 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:12.115663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf08e88-d700-4d6e-8084-8340f9a6ce53 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:12.117416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf08e88-d700-4d6e-8084-8340f9a6ce53 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:12.119631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf08e88-d700-4d6e-8084-8340f9a6ce53 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:12.122167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf08e88-d700-4d6e-8084-8340f9a6ce53 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:12.122826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-adf08e88-d700-4d6e-8084-8340f9a6ce53 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:12.207028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0d684a96-3ded-4ec1-a6ed-e6462516e7b2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:12.220242 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0d684a96-3ded-4ec1-a6ed-e6462516e7b2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1509 microversion: 2.1 time: 0.537347 Aug 29 15:49:12.222334 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2809/5458] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:11 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1509 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:12.233737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aac6d147-3146-4db1-9baf-6439cf09a1fb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:12.234522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aac6d147-3146-4db1-9baf-6439cf09a1fb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:12.391559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aac6d147-3146-4db1-9baf-6439cf09a1fb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:12.400828 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aac6d147-3146-4db1-9baf-6439cf09a1fb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1241 microversion: 2.1 time: 0.171080 Aug 29 15:49:12.407057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-adf08e88-d700-4d6e-8084-8340f9a6ce53 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:12.418113 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-adf08e88-d700-4d6e-8084-8340f9a6ce53 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 200 len: 1293 microversion: 2.1 time: 0.342801 Aug 29 15:49:12.418336 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2810/5459] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:12 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1241 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:12.426468 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2650/5460] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:12 2022] GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 1293 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:12.436009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-40db1c39-1897-4b5b-9a94-d2cf4d539f90 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:12.436632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-40db1c39-1897-4b5b-9a94-d2cf4d539f90 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:12.458265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40db1c39-1897-4b5b-9a94-d2cf4d539f90 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:12.458981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40db1c39-1897-4b5b-9a94-d2cf4d539f90 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:12.459669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40db1c39-1897-4b5b-9a94-d2cf4d539f90 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:12.462746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40db1c39-1897-4b5b-9a94-d2cf4d539f90 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:12.463460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40db1c39-1897-4b5b-9a94-d2cf4d539f90 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:12.464082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40db1c39-1897-4b5b-9a94-d2cf4d539f90 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:12.714915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-136829a0-ed25-4bfe-bd9a-f6cb6bf756d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:12.715972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-40db1c39-1897-4b5b-9a94-d2cf4d539f90 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:12.716732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-136829a0-ed25-4bfe-bd9a-f6cb6bf756d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:12.725011 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-40db1c39-1897-4b5b-9a94-d2cf4d539f90 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.305434 Aug 29 15:49:12.729159 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2811/5461] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:12 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:12.736012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-136829a0-ed25-4bfe-bd9a-f6cb6bf756d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:12.736629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-136829a0-ed25-4bfe-bd9a-f6cb6bf756d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:12.737263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-136829a0-ed25-4bfe-bd9a-f6cb6bf756d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:12.738250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-136829a0-ed25-4bfe-bd9a-f6cb6bf756d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:12.738768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-136829a0-ed25-4bfe-bd9a-f6cb6bf756d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:12.739352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-136829a0-ed25-4bfe-bd9a-f6cb6bf756d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:12.754660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7da032b0-8c96-4fde-8116-7743bcb7329c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:12.755353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7da032b0-8c96-4fde-8116-7743bcb7329c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:12.773920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7da032b0-8c96-4fde-8116-7743bcb7329c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:12.774355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7da032b0-8c96-4fde-8116-7743bcb7329c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:12.774810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7da032b0-8c96-4fde-8116-7743bcb7329c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:12.777554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7da032b0-8c96-4fde-8116-7743bcb7329c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:12.778036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7da032b0-8c96-4fde-8116-7743bcb7329c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:12.778470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7da032b0-8c96-4fde-8116-7743bcb7329c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:12.965882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-136829a0-ed25-4bfe-bd9a-f6cb6bf756d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:12.976514 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-136829a0-ed25-4bfe-bd9a-f6cb6bf756d6 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1318 microversion: 2.1 time: 0.267336 Aug 29 15:49:12.989828 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2651/5462] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:12 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:13.013115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-63433679-2766-4e78-8223-f1a3ebe9598b req-26478daf-20bf-42af-8160-f09355d7b7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c86c100-b9bb-4ec4-b849-672fa3a330b5", "name": "network-vif-plugged", "status": "completed", "tag": "3ca29955-4579-41d9-b420-15076a70bb0b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:13.039214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-63433679-2766-4e78-8223-f1a3ebe9598b req-26478daf-20bf-42af-8160-f09355d7b7f3 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.039965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-63433679-2766-4e78-8223-f1a3ebe9598b req-26478daf-20bf-42af-8160-f09355d7b7f3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.040567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-63433679-2766-4e78-8223-f1a3ebe9598b req-26478daf-20bf-42af-8160-f09355d7b7f3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.058237 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-63433679-2766-4e78-8223-f1a3ebe9598b req-26478daf-20bf-42af-8160-f09355d7b7f3 service nova] Creating event network-vif-plugged:3ca29955-4579-41d9-b420-15076a70bb0b for instance 3c86c100-b9bb-4ec4-b849-672fa3a330b5 on n-h2-839401-11 Aug 29 15:49:13.068710 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-63433679-2766-4e78-8223-f1a3ebe9598b req-26478daf-20bf-42af-8160-f09355d7b7f3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056298 Aug 29 15:49:13.070584 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2652/5463] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:13.092853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7da032b0-8c96-4fde-8116-7743bcb7329c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:13.106543 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7da032b0-8c96-4fde-8116-7743bcb7329c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.361974 Aug 29 15:49:13.107184 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2812/5464] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:12 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:13.129780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9719d89e-2f2a-40fc-a1d8-bf6ae31b66e6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:13.130783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9719d89e-2f2a-40fc-a1d8-bf6ae31b66e6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Failed to fetch instance by id -1 {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:49:13.131489 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-9719d89e-2f2a-40fc-a1d8-bf6ae31b66e6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance -1 could not be found. Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9719d89e-2f2a-40fc-a1d8-bf6ae31b66e6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance -1 could not be found. Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '-1'} Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:13.133610 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:13.139487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:13.139487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:13.139487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 29 15:49:13.139487 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:13.140865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9719d89e-2f2a-40fc-a1d8-bf6ae31b66e6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:13.141945 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9719d89e-2f2a-40fc-a1d8-bf6ae31b66e6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.018531 Aug 29 15:49:13.143032 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2653/5465] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:49:13 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:49:13.152219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-088cd8bf-18a7-4a35-aa0e-8bab29bb5b36 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:13.153790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-088cd8bf-18a7-4a35-aa0e-8bab29bb5b36 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:13.161636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-088cd8bf-18a7-4a35-aa0e-8bab29bb5b36 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.162330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-088cd8bf-18a7-4a35-aa0e-8bab29bb5b36 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.163572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-088cd8bf-18a7-4a35-aa0e-8bab29bb5b36 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.164407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-088cd8bf-18a7-4a35-aa0e-8bab29bb5b36 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.164975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-088cd8bf-18a7-4a35-aa0e-8bab29bb5b36 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.165536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-088cd8bf-18a7-4a35-aa0e-8bab29bb5b36 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.254715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-508e180f-1c88-4b62-af8b-a52e9f68cbd0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:13.255788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-508e180f-1c88-4b62-af8b-a52e9f68cbd0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:13.273046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-508e180f-1c88-4b62-af8b-a52e9f68cbd0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.274736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-508e180f-1c88-4b62-af8b-a52e9f68cbd0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.275436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-508e180f-1c88-4b62-af8b-a52e9f68cbd0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.277976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-508e180f-1c88-4b62-af8b-a52e9f68cbd0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.278711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-508e180f-1c88-4b62-af8b-a52e9f68cbd0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.280421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-508e180f-1c88-4b62-af8b-a52e9f68cbd0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.328483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-088cd8bf-18a7-4a35-aa0e-8bab29bb5b36 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:13.338483 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-088cd8bf-18a7-4a35-aa0e-8bab29bb5b36 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.190449 Aug 29 15:49:13.353124 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2813/5466] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:13 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:13.370293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-acb41ea2-caf7-4b65-a3e6-4ac630a1a810 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:13.373893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-acb41ea2-caf7-4b65-a3e6-4ac630a1a810 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:13.383917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acb41ea2-caf7-4b65-a3e6-4ac630a1a810 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.384813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acb41ea2-caf7-4b65-a3e6-4ac630a1a810 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.386137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acb41ea2-caf7-4b65-a3e6-4ac630a1a810 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.387092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acb41ea2-caf7-4b65-a3e6-4ac630a1a810 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.387918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acb41ea2-caf7-4b65-a3e6-4ac630a1a810 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.388606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acb41ea2-caf7-4b65-a3e6-4ac630a1a810 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.502369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-508e180f-1c88-4b62-af8b-a52e9f68cbd0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:13.516244 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-508e180f-1c88-4b62-af8b-a52e9f68cbd0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1509 microversion: 2.1 time: 0.271501 Aug 29 15:49:13.517897 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2654/5467] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:13 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1509 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:13.524798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c5a7a297-5d9c-4b3f-9784-939e9e146f4e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:13.525869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c5a7a297-5d9c-4b3f-9784-939e9e146f4e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:13.533541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5a7a297-5d9c-4b3f-9784-939e9e146f4e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.534438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5a7a297-5d9c-4b3f-9784-939e9e146f4e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.535053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5a7a297-5d9c-4b3f-9784-939e9e146f4e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.535984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5a7a297-5d9c-4b3f-9784-939e9e146f4e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.536742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5a7a297-5d9c-4b3f-9784-939e9e146f4e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.538021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5a7a297-5d9c-4b3f-9784-939e9e146f4e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.625822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c5a7a297-5d9c-4b3f-9784-939e9e146f4e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:13.634068 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c5a7a297-5d9c-4b3f-9784-939e9e146f4e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1245 microversion: 2.1 time: 0.113485 Aug 29 15:49:13.644770 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2655/5468] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:13 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1245 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:13.644913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-acb41ea2-caf7-4b65-a3e6-4ac630a1a810 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:13.645047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eff4cf5b-c0a6-4546-b014-b630a30f252c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:13.645047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eff4cf5b-c0a6-4546-b014-b630a30f252c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:13.646122 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-acb41ea2-caf7-4b65-a3e6-4ac630a1a810 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.280390 Aug 29 15:49:13.647232 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2814/5469] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:13 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:13.654427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eff4cf5b-c0a6-4546-b014-b630a30f252c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.655200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eff4cf5b-c0a6-4546-b014-b630a30f252c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.655709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eff4cf5b-c0a6-4546-b014-b630a30f252c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.656540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eff4cf5b-c0a6-4546-b014-b630a30f252c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.657121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eff4cf5b-c0a6-4546-b014-b630a30f252c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.657632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eff4cf5b-c0a6-4546-b014-b630a30f252c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.667045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d04910cd-2094-497a-abd4-6e31b24e8626 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:13.667882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d04910cd-2094-497a-abd4-6e31b24e8626 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: 4fb91af7-5193-45fc-ab88-cc7cade0d721] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:13.674091 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-d04910cd-2094-497a-abd4-6e31b24e8626 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance 4fb91af7-5193-45fc-ab88-cc7cade0d721 could not be found. Aug 29 15:49:13.679598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d04910cd-2094-497a-abd4-6e31b24e8626 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/4fb91af7-5193-45fc-ab88-cc7cade0d721/action HTTP/1.1 Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 19 Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: {"forceDelete": {}} Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 4fb91af7-5193-45fc-ab88-cc7cade0d721 could not be found. Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '4fb91af7-5193-45fc-ab88-cc7cade0d721', 'body': {'forceDelete': {}}} Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fb91af7-5193-45fc-ab88-cc7cade0d721 could not be found. Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fb91af7-5193-45fc-ab88-cc7cade0d721 could not be found. Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:13.681862 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:13.687794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:13.687794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:13.687794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fb91af7-5193-45fc-ab88-cc7cade0d721 could not be found. Aug 29 15:49:13.687794 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:13.689427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d04910cd-2094-497a-abd4-6e31b24e8626 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance 4fb91af7-5193-45fc-ab88-cc7cade0d721 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:13.691360 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d04910cd-2094-497a-abd4-6e31b24e8626 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/4fb91af7-5193-45fc-ab88-cc7cade0d721/action" status: 404 len: 111 microversion: 2.1 time: 0.028274 Aug 29 15:49:13.693185 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2815/5470] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:13 2022] POST /compute/v2.1/servers/4fb91af7-5193-45fc-ab88-cc7cade0d721/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:13.702413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9b7fe81b-b73b-4279-a04b-71527530eca9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:13.703280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9b7fe81b-b73b-4279-a04b-71527530eca9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:13.713671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b7fe81b-b73b-4279-a04b-71527530eca9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.714218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b7fe81b-b73b-4279-a04b-71527530eca9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.714692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b7fe81b-b73b-4279-a04b-71527530eca9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.715425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b7fe81b-b73b-4279-a04b-71527530eca9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.716255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b7fe81b-b73b-4279-a04b-71527530eca9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.717333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b7fe81b-b73b-4279-a04b-71527530eca9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.873026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eff4cf5b-c0a6-4546-b014-b630a30f252c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:13.883598 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eff4cf5b-c0a6-4546-b014-b630a30f252c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 200 len: 1293 microversion: 2.1 time: 0.246337 Aug 29 15:49:13.884827 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2656/5471] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:13 2022] GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 1293 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:13.893794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9b7fe81b-b73b-4279-a04b-71527530eca9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:13.903176 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9b7fe81b-b73b-4279-a04b-71527530eca9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.206108 Aug 29 15:49:13.903897 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2816/5472] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:13 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:13.924266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-87d8efb2-867d-4620-81e2-25b41c071094 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:13.924914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-87d8efb2-867d-4620-81e2-25b41c071094 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:13.932615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87d8efb2-867d-4620-81e2-25b41c071094 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.933364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87d8efb2-867d-4620-81e2-25b41c071094 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.933964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87d8efb2-867d-4620-81e2-25b41c071094 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.934829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87d8efb2-867d-4620-81e2-25b41c071094 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.935607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87d8efb2-867d-4620-81e2-25b41c071094 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.936190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87d8efb2-867d-4620-81e2-25b41c071094 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.998951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a2d3e5e4-c727-466e-b2ff-87799440f499 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:13.999505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a2d3e5e4-c727-466e-b2ff-87799440f499 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:14.006289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2d3e5e4-c727-466e-b2ff-87799440f499 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.006800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2d3e5e4-c727-466e-b2ff-87799440f499 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.007244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2d3e5e4-c727-466e-b2ff-87799440f499 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.007951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2d3e5e4-c727-466e-b2ff-87799440f499 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.008617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2d3e5e4-c727-466e-b2ff-87799440f499 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.009055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2d3e5e4-c727-466e-b2ff-87799440f499 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.172993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a2d3e5e4-c727-466e-b2ff-87799440f499 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:14.182358 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a2d3e5e4-c727-466e-b2ff-87799440f499 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1318 microversion: 2.1 time: 0.188543 Aug 29 15:49:14.198766 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2817/5473] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:13 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:14.329746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-87d8efb2-867d-4620-81e2-25b41c071094 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:14.346109 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-87d8efb2-867d-4620-81e2-25b41c071094 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.425858 Aug 29 15:49:14.347400 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2657/5474] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:13 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:14.373310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7e74ff6e-d0c0-41bc-994b-cebe3934b57a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:14.376253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7e74ff6e-d0c0-41bc-994b-cebe3934b57a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: 9c760aaf-bea9-4b11-b2a3-e85b340fb71f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:14.384833 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-7e74ff6e-d0c0-41bc-994b-cebe3934b57a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance 9c760aaf-bea9-4b11-b2a3-e85b340fb71f could not be found. Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7e74ff6e-d0c0-41bc-994b-cebe3934b57a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/9c760aaf-bea9-4b11-b2a3-e85b340fb71f/action HTTP/1.1 Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 39 Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: {"os-getConsoleOutput": {"length": 10}} Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 9c760aaf-bea9-4b11-b2a3-e85b340fb71f could not be found. Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '9c760aaf-bea9-4b11-b2a3-e85b340fb71f', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c760aaf-bea9-4b11-b2a3-e85b340fb71f could not be found. Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c760aaf-bea9-4b11-b2a3-e85b340fb71f could not be found. Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:14.401967 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:14.406488 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:14.406488 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:14.406488 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:14.406488 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:14.406488 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c760aaf-bea9-4b11-b2a3-e85b340fb71f could not be found. Aug 29 15:49:14.406488 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:14.409177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7e74ff6e-d0c0-41bc-994b-cebe3934b57a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance 9c760aaf-bea9-4b11-b2a3-e85b340fb71f could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:14.410267 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7e74ff6e-d0c0-41bc-994b-cebe3934b57a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/9c760aaf-bea9-4b11-b2a3-e85b340fb71f/action" status: 404 len: 111 microversion: 2.1 time: 0.046024 Aug 29 15:49:14.411069 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2818/5475] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:14 2022] POST /compute/v2.1/servers/9c760aaf-bea9-4b11-b2a3-e85b340fb71f/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:14.420318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-057aff09-d09a-4d5e-ac62-fec60cd5da67 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:14.420945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-057aff09-d09a-4d5e-ac62-fec60cd5da67 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:14.428301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-057aff09-d09a-4d5e-ac62-fec60cd5da67 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.428822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-057aff09-d09a-4d5e-ac62-fec60cd5da67 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.429288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-057aff09-d09a-4d5e-ac62-fec60cd5da67 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.430003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-057aff09-d09a-4d5e-ac62-fec60cd5da67 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.430464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-057aff09-d09a-4d5e-ac62-fec60cd5da67 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.437168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-057aff09-d09a-4d5e-ac62-fec60cd5da67 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.538822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a4cd8ab6-fb51-4605-a8b2-b53ac86e7f10 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:14.539726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a4cd8ab6-fb51-4605-a8b2-b53ac86e7f10 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:14.548041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4cd8ab6-fb51-4605-a8b2-b53ac86e7f10 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.548789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4cd8ab6-fb51-4605-a8b2-b53ac86e7f10 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.549468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4cd8ab6-fb51-4605-a8b2-b53ac86e7f10 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.550667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4cd8ab6-fb51-4605-a8b2-b53ac86e7f10 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.551943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4cd8ab6-fb51-4605-a8b2-b53ac86e7f10 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.552910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4cd8ab6-fb51-4605-a8b2-b53ac86e7f10 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.717916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a4cd8ab6-fb51-4605-a8b2-b53ac86e7f10 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:14.731652 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a4cd8ab6-fb51-4605-a8b2-b53ac86e7f10 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1509 microversion: 2.1 time: 0.197115 Aug 29 15:49:14.732875 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2819/5476] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:14 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:14.739339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e714778c-4e6e-4d8e-98fa-fda926141189 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:14.740289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e714778c-4e6e-4d8e-98fa-fda926141189 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:14.749011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e714778c-4e6e-4d8e-98fa-fda926141189 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.750284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e714778c-4e6e-4d8e-98fa-fda926141189 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.751121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e714778c-4e6e-4d8e-98fa-fda926141189 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.752367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e714778c-4e6e-4d8e-98fa-fda926141189 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.754263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e714778c-4e6e-4d8e-98fa-fda926141189 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.755005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e714778c-4e6e-4d8e-98fa-fda926141189 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.839356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e714778c-4e6e-4d8e-98fa-fda926141189 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:14.851061 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e714778c-4e6e-4d8e-98fa-fda926141189 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1293 microversion: 2.1 time: 0.116700 Aug 29 15:49:14.852091 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2820/5477] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:14 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1293 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:14.935374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-057aff09-d09a-4d5e-ac62-fec60cd5da67 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:14.950688 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-057aff09-d09a-4d5e-ac62-fec60cd5da67 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.534415 Aug 29 15:49:14.951291 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2658/5478] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:14 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:14.962471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c3751c3e-37a4-4290-842e-995c13709df3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:14.963413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c3751c3e-37a4-4290-842e-995c13709df3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:14.977458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3751c3e-37a4-4290-842e-995c13709df3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.978072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3751c3e-37a4-4290-842e-995c13709df3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.978585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3751c3e-37a4-4290-842e-995c13709df3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.979579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3751c3e-37a4-4290-842e-995c13709df3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.980241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3751c3e-37a4-4290-842e-995c13709df3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.980761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3751c3e-37a4-4290-842e-995c13709df3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.077117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-45dd9ce7-a050-429c-af97-ba2320a430f6 tempest-PortsAdminExtendedAttrsTestJSON-25814563 tempest-PortsAdminExtendedAttrsTestJSON-25814563-project-admin] Calling method '.version_select at 0x7fc433ba1dc0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:15.079568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45dd9ce7-a050-429c-af97-ba2320a430f6 tempest-PortsAdminExtendedAttrsTestJSON-25814563 tempest-PortsAdminExtendedAttrsTestJSON-25814563-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.080069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45dd9ce7-a050-429c-af97-ba2320a430f6 tempest-PortsAdminExtendedAttrsTestJSON-25814563 tempest-PortsAdminExtendedAttrsTestJSON-25814563-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.080734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45dd9ce7-a050-429c-af97-ba2320a430f6 tempest-PortsAdminExtendedAttrsTestJSON-25814563 tempest-PortsAdminExtendedAttrsTestJSON-25814563-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.112656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45dd9ce7-a050-429c-af97-ba2320a430f6 tempest-PortsAdminExtendedAttrsTestJSON-25814563 tempest-PortsAdminExtendedAttrsTestJSON-25814563-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.113411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45dd9ce7-a050-429c-af97-ba2320a430f6 tempest-PortsAdminExtendedAttrsTestJSON-25814563 tempest-PortsAdminExtendedAttrsTestJSON-25814563-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.114056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45dd9ce7-a050-429c-af97-ba2320a430f6 tempest-PortsAdminExtendedAttrsTestJSON-25814563 tempest-PortsAdminExtendedAttrsTestJSON-25814563-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.126855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45dd9ce7-a050-429c-af97-ba2320a430f6 tempest-PortsAdminExtendedAttrsTestJSON-25814563 tempest-PortsAdminExtendedAttrsTestJSON-25814563-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.127622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45dd9ce7-a050-429c-af97-ba2320a430f6 tempest-PortsAdminExtendedAttrsTestJSON-25814563 tempest-PortsAdminExtendedAttrsTestJSON-25814563-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.128276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45dd9ce7-a050-429c-af97-ba2320a430f6 tempest-PortsAdminExtendedAttrsTestJSON-25814563 tempest-PortsAdminExtendedAttrsTestJSON-25814563-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.136193 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-45dd9ce7-a050-429c-af97-ba2320a430f6 tempest-PortsAdminExtendedAttrsTestJSON-25814563 tempest-PortsAdminExtendedAttrsTestJSON-25814563-project-admin] 10.222.0.62 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.265796 Aug 29 15:49:15.144204 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2821/5479] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 15:49:14 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:49:15.153340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-946b31fb-a78b-4b73-bb54-ce9019155e93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:15.161500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-946b31fb-a78b-4b73-bb54-ce9019155e93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:15.174214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c3751c3e-37a4-4290-842e-995c13709df3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:15.178632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-946b31fb-a78b-4b73-bb54-ce9019155e93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.179152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-946b31fb-a78b-4b73-bb54-ce9019155e93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.179704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-946b31fb-a78b-4b73-bb54-ce9019155e93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.180388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-946b31fb-a78b-4b73-bb54-ce9019155e93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.180920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-946b31fb-a78b-4b73-bb54-ce9019155e93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.181364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-946b31fb-a78b-4b73-bb54-ce9019155e93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.183405 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c3751c3e-37a4-4290-842e-995c13709df3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 200 len: 1293 microversion: 2.1 time: 0.225088 Aug 29 15:49:15.183946 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2659/5480] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:14 2022] GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 1293 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:15.204155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cee0892a-7e02-4dc2-a4f7-c4b1f94d0cf9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:15.204792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cee0892a-7e02-4dc2-a4f7-c4b1f94d0cf9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:15.214842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cee0892a-7e02-4dc2-a4f7-c4b1f94d0cf9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.215369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cee0892a-7e02-4dc2-a4f7-c4b1f94d0cf9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.215827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cee0892a-7e02-4dc2-a4f7-c4b1f94d0cf9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.216524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cee0892a-7e02-4dc2-a4f7-c4b1f94d0cf9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.216979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cee0892a-7e02-4dc2-a4f7-c4b1f94d0cf9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.219862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cee0892a-7e02-4dc2-a4f7-c4b1f94d0cf9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.422277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cee0892a-7e02-4dc2-a4f7-c4b1f94d0cf9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:15.431299 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cee0892a-7e02-4dc2-a4f7-c4b1f94d0cf9 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1318 microversion: 2.1 time: 0.231246 Aug 29 15:49:15.432491 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2660/5481] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:15 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:15.511561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-946b31fb-a78b-4b73-bb54-ce9019155e93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:15.520594 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-946b31fb-a78b-4b73-bb54-ce9019155e93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.374907 Aug 29 15:49:15.521649 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2822/5482] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:15 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:15.541598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b878fd2c-c8e0-4b10-b3bf-92aa87ba5cc7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:15.542251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b878fd2c-c8e0-4b10-b3bf-92aa87ba5cc7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: 3e903482-d5ec-45f4-b887-8bb543f24be7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:15.551199 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-b878fd2c-c8e0-4b10-b3bf-92aa87ba5cc7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance 3e903482-d5ec-45f4-b887-8bb543f24be7 could not be found. Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b878fd2c-c8e0-4b10-b3bf-92aa87ba5cc7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/3e903482-d5ec-45f4-b887-8bb543f24be7 HTTP/1.1 Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 3e903482-d5ec-45f4-b887-8bb543f24be7 could not be found. Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '3e903482-d5ec-45f4-b887-8bb543f24be7'} Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e903482-d5ec-45f4-b887-8bb543f24be7 could not be found. Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e903482-d5ec-45f4-b887-8bb543f24be7 could not be found. Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:15.553465 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:15.559178 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:15.559178 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:15.559178 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:15.559178 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e903482-d5ec-45f4-b887-8bb543f24be7 could not be found. Aug 29 15:49:15.559178 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:15.560584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b878fd2c-c8e0-4b10-b3bf-92aa87ba5cc7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance 3e903482-d5ec-45f4-b887-8bb543f24be7 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:15.561708 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b878fd2c-c8e0-4b10-b3bf-92aa87ba5cc7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/3e903482-d5ec-45f4-b887-8bb543f24be7" status: 404 len: 111 microversion: 2.1 time: 0.024253 Aug 29 15:49:15.565934 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2661/5483] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:15 2022] GET /compute/v2.1/servers/3e903482-d5ec-45f4-b887-8bb543f24be7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:15.571343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-61256c90-b123-44db-aac0-b84f78127c14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:15.572308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-61256c90-b123-44db-aac0-b84f78127c14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:15.579313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61256c90-b123-44db-aac0-b84f78127c14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.579803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61256c90-b123-44db-aac0-b84f78127c14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.580235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61256c90-b123-44db-aac0-b84f78127c14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.581273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61256c90-b123-44db-aac0-b84f78127c14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.581812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61256c90-b123-44db-aac0-b84f78127c14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.582681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-61256c90-b123-44db-aac0-b84f78127c14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.758320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d4fab84f-1e20-4612-ab29-315bd3ac09cd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:15.759232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d4fab84f-1e20-4612-ab29-315bd3ac09cd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:15.770772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4fab84f-1e20-4612-ab29-315bd3ac09cd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.772180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4fab84f-1e20-4612-ab29-315bd3ac09cd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.773024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4fab84f-1e20-4612-ab29-315bd3ac09cd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.774086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4fab84f-1e20-4612-ab29-315bd3ac09cd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.774688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4fab84f-1e20-4612-ab29-315bd3ac09cd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.775213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4fab84f-1e20-4612-ab29-315bd3ac09cd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.826764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-61256c90-b123-44db-aac0-b84f78127c14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:15.860768 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-61256c90-b123-44db-aac0-b84f78127c14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.292014 Aug 29 15:49:15.862472 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2823/5484] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:15 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:15.879233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fa3a057f-a126-441c-9712-f8d20428a1f3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:15.881207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fa3a057f-a126-441c-9712-f8d20428a1f3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:15.895239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa3a057f-a126-441c-9712-f8d20428a1f3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.896252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa3a057f-a126-441c-9712-f8d20428a1f3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.896946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa3a057f-a126-441c-9712-f8d20428a1f3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.898144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa3a057f-a126-441c-9712-f8d20428a1f3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.899421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa3a057f-a126-441c-9712-f8d20428a1f3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.900279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa3a057f-a126-441c-9712-f8d20428a1f3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.998565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d4fab84f-1e20-4612-ab29-315bd3ac09cd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:16.009314 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d4fab84f-1e20-4612-ab29-315bd3ac09cd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1515 microversion: 2.1 time: 0.255197 Aug 29 15:49:16.009971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fa3a057f-a126-441c-9712-f8d20428a1f3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:16.010425 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2662/5485] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:15 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:16.015636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-96f848db-125b-448e-865e-710fcb4a559e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:16.016370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-96f848db-125b-448e-865e-710fcb4a559e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:16.022165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:16.024547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96f848db-125b-448e-865e-710fcb4a559e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.025417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96f848db-125b-448e-865e-710fcb4a559e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.026124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96f848db-125b-448e-865e-710fcb4a559e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.027038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96f848db-125b-448e-865e-710fcb4a559e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.027728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96f848db-125b-448e-865e-710fcb4a559e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.028342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96f848db-125b-448e-865e-710fcb4a559e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.036876 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fa3a057f-a126-441c-9712-f8d20428a1f3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1293 microversion: 2.1 time: 0.167164 Aug 29 15:49:16.037617 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2824/5486] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:15 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1293 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:16.204910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-001e2ac1-c3d1-4658-a9e9-97df28cb5fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:16.205900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-001e2ac1-c3d1-4658-a9e9-97df28cb5fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:16.220906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-001e2ac1-c3d1-4658-a9e9-97df28cb5fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.229039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-001e2ac1-c3d1-4658-a9e9-97df28cb5fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.231397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-001e2ac1-c3d1-4658-a9e9-97df28cb5fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.232555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-001e2ac1-c3d1-4658-a9e9-97df28cb5fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.239955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-001e2ac1-c3d1-4658-a9e9-97df28cb5fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.241678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-001e2ac1-c3d1-4658-a9e9-97df28cb5fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.326934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-96f848db-125b-448e-865e-710fcb4a559e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:16.338812 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-96f848db-125b-448e-865e-710fcb4a559e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.326954 Aug 29 15:49:16.340805 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2663/5487] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:16 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:16.455036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b72c0ef-a513-458e-81f0-7e76164a2e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:16.456369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4b72c0ef-a513-458e-81f0-7e76164a2e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:16.468948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b72c0ef-a513-458e-81f0-7e76164a2e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.469769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b72c0ef-a513-458e-81f0-7e76164a2e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.470611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b72c0ef-a513-458e-81f0-7e76164a2e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.474196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b72c0ef-a513-458e-81f0-7e76164a2e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.475080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b72c0ef-a513-458e-81f0-7e76164a2e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.475687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b72c0ef-a513-458e-81f0-7e76164a2e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.886383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-001e2ac1-c3d1-4658-a9e9-97df28cb5fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:16.900687 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-001e2ac1-c3d1-4658-a9e9-97df28cb5fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 200 len: 1293 microversion: 2.1 time: 0.699764 Aug 29 15:49:16.904208 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2825/5488] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:16 2022] GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 1293 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:16.912895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-be03a39b-87c9-4846-ab9f-db7a070e0070 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1337976958", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-be03a39b-87c9-4846-ab9f-db7a070e0070 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 238 Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1337976958", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1337976958', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '74eea137-7f8c-43e1-bd42-582bf8562b2a'}]}}} Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:16.930828 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 29 15:49:16.936994 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:16.941448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-be03a39b-87c9-4846-ab9f-db7a070e0070 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:16.943280 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-be03a39b-87c9-4846-ab9f-db7a070e0070 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.036651 Aug 29 15:49:16.944173 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2826/5489] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:16 2022] POST /compute/v2.1/servers => generated 139 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:16.953760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-63be041a-001c-4dd7-80de-f85fc58acaf6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:16.955048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-63be041a-001c-4dd7-80de-f85fc58acaf6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:16.966796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63be041a-001c-4dd7-80de-f85fc58acaf6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.967890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63be041a-001c-4dd7-80de-f85fc58acaf6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.968693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63be041a-001c-4dd7-80de-f85fc58acaf6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.969800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63be041a-001c-4dd7-80de-f85fc58acaf6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.970452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63be041a-001c-4dd7-80de-f85fc58acaf6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.971266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63be041a-001c-4dd7-80de-f85fc58acaf6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.976152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4b72c0ef-a513-458e-81f0-7e76164a2e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:16.987161 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4b72c0ef-a513-458e-81f0-7e76164a2e64 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1318 microversion: 2.1 time: 0.536667 Aug 29 15:49:17.002944 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2664/5490] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:16 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:17.058943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a917b92e-bcb5-4d1a-9894-6c5154bf1770 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:17.059784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a917b92e-bcb5-4d1a-9894-6c5154bf1770 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:17.074420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a917b92e-bcb5-4d1a-9894-6c5154bf1770 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.075197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a917b92e-bcb5-4d1a-9894-6c5154bf1770 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.075818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a917b92e-bcb5-4d1a-9894-6c5154bf1770 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.076718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a917b92e-bcb5-4d1a-9894-6c5154bf1770 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.077371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a917b92e-bcb5-4d1a-9894-6c5154bf1770 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.078413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a917b92e-bcb5-4d1a-9894-6c5154bf1770 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.240593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-63be041a-001c-4dd7-80de-f85fc58acaf6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:17.255072 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-63be041a-001c-4dd7-80de-f85fc58acaf6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.306131 Aug 29 15:49:17.256274 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2827/5491] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:16 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:17.281547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f1ba91a-9f86-450d-9855-20478a2d90ae tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:17.282188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3f1ba91a-9f86-450d-9855-20478a2d90ae tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:17.290113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a917b92e-bcb5-4d1a-9894-6c5154bf1770 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:17.291100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f1ba91a-9f86-450d-9855-20478a2d90ae tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.291607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f1ba91a-9f86-450d-9855-20478a2d90ae tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.297065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f1ba91a-9f86-450d-9855-20478a2d90ae tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.298089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f1ba91a-9f86-450d-9855-20478a2d90ae tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.298759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f1ba91a-9f86-450d-9855-20478a2d90ae tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.299345 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a917b92e-bcb5-4d1a-9894-6c5154bf1770 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1299 microversion: 2.1 time: 0.244353 Aug 29 15:49:17.299516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f1ba91a-9f86-450d-9855-20478a2d90ae tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.314508 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2665/5492] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:17 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1299 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:17.357590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b6c48d0f-de77-4598-9845-3cbfdf8c99d1 req-b472868e-a3fd-4c04-b7f6-1c52224de6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e021dd0-d5dc-4600-b577-27abfc1282bb", "name": "network-vif-plugged", "status": "completed", "tag": "37037bd8-6ee9-4555-a34d-b0d12a0a8cc1"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:17.376499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b6c48d0f-de77-4598-9845-3cbfdf8c99d1 req-b472868e-a3fd-4c04-b7f6-1c52224de6f5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.378760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b6c48d0f-de77-4598-9845-3cbfdf8c99d1 req-b472868e-a3fd-4c04-b7f6-1c52224de6f5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.379396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b6c48d0f-de77-4598-9845-3cbfdf8c99d1 req-b472868e-a3fd-4c04-b7f6-1c52224de6f5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.411053 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b6c48d0f-de77-4598-9845-3cbfdf8c99d1 req-b472868e-a3fd-4c04-b7f6-1c52224de6f5 service nova] Creating event network-vif-plugged:37037bd8-6ee9-4555-a34d-b0d12a0a8cc1 for instance 0e021dd0-d5dc-4600-b577-27abfc1282bb on n-h1-839401-11 Aug 29 15:49:17.425985 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b6c48d0f-de77-4598-9845-3cbfdf8c99d1 req-b472868e-a3fd-4c04-b7f6-1c52224de6f5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073328 Aug 29 15:49:17.427154 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2666/5493] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:49:17.856659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3f1ba91a-9f86-450d-9855-20478a2d90ae tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:17.868240 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3f1ba91a-9f86-450d-9855-20478a2d90ae tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.591135 Aug 29 15:49:17.869158 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2828/5494] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:17 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:17.929119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-39c0b709-e085-4d69-948a-998dba04dd59 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:17.930553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-39c0b709-e085-4d69-948a-998dba04dd59 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:17.942870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39c0b709-e085-4d69-948a-998dba04dd59 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.958813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39c0b709-e085-4d69-948a-998dba04dd59 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.961819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39c0b709-e085-4d69-948a-998dba04dd59 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.967138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39c0b709-e085-4d69-948a-998dba04dd59 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.969971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39c0b709-e085-4d69-948a-998dba04dd59 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.973012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39c0b709-e085-4d69-948a-998dba04dd59 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.981349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-35350c26-66b0-41f4-818e-500ee28107a6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-416053275", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-35350c26-66b0-41f4-818e-500ee28107a6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 234 Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-416053275", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-416053275', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '74eea137-7f8c-43e1-bd42-582bf8562b2a'}]}}} Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:17.990370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 29 15:49:17.996518 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:18.000673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-35350c26-66b0-41f4-818e-500ee28107a6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:18.002656 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-35350c26-66b0-41f4-818e-500ee28107a6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.025403 Aug 29 15:49:18.006930 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2829/5495] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:17 2022] POST /compute/v2.1/servers => generated 133 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:18.022887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eba6a28e-e9f4-4029-b981-8adb8789c48a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:18.024034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eba6a28e-e9f4-4029-b981-8adb8789c48a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:18.038087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eba6a28e-e9f4-4029-b981-8adb8789c48a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.038878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eba6a28e-e9f4-4029-b981-8adb8789c48a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.039518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eba6a28e-e9f4-4029-b981-8adb8789c48a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.041368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eba6a28e-e9f4-4029-b981-8adb8789c48a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.042001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eba6a28e-e9f4-4029-b981-8adb8789c48a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.043055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eba6a28e-e9f4-4029-b981-8adb8789c48a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.350294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-39c0b709-e085-4d69-948a-998dba04dd59 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:18.359098 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-39c0b709-e085-4d69-948a-998dba04dd59 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 200 len: 1293 microversion: 2.1 time: 0.435316 Aug 29 15:49:18.359785 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2667/5496] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:17 2022] GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 1293 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:18.376029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fe607b50-7ed1-4404-a071-7f380df5e3cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:18.376911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fe607b50-7ed1-4404-a071-7f380df5e3cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:18.383739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe607b50-7ed1-4404-a071-7f380df5e3cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.384483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe607b50-7ed1-4404-a071-7f380df5e3cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.385394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe607b50-7ed1-4404-a071-7f380df5e3cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.386093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe607b50-7ed1-4404-a071-7f380df5e3cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.386733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe607b50-7ed1-4404-a071-7f380df5e3cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.387318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe607b50-7ed1-4404-a071-7f380df5e3cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.426116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eba6a28e-e9f4-4029-b981-8adb8789c48a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:18.429565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:18.437801 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eba6a28e-e9f4-4029-b981-8adb8789c48a tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1508 microversion: 2.1 time: 0.425492 Aug 29 15:49:18.438967 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2830/5497] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:18 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1508 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:18.453427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1be9f388-ca10-467a-be41-96727a1c94c8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:18.454462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1be9f388-ca10-467a-be41-96727a1c94c8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:18.460987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1be9f388-ca10-467a-be41-96727a1c94c8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.461731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1be9f388-ca10-467a-be41-96727a1c94c8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.462483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1be9f388-ca10-467a-be41-96727a1c94c8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.463458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1be9f388-ca10-467a-be41-96727a1c94c8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.464139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1be9f388-ca10-467a-be41-96727a1c94c8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.464575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1be9f388-ca10-467a-be41-96727a1c94c8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.688180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1be9f388-ca10-467a-be41-96727a1c94c8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:18.701257 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1be9f388-ca10-467a-be41-96727a1c94c8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1367 microversion: 2.1 time: 0.260994 Aug 29 15:49:18.715113 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2831/5498] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:18 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:18.727280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-55e75df0-0153-48ff-8eae-a80d267f1d8d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da31af03-0547-415f-935e-1a771ea11d73", "device": "/dev/sdb"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:18.730216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-55e75df0-0153-48ff-8eae-a80d267f1d8d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:18.737141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55e75df0-0153-48ff-8eae-a80d267f1d8d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.737939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55e75df0-0153-48ff-8eae-a80d267f1d8d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.738563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55e75df0-0153-48ff-8eae-a80d267f1d8d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.739816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55e75df0-0153-48ff-8eae-a80d267f1d8d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.740458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55e75df0-0153-48ff-8eae-a80d267f1d8d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.741098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55e75df0-0153-48ff-8eae-a80d267f1d8d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.120934 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-55e75df0-0153-48ff-8eae-a80d267f1d8d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "POST /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404199 Aug 29 15:49:19.123040 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2832/5499] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 15:49:18 2022] POST /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:19.148069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b64b4b6f-e2cb-4d49-9fdd-8c2c869ae4b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'create', calling method: .version_select at 0x7fc42b575550>, body: {"keypair": {"name": "tempest-keypair-300282973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtTN32Zed+EwRaeUPA1EI3FjJf7tv39Fv6rhHF02Ph3luW6Yrnx1+93+1glY3fdrewzPx9t8QQJyfpDc6qYWApTZNEKhFMXhex9dUE+3soK1H1SWyfD+3ANqyOYcXxt+w=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:19.183327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=17 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:19.187587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fe607b50-7ed1-4404-a071-7f380df5e3cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:19.193885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-b64b4b6f-e2cb-4d49-9fdd-8c2c869ae4b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Getting quotas for project bb5330327389417995f14947be334a04. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:19.205600 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fe607b50-7ed1-4404-a071-7f380df5e3cb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.842986 Aug 29 15:49:19.206324 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2668/5500] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:18 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:19.230533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-b64b4b6f-e2cb-4d49-9fdd-8c2c869ae4b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Getting quotas for user e75a8c66c5304e608e2f3120c1192534 and project bb5330327389417995f14947be334a04. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:19.235521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d55c6b85-2e46-41db-b2f8-703a66084055 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:19.236054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d55c6b85-2e46-41db-b2f8-703a66084055 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:19.253108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55c6b85-2e46-41db-b2f8-703a66084055 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.253108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55c6b85-2e46-41db-b2f8-703a66084055 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.253108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55c6b85-2e46-41db-b2f8-703a66084055 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.253108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55c6b85-2e46-41db-b2f8-703a66084055 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.253108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55c6b85-2e46-41db-b2f8-703a66084055 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.253108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55c6b85-2e46-41db-b2f8-703a66084055 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.308763 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b64b4b6f-e2cb-4d49-9fdd-8c2c869ae4b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.184229 Aug 29 15:49:19.309789 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2833/5501] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:49:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:19.382850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2f00b4f3-e78a-4d8e-a06a-4c73154cdd29 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:19.384019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2f00b4f3-e78a-4d8e-a06a-4c73154cdd29 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:19.395659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f00b4f3-e78a-4d8e-a06a-4c73154cdd29 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.396657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f00b4f3-e78a-4d8e-a06a-4c73154cdd29 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.397335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f00b4f3-e78a-4d8e-a06a-4c73154cdd29 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.399100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f00b4f3-e78a-4d8e-a06a-4c73154cdd29 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.400746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f00b4f3-e78a-4d8e-a06a-4c73154cdd29 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.402651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f00b4f3-e78a-4d8e-a06a-4c73154cdd29 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.705337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d55c6b85-2e46-41db-b2f8-703a66084055 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:19.718881 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d55c6b85-2e46-41db-b2f8-703a66084055 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.488516 Aug 29 15:49:19.721693 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2669/5502] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:19 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:19.740071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e54c3805-52e5-45b2-b516-94fb9c24aed1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:19.741679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e54c3805-52e5-45b2-b516-94fb9c24aed1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:19.753826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e54c3805-52e5-45b2-b516-94fb9c24aed1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.757763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e54c3805-52e5-45b2-b516-94fb9c24aed1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.759586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e54c3805-52e5-45b2-b516-94fb9c24aed1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.762107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e54c3805-52e5-45b2-b516-94fb9c24aed1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.763686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e54c3805-52e5-45b2-b516-94fb9c24aed1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.764299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e54c3805-52e5-45b2-b516-94fb9c24aed1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.778754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2f00b4f3-e78a-4d8e-a06a-4c73154cdd29 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:19.790987 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2f00b4f3-e78a-4d8e-a06a-4c73154cdd29 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 200 len: 1474 microversion: 2.1 time: 0.414405 Aug 29 15:49:19.791555 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2834/5503] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:19 2022] GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 1474 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:19.810732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f488fbaa-3863-4022-84fd-95937649f175 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:19.811284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f488fbaa-3863-4022-84fd-95937649f175 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: c5ae5ed1-612a-434a-8b41-0f3f918ad20f] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:19.826518 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-f488fbaa-3863-4022-84fd-95937649f175 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance c5ae5ed1-612a-434a-8b41-0f3f918ad20f could not be found. Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f488fbaa-3863-4022-84fd-95937649f175 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/c5ae5ed1-612a-434a-8b41-0f3f918ad20f/action HTTP/1.1 Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 13 Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: {"pause": {}} Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance c5ae5ed1-612a-434a-8b41-0f3f918ad20f could not be found. Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'c5ae5ed1-612a-434a-8b41-0f3f918ad20f', 'body': {'pause': {}}} Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ae5ed1-612a-434a-8b41-0f3f918ad20f could not be found. Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ae5ed1-612a-434a-8b41-0f3f918ad20f could not be found. Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:19.842191 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:19.847709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:19.847709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:19.847709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ae5ed1-612a-434a-8b41-0f3f918ad20f could not be found. Aug 29 15:49:19.847709 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:19.847709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f488fbaa-3863-4022-84fd-95937649f175 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance c5ae5ed1-612a-434a-8b41-0f3f918ad20f could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:19.850025 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f488fbaa-3863-4022-84fd-95937649f175 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/c5ae5ed1-612a-434a-8b41-0f3f918ad20f/action" status: 404 len: 111 microversion: 2.1 time: 0.055316 Aug 29 15:49:19.850757 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2835/5504] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:19 2022] POST /compute/v2.1/servers/c5ae5ed1-612a-434a-8b41-0f3f918ad20f/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:19.865486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d21f8687-d469-4147-b7a9-48cfddf0b689 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:19.867838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d21f8687-d469-4147-b7a9-48cfddf0b689 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:19.884274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d21f8687-d469-4147-b7a9-48cfddf0b689 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.887160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d21f8687-d469-4147-b7a9-48cfddf0b689 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.887872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d21f8687-d469-4147-b7a9-48cfddf0b689 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.889479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d21f8687-d469-4147-b7a9-48cfddf0b689 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.891267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d21f8687-d469-4147-b7a9-48cfddf0b689 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.891954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d21f8687-d469-4147-b7a9-48cfddf0b689 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:20.197264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d21f8687-d469-4147-b7a9-48cfddf0b689 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:20.205715 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d21f8687-d469-4147-b7a9-48cfddf0b689 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.347656 Aug 29 15:49:20.206177 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2836/5505] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:19 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:20.227227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-987005789", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:20.291001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] validate_networks() for [('e7e1a9e7-4d7f-4958-9bd4-e4039baa5a12', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:49:20.304912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e54c3805-52e5-45b2-b516-94fb9c24aed1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:20.323714 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e54c3805-52e5-45b2-b516-94fb9c24aed1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1367 microversion: 2.1 time: 0.599672 Aug 29 15:49:20.324221 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2670/5506] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:19 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1367 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:20.342593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b7644eb7-4277-445e-a31c-3cbb23b24d68 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:20.343194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b7644eb7-4277-445e-a31c-3cbb23b24d68 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:20.353918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7644eb7-4277-445e-a31c-3cbb23b24d68 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:20.354435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7644eb7-4277-445e-a31c-3cbb23b24d68 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:20.354876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7644eb7-4277-445e-a31c-3cbb23b24d68 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:20.355595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7644eb7-4277-445e-a31c-3cbb23b24d68 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:20.356050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7644eb7-4277-445e-a31c-3cbb23b24d68 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:20.356766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7644eb7-4277-445e-a31c-3cbb23b24d68 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:20.881732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b7644eb7-4277-445e-a31c-3cbb23b24d68 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:20.896701 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b7644eb7-4277-445e-a31c-3cbb23b24d68 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.571346 Aug 29 15:49:20.911711 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2671/5507] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:20 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:20.919580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dc87d2ae-d205-4c84-8438-6477834ed73e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:20.920257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dc87d2ae-d205-4c84-8438-6477834ed73e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:20.930114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc87d2ae-d205-4c84-8438-6477834ed73e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:20.934923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc87d2ae-d205-4c84-8438-6477834ed73e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:20.934923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc87d2ae-d205-4c84-8438-6477834ed73e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:20.934923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc87d2ae-d205-4c84-8438-6477834ed73e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:20.936806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc87d2ae-d205-4c84-8438-6477834ed73e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:20.938601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc87d2ae-d205-4c84-8438-6477834ed73e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.048885 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dc87d2ae-d205-4c84-8438-6477834ed73e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action" status: 202 len: 0 microversion: 2.1 time: 0.133780 Aug 29 15:49:21.051125 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2672/5508] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:20 2022] POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:49:21.063981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dfbd6c4c-2f64-40e4-ad94-9e54985d7002 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:21.066074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dfbd6c4c-2f64-40e4-ad94-9e54985d7002 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:21.088960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dfbd6c4c-2f64-40e4-ad94-9e54985d7002 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.089494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dfbd6c4c-2f64-40e4-ad94-9e54985d7002 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.090129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dfbd6c4c-2f64-40e4-ad94-9e54985d7002 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.090892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dfbd6c4c-2f64-40e4-ad94-9e54985d7002 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.091357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dfbd6c4c-2f64-40e4-ad94-9e54985d7002 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.091792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dfbd6c4c-2f64-40e4-ad94-9e54985d7002 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.227927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:21.229842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:21.231234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:21.233694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:21.234281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:21.250304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.254611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.255459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.257228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.259711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.260883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.331824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:21.355599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for user db3e87dfe49444f886b7a9ac5d22bda1 and project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:21.401848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:49:21.404315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 4793378f-9049-4707-ac3c-b04709a33068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:49:21.517135 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d3ee976c-7b7b-4b4e-8c3a-0e69e3062d2a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.291214 Aug 29 15:49:21.518151 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2837/5509] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:49:21.526184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-d06c50aa-02a8-48ca-9eb4-7af0c714e52d req-28eb7bd9-e8ae-4de5-a5c0-0ac6254754a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0947721-9360-4db5-8636-ac5786d6cbe9", "tag": "9435fc27-8664-47fe-840f-9a73e4495c4f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:21.552276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d06c50aa-02a8-48ca-9eb4-7af0c714e52d req-28eb7bd9-e8ae-4de5-a5c0-0ac6254754a3 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.552779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d06c50aa-02a8-48ca-9eb4-7af0c714e52d req-28eb7bd9-e8ae-4de5-a5c0-0ac6254754a3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.553247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d06c50aa-02a8-48ca-9eb4-7af0c714e52d req-28eb7bd9-e8ae-4de5-a5c0-0ac6254754a3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.577494 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-d06c50aa-02a8-48ca-9eb4-7af0c714e52d req-28eb7bd9-e8ae-4de5-a5c0-0ac6254754a3 service nova] Creating event network-changed:9435fc27-8664-47fe-840f-9a73e4495c4f for instance f0947721-9360-4db5-8636-ac5786d6cbe9 on n-h2-839401-11 Aug 29 15:49:21.585870 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-d06c50aa-02a8-48ca-9eb4-7af0c714e52d req-28eb7bd9-e8ae-4de5-a5c0-0ac6254754a3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066019 Aug 29 15:49:21.587285 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2838/5510] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:21.592165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dfbd6c4c-2f64-40e4-ad94-9e54985d7002 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:21.597290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-056ff0cb-4f82-4d0e-a1ca-c786a319fc7d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:21.598391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-056ff0cb-4f82-4d0e-a1ca-c786a319fc7d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:21.600689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:21.602288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:21.610976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-056ff0cb-4f82-4d0e-a1ca-c786a319fc7d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.612072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-056ff0cb-4f82-4d0e-a1ca-c786a319fc7d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.614005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-056ff0cb-4f82-4d0e-a1ca-c786a319fc7d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.614803 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dfbd6c4c-2f64-40e4-ad94-9e54985d7002 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1510 microversion: 2.1 time: 0.560319 Aug 29 15:49:21.617207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-056ff0cb-4f82-4d0e-a1ca-c786a319fc7d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.629441 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2673/5511] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:21 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1510 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:21.634149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8f33f338-05b8-49e0-aadd-eba8090f9dcd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:21.634541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-056ff0cb-4f82-4d0e-a1ca-c786a319fc7d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.635364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-056ff0cb-4f82-4d0e-a1ca-c786a319fc7d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.636184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8f33f338-05b8-49e0-aadd-eba8090f9dcd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 4793378f-9049-4707-ac3c-b04709a33068] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:21.678607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8f33f338-05b8-49e0-aadd-eba8090f9dcd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 4793378f-9049-4707-ac3c-b04709a33068] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:49:21.860194 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8f33f338-05b8-49e0-aadd-eba8090f9dcd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4793378f-9049-4707-ac3c-b04709a33068" status: 204 len: 0 microversion: 2.1 time: 0.238672 Aug 29 15:49:21.866032 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2674/5512] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:21 2022] DELETE /compute/v2.1/servers/4793378f-9049-4707-ac3c-b04709a33068 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:49:21.878905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-012ca2b5-2019-4d0a-8372-62778abc3828 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:21.900009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-012ca2b5-2019-4d0a-8372-62778abc3828 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 4793378f-9049-4707-ac3c-b04709a33068] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:21.922327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:21.925496 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-012ca2b5-2019-4d0a-8372-62778abc3828 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-012ca2b5-2019-4d0a-8372-62778abc3828 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/4793378f-9049-4707-ac3c-b04709a33068 HTTP/1.1 Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '4793378f-9049-4707-ac3c-b04709a33068'} Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 4793378f-9049-4707-ac3c-b04709a33068 Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:21.939023 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-012ca2b5-2019-4d0a-8372-62778abc3828 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:21.945311 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-012ca2b5-2019-4d0a-8372-62778abc3828 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/4793378f-9049-4707-ac3c-b04709a33068" status: 404 len: 111 microversion: 2.1 time: 0.073748 Aug 29 15:49:21.961204 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2675/5513] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:21 2022] GET /compute/v2.1/servers/4793378f-9049-4707-ac3c-b04709a33068 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:22.013008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1835918272", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "e7e1a9e7-4d7f-4958-9bd4-e4039baa5a12"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:22.105304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] validate_networks() for [('e7e1a9e7-4d7f-4958-9bd4-e4039baa5a12', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:49:22.184276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-056ff0cb-4f82-4d0e-a1ca-c786a319fc7d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:22.199654 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-056ff0cb-4f82-4d0e-a1ca-c786a319fc7d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1367 microversion: 2.1 time: 0.610464 Aug 29 15:49:22.200468 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2839/5514] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:21 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1367 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:22.649307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7bba03aa-f308-4f05-ae66-26f306809ef3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:22.652446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7bba03aa-f308-4f05-ae66-26f306809ef3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:22.672178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bba03aa-f308-4f05-ae66-26f306809ef3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:22.675226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bba03aa-f308-4f05-ae66-26f306809ef3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:22.677480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bba03aa-f308-4f05-ae66-26f306809ef3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:22.679699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bba03aa-f308-4f05-ae66-26f306809ef3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:22.683203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bba03aa-f308-4f05-ae66-26f306809ef3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:22.684306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bba03aa-f308-4f05-ae66-26f306809ef3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.119699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:23.120200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:23.120595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:23.121008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:23.121459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:23.139417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.140223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7bba03aa-f308-4f05-ae66-26f306809ef3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:23.140735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.141352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.142113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.142586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.143024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.153827 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7bba03aa-f308-4f05-ae66-26f306809ef3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1490 microversion: 2.1 time: 0.513476 Aug 29 15:49:23.155215 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2840/5515] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:22 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1490 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:23.178085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:23.188986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for user db3e87dfe49444f886b7a9ac5d22bda1 and project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:23.197245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5bf9b2dd-3798-433c-888a-39a98640c239 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:23.198715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5bf9b2dd-3798-433c-888a-39a98640c239 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:23.217483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bf9b2dd-3798-433c-888a-39a98640c239 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.218845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bf9b2dd-3798-433c-888a-39a98640c239 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.220076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bf9b2dd-3798-433c-888a-39a98640c239 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.220258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:49:23.221166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bf9b2dd-3798-433c-888a-39a98640c239 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.221893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bf9b2dd-3798-433c-888a-39a98640c239 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.222826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bf9b2dd-3798-433c-888a-39a98640c239 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.225160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:49:23.269765 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-5bf9b2dd-3798-433c-888a-39a98640c239 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Cannot 'pause' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state paused Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5bf9b2dd-3798-433c-888a-39a98640c239 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action HTTP/1.1 Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 13 Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: {"pause": {}} Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: exception: Cannot 'pause' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state paused Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b0fd8c4a-7225-496b-a071-6fd8f37dc60a', 'body': {'pause': {}}} Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a in vm_state paused. Cannot pause while the instance is in this state. Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state paused Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:23.272294 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:23.278284 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:23.278284 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:23.278284 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:23.278284 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state paused Aug 29 15:49:23.278284 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:23.278284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5bf9b2dd-3798-433c-888a-39a98640c239 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 409 to user: Cannot 'pause' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state paused {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:23.281323 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5bf9b2dd-3798-433c-888a-39a98640c239 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action" status: 409 len: 143 microversion: 2.1 time: 0.102002 Aug 29 15:49:23.283046 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2841/5516] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:23 2022] POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action => generated 143 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:49:23.292021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6fffc673-4fa5-40d1-b870-4af6cb2838dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:23.295348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6fffc673-4fa5-40d1-b870-4af6cb2838dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:23.313394 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1f1f1320-b066-4f6c-9f0e-a877fb588116 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.304050 Aug 29 15:49:23.319272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fffc673-4fa5-40d1-b870-4af6cb2838dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.320510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fffc673-4fa5-40d1-b870-4af6cb2838dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.320646 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2676/5517] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:49:23.323701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fffc673-4fa5-40d1-b870-4af6cb2838dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.324709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fffc673-4fa5-40d1-b870-4af6cb2838dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.325381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fffc673-4fa5-40d1-b870-4af6cb2838dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.325539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b52af369-72e4-402a-9349-94eaf84c8532 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:23.326006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b52af369-72e4-402a-9349-94eaf84c8532 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:23.326366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fffc673-4fa5-40d1-b870-4af6cb2838dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.332845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b52af369-72e4-402a-9349-94eaf84c8532 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.333692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b52af369-72e4-402a-9349-94eaf84c8532 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.334294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b52af369-72e4-402a-9349-94eaf84c8532 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.335168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b52af369-72e4-402a-9349-94eaf84c8532 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.349011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b52af369-72e4-402a-9349-94eaf84c8532 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.349835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b52af369-72e4-402a-9349-94eaf84c8532 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.450918 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b52af369-72e4-402a-9349-94eaf84c8532 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action" status: 202 len: 0 microversion: 2.1 time: 0.128963 Aug 29 15:49:23.455513 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2677/5518] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:23 2022] POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:49:23.461464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-402eaf6a-c203-4be8-9f6d-0037344dbce3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:23.462181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-402eaf6a-c203-4be8-9f6d-0037344dbce3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:23.550515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-402eaf6a-c203-4be8-9f6d-0037344dbce3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:23.568069 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-402eaf6a-c203-4be8-9f6d-0037344dbce3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1221 microversion: 2.1 time: 0.111179 Aug 29 15:49:23.583994 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2678/5519] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:23 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1221 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:23.591864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4dc63999-da93-4b23-82a1-9cf7315efc82 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:23.592828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4dc63999-da93-4b23-82a1-9cf7315efc82 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:23.600644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dc63999-da93-4b23-82a1-9cf7315efc82 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.602732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dc63999-da93-4b23-82a1-9cf7315efc82 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.603546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dc63999-da93-4b23-82a1-9cf7315efc82 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.604493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dc63999-da93-4b23-82a1-9cf7315efc82 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.605182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dc63999-da93-4b23-82a1-9cf7315efc82 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.605787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dc63999-da93-4b23-82a1-9cf7315efc82 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.878660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4dc63999-da93-4b23-82a1-9cf7315efc82 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:23.894744 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4dc63999-da93-4b23-82a1-9cf7315efc82 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1497 microversion: 2.1 time: 0.307200 Aug 29 15:49:23.896664 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2679/5520] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:23 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1497 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:24.331517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6fffc673-4fa5-40d1-b870-4af6cb2838dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:24.345917 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6fffc673-4fa5-40d1-b870-4af6cb2838dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1367 microversion: 2.1 time: 1.061189 Aug 29 15:49:24.347180 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2842/5521] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:23 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1367 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:24.592667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c28f46f-6728-4d4c-92a3-d49ee87c45b5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:24.593309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6c28f46f-6728-4d4c-92a3-d49ee87c45b5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:24.600566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c28f46f-6728-4d4c-92a3-d49ee87c45b5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.601357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c28f46f-6728-4d4c-92a3-d49ee87c45b5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.601978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c28f46f-6728-4d4c-92a3-d49ee87c45b5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.602855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c28f46f-6728-4d4c-92a3-d49ee87c45b5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.603707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c28f46f-6728-4d4c-92a3-d49ee87c45b5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.604303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c28f46f-6728-4d4c-92a3-d49ee87c45b5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.713787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6c28f46f-6728-4d4c-92a3-d49ee87c45b5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:24.729587 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6c28f46f-6728-4d4c-92a3-d49ee87c45b5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1273 microversion: 2.1 time: 0.140918 Aug 29 15:49:24.730707 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2680/5522] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:24 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1273 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:24.921256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a5ccb419-c79b-4011-ba64-d8ab41709567 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:24.922327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a5ccb419-c79b-4011-ba64-d8ab41709567 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:24.942146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5ccb419-c79b-4011-ba64-d8ab41709567 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.943318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5ccb419-c79b-4011-ba64-d8ab41709567 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.944107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5ccb419-c79b-4011-ba64-d8ab41709567 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.945068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5ccb419-c79b-4011-ba64-d8ab41709567 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.945786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5ccb419-c79b-4011-ba64-d8ab41709567 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.946596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5ccb419-c79b-4011-ba64-d8ab41709567 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:25.285004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-535453404", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a56719a-8d81-464a-905c-2cbd572b7318"}], "security_groups": [{"name": "tempest-securitygroup--1758063351"}], "key_name": "tempest-keypair-300282973", "user_data": "}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:25.315094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a5ccb419-c79b-4011-ba64-d8ab41709567 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:25.324181 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a5ccb419-c79b-4011-ba64-d8ab41709567 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.407519 Aug 29 15:49:25.325164 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2843/5523] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:24 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:25.350467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f58eab26-3b35-416a-9dc0-1e4513aacfb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:25.354459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f58eab26-3b35-416a-9dc0-1e4513aacfb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:25.361827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f58eab26-3b35-416a-9dc0-1e4513aacfb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:25.362974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f58eab26-3b35-416a-9dc0-1e4513aacfb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:25.363799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f58eab26-3b35-416a-9dc0-1e4513aacfb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:25.364802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f58eab26-3b35-416a-9dc0-1e4513aacfb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:25.365607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f58eab26-3b35-416a-9dc0-1e4513aacfb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:25.366428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f58eab26-3b35-416a-9dc0-1e4513aacfb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:25.635753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f58eab26-3b35-416a-9dc0-1e4513aacfb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:25.644669 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f58eab26-3b35-416a-9dc0-1e4513aacfb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.298885 Aug 29 15:49:25.645306 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2844/5524] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:25 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:25.651637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3258a9c1-fdca-4ced-8b17-706299ef186c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:25.652600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3258a9c1-fdca-4ced-8b17-706299ef186c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:25.661310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3258a9c1-fdca-4ced-8b17-706299ef186c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:25.662072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3258a9c1-fdca-4ced-8b17-706299ef186c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:25.662671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3258a9c1-fdca-4ced-8b17-706299ef186c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:25.663401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3258a9c1-fdca-4ced-8b17-706299ef186c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:25.663885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3258a9c1-fdca-4ced-8b17-706299ef186c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:25.664318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3258a9c1-fdca-4ced-8b17-706299ef186c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:25.937887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] validate_networks() for [('4a56719a-8d81-464a-905c-2cbd572b7318', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:49:25.986999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3258a9c1-fdca-4ced-8b17-706299ef186c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:25.998127 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3258a9c1-fdca-4ced-8b17-706299ef186c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1367 microversion: 2.1 time: 0.351238 Aug 29 15:49:25.999294 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2845/5525] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:25 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:26.006306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-19dfc6cc-e746-4e9f-bf13-2df469846579 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:26.008711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-19dfc6cc-e746-4e9f-bf13-2df469846579 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:26.017529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19dfc6cc-e746-4e9f-bf13-2df469846579 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.018032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19dfc6cc-e746-4e9f-bf13-2df469846579 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.018516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19dfc6cc-e746-4e9f-bf13-2df469846579 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.019769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19dfc6cc-e746-4e9f-bf13-2df469846579 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.020427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19dfc6cc-e746-4e9f-bf13-2df469846579 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.021045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19dfc6cc-e746-4e9f-bf13-2df469846579 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.041770 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-19dfc6cc-e746-4e9f-bf13-2df469846579 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-19dfc6cc-e746-4e9f-bf13-2df469846579 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845/action HTTP/1.1 Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 28 Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: {"reboot": {"type": "SOFT"}} Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'bf3c27d9-2596-4f58-80ab-0df600408845', 'body': {'reboot': {'type': 'SOFT'}}} Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:26.043890 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:26.055937 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:49:26.055937 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:26.055937 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:26.055937 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:26.055937 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:26.055937 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:26.055937 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:26.055937 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:26.055937 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:26.055937 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:49:26.055937 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:26.055937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-19dfc6cc-e746-4e9f-bf13-2df469846579 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:26.055937 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-19dfc6cc-e746-4e9f-bf13-2df469846579 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845/action" status: 404 len: 111 microversion: 2.1 time: 0.045140 Aug 29 15:49:26.055937 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2846/5526] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:25 2022] POST /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:26.055937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4638ae98-d780-4b3e-b75d-86a9dbe022f2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:26.057035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4638ae98-d780-4b3e-b75d-86a9dbe022f2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:26.062925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4638ae98-d780-4b3e-b75d-86a9dbe022f2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.063438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4638ae98-d780-4b3e-b75d-86a9dbe022f2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.063879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4638ae98-d780-4b3e-b75d-86a9dbe022f2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.064660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4638ae98-d780-4b3e-b75d-86a9dbe022f2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.066562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4638ae98-d780-4b3e-b75d-86a9dbe022f2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.067341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4638ae98-d780-4b3e-b75d-86a9dbe022f2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.194257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4638ae98-d780-4b3e-b75d-86a9dbe022f2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:26.205030 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4638ae98-d780-4b3e-b75d-86a9dbe022f2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1279 microversion: 2.1 time: 0.155152 Aug 29 15:49:26.206119 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2847/5527] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:26 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:26.224237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-da8471dc-048a-4b47-adb0-eff6b1555ce9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:26.225275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-da8471dc-048a-4b47-adb0-eff6b1555ce9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:26.231923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da8471dc-048a-4b47-adb0-eff6b1555ce9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.233269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da8471dc-048a-4b47-adb0-eff6b1555ce9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.233928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da8471dc-048a-4b47-adb0-eff6b1555ce9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.235018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da8471dc-048a-4b47-adb0-eff6b1555ce9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.235589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da8471dc-048a-4b47-adb0-eff6b1555ce9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.236116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da8471dc-048a-4b47-adb0-eff6b1555ce9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.546380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-da8471dc-048a-4b47-adb0-eff6b1555ce9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:26.554628 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-da8471dc-048a-4b47-adb0-eff6b1555ce9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.346974 Aug 29 15:49:26.565595 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2848/5528] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:26 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:26.591592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec3f0f9a-0bd7-49ec-8d82-2065f164ecd8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:26.593909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ec3f0f9a-0bd7-49ec-8d82-2065f164ecd8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:26.605743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec3f0f9a-0bd7-49ec-8d82-2065f164ecd8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.606502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec3f0f9a-0bd7-49ec-8d82-2065f164ecd8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.607102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec3f0f9a-0bd7-49ec-8d82-2065f164ecd8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.607990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec3f0f9a-0bd7-49ec-8d82-2065f164ecd8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.608605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec3f0f9a-0bd7-49ec-8d82-2065f164ecd8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.609218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec3f0f9a-0bd7-49ec-8d82-2065f164ecd8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.957811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ec3f0f9a-0bd7-49ec-8d82-2065f164ecd8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:26.970098 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ec3f0f9a-0bd7-49ec-8d82-2065f164ecd8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.383735 Aug 29 15:49:26.984664 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2849/5529] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:26 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:26.995964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-620b8166-d032-469a-a117-56f225645c44 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:26.998407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-620b8166-d032-469a-a117-56f225645c44 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: ef22d643-03f4-4c2a-933f-86ef3f1e7dd7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:27.004563 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-620b8166-d032-469a-a117-56f225645c44 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance ef22d643-03f4-4c2a-933f-86ef3f1e7dd7 could not be found. Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-620b8166-d032-469a-a117-56f225645c44 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/ef22d643-03f4-4c2a-933f-86ef3f1e7dd7/action HTTP/1.1 Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 28 Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: {"reboot": {"type": "SOFT"}} Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance ef22d643-03f4-4c2a-933f-86ef3f1e7dd7 could not be found. Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'ef22d643-03f4-4c2a-933f-86ef3f1e7dd7', 'body': {'reboot': {'type': 'SOFT'}}} Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef22d643-03f4-4c2a-933f-86ef3f1e7dd7 could not be found. Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef22d643-03f4-4c2a-933f-86ef3f1e7dd7 could not be found. Aug 29 15:49:27.007226 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:27.014063 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:27.014063 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:27.014063 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:27.014063 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:27.014063 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:27.014063 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:27.014063 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:27.014063 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef22d643-03f4-4c2a-933f-86ef3f1e7dd7 could not be found. Aug 29 15:49:27.014063 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:27.016860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-620b8166-d032-469a-a117-56f225645c44 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance ef22d643-03f4-4c2a-933f-86ef3f1e7dd7 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:27.017937 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-620b8166-d032-469a-a117-56f225645c44 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/ef22d643-03f4-4c2a-933f-86ef3f1e7dd7/action" status: 404 len: 111 microversion: 2.1 time: 0.027003 Aug 29 15:49:27.018700 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2850/5530] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:26 2022] POST /compute/v2.1/servers/ef22d643-03f4-4c2a-933f-86ef3f1e7dd7/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:49:27.025884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-56d4e888-2bb4-4615-809b-f5e49563cb00 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:27.027216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-56d4e888-2bb4-4615-809b-f5e49563cb00 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:27.036164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56d4e888-2bb4-4615-809b-f5e49563cb00 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.036759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56d4e888-2bb4-4615-809b-f5e49563cb00 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.037326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56d4e888-2bb4-4615-809b-f5e49563cb00 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.038145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56d4e888-2bb4-4615-809b-f5e49563cb00 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.038841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56d4e888-2bb4-4615-809b-f5e49563cb00 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.039280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56d4e888-2bb4-4615-809b-f5e49563cb00 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.061269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:27.315024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-56d4e888-2bb4-4615-809b-f5e49563cb00 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:27.327941 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-56d4e888-2bb4-4615-809b-f5e49563cb00 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1367 microversion: 2.1 time: 0.307216 Aug 29 15:49:27.329342 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2851/5531] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:27 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:27.345017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0b5dbb85-6652-4c5a-a248-7917c84b8357 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:27.346695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0b5dbb85-6652-4c5a-a248-7917c84b8357 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:27.357790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b5dbb85-6652-4c5a-a248-7917c84b8357 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.359496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b5dbb85-6652-4c5a-a248-7917c84b8357 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.360305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b5dbb85-6652-4c5a-a248-7917c84b8357 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.362805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b5dbb85-6652-4c5a-a248-7917c84b8357 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.363825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b5dbb85-6652-4c5a-a248-7917c84b8357 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.365667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b5dbb85-6652-4c5a-a248-7917c84b8357 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.417977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:27.419659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:27.420331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:27.420924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:27.421540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:27.440936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=23 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:27.464340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.464964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.465427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.467270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.467744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.468259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.498884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Getting quotas for project bb5330327389417995f14947be334a04. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:27.506769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Getting quotas for user e75a8c66c5304e608e2f3120c1192534 and project bb5330327389417995f14947be334a04. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:27.526364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:49:27.530516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:49:27.617430 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7fcb71d1-a925-437b-b9eb-1dc568758496 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.336996 Aug 29 15:49:27.619024 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2681/5532] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:25 2022] POST /compute/v2.1/servers => generated 409 bytes in 2340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:49:27.628253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d699b9f2-a314-48ae-bf05-509ba8e46fa3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:27.629308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d699b9f2-a314-48ae-bf05-509ba8e46fa3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:27.641066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d699b9f2-a314-48ae-bf05-509ba8e46fa3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.641872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d699b9f2-a314-48ae-bf05-509ba8e46fa3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.642556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d699b9f2-a314-48ae-bf05-509ba8e46fa3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.644660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d699b9f2-a314-48ae-bf05-509ba8e46fa3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.645897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d699b9f2-a314-48ae-bf05-509ba8e46fa3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.647087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d699b9f2-a314-48ae-bf05-509ba8e46fa3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.673506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0b5dbb85-6652-4c5a-a248-7917c84b8357 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:27.687017 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0b5dbb85-6652-4c5a-a248-7917c84b8357 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.355394 Aug 29 15:49:27.688063 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2852/5533] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:27 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:27.697488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2f3dfaf9-2dd1-4315-a65b-0ef25c9818d4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:27.699068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2f3dfaf9-2dd1-4315-a65b-0ef25c9818d4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:27.786809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2f3dfaf9-2dd1-4315-a65b-0ef25c9818d4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:27.815248 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2f3dfaf9-2dd1-4315-a65b-0ef25c9818d4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1244 microversion: 2.1 time: 0.122484 Aug 29 15:49:27.832876 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2853/5534] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:27 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1244 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:27.838519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-446ccc4b-6758-4d4c-977f-53e0a3028e02 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:27.847491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-446ccc4b-6758-4d4c-977f-53e0a3028e02 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:27.868360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-446ccc4b-6758-4d4c-977f-53e0a3028e02 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.868872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-446ccc4b-6758-4d4c-977f-53e0a3028e02 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.869335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-446ccc4b-6758-4d4c-977f-53e0a3028e02 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.870049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-446ccc4b-6758-4d4c-977f-53e0a3028e02 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.870512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-446ccc4b-6758-4d4c-977f-53e0a3028e02 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.870940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-446ccc4b-6758-4d4c-977f-53e0a3028e02 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.192539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-446ccc4b-6758-4d4c-977f-53e0a3028e02 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:28.208915 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-446ccc4b-6758-4d4c-977f-53e0a3028e02 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.373804 Aug 29 15:49:28.209839 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2854/5535] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:27 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:28.233052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c52324d5-a64d-42ba-983d-c3c41c0902a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:28.236927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c52324d5-a64d-42ba-983d-c3c41c0902a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:28.244534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c52324d5-a64d-42ba-983d-c3c41c0902a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.245346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c52324d5-a64d-42ba-983d-c3c41c0902a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.246249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c52324d5-a64d-42ba-983d-c3c41c0902a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.247401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c52324d5-a64d-42ba-983d-c3c41c0902a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.248140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c52324d5-a64d-42ba-983d-c3c41c0902a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.249142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c52324d5-a64d-42ba-983d-c3c41c0902a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.256274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d699b9f2-a314-48ae-bf05-509ba8e46fa3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:28.268720 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-c52324d5-a64d-42ba-983d-c3c41c0902a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c52324d5-a64d-42ba-983d-c3c41c0902a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845/action HTTP/1.1 Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 65 Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: {"rebuild": {"imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c"}} Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'bf3c27d9-2596-4f58-80ab-0df600408845', 'body': {'rebuild': {'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c'}}} Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 29 15:49:28.271077 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 29 15:49:28.276162 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:49:28.276162 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:28.276162 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:28.276162 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:28.276162 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:28.276162 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:49:28.276162 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:28.276162 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:28.276162 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:28.276162 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:28.276162 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:28.276162 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:28.276162 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:28.276162 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:28.276162 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:49:28.276162 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:28.278961 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d699b9f2-a314-48ae-bf05-509ba8e46fa3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1321 microversion: 2.1 time: 0.655525 Aug 29 15:49:28.278961 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2682/5536] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:27 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1321 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:28.280287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c52324d5-a64d-42ba-983d-c3c41c0902a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:28.281489 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c52324d5-a64d-42ba-983d-c3c41c0902a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845/action" status: 404 len: 111 microversion: 2.1 time: 0.055055 Aug 29 15:49:28.282354 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2855/5537] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:28 2022] POST /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:49:28.294170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4e0c4718-4b8e-4188-a47b-dffe49e9dac2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:28.294825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4e0c4718-4b8e-4188-a47b-dffe49e9dac2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:28.304690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e0c4718-4b8e-4188-a47b-dffe49e9dac2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.305593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e0c4718-4b8e-4188-a47b-dffe49e9dac2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.306466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e0c4718-4b8e-4188-a47b-dffe49e9dac2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.307909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e0c4718-4b8e-4188-a47b-dffe49e9dac2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.308720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e0c4718-4b8e-4188-a47b-dffe49e9dac2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.309686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e0c4718-4b8e-4188-a47b-dffe49e9dac2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.349672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6af50539-5754-4c53-8377-f2bab02df67c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:28.350791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6af50539-5754-4c53-8377-f2bab02df67c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:28.359938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6af50539-5754-4c53-8377-f2bab02df67c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.360680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6af50539-5754-4c53-8377-f2bab02df67c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.361326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6af50539-5754-4c53-8377-f2bab02df67c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.362299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6af50539-5754-4c53-8377-f2bab02df67c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.362958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6af50539-5754-4c53-8377-f2bab02df67c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.363394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6af50539-5754-4c53-8377-f2bab02df67c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.523036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6af50539-5754-4c53-8377-f2bab02df67c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:28.531305 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6af50539-5754-4c53-8377-f2bab02df67c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1367 microversion: 2.1 time: 0.186811 Aug 29 15:49:28.531985 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2856/5538] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:28 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:28.841870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4e0c4718-4b8e-4188-a47b-dffe49e9dac2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:28.842631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4a3b5830-bbe4-49ed-b850-f2a75f32ab08 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:28.843275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4a3b5830-bbe4-49ed-b850-f2a75f32ab08 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:28.852299 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4e0c4718-4b8e-4188-a47b-dffe49e9dac2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.562328 Aug 29 15:49:28.855460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a3b5830-bbe4-49ed-b850-f2a75f32ab08 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.869118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a3b5830-bbe4-49ed-b850-f2a75f32ab08 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.869518 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2683/5539] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:28 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:28.870861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a3b5830-bbe4-49ed-b850-f2a75f32ab08 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.875279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a3b5830-bbe4-49ed-b850-f2a75f32ab08 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.876195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a3b5830-bbe4-49ed-b850-f2a75f32ab08 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.876791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a3b5830-bbe4-49ed-b850-f2a75f32ab08 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.879377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0677f4a5-44c8-4a32-b4da-750a9cb9b8a0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:28.880009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0677f4a5-44c8-4a32-b4da-750a9cb9b8a0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:28.893021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0677f4a5-44c8-4a32-b4da-750a9cb9b8a0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.893570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0677f4a5-44c8-4a32-b4da-750a9cb9b8a0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.894004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0677f4a5-44c8-4a32-b4da-750a9cb9b8a0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.894722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0677f4a5-44c8-4a32-b4da-750a9cb9b8a0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.895159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0677f4a5-44c8-4a32-b4da-750a9cb9b8a0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.895585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0677f4a5-44c8-4a32-b4da-750a9cb9b8a0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.991313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4a3b5830-bbe4-49ed-b850-f2a75f32ab08 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:29.000934 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4a3b5830-bbe4-49ed-b850-f2a75f32ab08 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1296 microversion: 2.1 time: 0.165119 Aug 29 15:49:29.010452 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2857/5540] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:28 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1296 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:29.017275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-136a58c2-396a-4bf1-9243-f459d6ef3dcd req-bcd2d0a9-f70a-46c9-bae9-801412584bee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0947721-9360-4db5-8636-ac5786d6cbe9", "name": "network-vif-plugged", "status": "completed", "tag": "9435fc27-8664-47fe-840f-9a73e4495c4f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:29.032904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-136a58c2-396a-4bf1-9243-f459d6ef3dcd req-bcd2d0a9-f70a-46c9-bae9-801412584bee service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.033701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-136a58c2-396a-4bf1-9243-f459d6ef3dcd req-bcd2d0a9-f70a-46c9-bae9-801412584bee service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.035119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-136a58c2-396a-4bf1-9243-f459d6ef3dcd req-bcd2d0a9-f70a-46c9-bae9-801412584bee service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.050720 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-136a58c2-396a-4bf1-9243-f459d6ef3dcd req-bcd2d0a9-f70a-46c9-bae9-801412584bee service nova] Creating event network-vif-plugged:9435fc27-8664-47fe-840f-9a73e4495c4f for instance f0947721-9360-4db5-8636-ac5786d6cbe9 on n-h2-839401-11 Aug 29 15:49:29.056340 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-136a58c2-396a-4bf1-9243-f459d6ef3dcd req-bcd2d0a9-f70a-46c9-bae9-801412584bee service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044168 Aug 29 15:49:29.057319 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2858/5541] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:29.298381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b8f7c7e-7b20-47ca-a755-691d2b68e75e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:29.299575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8b8f7c7e-7b20-47ca-a755-691d2b68e75e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:29.305892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b8f7c7e-7b20-47ca-a755-691d2b68e75e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.306380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b8f7c7e-7b20-47ca-a755-691d2b68e75e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.306807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b8f7c7e-7b20-47ca-a755-691d2b68e75e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.307525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b8f7c7e-7b20-47ca-a755-691d2b68e75e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.307975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b8f7c7e-7b20-47ca-a755-691d2b68e75e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.308403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b8f7c7e-7b20-47ca-a755-691d2b68e75e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.523965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8b8f7c7e-7b20-47ca-a755-691d2b68e75e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:29.534359 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8b8f7c7e-7b20-47ca-a755-691d2b68e75e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1321 microversion: 2.1 time: 0.240709 Aug 29 15:49:29.535568 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2859/5542] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:29 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:29.554071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-45d19507-d9d9-4f4f-88b2-3be7723d0f66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:29.554980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-45d19507-d9d9-4f4f-88b2-3be7723d0f66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:29.561887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45d19507-d9d9-4f4f-88b2-3be7723d0f66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.573627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45d19507-d9d9-4f4f-88b2-3be7723d0f66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.574351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45d19507-d9d9-4f4f-88b2-3be7723d0f66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.575213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45d19507-d9d9-4f4f-88b2-3be7723d0f66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.576117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45d19507-d9d9-4f4f-88b2-3be7723d0f66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.576823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45d19507-d9d9-4f4f-88b2-3be7723d0f66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.793812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0677f4a5-44c8-4a32-b4da-750a9cb9b8a0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:29.809450 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0677f4a5-44c8-4a32-b4da-750a9cb9b8a0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.933883 Aug 29 15:49:29.826719 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2684/5543] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:28 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:29.836959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-22567a8a-3c57-42da-8247-a4fafb95b3aa tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:29.844823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-22567a8a-3c57-42da-8247-a4fafb95b3aa tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: 3f5da509-63bb-4ab3-971c-71d1bebcf55c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:29.869898 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-22567a8a-3c57-42da-8247-a4fafb95b3aa tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance 3f5da509-63bb-4ab3-971c-71d1bebcf55c could not be found. Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-22567a8a-3c57-42da-8247-a4fafb95b3aa tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/3f5da509-63bb-4ab3-971c-71d1bebcf55c/action HTTP/1.1 Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 65 Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: {"rebuild": {"imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c"}} Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 3f5da509-63bb-4ab3-971c-71d1bebcf55c could not be found. Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '3f5da509-63bb-4ab3-971c-71d1bebcf55c', 'body': {'rebuild': {'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c'}}} Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f5da509-63bb-4ab3-971c-71d1bebcf55c could not be found. Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:49:29.871796 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f5da509-63bb-4ab3-971c-71d1bebcf55c could not be found. Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f5da509-63bb-4ab3-971c-71d1bebcf55c could not be found. Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-22567a8a-3c57-42da-8247-a4fafb95b3aa tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance 3f5da509-63bb-4ab3-971c-71d1bebcf55c could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-22567a8a-3c57-42da-8247-a4fafb95b3aa tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/3f5da509-63bb-4ab3-971c-71d1bebcf55c/action" status: 404 len: 111 microversion: 2.1 time: 0.040857 Aug 29 15:49:29.876726 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2685/5544] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:29 2022] POST /compute/v2.1/servers/3f5da509-63bb-4ab3-971c-71d1bebcf55c/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:29.882013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ce4b9c2e-487b-4409-8ecf-be2978abf02f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:29.882625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ce4b9c2e-487b-4409-8ecf-be2978abf02f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:29.903540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce4b9c2e-487b-4409-8ecf-be2978abf02f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.904482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce4b9c2e-487b-4409-8ecf-be2978abf02f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.904928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce4b9c2e-487b-4409-8ecf-be2978abf02f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.905691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce4b9c2e-487b-4409-8ecf-be2978abf02f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.917860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce4b9c2e-487b-4409-8ecf-be2978abf02f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.918323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce4b9c2e-487b-4409-8ecf-be2978abf02f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.930919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-45d19507-d9d9-4f4f-88b2-3be7723d0f66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:29.940514 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-45d19507-d9d9-4f4f-88b2-3be7723d0f66 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1367 microversion: 2.1 time: 0.392045 Aug 29 15:49:29.961938 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2860/5545] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:29 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1367 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:30.024536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a35b6620-8e44-49f4-b89e-a31d8eefef78 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:30.025454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a35b6620-8e44-49f4-b89e-a31d8eefef78 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:30.042905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a35b6620-8e44-49f4-b89e-a31d8eefef78 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.044313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a35b6620-8e44-49f4-b89e-a31d8eefef78 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.045800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a35b6620-8e44-49f4-b89e-a31d8eefef78 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.047523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a35b6620-8e44-49f4-b89e-a31d8eefef78 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.049754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a35b6620-8e44-49f4-b89e-a31d8eefef78 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.054373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a35b6620-8e44-49f4-b89e-a31d8eefef78 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.322544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ce4b9c2e-487b-4409-8ecf-be2978abf02f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:30.332616 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ce4b9c2e-487b-4409-8ecf-be2978abf02f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.453799 Aug 29 15:49:30.333563 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2686/5546] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:29 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:30.354172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bccc4c83-adfb-45ca-a866-18185964d7bc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:30.355515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bccc4c83-adfb-45ca-a866-18185964d7bc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:30.362256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bccc4c83-adfb-45ca-a866-18185964d7bc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.363017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bccc4c83-adfb-45ca-a866-18185964d7bc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.363529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bccc4c83-adfb-45ca-a866-18185964d7bc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.364224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bccc4c83-adfb-45ca-a866-18185964d7bc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.364687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bccc4c83-adfb-45ca-a866-18185964d7bc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.365299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bccc4c83-adfb-45ca-a866-18185964d7bc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.566132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a35b6620-8e44-49f4-b89e-a31d8eefef78 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:30.577632 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a35b6620-8e44-49f4-b89e-a31d8eefef78 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1302 microversion: 2.1 time: 0.557762 Aug 29 15:49:30.595334 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2861/5547] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:30 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1302 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:30.606905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9ea1cb77-34de-4079-9979-1c04821a33f0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:30.608263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9ea1cb77-34de-4079-9979-1c04821a33f0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:30.620395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ea1cb77-34de-4079-9979-1c04821a33f0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.621348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ea1cb77-34de-4079-9979-1c04821a33f0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.622098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ea1cb77-34de-4079-9979-1c04821a33f0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.623078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ea1cb77-34de-4079-9979-1c04821a33f0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.623767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ea1cb77-34de-4079-9979-1c04821a33f0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.624495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ea1cb77-34de-4079-9979-1c04821a33f0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.802464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bccc4c83-adfb-45ca-a866-18185964d7bc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:30.812352 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bccc4c83-adfb-45ca-a866-18185964d7bc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.461979 Aug 29 15:49:30.813273 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2687/5548] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:30 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:30.823940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-9655c4ec-8d8e-4acc-b27a-40b6c9ee2b46 req-b321cf5e-0466-4755-9f32-45a11dd7c127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89", "tag": "aab790f6-3f55-467e-a0cc-226b8fb3604f"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:30.838807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9655c4ec-8d8e-4acc-b27a-40b6c9ee2b46 req-b321cf5e-0466-4755-9f32-45a11dd7c127 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.839842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9655c4ec-8d8e-4acc-b27a-40b6c9ee2b46 req-b321cf5e-0466-4755-9f32-45a11dd7c127 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.840565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9655c4ec-8d8e-4acc-b27a-40b6c9ee2b46 req-b321cf5e-0466-4755-9f32-45a11dd7c127 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.857276 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-9655c4ec-8d8e-4acc-b27a-40b6c9ee2b46 req-b321cf5e-0466-4755-9f32-45a11dd7c127 service nova] Creating event network-changed:aab790f6-3f55-467e-a0cc-226b8fb3604f for instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 on n-h1-839401-11 Aug 29 15:49:30.863915 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-9655c4ec-8d8e-4acc-b27a-40b6c9ee2b46 req-b321cf5e-0466-4755-9f32-45a11dd7c127 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048838 Aug 29 15:49:30.865146 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2688/5549] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:30.870796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-edb27705-9bd8-4a09-b19e-de90918fcdc0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:30.871496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-edb27705-9bd8-4a09-b19e-de90918fcdc0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: a93a7fdb-1a58-4f09-8363-36d34aa5f86c] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:30.874411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9ea1cb77-34de-4079-9979-1c04821a33f0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:30.874579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:30.885216 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-edb27705-9bd8-4a09-b19e-de90918fcdc0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance a93a7fdb-1a58-4f09-8363-36d34aa5f86c could not be found. Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-edb27705-9bd8-4a09-b19e-de90918fcdc0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/a93a7fdb-1a58-4f09-8363-36d34aa5f86c/action HTTP/1.1 Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 15 Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: {"restore": {}} Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance a93a7fdb-1a58-4f09-8363-36d34aa5f86c could not be found. Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'a93a7fdb-1a58-4f09-8363-36d34aa5f86c', 'body': {'restore': {}}} Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a93a7fdb-1a58-4f09-8363-36d34aa5f86c could not be found. Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a93a7fdb-1a58-4f09-8363-36d34aa5f86c could not be found. Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:30.887945 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:30.893182 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:30.893182 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:30.893182 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a93a7fdb-1a58-4f09-8363-36d34aa5f86c could not be found. Aug 29 15:49:30.893182 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:30.895424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-edb27705-9bd8-4a09-b19e-de90918fcdc0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance a93a7fdb-1a58-4f09-8363-36d34aa5f86c could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:30.897015 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-edb27705-9bd8-4a09-b19e-de90918fcdc0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/a93a7fdb-1a58-4f09-8363-36d34aa5f86c/action" status: 404 len: 111 microversion: 2.1 time: 0.030338 Aug 29 15:49:30.898126 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2689/5550] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:30 2022] POST /compute/v2.1/servers/a93a7fdb-1a58-4f09-8363-36d34aa5f86c/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:30.907090 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9ea1cb77-34de-4079-9979-1c04821a33f0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1321 microversion: 2.1 time: 0.309090 Aug 29 15:49:30.909952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b94f7ef0-644d-44c9-90c8-b7f7f10626ef tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:30.923966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b94f7ef0-644d-44c9-90c8-b7f7f10626ef tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:30.925720 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2862/5551] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:30 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:30.942439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b94f7ef0-644d-44c9-90c8-b7f7f10626ef tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.943098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b94f7ef0-644d-44c9-90c8-b7f7f10626ef tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.943434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b94f7ef0-644d-44c9-90c8-b7f7f10626ef tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.944164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b94f7ef0-644d-44c9-90c8-b7f7f10626ef tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.944619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b94f7ef0-644d-44c9-90c8-b7f7f10626ef tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.945288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b94f7ef0-644d-44c9-90c8-b7f7f10626ef tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.970588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6a671d90-f88b-45e6-aae8-0b6edcaf6c3a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:30.971121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6a671d90-f88b-45e6-aae8-0b6edcaf6c3a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:30.979170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a671d90-f88b-45e6-aae8-0b6edcaf6c3a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.979826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a671d90-f88b-45e6-aae8-0b6edcaf6c3a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.980279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a671d90-f88b-45e6-aae8-0b6edcaf6c3a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.981237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a671d90-f88b-45e6-aae8-0b6edcaf6c3a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.981861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a671d90-f88b-45e6-aae8-0b6edcaf6c3a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.982304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a671d90-f88b-45e6-aae8-0b6edcaf6c3a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.216793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6a671d90-f88b-45e6-aae8-0b6edcaf6c3a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:31.228401 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6a671d90-f88b-45e6-aae8-0b6edcaf6c3a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1367 microversion: 2.1 time: 0.263056 Aug 29 15:49:31.242815 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2863/5552] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:30 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:31.294329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b94f7ef0-644d-44c9-90c8-b7f7f10626ef tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:31.305874 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b94f7ef0-644d-44c9-90c8-b7f7f10626ef tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.403282 Aug 29 15:49:31.306757 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2690/5553] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:30 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:31.332943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eccea074-972e-4e89-9523-afb131dc5429 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:31.333728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eccea074-972e-4e89-9523-afb131dc5429 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:31.337944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:31.355823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eccea074-972e-4e89-9523-afb131dc5429 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.365958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eccea074-972e-4e89-9523-afb131dc5429 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.368505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eccea074-972e-4e89-9523-afb131dc5429 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.370476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eccea074-972e-4e89-9523-afb131dc5429 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.374506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eccea074-972e-4e89-9523-afb131dc5429 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.375493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eccea074-972e-4e89-9523-afb131dc5429 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.600161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-545c5800-6e20-40e4-94e7-4caaf70bc73b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:31.601291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-545c5800-6e20-40e4-94e7-4caaf70bc73b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:31.608584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-545c5800-6e20-40e4-94e7-4caaf70bc73b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.609373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-545c5800-6e20-40e4-94e7-4caaf70bc73b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.610142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-545c5800-6e20-40e4-94e7-4caaf70bc73b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.611076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-545c5800-6e20-40e4-94e7-4caaf70bc73b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.611765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-545c5800-6e20-40e4-94e7-4caaf70bc73b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.612457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-545c5800-6e20-40e4-94e7-4caaf70bc73b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.717920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eccea074-972e-4e89-9523-afb131dc5429 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:31.733334 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eccea074-972e-4e89-9523-afb131dc5429 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.409115 Aug 29 15:49:31.739276 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2864/5554] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:31 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:31.758065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9b0cbfa3-9c3a-4fb2-9836-3cdbc8678ea1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:31.758877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9b0cbfa3-9c3a-4fb2-9836-3cdbc8678ea1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:31.767420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b0cbfa3-9c3a-4fb2-9836-3cdbc8678ea1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.770036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b0cbfa3-9c3a-4fb2-9836-3cdbc8678ea1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.770790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b0cbfa3-9c3a-4fb2-9836-3cdbc8678ea1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.771787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b0cbfa3-9c3a-4fb2-9836-3cdbc8678ea1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.772324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b0cbfa3-9c3a-4fb2-9836-3cdbc8678ea1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.772824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b0cbfa3-9c3a-4fb2-9836-3cdbc8678ea1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.799089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-545c5800-6e20-40e4-94e7-4caaf70bc73b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:31.813882 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-545c5800-6e20-40e4-94e7-4caaf70bc73b tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1302 microversion: 2.1 time: 0.217729 Aug 29 15:49:31.814844 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2691/5555] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:31 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1302 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:31.819540 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-9b0cbfa3-9c3a-4fb2-9836-3cdbc8678ea1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Cannot 'restore' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9b0cbfa3-9c3a-4fb2-9836-3cdbc8678ea1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action HTTP/1.1 Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 15 Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: {"restore": {}} Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: exception: Cannot 'restore' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b0fd8c4a-7225-496b-a071-6fd8f37dc60a', 'body': {'restore': {}}} Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a in vm_state active. Cannot restore while the instance is in this state. Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:31.823753 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:31.831401 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:31.831401 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:31.831401 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:31.831401 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active Aug 29 15:49:31.831401 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:31.833844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9b0cbfa3-9c3a-4fb2-9836-3cdbc8678ea1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 409 to user: Cannot 'restore' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:31.835005 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9b0cbfa3-9c3a-4fb2-9836-3cdbc8678ea1 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action" status: 409 len: 145 microversion: 2.1 time: 0.081064 Aug 29 15:49:31.842275 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2865/5556] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:31 2022] POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action => generated 145 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:49:31.845972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a9e91f4f-7422-4b6a-9e9d-b15df95a7a65 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:31.846641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a9e91f4f-7422-4b6a-9e9d-b15df95a7a65 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:31.856156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9e91f4f-7422-4b6a-9e9d-b15df95a7a65 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.857010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9e91f4f-7422-4b6a-9e9d-b15df95a7a65 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.857675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9e91f4f-7422-4b6a-9e9d-b15df95a7a65 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.860148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9e91f4f-7422-4b6a-9e9d-b15df95a7a65 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.861232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9e91f4f-7422-4b6a-9e9d-b15df95a7a65 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.863027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9e91f4f-7422-4b6a-9e9d-b15df95a7a65 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.938412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-97c0616f-3f0e-499c-9da6-af4eec8f59b8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:31.939032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-97c0616f-3f0e-499c-9da6-af4eec8f59b8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:31.966486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97c0616f-3f0e-499c-9da6-af4eec8f59b8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.967725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97c0616f-3f0e-499c-9da6-af4eec8f59b8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.969169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97c0616f-3f0e-499c-9da6-af4eec8f59b8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.973383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97c0616f-3f0e-499c-9da6-af4eec8f59b8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.976143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97c0616f-3f0e-499c-9da6-af4eec8f59b8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.976802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97c0616f-3f0e-499c-9da6-af4eec8f59b8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.092783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a9e91f4f-7422-4b6a-9e9d-b15df95a7a65 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:32.101046 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a9e91f4f-7422-4b6a-9e9d-b15df95a7a65 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.258833 Aug 29 15:49:32.101966 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2692/5557] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:31 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:32.124760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0ffe90d9-584c-4fea-910b-c97d5abc3f41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:32.125331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0ffe90d9-584c-4fea-910b-c97d5abc3f41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:32.138753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ffe90d9-584c-4fea-910b-c97d5abc3f41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.139252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ffe90d9-584c-4fea-910b-c97d5abc3f41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.139690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ffe90d9-584c-4fea-910b-c97d5abc3f41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.140395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ffe90d9-584c-4fea-910b-c97d5abc3f41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.140846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ffe90d9-584c-4fea-910b-c97d5abc3f41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.141295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ffe90d9-584c-4fea-910b-c97d5abc3f41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.406638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0ffe90d9-584c-4fea-910b-c97d5abc3f41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:32.415605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-97c0616f-3f0e-499c-9da6-af4eec8f59b8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:32.425243 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0ffe90d9-584c-4fea-910b-c97d5abc3f41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.305141 Aug 29 15:49:32.430011 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2693/5558] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:32 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:32.443326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b46f4dd4-cf46-4e06-9ed4-5d4109976f34 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:32.444884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b46f4dd4-cf46-4e06-9ed4-5d4109976f34 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:32.457952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b46f4dd4-cf46-4e06-9ed4-5d4109976f34 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.460024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b46f4dd4-cf46-4e06-9ed4-5d4109976f34 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.460961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b46f4dd4-cf46-4e06-9ed4-5d4109976f34 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.462700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b46f4dd4-cf46-4e06-9ed4-5d4109976f34 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.465771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b46f4dd4-cf46-4e06-9ed4-5d4109976f34 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.466828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b46f4dd4-cf46-4e06-9ed4-5d4109976f34 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.494360 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-97c0616f-3f0e-499c-9da6-af4eec8f59b8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1321 microversion: 2.1 time: 0.563427 Aug 29 15:49:32.499010 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2866/5559] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:31 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1321 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:32.520934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ac6e64c3-26cc-4adb-9ff7-74f63ee4df8c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:32.524869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ac6e64c3-26cc-4adb-9ff7-74f63ee4df8c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: d18b48b2-d1de-43b9-8f49-bb5eb805a85a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:32.558551 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-ac6e64c3-26cc-4adb-9ff7-74f63ee4df8c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance d18b48b2-d1de-43b9-8f49-bb5eb805a85a could not be found. Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ac6e64c3-26cc-4adb-9ff7-74f63ee4df8c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/d18b48b2-d1de-43b9-8f49-bb5eb805a85a/action HTTP/1.1 Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 14 Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: {"resume": {}} Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance d18b48b2-d1de-43b9-8f49-bb5eb805a85a could not be found. Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'd18b48b2-d1de-43b9-8f49-bb5eb805a85a', 'body': {'resume': {}}} Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d18b48b2-d1de-43b9-8f49-bb5eb805a85a could not be found. Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d18b48b2-d1de-43b9-8f49-bb5eb805a85a could not be found. Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:32.598666 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:32.604370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:32.604370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:32.604370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d18b48b2-d1de-43b9-8f49-bb5eb805a85a could not be found. Aug 29 15:49:32.604370 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:32.604370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ac6e64c3-26cc-4adb-9ff7-74f63ee4df8c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance d18b48b2-d1de-43b9-8f49-bb5eb805a85a could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:32.604370 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ac6e64c3-26cc-4adb-9ff7-74f63ee4df8c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/d18b48b2-d1de-43b9-8f49-bb5eb805a85a/action" status: 404 len: 111 microversion: 2.1 time: 0.100245 Aug 29 15:49:32.610052 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2867/5560] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:32 2022] POST /compute/v2.1/servers/d18b48b2-d1de-43b9-8f49-bb5eb805a85a/action => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:32.629100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec2a4dd3-afe9-486f-b53a-1b3889832596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:32.633756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ec2a4dd3-afe9-486f-b53a-1b3889832596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:32.660403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec2a4dd3-afe9-486f-b53a-1b3889832596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.667582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec2a4dd3-afe9-486f-b53a-1b3889832596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.668798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec2a4dd3-afe9-486f-b53a-1b3889832596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.669732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec2a4dd3-afe9-486f-b53a-1b3889832596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.670579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec2a4dd3-afe9-486f-b53a-1b3889832596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.671378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec2a4dd3-afe9-486f-b53a-1b3889832596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.912365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b46f4dd4-cf46-4e06-9ed4-5d4109976f34 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:32.934652 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b46f4dd4-cf46-4e06-9ed4-5d4109976f34 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1367 microversion: 2.1 time: 0.499661 Aug 29 15:49:32.942436 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2694/5561] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:32 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1367 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:32.956337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7cae9a30-6c0d-4733-a573-4f2245ead3a4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:32.966259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7cae9a30-6c0d-4733-a573-4f2245ead3a4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:32.985251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cae9a30-6c0d-4733-a573-4f2245ead3a4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.986282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cae9a30-6c0d-4733-a573-4f2245ead3a4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.987393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cae9a30-6c0d-4733-a573-4f2245ead3a4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.988737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cae9a30-6c0d-4733-a573-4f2245ead3a4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.990084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cae9a30-6c0d-4733-a573-4f2245ead3a4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.991808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7cae9a30-6c0d-4733-a573-4f2245ead3a4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.203798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ec2a4dd3-afe9-486f-b53a-1b3889832596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:33.217631 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ec2a4dd3-afe9-486f-b53a-1b3889832596 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.605725 Aug 29 15:49:33.221213 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2868/5562] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:32 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:33.240728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5b5cdd73-1e91-49d3-a11e-c7d574c524cd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:33.241854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5b5cdd73-1e91-49d3-a11e-c7d574c524cd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:33.255688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b5cdd73-1e91-49d3-a11e-c7d574c524cd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.256501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b5cdd73-1e91-49d3-a11e-c7d574c524cd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.261714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b5cdd73-1e91-49d3-a11e-c7d574c524cd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.263168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b5cdd73-1e91-49d3-a11e-c7d574c524cd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.264313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b5cdd73-1e91-49d3-a11e-c7d574c524cd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.264965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b5cdd73-1e91-49d3-a11e-c7d574c524cd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.296302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7cae9a30-6c0d-4733-a573-4f2245ead3a4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:33.309450 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7cae9a30-6c0d-4733-a573-4f2245ead3a4 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1370 microversion: 2.1 time: 0.361310 Aug 29 15:49:33.310099 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2695/5563] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:32 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1370 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:33.542448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-255f0ec5-d655-4513-9eaf-5f9841ea5f1b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:33.543133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-255f0ec5-d655-4513-9eaf-5f9841ea5f1b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:33.550182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-255f0ec5-d655-4513-9eaf-5f9841ea5f1b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.550741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-255f0ec5-d655-4513-9eaf-5f9841ea5f1b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.551239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-255f0ec5-d655-4513-9eaf-5f9841ea5f1b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.552021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-255f0ec5-d655-4513-9eaf-5f9841ea5f1b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.552719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-255f0ec5-d655-4513-9eaf-5f9841ea5f1b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.553295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-255f0ec5-d655-4513-9eaf-5f9841ea5f1b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.587109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:33.598151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5b5cdd73-1e91-49d3-a11e-c7d574c524cd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:33.618632 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5b5cdd73-1e91-49d3-a11e-c7d574c524cd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.383753 Aug 29 15:49:33.619632 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2869/5564] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:33 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:33.644821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-70d983b7-b23a-4c32-9bdf-c2121bb65f85 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:33.645636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-70d983b7-b23a-4c32-9bdf-c2121bb65f85 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:33.654655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70d983b7-b23a-4c32-9bdf-c2121bb65f85 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.656239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70d983b7-b23a-4c32-9bdf-c2121bb65f85 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.656722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70d983b7-b23a-4c32-9bdf-c2121bb65f85 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.657531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70d983b7-b23a-4c32-9bdf-c2121bb65f85 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.658057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70d983b7-b23a-4c32-9bdf-c2121bb65f85 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.658681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70d983b7-b23a-4c32-9bdf-c2121bb65f85 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.717936 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-70d983b7-b23a-4c32-9bdf-c2121bb65f85 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Cannot 'resume' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-70d983b7-b23a-4c32-9bdf-c2121bb65f85 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action HTTP/1.1 Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 14 Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: {"resume": {}} Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: exception: Cannot 'resume' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b0fd8c4a-7225-496b-a071-6fd8f37dc60a', 'body': {'resume': {}}} Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a in vm_state active. Cannot resume while the instance is in this state. Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:33.719763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:33.724662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:33.724662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:33.724662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:33.724662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:33.724662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:33.724662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active Aug 29 15:49:33.724662 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:33.727397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-70d983b7-b23a-4c32-9bdf-c2121bb65f85 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 409 to user: Cannot 'resume' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:33.729298 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-70d983b7-b23a-4c32-9bdf-c2121bb65f85 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action" status: 409 len: 144 microversion: 2.1 time: 0.089520 Aug 29 15:49:33.730090 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2870/5565] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:33 2022] POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action => generated 144 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:49:33.738398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-272f2252-e68e-4cbc-a0d8-7420f309886b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:33.742191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-272f2252-e68e-4cbc-a0d8-7420f309886b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:33.761946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-272f2252-e68e-4cbc-a0d8-7420f309886b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.762450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-272f2252-e68e-4cbc-a0d8-7420f309886b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.762893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-272f2252-e68e-4cbc-a0d8-7420f309886b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.763607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-272f2252-e68e-4cbc-a0d8-7420f309886b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.764074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-272f2252-e68e-4cbc-a0d8-7420f309886b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.764506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-272f2252-e68e-4cbc-a0d8-7420f309886b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.862465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-255f0ec5-d655-4513-9eaf-5f9841ea5f1b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:33.873946 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-255f0ec5-d655-4513-9eaf-5f9841ea5f1b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1321 microversion: 2.1 time: 0.334499 Aug 29 15:49:33.875665 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2696/5566] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:33 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:33.927694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-301bd1c3-706d-4057-9042-087bdb9c891a req-6a08b7a1-3335-4bd4-924a-a4182cbc9545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cbe7b40-fde9-4090-8c20-74c27c5af79b", "tag": "55968408-6166-427a-867d-93135f6ec6d5"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:33.959353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-301bd1c3-706d-4057-9042-087bdb9c891a req-6a08b7a1-3335-4bd4-924a-a4182cbc9545 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.960461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-301bd1c3-706d-4057-9042-087bdb9c891a req-6a08b7a1-3335-4bd4-924a-a4182cbc9545 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.960926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-301bd1c3-706d-4057-9042-087bdb9c891a req-6a08b7a1-3335-4bd4-924a-a4182cbc9545 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.987284 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-301bd1c3-706d-4057-9042-087bdb9c891a req-6a08b7a1-3335-4bd4-924a-a4182cbc9545 service nova] Creating event network-changed:55968408-6166-427a-867d-93135f6ec6d5 for instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b on n-h2-839401-11 Aug 29 15:49:34.003295 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-301bd1c3-706d-4057-9042-087bdb9c891a req-6a08b7a1-3335-4bd4-924a-a4182cbc9545 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080863 Aug 29 15:49:34.003956 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2697/5567] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:49:34.010466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-97992cde-0ed8-460b-86e2-342db56ee8cd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:34.011170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-97992cde-0ed8-460b-86e2-342db56ee8cd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:34.017494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97992cde-0ed8-460b-86e2-342db56ee8cd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.018264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97992cde-0ed8-460b-86e2-342db56ee8cd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.018868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97992cde-0ed8-460b-86e2-342db56ee8cd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.019808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97992cde-0ed8-460b-86e2-342db56ee8cd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.020521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97992cde-0ed8-460b-86e2-342db56ee8cd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.021201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97992cde-0ed8-460b-86e2-342db56ee8cd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.220707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-272f2252-e68e-4cbc-a0d8-7420f309886b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:34.231612 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-272f2252-e68e-4cbc-a0d8-7420f309886b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.497077 Aug 29 15:49:34.232204 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2871/5568] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:33 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:34.271393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b37685f3-32b8-427a-b3e0-9cd5b3d62ab5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:34.272057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b37685f3-32b8-427a-b3e0-9cd5b3d62ab5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:34.285768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b37685f3-32b8-427a-b3e0-9cd5b3d62ab5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.286594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b37685f3-32b8-427a-b3e0-9cd5b3d62ab5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.287274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b37685f3-32b8-427a-b3e0-9cd5b3d62ab5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.288243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b37685f3-32b8-427a-b3e0-9cd5b3d62ab5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.288998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b37685f3-32b8-427a-b3e0-9cd5b3d62ab5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.289655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b37685f3-32b8-427a-b3e0-9cd5b3d62ab5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.296308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:34.650217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b37685f3-32b8-427a-b3e0-9cd5b3d62ab5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:34.659186 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b37685f3-32b8-427a-b3e0-9cd5b3d62ab5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.397569 Aug 29 15:49:34.673479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-97992cde-0ed8-460b-86e2-342db56ee8cd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:34.673635 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2872/5569] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:34 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:34.678282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-accc93d1-d2af-4c04-943f-5f07ade37b11 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:34.679153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-accc93d1-d2af-4c04-943f-5f07ade37b11 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:34.685652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-accc93d1-d2af-4c04-943f-5f07ade37b11 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.686160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-accc93d1-d2af-4c04-943f-5f07ade37b11 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.686607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-accc93d1-d2af-4c04-943f-5f07ade37b11 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.687329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-accc93d1-d2af-4c04-943f-5f07ade37b11 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.687795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-accc93d1-d2af-4c04-943f-5f07ade37b11 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.688532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-accc93d1-d2af-4c04-943f-5f07ade37b11 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.703544 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-97992cde-0ed8-460b-86e2-342db56ee8cd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1557 microversion: 2.1 time: 0.696170 Aug 29 15:49:34.704992 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2698/5570] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:34 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1557 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:34.731827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-36b0e466-d5cf-4b11-90d2-6d16a81f4883 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:34.732978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-36b0e466-d5cf-4b11-90d2-6d16a81f4883 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:34.747022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36b0e466-d5cf-4b11-90d2-6d16a81f4883 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.748713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36b0e466-d5cf-4b11-90d2-6d16a81f4883 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.749609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36b0e466-d5cf-4b11-90d2-6d16a81f4883 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.750626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36b0e466-d5cf-4b11-90d2-6d16a81f4883 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.755552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36b0e466-d5cf-4b11-90d2-6d16a81f4883 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.756389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36b0e466-d5cf-4b11-90d2-6d16a81f4883 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.937960 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-36b0e466-d5cf-4b11-90d2-6d16a81f4883 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.212433 Aug 29 15:49:34.940085 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2699/5571] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:49:34 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9/os-interface => generated 285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:34.954350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f5ab37fb-0d52-48d4-8429-5dce8e370627 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f5ab37fb-0d52-48d4-8429-5dce8e370627 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 160 Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "74eea137-7f8c-43e1-bd42-582bf8562b2a"}]}} Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': '', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'networks': [{'uuid': '74eea137-7f8c-43e1-bd42-582bf8562b2a'}]}}} Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi '' Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:49:34.959065 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:49:34.964867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:49:34.964867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:49:34.964867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.964867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:34.964867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.964867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:34.964867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:34.964867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:34.964867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:49:34.964867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:49:34.964867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:49:34.964867 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.967986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f5ab37fb-0d52-48d4-8429-5dce8e370627 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:34.969031 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f5ab37fb-0d52-48d4-8429-5dce8e370627 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.027760 Aug 29 15:49:34.969886 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2700/5572] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:34 2022] POST /compute/v2.1/servers => generated 108 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:34.984885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e61d1416-ad2c-4cbc-89fe-5779a2448fe5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:34.988490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e61d1416-ad2c-4cbc-89fe-5779a2448fe5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:35.014873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e61d1416-ad2c-4cbc-89fe-5779a2448fe5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.015852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e61d1416-ad2c-4cbc-89fe-5779a2448fe5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.016642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e61d1416-ad2c-4cbc-89fe-5779a2448fe5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.018932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e61d1416-ad2c-4cbc-89fe-5779a2448fe5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.020611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e61d1416-ad2c-4cbc-89fe-5779a2448fe5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.022780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e61d1416-ad2c-4cbc-89fe-5779a2448fe5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.124815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-accc93d1-d2af-4c04-943f-5f07ade37b11 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:35.141968 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-accc93d1-d2af-4c04-943f-5f07ade37b11 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1370 microversion: 2.1 time: 0.467534 Aug 29 15:49:35.143352 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2873/5573] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:34 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1370 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:35.148312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f02301ce-d57a-475d-805f-bda5d71ffa29 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.149195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f02301ce-d57a-475d-805f-bda5d71ffa29 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:35.163082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f02301ce-d57a-475d-805f-bda5d71ffa29 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.163958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f02301ce-d57a-475d-805f-bda5d71ffa29 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.164630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f02301ce-d57a-475d-805f-bda5d71ffa29 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.165601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f02301ce-d57a-475d-805f-bda5d71ffa29 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.169857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f02301ce-d57a-475d-805f-bda5d71ffa29 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.170617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f02301ce-d57a-475d-805f-bda5d71ffa29 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.486586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f02301ce-d57a-475d-805f-bda5d71ffa29 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:35.506901 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f02301ce-d57a-475d-805f-bda5d71ffa29 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.362208 Aug 29 15:49:35.507511 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2874/5574] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:35 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:35.531728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a757cbf2-b60e-4096-9ebf-c44742853972 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.542020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a757cbf2-b60e-4096-9ebf-c44742853972 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:35.550511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a757cbf2-b60e-4096-9ebf-c44742853972 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.551342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a757cbf2-b60e-4096-9ebf-c44742853972 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.551982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a757cbf2-b60e-4096-9ebf-c44742853972 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.553836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a757cbf2-b60e-4096-9ebf-c44742853972 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.554514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a757cbf2-b60e-4096-9ebf-c44742853972 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.556550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a757cbf2-b60e-4096-9ebf-c44742853972 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.822032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a757cbf2-b60e-4096-9ebf-c44742853972 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:35.836165 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a757cbf2-b60e-4096-9ebf-c44742853972 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.309694 Aug 29 15:49:35.836762 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2875/5575] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:35 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:35.856698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ca04a79c-85fb-4b31-a7e6-eecb04382b29 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:35.857551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ca04a79c-85fb-4b31-a7e6-eecb04382b29 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: d4c272ae-10e8-44ca-aa75-1ec921bac2d1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:35.863867 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-ca04a79c-85fb-4b31-a7e6-eecb04382b29 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance d4c272ae-10e8-44ca-aa75-1ec921bac2d1 could not be found. Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ca04a79c-85fb-4b31-a7e6-eecb04382b29 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/d4c272ae-10e8-44ca-aa75-1ec921bac2d1/action HTTP/1.1 Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 14 Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: {"shelve": {}} Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance d4c272ae-10e8-44ca-aa75-1ec921bac2d1 could not be found. Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'd4c272ae-10e8-44ca-aa75-1ec921bac2d1', 'body': {'shelve': {}}} Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4c272ae-10e8-44ca-aa75-1ec921bac2d1 could not be found. Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4c272ae-10e8-44ca-aa75-1ec921bac2d1 could not be found. Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:35.867522 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:35.872694 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:35.872694 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:35.872694 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4c272ae-10e8-44ca-aa75-1ec921bac2d1 could not be found. Aug 29 15:49:35.872694 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.873909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ca04a79c-85fb-4b31-a7e6-eecb04382b29 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance d4c272ae-10e8-44ca-aa75-1ec921bac2d1 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:35.874998 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ca04a79c-85fb-4b31-a7e6-eecb04382b29 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/d4c272ae-10e8-44ca-aa75-1ec921bac2d1/action" status: 404 len: 111 microversion: 2.1 time: 0.022773 Aug 29 15:49:35.879576 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2876/5576] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:35 2022] POST /compute/v2.1/servers/d4c272ae-10e8-44ca-aa75-1ec921bac2d1/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:49:35.886166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-398c33f1-fc5d-4f0a-8d09-554ce15a9e06 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.887101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-398c33f1-fc5d-4f0a-8d09-554ce15a9e06 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:35.894998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-398c33f1-fc5d-4f0a-8d09-554ce15a9e06 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.895829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-398c33f1-fc5d-4f0a-8d09-554ce15a9e06 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.896280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-398c33f1-fc5d-4f0a-8d09-554ce15a9e06 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.897022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-398c33f1-fc5d-4f0a-8d09-554ce15a9e06 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.897660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-398c33f1-fc5d-4f0a-8d09-554ce15a9e06 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.898097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-398c33f1-fc5d-4f0a-8d09-554ce15a9e06 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:36.040093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-398c33f1-fc5d-4f0a-8d09-554ce15a9e06 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:36.048480 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-398c33f1-fc5d-4f0a-8d09-554ce15a9e06 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.167532 Aug 29 15:49:36.049279 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2877/5577] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:35 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:36.072643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-13ede6dd-c825-4ed8-bbe1-5ed095db06ab tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:36.073228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-13ede6dd-c825-4ed8-bbe1-5ed095db06ab tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:36.079625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13ede6dd-c825-4ed8-bbe1-5ed095db06ab tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:36.080131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13ede6dd-c825-4ed8-bbe1-5ed095db06ab tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:36.080832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13ede6dd-c825-4ed8-bbe1-5ed095db06ab tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:36.082168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13ede6dd-c825-4ed8-bbe1-5ed095db06ab tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:36.082804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13ede6dd-c825-4ed8-bbe1-5ed095db06ab tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:36.085400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13ede6dd-c825-4ed8-bbe1-5ed095db06ab tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:36.262944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e61d1416-ad2c-4cbc-89fe-5779a2448fe5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:36.264458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-13ede6dd-c825-4ed8-bbe1-5ed095db06ab tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:36.274368 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-13ede6dd-c825-4ed8-bbe1-5ed095db06ab tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.206358 Aug 29 15:49:36.275222 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2878/5578] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:36 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:36.281956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a4b610e3-3b53-46f4-b806-27340f39f3c3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:36.282867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a4b610e3-3b53-46f4-b806-27340f39f3c3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:36.284224 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e61d1416-ad2c-4cbc-89fe-5779a2448fe5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1321 microversion: 2.1 time: 1.313014 Aug 29 15:49:36.285262 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2701/5579] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:34 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1321 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:36.294950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e6d70084-5685-4722-8a53-7ac2ce927b80 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:36.295758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e6d70084-5685-4722-8a53-7ac2ce927b80 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:36.303160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4b610e3-3b53-46f4-b806-27340f39f3c3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:36.303671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4b610e3-3b53-46f4-b806-27340f39f3c3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:36.304187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4b610e3-3b53-46f4-b806-27340f39f3c3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:36.305397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4b610e3-3b53-46f4-b806-27340f39f3c3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:36.305900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6d70084-5685-4722-8a53-7ac2ce927b80 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:36.306031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4b610e3-3b53-46f4-b806-27340f39f3c3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:36.306327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4b610e3-3b53-46f4-b806-27340f39f3c3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:36.306448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6d70084-5685-4722-8a53-7ac2ce927b80 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:36.306807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6d70084-5685-4722-8a53-7ac2ce927b80 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:36.307511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6d70084-5685-4722-8a53-7ac2ce927b80 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:36.317830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6d70084-5685-4722-8a53-7ac2ce927b80 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:36.318304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e6d70084-5685-4722-8a53-7ac2ce927b80 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:36.360845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-e6d70084-5685-4722-8a53-7ac2ce927b80 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lazy-loading 'flavor' on Instance uuid b0fd8c4a-7225-496b-a071-6fd8f37dc60a {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:49:36.511858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a4b610e3-3b53-46f4-b806-27340f39f3c3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:36.529221 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a4b610e3-3b53-46f4-b806-27340f39f3c3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1370 microversion: 2.1 time: 0.252560 Aug 29 15:49:36.537319 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2879/5580] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:36 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:36.698691 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e6d70084-5685-4722-8a53-7ac2ce927b80 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action" status: 202 len: 0 microversion: 2.1 time: 0.407219 Aug 29 15:49:36.704241 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2702/5581] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:36 2022] POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:49:36.709379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-de72bc64-2e6a-452b-a104-2ba1ead8c496 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:36.710002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-de72bc64-2e6a-452b-a104-2ba1ead8c496 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:36.725866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de72bc64-2e6a-452b-a104-2ba1ead8c496 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:36.726851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de72bc64-2e6a-452b-a104-2ba1ead8c496 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:36.727672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de72bc64-2e6a-452b-a104-2ba1ead8c496 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:36.728710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de72bc64-2e6a-452b-a104-2ba1ead8c496 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:36.730129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de72bc64-2e6a-452b-a104-2ba1ead8c496 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:36.731147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-de72bc64-2e6a-452b-a104-2ba1ead8c496 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.245835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-de72bc64-2e6a-452b-a104-2ba1ead8c496 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:37.256724 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-de72bc64-2e6a-452b-a104-2ba1ead8c496 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1511 microversion: 2.1 time: 0.551532 Aug 29 15:49:37.257711 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2880/5582] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:36 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1511 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:37.307728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1a7c3125-2f83-4dc8-8ed0-817d206eca78 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:37.308643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1a7c3125-2f83-4dc8-8ed0-817d206eca78 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:37.317337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a7c3125-2f83-4dc8-8ed0-817d206eca78 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:37.318166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a7c3125-2f83-4dc8-8ed0-817d206eca78 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:37.318831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a7c3125-2f83-4dc8-8ed0-817d206eca78 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.319787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a7c3125-2f83-4dc8-8ed0-817d206eca78 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:37.320512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a7c3125-2f83-4dc8-8ed0-817d206eca78 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:37.321221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a7c3125-2f83-4dc8-8ed0-817d206eca78 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.484413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:37.517719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=5 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:37.558115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4bbdf62f-6544-49d9-9ec9-7d80ad3c6780 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:37.558806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4bbdf62f-6544-49d9-9ec9-7d80ad3c6780 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:37.568494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bbdf62f-6544-49d9-9ec9-7d80ad3c6780 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:37.571518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bbdf62f-6544-49d9-9ec9-7d80ad3c6780 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:37.572013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bbdf62f-6544-49d9-9ec9-7d80ad3c6780 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.577983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bbdf62f-6544-49d9-9ec9-7d80ad3c6780 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:37.578619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bbdf62f-6544-49d9-9ec9-7d80ad3c6780 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:37.579141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bbdf62f-6544-49d9-9ec9-7d80ad3c6780 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.793209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=11 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:37.891286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4bbdf62f-6544-49d9-9ec9-7d80ad3c6780 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:37.933112 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4bbdf62f-6544-49d9-9ec9-7d80ad3c6780 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1370 microversion: 2.1 time: 0.375140 Aug 29 15:49:37.934883 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2881/5583] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:37 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1370 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:37.974816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-d3936c45-24c1-451b-87ee-c92f747faf5b req-8d2211a1-6b50-4c54-aa6d-86ade0b14afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0947721-9360-4db5-8636-ac5786d6cbe9", "tag": "9435fc27-8664-47fe-840f-9a73e4495c4f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:37.996803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1a7c3125-2f83-4dc8-8ed0-817d206eca78 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:38.010317 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1a7c3125-2f83-4dc8-8ed0-817d206eca78 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1321 microversion: 2.1 time: 0.707082 Aug 29 15:49:38.011327 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2703/5584] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:37 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1321 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:38.051636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d3936c45-24c1-451b-87ee-c92f747faf5b req-8d2211a1-6b50-4c54-aa6d-86ade0b14afb service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:38.053536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d3936c45-24c1-451b-87ee-c92f747faf5b req-8d2211a1-6b50-4c54-aa6d-86ade0b14afb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:38.057802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d3936c45-24c1-451b-87ee-c92f747faf5b req-8d2211a1-6b50-4c54-aa6d-86ade0b14afb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:38.086540 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-d3936c45-24c1-451b-87ee-c92f747faf5b req-8d2211a1-6b50-4c54-aa6d-86ade0b14afb service nova] Creating event network-changed:9435fc27-8664-47fe-840f-9a73e4495c4f for instance f0947721-9360-4db5-8636-ac5786d6cbe9 on n-h2-839401-11 Aug 29 15:49:38.104447 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-d3936c45-24c1-451b-87ee-c92f747faf5b req-8d2211a1-6b50-4c54-aa6d-86ade0b14afb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151845 Aug 29 15:49:38.105823 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2882/5585] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:49:38.278229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-632aafb9-1337-4920-97a5-c5166728782b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:38.279271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-632aafb9-1337-4920-97a5-c5166728782b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:38.294337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-632aafb9-1337-4920-97a5-c5166728782b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:38.301548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-632aafb9-1337-4920-97a5-c5166728782b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:38.302519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-632aafb9-1337-4920-97a5-c5166728782b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:38.303405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-632aafb9-1337-4920-97a5-c5166728782b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:38.304328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-632aafb9-1337-4920-97a5-c5166728782b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:38.304898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-632aafb9-1337-4920-97a5-c5166728782b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:38.758506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-632aafb9-1337-4920-97a5-c5166728782b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:38.769366 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-632aafb9-1337-4920-97a5-c5166728782b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1511 microversion: 2.1 time: 0.494963 Aug 29 15:49:38.769968 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2704/5586] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:38 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1511 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:38.961040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8f0f28dc-bff1-436f-9be0-770f80a33095 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:38.964360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8f0f28dc-bff1-436f-9be0-770f80a33095 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:38.974590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0f28dc-bff1-436f-9be0-770f80a33095 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:38.976021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0f28dc-bff1-436f-9be0-770f80a33095 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:38.976721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0f28dc-bff1-436f-9be0-770f80a33095 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:38.978186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0f28dc-bff1-436f-9be0-770f80a33095 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:38.978944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0f28dc-bff1-436f-9be0-770f80a33095 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:38.979604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0f28dc-bff1-436f-9be0-770f80a33095 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:39.035235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eebc499e-6225-442a-a2b5-e9fbcf716662 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:39.039781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eebc499e-6225-442a-a2b5-e9fbcf716662 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:39.049807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eebc499e-6225-442a-a2b5-e9fbcf716662 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.054590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eebc499e-6225-442a-a2b5-e9fbcf716662 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.059084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eebc499e-6225-442a-a2b5-e9fbcf716662 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:39.060653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eebc499e-6225-442a-a2b5-e9fbcf716662 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.062372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eebc499e-6225-442a-a2b5-e9fbcf716662 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.063712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eebc499e-6225-442a-a2b5-e9fbcf716662 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:39.431321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8f0f28dc-bff1-436f-9be0-770f80a33095 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:39.445597 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8f0f28dc-bff1-436f-9be0-770f80a33095 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1370 microversion: 2.1 time: 0.493318 Aug 29 15:49:39.454566 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2883/5587] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:38 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1370 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:39.519131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eebc499e-6225-442a-a2b5-e9fbcf716662 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:39.557440 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eebc499e-6225-442a-a2b5-e9fbcf716662 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1321 microversion: 2.1 time: 0.525111 Aug 29 15:49:39.562995 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2705/5588] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:39 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1321 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:39.796779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-954dffdc-ce20-4138-abc6-45e30849d879 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:39.797668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-954dffdc-ce20-4138-abc6-45e30849d879 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:39.808550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954dffdc-ce20-4138-abc6-45e30849d879 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.809575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954dffdc-ce20-4138-abc6-45e30849d879 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.812084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954dffdc-ce20-4138-abc6-45e30849d879 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:39.814109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954dffdc-ce20-4138-abc6-45e30849d879 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.814605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954dffdc-ce20-4138-abc6-45e30849d879 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.817279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-954dffdc-ce20-4138-abc6-45e30849d879 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:39.989473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-77120011-c805-4bfe-b5eb-244f61369969 req-19f8cf5c-1f41-4892-ad88-7dc4f1e70a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89", "name": "network-vif-plugged", "status": "completed", "tag": "aab790f6-3f55-467e-a0cc-226b8fb3604f"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:40.036684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-77120011-c805-4bfe-b5eb-244f61369969 req-19f8cf5c-1f41-4892-ad88-7dc4f1e70a4b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.038938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-77120011-c805-4bfe-b5eb-244f61369969 req-19f8cf5c-1f41-4892-ad88-7dc4f1e70a4b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.040311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-77120011-c805-4bfe-b5eb-244f61369969 req-19f8cf5c-1f41-4892-ad88-7dc4f1e70a4b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.077234 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-77120011-c805-4bfe-b5eb-244f61369969 req-19f8cf5c-1f41-4892-ad88-7dc4f1e70a4b service nova] Creating event network-vif-plugged:aab790f6-3f55-467e-a0cc-226b8fb3604f for instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 on n-h1-839401-11 Aug 29 15:49:40.091420 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-77120011-c805-4bfe-b5eb-244f61369969 req-19f8cf5c-1f41-4892-ad88-7dc4f1e70a4b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115013 Aug 29 15:49:40.094515 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2706/5589] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:40.269720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-954dffdc-ce20-4138-abc6-45e30849d879 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:40.280926 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-954dffdc-ce20-4138-abc6-45e30849d879 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1511 microversion: 2.1 time: 0.493808 Aug 29 15:49:40.281938 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2884/5590] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:39 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1511 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:40.469023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d55df30b-f915-4049-bcd5-fcaf2d1990d7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:40.469954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d55df30b-f915-4049-bcd5-fcaf2d1990d7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:40.490205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55df30b-f915-4049-bcd5-fcaf2d1990d7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.490712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55df30b-f915-4049-bcd5-fcaf2d1990d7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.491163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55df30b-f915-4049-bcd5-fcaf2d1990d7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.494286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55df30b-f915-4049-bcd5-fcaf2d1990d7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.494979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55df30b-f915-4049-bcd5-fcaf2d1990d7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.495630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d55df30b-f915-4049-bcd5-fcaf2d1990d7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.587801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-43913c91-b9e8-4528-a32d-a38065d6d8af tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:40.588446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-43913c91-b9e8-4528-a32d-a38065d6d8af tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:40.599657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43913c91-b9e8-4528-a32d-a38065d6d8af tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.600167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43913c91-b9e8-4528-a32d-a38065d6d8af tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.600623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43913c91-b9e8-4528-a32d-a38065d6d8af tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.602317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43913c91-b9e8-4528-a32d-a38065d6d8af tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.602955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43913c91-b9e8-4528-a32d-a38065d6d8af tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.603925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43913c91-b9e8-4528-a32d-a38065d6d8af tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.956059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d55df30b-f915-4049-bcd5-fcaf2d1990d7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:40.972864 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d55df30b-f915-4049-bcd5-fcaf2d1990d7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1370 microversion: 2.1 time: 0.508207 Aug 29 15:49:40.972864 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2707/5591] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:40 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1370 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:41.202829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-43913c91-b9e8-4528-a32d-a38065d6d8af tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:41.224931 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-43913c91-b9e8-4528-a32d-a38065d6d8af tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1321 microversion: 2.1 time: 0.644998 Aug 29 15:49:41.225514 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2885/5592] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:40 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1321 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:41.303521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-44839375-7357-465c-a79d-9bd08ceb3d3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:41.305619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-44839375-7357-465c-a79d-9bd08ceb3d3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:41.315472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44839375-7357-465c-a79d-9bd08ceb3d3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:41.316204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44839375-7357-465c-a79d-9bd08ceb3d3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:41.316842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44839375-7357-465c-a79d-9bd08ceb3d3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:41.318147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44839375-7357-465c-a79d-9bd08ceb3d3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:41.318809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44839375-7357-465c-a79d-9bd08ceb3d3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:41.319408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44839375-7357-465c-a79d-9bd08ceb3d3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:41.641443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-44839375-7357-465c-a79d-9bd08ceb3d3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:41.662448 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-44839375-7357-465c-a79d-9bd08ceb3d3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1511 microversion: 2.1 time: 0.358257 Aug 29 15:49:41.663865 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2708/5593] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:41 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:42.008459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ab3a7cd-20a0-4afb-b37c-5b363e2fa8d2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:42.009144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ab3a7cd-20a0-4afb-b37c-5b363e2fa8d2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:42.018419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ab3a7cd-20a0-4afb-b37c-5b363e2fa8d2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:42.019333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ab3a7cd-20a0-4afb-b37c-5b363e2fa8d2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:42.019783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ab3a7cd-20a0-4afb-b37c-5b363e2fa8d2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:42.020840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ab3a7cd-20a0-4afb-b37c-5b363e2fa8d2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:42.021399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ab3a7cd-20a0-4afb-b37c-5b363e2fa8d2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:42.021858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ab3a7cd-20a0-4afb-b37c-5b363e2fa8d2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:42.248012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-de2504df-2fa3-47c8-9302-6af86eef0e7e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:42.248819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-de2504df-2fa3-47c8-9302-6af86eef0e7e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:42.260934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de2504df-2fa3-47c8-9302-6af86eef0e7e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:42.264696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de2504df-2fa3-47c8-9302-6af86eef0e7e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:42.265403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de2504df-2fa3-47c8-9302-6af86eef0e7e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:42.266339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de2504df-2fa3-47c8-9302-6af86eef0e7e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:42.266955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de2504df-2fa3-47c8-9302-6af86eef0e7e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:42.270582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-de2504df-2fa3-47c8-9302-6af86eef0e7e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:42.639928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-de2504df-2fa3-47c8-9302-6af86eef0e7e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:42.650649 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-de2504df-2fa3-47c8-9302-6af86eef0e7e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1321 microversion: 2.1 time: 0.407029 Aug 29 15:49:42.653315 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2709/5594] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:42 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1321 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:42.688415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a9f47c1-2420-4076-bb0e-9c0135ce3ba7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:42.692017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a9f47c1-2420-4076-bb0e-9c0135ce3ba7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:42.703468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a9f47c1-2420-4076-bb0e-9c0135ce3ba7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:42.704810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a9f47c1-2420-4076-bb0e-9c0135ce3ba7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:42.705984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a9f47c1-2420-4076-bb0e-9c0135ce3ba7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:42.706923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a9f47c1-2420-4076-bb0e-9c0135ce3ba7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:42.707724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a9f47c1-2420-4076-bb0e-9c0135ce3ba7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:42.708386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a9f47c1-2420-4076-bb0e-9c0135ce3ba7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:42.823247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5ab3a7cd-20a0-4afb-b37c-5b363e2fa8d2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:42.885647 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ab3a7cd-20a0-4afb-b37c-5b363e2fa8d2 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1370 microversion: 2.1 time: 0.869906 Aug 29 15:49:42.886749 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2886/5595] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:42 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1370 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:42.997569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5a9f47c1-2420-4076-bb0e-9c0135ce3ba7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:43.010306 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5a9f47c1-2420-4076-bb0e-9c0135ce3ba7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1511 microversion: 2.1 time: 0.329605 Aug 29 15:49:43.025598 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2710/5596] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:42 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1511 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:43.677526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e4d43eee-a319-4de3-a130-b8997547fc99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:43.678899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e4d43eee-a319-4de3-a130-b8997547fc99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:43.702705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4d43eee-a319-4de3-a130-b8997547fc99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:43.710561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4d43eee-a319-4de3-a130-b8997547fc99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:43.711290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4d43eee-a319-4de3-a130-b8997547fc99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:43.712206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4d43eee-a319-4de3-a130-b8997547fc99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:43.712833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4d43eee-a319-4de3-a130-b8997547fc99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:43.714421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4d43eee-a319-4de3-a130-b8997547fc99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:43.906205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4d1b5255-6fc4-44b2-b093-45e43170d3e0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:43.906827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4d1b5255-6fc4-44b2-b093-45e43170d3e0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:43.918606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d1b5255-6fc4-44b2-b093-45e43170d3e0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:43.919099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d1b5255-6fc4-44b2-b093-45e43170d3e0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:43.919536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d1b5255-6fc4-44b2-b093-45e43170d3e0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:43.920238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d1b5255-6fc4-44b2-b093-45e43170d3e0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:43.920697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d1b5255-6fc4-44b2-b093-45e43170d3e0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:43.921142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d1b5255-6fc4-44b2-b093-45e43170d3e0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.132689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e4d43eee-a319-4de3-a130-b8997547fc99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:44.158133 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e4d43eee-a319-4de3-a130-b8997547fc99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1501 microversion: 2.1 time: 0.488178 Aug 29 15:49:44.163705 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2887/5597] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:43 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1501 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:44.180270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-53b3e9ec-414b-411a-b480-de00e7fb16ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:44.181386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-53b3e9ec-414b-411a-b480-de00e7fb16ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:44.195654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:44.201034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53b3e9ec-414b-411a-b480-de00e7fb16ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.201874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53b3e9ec-414b-411a-b480-de00e7fb16ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.204355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53b3e9ec-414b-411a-b480-de00e7fb16ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.206747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53b3e9ec-414b-411a-b480-de00e7fb16ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.207458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53b3e9ec-414b-411a-b480-de00e7fb16ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.209199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53b3e9ec-414b-411a-b480-de00e7fb16ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.240039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4d1b5255-6fc4-44b2-b093-45e43170d3e0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:44.255137 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4d1b5255-6fc4-44b2-b093-45e43170d3e0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1370 microversion: 2.1 time: 0.351666 Aug 29 15:49:44.257106 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2711/5598] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:43 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1370 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:44.264976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f3477ff8-4906-44a5-a000-0a1a89af2bae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:44.265671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f3477ff8-4906-44a5-a000-0a1a89af2bae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:44.272266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3477ff8-4906-44a5-a000-0a1a89af2bae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.272757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3477ff8-4906-44a5-a000-0a1a89af2bae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.273357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3477ff8-4906-44a5-a000-0a1a89af2bae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.274058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3477ff8-4906-44a5-a000-0a1a89af2bae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.274781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3477ff8-4906-44a5-a000-0a1a89af2bae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.275374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f3477ff8-4906-44a5-a000-0a1a89af2bae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.481546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f3477ff8-4906-44a5-a000-0a1a89af2bae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:44.490410 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f3477ff8-4906-44a5-a000-0a1a89af2bae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1501 microversion: 2.1 time: 0.231738 Aug 29 15:49:44.491281 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2712/5599] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:44 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1501 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:44.496130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-6319803b-c13c-426f-8984-65d13bca9d70 req-1c0a0c11-f1ed-4fb4-ba88-39ff6a43c3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cbe7b40-fde9-4090-8c20-74c27c5af79b", "name": "network-vif-plugged", "status": "completed", "tag": "55968408-6166-427a-867d-93135f6ec6d5"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:44.508467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6319803b-c13c-426f-8984-65d13bca9d70 req-1c0a0c11-f1ed-4fb4-ba88-39ff6a43c3f9 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.509177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6319803b-c13c-426f-8984-65d13bca9d70 req-1c0a0c11-f1ed-4fb4-ba88-39ff6a43c3f9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.510099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6319803b-c13c-426f-8984-65d13bca9d70 req-1c0a0c11-f1ed-4fb4-ba88-39ff6a43c3f9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.517596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-53b3e9ec-414b-411a-b480-de00e7fb16ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:44.531480 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-6319803b-c13c-426f-8984-65d13bca9d70 req-1c0a0c11-f1ed-4fb4-ba88-39ff6a43c3f9 service nova] Creating event network-vif-plugged:55968408-6166-427a-867d-93135f6ec6d5 for instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b on n-h2-839401-11 Aug 29 15:49:44.532068 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-53b3e9ec-414b-411a-b480-de00e7fb16ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1511 microversion: 2.1 time: 0.366967 Aug 29 15:49:44.533229 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2888/5600] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:44 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1511 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:44.547788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-737ee8b3-b8e7-4de4-89fa-2cdf0e1dcda0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:44.549414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-737ee8b3-b8e7-4de4-89fa-2cdf0e1dcda0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:44.555000 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-6319803b-c13c-426f-8984-65d13bca9d70 req-1c0a0c11-f1ed-4fb4-ba88-39ff6a43c3f9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062190 Aug 29 15:49:44.556294 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2713/5601] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:44.570945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-737ee8b3-b8e7-4de4-89fa-2cdf0e1dcda0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.575380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-737ee8b3-b8e7-4de4-89fa-2cdf0e1dcda0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.577466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-737ee8b3-b8e7-4de4-89fa-2cdf0e1dcda0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.578419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-737ee8b3-b8e7-4de4-89fa-2cdf0e1dcda0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.579467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-737ee8b3-b8e7-4de4-89fa-2cdf0e1dcda0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.582350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-737ee8b3-b8e7-4de4-89fa-2cdf0e1dcda0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.624658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-737ee8b3-b8e7-4de4-89fa-2cdf0e1dcda0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:49:44.674381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:44.760451 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-737ee8b3-b8e7-4de4-89fa-2cdf0e1dcda0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 204 len: 0 microversion: 2.1 time: 0.225314 Aug 29 15:49:44.762145 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2889/5602] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:44 2022] DELETE /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:49:44.774079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-724160cb-bb0c-4dad-87bb-6e74ad9b2ed8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:44.776696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-724160cb-bb0c-4dad-87bb-6e74ad9b2ed8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:44.819953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-724160cb-bb0c-4dad-87bb-6e74ad9b2ed8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.821318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-724160cb-bb0c-4dad-87bb-6e74ad9b2ed8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.823356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-724160cb-bb0c-4dad-87bb-6e74ad9b2ed8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.824362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-724160cb-bb0c-4dad-87bb-6e74ad9b2ed8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.826140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-724160cb-bb0c-4dad-87bb-6e74ad9b2ed8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.827716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-724160cb-bb0c-4dad-87bb-6e74ad9b2ed8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.864269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:45.080980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-724160cb-bb0c-4dad-87bb-6e74ad9b2ed8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:45.096102 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-724160cb-bb0c-4dad-87bb-6e74ad9b2ed8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1507 microversion: 2.1 time: 0.328274 Aug 29 15:49:45.098206 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2714/5603] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:44 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1507 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:45.281666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c493ac58-9c56-4097-8ece-ae2f04d897f1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:45.282481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c493ac58-9c56-4097-8ece-ae2f04d897f1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:45.295977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c493ac58-9c56-4097-8ece-ae2f04d897f1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:45.297496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c493ac58-9c56-4097-8ece-ae2f04d897f1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:45.301204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c493ac58-9c56-4097-8ece-ae2f04d897f1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:45.302079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c493ac58-9c56-4097-8ece-ae2f04d897f1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:45.302690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c493ac58-9c56-4097-8ece-ae2f04d897f1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:45.303198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c493ac58-9c56-4097-8ece-ae2f04d897f1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:45.399320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1851975897", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "61331136-bbf7-4367-8fcf-d2e17df2d2b7"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:45.475004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] validate_networks() for [('61331136-bbf7-4367-8fcf-d2e17df2d2b7', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:49:46.020829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c493ac58-9c56-4097-8ece-ae2f04d897f1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:46.030661 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c493ac58-9c56-4097-8ece-ae2f04d897f1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1370 microversion: 2.1 time: 0.753375 Aug 29 15:49:46.031605 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2715/5604] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:45 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1370 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:46.042665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f7535208-1e51-4483-a7b1-c907397f7c5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:46.044067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f7535208-1e51-4483-a7b1-c907397f7c5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:46.052538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7535208-1e51-4483-a7b1-c907397f7c5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:46.053035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7535208-1e51-4483-a7b1-c907397f7c5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:46.053689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7535208-1e51-4483-a7b1-c907397f7c5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:46.055010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7535208-1e51-4483-a7b1-c907397f7c5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:46.055621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7535208-1e51-4483-a7b1-c907397f7c5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:46.056050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7535208-1e51-4483-a7b1-c907397f7c5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:46.310700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:46.311268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:46.312008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f7535208-1e51-4483-a7b1-c907397f7c5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:46.313329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:46.314343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:46.317052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:46.325934 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f7535208-1e51-4483-a7b1-c907397f7c5b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1511 microversion: 2.1 time: 0.293048 Aug 29 15:49:46.335375 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2716/5605] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:46 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:46.343856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:46.344600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:46.345332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:46.346893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0ecfae96-9020-4694-925f-6c29bf383d96 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:46.348358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:46.349622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:46.351710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0ecfae96-9020-4694-925f-6c29bf383d96 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:46.354522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:46.365100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ecfae96-9020-4694-925f-6c29bf383d96 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:46.380203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ecfae96-9020-4694-925f-6c29bf383d96 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:46.381245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ecfae96-9020-4694-925f-6c29bf383d96 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:46.382251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ecfae96-9020-4694-925f-6c29bf383d96 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:46.383994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ecfae96-9020-4694-925f-6c29bf383d96 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:46.387764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ecfae96-9020-4694-925f-6c29bf383d96 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:46.399887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Getting quotas for project 1360d49b02294f979903bb9bc33fcae0. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:46.408996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Getting quotas for user 5aa1b5aead3e485d920ef7becb36708e and project 1360d49b02294f979903bb9bc33fcae0. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:46.430282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:49:46.433074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:49:46.493889 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-555c8e81-c635-41fe-b3b9-192f9c7c3c24 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.294118 Aug 29 15:49:46.501926 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2890/5606] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:49:46.509239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-51747a55-0b3e-42bf-b080-ea9319b5681b tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:46.510313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-51747a55-0b3e-42bf-b080-ea9319b5681b tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:46.659957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-51747a55-0b3e-42bf-b080-ea9319b5681b tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:46.675259 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-51747a55-0b3e-42bf-b080-ea9319b5681b tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1225 microversion: 2.1 time: 0.170410 Aug 29 15:49:46.677148 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2891/5607] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:46 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1225 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:46.890648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0ecfae96-9020-4694-925f-6c29bf383d96 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:46.915279 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0ecfae96-9020-4694-925f-6c29bf383d96 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1507 microversion: 2.1 time: 0.575838 Aug 29 15:49:46.916245 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2717/5608] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:46 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1507 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:47.055183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-67ca659d-c5ba-4abe-bc82-b47a1b8128b1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:47.056038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-67ca659d-c5ba-4abe-bc82-b47a1b8128b1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:47.088743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67ca659d-c5ba-4abe-bc82-b47a1b8128b1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.091926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67ca659d-c5ba-4abe-bc82-b47a1b8128b1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.092631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67ca659d-c5ba-4abe-bc82-b47a1b8128b1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:47.095375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67ca659d-c5ba-4abe-bc82-b47a1b8128b1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.096189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67ca659d-c5ba-4abe-bc82-b47a1b8128b1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.096991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67ca659d-c5ba-4abe-bc82-b47a1b8128b1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:47.413933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6b0e86fc-0b4c-44d5-a00e-d8eff454d6fe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:47.415225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6b0e86fc-0b4c-44d5-a00e-d8eff454d6fe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:47.431326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b0e86fc-0b4c-44d5-a00e-d8eff454d6fe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.432034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b0e86fc-0b4c-44d5-a00e-d8eff454d6fe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.432479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b0e86fc-0b4c-44d5-a00e-d8eff454d6fe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:47.433446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b0e86fc-0b4c-44d5-a00e-d8eff454d6fe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.433911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b0e86fc-0b4c-44d5-a00e-d8eff454d6fe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.434527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b0e86fc-0b4c-44d5-a00e-d8eff454d6fe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:47.632802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-67ca659d-c5ba-4abe-bc82-b47a1b8128b1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:47.660201 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-67ca659d-c5ba-4abe-bc82-b47a1b8128b1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1564 microversion: 2.1 time: 0.607706 Aug 29 15:49:47.663192 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2892/5609] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:47 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1564 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:47.685357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ecf77466-29b0-4162-b513-3c5ea80da9e9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:47.686489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ecf77466-29b0-4162-b513-3c5ea80da9e9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:47.695531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecf77466-29b0-4162-b513-3c5ea80da9e9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.700596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecf77466-29b0-4162-b513-3c5ea80da9e9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.701438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecf77466-29b0-4162-b513-3c5ea80da9e9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:47.703440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecf77466-29b0-4162-b513-3c5ea80da9e9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.705451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecf77466-29b0-4162-b513-3c5ea80da9e9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.706038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ecf77466-29b0-4162-b513-3c5ea80da9e9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:47.963097 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ecf77466-29b0-4162-b513-3c5ea80da9e9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.282895 Aug 29 15:49:47.964028 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2893/5610] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:49:47 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-interface => generated 285 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:47.978093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f13c3f7f-8930-4f14-91f5-e3b8b79d1d62 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:47.979092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f13c3f7f-8930-4f14-91f5-e3b8b79d1d62 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:47.993764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f13c3f7f-8930-4f14-91f5-e3b8b79d1d62 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.994597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f13c3f7f-8930-4f14-91f5-e3b8b79d1d62 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.995314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f13c3f7f-8930-4f14-91f5-e3b8b79d1d62 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:47.996421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f13c3f7f-8930-4f14-91f5-e3b8b79d1d62 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.997134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f13c3f7f-8930-4f14-91f5-e3b8b79d1d62 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.997858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f13c3f7f-8930-4f14-91f5-e3b8b79d1d62 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:48.095954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6b0e86fc-0b4c-44d5-a00e-d8eff454d6fe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:48.123968 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6b0e86fc-0b4c-44d5-a00e-d8eff454d6fe tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1511 microversion: 2.1 time: 0.751443 Aug 29 15:49:48.127153 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2718/5611] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:47 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1511 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:48.141119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f13c3f7f-8930-4f14-91f5-e3b8b79d1d62 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:48.154361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-995f1cd6-8d42-4738-a41f-a69ceb622e1f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:48.156616 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f13c3f7f-8930-4f14-91f5-e3b8b79d1d62 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1277 microversion: 2.1 time: 0.187064 Aug 29 15:49:48.158667 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2894/5612] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:47 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:48.173589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-9058039f-80ff-4fb4-b4bf-fd83f138edcc req-9f601749-798a-4f7a-ac85-07093e1a6662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89", "name": "network-vif-deleted", "tag": "aab790f6-3f55-467e-a0cc-226b8fb3604f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:48.178891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-995f1cd6-8d42-4738-a41f-a69ceb622e1f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:48.188685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-995f1cd6-8d42-4738-a41f-a69ceb622e1f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:48.189576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-995f1cd6-8d42-4738-a41f-a69ceb622e1f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:48.190304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-995f1cd6-8d42-4738-a41f-a69ceb622e1f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:48.192248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-995f1cd6-8d42-4738-a41f-a69ceb622e1f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:48.192941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-995f1cd6-8d42-4738-a41f-a69ceb622e1f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:48.193591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-995f1cd6-8d42-4738-a41f-a69ceb622e1f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:48.204001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9058039f-80ff-4fb4-b4bf-fd83f138edcc req-9f601749-798a-4f7a-ac85-07093e1a6662 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:48.204504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9058039f-80ff-4fb4-b4bf-fd83f138edcc req-9f601749-798a-4f7a-ac85-07093e1a6662 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:48.204942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9058039f-80ff-4fb4-b4bf-fd83f138edcc req-9f601749-798a-4f7a-ac85-07093e1a6662 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:48.251211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-995f1cd6-8d42-4738-a41f-a69ceb622e1f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:48.251703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-995f1cd6-8d42-4738-a41f-a69ceb622e1f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:48.252144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-995f1cd6-8d42-4738-a41f-a69ceb622e1f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:48.252674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-995f1cd6-8d42-4738-a41f-a69ceb622e1f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lazy-loading 'fault' on Instance uuid ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:49:48.260238 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-9058039f-80ff-4fb4-b4bf-fd83f138edcc req-9f601749-798a-4f7a-ac85-07093e1a6662 service nova] Creating event network-vif-deleted:aab790f6-3f55-467e-a0cc-226b8fb3604f for instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 on n-h1-839401-11 Aug 29 15:49:48.278878 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-9058039f-80ff-4fb4-b4bf-fd83f138edcc req-9f601749-798a-4f7a-ac85-07093e1a6662 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117288 Aug 29 15:49:48.280707 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2895/5613] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:48.395821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-995f1cd6-8d42-4738-a41f-a69ceb622e1f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:48.403893 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-995f1cd6-8d42-4738-a41f-a69ceb622e1f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 200 len: 1311 microversion: 2.1 time: 0.275146 Aug 29 15:49:48.407289 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2719/5614] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:48 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 1311 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:48.419214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2a736c91-858b-48e3-b72f-1edd099bd4a1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:48.419813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2a736c91-858b-48e3-b72f-1edd099bd4a1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:48.430261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a736c91-858b-48e3-b72f-1edd099bd4a1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:48.431039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a736c91-858b-48e3-b72f-1edd099bd4a1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:48.431641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a736c91-858b-48e3-b72f-1edd099bd4a1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:48.433691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a736c91-858b-48e3-b72f-1edd099bd4a1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:48.434828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a736c91-858b-48e3-b72f-1edd099bd4a1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:48.435444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a736c91-858b-48e3-b72f-1edd099bd4a1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:48.581515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-2a736c91-858b-48e3-b72f-1edd099bd4a1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lazy-loading 'services' on Instance uuid 3c86c100-b9bb-4ec4-b849-672fa3a330b5 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:49:48.703849 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2a736c91-858b-48e3-b72f-1edd099bd4a1 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5/os-volume_attachments/da31af03-0547-415f-935e-1a771ea11d73" status: 202 len: 0 microversion: 2.1 time: 0.289832 Aug 29 15:49:48.706619 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2896/5615] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 15:49:48 2022] DELETE /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5/os-volume_attachments/da31af03-0547-415f-935e-1a771ea11d73 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:49:49.152943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-55c181b7-5638-4be5-a612-446d24cef697 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:49.153591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-55c181b7-5638-4be5-a612-446d24cef697 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:49.176731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55c181b7-5638-4be5-a612-446d24cef697 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:49.177886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55c181b7-5638-4be5-a612-446d24cef697 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:49.182103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55c181b7-5638-4be5-a612-446d24cef697 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:49.185577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55c181b7-5638-4be5-a612-446d24cef697 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:49.187821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55c181b7-5638-4be5-a612-446d24cef697 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:49.188341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55c181b7-5638-4be5-a612-446d24cef697 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:49.197038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d76f2753-7c3f-4f96-b355-594c33e9ab0a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:49.203416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d76f2753-7c3f-4f96-b355-594c33e9ab0a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:49.222216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d76f2753-7c3f-4f96-b355-594c33e9ab0a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:49.224998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d76f2753-7c3f-4f96-b355-594c33e9ab0a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:49.226213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d76f2753-7c3f-4f96-b355-594c33e9ab0a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:49.227446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d76f2753-7c3f-4f96-b355-594c33e9ab0a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:49.228679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d76f2753-7c3f-4f96-b355-594c33e9ab0a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:49.229682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d76f2753-7c3f-4f96-b355-594c33e9ab0a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:49.447431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d76f2753-7c3f-4f96-b355-594c33e9ab0a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:49.460083 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d76f2753-7c3f-4f96-b355-594c33e9ab0a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1295 microversion: 2.1 time: 0.279268 Aug 29 15:49:49.460721 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2897/5616] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:49 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1295 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:49.470404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a75b3d3b-cbf9-444c-b207-8812b367ba99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:49.471481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a75b3d3b-cbf9-444c-b207-8812b367ba99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:49.492853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a75b3d3b-cbf9-444c-b207-8812b367ba99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:49.494126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a75b3d3b-cbf9-444c-b207-8812b367ba99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:49.497283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a75b3d3b-cbf9-444c-b207-8812b367ba99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:49.498137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a75b3d3b-cbf9-444c-b207-8812b367ba99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:49.498623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a75b3d3b-cbf9-444c-b207-8812b367ba99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:49.499126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a75b3d3b-cbf9-444c-b207-8812b367ba99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:49.535204 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-a75b3d3b-cbf9-444c-b207-8812b367ba99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a75b3d3b-cbf9-444c-b207-8812b367ba99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 HTTP/1.1 Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89'} Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:49.540723 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:49.547321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:49.547321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:49.547321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:49.547321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:49.547321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. Aug 29 15:49:49.547321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:49:49.547321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a75b3d3b-cbf9-444c-b207-8812b367ba99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:49.547321 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a75b3d3b-cbf9-444c-b207-8812b367ba99 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 404 len: 111 microversion: 2.1 time: 0.079110 Aug 29 15:49:49.558119 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2898/5617] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:49 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:49.579196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fb83ce2e-49b5-45a0-92dc-9cc7c7678cc7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Action: 'create', calling method: .version_select at 0x7fc42b72c310>, body: {"keypair": {"name": "tempest-key-1853576478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdrJW8MlpIzUFGKrw0XGEycmvssXCvQCGdMIS93xYbcAfk9+0upTvzfKRMhYo1hOOpT2fUgUC3kCstSHvvcJxMAJt4xp8VJlsogHcSDO9fHzAOZqj9TVMWefzlTq8KzTw=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:49.626010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-fb83ce2e-49b5-45a0-92dc-9cc7c7678cc7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:49.640826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-fb83ce2e-49b5-45a0-92dc-9cc7c7678cc7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for user db3e87dfe49444f886b7a9ac5d22bda1 and project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:49.707695 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fb83ce2e-49b5-45a0-92dc-9cc7c7678cc7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.135084 Aug 29 15:49:49.708394 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2899/5618] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:49:49 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:49.737772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b1bf9d7-2da3-4da4-b475-b96723c98882 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '.version_select at 0x7fc433c04ee0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:49.749386 n-d-839401-11 devstack@n-api.service[122360]: WARNING oslo_db.sqlalchemy.utils [None req-8b1bf9d7-2da3-4da4-b475-b96723c98882 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:49:49.762597 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8b1bf9d7-2da3-4da4-b475-b96723c98882 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.046403 Aug 29 15:49:49.765009 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2900/5619] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:49:49 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:49.974059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-419083399", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "key_name": "tempest-key-1853576478", "networks": [{"uuid": "e7e1a9e7-4d7f-4958-9bd4-e4039baa5a12"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:50.142560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] validate_networks() for [('e7e1a9e7-4d7f-4958-9bd4-e4039baa5a12', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:49:50.239166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-55c181b7-5638-4be5-a612-446d24cef697 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:50.249366 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-55c181b7-5638-4be5-a612-446d24cef697 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1511 microversion: 2.1 time: 1.100596 Aug 29 15:49:50.254411 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2720/5620] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:49 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1511 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:50.492343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3f1f92fb-6015-4a9b-8c16-fac3f95f1df1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:50.511845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3f1f92fb-6015-4a9b-8c16-fac3f95f1df1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:50.524552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f1f92fb-6015-4a9b-8c16-fac3f95f1df1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:50.526100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f1f92fb-6015-4a9b-8c16-fac3f95f1df1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:50.527426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f1f92fb-6015-4a9b-8c16-fac3f95f1df1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.528983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f1f92fb-6015-4a9b-8c16-fac3f95f1df1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:50.529732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f1f92fb-6015-4a9b-8c16-fac3f95f1df1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:50.530408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f1f92fb-6015-4a9b-8c16-fac3f95f1df1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.683770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3f1f92fb-6015-4a9b-8c16-fac3f95f1df1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:50.692506 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3f1f92fb-6015-4a9b-8c16-fac3f95f1df1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1283 microversion: 2.1 time: 0.210903 Aug 29 15:49:50.696575 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2721/5621] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:50 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1283 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:50.710868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-cd5b77ad-16c6-479c-9cfa-b1ce43c6b399 req-747f8174-fc6d-4bea-8920-0176fa6609f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cbe7b40-fde9-4090-8c20-74c27c5af79b", "tag": "55968408-6166-427a-867d-93135f6ec6d5"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:50.736420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cd5b77ad-16c6-479c-9cfa-b1ce43c6b399 req-747f8174-fc6d-4bea-8920-0176fa6609f3 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:50.739883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cd5b77ad-16c6-479c-9cfa-b1ce43c6b399 req-747f8174-fc6d-4bea-8920-0176fa6609f3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:50.740747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cd5b77ad-16c6-479c-9cfa-b1ce43c6b399 req-747f8174-fc6d-4bea-8920-0176fa6609f3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.775884 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-cd5b77ad-16c6-479c-9cfa-b1ce43c6b399 req-747f8174-fc6d-4bea-8920-0176fa6609f3 service nova] Creating event network-changed:55968408-6166-427a-867d-93135f6ec6d5 for instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b on n-h2-839401-11 Aug 29 15:49:50.789963 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-cd5b77ad-16c6-479c-9cfa-b1ce43c6b399 req-747f8174-fc6d-4bea-8920-0176fa6609f3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088739 Aug 29 15:49:50.791830 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2722/5622] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:51.279991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-55a6f817-516e-49a9-aa21-1e01cb77441b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:51.281623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-55a6f817-516e-49a9-aa21-1e01cb77441b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:51.298824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55a6f817-516e-49a9-aa21-1e01cb77441b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:51.299378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55a6f817-516e-49a9-aa21-1e01cb77441b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:51.301175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55a6f817-516e-49a9-aa21-1e01cb77441b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:51.301937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55a6f817-516e-49a9-aa21-1e01cb77441b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:51.302402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55a6f817-516e-49a9-aa21-1e01cb77441b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:51.306477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55a6f817-516e-49a9-aa21-1e01cb77441b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:51.875986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-55a6f817-516e-49a9-aa21-1e01cb77441b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:51.889000 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-55a6f817-516e-49a9-aa21-1e01cb77441b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1511 microversion: 2.1 time: 0.615204 Aug 29 15:49:51.909707 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2723/5623] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:51 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1511 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:51.914792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b67272c-56b2-4551-9934-499538883a0e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:51.915415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4b67272c-56b2-4551-9934-499538883a0e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:51.934012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b67272c-56b2-4551-9934-499538883a0e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:51.934555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b67272c-56b2-4551-9934-499538883a0e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:51.935014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b67272c-56b2-4551-9934-499538883a0e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:51.935754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b67272c-56b2-4551-9934-499538883a0e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:51.936221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b67272c-56b2-4551-9934-499538883a0e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:51.936656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b67272c-56b2-4551-9934-499538883a0e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:52.318857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4b67272c-56b2-4551-9934-499538883a0e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:52.330453 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4b67272c-56b2-4551-9934-499538883a0e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1325 microversion: 2.1 time: 0.419479 Aug 29 15:49:52.334135 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2724/5624] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:51 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1325 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:52.627620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:52.628618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:52.629474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:52.630475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:52.631161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:52.652539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:52.654430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:52.656479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:52.658999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:52.660964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:52.665763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:52.723198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:52.730946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for user db3e87dfe49444f886b7a9ac5d22bda1 and project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:52.748308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:49:52.752036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:49:52.865833 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c86b3a34-6171-4a56-9344-5a1c63177076 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.895151 Aug 29 15:49:52.869780 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2901/5625] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:49:52.879234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2921ff35-b9c3-42cd-9fe4-8f58620b0f88 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:52.879848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2921ff35-b9c3-42cd-9fe4-8f58620b0f88 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:52.917637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f210c171-e402-40a8-9b4c-a04974343f8a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:52.919241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f210c171-e402-40a8-9b4c-a04974343f8a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:52.929716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f210c171-e402-40a8-9b4c-a04974343f8a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:52.931541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f210c171-e402-40a8-9b4c-a04974343f8a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:52.932274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f210c171-e402-40a8-9b4c-a04974343f8a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:52.936557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f210c171-e402-40a8-9b4c-a04974343f8a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:52.939678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f210c171-e402-40a8-9b4c-a04974343f8a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:52.940545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f210c171-e402-40a8-9b4c-a04974343f8a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.267985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f210c171-e402-40a8-9b4c-a04974343f8a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:53.282387 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f210c171-e402-40a8-9b4c-a04974343f8a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1511 microversion: 2.1 time: 0.369747 Aug 29 15:49:53.290030 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2902/5626] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:52 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1511 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:53.361343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-373b11ee-3ebe-451f-bf01-c9a2f6ed2e2a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:53.361343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-373b11ee-3ebe-451f-bf01-c9a2f6ed2e2a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:53.364914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373b11ee-3ebe-451f-bf01-c9a2f6ed2e2a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.365467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373b11ee-3ebe-451f-bf01-c9a2f6ed2e2a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.365909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373b11ee-3ebe-451f-bf01-c9a2f6ed2e2a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.366629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373b11ee-3ebe-451f-bf01-c9a2f6ed2e2a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.367090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373b11ee-3ebe-451f-bf01-c9a2f6ed2e2a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.367517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373b11ee-3ebe-451f-bf01-c9a2f6ed2e2a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.674093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-373b11ee-3ebe-451f-bf01-c9a2f6ed2e2a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:53.690729 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-373b11ee-3ebe-451f-bf01-c9a2f6ed2e2a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1325 microversion: 2.1 time: 0.340633 Aug 29 15:49:53.706281 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2903/5627] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:53 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1325 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:53.906168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2921ff35-b9c3-42cd-9fe4-8f58620b0f88 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:53.920963 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2921ff35-b9c3-42cd-9fe4-8f58620b0f88 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1228 microversion: 2.1 time: 1.045909 Aug 29 15:49:53.930604 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2725/5628] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:52 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1228 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:54.310250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a9725c5e-09f0-4d66-82e7-6d14cecf061c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:54.310875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a9725c5e-09f0-4d66-82e7-6d14cecf061c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:54.328821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9725c5e-09f0-4d66-82e7-6d14cecf061c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.329310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9725c5e-09f0-4d66-82e7-6d14cecf061c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.329960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9725c5e-09f0-4d66-82e7-6d14cecf061c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.330713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9725c5e-09f0-4d66-82e7-6d14cecf061c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.331177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9725c5e-09f0-4d66-82e7-6d14cecf061c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.331610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9725c5e-09f0-4d66-82e7-6d14cecf061c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.489307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-ac79dea6-f41f-462f-8fab-e1fcc8f4f654 req-d44896af-058b-4f68-abea-ebb4268d1a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78f934d9-5e74-4e6c-9e70-0788281777b4", "tag": "7eb08a4f-79df-49d3-adc3-43214302ba67"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:54.502831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ac79dea6-f41f-462f-8fab-e1fcc8f4f654 req-d44896af-058b-4f68-abea-ebb4268d1a65 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.503556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ac79dea6-f41f-462f-8fab-e1fcc8f4f654 req-d44896af-058b-4f68-abea-ebb4268d1a65 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.504255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ac79dea6-f41f-462f-8fab-e1fcc8f4f654 req-d44896af-058b-4f68-abea-ebb4268d1a65 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.524146 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-ac79dea6-f41f-462f-8fab-e1fcc8f4f654 req-d44896af-058b-4f68-abea-ebb4268d1a65 service nova] Creating event network-changed:7eb08a4f-79df-49d3-adc3-43214302ba67 for instance 78f934d9-5e74-4e6c-9e70-0788281777b4 on n-h1-839401-11 Aug 29 15:49:54.530988 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-ac79dea6-f41f-462f-8fab-e1fcc8f4f654 req-d44896af-058b-4f68-abea-ebb4268d1a65 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046134 Aug 29 15:49:54.532338 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2726/5629] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:49:54.669557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a9725c5e-09f0-4d66-82e7-6d14cecf061c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:54.680052 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a9725c5e-09f0-4d66-82e7-6d14cecf061c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1532 microversion: 2.1 time: 0.375028 Aug 29 15:49:54.681396 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2904/5630] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:54 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1532 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:54.714311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9b0f9590-f665-4f7e-8942-98b2fe5ab6d2 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:54.715896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9b0f9590-f665-4f7e-8942-98b2fe5ab6d2 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:54.723208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b0f9590-f665-4f7e-8942-98b2fe5ab6d2 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.724166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b0f9590-f665-4f7e-8942-98b2fe5ab6d2 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.725363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b0f9590-f665-4f7e-8942-98b2fe5ab6d2 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.726939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b0f9590-f665-4f7e-8942-98b2fe5ab6d2 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.727939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b0f9590-f665-4f7e-8942-98b2fe5ab6d2 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.728449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b0f9590-f665-4f7e-8942-98b2fe5ab6d2 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.947798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-37b73a4c-ed09-477e-9d86-f27812b8d2d7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:54.948453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-37b73a4c-ed09-477e-9d86-f27812b8d2d7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:54.965638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37b73a4c-ed09-477e-9d86-f27812b8d2d7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.966581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37b73a4c-ed09-477e-9d86-f27812b8d2d7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.967033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37b73a4c-ed09-477e-9d86-f27812b8d2d7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.967770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37b73a4c-ed09-477e-9d86-f27812b8d2d7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.981631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37b73a4c-ed09-477e-9d86-f27812b8d2d7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.982292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37b73a4c-ed09-477e-9d86-f27812b8d2d7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:55.027039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9b0f9590-f665-4f7e-8942-98b2fe5ab6d2 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:55.038861 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9b0f9590-f665-4f7e-8942-98b2fe5ab6d2 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1325 microversion: 2.1 time: 0.329374 Aug 29 15:49:55.044368 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2727/5631] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:54 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1325 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:55.115102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-37b73a4c-ed09-477e-9d86-f27812b8d2d7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:55.123966 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-37b73a4c-ed09-477e-9d86-f27812b8d2d7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1288 microversion: 2.1 time: 0.180020 Aug 29 15:49:55.129753 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2905/5632] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:54 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1288 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:55.702254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f5552d73-6e99-42d6-b9bf-a98ce101648b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:55.702882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f5552d73-6e99-42d6-b9bf-a98ce101648b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:55.721240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5552d73-6e99-42d6-b9bf-a98ce101648b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:55.725243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5552d73-6e99-42d6-b9bf-a98ce101648b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:55.725899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5552d73-6e99-42d6-b9bf-a98ce101648b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:55.727088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5552d73-6e99-42d6-b9bf-a98ce101648b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:55.728135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5552d73-6e99-42d6-b9bf-a98ce101648b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:55.729903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5552d73-6e99-42d6-b9bf-a98ce101648b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.067056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f368856f-bc47-40e8-bc5f-1f26d368ab2e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:56.068445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f368856f-bc47-40e8-bc5f-1f26d368ab2e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:56.099107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f368856f-bc47-40e8-bc5f-1f26d368ab2e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.101286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f368856f-bc47-40e8-bc5f-1f26d368ab2e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.101976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f368856f-bc47-40e8-bc5f-1f26d368ab2e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.102749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f368856f-bc47-40e8-bc5f-1f26d368ab2e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.103229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f368856f-bc47-40e8-bc5f-1f26d368ab2e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.105908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f368856f-bc47-40e8-bc5f-1f26d368ab2e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.308378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f5552d73-6e99-42d6-b9bf-a98ce101648b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:56.320823 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f5552d73-6e99-42d6-b9bf-a98ce101648b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1532 microversion: 2.1 time: 0.622313 Aug 29 15:49:56.322108 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2728/5633] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:55 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1532 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:56.329139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-02bc8a06-e027-4051-a257-f88e5838e5b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:56.330979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-02bc8a06-e027-4051-a257-f88e5838e5b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:56.338652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02bc8a06-e027-4051-a257-f88e5838e5b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.339222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02bc8a06-e027-4051-a257-f88e5838e5b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.339730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02bc8a06-e027-4051-a257-f88e5838e5b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.340594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02bc8a06-e027-4051-a257-f88e5838e5b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.341147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02bc8a06-e027-4051-a257-f88e5838e5b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.341808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02bc8a06-e027-4051-a257-f88e5838e5b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.350482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f368856f-bc47-40e8-bc5f-1f26d368ab2e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:56.366691 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f368856f-bc47-40e8-bc5f-1f26d368ab2e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1325 microversion: 2.1 time: 0.301117 Aug 29 15:49:56.368522 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2906/5634] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:56 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1325 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:56.531480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-02bc8a06-e027-4051-a257-f88e5838e5b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:56.541007 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-02bc8a06-e027-4051-a257-f88e5838e5b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1328 microversion: 2.1 time: 0.217537 Aug 29 15:49:56.541717 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2729/5635] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:56 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1328 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:56.608787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-84f1fd4b-b057-493c-9be7-5615fdbcc8ac tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:56.609335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-84f1fd4b-b057-493c-9be7-5615fdbcc8ac tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:56.616848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84f1fd4b-b057-493c-9be7-5615fdbcc8ac tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.617398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84f1fd4b-b057-493c-9be7-5615fdbcc8ac tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.617839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84f1fd4b-b057-493c-9be7-5615fdbcc8ac tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.618538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84f1fd4b-b057-493c-9be7-5615fdbcc8ac tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.618996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84f1fd4b-b057-493c-9be7-5615fdbcc8ac tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.619437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84f1fd4b-b057-493c-9be7-5615fdbcc8ac tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.648049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-84f1fd4b-b057-493c-9be7-5615fdbcc8ac tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:49:56.737160 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-84f1fd4b-b057-493c-9be7-5615fdbcc8ac tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 204 len: 0 microversion: 2.1 time: 0.132040 Aug 29 15:49:56.737922 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2907/5636] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:56 2022] DELETE /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:49:56.746097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1a75a739-3621-4a56-b8ac-d7e1ecc78fe2 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:56.746817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1a75a739-3621-4a56-b8ac-d7e1ecc78fe2 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:56.754551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a75a739-3621-4a56-b8ac-d7e1ecc78fe2 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.755085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a75a739-3621-4a56-b8ac-d7e1ecc78fe2 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.755523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a75a739-3621-4a56-b8ac-d7e1ecc78fe2 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.756220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a75a739-3621-4a56-b8ac-d7e1ecc78fe2 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.756701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a75a739-3621-4a56-b8ac-d7e1ecc78fe2 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.757147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a75a739-3621-4a56-b8ac-d7e1ecc78fe2 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.902951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1a75a739-3621-4a56-b8ac-d7e1ecc78fe2 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:56.912652 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1a75a739-3621-4a56-b8ac-d7e1ecc78fe2 tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1514 microversion: 2.1 time: 0.170338 Aug 29 15:49:56.913251 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2730/5637] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:56 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:57.343061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-39b6c5f0-030f-474e-a604-96b0fe048b99 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:57.343913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-39b6c5f0-030f-474e-a604-96b0fe048b99 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:57.351869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b6c5f0-030f-474e-a604-96b0fe048b99 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.352359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b6c5f0-030f-474e-a604-96b0fe048b99 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.352835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b6c5f0-030f-474e-a604-96b0fe048b99 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:57.353566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b6c5f0-030f-474e-a604-96b0fe048b99 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.354016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b6c5f0-030f-474e-a604-96b0fe048b99 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.355209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39b6c5f0-030f-474e-a604-96b0fe048b99 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:57.388559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e37651dc-5b4e-402f-be70-b69e1e3c4bf1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:57.389544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e37651dc-5b4e-402f-be70-b69e1e3c4bf1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:57.396732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e37651dc-5b4e-402f-be70-b69e1e3c4bf1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.397854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e37651dc-5b4e-402f-be70-b69e1e3c4bf1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.398666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e37651dc-5b4e-402f-be70-b69e1e3c4bf1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:57.399670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e37651dc-5b4e-402f-be70-b69e1e3c4bf1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.400526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e37651dc-5b4e-402f-be70-b69e1e3c4bf1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.401224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e37651dc-5b4e-402f-be70-b69e1e3c4bf1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:57.514785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-39b6c5f0-030f-474e-a604-96b0fe048b99 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:57.524751 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-39b6c5f0-030f-474e-a604-96b0fe048b99 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1532 microversion: 2.1 time: 0.186034 Aug 29 15:49:57.525386 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2908/5638] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:57 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1532 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:57.562879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-409b25c1-0c41-456b-8371-0aca2ea2a34d req-f7c3deac-31c1-44ab-a73b-cda2cdc9f1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0fd8c4a-7225-496b-a071-6fd8f37dc60a", "name": "network-vif-plugged", "status": "completed", "tag": "8dc04ade-2041-4d24-bbaf-7f8f25a7e827"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:57.573416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-409b25c1-0c41-456b-8371-0aca2ea2a34d req-f7c3deac-31c1-44ab-a73b-cda2cdc9f1a9 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.574203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-409b25c1-0c41-456b-8371-0aca2ea2a34d req-f7c3deac-31c1-44ab-a73b-cda2cdc9f1a9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.574709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-409b25c1-0c41-456b-8371-0aca2ea2a34d req-f7c3deac-31c1-44ab-a73b-cda2cdc9f1a9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:57.579388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:57.588120 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-409b25c1-0c41-456b-8371-0aca2ea2a34d req-f7c3deac-31c1-44ab-a73b-cda2cdc9f1a9 service nova] Creating event network-vif-plugged:8dc04ade-2041-4d24-bbaf-7f8f25a7e827 for instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a on n-h1-839401-11 Aug 29 15:49:57.594374 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-409b25c1-0c41-456b-8371-0aca2ea2a34d req-f7c3deac-31c1-44ab-a73b-cda2cdc9f1a9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036416 Aug 29 15:49:57.595433 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2909/5639] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:57.602189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cc6a3d48-eaf1-4be5-9afb-50daafa2f0ae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:57.602967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cc6a3d48-eaf1-4be5-9afb-50daafa2f0ae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:57.608214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e37651dc-5b4e-402f-be70-b69e1e3c4bf1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:57.610149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc6a3d48-eaf1-4be5-9afb-50daafa2f0ae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.610715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc6a3d48-eaf1-4be5-9afb-50daafa2f0ae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.611232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc6a3d48-eaf1-4be5-9afb-50daafa2f0ae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:57.612098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc6a3d48-eaf1-4be5-9afb-50daafa2f0ae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.612634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc6a3d48-eaf1-4be5-9afb-50daafa2f0ae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.613218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc6a3d48-eaf1-4be5-9afb-50daafa2f0ae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:57.617617 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e37651dc-5b4e-402f-be70-b69e1e3c4bf1 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1325 microversion: 2.1 time: 0.233658 Aug 29 15:49:57.618214 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2731/5640] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:57 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1325 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:57.764483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cc6a3d48-eaf1-4be5-9afb-50daafa2f0ae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:57.774944 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cc6a3d48-eaf1-4be5-9afb-50daafa2f0ae tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1328 microversion: 2.1 time: 0.177705 Aug 29 15:49:57.777197 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2910/5641] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:57 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1328 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:57.935555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f1f5b10d-3eeb-4b32-a32f-7a2d24cb032e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:57.936155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f1f5b10d-3eeb-4b32-a32f-7a2d24cb032e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:57.943725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1f5b10d-3eeb-4b32-a32f-7a2d24cb032e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.944468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1f5b10d-3eeb-4b32-a32f-7a2d24cb032e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.944905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1f5b10d-3eeb-4b32-a32f-7a2d24cb032e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:57.946433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1f5b10d-3eeb-4b32-a32f-7a2d24cb032e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.947075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1f5b10d-3eeb-4b32-a32f-7a2d24cb032e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.947509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1f5b10d-3eeb-4b32-a32f-7a2d24cb032e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.206991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f1f5b10d-3eeb-4b32-a32f-7a2d24cb032e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:58.216778 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f1f5b10d-3eeb-4b32-a32f-7a2d24cb032e tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1514 microversion: 2.1 time: 0.285989 Aug 29 15:49:58.217425 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2732/5642] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:57 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1514 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:58.546541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2ce20f17-607f-4786-a238-7094b0cb0319 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:58.548619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2ce20f17-607f-4786-a238-7094b0cb0319 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:58.552847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:58.556995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ce20f17-607f-4786-a238-7094b0cb0319 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.557558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ce20f17-607f-4786-a238-7094b0cb0319 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.558413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ce20f17-607f-4786-a238-7094b0cb0319 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.559133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ce20f17-607f-4786-a238-7094b0cb0319 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.559590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ce20f17-607f-4786-a238-7094b0cb0319 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.560010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ce20f17-607f-4786-a238-7094b0cb0319 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.640108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8e883844-ae52-4adf-96bc-06399dcc80bb tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:58.641643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8e883844-ae52-4adf-96bc-06399dcc80bb tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:58.649717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e883844-ae52-4adf-96bc-06399dcc80bb tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.650480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e883844-ae52-4adf-96bc-06399dcc80bb tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.651089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e883844-ae52-4adf-96bc-06399dcc80bb tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.652038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e883844-ae52-4adf-96bc-06399dcc80bb tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.652662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e883844-ae52-4adf-96bc-06399dcc80bb tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.653283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e883844-ae52-4adf-96bc-06399dcc80bb tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.658380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:58.772718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2ce20f17-607f-4786-a238-7094b0cb0319 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:58.781244 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2ce20f17-607f-4786-a238-7094b0cb0319 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1532 microversion: 2.1 time: 0.238680 Aug 29 15:49:58.782180 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2911/5643] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:58 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1532 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:58.799036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-95811d47-ad41-4537-8dc8-501d68c70892 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:58.800003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-95811d47-ad41-4537-8dc8-501d68c70892 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:58.808392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95811d47-ad41-4537-8dc8-501d68c70892 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.809448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95811d47-ad41-4537-8dc8-501d68c70892 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.810117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95811d47-ad41-4537-8dc8-501d68c70892 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.811463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95811d47-ad41-4537-8dc8-501d68c70892 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.812160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95811d47-ad41-4537-8dc8-501d68c70892 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.812801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95811d47-ad41-4537-8dc8-501d68c70892 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.966952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8e883844-ae52-4adf-96bc-06399dcc80bb tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:58.976649 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8e883844-ae52-4adf-96bc-06399dcc80bb tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1325 microversion: 2.1 time: 0.340537 Aug 29 15:49:58.989229 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2733/5644] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:58 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1325 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:59.092934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-95811d47-ad41-4537-8dc8-501d68c70892 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:59.101934 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-95811d47-ad41-4537-8dc8-501d68c70892 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1328 microversion: 2.1 time: 0.309560 Aug 29 15:49:59.107786 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2912/5645] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:58 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1328 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:59.240404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-16b092dd-af14-4b3d-8109-a886d05affbb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:59.241040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-16b092dd-af14-4b3d-8109-a886d05affbb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:59.258132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16b092dd-af14-4b3d-8109-a886d05affbb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.258944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16b092dd-af14-4b3d-8109-a886d05affbb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.262931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16b092dd-af14-4b3d-8109-a886d05affbb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.264153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16b092dd-af14-4b3d-8109-a886d05affbb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.264805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16b092dd-af14-4b3d-8109-a886d05affbb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.265868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-16b092dd-af14-4b3d-8109-a886d05affbb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.354478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-c237ef1b-49bb-4256-9d91-0c27a9bf23b6 req-10281e22-1eec-41de-a7df-163cbf152dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31116131-8b70-4019-aa25-d3b9e58d2e1b", "tag": "0c103c97-e46e-4049-8d56-d8e8304f1ea7"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:59.382170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c237ef1b-49bb-4256-9d91-0c27a9bf23b6 req-10281e22-1eec-41de-a7df-163cbf152dc5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.382735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c237ef1b-49bb-4256-9d91-0c27a9bf23b6 req-10281e22-1eec-41de-a7df-163cbf152dc5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.383224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c237ef1b-49bb-4256-9d91-0c27a9bf23b6 req-10281e22-1eec-41de-a7df-163cbf152dc5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.401622 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-c237ef1b-49bb-4256-9d91-0c27a9bf23b6 req-10281e22-1eec-41de-a7df-163cbf152dc5 service nova] Creating event network-changed:0c103c97-e46e-4049-8d56-d8e8304f1ea7 for instance 31116131-8b70-4019-aa25-d3b9e58d2e1b on n-h1-839401-11 Aug 29 15:49:59.410330 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-c237ef1b-49bb-4256-9d91-0c27a9bf23b6 req-10281e22-1eec-41de-a7df-163cbf152dc5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236362 Aug 29 15:49:59.411457 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2734/5646] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:49:59.514258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-16b092dd-af14-4b3d-8109-a886d05affbb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:59.523126 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-16b092dd-af14-4b3d-8109-a886d05affbb tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1514 microversion: 2.1 time: 0.287678 Aug 29 15:49:59.524476 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2913/5647] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:59 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1514 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:59.806111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-538f0cbe-5040-4f47-ab28-41c66c8c3853 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:59.806801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-538f0cbe-5040-4f47-ab28-41c66c8c3853 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:59.813719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-538f0cbe-5040-4f47-ab28-41c66c8c3853 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.814775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-538f0cbe-5040-4f47-ab28-41c66c8c3853 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.815717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-538f0cbe-5040-4f47-ab28-41c66c8c3853 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.816595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-538f0cbe-5040-4f47-ab28-41c66c8c3853 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.817249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-538f0cbe-5040-4f47-ab28-41c66c8c3853 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.817948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-538f0cbe-5040-4f47-ab28-41c66c8c3853 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.998867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4156fd08-9e7c-4e31-8503-9e01f6bb0526 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:59.999490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4156fd08-9e7c-4e31-8503-9e01f6bb0526 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:00.007677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4156fd08-9e7c-4e31-8503-9e01f6bb0526 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.008186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4156fd08-9e7c-4e31-8503-9e01f6bb0526 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.008669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4156fd08-9e7c-4e31-8503-9e01f6bb0526 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.009420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4156fd08-9e7c-4e31-8503-9e01f6bb0526 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.010350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4156fd08-9e7c-4e31-8503-9e01f6bb0526 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.010820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4156fd08-9e7c-4e31-8503-9e01f6bb0526 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.046257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-538f0cbe-5040-4f47-ab28-41c66c8c3853 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:00.054841 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-538f0cbe-5040-4f47-ab28-41c66c8c3853 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1532 microversion: 2.1 time: 0.253344 Aug 29 15:50:00.057127 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2735/5648] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:59 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1532 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:00.123493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4acf3db1-3bfe-4841-bdb0-2e64f6fed8f9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:00.124402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4acf3db1-3bfe-4841-bdb0-2e64f6fed8f9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:00.131129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4acf3db1-3bfe-4841-bdb0-2e64f6fed8f9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.131628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4acf3db1-3bfe-4841-bdb0-2e64f6fed8f9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.132197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4acf3db1-3bfe-4841-bdb0-2e64f6fed8f9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.132909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4acf3db1-3bfe-4841-bdb0-2e64f6fed8f9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.139513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4acf3db1-3bfe-4841-bdb0-2e64f6fed8f9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.139941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4acf3db1-3bfe-4841-bdb0-2e64f6fed8f9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.251989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4156fd08-9e7c-4e31-8503-9e01f6bb0526 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:00.264678 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4156fd08-9e7c-4e31-8503-9e01f6bb0526 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1325 microversion: 2.1 time: 0.268893 Aug 29 15:50:00.265629 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2914/5649] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:59 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1325 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:00.338235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-020a723c-65cf-43bf-8d46-7523019ae066 req-c8d8f6f5-790b-418f-a88a-f71ed9009775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c86c100-b9bb-4ec4-b849-672fa3a330b5", "name": "network-vif-deleted", "tag": "3ca29955-4579-41d9-b420-15076a70bb0b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:00.357711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-020a723c-65cf-43bf-8d46-7523019ae066 req-c8d8f6f5-790b-418f-a88a-f71ed9009775 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.358193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-020a723c-65cf-43bf-8d46-7523019ae066 req-c8d8f6f5-790b-418f-a88a-f71ed9009775 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.358635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-020a723c-65cf-43bf-8d46-7523019ae066 req-c8d8f6f5-790b-418f-a88a-f71ed9009775 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.365525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4acf3db1-3bfe-4841-bdb0-2e64f6fed8f9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:00.377491 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-020a723c-65cf-43bf-8d46-7523019ae066 req-c8d8f6f5-790b-418f-a88a-f71ed9009775 service nova] Creating event network-vif-deleted:3ca29955-4579-41d9-b420-15076a70bb0b for instance 3c86c100-b9bb-4ec4-b849-672fa3a330b5 on n-h2-839401-11 Aug 29 15:50:00.383295 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-020a723c-65cf-43bf-8d46-7523019ae066 req-c8d8f6f5-790b-418f-a88a-f71ed9009775 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058241 Aug 29 15:50:00.384472 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2915/5650] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:00.405066 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4acf3db1-3bfe-4841-bdb0-2e64f6fed8f9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1328 microversion: 2.1 time: 0.285808 Aug 29 15:50:00.405939 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2736/5651] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:00 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1328 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:00.546579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e15cb18c-fde0-4f60-94f1-bde94cc0790d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:00.547498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e15cb18c-fde0-4f60-94f1-bde94cc0790d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:00.556061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e15cb18c-fde0-4f60-94f1-bde94cc0790d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.556533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e15cb18c-fde0-4f60-94f1-bde94cc0790d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.556998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e15cb18c-fde0-4f60-94f1-bde94cc0790d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.557809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e15cb18c-fde0-4f60-94f1-bde94cc0790d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.558448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e15cb18c-fde0-4f60-94f1-bde94cc0790d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.558871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e15cb18c-fde0-4f60-94f1-bde94cc0790d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.598602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e15cb18c-fde0-4f60-94f1-bde94cc0790d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.599126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e15cb18c-fde0-4f60-94f1-bde94cc0790d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.599565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e15cb18c-fde0-4f60-94f1-bde94cc0790d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.600020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-e15cb18c-fde0-4f60-94f1-bde94cc0790d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lazy-loading 'fault' on Instance uuid 3c86c100-b9bb-4ec4-b849-672fa3a330b5 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:50:00.663593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e15cb18c-fde0-4f60-94f1-bde94cc0790d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53af5a51f87647d0ae78531c72554ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9a115c069d424caee396c6dfd3fa50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:00.671792 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e15cb18c-fde0-4f60-94f1-bde94cc0790d tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 200 len: 1308 microversion: 2.1 time: 0.130043 Aug 29 15:50:00.672468 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2916/5652] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:00 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 1308 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:01.078215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c0d4bd9c-65f6-4c8d-bd69-a47607ac9105 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:01.080317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c0d4bd9c-65f6-4c8d-bd69-a47607ac9105 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:01.083371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=98 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:01.099017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d4bd9c-65f6-4c8d-bd69-a47607ac9105 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.099781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d4bd9c-65f6-4c8d-bd69-a47607ac9105 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.100214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d4bd9c-65f6-4c8d-bd69-a47607ac9105 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.100932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d4bd9c-65f6-4c8d-bd69-a47607ac9105 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.101409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d4bd9c-65f6-4c8d-bd69-a47607ac9105 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.101831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d4bd9c-65f6-4c8d-bd69-a47607ac9105 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.287259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-defce8e3-bfeb-4d79-a8db-c20a1316531e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:01.288632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-defce8e3-bfeb-4d79-a8db-c20a1316531e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:01.293878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c0d4bd9c-65f6-4c8d-bd69-a47607ac9105 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:01.299685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-defce8e3-bfeb-4d79-a8db-c20a1316531e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.300366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-defce8e3-bfeb-4d79-a8db-c20a1316531e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.301332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-defce8e3-bfeb-4d79-a8db-c20a1316531e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.302057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-defce8e3-bfeb-4d79-a8db-c20a1316531e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.302517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-defce8e3-bfeb-4d79-a8db-c20a1316531e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.304065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-defce8e3-bfeb-4d79-a8db-c20a1316531e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.305516 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c0d4bd9c-65f6-4c8d-bd69-a47607ac9105 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1532 microversion: 2.1 time: 0.232495 Aug 29 15:50:01.307147 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2737/5653] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:01 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1532 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:01.427299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-63e6f81e-89f7-4ca9-81ce-3856e3c913bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:01.428254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-63e6f81e-89f7-4ca9-81ce-3856e3c913bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:01.435142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63e6f81e-89f7-4ca9-81ce-3856e3c913bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.436594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63e6f81e-89f7-4ca9-81ce-3856e3c913bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.437195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63e6f81e-89f7-4ca9-81ce-3856e3c913bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.438121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63e6f81e-89f7-4ca9-81ce-3856e3c913bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.438682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63e6f81e-89f7-4ca9-81ce-3856e3c913bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.439185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63e6f81e-89f7-4ca9-81ce-3856e3c913bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.589821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-63e6f81e-89f7-4ca9-81ce-3856e3c913bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:01.599639 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-63e6f81e-89f7-4ca9-81ce-3856e3c913bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1328 microversion: 2.1 time: 0.176689 Aug 29 15:50:01.600513 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2738/5654] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:01 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1328 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:01.693387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f77222e4-d20c-4c02-820b-7b3f189849fc tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:01.694261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f77222e4-d20c-4c02-820b-7b3f189849fc tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] [instance: 3c86c100-b9bb-4ec4-b849-672fa3a330b5] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:01.701237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f77222e4-d20c-4c02-820b-7b3f189849fc tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.701736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f77222e4-d20c-4c02-820b-7b3f189849fc tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.702169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f77222e4-d20c-4c02-820b-7b3f189849fc tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.702877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f77222e4-d20c-4c02-820b-7b3f189849fc tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.703327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f77222e4-d20c-4c02-820b-7b3f189849fc tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.703747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f77222e4-d20c-4c02-820b-7b3f189849fc tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.719229 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-f77222e4-d20c-4c02-820b-7b3f189849fc tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] HTTP exception thrown: Instance 3c86c100-b9bb-4ec4-b849-672fa3a330b5 could not be found. Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f77222e4-d20c-4c02-820b-7b3f189849fc tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Request method failure captured: Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 HTTP/1.1 Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN8d45lCidmdLz0ugzp-JQiPaohSsTYvE-yC23Y5T3cGSGEfM26ahWch4pPQyEWtaKSd_P_KMocgTTR6nWOAaz90J5viCtxdRLL8Juq9VYCzWIOeBez0w2x2TqgRcOuHupbsER01P6G2C7LoJVeqjfLDh30QLVw34axUcOOyKodddzo Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 9f9a115c069d424caee396c6dfd3fa50 Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-VolumesSnapshotTestJSON-388071742 Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9f9a115c069d424caee396c6dfd3fa50", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9f9a115c069d424caee396c6dfd3fa50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9f9a115c069d424caee396c6dfd3fa50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9f9a115c069d424caee396c6dfd3fa50"}]}] Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-VolumesSnapshotTestJSON-388071742 Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 9f9a115c069d424caee396c6dfd3fa50 Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-388071742 Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-VolumesSnapshotTestJSON-388071742-project Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 53af5a51f87647d0ae78531c72554ca6 Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-VolumesSnapshotTestJSON-388071742-project Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 3c86c100-b9bb-4ec4-b849-672fa3a330b5 could not be found. Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '3c86c100-b9bb-4ec4-b849-672fa3a330b5'} Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c86c100-b9bb-4ec4-b849-672fa3a330b5 could not be found. Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c86c100-b9bb-4ec4-b849-672fa3a330b5 could not be found. Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:01.720952 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:01.729435 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:01.729435 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:01.729435 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:01.729435 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:01.729435 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:01.729435 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c86c100-b9bb-4ec4-b849-672fa3a330b5 could not be found. Aug 29 15:50:01.729435 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:01.729435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f77222e4-d20c-4c02-820b-7b3f189849fc tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] Returning 404 to user: Instance 3c86c100-b9bb-4ec4-b849-672fa3a330b5 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:01.729435 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f77222e4-d20c-4c02-820b-7b3f189849fc tempest-VolumesSnapshotTestJSON-388071742 tempest-VolumesSnapshotTestJSON-388071742-project] 10.222.0.62 "GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5" status: 404 len: 111 microversion: 2.1 time: 0.033350 Aug 29 15:50:01.729435 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2739/5655] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:01 2022] GET /compute/v2.1/servers/3c86c100-b9bb-4ec4-b849-672fa3a330b5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:50:01.930552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-defce8e3-bfeb-4d79-a8db-c20a1316531e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:01.938807 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-defce8e3-bfeb-4d79-a8db-c20a1316531e tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1325 microversion: 2.1 time: 0.655761 Aug 29 15:50:01.939491 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2917/5656] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:01 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1325 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:02.336440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-007fd07c-c0c6-48ce-91d4-38465b0fa548 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:02.338028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-007fd07c-c0c6-48ce-91d4-38465b0fa548 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:02.345575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-007fd07c-c0c6-48ce-91d4-38465b0fa548 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:02.346470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-007fd07c-c0c6-48ce-91d4-38465b0fa548 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:02.347155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-007fd07c-c0c6-48ce-91d4-38465b0fa548 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:02.348140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-007fd07c-c0c6-48ce-91d4-38465b0fa548 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:02.348701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-007fd07c-c0c6-48ce-91d4-38465b0fa548 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:02.349262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-007fd07c-c0c6-48ce-91d4-38465b0fa548 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:02.491541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-007fd07c-c0c6-48ce-91d4-38465b0fa548 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:02.500713 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-007fd07c-c0c6-48ce-91d4-38465b0fa548 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1532 microversion: 2.1 time: 0.173646 Aug 29 15:50:02.510044 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2740/5657] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:02 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1532 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:02.620709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-14a2c899-f395-4322-a9ed-70aeedd3d271 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:02.621298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-14a2c899-f395-4322-a9ed-70aeedd3d271 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:02.628795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14a2c899-f395-4322-a9ed-70aeedd3d271 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:02.629431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14a2c899-f395-4322-a9ed-70aeedd3d271 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:02.629949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14a2c899-f395-4322-a9ed-70aeedd3d271 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:02.630793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14a2c899-f395-4322-a9ed-70aeedd3d271 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:02.631479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14a2c899-f395-4322-a9ed-70aeedd3d271 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:02.632054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14a2c899-f395-4322-a9ed-70aeedd3d271 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:02.687722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:02.741845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=18 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:02.926977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-14a2c899-f395-4322-a9ed-70aeedd3d271 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:02.935679 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-14a2c899-f395-4322-a9ed-70aeedd3d271 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1328 microversion: 2.1 time: 0.319252 Aug 29 15:50:02.942284 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2918/5658] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:02 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1328 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:02.962839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b23d8e89-ca1f-428d-ac69-4d47ddaeeb7f tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:02.963717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b23d8e89-ca1f-428d-ac69-4d47ddaeeb7f tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:02.971704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b23d8e89-ca1f-428d-ac69-4d47ddaeeb7f tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:02.972938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b23d8e89-ca1f-428d-ac69-4d47ddaeeb7f tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:02.973462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b23d8e89-ca1f-428d-ac69-4d47ddaeeb7f tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:02.974193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b23d8e89-ca1f-428d-ac69-4d47ddaeeb7f tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:02.974709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b23d8e89-ca1f-428d-ac69-4d47ddaeeb7f tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:02.975191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b23d8e89-ca1f-428d-ac69-4d47ddaeeb7f tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.158023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b23d8e89-ca1f-428d-ac69-4d47ddaeeb7f tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:03.172253 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b23d8e89-ca1f-428d-ac69-4d47ddaeeb7f tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1325 microversion: 2.1 time: 0.214304 Aug 29 15:50:03.173546 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2741/5659] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:02 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1325 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:03.523350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3190130c-fcd6-47e4-bfbc-531031a9bcb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:03.526201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3190130c-fcd6-47e4-bfbc-531031a9bcb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:03.544463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3190130c-fcd6-47e4-bfbc-531031a9bcb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.547224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3190130c-fcd6-47e4-bfbc-531031a9bcb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.547954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3190130c-fcd6-47e4-bfbc-531031a9bcb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.548749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3190130c-fcd6-47e4-bfbc-531031a9bcb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.549298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3190130c-fcd6-47e4-bfbc-531031a9bcb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.554501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3190130c-fcd6-47e4-bfbc-531031a9bcb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.919427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3190130c-fcd6-47e4-bfbc-531031a9bcb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:03.930387 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3190130c-fcd6-47e4-bfbc-531031a9bcb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1527 microversion: 2.1 time: 0.412067 Aug 29 15:50:03.946996 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2919/5660] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:03 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1527 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:03.956581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c207ee0f-a3ff-43b2-8d9c-d65407017610 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:03.957247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c207ee0f-a3ff-43b2-8d9c-d65407017610 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:03.961882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:03.975329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c207ee0f-a3ff-43b2-8d9c-d65407017610 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.975838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c207ee0f-a3ff-43b2-8d9c-d65407017610 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.976031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-fe3b38c1-703b-4d26-a8e3-e8d399c1f538 req-b787f7c2-659a-4e7e-98f0-0570f13b953e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f934d9-5e74-4e6c-9e70-0788281777b4", "name": "network-vif-plugged", "status": "completed", "tag": "7eb08a4f-79df-49d3-adc3-43214302ba67"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:03.976282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c207ee0f-a3ff-43b2-8d9c-d65407017610 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.977015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c207ee0f-a3ff-43b2-8d9c-d65407017610 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.977704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c207ee0f-a3ff-43b2-8d9c-d65407017610 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.978631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c207ee0f-a3ff-43b2-8d9c-d65407017610 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.994402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fe3b38c1-703b-4d26-a8e3-e8d399c1f538 req-b787f7c2-659a-4e7e-98f0-0570f13b953e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.996893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fe3b38c1-703b-4d26-a8e3-e8d399c1f538 req-b787f7c2-659a-4e7e-98f0-0570f13b953e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.997597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fe3b38c1-703b-4d26-a8e3-e8d399c1f538 req-b787f7c2-659a-4e7e-98f0-0570f13b953e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:04.032770 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-fe3b38c1-703b-4d26-a8e3-e8d399c1f538 req-b787f7c2-659a-4e7e-98f0-0570f13b953e service nova] Creating event network-vif-plugged:7eb08a4f-79df-49d3-adc3-43214302ba67 for instance 78f934d9-5e74-4e6c-9e70-0788281777b4 on n-h1-839401-11 Aug 29 15:50:04.044396 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-fe3b38c1-703b-4d26-a8e3-e8d399c1f538 req-b787f7c2-659a-4e7e-98f0-0570f13b953e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070997 Aug 29 15:50:04.047756 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2920/5661] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:50:04.193461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-913f0de7-e512-470d-9e97-a6505cf9d028 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:04.194750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-913f0de7-e512-470d-9e97-a6505cf9d028 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:04.218609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-913f0de7-e512-470d-9e97-a6505cf9d028 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:04.226560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-913f0de7-e512-470d-9e97-a6505cf9d028 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:04.227923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-913f0de7-e512-470d-9e97-a6505cf9d028 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:04.230009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-913f0de7-e512-470d-9e97-a6505cf9d028 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:04.231042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-913f0de7-e512-470d-9e97-a6505cf9d028 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:04.231866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-913f0de7-e512-470d-9e97-a6505cf9d028 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:04.276447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c207ee0f-a3ff-43b2-8d9c-d65407017610 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:04.299990 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c207ee0f-a3ff-43b2-8d9c-d65407017610 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1328 microversion: 2.1 time: 0.345835 Aug 29 15:50:04.300726 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2742/5662] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:03 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1328 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:04.597506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-913f0de7-e512-470d-9e97-a6505cf9d028 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:04.608777 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-913f0de7-e512-470d-9e97-a6505cf9d028 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1325 microversion: 2.1 time: 0.420145 Aug 29 15:50:04.628340 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2921/5663] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:04 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1325 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:04.970243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e7b4718c-2ccc-4802-9be2-d75e4181fdb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:04.971736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e7b4718c-2ccc-4802-9be2-d75e4181fdb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:04.981553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7b4718c-2ccc-4802-9be2-d75e4181fdb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:04.982443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7b4718c-2ccc-4802-9be2-d75e4181fdb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:04.983120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7b4718c-2ccc-4802-9be2-d75e4181fdb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:04.984457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7b4718c-2ccc-4802-9be2-d75e4181fdb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:04.986799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7b4718c-2ccc-4802-9be2-d75e4181fdb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:04.987484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7b4718c-2ccc-4802-9be2-d75e4181fdb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:05.321826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ac683541-949e-4914-8444-9b73a6c0abb7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:05.324392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ac683541-949e-4914-8444-9b73a6c0abb7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:05.332964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e7b4718c-2ccc-4802-9be2-d75e4181fdb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:05.335773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac683541-949e-4914-8444-9b73a6c0abb7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:05.337464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac683541-949e-4914-8444-9b73a6c0abb7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:05.338415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac683541-949e-4914-8444-9b73a6c0abb7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:05.339626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac683541-949e-4914-8444-9b73a6c0abb7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:05.340341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac683541-949e-4914-8444-9b73a6c0abb7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:05.341573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac683541-949e-4914-8444-9b73a6c0abb7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:05.344761 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e7b4718c-2ccc-4802-9be2-d75e4181fdb6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1527 microversion: 2.1 time: 0.378580 Aug 29 15:50:05.345395 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2743/5664] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:04 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1527 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:05.631577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e178f12-e2ce-431a-a4c4-4197482dd17a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:05.632348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9e178f12-e2ce-431a-a4c4-4197482dd17a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:05.642785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e178f12-e2ce-431a-a4c4-4197482dd17a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:05.644220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e178f12-e2ce-431a-a4c4-4197482dd17a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:05.645859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e178f12-e2ce-431a-a4c4-4197482dd17a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:05.650411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e178f12-e2ce-431a-a4c4-4197482dd17a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:05.651549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e178f12-e2ce-431a-a4c4-4197482dd17a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:05.653313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e178f12-e2ce-431a-a4c4-4197482dd17a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:05.705580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ac683541-949e-4914-8444-9b73a6c0abb7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:05.715272 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ac683541-949e-4914-8444-9b73a6c0abb7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1328 microversion: 2.1 time: 0.397311 Aug 29 15:50:05.718009 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2922/5665] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:05 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1328 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:06.024002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9e178f12-e2ce-431a-a4c4-4197482dd17a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:06.037632 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9e178f12-e2ce-431a-a4c4-4197482dd17a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1325 microversion: 2.1 time: 0.409878 Aug 29 15:50:06.066675 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2744/5666] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:05 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1325 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:06.225615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-1ac92415-8ea2-4308-aa51-f06acc7ace53 req-54239660-6327-4e04-8544-3ae3f4935a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31116131-8b70-4019-aa25-d3b9e58d2e1b", "name": "network-vif-plugged", "status": "completed", "tag": "0c103c97-e46e-4049-8d56-d8e8304f1ea7"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:06.247182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1ac92415-8ea2-4308-aa51-f06acc7ace53 req-54239660-6327-4e04-8544-3ae3f4935a9b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:06.248115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1ac92415-8ea2-4308-aa51-f06acc7ace53 req-54239660-6327-4e04-8544-3ae3f4935a9b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:06.248786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1ac92415-8ea2-4308-aa51-f06acc7ace53 req-54239660-6327-4e04-8544-3ae3f4935a9b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:06.270011 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-1ac92415-8ea2-4308-aa51-f06acc7ace53 req-54239660-6327-4e04-8544-3ae3f4935a9b service nova] Creating event network-vif-plugged:0c103c97-e46e-4049-8d56-d8e8304f1ea7 for instance 31116131-8b70-4019-aa25-d3b9e58d2e1b on n-h1-839401-11 Aug 29 15:50:06.277352 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-1ac92415-8ea2-4308-aa51-f06acc7ace53 req-54239660-6327-4e04-8544-3ae3f4935a9b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055643 Aug 29 15:50:06.278682 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2923/5667] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:06.365286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-40ffdbb0-b6a9-4186-b3f2-516a0f892045 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:06.366512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-40ffdbb0-b6a9-4186-b3f2-516a0f892045 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:06.381647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40ffdbb0-b6a9-4186-b3f2-516a0f892045 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:06.383437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40ffdbb0-b6a9-4186-b3f2-516a0f892045 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:06.384618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40ffdbb0-b6a9-4186-b3f2-516a0f892045 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:06.385894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40ffdbb0-b6a9-4186-b3f2-516a0f892045 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:06.388651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40ffdbb0-b6a9-4186-b3f2-516a0f892045 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:06.391611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40ffdbb0-b6a9-4186-b3f2-516a0f892045 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:06.739174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2cebbd94-e8aa-4087-b68f-a25cab8f1521 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:06.740053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2cebbd94-e8aa-4087-b68f-a25cab8f1521 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:06.755852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cebbd94-e8aa-4087-b68f-a25cab8f1521 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:06.756515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cebbd94-e8aa-4087-b68f-a25cab8f1521 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:06.757063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cebbd94-e8aa-4087-b68f-a25cab8f1521 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:06.757945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cebbd94-e8aa-4087-b68f-a25cab8f1521 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:06.758503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cebbd94-e8aa-4087-b68f-a25cab8f1521 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:06.759205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2cebbd94-e8aa-4087-b68f-a25cab8f1521 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:06.797296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-40ffdbb0-b6a9-4186-b3f2-516a0f892045 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:06.809374 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-40ffdbb0-b6a9-4186-b3f2-516a0f892045 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1527 microversion: 2.1 time: 0.447998 Aug 29 15:50:06.823339 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2745/5668] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:06 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1527 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:07.059540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2cebbd94-e8aa-4087-b68f-a25cab8f1521 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:07.075538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a49550e8-cfa1-45d9-914e-ac4114ab2d31 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:07.077827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a49550e8-cfa1-45d9-914e-ac4114ab2d31 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:07.086161 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2cebbd94-e8aa-4087-b68f-a25cab8f1521 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1328 microversion: 2.1 time: 0.352138 Aug 29 15:50:07.086761 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2924/5669] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:06 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1328 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:07.102236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a49550e8-cfa1-45d9-914e-ac4114ab2d31 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.104163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a49550e8-cfa1-45d9-914e-ac4114ab2d31 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.108192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a49550e8-cfa1-45d9-914e-ac4114ab2d31 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.108996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a49550e8-cfa1-45d9-914e-ac4114ab2d31 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.109511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a49550e8-cfa1-45d9-914e-ac4114ab2d31 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.112102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a49550e8-cfa1-45d9-914e-ac4114ab2d31 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.383246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a49550e8-cfa1-45d9-914e-ac4114ab2d31 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:07.398213 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a49550e8-cfa1-45d9-914e-ac4114ab2d31 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1522 microversion: 2.1 time: 0.329690 Aug 29 15:50:07.401335 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2746/5670] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:07 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:07.420425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a1a2e0a-8fdf-43a6-9181-ded966fe6d22 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:07.421265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9a1a2e0a-8fdf-43a6-9181-ded966fe6d22 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:07.428327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a1a2e0a-8fdf-43a6-9181-ded966fe6d22 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.429161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a1a2e0a-8fdf-43a6-9181-ded966fe6d22 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.440841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a1a2e0a-8fdf-43a6-9181-ded966fe6d22 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.441889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a1a2e0a-8fdf-43a6-9181-ded966fe6d22 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.442394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a1a2e0a-8fdf-43a6-9181-ded966fe6d22 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.442852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a1a2e0a-8fdf-43a6-9181-ded966fe6d22 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.513099 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-9a1a2e0a-8fdf-43a6-9181-ded966fe6d22 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] HTTP exception thrown: Action 999 not found Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a1a2e0a-8fdf-43a6-9181-ded966fe6d22 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Request method failure captured: Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4/os-instance-actions/999 HTTP/1.1 Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOAZtEGTbJnguLtyBx33IJ7KUfgiiylt48HuHC4ZWrH56slG-homdfddHzZqscNghY4mxWu13-b37fQ9pY1wNuN_dT0LfjPkkxVXw2MX0qzXhtVL-sDxGQS546gw6-jyn5V9YBc6ckvynUK_N_cE3VlHatdcUu1Y0dZmpHoNxC6h71I Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 1360d49b02294f979903bb9bc33fcae0 Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1006414294 Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1360d49b02294f979903bb9bc33fcae0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1360d49b02294f979903bb9bc33fcae0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1360d49b02294f979903bb9bc33fcae0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1360d49b02294f979903bb9bc33fcae0"}]}] Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1006414294 Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 1360d49b02294f979903bb9bc33fcae0 Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1006414294 Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-InstanceActionsNegativeTestJSON-1006414294-project Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 5aa1b5aead3e485d920ef7becb36708e Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1006414294-project Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: exception: Action 999 not found Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'server_id': '78f934d9-5e74-4e6c-9e70-0788281777b4', 'id': '999'} Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 29 15:50:07.520975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:50:07.527805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a1a2e0a-8fdf-43a6-9181-ded966fe6d22 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Returning 404 to user: Action 999 not found {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:07.527805 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a1a2e0a-8fdf-43a6-9181-ded966fe6d22 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.106523 Aug 29 15:50:07.534063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-297036a4-69b6-4356-b98b-1ca68cf7060f tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '.version_select at 0x7fc42a7ea310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:07.534637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-297036a4-69b6-4356-b98b-1ca68cf7060f tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 0d43c597-f192-4c63-94a7-b5a203247128] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:07.535708 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2925/5671] 10.222.0.62 () {58 vars in 1308 bytes} [Mon Aug 29 15:50:07 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4/os-instance-actions/999 => generated 66 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:50:07.545354 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-297036a4-69b6-4356-b98b-1ca68cf7060f tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] HTTP exception thrown: Instance 0d43c597-f192-4c63-94a7-b5a203247128 could not be found. Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-297036a4-69b6-4356-b98b-1ca68cf7060f tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Request method failure captured: Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/0d43c597-f192-4c63-94a7-b5a203247128/os-instance-actions HTTP/1.1 Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOAZtEGTbJnguLtyBx33IJ7KUfgiiylt48HuHC4ZWrH56slG-homdfddHzZqscNghY4mxWu13-b37fQ9pY1wNuN_dT0LfjPkkxVXw2MX0qzXhtVL-sDxGQS546gw6-jyn5V9YBc6ckvynUK_N_cE3VlHatdcUu1Y0dZmpHoNxC6h71I Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 1360d49b02294f979903bb9bc33fcae0 Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1006414294 Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1360d49b02294f979903bb9bc33fcae0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1360d49b02294f979903bb9bc33fcae0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1360d49b02294f979903bb9bc33fcae0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1360d49b02294f979903bb9bc33fcae0"}]}] Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1006414294 Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 1360d49b02294f979903bb9bc33fcae0 Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1006414294 Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-InstanceActionsNegativeTestJSON-1006414294-project Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 5aa1b5aead3e485d920ef7becb36708e Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1006414294-project Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 0d43c597-f192-4c63-94a7-b5a203247128 could not be found. Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'server_id': '0d43c597-f192-4c63-94a7-b5a203247128'} Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d43c597-f192-4c63-94a7-b5a203247128 could not be found. Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:07.547481 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:07.552820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d43c597-f192-4c63-94a7-b5a203247128 could not be found. Aug 29 15:50:07.552820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:07.552820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:07.552820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:07.552820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:07.552820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:07.552820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:07.552820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:07.552820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:07.552820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d43c597-f192-4c63-94a7-b5a203247128 could not be found. Aug 29 15:50:07.552820 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:07.558109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-297036a4-69b6-4356-b98b-1ca68cf7060f tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Returning 404 to user: Instance 0d43c597-f192-4c63-94a7-b5a203247128 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:07.559819 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-297036a4-69b6-4356-b98b-1ca68cf7060f tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/0d43c597-f192-4c63-94a7-b5a203247128/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.029873 Aug 29 15:50:07.573032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3213691a-3abe-4e41-a8c4-ae795a90079a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:07.573443 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2747/5672] 10.222.0.62 () {58 vars in 1296 bytes} [Mon Aug 29 15:50:07 2022] GET /compute/v2.1/servers/0d43c597-f192-4c63-94a7-b5a203247128/os-instance-actions => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:50:07.574192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3213691a-3abe-4e41-a8c4-ae795a90079a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:07.580697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3213691a-3abe-4e41-a8c4-ae795a90079a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.581228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3213691a-3abe-4e41-a8c4-ae795a90079a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.581893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3213691a-3abe-4e41-a8c4-ae795a90079a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.582614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3213691a-3abe-4e41-a8c4-ae795a90079a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.583079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3213691a-3abe-4e41-a8c4-ae795a90079a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.583510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3213691a-3abe-4e41-a8c4-ae795a90079a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.632351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3213691a-3abe-4e41-a8c4-ae795a90079a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:50:07.721164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:07.777023 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3213691a-3abe-4e41-a8c4-ae795a90079a tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "DELETE /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 204 len: 0 microversion: 2.1 time: 0.207575 Aug 29 15:50:07.784315 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2926/5673] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:50:07 2022] DELETE /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:50:07.791844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ee456958-3bb6-4eba-ad70-5364e9e4ba50 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:07.792783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ee456958-3bb6-4eba-ad70-5364e9e4ba50 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:07.802984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee456958-3bb6-4eba-ad70-5364e9e4ba50 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.803772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee456958-3bb6-4eba-ad70-5364e9e4ba50 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.804709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee456958-3bb6-4eba-ad70-5364e9e4ba50 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.810582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee456958-3bb6-4eba-ad70-5364e9e4ba50 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.813733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee456958-3bb6-4eba-ad70-5364e9e4ba50 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.814748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee456958-3bb6-4eba-ad70-5364e9e4ba50 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.839683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-93584b6a-8fa4-44b0-b67a-232885960d35 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:07.851504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-93584b6a-8fa4-44b0-b67a-232885960d35 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:07.858239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93584b6a-8fa4-44b0-b67a-232885960d35 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.859053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93584b6a-8fa4-44b0-b67a-232885960d35 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.859722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93584b6a-8fa4-44b0-b67a-232885960d35 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.860740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93584b6a-8fa4-44b0-b67a-232885960d35 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.861448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93584b6a-8fa4-44b0-b67a-232885960d35 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.862139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93584b6a-8fa4-44b0-b67a-232885960d35 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.078157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ee456958-3bb6-4eba-ad70-5364e9e4ba50 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:08.093873 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ee456958-3bb6-4eba-ad70-5364e9e4ba50 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1528 microversion: 2.1 time: 0.308085 Aug 29 15:50:08.094905 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2748/5674] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:07 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1528 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:08.110230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-99687a4e-9e52-441f-8fa8-2ccfea82edcd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:08.111304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-93584b6a-8fa4-44b0-b67a-232885960d35 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:08.115740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-99687a4e-9e52-441f-8fa8-2ccfea82edcd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:08.122130 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-93584b6a-8fa4-44b0-b67a-232885960d35 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1527 microversion: 2.1 time: 0.286699 Aug 29 15:50:08.128125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99687a4e-9e52-441f-8fa8-2ccfea82edcd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:08.128981 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2927/5675] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:07 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1527 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:08.129699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99687a4e-9e52-441f-8fa8-2ccfea82edcd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:08.130327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99687a4e-9e52-441f-8fa8-2ccfea82edcd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.131236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99687a4e-9e52-441f-8fa8-2ccfea82edcd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:08.131872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99687a4e-9e52-441f-8fa8-2ccfea82edcd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:08.132553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99687a4e-9e52-441f-8fa8-2ccfea82edcd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.432418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-99687a4e-9e52-441f-8fa8-2ccfea82edcd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:08.441514 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-99687a4e-9e52-441f-8fa8-2ccfea82edcd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1328 microversion: 2.1 time: 0.334949 Aug 29 15:50:08.453876 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2749/5676] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:08 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1328 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:09.121853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-467f0cf5-0c2b-49c9-af9a-9182f04dcc06 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:09.124902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-467f0cf5-0c2b-49c9-af9a-9182f04dcc06 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:09.151177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-467f0cf5-0c2b-49c9-af9a-9182f04dcc06 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:09.151985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-467f0cf5-0c2b-49c9-af9a-9182f04dcc06 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:09.152696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-467f0cf5-0c2b-49c9-af9a-9182f04dcc06 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:09.152910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-65d615d2-1e34-4a81-bcac-b4e53335bc96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:09.153640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-467f0cf5-0c2b-49c9-af9a-9182f04dcc06 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:09.154094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-467f0cf5-0c2b-49c9-af9a-9182f04dcc06 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:09.155162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-65d615d2-1e34-4a81-bcac-b4e53335bc96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:09.155751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-467f0cf5-0c2b-49c9-af9a-9182f04dcc06 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:09.175709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65d615d2-1e34-4a81-bcac-b4e53335bc96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:09.189266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65d615d2-1e34-4a81-bcac-b4e53335bc96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:09.193108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65d615d2-1e34-4a81-bcac-b4e53335bc96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:09.194240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65d615d2-1e34-4a81-bcac-b4e53335bc96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:09.211515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65d615d2-1e34-4a81-bcac-b4e53335bc96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:09.211977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65d615d2-1e34-4a81-bcac-b4e53335bc96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:09.501819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-467f0cf5-0c2b-49c9-af9a-9182f04dcc06 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:09.512480 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-467f0cf5-0c2b-49c9-af9a-9182f04dcc06 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1528 microversion: 2.1 time: 0.394526 Aug 29 15:50:09.514265 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2928/5677] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:09 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1528 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:09.519971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d5ba471-afe1-4294-85ca-223260373ae2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:09.521109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2d5ba471-afe1-4294-85ca-223260373ae2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:09.528783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5ba471-afe1-4294-85ca-223260373ae2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:09.529593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5ba471-afe1-4294-85ca-223260373ae2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:09.530041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5ba471-afe1-4294-85ca-223260373ae2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:09.530788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5ba471-afe1-4294-85ca-223260373ae2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:09.531249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5ba471-afe1-4294-85ca-223260373ae2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:09.531683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5ba471-afe1-4294-85ca-223260373ae2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:10.067122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d5ba471-afe1-4294-85ca-223260373ae2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:10.077926 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d5ba471-afe1-4294-85ca-223260373ae2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1509 microversion: 2.1 time: 0.562335 Aug 29 15:50:10.082721 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2929/5678] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:09 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1509 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:10.107209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-22b1302e-aff0-4702-92c6-a5ebc3138ad3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:10.109340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-22b1302e-aff0-4702-92c6-a5ebc3138ad3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:10.118544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22b1302e-aff0-4702-92c6-a5ebc3138ad3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:10.125985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22b1302e-aff0-4702-92c6-a5ebc3138ad3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:10.127480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22b1302e-aff0-4702-92c6-a5ebc3138ad3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:10.128613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22b1302e-aff0-4702-92c6-a5ebc3138ad3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:10.129335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22b1302e-aff0-4702-92c6-a5ebc3138ad3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:10.130004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22b1302e-aff0-4702-92c6-a5ebc3138ad3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:10.159803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-65d615d2-1e34-4a81-bcac-b4e53335bc96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:10.193776 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-65d615d2-1e34-4a81-bcac-b4e53335bc96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1527 microversion: 2.1 time: 1.040242 Aug 29 15:50:10.197723 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2750/5679] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:09 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1527 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:10.489324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-22b1302e-aff0-4702-92c6-a5ebc3138ad3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:10.511195 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-22b1302e-aff0-4702-92c6-a5ebc3138ad3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1509 microversion: 2.1 time: 0.407830 Aug 29 15:50:10.515187 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2930/5680] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:10 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1509 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:10.536417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fe498a77-4d66-435d-a207-c4013cafdcac tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:10.536996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fe498a77-4d66-435d-a207-c4013cafdcac tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:10.539713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6fac6b58-3f0e-4772-ba8a-c76738a07206 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:10.542232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6fac6b58-3f0e-4772-ba8a-c76738a07206 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:10.550828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe498a77-4d66-435d-a207-c4013cafdcac tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:10.551350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe498a77-4d66-435d-a207-c4013cafdcac tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:10.551800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe498a77-4d66-435d-a207-c4013cafdcac tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:10.552547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe498a77-4d66-435d-a207-c4013cafdcac tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:10.553011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe498a77-4d66-435d-a207-c4013cafdcac tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:10.560487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe498a77-4d66-435d-a207-c4013cafdcac tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:10.562628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fac6b58-3f0e-4772-ba8a-c76738a07206 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:10.563215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fac6b58-3f0e-4772-ba8a-c76738a07206 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:10.566746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fac6b58-3f0e-4772-ba8a-c76738a07206 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:10.567944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fac6b58-3f0e-4772-ba8a-c76738a07206 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:10.569779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fac6b58-3f0e-4772-ba8a-c76738a07206 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:10.581308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6fac6b58-3f0e-4772-ba8a-c76738a07206 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:10.634123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fe498a77-4d66-435d-a207-c4013cafdcac tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:50:10.881650 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fe498a77-4d66-435d-a207-c4013cafdcac tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "DELETE /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 204 len: 0 microversion: 2.1 time: 0.346021 Aug 29 15:50:10.888792 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2931/5681] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:50:10 2022] DELETE /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:50:10.917228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b362c0e2-9b06-41db-92a1-c5b55a46972b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:10.921226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b362c0e2-9b06-41db-92a1-c5b55a46972b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:10.941671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b362c0e2-9b06-41db-92a1-c5b55a46972b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:10.954786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b362c0e2-9b06-41db-92a1-c5b55a46972b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:10.955681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b362c0e2-9b06-41db-92a1-c5b55a46972b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:10.960272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b362c0e2-9b06-41db-92a1-c5b55a46972b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:10.961589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b362c0e2-9b06-41db-92a1-c5b55a46972b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:10.962350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b362c0e2-9b06-41db-92a1-c5b55a46972b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:11.337419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b362c0e2-9b06-41db-92a1-c5b55a46972b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:11.359328 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b362c0e2-9b06-41db-92a1-c5b55a46972b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1515 microversion: 2.1 time: 0.466811 Aug 29 15:50:11.361317 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2932/5682] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:10 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1515 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:11.385034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-ab8a9edd-b1da-4d60-ab06-932ff22e495e req-6dd0627d-109e-4a28-b3c6-b787b36c7349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f934d9-5e74-4e6c-9e70-0788281777b4", "name": "network-vif-deleted", "tag": "7eb08a4f-79df-49d3-adc3-43214302ba67"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:11.416793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ab8a9edd-b1da-4d60-ab06-932ff22e495e req-6dd0627d-109e-4a28-b3c6-b787b36c7349 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:11.420653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ab8a9edd-b1da-4d60-ab06-932ff22e495e req-6dd0627d-109e-4a28-b3c6-b787b36c7349 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:11.421164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ab8a9edd-b1da-4d60-ab06-932ff22e495e req-6dd0627d-109e-4a28-b3c6-b787b36c7349 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:11.468729 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-ab8a9edd-b1da-4d60-ab06-932ff22e495e req-6dd0627d-109e-4a28-b3c6-b787b36c7349 service nova] Creating event network-vif-deleted:7eb08a4f-79df-49d3-adc3-43214302ba67 for instance 78f934d9-5e74-4e6c-9e70-0788281777b4 on n-h1-839401-11 Aug 29 15:50:11.483425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6fac6b58-3f0e-4772-ba8a-c76738a07206 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:11.490029 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-ab8a9edd-b1da-4d60-ab06-932ff22e495e req-6dd0627d-109e-4a28-b3c6-b787b36c7349 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127306 Aug 29 15:50:11.498064 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2933/5683] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:11.499078 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6fac6b58-3f0e-4772-ba8a-c76738a07206 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1528 microversion: 2.1 time: 0.965708 Aug 29 15:50:11.500168 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2751/5684] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:10 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1528 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:11.521008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bba45b6c-0bf8-44ee-8e92-9538ea919e41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:11.521772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bba45b6c-0bf8-44ee-8e92-9538ea919e41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:11.533876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bba45b6c-0bf8-44ee-8e92-9538ea919e41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:11.546490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bba45b6c-0bf8-44ee-8e92-9538ea919e41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:11.547433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bba45b6c-0bf8-44ee-8e92-9538ea919e41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:11.548211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bba45b6c-0bf8-44ee-8e92-9538ea919e41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:11.549430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bba45b6c-0bf8-44ee-8e92-9538ea919e41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:11.554288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bba45b6c-0bf8-44ee-8e92-9538ea919e41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:11.982302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bba45b6c-0bf8-44ee-8e92-9538ea919e41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:11.993864 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bba45b6c-0bf8-44ee-8e92-9538ea919e41 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1527 microversion: 2.1 time: 0.493924 Aug 29 15:50:12.007893 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2934/5685] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:11 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1527 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:12.386243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aea016e1-16ad-423a-a9bd-4bc77e88752d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:12.386795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aea016e1-16ad-423a-a9bd-4bc77e88752d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:12.399992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aea016e1-16ad-423a-a9bd-4bc77e88752d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:12.400504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aea016e1-16ad-423a-a9bd-4bc77e88752d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:12.400952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aea016e1-16ad-423a-a9bd-4bc77e88752d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:12.403686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aea016e1-16ad-423a-a9bd-4bc77e88752d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:12.405594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aea016e1-16ad-423a-a9bd-4bc77e88752d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:12.410065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aea016e1-16ad-423a-a9bd-4bc77e88752d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:12.420569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:12.522953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d59ef0b5-892c-4da0-9698-2c45f96fe653 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:12.523575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d59ef0b5-892c-4da0-9698-2c45f96fe653 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:12.534510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d59ef0b5-892c-4da0-9698-2c45f96fe653 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:12.542025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d59ef0b5-892c-4da0-9698-2c45f96fe653 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:12.542800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d59ef0b5-892c-4da0-9698-2c45f96fe653 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:12.543729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d59ef0b5-892c-4da0-9698-2c45f96fe653 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:12.544357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d59ef0b5-892c-4da0-9698-2c45f96fe653 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:12.544989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d59ef0b5-892c-4da0-9698-2c45f96fe653 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:12.638338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d59ef0b5-892c-4da0-9698-2c45f96fe653 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:12.640328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d59ef0b5-892c-4da0-9698-2c45f96fe653 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:12.640955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d59ef0b5-892c-4da0-9698-2c45f96fe653 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:12.641603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-d59ef0b5-892c-4da0-9698-2c45f96fe653 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lazy-loading 'fault' on Instance uuid 78f934d9-5e74-4e6c-9e70-0788281777b4 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:50:12.714829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aea016e1-16ad-423a-a9bd-4bc77e88752d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:12.762317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d59ef0b5-892c-4da0-9698-2c45f96fe653 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa1b5aead3e485d920ef7becb36708e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1360d49b02294f979903bb9bc33fcae0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:12.764590 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aea016e1-16ad-423a-a9bd-4bc77e88752d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1515 microversion: 2.1 time: 0.381949 Aug 29 15:50:12.773848 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2752/5686] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:12 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1515 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:12.785811 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d59ef0b5-892c-4da0-9698-2c45f96fe653 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 200 len: 1315 microversion: 2.1 time: 0.263640 Aug 29 15:50:12.799866 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2935/5687] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:12 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:13.020129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2d9baaa2-d474-4a1d-8f6a-6ac03647829b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:13.020755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2d9baaa2-d474-4a1d-8f6a-6ac03647829b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:13.029076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d9baaa2-d474-4a1d-8f6a-6ac03647829b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:13.030048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d9baaa2-d474-4a1d-8f6a-6ac03647829b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:13.030640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d9baaa2-d474-4a1d-8f6a-6ac03647829b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:13.032656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d9baaa2-d474-4a1d-8f6a-6ac03647829b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:13.032656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d9baaa2-d474-4a1d-8f6a-6ac03647829b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:13.032656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2d9baaa2-d474-4a1d-8f6a-6ac03647829b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:13.332958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2d9baaa2-d474-4a1d-8f6a-6ac03647829b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:13.343332 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2d9baaa2-d474-4a1d-8f6a-6ac03647829b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1527 microversion: 2.1 time: 0.325830 Aug 29 15:50:13.345269 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2753/5688] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:13 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1527 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:13.791865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ae11238-4558-485c-b60b-3b8eb0fc548b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:13.793005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ae11238-4558-485c-b60b-3b8eb0fc548b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:13.811466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a85555e6-d0cb-498a-ad58-e39509e07708 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:13.812902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a85555e6-d0cb-498a-ad58-e39509e07708 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] [instance: 78f934d9-5e74-4e6c-9e70-0788281777b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:13.822815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ae11238-4558-485c-b60b-3b8eb0fc548b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:13.826533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a85555e6-d0cb-498a-ad58-e39509e07708 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:13.827899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ae11238-4558-485c-b60b-3b8eb0fc548b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:13.831727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ae11238-4558-485c-b60b-3b8eb0fc548b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:13.835365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a85555e6-d0cb-498a-ad58-e39509e07708 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:13.836493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ae11238-4558-485c-b60b-3b8eb0fc548b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:13.837676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ae11238-4558-485c-b60b-3b8eb0fc548b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:13.841471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a85555e6-d0cb-498a-ad58-e39509e07708 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:13.842333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a85555e6-d0cb-498a-ad58-e39509e07708 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:13.843287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ae11238-4558-485c-b60b-3b8eb0fc548b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:13.845609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a85555e6-d0cb-498a-ad58-e39509e07708 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:13.846330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a85555e6-d0cb-498a-ad58-e39509e07708 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:13.922105 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-a85555e6-d0cb-498a-ad58-e39509e07708 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] HTTP exception thrown: Instance 78f934d9-5e74-4e6c-9e70-0788281777b4 could not be found. Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a85555e6-d0cb-498a-ad58-e39509e07708 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Request method failure captured: Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 HTTP/1.1 Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOAZtEGTbJnguLtyBx33IJ7KUfgiiylt48HuHC4ZWrH56slG-homdfddHzZqscNghY4mxWu13-b37fQ9pY1wNuN_dT0LfjPkkxVXw2MX0qzXhtVL-sDxGQS546gw6-jyn5V9YBc6ckvynUK_N_cE3VlHatdcUu1Y0dZmpHoNxC6h71I Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 1360d49b02294f979903bb9bc33fcae0 Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1006414294 Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1360d49b02294f979903bb9bc33fcae0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1360d49b02294f979903bb9bc33fcae0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1360d49b02294f979903bb9bc33fcae0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1360d49b02294f979903bb9bc33fcae0"}]}] Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1006414294 Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 1360d49b02294f979903bb9bc33fcae0 Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1006414294 Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-InstanceActionsNegativeTestJSON-1006414294-project Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 5aa1b5aead3e485d920ef7becb36708e Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1006414294-project Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 78f934d9-5e74-4e6c-9e70-0788281777b4 could not be found. Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '78f934d9-5e74-4e6c-9e70-0788281777b4'} Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78f934d9-5e74-4e6c-9e70-0788281777b4 could not be found. Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78f934d9-5e74-4e6c-9e70-0788281777b4 could not be found. Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:13.930949 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:13.936377 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:13.936377 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:13.936377 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:13.936377 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:13.936377 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:13.936377 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:13.936377 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78f934d9-5e74-4e6c-9e70-0788281777b4 could not be found. Aug 29 15:50:13.936377 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:13.937952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a85555e6-d0cb-498a-ad58-e39509e07708 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] Returning 404 to user: Instance 78f934d9-5e74-4e6c-9e70-0788281777b4 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:13.939007 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a85555e6-d0cb-498a-ad58-e39509e07708 tempest-InstanceActionsNegativeTestJSON-1006414294 tempest-InstanceActionsNegativeTestJSON-1006414294-project] 10.222.0.62 "GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4" status: 404 len: 111 microversion: 2.1 time: 0.131434 Aug 29 15:50:13.945014 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2754/5689] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:13 2022] GET /compute/v2.1/servers/78f934d9-5e74-4e6c-9e70-0788281777b4 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:50:14.332365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5ae11238-4558-485c-b60b-3b8eb0fc548b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:14.352138 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ae11238-4558-485c-b60b-3b8eb0fc548b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1515 microversion: 2.1 time: 0.565552 Aug 29 15:50:14.353302 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2936/5690] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:13 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1515 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:14.392348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c551789-64c6-41f1-b6dc-88913233df14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:14.393387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6c551789-64c6-41f1-b6dc-88913233df14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:14.400610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c551789-64c6-41f1-b6dc-88913233df14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:14.401429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c551789-64c6-41f1-b6dc-88913233df14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:14.402110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c551789-64c6-41f1-b6dc-88913233df14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:14.403055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c551789-64c6-41f1-b6dc-88913233df14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:14.403829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c551789-64c6-41f1-b6dc-88913233df14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:14.404648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c551789-64c6-41f1-b6dc-88913233df14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:14.549386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-7fbbce02-31e8-4361-8cc0-1bc301af2950 req-e1f62ce8-bd4a-4c31-8199-280257a1e6fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31116131-8b70-4019-aa25-d3b9e58d2e1b", "name": "network-vif-deleted", "tag": "0c103c97-e46e-4049-8d56-d8e8304f1ea7"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:14.575597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7fbbce02-31e8-4361-8cc0-1bc301af2950 req-e1f62ce8-bd4a-4c31-8199-280257a1e6fd service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:14.577246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7fbbce02-31e8-4361-8cc0-1bc301af2950 req-e1f62ce8-bd4a-4c31-8199-280257a1e6fd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:14.578033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7fbbce02-31e8-4361-8cc0-1bc301af2950 req-e1f62ce8-bd4a-4c31-8199-280257a1e6fd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:14.610971 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-7fbbce02-31e8-4361-8cc0-1bc301af2950 req-e1f62ce8-bd4a-4c31-8199-280257a1e6fd service nova] Creating event network-vif-deleted:0c103c97-e46e-4049-8d56-d8e8304f1ea7 for instance 31116131-8b70-4019-aa25-d3b9e58d2e1b on n-h1-839401-11 Aug 29 15:50:14.625887 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-7fbbce02-31e8-4361-8cc0-1bc301af2950 req-e1f62ce8-bd4a-4c31-8199-280257a1e6fd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093068 Aug 29 15:50:14.627335 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2937/5691] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:14.994553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6c551789-64c6-41f1-b6dc-88913233df14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:15.057686 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6c551789-64c6-41f1-b6dc-88913233df14 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1527 microversion: 2.1 time: 0.664947 Aug 29 15:50:15.062801 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2755/5692] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:14 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1527 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:15.399034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-05820c88-3cf6-49b7-bd57-170b62f13c18 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:15.399750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-05820c88-3cf6-49b7-bd57-170b62f13c18 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:15.417790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05820c88-3cf6-49b7-bd57-170b62f13c18 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:15.418295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05820c88-3cf6-49b7-bd57-170b62f13c18 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:15.422754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05820c88-3cf6-49b7-bd57-170b62f13c18 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:15.424072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05820c88-3cf6-49b7-bd57-170b62f13c18 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:15.424779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05820c88-3cf6-49b7-bd57-170b62f13c18 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:15.425432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05820c88-3cf6-49b7-bd57-170b62f13c18 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:15.501261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05820c88-3cf6-49b7-bd57-170b62f13c18 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:15.502160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05820c88-3cf6-49b7-bd57-170b62f13c18 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:15.502897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05820c88-3cf6-49b7-bd57-170b62f13c18 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:15.503619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-05820c88-3cf6-49b7-bd57-170b62f13c18 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lazy-loading 'fault' on Instance uuid 31116131-8b70-4019-aa25-d3b9e58d2e1b {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:50:15.669537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-05820c88-3cf6-49b7-bd57-170b62f13c18 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:15.677205 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-05820c88-3cf6-49b7-bd57-170b62f13c18 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 200 len: 1318 microversion: 2.1 time: 0.286903 Aug 29 15:50:15.694965 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2938/5693] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:15 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:16.117248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-88d15bff-e8f1-44ca-ae21-12ed21aadf93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:16.117248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-88d15bff-e8f1-44ca-ae21-12ed21aadf93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:16.130829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d15bff-e8f1-44ca-ae21-12ed21aadf93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:16.166932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d15bff-e8f1-44ca-ae21-12ed21aadf93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:16.166932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d15bff-e8f1-44ca-ae21-12ed21aadf93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:16.166932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d15bff-e8f1-44ca-ae21-12ed21aadf93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:16.166932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d15bff-e8f1-44ca-ae21-12ed21aadf93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:16.166932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d15bff-e8f1-44ca-ae21-12ed21aadf93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:16.367426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-88d15bff-e8f1-44ca-ae21-12ed21aadf93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:16.383329 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-88d15bff-e8f1-44ca-ae21-12ed21aadf93 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1527 microversion: 2.1 time: 0.283192 Aug 29 15:50:16.384520 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2756/5694] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:16 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1527 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:16.710450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5153f686-59d6-4a58-bcf6-85a3d89217cf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:16.711299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5153f686-59d6-4a58-bcf6-85a3d89217cf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:16.738008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5153f686-59d6-4a58-bcf6-85a3d89217cf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:16.741033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5153f686-59d6-4a58-bcf6-85a3d89217cf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:16.742541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5153f686-59d6-4a58-bcf6-85a3d89217cf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:16.745402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5153f686-59d6-4a58-bcf6-85a3d89217cf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:16.746002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5153f686-59d6-4a58-bcf6-85a3d89217cf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:16.749280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5153f686-59d6-4a58-bcf6-85a3d89217cf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:16.808011 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-5153f686-59d6-4a58-bcf6-85a3d89217cf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5153f686-59d6-4a58-bcf6-85a3d89217cf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b HTTP/1.1 Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '31116131-8b70-4019-aa25-d3b9e58d2e1b'} Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:50:16.821718 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:16.826896 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:16.826896 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:16.826896 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:16.826896 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:16.826896 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. Aug 29 15:50:16.826896 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:50:16.826896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5153f686-59d6-4a58-bcf6-85a3d89217cf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:16.826896 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5153f686-59d6-4a58-bcf6-85a3d89217cf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 404 len: 111 microversion: 2.1 time: 0.125131 Aug 29 15:50:16.827631 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2939/5695] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:16 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:50:16.850634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-280e5c3f-5d51-4b14-a3c5-e1ac3845c80e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '.version_select at 0x7fc42a76bdc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:16.895524 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-280e5c3f-5d51-4b14-a3c5-e1ac3845c80e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-key-1853576478" status: 202 len: 0 microversion: 2.1 time: 0.065134 Aug 29 15:50:16.899219 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2757/5696] 10.222.0.62 () {58 vars in 1209 bytes} [Mon Aug 29 15:50:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1853576478 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:50:17.123492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-749863843", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "e7e1a9e7-4d7f-4958-9bd4-e4039baa5a12"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:17.271545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] validate_networks() for [('e7e1a9e7-4d7f-4958-9bd4-e4039baa5a12', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:50:17.421547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a6e8ba3-80fa-4cb8-936b-455170228e5a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:17.425445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a6e8ba3-80fa-4cb8-936b-455170228e5a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:17.438118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a6e8ba3-80fa-4cb8-936b-455170228e5a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:17.439244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a6e8ba3-80fa-4cb8-936b-455170228e5a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:17.440024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a6e8ba3-80fa-4cb8-936b-455170228e5a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:17.441309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a6e8ba3-80fa-4cb8-936b-455170228e5a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:17.442208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a6e8ba3-80fa-4cb8-936b-455170228e5a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:17.446222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a6e8ba3-80fa-4cb8-936b-455170228e5a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:17.993970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5a6e8ba3-80fa-4cb8-936b-455170228e5a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:18.002520 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5a6e8ba3-80fa-4cb8-936b-455170228e5a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1527 microversion: 2.1 time: 0.591399 Aug 29 15:50:18.013002 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2758/5697] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:17 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1527 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:18.591426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:50:18.592458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:50:18.593150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:50:18.594267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:50:18.595226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:50:18.624478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:18.629906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:18.632854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:18.635668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:18.641608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:18.645112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:18.755669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:18.780759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for user db3e87dfe49444f886b7a9ac5d22bda1 and project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:18.846760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:50:18.865382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:50:19.040510 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a3b2343c-9443-4243-a45c-a4557f188e67 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.920909 Aug 29 15:50:19.049428 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2940/5698] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:50:19.053994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-37f080da-53d9-4acb-a47d-b4bbab25afff tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:19.054626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-37f080da-53d9-4acb-a47d-b4bbab25afff tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:19.061532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5f938654-fe3d-4fab-8ded-64535c0382e8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:19.066205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5f938654-fe3d-4fab-8ded-64535c0382e8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:19.084536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f938654-fe3d-4fab-8ded-64535c0382e8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:19.085359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f938654-fe3d-4fab-8ded-64535c0382e8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:19.085996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f938654-fe3d-4fab-8ded-64535c0382e8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:19.086948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f938654-fe3d-4fab-8ded-64535c0382e8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:19.088256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f938654-fe3d-4fab-8ded-64535c0382e8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:19.088901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f938654-fe3d-4fab-8ded-64535c0382e8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:19.267390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-37f080da-53d9-4acb-a47d-b4bbab25afff tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:19.296368 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-37f080da-53d9-4acb-a47d-b4bbab25afff tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1208 microversion: 2.1 time: 0.246032 Aug 29 15:50:19.297032 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2759/5699] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:19 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1208 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:19.613437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5f938654-fe3d-4fab-8ded-64535c0382e8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:19.639398 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5f938654-fe3d-4fab-8ded-64535c0382e8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1527 microversion: 2.1 time: 0.583565 Aug 29 15:50:19.640065 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2941/5700] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:19 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1527 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:20.317255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f21e5d79-0618-4433-8e2f-648215ada54d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:20.317879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f21e5d79-0618-4433-8e2f-648215ada54d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:20.328164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21e5d79-0618-4433-8e2f-648215ada54d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:20.334203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21e5d79-0618-4433-8e2f-648215ada54d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:20.334848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21e5d79-0618-4433-8e2f-648215ada54d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:20.335822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21e5d79-0618-4433-8e2f-648215ada54d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:20.336288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21e5d79-0618-4433-8e2f-648215ada54d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:20.336947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21e5d79-0618-4433-8e2f-648215ada54d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:20.506569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f21e5d79-0618-4433-8e2f-648215ada54d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:20.517769 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f21e5d79-0618-4433-8e2f-648215ada54d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1204 microversion: 2.1 time: 0.204382 Aug 29 15:50:20.523360 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2760/5701] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:20 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1204 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:20.675050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-705927f3-e906-4aca-b2bd-864e2143b3c5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:20.675499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-705927f3-e906-4aca-b2bd-864e2143b3c5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:20.709338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-705927f3-e906-4aca-b2bd-864e2143b3c5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:20.710793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-705927f3-e906-4aca-b2bd-864e2143b3c5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:20.711404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-705927f3-e906-4aca-b2bd-864e2143b3c5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:20.712410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-705927f3-e906-4aca-b2bd-864e2143b3c5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:20.714127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-705927f3-e906-4aca-b2bd-864e2143b3c5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:20.714903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-705927f3-e906-4aca-b2bd-864e2143b3c5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:21.183045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-705927f3-e906-4aca-b2bd-864e2143b3c5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:21.192408 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-705927f3-e906-4aca-b2bd-864e2143b3c5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1527 microversion: 2.1 time: 0.522092 Aug 29 15:50:21.193025 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2942/5702] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:20 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1527 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:21.549237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d952393c-4581-45a7-a181-231a84fdc44d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:21.549945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d952393c-4581-45a7-a181-231a84fdc44d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:21.560972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d952393c-4581-45a7-a181-231a84fdc44d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:21.562777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d952393c-4581-45a7-a181-231a84fdc44d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:21.563776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d952393c-4581-45a7-a181-231a84fdc44d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:21.568138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d952393c-4581-45a7-a181-231a84fdc44d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:21.568979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d952393c-4581-45a7-a181-231a84fdc44d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:21.569617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d952393c-4581-45a7-a181-231a84fdc44d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:21.789655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d952393c-4581-45a7-a181-231a84fdc44d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:21.801128 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d952393c-4581-45a7-a181-231a84fdc44d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1266 microversion: 2.1 time: 0.258057 Aug 29 15:50:21.802404 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2761/5703] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:21 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:22.220490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1c44249f-00bf-406b-b3ba-54602037f8c8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:22.222061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1c44249f-00bf-406b-b3ba-54602037f8c8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:22.242586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c44249f-00bf-406b-b3ba-54602037f8c8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:22.244160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c44249f-00bf-406b-b3ba-54602037f8c8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:22.244454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c44249f-00bf-406b-b3ba-54602037f8c8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:22.246341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c44249f-00bf-406b-b3ba-54602037f8c8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:22.251180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c44249f-00bf-406b-b3ba-54602037f8c8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:22.252076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c44249f-00bf-406b-b3ba-54602037f8c8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:22.312332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:22.609568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1c44249f-00bf-406b-b3ba-54602037f8c8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:22.632190 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1c44249f-00bf-406b-b3ba-54602037f8c8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1527 microversion: 2.1 time: 0.418173 Aug 29 15:50:22.647053 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2943/5704] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:22 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1527 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:22.878971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b0111913-0fac-457d-a057-33a9b1b7d4ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:22.880164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b0111913-0fac-457d-a057-33a9b1b7d4ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:22.891672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0111913-0fac-457d-a057-33a9b1b7d4ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:22.894809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0111913-0fac-457d-a057-33a9b1b7d4ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:22.895452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0111913-0fac-457d-a057-33a9b1b7d4ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:22.898875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0111913-0fac-457d-a057-33a9b1b7d4ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:22.899531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0111913-0fac-457d-a057-33a9b1b7d4ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:22.900133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b0111913-0fac-457d-a057-33a9b1b7d4ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:23.373993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b0111913-0fac-457d-a057-33a9b1b7d4ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:23.388095 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b0111913-0fac-457d-a057-33a9b1b7d4ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1308 microversion: 2.1 time: 0.517810 Aug 29 15:50:23.391476 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2762/5705] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:22 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1308 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:23.654964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1135fd2f-fa4c-4e4e-bdf9-fd4bef37b5fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:23.656495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1135fd2f-fa4c-4e4e-bdf9-fd4bef37b5fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:23.676861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1135fd2f-fa4c-4e4e-bdf9-fd4bef37b5fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:23.680117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1135fd2f-fa4c-4e4e-bdf9-fd4bef37b5fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:23.681823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1135fd2f-fa4c-4e4e-bdf9-fd4bef37b5fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:23.687224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1135fd2f-fa4c-4e4e-bdf9-fd4bef37b5fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:23.688021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1135fd2f-fa4c-4e4e-bdf9-fd4bef37b5fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:23.688722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1135fd2f-fa4c-4e4e-bdf9-fd4bef37b5fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:24.212699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1135fd2f-fa4c-4e4e-bdf9-fd4bef37b5fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:24.225550 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1135fd2f-fa4c-4e4e-bdf9-fd4bef37b5fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1527 microversion: 2.1 time: 0.575099 Aug 29 15:50:24.226502 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2944/5706] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:23 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1527 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:24.362691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-79c3227c-9200-4a82-aa1c-d6f55c286636 req-9c6fb12c-c300-48a1-b9e1-3cbfea5a26d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "507274a1-8eee-4a29-9f47-5c560ae48444", "tag": "3cbd6b2a-e077-48b9-84fb-4c92c81c92c9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:24.401609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-79c3227c-9200-4a82-aa1c-d6f55c286636 req-9c6fb12c-c300-48a1-b9e1-3cbfea5a26d2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:24.402193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-79c3227c-9200-4a82-aa1c-d6f55c286636 req-9c6fb12c-c300-48a1-b9e1-3cbfea5a26d2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:24.402641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-79c3227c-9200-4a82-aa1c-d6f55c286636 req-9c6fb12c-c300-48a1-b9e1-3cbfea5a26d2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:24.413404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0a8ba70c-9ff4-470f-9ed9-d1482d1180ce tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:24.414425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0a8ba70c-9ff4-470f-9ed9-d1482d1180ce tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:24.437524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:24.439262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a8ba70c-9ff4-470f-9ed9-d1482d1180ce tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:24.439706 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-79c3227c-9200-4a82-aa1c-d6f55c286636 req-9c6fb12c-c300-48a1-b9e1-3cbfea5a26d2 service nova] Creating event network-changed:3cbd6b2a-e077-48b9-84fb-4c92c81c92c9 for instance 507274a1-8eee-4a29-9f47-5c560ae48444 on n-h1-839401-11 Aug 29 15:50:24.440136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a8ba70c-9ff4-470f-9ed9-d1482d1180ce tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:24.441350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a8ba70c-9ff4-470f-9ed9-d1482d1180ce tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:24.443143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a8ba70c-9ff4-470f-9ed9-d1482d1180ce tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:24.444991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a8ba70c-9ff4-470f-9ed9-d1482d1180ce tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:24.450147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a8ba70c-9ff4-470f-9ed9-d1482d1180ce tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:24.457808 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-79c3227c-9200-4a82-aa1c-d6f55c286636 req-9c6fb12c-c300-48a1-b9e1-3cbfea5a26d2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098655 Aug 29 15:50:24.459851 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2763/5707] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:25.076302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0a8ba70c-9ff4-470f-9ed9-d1482d1180ce tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:25.086009 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0a8ba70c-9ff4-470f-9ed9-d1482d1180ce tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1308 microversion: 2.1 time: 0.678264 Aug 29 15:50:25.105394 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2945/5708] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:24 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1308 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:25.247312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1e1565c9-9b33-4b71-baf9-a97babbb42a8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:25.248672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1e1565c9-9b33-4b71-baf9-a97babbb42a8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:25.267710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e1565c9-9b33-4b71-baf9-a97babbb42a8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:25.271006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e1565c9-9b33-4b71-baf9-a97babbb42a8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:25.271600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e1565c9-9b33-4b71-baf9-a97babbb42a8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:25.272230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e1565c9-9b33-4b71-baf9-a97babbb42a8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:25.272699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e1565c9-9b33-4b71-baf9-a97babbb42a8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:25.273167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e1565c9-9b33-4b71-baf9-a97babbb42a8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:26.062777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1e1565c9-9b33-4b71-baf9-a97babbb42a8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:26.095278 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1e1565c9-9b33-4b71-baf9-a97babbb42a8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1527 microversion: 2.1 time: 0.852505 Aug 29 15:50:26.097028 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2764/5709] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:25 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1527 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:26.125934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-30813ee3-1304-4a29-b9b6-90d7e3592b74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:26.126552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-30813ee3-1304-4a29-b9b6-90d7e3592b74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:26.138230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30813ee3-1304-4a29-b9b6-90d7e3592b74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:26.138728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30813ee3-1304-4a29-b9b6-90d7e3592b74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:26.139167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30813ee3-1304-4a29-b9b6-90d7e3592b74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:26.139883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30813ee3-1304-4a29-b9b6-90d7e3592b74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:26.140341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30813ee3-1304-4a29-b9b6-90d7e3592b74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:26.140770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30813ee3-1304-4a29-b9b6-90d7e3592b74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:26.474868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-30813ee3-1304-4a29-b9b6-90d7e3592b74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:26.494660 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-30813ee3-1304-4a29-b9b6-90d7e3592b74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1308 microversion: 2.1 time: 0.368120 Aug 29 15:50:26.497633 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2946/5710] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:26 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1308 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:27.121646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8eb4a317-8c56-4396-b9e1-4bbf290bb47a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:27.122386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8eb4a317-8c56-4396-b9e1-4bbf290bb47a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:27.136051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8eb4a317-8c56-4396-b9e1-4bbf290bb47a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:27.136770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8eb4a317-8c56-4396-b9e1-4bbf290bb47a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:27.137298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8eb4a317-8c56-4396-b9e1-4bbf290bb47a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:27.140287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8eb4a317-8c56-4396-b9e1-4bbf290bb47a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:27.140759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8eb4a317-8c56-4396-b9e1-4bbf290bb47a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:27.141842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8eb4a317-8c56-4396-b9e1-4bbf290bb47a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:27.474539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8eb4a317-8c56-4396-b9e1-4bbf290bb47a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:27.494874 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8eb4a317-8c56-4396-b9e1-4bbf290bb47a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1509 microversion: 2.1 time: 0.373789 Aug 29 15:50:27.496688 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2765/5711] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:27 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1509 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:27.520150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b7ea9dd4-f1b5-4cba-9526-7a6d2d11a4eb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:27.521839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b7ea9dd4-f1b5-4cba-9526-7a6d2d11a4eb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:27.531749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7ea9dd4-f1b5-4cba-9526-7a6d2d11a4eb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:27.532753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7ea9dd4-f1b5-4cba-9526-7a6d2d11a4eb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:27.533534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7ea9dd4-f1b5-4cba-9526-7a6d2d11a4eb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:27.534522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7ea9dd4-f1b5-4cba-9526-7a6d2d11a4eb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:27.535240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7ea9dd4-f1b5-4cba-9526-7a6d2d11a4eb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:27.536051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b7ea9dd4-f1b5-4cba-9526-7a6d2d11a4eb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:27.808597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b7ea9dd4-f1b5-4cba-9526-7a6d2d11a4eb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:27.818116 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b7ea9dd4-f1b5-4cba-9526-7a6d2d11a4eb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1308 microversion: 2.1 time: 0.303460 Aug 29 15:50:27.822833 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2947/5712] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:27 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1308 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:28.517265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-574f8649-68cf-4aaf-9409-eee4c85b9287 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:28.518029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-574f8649-68cf-4aaf-9409-eee4c85b9287 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:28.538291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-574f8649-68cf-4aaf-9409-eee4c85b9287 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:28.540099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-574f8649-68cf-4aaf-9409-eee4c85b9287 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:28.541553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-574f8649-68cf-4aaf-9409-eee4c85b9287 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:28.543024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-574f8649-68cf-4aaf-9409-eee4c85b9287 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:28.544069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-574f8649-68cf-4aaf-9409-eee4c85b9287 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:28.544779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-574f8649-68cf-4aaf-9409-eee4c85b9287 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:28.853793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-574f8649-68cf-4aaf-9409-eee4c85b9287 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:28.854840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e5d17043-e004-4ef9-a778-d33ad9ed88e9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:28.856015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e5d17043-e004-4ef9-a778-d33ad9ed88e9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:28.862407 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-574f8649-68cf-4aaf-9409-eee4c85b9287 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1509 microversion: 2.1 time: 0.349660 Aug 29 15:50:28.865240 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2766/5713] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:28 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1509 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:28.880331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:28.881539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:28.886715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5d17043-e004-4ef9-a778-d33ad9ed88e9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:28.895970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5d17043-e004-4ef9-a778-d33ad9ed88e9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:28.896554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5d17043-e004-4ef9-a778-d33ad9ed88e9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:28.897356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5d17043-e004-4ef9-a778-d33ad9ed88e9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:28.897849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5d17043-e004-4ef9-a778-d33ad9ed88e9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:28.898265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5d17043-e004-4ef9-a778-d33ad9ed88e9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:29.831877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e5d17043-e004-4ef9-a778-d33ad9ed88e9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:29.845316 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e5d17043-e004-4ef9-a778-d33ad9ed88e9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1308 microversion: 2.1 time: 1.005223 Aug 29 15:50:29.845943 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2948/5714] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:28 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1308 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:29.888800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7dbefccb-ce69-45e0-8456-0e854c39327f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:29.890190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7dbefccb-ce69-45e0-8456-0e854c39327f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:29.901988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:29.909141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dbefccb-ce69-45e0-8456-0e854c39327f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:29.909966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dbefccb-ce69-45e0-8456-0e854c39327f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:29.913343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dbefccb-ce69-45e0-8456-0e854c39327f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:29.914343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dbefccb-ce69-45e0-8456-0e854c39327f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:29.917072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dbefccb-ce69-45e0-8456-0e854c39327f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:29.917814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7dbefccb-ce69-45e0-8456-0e854c39327f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:30.300083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7dbefccb-ce69-45e0-8456-0e854c39327f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:30.308161 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7dbefccb-ce69-45e0-8456-0e854c39327f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1509 microversion: 2.1 time: 0.426350 Aug 29 15:50:30.313847 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2767/5715] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:29 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1509 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:30.607204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-9287708e-74f2-4393-b7be-140695cd565b req-6ceebad5-5d2f-41a2-90c7-4ac8031ed096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0fd8c4a-7225-496b-a071-6fd8f37dc60a", "name": "network-vif-unplugged", "status": "completed", "tag": "8dc04ade-2041-4d24-bbaf-7f8f25a7e827"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:30.621593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9287708e-74f2-4393-b7be-140695cd565b req-6ceebad5-5d2f-41a2-90c7-4ac8031ed096 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:30.622787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9287708e-74f2-4393-b7be-140695cd565b req-6ceebad5-5d2f-41a2-90c7-4ac8031ed096 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:30.623591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9287708e-74f2-4393-b7be-140695cd565b req-6ceebad5-5d2f-41a2-90c7-4ac8031ed096 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:30.662704 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-9287708e-74f2-4393-b7be-140695cd565b req-6ceebad5-5d2f-41a2-90c7-4ac8031ed096 service nova] Creating event network-vif-unplugged:8dc04ade-2041-4d24-bbaf-7f8f25a7e827 for instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a on n-h1-839401-11 Aug 29 15:50:30.686455 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-9287708e-74f2-4393-b7be-140695cd565b req-6ceebad5-5d2f-41a2-90c7-4ac8031ed096 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075416 Aug 29 15:50:30.687210 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2949/5716] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:30.878413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-74162705-3e48-41dd-92d5-4c3e7d297359 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:30.879506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-74162705-3e48-41dd-92d5-4c3e7d297359 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:30.895077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74162705-3e48-41dd-92d5-4c3e7d297359 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:30.896322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74162705-3e48-41dd-92d5-4c3e7d297359 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:30.902769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74162705-3e48-41dd-92d5-4c3e7d297359 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:30.903751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74162705-3e48-41dd-92d5-4c3e7d297359 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:30.913993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74162705-3e48-41dd-92d5-4c3e7d297359 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:30.915733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74162705-3e48-41dd-92d5-4c3e7d297359 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:31.332196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-74162705-3e48-41dd-92d5-4c3e7d297359 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:31.336279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8987a3a8-da65-4df7-9ec4-dada55da7083 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:31.337240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8987a3a8-da65-4df7-9ec4-dada55da7083 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:31.346133 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-74162705-3e48-41dd-92d5-4c3e7d297359 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1308 microversion: 2.1 time: 0.477960 Aug 29 15:50:31.349907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8987a3a8-da65-4df7-9ec4-dada55da7083 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:31.350685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8987a3a8-da65-4df7-9ec4-dada55da7083 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:31.353585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8987a3a8-da65-4df7-9ec4-dada55da7083 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:31.354609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8987a3a8-da65-4df7-9ec4-dada55da7083 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:31.355307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8987a3a8-da65-4df7-9ec4-dada55da7083 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:31.356196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8987a3a8-da65-4df7-9ec4-dada55da7083 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:31.365410 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2768/5717] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:30 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1308 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:31.645328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8987a3a8-da65-4df7-9ec4-dada55da7083 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:31.657134 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8987a3a8-da65-4df7-9ec4-dada55da7083 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1509 microversion: 2.1 time: 0.325388 Aug 29 15:50:31.661814 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2950/5718] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:31 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1509 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:32.372203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a34e01b1-18f5-4470-b381-c9b45d14f886 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:32.373776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a34e01b1-18f5-4470-b381-c9b45d14f886 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:32.384964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:32.388699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34e01b1-18f5-4470-b381-c9b45d14f886 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:32.391282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34e01b1-18f5-4470-b381-c9b45d14f886 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:32.393460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34e01b1-18f5-4470-b381-c9b45d14f886 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:32.395048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34e01b1-18f5-4470-b381-c9b45d14f886 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:32.396097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34e01b1-18f5-4470-b381-c9b45d14f886 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:32.396947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a34e01b1-18f5-4470-b381-c9b45d14f886 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:32.688226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-990ca294-e3ff-433c-836f-71000bd7f9b7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:32.689175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-990ca294-e3ff-433c-836f-71000bd7f9b7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:32.713962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-990ca294-e3ff-433c-836f-71000bd7f9b7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:32.714606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-990ca294-e3ff-433c-836f-71000bd7f9b7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:32.715175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-990ca294-e3ff-433c-836f-71000bd7f9b7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:32.717459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-990ca294-e3ff-433c-836f-71000bd7f9b7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:32.718184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-990ca294-e3ff-433c-836f-71000bd7f9b7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:32.719441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-990ca294-e3ff-433c-836f-71000bd7f9b7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:32.947979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a34e01b1-18f5-4470-b381-c9b45d14f886 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:32.960413 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a34e01b1-18f5-4470-b381-c9b45d14f886 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1308 microversion: 2.1 time: 0.593192 Aug 29 15:50:32.976396 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2769/5719] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:32 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1308 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:33.006997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-990ca294-e3ff-433c-836f-71000bd7f9b7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:33.024365 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-990ca294-e3ff-433c-836f-71000bd7f9b7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1452 microversion: 2.1 time: 0.343321 Aug 29 15:50:33.026898 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2951/5720] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:32 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1452 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:33.048875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b19ffbf1-82c6-419d-9de1-ab59bbb6c523 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:33.050569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b19ffbf1-82c6-419d-9de1-ab59bbb6c523 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:33.064585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b19ffbf1-82c6-419d-9de1-ab59bbb6c523 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:33.065475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b19ffbf1-82c6-419d-9de1-ab59bbb6c523 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:33.069224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b19ffbf1-82c6-419d-9de1-ab59bbb6c523 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:33.070197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b19ffbf1-82c6-419d-9de1-ab59bbb6c523 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:33.070842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b19ffbf1-82c6-419d-9de1-ab59bbb6c523 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:33.072880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b19ffbf1-82c6-419d-9de1-ab59bbb6c523 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:33.590047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-10dbf688-bee0-45ae-b2c2-6250475d2700 req-8173ae66-442c-4196-9466-1c23d9a68d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "507274a1-8eee-4a29-9f47-5c560ae48444", "name": "network-vif-plugged", "status": "completed", "tag": "3cbd6b2a-e077-48b9-84fb-4c92c81c92c9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:33.622228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-10dbf688-bee0-45ae-b2c2-6250475d2700 req-8173ae66-442c-4196-9466-1c23d9a68d06 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:33.622228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-10dbf688-bee0-45ae-b2c2-6250475d2700 req-8173ae66-442c-4196-9466-1c23d9a68d06 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:33.628115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-10dbf688-bee0-45ae-b2c2-6250475d2700 req-8173ae66-442c-4196-9466-1c23d9a68d06 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:33.668808 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-10dbf688-bee0-45ae-b2c2-6250475d2700 req-8173ae66-442c-4196-9466-1c23d9a68d06 service nova] Creating event network-vif-plugged:3cbd6b2a-e077-48b9-84fb-4c92c81c92c9 for instance 507274a1-8eee-4a29-9f47-5c560ae48444 on n-h1-839401-11 Aug 29 15:50:33.679371 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-10dbf688-bee0-45ae-b2c2-6250475d2700 req-8173ae66-442c-4196-9466-1c23d9a68d06 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.379735 Aug 29 15:50:33.680820 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2952/5721] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:50:33.997542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-07e2b11a-8e8c-49f8-b1db-8b61071b08d8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:33.998448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-07e2b11a-8e8c-49f8-b1db-8b61071b08d8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:34.016875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07e2b11a-8e8c-49f8-b1db-8b61071b08d8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:34.019454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07e2b11a-8e8c-49f8-b1db-8b61071b08d8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:34.020186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07e2b11a-8e8c-49f8-b1db-8b61071b08d8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:34.021985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07e2b11a-8e8c-49f8-b1db-8b61071b08d8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:34.025562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07e2b11a-8e8c-49f8-b1db-8b61071b08d8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:34.026147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07e2b11a-8e8c-49f8-b1db-8b61071b08d8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:34.145234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b19ffbf1-82c6-419d-9de1-ab59bbb6c523 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:34.155877 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b19ffbf1-82c6-419d-9de1-ab59bbb6c523 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1452 microversion: 2.1 time: 1.111870 Aug 29 15:50:34.162582 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2770/5722] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:33 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1452 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:34.245348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d449cc96-c2b6-4454-84a5-ae3d437bf19f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:34.249211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d449cc96-c2b6-4454-84a5-ae3d437bf19f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:34.275682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d449cc96-c2b6-4454-84a5-ae3d437bf19f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:34.276292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d449cc96-c2b6-4454-84a5-ae3d437bf19f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:34.276867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d449cc96-c2b6-4454-84a5-ae3d437bf19f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:34.277821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d449cc96-c2b6-4454-84a5-ae3d437bf19f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:34.279591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d449cc96-c2b6-4454-84a5-ae3d437bf19f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:34.282140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d449cc96-c2b6-4454-84a5-ae3d437bf19f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:34.351312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-d449cc96-c2b6-4454-84a5-ae3d437bf19f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lazy-loading 'flavor' on Instance uuid b0fd8c4a-7225-496b-a071-6fd8f37dc60a {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:50:34.373387 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-d449cc96-c2b6-4454-84a5-ae3d437bf19f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Cannot 'shelve' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state shelved_offloaded Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d449cc96-c2b6-4454-84a5-ae3d437bf19f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action HTTP/1.1 Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 14 Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: {"shelve": {}} Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: exception: Cannot 'shelve' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state shelved_offloaded Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'b0fd8c4a-7225-496b-a071-6fd8f37dc60a', 'body': {'shelve': {}}} Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:50:34.376050 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:50:34.380968 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:50:34.380968 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state shelved_offloaded Aug 29 15:50:34.380968 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:34.380968 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:34.380968 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:34.380968 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:34.380968 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:34.380968 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:34.380968 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:34.380968 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:34.380968 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state shelved_offloaded Aug 29 15:50:34.380968 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:50:34.384020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d449cc96-c2b6-4454-84a5-ae3d437bf19f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 409 to user: Cannot 'shelve' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state shelved_offloaded {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:34.385877 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d449cc96-c2b6-4454-84a5-ae3d437bf19f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action" status: 409 len: 155 microversion: 2.1 time: 0.155286 Aug 29 15:50:34.387638 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2771/5723] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:50:34 2022] POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action => generated 155 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:50:34.402381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2daf9667-009f-43e1-ba3e-5a36f049a5e0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:34.403296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2daf9667-009f-43e1-ba3e-5a36f049a5e0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:34.411213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2daf9667-009f-43e1-ba3e-5a36f049a5e0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:34.413433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2daf9667-009f-43e1-ba3e-5a36f049a5e0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:34.414337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2daf9667-009f-43e1-ba3e-5a36f049a5e0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:34.415430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2daf9667-009f-43e1-ba3e-5a36f049a5e0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:34.416168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2daf9667-009f-43e1-ba3e-5a36f049a5e0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:34.416842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2daf9667-009f-43e1-ba3e-5a36f049a5e0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:34.441823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:34.446636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-07e2b11a-8e8c-49f8-b1db-8b61071b08d8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:34.459638 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-07e2b11a-8e8c-49f8-b1db-8b61071b08d8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1308 microversion: 2.1 time: 0.480158 Aug 29 15:50:34.463462 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2953/5724] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:33 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1308 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:34.491262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2daf9667-009f-43e1-ba3e-5a36f049a5e0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122361) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 15:50:34.636856 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2daf9667-009f-43e1-ba3e-5a36f049a5e0 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action" status: 202 len: 0 microversion: 2.1 time: 0.243015 Aug 29 15:50:34.643931 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2772/5725] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:50:34 2022] POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:50:34.647985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e21b27c4-ac87-461f-b423-257c4295c4e2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:34.648617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e21b27c4-ac87-461f-b423-257c4295c4e2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:34.656595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e21b27c4-ac87-461f-b423-257c4295c4e2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:34.660891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e21b27c4-ac87-461f-b423-257c4295c4e2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:34.661706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e21b27c4-ac87-461f-b423-257c4295c4e2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:34.663910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e21b27c4-ac87-461f-b423-257c4295c4e2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:34.664947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e21b27c4-ac87-461f-b423-257c4295c4e2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:34.665598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e21b27c4-ac87-461f-b423-257c4295c4e2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:35.026925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e21b27c4-ac87-461f-b423-257c4295c4e2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:35.045769 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e21b27c4-ac87-461f-b423-257c4295c4e2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1460 microversion: 2.1 time: 0.402174 Aug 29 15:50:35.046306 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2954/5726] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:34 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1460 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:35.485801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-94c79883-ef9d-4e71-933a-7570f1e30c33 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:35.486629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-94c79883-ef9d-4e71-933a-7570f1e30c33 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:35.496404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94c79883-ef9d-4e71-933a-7570f1e30c33 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:35.503406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94c79883-ef9d-4e71-933a-7570f1e30c33 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:35.505067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94c79883-ef9d-4e71-933a-7570f1e30c33 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:35.506285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94c79883-ef9d-4e71-933a-7570f1e30c33 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:35.511253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94c79883-ef9d-4e71-933a-7570f1e30c33 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:35.511867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94c79883-ef9d-4e71-933a-7570f1e30c33 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:36.068984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-22719116-9e4c-4404-9132-a690b71c059b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:36.069695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-22719116-9e4c-4404-9132-a690b71c059b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:36.110419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22719116-9e4c-4404-9132-a690b71c059b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:36.111263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22719116-9e4c-4404-9132-a690b71c059b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:36.111992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22719116-9e4c-4404-9132-a690b71c059b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:36.113010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22719116-9e4c-4404-9132-a690b71c059b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:36.113717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22719116-9e4c-4404-9132-a690b71c059b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:36.114342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22719116-9e4c-4404-9132-a690b71c059b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:36.214100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-94c79883-ef9d-4e71-933a-7570f1e30c33 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:36.228012 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-94c79883-ef9d-4e71-933a-7570f1e30c33 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1308 microversion: 2.1 time: 0.747507 Aug 29 15:50:36.228828 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2773/5727] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:35 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1308 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:36.330642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-22719116-9e4c-4404-9132-a690b71c059b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:36.342534 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-22719116-9e4c-4404-9132-a690b71c059b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1460 microversion: 2.1 time: 0.279789 Aug 29 15:50:36.350660 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2955/5728] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:36 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1460 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:36.578266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-169008215", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "5245d492-8e0f-48bc-9e75-1c9648fdd29b"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:36.658926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] validate_networks() for [('5245d492-8e0f-48bc-9e75-1c9648fdd29b', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:50:37.237444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:50:37.238318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:50:37.238550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:50:37.238962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:50:37.239374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:50:37.253458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c09a1f27-cb3c-47f5-8845-5f076bb7bc3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:37.254065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c09a1f27-cb3c-47f5-8845-5f076bb7bc3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:37.254457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:37.254950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:37.258410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:37.259187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:37.262091 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:37.262247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c09a1f27-cb3c-47f5-8845-5f076bb7bc3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:37.262687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c09a1f27-cb3c-47f5-8845-5f076bb7bc3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:37.262914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:37.266794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c09a1f27-cb3c-47f5-8845-5f076bb7bc3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:37.270393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c09a1f27-cb3c-47f5-8845-5f076bb7bc3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:37.270876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c09a1f27-cb3c-47f5-8845-5f076bb7bc3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:37.271495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c09a1f27-cb3c-47f5-8845-5f076bb7bc3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:37.308304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Getting quotas for project 9df2fd8bb18442cd8d9134ac85ecadb1. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:37.317708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Getting quotas for user b4a3b567728c4bbcaf5908807f0deaac and project 9df2fd8bb18442cd8d9134ac85ecadb1. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:37.349779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:50:37.352271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:50:37.431252 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4726fec4-d897-44fe-b35d-7b4fc92d416d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.963536 Aug 29 15:50:37.438449 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2774/5729] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:50:37.451791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a91020f6-dddc-4725-8e7a-e584fd7e4101 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:37.453511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a91020f6-dddc-4725-8e7a-e584fd7e4101 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:37.463833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a91020f6-dddc-4725-8e7a-e584fd7e4101 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:37.464792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a91020f6-dddc-4725-8e7a-e584fd7e4101 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:37.465456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a91020f6-dddc-4725-8e7a-e584fd7e4101 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:37.466400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a91020f6-dddc-4725-8e7a-e584fd7e4101 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:37.467022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a91020f6-dddc-4725-8e7a-e584fd7e4101 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:37.467612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a91020f6-dddc-4725-8e7a-e584fd7e4101 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:37.650728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c09a1f27-cb3c-47f5-8845-5f076bb7bc3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:37.668452 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c09a1f27-cb3c-47f5-8845-5f076bb7bc3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1488 microversion: 2.1 time: 0.418044 Aug 29 15:50:37.670738 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2956/5730] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:37 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1488 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:37.679611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-80b58da7-401a-499c-a329-9503a8e24798 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:37.680720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-80b58da7-401a-499c-a329-9503a8e24798 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:37.724559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a91020f6-dddc-4725-8e7a-e584fd7e4101 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:37.734415 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a91020f6-dddc-4725-8e7a-e584fd7e4101 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.294651 Aug 29 15:50:37.739352 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2775/5731] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:37 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:37.842467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-80b58da7-401a-499c-a329-9503a8e24798 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:37.865118 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-80b58da7-401a-499c-a329-9503a8e24798 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1223 microversion: 2.1 time: 0.192880 Aug 29 15:50:37.866053 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2957/5732] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:37 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1223 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:37.979535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-749863843", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "e7e1a9e7-4d7f-4958-9bd4-e4039baa5a12"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:38.085600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] validate_networks() for [('e7e1a9e7-4d7f-4958-9bd4-e4039baa5a12', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:50:38.764354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9c2025a2-7c2b-4c4e-9c7a-6a8d26eacd62 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:38.764980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9c2025a2-7c2b-4c4e-9c7a-6a8d26eacd62 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:38.789325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:50:38.789976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c2025a2-7c2b-4c4e-9c7a-6a8d26eacd62 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:38.790151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:50:38.790275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c2025a2-7c2b-4c4e-9c7a-6a8d26eacd62 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:38.790381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:50:38.790505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c2025a2-7c2b-4c4e-9c7a-6a8d26eacd62 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:38.790619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:50:38.790923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:50:38.791072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c2025a2-7c2b-4c4e-9c7a-6a8d26eacd62 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:38.791743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c2025a2-7c2b-4c4e-9c7a-6a8d26eacd62 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:38.792171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c2025a2-7c2b-4c4e-9c7a-6a8d26eacd62 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:38.809312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:38.809815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:38.810254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:38.810988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:38.811447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:38.811875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:38.853480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:38.865841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for user db3e87dfe49444f886b7a9ac5d22bda1 and project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:38.898823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:50:38.903902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:50:38.970220 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ddce41c2-f6ff-49c0-8e7b-0b1edcd1d581 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994700 Aug 29 15:50:38.972244 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2776/5733] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:50:38.978750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-284aa51d-c918-4b73-8d85-96b8e8ca12a4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:38.979876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-284aa51d-c918-4b73-8d85-96b8e8ca12a4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:38.987877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-284aa51d-c918-4b73-8d85-96b8e8ca12a4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:38.988706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-284aa51d-c918-4b73-8d85-96b8e8ca12a4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:38.989729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-284aa51d-c918-4b73-8d85-96b8e8ca12a4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:38.990688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-284aa51d-c918-4b73-8d85-96b8e8ca12a4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:38.991905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-284aa51d-c918-4b73-8d85-96b8e8ca12a4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:38.992747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-284aa51d-c918-4b73-8d85-96b8e8ca12a4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:39.096900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-284aa51d-c918-4b73-8d85-96b8e8ca12a4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:39.111831 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-284aa51d-c918-4b73-8d85-96b8e8ca12a4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1275 microversion: 2.1 time: 0.137759 Aug 29 15:50:39.129453 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2777/5734] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:38 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:39.155384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c1d06c22-1a2c-475d-beaf-421b9d68cad8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:39.159066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c1d06c22-1a2c-475d-beaf-421b9d68cad8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:39.289122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9c2025a2-7c2b-4c4e-9c7a-6a8d26eacd62 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:39.302060 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9c2025a2-7c2b-4c4e-9c7a-6a8d26eacd62 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.541631 Aug 29 15:50:39.303094 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2958/5735] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:38 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:39.307727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-123bd2a4-b450-429b-ba3c-b395411a3555 req-adffd57a-0cf7-4f14-9e0f-77edc4a5fc74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0fd8c4a-7225-496b-a071-6fd8f37dc60a", "tag": "8dc04ade-2041-4d24-bbaf-7f8f25a7e827"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:39.329796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-123bd2a4-b450-429b-ba3c-b395411a3555 req-adffd57a-0cf7-4f14-9e0f-77edc4a5fc74 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:39.330380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-123bd2a4-b450-429b-ba3c-b395411a3555 req-adffd57a-0cf7-4f14-9e0f-77edc4a5fc74 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:39.330816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-123bd2a4-b450-429b-ba3c-b395411a3555 req-adffd57a-0cf7-4f14-9e0f-77edc4a5fc74 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:39.372247 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-123bd2a4-b450-429b-ba3c-b395411a3555 req-adffd57a-0cf7-4f14-9e0f-77edc4a5fc74 service nova] Creating event network-changed:8dc04ade-2041-4d24-bbaf-7f8f25a7e827 for instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a on n-h2-839401-11 Aug 29 15:50:39.404105 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-123bd2a4-b450-429b-ba3c-b395411a3555 req-adffd57a-0cf7-4f14-9e0f-77edc4a5fc74 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098700 Aug 29 15:50:39.407330 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2959/5736] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:39.447448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c1d06c22-1a2c-475d-beaf-421b9d68cad8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:39.456014 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c1d06c22-1a2c-475d-beaf-421b9d68cad8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1208 microversion: 2.1 time: 0.323871 Aug 29 15:50:39.460032 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2778/5737] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:39 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1208 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:40.136413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2e07bd5c-4da1-44ce-a6b8-c5d01fd9409d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:40.138315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2e07bd5c-4da1-44ce-a6b8-c5d01fd9409d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:40.154833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e07bd5c-4da1-44ce-a6b8-c5d01fd9409d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:40.155481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e07bd5c-4da1-44ce-a6b8-c5d01fd9409d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:40.156019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e07bd5c-4da1-44ce-a6b8-c5d01fd9409d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:40.156834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e07bd5c-4da1-44ce-a6b8-c5d01fd9409d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:40.157422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e07bd5c-4da1-44ce-a6b8-c5d01fd9409d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:40.157961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e07bd5c-4da1-44ce-a6b8-c5d01fd9409d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:40.322170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d6068a95-efda-4a5f-96c2-4ddde2ecba46 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:40.323383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d6068a95-efda-4a5f-96c2-4ddde2ecba46 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:40.324594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2e07bd5c-4da1-44ce-a6b8-c5d01fd9409d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:40.335576 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2e07bd5c-4da1-44ce-a6b8-c5d01fd9409d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1283 microversion: 2.1 time: 0.205477 Aug 29 15:50:40.350869 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2960/5738] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:40 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1283 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:40.351118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6068a95-efda-4a5f-96c2-4ddde2ecba46 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:40.351118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6068a95-efda-4a5f-96c2-4ddde2ecba46 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:40.351118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6068a95-efda-4a5f-96c2-4ddde2ecba46 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:40.353956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6068a95-efda-4a5f-96c2-4ddde2ecba46 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:40.354463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6068a95-efda-4a5f-96c2-4ddde2ecba46 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:40.354910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6068a95-efda-4a5f-96c2-4ddde2ecba46 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:40.479825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c5f17a09-52ce-4d93-9f38-40c069e707f7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:40.480507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c5f17a09-52ce-4d93-9f38-40c069e707f7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:40.498186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5f17a09-52ce-4d93-9f38-40c069e707f7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:40.498696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5f17a09-52ce-4d93-9f38-40c069e707f7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:40.499145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5f17a09-52ce-4d93-9f38-40c069e707f7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:40.499867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5f17a09-52ce-4d93-9f38-40c069e707f7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:40.500326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5f17a09-52ce-4d93-9f38-40c069e707f7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:40.500755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5f17a09-52ce-4d93-9f38-40c069e707f7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:40.670659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c5f17a09-52ce-4d93-9f38-40c069e707f7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:40.691883 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c5f17a09-52ce-4d93-9f38-40c069e707f7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1204 microversion: 2.1 time: 0.216192 Aug 29 15:50:40.716361 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2961/5739] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:40 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1204 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:40.963699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d6068a95-efda-4a5f-96c2-4ddde2ecba46 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:40.980422 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d6068a95-efda-4a5f-96c2-4ddde2ecba46 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.662033 Aug 29 15:50:40.981469 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2779/5740] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:40 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:41.358696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f3121cfd-46a3-407a-bdfe-77789b29707d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:41.359291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f3121cfd-46a3-407a-bdfe-77789b29707d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:41.382670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3121cfd-46a3-407a-bdfe-77789b29707d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:41.385030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3121cfd-46a3-407a-bdfe-77789b29707d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:41.385758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3121cfd-46a3-407a-bdfe-77789b29707d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:41.388518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3121cfd-46a3-407a-bdfe-77789b29707d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:41.389325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3121cfd-46a3-407a-bdfe-77789b29707d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:41.390615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3121cfd-46a3-407a-bdfe-77789b29707d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:41.552079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f3121cfd-46a3-407a-bdfe-77789b29707d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:41.571723 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f3121cfd-46a3-407a-bdfe-77789b29707d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1281 microversion: 2.1 time: 0.209320 Aug 29 15:50:41.582478 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2962/5741] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:41 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1281 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:41.717414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-88bf8577-cc15-400d-a706-e823faab8d2f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:41.718019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-88bf8577-cc15-400d-a706-e823faab8d2f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:41.737423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88bf8577-cc15-400d-a706-e823faab8d2f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:41.737957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88bf8577-cc15-400d-a706-e823faab8d2f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:41.738349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88bf8577-cc15-400d-a706-e823faab8d2f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:41.740908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88bf8577-cc15-400d-a706-e823faab8d2f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:41.744245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88bf8577-cc15-400d-a706-e823faab8d2f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:41.744926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88bf8577-cc15-400d-a706-e823faab8d2f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:42.002039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a4026a79-6ae5-4a3b-89b9-ca999070b1ff tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:42.002899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a4026a79-6ae5-4a3b-89b9-ca999070b1ff tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:42.023363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4026a79-6ae5-4a3b-89b9-ca999070b1ff tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:42.026481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4026a79-6ae5-4a3b-89b9-ca999070b1ff tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:42.027155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4026a79-6ae5-4a3b-89b9-ca999070b1ff tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:42.028187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4026a79-6ae5-4a3b-89b9-ca999070b1ff tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:42.030323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4026a79-6ae5-4a3b-89b9-ca999070b1ff tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:42.030951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4026a79-6ae5-4a3b-89b9-ca999070b1ff tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:42.044262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:42.480484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a4026a79-6ae5-4a3b-89b9-ca999070b1ff tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:42.505279 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a4026a79-6ae5-4a3b-89b9-ca999070b1ff tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.505028 Aug 29 15:50:42.511258 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2963/5742] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:41 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:42.608640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7dc61ddd-6905-4790-94ba-81cfcac70e58 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:42.609289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7dc61ddd-6905-4790-94ba-81cfcac70e58 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:42.624046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dc61ddd-6905-4790-94ba-81cfcac70e58 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:42.627091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dc61ddd-6905-4790-94ba-81cfcac70e58 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:42.627638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dc61ddd-6905-4790-94ba-81cfcac70e58 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:42.631455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dc61ddd-6905-4790-94ba-81cfcac70e58 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:42.632103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dc61ddd-6905-4790-94ba-81cfcac70e58 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:42.633710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dc61ddd-6905-4790-94ba-81cfcac70e58 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:42.823987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7dc61ddd-6905-4790-94ba-81cfcac70e58 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:42.842457 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7dc61ddd-6905-4790-94ba-81cfcac70e58 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1281 microversion: 2.1 time: 0.237934 Aug 29 15:50:42.843087 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2964/5743] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:42 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1281 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:43.081710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-88bf8577-cc15-400d-a706-e823faab8d2f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:43.128432 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-88bf8577-cc15-400d-a706-e823faab8d2f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1278 microversion: 2.1 time: 1.410027 Aug 29 15:50:43.129960 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2780/5744] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:41 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1278 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:43.532900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-12e1b36a-6e94-4131-b90b-a4203b90a308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:43.539328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-12e1b36a-6e94-4131-b90b-a4203b90a308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:43.558157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12e1b36a-6e94-4131-b90b-a4203b90a308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:43.559016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12e1b36a-6e94-4131-b90b-a4203b90a308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:43.560275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12e1b36a-6e94-4131-b90b-a4203b90a308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:43.561910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12e1b36a-6e94-4131-b90b-a4203b90a308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:43.569885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12e1b36a-6e94-4131-b90b-a4203b90a308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:43.570881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12e1b36a-6e94-4131-b90b-a4203b90a308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:43.864800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-978ffcfe-3e1d-4918-a1dc-567c7593b20b tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:43.865847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-978ffcfe-3e1d-4918-a1dc-567c7593b20b tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:43.897918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-978ffcfe-3e1d-4918-a1dc-567c7593b20b tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:43.904489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-978ffcfe-3e1d-4918-a1dc-567c7593b20b tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:43.907081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-978ffcfe-3e1d-4918-a1dc-567c7593b20b tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:43.908467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-978ffcfe-3e1d-4918-a1dc-567c7593b20b tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:43.910232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-978ffcfe-3e1d-4918-a1dc-567c7593b20b tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:43.914949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-978ffcfe-3e1d-4918-a1dc-567c7593b20b tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:43.920130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-12e1b36a-6e94-4131-b90b-a4203b90a308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:43.951669 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-12e1b36a-6e94-4131-b90b-a4203b90a308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.423721 Aug 29 15:50:43.953492 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2965/5745] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:43 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:44.183792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-54ca2e62-9c22-4251-8061-57e4802cf338 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:44.184800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-54ca2e62-9c22-4251-8061-57e4802cf338 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:44.199053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54ca2e62-9c22-4251-8061-57e4802cf338 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:44.200306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54ca2e62-9c22-4251-8061-57e4802cf338 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:44.203687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54ca2e62-9c22-4251-8061-57e4802cf338 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:44.205977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54ca2e62-9c22-4251-8061-57e4802cf338 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:44.209706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54ca2e62-9c22-4251-8061-57e4802cf338 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:44.216527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54ca2e62-9c22-4251-8061-57e4802cf338 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:44.224366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-978ffcfe-3e1d-4918-a1dc-567c7593b20b tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:44.239816 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-978ffcfe-3e1d-4918-a1dc-567c7593b20b tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1281 microversion: 2.1 time: 0.380379 Aug 29 15:50:44.254349 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2781/5746] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:43 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1281 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:44.344610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-54ca2e62-9c22-4251-8061-57e4802cf338 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:44.355074 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-54ca2e62-9c22-4251-8061-57e4802cf338 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1266 microversion: 2.1 time: 0.175677 Aug 29 15:50:44.365445 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2966/5747] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:44 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:44.975548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4bf020c3-855c-486a-8618-f70c6605b8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:44.976485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4bf020c3-855c-486a-8618-f70c6605b8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:44.991555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bf020c3-855c-486a-8618-f70c6605b8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:44.992545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bf020c3-855c-486a-8618-f70c6605b8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:44.993673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bf020c3-855c-486a-8618-f70c6605b8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:44.995868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bf020c3-855c-486a-8618-f70c6605b8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:45.001004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bf020c3-855c-486a-8618-f70c6605b8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:45.004896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bf020c3-855c-486a-8618-f70c6605b8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:45.266503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d63765f1-6f8d-46a4-ae9a-74a258fb7377 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:45.267834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d63765f1-6f8d-46a4-ae9a-74a258fb7377 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:45.279842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d63765f1-6f8d-46a4-ae9a-74a258fb7377 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:45.281733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d63765f1-6f8d-46a4-ae9a-74a258fb7377 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:45.285262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d63765f1-6f8d-46a4-ae9a-74a258fb7377 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:45.286453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d63765f1-6f8d-46a4-ae9a-74a258fb7377 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:45.288081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d63765f1-6f8d-46a4-ae9a-74a258fb7377 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:45.288728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d63765f1-6f8d-46a4-ae9a-74a258fb7377 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:45.471521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4bf020c3-855c-486a-8618-f70c6605b8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:45.486705 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4bf020c3-855c-486a-8618-f70c6605b8d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.515492 Aug 29 15:50:45.488120 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2782/5748] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:44 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:45.493027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-54b0e0b0-1cec-4b3e-a53d-c3a4d9f71cb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:45.493909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-54b0e0b0-1cec-4b3e-a53d-c3a4d9f71cb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:45.500205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54b0e0b0-1cec-4b3e-a53d-c3a4d9f71cb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:45.501054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54b0e0b0-1cec-4b3e-a53d-c3a4d9f71cb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:45.501606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54b0e0b0-1cec-4b3e-a53d-c3a4d9f71cb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:45.502695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54b0e0b0-1cec-4b3e-a53d-c3a4d9f71cb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:45.503302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54b0e0b0-1cec-4b3e-a53d-c3a4d9f71cb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:45.503971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54b0e0b0-1cec-4b3e-a53d-c3a4d9f71cb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:45.566122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d63765f1-6f8d-46a4-ae9a-74a258fb7377 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:45.581526 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d63765f1-6f8d-46a4-ae9a-74a258fb7377 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1323 microversion: 2.1 time: 0.317834 Aug 29 15:50:45.583126 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2967/5749] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:45 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1323 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:45.630571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-54b0e0b0-1cec-4b3e-a53d-c3a4d9f71cb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:45.647123 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-54b0e0b0-1cec-4b3e-a53d-c3a4d9f71cb1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1266 microversion: 2.1 time: 0.157563 Aug 29 15:50:45.647820 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2783/5750] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:45 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:46.511421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-338bcd8f-3a18-496d-8552-b686eeabd03c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:46.512867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-338bcd8f-3a18-496d-8552-b686eeabd03c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:46.524880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-338bcd8f-3a18-496d-8552-b686eeabd03c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:46.527739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-338bcd8f-3a18-496d-8552-b686eeabd03c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:46.528409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-338bcd8f-3a18-496d-8552-b686eeabd03c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:46.533014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-338bcd8f-3a18-496d-8552-b686eeabd03c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:46.533784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-338bcd8f-3a18-496d-8552-b686eeabd03c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:46.534438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-338bcd8f-3a18-496d-8552-b686eeabd03c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:46.606173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d8ce56cb-bd87-4cc5-97d9-16f3603b70c8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:46.607207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d8ce56cb-bd87-4cc5-97d9-16f3603b70c8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:46.626431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8ce56cb-bd87-4cc5-97d9-16f3603b70c8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:46.627268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8ce56cb-bd87-4cc5-97d9-16f3603b70c8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:46.627874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8ce56cb-bd87-4cc5-97d9-16f3603b70c8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:46.628752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8ce56cb-bd87-4cc5-97d9-16f3603b70c8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:46.629403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8ce56cb-bd87-4cc5-97d9-16f3603b70c8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:46.630134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8ce56cb-bd87-4cc5-97d9-16f3603b70c8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:47.072116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d8ce56cb-bd87-4cc5-97d9-16f3603b70c8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:47.110084 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d8ce56cb-bd87-4cc5-97d9-16f3603b70c8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1323 microversion: 2.1 time: 0.503305 Aug 29 15:50:47.118350 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2784/5751] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:46 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1323 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:47.130130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-30c56f02-a99d-4507-a35c-1950989ea58b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:47.131169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-30c56f02-a99d-4507-a35c-1950989ea58b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:47.140221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30c56f02-a99d-4507-a35c-1950989ea58b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:47.142237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30c56f02-a99d-4507-a35c-1950989ea58b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:47.144619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30c56f02-a99d-4507-a35c-1950989ea58b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:47.147017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30c56f02-a99d-4507-a35c-1950989ea58b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:47.149010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30c56f02-a99d-4507-a35c-1950989ea58b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:47.150457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30c56f02-a99d-4507-a35c-1950989ea58b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:47.266163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-338bcd8f-3a18-496d-8552-b686eeabd03c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:47.281697 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-338bcd8f-3a18-496d-8552-b686eeabd03c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.773100 Aug 29 15:50:47.283358 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2968/5752] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:46 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:47.433673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-dce23375-3fb3-48a2-9205-544e69e25a9f req-dc09e244-b0e0-4076-8623-09d65d332ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c40da290-3668-453f-937c-5ef2e7e75a06", "tag": "2f895dca-d3a6-4a5a-aaef-3c0a82d4056e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:47.467236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dce23375-3fb3-48a2-9205-544e69e25a9f req-dc09e244-b0e0-4076-8623-09d65d332ee3 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:47.469747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dce23375-3fb3-48a2-9205-544e69e25a9f req-dc09e244-b0e0-4076-8623-09d65d332ee3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:47.472698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dce23375-3fb3-48a2-9205-544e69e25a9f req-dc09e244-b0e0-4076-8623-09d65d332ee3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:47.520781 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-dce23375-3fb3-48a2-9205-544e69e25a9f req-dc09e244-b0e0-4076-8623-09d65d332ee3 service nova] Creating event network-changed:2f895dca-d3a6-4a5a-aaef-3c0a82d4056e for instance c40da290-3668-453f-937c-5ef2e7e75a06 on n-h2-839401-11 Aug 29 15:50:47.547796 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-dce23375-3fb3-48a2-9205-544e69e25a9f req-dc09e244-b0e0-4076-8623-09d65d332ee3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.262802 Aug 29 15:50:47.553168 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2969/5753] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:48.105131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-30c56f02-a99d-4507-a35c-1950989ea58b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:48.115332 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-30c56f02-a99d-4507-a35c-1950989ea58b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1308 microversion: 2.1 time: 0.993224 Aug 29 15:50:48.115862 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2785/5754] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:47 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1308 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:48.138060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-930d65f3-25b0-41f5-bd4d-87857594643c tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:48.139192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-930d65f3-25b0-41f5-bd4d-87857594643c tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:48.163214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:48.165178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-930d65f3-25b0-41f5-bd4d-87857594643c tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:48.170325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-930d65f3-25b0-41f5-bd4d-87857594643c tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:48.170325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-930d65f3-25b0-41f5-bd4d-87857594643c tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:48.170325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-930d65f3-25b0-41f5-bd4d-87857594643c tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:48.170325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-930d65f3-25b0-41f5-bd4d-87857594643c tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:48.170325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-930d65f3-25b0-41f5-bd4d-87857594643c tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:48.304718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-84a7475e-222a-47cb-99ab-d87df31bc0e7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:48.305542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-84a7475e-222a-47cb-99ab-d87df31bc0e7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:48.315987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84a7475e-222a-47cb-99ab-d87df31bc0e7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:48.317205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84a7475e-222a-47cb-99ab-d87df31bc0e7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:48.322014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84a7475e-222a-47cb-99ab-d87df31bc0e7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:48.323216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84a7475e-222a-47cb-99ab-d87df31bc0e7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:48.324056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84a7475e-222a-47cb-99ab-d87df31bc0e7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:48.324925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84a7475e-222a-47cb-99ab-d87df31bc0e7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:48.542262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-930d65f3-25b0-41f5-bd4d-87857594643c tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:48.570183 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-930d65f3-25b0-41f5-bd4d-87857594643c tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1323 microversion: 2.1 time: 0.435607 Aug 29 15:50:48.572864 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2970/5755] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:48 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1323 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:48.830358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:48.918845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-84a7475e-222a-47cb-99ab-d87df31bc0e7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:48.931779 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-84a7475e-222a-47cb-99ab-d87df31bc0e7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.632357 Aug 29 15:50:48.941284 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2786/5756] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:48 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:49.145046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3db7c727-5de9-445b-b288-f9356ddbc5da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:49.146220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3db7c727-5de9-445b-b288-f9356ddbc5da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:49.164310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3db7c727-5de9-445b-b288-f9356ddbc5da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:49.165678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3db7c727-5de9-445b-b288-f9356ddbc5da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:49.166336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3db7c727-5de9-445b-b288-f9356ddbc5da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:49.176448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3db7c727-5de9-445b-b288-f9356ddbc5da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:49.177334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3db7c727-5de9-445b-b288-f9356ddbc5da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:49.178084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3db7c727-5de9-445b-b288-f9356ddbc5da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:49.536814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3db7c727-5de9-445b-b288-f9356ddbc5da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:49.564923 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3db7c727-5de9-445b-b288-f9356ddbc5da tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1308 microversion: 2.1 time: 0.430656 Aug 29 15:50:49.568088 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2971/5757] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:49 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1308 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:49.591644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-9a75919c-0bbd-4186-b7b0-75cc7f57a02e req-574cbc5a-4081-4675-9abe-bd285fe5fed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d207d03-2c7b-4684-9a0d-21b1c5bebe9e", "tag": "a2acda54-0e76-4550-98fb-162209334237"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:49.601150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f2fd7f28-6b77-4a4d-9082-165735f7af09 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:49.602217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f2fd7f28-6b77-4a4d-9082-165735f7af09 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:49.609556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2fd7f28-6b77-4a4d-9082-165735f7af09 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:49.610451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2fd7f28-6b77-4a4d-9082-165735f7af09 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:49.611246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2fd7f28-6b77-4a4d-9082-165735f7af09 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:49.612418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=14 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:49.612964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2fd7f28-6b77-4a4d-9082-165735f7af09 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:49.613945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2fd7f28-6b77-4a4d-9082-165735f7af09 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:49.614986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2fd7f28-6b77-4a4d-9082-165735f7af09 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:49.619206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9a75919c-0bbd-4186-b7b0-75cc7f57a02e req-574cbc5a-4081-4675-9abe-bd285fe5fed5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:49.619825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9a75919c-0bbd-4186-b7b0-75cc7f57a02e req-574cbc5a-4081-4675-9abe-bd285fe5fed5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:49.622406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9a75919c-0bbd-4186-b7b0-75cc7f57a02e req-574cbc5a-4081-4675-9abe-bd285fe5fed5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:49.648866 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-9a75919c-0bbd-4186-b7b0-75cc7f57a02e req-574cbc5a-4081-4675-9abe-bd285fe5fed5 service nova] Creating event network-changed:a2acda54-0e76-4550-98fb-162209334237 for instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e on n-h1-839401-11 Aug 29 15:50:49.679937 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-9a75919c-0bbd-4186-b7b0-75cc7f57a02e req-574cbc5a-4081-4675-9abe-bd285fe5fed5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098147 Aug 29 15:50:49.690234 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2787/5758] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:50:49.906281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f2fd7f28-6b77-4a4d-9082-165735f7af09 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:49.918528 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f2fd7f28-6b77-4a4d-9082-165735f7af09 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1323 microversion: 2.1 time: 0.321601 Aug 29 15:50:49.931570 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2972/5759] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:49 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1323 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:49.965286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f4bc7c13-8933-4a3b-a49b-2b7d45cfbc13 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:49.966307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f4bc7c13-8933-4a3b-a49b-2b7d45cfbc13 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:49.973113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4bc7c13-8933-4a3b-a49b-2b7d45cfbc13 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:49.973676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4bc7c13-8933-4a3b-a49b-2b7d45cfbc13 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:49.974107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4bc7c13-8933-4a3b-a49b-2b7d45cfbc13 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:49.974809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4bc7c13-8933-4a3b-a49b-2b7d45cfbc13 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:49.975261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4bc7c13-8933-4a3b-a49b-2b7d45cfbc13 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:49.975682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4bc7c13-8933-4a3b-a49b-2b7d45cfbc13 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:50.513313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f4bc7c13-8933-4a3b-a49b-2b7d45cfbc13 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:50.522783 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f4bc7c13-8933-4a3b-a49b-2b7d45cfbc13 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.561625 Aug 29 15:50:50.523552 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2788/5760] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:49 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:50.588088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24b712ff-2329-41f1-bb2b-b93c399d5d7b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:50.588855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-24b712ff-2329-41f1-bb2b-b93c399d5d7b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:50.599900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24b712ff-2329-41f1-bb2b-b93c399d5d7b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:50.600334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24b712ff-2329-41f1-bb2b-b93c399d5d7b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:50.600782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24b712ff-2329-41f1-bb2b-b93c399d5d7b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:50.601534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24b712ff-2329-41f1-bb2b-b93c399d5d7b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:50.601983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24b712ff-2329-41f1-bb2b-b93c399d5d7b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:50.602623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24b712ff-2329-41f1-bb2b-b93c399d5d7b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:50.912264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-24b712ff-2329-41f1-bb2b-b93c399d5d7b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:50.923897 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-24b712ff-2329-41f1-bb2b-b93c399d5d7b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1308 microversion: 2.1 time: 0.339696 Aug 29 15:50:50.924535 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2973/5761] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:50 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1308 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:50.948480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1f03ae83-3c0b-4c9e-9b83-368e1877e047 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:50.949231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1f03ae83-3c0b-4c9e-9b83-368e1877e047 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:50.959994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f03ae83-3c0b-4c9e-9b83-368e1877e047 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:50.960565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f03ae83-3c0b-4c9e-9b83-368e1877e047 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:50.960948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f03ae83-3c0b-4c9e-9b83-368e1877e047 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:50.961809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f03ae83-3c0b-4c9e-9b83-368e1877e047 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:50.962554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f03ae83-3c0b-4c9e-9b83-368e1877e047 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:50.963424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f03ae83-3c0b-4c9e-9b83-368e1877e047 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:51.209339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1f03ae83-3c0b-4c9e-9b83-368e1877e047 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:51.218157 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1f03ae83-3c0b-4c9e-9b83-368e1877e047 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1323 microversion: 2.1 time: 0.274705 Aug 29 15:50:51.231545 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2789/5762] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:50 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1323 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:51.547480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2e8c7959-2ff6-4395-b598-b0a6d95d0722 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:51.548526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2e8c7959-2ff6-4395-b598-b0a6d95d0722 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:51.559931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e8c7959-2ff6-4395-b598-b0a6d95d0722 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:51.560774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e8c7959-2ff6-4395-b598-b0a6d95d0722 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:51.561620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e8c7959-2ff6-4395-b598-b0a6d95d0722 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:51.562752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e8c7959-2ff6-4395-b598-b0a6d95d0722 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:51.563592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e8c7959-2ff6-4395-b598-b0a6d95d0722 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:51.564201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e8c7959-2ff6-4395-b598-b0a6d95d0722 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:51.898830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2e8c7959-2ff6-4395-b598-b0a6d95d0722 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:51.907295 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2e8c7959-2ff6-4395-b598-b0a6d95d0722 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.366848 Aug 29 15:50:51.910668 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2974/5763] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:51 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:51.948630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5c3e9779-e2cd-4421-a87e-941f69e2598b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:51.949635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5c3e9779-e2cd-4421-a87e-941f69e2598b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:51.963089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c3e9779-e2cd-4421-a87e-941f69e2598b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:51.963577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c3e9779-e2cd-4421-a87e-941f69e2598b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:51.964083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c3e9779-e2cd-4421-a87e-941f69e2598b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:51.964940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c3e9779-e2cd-4421-a87e-941f69e2598b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:51.965599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c3e9779-e2cd-4421-a87e-941f69e2598b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:51.966186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c3e9779-e2cd-4421-a87e-941f69e2598b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:52.233354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5c3e9779-e2cd-4421-a87e-941f69e2598b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:52.237056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:52.241996 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5c3e9779-e2cd-4421-a87e-941f69e2598b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1308 microversion: 2.1 time: 0.297895 Aug 29 15:50:52.242588 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2790/5764] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:51 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:52.260793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b1df13e0-bad7-43c5-af99-87db247aefc8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:52.260793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b1df13e0-bad7-43c5-af99-87db247aefc8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:52.271922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1df13e0-bad7-43c5-af99-87db247aefc8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:52.274922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1df13e0-bad7-43c5-af99-87db247aefc8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:52.275595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1df13e0-bad7-43c5-af99-87db247aefc8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:52.276512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1df13e0-bad7-43c5-af99-87db247aefc8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:52.280126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1df13e0-bad7-43c5-af99-87db247aefc8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:52.280596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1df13e0-bad7-43c5-af99-87db247aefc8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:52.458651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b1df13e0-bad7-43c5-af99-87db247aefc8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:52.470604 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b1df13e0-bad7-43c5-af99-87db247aefc8 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1323 microversion: 2.1 time: 0.218505 Aug 29 15:50:52.471660 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2975/5765] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:52 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1323 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:52.929523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-98da7523-cc03-4b40-9414-b46ef81b26ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:52.930148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-98da7523-cc03-4b40-9414-b46ef81b26ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:52.946785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98da7523-cc03-4b40-9414-b46ef81b26ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:52.947305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98da7523-cc03-4b40-9414-b46ef81b26ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:52.950861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98da7523-cc03-4b40-9414-b46ef81b26ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:52.953608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98da7523-cc03-4b40-9414-b46ef81b26ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:52.956050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98da7523-cc03-4b40-9414-b46ef81b26ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:52.956512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98da7523-cc03-4b40-9414-b46ef81b26ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:53.273040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-18e0b353-9b63-42b9-a92d-dc0044089f73 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:53.274739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-18e0b353-9b63-42b9-a92d-dc0044089f73 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:53.300685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18e0b353-9b63-42b9-a92d-dc0044089f73 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:53.300685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18e0b353-9b63-42b9-a92d-dc0044089f73 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:53.301115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18e0b353-9b63-42b9-a92d-dc0044089f73 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:53.301853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18e0b353-9b63-42b9-a92d-dc0044089f73 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:53.306937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18e0b353-9b63-42b9-a92d-dc0044089f73 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:53.307424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18e0b353-9b63-42b9-a92d-dc0044089f73 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:53.441265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-98da7523-cc03-4b40-9414-b46ef81b26ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:53.452210 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-98da7523-cc03-4b40-9414-b46ef81b26ee tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.524922 Aug 29 15:50:53.453333 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2791/5766] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:52 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:53.492228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-159eb58e-edf1-45a1-ade5-c95c7cd27234 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:53.493296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-159eb58e-edf1-45a1-ade5-c95c7cd27234 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:53.506250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-159eb58e-edf1-45a1-ade5-c95c7cd27234 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:53.506806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-159eb58e-edf1-45a1-ade5-c95c7cd27234 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:53.507455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-159eb58e-edf1-45a1-ade5-c95c7cd27234 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:53.508009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-159eb58e-edf1-45a1-ade5-c95c7cd27234 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:53.508515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-159eb58e-edf1-45a1-ade5-c95c7cd27234 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:53.508908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-159eb58e-edf1-45a1-ade5-c95c7cd27234 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:53.796521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-18e0b353-9b63-42b9-a92d-dc0044089f73 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:53.814531 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-18e0b353-9b63-42b9-a92d-dc0044089f73 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1308 microversion: 2.1 time: 0.547351 Aug 29 15:50:53.839145 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2976/5767] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:53 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1308 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:54.046835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-159eb58e-edf1-45a1-ade5-c95c7cd27234 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:54.059437 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-159eb58e-edf1-45a1-ade5-c95c7cd27234 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1323 microversion: 2.1 time: 0.571818 Aug 29 15:50:54.063924 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2792/5768] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:53 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1323 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:54.476903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-263b691d-26d6-4b21-a7d5-3d213b7b0efa tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:54.478251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-263b691d-26d6-4b21-a7d5-3d213b7b0efa tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:54.503010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-263b691d-26d6-4b21-a7d5-3d213b7b0efa tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:54.512438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-263b691d-26d6-4b21-a7d5-3d213b7b0efa tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:54.521172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-263b691d-26d6-4b21-a7d5-3d213b7b0efa tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:54.522145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-263b691d-26d6-4b21-a7d5-3d213b7b0efa tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:54.529038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-263b691d-26d6-4b21-a7d5-3d213b7b0efa tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:54.530505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-263b691d-26d6-4b21-a7d5-3d213b7b0efa tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:54.862920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7c0a0c14-3a4f-4e8c-ba63-6167b164d1d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:54.865033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7c0a0c14-3a4f-4e8c-ba63-6167b164d1d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:54.876852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c0a0c14-3a4f-4e8c-ba63-6167b164d1d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:54.877483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c0a0c14-3a4f-4e8c-ba63-6167b164d1d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:54.877912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c0a0c14-3a4f-4e8c-ba63-6167b164d1d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:54.882686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c0a0c14-3a4f-4e8c-ba63-6167b164d1d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:54.887726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c0a0c14-3a4f-4e8c-ba63-6167b164d1d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:54.888425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c0a0c14-3a4f-4e8c-ba63-6167b164d1d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:55.111066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-263b691d-26d6-4b21-a7d5-3d213b7b0efa tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:55.125568 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-263b691d-26d6-4b21-a7d5-3d213b7b0efa tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.649164 Aug 29 15:50:55.144027 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2977/5769] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:54 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:55.152959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bad9b73c-c552-4090-a979-1f1431b96bd4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:55.157150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bad9b73c-c552-4090-a979-1f1431b96bd4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:55.179958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=67 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:55.190200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bad9b73c-c552-4090-a979-1f1431b96bd4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:55.193624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bad9b73c-c552-4090-a979-1f1431b96bd4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:55.194358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bad9b73c-c552-4090-a979-1f1431b96bd4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:55.195363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bad9b73c-c552-4090-a979-1f1431b96bd4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:55.196039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bad9b73c-c552-4090-a979-1f1431b96bd4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:55.198525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bad9b73c-c552-4090-a979-1f1431b96bd4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:55.581962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7c0a0c14-3a4f-4e8c-ba63-6167b164d1d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:55.596136 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7c0a0c14-3a4f-4e8c-ba63-6167b164d1d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1308 microversion: 2.1 time: 0.738547 Aug 29 15:50:55.597911 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2793/5770] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:54 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1308 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:55.740238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bad9b73c-c552-4090-a979-1f1431b96bd4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:55.754442 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bad9b73c-c552-4090-a979-1f1431b96bd4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1323 microversion: 2.1 time: 0.621858 Aug 29 15:50:55.755061 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2978/5771] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:55 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1323 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:56.154964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9ecf1bdf-3385-4dc1-a683-196c7fb9a8ba tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:56.155636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9ecf1bdf-3385-4dc1-a683-196c7fb9a8ba tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:56.175109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ecf1bdf-3385-4dc1-a683-196c7fb9a8ba tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:56.175620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ecf1bdf-3385-4dc1-a683-196c7fb9a8ba tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:56.177447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ecf1bdf-3385-4dc1-a683-196c7fb9a8ba tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:56.179988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ecf1bdf-3385-4dc1-a683-196c7fb9a8ba tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:56.180633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ecf1bdf-3385-4dc1-a683-196c7fb9a8ba tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:56.183608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ecf1bdf-3385-4dc1-a683-196c7fb9a8ba tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:56.618692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b49c697f-dcb8-43cd-90fb-fe286e091571 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:56.620532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b49c697f-dcb8-43cd-90fb-fe286e091571 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:56.635253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b49c697f-dcb8-43cd-90fb-fe286e091571 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:56.638124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b49c697f-dcb8-43cd-90fb-fe286e091571 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:56.640814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b49c697f-dcb8-43cd-90fb-fe286e091571 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:56.641781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b49c697f-dcb8-43cd-90fb-fe286e091571 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:56.642476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b49c697f-dcb8-43cd-90fb-fe286e091571 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:56.648013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b49c697f-dcb8-43cd-90fb-fe286e091571 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:56.876137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9ecf1bdf-3385-4dc1-a683-196c7fb9a8ba tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:56.891121 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9ecf1bdf-3385-4dc1-a683-196c7fb9a8ba tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.741941 Aug 29 15:50:56.894456 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2794/5772] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:56 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:56.910188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4406027a-1bb0-4351-8de6-5d00f375bdb9 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:56.913179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4406027a-1bb0-4351-8de6-5d00f375bdb9 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:56.951731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4406027a-1bb0-4351-8de6-5d00f375bdb9 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:56.953436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4406027a-1bb0-4351-8de6-5d00f375bdb9 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:56.956469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4406027a-1bb0-4351-8de6-5d00f375bdb9 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:56.959071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4406027a-1bb0-4351-8de6-5d00f375bdb9 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:56.959839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4406027a-1bb0-4351-8de6-5d00f375bdb9 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:56.961004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4406027a-1bb0-4351-8de6-5d00f375bdb9 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:57.022193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b49c697f-dcb8-43cd-90fb-fe286e091571 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:57.038079 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b49c697f-dcb8-43cd-90fb-fe286e091571 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1308 microversion: 2.1 time: 0.423548 Aug 29 15:50:57.041486 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2979/5773] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:56 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1308 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:57.201198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-74bdf50f-5568-40f6-9c9d-506d934b83fc req-925500d5-f28d-4623-9487-62b8bf7fd84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d207d03-2c7b-4684-9a0d-21b1c5bebe9e", "name": "network-vif-plugged", "status": "completed", "tag": "a2acda54-0e76-4550-98fb-162209334237"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:57.213254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-74bdf50f-5568-40f6-9c9d-506d934b83fc req-925500d5-f28d-4623-9487-62b8bf7fd84e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:57.214250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-74bdf50f-5568-40f6-9c9d-506d934b83fc req-925500d5-f28d-4623-9487-62b8bf7fd84e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:57.214892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-74bdf50f-5568-40f6-9c9d-506d934b83fc req-925500d5-f28d-4623-9487-62b8bf7fd84e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:57.230392 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-74bdf50f-5568-40f6-9c9d-506d934b83fc req-925500d5-f28d-4623-9487-62b8bf7fd84e service nova] Creating event network-vif-plugged:a2acda54-0e76-4550-98fb-162209334237 for instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e on n-h1-839401-11 Aug 29 15:50:57.244597 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-74bdf50f-5568-40f6-9c9d-506d934b83fc req-925500d5-f28d-4623-9487-62b8bf7fd84e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041867 Aug 29 15:50:57.245882 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2980/5774] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:50:57.339899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4406027a-1bb0-4351-8de6-5d00f375bdb9 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:57.350994 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4406027a-1bb0-4351-8de6-5d00f375bdb9 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1323 microversion: 2.1 time: 0.454494 Aug 29 15:50:57.368154 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2795/5775] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:56 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1323 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:57.916564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f65025ac-86c4-4637-a2f9-823345d7cce7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:57.917910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f65025ac-86c4-4637-a2f9-823345d7cce7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:57.934166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65025ac-86c4-4637-a2f9-823345d7cce7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:57.936746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65025ac-86c4-4637-a2f9-823345d7cce7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:57.938121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65025ac-86c4-4637-a2f9-823345d7cce7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:57.940663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65025ac-86c4-4637-a2f9-823345d7cce7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:57.941709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65025ac-86c4-4637-a2f9-823345d7cce7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:57.942889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f65025ac-86c4-4637-a2f9-823345d7cce7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:57.956516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:58.060832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4dbc370c-b323-421e-ae58-201173a2e742 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:58.062150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4dbc370c-b323-421e-ae58-201173a2e742 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:58.072422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbc370c-b323-421e-ae58-201173a2e742 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:58.073217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbc370c-b323-421e-ae58-201173a2e742 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:58.073831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbc370c-b323-421e-ae58-201173a2e742 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:58.074728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbc370c-b323-421e-ae58-201173a2e742 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:58.075358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbc370c-b323-421e-ae58-201173a2e742 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:58.075962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbc370c-b323-421e-ae58-201173a2e742 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:58.255396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4dbc370c-b323-421e-ae58-201173a2e742 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:58.264369 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4dbc370c-b323-421e-ae58-201173a2e742 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1308 microversion: 2.1 time: 0.208427 Aug 29 15:50:58.265744 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2796/5776] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:58 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:58.313337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f65025ac-86c4-4637-a2f9-823345d7cce7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:58.326939 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f65025ac-86c4-4637-a2f9-823345d7cce7 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.417358 Aug 29 15:50:58.346876 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2981/5777] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:57 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:58.375345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-658906c3-9774-49dc-bac2-c10e1b4374aa tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:58.376251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-658906c3-9774-49dc-bac2-c10e1b4374aa tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:58.384050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-658906c3-9774-49dc-bac2-c10e1b4374aa tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:58.385437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-658906c3-9774-49dc-bac2-c10e1b4374aa tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:58.386061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-658906c3-9774-49dc-bac2-c10e1b4374aa tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:58.387094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-658906c3-9774-49dc-bac2-c10e1b4374aa tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:58.387757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-658906c3-9774-49dc-bac2-c10e1b4374aa tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:58.388367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-658906c3-9774-49dc-bac2-c10e1b4374aa tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:58.588721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-658906c3-9774-49dc-bac2-c10e1b4374aa tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:58.602904 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-658906c3-9774-49dc-bac2-c10e1b4374aa tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1323 microversion: 2.1 time: 0.231095 Aug 29 15:50:58.619542 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2797/5778] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:58 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1323 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:59.264346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a45489bc-8a74-4118-b702-e156492feaef req-1272cbaa-0542-43de-9e37-3e1106032bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c40da290-3668-453f-937c-5ef2e7e75a06", "name": "network-vif-plugged", "status": "completed", "tag": "2f895dca-d3a6-4a5a-aaef-3c0a82d4056e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:59.277674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a45489bc-8a74-4118-b702-e156492feaef req-1272cbaa-0542-43de-9e37-3e1106032bc9 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:59.285956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-02bbf1bf-0cda-4e3c-af40-8b228e71e06b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:59.286663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-02bbf1bf-0cda-4e3c-af40-8b228e71e06b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:59.296312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a45489bc-8a74-4118-b702-e156492feaef req-1272cbaa-0542-43de-9e37-3e1106032bc9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:59.297310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a45489bc-8a74-4118-b702-e156492feaef req-1272cbaa-0542-43de-9e37-3e1106032bc9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:59.304991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02bbf1bf-0cda-4e3c-af40-8b228e71e06b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:59.306609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02bbf1bf-0cda-4e3c-af40-8b228e71e06b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:59.307195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02bbf1bf-0cda-4e3c-af40-8b228e71e06b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:59.308821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02bbf1bf-0cda-4e3c-af40-8b228e71e06b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:59.309642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02bbf1bf-0cda-4e3c-af40-8b228e71e06b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:59.310812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02bbf1bf-0cda-4e3c-af40-8b228e71e06b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:59.317820 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a45489bc-8a74-4118-b702-e156492feaef req-1272cbaa-0542-43de-9e37-3e1106032bc9 service nova] Creating event network-vif-plugged:2f895dca-d3a6-4a5a-aaef-3c0a82d4056e for instance c40da290-3668-453f-937c-5ef2e7e75a06 on n-h2-839401-11 Aug 29 15:50:59.325940 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a45489bc-8a74-4118-b702-e156492feaef req-1272cbaa-0542-43de-9e37-3e1106032bc9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065938 Aug 29 15:50:59.328289 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2982/5779] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:59.362579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5a019256-882f-46dd-9c39-53aaa530217a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:59.363330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5a019256-882f-46dd-9c39-53aaa530217a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:59.375460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a019256-882f-46dd-9c39-53aaa530217a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:59.375963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a019256-882f-46dd-9c39-53aaa530217a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:59.376611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a019256-882f-46dd-9c39-53aaa530217a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:59.377712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a019256-882f-46dd-9c39-53aaa530217a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:59.378182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a019256-882f-46dd-9c39-53aaa530217a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:59.378629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a019256-882f-46dd-9c39-53aaa530217a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:59.529485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-02bbf1bf-0cda-4e3c-af40-8b228e71e06b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:59.544381 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-02bbf1bf-0cda-4e3c-af40-8b228e71e06b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1488 microversion: 2.1 time: 0.260970 Aug 29 15:50:59.547602 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2798/5780] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:59 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1488 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:59.570736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6ba0f8e9-bf33-4e45-8a99-768915dd00b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:59.571828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6ba0f8e9-bf33-4e45-8a99-768915dd00b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:59.584131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba0f8e9-bf33-4e45-8a99-768915dd00b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:59.586701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba0f8e9-bf33-4e45-8a99-768915dd00b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:59.587833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba0f8e9-bf33-4e45-8a99-768915dd00b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:59.590000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba0f8e9-bf33-4e45-8a99-768915dd00b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:59.591128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba0f8e9-bf33-4e45-8a99-768915dd00b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:59.592837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5a019256-882f-46dd-9c39-53aaa530217a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:59.593413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ba0f8e9-bf33-4e45-8a99-768915dd00b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:59.606056 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5a019256-882f-46dd-9c39-53aaa530217a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.259040 Aug 29 15:50:59.607261 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2983/5781] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:59 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:59.635140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ee0df86f-04e2-4c06-b93f-886f7d5a3717 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:59.635915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ee0df86f-04e2-4c06-b93f-886f7d5a3717 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:59.642252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee0df86f-04e2-4c06-b93f-886f7d5a3717 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:59.642991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee0df86f-04e2-4c06-b93f-886f7d5a3717 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:59.643521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee0df86f-04e2-4c06-b93f-886f7d5a3717 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:59.644378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee0df86f-04e2-4c06-b93f-886f7d5a3717 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:59.644913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee0df86f-04e2-4c06-b93f-886f7d5a3717 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:59.645420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee0df86f-04e2-4c06-b93f-886f7d5a3717 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:59.842961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6ba0f8e9-bf33-4e45-8a99-768915dd00b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:59.851668 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6ba0f8e9-bf33-4e45-8a99-768915dd00b1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1488 microversion: 2.1 time: 0.287103 Aug 29 15:50:59.852204 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2799/5782] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:59 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1488 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:59.872094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1a7fe383-a1be-41bb-8146-9623fb6e685a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:59.872783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1a7fe383-a1be-41bb-8146-9623fb6e685a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:59.879128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a7fe383-a1be-41bb-8146-9623fb6e685a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:59.879618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a7fe383-a1be-41bb-8146-9623fb6e685a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:59.880058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a7fe383-a1be-41bb-8146-9623fb6e685a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:59.880758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a7fe383-a1be-41bb-8146-9623fb6e685a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:59.881242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a7fe383-a1be-41bb-8146-9623fb6e685a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:59.881884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a7fe383-a1be-41bb-8146-9623fb6e685a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:59.924086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ee0df86f-04e2-4c06-b93f-886f7d5a3717 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:59.940207 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ee0df86f-04e2-4c06-b93f-886f7d5a3717 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1323 microversion: 2.1 time: 0.315162 Aug 29 15:50:59.940921 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2984/5783] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:59 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1323 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:00.033824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1a7fe383-a1be-41bb-8146-9623fb6e685a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:00.044386 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1a7fe383-a1be-41bb-8146-9623fb6e685a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1488 microversion: 2.1 time: 0.176127 Aug 29 15:51:00.051050 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2800/5784] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:59 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1488 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:00.066194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d70c6072-39bc-4b0b-b6ea-55575e8459a1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:00.066960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d70c6072-39bc-4b0b-b6ea-55575e8459a1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:00.073691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d70c6072-39bc-4b0b-b6ea-55575e8459a1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:00.074442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d70c6072-39bc-4b0b-b6ea-55575e8459a1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:00.075093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d70c6072-39bc-4b0b-b6ea-55575e8459a1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:00.075999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d70c6072-39bc-4b0b-b6ea-55575e8459a1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:00.076670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d70c6072-39bc-4b0b-b6ea-55575e8459a1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:00.077337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d70c6072-39bc-4b0b-b6ea-55575e8459a1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:00.106631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d70c6072-39bc-4b0b-b6ea-55575e8459a1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:51:00.215011 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d70c6072-39bc-4b0b-b6ea-55575e8459a1 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 204 len: 0 microversion: 2.1 time: 0.152352 Aug 29 15:51:00.216222 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2985/5785] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:51:00 2022] DELETE /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:51:00.224669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fa5e4736-ecce-4302-9370-859551376e36 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:00.225590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fa5e4736-ecce-4302-9370-859551376e36 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:00.229449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:00.233907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa5e4736-ecce-4302-9370-859551376e36 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:00.235294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa5e4736-ecce-4302-9370-859551376e36 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:00.235903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa5e4736-ecce-4302-9370-859551376e36 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:00.237224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa5e4736-ecce-4302-9370-859551376e36 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:00.238850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa5e4736-ecce-4302-9370-859551376e36 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:00.239502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fa5e4736-ecce-4302-9370-859551376e36 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:00.427364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fa5e4736-ecce-4302-9370-859551376e36 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:00.436400 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fa5e4736-ecce-4302-9370-859551376e36 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1494 microversion: 2.1 time: 0.215663 Aug 29 15:51:00.436999 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2801/5786] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:00 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1494 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:00.633066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-040003c4-d17c-4fe7-83ba-1b5f18d1fc9c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:00.634849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-040003c4-d17c-4fe7-83ba-1b5f18d1fc9c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:00.644005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-040003c4-d17c-4fe7-83ba-1b5f18d1fc9c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:00.648965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-040003c4-d17c-4fe7-83ba-1b5f18d1fc9c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:00.649733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-040003c4-d17c-4fe7-83ba-1b5f18d1fc9c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:00.651028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-040003c4-d17c-4fe7-83ba-1b5f18d1fc9c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:00.651594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-040003c4-d17c-4fe7-83ba-1b5f18d1fc9c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:00.652165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-040003c4-d17c-4fe7-83ba-1b5f18d1fc9c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:00.964078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5bd963d4-8535-478d-b34a-e568c0751b79 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:00.965684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5bd963d4-8535-478d-b34a-e568c0751b79 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:00.978325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-040003c4-d17c-4fe7-83ba-1b5f18d1fc9c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:00.990760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bd963d4-8535-478d-b34a-e568c0751b79 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:00.993813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bd963d4-8535-478d-b34a-e568c0751b79 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:00.994881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bd963d4-8535-478d-b34a-e568c0751b79 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:00.995952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bd963d4-8535-478d-b34a-e568c0751b79 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:00.996241 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-040003c4-d17c-4fe7-83ba-1b5f18d1fc9c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.367051 Aug 29 15:51:00.998179 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2986/5787] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:00 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:00.998778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bd963d4-8535-478d-b34a-e568c0751b79 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:00.999648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bd963d4-8535-478d-b34a-e568c0751b79 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:01.169351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5bd963d4-8535-478d-b34a-e568c0751b79 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:01.179880 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5bd963d4-8535-478d-b34a-e568c0751b79 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1323 microversion: 2.1 time: 0.221953 Aug 29 15:51:01.197910 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2802/5788] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:00 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1323 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:01.457983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-67565713-c853-4c5e-b143-4033cca2a176 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:01.458606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-67565713-c853-4c5e-b143-4033cca2a176 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:01.464903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67565713-c853-4c5e-b143-4033cca2a176 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:01.465623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67565713-c853-4c5e-b143-4033cca2a176 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:01.466080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67565713-c853-4c5e-b143-4033cca2a176 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:01.466989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67565713-c853-4c5e-b143-4033cca2a176 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:01.467602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67565713-c853-4c5e-b143-4033cca2a176 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:01.468205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-67565713-c853-4c5e-b143-4033cca2a176 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:01.712251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-67565713-c853-4c5e-b143-4033cca2a176 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:01.721651 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-67565713-c853-4c5e-b143-4033cca2a176 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1494 microversion: 2.1 time: 0.267645 Aug 29 15:51:01.722239 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2987/5789] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:01 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1494 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:02.018735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7e808fdb-44f4-4f0a-8751-3b0deedfa21c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:02.019559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7e808fdb-44f4-4f0a-8751-3b0deedfa21c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:02.030809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e808fdb-44f4-4f0a-8751-3b0deedfa21c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:02.031318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e808fdb-44f4-4f0a-8751-3b0deedfa21c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:02.031765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e808fdb-44f4-4f0a-8751-3b0deedfa21c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:02.032851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e808fdb-44f4-4f0a-8751-3b0deedfa21c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:02.033537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e808fdb-44f4-4f0a-8751-3b0deedfa21c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:02.033960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e808fdb-44f4-4f0a-8751-3b0deedfa21c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:02.203219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a4e0e4a4-4b33-4401-a81b-186599e28013 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:02.204412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a4e0e4a4-4b33-4401-a81b-186599e28013 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:02.213566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4e0e4a4-4b33-4401-a81b-186599e28013 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:02.215098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4e0e4a4-4b33-4401-a81b-186599e28013 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:02.215775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4e0e4a4-4b33-4401-a81b-186599e28013 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:02.216919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4e0e4a4-4b33-4401-a81b-186599e28013 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:02.217655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4e0e4a4-4b33-4401-a81b-186599e28013 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:02.219245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4e0e4a4-4b33-4401-a81b-186599e28013 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:02.269909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7e808fdb-44f4-4f0a-8751-3b0deedfa21c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:02.280405 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7e808fdb-44f4-4f0a-8751-3b0deedfa21c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.265865 Aug 29 15:51:02.294996 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2803/5790] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:02 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:02.593257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-986794f5-73d1-47d3-834e-cd2f69b2f823 req-88b58f56-6e0d-4a69-b136-31e10113126e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d207d03-2c7b-4684-9a0d-21b1c5bebe9e", "name": "network-vif-deleted", "tag": "a2acda54-0e76-4550-98fb-162209334237"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:02.620995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-986794f5-73d1-47d3-834e-cd2f69b2f823 req-88b58f56-6e0d-4a69-b136-31e10113126e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:02.630949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-986794f5-73d1-47d3-834e-cd2f69b2f823 req-88b58f56-6e0d-4a69-b136-31e10113126e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:02.631869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-986794f5-73d1-47d3-834e-cd2f69b2f823 req-88b58f56-6e0d-4a69-b136-31e10113126e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:02.671052 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-986794f5-73d1-47d3-834e-cd2f69b2f823 req-88b58f56-6e0d-4a69-b136-31e10113126e service nova] Creating event network-vif-deleted:a2acda54-0e76-4550-98fb-162209334237 for instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e on n-h1-839401-11 Aug 29 15:51:02.683191 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-986794f5-73d1-47d3-834e-cd2f69b2f823 req-88b58f56-6e0d-4a69-b136-31e10113126e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094178 Aug 29 15:51:02.689858 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2804/5791] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:02.744480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c6e928c4-b94f-415d-b5c1-5c68e3c081c5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:02.746732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c6e928c4-b94f-415d-b5c1-5c68e3c081c5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:02.754877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6e928c4-b94f-415d-b5c1-5c68e3c081c5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:02.755652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6e928c4-b94f-415d-b5c1-5c68e3c081c5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:02.756875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6e928c4-b94f-415d-b5c1-5c68e3c081c5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:02.757888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6e928c4-b94f-415d-b5c1-5c68e3c081c5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:02.758719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6e928c4-b94f-415d-b5c1-5c68e3c081c5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:02.759639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6e928c4-b94f-415d-b5c1-5c68e3c081c5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:02.817955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6e928c4-b94f-415d-b5c1-5c68e3c081c5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:02.818761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6e928c4-b94f-415d-b5c1-5c68e3c081c5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:02.819369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6e928c4-b94f-415d-b5c1-5c68e3c081c5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:02.819994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-c6e928c4-b94f-415d-b5c1-5c68e3c081c5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lazy-loading 'fault' on Instance uuid 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:02.897259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c6e928c4-b94f-415d-b5c1-5c68e3c081c5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:02.906068 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c6e928c4-b94f-415d-b5c1-5c68e3c081c5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 200 len: 1298 microversion: 2.1 time: 0.166634 Aug 29 15:51:02.918073 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2805/5792] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:02 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 1298 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:02.971710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a4e0e4a4-4b33-4401-a81b-186599e28013 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:02.980888 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a4e0e4a4-4b33-4401-a81b-186599e28013 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1323 microversion: 2.1 time: 0.782692 Aug 29 15:51:02.981911 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2988/5793] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:02 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1323 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:03.302186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9fb3e0e2-6564-44be-a628-7921f9978ff8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:03.302904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9fb3e0e2-6564-44be-a628-7921f9978ff8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:03.311452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fb3e0e2-6564-44be-a628-7921f9978ff8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:03.312479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fb3e0e2-6564-44be-a628-7921f9978ff8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:03.313142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fb3e0e2-6564-44be-a628-7921f9978ff8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:03.314253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fb3e0e2-6564-44be-a628-7921f9978ff8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:03.317797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fb3e0e2-6564-44be-a628-7921f9978ff8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:03.318488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fb3e0e2-6564-44be-a628-7921f9978ff8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:03.521047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9fb3e0e2-6564-44be-a628-7921f9978ff8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:03.530449 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9fb3e0e2-6564-44be-a628-7921f9978ff8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.232373 Aug 29 15:51:03.537919 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2806/5794] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:03 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:03.930336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d79ab509-47de-4863-b7df-f9846fe93fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:03.931440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d79ab509-47de-4863-b7df-f9846fe93fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:03.939848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d79ab509-47de-4863-b7df-f9846fe93fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:03.940641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d79ab509-47de-4863-b7df-f9846fe93fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:03.941462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d79ab509-47de-4863-b7df-f9846fe93fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:03.942340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d79ab509-47de-4863-b7df-f9846fe93fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:03.943299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d79ab509-47de-4863-b7df-f9846fe93fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:03.944080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d79ab509-47de-4863-b7df-f9846fe93fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:03.961878 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-d79ab509-47de-4863-b7df-f9846fe93fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d79ab509-47de-4863-b7df-f9846fe93fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e HTTP/1.1 Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '6d207d03-2c7b-4684-9a0d-21b1c5bebe9e'} Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:03.964107 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:03.969868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:03.969868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:03.969868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:03.969868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:03.969868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. Aug 29 15:51:03.969868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:03.972063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d79ab509-47de-4863-b7df-f9846fe93fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:03.974329 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d79ab509-47de-4863-b7df-f9846fe93fcf tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 404 len: 111 microversion: 2.1 time: 0.048100 Aug 29 15:51:03.975457 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2989/5795] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:03 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:51:03.986762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a8e2630c-578a-4e8f-af67-b2d41435a4c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:03.987388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a8e2630c-578a-4e8f-af67-b2d41435a4c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:03.994734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8e2630c-578a-4e8f-af67-b2d41435a4c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:03.995234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8e2630c-578a-4e8f-af67-b2d41435a4c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:03.995667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8e2630c-578a-4e8f-af67-b2d41435a4c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:03.996588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8e2630c-578a-4e8f-af67-b2d41435a4c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:04.002024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d85372b2-0cc1-4a3c-b2b5-4930dc30b2cd tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:04.002575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8e2630c-578a-4e8f-af67-b2d41435a4c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:04.003228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8e2630c-578a-4e8f-af67-b2d41435a4c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:04.006047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d85372b2-0cc1-4a3c-b2b5-4930dc30b2cd tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:04.022102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85372b2-0cc1-4a3c-b2b5-4930dc30b2cd tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:04.027219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85372b2-0cc1-4a3c-b2b5-4930dc30b2cd tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:04.027922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85372b2-0cc1-4a3c-b2b5-4930dc30b2cd tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:04.028840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85372b2-0cc1-4a3c-b2b5-4930dc30b2cd tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:04.029526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85372b2-0cc1-4a3c-b2b5-4930dc30b2cd tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:04.030205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85372b2-0cc1-4a3c-b2b5-4930dc30b2cd tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:04.061076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a8e2630c-578a-4e8f-af67-b2d41435a4c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:51:04.071065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:04.165041 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a8e2630c-578a-4e8f-af67-b2d41435a4c0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "DELETE /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 204 len: 0 microversion: 2.1 time: 0.185179 Aug 29 15:51:04.166265 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2807/5796] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:51:03 2022] DELETE /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:51:04.175250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8ae80254-1aaa-457c-97e1-d95d5e6dc420 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:04.176247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8ae80254-1aaa-457c-97e1-d95d5e6dc420 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:04.182458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ae80254-1aaa-457c-97e1-d95d5e6dc420 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:04.182945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ae80254-1aaa-457c-97e1-d95d5e6dc420 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:04.183374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ae80254-1aaa-457c-97e1-d95d5e6dc420 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:04.184071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ae80254-1aaa-457c-97e1-d95d5e6dc420 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:04.184520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ae80254-1aaa-457c-97e1-d95d5e6dc420 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:04.185008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ae80254-1aaa-457c-97e1-d95d5e6dc420 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:04.359612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8ae80254-1aaa-457c-97e1-d95d5e6dc420 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:04.360903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d85372b2-0cc1-4a3c-b2b5-4930dc30b2cd tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:04.371556 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8ae80254-1aaa-457c-97e1-d95d5e6dc420 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1494 microversion: 2.1 time: 0.200645 Aug 29 15:51:04.372897 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2808/5797] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:04 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1494 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:04.390963 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d85372b2-0cc1-4a3c-b2b5-4930dc30b2cd tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1323 microversion: 2.1 time: 0.374478 Aug 29 15:51:04.392529 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2990/5798] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:03 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1323 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:04.558361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eba6fe6f-6490-4bb3-85ff-424f2a66a509 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:04.559329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eba6fe6f-6490-4bb3-85ff-424f2a66a509 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:04.566269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eba6fe6f-6490-4bb3-85ff-424f2a66a509 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:04.566641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eba6fe6f-6490-4bb3-85ff-424f2a66a509 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:04.567307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eba6fe6f-6490-4bb3-85ff-424f2a66a509 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:04.568029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eba6fe6f-6490-4bb3-85ff-424f2a66a509 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:04.568486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eba6fe6f-6490-4bb3-85ff-424f2a66a509 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:04.568911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eba6fe6f-6490-4bb3-85ff-424f2a66a509 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:04.737216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eba6fe6f-6490-4bb3-85ff-424f2a66a509 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:04.741893 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eba6fe6f-6490-4bb3-85ff-424f2a66a509 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.187513 Aug 29 15:51:04.744091 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2809/5799] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:04 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:05.395012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8131906a-cb84-4b92-b773-dfea6b81c53d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:05.395621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8131906a-cb84-4b92-b773-dfea6b81c53d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:05.414648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8756db27-590f-4e25-aae0-5e864224d815 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:05.415277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8756db27-590f-4e25-aae0-5e864224d815 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:05.432174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8756db27-590f-4e25-aae0-5e864224d815 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:05.432670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8756db27-590f-4e25-aae0-5e864224d815 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:05.435825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8131906a-cb84-4b92-b773-dfea6b81c53d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:05.439151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8131906a-cb84-4b92-b773-dfea6b81c53d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:05.439716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8131906a-cb84-4b92-b773-dfea6b81c53d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:05.440242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8756db27-590f-4e25-aae0-5e864224d815 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:05.441139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8131906a-cb84-4b92-b773-dfea6b81c53d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:05.441459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8756db27-590f-4e25-aae0-5e864224d815 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:05.441606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8131906a-cb84-4b92-b773-dfea6b81c53d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:05.441954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8756db27-590f-4e25-aae0-5e864224d815 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:05.442082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8131906a-cb84-4b92-b773-dfea6b81c53d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:05.442400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8756db27-590f-4e25-aae0-5e864224d815 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:05.643857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8131906a-cb84-4b92-b773-dfea6b81c53d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:05.654703 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8131906a-cb84-4b92-b773-dfea6b81c53d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1494 microversion: 2.1 time: 0.263520 Aug 29 15:51:05.655369 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2991/5800] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:05 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1494 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:05.765754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e8c683dd-25e6-4e7b-8d92-5c21811eb033 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:05.766363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e8c683dd-25e6-4e7b-8d92-5c21811eb033 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:05.773434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8c683dd-25e6-4e7b-8d92-5c21811eb033 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:05.777500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8c683dd-25e6-4e7b-8d92-5c21811eb033 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:05.778225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8c683dd-25e6-4e7b-8d92-5c21811eb033 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:05.779139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8c683dd-25e6-4e7b-8d92-5c21811eb033 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:05.781690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8c683dd-25e6-4e7b-8d92-5c21811eb033 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:05.783088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8c683dd-25e6-4e7b-8d92-5c21811eb033 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:05.794070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8756db27-590f-4e25-aae0-5e864224d815 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:05.809228 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8756db27-590f-4e25-aae0-5e864224d815 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1323 microversion: 2.1 time: 0.400974 Aug 29 15:51:05.817154 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2810/5801] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:05 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1323 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:06.108900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e8c683dd-25e6-4e7b-8d92-5c21811eb033 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:06.121369 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e8c683dd-25e6-4e7b-8d92-5c21811eb033 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.360023 Aug 29 15:51:06.123555 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2992/5802] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:05 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:06.410300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-5756878a-f4e5-44ee-b383-083499c6d36e req-d34df3ea-b142-4d4c-a40c-931d66daeb74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "507274a1-8eee-4a29-9f47-5c560ae48444", "name": "network-vif-deleted", "tag": "3cbd6b2a-e077-48b9-84fb-4c92c81c92c9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:06.423752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5756878a-f4e5-44ee-b383-083499c6d36e req-d34df3ea-b142-4d4c-a40c-931d66daeb74 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:06.425073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5756878a-f4e5-44ee-b383-083499c6d36e req-d34df3ea-b142-4d4c-a40c-931d66daeb74 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:06.425892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5756878a-f4e5-44ee-b383-083499c6d36e req-d34df3ea-b142-4d4c-a40c-931d66daeb74 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:06.440200 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5756878a-f4e5-44ee-b383-083499c6d36e req-d34df3ea-b142-4d4c-a40c-931d66daeb74 service nova] Creating event network-vif-deleted:3cbd6b2a-e077-48b9-84fb-4c92c81c92c9 for instance 507274a1-8eee-4a29-9f47-5c560ae48444 on n-h1-839401-11 Aug 29 15:51:06.448587 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-5756878a-f4e5-44ee-b383-083499c6d36e req-d34df3ea-b142-4d4c-a40c-931d66daeb74 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044618 Aug 29 15:51:06.452594 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2811/5803] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:06.679745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0fab04f8-b170-442d-a02b-9982d0618c7d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:06.681211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0fab04f8-b170-442d-a02b-9982d0618c7d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:06.701413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fab04f8-b170-442d-a02b-9982d0618c7d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:06.702471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fab04f8-b170-442d-a02b-9982d0618c7d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:06.704156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fab04f8-b170-442d-a02b-9982d0618c7d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:06.705217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fab04f8-b170-442d-a02b-9982d0618c7d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:06.706128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fab04f8-b170-442d-a02b-9982d0618c7d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:06.707618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fab04f8-b170-442d-a02b-9982d0618c7d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:06.756746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fab04f8-b170-442d-a02b-9982d0618c7d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:06.757589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fab04f8-b170-442d-a02b-9982d0618c7d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:06.758238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fab04f8-b170-442d-a02b-9982d0618c7d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:06.759604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-0fab04f8-b170-442d-a02b-9982d0618c7d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lazy-loading 'fault' on Instance uuid 507274a1-8eee-4a29-9f47-5c560ae48444 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:06.833182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0fab04f8-b170-442d-a02b-9982d0618c7d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:06.857333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a9bd3273-6a08-45dc-99dd-a80862797e5d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:06.857700 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0fab04f8-b170-442d-a02b-9982d0618c7d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 200 len: 1298 microversion: 2.1 time: 0.185325 Aug 29 15:51:06.859211 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2993/5804] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:06 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 1298 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:06.873133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a9bd3273-6a08-45dc-99dd-a80862797e5d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:06.898171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9bd3273-6a08-45dc-99dd-a80862797e5d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:06.898563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9bd3273-6a08-45dc-99dd-a80862797e5d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:06.899374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9bd3273-6a08-45dc-99dd-a80862797e5d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:06.900545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9bd3273-6a08-45dc-99dd-a80862797e5d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:06.900645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9bd3273-6a08-45dc-99dd-a80862797e5d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:06.901071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9bd3273-6a08-45dc-99dd-a80862797e5d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:07.124270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a9bd3273-6a08-45dc-99dd-a80862797e5d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:07.138427 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a9bd3273-6a08-45dc-99dd-a80862797e5d tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1519 microversion: 2.1 time: 0.302091 Aug 29 15:51:07.139844 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2812/5805] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:06 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1519 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:07.145406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-84bacf59-06ff-4600-b05c-755d32db9bfb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:07.146144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-84bacf59-06ff-4600-b05c-755d32db9bfb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:07.152921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84bacf59-06ff-4600-b05c-755d32db9bfb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:07.153929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84bacf59-06ff-4600-b05c-755d32db9bfb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:07.154592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84bacf59-06ff-4600-b05c-755d32db9bfb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:07.155696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84bacf59-06ff-4600-b05c-755d32db9bfb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:07.156696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84bacf59-06ff-4600-b05c-755d32db9bfb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:07.157393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84bacf59-06ff-4600-b05c-755d32db9bfb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:07.275124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f0c9ae30-d15a-4691-9420-b14784891116 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-564733607", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5245d492-8e0f-48bc-9e75-1c9648fdd29b"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f0c9ae30-d15a-4691-9420-b14784891116 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Request method failure captured: Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 242 Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOBMBv7JGzBwsIiSZdZJon709MCfvYusKlz8GeKiPtNxlPiGcAgR6PjxWsPS4nbQa0pZp9cl_VoYokkNRnzu2bTBjWimtNk8o20xAwVmlMwjOY81791xiSEF3hpOY0EEQK17BWtJGhEUaseVqpaaWxBe2ebZnWYQT3TnWWsrAdkPNfk Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 9df2fd8bb18442cd8d9134ac85ecadb1 Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9df2fd8bb18442cd8d9134ac85ecadb1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9df2fd8bb18442cd8d9134ac85ecadb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9df2fd8bb18442cd8d9134ac85ecadb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9df2fd8bb18442cd8d9134ac85ecadb1"}]}] Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 9df2fd8bb18442cd8d9134ac85ecadb1 Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerMetadataNegativeTestJSON-1231999538-project Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b4a3b567728c4bbcaf5908807f0deaac Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1231999538-project Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-564733607", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5245d492-8e0f-48bc-9e75-1c9648fdd29b"}]}} Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-564733607', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '5245d492-8e0f-48bc-9e75-1c9648fdd29b'}]}}} Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:07.280028 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.285602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.296331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f0c9ae30-d15a-4691-9420-b14784891116 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:07.297587 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f0c9ae30-d15a-4691-9420-b14784891116 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.027298 Aug 29 15:51:07.298856 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2813/5806] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:07 2022] POST /compute/v2.1/servers => generated 175 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:51:07.312094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-591e1a7c-250a-4f60-bf05-681c275d2df0 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:07.312905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-591e1a7c-250a-4f60-bf05-681c275d2df0 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: babb08f2-4037-43df-ba10-6aabb48269e6] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:07.330174 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-591e1a7c-250a-4f60-bf05-681c275d2df0 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] HTTP exception thrown: Instance babb08f2-4037-43df-ba10-6aabb48269e6 could not be found. Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-591e1a7c-250a-4f60-bf05-681c275d2df0 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Request method failure captured: Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/babb08f2-4037-43df-ba10-6aabb48269e6/metadata HTTP/1.1 Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOBMBv7JGzBwsIiSZdZJon709MCfvYusKlz8GeKiPtNxlPiGcAgR6PjxWsPS4nbQa0pZp9cl_VoYokkNRnzu2bTBjWimtNk8o20xAwVmlMwjOY81791xiSEF3hpOY0EEQK17BWtJGhEUaseVqpaaWxBe2ebZnWYQT3TnWWsrAdkPNfk Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 9df2fd8bb18442cd8d9134ac85ecadb1 Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9df2fd8bb18442cd8d9134ac85ecadb1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9df2fd8bb18442cd8d9134ac85ecadb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9df2fd8bb18442cd8d9134ac85ecadb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9df2fd8bb18442cd8d9134ac85ecadb1"}]}] Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 9df2fd8bb18442cd8d9134ac85ecadb1 Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerMetadataNegativeTestJSON-1231999538-project Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b4a3b567728c4bbcaf5908807f0deaac Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1231999538-project Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance babb08f2-4037-43df-ba10-6aabb48269e6 could not be found. Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'server_id': 'babb08f2-4037-43df-ba10-6aabb48269e6'} Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance babb08f2-4037-43df-ba10-6aabb48269e6 could not be found. Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance babb08f2-4037-43df-ba10-6aabb48269e6 could not be found. Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:07.342143 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:07.348703 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:07.348703 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:07.348703 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance babb08f2-4037-43df-ba10-6aabb48269e6 could not be found. Aug 29 15:51:07.348703 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.348703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-591e1a7c-250a-4f60-bf05-681c275d2df0 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Returning 404 to user: Instance babb08f2-4037-43df-ba10-6aabb48269e6 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:07.348703 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-591e1a7c-250a-4f60-bf05-681c275d2df0 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/babb08f2-4037-43df-ba10-6aabb48269e6/metadata" status: 404 len: 111 microversion: 2.1 time: 0.038187 Aug 29 15:51:07.355900 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2814/5807] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 15:51:07 2022] GET /compute/v2.1/servers/babb08f2-4037-43df-ba10-6aabb48269e6/metadata => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:51:07.440967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a326a503-89e2-4e9a-b564-e730ab4d7675 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1523279213", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5245d492-8e0f-48bc-9e75-1c9648fdd29b"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a326a503-89e2-4e9a-b564-e730ab4d7675 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Request method failure captured: Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 499 Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOBMBv7JGzBwsIiSZdZJon709MCfvYusKlz8GeKiPtNxlPiGcAgR6PjxWsPS4nbQa0pZp9cl_VoYokkNRnzu2bTBjWimtNk8o20xAwVmlMwjOY81791xiSEF3hpOY0EEQK17BWtJGhEUaseVqpaaWxBe2ebZnWYQT3TnWWsrAdkPNfk Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 9df2fd8bb18442cd8d9134ac85ecadb1 Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9df2fd8bb18442cd8d9134ac85ecadb1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9df2fd8bb18442cd8d9134ac85ecadb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9df2fd8bb18442cd8d9134ac85ecadb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9df2fd8bb18442cd8d9134ac85ecadb1"}]}] Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 9df2fd8bb18442cd8d9134ac85ecadb1 Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerMetadataNegativeTestJSON-1231999538-project Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b4a3b567728c4bbcaf5908807f0deaac Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1231999538-project Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1523279213", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5245d492-8e0f-48bc-9e75-1c9648fdd29b"}]}} Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1523279213', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5245d492-8e0f-48bc-9e75-1c9648fdd29b'}]}}} Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:51:07.448015 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.452202 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.458411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a326a503-89e2-4e9a-b564-e730ab4d7675 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:07.460140 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a326a503-89e2-4e9a-b564-e730ab4d7675 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.026480 Aug 29 15:51:07.462367 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2815/5808] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:07 2022] POST /compute/v2.1/servers => generated 687 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:51:07.499862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-84bacf59-06ff-4600-b05c-755d32db9bfb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:07.509078 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-84bacf59-06ff-4600-b05c-755d32db9bfb tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.368382 Aug 29 15:51:07.514885 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2994/5809] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:07 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:07.522128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-39bbdcc9-a134-4d3e-b5ae-93c8331ddcd4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1845983144", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5245d492-8e0f-48bc-9e75-1c9648fdd29b"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-39bbdcc9-a134-4d3e-b5ae-93c8331ddcd4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Request method failure captured: Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 500 Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOBMBv7JGzBwsIiSZdZJon709MCfvYusKlz8GeKiPtNxlPiGcAgR6PjxWsPS4nbQa0pZp9cl_VoYokkNRnzu2bTBjWimtNk8o20xAwVmlMwjOY81791xiSEF3hpOY0EEQK17BWtJGhEUaseVqpaaWxBe2ebZnWYQT3TnWWsrAdkPNfk Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 9df2fd8bb18442cd8d9134ac85ecadb1 Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9df2fd8bb18442cd8d9134ac85ecadb1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9df2fd8bb18442cd8d9134ac85ecadb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9df2fd8bb18442cd8d9134ac85ecadb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9df2fd8bb18442cd8d9134ac85ecadb1"}]}] Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 9df2fd8bb18442cd8d9134ac85ecadb1 Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerMetadataNegativeTestJSON-1231999538-project Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b4a3b567728c4bbcaf5908807f0deaac Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1231999538-project Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1845983144", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5245d492-8e0f-48bc-9e75-1c9648fdd29b"}]}} Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1845983144', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5245d492-8e0f-48bc-9e75-1c9648fdd29b'}]}}} Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:51:07.530223 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.533804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-39bbdcc9-a134-4d3e-b5ae-93c8331ddcd4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:07.536340 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-39bbdcc9-a134-4d3e-b5ae-93c8331ddcd4 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.016870 Aug 29 15:51:07.536842 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2816/5810] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:07 2022] POST /compute/v2.1/servers => generated 689 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:51:07.613604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1d3d3431-4ff5-4fdc-abc3-fe8dd4b345c3 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1775273191", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5245d492-8e0f-48bc-9e75-1c9648fdd29b"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1d3d3431-4ff5-4fdc-abc3-fe8dd4b345c3 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Request method failure captured: Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 754 Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOBMBv7JGzBwsIiSZdZJon709MCfvYusKlz8GeKiPtNxlPiGcAgR6PjxWsPS4nbQa0pZp9cl_VoYokkNRnzu2bTBjWimtNk8o20xAwVmlMwjOY81791xiSEF3hpOY0EEQK17BWtJGhEUaseVqpaaWxBe2ebZnWYQT3TnWWsrAdkPNfk Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 9df2fd8bb18442cd8d9134ac85ecadb1 Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9df2fd8bb18442cd8d9134ac85ecadb1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9df2fd8bb18442cd8d9134ac85ecadb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9df2fd8bb18442cd8d9134ac85ecadb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9df2fd8bb18442cd8d9134ac85ecadb1"}]}] Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 9df2fd8bb18442cd8d9134ac85ecadb1 Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerMetadataNegativeTestJSON-1231999538-project Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b4a3b567728c4bbcaf5908807f0deaac Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1231999538-project Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1775273191", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5245d492-8e0f-48bc-9e75-1c9648fdd29b"}]}} Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1775273191', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5245d492-8e0f-48bc-9e75-1c9648fdd29b'}]}}} Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:51:07.624206 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:51:07.628082 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:51:07.631401 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.631401 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.633780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1d3d3431-4ff5-4fdc-abc3-fe8dd4b345c3 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:07.636452 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1d3d3431-4ff5-4fdc-abc3-fe8dd4b345c3 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.027537 Aug 29 15:51:07.638238 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2995/5811] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:07 2022] POST /compute/v2.1/servers => generated 1197 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 29 15:51:07.708654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f816869-3204-4e16-a105-7c5bf5faa3f9 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1522286664", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5245d492-8e0f-48bc-9e75-1c9648fdd29b"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f816869-3204-4e16-a105-7c5bf5faa3f9 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Request method failure captured: Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 1266 Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOBMBv7JGzBwsIiSZdZJon709MCfvYusKlz8GeKiPtNxlPiGcAgR6PjxWsPS4nbQa0pZp9cl_VoYokkNRnzu2bTBjWimtNk8o20xAwVmlMwjOY81791xiSEF3hpOY0EEQK17BWtJGhEUaseVqpaaWxBe2ebZnWYQT3TnWWsrAdkPNfk Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 9df2fd8bb18442cd8d9134ac85ecadb1 Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9df2fd8bb18442cd8d9134ac85ecadb1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9df2fd8bb18442cd8d9134ac85ecadb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9df2fd8bb18442cd8d9134ac85ecadb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9df2fd8bb18442cd8d9134ac85ecadb1"}]}] Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 9df2fd8bb18442cd8d9134ac85ecadb1 Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerMetadataNegativeTestJSON-1231999538-project Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b4a3b567728c4bbcaf5908807f0deaac Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1231999538-project Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1522286664", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5245d492-8e0f-48bc-9e75-1c9648fdd29b"}]}} Aug 29 15:51:07.713797 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1522286664', 'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5245d492-8e0f-48bc-9e75-1c9648fdd29b'}]}}} Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.716776 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:51:07.718308 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:51:07.721317 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:51:07.721317 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.721317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f816869-3204-4e16-a105-7c5bf5faa3f9 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:07.721317 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9f816869-3204-4e16-a105-7c5bf5faa3f9 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.012419 Aug 29 15:51:07.721317 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2817/5812] 10.222.0.62 () {60 vars in 1148 bytes} [Mon Aug 29 15:51:07 2022] POST /compute/v2.1/servers => generated 2221 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 29 15:51:07.729044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c9ab5266-3287-43d2-a2cb-27d578d93020 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:07.729732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c9ab5266-3287-43d2-a2cb-27d578d93020 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: ac97a4ea-0c68-47a0-83ef-6ab2706a1f26] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:07.737453 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-c9ab5266-3287-43d2-a2cb-27d578d93020 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] HTTP exception thrown: Instance ac97a4ea-0c68-47a0-83ef-6ab2706a1f26 could not be found. Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c9ab5266-3287-43d2-a2cb-27d578d93020 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Request method failure captured: Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/ac97a4ea-0c68-47a0-83ef-6ab2706a1f26/metadata/test2 HTTP/1.1 Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOBMBv7JGzBwsIiSZdZJon709MCfvYusKlz8GeKiPtNxlPiGcAgR6PjxWsPS4nbQa0pZp9cl_VoYokkNRnzu2bTBjWimtNk8o20xAwVmlMwjOY81791xiSEF3hpOY0EEQK17BWtJGhEUaseVqpaaWxBe2ebZnWYQT3TnWWsrAdkPNfk Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 9df2fd8bb18442cd8d9134ac85ecadb1 Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9df2fd8bb18442cd8d9134ac85ecadb1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9df2fd8bb18442cd8d9134ac85ecadb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9df2fd8bb18442cd8d9134ac85ecadb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9df2fd8bb18442cd8d9134ac85ecadb1"}]}] Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 9df2fd8bb18442cd8d9134ac85ecadb1 Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerMetadataNegativeTestJSON-1231999538-project Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b4a3b567728c4bbcaf5908807f0deaac Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1231999538-project Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance ac97a4ea-0c68-47a0-83ef-6ab2706a1f26 could not be found. Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'server_id': 'ac97a4ea-0c68-47a0-83ef-6ab2706a1f26', 'id': 'test2'} Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac97a4ea-0c68-47a0-83ef-6ab2706a1f26 could not be found. Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac97a4ea-0c68-47a0-83ef-6ab2706a1f26 could not be found. Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:07.739360 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:07.744993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:07.744993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:07.744993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac97a4ea-0c68-47a0-83ef-6ab2706a1f26 could not be found. Aug 29 15:51:07.744993 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.744993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c9ab5266-3287-43d2-a2cb-27d578d93020 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Returning 404 to user: Instance ac97a4ea-0c68-47a0-83ef-6ab2706a1f26 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:07.745459 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c9ab5266-3287-43d2-a2cb-27d578d93020 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/ac97a4ea-0c68-47a0-83ef-6ab2706a1f26/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.019975 Aug 29 15:51:07.746078 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2996/5813] 10.222.0.62 () {58 vars in 1281 bytes} [Mon Aug 29 15:51:07 2022] GET /compute/v2.1/servers/ac97a4ea-0c68-47a0-83ef-6ab2706a1f26/metadata/test2 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:07.760290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-302a587d-77ad-4348-9069-379f3ae8a4fb tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:07.760793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-302a587d-77ad-4348-9069-379f3ae8a4fb tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:07.768055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-302a587d-77ad-4348-9069-379f3ae8a4fb tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:07.768549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-302a587d-77ad-4348-9069-379f3ae8a4fb tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:07.768990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-302a587d-77ad-4348-9069-379f3ae8a4fb tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:07.782974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-302a587d-77ad-4348-9069-379f3ae8a4fb tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:07.783385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-302a587d-77ad-4348-9069-379f3ae8a4fb tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:07.783835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-302a587d-77ad-4348-9069-379f3ae8a4fb tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:07.862170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-302a587d-77ad-4348-9069-379f3ae8a4fb tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:51:07.879854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-71480b81-f764-4217-aba8-c0f991151473 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:07.880480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-71480b81-f764-4217-aba8-c0f991151473 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:07.898603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71480b81-f764-4217-aba8-c0f991151473 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:07.899116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71480b81-f764-4217-aba8-c0f991151473 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:07.899561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71480b81-f764-4217-aba8-c0f991151473 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:07.900281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71480b81-f764-4217-aba8-c0f991151473 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:07.900942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71480b81-f764-4217-aba8-c0f991151473 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:07.901568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71480b81-f764-4217-aba8-c0f991151473 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:07.934478 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-71480b81-f764-4217-aba8-c0f991151473 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-71480b81-f764-4217-aba8-c0f991151473 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 HTTP/1.1 Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '507274a1-8eee-4a29-9f47-5c560ae48444'} Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.936428 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:07.942140 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:07.942140 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:07.942140 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:07.942140 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:07.942140 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. Aug 29 15:51:07.942140 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:07.942140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-71480b81-f764-4217-aba8-c0f991151473 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:07.942140 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-71480b81-f764-4217-aba8-c0f991151473 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 404 len: 111 microversion: 2.1 time: 0.061974 Aug 29 15:51:07.942140 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2997/5814] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:07 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:08.047177 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-302a587d-77ad-4348-9069-379f3ae8a4fb tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 204 len: 0 microversion: 2.1 time: 0.290783 Aug 29 15:51:08.050411 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2818/5815] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:51:07 2022] DELETE /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:51:08.054246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1126327520", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "e7e1a9e7-4d7f-4958-9bd4-e4039baa5a12"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:08.063363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4f08ef18-f135-461a-af37-d86e65cf0522 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:08.065746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4f08ef18-f135-461a-af37-d86e65cf0522 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:08.080679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f08ef18-f135-461a-af37-d86e65cf0522 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:08.081457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f08ef18-f135-461a-af37-d86e65cf0522 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:08.082115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f08ef18-f135-461a-af37-d86e65cf0522 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:08.083114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f08ef18-f135-461a-af37-d86e65cf0522 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:08.083777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f08ef18-f135-461a-af37-d86e65cf0522 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:08.084629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f08ef18-f135-461a-af37-d86e65cf0522 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:08.151640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] validate_networks() for [('e7e1a9e7-4d7f-4958-9bd4-e4039baa5a12', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:51:08.371071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4f08ef18-f135-461a-af37-d86e65cf0522 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:08.382994 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4f08ef18-f135-461a-af37-d86e65cf0522 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1525 microversion: 2.1 time: 0.330288 Aug 29 15:51:08.385721 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2819/5816] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:08 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1525 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:08.524961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-15cebc75-25eb-4929-8233-689d450207eb req-ca388b72-b8dc-4c31-b121-40f99b99a3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0fd8c4a-7225-496b-a071-6fd8f37dc60a", "name": "network-vif-plugged", "status": "completed", "tag": "8dc04ade-2041-4d24-bbaf-7f8f25a7e827"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:08.551778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-15cebc75-25eb-4929-8233-689d450207eb req-ca388b72-b8dc-4c31-b121-40f99b99a3b7 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:08.567197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-15cebc75-25eb-4929-8233-689d450207eb req-ca388b72-b8dc-4c31-b121-40f99b99a3b7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:08.568176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-15cebc75-25eb-4929-8233-689d450207eb req-ca388b72-b8dc-4c31-b121-40f99b99a3b7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:08.602990 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-15cebc75-25eb-4929-8233-689d450207eb req-ca388b72-b8dc-4c31-b121-40f99b99a3b7 service nova] Creating event network-vif-plugged:8dc04ade-2041-4d24-bbaf-7f8f25a7e827 for instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a on n-h2-839401-11 Aug 29 15:51:08.615802 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-15cebc75-25eb-4929-8233-689d450207eb req-ca388b72-b8dc-4c31-b121-40f99b99a3b7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093001 Aug 29 15:51:08.618892 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2820/5817] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:08.647996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6020af82-e935-4647-bf97-786a0eb19718 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:08.651546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6020af82-e935-4647-bf97-786a0eb19718 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:08.664802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6020af82-e935-4647-bf97-786a0eb19718 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:08.665878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6020af82-e935-4647-bf97-786a0eb19718 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:08.666753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6020af82-e935-4647-bf97-786a0eb19718 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:08.667634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6020af82-e935-4647-bf97-786a0eb19718 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:08.668264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6020af82-e935-4647-bf97-786a0eb19718 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:08.669672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6020af82-e935-4647-bf97-786a0eb19718 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:09.015631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:51:09.017310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:51:09.018018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:51:09.018720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:51:09.019367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:51:09.032248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:09.032746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:09.033262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:09.034019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:09.034610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:09.035318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:09.058952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:51:09.066445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for user db3e87dfe49444f886b7a9ac5d22bda1 and project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:51:09.078676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6020af82-e935-4647-bf97-786a0eb19718 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:09.088223 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6020af82-e935-4647-bf97-786a0eb19718 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.449802 Aug 29 15:51:09.101326 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2821/5818] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:08 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:09.101703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:51:09.101703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:51:09.171884 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d4eea4b2-9d4c-44ad-930b-6bd1f8062906 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122055 Aug 29 15:51:09.173153 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2998/5819] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:51:09.185820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5578f68f-9ab1-4b7c-a99b-c51dd838c034 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:09.197606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5578f68f-9ab1-4b7c-a99b-c51dd838c034 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:09.303237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5578f68f-9ab1-4b7c-a99b-c51dd838c034 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:09.310378 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5578f68f-9ab1-4b7c-a99b-c51dd838c034 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1209 microversion: 2.1 time: 0.129774 Aug 29 15:51:09.323520 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2822/5820] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:09 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1209 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:09.404533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-364487cc-978d-4f77-a2bd-d041e92b8b15 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:09.405273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-364487cc-978d-4f77-a2bd-d041e92b8b15 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:09.415931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-364487cc-978d-4f77-a2bd-d041e92b8b15 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:09.416522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-364487cc-978d-4f77-a2bd-d041e92b8b15 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:09.417104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-364487cc-978d-4f77-a2bd-d041e92b8b15 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:09.418773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-364487cc-978d-4f77-a2bd-d041e92b8b15 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:09.419344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-364487cc-978d-4f77-a2bd-d041e92b8b15 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:09.419890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-364487cc-978d-4f77-a2bd-d041e92b8b15 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:09.622313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-364487cc-978d-4f77-a2bd-d041e92b8b15 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:09.636165 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-364487cc-978d-4f77-a2bd-d041e92b8b15 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1525 microversion: 2.1 time: 0.235590 Aug 29 15:51:09.651601 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 2999/5821] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:09 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1525 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:10.110890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d9153e6f-fb76-460b-a344-c40d1f55a7d6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:10.112455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d9153e6f-fb76-460b-a344-c40d1f55a7d6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:10.120701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9153e6f-fb76-460b-a344-c40d1f55a7d6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:10.121224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9153e6f-fb76-460b-a344-c40d1f55a7d6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:10.132631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9153e6f-fb76-460b-a344-c40d1f55a7d6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:10.133992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9153e6f-fb76-460b-a344-c40d1f55a7d6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:10.138175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9153e6f-fb76-460b-a344-c40d1f55a7d6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:10.138745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d9153e6f-fb76-460b-a344-c40d1f55a7d6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:10.331395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-41cba972-caeb-455b-af9f-800b8012016c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:10.332023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-41cba972-caeb-455b-af9f-800b8012016c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:10.355956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-41cba972-caeb-455b-af9f-800b8012016c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:10.356560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-41cba972-caeb-455b-af9f-800b8012016c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:10.357074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-41cba972-caeb-455b-af9f-800b8012016c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:10.358054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-41cba972-caeb-455b-af9f-800b8012016c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:10.359576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-41cba972-caeb-455b-af9f-800b8012016c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:10.361474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-41cba972-caeb-455b-af9f-800b8012016c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:10.434863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:10.550955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d9153e6f-fb76-460b-a344-c40d1f55a7d6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:10.562189 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d9153e6f-fb76-460b-a344-c40d1f55a7d6 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.455183 Aug 29 15:51:10.562783 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2823/5822] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:10 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:10.658918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-858a64e6-654b-4cfc-894e-952d86e407a6 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:10.660020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-858a64e6-654b-4cfc-894e-952d86e407a6 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:10.672261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-858a64e6-654b-4cfc-894e-952d86e407a6 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:10.677612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-858a64e6-654b-4cfc-894e-952d86e407a6 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:10.678623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-858a64e6-654b-4cfc-894e-952d86e407a6 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:10.679750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-858a64e6-654b-4cfc-894e-952d86e407a6 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:10.680643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-858a64e6-654b-4cfc-894e-952d86e407a6 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:10.681277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-858a64e6-654b-4cfc-894e-952d86e407a6 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:10.685435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-41cba972-caeb-455b-af9f-800b8012016c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:10.703148 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-41cba972-caeb-455b-af9f-800b8012016c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1205 microversion: 2.1 time: 0.370235 Aug 29 15:51:10.703813 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3000/5823] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:10 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1205 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:11.063867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-858a64e6-654b-4cfc-894e-952d86e407a6 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:11.080330 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-858a64e6-654b-4cfc-894e-952d86e407a6 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1525 microversion: 2.1 time: 0.425494 Aug 29 15:51:11.082088 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2824/5824] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:10 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1525 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:11.213303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-7bd88c17-6ccc-4b2d-b257-5add7df2545d req-5f05320c-c528-415b-ae74-8e6c12058369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c40da290-3668-453f-937c-5ef2e7e75a06", "name": "network-vif-deleted", "tag": "2f895dca-d3a6-4a5a-aaef-3c0a82d4056e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:11.232438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7bd88c17-6ccc-4b2d-b257-5add7df2545d req-5f05320c-c528-415b-ae74-8e6c12058369 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:11.234644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7bd88c17-6ccc-4b2d-b257-5add7df2545d req-5f05320c-c528-415b-ae74-8e6c12058369 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:11.235878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7bd88c17-6ccc-4b2d-b257-5add7df2545d req-5f05320c-c528-415b-ae74-8e6c12058369 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:11.264851 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-7bd88c17-6ccc-4b2d-b257-5add7df2545d req-5f05320c-c528-415b-ae74-8e6c12058369 service nova] Creating event network-vif-deleted:2f895dca-d3a6-4a5a-aaef-3c0a82d4056e for instance c40da290-3668-453f-937c-5ef2e7e75a06 on n-h2-839401-11 Aug 29 15:51:11.272168 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-7bd88c17-6ccc-4b2d-b257-5add7df2545d req-5f05320c-c528-415b-ae74-8e6c12058369 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063101 Aug 29 15:51:11.272799 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3001/5825] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:11.585783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9590b3ea-acf5-466d-b15c-c3e5f32bfa1d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:11.586389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9590b3ea-acf5-466d-b15c-c3e5f32bfa1d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:11.596556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9590b3ea-acf5-466d-b15c-c3e5f32bfa1d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:11.597120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9590b3ea-acf5-466d-b15c-c3e5f32bfa1d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:11.597593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9590b3ea-acf5-466d-b15c-c3e5f32bfa1d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:11.605305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9590b3ea-acf5-466d-b15c-c3e5f32bfa1d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:11.607356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9590b3ea-acf5-466d-b15c-c3e5f32bfa1d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:11.608176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9590b3ea-acf5-466d-b15c-c3e5f32bfa1d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:11.733906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a1409256-15b8-42e3-81d8-08142b237a17 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:11.735361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a1409256-15b8-42e3-81d8-08142b237a17 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:11.754546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1409256-15b8-42e3-81d8-08142b237a17 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:11.757610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1409256-15b8-42e3-81d8-08142b237a17 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:11.759897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1409256-15b8-42e3-81d8-08142b237a17 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:11.762033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1409256-15b8-42e3-81d8-08142b237a17 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:11.767016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1409256-15b8-42e3-81d8-08142b237a17 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:11.767820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1409256-15b8-42e3-81d8-08142b237a17 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:11.897035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a1409256-15b8-42e3-81d8-08142b237a17 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:11.908788 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a1409256-15b8-42e3-81d8-08142b237a17 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1267 microversion: 2.1 time: 0.181855 Aug 29 15:51:11.930268 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3002/5826] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:11 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:12.046558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9590b3ea-acf5-466d-b15c-c3e5f32bfa1d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:12.067933 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9590b3ea-acf5-466d-b15c-c3e5f32bfa1d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.483419 Aug 29 15:51:12.068680 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2825/5827] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:11 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:12.107413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85277636-99b3-4011-91ef-57180603c544 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:12.108091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-85277636-99b3-4011-91ef-57180603c544 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:12.129495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85277636-99b3-4011-91ef-57180603c544 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:12.152376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85277636-99b3-4011-91ef-57180603c544 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:12.153008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85277636-99b3-4011-91ef-57180603c544 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:12.153606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85277636-99b3-4011-91ef-57180603c544 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:12.154080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85277636-99b3-4011-91ef-57180603c544 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:12.154499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85277636-99b3-4011-91ef-57180603c544 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:12.269500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85277636-99b3-4011-91ef-57180603c544 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:12.270012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85277636-99b3-4011-91ef-57180603c544 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:12.270924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85277636-99b3-4011-91ef-57180603c544 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:12.270924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-85277636-99b3-4011-91ef-57180603c544 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lazy-loading 'fault' on Instance uuid c40da290-3668-453f-937c-5ef2e7e75a06 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:12.361051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-85277636-99b3-4011-91ef-57180603c544 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a3b567728c4bbcaf5908807f0deaac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df2fd8bb18442cd8d9134ac85ecadb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:12.389779 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85277636-99b3-4011-91ef-57180603c544 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 200 len: 1313 microversion: 2.1 time: 0.291705 Aug 29 15:51:12.393036 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3003/5828] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:12 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:12.952177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fff297db-6e52-419e-a007-2a13d4015f66 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:12.953498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fff297db-6e52-419e-a007-2a13d4015f66 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:12.970265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff297db-6e52-419e-a007-2a13d4015f66 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:12.972197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff297db-6e52-419e-a007-2a13d4015f66 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:12.975498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff297db-6e52-419e-a007-2a13d4015f66 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:12.977049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff297db-6e52-419e-a007-2a13d4015f66 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:12.980040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff297db-6e52-419e-a007-2a13d4015f66 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:12.984060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff297db-6e52-419e-a007-2a13d4015f66 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:13.093457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98a6abc1-036e-4897-9df1-672f7cafb0a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:13.094826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-98a6abc1-036e-4897-9df1-672f7cafb0a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:13.108668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98a6abc1-036e-4897-9df1-672f7cafb0a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:13.109488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98a6abc1-036e-4897-9df1-672f7cafb0a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:13.110180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98a6abc1-036e-4897-9df1-672f7cafb0a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:13.111216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98a6abc1-036e-4897-9df1-672f7cafb0a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:13.112229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98a6abc1-036e-4897-9df1-672f7cafb0a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:13.113008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98a6abc1-036e-4897-9df1-672f7cafb0a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:13.421715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fff297db-6e52-419e-a007-2a13d4015f66 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:13.434367 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fff297db-6e52-419e-a007-2a13d4015f66 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1309 microversion: 2.1 time: 0.485208 Aug 29 15:51:13.437236 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2826/5829] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:12 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1309 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:13.442226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3a95c9a8-8f4e-4f8e-8ab3-b5fcc30ff958 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:13.443085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3a95c9a8-8f4e-4f8e-8ab3-b5fcc30ff958 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] [instance: c40da290-3668-453f-937c-5ef2e7e75a06] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:13.458785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a95c9a8-8f4e-4f8e-8ab3-b5fcc30ff958 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:13.462510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a95c9a8-8f4e-4f8e-8ab3-b5fcc30ff958 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:13.465213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a95c9a8-8f4e-4f8e-8ab3-b5fcc30ff958 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:13.466897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a95c9a8-8f4e-4f8e-8ab3-b5fcc30ff958 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:13.467382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a95c9a8-8f4e-4f8e-8ab3-b5fcc30ff958 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:13.467821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a95c9a8-8f4e-4f8e-8ab3-b5fcc30ff958 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:13.508622 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-3a95c9a8-8f4e-4f8e-8ab3-b5fcc30ff958 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] HTTP exception thrown: Instance c40da290-3668-453f-937c-5ef2e7e75a06 could not be found. Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3a95c9a8-8f4e-4f8e-8ab3-b5fcc30ff958 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Request method failure captured: Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 HTTP/1.1 Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOBMBv7JGzBwsIiSZdZJon709MCfvYusKlz8GeKiPtNxlPiGcAgR6PjxWsPS4nbQa0pZp9cl_VoYokkNRnzu2bTBjWimtNk8o20xAwVmlMwjOY81791xiSEF3hpOY0EEQK17BWtJGhEUaseVqpaaWxBe2ebZnWYQT3TnWWsrAdkPNfk Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 9df2fd8bb18442cd8d9134ac85ecadb1 Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9df2fd8bb18442cd8d9134ac85ecadb1", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9df2fd8bb18442cd8d9134ac85ecadb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9df2fd8bb18442cd8d9134ac85ecadb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9df2fd8bb18442cd8d9134ac85ecadb1"}]}] Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 9df2fd8bb18442cd8d9134ac85ecadb1 Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1231999538 Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerMetadataNegativeTestJSON-1231999538-project Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b4a3b567728c4bbcaf5908807f0deaac Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1231999538-project Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance c40da290-3668-453f-937c-5ef2e7e75a06 could not be found. Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'c40da290-3668-453f-937c-5ef2e7e75a06'} Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c40da290-3668-453f-937c-5ef2e7e75a06 could not be found. Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c40da290-3668-453f-937c-5ef2e7e75a06 could not be found. Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:13.510804 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:13.516171 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:13.516171 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:13.516171 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:13.516171 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:13.516171 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:13.516171 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:13.516171 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c40da290-3668-453f-937c-5ef2e7e75a06 could not be found. Aug 29 15:51:13.516171 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:13.516171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3a95c9a8-8f4e-4f8e-8ab3-b5fcc30ff958 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] Returning 404 to user: Instance c40da290-3668-453f-937c-5ef2e7e75a06 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:13.516171 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3a95c9a8-8f4e-4f8e-8ab3-b5fcc30ff958 tempest-ServerMetadataNegativeTestJSON-1231999538 tempest-ServerMetadataNegativeTestJSON-1231999538-project] 10.222.0.62 "GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06" status: 404 len: 111 microversion: 2.1 time: 0.073841 Aug 29 15:51:13.520425 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2827/5830] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:13 2022] GET /compute/v2.1/servers/c40da290-3668-453f-937c-5ef2e7e75a06 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:13.583120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-98a6abc1-036e-4897-9df1-672f7cafb0a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:13.596344 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-98a6abc1-036e-4897-9df1-672f7cafb0a4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1518 microversion: 2.1 time: 0.506842 Aug 29 15:51:13.609111 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3004/5831] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:13 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1518 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:14.455980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-89766273-630d-4407-bed0-ef0282358bd6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:14.457886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-89766273-630d-4407-bed0-ef0282358bd6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:14.470117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89766273-630d-4407-bed0-ef0282358bd6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:14.470684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89766273-630d-4407-bed0-ef0282358bd6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:14.473568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89766273-630d-4407-bed0-ef0282358bd6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:14.474409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89766273-630d-4407-bed0-ef0282358bd6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:14.474830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89766273-630d-4407-bed0-ef0282358bd6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:14.475281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89766273-630d-4407-bed0-ef0282358bd6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:14.625449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-79bf4f2b-01f0-4e5b-b44b-5aca767f32af tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:14.627083 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-79bf4f2b-01f0-4e5b-b44b-5aca767f32af tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:14.648251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79bf4f2b-01f0-4e5b-b44b-5aca767f32af tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:14.650563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79bf4f2b-01f0-4e5b-b44b-5aca767f32af tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:14.651288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79bf4f2b-01f0-4e5b-b44b-5aca767f32af tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:14.652299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79bf4f2b-01f0-4e5b-b44b-5aca767f32af tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:14.652996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79bf4f2b-01f0-4e5b-b44b-5aca767f32af tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:14.655020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79bf4f2b-01f0-4e5b-b44b-5aca767f32af tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:14.926000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-79bf4f2b-01f0-4e5b-b44b-5aca767f32af tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:14.938215 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-79bf4f2b-01f0-4e5b-b44b-5aca767f32af tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.316028 Aug 29 15:51:14.939770 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3005/5832] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:14 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:14.950268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-32fde56d-cd8e-4a04-957e-3a8b7be973e4 req-b8169c68-2d03-4386-b1ed-932ec525b93c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e0c4f14-7bec-433d-9654-6be9cf22b78e", "tag": "e9b40f70-8b4b-4dbb-a0d7-8168a4792cce"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:14.971019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-32fde56d-cd8e-4a04-957e-3a8b7be973e4 req-b8169c68-2d03-4386-b1ed-932ec525b93c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:14.971831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-32fde56d-cd8e-4a04-957e-3a8b7be973e4 req-b8169c68-2d03-4386-b1ed-932ec525b93c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:14.973130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-32fde56d-cd8e-4a04-957e-3a8b7be973e4 req-b8169c68-2d03-4386-b1ed-932ec525b93c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:14.988268 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-32fde56d-cd8e-4a04-957e-3a8b7be973e4 req-b8169c68-2d03-4386-b1ed-932ec525b93c service nova] Creating event network-changed:e9b40f70-8b4b-4dbb-a0d7-8168a4792cce for instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e on n-h1-839401-11 Aug 29 15:51:15.001522 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-32fde56d-cd8e-4a04-957e-3a8b7be973e4 req-b8169c68-2d03-4386-b1ed-932ec525b93c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060047 Aug 29 15:51:15.003942 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3006/5833] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:15.021146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-876226ca-919d-48df-bf10-ab2c057b72c4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:15.022879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-876226ca-919d-48df-bf10-ab2c057b72c4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:15.029982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-876226ca-919d-48df-bf10-ab2c057b72c4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:15.031104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-876226ca-919d-48df-bf10-ab2c057b72c4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:15.031830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-876226ca-919d-48df-bf10-ab2c057b72c4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:15.032776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-876226ca-919d-48df-bf10-ab2c057b72c4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:15.033520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-876226ca-919d-48df-bf10-ab2c057b72c4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:15.034184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-876226ca-919d-48df-bf10-ab2c057b72c4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:15.059141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-89766273-630d-4407-bed0-ef0282358bd6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:15.067579 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-89766273-630d-4407-bed0-ef0282358bd6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1309 microversion: 2.1 time: 0.615972 Aug 29 15:51:15.086219 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2828/5834] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:14 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1309 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:15.265187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-876226ca-919d-48df-bf10-ab2c057b72c4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:15.289415 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-876226ca-919d-48df-bf10-ab2c057b72c4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.283968 Aug 29 15:51:15.290307 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3007/5835] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:15 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:15.320402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b1007e2a-a3b8-4b4a-8102-75a3581d2635 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:15.321360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b1007e2a-a3b8-4b4a-8102-75a3581d2635 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:15.335568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1007e2a-a3b8-4b4a-8102-75a3581d2635 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:15.336333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1007e2a-a3b8-4b4a-8102-75a3581d2635 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:15.337331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1007e2a-a3b8-4b4a-8102-75a3581d2635 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:15.338277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1007e2a-a3b8-4b4a-8102-75a3581d2635 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:15.339094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1007e2a-a3b8-4b4a-8102-75a3581d2635 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:15.339694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1007e2a-a3b8-4b4a-8102-75a3581d2635 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:15.411483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:15.720479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b1007e2a-a3b8-4b4a-8102-75a3581d2635 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:15.736117 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b1007e2a-a3b8-4b4a-8102-75a3581d2635 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.419824 Aug 29 15:51:15.739200 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2829/5836] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:15 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:15.766381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2c15318d-fb9c-49d9-bffd-890262ecbb38 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:15.783567 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-2c15318d-fb9c-49d9-bffd-890262ecbb38 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance 8f919983-9f08-4943-9b75-c8a7ebcd60b2 has no mapping to a cell. Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2c15318d-fb9c-49d9-bffd-890262ecbb38 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/8f919983-9f08-4943-9b75-c8a7ebcd60b2/action HTTP/1.1 Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 15 Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: {"os-stop": {}} Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 8f919983-9f08-4943-9b75-c8a7ebcd60b2 has no mapping to a cell. Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '8f919983-9f08-4943-9b75-c8a7ebcd60b2', 'body': {'os-stop': {}}} Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 8f919983-9f08-4943-9b75-c8a7ebcd60b2 has no mapping to a cell. Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:15.802111 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f919983-9f08-4943-9b75-c8a7ebcd60b2 has no mapping to a cell. Aug 29 15:51:15.807576 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:15.807576 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:15.807576 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:15.807576 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:15.807576 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:15.807576 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:15.807576 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:15.807576 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:15.807576 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f919983-9f08-4943-9b75-c8a7ebcd60b2 has no mapping to a cell. Aug 29 15:51:15.807576 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:15.809364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2c15318d-fb9c-49d9-bffd-890262ecbb38 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance 8f919983-9f08-4943-9b75-c8a7ebcd60b2 has no mapping to a cell. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:15.810452 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2c15318d-fb9c-49d9-bffd-890262ecbb38 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/8f919983-9f08-4943-9b75-c8a7ebcd60b2/action" status: 404 len: 117 microversion: 2.1 time: 0.049815 Aug 29 15:51:15.811589 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3008/5837] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:15 2022] POST /compute/v2.1/servers/8f919983-9f08-4943-9b75-c8a7ebcd60b2/action => generated 117 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:15.819973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-35571d7d-7885-4a13-9324-bc032f54d7f9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:15.820870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-35571d7d-7885-4a13-9324-bc032f54d7f9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:15.848839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35571d7d-7885-4a13-9324-bc032f54d7f9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:15.857607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35571d7d-7885-4a13-9324-bc032f54d7f9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:15.858264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35571d7d-7885-4a13-9324-bc032f54d7f9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:15.859054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35571d7d-7885-4a13-9324-bc032f54d7f9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:15.859597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35571d7d-7885-4a13-9324-bc032f54d7f9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:15.860176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35571d7d-7885-4a13-9324-bc032f54d7f9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:16.094747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4ff6111f-9cd1-435f-8b0a-ddaf8e30a019 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:16.098602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4ff6111f-9cd1-435f-8b0a-ddaf8e30a019 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:16.106648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ff6111f-9cd1-435f-8b0a-ddaf8e30a019 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:16.107446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ff6111f-9cd1-435f-8b0a-ddaf8e30a019 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:16.109918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ff6111f-9cd1-435f-8b0a-ddaf8e30a019 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:16.110867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ff6111f-9cd1-435f-8b0a-ddaf8e30a019 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:16.117521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ff6111f-9cd1-435f-8b0a-ddaf8e30a019 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:16.117989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ff6111f-9cd1-435f-8b0a-ddaf8e30a019 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:16.407422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4ff6111f-9cd1-435f-8b0a-ddaf8e30a019 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:16.422036 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4ff6111f-9cd1-435f-8b0a-ddaf8e30a019 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1309 microversion: 2.1 time: 0.331211 Aug 29 15:51:16.422612 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3009/5838] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:16 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1309 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:16.727621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-35571d7d-7885-4a13-9324-bc032f54d7f9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:16.740297 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-35571d7d-7885-4a13-9324-bc032f54d7f9 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.924151 Aug 29 15:51:16.740897 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2830/5839] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:15 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:16.762150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b050f387-3e69-43ed-bb5d-cefb48700f0e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:16.762795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b050f387-3e69-43ed-bb5d-cefb48700f0e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:16.778110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b050f387-3e69-43ed-bb5d-cefb48700f0e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:16.779667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b050f387-3e69-43ed-bb5d-cefb48700f0e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:16.780466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b050f387-3e69-43ed-bb5d-cefb48700f0e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:16.781396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b050f387-3e69-43ed-bb5d-cefb48700f0e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:16.782044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b050f387-3e69-43ed-bb5d-cefb48700f0e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:16.782645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b050f387-3e69-43ed-bb5d-cefb48700f0e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.116841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b050f387-3e69-43ed-bb5d-cefb48700f0e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:17.125754 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b050f387-3e69-43ed-bb5d-cefb48700f0e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.368158 Aug 29 15:51:17.130664 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3010/5840] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:16 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:17.148793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e3f562c6-2715-4b92-8a92-0303ef0fdc96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:17.149368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e3f562c6-2715-4b92-8a92-0303ef0fdc96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: 2fa54882-188b-4ad0-a90e-1f137aa6df49] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:17.157718 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-e3f562c6-2715-4b92-8a92-0303ef0fdc96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance 2fa54882-188b-4ad0-a90e-1f137aa6df49 could not be found. Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e3f562c6-2715-4b92-8a92-0303ef0fdc96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/2fa54882-188b-4ad0-a90e-1f137aa6df49/action HTTP/1.1 Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 15 Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: {"suspend": {}} Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 2fa54882-188b-4ad0-a90e-1f137aa6df49 could not be found. Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '2fa54882-188b-4ad0-a90e-1f137aa6df49', 'body': {'suspend': {}}} Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fa54882-188b-4ad0-a90e-1f137aa6df49 could not be found. Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fa54882-188b-4ad0-a90e-1f137aa6df49 could not be found. Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:17.167154 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:17.172685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:17.172685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:17.172685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fa54882-188b-4ad0-a90e-1f137aa6df49 could not be found. Aug 29 15:51:17.172685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:17.173924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e3f562c6-2715-4b92-8a92-0303ef0fdc96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance 2fa54882-188b-4ad0-a90e-1f137aa6df49 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:17.174984 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e3f562c6-2715-4b92-8a92-0303ef0fdc96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/2fa54882-188b-4ad0-a90e-1f137aa6df49/action" status: 404 len: 111 microversion: 2.1 time: 0.030370 Aug 29 15:51:17.176010 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2831/5841] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:17 2022] POST /compute/v2.1/servers/2fa54882-188b-4ad0-a90e-1f137aa6df49/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:17.184207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-872dc059-e802-443f-a8b9-5656e0b4edcd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:17.185787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-872dc059-e802-443f-a8b9-5656e0b4edcd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:17.196256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-872dc059-e802-443f-a8b9-5656e0b4edcd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:17.197220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-872dc059-e802-443f-a8b9-5656e0b4edcd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:17.200444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-872dc059-e802-443f-a8b9-5656e0b4edcd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.201479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-872dc059-e802-443f-a8b9-5656e0b4edcd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:17.211891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-872dc059-e802-443f-a8b9-5656e0b4edcd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:17.212752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-872dc059-e802-443f-a8b9-5656e0b4edcd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.447906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-04c0b771-b8c8-4c45-a11e-430d4e3478ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:17.448667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-04c0b771-b8c8-4c45-a11e-430d4e3478ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:17.462807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04c0b771-b8c8-4c45-a11e-430d4e3478ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:17.464879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04c0b771-b8c8-4c45-a11e-430d4e3478ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:17.466426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04c0b771-b8c8-4c45-a11e-430d4e3478ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.467183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04c0b771-b8c8-4c45-a11e-430d4e3478ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:17.471653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04c0b771-b8c8-4c45-a11e-430d4e3478ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:17.472129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04c0b771-b8c8-4c45-a11e-430d4e3478ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.522630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-872dc059-e802-443f-a8b9-5656e0b4edcd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:17.533671 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-872dc059-e802-443f-a8b9-5656e0b4edcd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.353058 Aug 29 15:51:17.534317 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3011/5842] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:17 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:17.562154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-576c97b8-6c36-45f3-afc5-63e84fe4fadc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:17.566085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-576c97b8-6c36-45f3-afc5-63e84fe4fadc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:17.585970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-576c97b8-6c36-45f3-afc5-63e84fe4fadc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:17.586493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-576c97b8-6c36-45f3-afc5-63e84fe4fadc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:17.586961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-576c97b8-6c36-45f3-afc5-63e84fe4fadc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.587731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-576c97b8-6c36-45f3-afc5-63e84fe4fadc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:17.588188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-576c97b8-6c36-45f3-afc5-63e84fe4fadc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:17.589024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-576c97b8-6c36-45f3-afc5-63e84fe4fadc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.837341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-04c0b771-b8c8-4c45-a11e-430d4e3478ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:17.857453 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-04c0b771-b8c8-4c45-a11e-430d4e3478ec tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1309 microversion: 2.1 time: 0.413272 Aug 29 15:51:17.858942 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2832/5843] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:17 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1309 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:17.954881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-576c97b8-6c36-45f3-afc5-63e84fe4fadc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:17.971859 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-576c97b8-6c36-45f3-afc5-63e84fe4fadc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.416367 Aug 29 15:51:17.976676 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3012/5844] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:17 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:17.996197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-072d9cab-1133-478f-87eb-e85668f7ed60 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:17.996729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-072d9cab-1133-478f-87eb-e85668f7ed60 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:18.004246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-072d9cab-1133-478f-87eb-e85668f7ed60 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:18.004990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-072d9cab-1133-478f-87eb-e85668f7ed60 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.005633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-072d9cab-1133-478f-87eb-e85668f7ed60 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:18.006545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-072d9cab-1133-478f-87eb-e85668f7ed60 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:18.007162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-072d9cab-1133-478f-87eb-e85668f7ed60 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.007756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-072d9cab-1133-478f-87eb-e85668f7ed60 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:18.047794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-072d9cab-1133-478f-87eb-e85668f7ed60 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lazy-loading 'flavor' on Instance uuid b0fd8c4a-7225-496b-a071-6fd8f37dc60a {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:18.138496 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-072d9cab-1133-478f-87eb-e85668f7ed60 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action" status: 202 len: 0 microversion: 2.1 time: 0.145907 Aug 29 15:51:18.139485 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2833/5845] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:17 2022] POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:51:18.148067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7d3c5a37-6928-4caf-be82-de6504f1cf96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:18.148702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7d3c5a37-6928-4caf-be82-de6504f1cf96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:18.165951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d3c5a37-6928-4caf-be82-de6504f1cf96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:18.168344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d3c5a37-6928-4caf-be82-de6504f1cf96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.168823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d3c5a37-6928-4caf-be82-de6504f1cf96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:18.169576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d3c5a37-6928-4caf-be82-de6504f1cf96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:18.174433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d3c5a37-6928-4caf-be82-de6504f1cf96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.174935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d3c5a37-6928-4caf-be82-de6504f1cf96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:18.417404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7d3c5a37-6928-4caf-be82-de6504f1cf96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:18.434073 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7d3c5a37-6928-4caf-be82-de6504f1cf96 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1513 microversion: 2.1 time: 0.290318 Aug 29 15:51:18.452949 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3013/5846] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:18 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1513 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:18.718072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-51ea3a21-52ce-495a-abf4-80d6be8716d3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:18.718663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-51ea3a21-52ce-495a-abf4-80d6be8716d3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:18.727374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51ea3a21-52ce-495a-abf4-80d6be8716d3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:18.727889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51ea3a21-52ce-495a-abf4-80d6be8716d3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.728339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51ea3a21-52ce-495a-abf4-80d6be8716d3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:18.729290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51ea3a21-52ce-495a-abf4-80d6be8716d3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:18.729749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51ea3a21-52ce-495a-abf4-80d6be8716d3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.730287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-51ea3a21-52ce-495a-abf4-80d6be8716d3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:18.760643 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-51ea3a21-52ce-495a-abf4-80d6be8716d3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9/ips" status: 200 len: 149 microversion: 2.1 time: 0.048723 Aug 29 15:51:18.767755 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2834/5847] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:51:18 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9/ips => generated 149 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:18.774037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-90045b1f-6d59-4010-962a-94d405ba5772 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bb27947-74bd-4ae1-bd40-b98be696387c"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:18.776912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-90045b1f-6d59-4010-962a-94d405ba5772 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:18.784258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90045b1f-6d59-4010-962a-94d405ba5772 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:18.784975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90045b1f-6d59-4010-962a-94d405ba5772 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.785437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90045b1f-6d59-4010-962a-94d405ba5772 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:18.786130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90045b1f-6d59-4010-962a-94d405ba5772 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:18.786577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90045b1f-6d59-4010-962a-94d405ba5772 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.787162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90045b1f-6d59-4010-962a-94d405ba5772 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:18.881492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5b263ba6-42b5-4cc8-b9ef-22a92af7a778 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:18.882667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5b263ba6-42b5-4cc8-b9ef-22a92af7a778 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:18.919196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b263ba6-42b5-4cc8-b9ef-22a92af7a778 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:18.919439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b263ba6-42b5-4cc8-b9ef-22a92af7a778 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.919713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b263ba6-42b5-4cc8-b9ef-22a92af7a778 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:18.921934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b263ba6-42b5-4cc8-b9ef-22a92af7a778 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:18.923144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b263ba6-42b5-4cc8-b9ef-22a92af7a778 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.925607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b263ba6-42b5-4cc8-b9ef-22a92af7a778 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.005111 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-90045b1f-6d59-4010-962a-94d405ba5772 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] HTTP exception thrown: Invalid volume: volume 7bb27947-74bd-4ae1-bd40-b98be696387c is already attached to instances: 646846a6-56c9-4370-8435-da5ae0466afb Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-90045b1f-6d59-4010-962a-94d405ba5772 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Request method failure captured: Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9/os-volume_attachments HTTP/1.1 Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 74 Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN9tQXht5Cgfnk-DmzN0MSv0rXQhWQjuwOYU5tmb_XOusFJfbKA_p0tIIxvVCByZJRyPrAyx_GOz9WX3qLDWm96rtVzsejl6mJXf7m_CCbLuHpKW-VnQamqEv9ykDteayNDpjpy7E2YIdOozyPaQJ7msypSAairkWE-SbOPzxpLLe7o Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_90cd659e27ab4f5b9c926a11221a8d80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}] Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: a27d353043364e838b7b6db2c5e97215 Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: {"volumeAttachment": {"volumeId": "7bb27947-74bd-4ae1-bd40-b98be696387c"}} Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid volume: volume 7bb27947-74bd-4ae1-bd40-b98be696387c is already attached to instances: 646846a6-56c9-4370-8435-da5ae0466afb Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'server_id': 'f0947721-9360-4db5-8636-ac5786d6cbe9', 'body': {'volumeAttachment': {'volumeId': '7bb27947-74bd-4ae1-bd40-b98be696387c'}}} Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7bb27947-74bd-4ae1-bd40-b98be696387c is already attached to instances: 646846a6-56c9-4370-8435-da5ae0466afb Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:19.006763 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:19.012478 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:19.012478 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:19.012478 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 15:51:19.012478 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 15:51:19.012478 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7bb27947-74bd-4ae1-bd40-b98be696387c is already attached to instances: 646846a6-56c9-4370-8435-da5ae0466afb Aug 29 15:51:19.012478 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:19.012478 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:19.012478 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:19.012478 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:19.012478 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:19.012478 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:19.012478 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:19.012478 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:19.012478 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7bb27947-74bd-4ae1-bd40-b98be696387c is already attached to instances: 646846a6-56c9-4370-8435-da5ae0466afb Aug 29 15:51:19.012478 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:19.013845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-90045b1f-6d59-4010-962a-94d405ba5772 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Returning 400 to user: Invalid volume: volume 7bb27947-74bd-4ae1-bd40-b98be696387c is already attached to instances: 646846a6-56c9-4370-8435-da5ae0466afb {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:19.014266 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-90045b1f-6d59-4010-962a-94d405ba5772 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "POST /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.245076 Aug 29 15:51:19.015075 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3014/5848] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 15:51:18 2022] POST /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9/os-volume_attachments => generated 174 bytes in 247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:51:19.023749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-146c2f53-d755-4c40-86f0-1860ccc06fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:19.024515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-146c2f53-d755-4c40-86f0-1860ccc06fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:19.035256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-146c2f53-d755-4c40-86f0-1860ccc06fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.040389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-146c2f53-d755-4c40-86f0-1860ccc06fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.041155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-146c2f53-d755-4c40-86f0-1860ccc06fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.042170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-146c2f53-d755-4c40-86f0-1860ccc06fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.042596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-146c2f53-d755-4c40-86f0-1860ccc06fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.043023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-146c2f53-d755-4c40-86f0-1860ccc06fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.043630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:19.087554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:19.100443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-146c2f53-d755-4c40-86f0-1860ccc06fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:51:19.220124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:19.243272 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-146c2f53-d755-4c40-86f0-1860ccc06fbc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 204 len: 0 microversion: 2.1 time: 0.222913 Aug 29 15:51:19.245907 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3015/5849] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:51:19 2022] DELETE /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:51:19.256359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0fb74eae-88b7-46e2-8074-31c2890f7af1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:19.258754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0fb74eae-88b7-46e2-8074-31c2890f7af1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:19.269725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fb74eae-88b7-46e2-8074-31c2890f7af1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.270665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fb74eae-88b7-46e2-8074-31c2890f7af1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.271458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fb74eae-88b7-46e2-8074-31c2890f7af1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.272600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fb74eae-88b7-46e2-8074-31c2890f7af1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.273264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fb74eae-88b7-46e2-8074-31c2890f7af1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.273854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fb74eae-88b7-46e2-8074-31c2890f7af1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.307857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:19.376525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5b263ba6-42b5-4cc8-b9ef-22a92af7a778 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:19.386967 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5b263ba6-42b5-4cc8-b9ef-22a92af7a778 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1309 microversion: 2.1 time: 0.511757 Aug 29 15:51:19.401069 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2835/5850] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:18 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1309 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:19.456086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-083124e9-453a-436c-90fb-ef4109512971 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:19.456850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-083124e9-453a-436c-90fb-ef4109512971 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:19.475478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-083124e9-453a-436c-90fb-ef4109512971 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.476070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-083124e9-453a-436c-90fb-ef4109512971 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.477466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-083124e9-453a-436c-90fb-ef4109512971 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.478448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-083124e9-453a-436c-90fb-ef4109512971 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.479492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-083124e9-453a-436c-90fb-ef4109512971 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.481751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-083124e9-453a-436c-90fb-ef4109512971 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.780540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-083124e9-453a-436c-90fb-ef4109512971 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:19.797203 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-083124e9-453a-436c-90fb-ef4109512971 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1496 microversion: 2.1 time: 0.344772 Aug 29 15:51:19.798047 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2836/5851] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:19 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1496 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:19.819551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-63c6bd11-c2c7-43f8-b4ed-a156d49abf8d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:19.823153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-63c6bd11-c2c7-43f8-b4ed-a156d49abf8d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:19.830323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63c6bd11-c2c7-43f8-b4ed-a156d49abf8d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.831310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63c6bd11-c2c7-43f8-b4ed-a156d49abf8d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.832003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63c6bd11-c2c7-43f8-b4ed-a156d49abf8d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.833587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63c6bd11-c2c7-43f8-b4ed-a156d49abf8d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.834292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63c6bd11-c2c7-43f8-b4ed-a156d49abf8d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.834967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-63c6bd11-c2c7-43f8-b4ed-a156d49abf8d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.861831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-63c6bd11-c2c7-43f8-b4ed-a156d49abf8d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lazy-loading 'flavor' on Instance uuid b0fd8c4a-7225-496b-a071-6fd8f37dc60a {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:19.878442 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-63c6bd11-c2c7-43f8-b4ed-a156d49abf8d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Cannot 'suspend' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state suspended Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-63c6bd11-c2c7-43f8-b4ed-a156d49abf8d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action HTTP/1.1 Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 15 Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: {"suspend": {}} Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: exception: Cannot 'suspend' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state suspended Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'b0fd8c4a-7225-496b-a071-6fd8f37dc60a', 'body': {'suspend': {}}} Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a in vm_state suspended. Cannot suspend while the instance is in this state. Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 29 15:51:19.880416 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:51:19.886670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:51:19.886670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:51:19.886670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state suspended Aug 29 15:51:19.886670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:19.886670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:19.886670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:19.886670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:19.886670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:19.886670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:19.886670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:19.886670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:19.886670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state suspended Aug 29 15:51:19.886670 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:19.889276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-63c6bd11-c2c7-43f8-b4ed-a156d49abf8d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 409 to user: Cannot 'suspend' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state suspended {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:19.890401 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-63c6bd11-c2c7-43f8-b4ed-a156d49abf8d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action" status: 409 len: 148 microversion: 2.1 time: 0.074974 Aug 29 15:51:19.894890 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2837/5852] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:19 2022] POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action => generated 148 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:51:19.907673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d58e53fb-d788-4d52-afed-326063ce76bd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:19.908580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d58e53fb-d788-4d52-afed-326063ce76bd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:19.928228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d58e53fb-d788-4d52-afed-326063ce76bd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.930335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d58e53fb-d788-4d52-afed-326063ce76bd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.934599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d58e53fb-d788-4d52-afed-326063ce76bd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.941945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d58e53fb-d788-4d52-afed-326063ce76bd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.942199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d58e53fb-d788-4d52-afed-326063ce76bd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.944747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d58e53fb-d788-4d52-afed-326063ce76bd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:20.120225 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d58e53fb-d788-4d52-afed-326063ce76bd tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action" status: 202 len: 0 microversion: 2.1 time: 0.221536 Aug 29 15:51:20.123005 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2838/5853] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:19 2022] POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:51:20.138531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-156e4396-ad8b-49b4-9794-fba1cf0033d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:20.143925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-156e4396-ad8b-49b4-9794-fba1cf0033d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:20.161495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-156e4396-ad8b-49b4-9794-fba1cf0033d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:20.162054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-156e4396-ad8b-49b4-9794-fba1cf0033d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:20.162502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-156e4396-ad8b-49b4-9794-fba1cf0033d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:20.163307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-156e4396-ad8b-49b4-9794-fba1cf0033d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:20.163698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-156e4396-ad8b-49b4-9794-fba1cf0033d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:20.164121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-156e4396-ad8b-49b4-9794-fba1cf0033d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:20.215608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0fb74eae-88b7-46e2-8074-31c2890f7af1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:20.228078 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0fb74eae-88b7-46e2-8074-31c2890f7af1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1681 microversion: 2.1 time: 0.977239 Aug 29 15:51:20.233734 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3016/5854] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:19 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1681 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:20.353422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-156e4396-ad8b-49b4-9794-fba1cf0033d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:20.366380 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-156e4396-ad8b-49b4-9794-fba1cf0033d5 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1502 microversion: 2.1 time: 0.239340 Aug 29 15:51:20.368672 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2839/5855] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:20 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:20.427272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b864e390-8974-48a4-9719-98da63486a27 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:20.428120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b864e390-8974-48a4-9719-98da63486a27 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:20.435766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b864e390-8974-48a4-9719-98da63486a27 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:20.436440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b864e390-8974-48a4-9719-98da63486a27 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:20.436881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b864e390-8974-48a4-9719-98da63486a27 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:20.438803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b864e390-8974-48a4-9719-98da63486a27 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:20.440242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b864e390-8974-48a4-9719-98da63486a27 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:20.440917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b864e390-8974-48a4-9719-98da63486a27 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:20.468910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:20.637923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea267a41-6cd6-4492-b884-50d320325373 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'create', calling method: .version_select at 0x7fc42a43d430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1193571999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4Q+Yfw3b4s7PzAihtc42dCGcaSw3FSAgxaVSNGR84X2j8S8LTEas064eWNV+Lq0Sgx/9+KWnCUbVDyZZPetkI6xfXADYZhwFkcSGdkRsFky9huh75uHs6ccHdv/R4a8A=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:20.665270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-ea267a41-6cd6-4492-b884-50d320325373 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Getting quotas for project 63c8e858d9064ae3875d91e8a43f7ee4. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:51:20.676998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-ea267a41-6cd6-4492-b884-50d320325373 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Getting quotas for user 008972030ade418cb180f0702ae168b4 and project 63c8e858d9064ae3875d91e8a43f7ee4. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:51:20.713290 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ea267a41-6cd6-4492-b884-50d320325373 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.277020 Aug 29 15:51:20.714814 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2840/5856] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:51:20 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:51:20.784651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b864e390-8974-48a4-9719-98da63486a27 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:20.800872 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b864e390-8974-48a4-9719-98da63486a27 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1309 microversion: 2.1 time: 0.379448 Aug 29 15:51:20.804490 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3017/5857] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:20 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1309 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:21.260902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-41c5eccf-31eb-4034-aa06-4310643a89dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:21.264902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-41c5eccf-31eb-4034-aa06-4310643a89dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:21.280410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41c5eccf-31eb-4034-aa06-4310643a89dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.281677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41c5eccf-31eb-4034-aa06-4310643a89dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:21.282979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41c5eccf-31eb-4034-aa06-4310643a89dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.285635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41c5eccf-31eb-4034-aa06-4310643a89dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.286616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41c5eccf-31eb-4034-aa06-4310643a89dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:21.289011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41c5eccf-31eb-4034-aa06-4310643a89dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.388713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-62c7de4d-9a83-4c3b-88c5-2a210607a526 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:21.389842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-62c7de4d-9a83-4c3b-88c5-2a210607a526 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:21.404135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62c7de4d-9a83-4c3b-88c5-2a210607a526 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.422294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62c7de4d-9a83-4c3b-88c5-2a210607a526 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:21.427347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62c7de4d-9a83-4c3b-88c5-2a210607a526 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.431985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62c7de4d-9a83-4c3b-88c5-2a210607a526 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.432672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62c7de4d-9a83-4c3b-88c5-2a210607a526 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:21.434239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62c7de4d-9a83-4c3b-88c5-2a210607a526 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.678563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-62c7de4d-9a83-4c3b-88c5-2a210607a526 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:21.700951 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-62c7de4d-9a83-4c3b-88c5-2a210607a526 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1502 microversion: 2.1 time: 0.312646 Aug 29 15:51:21.702176 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3018/5858] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:21 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1502 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:21.707572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c0699043-3416-43d9-a115-7dba7776da0c req-db148675-c59e-467f-a69d-4e29057e5c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e0c4f14-7bec-433d-9654-6be9cf22b78e", "name": "network-vif-plugged", "status": "completed", "tag": "e9b40f70-8b4b-4dbb-a0d7-8168a4792cce"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:21.720039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c0699043-3416-43d9-a115-7dba7776da0c req-db148675-c59e-467f-a69d-4e29057e5c75 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.721000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c0699043-3416-43d9-a115-7dba7776da0c req-db148675-c59e-467f-a69d-4e29057e5c75 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:21.721731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c0699043-3416-43d9-a115-7dba7776da0c req-db148675-c59e-467f-a69d-4e29057e5c75 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.741251 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c0699043-3416-43d9-a115-7dba7776da0c req-db148675-c59e-467f-a69d-4e29057e5c75 service nova] Creating event network-vif-plugged:e9b40f70-8b4b-4dbb-a0d7-8168a4792cce for instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e on n-h1-839401-11 Aug 29 15:51:21.747638 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c0699043-3416-43d9-a115-7dba7776da0c req-db148675-c59e-467f-a69d-4e29057e5c75 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043307 Aug 29 15:51:21.748954 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3019/5859] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:21.826328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7297aa8f-7213-4ae0-a07a-0f1f4c116788 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:21.827172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7297aa8f-7213-4ae0-a07a-0f1f4c116788 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:21.842207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7297aa8f-7213-4ae0-a07a-0f1f4c116788 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.846103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7297aa8f-7213-4ae0-a07a-0f1f4c116788 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:21.847274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7297aa8f-7213-4ae0-a07a-0f1f4c116788 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.850220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7297aa8f-7213-4ae0-a07a-0f1f4c116788 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.850780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7297aa8f-7213-4ae0-a07a-0f1f4c116788 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:21.851810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7297aa8f-7213-4ae0-a07a-0f1f4c116788 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:22.106567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7297aa8f-7213-4ae0-a07a-0f1f4c116788 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:22.115296 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7297aa8f-7213-4ae0-a07a-0f1f4c116788 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1309 microversion: 2.1 time: 0.293995 Aug 29 15:51:22.119962 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3020/5860] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:21 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1309 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:22.545458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-41c5eccf-31eb-4034-aa06-4310643a89dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:22.559348 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-41c5eccf-31eb-4034-aa06-4310643a89dc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1681 microversion: 2.1 time: 1.308630 Aug 29 15:51:22.559949 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2841/5861] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:21 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1681 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:22.726447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-53e794c6-ce63-43e5-b392-8a9d6186d023 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:22.728008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-53e794c6-ce63-43e5-b392-8a9d6186d023 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:22.739697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53e794c6-ce63-43e5-b392-8a9d6186d023 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:22.740517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53e794c6-ce63-43e5-b392-8a9d6186d023 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:22.741520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53e794c6-ce63-43e5-b392-8a9d6186d023 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:22.743047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53e794c6-ce63-43e5-b392-8a9d6186d023 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:22.744460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53e794c6-ce63-43e5-b392-8a9d6186d023 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:22.745139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53e794c6-ce63-43e5-b392-8a9d6186d023 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:22.949838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-53e794c6-ce63-43e5-b392-8a9d6186d023 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:22.962681 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-53e794c6-ce63-43e5-b392-8a9d6186d023 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1502 microversion: 2.1 time: 0.243554 Aug 29 15:51:22.964545 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3021/5862] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:22 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:23.149249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7617e15d-dc17-43d6-b6be-589434c54a74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:23.150035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7617e15d-dc17-43d6-b6be-589434c54a74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:23.159875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:23.162661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7617e15d-dc17-43d6-b6be-589434c54a74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:23.163739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7617e15d-dc17-43d6-b6be-589434c54a74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:23.164354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7617e15d-dc17-43d6-b6be-589434c54a74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:23.165711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7617e15d-dc17-43d6-b6be-589434c54a74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:23.166116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7617e15d-dc17-43d6-b6be-589434c54a74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:23.166778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7617e15d-dc17-43d6-b6be-589434c54a74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:23.582361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a83bf363-66d6-472d-8f32-f7565f75cc54 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:23.583518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a83bf363-66d6-472d-8f32-f7565f75cc54 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:23.592793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a83bf363-66d6-472d-8f32-f7565f75cc54 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:23.593332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a83bf363-66d6-472d-8f32-f7565f75cc54 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:23.593766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a83bf363-66d6-472d-8f32-f7565f75cc54 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:23.594469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a83bf363-66d6-472d-8f32-f7565f75cc54 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:23.594931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a83bf363-66d6-472d-8f32-f7565f75cc54 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:23.595371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a83bf363-66d6-472d-8f32-f7565f75cc54 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:23.640640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7617e15d-dc17-43d6-b6be-589434c54a74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:23.653898 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7617e15d-dc17-43d6-b6be-589434c54a74 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1309 microversion: 2.1 time: 0.511698 Aug 29 15:51:23.659554 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2842/5863] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:23 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1309 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:23.990338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a2dc6aef-45e6-4359-9ffa-850c1c7984da tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:23.990965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a2dc6aef-45e6-4359-9ffa-850c1c7984da tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:24.002196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2dc6aef-45e6-4359-9ffa-850c1c7984da tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:24.002978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2dc6aef-45e6-4359-9ffa-850c1c7984da tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:24.003598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2dc6aef-45e6-4359-9ffa-850c1c7984da tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:24.004496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2dc6aef-45e6-4359-9ffa-850c1c7984da tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:24.010138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2dc6aef-45e6-4359-9ffa-850c1c7984da tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:24.010587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2dc6aef-45e6-4359-9ffa-850c1c7984da tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:24.077583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a83bf363-66d6-472d-8f32-f7565f75cc54 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:24.091696 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a83bf363-66d6-472d-8f32-f7565f75cc54 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1681 microversion: 2.1 time: 0.512225 Aug 29 15:51:24.101225 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3022/5864] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:23 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1681 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:24.437162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a2dc6aef-45e6-4359-9ffa-850c1c7984da tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:24.462842 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a2dc6aef-45e6-4359-9ffa-850c1c7984da tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1502 microversion: 2.1 time: 0.473777 Aug 29 15:51:24.463619 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2843/5865] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:23 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1502 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:24.684732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7e952018-7f73-4bb4-9d1b-e582c6346d8a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:24.685707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7e952018-7f73-4bb4-9d1b-e582c6346d8a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:24.696842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e952018-7f73-4bb4-9d1b-e582c6346d8a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:24.698154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e952018-7f73-4bb4-9d1b-e582c6346d8a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:24.699568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e952018-7f73-4bb4-9d1b-e582c6346d8a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:24.700376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e952018-7f73-4bb4-9d1b-e582c6346d8a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:24.706878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e952018-7f73-4bb4-9d1b-e582c6346d8a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:24.707692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e952018-7f73-4bb4-9d1b-e582c6346d8a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:24.857482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-52c23bf3-2ce0-4189-8914-9e7a65df2aa2 req-e18309f9-1687-4bf0-878f-dc6e6f2959f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0947721-9360-4db5-8636-ac5786d6cbe9", "name": "network-vif-deleted", "tag": "9435fc27-8664-47fe-840f-9a73e4495c4f"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:24.877045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-52c23bf3-2ce0-4189-8914-9e7a65df2aa2 req-e18309f9-1687-4bf0-878f-dc6e6f2959f0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:24.886358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-52c23bf3-2ce0-4189-8914-9e7a65df2aa2 req-e18309f9-1687-4bf0-878f-dc6e6f2959f0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:24.886851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-52c23bf3-2ce0-4189-8914-9e7a65df2aa2 req-e18309f9-1687-4bf0-878f-dc6e6f2959f0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:24.917095 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-52c23bf3-2ce0-4189-8914-9e7a65df2aa2 req-e18309f9-1687-4bf0-878f-dc6e6f2959f0 service nova] Creating event network-vif-deleted:9435fc27-8664-47fe-840f-9a73e4495c4f for instance f0947721-9360-4db5-8636-ac5786d6cbe9 on n-h2-839401-11 Aug 29 15:51:24.952277 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-52c23bf3-2ce0-4189-8914-9e7a65df2aa2 req-e18309f9-1687-4bf0-878f-dc6e6f2959f0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123997 Aug 29 15:51:24.954106 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2844/5866] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:25.121040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-21586a54-fc14-4a34-91a4-cc64251209d1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:25.122449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-21586a54-fc14-4a34-91a4-cc64251209d1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:25.140563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21586a54-fc14-4a34-91a4-cc64251209d1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.143117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21586a54-fc14-4a34-91a4-cc64251209d1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.145448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21586a54-fc14-4a34-91a4-cc64251209d1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.146317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21586a54-fc14-4a34-91a4-cc64251209d1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.149636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21586a54-fc14-4a34-91a4-cc64251209d1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.151564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21586a54-fc14-4a34-91a4-cc64251209d1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.232388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21586a54-fc14-4a34-91a4-cc64251209d1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.234583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21586a54-fc14-4a34-91a4-cc64251209d1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.237810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21586a54-fc14-4a34-91a4-cc64251209d1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.239879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-21586a54-fc14-4a34-91a4-cc64251209d1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lazy-loading 'fault' on Instance uuid f0947721-9360-4db5-8636-ac5786d6cbe9 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:25.342808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7e952018-7f73-4bb4-9d1b-e582c6346d8a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:25.351527 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7e952018-7f73-4bb4-9d1b-e582c6346d8a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1490 microversion: 2.1 time: 0.671176 Aug 29 15:51:25.360447 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3023/5867] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:24 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1490 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:25.380848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-21586a54-fc14-4a34-91a4-cc64251209d1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:25.387032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d83b1912-c101-4019-9635-f34a36aa2849 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:25.391470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d83b1912-c101-4019-9635-f34a36aa2849 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:25.391689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:25.398078 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-21586a54-fc14-4a34-91a4-cc64251209d1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 200 len: 1331 microversion: 2.1 time: 0.280553 Aug 29 15:51:25.398827 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2845/5868] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:25 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 1331 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:25.422686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d83b1912-c101-4019-9635-f34a36aa2849 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.427094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d83b1912-c101-4019-9635-f34a36aa2849 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.427795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d83b1912-c101-4019-9635-f34a36aa2849 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.429703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d83b1912-c101-4019-9635-f34a36aa2849 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.430565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d83b1912-c101-4019-9635-f34a36aa2849 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.431518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d83b1912-c101-4019-9635-f34a36aa2849 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.486117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a14b2f97-1141-49ef-adff-b456ca518f03 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:25.487106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a14b2f97-1141-49ef-adff-b456ca518f03 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:25.494598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a14b2f97-1141-49ef-adff-b456ca518f03 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.505138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a14b2f97-1141-49ef-adff-b456ca518f03 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.506010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a14b2f97-1141-49ef-adff-b456ca518f03 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.506984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a14b2f97-1141-49ef-adff-b456ca518f03 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.507685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a14b2f97-1141-49ef-adff-b456ca518f03 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.508334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a14b2f97-1141-49ef-adff-b456ca518f03 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.524210 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d83b1912-c101-4019-9635-f34a36aa2849 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "PUT /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1085 microversion: 2.1 time: 0.142084 Aug 29 15:51:25.538599 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3024/5869] 10.222.0.62 () {60 vars in 1256 bytes} [Mon Aug 29 15:51:25 2022] PUT /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1085 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:25.544259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ebba065-73fb-461e-9d52-75e4d66b5675 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:25.545008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ebba065-73fb-461e-9d52-75e4d66b5675 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:25.552532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ebba065-73fb-461e-9d52-75e4d66b5675 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.553178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ebba065-73fb-461e-9d52-75e4d66b5675 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.553757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ebba065-73fb-461e-9d52-75e4d66b5675 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.554553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ebba065-73fb-461e-9d52-75e4d66b5675 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.555124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ebba065-73fb-461e-9d52-75e4d66b5675 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.555644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ebba065-73fb-461e-9d52-75e4d66b5675 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.725210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a14b2f97-1141-49ef-adff-b456ca518f03 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:25.741942 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a14b2f97-1141-49ef-adff-b456ca518f03 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.259974 Aug 29 15:51:25.744133 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2846/5870] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:25 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:25.776445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-90a6a963-c449-4368-93e0-1f4d4bf0768d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:25.780582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-90a6a963-c449-4368-93e0-1f4d4bf0768d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:25.797357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90a6a963-c449-4368-93e0-1f4d4bf0768d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.798210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90a6a963-c449-4368-93e0-1f4d4bf0768d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.802041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90a6a963-c449-4368-93e0-1f4d4bf0768d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.803134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90a6a963-c449-4368-93e0-1f4d4bf0768d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.806867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90a6a963-c449-4368-93e0-1f4d4bf0768d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.807758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90a6a963-c449-4368-93e0-1f4d4bf0768d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.920521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5ebba065-73fb-461e-9d52-75e4d66b5675 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:25.945852 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ebba065-73fb-461e-9d52-75e4d66b5675 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1511 microversion: 2.1 time: 0.404067 Aug 29 15:51:25.947489 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3025/5871] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:25 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1511 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:25.967666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0b3f2f94-6d4b-429f-94f9-84b58aa2ccf9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:25.968935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0b3f2f94-6d4b-429f-94f9-84b58aa2ccf9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:25.976188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b3f2f94-6d4b-429f-94f9-84b58aa2ccf9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.977013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b3f2f94-6d4b-429f-94f9-84b58aa2ccf9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.977757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b3f2f94-6d4b-429f-94f9-84b58aa2ccf9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.978800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b3f2f94-6d4b-429f-94f9-84b58aa2ccf9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.979462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b3f2f94-6d4b-429f-94f9-84b58aa2ccf9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.980128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b3f2f94-6d4b-429f-94f9-84b58aa2ccf9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.111531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-90a6a963-c449-4368-93e0-1f4d4bf0768d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:26.120716 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-90a6a963-c449-4368-93e0-1f4d4bf0768d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.355649 Aug 29 15:51:26.122032 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2847/5872] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:25 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:26.145884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f1e29fc9-242e-48ac-b2d7-e87d8ac5bb9e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:26.146781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f1e29fc9-242e-48ac-b2d7-e87d8ac5bb9e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: 9c962954-08f0-4821-bd6b-f0a51f078265] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:26.154096 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-f1e29fc9-242e-48ac-b2d7-e87d8ac5bb9e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance 9c962954-08f0-4821-bd6b-f0a51f078265 could not be found. Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f1e29fc9-242e-48ac-b2d7-e87d8ac5bb9e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/9c962954-08f0-4821-bd6b-f0a51f078265/action HTTP/1.1 Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 15 Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: {"unpause": {}} Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 9c962954-08f0-4821-bd6b-f0a51f078265 could not be found. Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '9c962954-08f0-4821-bd6b-f0a51f078265', 'body': {'unpause': {}}} Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c962954-08f0-4821-bd6b-f0a51f078265 could not be found. Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c962954-08f0-4821-bd6b-f0a51f078265 could not be found. Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:26.157345 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:26.164361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:26.164361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:26.164361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c962954-08f0-4821-bd6b-f0a51f078265 could not be found. Aug 29 15:51:26.164361 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:26.166059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f1e29fc9-242e-48ac-b2d7-e87d8ac5bb9e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance 9c962954-08f0-4821-bd6b-f0a51f078265 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:26.167181 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f1e29fc9-242e-48ac-b2d7-e87d8ac5bb9e tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/9c962954-08f0-4821-bd6b-f0a51f078265/action" status: 404 len: 111 microversion: 2.1 time: 0.027561 Aug 29 15:51:26.172953 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2848/5873] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:26 2022] POST /compute/v2.1/servers/9c962954-08f0-4821-bd6b-f0a51f078265/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:51:26.189550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e75b7108-db99-4f17-88c0-c9a1544d1c10 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:26.190346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e75b7108-db99-4f17-88c0-c9a1544d1c10 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:26.198890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e75b7108-db99-4f17-88c0-c9a1544d1c10 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.199590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e75b7108-db99-4f17-88c0-c9a1544d1c10 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.200139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e75b7108-db99-4f17-88c0-c9a1544d1c10 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.201986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e75b7108-db99-4f17-88c0-c9a1544d1c10 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.202574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e75b7108-db99-4f17-88c0-c9a1544d1c10 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.203119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e75b7108-db99-4f17-88c0-c9a1544d1c10 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.306751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0b3f2f94-6d4b-429f-94f9-84b58aa2ccf9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:26.314863 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0b3f2f94-6d4b-429f-94f9-84b58aa2ccf9 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1511 microversion: 2.1 time: 0.351287 Aug 29 15:51:26.315830 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3026/5874] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:25 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:26.338747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d4551da3-39c2-4840-848b-496f521110bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:26.339407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d4551da3-39c2-4840-848b-496f521110bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:26.346776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4551da3-39c2-4840-848b-496f521110bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.347397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4551da3-39c2-4840-848b-496f521110bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.347756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4551da3-39c2-4840-848b-496f521110bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.348561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4551da3-39c2-4840-848b-496f521110bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.349009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4551da3-39c2-4840-848b-496f521110bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.349665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4551da3-39c2-4840-848b-496f521110bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.382262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d4551da3-39c2-4840-848b-496f521110bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:51:26.429187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e75b7108-db99-4f17-88c0-c9a1544d1c10 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:26.440546 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e75b7108-db99-4f17-88c0-c9a1544d1c10 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.266020 Aug 29 15:51:26.442775 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2849/5875] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:26 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:26.455391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-28266179-81c2-4e18-a3e4-04956b2dd69e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:26.456599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-28266179-81c2-4e18-a3e4-04956b2dd69e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:26.473798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28266179-81c2-4e18-a3e4-04956b2dd69e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.475629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28266179-81c2-4e18-a3e4-04956b2dd69e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.476193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28266179-81c2-4e18-a3e4-04956b2dd69e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.477324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28266179-81c2-4e18-a3e4-04956b2dd69e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.477774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28266179-81c2-4e18-a3e4-04956b2dd69e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.478276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28266179-81c2-4e18-a3e4-04956b2dd69e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.498873 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-28266179-81c2-4e18-a3e4-04956b2dd69e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] HTTP exception thrown: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-28266179-81c2-4e18-a3e4-04956b2dd69e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Request method failure captured: Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 HTTP/1.1 Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN9tQXht5Cgfnk-DmzN0MSv0rXQhWQjuwOYU5tmb_XOusFJfbKA_p0tIIxvVCByZJRyPrAyx_GOz9WX3qLDWm96rtVzsejl6mJXf7m_CCbLuHpKW-VnQamqEv9ykDteayNDpjpy7E2YIdOozyPaQJ7msypSAairkWE-SbOPzxpLLe7o Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_90cd659e27ab4f5b9c926a11221a8d80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}] Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: a27d353043364e838b7b6db2c5e97215 Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'f0947721-9360-4db5-8636-ac5786d6cbe9'} Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:26.500702 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:26.507132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:26.507132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:26.507132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:26.507132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:26.507132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:26.507132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. Aug 29 15:51:26.507132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:26.510088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-28266179-81c2-4e18-a3e4-04956b2dd69e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Returning 404 to user: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:26.512222 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-28266179-81c2-4e18-a3e4-04956b2dd69e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 404 len: 111 microversion: 2.1 time: 0.066525 Aug 29 15:51:26.518317 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2850/5876] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:26 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:26.528127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-463c602f-0782-43ee-ba30-9cf93873d7b4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:26.530056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-463c602f-0782-43ee-ba30-9cf93873d7b4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:26.537138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-463c602f-0782-43ee-ba30-9cf93873d7b4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.537995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-463c602f-0782-43ee-ba30-9cf93873d7b4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.538533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-463c602f-0782-43ee-ba30-9cf93873d7b4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.539495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-463c602f-0782-43ee-ba30-9cf93873d7b4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.540052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-463c602f-0782-43ee-ba30-9cf93873d7b4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.540632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-463c602f-0782-43ee-ba30-9cf93873d7b4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.542409 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d4551da3-39c2-4840-848b-496f521110bd tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 204 len: 0 microversion: 2.1 time: 0.209016 Aug 29 15:51:26.545011 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3027/5877] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:51:26 2022] DELETE /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:51:26.552048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-16d97d53-e13f-472a-842c-55aeaf087472 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '.version_select at 0x7fc42a843b80>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:26.588742 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-16d97d53-e13f-472a-842c-55aeaf087472 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-226488096" status: 202 len: 0 microversion: 2.1 time: 0.041943 Aug 29 15:51:26.589951 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3028/5878] 10.222.0.62 () {58 vars in 1218 bytes} [Mon Aug 29 15:51:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-226488096 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:51:26.595919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-25c262f2-3581-4c48-90e5-b857a9c23665 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:26.596858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-25c262f2-3581-4c48-90e5-b857a9c23665 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:26.605187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25c262f2-3581-4c48-90e5-b857a9c23665 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.605925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25c262f2-3581-4c48-90e5-b857a9c23665 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.606561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25c262f2-3581-4c48-90e5-b857a9c23665 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.607536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25c262f2-3581-4c48-90e5-b857a9c23665 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.608167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25c262f2-3581-4c48-90e5-b857a9c23665 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.608768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25c262f2-3581-4c48-90e5-b857a9c23665 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.990573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-463c602f-0782-43ee-ba30-9cf93873d7b4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:27.001166 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-463c602f-0782-43ee-ba30-9cf93873d7b4 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.479680 Aug 29 15:51:27.002660 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2851/5879] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:26 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:27.034076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-22728073-05c8-4f8d-b6f7-1c68e5cbb6fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:27.035034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-22728073-05c8-4f8d-b6f7-1c68e5cbb6fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:27.043620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22728073-05c8-4f8d-b6f7-1c68e5cbb6fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.044410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22728073-05c8-4f8d-b6f7-1c68e5cbb6fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.045008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22728073-05c8-4f8d-b6f7-1c68e5cbb6fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.046242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22728073-05c8-4f8d-b6f7-1c68e5cbb6fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.046977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22728073-05c8-4f8d-b6f7-1c68e5cbb6fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.047883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22728073-05c8-4f8d-b6f7-1c68e5cbb6fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.083099 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-22728073-05c8-4f8d-b6f7-1c68e5cbb6fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Cannot 'unpause' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-22728073-05c8-4f8d-b6f7-1c68e5cbb6fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action HTTP/1.1 Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 15 Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: {"unpause": {}} Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: exception: Cannot 'unpause' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'b0fd8c4a-7225-496b-a071-6fd8f37dc60a', 'body': {'unpause': {}}} Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a in vm_state active. Cannot unpause while the instance is in this state. Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:27.085230 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:27.091699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:27.091699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:27.091699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:27.091699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active Aug 29 15:51:27.091699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:27.093411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-22728073-05c8-4f8d-b6f7-1c68e5cbb6fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 409 to user: Cannot 'unpause' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:27.094639 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-22728073-05c8-4f8d-b6f7-1c68e5cbb6fc tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action" status: 409 len: 145 microversion: 2.1 time: 0.068729 Aug 29 15:51:27.095805 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2852/5880] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:27 2022] POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action => generated 145 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:51:27.104513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a83d04a7-a741-4ea0-a317-1aa950412157 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:27.105513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a83d04a7-a741-4ea0-a317-1aa950412157 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:27.118715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a83d04a7-a741-4ea0-a317-1aa950412157 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.119966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a83d04a7-a741-4ea0-a317-1aa950412157 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.120737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a83d04a7-a741-4ea0-a317-1aa950412157 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.121752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a83d04a7-a741-4ea0-a317-1aa950412157 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.123159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a83d04a7-a741-4ea0-a317-1aa950412157 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.123866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a83d04a7-a741-4ea0-a317-1aa950412157 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.142252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-25c262f2-3581-4c48-90e5-b857a9c23665 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:27.158516 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-25c262f2-3581-4c48-90e5-b857a9c23665 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1517 microversion: 2.1 time: 0.565233 Aug 29 15:51:27.173466 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3029/5881] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:26 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1517 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:27.467759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a83d04a7-a741-4ea0-a317-1aa950412157 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:27.478221 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a83d04a7-a741-4ea0-a317-1aa950412157 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.378334 Aug 29 15:51:27.479274 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2853/5882] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:27 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:27.501651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e53cb76e-5282-4b60-98a9-a92290887511 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:27.503050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e53cb76e-5282-4b60-98a9-a92290887511 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:27.509979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e53cb76e-5282-4b60-98a9-a92290887511 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.510810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e53cb76e-5282-4b60-98a9-a92290887511 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.511483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e53cb76e-5282-4b60-98a9-a92290887511 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.512482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e53cb76e-5282-4b60-98a9-a92290887511 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.513162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e53cb76e-5282-4b60-98a9-a92290887511 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.513897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e53cb76e-5282-4b60-98a9-a92290887511 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.964206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e53cb76e-5282-4b60-98a9-a92290887511 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:27.974455 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e53cb76e-5282-4b60-98a9-a92290887511 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.477177 Aug 29 15:51:27.975052 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3030/5883] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:27 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:27.998045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ebdaba0f-4868-4286-95f6-1bedb7c2a081 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:27.999512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ebdaba0f-4868-4286-95f6-1bedb7c2a081 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: 3d4472ab-894c-45d3-8203-94a53fb02574] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:28.017600 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-ebdaba0f-4868-4286-95f6-1bedb7c2a081 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance 3d4472ab-894c-45d3-8203-94a53fb02574 could not be found. Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ebdaba0f-4868-4286-95f6-1bedb7c2a081 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/3d4472ab-894c-45d3-8203-94a53fb02574/action HTTP/1.1 Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 18 Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: {"unshelve": null} Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 3d4472ab-894c-45d3-8203-94a53fb02574 could not be found. Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '3d4472ab-894c-45d3-8203-94a53fb02574', 'body': {'unshelve': None}} Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d4472ab-894c-45d3-8203-94a53fb02574 could not be found. Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d4472ab-894c-45d3-8203-94a53fb02574 could not be found. Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:28.022107 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:28.034873 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:28.034873 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:28.034873 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:28.034873 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:28.034873 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:28.034873 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:28.034873 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d4472ab-894c-45d3-8203-94a53fb02574 could not be found. Aug 29 15:51:28.034873 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:28.034873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ebdaba0f-4868-4286-95f6-1bedb7c2a081 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance 3d4472ab-894c-45d3-8203-94a53fb02574 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:28.034873 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ebdaba0f-4868-4286-95f6-1bedb7c2a081 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/3d4472ab-894c-45d3-8203-94a53fb02574/action" status: 404 len: 111 microversion: 2.1 time: 0.037249 Aug 29 15:51:28.034873 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2854/5884] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:27 2022] POST /compute/v2.1/servers/3d4472ab-894c-45d3-8203-94a53fb02574/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:28.043282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-74bad4a2-760a-4200-b56b-8dea179653ce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:28.043282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-74bad4a2-760a-4200-b56b-8dea179653ce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:28.054382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74bad4a2-760a-4200-b56b-8dea179653ce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.055263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74bad4a2-760a-4200-b56b-8dea179653ce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.055955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74bad4a2-760a-4200-b56b-8dea179653ce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.056953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74bad4a2-760a-4200-b56b-8dea179653ce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.057631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74bad4a2-760a-4200-b56b-8dea179653ce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.059320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-74bad4a2-760a-4200-b56b-8dea179653ce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.180464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2b9ba5ca-ffb1-484b-b37f-5498984a7dd5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:28.181429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2b9ba5ca-ffb1-484b-b37f-5498984a7dd5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:28.198517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b9ba5ca-ffb1-484b-b37f-5498984a7dd5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.199173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b9ba5ca-ffb1-484b-b37f-5498984a7dd5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.199701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b9ba5ca-ffb1-484b-b37f-5498984a7dd5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.200701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b9ba5ca-ffb1-484b-b37f-5498984a7dd5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.201282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b9ba5ca-ffb1-484b-b37f-5498984a7dd5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.201803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2b9ba5ca-ffb1-484b-b37f-5498984a7dd5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.580443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2b9ba5ca-ffb1-484b-b37f-5498984a7dd5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:28.600659 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2b9ba5ca-ffb1-484b-b37f-5498984a7dd5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1517 microversion: 2.1 time: 0.425357 Aug 29 15:51:28.613146 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2855/5885] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:28 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1517 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:28.696716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-74bad4a2-760a-4200-b56b-8dea179653ce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:28.710488 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-74bad4a2-760a-4200-b56b-8dea179653ce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.673641 Aug 29 15:51:28.712200 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3031/5886] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:28 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:28.736880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a38afc7d-f646-4640-ac80-1f47d205475c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:28.738442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a38afc7d-f646-4640-ac80-1f47d205475c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:28.757196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38afc7d-f646-4640-ac80-1f47d205475c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.758005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38afc7d-f646-4640-ac80-1f47d205475c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.758465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38afc7d-f646-4640-ac80-1f47d205475c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.760201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38afc7d-f646-4640-ac80-1f47d205475c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.760674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38afc7d-f646-4640-ac80-1f47d205475c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.761124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a38afc7d-f646-4640-ac80-1f47d205475c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.138671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-11e22ba1-54fc-49d5-b475-d6f8955ee6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:29.139885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-11e22ba1-54fc-49d5-b475-d6f8955ee6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:29.157371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11e22ba1-54fc-49d5-b475-d6f8955ee6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.159772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11e22ba1-54fc-49d5-b475-d6f8955ee6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.160826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11e22ba1-54fc-49d5-b475-d6f8955ee6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.163522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11e22ba1-54fc-49d5-b475-d6f8955ee6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.164645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11e22ba1-54fc-49d5-b475-d6f8955ee6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.165720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11e22ba1-54fc-49d5-b475-d6f8955ee6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.348847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-11e22ba1-54fc-49d5-b475-d6f8955ee6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lazy-loading 'services' on Instance uuid 646846a6-56c9-4370-8435-da5ae0466afb {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:29.472942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:29.483820 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-11e22ba1-54fc-49d5-b475-d6f8955ee6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments/7bb27947-74bd-4ae1-bd40-b98be696387c" status: 202 len: 0 microversion: 2.1 time: 0.350777 Aug 29 15:51:29.486209 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3032/5887] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 15:51:29 2022] DELETE /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments/7bb27947-74bd-4ae1-bd40-b98be696387c => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:51:29.495651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-6ead9da3-0482-4f9c-9953-253c50051bd1 req-8eebfe9a-6d55-4ea5-b8cb-a27f0e26e6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e0c4f14-7bec-433d-9654-6be9cf22b78e", "name": "network-vif-deleted", "tag": "e9b40f70-8b4b-4dbb-a0d7-8168a4792cce"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:29.527035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6ead9da3-0482-4f9c-9953-253c50051bd1 req-8eebfe9a-6d55-4ea5-b8cb-a27f0e26e6e0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.528951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6ead9da3-0482-4f9c-9953-253c50051bd1 req-8eebfe9a-6d55-4ea5-b8cb-a27f0e26e6e0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.529469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6ead9da3-0482-4f9c-9953-253c50051bd1 req-8eebfe9a-6d55-4ea5-b8cb-a27f0e26e6e0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.576445 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-6ead9da3-0482-4f9c-9953-253c50051bd1 req-8eebfe9a-6d55-4ea5-b8cb-a27f0e26e6e0 service nova] Creating event network-vif-deleted:e9b40f70-8b4b-4dbb-a0d7-8168a4792cce for instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e on n-h1-839401-11 Aug 29 15:51:29.601408 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-6ead9da3-0482-4f9c-9953-253c50051bd1 req-8eebfe9a-6d55-4ea5-b8cb-a27f0e26e6e0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111084 Aug 29 15:51:29.603111 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3033/5888] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:29.618332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6818bb51-3d33-419b-99a2-522d1838d0ac tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:29.623563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6818bb51-3d33-419b-99a2-522d1838d0ac tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:29.642445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6818bb51-3d33-419b-99a2-522d1838d0ac tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.643792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6818bb51-3d33-419b-99a2-522d1838d0ac tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.645449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6818bb51-3d33-419b-99a2-522d1838d0ac tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.648664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6818bb51-3d33-419b-99a2-522d1838d0ac tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.650830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6818bb51-3d33-419b-99a2-522d1838d0ac tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.652696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6818bb51-3d33-419b-99a2-522d1838d0ac tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.749771 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6818bb51-3d33-419b-99a2-522d1838d0ac tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144718 Aug 29 15:51:29.750612 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3034/5889] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:29 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:29.765668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2a0817bf-e941-4b60-a67a-5ce0bee381fb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:29.766939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2a0817bf-e941-4b60-a67a-5ce0bee381fb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:29.781011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a0817bf-e941-4b60-a67a-5ce0bee381fb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.781861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a0817bf-e941-4b60-a67a-5ce0bee381fb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.782630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a0817bf-e941-4b60-a67a-5ce0bee381fb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.783612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a0817bf-e941-4b60-a67a-5ce0bee381fb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.784288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a0817bf-e941-4b60-a67a-5ce0bee381fb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.784925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a0817bf-e941-4b60-a67a-5ce0bee381fb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.847641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a0817bf-e941-4b60-a67a-5ce0bee381fb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.848421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a0817bf-e941-4b60-a67a-5ce0bee381fb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.849255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a0817bf-e941-4b60-a67a-5ce0bee381fb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.849881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-2a0817bf-e941-4b60-a67a-5ce0bee381fb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lazy-loading 'fault' on Instance uuid 3e0c4f14-7bec-433d-9654-6be9cf22b78e {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:30.000164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2a0817bf-e941-4b60-a67a-5ce0bee381fb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:30.010772 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2a0817bf-e941-4b60-a67a-5ce0bee381fb tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 200 len: 1320 microversion: 2.1 time: 0.258882 Aug 29 15:51:30.011994 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3035/5890] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:29 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 1320 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:30.352112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a38afc7d-f646-4640-ac80-1f47d205475c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:30.360948 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a38afc7d-f646-4640-ac80-1f47d205475c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 1.629517 Aug 29 15:51:30.365464 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2856/5891] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:28 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:30.396273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ee8b5c2b-fe75-4a98-9468-11cae7252a9a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:30.397304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ee8b5c2b-fe75-4a98-9468-11cae7252a9a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:30.418332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee8b5c2b-fe75-4a98-9468-11cae7252a9a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.418838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee8b5c2b-fe75-4a98-9468-11cae7252a9a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.419284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee8b5c2b-fe75-4a98-9468-11cae7252a9a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.420022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee8b5c2b-fe75-4a98-9468-11cae7252a9a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.420492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee8b5c2b-fe75-4a98-9468-11cae7252a9a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.420924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee8b5c2b-fe75-4a98-9468-11cae7252a9a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.763874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-12cdf027-4287-42c7-b382-8fb16422f1b1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:30.769215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-12cdf027-4287-42c7-b382-8fb16422f1b1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:30.771294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:30.790687 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-ee8b5c2b-fe75-4a98-9468-11cae7252a9a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Cannot 'unshelve' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ee8b5c2b-fe75-4a98-9468-11cae7252a9a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action HTTP/1.1 Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 18 Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: {"unshelve": null} Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: exception: Cannot 'unshelve' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b0fd8c4a-7225-496b-a071-6fd8f37dc60a', 'body': {'unshelve': None}} Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a in vm_state active. Cannot unshelve while the instance is in this state. Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:51:30.794633 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:51:30.800975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active Aug 29 15:51:30.800975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.800975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:30.800975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.800975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:30.800975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:30.800975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:30.800975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:30.800975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:30.800975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active Aug 29 15:51:30.800975 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.801923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12cdf027-4287-42c7-b382-8fb16422f1b1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.801923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12cdf027-4287-42c7-b382-8fb16422f1b1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.801923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12cdf027-4287-42c7-b382-8fb16422f1b1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.805076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ee8b5c2b-fe75-4a98-9468-11cae7252a9a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 409 to user: Cannot 'unshelve' instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a while it is in vm_state active {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:30.805576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12cdf027-4287-42c7-b382-8fb16422f1b1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.806898 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ee8b5c2b-fe75-4a98-9468-11cae7252a9a tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action" status: 409 len: 146 microversion: 2.1 time: 0.424288 Aug 29 15:51:30.808227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12cdf027-4287-42c7-b382-8fb16422f1b1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.808917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-12cdf027-4287-42c7-b382-8fb16422f1b1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.813512 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3036/5892] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:30 2022] POST /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a/action => generated 146 bytes in 431 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:51:30.820571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5193fc88-c0ff-4318-8527-a1d5f9112f04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:30.821606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5193fc88-c0ff-4318-8527-a1d5f9112f04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:30.839756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5193fc88-c0ff-4318-8527-a1d5f9112f04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.847779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5193fc88-c0ff-4318-8527-a1d5f9112f04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.848620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5193fc88-c0ff-4318-8527-a1d5f9112f04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.849951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5193fc88-c0ff-4318-8527-a1d5f9112f04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.850600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5193fc88-c0ff-4318-8527-a1d5f9112f04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.851192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5193fc88-c0ff-4318-8527-a1d5f9112f04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.921733 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-12cdf027-4287-42c7-b382-8fb16422f1b1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162939 Aug 29 15:51:30.924269 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2857/5893] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:30 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:31.038148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2cf2d559-1596-4d68-8b30-d2df5f180b37 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:31.040698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2cf2d559-1596-4d68-8b30-d2df5f180b37 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:31.056612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cf2d559-1596-4d68-8b30-d2df5f180b37 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.058030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cf2d559-1596-4d68-8b30-d2df5f180b37 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.058887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cf2d559-1596-4d68-8b30-d2df5f180b37 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.060155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cf2d559-1596-4d68-8b30-d2df5f180b37 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.067744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cf2d559-1596-4d68-8b30-d2df5f180b37 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.068639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cf2d559-1596-4d68-8b30-d2df5f180b37 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.133819 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-2cf2d559-1596-4d68-8b30-d2df5f180b37 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2cf2d559-1596-4d68-8b30-d2df5f180b37 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e HTTP/1.1 Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '3e0c4f14-7bec-433d-9654-6be9cf22b78e'} Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:31.143604 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:31.148699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:31.148699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:31.148699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:31.148699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:31.148699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. Aug 29 15:51:31.148699 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:31.148699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2cf2d559-1596-4d68-8b30-d2df5f180b37 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:31.149381 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2cf2d559-1596-4d68-8b30-d2df5f180b37 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 404 len: 111 microversion: 2.1 time: 0.119366 Aug 29 15:51:31.151415 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2858/5894] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:31 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:31.386882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1706616508", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "e7e1a9e7-4d7f-4958-9bd4-e4039baa5a12"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:31.494730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] validate_networks() for [('e7e1a9e7-4d7f-4958-9bd4-e4039baa5a12', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:51:31.563189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5193fc88-c0ff-4318-8527-a1d5f9112f04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:31.576242 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5193fc88-c0ff-4318-8527-a1d5f9112f04 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.761506 Aug 29 15:51:31.579027 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3037/5895] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:30 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:31.622726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-485f0183-437a-4638-a5fe-a862f3587231 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:31.623835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-485f0183-437a-4638-a5fe-a862f3587231 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:31.644718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-485f0183-437a-4638-a5fe-a862f3587231 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.646297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-485f0183-437a-4638-a5fe-a862f3587231 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.648097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-485f0183-437a-4638-a5fe-a862f3587231 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.649940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-485f0183-437a-4638-a5fe-a862f3587231 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.650984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-485f0183-437a-4638-a5fe-a862f3587231 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.654037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-485f0183-437a-4638-a5fe-a862f3587231 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:32.012123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-485f0183-437a-4638-a5fe-a862f3587231 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:32.023386 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-485f0183-437a-4638-a5fe-a862f3587231 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.408552 Aug 29 15:51:32.023974 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3038/5896] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:31 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:32.039193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1faa4570-ecc0-40e2-9aa3-47be616c2432 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:32.047599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1faa4570-ecc0-40e2-9aa3-47be616c2432 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:32.062512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1faa4570-ecc0-40e2-9aa3-47be616c2432 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:32.063703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1faa4570-ecc0-40e2-9aa3-47be616c2432 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:32.092321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1faa4570-ecc0-40e2-9aa3-47be616c2432 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:32.094982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1faa4570-ecc0-40e2-9aa3-47be616c2432 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:32.095522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1faa4570-ecc0-40e2-9aa3-47be616c2432 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:32.099340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1faa4570-ecc0-40e2-9aa3-47be616c2432 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:32.198481 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1faa4570-ecc0-40e2-9aa3-47be616c2432 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164970 Aug 29 15:51:32.203347 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3039/5897] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:32 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:32.214884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9415cb2f-a0fe-4132-b4e2-6b08f53bf1ce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-64617600_updated"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:32.229928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9415cb2f-a0fe-4132-b4e2-6b08f53bf1ce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: 30a42182-c94b-4b6d-8e6e-b46408983934] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:32.245864 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-9415cb2f-a0fe-4132-b4e2-6b08f53bf1ce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance 30a42182-c94b-4b6d-8e6e-b46408983934 could not be found. Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9415cb2f-a0fe-4132-b4e2-6b08f53bf1ce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: request: PUT /compute/v2.1/servers/30a42182-c94b-4b6d-8e6e-b46408983934 HTTP/1.1 Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 79 Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-64617600_updated"}} Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 30a42182-c94b-4b6d-8e6e-b46408983934 could not be found. Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '30a42182-c94b-4b6d-8e6e-b46408983934', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-64617600_updated'}}} Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30a42182-c94b-4b6d-8e6e-b46408983934 could not be found. Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 29 15:51:32.253418 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:32.259080 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:32.259080 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:32.259080 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:32.259080 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30a42182-c94b-4b6d-8e6e-b46408983934 could not be found. Aug 29 15:51:32.259080 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:32.259080 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:32.259080 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:32.259080 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:32.259080 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:32.259080 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:32.259080 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:32.259080 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:32.259080 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30a42182-c94b-4b6d-8e6e-b46408983934 could not be found. Aug 29 15:51:32.259080 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:32.264323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9415cb2f-a0fe-4132-b4e2-6b08f53bf1ce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance 30a42182-c94b-4b6d-8e6e-b46408983934 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:32.265327 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9415cb2f-a0fe-4132-b4e2-6b08f53bf1ce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "PUT /compute/v2.1/servers/30a42182-c94b-4b6d-8e6e-b46408983934" status: 404 len: 111 microversion: 2.1 time: 0.060627 Aug 29 15:51:32.269985 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3040/5898] 10.222.0.62 () {60 vars in 1256 bytes} [Mon Aug 29 15:51:32 2022] PUT /compute/v2.1/servers/30a42182-c94b-4b6d-8e6e-b46408983934 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:32.284761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-82a05438-5eb6-4b37-b39b-69909c2df97e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba7be703-b9c8-49f1-a7a7-01792c699cf4"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:32.293362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-82a05438-5eb6-4b37-b39b-69909c2df97e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:32.313921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82a05438-5eb6-4b37-b39b-69909c2df97e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:32.314470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82a05438-5eb6-4b37-b39b-69909c2df97e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:32.318082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82a05438-5eb6-4b37-b39b-69909c2df97e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:32.321795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82a05438-5eb6-4b37-b39b-69909c2df97e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:32.322825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82a05438-5eb6-4b37-b39b-69909c2df97e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:32.323855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82a05438-5eb6-4b37-b39b-69909c2df97e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:32.955970 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-82a05438-5eb6-4b37-b39b-69909c2df97e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.684607 Aug 29 15:51:32.956612 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3041/5899] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 15:51:32 2022] POST /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments => generated 194 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:32.971196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-307d0a94-0a15-40a8-970c-9346aa93ec3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:32.971921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-307d0a94-0a15-40a8-970c-9346aa93ec3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:33.015394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-307d0a94-0a15-40a8-970c-9346aa93ec3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:33.017129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-307d0a94-0a15-40a8-970c-9346aa93ec3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:33.017913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-307d0a94-0a15-40a8-970c-9346aa93ec3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:33.018900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-307d0a94-0a15-40a8-970c-9346aa93ec3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:33.022402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-307d0a94-0a15-40a8-970c-9346aa93ec3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:33.023160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-307d0a94-0a15-40a8-970c-9346aa93ec3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:33.286634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-307d0a94-0a15-40a8-970c-9346aa93ec3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:33.304927 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-307d0a94-0a15-40a8-970c-9346aa93ec3b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.333391 Aug 29 15:51:33.324597 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3042/5900] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:32 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:33.334916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ccd44773-134d-446c-9705-173286496fb3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:33.339149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ccd44773-134d-446c-9705-173286496fb3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:33.372618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccd44773-134d-446c-9705-173286496fb3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:33.378522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccd44773-134d-446c-9705-173286496fb3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:33.379219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccd44773-134d-446c-9705-173286496fb3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:33.382743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccd44773-134d-446c-9705-173286496fb3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:33.383449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccd44773-134d-446c-9705-173286496fb3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:33.384790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ccd44773-134d-446c-9705-173286496fb3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:33.515941 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ccd44773-134d-446c-9705-173286496fb3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204622 Aug 29 15:51:33.528178 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3043/5901] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:33 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:33.539133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1760ac9c-ffca-4740-b150-2eb765a6925f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:33.539753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1760ac9c-ffca-4740-b150-2eb765a6925f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:33.554026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1760ac9c-ffca-4740-b150-2eb765a6925f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:33.561331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1760ac9c-ffca-4740-b150-2eb765a6925f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:33.567514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1760ac9c-ffca-4740-b150-2eb765a6925f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:33.568303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1760ac9c-ffca-4740-b150-2eb765a6925f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:33.568788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1760ac9c-ffca-4740-b150-2eb765a6925f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:33.569294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1760ac9c-ffca-4740-b150-2eb765a6925f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.218715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1760ac9c-ffca-4740-b150-2eb765a6925f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:34.229276 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1760ac9c-ffca-4740-b150-2eb765a6925f tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.699575 Aug 29 15:51:34.236947 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3044/5902] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:33 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:34.260930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cc30b92d-60de-4d17-abcc-8df0e3c4a049 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cc30b92d-60de-4d17-abcc-8df0e3c4a049 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: request: PUT /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a HTTP/1.1 Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 280 Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b0fd8c4a-7225-496b-a071-6fd8f37dc60a', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:34.271897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:51:34.276412 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:34.280034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cc30b92d-60de-4d17-abcc-8df0e3c4a049 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:34.282351 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cc30b92d-60de-4d17-abcc-8df0e3c4a049 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "PUT /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 400 len: 619 microversion: 2.1 time: 0.028259 Aug 29 15:51:34.285712 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3045/5903] 10.222.0.62 () {60 vars in 1257 bytes} [Mon Aug 29 15:51:34 2022] PUT /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 619 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:51:34.302946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6c80350f-1605-400f-87fd-19f89954dfdf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:34.305044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6c80350f-1605-400f-87fd-19f89954dfdf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:34.322868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c80350f-1605-400f-87fd-19f89954dfdf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.324140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c80350f-1605-400f-87fd-19f89954dfdf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.326203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c80350f-1605-400f-87fd-19f89954dfdf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.327295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c80350f-1605-400f-87fd-19f89954dfdf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.328754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c80350f-1605-400f-87fd-19f89954dfdf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.331421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c80350f-1605-400f-87fd-19f89954dfdf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.558550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:51:34.559220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:51:34.559781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:51:34.560214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:51:34.560612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:51:34.606094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.606706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.607168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.614772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.618385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.619226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.675594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6c80350f-1605-400f-87fd-19f89954dfdf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:34.687277 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6c80350f-1605-400f-87fd-19f89954dfdf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.397990 Aug 29 15:51:34.692215 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3046/5904] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:34 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:34.700213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3795c0f1-33c5-4d68-aaeb-dfcea4a0951b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:34.703218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:51:34.707355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3795c0f1-33c5-4d68-aaeb-dfcea4a0951b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:34.713392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Getting quotas for user db3e87dfe49444f886b7a9ac5d22bda1 and project bbf584fd54ef4927a152fbbe03568cf6. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:51:34.723451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3795c0f1-33c5-4d68-aaeb-dfcea4a0951b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.727278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3795c0f1-33c5-4d68-aaeb-dfcea4a0951b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.727729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3795c0f1-33c5-4d68-aaeb-dfcea4a0951b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.730142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3795c0f1-33c5-4d68-aaeb-dfcea4a0951b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.730645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3795c0f1-33c5-4d68-aaeb-dfcea4a0951b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.731084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3795c0f1-33c5-4d68-aaeb-dfcea4a0951b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.766212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:51:34.769807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:51:34.826309 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3795c0f1-33c5-4d68-aaeb-dfcea4a0951b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132505 Aug 29 15:51:34.842238 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3047/5905] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:34 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:34.847999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-09696188-7e50-40c3-803f-f74c3f568bb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:34.854394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-09696188-7e50-40c3-803f-f74c3f568bb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:34.864471 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7a67b5f8-c514-42bc-9272-661e9134e1d0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.482221 Aug 29 15:51:34.868542 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2859/5906] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:51:34.880048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-02592706-97e5-47c5-9e3b-4d0b2316af61 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:34.882184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-02592706-97e5-47c5-9e3b-4d0b2316af61 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:34.905134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09696188-7e50-40c3-803f-f74c3f568bb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.909349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09696188-7e50-40c3-803f-f74c3f568bb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.909952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09696188-7e50-40c3-803f-f74c3f568bb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.910713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09696188-7e50-40c3-803f-f74c3f568bb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.911192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09696188-7e50-40c3-803f-f74c3f568bb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.911652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09696188-7e50-40c3-803f-f74c3f568bb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.168155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-02592706-97e5-47c5-9e3b-4d0b2316af61 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:35.178581 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-02592706-97e5-47c5-9e3b-4d0b2316af61 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1209 microversion: 2.1 time: 0.303213 Aug 29 15:51:35.194401 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2860/5907] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:34 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1209 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:35.409254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-09696188-7e50-40c3-803f-f74c3f568bb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:35.422300 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-09696188-7e50-40c3-803f-f74c3f568bb8 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.578493 Aug 29 15:51:35.425334 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3048/5908] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:34 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:35.442772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-46de1742-03cb-474b-8b67-80b6515f2a5c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-46de1742-03cb-474b-8b67-80b6515f2a5c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: request: PUT /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a HTTP/1.1 Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 24 Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: {"server": {"name": ""}} Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'b0fd8c4a-7225-496b-a071-6fd8f37dc60a', 'body': {'server': {'name': ''}}} Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi '' Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:51:35.447168 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:51:35.456169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:51:35.456169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:35.456169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:35.456169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:35.456169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:35.456169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:35.456169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:35.456169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:51:35.456169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:51:35.456169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:51:35.456169 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:35.456169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-46de1742-03cb-474b-8b67-80b6515f2a5c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:35.456169 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-46de1742-03cb-474b-8b67-80b6515f2a5c tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "PUT /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 400 len: 108 microversion: 2.1 time: 0.010238 Aug 29 15:51:35.456169 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2861/5909] 10.222.0.62 () {60 vars in 1256 bytes} [Mon Aug 29 15:51:35 2022] PUT /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:51:35.460286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-db03de5f-0f8e-42f1-be36-b27d471be787 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:35.460286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-db03de5f-0f8e-42f1-be36-b27d471be787 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:35.468024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db03de5f-0f8e-42f1-be36-b27d471be787 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.468530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db03de5f-0f8e-42f1-be36-b27d471be787 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.508414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db03de5f-0f8e-42f1-be36-b27d471be787 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.513041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db03de5f-0f8e-42f1-be36-b27d471be787 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.513904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db03de5f-0f8e-42f1-be36-b27d471be787 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.514666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db03de5f-0f8e-42f1-be36-b27d471be787 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.821940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-db03de5f-0f8e-42f1-be36-b27d471be787 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:35.840258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-78fe2da6-8967-4043-ad0c-4df81cf10e39 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:35.844028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-78fe2da6-8967-4043-ad0c-4df81cf10e39 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:35.855113 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-db03de5f-0f8e-42f1-be36-b27d471be787 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1505 microversion: 2.1 time: 0.401141 Aug 29 15:51:35.857860 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3049/5910] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:35 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1505 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:35.873278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78fe2da6-8967-4043-ad0c-4df81cf10e39 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.873278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78fe2da6-8967-4043-ad0c-4df81cf10e39 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.879668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78fe2da6-8967-4043-ad0c-4df81cf10e39 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.881161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78fe2da6-8967-4043-ad0c-4df81cf10e39 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.882799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78fe2da6-8967-4043-ad0c-4df81cf10e39 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.884573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78fe2da6-8967-4043-ad0c-4df81cf10e39 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.998228 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-78fe2da6-8967-4043-ad0c-4df81cf10e39 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164144 Aug 29 15:51:36.004469 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2862/5911] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:35 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:36.209368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-313181fc-c57f-4338-8f12-493f9851735a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:36.210018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-313181fc-c57f-4338-8f12-493f9851735a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:36.243246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-313181fc-c57f-4338-8f12-493f9851735a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.244902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-313181fc-c57f-4338-8f12-493f9851735a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.248240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-313181fc-c57f-4338-8f12-493f9851735a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:36.252949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-313181fc-c57f-4338-8f12-493f9851735a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.257734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-313181fc-c57f-4338-8f12-493f9851735a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.260553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-313181fc-c57f-4338-8f12-493f9851735a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:36.434189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-313181fc-c57f-4338-8f12-493f9851735a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:36.438551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:36.454969 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-313181fc-c57f-4338-8f12-493f9851735a tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1205 microversion: 2.1 time: 0.246831 Aug 29 15:51:36.455651 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3050/5912] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:36 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1205 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:36.893932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-178631282", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "364d95a2-a7a2-4f21-a305-249b85359533"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1193571999", "security_groups": [{"name": "tempest-secgroup-smoke-634155282"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:37.016941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-111ecb0d-b745-4f43-a79b-f39aa04a14d8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:37.022247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-111ecb0d-b745-4f43-a79b-f39aa04a14d8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:37.061728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] validate_networks() for [('364d95a2-a7a2-4f21-a305-249b85359533', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:51:37.074256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-111ecb0d-b745-4f43-a79b-f39aa04a14d8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:37.077192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-111ecb0d-b745-4f43-a79b-f39aa04a14d8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:37.077650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-111ecb0d-b745-4f43-a79b-f39aa04a14d8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.084479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-111ecb0d-b745-4f43-a79b-f39aa04a14d8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:37.084975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-111ecb0d-b745-4f43-a79b-f39aa04a14d8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:37.085452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-111ecb0d-b745-4f43-a79b-f39aa04a14d8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.257872 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-111ecb0d-b745-4f43-a79b-f39aa04a14d8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.243004 Aug 29 15:51:37.262977 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3051/5913] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:37 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:37.484198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-563e60c0-cdf7-43ea-a854-87419eb7c73f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:37.484840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-563e60c0-cdf7-43ea-a854-87419eb7c73f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:37.501230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-563e60c0-cdf7-43ea-a854-87419eb7c73f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:37.501809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-563e60c0-cdf7-43ea-a854-87419eb7c73f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:37.502259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-563e60c0-cdf7-43ea-a854-87419eb7c73f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.502991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-563e60c0-cdf7-43ea-a854-87419eb7c73f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:37.503446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-563e60c0-cdf7-43ea-a854-87419eb7c73f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:37.513345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-563e60c0-cdf7-43ea-a854-87419eb7c73f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.672895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-563e60c0-cdf7-43ea-a854-87419eb7c73f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:37.682873 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-563e60c0-cdf7-43ea-a854-87419eb7c73f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1267 microversion: 2.1 time: 0.208074 Aug 29 15:51:37.695073 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3052/5914] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:37 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:38.036504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:51:38.037572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:51:38.038241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:51:38.038819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:51:38.039394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:51:38.053496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:38.056321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:38.056991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:38.059333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:38.063112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:38.063785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:38.112569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Getting quotas for project 63c8e858d9064ae3875d91e8a43f7ee4. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:51:38.118600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Getting quotas for user 008972030ade418cb180f0702ae168b4 and project 63c8e858d9064ae3875d91e8a43f7ee4. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:51:38.136226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:51:38.139007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:51:38.221054 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3f39ddd7-18a9-4369-9c32-aa78cef59d28 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.329936 Aug 29 15:51:38.223782 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2863/5915] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:51:38.235062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8c9971f5-b022-4f07-a43d-7d49be4f1960 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:38.236379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8c9971f5-b022-4f07-a43d-7d49be4f1960 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:38.276453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-73d4c870-bb52-47ac-8f8e-d7a093870a5d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:38.279397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-73d4c870-bb52-47ac-8f8e-d7a093870a5d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:38.314305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73d4c870-bb52-47ac-8f8e-d7a093870a5d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:38.315520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73d4c870-bb52-47ac-8f8e-d7a093870a5d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:38.330756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73d4c870-bb52-47ac-8f8e-d7a093870a5d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:38.335950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73d4c870-bb52-47ac-8f8e-d7a093870a5d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:38.336319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73d4c870-bb52-47ac-8f8e-d7a093870a5d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:38.336761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73d4c870-bb52-47ac-8f8e-d7a093870a5d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:38.385396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8c9971f5-b022-4f07-a43d-7d49be4f1960 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:38.396793 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8c9971f5-b022-4f07-a43d-7d49be4f1960 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1266 microversion: 2.1 time: 0.167131 Aug 29 15:51:38.400196 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3053/5916] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:38 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:38.440338 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-73d4c870-bb52-47ac-8f8e-d7a093870a5d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169546 Aug 29 15:51:38.442208 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2864/5917] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:38 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:38.718295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eb933fa5-74ea-45ef-865d-cc0efc187b75 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:38.719646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eb933fa5-74ea-45ef-865d-cc0efc187b75 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:38.735728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb933fa5-74ea-45ef-865d-cc0efc187b75 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:38.736731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb933fa5-74ea-45ef-865d-cc0efc187b75 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:38.738571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb933fa5-74ea-45ef-865d-cc0efc187b75 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:38.739582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb933fa5-74ea-45ef-865d-cc0efc187b75 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:38.741623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb933fa5-74ea-45ef-865d-cc0efc187b75 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:38.742313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb933fa5-74ea-45ef-865d-cc0efc187b75 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.422269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-36e67690-7bf4-43ec-9276-4d68edd9a76b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:39.423835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-36e67690-7bf4-43ec-9276-4d68edd9a76b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:39.436848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e67690-7bf4-43ec-9276-4d68edd9a76b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:39.439259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e67690-7bf4-43ec-9276-4d68edd9a76b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:39.441643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e67690-7bf4-43ec-9276-4d68edd9a76b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.442806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e67690-7bf4-43ec-9276-4d68edd9a76b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:39.444049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e67690-7bf4-43ec-9276-4d68edd9a76b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:39.444688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e67690-7bf4-43ec-9276-4d68edd9a76b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.523145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eb933fa5-74ea-45ef-865d-cc0efc187b75 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:39.538569 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eb933fa5-74ea-45ef-865d-cc0efc187b75 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1309 microversion: 2.1 time: 0.822613 Aug 29 15:51:39.540042 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3054/5918] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:38 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1309 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:39.568684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a2ebadbb-7c89-401e-8982-6d7e91e87292 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:39.581135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a2ebadbb-7c89-401e-8982-6d7e91e87292 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:39.602833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2ebadbb-7c89-401e-8982-6d7e91e87292 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:39.603433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2ebadbb-7c89-401e-8982-6d7e91e87292 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:39.605297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2ebadbb-7c89-401e-8982-6d7e91e87292 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.608018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2ebadbb-7c89-401e-8982-6d7e91e87292 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:39.612180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2ebadbb-7c89-401e-8982-6d7e91e87292 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:39.614005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2ebadbb-7c89-401e-8982-6d7e91e87292 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.732538 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a2ebadbb-7c89-401e-8982-6d7e91e87292 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.186455 Aug 29 15:51:39.735462 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3055/5919] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:51:39 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb/os-volume_attachments => generated 25 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:51:39.818435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e23488a2-56df-4309-b413-5d0f08d55372 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:39.819636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e23488a2-56df-4309-b413-5d0f08d55372 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:39.829596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23488a2-56df-4309-b413-5d0f08d55372 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:39.830424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23488a2-56df-4309-b413-5d0f08d55372 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:39.903058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36e67690-7bf4-43ec-9276-4d68edd9a76b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:39.915269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23488a2-56df-4309-b413-5d0f08d55372 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.916481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23488a2-56df-4309-b413-5d0f08d55372 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:39.923305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23488a2-56df-4309-b413-5d0f08d55372 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:39.927976 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-36e67690-7bf4-43ec-9276-4d68edd9a76b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1270 microversion: 2.1 time: 0.501834 Aug 29 15:51:39.928958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23488a2-56df-4309-b413-5d0f08d55372 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.932190 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2865/5920] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:39 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1270 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:39.994623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e23488a2-56df-4309-b413-5d0f08d55372 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:51:40.187086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:40.192865 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e23488a2-56df-4309-b413-5d0f08d55372 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 204 len: 0 microversion: 2.1 time: 0.382704 Aug 29 15:51:40.204050 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3056/5921] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:51:39 2022] DELETE /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:51:40.213236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0b887cef-eff8-4908-88ac-bac65d0c2344 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:40.213739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0b887cef-eff8-4908-88ac-bac65d0c2344 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:40.242061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b887cef-eff8-4908-88ac-bac65d0c2344 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:40.245673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b887cef-eff8-4908-88ac-bac65d0c2344 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:40.260101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b887cef-eff8-4908-88ac-bac65d0c2344 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:40.263937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b887cef-eff8-4908-88ac-bac65d0c2344 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:40.264470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b887cef-eff8-4908-88ac-bac65d0c2344 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:40.264924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b887cef-eff8-4908-88ac-bac65d0c2344 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:40.561715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6ee659e1-b714-4f1b-85d4-d85abfe77298 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:40.563625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6ee659e1-b714-4f1b-85d4-d85abfe77298 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:40.601376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ee659e1-b714-4f1b-85d4-d85abfe77298 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:40.601890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ee659e1-b714-4f1b-85d4-d85abfe77298 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:40.603841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ee659e1-b714-4f1b-85d4-d85abfe77298 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:40.605111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ee659e1-b714-4f1b-85d4-d85abfe77298 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:40.606365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ee659e1-b714-4f1b-85d4-d85abfe77298 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:40.608659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ee659e1-b714-4f1b-85d4-d85abfe77298 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.016877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0b887cef-eff8-4908-88ac-bac65d0c2344 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:41.039177 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0b887cef-eff8-4908-88ac-bac65d0c2344 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1679 microversion: 2.1 time: 0.833079 Aug 29 15:51:41.039960 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2866/5922] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:40 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1679 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:41.063433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aa134bcb-7f32-4157-9ce6-fb8a441f6cde tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:41.064065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aa134bcb-7f32-4157-9ce6-fb8a441f6cde tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:41.085355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa134bcb-7f32-4157-9ce6-fb8a441f6cde tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.085870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa134bcb-7f32-4157-9ce6-fb8a441f6cde tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.086318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa134bcb-7f32-4157-9ce6-fb8a441f6cde tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.087059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa134bcb-7f32-4157-9ce6-fb8a441f6cde tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.087526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa134bcb-7f32-4157-9ce6-fb8a441f6cde tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.087962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa134bcb-7f32-4157-9ce6-fb8a441f6cde tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.194801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6ee659e1-b714-4f1b-85d4-d85abfe77298 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:41.208602 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6ee659e1-b714-4f1b-85d4-d85abfe77298 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1309 microversion: 2.1 time: 0.651704 Aug 29 15:51:41.210213 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3057/5923] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:40 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1309 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:41.275033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aa134bcb-7f32-4157-9ce6-fb8a441f6cde tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:41.286749 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aa134bcb-7f32-4157-9ce6-fb8a441f6cde tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1336 microversion: 2.1 time: 0.237839 Aug 29 15:51:41.288635 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2867/5924] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:41 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1336 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:41.412017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-163a1fa7-b3e7-46d7-903d-cfc6dfb34b15 req-9b72661d-4d9c-4935-aac3-1d70650a3523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7354e9a0-2795-4a98-a91d-6669a3b353f0", "tag": "61b03ce4-5865-4462-8365-bbc3595caa3d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:41.440069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-163a1fa7-b3e7-46d7-903d-cfc6dfb34b15 req-9b72661d-4d9c-4935-aac3-1d70650a3523 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.457423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-163a1fa7-b3e7-46d7-903d-cfc6dfb34b15 req-9b72661d-4d9c-4935-aac3-1d70650a3523 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.458204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-163a1fa7-b3e7-46d7-903d-cfc6dfb34b15 req-9b72661d-4d9c-4935-aac3-1d70650a3523 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.512355 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-163a1fa7-b3e7-46d7-903d-cfc6dfb34b15 req-9b72661d-4d9c-4935-aac3-1d70650a3523 service nova] Creating event network-changed:61b03ce4-5865-4462-8365-bbc3595caa3d for instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 on n-h1-839401-11 Aug 29 15:51:41.525532 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-163a1fa7-b3e7-46d7-903d-cfc6dfb34b15 req-9b72661d-4d9c-4935-aac3-1d70650a3523 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121004 Aug 29 15:51:41.534146 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3058/5925] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:42.059803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b0ad073-72e0-4e96-81e7-0890668423ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:42.060416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4b0ad073-72e0-4e96-81e7-0890668423ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:42.074318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b0ad073-72e0-4e96-81e7-0890668423ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.074829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b0ad073-72e0-4e96-81e7-0890668423ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.075455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b0ad073-72e0-4e96-81e7-0890668423ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:42.076385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b0ad073-72e0-4e96-81e7-0890668423ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.077257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b0ad073-72e0-4e96-81e7-0890668423ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.077886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b0ad073-72e0-4e96-81e7-0890668423ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:42.233398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c0222b72-f311-4392-8545-0920bc452890 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:42.234107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c0222b72-f311-4392-8545-0920bc452890 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:42.252460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0222b72-f311-4392-8545-0920bc452890 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.252966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0222b72-f311-4392-8545-0920bc452890 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.253438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0222b72-f311-4392-8545-0920bc452890 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:42.256156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0222b72-f311-4392-8545-0920bc452890 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.256884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0222b72-f311-4392-8545-0920bc452890 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.261295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0222b72-f311-4392-8545-0920bc452890 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:42.513938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4b0ad073-72e0-4e96-81e7-0890668423ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:42.526289 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4b0ad073-72e0-4e96-81e7-0890668423ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1679 microversion: 2.1 time: 0.469994 Aug 29 15:51:42.527140 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2868/5926] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:42 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1679 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:42.544047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c078d384-0906-444b-ba81-4bfcf3a51965 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:42.544990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c078d384-0906-444b-ba81-4bfcf3a51965 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:42.555826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c078d384-0906-444b-ba81-4bfcf3a51965 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.556878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c078d384-0906-444b-ba81-4bfcf3a51965 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.558731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c078d384-0906-444b-ba81-4bfcf3a51965 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:42.560170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c078d384-0906-444b-ba81-4bfcf3a51965 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.561949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c078d384-0906-444b-ba81-4bfcf3a51965 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.564945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c078d384-0906-444b-ba81-4bfcf3a51965 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:42.620668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:42.774536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c0222b72-f311-4392-8545-0920bc452890 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:42.801574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c078d384-0906-444b-ba81-4bfcf3a51965 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:42.807997 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c0222b72-f311-4392-8545-0920bc452890 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1309 microversion: 2.1 time: 0.566681 Aug 29 15:51:42.822629 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c078d384-0906-444b-ba81-4bfcf3a51965 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1324 microversion: 2.1 time: 0.281769 Aug 29 15:51:42.822839 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3059/5927] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:42 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1309 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:42.829310 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2869/5928] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:42 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1324 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:43.547877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a1c603cf-a693-47d5-988e-25d9c208e9bb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:43.549202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a1c603cf-a693-47d5-988e-25d9c208e9bb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:43.558514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1c603cf-a693-47d5-988e-25d9c208e9bb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:43.559496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1c603cf-a693-47d5-988e-25d9c208e9bb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:43.563741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1c603cf-a693-47d5-988e-25d9c208e9bb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:43.567314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1c603cf-a693-47d5-988e-25d9c208e9bb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:43.569558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1c603cf-a693-47d5-988e-25d9c208e9bb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:43.570174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1c603cf-a693-47d5-988e-25d9c208e9bb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:43.829674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e0ac6cf1-11c0-4d78-8be6-b4108b99ae6e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:43.831379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e0ac6cf1-11c0-4d78-8be6-b4108b99ae6e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:43.843653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0ac6cf1-11c0-4d78-8be6-b4108b99ae6e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:43.844476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0ac6cf1-11c0-4d78-8be6-b4108b99ae6e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:43.846962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0ac6cf1-11c0-4d78-8be6-b4108b99ae6e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:43.849519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0ac6cf1-11c0-4d78-8be6-b4108b99ae6e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:43.850251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0ac6cf1-11c0-4d78-8be6-b4108b99ae6e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:43.851748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0ac6cf1-11c0-4d78-8be6-b4108b99ae6e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.285912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a1c603cf-a693-47d5-988e-25d9c208e9bb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:44.296500 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a1c603cf-a693-47d5-988e-25d9c208e9bb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1679 microversion: 2.1 time: 0.752557 Aug 29 15:51:44.317955 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3060/5929] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:43 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1679 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:44.338178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-772d938f-b630-4854-b7ca-80797bc4d0f5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:44.339008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-772d938f-b630-4854-b7ca-80797bc4d0f5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:44.370962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-772d938f-b630-4854-b7ca-80797bc4d0f5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.371457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-772d938f-b630-4854-b7ca-80797bc4d0f5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.373861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-772d938f-b630-4854-b7ca-80797bc4d0f5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.374631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-772d938f-b630-4854-b7ca-80797bc4d0f5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.375095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-772d938f-b630-4854-b7ca-80797bc4d0f5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.385646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-772d938f-b630-4854-b7ca-80797bc4d0f5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.651053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e0ac6cf1-11c0-4d78-8be6-b4108b99ae6e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:44.667346 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e0ac6cf1-11c0-4d78-8be6-b4108b99ae6e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1309 microversion: 2.1 time: 0.840103 Aug 29 15:51:44.670634 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2870/5930] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:43 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1309 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:44.927259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-772d938f-b630-4854-b7ca-80797bc4d0f5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:44.936687 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-772d938f-b630-4854-b7ca-80797bc4d0f5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1391 microversion: 2.1 time: 0.615960 Aug 29 15:51:44.946944 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3061/5931] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:44 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1391 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:45.320538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ba06c08a-ca45-4741-98a8-bd3a6139eb4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:45.321930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ba06c08a-ca45-4741-98a8-bd3a6139eb4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:45.335170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba06c08a-ca45-4741-98a8-bd3a6139eb4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.338279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba06c08a-ca45-4741-98a8-bd3a6139eb4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.340977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba06c08a-ca45-4741-98a8-bd3a6139eb4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.342129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba06c08a-ca45-4741-98a8-bd3a6139eb4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.350674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba06c08a-ca45-4741-98a8-bd3a6139eb4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.351439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ba06c08a-ca45-4741-98a8-bd3a6139eb4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.522365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-18555f30-0bd5-4aa0-aa72-336f23464950 req-4e510baa-2797-41fb-8f55-37ca12f9b0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646846a6-56c9-4370-8435-da5ae0466afb", "name": "network-vif-deleted", "tag": "98c9ec0b-ac20-402a-9542-f7e5af3d086c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:45.554069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-18555f30-0bd5-4aa0-aa72-336f23464950 req-4e510baa-2797-41fb-8f55-37ca12f9b0c1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.554564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-18555f30-0bd5-4aa0-aa72-336f23464950 req-4e510baa-2797-41fb-8f55-37ca12f9b0c1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.555078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-18555f30-0bd5-4aa0-aa72-336f23464950 req-4e510baa-2797-41fb-8f55-37ca12f9b0c1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.588341 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-18555f30-0bd5-4aa0-aa72-336f23464950 req-4e510baa-2797-41fb-8f55-37ca12f9b0c1 service nova] Creating event network-vif-deleted:98c9ec0b-ac20-402a-9542-f7e5af3d086c for instance 646846a6-56c9-4370-8435-da5ae0466afb on n-h1-839401-11 Aug 29 15:51:45.620292 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-18555f30-0bd5-4aa0-aa72-336f23464950 req-4e510baa-2797-41fb-8f55-37ca12f9b0c1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113480 Aug 29 15:51:45.620950 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3062/5932] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:45.682575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ba06c08a-ca45-4741-98a8-bd3a6139eb4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:45.691292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6f9c4bc1-f996-4484-b095-7a9e39fcec72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:45.692008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6f9c4bc1-f996-4484-b095-7a9e39fcec72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:45.700493 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ba06c08a-ca45-4741-98a8-bd3a6139eb4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 200 len: 1612 microversion: 2.1 time: 0.384032 Aug 29 15:51:45.701167 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2871/5933] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:45 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 1612 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:45.715256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f9c4bc1-f996-4484-b095-7a9e39fcec72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.715755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f9c4bc1-f996-4484-b095-7a9e39fcec72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.716198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f9c4bc1-f996-4484-b095-7a9e39fcec72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.716934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f9c4bc1-f996-4484-b095-7a9e39fcec72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.718010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f9c4bc1-f996-4484-b095-7a9e39fcec72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.718445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f9c4bc1-f996-4484-b095-7a9e39fcec72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.957994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a6394c48-9266-483a-aff8-d0a2712ab4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:45.958616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a6394c48-9266-483a-aff8-d0a2712ab4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:45.972174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6394c48-9266-483a-aff8-d0a2712ab4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.972690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6394c48-9266-483a-aff8-d0a2712ab4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.973159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6394c48-9266-483a-aff8-d0a2712ab4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.974124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6394c48-9266-483a-aff8-d0a2712ab4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.974782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6394c48-9266-483a-aff8-d0a2712ab4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.977925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a6394c48-9266-483a-aff8-d0a2712ab4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.091348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6f9c4bc1-f996-4484-b095-7a9e39fcec72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:46.116590 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6f9c4bc1-f996-4484-b095-7a9e39fcec72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1309 microversion: 2.1 time: 0.429329 Aug 29 15:51:46.117498 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3063/5934] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:45 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1309 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:46.725067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-241ba014-f4ad-4d08-a61d-0c5858cd5803 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:46.725803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-241ba014-f4ad-4d08-a61d-0c5858cd5803 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:46.739452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-241ba014-f4ad-4d08-a61d-0c5858cd5803 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.739452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-241ba014-f4ad-4d08-a61d-0c5858cd5803 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.742902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-241ba014-f4ad-4d08-a61d-0c5858cd5803 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.742902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-241ba014-f4ad-4d08-a61d-0c5858cd5803 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.744989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-241ba014-f4ad-4d08-a61d-0c5858cd5803 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.745620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-241ba014-f4ad-4d08-a61d-0c5858cd5803 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.781898 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-241ba014-f4ad-4d08-a61d-0c5858cd5803 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] HTTP exception thrown: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-241ba014-f4ad-4d08-a61d-0c5858cd5803 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Request method failure captured: Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb HTTP/1.1 Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN9tQXht5Cgfnk-DmzN0MSv0rXQhWQjuwOYU5tmb_XOusFJfbKA_p0tIIxvVCByZJRyPrAyx_GOz9WX3qLDWm96rtVzsejl6mJXf7m_CCbLuHpKW-VnQamqEv9ykDteayNDpjpy7E2YIdOozyPaQJ7msypSAairkWE-SbOPzxpLLe7o Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_90cd659e27ab4f5b9c926a11221a8d80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}] Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: a27d353043364e838b7b6db2c5e97215 Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '646846a6-56c9-4370-8435-da5ae0466afb'} Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:46.790250 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:46.797493 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:46.797493 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:46.797493 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:46.797493 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:46.797493 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:46.797493 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. Aug 29 15:51:46.797493 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:46.797493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-241ba014-f4ad-4d08-a61d-0c5858cd5803 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Returning 404 to user: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:46.799188 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-241ba014-f4ad-4d08-a61d-0c5858cd5803 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 404 len: 111 microversion: 2.1 time: 0.078341 Aug 29 15:51:46.800211 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3064/5935] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:46 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:46.810106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-79bf2e9c-2d1c-45b4-8492-30fbd3d94a00 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '.version_select at 0x7fc42a6afa60>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:46.854597 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-79bf2e9c-2d1c-45b4-8492-30fbd3d94a00 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1547085070" status: 202 len: 0 microversion: 2.1 time: 0.049918 Aug 29 15:51:46.856014 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3065/5936] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 15:51:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1547085070 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:51:46.982421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a6394c48-9266-483a-aff8-d0a2712ab4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:46.998829 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a6394c48-9266-483a-aff8-d0a2712ab4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1391 microversion: 2.1 time: 1.044827 Aug 29 15:51:46.999845 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2872/5937] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:45 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1391 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:47.145521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e7ff6d95-5276-4cbc-aa08-f7e94024481c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:47.146151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e7ff6d95-5276-4cbc-aa08-f7e94024481c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:47.168036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7ff6d95-5276-4cbc-aa08-f7e94024481c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.174920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7ff6d95-5276-4cbc-aa08-f7e94024481c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.175795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7ff6d95-5276-4cbc-aa08-f7e94024481c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.178253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7ff6d95-5276-4cbc-aa08-f7e94024481c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.179088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7ff6d95-5276-4cbc-aa08-f7e94024481c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.186316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7ff6d95-5276-4cbc-aa08-f7e94024481c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.472529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-11ddeb61-161b-41a4-973a-05a2c0675371 req-761ba240-bb27-45d9-a250-84945b5d5d70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed2e48a2-4790-4e37-98b5-3dcd6375f222", "tag": "daa049ea-5255-46cb-a644-fb8d87623d38"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:47.514286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-11ddeb61-161b-41a4-973a-05a2c0675371 req-761ba240-bb27-45d9-a250-84945b5d5d70 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.521780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-11ddeb61-161b-41a4-973a-05a2c0675371 req-761ba240-bb27-45d9-a250-84945b5d5d70 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.522481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-11ddeb61-161b-41a4-973a-05a2c0675371 req-761ba240-bb27-45d9-a250-84945b5d5d70 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.537907 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-11ddeb61-161b-41a4-973a-05a2c0675371 req-761ba240-bb27-45d9-a250-84945b5d5d70 service nova] Creating event network-changed:daa049ea-5255-46cb-a644-fb8d87623d38 for instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 on n-h2-839401-11 Aug 29 15:51:47.545117 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-11ddeb61-161b-41a4-973a-05a2c0675371 req-761ba240-bb27-45d9-a250-84945b5d5d70 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076981 Aug 29 15:51:47.547627 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2873/5938] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:47.601882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e7ff6d95-5276-4cbc-aa08-f7e94024481c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:47.614815 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e7ff6d95-5276-4cbc-aa08-f7e94024481c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1309 microversion: 2.1 time: 0.474811 Aug 29 15:51:47.615763 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3066/5939] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:47 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1309 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:48.022776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7f4ef9af-218a-44e6-8a73-193b04730aa7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:48.023619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7f4ef9af-218a-44e6-8a73-193b04730aa7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:48.039595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f4ef9af-218a-44e6-8a73-193b04730aa7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.040199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f4ef9af-218a-44e6-8a73-193b04730aa7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.040552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f4ef9af-218a-44e6-8a73-193b04730aa7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.041518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f4ef9af-218a-44e6-8a73-193b04730aa7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.042167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f4ef9af-218a-44e6-8a73-193b04730aa7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.043011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f4ef9af-218a-44e6-8a73-193b04730aa7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.096657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:48.127813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=14 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:48.271643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-80439f11-b019-4758-b57f-a383f95dfbb5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Action: 'create', calling method: .version_select at 0x7fc42a8415e0>, body: {"keypair": {"name": "tempest-keypair-385542885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBa07UF3cGodPF20Ym4SN6EnSrhoXwb9uO6oOl2JIj510o3E6zUDOVF4MeHicxf1S6aYaO8g79ZYNnYBcSzVC7u9N/LQvcqtUtuvgelJRmdg3mP/SD2IAS+BY5Z0xbb2iQ=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:48.334254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-80439f11-b019-4758-b57f-a383f95dfbb5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Getting quotas for project 90cd659e27ab4f5b9c926a11221a8d80. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:51:48.357754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-80439f11-b019-4758-b57f-a383f95dfbb5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Getting quotas for user a27d353043364e838b7b6db2c5e97215 and project 90cd659e27ab4f5b9c926a11221a8d80. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:51:48.417363 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-80439f11-b019-4758-b57f-a383f95dfbb5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149917 Aug 29 15:51:48.418651 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3067/5940] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:51:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:51:48.427392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7f4ef9af-218a-44e6-8a73-193b04730aa7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:48.458868 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7f4ef9af-218a-44e6-8a73-193b04730aa7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1391 microversion: 2.1 time: 0.441816 Aug 29 15:51:48.459479 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2874/5941] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:48 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1391 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:48.485489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eaba0805-c1e2-4b62-bba3-400cb5ad5f9d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:48.486604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eaba0805-c1e2-4b62-bba3-400cb5ad5f9d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:48.495711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaba0805-c1e2-4b62-bba3-400cb5ad5f9d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.496223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaba0805-c1e2-4b62-bba3-400cb5ad5f9d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.496663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaba0805-c1e2-4b62-bba3-400cb5ad5f9d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.497520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaba0805-c1e2-4b62-bba3-400cb5ad5f9d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.499157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaba0805-c1e2-4b62-bba3-400cb5ad5f9d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.500486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eaba0805-c1e2-4b62-bba3-400cb5ad5f9d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.525964 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-eaba0805-c1e2-4b62-bba3-400cb5ad5f9d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eaba0805-c1e2-4b62-bba3-400cb5ad5f9d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 HTTP/1.1 Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'bf3c27d9-2596-4f58-80ab-0df600408845'} Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:48.528571 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:48.534708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:51:48.534708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.534708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:48.534708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.534708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:48.534708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:48.534708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:48.534708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:48.534708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:48.534708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:51:48.534708 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.538835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eaba0805-c1e2-4b62-bba3-400cb5ad5f9d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:48.540029 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eaba0805-c1e2-4b62-bba3-400cb5ad5f9d tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 404 len: 111 microversion: 2.1 time: 0.059717 Aug 29 15:51:48.550679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-22d10e43-cfca-47b9-93f9-678dc678c06b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:48.551327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-22d10e43-cfca-47b9-93f9-678dc678c06b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: bf3c27d9-2596-4f58-80ab-0df600408845] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:48.555928 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3068/5942] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:51:48 2022] DELETE /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:48.560226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22d10e43-cfca-47b9-93f9-678dc678c06b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.561131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22d10e43-cfca-47b9-93f9-678dc678c06b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.561736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22d10e43-cfca-47b9-93f9-678dc678c06b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.562715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22d10e43-cfca-47b9-93f9-678dc678c06b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.563340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22d10e43-cfca-47b9-93f9-678dc678c06b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.565021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22d10e43-cfca-47b9-93f9-678dc678c06b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.588062 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-22d10e43-cfca-47b9-93f9-678dc678c06b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-22d10e43-cfca-47b9-93f9-678dc678c06b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 HTTP/1.1 Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'bf3c27d9-2596-4f58-80ab-0df600408845'} Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:48.590599 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.598188 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:48.598188 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:48.598188 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:48.598188 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:48.598188 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:48.598188 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. Aug 29 15:51:48.598188 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:48.605266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-22d10e43-cfca-47b9-93f9-678dc678c06b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance bf3c27d9-2596-4f58-80ab-0df600408845 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:48.605266 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-22d10e43-cfca-47b9-93f9-678dc678c06b tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845" status: 404 len: 111 microversion: 2.1 time: 0.058373 Aug 29 15:51:48.605266 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2875/5943] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:48 2022] GET /compute/v2.1/servers/bf3c27d9-2596-4f58-80ab-0df600408845 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:48.613237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-574cf3be-c8a4-483a-9801-558af8a265d2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:48.613641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-574cf3be-c8a4-483a-9801-558af8a265d2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:48.621673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-574cf3be-c8a4-483a-9801-558af8a265d2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.622481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-574cf3be-c8a4-483a-9801-558af8a265d2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.623186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-574cf3be-c8a4-483a-9801-558af8a265d2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.624147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-574cf3be-c8a4-483a-9801-558af8a265d2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.624824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-574cf3be-c8a4-483a-9801-558af8a265d2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.625530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-574cf3be-c8a4-483a-9801-558af8a265d2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.638028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f5cd2f71-796f-435e-8f23-cc2c20e8526c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:48.638643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f5cd2f71-796f-435e-8f23-cc2c20e8526c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:48.645981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:48.653731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5cd2f71-796f-435e-8f23-cc2c20e8526c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.654542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5cd2f71-796f-435e-8f23-cc2c20e8526c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.655238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5cd2f71-796f-435e-8f23-cc2c20e8526c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.656131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5cd2f71-796f-435e-8f23-cc2c20e8526c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.656758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5cd2f71-796f-435e-8f23-cc2c20e8526c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.657556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5cd2f71-796f-435e-8f23-cc2c20e8526c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.687226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-574cf3be-c8a4-483a-9801-558af8a265d2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:51:48.767968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:48.833751 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-574cf3be-c8a4-483a-9801-558af8a265d2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 204 len: 0 microversion: 2.1 time: 0.224902 Aug 29 15:51:48.838593 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3069/5944] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:51:48 2022] DELETE /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:51:48.851317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e8f8db2a-8798-4db8-b4c9-785d1d7653f3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:48.856567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e8f8db2a-8798-4db8-b4c9-785d1d7653f3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:48.878497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8f8db2a-8798-4db8-b4c9-785d1d7653f3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.880010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8f8db2a-8798-4db8-b4c9-785d1d7653f3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.881148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8f8db2a-8798-4db8-b4c9-785d1d7653f3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.883606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8f8db2a-8798-4db8-b4c9-785d1d7653f3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.885473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8f8db2a-8798-4db8-b4c9-785d1d7653f3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.886955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e8f8db2a-8798-4db8-b4c9-785d1d7653f3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:49.007705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f5cd2f71-796f-435e-8f23-cc2c20e8526c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:49.016425 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f5cd2f71-796f-435e-8f23-cc2c20e8526c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1309 microversion: 2.1 time: 0.382657 Aug 29 15:51:49.023195 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2876/5945] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:48 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1309 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:49.147815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e8f8db2a-8798-4db8-b4c9-785d1d7653f3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:49.156443 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e8f8db2a-8798-4db8-b4c9-785d1d7653f3 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1511 microversion: 2.1 time: 0.316408 Aug 29 15:51:49.157305 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3070/5946] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:48 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:49.481358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f9bb5b0d-67bf-4b57-b749-c2374dab2dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:49.482215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f9bb5b0d-67bf-4b57-b749-c2374dab2dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:49.496336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9bb5b0d-67bf-4b57-b749-c2374dab2dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:49.498564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9bb5b0d-67bf-4b57-b749-c2374dab2dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:49.500475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9bb5b0d-67bf-4b57-b749-c2374dab2dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:49.502148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9bb5b0d-67bf-4b57-b749-c2374dab2dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:49.503402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9bb5b0d-67bf-4b57-b749-c2374dab2dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:49.504718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9bb5b0d-67bf-4b57-b749-c2374dab2dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:49.678727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-96f6ab68-43e8-4ad9-a335-a27f081deebc req-05565cb6-6e83-4143-8212-11cb093f191e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7354e9a0-2795-4a98-a91d-6669a3b353f0", "name": "network-vif-plugged", "status": "completed", "tag": "61b03ce4-5865-4462-8365-bbc3595caa3d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:49.709515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-96f6ab68-43e8-4ad9-a335-a27f081deebc req-05565cb6-6e83-4143-8212-11cb093f191e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:49.710432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-96f6ab68-43e8-4ad9-a335-a27f081deebc req-05565cb6-6e83-4143-8212-11cb093f191e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:49.711095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-96f6ab68-43e8-4ad9-a335-a27f081deebc req-05565cb6-6e83-4143-8212-11cb093f191e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:49.726506 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-96f6ab68-43e8-4ad9-a335-a27f081deebc req-05565cb6-6e83-4143-8212-11cb093f191e service nova] Creating event network-vif-plugged:61b03ce4-5865-4462-8365-bbc3595caa3d for instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 on n-h1-839401-11 Aug 29 15:51:49.733593 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-96f6ab68-43e8-4ad9-a335-a27f081deebc req-05565cb6-6e83-4143-8212-11cb093f191e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058535 Aug 29 15:51:49.735138 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3071/5947] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:51:49.941485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f9bb5b0d-67bf-4b57-b749-c2374dab2dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:49.949883 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f9bb5b0d-67bf-4b57-b749-c2374dab2dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1391 microversion: 2.1 time: 0.473928 Aug 29 15:51:49.950480 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2877/5948] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:49 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1391 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:50.039222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dd30c9d3-6a12-4792-b784-05e97b6b34ca tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:50.040173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dd30c9d3-6a12-4792-b784-05e97b6b34ca tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:50.046933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd30c9d3-6a12-4792-b784-05e97b6b34ca tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.047446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd30c9d3-6a12-4792-b784-05e97b6b34ca tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.047890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd30c9d3-6a12-4792-b784-05e97b6b34ca tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.048986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd30c9d3-6a12-4792-b784-05e97b6b34ca tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.049553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd30c9d3-6a12-4792-b784-05e97b6b34ca tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.049997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd30c9d3-6a12-4792-b784-05e97b6b34ca tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.180546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7ebdc1df-8229-4389-a33f-c7ce37d18c57 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:50.181386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7ebdc1df-8229-4389-a33f-c7ce37d18c57 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:50.188034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ebdc1df-8229-4389-a33f-c7ce37d18c57 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.188664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ebdc1df-8229-4389-a33f-c7ce37d18c57 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.189261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ebdc1df-8229-4389-a33f-c7ce37d18c57 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.190189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ebdc1df-8229-4389-a33f-c7ce37d18c57 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.190841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ebdc1df-8229-4389-a33f-c7ce37d18c57 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.191459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ebdc1df-8229-4389-a33f-c7ce37d18c57 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.211570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dd30c9d3-6a12-4792-b784-05e97b6b34ca tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:50.221885 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dd30c9d3-6a12-4792-b784-05e97b6b34ca tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1309 microversion: 2.1 time: 0.187790 Aug 29 15:51:50.234029 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3072/5949] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:50 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1309 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:50.488872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7ebdc1df-8229-4389-a33f-c7ce37d18c57 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:50.509671 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7ebdc1df-8229-4389-a33f-c7ce37d18c57 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1511 microversion: 2.1 time: 0.323448 Aug 29 15:51:50.509671 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2878/5950] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:50 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:50.971645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b30840ca-0c9a-4e03-8151-621f6216d8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:50.972197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b30840ca-0c9a-4e03-8151-621f6216d8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:50.980684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b30840ca-0c9a-4e03-8151-621f6216d8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.981509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b30840ca-0c9a-4e03-8151-621f6216d8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.982127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b30840ca-0c9a-4e03-8151-621f6216d8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.982994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b30840ca-0c9a-4e03-8151-621f6216d8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.983893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b30840ca-0c9a-4e03-8151-621f6216d8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.984857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b30840ca-0c9a-4e03-8151-621f6216d8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.144135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1843070079", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ebda995-e90a-4f2e-b960-05df0b4c22d1"}], "security_groups": [{"name": "tempest-securitygroup--1380896784"}], "key_name": "tempest-keypair-385542885", "user_data": "}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:51.173064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b30840ca-0c9a-4e03-8151-621f6216d8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:51.181749 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b30840ca-0c9a-4e03-8151-621f6216d8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1391 microversion: 2.1 time: 0.214413 Aug 29 15:51:51.182739 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3073/5951] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:50 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1391 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:51.243167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b3ea35a-7675-4edf-9a13-29fd53ef3f46 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:51.243859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6b3ea35a-7675-4edf-9a13-29fd53ef3f46 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:51.250246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b3ea35a-7675-4edf-9a13-29fd53ef3f46 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.250745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b3ea35a-7675-4edf-9a13-29fd53ef3f46 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.251464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b3ea35a-7675-4edf-9a13-29fd53ef3f46 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.252265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b3ea35a-7675-4edf-9a13-29fd53ef3f46 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.252951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b3ea35a-7675-4edf-9a13-29fd53ef3f46 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.253336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b3ea35a-7675-4edf-9a13-29fd53ef3f46 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.268039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] validate_networks() for [('0ebda995-e90a-4f2e-b960-05df0b4c22d1', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:51:51.442066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b3ea35a-7675-4edf-9a13-29fd53ef3f46 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:51.451514 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6b3ea35a-7675-4edf-9a13-29fd53ef3f46 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1309 microversion: 2.1 time: 0.212317 Aug 29 15:51:51.453066 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3074/5952] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:51 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1309 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:51.523623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-66719ac7-c56b-458e-afac-5a67805ba308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:51.524785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-66719ac7-c56b-458e-afac-5a67805ba308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:51.539435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66719ac7-c56b-458e-afac-5a67805ba308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.541748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66719ac7-c56b-458e-afac-5a67805ba308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.543339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66719ac7-c56b-458e-afac-5a67805ba308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.549389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66719ac7-c56b-458e-afac-5a67805ba308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.550002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66719ac7-c56b-458e-afac-5a67805ba308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.553212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-66719ac7-c56b-458e-afac-5a67805ba308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.771020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-66719ac7-c56b-458e-afac-5a67805ba308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:51.779643 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-66719ac7-c56b-458e-afac-5a67805ba308 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1511 microversion: 2.1 time: 0.261857 Aug 29 15:51:51.781036 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3075/5953] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:51 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1511 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:51.799321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:51:51.799858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:51:51.800409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:51:51.801202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:51:51.801425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:51:51.811736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.812227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.812669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.813455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.814227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.814784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.848915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Getting quotas for project 90cd659e27ab4f5b9c926a11221a8d80. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:51:51.856073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Getting quotas for user a27d353043364e838b7b6db2c5e97215 and project 90cd659e27ab4f5b9c926a11221a8d80. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:51:51.870106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:51:51.872517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:51:51.923985 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5d7ed30d-159b-4643-a7ee-f71a9c1683e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.786206 Aug 29 15:51:51.925013 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2879/5954] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:51:51.936646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f83974a-d0c9-47e8-bf8f-c6c21c4bdfa8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:51.937493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3f83974a-d0c9-47e8-bf8f-c6c21c4bdfa8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:52.008417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3f83974a-d0c9-47e8-bf8f-c6c21c4bdfa8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:52.017591 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3f83974a-d0c9-47e8-bf8f-c6c21c4bdfa8 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1241 microversion: 2.1 time: 0.085270 Aug 29 15:51:52.018185 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3076/5955] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:51 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:52.209565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6ef9ee35-89aa-4677-b3fc-56c89ef32ede tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:52.210663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6ef9ee35-89aa-4677-b3fc-56c89ef32ede tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:52.223908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ef9ee35-89aa-4677-b3fc-56c89ef32ede tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.224420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ef9ee35-89aa-4677-b3fc-56c89ef32ede tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.224879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ef9ee35-89aa-4677-b3fc-56c89ef32ede tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.225620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ef9ee35-89aa-4677-b3fc-56c89ef32ede tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.226200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ef9ee35-89aa-4677-b3fc-56c89ef32ede tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.226628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ef9ee35-89aa-4677-b3fc-56c89ef32ede tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.417563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6ef9ee35-89aa-4677-b3fc-56c89ef32ede tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:52.428949 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6ef9ee35-89aa-4677-b3fc-56c89ef32ede tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1391 microversion: 2.1 time: 0.228880 Aug 29 15:51:52.430008 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2880/5956] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:52 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1391 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:52.474895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7d064401-2b33-4f00-a499-4347d3d3dd16 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:52.475553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7d064401-2b33-4f00-a499-4347d3d3dd16 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:52.483250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d064401-2b33-4f00-a499-4347d3d3dd16 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.484195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d064401-2b33-4f00-a499-4347d3d3dd16 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.484814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d064401-2b33-4f00-a499-4347d3d3dd16 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.485764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d064401-2b33-4f00-a499-4347d3d3dd16 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.486564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d064401-2b33-4f00-a499-4347d3d3dd16 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.487256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d064401-2b33-4f00-a499-4347d3d3dd16 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.701103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7d064401-2b33-4f00-a499-4347d3d3dd16 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:52.712296 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7d064401-2b33-4f00-a499-4347d3d3dd16 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1489 microversion: 2.1 time: 0.242117 Aug 29 15:51:52.713623 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3077/5957] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:52 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1489 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:52.734697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8ec8587f-3b50-44ea-bb69-28fcdd65522c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1257203337"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:52.737456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8ec8587f-3b50-44ea-bb69-28fcdd65522c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:52.743923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ec8587f-3b50-44ea-bb69-28fcdd65522c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.744431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ec8587f-3b50-44ea-bb69-28fcdd65522c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.744874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ec8587f-3b50-44ea-bb69-28fcdd65522c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.745618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ec8587f-3b50-44ea-bb69-28fcdd65522c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.749501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ec8587f-3b50-44ea-bb69-28fcdd65522c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.749946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ec8587f-3b50-44ea-bb69-28fcdd65522c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.801707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-da9edf7d-e431-4aa7-8a95-4cefad742653 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:52.802325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-da9edf7d-e431-4aa7-8a95-4cefad742653 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:52.814717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9edf7d-e431-4aa7-8a95-4cefad742653 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.815277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9edf7d-e431-4aa7-8a95-4cefad742653 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.816979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9edf7d-e431-4aa7-8a95-4cefad742653 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.819688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9edf7d-e431-4aa7-8a95-4cefad742653 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.820363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9edf7d-e431-4aa7-8a95-4cefad742653 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.820807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da9edf7d-e431-4aa7-8a95-4cefad742653 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.884388 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8ec8587f-3b50-44ea-bb69-28fcdd65522c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "PUT /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1074 microversion: 2.1 time: 0.153289 Aug 29 15:51:52.901276 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2881/5958] 10.222.0.62 () {60 vars in 1256 bytes} [Mon Aug 29 15:51:52 2022] PUT /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1074 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:52.912191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0b294451-2b3c-4805-b13f-04ce8dbf1129 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:52.913514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0b294451-2b3c-4805-b13f-04ce8dbf1129 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:52.921295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b294451-2b3c-4805-b13f-04ce8dbf1129 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.922162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b294451-2b3c-4805-b13f-04ce8dbf1129 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.922823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b294451-2b3c-4805-b13f-04ce8dbf1129 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.923576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b294451-2b3c-4805-b13f-04ce8dbf1129 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.924258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b294451-2b3c-4805-b13f-04ce8dbf1129 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.924690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b294451-2b3c-4805-b13f-04ce8dbf1129 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:53.095130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-da9edf7d-e431-4aa7-8a95-4cefad742653 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:53.104487 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-da9edf7d-e431-4aa7-8a95-4cefad742653 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1511 microversion: 2.1 time: 0.307213 Aug 29 15:51:53.105315 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3078/5959] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:52 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1511 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:53.155995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0b294451-2b3c-4805-b13f-04ce8dbf1129 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:53.164632 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0b294451-2b3c-4805-b13f-04ce8dbf1129 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1500 microversion: 2.1 time: 0.257027 Aug 29 15:51:53.165491 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2882/5960] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:52 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1500 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:53.185128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cbf1ceea-6f3b-435d-a8e7-e212f848340e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:53.185919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cbf1ceea-6f3b-435d-a8e7-e212f848340e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:53.192162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbf1ceea-6f3b-435d-a8e7-e212f848340e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:53.192672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbf1ceea-6f3b-435d-a8e7-e212f848340e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:53.193296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbf1ceea-6f3b-435d-a8e7-e212f848340e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:53.194000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbf1ceea-6f3b-435d-a8e7-e212f848340e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:53.194652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbf1ceea-6f3b-435d-a8e7-e212f848340e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:53.195077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbf1ceea-6f3b-435d-a8e7-e212f848340e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:53.410812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cbf1ceea-6f3b-435d-a8e7-e212f848340e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:53.419067 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cbf1ceea-6f3b-435d-a8e7-e212f848340e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1500 microversion: 2.1 time: 0.237746 Aug 29 15:51:53.433897 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2883/5961] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:53 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1500 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:53.442056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-160c48ec-525a-4118-9bc8-d94f25b59669 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:53.451329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-160c48ec-525a-4118-9bc8-d94f25b59669 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:53.452083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-160c48ec-525a-4118-9bc8-d94f25b59669 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:53.452743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-160c48ec-525a-4118-9bc8-d94f25b59669 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:53.488668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-160c48ec-525a-4118-9bc8-d94f25b59669 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Going to try to stop instance {{(pid=122361) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:51:53.622752 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-160c48ec-525a-4118-9bc8-d94f25b59669 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "POST /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0/action" status: 202 len: 0 microversion: 2.1 time: 0.184442 Aug 29 15:51:53.624203 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2884/5962] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:53 2022] POST /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:51:53.640607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-471182a6-475b-4010-9df5-243034abc57f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:53.643369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-471182a6-475b-4010-9df5-243034abc57f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:53.664536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-471182a6-475b-4010-9df5-243034abc57f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:53.671612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-471182a6-475b-4010-9df5-243034abc57f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:53.672262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-471182a6-475b-4010-9df5-243034abc57f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:53.673630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-471182a6-475b-4010-9df5-243034abc57f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:53.674252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-471182a6-475b-4010-9df5-243034abc57f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:53.674950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-471182a6-475b-4010-9df5-243034abc57f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:53.737788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ac8752ec-581f-43d5-b026-9c20278bc505 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:53.739353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ac8752ec-581f-43d5-b026-9c20278bc505 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:53.768937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac8752ec-581f-43d5-b026-9c20278bc505 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:53.774222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac8752ec-581f-43d5-b026-9c20278bc505 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:53.779095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac8752ec-581f-43d5-b026-9c20278bc505 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:53.784622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac8752ec-581f-43d5-b026-9c20278bc505 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:53.785737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac8752ec-581f-43d5-b026-9c20278bc505 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:53.789077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac8752ec-581f-43d5-b026-9c20278bc505 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:53.986736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ac8752ec-581f-43d5-b026-9c20278bc505 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:53.997382 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ac8752ec-581f-43d5-b026-9c20278bc505 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1301 microversion: 2.1 time: 0.890632 Aug 29 15:51:53.999354 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3079/5963] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:53 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1301 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:54.004690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-af0741d3-61c1-491a-99ce-57e535b17be5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:54.005649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-af0741d3-61c1-491a-99ce-57e535b17be5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:54.014014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af0741d3-61c1-491a-99ce-57e535b17be5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.014520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af0741d3-61c1-491a-99ce-57e535b17be5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.015436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af0741d3-61c1-491a-99ce-57e535b17be5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.016923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af0741d3-61c1-491a-99ce-57e535b17be5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.018175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af0741d3-61c1-491a-99ce-57e535b17be5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.018796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af0741d3-61c1-491a-99ce-57e535b17be5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.389509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-471182a6-475b-4010-9df5-243034abc57f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:54.399782 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-471182a6-475b-4010-9df5-243034abc57f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1391 microversion: 2.1 time: 0.772647 Aug 29 15:51:54.414100 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2885/5964] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:53 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1391 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:54.419744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4fd7d70e-a5e9-4b92-883d-465795d6794e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:54.424405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4fd7d70e-a5e9-4b92-883d-465795d6794e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:54.425037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-af0741d3-61c1-491a-99ce-57e535b17be5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:54.431438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fd7d70e-a5e9-4b92-883d-465795d6794e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.432186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fd7d70e-a5e9-4b92-883d-465795d6794e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.432769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fd7d70e-a5e9-4b92-883d-465795d6794e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.434446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fd7d70e-a5e9-4b92-883d-465795d6794e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.435050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fd7d70e-a5e9-4b92-883d-465795d6794e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.435621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4fd7d70e-a5e9-4b92-883d-465795d6794e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.437806 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-af0741d3-61c1-491a-99ce-57e535b17be5 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.436555 Aug 29 15:51:54.438778 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3080/5965] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:53 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:54.461750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-35a695c3-8bd8-4b94-8aa2-e0dbee546dce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:54.464140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-35a695c3-8bd8-4b94-8aa2-e0dbee546dce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:54.477654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:54.490686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-4fd7d70e-a5e9-4b92-883d-465795d6794e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lazy-loading 'flavor' on Instance uuid 3cbe7b40-fde9-4090-8c20-74c27c5af79b {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:54.501744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35a695c3-8bd8-4b94-8aa2-e0dbee546dce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.506822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35a695c3-8bd8-4b94-8aa2-e0dbee546dce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.508121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35a695c3-8bd8-4b94-8aa2-e0dbee546dce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.509813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35a695c3-8bd8-4b94-8aa2-e0dbee546dce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.514061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35a695c3-8bd8-4b94-8aa2-e0dbee546dce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.515152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35a695c3-8bd8-4b94-8aa2-e0dbee546dce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.710516 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4fd7d70e-a5e9-4b92-883d-465795d6794e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/action" status: 200 len: 32 microversion: 2.1 time: 0.292536 Aug 29 15:51:54.711597 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2886/5966] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:54 2022] POST /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/action => generated 32 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:51:54.724918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c5517ff2-a765-4359-9fc0-b199e6980d96 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:54.726350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c5517ff2-a765-4359-9fc0-b199e6980d96 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:54.744369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5517ff2-a765-4359-9fc0-b199e6980d96 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.745461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5517ff2-a765-4359-9fc0-b199e6980d96 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.747387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5517ff2-a765-4359-9fc0-b199e6980d96 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.750384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5517ff2-a765-4359-9fc0-b199e6980d96 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.754871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5517ff2-a765-4359-9fc0-b199e6980d96 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.755533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5517ff2-a765-4359-9fc0-b199e6980d96 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.861628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-35a695c3-8bd8-4b94-8aa2-e0dbee546dce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:54.876636 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-35a695c3-8bd8-4b94-8aa2-e0dbee546dce tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1511 microversion: 2.1 time: 0.434499 Aug 29 15:51:54.877200 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3081/5967] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:54 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1511 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:55.025374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f0c4ca0e-1fcb-4e2f-b4a5-2f34dcac1c07 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:55.026079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f0c4ca0e-1fcb-4e2f-b4a5-2f34dcac1c07 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:55.038926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0c4ca0e-1fcb-4e2f-b4a5-2f34dcac1c07 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:55.043330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0c4ca0e-1fcb-4e2f-b4a5-2f34dcac1c07 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:55.043930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0c4ca0e-1fcb-4e2f-b4a5-2f34dcac1c07 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:55.044775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0c4ca0e-1fcb-4e2f-b4a5-2f34dcac1c07 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:55.045366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0c4ca0e-1fcb-4e2f-b4a5-2f34dcac1c07 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:55.045877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0c4ca0e-1fcb-4e2f-b4a5-2f34dcac1c07 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:55.202857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f0c4ca0e-1fcb-4e2f-b4a5-2f34dcac1c07 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:55.213797 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f0c4ca0e-1fcb-4e2f-b4a5-2f34dcac1c07 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1299 microversion: 2.1 time: 0.194274 Aug 29 15:51:55.214687 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3082/5968] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:55 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1299 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:55.394794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c5517ff2-a765-4359-9fc0-b199e6980d96 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:55.404594 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c5517ff2-a765-4359-9fc0-b199e6980d96 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.686280 Aug 29 15:51:55.424136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-29c96bb3-7100-47d8-a9df-35dd3c0509ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:55.424874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-29c96bb3-7100-47d8-a9df-35dd3c0509ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:55.429810 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2887/5969] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:54 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:55.431337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c96bb3-7100-47d8-a9df-35dd3c0509ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:55.432439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c96bb3-7100-47d8-a9df-35dd3c0509ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:55.433022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c96bb3-7100-47d8-a9df-35dd3c0509ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:55.433756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c96bb3-7100-47d8-a9df-35dd3c0509ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:55.434406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c96bb3-7100-47d8-a9df-35dd3c0509ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:55.434895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29c96bb3-7100-47d8-a9df-35dd3c0509ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:55.459037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-296da084-4c07-4ab6-919e-8a97094c4a3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:55.459872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-296da084-4c07-4ab6-919e-8a97094c4a3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:55.469427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-296da084-4c07-4ab6-919e-8a97094c4a3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:55.470082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-296da084-4c07-4ab6-919e-8a97094c4a3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:55.470635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-296da084-4c07-4ab6-919e-8a97094c4a3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:55.471479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-296da084-4c07-4ab6-919e-8a97094c4a3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:55.472242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-296da084-4c07-4ab6-919e-8a97094c4a3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:55.472799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-296da084-4c07-4ab6-919e-8a97094c4a3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:55.969281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-29c96bb3-7100-47d8-a9df-35dd3c0509ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:55.981775 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-29c96bb3-7100-47d8-a9df-35dd3c0509ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1391 microversion: 2.1 time: 0.563041 Aug 29 15:51:55.988222 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3083/5970] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:55 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1391 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:56.003024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6a0429b5-c635-4d0e-a3d3-65f98bf5c6bf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:56.005827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6a0429b5-c635-4d0e-a3d3-65f98bf5c6bf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:56.023407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0429b5-c635-4d0e-a3d3-65f98bf5c6bf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:56.024068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0429b5-c635-4d0e-a3d3-65f98bf5c6bf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:56.024626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0429b5-c635-4d0e-a3d3-65f98bf5c6bf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:56.025466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0429b5-c635-4d0e-a3d3-65f98bf5c6bf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:56.026046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0429b5-c635-4d0e-a3d3-65f98bf5c6bf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:56.026498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0429b5-c635-4d0e-a3d3-65f98bf5c6bf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:56.174300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-296da084-4c07-4ab6-919e-8a97094c4a3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:56.190126 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-296da084-4c07-4ab6-919e-8a97094c4a3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.734705 Aug 29 15:51:56.190779 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2888/5971] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:55 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:56.237553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e8df4291-4425-4605-a67e-58c614a74ee5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:56.238265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e8df4291-4425-4605-a67e-58c614a74ee5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:56.256612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8df4291-4425-4605-a67e-58c614a74ee5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:56.257403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8df4291-4425-4605-a67e-58c614a74ee5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:56.257999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8df4291-4425-4605-a67e-58c614a74ee5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:56.260090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8df4291-4425-4605-a67e-58c614a74ee5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:56.260742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8df4291-4425-4605-a67e-58c614a74ee5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:56.261039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6a0429b5-c635-4d0e-a3d3-65f98bf5c6bf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d1e88d25a04cfe93fdc728736b0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28bb9d84c3a4fa2b0ea86fc70720d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:56.261749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8df4291-4425-4605-a67e-58c614a74ee5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:56.276397 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6a0429b5-c635-4d0e-a3d3-65f98bf5c6bf tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 200 len: 1469 microversion: 2.1 time: 0.283558 Aug 29 15:51:56.277128 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3084/5972] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:55 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 1469 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:56.429551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7dae1e2a-1bd1-4241-9b32-779f6a1decc3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:56.430573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7dae1e2a-1bd1-4241-9b32-779f6a1decc3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:56.437308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dae1e2a-1bd1-4241-9b32-779f6a1decc3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:56.437979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dae1e2a-1bd1-4241-9b32-779f6a1decc3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:56.448563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dae1e2a-1bd1-4241-9b32-779f6a1decc3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:56.449515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dae1e2a-1bd1-4241-9b32-779f6a1decc3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:56.450018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dae1e2a-1bd1-4241-9b32-779f6a1decc3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:56.450465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7dae1e2a-1bd1-4241-9b32-779f6a1decc3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:56.611855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e8df4291-4425-4605-a67e-58c614a74ee5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:56.632835 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e8df4291-4425-4605-a67e-58c614a74ee5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1299 microversion: 2.1 time: 0.400759 Aug 29 15:51:56.640090 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2889/5973] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:56 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1299 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:56.648435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b345902d-c434-40b9-9a3f-1b1bade88d36 req-fe2a8405-8da1-4164-8fe2-1b9e09fa818d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0fd8c4a-7225-496b-a071-6fd8f37dc60a", "name": "network-vif-deleted", "tag": "8dc04ade-2041-4d24-bbaf-7f8f25a7e827"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:56.666346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b345902d-c434-40b9-9a3f-1b1bade88d36 req-fe2a8405-8da1-4164-8fe2-1b9e09fa818d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:56.667262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b345902d-c434-40b9-9a3f-1b1bade88d36 req-fe2a8405-8da1-4164-8fe2-1b9e09fa818d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:56.667797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b345902d-c434-40b9-9a3f-1b1bade88d36 req-fe2a8405-8da1-4164-8fe2-1b9e09fa818d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:56.701141 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b345902d-c434-40b9-9a3f-1b1bade88d36 req-fe2a8405-8da1-4164-8fe2-1b9e09fa818d service nova] Creating event network-vif-deleted:8dc04ade-2041-4d24-bbaf-7f8f25a7e827 for instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a on n-h2-839401-11 Aug 29 15:51:56.716859 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b345902d-c434-40b9-9a3f-1b1bade88d36 req-fe2a8405-8da1-4164-8fe2-1b9e09fa818d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074934 Aug 29 15:51:56.720586 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2890/5974] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:56.831409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7dae1e2a-1bd1-4241-9b32-779f6a1decc3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:56.846318 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7dae1e2a-1bd1-4241-9b32-779f6a1decc3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.420783 Aug 29 15:51:56.847096 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3085/5975] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:56 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:57.007122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4ba4f358-dbcd-42e3-8f33-92bd276b2eb3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:57.008624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4ba4f358-dbcd-42e3-8f33-92bd276b2eb3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:57.020969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ba4f358-dbcd-42e3-8f33-92bd276b2eb3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:57.021844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ba4f358-dbcd-42e3-8f33-92bd276b2eb3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:57.022819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ba4f358-dbcd-42e3-8f33-92bd276b2eb3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:57.023779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ba4f358-dbcd-42e3-8f33-92bd276b2eb3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:57.024634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ba4f358-dbcd-42e3-8f33-92bd276b2eb3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:57.025330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ba4f358-dbcd-42e3-8f33-92bd276b2eb3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:57.212062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9e6c861f-f51f-4a93-bff8-d24d7b74e5d2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:57.212678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9e6c861f-f51f-4a93-bff8-d24d7b74e5d2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:57.229799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e6c861f-f51f-4a93-bff8-d24d7b74e5d2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:57.230648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e6c861f-f51f-4a93-bff8-d24d7b74e5d2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:57.231237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e6c861f-f51f-4a93-bff8-d24d7b74e5d2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:57.236195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e6c861f-f51f-4a93-bff8-d24d7b74e5d2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:57.238683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e6c861f-f51f-4a93-bff8-d24d7b74e5d2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:57.240676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e6c861f-f51f-4a93-bff8-d24d7b74e5d2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:57.842125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4ba4f358-dbcd-42e3-8f33-92bd276b2eb3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:57.855115 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4ba4f358-dbcd-42e3-8f33-92bd276b2eb3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1391 microversion: 2.1 time: 0.856501 Aug 29 15:51:57.864028 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2891/5976] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:56 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1391 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:57.869751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea9b718e-c2ae-481a-a40e-9d92d5e182f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:57.870386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ea9b718e-c2ae-481a-a40e-9d92d5e182f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] [instance: b0fd8c4a-7225-496b-a071-6fd8f37dc60a] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:57.894308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea9b718e-c2ae-481a-a40e-9d92d5e182f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:57.894590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea9b718e-c2ae-481a-a40e-9d92d5e182f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:57.895270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea9b718e-c2ae-481a-a40e-9d92d5e182f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:57.896679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea9b718e-c2ae-481a-a40e-9d92d5e182f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:57.897526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea9b718e-c2ae-481a-a40e-9d92d5e182f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:57.898746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea9b718e-c2ae-481a-a40e-9d92d5e182f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:57.934637 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-ea9b718e-c2ae-481a-a40e-9d92d5e182f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] HTTP exception thrown: Instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a could not be found. Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea9b718e-c2ae-481a-a40e-9d92d5e182f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Request method failure captured: Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a HTTP/1.1 Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-4xGZ6KuHSwZcNI5DrAfIQ_sPmPRjZq-HPHNyUnXwaooGJr7Ztxw8LFyTIcRzxIDKnAAswNNu4PAOZRQ96vqRGpW6TywBKnSZMq4KkQrLq1XHzhEvfucmuaiVgmdLJXvCjjCKJglMMTg8ywQte98GQYAhVy3O7fe0mvLv8yekM-uA Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d28bb9d84c3a4fa2b0ea86fc70720d13", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d28bb9d84c3a4fa2b0ea86fc70720d13"}]}] Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d28bb9d84c3a4fa2b0ea86fc70720d13 Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1485482412 Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b3d1e88d25a04cfe93fdc728736b0e2d Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-1485482412-project Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a could not be found. Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'b0fd8c4a-7225-496b-a071-6fd8f37dc60a'} Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a could not be found. Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a could not be found. Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:57.941429 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:57.944830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:57.944830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:57.944830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:57.944830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:57.944830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:57.944830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a could not be found. Aug 29 15:51:57.944830 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:51:57.946231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea9b718e-c2ae-481a-a40e-9d92d5e182f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] Returning 404 to user: Instance b0fd8c4a-7225-496b-a071-6fd8f37dc60a could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:57.948617 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ea9b718e-c2ae-481a-a40e-9d92d5e182f2 tempest-ServersNegativeTestJSON-1485482412 tempest-ServersNegativeTestJSON-1485482412-project] 10.222.0.62 "GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a" status: 404 len: 111 microversion: 2.1 time: 0.082215 Aug 29 15:51:57.950101 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2892/5977] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:57 2022] GET /compute/v2.1/servers/b0fd8c4a-7225-496b-a071-6fd8f37dc60a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:57.959052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-29391d5a-c51d-4b64-a5a8-4b3dd3cf152e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:57.959848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-29391d5a-c51d-4b64-a5a8-4b3dd3cf152e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:57.966755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29391d5a-c51d-4b64-a5a8-4b3dd3cf152e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:57.967500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29391d5a-c51d-4b64-a5a8-4b3dd3cf152e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:57.968692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29391d5a-c51d-4b64-a5a8-4b3dd3cf152e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:57.969663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29391d5a-c51d-4b64-a5a8-4b3dd3cf152e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:57.970367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29391d5a-c51d-4b64-a5a8-4b3dd3cf152e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:57.971006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29391d5a-c51d-4b64-a5a8-4b3dd3cf152e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.227595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e6c861f-f51f-4a93-bff8-d24d7b74e5d2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:58.239504 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9e6c861f-f51f-4a93-bff8-d24d7b74e5d2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 1.031461 Aug 29 15:51:58.241830 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3086/5978] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:57 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:58.248857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-32c0ba22-eaeb-4020-98db-03d8d802dc6e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:58.249837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-32c0ba22-eaeb-4020-98db-03d8d802dc6e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:58.257596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32c0ba22-eaeb-4020-98db-03d8d802dc6e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:58.258436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32c0ba22-eaeb-4020-98db-03d8d802dc6e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:58.259423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32c0ba22-eaeb-4020-98db-03d8d802dc6e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.260335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32c0ba22-eaeb-4020-98db-03d8d802dc6e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:58.261140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32c0ba22-eaeb-4020-98db-03d8d802dc6e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:58.261922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32c0ba22-eaeb-4020-98db-03d8d802dc6e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.532662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-29391d5a-c51d-4b64-a5a8-4b3dd3cf152e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:58.548061 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-29391d5a-c51d-4b64-a5a8-4b3dd3cf152e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1367 microversion: 2.1 time: 0.595551 Aug 29 15:51:58.548768 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2893/5979] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:57 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1367 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:58.663495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-32c0ba22-eaeb-4020-98db-03d8d802dc6e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:58.683239 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-32c0ba22-eaeb-4020-98db-03d8d802dc6e tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.439835 Aug 29 15:51:58.697131 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3087/5980] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:58 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:58.802560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-9d2ad958-7830-4fa1-998b-dab269cb0926 req-3df5b5db-a24b-4a59-9fd2-7e8434cd0d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2e48a2-4790-4e37-98b5-3dcd6375f222", "name": "network-vif-plugged", "status": "completed", "tag": "daa049ea-5255-46cb-a644-fb8d87623d38"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:58.822131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9d2ad958-7830-4fa1-998b-dab269cb0926 req-3df5b5db-a24b-4a59-9fd2-7e8434cd0d87 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:58.823113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9d2ad958-7830-4fa1-998b-dab269cb0926 req-3df5b5db-a24b-4a59-9fd2-7e8434cd0d87 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:58.823885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9d2ad958-7830-4fa1-998b-dab269cb0926 req-3df5b5db-a24b-4a59-9fd2-7e8434cd0d87 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.841344 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-9d2ad958-7830-4fa1-998b-dab269cb0926 req-3df5b5db-a24b-4a59-9fd2-7e8434cd0d87 service nova] Creating event network-vif-plugged:daa049ea-5255-46cb-a644-fb8d87623d38 for instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 on n-h2-839401-11 Aug 29 15:51:58.852879 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-9d2ad958-7830-4fa1-998b-dab269cb0926 req-3df5b5db-a24b-4a59-9fd2-7e8434cd0d87 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058239 Aug 29 15:51:58.855126 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2894/5981] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:58.891069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7bc8c38b-3c3a-41da-a33b-bb05ec91ad14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:58.891708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7bc8c38b-3c3a-41da-a33b-bb05ec91ad14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:58.900303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bc8c38b-3c3a-41da-a33b-bb05ec91ad14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:58.900820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bc8c38b-3c3a-41da-a33b-bb05ec91ad14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:58.901517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bc8c38b-3c3a-41da-a33b-bb05ec91ad14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.902485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bc8c38b-3c3a-41da-a33b-bb05ec91ad14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:58.904695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bc8c38b-3c3a-41da-a33b-bb05ec91ad14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:58.907962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bc8c38b-3c3a-41da-a33b-bb05ec91ad14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.922428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:59.155186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d26d8f40-9310-4a0e-a2ca-df440831c323 req-25eefe3c-9404-4e91-bfb1-55721b87cbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52c16c7d-383b-4572-8c59-982ea4f677d0", "tag": "5d40b62c-10f3-4b72-bbef-f1f5d5fb1e4b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:59.183353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d26d8f40-9310-4a0e-a2ca-df440831c323 req-25eefe3c-9404-4e91-bfb1-55721b87cbd5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:59.193545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d26d8f40-9310-4a0e-a2ca-df440831c323 req-25eefe3c-9404-4e91-bfb1-55721b87cbd5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:59.194323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d26d8f40-9310-4a0e-a2ca-df440831c323 req-25eefe3c-9404-4e91-bfb1-55721b87cbd5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:59.225794 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d26d8f40-9310-4a0e-a2ca-df440831c323 req-25eefe3c-9404-4e91-bfb1-55721b87cbd5 service nova] Creating event network-changed:5d40b62c-10f3-4b72-bbef-f1f5d5fb1e4b for instance 52c16c7d-383b-4572-8c59-982ea4f677d0 on n-h1-839401-11 Aug 29 15:51:59.243400 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d26d8f40-9310-4a0e-a2ca-df440831c323 req-25eefe3c-9404-4e91-bfb1-55721b87cbd5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098851 Aug 29 15:51:59.244757 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2895/5982] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:59.268209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6e925b24-5042-448f-b697-18287ad9b565 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:59.268903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6e925b24-5042-448f-b697-18287ad9b565 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:59.276501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e925b24-5042-448f-b697-18287ad9b565 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:59.277277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e925b24-5042-448f-b697-18287ad9b565 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:59.277921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e925b24-5042-448f-b697-18287ad9b565 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:59.278789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e925b24-5042-448f-b697-18287ad9b565 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:59.279415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e925b24-5042-448f-b697-18287ad9b565 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:59.280303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e925b24-5042-448f-b697-18287ad9b565 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:59.356135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7bc8c38b-3c3a-41da-a33b-bb05ec91ad14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:59.370465 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7bc8c38b-3c3a-41da-a33b-bb05ec91ad14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1391 microversion: 2.1 time: 0.494077 Aug 29 15:51:59.371077 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3088/5983] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:58 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1391 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:59.570110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2641a0b3-e814-4b3a-b047-613560f6bd3f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:59.570630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2641a0b3-e814-4b3a-b047-613560f6bd3f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:59.574053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6e925b24-5042-448f-b697-18287ad9b565 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:59.584095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2641a0b3-e814-4b3a-b047-613560f6bd3f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:59.584995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2641a0b3-e814-4b3a-b047-613560f6bd3f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:59.585674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2641a0b3-e814-4b3a-b047-613560f6bd3f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:59.586579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2641a0b3-e814-4b3a-b047-613560f6bd3f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:59.588708 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6e925b24-5042-448f-b697-18287ad9b565 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.324896 Aug 29 15:51:59.588853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2641a0b3-e814-4b3a-b047-613560f6bd3f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:59.590115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2641a0b3-e814-4b3a-b047-613560f6bd3f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:59.593100 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2896/5984] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:59 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:59.708163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6a070795-94d0-4b34-b0bf-b691e123db32 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:59.709151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6a070795-94d0-4b34-b0bf-b691e123db32 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:59.717211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a070795-94d0-4b34-b0bf-b691e123db32 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:59.717958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a070795-94d0-4b34-b0bf-b691e123db32 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:59.718621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a070795-94d0-4b34-b0bf-b691e123db32 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:59.719525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a070795-94d0-4b34-b0bf-b691e123db32 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:59.720524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a070795-94d0-4b34-b0bf-b691e123db32 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:59.720524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a070795-94d0-4b34-b0bf-b691e123db32 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:59.888904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2641a0b3-e814-4b3a-b047-613560f6bd3f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:59.898111 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2641a0b3-e814-4b3a-b047-613560f6bd3f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1367 microversion: 2.1 time: 0.331945 Aug 29 15:51:59.899092 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3089/5985] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:59 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:00.120022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6a070795-94d0-4b34-b0bf-b691e123db32 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:00.135924 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6a070795-94d0-4b34-b0bf-b691e123db32 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.431567 Aug 29 15:52:00.138781 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2897/5986] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:59 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:00.405892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-624b339b-ae85-4429-8b06-144fc247f80b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:00.406540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-624b339b-ae85-4429-8b06-144fc247f80b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:00.418587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-624b339b-ae85-4429-8b06-144fc247f80b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:00.419295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-624b339b-ae85-4429-8b06-144fc247f80b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:00.419902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-624b339b-ae85-4429-8b06-144fc247f80b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:00.420800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-624b339b-ae85-4429-8b06-144fc247f80b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:00.421722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-624b339b-ae85-4429-8b06-144fc247f80b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:00.422335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-624b339b-ae85-4429-8b06-144fc247f80b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:00.614742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-948d4118-5f2d-45a6-ba97-d878baeff3e3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:00.615370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-948d4118-5f2d-45a6-ba97-d878baeff3e3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:00.627747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-948d4118-5f2d-45a6-ba97-d878baeff3e3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:00.628592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-948d4118-5f2d-45a6-ba97-d878baeff3e3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:00.629346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-948d4118-5f2d-45a6-ba97-d878baeff3e3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:00.630298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-948d4118-5f2d-45a6-ba97-d878baeff3e3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:00.630955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-948d4118-5f2d-45a6-ba97-d878baeff3e3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:00.631582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-948d4118-5f2d-45a6-ba97-d878baeff3e3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:00.717608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-624b339b-ae85-4429-8b06-144fc247f80b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:00.729483 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-624b339b-ae85-4429-8b06-144fc247f80b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1391 microversion: 2.1 time: 0.340939 Aug 29 15:52:00.730710 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3090/5987] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:00 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1391 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:00.883426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-948d4118-5f2d-45a6-ba97-d878baeff3e3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:00.902080 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-948d4118-5f2d-45a6-ba97-d878baeff3e3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.288944 Aug 29 15:52:00.903526 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2898/5988] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:00 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:00.924026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1f08a32c-543b-46c4-b9e1-5a6af286fd32 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:00.925364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1f08a32c-543b-46c4-b9e1-5a6af286fd32 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:00.933530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f08a32c-543b-46c4-b9e1-5a6af286fd32 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:00.934090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f08a32c-543b-46c4-b9e1-5a6af286fd32 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:00.934818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f08a32c-543b-46c4-b9e1-5a6af286fd32 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:00.935885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f08a32c-543b-46c4-b9e1-5a6af286fd32 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:00.936408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f08a32c-543b-46c4-b9e1-5a6af286fd32 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:00.936905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f08a32c-543b-46c4-b9e1-5a6af286fd32 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:01.162633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4f0118fa-d09c-4998-8edc-3bb56638161a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:01.164008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4f0118fa-d09c-4998-8edc-3bb56638161a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:01.171211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0118fa-d09c-4998-8edc-3bb56638161a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:01.172352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0118fa-d09c-4998-8edc-3bb56638161a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:01.173023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0118fa-d09c-4998-8edc-3bb56638161a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:01.173998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0118fa-d09c-4998-8edc-3bb56638161a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:01.174637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0118fa-d09c-4998-8edc-3bb56638161a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:01.175270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f0118fa-d09c-4998-8edc-3bb56638161a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:01.260492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1f08a32c-543b-46c4-b9e1-5a6af286fd32 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:01.269347 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1f08a32c-543b-46c4-b9e1-5a6af286fd32 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1367 microversion: 2.1 time: 0.349942 Aug 29 15:52:01.276937 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3091/5989] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:00 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:01.747944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4f0118fa-d09c-4998-8edc-3bb56638161a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:01.755342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-92195c55-dd18-467b-9974-54b1cc357941 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:01.755983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-92195c55-dd18-467b-9974-54b1cc357941 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:01.759457 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4f0118fa-d09c-4998-8edc-3bb56638161a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.602923 Aug 29 15:52:01.764782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92195c55-dd18-467b-9974-54b1cc357941 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:01.765554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92195c55-dd18-467b-9974-54b1cc357941 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:01.766212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92195c55-dd18-467b-9974-54b1cc357941 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:01.767291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92195c55-dd18-467b-9974-54b1cc357941 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:01.767948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92195c55-dd18-467b-9974-54b1cc357941 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:01.768702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-92195c55-dd18-467b-9974-54b1cc357941 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:01.776038 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2899/5990] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:01 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:01.921167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:01.923123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:01.928596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2f665bf2-5ab9-46f1-babd-ead604722f1e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:01.929950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2f665bf2-5ab9-46f1-babd-ead604722f1e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:01.937135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f665bf2-5ab9-46f1-babd-ead604722f1e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:01.938031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f665bf2-5ab9-46f1-babd-ead604722f1e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:01.938696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f665bf2-5ab9-46f1-babd-ead604722f1e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:01.939950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f665bf2-5ab9-46f1-babd-ead604722f1e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:01.940709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f665bf2-5ab9-46f1-babd-ead604722f1e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:01.941379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f665bf2-5ab9-46f1-babd-ead604722f1e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:02.013637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:02.024809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-92195c55-dd18-467b-9974-54b1cc357941 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:02.034582 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-92195c55-dd18-467b-9974-54b1cc357941 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1563 microversion: 2.1 time: 0.287342 Aug 29 15:52:02.038150 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3092/5991] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:01 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1563 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:02.065061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c939148e-2fca-4de6-822b-697bec3d5f2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:02.066088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c939148e-2fca-4de6-822b-697bec3d5f2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:02.072634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c939148e-2fca-4de6-822b-697bec3d5f2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:02.073942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c939148e-2fca-4de6-822b-697bec3d5f2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:02.074648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c939148e-2fca-4de6-822b-697bec3d5f2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:02.075718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c939148e-2fca-4de6-822b-697bec3d5f2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:02.076404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c939148e-2fca-4de6-822b-697bec3d5f2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:02.077114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c939148e-2fca-4de6-822b-697bec3d5f2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:02.227283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2f665bf2-5ab9-46f1-babd-ead604722f1e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:02.241948 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2f665bf2-5ab9-46f1-babd-ead604722f1e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.321620 Aug 29 15:52:02.243358 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2900/5992] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:01 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:02.305432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0b938435-ca39-4acc-a852-80c49640c13e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:02.306161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0b938435-ca39-4acc-a852-80c49640c13e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:02.314324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b938435-ca39-4acc-a852-80c49640c13e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:02.314901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b938435-ca39-4acc-a852-80c49640c13e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:02.315558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b938435-ca39-4acc-a852-80c49640c13e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:02.316679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b938435-ca39-4acc-a852-80c49640c13e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:02.317368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b938435-ca39-4acc-a852-80c49640c13e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:02.317853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b938435-ca39-4acc-a852-80c49640c13e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:02.358840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c939148e-2fca-4de6-822b-697bec3d5f2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:02.371294 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c939148e-2fca-4de6-822b-697bec3d5f2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1563 microversion: 2.1 time: 0.315060 Aug 29 15:52:02.389314 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3093/5993] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:02 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1563 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:02.740421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0b938435-ca39-4acc-a852-80c49640c13e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:02.749538 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0b938435-ca39-4acc-a852-80c49640c13e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1367 microversion: 2.1 time: 0.454856 Aug 29 15:52:02.751688 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2901/5994] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:02 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1367 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:02.781723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-15ccfbfb-c75e-42b2-8150-d432c0254961 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:02.782432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-15ccfbfb-c75e-42b2-8150-d432c0254961 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:02.799420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15ccfbfb-c75e-42b2-8150-d432c0254961 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:02.800171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15ccfbfb-c75e-42b2-8150-d432c0254961 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:02.800805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15ccfbfb-c75e-42b2-8150-d432c0254961 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:02.802069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15ccfbfb-c75e-42b2-8150-d432c0254961 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:02.805312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15ccfbfb-c75e-42b2-8150-d432c0254961 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:02.805895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15ccfbfb-c75e-42b2-8150-d432c0254961 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:03.141693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-15ccfbfb-c75e-42b2-8150-d432c0254961 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:03.156744 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-15ccfbfb-c75e-42b2-8150-d432c0254961 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.379296 Aug 29 15:52:03.158775 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3094/5995] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:02 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:03.265230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cb7a3210-c1fd-4327-8a23-e90aa51487b7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:03.266020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cb7a3210-c1fd-4327-8a23-e90aa51487b7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:03.275569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb7a3210-c1fd-4327-8a23-e90aa51487b7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:03.276291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb7a3210-c1fd-4327-8a23-e90aa51487b7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:03.276908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb7a3210-c1fd-4327-8a23-e90aa51487b7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:03.277799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb7a3210-c1fd-4327-8a23-e90aa51487b7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:03.279425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb7a3210-c1fd-4327-8a23-e90aa51487b7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:03.280065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb7a3210-c1fd-4327-8a23-e90aa51487b7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:03.690199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cb7a3210-c1fd-4327-8a23-e90aa51487b7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:03.701158 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cb7a3210-c1fd-4327-8a23-e90aa51487b7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.440599 Aug 29 15:52:03.707263 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2902/5996] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:03 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:03.774025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a3dd2ec2-7479-4d05-820e-0cec39c0d4e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:03.774826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a3dd2ec2-7479-4d05-820e-0cec39c0d4e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:03.790082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3dd2ec2-7479-4d05-820e-0cec39c0d4e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:03.794890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3dd2ec2-7479-4d05-820e-0cec39c0d4e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:03.795358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3dd2ec2-7479-4d05-820e-0cec39c0d4e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:03.796113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3dd2ec2-7479-4d05-820e-0cec39c0d4e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:03.796566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3dd2ec2-7479-4d05-820e-0cec39c0d4e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:03.802024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3dd2ec2-7479-4d05-820e-0cec39c0d4e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:04.126616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a3dd2ec2-7479-4d05-820e-0cec39c0d4e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:04.138748 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a3dd2ec2-7479-4d05-820e-0cec39c0d4e2 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1367 microversion: 2.1 time: 0.370479 Aug 29 15:52:04.140149 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3095/5997] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:03 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:04.186396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5c4a0f69-8e46-4b7f-bf90-31f6e1c19d13 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:04.187541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5c4a0f69-8e46-4b7f-bf90-31f6e1c19d13 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:04.200004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c4a0f69-8e46-4b7f-bf90-31f6e1c19d13 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:04.202615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c4a0f69-8e46-4b7f-bf90-31f6e1c19d13 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:04.204350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c4a0f69-8e46-4b7f-bf90-31f6e1c19d13 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:04.206633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c4a0f69-8e46-4b7f-bf90-31f6e1c19d13 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:04.209467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c4a0f69-8e46-4b7f-bf90-31f6e1c19d13 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:04.212096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c4a0f69-8e46-4b7f-bf90-31f6e1c19d13 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:04.729742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7a309c35-af1a-44b6-890c-0b3f1c1e9967 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:04.730544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7a309c35-af1a-44b6-890c-0b3f1c1e9967 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:04.730869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5c4a0f69-8e46-4b7f-bf90-31f6e1c19d13 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:04.733636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:04.741725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:04.743907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a309c35-af1a-44b6-890c-0b3f1c1e9967 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:04.744993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a309c35-af1a-44b6-890c-0b3f1c1e9967 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:04.746845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a309c35-af1a-44b6-890c-0b3f1c1e9967 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:04.748071 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5c4a0f69-8e46-4b7f-bf90-31f6e1c19d13 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.568356 Aug 29 15:52:04.748693 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2903/5998] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:04 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:04.750071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a309c35-af1a-44b6-890c-0b3f1c1e9967 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:04.750767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a309c35-af1a-44b6-890c-0b3f1c1e9967 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:04.751561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a309c35-af1a-44b6-890c-0b3f1c1e9967 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:05.082754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7a309c35-af1a-44b6-890c-0b3f1c1e9967 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:05.094590 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7a309c35-af1a-44b6-890c-0b3f1c1e9967 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.369585 Aug 29 15:52:05.109222 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3096/5999] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:04 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:05.161055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2ede8f35-75bb-4d74-83c6-aa4c01946688 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:05.161772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2ede8f35-75bb-4d74-83c6-aa4c01946688 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:05.176001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ede8f35-75bb-4d74-83c6-aa4c01946688 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:05.176709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ede8f35-75bb-4d74-83c6-aa4c01946688 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:05.177187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ede8f35-75bb-4d74-83c6-aa4c01946688 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:05.177976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ede8f35-75bb-4d74-83c6-aa4c01946688 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:05.178587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ede8f35-75bb-4d74-83c6-aa4c01946688 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:05.179195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ede8f35-75bb-4d74-83c6-aa4c01946688 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:05.511942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2ede8f35-75bb-4d74-83c6-aa4c01946688 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:05.523549 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2ede8f35-75bb-4d74-83c6-aa4c01946688 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1367 microversion: 2.1 time: 0.367102 Aug 29 15:52:05.536163 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2904/6000] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:05 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:05.772344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d48a85ae-b28d-461d-8cba-41e4a10244e3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:05.772988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d48a85ae-b28d-461d-8cba-41e4a10244e3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:05.784144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d48a85ae-b28d-461d-8cba-41e4a10244e3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:05.784986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d48a85ae-b28d-461d-8cba-41e4a10244e3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:05.786126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d48a85ae-b28d-461d-8cba-41e4a10244e3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:05.787245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d48a85ae-b28d-461d-8cba-41e4a10244e3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:05.788635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d48a85ae-b28d-461d-8cba-41e4a10244e3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:05.789779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d48a85ae-b28d-461d-8cba-41e4a10244e3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:05.878437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-c5882d0b-1814-4952-be8f-b7798c8e35a0 req-cba49c7e-9b56-46f0-a4d4-8f69955316a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52c16c7d-383b-4572-8c59-982ea4f677d0", "name": "network-vif-plugged", "status": "completed", "tag": "5d40b62c-10f3-4b72-bbef-f1f5d5fb1e4b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:05.891785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c5882d0b-1814-4952-be8f-b7798c8e35a0 req-cba49c7e-9b56-46f0-a4d4-8f69955316a4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:05.892523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c5882d0b-1814-4952-be8f-b7798c8e35a0 req-cba49c7e-9b56-46f0-a4d4-8f69955316a4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:05.892954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c5882d0b-1814-4952-be8f-b7798c8e35a0 req-cba49c7e-9b56-46f0-a4d4-8f69955316a4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:06.172033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d48a85ae-b28d-461d-8cba-41e4a10244e3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:06.207339 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d48a85ae-b28d-461d-8cba-41e4a10244e3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.438768 Aug 29 15:52:06.208342 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3097/6001] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:05 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:06.254235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e7e7ab94-6d92-4a8b-9925-2d4402ed7575 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:06.256282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e7e7ab94-6d92-4a8b-9925-2d4402ed7575 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:06.291043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7e7ab94-6d92-4a8b-9925-2d4402ed7575 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:06.291780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7e7ab94-6d92-4a8b-9925-2d4402ed7575 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:06.292250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7e7ab94-6d92-4a8b-9925-2d4402ed7575 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:06.293914 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-c5882d0b-1814-4952-be8f-b7798c8e35a0 req-cba49c7e-9b56-46f0-a4d4-8f69955316a4 service nova] Creating event network-vif-plugged:5d40b62c-10f3-4b72-bbef-f1f5d5fb1e4b for instance 52c16c7d-383b-4572-8c59-982ea4f677d0 on n-h1-839401-11 Aug 29 15:52:06.301186 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-c5882d0b-1814-4952-be8f-b7798c8e35a0 req-cba49c7e-9b56-46f0-a4d4-8f69955316a4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.428593 Aug 29 15:52:06.301376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7e7ab94-6d92-4a8b-9925-2d4402ed7575 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:06.301925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7e7ab94-6d92-4a8b-9925-2d4402ed7575 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:06.302372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7e7ab94-6d92-4a8b-9925-2d4402ed7575 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:06.302659 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2905/6002] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:52:06.554029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dbe2ad37-deea-4333-99d7-716f0a8e4479 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:06.554956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dbe2ad37-deea-4333-99d7-716f0a8e4479 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:06.567067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbe2ad37-deea-4333-99d7-716f0a8e4479 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:06.568373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbe2ad37-deea-4333-99d7-716f0a8e4479 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:06.569126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbe2ad37-deea-4333-99d7-716f0a8e4479 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:06.570469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbe2ad37-deea-4333-99d7-716f0a8e4479 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:06.571325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbe2ad37-deea-4333-99d7-716f0a8e4479 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:06.572958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dbe2ad37-deea-4333-99d7-716f0a8e4479 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:06.737922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e7e7ab94-6d92-4a8b-9925-2d4402ed7575 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:06.750280 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e7e7ab94-6d92-4a8b-9925-2d4402ed7575 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.540719 Aug 29 15:52:06.752084 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3098/6003] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:06 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:06.881045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dbe2ad37-deea-4333-99d7-716f0a8e4479 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:06.894882 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dbe2ad37-deea-4333-99d7-716f0a8e4479 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1367 microversion: 2.1 time: 0.350769 Aug 29 15:52:06.898217 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2906/6004] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:06 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:07.071632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6ef972b2-fc14-4f6a-9be2-160b9c84efcd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:07.072173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6ef972b2-fc14-4f6a-9be2-160b9c84efcd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:07.080114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ef972b2-fc14-4f6a-9be2-160b9c84efcd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.080618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ef972b2-fc14-4f6a-9be2-160b9c84efcd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.081339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ef972b2-fc14-4f6a-9be2-160b9c84efcd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.082263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ef972b2-fc14-4f6a-9be2-160b9c84efcd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.082885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ef972b2-fc14-4f6a-9be2-160b9c84efcd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.083468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ef972b2-fc14-4f6a-9be2-160b9c84efcd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.091127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f2c4e95b-0f8c-4b6c-957e-be19b629694c req-37dc56b2-20d8-49a1-9e74-f4032d541f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed2e48a2-4790-4e37-98b5-3dcd6375f222", "tag": "daa049ea-5255-46cb-a644-fb8d87623d38"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:07.101908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f2c4e95b-0f8c-4b6c-957e-be19b629694c req-37dc56b2-20d8-49a1-9e74-f4032d541f5c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.102846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f2c4e95b-0f8c-4b6c-957e-be19b629694c req-37dc56b2-20d8-49a1-9e74-f4032d541f5c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.103543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f2c4e95b-0f8c-4b6c-957e-be19b629694c req-37dc56b2-20d8-49a1-9e74-f4032d541f5c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.118283 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f2c4e95b-0f8c-4b6c-957e-be19b629694c req-37dc56b2-20d8-49a1-9e74-f4032d541f5c service nova] Creating event network-changed:daa049ea-5255-46cb-a644-fb8d87623d38 for instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 on n-h2-839401-11 Aug 29 15:52:07.128126 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f2c4e95b-0f8c-4b6c-957e-be19b629694c req-37dc56b2-20d8-49a1-9e74-f4032d541f5c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042331 Aug 29 15:52:07.129408 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2907/6005] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:52:07.235666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7fb9869b-6775-453e-8faa-92e6101fe00f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:07.236538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7fb9869b-6775-453e-8faa-92e6101fe00f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:07.250512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fb9869b-6775-453e-8faa-92e6101fe00f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.251661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fb9869b-6775-453e-8faa-92e6101fe00f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.254958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fb9869b-6775-453e-8faa-92e6101fe00f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.255998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fb9869b-6775-453e-8faa-92e6101fe00f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.257048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fb9869b-6775-453e-8faa-92e6101fe00f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.261948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7fb9869b-6775-453e-8faa-92e6101fe00f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.307325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6ef972b2-fc14-4f6a-9be2-160b9c84efcd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:07.316961 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6ef972b2-fc14-4f6a-9be2-160b9c84efcd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1563 microversion: 2.1 time: 0.249844 Aug 29 15:52:07.321920 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3099/6006] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:07 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:07.614681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7fb9869b-6775-453e-8faa-92e6101fe00f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:07.637697 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7fb9869b-6775-453e-8faa-92e6101fe00f tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.407465 Aug 29 15:52:07.640542 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2908/6007] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:07 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:07.774351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:07.775228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:07.786603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.787103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.787547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.788266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.791613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.792442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.923234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d3fcb528-0dda-4bd8-b4d0-db1edff9ddef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:07.924456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d3fcb528-0dda-4bd8-b4d0-db1edff9ddef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:07.937941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3fcb528-0dda-4bd8-b4d0-db1edff9ddef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.938809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3fcb528-0dda-4bd8-b4d0-db1edff9ddef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.939349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3fcb528-0dda-4bd8-b4d0-db1edff9ddef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.940096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3fcb528-0dda-4bd8-b4d0-db1edff9ddef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.940559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3fcb528-0dda-4bd8-b4d0-db1edff9ddef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.941499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3fcb528-0dda-4bd8-b4d0-db1edff9ddef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:08.161168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:08.172450 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.402124 Aug 29 15:52:08.178691 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3100/6008] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:07 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:08.288198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:08.290274 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002429 Aug 29 15:52:08.291259 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3101/6009] 10.222.0.62 () {56 vars in 886 bytes} [Mon Aug 29 15:52:08 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 29 15:52:08.299378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:08.302268 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002664 Aug 29 15:52:08.303501 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3102/6010] 10.222.0.62 () {54 vars in 1035 bytes} [Mon Aug 29 15:52:08 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 29 15:52:08.310386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:08.311642 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001812 Aug 29 15:52:08.312130 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3103/6011] 10.222.0.62 () {54 vars in 1041 bytes} [Mon Aug 29 15:52:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:52:08.320446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:08.321466 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-98abce8a-1429-45c9-aa59-dbe192e50cc8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001280 Aug 29 15:52:08.322053 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3104/6012] 10.222.0.62 () {56 vars in 886 bytes} [Mon Aug 29 15:52:08 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 15:52:08.463842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d3fcb528-0dda-4bd8-b4d0-db1edff9ddef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:08.476495 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d3fcb528-0dda-4bd8-b4d0-db1edff9ddef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1367 microversion: 2.1 time: 0.561632 Aug 29 15:52:08.491675 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2909/6013] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:07 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1367 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:08.671038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1aff57c6-94c3-4c48-ba94-8604368a999d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:08.672468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1aff57c6-94c3-4c48-ba94-8604368a999d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:08.683398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1aff57c6-94c3-4c48-ba94-8604368a999d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:08.690228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1aff57c6-94c3-4c48-ba94-8604368a999d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:08.691248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1aff57c6-94c3-4c48-ba94-8604368a999d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:08.693519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1aff57c6-94c3-4c48-ba94-8604368a999d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:08.694543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1aff57c6-94c3-4c48-ba94-8604368a999d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:08.695637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1aff57c6-94c3-4c48-ba94-8604368a999d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:08.885857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1aff57c6-94c3-4c48-ba94-8604368a999d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:08.899084 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1aff57c6-94c3-4c48-ba94-8604368a999d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.235910 Aug 29 15:52:08.899867 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3105/6014] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:08 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:09.200310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6ebf650f-1d71-437d-ac84-b072053e70b6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:09.201495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6ebf650f-1d71-437d-ac84-b072053e70b6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:09.208429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ebf650f-1d71-437d-ac84-b072053e70b6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:09.209113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ebf650f-1d71-437d-ac84-b072053e70b6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:09.209704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ebf650f-1d71-437d-ac84-b072053e70b6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:09.210564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ebf650f-1d71-437d-ac84-b072053e70b6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:09.211205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ebf650f-1d71-437d-ac84-b072053e70b6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:09.211807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ebf650f-1d71-437d-ac84-b072053e70b6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:09.370687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6ebf650f-1d71-437d-ac84-b072053e70b6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:09.379804 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6ebf650f-1d71-437d-ac84-b072053e70b6 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.184080 Aug 29 15:52:09.380405 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2910/6015] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:09 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:09.505805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-01d5e1ce-232e-4a6d-970b-9791fb5e4b0e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:09.506673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-01d5e1ce-232e-4a6d-970b-9791fb5e4b0e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:09.515249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01d5e1ce-232e-4a6d-970b-9791fb5e4b0e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:09.516001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01d5e1ce-232e-4a6d-970b-9791fb5e4b0e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:09.516656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01d5e1ce-232e-4a6d-970b-9791fb5e4b0e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:09.517497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01d5e1ce-232e-4a6d-970b-9791fb5e4b0e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:09.518204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01d5e1ce-232e-4a6d-970b-9791fb5e4b0e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:09.518646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01d5e1ce-232e-4a6d-970b-9791fb5e4b0e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:09.676096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-01d5e1ce-232e-4a6d-970b-9791fb5e4b0e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:09.694294 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-01d5e1ce-232e-4a6d-970b-9791fb5e4b0e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1556 microversion: 2.1 time: 0.193408 Aug 29 15:52:09.710013 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3106/6016] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:09 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1556 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:09.722549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5998e4e1-0991-433e-8b0d-3a225e3469c1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:09.723520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5998e4e1-0991-433e-8b0d-3a225e3469c1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:09.735038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5998e4e1-0991-433e-8b0d-3a225e3469c1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:09.735545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5998e4e1-0991-433e-8b0d-3a225e3469c1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:09.736214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5998e4e1-0991-433e-8b0d-3a225e3469c1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:09.737111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5998e4e1-0991-433e-8b0d-3a225e3469c1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:09.737734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5998e4e1-0991-433e-8b0d-3a225e3469c1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:09.738315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5998e4e1-0991-433e-8b0d-3a225e3469c1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:09.848891 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5998e4e1-0991-433e-8b0d-3a225e3469c1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131247 Aug 29 15:52:09.849538 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2911/6017] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:52:09 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:09.922236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6ced3ab4-f61a-40df-90d1-1f43e32c26a5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:09.923034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6ced3ab4-f61a-40df-90d1-1f43e32c26a5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:09.934871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ced3ab4-f61a-40df-90d1-1f43e32c26a5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:09.937539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ced3ab4-f61a-40df-90d1-1f43e32c26a5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:09.938414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ced3ab4-f61a-40df-90d1-1f43e32c26a5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:09.940029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ced3ab4-f61a-40df-90d1-1f43e32c26a5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:09.942758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ced3ab4-f61a-40df-90d1-1f43e32c26a5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:09.944417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ced3ab4-f61a-40df-90d1-1f43e32c26a5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:10.206065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6ced3ab4-f61a-40df-90d1-1f43e32c26a5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:10.219276 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6ced3ab4-f61a-40df-90d1-1f43e32c26a5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.301159 Aug 29 15:52:10.234155 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3107/6018] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:09 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:10.410442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ef1992b5-dcf7-44a3-98cb-7f857675f5e0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:10.411875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ef1992b5-dcf7-44a3-98cb-7f857675f5e0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:10.443990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef1992b5-dcf7-44a3-98cb-7f857675f5e0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:10.444716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef1992b5-dcf7-44a3-98cb-7f857675f5e0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:10.445193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef1992b5-dcf7-44a3-98cb-7f857675f5e0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:10.447349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef1992b5-dcf7-44a3-98cb-7f857675f5e0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:10.455399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef1992b5-dcf7-44a3-98cb-7f857675f5e0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:10.456849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef1992b5-dcf7-44a3-98cb-7f857675f5e0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:10.802654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ef1992b5-dcf7-44a3-98cb-7f857675f5e0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:10.817965 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ef1992b5-dcf7-44a3-98cb-7f857675f5e0 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.418953 Aug 29 15:52:10.832234 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2912/6019] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:10 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:11.244914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8f52d25c-f367-4e82-9fcd-1fc539a3e871 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:11.246329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8f52d25c-f367-4e82-9fcd-1fc539a3e871 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:11.255057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f52d25c-f367-4e82-9fcd-1fc539a3e871 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:11.255969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f52d25c-f367-4e82-9fcd-1fc539a3e871 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:11.256597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f52d25c-f367-4e82-9fcd-1fc539a3e871 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:11.257728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f52d25c-f367-4e82-9fcd-1fc539a3e871 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:11.258377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f52d25c-f367-4e82-9fcd-1fc539a3e871 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:11.259328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f52d25c-f367-4e82-9fcd-1fc539a3e871 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:11.574002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-c4a3a641-c5ac-42ac-942e-03d0c4dbd379 req-a0513302-0564-457a-a7f8-bcc3b939b502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52c16c7d-383b-4572-8c59-982ea4f677d0", "tag": "5d40b62c-10f3-4b72-bbef-f1f5d5fb1e4b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:11.588402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c4a3a641-c5ac-42ac-942e-03d0c4dbd379 req-a0513302-0564-457a-a7f8-bcc3b939b502 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:11.588934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c4a3a641-c5ac-42ac-942e-03d0c4dbd379 req-a0513302-0564-457a-a7f8-bcc3b939b502 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:11.589398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c4a3a641-c5ac-42ac-942e-03d0c4dbd379 req-a0513302-0564-457a-a7f8-bcc3b939b502 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:11.607676 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-c4a3a641-c5ac-42ac-942e-03d0c4dbd379 req-a0513302-0564-457a-a7f8-bcc3b939b502 service nova] Creating event network-changed:5d40b62c-10f3-4b72-bbef-f1f5d5fb1e4b for instance 52c16c7d-383b-4572-8c59-982ea4f677d0 on n-h1-839401-11 Aug 29 15:52:11.613978 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-c4a3a641-c5ac-42ac-942e-03d0c4dbd379 req-a0513302-0564-457a-a7f8-bcc3b939b502 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045394 Aug 29 15:52:11.618749 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2913/6020] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:52:11.843188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d59bef31-c707-4a41-beae-10d8207ad0ed tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:11.844724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d59bef31-c707-4a41-beae-10d8207ad0ed tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:11.855257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d59bef31-c707-4a41-beae-10d8207ad0ed tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:11.855748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d59bef31-c707-4a41-beae-10d8207ad0ed tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:11.856379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d59bef31-c707-4a41-beae-10d8207ad0ed tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:11.857327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d59bef31-c707-4a41-beae-10d8207ad0ed tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:11.857787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d59bef31-c707-4a41-beae-10d8207ad0ed tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:11.858858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d59bef31-c707-4a41-beae-10d8207ad0ed tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:11.984572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8f52d25c-f367-4e82-9fcd-1fc539a3e871 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:11.988287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:12.005135 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8f52d25c-f367-4e82-9fcd-1fc539a3e871 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.760550 Aug 29 15:52:12.006970 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3108/6021] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:11 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:12.403914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d59bef31-c707-4a41-beae-10d8207ad0ed tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:12.416539 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d59bef31-c707-4a41-beae-10d8207ad0ed tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.579379 Aug 29 15:52:12.417606 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2914/6022] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:11 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:13.029326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ef452765-131b-4d2d-9cf1-5fb4a45cd238 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:13.030262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ef452765-131b-4d2d-9cf1-5fb4a45cd238 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:13.041730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef452765-131b-4d2d-9cf1-5fb4a45cd238 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:13.042214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef452765-131b-4d2d-9cf1-5fb4a45cd238 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:13.042652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef452765-131b-4d2d-9cf1-5fb4a45cd238 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:13.043362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef452765-131b-4d2d-9cf1-5fb4a45cd238 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:13.052761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef452765-131b-4d2d-9cf1-5fb4a45cd238 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:13.053348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef452765-131b-4d2d-9cf1-5fb4a45cd238 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:13.440955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ef452765-131b-4d2d-9cf1-5fb4a45cd238 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:13.445059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3148dc74-93f8-4e3f-b164-10485a39ecd7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:13.445687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3148dc74-93f8-4e3f-b164-10485a39ecd7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:13.456218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3148dc74-93f8-4e3f-b164-10485a39ecd7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:13.456738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3148dc74-93f8-4e3f-b164-10485a39ecd7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:13.470467 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ef452765-131b-4d2d-9cf1-5fb4a45cd238 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.445021 Aug 29 15:52:13.473608 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3109/6023] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:13 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:13.474076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3148dc74-93f8-4e3f-b164-10485a39ecd7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:13.475874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3148dc74-93f8-4e3f-b164-10485a39ecd7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:13.477630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3148dc74-93f8-4e3f-b164-10485a39ecd7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:13.478089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3148dc74-93f8-4e3f-b164-10485a39ecd7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:13.721700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3148dc74-93f8-4e3f-b164-10485a39ecd7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:13.731864 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3148dc74-93f8-4e3f-b164-10485a39ecd7 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.297396 Aug 29 15:52:13.750237 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2915/6024] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:13 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:14.496052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b3af3ac7-9d0f-45f1-b0a4-e867019a84c9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:14.497415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b3af3ac7-9d0f-45f1-b0a4-e867019a84c9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:14.509782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3af3ac7-9d0f-45f1-b0a4-e867019a84c9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:14.511303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3af3ac7-9d0f-45f1-b0a4-e867019a84c9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:14.511944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3af3ac7-9d0f-45f1-b0a4-e867019a84c9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:14.512847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3af3ac7-9d0f-45f1-b0a4-e867019a84c9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:14.513521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3af3ac7-9d0f-45f1-b0a4-e867019a84c9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:14.514143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3af3ac7-9d0f-45f1-b0a4-e867019a84c9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:14.760887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a9e724f6-8268-479a-8345-30a91cba0dfe tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:14.761636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a9e724f6-8268-479a-8345-30a91cba0dfe tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:14.770001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9e724f6-8268-479a-8345-30a91cba0dfe tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:14.770505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9e724f6-8268-479a-8345-30a91cba0dfe tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:14.771193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9e724f6-8268-479a-8345-30a91cba0dfe tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:14.772100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9e724f6-8268-479a-8345-30a91cba0dfe tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:14.772893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9e724f6-8268-479a-8345-30a91cba0dfe tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:14.773547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9e724f6-8268-479a-8345-30a91cba0dfe tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:14.875182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b3af3ac7-9d0f-45f1-b0a4-e867019a84c9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:14.893495 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b3af3ac7-9d0f-45f1-b0a4-e867019a84c9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.401882 Aug 29 15:52:14.894653 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3110/6025] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:14 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:15.010268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a9e724f6-8268-479a-8345-30a91cba0dfe tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:15.019917 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a9e724f6-8268-479a-8345-30a91cba0dfe tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.266191 Aug 29 15:52:15.021220 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2916/6026] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:14 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:15.919040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f2b4045b-5810-44af-8dd5-8e48fd4029d1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:15.921464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f2b4045b-5810-44af-8dd5-8e48fd4029d1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:15.939558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2b4045b-5810-44af-8dd5-8e48fd4029d1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:15.941776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2b4045b-5810-44af-8dd5-8e48fd4029d1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:15.943336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2b4045b-5810-44af-8dd5-8e48fd4029d1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:15.946323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2b4045b-5810-44af-8dd5-8e48fd4029d1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:15.947569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2b4045b-5810-44af-8dd5-8e48fd4029d1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:15.948845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2b4045b-5810-44af-8dd5-8e48fd4029d1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:16.048165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2059960d-14cd-4a1b-a435-bde776e11639 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:16.049789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2059960d-14cd-4a1b-a435-bde776e11639 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:16.060998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2059960d-14cd-4a1b-a435-bde776e11639 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:16.061544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2059960d-14cd-4a1b-a435-bde776e11639 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:16.061992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2059960d-14cd-4a1b-a435-bde776e11639 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:16.065816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2059960d-14cd-4a1b-a435-bde776e11639 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:16.066488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2059960d-14cd-4a1b-a435-bde776e11639 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:16.067978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2059960d-14cd-4a1b-a435-bde776e11639 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:16.382567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2059960d-14cd-4a1b-a435-bde776e11639 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:16.392789 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2059960d-14cd-4a1b-a435-bde776e11639 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.355689 Aug 29 15:52:16.393440 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2917/6027] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:16 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:16.433138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f2b4045b-5810-44af-8dd5-8e48fd4029d1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:16.445778 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f2b4045b-5810-44af-8dd5-8e48fd4029d1 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.533963 Aug 29 15:52:16.449763 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3111/6028] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:15 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:17.415763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a680ced9-a39e-4675-999b-45fa64419d6d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:17.417369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a680ced9-a39e-4675-999b-45fa64419d6d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:17.424995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:17.430026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a680ced9-a39e-4675-999b-45fa64419d6d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:17.430824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a680ced9-a39e-4675-999b-45fa64419d6d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:17.431405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a680ced9-a39e-4675-999b-45fa64419d6d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:17.434337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a680ced9-a39e-4675-999b-45fa64419d6d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:17.434575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a680ced9-a39e-4675-999b-45fa64419d6d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:17.436270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a680ced9-a39e-4675-999b-45fa64419d6d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:17.472501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-42a29629-a258-471c-bed1-9726ad96b755 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:17.473155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-42a29629-a258-471c-bed1-9726ad96b755 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:17.487501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42a29629-a258-471c-bed1-9726ad96b755 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:17.488042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42a29629-a258-471c-bed1-9726ad96b755 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:17.488499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42a29629-a258-471c-bed1-9726ad96b755 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:17.499717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42a29629-a258-471c-bed1-9726ad96b755 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:17.505256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42a29629-a258-471c-bed1-9726ad96b755 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:17.516277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42a29629-a258-471c-bed1-9726ad96b755 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:17.776607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a680ced9-a39e-4675-999b-45fa64419d6d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:17.804222 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a680ced9-a39e-4675-999b-45fa64419d6d tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.391668 Aug 29 15:52:17.805946 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2918/6029] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:17 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:18.012386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-42a29629-a258-471c-bed1-9726ad96b755 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:18.038107 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-42a29629-a258-471c-bed1-9726ad96b755 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.570928 Aug 29 15:52:18.040771 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3112/6030] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:17 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:18.836057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fd97c09b-ef53-47e8-823e-b563f563c625 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:18.836676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fd97c09b-ef53-47e8-823e-b563f563c625 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:18.859964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd97c09b-ef53-47e8-823e-b563f563c625 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:18.860701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd97c09b-ef53-47e8-823e-b563f563c625 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:18.861707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd97c09b-ef53-47e8-823e-b563f563c625 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:18.862502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd97c09b-ef53-47e8-823e-b563f563c625 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:18.863313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd97c09b-ef53-47e8-823e-b563f563c625 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:18.863983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd97c09b-ef53-47e8-823e-b563f563c625 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:19.071505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fd97c09b-ef53-47e8-823e-b563f563c625 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:19.080223 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fd97c09b-ef53-47e8-823e-b563f563c625 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1510 microversion: 2.1 time: 0.251652 Aug 29 15:52:19.081286 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2919/6031] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:18 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:19.086345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ab1ce9e2-1704-4c8e-8634-175c9d030029 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:19.087152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ab1ce9e2-1704-4c8e-8634-175c9d030029 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:19.094060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab1ce9e2-1704-4c8e-8634-175c9d030029 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:19.094816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab1ce9e2-1704-4c8e-8634-175c9d030029 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:19.095546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab1ce9e2-1704-4c8e-8634-175c9d030029 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:19.096414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab1ce9e2-1704-4c8e-8634-175c9d030029 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:19.096878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab1ce9e2-1704-4c8e-8634-175c9d030029 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:19.097489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab1ce9e2-1704-4c8e-8634-175c9d030029 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:19.288906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ab1ce9e2-1704-4c8e-8634-175c9d030029 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:19.307592 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ab1ce9e2-1704-4c8e-8634-175c9d030029 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.221996 Aug 29 15:52:19.308218 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2920/6032] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:19 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:19.431307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ca052afe-3275-4e67-ae15-54135f8f3d47 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Action: 'create', calling method: .version_select at 0x7fc42a6fe3a0>, body: {"keypair": {"name": "tempest-keypair-61291724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN3TRbsckTjj34RjoGf/6zloF+x5chU/DwbtFdhkuo57cgR+OezkW8V3eEyiFCpiwGpIlkstrC6FS/xzhdVY8uLHDfzzxWI/08Q2Db6R68EqDgDVNfGM2O5j7+PJ4kbXg=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:19.476841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-ca052afe-3275-4e67-ae15-54135f8f3d47 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Getting quotas for project 8fce4f5819b946bc907d71bec14ecbdf. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:52:19.490326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-ca052afe-3275-4e67-ae15-54135f8f3d47 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Getting quotas for user d6fae8e2411942caabfbb819f182a8a5 and project 8fce4f5819b946bc907d71bec14ecbdf. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:52:19.546039 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ca052afe-3275-4e67-ae15-54135f8f3d47 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.504720 Aug 29 15:52:19.555040 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3113/6033] 10.222.0.62 () {62 vars in 1200 bytes} [Mon Aug 29 15:52:19 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 513 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:52:20.102415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b890e16d-6643-4367-8a48-4df60c8068dc tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:20.103026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b890e16d-6643-4367-8a48-4df60c8068dc tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:20.115996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b890e16d-6643-4367-8a48-4df60c8068dc tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:20.116521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b890e16d-6643-4367-8a48-4df60c8068dc tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:20.116965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b890e16d-6643-4367-8a48-4df60c8068dc tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:20.117731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b890e16d-6643-4367-8a48-4df60c8068dc tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:20.118179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b890e16d-6643-4367-8a48-4df60c8068dc tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:20.121452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b890e16d-6643-4367-8a48-4df60c8068dc tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:20.321772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b890e16d-6643-4367-8a48-4df60c8068dc tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:20.329773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2c8dae17-d236-487a-8a09-c807b8833625 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:20.330389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2c8dae17-d236-487a-8a09-c807b8833625 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:20.331293 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b890e16d-6643-4367-8a48-4df60c8068dc tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1487 microversion: 2.1 time: 0.233172 Aug 29 15:52:20.333463 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2921/6034] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:20 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1487 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:20.342395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c8dae17-d236-487a-8a09-c807b8833625 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:20.342887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c8dae17-d236-487a-8a09-c807b8833625 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:20.343331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c8dae17-d236-487a-8a09-c807b8833625 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:20.344064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c8dae17-d236-487a-8a09-c807b8833625 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:20.344517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c8dae17-d236-487a-8a09-c807b8833625 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:20.344936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2c8dae17-d236-487a-8a09-c807b8833625 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:20.353902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-304817ee-dec7-40d1-8c8e-f4bfe0177393 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-429475469"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:20.358021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-304817ee-dec7-40d1-8c8e-f4bfe0177393 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:20.366310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-304817ee-dec7-40d1-8c8e-f4bfe0177393 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:20.367309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-304817ee-dec7-40d1-8c8e-f4bfe0177393 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:20.368017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-304817ee-dec7-40d1-8c8e-f4bfe0177393 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:20.369485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-304817ee-dec7-40d1-8c8e-f4bfe0177393 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:20.370334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-304817ee-dec7-40d1-8c8e-f4bfe0177393 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:20.371012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-304817ee-dec7-40d1-8c8e-f4bfe0177393 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:20.455479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:20.472000 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-304817ee-dec7-40d1-8c8e-f4bfe0177393 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "PUT /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1059 microversion: 2.1 time: 0.121810 Aug 29 15:52:20.473517 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2922/6035] 10.222.0.62 () {60 vars in 1256 bytes} [Mon Aug 29 15:52:20 2022] PUT /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1059 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:20.490645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-18c8b281-8e12-4058-a551-503c597261ea tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:20.492375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-18c8b281-8e12-4058-a551-503c597261ea tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:20.499175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18c8b281-8e12-4058-a551-503c597261ea tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:20.500461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18c8b281-8e12-4058-a551-503c597261ea tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:20.501227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18c8b281-8e12-4058-a551-503c597261ea tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:20.503105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18c8b281-8e12-4058-a551-503c597261ea tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:20.504043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18c8b281-8e12-4058-a551-503c597261ea tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:20.504758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18c8b281-8e12-4058-a551-503c597261ea tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:20.719200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-18c8b281-8e12-4058-a551-503c597261ea tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:20.734636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2c8dae17-d236-487a-8a09-c807b8833625 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:20.785319 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2c8dae17-d236-487a-8a09-c807b8833625 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.458813 Aug 29 15:52:20.787291 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3114/6036] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:20 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:20.806527 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-18c8b281-8e12-4058-a551-503c597261ea tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1486 microversion: 2.1 time: 0.319289 Aug 29 15:52:20.808057 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2923/6037] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:20 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1486 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:20.838811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5044ba8c-2d90-4622-9fc7-c1b57098b7c8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:20.840166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5044ba8c-2d90-4622-9fc7-c1b57098b7c8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:20.866387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5044ba8c-2d90-4622-9fc7-c1b57098b7c8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:20.868703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5044ba8c-2d90-4622-9fc7-c1b57098b7c8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:20.872176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5044ba8c-2d90-4622-9fc7-c1b57098b7c8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:20.876145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5044ba8c-2d90-4622-9fc7-c1b57098b7c8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:20.877072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5044ba8c-2d90-4622-9fc7-c1b57098b7c8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:20.878021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5044ba8c-2d90-4622-9fc7-c1b57098b7c8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:21.155701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5044ba8c-2d90-4622-9fc7-c1b57098b7c8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:21.166405 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5044ba8c-2d90-4622-9fc7-c1b57098b7c8 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1486 microversion: 2.1 time: 0.335081 Aug 29 15:52:21.168106 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3115/6038] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:20 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1486 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:21.188907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6aa08657-651f-4144-929e-89f0bb4a8900 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:21.189608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6aa08657-651f-4144-929e-89f0bb4a8900 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:21.197482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa08657-651f-4144-929e-89f0bb4a8900 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:21.198283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa08657-651f-4144-929e-89f0bb4a8900 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:21.198923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa08657-651f-4144-929e-89f0bb4a8900 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:21.199822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa08657-651f-4144-929e-89f0bb4a8900 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:21.200458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa08657-651f-4144-929e-89f0bb4a8900 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:21.201103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aa08657-651f-4144-929e-89f0bb4a8900 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:21.239705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6aa08657-651f-4144-929e-89f0bb4a8900 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:52:21.356847 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6aa08657-651f-4144-929e-89f0bb4a8900 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 204 len: 0 microversion: 2.1 time: 0.170688 Aug 29 15:52:21.357937 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2924/6039] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:52:21 2022] DELETE /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:52:21.368280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4b879782-12d2-4543-906d-a0b3ba5dc7d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:21.368950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4b879782-12d2-4543-906d-a0b3ba5dc7d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:21.380051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b879782-12d2-4543-906d-a0b3ba5dc7d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:21.380605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b879782-12d2-4543-906d-a0b3ba5dc7d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:21.381329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b879782-12d2-4543-906d-a0b3ba5dc7d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:21.382490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b879782-12d2-4543-906d-a0b3ba5dc7d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:21.382957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b879782-12d2-4543-906d-a0b3ba5dc7d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:21.384453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b879782-12d2-4543-906d-a0b3ba5dc7d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:21.621859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4b879782-12d2-4543-906d-a0b3ba5dc7d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:21.635374 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4b879782-12d2-4543-906d-a0b3ba5dc7d3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1492 microversion: 2.1 time: 0.272650 Aug 29 15:52:21.636314 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3116/6040] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:21 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1492 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:21.808785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-23ebbfeb-79a2-4abc-870c-ca0c6ac8b9e7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:21.809525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-23ebbfeb-79a2-4abc-870c-ca0c6ac8b9e7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:21.824866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23ebbfeb-79a2-4abc-870c-ca0c6ac8b9e7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:21.825406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23ebbfeb-79a2-4abc-870c-ca0c6ac8b9e7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:21.826146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23ebbfeb-79a2-4abc-870c-ca0c6ac8b9e7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:21.826871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23ebbfeb-79a2-4abc-870c-ca0c6ac8b9e7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:21.827339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23ebbfeb-79a2-4abc-870c-ca0c6ac8b9e7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:21.827774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23ebbfeb-79a2-4abc-870c-ca0c6ac8b9e7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:21.877905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-994783751", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75462ae6-c197-4fad-8ddf-2c69c9916b43"}], "security_groups": [{"name": "tempest-securitygroup--1913252936"}], "key_name": "tempest-keypair-61291724", "user_data": "}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:22.022734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] validate_networks() for [('75462ae6-c197-4fad-8ddf-2c69c9916b43', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:52:22.062032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-23ebbfeb-79a2-4abc-870c-ca0c6ac8b9e7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:22.077118 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-23ebbfeb-79a2-4abc-870c-ca0c6ac8b9e7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.272487 Aug 29 15:52:22.078507 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2925/6041] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:21 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:22.666837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e0d191df-6ad6-4f46-b0b3-2a55f2f75590 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:22.667525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e0d191df-6ad6-4f46-b0b3-2a55f2f75590 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:22.678928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0d191df-6ad6-4f46-b0b3-2a55f2f75590 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:22.680172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0d191df-6ad6-4f46-b0b3-2a55f2f75590 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:22.680878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0d191df-6ad6-4f46-b0b3-2a55f2f75590 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:22.681944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0d191df-6ad6-4f46-b0b3-2a55f2f75590 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:22.682808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0d191df-6ad6-4f46-b0b3-2a55f2f75590 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:22.683424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0d191df-6ad6-4f46-b0b3-2a55f2f75590 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:22.760529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:52:22.761019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:52:22.762757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:52:22.763171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:52:22.763595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:52:22.787687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:22.788184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:22.788623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:22.789410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:22.789871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:22.790295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:22.813605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Getting quotas for project 8fce4f5819b946bc907d71bec14ecbdf. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:52:22.824474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Getting quotas for user d6fae8e2411942caabfbb819f182a8a5 and project 8fce4f5819b946bc907d71bec14ecbdf. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:52:22.847263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:52:22.852637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:52:22.916895 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a23a342b-386d-48d2-9730-5b9bea78d992 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.043227 Aug 29 15:52:22.923599 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3117/6042] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:52:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:52:22.929772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c7d817b7-26e5-4d9f-aa58-df7496289e5f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:22.930588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c7d817b7-26e5-4d9f-aa58-df7496289e5f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:22.959332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e0d191df-6ad6-4f46-b0b3-2a55f2f75590 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:22.970654 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e0d191df-6ad6-4f46-b0b3-2a55f2f75590 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1492 microversion: 2.1 time: 0.317182 Aug 29 15:52:22.974915 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2926/6043] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:22 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1492 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:23.039499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c7d817b7-26e5-4d9f-aa58-df7496289e5f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:23.050026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c7d817b7-26e5-4d9f-aa58-df7496289e5f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:23.053652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c7d817b7-26e5-4d9f-aa58-df7496289e5f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:23.058065 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c7d817b7-26e5-4d9f-aa58-df7496289e5f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1279 microversion: 2.20 time: 0.133104 Aug 29 15:52:23.058938 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3118/6044] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:22 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1279 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:23.102393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-66bc6485-8d4e-4fc6-bfe4-ba9992a4c661 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:23.103006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-66bc6485-8d4e-4fc6-bfe4-ba9992a4c661 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:23.113037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66bc6485-8d4e-4fc6-bfe4-ba9992a4c661 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:23.113558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66bc6485-8d4e-4fc6-bfe4-ba9992a4c661 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:23.121585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66bc6485-8d4e-4fc6-bfe4-ba9992a4c661 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:23.122431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66bc6485-8d4e-4fc6-bfe4-ba9992a4c661 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:23.122929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66bc6485-8d4e-4fc6-bfe4-ba9992a4c661 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:23.123433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66bc6485-8d4e-4fc6-bfe4-ba9992a4c661 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:23.548366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-66bc6485-8d4e-4fc6-bfe4-ba9992a4c661 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:23.572638 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-66bc6485-8d4e-4fc6-bfe4-ba9992a4c661 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.474301 Aug 29 15:52:23.585129 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2927/6045] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:23 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:23.995083 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24ebe515-eb47-419b-a5df-9aac61c11f3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:23.995589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-24ebe515-eb47-419b-a5df-9aac61c11f3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:24.011984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24ebe515-eb47-419b-a5df-9aac61c11f3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:24.012490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24ebe515-eb47-419b-a5df-9aac61c11f3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:24.012992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24ebe515-eb47-419b-a5df-9aac61c11f3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:24.013751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24ebe515-eb47-419b-a5df-9aac61c11f3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:24.014223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24ebe515-eb47-419b-a5df-9aac61c11f3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:24.014722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24ebe515-eb47-419b-a5df-9aac61c11f3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:24.082933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a552ecce-894d-4bee-bb46-b144b3b8d4ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:24.083832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a552ecce-894d-4bee-bb46-b144b3b8d4ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:24.106731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a552ecce-894d-4bee-bb46-b144b3b8d4ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:24.110338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a552ecce-894d-4bee-bb46-b144b3b8d4ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:24.113412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a552ecce-894d-4bee-bb46-b144b3b8d4ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:24.115205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a552ecce-894d-4bee-bb46-b144b3b8d4ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:24.118144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a552ecce-894d-4bee-bb46-b144b3b8d4ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:24.120361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a552ecce-894d-4bee-bb46-b144b3b8d4ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:24.155162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-24ebe515-eb47-419b-a5df-9aac61c11f3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:24.164365 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-24ebe515-eb47-419b-a5df-9aac61c11f3f tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1450 microversion: 2.1 time: 0.173477 Aug 29 15:52:24.165102 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3119/6046] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:23 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1450 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:24.249559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-6ae6d45c-40a3-441b-a34c-d540e76fe3cd req-6e9b3624-1be5-4266-aae7-fc99634b4919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7354e9a0-2795-4a98-a91d-6669a3b353f0", "name": "network-vif-deleted", "tag": "61b03ce4-5865-4462-8365-bbc3595caa3d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:24.266509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a552ecce-894d-4bee-bb46-b144b3b8d4ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:24.273551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6ae6d45c-40a3-441b-a34c-d540e76fe3cd req-6e9b3624-1be5-4266-aae7-fc99634b4919 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:24.274381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6ae6d45c-40a3-441b-a34c-d540e76fe3cd req-6e9b3624-1be5-4266-aae7-fc99634b4919 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:24.274998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6ae6d45c-40a3-441b-a34c-d540e76fe3cd req-6e9b3624-1be5-4266-aae7-fc99634b4919 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:24.289000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a552ecce-894d-4bee-bb46-b144b3b8d4ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:24.290871 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-6ae6d45c-40a3-441b-a34c-d540e76fe3cd req-6e9b3624-1be5-4266-aae7-fc99634b4919 service nova] Creating event network-vif-deleted:61b03ce4-5865-4462-8365-bbc3595caa3d for instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 on n-h1-839401-11 Aug 29 15:52:24.292948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a552ecce-894d-4bee-bb46-b144b3b8d4ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:24.301377 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-6ae6d45c-40a3-441b-a34c-d540e76fe3cd req-6e9b3624-1be5-4266-aae7-fc99634b4919 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054496 Aug 29 15:52:24.303684 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a552ecce-894d-4bee-bb46-b144b3b8d4ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1331 microversion: 2.20 time: 0.223003 Aug 29 15:52:24.306176 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2928/6047] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:24 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1331 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:24.306733 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3120/6048] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:24.600020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8524e5a5-d897-4372-8683-c5b918e89f30 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:24.600635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8524e5a5-d897-4372-8683-c5b918e89f30 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:24.608393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8524e5a5-d897-4372-8683-c5b918e89f30 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:24.608891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8524e5a5-d897-4372-8683-c5b918e89f30 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:24.621675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8524e5a5-d897-4372-8683-c5b918e89f30 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:24.622666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8524e5a5-d897-4372-8683-c5b918e89f30 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:24.623131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8524e5a5-d897-4372-8683-c5b918e89f30 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:24.623609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8524e5a5-d897-4372-8683-c5b918e89f30 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:24.808762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8524e5a5-d897-4372-8683-c5b918e89f30 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:24.822062 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8524e5a5-d897-4372-8683-c5b918e89f30 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.225933 Aug 29 15:52:24.823246 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2929/6049] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:24 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:25.193769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e57a2056-414e-41f1-b3a0-979f62eb54f3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:25.195970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e57a2056-414e-41f1-b3a0-979f62eb54f3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:25.213908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e57a2056-414e-41f1-b3a0-979f62eb54f3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:25.216164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e57a2056-414e-41f1-b3a0-979f62eb54f3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:25.217127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e57a2056-414e-41f1-b3a0-979f62eb54f3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:25.219815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e57a2056-414e-41f1-b3a0-979f62eb54f3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:25.220849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e57a2056-414e-41f1-b3a0-979f62eb54f3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:25.222958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e57a2056-414e-41f1-b3a0-979f62eb54f3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:25.293666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e57a2056-414e-41f1-b3a0-979f62eb54f3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:25.294262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e57a2056-414e-41f1-b3a0-979f62eb54f3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:25.294775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e57a2056-414e-41f1-b3a0-979f62eb54f3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:25.295302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-e57a2056-414e-41f1-b3a0-979f62eb54f3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lazy-loading 'fault' on Instance uuid 7354e9a0-2795-4a98-a91d-6669a3b353f0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:52:25.329769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3437bcf0-0cf3-43ad-afd8-93b5ce13a69f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:25.331359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3437bcf0-0cf3-43ad-afd8-93b5ce13a69f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:25.346436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3437bcf0-0cf3-43ad-afd8-93b5ce13a69f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:25.346965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3437bcf0-0cf3-43ad-afd8-93b5ce13a69f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:25.347381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3437bcf0-0cf3-43ad-afd8-93b5ce13a69f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:25.348096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3437bcf0-0cf3-43ad-afd8-93b5ce13a69f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:25.348558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3437bcf0-0cf3-43ad-afd8-93b5ce13a69f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:25.348985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3437bcf0-0cf3-43ad-afd8-93b5ce13a69f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:25.414396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e57a2056-414e-41f1-b3a0-979f62eb54f3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:25.423702 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e57a2056-414e-41f1-b3a0-979f62eb54f3 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 200 len: 1309 microversion: 2.1 time: 0.235577 Aug 29 15:52:25.425277 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3121/6050] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:25 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 1309 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:25.514229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3437bcf0-0cf3-43ad-afd8-93b5ce13a69f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:25.525630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3437bcf0-0cf3-43ad-afd8-93b5ce13a69f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:25.527508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3437bcf0-0cf3-43ad-afd8-93b5ce13a69f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:25.529324 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3437bcf0-0cf3-43ad-afd8-93b5ce13a69f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1337 microversion: 2.20 time: 0.205144 Aug 29 15:52:25.530510 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2930/6051] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:25 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1337 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:25.845258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a6db8f07-f203-49e7-9f25-c5cbee770e33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:25.846289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a6db8f07-f203-49e7-9f25-c5cbee770e33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:25.853173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6db8f07-f203-49e7-9f25-c5cbee770e33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:25.853930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6db8f07-f203-49e7-9f25-c5cbee770e33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:25.854589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6db8f07-f203-49e7-9f25-c5cbee770e33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:25.855523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6db8f07-f203-49e7-9f25-c5cbee770e33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:25.856193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6db8f07-f203-49e7-9f25-c5cbee770e33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:25.856833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6db8f07-f203-49e7-9f25-c5cbee770e33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.009528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a6db8f07-f203-49e7-9f25-c5cbee770e33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:26.020083 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a6db8f07-f203-49e7-9f25-c5cbee770e33 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.180606 Aug 29 15:52:26.021175 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3122/6052] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:25 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:26.449755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1c5465de-f31a-4d57-8f8a-e851b1ca18a2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:26.450976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1c5465de-f31a-4d57-8f8a-e851b1ca18a2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:26.461037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c5465de-f31a-4d57-8f8a-e851b1ca18a2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.464706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c5465de-f31a-4d57-8f8a-e851b1ca18a2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.465193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c5465de-f31a-4d57-8f8a-e851b1ca18a2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.465927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c5465de-f31a-4d57-8f8a-e851b1ca18a2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.466395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c5465de-f31a-4d57-8f8a-e851b1ca18a2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.467304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c5465de-f31a-4d57-8f8a-e851b1ca18a2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.483196 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-1c5465de-f31a-4d57-8f8a-e851b1ca18a2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1c5465de-f31a-4d57-8f8a-e851b1ca18a2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 HTTP/1.1 Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '7354e9a0-2795-4a98-a91d-6669a3b353f0'} Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.484878 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.490211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.490211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.490211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:26.490211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:26.490211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. Aug 29 15:52:26.490211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.491345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1c5465de-f31a-4d57-8f8a-e851b1ca18a2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:26.492400 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1c5465de-f31a-4d57-8f8a-e851b1ca18a2 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 404 len: 111 microversion: 2.1 time: 0.046784 Aug 29 15:52:26.496583 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2931/6053] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:26 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:26.507851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dbe07ccb-ec7c-444c-9654-04ad68dfe99c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:26.508394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dbe07ccb-ec7c-444c-9654-04ad68dfe99c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:26.517240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbe07ccb-ec7c-444c-9654-04ad68dfe99c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.517849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbe07ccb-ec7c-444c-9654-04ad68dfe99c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.518411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbe07ccb-ec7c-444c-9654-04ad68dfe99c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.519400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbe07ccb-ec7c-444c-9654-04ad68dfe99c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.519958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbe07ccb-ec7c-444c-9654-04ad68dfe99c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.520391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbe07ccb-ec7c-444c-9654-04ad68dfe99c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.536605 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-dbe07ccb-ec7c-444c-9654-04ad68dfe99c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dbe07ccb-ec7c-444c-9654-04ad68dfe99c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 HTTP/1.1 Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7354e9a0-2795-4a98-a91d-6669a3b353f0'} Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:26.538458 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. Aug 29 15:52:26.542238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.542238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.542238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.542238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.542238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.542238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.542238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:26.542238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:26.542238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. Aug 29 15:52:26.542238 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.542238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dbe07ccb-ec7c-444c-9654-04ad68dfe99c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:26.542238 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dbe07ccb-ec7c-444c-9654-04ad68dfe99c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 404 len: 111 microversion: 2.1 time: 0.035985 Aug 29 15:52:26.542238 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3123/6054] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:52:26 2022] DELETE /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:26.548523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6eb276d4-8b7e-4618-86c1-fa554b17d759 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:26.549372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6eb276d4-8b7e-4618-86c1-fa554b17d759 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 7354e9a0-2795-4a98-a91d-6669a3b353f0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:26.563795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6eb276d4-8b7e-4618-86c1-fa554b17d759 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.564992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6eb276d4-8b7e-4618-86c1-fa554b17d759 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.565559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6eb276d4-8b7e-4618-86c1-fa554b17d759 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.567474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6eb276d4-8b7e-4618-86c1-fa554b17d759 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.567741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-beec3478-c90a-47f2-9332-553de0ab07b3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:26.568298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6eb276d4-8b7e-4618-86c1-fa554b17d759 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.569116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-beec3478-c90a-47f2-9332-553de0ab07b3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:26.569653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6eb276d4-8b7e-4618-86c1-fa554b17d759 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.589300 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-6eb276d4-8b7e-4618-86c1-fa554b17d759 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6eb276d4-8b7e-4618-86c1-fa554b17d759 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 HTTP/1.1 Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '7354e9a0-2795-4a98-a91d-6669a3b353f0'} Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.590971 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.594981 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.594981 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.594981 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:26.594981 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:26.594981 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. Aug 29 15:52:26.594981 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.594981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6eb276d4-8b7e-4618-86c1-fa554b17d759 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 7354e9a0-2795-4a98-a91d-6669a3b353f0 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:26.595966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-beec3478-c90a-47f2-9332-553de0ab07b3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.595966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-beec3478-c90a-47f2-9332-553de0ab07b3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.596130 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6eb276d4-8b7e-4618-86c1-fa554b17d759 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0" status: 404 len: 111 microversion: 2.1 time: 0.051036 Aug 29 15:52:26.599753 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2932/6055] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:26 2022] GET /compute/v2.1/servers/7354e9a0-2795-4a98-a91d-6669a3b353f0 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:52:26.599920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-beec3478-c90a-47f2-9332-553de0ab07b3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.599920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-beec3478-c90a-47f2-9332-553de0ab07b3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.599920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-beec3478-c90a-47f2-9332-553de0ab07b3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.599920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-beec3478-c90a-47f2-9332-553de0ab07b3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.609059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-87edc513-d4a4-42e7-b7ba-129246a8b223 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:26.609687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-87edc513-d4a4-42e7-b7ba-129246a8b223 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:26.620583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87edc513-d4a4-42e7-b7ba-129246a8b223 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.629921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87edc513-d4a4-42e7-b7ba-129246a8b223 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.630699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87edc513-d4a4-42e7-b7ba-129246a8b223 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.631666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87edc513-d4a4-42e7-b7ba-129246a8b223 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.632304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87edc513-d4a4-42e7-b7ba-129246a8b223 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.632950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87edc513-d4a4-42e7-b7ba-129246a8b223 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.656827 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-87edc513-d4a4-42e7-b7ba-129246a8b223 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-87edc513-d4a4-42e7-b7ba-129246a8b223 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e HTTP/1.1 Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '3e0c4f14-7bec-433d-9654-6be9cf22b78e'} Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:26.667472 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. Aug 29 15:52:26.671194 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.671194 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.671194 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.671194 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.671194 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.671194 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.671194 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:26.671194 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:26.671194 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. Aug 29 15:52:26.671194 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.673236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-87edc513-d4a4-42e7-b7ba-129246a8b223 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:26.674372 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-87edc513-d4a4-42e7-b7ba-129246a8b223 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 404 len: 111 microversion: 2.1 time: 0.073228 Aug 29 15:52:26.675525 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2933/6056] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:52:26 2022] DELETE /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:26.694480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9af327ab-3bf6-465d-8e54-eeecd0d42c81 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:26.694480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9af327ab-3bf6-465d-8e54-eeecd0d42c81 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 3e0c4f14-7bec-433d-9654-6be9cf22b78e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:26.710169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9af327ab-3bf6-465d-8e54-eeecd0d42c81 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.710169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9af327ab-3bf6-465d-8e54-eeecd0d42c81 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.710460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9af327ab-3bf6-465d-8e54-eeecd0d42c81 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.710959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9af327ab-3bf6-465d-8e54-eeecd0d42c81 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.711430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9af327ab-3bf6-465d-8e54-eeecd0d42c81 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.711861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9af327ab-3bf6-465d-8e54-eeecd0d42c81 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.741417 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-9af327ab-3bf6-465d-8e54-eeecd0d42c81 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9af327ab-3bf6-465d-8e54-eeecd0d42c81 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e HTTP/1.1 Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '3e0c4f14-7bec-433d-9654-6be9cf22b78e'} Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.743931 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.748965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.748965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.748965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:26.748965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:26.748965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. Aug 29 15:52:26.748965 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.748965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9af327ab-3bf6-465d-8e54-eeecd0d42c81 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 3e0c4f14-7bec-433d-9654-6be9cf22b78e could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:26.750235 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9af327ab-3bf6-465d-8e54-eeecd0d42c81 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e" status: 404 len: 111 microversion: 2.1 time: 0.068293 Aug 29 15:52:26.755404 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2934/6057] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:26 2022] GET /compute/v2.1/servers/3e0c4f14-7bec-433d-9654-6be9cf22b78e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:52:26.763248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e90d52a1-d3da-477d-8b9f-70567604a78e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:26.763759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e90d52a1-d3da-477d-8b9f-70567604a78e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:26.770884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e90d52a1-d3da-477d-8b9f-70567604a78e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.771535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e90d52a1-d3da-477d-8b9f-70567604a78e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.771972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e90d52a1-d3da-477d-8b9f-70567604a78e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.772696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e90d52a1-d3da-477d-8b9f-70567604a78e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.773184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e90d52a1-d3da-477d-8b9f-70567604a78e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.773606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e90d52a1-d3da-477d-8b9f-70567604a78e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.800263 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-e90d52a1-d3da-477d-8b9f-70567604a78e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e90d52a1-d3da-477d-8b9f-70567604a78e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e HTTP/1.1 Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '6d207d03-2c7b-4684-9a0d-21b1c5bebe9e'} Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:26.802644 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. Aug 29 15:52:26.806112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.806112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.806112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.806112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.806112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.806112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.806112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:26.806112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:26.806112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. Aug 29 15:52:26.806112 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.806112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e90d52a1-d3da-477d-8b9f-70567604a78e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:26.806112 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e90d52a1-d3da-477d-8b9f-70567604a78e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 404 len: 111 microversion: 2.1 time: 0.047770 Aug 29 15:52:26.806112 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2935/6058] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:52:26 2022] DELETE /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:26.816514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e97858f6-ff9c-4734-818a-90cdf9c8a272 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:26.817218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e97858f6-ff9c-4734-818a-90cdf9c8a272 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:26.824664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e97858f6-ff9c-4734-818a-90cdf9c8a272 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.825180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e97858f6-ff9c-4734-818a-90cdf9c8a272 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.825621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e97858f6-ff9c-4734-818a-90cdf9c8a272 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.826436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e97858f6-ff9c-4734-818a-90cdf9c8a272 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.827301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e97858f6-ff9c-4734-818a-90cdf9c8a272 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.827301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e97858f6-ff9c-4734-818a-90cdf9c8a272 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.844251 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-e97858f6-ff9c-4734-818a-90cdf9c8a272 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e97858f6-ff9c-4734-818a-90cdf9c8a272 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e HTTP/1.1 Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '6d207d03-2c7b-4684-9a0d-21b1c5bebe9e'} Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.845685 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.850018 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.850018 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.850018 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:26.850018 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:26.850018 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. Aug 29 15:52:26.850018 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.850018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e97858f6-ff9c-4734-818a-90cdf9c8a272 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 6d207d03-2c7b-4684-9a0d-21b1c5bebe9e could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:26.850018 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e97858f6-ff9c-4734-818a-90cdf9c8a272 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e" status: 404 len: 111 microversion: 2.1 time: 0.035674 Aug 29 15:52:26.851236 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2936/6059] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:26 2022] GET /compute/v2.1/servers/6d207d03-2c7b-4684-9a0d-21b1c5bebe9e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:26.853870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-beec3478-c90a-47f2-9332-553de0ab07b3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:26.856340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-538727f9-1eb2-4158-a46e-15bc41b7201c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:26.863955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-538727f9-1eb2-4158-a46e-15bc41b7201c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:26.868020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-beec3478-c90a-47f2-9332-553de0ab07b3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:26.871440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-beec3478-c90a-47f2-9332-553de0ab07b3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:26.872664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-538727f9-1eb2-4158-a46e-15bc41b7201c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.872802 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-beec3478-c90a-47f2-9332-553de0ab07b3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1405 microversion: 2.20 time: 0.319089 Aug 29 15:52:26.873177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-538727f9-1eb2-4158-a46e-15bc41b7201c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.873908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-538727f9-1eb2-4158-a46e-15bc41b7201c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.874957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-538727f9-1eb2-4158-a46e-15bc41b7201c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.875159 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3124/6060] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:26 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1405 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:26.875723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-538727f9-1eb2-4158-a46e-15bc41b7201c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.876301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-538727f9-1eb2-4158-a46e-15bc41b7201c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.895276 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-538727f9-1eb2-4158-a46e-15bc41b7201c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-538727f9-1eb2-4158-a46e-15bc41b7201c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 HTTP/1.1 Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '507274a1-8eee-4a29-9f47-5c560ae48444'} Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:26.898134 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. Aug 29 15:52:26.902506 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.902506 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.902506 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.902506 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.902506 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.902506 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.902506 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:26.902506 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:26.902506 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. Aug 29 15:52:26.902506 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.906283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-538727f9-1eb2-4158-a46e-15bc41b7201c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:26.907542 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-538727f9-1eb2-4158-a46e-15bc41b7201c tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "DELETE /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 404 len: 111 microversion: 2.1 time: 0.055257 Aug 29 15:52:26.908430 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2937/6061] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:52:26 2022] DELETE /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:26.916862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ed42746c-6b37-46da-bbbc-27a3b766df79 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:26.917719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ed42746c-6b37-46da-bbbc-27a3b766df79 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 507274a1-8eee-4a29-9f47-5c560ae48444] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:26.932568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed42746c-6b37-46da-bbbc-27a3b766df79 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.934603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed42746c-6b37-46da-bbbc-27a3b766df79 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.936384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed42746c-6b37-46da-bbbc-27a3b766df79 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.939792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed42746c-6b37-46da-bbbc-27a3b766df79 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.940283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed42746c-6b37-46da-bbbc-27a3b766df79 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.944804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed42746c-6b37-46da-bbbc-27a3b766df79 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.965459 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-ed42746c-6b37-46da-bbbc-27a3b766df79 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ed42746c-6b37-46da-bbbc-27a3b766df79 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 HTTP/1.1 Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '507274a1-8eee-4a29-9f47-5c560ae48444'} Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.967591 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:26.971224 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:26.971224 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:26.971224 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:26.971224 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:26.971224 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. Aug 29 15:52:26.971224 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:26.973065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ed42746c-6b37-46da-bbbc-27a3b766df79 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 507274a1-8eee-4a29-9f47-5c560ae48444 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:26.974282 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ed42746c-6b37-46da-bbbc-27a3b766df79 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444" status: 404 len: 111 microversion: 2.1 time: 0.061494 Aug 29 15:52:26.975352 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3125/6062] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:26 2022] GET /compute/v2.1/servers/507274a1-8eee-4a29-9f47-5c560ae48444 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:52:26.983723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5ea868e5-1940-45d7-b323-a571bfbe0f72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:26.984224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5ea868e5-1940-45d7-b323-a571bfbe0f72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:26.990867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ea868e5-1940-45d7-b323-a571bfbe0f72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.991669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ea868e5-1940-45d7-b323-a571bfbe0f72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.992211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ea868e5-1940-45d7-b323-a571bfbe0f72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.993038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ea868e5-1940-45d7-b323-a571bfbe0f72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.993544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ea868e5-1940-45d7-b323-a571bfbe0f72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.994878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ea868e5-1940-45d7-b323-a571bfbe0f72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.014668 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-5ea868e5-1940-45d7-b323-a571bfbe0f72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5ea868e5-1940-45d7-b323-a571bfbe0f72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b HTTP/1.1 Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '31116131-8b70-4019-aa25-d3b9e58d2e1b'} Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:27.016459 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. Aug 29 15:52:27.019883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.019883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:27.019883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.019883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.019883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:27.019883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:27.019883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:27.019883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:27.019883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. Aug 29 15:52:27.019883 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.019883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5ea868e5-1940-45d7-b323-a571bfbe0f72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:27.019883 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5ea868e5-1940-45d7-b323-a571bfbe0f72 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "DELETE /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 404 len: 111 microversion: 2.1 time: 0.038775 Aug 29 15:52:27.027533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f2e7ad7f-c684-4c01-bea9-3e9b1acef59b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:27.028333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f2e7ad7f-c684-4c01-bea9-3e9b1acef59b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 31116131-8b70-4019-aa25-d3b9e58d2e1b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:27.029220 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2938/6063] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:52:26 2022] DELETE /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:27.038279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2e7ad7f-c684-4c01-bea9-3e9b1acef59b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.038785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2e7ad7f-c684-4c01-bea9-3e9b1acef59b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.039291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2e7ad7f-c684-4c01-bea9-3e9b1acef59b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.040000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2e7ad7f-c684-4c01-bea9-3e9b1acef59b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.040460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2e7ad7f-c684-4c01-bea9-3e9b1acef59b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.040884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2e7ad7f-c684-4c01-bea9-3e9b1acef59b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.048019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1a945e67-4c6b-4ae2-9834-4e516f153499 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:27.049215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1a945e67-4c6b-4ae2-9834-4e516f153499 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:27.065817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a945e67-4c6b-4ae2-9834-4e516f153499 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.066455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a945e67-4c6b-4ae2-9834-4e516f153499 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.068380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a945e67-4c6b-4ae2-9834-4e516f153499 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.069231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a945e67-4c6b-4ae2-9834-4e516f153499 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.070525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a945e67-4c6b-4ae2-9834-4e516f153499 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.072494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a945e67-4c6b-4ae2-9834-4e516f153499 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.096853 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-f2e7ad7f-c684-4c01-bea9-3e9b1acef59b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f2e7ad7f-c684-4c01-bea9-3e9b1acef59b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b HTTP/1.1 Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '31116131-8b70-4019-aa25-d3b9e58d2e1b'} Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.100874 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.104253 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:27.104253 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:27.104253 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:27.104253 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:27.104253 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. Aug 29 15:52:27.104253 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.107655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f2e7ad7f-c684-4c01-bea9-3e9b1acef59b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 31116131-8b70-4019-aa25-d3b9e58d2e1b could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:27.108741 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f2e7ad7f-c684-4c01-bea9-3e9b1acef59b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b" status: 404 len: 111 microversion: 2.1 time: 0.085823 Aug 29 15:52:27.110336 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3126/6064] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:27 2022] GET /compute/v2.1/servers/31116131-8b70-4019-aa25-d3b9e58d2e1b => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:52:27.122607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b8eb370b-dc0b-431e-9940-bfa24f30146e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:27.123529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b8eb370b-dc0b-431e-9940-bfa24f30146e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:27.131000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8eb370b-dc0b-431e-9940-bfa24f30146e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.131810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8eb370b-dc0b-431e-9940-bfa24f30146e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.132403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8eb370b-dc0b-431e-9940-bfa24f30146e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.133304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8eb370b-dc0b-431e-9940-bfa24f30146e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.134598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8eb370b-dc0b-431e-9940-bfa24f30146e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.135179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8eb370b-dc0b-431e-9940-bfa24f30146e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.151314 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-b8eb370b-dc0b-431e-9940-bfa24f30146e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b8eb370b-dc0b-431e-9940-bfa24f30146e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 HTTP/1.1 Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89'} Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:27.153235 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. Aug 29 15:52:27.156690 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.156690 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:27.156690 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.156690 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.156690 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:27.156690 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:27.156690 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:27.156690 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:27.156690 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. Aug 29 15:52:27.156690 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.159686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b8eb370b-dc0b-431e-9940-bfa24f30146e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:27.160789 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b8eb370b-dc0b-431e-9940-bfa24f30146e tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 404 len: 111 microversion: 2.1 time: 0.044658 Aug 29 15:52:27.161936 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3127/6065] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:52:27 2022] DELETE /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:27.169575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e8507a72-40fe-41b5-8877-e21ed3f6a8b1 req-ac9d48c8-2eef-4dc0-ad37-1f989b99cf11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fba35d0-e4ed-4088-a1d1-ccabdd81c178", "tag": "db244ebb-da5f-469b-ae27-7da59496c697"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:27.181193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e8507a72-40fe-41b5-8877-e21ed3f6a8b1 req-ac9d48c8-2eef-4dc0-ad37-1f989b99cf11 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.181951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e8507a72-40fe-41b5-8877-e21ed3f6a8b1 req-ac9d48c8-2eef-4dc0-ad37-1f989b99cf11 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.182562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e8507a72-40fe-41b5-8877-e21ed3f6a8b1 req-ac9d48c8-2eef-4dc0-ad37-1f989b99cf11 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.195717 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e8507a72-40fe-41b5-8877-e21ed3f6a8b1 req-ac9d48c8-2eef-4dc0-ad37-1f989b99cf11 service nova] Creating event network-changed:db244ebb-da5f-469b-ae27-7da59496c697 for instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 on n-h2-839401-11 Aug 29 15:52:27.201252 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e8507a72-40fe-41b5-8877-e21ed3f6a8b1 req-ac9d48c8-2eef-4dc0-ad37-1f989b99cf11 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037882 Aug 29 15:52:27.202377 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3128/6066] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:27.208388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e19e3c66-d681-426a-8b68-10d52ed01f45 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:27.209829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e19e3c66-d681-426a-8b68-10d52ed01f45 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:27.217064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e19e3c66-d681-426a-8b68-10d52ed01f45 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.218824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e19e3c66-d681-426a-8b68-10d52ed01f45 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.219979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e19e3c66-d681-426a-8b68-10d52ed01f45 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.221193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e19e3c66-d681-426a-8b68-10d52ed01f45 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.221828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e19e3c66-d681-426a-8b68-10d52ed01f45 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.222434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e19e3c66-d681-426a-8b68-10d52ed01f45 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.241885 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-e19e3c66-d681-426a-8b68-10d52ed01f45 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e19e3c66-d681-426a-8b68-10d52ed01f45 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 HTTP/1.1 Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89'} Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.243940 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.247930 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:27.247930 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:27.247930 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:27.247930 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:27.247930 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. Aug 29 15:52:27.247930 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.251473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e19e3c66-d681-426a-8b68-10d52ed01f45 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:27.252364 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e19e3c66-d681-426a-8b68-10d52ed01f45 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89" status: 404 len: 111 microversion: 2.1 time: 0.048743 Aug 29 15:52:27.259981 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3129/6067] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:27 2022] GET /compute/v2.1/servers/ad00f5a6-07f9-4628-8dbe-bc7fbf76cd89 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:27.266701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e412bf58-ea09-4b38-9d71-3df3e23d3971 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:27.267506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e412bf58-ea09-4b38-9d71-3df3e23d3971 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 4793378f-9049-4707-ac3c-b04709a33068] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:27.274094 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-e412bf58-ea09-4b38-9d71-3df3e23d3971 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e412bf58-ea09-4b38-9d71-3df3e23d3971 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/4793378f-9049-4707-ac3c-b04709a33068 HTTP/1.1 Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '4793378f-9049-4707-ac3c-b04709a33068'} Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:27.275902 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.280325 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.280325 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:27.280325 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:27.280325 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:27.280325 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:27.280325 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. Aug 29 15:52:27.280325 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.283622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e412bf58-ea09-4b38-9d71-3df3e23d3971 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:27.284700 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e412bf58-ea09-4b38-9d71-3df3e23d3971 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4793378f-9049-4707-ac3c-b04709a33068" status: 404 len: 111 microversion: 2.1 time: 0.023463 Aug 29 15:52:27.288622 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3130/6068] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:52:27 2022] DELETE /compute/v2.1/servers/4793378f-9049-4707-ac3c-b04709a33068 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:27.294623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c2eee8b9-b422-4c4a-b4cc-5d067dc7e973 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:27.295456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c2eee8b9-b422-4c4a-b4cc-5d067dc7e973 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 4793378f-9049-4707-ac3c-b04709a33068] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:27.302403 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-c2eee8b9-b422-4c4a-b4cc-5d067dc7e973 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c2eee8b9-b422-4c4a-b4cc-5d067dc7e973 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/4793378f-9049-4707-ac3c-b04709a33068 HTTP/1.1 Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '4793378f-9049-4707-ac3c-b04709a33068'} Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:27.304410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:27.307801 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:27.307801 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:27.307801 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. Aug 29 15:52:27.307801 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:27.309422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c2eee8b9-b422-4c4a-b4cc-5d067dc7e973 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 4793378f-9049-4707-ac3c-b04709a33068 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:27.310400 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c2eee8b9-b422-4c4a-b4cc-5d067dc7e973 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/4793378f-9049-4707-ac3c-b04709a33068" status: 404 len: 111 microversion: 2.1 time: 0.020582 Aug 29 15:52:27.311173 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3131/6069] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:27 2022] GET /compute/v2.1/servers/4793378f-9049-4707-ac3c-b04709a33068 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:27.322415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6f7c3c6c-2b57-4ab7-b51f-4584a6396193 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:27.323355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6f7c3c6c-2b57-4ab7-b51f-4584a6396193 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:27.330795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f7c3c6c-2b57-4ab7-b51f-4584a6396193 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.331544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f7c3c6c-2b57-4ab7-b51f-4584a6396193 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.332151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f7c3c6c-2b57-4ab7-b51f-4584a6396193 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.333027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f7c3c6c-2b57-4ab7-b51f-4584a6396193 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.333643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f7c3c6c-2b57-4ab7-b51f-4584a6396193 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.334208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6f7c3c6c-2b57-4ab7-b51f-4584a6396193 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.367140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6f7c3c6c-2b57-4ab7-b51f-4584a6396193 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:52:27.386434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1a945e67-4c6b-4ae2-9834-4e516f153499 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:27.400289 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1a945e67-4c6b-4ae2-9834-4e516f153499 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.362747 Aug 29 15:52:27.401602 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2939/6070] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:27 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:27.431423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:27.477013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:27.491242 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6f7c3c6c-2b57-4ab7-b51f-4584a6396193 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 204 len: 0 microversion: 2.1 time: 0.173328 Aug 29 15:52:27.492042 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3132/6071] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:52:27 2022] DELETE /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:52:27.500461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4c6474aa-2c11-4f74-b4b4-a06942770b02 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:27.501256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4c6474aa-2c11-4f74-b4b4-a06942770b02 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:27.509444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c6474aa-2c11-4f74-b4b4-a06942770b02 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.510201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c6474aa-2c11-4f74-b4b4-a06942770b02 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.510930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c6474aa-2c11-4f74-b4b4-a06942770b02 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.512498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c6474aa-2c11-4f74-b4b4-a06942770b02 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.513160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c6474aa-2c11-4f74-b4b4-a06942770b02 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.513733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c6474aa-2c11-4f74-b4b4-a06942770b02 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.903595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1bc34619-1dd7-41c6-8d77-8b76f5a361a2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:27.905047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1bc34619-1dd7-41c6-8d77-8b76f5a361a2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:27.922858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1bc34619-1dd7-41c6-8d77-8b76f5a361a2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.924090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1bc34619-1dd7-41c6-8d77-8b76f5a361a2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.925479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1bc34619-1dd7-41c6-8d77-8b76f5a361a2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.926552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1bc34619-1dd7-41c6-8d77-8b76f5a361a2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.927244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1bc34619-1dd7-41c6-8d77-8b76f5a361a2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.928303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1bc34619-1dd7-41c6-8d77-8b76f5a361a2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:28.090750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4c6474aa-2c11-4f74-b4b4-a06942770b02 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:28.102888 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4c6474aa-2c11-4f74-b4b4-a06942770b02 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 200 len: 1480 microversion: 2.1 time: 0.606210 Aug 29 15:52:28.121248 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2940/6072] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:27 2022] GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 1480 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:28.209480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1bc34619-1dd7-41c6-8d77-8b76f5a361a2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:28.218886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1bc34619-1dd7-41c6-8d77-8b76f5a361a2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:28.220514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1bc34619-1dd7-41c6-8d77-8b76f5a361a2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:28.221721 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1bc34619-1dd7-41c6-8d77-8b76f5a361a2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1405 microversion: 2.20 time: 0.323195 Aug 29 15:52:28.222555 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3133/6073] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:27 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1405 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:28.422643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0941d29b-a4d6-45a7-8b46-661a2119ec3c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:28.423631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0941d29b-a4d6-45a7-8b46-661a2119ec3c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:28.430179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0941d29b-a4d6-45a7-8b46-661a2119ec3c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:28.430754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0941d29b-a4d6-45a7-8b46-661a2119ec3c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:28.431298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0941d29b-a4d6-45a7-8b46-661a2119ec3c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:28.432093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0941d29b-a4d6-45a7-8b46-661a2119ec3c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:28.432638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0941d29b-a4d6-45a7-8b46-661a2119ec3c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:28.433182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0941d29b-a4d6-45a7-8b46-661a2119ec3c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:28.598232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0941d29b-a4d6-45a7-8b46-661a2119ec3c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:28.607410 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0941d29b-a4d6-45a7-8b46-661a2119ec3c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.188781 Aug 29 15:52:28.608028 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2941/6074] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:28 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:29.125062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3720a863-9217-4c0a-ba9c-fae96a301724 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:29.125604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3720a863-9217-4c0a-ba9c-fae96a301724 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:29.132520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3720a863-9217-4c0a-ba9c-fae96a301724 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.132990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3720a863-9217-4c0a-ba9c-fae96a301724 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.133506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3720a863-9217-4c0a-ba9c-fae96a301724 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:29.134541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3720a863-9217-4c0a-ba9c-fae96a301724 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.134997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3720a863-9217-4c0a-ba9c-fae96a301724 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.135421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3720a863-9217-4c0a-ba9c-fae96a301724 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:29.245229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e0344c96-e0ea-42a7-9704-f735e2ead48f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:29.246664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e0344c96-e0ea-42a7-9704-f735e2ead48f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:29.254400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0344c96-e0ea-42a7-9704-f735e2ead48f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.255142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0344c96-e0ea-42a7-9704-f735e2ead48f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.255774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0344c96-e0ea-42a7-9704-f735e2ead48f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:29.256803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0344c96-e0ea-42a7-9704-f735e2ead48f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.257444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0344c96-e0ea-42a7-9704-f735e2ead48f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.258807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0344c96-e0ea-42a7-9704-f735e2ead48f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:29.289703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:29.388780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3720a863-9217-4c0a-ba9c-fae96a301724 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:29.404604 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3720a863-9217-4c0a-ba9c-fae96a301724 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 200 len: 1480 microversion: 2.1 time: 0.283540 Aug 29 15:52:29.417699 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3134/6075] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:29 2022] GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 1480 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:29.517108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e0344c96-e0ea-42a7-9704-f735e2ead48f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:29.532280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e0344c96-e0ea-42a7-9704-f735e2ead48f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:29.535534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e0344c96-e0ea-42a7-9704-f735e2ead48f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:29.540844 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e0344c96-e0ea-42a7-9704-f735e2ead48f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1405 microversion: 2.20 time: 0.298835 Aug 29 15:52:29.558174 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2942/6076] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:29 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1405 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:29.632513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f6822646-8e84-4808-bd80-0c3ba5a6dac9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:29.633196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f6822646-8e84-4808-bd80-0c3ba5a6dac9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:29.640690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6822646-8e84-4808-bd80-0c3ba5a6dac9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.641432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6822646-8e84-4808-bd80-0c3ba5a6dac9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.642104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6822646-8e84-4808-bd80-0c3ba5a6dac9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:29.643091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6822646-8e84-4808-bd80-0c3ba5a6dac9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.643517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6822646-8e84-4808-bd80-0c3ba5a6dac9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.644182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6822646-8e84-4808-bd80-0c3ba5a6dac9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:29.871133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-e2cffae4-a598-46cb-8d66-c716d452568f req-126a4aeb-19ff-4305-8b11-b1c6ac98948b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e021dd0-d5dc-4600-b577-27abfc1282bb", "name": "network-vif-deleted", "tag": "37037bd8-6ee9-4555-a34d-b0d12a0a8cc1"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:29.883296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e2cffae4-a598-46cb-8d66-c716d452568f req-126a4aeb-19ff-4305-8b11-b1c6ac98948b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.885358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e2cffae4-a598-46cb-8d66-c716d452568f req-126a4aeb-19ff-4305-8b11-b1c6ac98948b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.886294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e2cffae4-a598-46cb-8d66-c716d452568f req-126a4aeb-19ff-4305-8b11-b1c6ac98948b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:29.899592 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-e2cffae4-a598-46cb-8d66-c716d452568f req-126a4aeb-19ff-4305-8b11-b1c6ac98948b service nova] Creating event network-vif-deleted:37037bd8-6ee9-4555-a34d-b0d12a0a8cc1 for instance 0e021dd0-d5dc-4600-b577-27abfc1282bb on n-h1-839401-11 Aug 29 15:52:29.907355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f6822646-8e84-4808-bd80-0c3ba5a6dac9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:29.911437 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-e2cffae4-a598-46cb-8d66-c716d452568f req-126a4aeb-19ff-4305-8b11-b1c6ac98948b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044794 Aug 29 15:52:29.913495 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2943/6077] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:29.921783 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f6822646-8e84-4808-bd80-0c3ba5a6dac9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.293767 Aug 29 15:52:29.922395 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3135/6078] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:29 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:30.427422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a565a243-ad0e-43da-8b5b-6b094f641d23 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:30.428247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a565a243-ad0e-43da-8b5b-6b094f641d23 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:30.435106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a565a243-ad0e-43da-8b5b-6b094f641d23 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:30.435813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a565a243-ad0e-43da-8b5b-6b094f641d23 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:30.436406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a565a243-ad0e-43da-8b5b-6b094f641d23 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:30.437282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a565a243-ad0e-43da-8b5b-6b094f641d23 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:30.437956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a565a243-ad0e-43da-8b5b-6b094f641d23 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:30.438543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a565a243-ad0e-43da-8b5b-6b094f641d23 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:30.478368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a565a243-ad0e-43da-8b5b-6b094f641d23 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:30.478874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a565a243-ad0e-43da-8b5b-6b094f641d23 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:30.479331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a565a243-ad0e-43da-8b5b-6b094f641d23 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:30.479794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-a565a243-ad0e-43da-8b5b-6b094f641d23 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lazy-loading 'fault' on Instance uuid 0e021dd0-d5dc-4600-b577-27abfc1282bb {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:52:30.539682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a565a243-ad0e-43da-8b5b-6b094f641d23 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3e87dfe49444f886b7a9ac5d22bda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf584fd54ef4927a152fbbe03568cf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:30.550013 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a565a243-ad0e-43da-8b5b-6b094f641d23 tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 200 len: 1283 microversion: 2.1 time: 0.127292 Aug 29 15:52:30.551322 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2944/6079] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:30 2022] GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 1283 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:30.569602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9df2ac21-10b9-4b50-af8e-e74c64e46b72 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:30.570310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9df2ac21-10b9-4b50-af8e-e74c64e46b72 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:30.577385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9df2ac21-10b9-4b50-af8e-e74c64e46b72 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:30.577961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9df2ac21-10b9-4b50-af8e-e74c64e46b72 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:30.578630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9df2ac21-10b9-4b50-af8e-e74c64e46b72 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:30.579628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9df2ac21-10b9-4b50-af8e-e74c64e46b72 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:30.580388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9df2ac21-10b9-4b50-af8e-e74c64e46b72 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:30.580873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9df2ac21-10b9-4b50-af8e-e74c64e46b72 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:30.780557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9df2ac21-10b9-4b50-af8e-e74c64e46b72 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:30.795452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9df2ac21-10b9-4b50-af8e-e74c64e46b72 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:30.797565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9df2ac21-10b9-4b50-af8e-e74c64e46b72 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:30.799169 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9df2ac21-10b9-4b50-af8e-e74c64e46b72 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1405 microversion: 2.20 time: 0.233666 Aug 29 15:52:30.799723 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3136/6080] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:30 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1405 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:31.214071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-915b7512-24b7-4cc9-bbcb-08dab77ad9c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:31.214694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-915b7512-24b7-4cc9-bbcb-08dab77ad9c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:31.224414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-915b7512-24b7-4cc9-bbcb-08dab77ad9c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.224924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-915b7512-24b7-4cc9-bbcb-08dab77ad9c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.225396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-915b7512-24b7-4cc9-bbcb-08dab77ad9c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.226216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-915b7512-24b7-4cc9-bbcb-08dab77ad9c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.226569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-915b7512-24b7-4cc9-bbcb-08dab77ad9c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.226998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-915b7512-24b7-4cc9-bbcb-08dab77ad9c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.374311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-915b7512-24b7-4cc9-bbcb-08dab77ad9c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:31.383188 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-915b7512-24b7-4cc9-bbcb-08dab77ad9c6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.443790 Aug 29 15:52:31.383765 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2945/6081] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:30 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:31.571515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d0abeea-0891-4067-93e0-2d02ad42390b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:31.572077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9d0abeea-0891-4067-93e0-2d02ad42390b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] [instance: 0e021dd0-d5dc-4600-b577-27abfc1282bb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:31.578810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d0abeea-0891-4067-93e0-2d02ad42390b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.579296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d0abeea-0891-4067-93e0-2d02ad42390b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.579830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d0abeea-0891-4067-93e0-2d02ad42390b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.580519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d0abeea-0891-4067-93e0-2d02ad42390b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.580977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d0abeea-0891-4067-93e0-2d02ad42390b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.581422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d0abeea-0891-4067-93e0-2d02ad42390b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.595515 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-9d0abeea-0891-4067-93e0-2d02ad42390b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] HTTP exception thrown: Instance 0e021dd0-d5dc-4600-b577-27abfc1282bb could not be found. Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d0abeea-0891-4067-93e0-2d02ad42390b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Request method failure captured: Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb HTTP/1.1 Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN_tmonmYCsZUULxY3rY8Yk9CSE_u_rgV9Dfy06PBCadjpS6XRc6il7LvHOIBFB3mQw7kcRryEPoW_4cbaefsLSxoopKDdjtY6Lb0LuPm02U8QP4XOrbuLq-Y6R_UwecydDPv-ldYL_Zu02iHUMfFEDOuElSafMJNgmgHurYCs6wH_I Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bbf584fd54ef4927a152fbbe03568cf6", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bbf584fd54ef4927a152fbbe03568cf6"}]}] Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersTestJSON-574541888 Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bbf584fd54ef4927a152fbbe03568cf6 Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersTestJSON-574541888 Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersTestJSON-574541888-project Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: db3e87dfe49444f886b7a9ac5d22bda1 Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersTestJSON-574541888-project Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 0e021dd0-d5dc-4600-b577-27abfc1282bb could not be found. Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '0e021dd0-d5dc-4600-b577-27abfc1282bb'} Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e021dd0-d5dc-4600-b577-27abfc1282bb could not be found. Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e021dd0-d5dc-4600-b577-27abfc1282bb could not be found. Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:31.597270 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:31.601318 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:31.601318 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:31.601318 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:31.601318 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:31.601318 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e021dd0-d5dc-4600-b577-27abfc1282bb could not be found. Aug 29 15:52:31.601318 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:31.601318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d0abeea-0891-4067-93e0-2d02ad42390b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] Returning 404 to user: Instance 0e021dd0-d5dc-4600-b577-27abfc1282bb could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:31.601318 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d0abeea-0891-4067-93e0-2d02ad42390b tempest-ServersTestJSON-574541888 tempest-ServersTestJSON-574541888-project] 10.222.0.62 "GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb" status: 404 len: 111 microversion: 2.1 time: 0.031129 Aug 29 15:52:31.601318 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3137/6082] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:31 2022] GET /compute/v2.1/servers/0e021dd0-d5dc-4600-b577-27abfc1282bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:31.825186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c20eae2c-78ce-446e-9903-8f142ebf54c0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:31.826211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c20eae2c-78ce-446e-9903-8f142ebf54c0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:31.834226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c20eae2c-78ce-446e-9903-8f142ebf54c0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.834936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c20eae2c-78ce-446e-9903-8f142ebf54c0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.835522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c20eae2c-78ce-446e-9903-8f142ebf54c0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.836453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c20eae2c-78ce-446e-9903-8f142ebf54c0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.837052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c20eae2c-78ce-446e-9903-8f142ebf54c0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.837646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c20eae2c-78ce-446e-9903-8f142ebf54c0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:32.090275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c20eae2c-78ce-446e-9903-8f142ebf54c0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:32.113328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c20eae2c-78ce-446e-9903-8f142ebf54c0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:32.115198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c20eae2c-78ce-446e-9903-8f142ebf54c0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:32.116553 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c20eae2c-78ce-446e-9903-8f142ebf54c0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1405 microversion: 2.20 time: 0.297619 Aug 29 15:52:32.117872 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2946/6083] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:31 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1405 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:32.405798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2f90504f-6a5c-4284-ae09-4f245d74b550 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:32.406692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2f90504f-6a5c-4284-ae09-4f245d74b550 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:32.419854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f90504f-6a5c-4284-ae09-4f245d74b550 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:32.423467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f90504f-6a5c-4284-ae09-4f245d74b550 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:32.424206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f90504f-6a5c-4284-ae09-4f245d74b550 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:32.425189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f90504f-6a5c-4284-ae09-4f245d74b550 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:32.426091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f90504f-6a5c-4284-ae09-4f245d74b550 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:32.433355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f90504f-6a5c-4284-ae09-4f245d74b550 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:32.673771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2f90504f-6a5c-4284-ae09-4f245d74b550 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:32.682953 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2f90504f-6a5c-4284-ae09-4f245d74b550 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.281370 Aug 29 15:52:32.683666 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3138/6084] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:32 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:33.147214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f5f1d832-7be5-4a0e-9de0-89d1bb2a199b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:33.148826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f5f1d832-7be5-4a0e-9de0-89d1bb2a199b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:33.160628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5f1d832-7be5-4a0e-9de0-89d1bb2a199b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:33.161565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5f1d832-7be5-4a0e-9de0-89d1bb2a199b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:33.162395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5f1d832-7be5-4a0e-9de0-89d1bb2a199b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:33.163267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5f1d832-7be5-4a0e-9de0-89d1bb2a199b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:33.164080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5f1d832-7be5-4a0e-9de0-89d1bb2a199b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:33.165654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5f1d832-7be5-4a0e-9de0-89d1bb2a199b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:33.676472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f5f1d832-7be5-4a0e-9de0-89d1bb2a199b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:33.689050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f5f1d832-7be5-4a0e-9de0-89d1bb2a199b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:33.690956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f5f1d832-7be5-4a0e-9de0-89d1bb2a199b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:33.694773 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f5f1d832-7be5-4a0e-9de0-89d1bb2a199b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1405 microversion: 2.20 time: 0.554877 Aug 29 15:52:33.700297 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2947/6085] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:33 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1405 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:33.720294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7d0f6ee0-ac8b-44c5-96ac-c6b38417e4d8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:33.720924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7d0f6ee0-ac8b-44c5-96ac-c6b38417e4d8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:33.724782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:33.725644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=12 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:33.743118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d0f6ee0-ac8b-44c5-96ac-c6b38417e4d8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:33.743736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d0f6ee0-ac8b-44c5-96ac-c6b38417e4d8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:33.746557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d0f6ee0-ac8b-44c5-96ac-c6b38417e4d8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:33.747329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d0f6ee0-ac8b-44c5-96ac-c6b38417e4d8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:33.748299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d0f6ee0-ac8b-44c5-96ac-c6b38417e4d8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:33.748736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d0f6ee0-ac8b-44c5-96ac-c6b38417e4d8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:34.099638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7d0f6ee0-ac8b-44c5-96ac-c6b38417e4d8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:34.110636 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7d0f6ee0-ac8b-44c5-96ac-c6b38417e4d8 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1735 microversion: 2.1 time: 0.394426 Aug 29 15:52:34.114241 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3139/6086] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:33 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1735 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:34.718539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c6a456f8-5db2-4bac-b5c3-9225887f222a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:34.720699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c6a456f8-5db2-4bac-b5c3-9225887f222a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:34.784435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6a456f8-5db2-4bac-b5c3-9225887f222a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:34.794506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6a456f8-5db2-4bac-b5c3-9225887f222a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:34.800329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6a456f8-5db2-4bac-b5c3-9225887f222a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:34.805382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6a456f8-5db2-4bac-b5c3-9225887f222a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:34.808580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6a456f8-5db2-4bac-b5c3-9225887f222a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:34.810562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6a456f8-5db2-4bac-b5c3-9225887f222a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:35.138733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f15221e0-52f8-42b9-ae0b-d6e772d71af9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:35.139338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f15221e0-52f8-42b9-ae0b-d6e772d71af9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:35.154882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f15221e0-52f8-42b9-ae0b-d6e772d71af9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:35.156160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f15221e0-52f8-42b9-ae0b-d6e772d71af9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:35.160186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f15221e0-52f8-42b9-ae0b-d6e772d71af9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:35.161205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f15221e0-52f8-42b9-ae0b-d6e772d71af9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:35.161839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f15221e0-52f8-42b9-ae0b-d6e772d71af9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:35.162815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f15221e0-52f8-42b9-ae0b-d6e772d71af9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:35.304721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c6a456f8-5db2-4bac-b5c3-9225887f222a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:35.326181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c6a456f8-5db2-4bac-b5c3-9225887f222a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:35.332813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c6a456f8-5db2-4bac-b5c3-9225887f222a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:35.373901 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c6a456f8-5db2-4bac-b5c3-9225887f222a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1405 microversion: 2.20 time: 0.657457 Aug 29 15:52:35.393731 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2948/6087] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:34 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1405 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:35.403037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f4f09b3f-4396-4228-a0af-021bd6423739 req-55708f51-34be-4bf5-aea2-6d5f9698dfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fba35d0-e4ed-4088-a1d1-ccabdd81c178", "name": "network-vif-plugged", "status": "completed", "tag": "db244ebb-da5f-469b-ae27-7da59496c697"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:35.418932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f4f09b3f-4396-4228-a0af-021bd6423739 req-55708f51-34be-4bf5-aea2-6d5f9698dfe2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:35.419564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f4f09b3f-4396-4228-a0af-021bd6423739 req-55708f51-34be-4bf5-aea2-6d5f9698dfe2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:35.420258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f4f09b3f-4396-4228-a0af-021bd6423739 req-55708f51-34be-4bf5-aea2-6d5f9698dfe2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:35.458512 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f4f09b3f-4396-4228-a0af-021bd6423739 req-55708f51-34be-4bf5-aea2-6d5f9698dfe2 service nova] Creating event network-vif-plugged:db244ebb-da5f-469b-ae27-7da59496c697 for instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 on n-h2-839401-11 Aug 29 15:52:35.481408 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f4f09b3f-4396-4228-a0af-021bd6423739 req-55708f51-34be-4bf5-aea2-6d5f9698dfe2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084765 Aug 29 15:52:35.483341 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2949/6088] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:35.520029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f15221e0-52f8-42b9-ae0b-d6e772d71af9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:35.538554 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f15221e0-52f8-42b9-ae0b-d6e772d71af9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1715 microversion: 2.1 time: 0.401008 Aug 29 15:52:35.541315 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3140/6089] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:35 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1715 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:35.750650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ae87d26d-412a-4c9e-a093-e544307b76fb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:35.751430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ae87d26d-412a-4c9e-a093-e544307b76fb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:35.762113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae87d26d-412a-4c9e-a093-e544307b76fb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:35.762868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae87d26d-412a-4c9e-a093-e544307b76fb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:35.763471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae87d26d-412a-4c9e-a093-e544307b76fb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:35.764362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae87d26d-412a-4c9e-a093-e544307b76fb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:35.765027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae87d26d-412a-4c9e-a093-e544307b76fb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:35.765806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae87d26d-412a-4c9e-a093-e544307b76fb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:35.897688 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-ae87d26d-412a-4c9e-a093-e544307b76fb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] HTTP exception thrown: Cannot 'detach_volume' instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b while it is in vm_state rescued Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ae87d26d-412a-4c9e-a093-e544307b76fb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Request method failure captured: Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments/ba7be703-b9c8-49f1-a7a7-01792c699cf4 HTTP/1.1 Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-Shrbl2HxkaYnOtK2CNdk6iJsrlpI7x2pEvqbwalbEhQTR6sDfV2Wu55DTc75O-bivlxXAmF3HFspNNYPdndfOjtbIQTsROFO0VNl42_MzCePBgIneIUPTQCeXIdrBxJJnQjgsKhXk98T5RKZXMNgJMbL43_mClT_pNirw55OB0CI Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bb5330327389417995f14947be334a04 Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bb5330327389417995f14947be334a04", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bb5330327389417995f14947be334a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}] Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bb5330327389417995f14947be334a04 Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e75a8c66c5304e608e2f3120c1192534 Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: exception: Cannot 'detach_volume' instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b while it is in vm_state rescued Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'server_id': '3cbe7b40-fde9-4090-8c20-74c27c5af79b', 'id': 'ba7be703-b9c8-49f1-a7a7-01792c699cf4'} Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b while it is in vm_state rescued Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:35.899469 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:35.903585 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:35.903585 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:35.903585 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:35.903585 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:35.903585 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b while it is in vm_state rescued Aug 29 15:52:35.903585 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:35.904006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ae87d26d-412a-4c9e-a093-e544307b76fb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Returning 409 to user: Cannot 'detach_volume' instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b while it is in vm_state rescued {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:35.904998 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ae87d26d-412a-4c9e-a093-e544307b76fb tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments/ba7be703-b9c8-49f1-a7a7-01792c699cf4" status: 409 len: 152 microversion: 2.1 time: 0.163193 Aug 29 15:52:35.906046 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2950/6090] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 15:52:35 2022] DELETE /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments/ba7be703-b9c8-49f1-a7a7-01792c699cf4 => generated 152 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:52:35.942084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-543d189a-7ce3-4890-9f75-c7961f2d7816 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:35.944518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-543d189a-7ce3-4890-9f75-c7961f2d7816 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:35.966272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-543d189a-7ce3-4890-9f75-c7961f2d7816 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:35.972256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-543d189a-7ce3-4890-9f75-c7961f2d7816 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:35.973876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-543d189a-7ce3-4890-9f75-c7961f2d7816 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:35.984726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-543d189a-7ce3-4890-9f75-c7961f2d7816 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:35.985522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-543d189a-7ce3-4890-9f75-c7961f2d7816 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:35.986281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-543d189a-7ce3-4890-9f75-c7961f2d7816 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:36.096622 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-543d189a-7ce3-4890-9f75-c7961f2d7816 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/action" status: 202 len: 0 microversion: 2.1 time: 0.183427 Aug 29 15:52:36.098105 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3141/6091] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:52:35 2022] POST /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:52:36.120116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e48ffbc-2ebb-4a60-aa71-e013dbe82710 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:36.127068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9e48ffbc-2ebb-4a60-aa71-e013dbe82710 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:36.140500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e48ffbc-2ebb-4a60-aa71-e013dbe82710 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:36.141841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e48ffbc-2ebb-4a60-aa71-e013dbe82710 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:36.142717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e48ffbc-2ebb-4a60-aa71-e013dbe82710 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:36.143874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e48ffbc-2ebb-4a60-aa71-e013dbe82710 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:36.144582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e48ffbc-2ebb-4a60-aa71-e013dbe82710 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:36.145360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e48ffbc-2ebb-4a60-aa71-e013dbe82710 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:36.403383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9982f438-1e27-4e53-a93c-83d732668822 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:36.404119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9982f438-1e27-4e53-a93c-83d732668822 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:36.415764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9982f438-1e27-4e53-a93c-83d732668822 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:36.425729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9982f438-1e27-4e53-a93c-83d732668822 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:36.428185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9982f438-1e27-4e53-a93c-83d732668822 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:36.429008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9982f438-1e27-4e53-a93c-83d732668822 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:36.432180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9982f438-1e27-4e53-a93c-83d732668822 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:36.435813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9982f438-1e27-4e53-a93c-83d732668822 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:36.591400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9e48ffbc-2ebb-4a60-aa71-e013dbe82710 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:36.605655 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9e48ffbc-2ebb-4a60-aa71-e013dbe82710 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1723 microversion: 2.1 time: 0.500828 Aug 29 15:52:36.607846 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2951/6092] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:36 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1723 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:36.817617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9982f438-1e27-4e53-a93c-83d732668822 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:36.861985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9982f438-1e27-4e53-a93c-83d732668822 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:36.863998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9982f438-1e27-4e53-a93c-83d732668822 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:36.866694 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9982f438-1e27-4e53-a93c-83d732668822 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1405 microversion: 2.20 time: 0.468672 Aug 29 15:52:36.867803 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3142/6093] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:36 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1405 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:37.630745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d8580ec2-fe4c-418a-a92d-8ecc89c0b87d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:37.634432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d8580ec2-fe4c-418a-a92d-8ecc89c0b87d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:37.642771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8580ec2-fe4c-418a-a92d-8ecc89c0b87d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:37.643596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8580ec2-fe4c-418a-a92d-8ecc89c0b87d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:37.644293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8580ec2-fe4c-418a-a92d-8ecc89c0b87d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:37.645280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8580ec2-fe4c-418a-a92d-8ecc89c0b87d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:37.645968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8580ec2-fe4c-418a-a92d-8ecc89c0b87d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:37.646625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d8580ec2-fe4c-418a-a92d-8ecc89c0b87d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:37.897772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4a4dfbe8-f905-4d38-878b-49cc005cba53 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:37.899192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4a4dfbe8-f905-4d38-878b-49cc005cba53 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:37.925446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a4dfbe8-f905-4d38-878b-49cc005cba53 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:37.926282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a4dfbe8-f905-4d38-878b-49cc005cba53 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:37.927458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a4dfbe8-f905-4d38-878b-49cc005cba53 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:37.928420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a4dfbe8-f905-4d38-878b-49cc005cba53 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:37.929661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a4dfbe8-f905-4d38-878b-49cc005cba53 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:37.930652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a4dfbe8-f905-4d38-878b-49cc005cba53 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:38.129025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d8580ec2-fe4c-418a-a92d-8ecc89c0b87d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:38.147260 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d8580ec2-fe4c-418a-a92d-8ecc89c0b87d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1723 microversion: 2.1 time: 0.518184 Aug 29 15:52:38.148473 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2952/6094] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:37 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1723 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:38.238046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4a4dfbe8-f905-4d38-878b-49cc005cba53 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:38.252105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4a4dfbe8-f905-4d38-878b-49cc005cba53 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:38.258254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4a4dfbe8-f905-4d38-878b-49cc005cba53 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:38.260225 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4a4dfbe8-f905-4d38-878b-49cc005cba53 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1596 microversion: 2.20 time: 0.370889 Aug 29 15:52:38.260943 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3143/6095] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:37 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1596 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:52:38.282472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4dd7b6d0-a21e-49f6-8529-a93cb02468a1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:38.283013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4dd7b6d0-a21e-49f6-8529-a93cb02468a1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:38.289382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dd7b6d0-a21e-49f6-8529-a93cb02468a1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:38.289887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dd7b6d0-a21e-49f6-8529-a93cb02468a1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:38.290332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dd7b6d0-a21e-49f6-8529-a93cb02468a1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:38.291053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dd7b6d0-a21e-49f6-8529-a93cb02468a1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:38.291518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dd7b6d0-a21e-49f6-8529-a93cb02468a1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:38.291952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dd7b6d0-a21e-49f6-8529-a93cb02468a1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:38.498082 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4dd7b6d0-a21e-49f6-8529-a93cb02468a1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.219687 Aug 29 15:52:38.503641 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2953/6096] 10.222.0.62 () {60 vars in 1316 bytes} [Mon Aug 29 15:52:38 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-interface => generated 284 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:52:39.168006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-11e302eb-751b-45d2-9f15-16e15cfa6c2a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:39.168618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-11e302eb-751b-45d2-9f15-16e15cfa6c2a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:39.187553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11e302eb-751b-45d2-9f15-16e15cfa6c2a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:39.188046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11e302eb-751b-45d2-9f15-16e15cfa6c2a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:39.188484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11e302eb-751b-45d2-9f15-16e15cfa6c2a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:39.189308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11e302eb-751b-45d2-9f15-16e15cfa6c2a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:39.189762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11e302eb-751b-45d2-9f15-16e15cfa6c2a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:39.190329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11e302eb-751b-45d2-9f15-16e15cfa6c2a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:39.503174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-11e302eb-751b-45d2-9f15-16e15cfa6c2a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:39.526445 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-11e302eb-751b-45d2-9f15-16e15cfa6c2a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1723 microversion: 2.1 time: 0.362286 Aug 29 15:52:39.533408 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3144/6097] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:39 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1723 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:39.974752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-24faaea1-d6bb-476e-9c70-10ebc504dc30 req-6554973c-a200-41ae-8e6e-89c42e6b5409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fba35d0-e4ed-4088-a1d1-ccabdd81c178", "tag": "db244ebb-da5f-469b-ae27-7da59496c697"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:39.995709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-24faaea1-d6bb-476e-9c70-10ebc504dc30 req-6554973c-a200-41ae-8e6e-89c42e6b5409 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:39.996430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-24faaea1-d6bb-476e-9c70-10ebc504dc30 req-6554973c-a200-41ae-8e6e-89c42e6b5409 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:39.997053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-24faaea1-d6bb-476e-9c70-10ebc504dc30 req-6554973c-a200-41ae-8e6e-89c42e6b5409 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:40.010410 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-24faaea1-d6bb-476e-9c70-10ebc504dc30 req-6554973c-a200-41ae-8e6e-89c42e6b5409 service nova] Creating event network-changed:db244ebb-da5f-469b-ae27-7da59496c697 for instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 on n-h2-839401-11 Aug 29 15:52:40.017887 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-24faaea1-d6bb-476e-9c70-10ebc504dc30 req-6554973c-a200-41ae-8e6e-89c42e6b5409 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049989 Aug 29 15:52:40.019077 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2954/6098] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:40.548079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d32b355b-08d9-4634-8255-9578421fbdf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:40.549137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d32b355b-08d9-4634-8255-9578421fbdf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:40.563181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d32b355b-08d9-4634-8255-9578421fbdf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:40.564042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d32b355b-08d9-4634-8255-9578421fbdf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:40.565420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d32b355b-08d9-4634-8255-9578421fbdf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:40.567908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d32b355b-08d9-4634-8255-9578421fbdf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:40.568551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d32b355b-08d9-4634-8255-9578421fbdf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:40.569650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d32b355b-08d9-4634-8255-9578421fbdf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:40.853540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d32b355b-08d9-4634-8255-9578421fbdf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:40.862417 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d32b355b-08d9-4634-8255-9578421fbdf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1723 microversion: 2.1 time: 0.318964 Aug 29 15:52:40.863579 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3145/6099] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:40 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:41.064004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-866c6154-568f-4cd3-8c2f-89c842c449d5 tempest-ComputeTenantNetworksTest-870558327 tempest-ComputeTenantNetworksTest-870558327-project] Calling method '.version_select at 0x7fc42a8bf700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:41.838580 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-866c6154-568f-4cd3-8c2f-89c842c449d5 tempest-ComputeTenantNetworksTest-870558327 tempest-ComputeTenantNetworksTest-870558327-project] 10.222.0.62 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.007823 Aug 29 15:52:41.839192 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2955/6100] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 15:52:40 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:41.851199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b528fbe-9e77-417c-9b82-1088b46fce6b tempest-ComputeTenantNetworksTest-870558327 tempest-ComputeTenantNetworksTest-870558327-project] Calling method '.version_select at 0x7fc42a6afb80>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:41.884591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d96dc880-1157-4b07-b7a1-7b136aa0e411 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:41.885401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d96dc880-1157-4b07-b7a1-7b136aa0e411 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:41.899383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d96dc880-1157-4b07-b7a1-7b136aa0e411 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:41.899873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d96dc880-1157-4b07-b7a1-7b136aa0e411 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:41.900327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d96dc880-1157-4b07-b7a1-7b136aa0e411 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:41.901413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d96dc880-1157-4b07-b7a1-7b136aa0e411 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:41.902039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d96dc880-1157-4b07-b7a1-7b136aa0e411 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:41.902614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d96dc880-1157-4b07-b7a1-7b136aa0e411 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:41.969557 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6b528fbe-9e77-417c-9b82-1088b46fce6b tempest-ComputeTenantNetworksTest-870558327 tempest-ComputeTenantNetworksTest-870558327-project] 10.222.0.62 "GET /compute/v2.1/os-tenant-networks/7ea8ded2-8903-41a2-9179-0b274415dee6" status: 200 len: 139 microversion: 2.1 time: 0.123294 Aug 29 15:52:41.970480 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3146/6101] 10.222.0.62 () {58 vars in 1269 bytes} [Mon Aug 29 15:52:41 2022] GET /compute/v2.1/os-tenant-networks/7ea8ded2-8903-41a2-9179-0b274415dee6 => generated 139 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:52:41.975306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-143a9747-e93e-452a-a9ad-151292e7632c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:41.977918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-143a9747-e93e-452a-a9ad-151292e7632c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:41.984799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-143a9747-e93e-452a-a9ad-151292e7632c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:41.985675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-143a9747-e93e-452a-a9ad-151292e7632c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:41.986290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-143a9747-e93e-452a-a9ad-151292e7632c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:41.987137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-143a9747-e93e-452a-a9ad-151292e7632c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:41.987737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-143a9747-e93e-452a-a9ad-151292e7632c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:41.988330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-143a9747-e93e-452a-a9ad-151292e7632c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:42.064784 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-143a9747-e93e-452a-a9ad-151292e7632c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222/action" status: 200 len: 24564 microversion: 2.1 time: 0.093150 Aug 29 15:52:42.066608 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3147/6102] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:52:41 2022] POST /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222/action => generated 24564 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:52:42.310818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d96dc880-1157-4b07-b7a1-7b136aa0e411 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:42.353402 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d96dc880-1157-4b07-b7a1-7b136aa0e411 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1729 microversion: 2.1 time: 0.471897 Aug 29 15:52:42.359193 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2956/6103] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:41 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1729 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:42.375971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-81fb87a5-bfc4-4964-8f0c-9febeda2a972 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:42.376760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-81fb87a5-bfc4-4964-8f0c-9febeda2a972 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:42.384523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81fb87a5-bfc4-4964-8f0c-9febeda2a972 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:42.385283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81fb87a5-bfc4-4964-8f0c-9febeda2a972 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:42.385938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81fb87a5-bfc4-4964-8f0c-9febeda2a972 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:42.386841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81fb87a5-bfc4-4964-8f0c-9febeda2a972 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:42.387476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81fb87a5-bfc4-4964-8f0c-9febeda2a972 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:42.388081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81fb87a5-bfc4-4964-8f0c-9febeda2a972 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:42.505785 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-81fb87a5-bfc4-4964-8f0c-9febeda2a972 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134551 Aug 29 15:52:42.507203 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3148/6104] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:52:42 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:43.759300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-a4d4496b-302a-4d85-a83b-ffa7e3d05fbf req-5f5d611c-5b19-4b72-9be7-b07e19a4de4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cbe7b40-fde9-4090-8c20-74c27c5af79b", "tag": "55968408-6166-427a-867d-93135f6ec6d5"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:43.797779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a4d4496b-302a-4d85-a83b-ffa7e3d05fbf req-5f5d611c-5b19-4b72-9be7-b07e19a4de4b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:43.798419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a4d4496b-302a-4d85-a83b-ffa7e3d05fbf req-5f5d611c-5b19-4b72-9be7-b07e19a4de4b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:43.798872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a4d4496b-302a-4d85-a83b-ffa7e3d05fbf req-5f5d611c-5b19-4b72-9be7-b07e19a4de4b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:43.812158 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-a4d4496b-302a-4d85-a83b-ffa7e3d05fbf req-5f5d611c-5b19-4b72-9be7-b07e19a4de4b service nova] Creating event network-changed:55968408-6166-427a-867d-93135f6ec6d5 for instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b on n-h2-839401-11 Aug 29 15:52:43.818415 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-a4d4496b-302a-4d85-a83b-ffa7e3d05fbf req-5f5d611c-5b19-4b72-9be7-b07e19a4de4b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063354 Aug 29 15:52:43.823689 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2957/6105] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:44.877700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ab4c162c-89aa-46fd-b6c2-bb528748e852 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Action: 'create', calling method: .version_select at 0x7fc42a66d280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1142630216"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:45.348865 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ab4c162c-89aa-46fd-b6c2-bb528748e852 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.892548 Aug 29 15:52:45.350128 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3149/6106] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Aug 29 15:52:44 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 895 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 15:52:45.378708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0dc939cd-fa66-4d99-adac-05a005179a88 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a53c9d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:45.465697 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0dc939cd-fa66-4d99-adac-05a005179a88 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766" status: 200 len: 345 microversion: 2.1 time: 0.106541 Aug 29 15:52:45.467045 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2958/6107] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:52:45 2022] GET /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766 => generated 345 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:45.865493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-99ad3692-70db-4f29-9431-17f4f636e3aa req-18ace08e-fcb5-460f-9119-10762ded9d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cbe7b40-fde9-4090-8c20-74c27c5af79b", "tag": "55968408-6166-427a-867d-93135f6ec6d5"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:45.879944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-99ad3692-70db-4f29-9431-17f4f636e3aa req-18ace08e-fcb5-460f-9119-10762ded9d38 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:45.881336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-99ad3692-70db-4f29-9431-17f4f636e3aa req-18ace08e-fcb5-460f-9119-10762ded9d38 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:45.882318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-99ad3692-70db-4f29-9431-17f4f636e3aa req-18ace08e-fcb5-460f-9119-10762ded9d38 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:45.896996 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-99ad3692-70db-4f29-9431-17f4f636e3aa req-18ace08e-fcb5-460f-9119-10762ded9d38 service nova] Creating event network-changed:55968408-6166-427a-867d-93135f6ec6d5 for instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b on n-h2-839401-11 Aug 29 15:52:45.904566 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-99ad3692-70db-4f29-9431-17f4f636e3aa req-18ace08e-fcb5-460f-9119-10762ded9d38 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046149 Aug 29 15:52:45.906646 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3150/6108] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:52:46.490098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c1cb3393-d32e-4ca1-ba7b-2881ec6dfb44 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a8bb310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:46.549927 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c1cb3393-d32e-4ca1-ba7b-2881ec6dfb44 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766" status: 200 len: 346 microversion: 2.1 time: 0.070707 Aug 29 15:52:46.564165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-298755e9-9453-461a-b11a-90c4ce8d5493 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Action: 'create', calling method: .version_select at 0x7fc42a672a60>, body: {"snapshot": {"volume_id": "25847a25-8ae2-4385-afbc-d78ca1b14766", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-146441463"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:46.564874 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2959/6109] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:52:46 2022] GET /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766 => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:46.852447 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-298755e9-9453-461a-b11a-90c4ce8d5493 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.292302 Aug 29 15:52:46.853759 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3151/6110] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Aug 29 15:52:46 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:46.864725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bfee377c-ec22-4e98-9627-d70ba8404cd7 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a8bb5e0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:46.920001 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bfee377c-ec22-4e98-9627-d70ba8404cd7 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9" status: 200 len: 286 microversion: 2.1 time: 0.059324 Aug 29 15:52:46.920713 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2960/6111] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 15:52:46 2022] GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:46.932578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-03035dca-a467-43b9-b449-635cc627b40a tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a6b53a0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:46.979627 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-03035dca-a467-43b9-b449-635cc627b40a tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.051882 Aug 29 15:52:46.980247 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3152/6112] 10.222.0.62 () {58 vars in 1140 bytes} [Mon Aug 29 15:52:46 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:46.992696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-84607a68-1240-4fac-a762-8ba4a3bb7a32 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a6d7e50>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:47.045280 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-84607a68-1240-4fac-a762-8ba4a3bb7a32 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9" status: 200 len: 286 microversion: 2.1 time: 0.057712 Aug 29 15:52:47.046250 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2961/6113] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 15:52:46 2022] GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:52:48.060250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-095ebe98-3207-4c85-8e51-e6f04bfdac2b tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc43009d160>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:48.105513 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-095ebe98-3207-4c85-8e51-e6f04bfdac2b tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9" status: 200 len: 286 microversion: 2.1 time: 0.050154 Aug 29 15:52:48.106120 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3153/6114] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 15:52:48 2022] GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:49.122755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e8324459-d6fc-4627-b888-fe64c15d2e84 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a7574c0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:49.183604 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e8324459-d6fc-4627-b888-fe64c15d2e84 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9" status: 200 len: 286 microversion: 2.1 time: 0.068195 Aug 29 15:52:49.184463 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2962/6115] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 15:52:49 2022] GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:50.197433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3847371e-0170-4360-96ca-5488c72e119b tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a6d5700>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:50.232272 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3847371e-0170-4360-96ca-5488c72e119b tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9" status: 200 len: 287 microversion: 2.1 time: 0.040049 Aug 29 15:52:50.233190 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3154/6116] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 15:52:50 2022] GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:50.249666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e4479d25-ee6a-40bd-9f9d-9023f8b65c09 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a8bb0d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:50.364129 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e4479d25-ee6a-40bd-9f9d-9023f8b65c09 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9" status: 202 len: 0 microversion: 2.1 time: 0.120723 Aug 29 15:52:50.364895 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2963/6117] 10.222.0.62 () {58 vars in 1254 bytes} [Mon Aug 29 15:52:50 2022] DELETE /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:52:50.373916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24ab7ed4-2115-467e-8fcb-4741cfe38d27 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a702ca0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:50.438321 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-24ab7ed4-2115-467e-8fcb-4741cfe38d27 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9" status: 200 len: 286 microversion: 2.1 time: 0.068695 Aug 29 15:52:50.439065 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3155/6118] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 15:52:50 2022] GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:51.459019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-474d7aca-149c-4bdd-ac03-6fbd4d2f3986 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a872a60>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:51.527723 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-474d7aca-149c-4bdd-ac03-6fbd4d2f3986 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9" status: 200 len: 286 microversion: 2.1 time: 0.074907 Aug 29 15:52:51.531708 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2964/6119] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 15:52:51 2022] GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:52.545260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4d51c0f4-39c7-472b-9a49-69d7a18a49ec tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a6d5160>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:52.573726 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-4d51c0f4-39c7-472b-9a49-69d7a18a49ec tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] HTTP exception thrown: Snapshot c1295799-fe5b-4123-a8a3-2c86b308e7f9 could not be found. Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4d51c0f4-39c7-472b-9a49-69d7a18a49ec tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Request method failure captured: Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9 HTTP/1.1 Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDODM0ehn42NA9uCsZB9gRex2PA48RGu1vJWMclRkkeNdjufvD6-F-z5NluBsscmoGTZa-pgSbYxn1AAqoNkju3hmK0xZeI-tTNaQF_1rrtAW4b2f2GbBHeyKnabAr5AEg56YA1qqONo0I1TLFoZHPw8iLygW9SaiEddBxlawRSjfsjc Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 0d6a9eab79fc4dd291a8576709af0655 Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1564398670 Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0d6a9eab79fc4dd291a8576709af0655", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0d6a9eab79fc4dd291a8576709af0655"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0d6a9eab79fc4dd291a8576709af0655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0d6a9eab79fc4dd291a8576709af0655"}]}] Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1564398670 Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 0d6a9eab79fc4dd291a8576709af0655 Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1564398670 Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-VolumesSnapshotsTestJSON-1564398670-project Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: f4b079e736e1459ca5a571a74286138f Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1564398670-project Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: exception: Snapshot c1295799-fe5b-4123-a8a3-2c86b308e7f9 could not be found. Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'c1295799-fe5b-4123-a8a3-2c86b308e7f9'} Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c1295799-fe5b-4123-a8a3-2c86b308e7f9 could not be found. (HTTP 404) (Request-ID: req-d7afbfec-32db-48fb-b7ed-846288db16f6) Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:52:52.583449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c1295799-fe5b-4123-a8a3-2c86b308e7f9 could not be found. Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c1295799-fe5b-4123-a8a3-2c86b308e7f9 could not be found. Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c1295799-fe5b-4123-a8a3-2c86b308e7f9 could not be found. Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4d51c0f4-39c7-472b-9a49-69d7a18a49ec tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Returning 404 to user: Snapshot c1295799-fe5b-4123-a8a3-2c86b308e7f9 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4d51c0f4-39c7-472b-9a49-69d7a18a49ec tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9" status: 404 len: 111 microversion: 2.1 time: 0.045007 Aug 29 15:52:52.590871 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3156/6120] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 15:52:52 2022] GET /compute/v2.1/os-snapshots/c1295799-fe5b-4123-a8a3-2c86b308e7f9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:52.597155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a0efd3e4-f505-4ae0-8ab1-5f0fd1b7fc00 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a8729d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:52.681634 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a0efd3e4-f505-4ae0-8ab1-5f0fd1b7fc00 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766" status: 202 len: 0 microversion: 2.1 time: 0.090313 Aug 29 15:52:52.684355 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2965/6121] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:52:52 2022] DELETE /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:52:52.692582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c338bfa6-6aef-4cb0-a81a-4c087c5b40c7 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a84faf0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:52.753252 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c338bfa6-6aef-4cb0-a81a-4c087c5b40c7 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766" status: 200 len: 345 microversion: 2.1 time: 0.066322 Aug 29 15:52:52.754060 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3157/6122] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:52:52 2022] GET /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:53.769858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-893cd830-649e-4344-b490-edc443723a35 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a7671f0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:53.783672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:53.805034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=70 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:53.880288 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-893cd830-649e-4344-b490-edc443723a35 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766" status: 200 len: 345 microversion: 2.1 time: 0.116142 Aug 29 15:52:53.881528 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2966/6123] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:52:53 2022] GET /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766 => generated 345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:54.897743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0ded2b37-cd68-4221-93e3-7624ebe3176b tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a6099d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:54.967577 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0ded2b37-cd68-4221-93e3-7624ebe3176b tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766" status: 200 len: 345 microversion: 2.1 time: 0.076187 Aug 29 15:52:54.975427 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3158/6124] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:52:54 2022] GET /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766 => generated 345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:55.982921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1204854c-e7fc-4f21-a2d2-e583109a9afb tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a705c10>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:56.018455 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-1204854c-e7fc-4f21-a2d2-e583109a9afb tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] HTTP exception thrown: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1204854c-e7fc-4f21-a2d2-e583109a9afb tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Request method failure captured: Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766 HTTP/1.1 Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDODM0ehn42NA9uCsZB9gRex2PA48RGu1vJWMclRkkeNdjufvD6-F-z5NluBsscmoGTZa-pgSbYxn1AAqoNkju3hmK0xZeI-tTNaQF_1rrtAW4b2f2GbBHeyKnabAr5AEg56YA1qqONo0I1TLFoZHPw8iLygW9SaiEddBxlawRSjfsjc Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 0d6a9eab79fc4dd291a8576709af0655 Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1564398670 Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0d6a9eab79fc4dd291a8576709af0655", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0d6a9eab79fc4dd291a8576709af0655"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0d6a9eab79fc4dd291a8576709af0655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0d6a9eab79fc4dd291a8576709af0655"}]}] Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1564398670 Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 0d6a9eab79fc4dd291a8576709af0655 Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1564398670 Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-VolumesSnapshotsTestJSON-1564398670-project Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: f4b079e736e1459ca5a571a74286138f Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1564398670-project Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: exception: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '25847a25-8ae2-4385-afbc-d78ca1b14766'} Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. (HTTP 404) (Request-ID: req-d2729f72-3ae8-4d23-9e61-709e6611d94c) Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:52:56.021305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. Aug 29 15:52:56.025173 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.029427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1204854c-e7fc-4f21-a2d2-e583109a9afb tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Returning 404 to user: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:56.030640 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1204854c-e7fc-4f21-a2d2-e583109a9afb tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766" status: 404 len: 109 microversion: 2.1 time: 0.051895 Aug 29 15:52:56.036054 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2967/6125] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:52:55 2022] GET /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:56.044991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6377070e-a2d1-4ed7-bf03-09e27e7fb8e4 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a6130d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:56.058602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=33 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:56.060349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:56.092164 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-6377070e-a2d1-4ed7-bf03-09e27e7fb8e4 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] HTTP exception thrown: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6377070e-a2d1-4ed7-bf03-09e27e7fb8e4 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Request method failure captured: Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766 HTTP/1.1 Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDODM0ehn42NA9uCsZB9gRex2PA48RGu1vJWMclRkkeNdjufvD6-F-z5NluBsscmoGTZa-pgSbYxn1AAqoNkju3hmK0xZeI-tTNaQF_1rrtAW4b2f2GbBHeyKnabAr5AEg56YA1qqONo0I1TLFoZHPw8iLygW9SaiEddBxlawRSjfsjc Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 0d6a9eab79fc4dd291a8576709af0655 Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1564398670 Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0d6a9eab79fc4dd291a8576709af0655", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0d6a9eab79fc4dd291a8576709af0655"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0d6a9eab79fc4dd291a8576709af0655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0d6a9eab79fc4dd291a8576709af0655"}]}] Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1564398670 Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 0d6a9eab79fc4dd291a8576709af0655 Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1564398670 Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-VolumesSnapshotsTestJSON-1564398670-project Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: f4b079e736e1459ca5a571a74286138f Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1564398670-project Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: exception: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '25847a25-8ae2-4385-afbc-d78ca1b14766'} Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. (HTTP 404) (Request-ID: req-6f1e9391-a3bc-4126-90fc-b5ae0ba61295) Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:52:56.096541 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. Aug 29 15:52:56.105273 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.117045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6377070e-a2d1-4ed7-bf03-09e27e7fb8e4 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Returning 404 to user: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:56.117837 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6377070e-a2d1-4ed7-bf03-09e27e7fb8e4 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766" status: 404 len: 109 microversion: 2.1 time: 0.080699 Aug 29 15:52:56.118786 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3159/6126] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:52:56 2022] DELETE /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:56.132480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a62ac064-2d4b-4c08-82ea-ef86fdc1d264 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Calling method '.version_select at 0x7fc42a8bf1f0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:56.203775 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-a62ac064-2d4b-4c08-82ea-ef86fdc1d264 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] HTTP exception thrown: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a62ac064-2d4b-4c08-82ea-ef86fdc1d264 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Request method failure captured: Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766 HTTP/1.1 Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDODM0ehn42NA9uCsZB9gRex2PA48RGu1vJWMclRkkeNdjufvD6-F-z5NluBsscmoGTZa-pgSbYxn1AAqoNkju3hmK0xZeI-tTNaQF_1rrtAW4b2f2GbBHeyKnabAr5AEg56YA1qqONo0I1TLFoZHPw8iLygW9SaiEddBxlawRSjfsjc Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 0d6a9eab79fc4dd291a8576709af0655 Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1564398670 Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0d6a9eab79fc4dd291a8576709af0655", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0d6a9eab79fc4dd291a8576709af0655"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0d6a9eab79fc4dd291a8576709af0655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0d6a9eab79fc4dd291a8576709af0655"}]}] Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1564398670 Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 0d6a9eab79fc4dd291a8576709af0655 Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1564398670 Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-VolumesSnapshotsTestJSON-1564398670-project Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: f4b079e736e1459ca5a571a74286138f Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1564398670-project Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: exception: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '25847a25-8ae2-4385-afbc-d78ca1b14766'} Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. (HTTP 404) (Request-ID: req-b28160b1-f0da-4c3d-bdec-1da3833e7f95) Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:52:56.208637 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. Aug 29 15:52:56.216602 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:52:56.226994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a62ac064-2d4b-4c08-82ea-ef86fdc1d264 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] Returning 404 to user: Volume 25847a25-8ae2-4385-afbc-d78ca1b14766 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:56.228422 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a62ac064-2d4b-4c08-82ea-ef86fdc1d264 tempest-VolumesSnapshotsTestJSON-1564398670 tempest-VolumesSnapshotsTestJSON-1564398670-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766" status: 404 len: 109 microversion: 2.1 time: 0.103631 Aug 29 15:52:56.229833 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2968/6127] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:52:56 2022] GET /compute/v2.1/os-volumes/25847a25-8ae2-4385-afbc-d78ca1b14766 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:53:16.831989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c7f303e6-4056-4b96-abf3-7cfed625ff30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:16.842256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c7f303e6-4056-4b96-abf3-7cfed625ff30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:16.851919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7f303e6-4056-4b96-abf3-7cfed625ff30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:16.852869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7f303e6-4056-4b96-abf3-7cfed625ff30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:16.853583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7f303e6-4056-4b96-abf3-7cfed625ff30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:16.854601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7f303e6-4056-4b96-abf3-7cfed625ff30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:16.855668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7f303e6-4056-4b96-abf3-7cfed625ff30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:16.857441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7f303e6-4056-4b96-abf3-7cfed625ff30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:16.887510 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c7f303e6-4056-4b96-abf3-7cfed625ff30 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/ips" status: 200 len: 148 microversion: 2.1 time: 0.061939 Aug 29 15:53:16.901346 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3160/6128] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:53:16 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/ips => generated 148 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:19.586199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c01e620b-a276-4eea-ae5a-6375dcd97b7a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d737055a-7a12-40ff-b3c6-a0800b8b32c9"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:19.591489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c01e620b-a276-4eea-ae5a-6375dcd97b7a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:19.615174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01e620b-a276-4eea-ae5a-6375dcd97b7a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:19.616726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01e620b-a276-4eea-ae5a-6375dcd97b7a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:19.618118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01e620b-a276-4eea-ae5a-6375dcd97b7a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:19.619765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01e620b-a276-4eea-ae5a-6375dcd97b7a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:19.620982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01e620b-a276-4eea-ae5a-6375dcd97b7a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:19.622082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c01e620b-a276-4eea-ae5a-6375dcd97b7a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.143199 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c01e620b-a276-4eea-ae5a-6375dcd97b7a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "POST /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.564344 Aug 29 15:53:20.149693 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2969/6129] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 15:53:19 2022] POST /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments => generated 194 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:20.832798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85c657f7-682e-4857-a1da-d87800387cf2 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:20.833959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-85c657f7-682e-4857-a1da-d87800387cf2 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:20.847574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85c657f7-682e-4857-a1da-d87800387cf2 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.847988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85c657f7-682e-4857-a1da-d87800387cf2 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.859205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85c657f7-682e-4857-a1da-d87800387cf2 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.863057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85c657f7-682e-4857-a1da-d87800387cf2 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.863579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85c657f7-682e-4857-a1da-d87800387cf2 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.865108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85c657f7-682e-4857-a1da-d87800387cf2 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:21.455916 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85c657f7-682e-4857-a1da-d87800387cf2 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1835 microversion: 2.1 time: 0.627683 Aug 29 15:53:21.458219 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3161/6130] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:20 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1835 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:21.483376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-04a5740f-008e-4226-9f52-853d6011b0d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:21.484189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-04a5740f-008e-4226-9f52-853d6011b0d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:21.491986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a5740f-008e-4226-9f52-853d6011b0d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:21.492537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a5740f-008e-4226-9f52-853d6011b0d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:21.493297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a5740f-008e-4226-9f52-853d6011b0d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:21.494866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a5740f-008e-4226-9f52-853d6011b0d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:21.495681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a5740f-008e-4226-9f52-853d6011b0d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:21.497729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04a5740f-008e-4226-9f52-853d6011b0d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:21.796752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-04a5740f-008e-4226-9f52-853d6011b0d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:21.810506 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-04a5740f-008e-4226-9f52-853d6011b0d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1682 microversion: 2.1 time: 0.333616 Aug 29 15:53:21.811477 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2970/6131] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:21 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1682 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:21.960773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9cd76d3a-fc59-440f-9819-f7afe5770760 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:21.963221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9cd76d3a-fc59-440f-9819-f7afe5770760 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:21.974842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cd76d3a-fc59-440f-9819-f7afe5770760 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:21.975339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cd76d3a-fc59-440f-9819-f7afe5770760 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:21.975784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cd76d3a-fc59-440f-9819-f7afe5770760 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:21.976508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cd76d3a-fc59-440f-9819-f7afe5770760 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:21.976967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cd76d3a-fc59-440f-9819-f7afe5770760 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:21.977459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9cd76d3a-fc59-440f-9819-f7afe5770760 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.060358 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9cd76d3a-fc59-440f-9819-f7afe5770760 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222/action" status: 200 len: 32636 microversion: 2.1 time: 0.107200 Aug 29 15:53:22.066996 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3162/6132] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:53:21 2022] POST /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222/action => generated 32636 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:53:22.221461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-83702079-71bf-4e44-b571-3504a20165f8 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:22.222167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-83702079-71bf-4e44-b571-3504a20165f8 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:22.228716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83702079-71bf-4e44-b571-3504a20165f8 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.229375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83702079-71bf-4e44-b571-3504a20165f8 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.233100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83702079-71bf-4e44-b571-3504a20165f8 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.238482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83702079-71bf-4e44-b571-3504a20165f8 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.239308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83702079-71bf-4e44-b571-3504a20165f8 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.240019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-83702079-71bf-4e44-b571-3504a20165f8 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.299409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-83702079-71bf-4e44-b571-3504a20165f8 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '136896314716474a9f05df902517eee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d14a536694a9e87634fdd0999e960', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:22.300310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-83702079-71bf-4e44-b571-3504a20165f8 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] flavor_id is None. Assuming migration. {{(pid=122361) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 15:53:22.300966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-83702079-71bf-4e44-b571-3504a20165f8 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122361) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 15:53:22.795597 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-83702079-71bf-4e44-b571-3504a20165f8 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222/action" status: 202 len: 0 microversion: 2.1 time: 0.577998 Aug 29 15:53:22.797329 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2971/6133] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:53:22 2022] POST /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:53:22.807220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-95946ecf-9744-4afd-bc23-52e04a60edbc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:22.808277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-95946ecf-9744-4afd-bc23-52e04a60edbc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:22.818939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95946ecf-9744-4afd-bc23-52e04a60edbc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.819580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95946ecf-9744-4afd-bc23-52e04a60edbc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.820228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95946ecf-9744-4afd-bc23-52e04a60edbc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.821051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95946ecf-9744-4afd-bc23-52e04a60edbc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.821630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95946ecf-9744-4afd-bc23-52e04a60edbc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.822156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-95946ecf-9744-4afd-bc23-52e04a60edbc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:23.184875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-95946ecf-9744-4afd-bc23-52e04a60edbc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:23.195686 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-95946ecf-9744-4afd-bc23-52e04a60edbc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1691 microversion: 2.1 time: 0.393751 Aug 29 15:53:23.196955 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3163/6134] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:22 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1691 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:24.219132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-268b126f-94df-43fe-b044-dcf3cbf2ab56 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:24.220036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-268b126f-94df-43fe-b044-dcf3cbf2ab56 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:24.238545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-268b126f-94df-43fe-b044-dcf3cbf2ab56 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:24.239343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-268b126f-94df-43fe-b044-dcf3cbf2ab56 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:24.239960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-268b126f-94df-43fe-b044-dcf3cbf2ab56 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:24.241963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-268b126f-94df-43fe-b044-dcf3cbf2ab56 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:24.242802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-268b126f-94df-43fe-b044-dcf3cbf2ab56 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:24.243451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-268b126f-94df-43fe-b044-dcf3cbf2ab56 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:24.663528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-268b126f-94df-43fe-b044-dcf3cbf2ab56 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:24.677586 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-268b126f-94df-43fe-b044-dcf3cbf2ab56 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1691 microversion: 2.1 time: 0.463935 Aug 29 15:53:24.694529 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2972/6135] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:24 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1691 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:25.702737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0cb3aa78-d02d-4c8b-9fa9-62fc1667b98e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:25.704144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0cb3aa78-d02d-4c8b-9fa9-62fc1667b98e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:25.725951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cb3aa78-d02d-4c8b-9fa9-62fc1667b98e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:25.727628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cb3aa78-d02d-4c8b-9fa9-62fc1667b98e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:25.728122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cb3aa78-d02d-4c8b-9fa9-62fc1667b98e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:25.728879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cb3aa78-d02d-4c8b-9fa9-62fc1667b98e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:25.729410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cb3aa78-d02d-4c8b-9fa9-62fc1667b98e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:25.729844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cb3aa78-d02d-4c8b-9fa9-62fc1667b98e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:26.038775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0cb3aa78-d02d-4c8b-9fa9-62fc1667b98e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:26.051553 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0cb3aa78-d02d-4c8b-9fa9-62fc1667b98e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1691 microversion: 2.1 time: 0.355476 Aug 29 15:53:26.053551 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3164/6136] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:25 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1691 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:27.076559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-da968807-4d2e-42bb-ba09-aa94d87fc004 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:27.077566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-da968807-4d2e-42bb-ba09-aa94d87fc004 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:27.094048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da968807-4d2e-42bb-ba09-aa94d87fc004 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:27.095113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da968807-4d2e-42bb-ba09-aa94d87fc004 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:27.095710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da968807-4d2e-42bb-ba09-aa94d87fc004 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:27.101903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da968807-4d2e-42bb-ba09-aa94d87fc004 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:27.102408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da968807-4d2e-42bb-ba09-aa94d87fc004 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:27.103090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da968807-4d2e-42bb-ba09-aa94d87fc004 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:27.294330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-da968807-4d2e-42bb-ba09-aa94d87fc004 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:27.305448 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-da968807-4d2e-42bb-ba09-aa94d87fc004 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1696 microversion: 2.1 time: 0.233818 Aug 29 15:53:27.319324 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2973/6137] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:27 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1696 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:28.328074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-97c125aa-c7ab-423e-9b20-9e83a057b0ba tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:28.331698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-97c125aa-c7ab-423e-9b20-9e83a057b0ba tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:28.354507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97c125aa-c7ab-423e-9b20-9e83a057b0ba tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:28.357023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97c125aa-c7ab-423e-9b20-9e83a057b0ba tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:28.357588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97c125aa-c7ab-423e-9b20-9e83a057b0ba tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:28.358399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97c125aa-c7ab-423e-9b20-9e83a057b0ba tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:28.358867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97c125aa-c7ab-423e-9b20-9e83a057b0ba tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:28.361109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97c125aa-c7ab-423e-9b20-9e83a057b0ba tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:28.730966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-97c125aa-c7ab-423e-9b20-9e83a057b0ba tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:28.740942 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-97c125aa-c7ab-423e-9b20-9e83a057b0ba tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1696 microversion: 2.1 time: 0.417418 Aug 29 15:53:28.742363 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3165/6138] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:28 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1696 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:29.765292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-856aa15b-3a2d-41d4-aab7-3e5640b462bb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:29.766739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-856aa15b-3a2d-41d4-aab7-3e5640b462bb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:29.782070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-856aa15b-3a2d-41d4-aab7-3e5640b462bb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:29.784356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-856aa15b-3a2d-41d4-aab7-3e5640b462bb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:29.785208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-856aa15b-3a2d-41d4-aab7-3e5640b462bb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:29.786164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-856aa15b-3a2d-41d4-aab7-3e5640b462bb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:29.786866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-856aa15b-3a2d-41d4-aab7-3e5640b462bb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:29.787512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-856aa15b-3a2d-41d4-aab7-3e5640b462bb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:29.991335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-856aa15b-3a2d-41d4-aab7-3e5640b462bb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:30.000067 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-856aa15b-3a2d-41d4-aab7-3e5640b462bb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1696 microversion: 2.1 time: 0.240278 Aug 29 15:53:30.001649 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2974/6139] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:29 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1696 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:31.023001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-382b351a-8431-458e-85fc-1aa95efb80e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:31.024422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-382b351a-8431-458e-85fc-1aa95efb80e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:31.037398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-382b351a-8431-458e-85fc-1aa95efb80e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:31.038658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-382b351a-8431-458e-85fc-1aa95efb80e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:31.042326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-382b351a-8431-458e-85fc-1aa95efb80e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:31.043378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-382b351a-8431-458e-85fc-1aa95efb80e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:31.044142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-382b351a-8431-458e-85fc-1aa95efb80e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:31.044778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-382b351a-8431-458e-85fc-1aa95efb80e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:31.712926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-382b351a-8431-458e-85fc-1aa95efb80e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:31.723253 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-382b351a-8431-458e-85fc-1aa95efb80e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1696 microversion: 2.1 time: 0.704270 Aug 29 15:53:31.739274 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3166/6140] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:31 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1696 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:32.754890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-94db95b9-1c3c-43ac-8dd6-4490c158c983 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:32.755528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-94db95b9-1c3c-43ac-8dd6-4490c158c983 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:32.770491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94db95b9-1c3c-43ac-8dd6-4490c158c983 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:32.772678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94db95b9-1c3c-43ac-8dd6-4490c158c983 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:32.773329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94db95b9-1c3c-43ac-8dd6-4490c158c983 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:32.774210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94db95b9-1c3c-43ac-8dd6-4490c158c983 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:32.785877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94db95b9-1c3c-43ac-8dd6-4490c158c983 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:32.786590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94db95b9-1c3c-43ac-8dd6-4490c158c983 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:33.160520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-94db95b9-1c3c-43ac-8dd6-4490c158c983 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:33.176581 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-94db95b9-1c3c-43ac-8dd6-4490c158c983 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1696 microversion: 2.1 time: 0.424691 Aug 29 15:53:33.180392 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2975/6141] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:32 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1696 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:34.204867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-25275f29-0340-44db-8a8b-21d40acca8ea tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:34.208482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-25275f29-0340-44db-8a8b-21d40acca8ea tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:34.231659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25275f29-0340-44db-8a8b-21d40acca8ea tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:34.235145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25275f29-0340-44db-8a8b-21d40acca8ea tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:34.237904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25275f29-0340-44db-8a8b-21d40acca8ea tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:34.239837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25275f29-0340-44db-8a8b-21d40acca8ea tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:34.240329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25275f29-0340-44db-8a8b-21d40acca8ea tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:34.241355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25275f29-0340-44db-8a8b-21d40acca8ea tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:34.754937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-25275f29-0340-44db-8a8b-21d40acca8ea tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:34.765548 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-25275f29-0340-44db-8a8b-21d40acca8ea tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1696 microversion: 2.1 time: 0.564672 Aug 29 15:53:34.774295 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3167/6142] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:34 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1696 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:34.776752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9772fd8e-1ee8-4cee-8e6d-a24ca1ccfeba tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d737055a-7a12-40ff-b3c6-a0800b8b32c9"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:34.779550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9772fd8e-1ee8-4cee-8e6d-a24ca1ccfeba tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:34.823413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9772fd8e-1ee8-4cee-8e6d-a24ca1ccfeba tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:34.823935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9772fd8e-1ee8-4cee-8e6d-a24ca1ccfeba tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:34.824386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9772fd8e-1ee8-4cee-8e6d-a24ca1ccfeba tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:34.825144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9772fd8e-1ee8-4cee-8e6d-a24ca1ccfeba tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:34.825620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9772fd8e-1ee8-4cee-8e6d-a24ca1ccfeba tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:34.826058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9772fd8e-1ee8-4cee-8e6d-a24ca1ccfeba tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:34.975335 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-9772fd8e-1ee8-4cee-8e6d-a24ca1ccfeba tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] HTTP exception thrown: Invalid volume: volume d737055a-7a12-40ff-b3c6-a0800b8b32c9 is already attached to instances: 52c16c7d-383b-4572-8c59-982ea4f677d0 Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9772fd8e-1ee8-4cee-8e6d-a24ca1ccfeba tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Request method failure captured: Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments HTTP/1.1 Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 74 Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN9tQXht5Cgfnk-DmzN0MSv0rXQhWQjuwOYU5tmb_XOusFJfbKA_p0tIIxvVCByZJRyPrAyx_GOz9WX3qLDWm96rtVzsejl6mJXf7m_CCbLuHpKW-VnQamqEv9ykDteayNDpjpy7E2YIdOozyPaQJ7msypSAairkWE-SbOPzxpLLe7o Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_90cd659e27ab4f5b9c926a11221a8d80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}] Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: a27d353043364e838b7b6db2c5e97215 Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: {"volumeAttachment": {"volumeId": "d737055a-7a12-40ff-b3c6-a0800b8b32c9"}} Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid volume: volume d737055a-7a12-40ff-b3c6-a0800b8b32c9 is already attached to instances: 52c16c7d-383b-4572-8c59-982ea4f677d0 Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'server_id': '52c16c7d-383b-4572-8c59-982ea4f677d0', 'body': {'volumeAttachment': {'volumeId': 'd737055a-7a12-40ff-b3c6-a0800b8b32c9'}}} Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d737055a-7a12-40ff-b3c6-a0800b8b32c9 is already attached to instances: 52c16c7d-383b-4572-8c59-982ea4f677d0 Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:53:34.977881 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d737055a-7a12-40ff-b3c6-a0800b8b32c9 is already attached to instances: 52c16c7d-383b-4572-8c59-982ea4f677d0 Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d737055a-7a12-40ff-b3c6-a0800b8b32c9 is already attached to instances: 52c16c7d-383b-4572-8c59-982ea4f677d0 Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9772fd8e-1ee8-4cee-8e6d-a24ca1ccfeba tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Returning 400 to user: Invalid volume: volume d737055a-7a12-40ff-b3c6-a0800b8b32c9 is already attached to instances: 52c16c7d-383b-4572-8c59-982ea4f677d0 {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9772fd8e-1ee8-4cee-8e6d-a24ca1ccfeba tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "POST /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.208380 Aug 29 15:53:34.985237 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2976/6143] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 15:53:34 2022] POST /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments => generated 174 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:53:35.093222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fbdbf6ef-d596-4443-af5b-d9c87567d10c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:35.094102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fbdbf6ef-d596-4443-af5b-d9c87567d10c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:35.124639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbdbf6ef-d596-4443-af5b-d9c87567d10c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.124915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbdbf6ef-d596-4443-af5b-d9c87567d10c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.125871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbdbf6ef-d596-4443-af5b-d9c87567d10c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.127336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbdbf6ef-d596-4443-af5b-d9c87567d10c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.128036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbdbf6ef-d596-4443-af5b-d9c87567d10c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.128674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbdbf6ef-d596-4443-af5b-d9c87567d10c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.309524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-fbdbf6ef-d596-4443-af5b-d9c87567d10c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lazy-loading 'services' on Instance uuid 52c16c7d-383b-4572-8c59-982ea4f677d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:53:35.483252 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fbdbf6ef-d596-4443-af5b-d9c87567d10c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments/d737055a-7a12-40ff-b3c6-a0800b8b32c9" status: 202 len: 0 microversion: 2.1 time: 0.394257 Aug 29 15:53:35.487033 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3168/6144] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 15:53:35 2022] DELETE /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments/d737055a-7a12-40ff-b3c6-a0800b8b32c9 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:53:35.506127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4f367c91-7616-4ba7-8777-92e145ba1e20 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:35.509158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4f367c91-7616-4ba7-8777-92e145ba1e20 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:35.547208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f367c91-7616-4ba7-8777-92e145ba1e20 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.547208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f367c91-7616-4ba7-8777-92e145ba1e20 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.547208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f367c91-7616-4ba7-8777-92e145ba1e20 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.550667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f367c91-7616-4ba7-8777-92e145ba1e20 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.553852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f367c91-7616-4ba7-8777-92e145ba1e20 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.564098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4f367c91-7616-4ba7-8777-92e145ba1e20 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.683192 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4f367c91-7616-4ba7-8777-92e145ba1e20 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192083 Aug 29 15:53:35.684518 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2977/6145] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:35 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:35.804105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4805249b-9b06-4e97-880c-6129e8fc997f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:35.804986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4805249b-9b06-4e97-880c-6129e8fc997f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:35.817980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4805249b-9b06-4e97-880c-6129e8fc997f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.818644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4805249b-9b06-4e97-880c-6129e8fc997f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.820845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4805249b-9b06-4e97-880c-6129e8fc997f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.821673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4805249b-9b06-4e97-880c-6129e8fc997f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.822369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4805249b-9b06-4e97-880c-6129e8fc997f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.825632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4805249b-9b06-4e97-880c-6129e8fc997f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:36.069832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4805249b-9b06-4e97-880c-6129e8fc997f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:36.084646 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4805249b-9b06-4e97-880c-6129e8fc997f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1696 microversion: 2.1 time: 0.287864 Aug 29 15:53:36.085303 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3169/6146] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:35 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1696 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:36.697763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-27189388-8291-4f14-8917-289653c5fc44 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:36.700306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-27189388-8291-4f14-8917-289653c5fc44 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:36.717044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27189388-8291-4f14-8917-289653c5fc44 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:36.718115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27189388-8291-4f14-8917-289653c5fc44 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:36.718961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27189388-8291-4f14-8917-289653c5fc44 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:36.721404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27189388-8291-4f14-8917-289653c5fc44 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:36.721925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27189388-8291-4f14-8917-289653c5fc44 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:36.722356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27189388-8291-4f14-8917-289653c5fc44 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:36.799751 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-27189388-8291-4f14-8917-289653c5fc44 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098907 Aug 29 15:53:36.802631 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2978/6147] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:36 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:37.107438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65e0b78b-faa5-4b21-9790-2d16b3505169 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:37.108050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-65e0b78b-faa5-4b21-9790-2d16b3505169 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:37.124784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65e0b78b-faa5-4b21-9790-2d16b3505169 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:37.130849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65e0b78b-faa5-4b21-9790-2d16b3505169 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:37.132514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65e0b78b-faa5-4b21-9790-2d16b3505169 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:37.142397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65e0b78b-faa5-4b21-9790-2d16b3505169 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:37.143135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65e0b78b-faa5-4b21-9790-2d16b3505169 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:37.143948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65e0b78b-faa5-4b21-9790-2d16b3505169 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:37.822264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0b080dbc-c306-44ba-a14b-ca47d730a182 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:37.836780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0b080dbc-c306-44ba-a14b-ca47d730a182 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:37.850533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-65e0b78b-faa5-4b21-9790-2d16b3505169 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:37.867884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b080dbc-c306-44ba-a14b-ca47d730a182 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:37.868489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b080dbc-c306-44ba-a14b-ca47d730a182 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:37.868920 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-65e0b78b-faa5-4b21-9790-2d16b3505169 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1696 microversion: 2.1 time: 0.765760 Aug 29 15:53:37.869049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b080dbc-c306-44ba-a14b-ca47d730a182 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:37.869694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b080dbc-c306-44ba-a14b-ca47d730a182 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:37.873047 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3170/6148] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:37 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1696 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:37.873337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b080dbc-c306-44ba-a14b-ca47d730a182 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:37.874178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b080dbc-c306-44ba-a14b-ca47d730a182 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:37.968835 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0b080dbc-c306-44ba-a14b-ca47d730a182 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159918 Aug 29 15:53:37.973127 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2979/6149] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:37 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:38.897548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0a70268b-4ae7-490b-9f1a-bacc80cf6ab8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:38.898820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0a70268b-4ae7-490b-9f1a-bacc80cf6ab8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:38.912499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a70268b-4ae7-490b-9f1a-bacc80cf6ab8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:38.915623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a70268b-4ae7-490b-9f1a-bacc80cf6ab8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:38.917691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a70268b-4ae7-490b-9f1a-bacc80cf6ab8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:38.918852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a70268b-4ae7-490b-9f1a-bacc80cf6ab8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:38.922217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a70268b-4ae7-490b-9f1a-bacc80cf6ab8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:38.923039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0a70268b-4ae7-490b-9f1a-bacc80cf6ab8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:38.967921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-93da3c8e-c262-471e-b023-c2f416324f6d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:38.969078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-93da3c8e-c262-471e-b023-c2f416324f6d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:39.001306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93da3c8e-c262-471e-b023-c2f416324f6d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:39.001982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93da3c8e-c262-471e-b023-c2f416324f6d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:39.002762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93da3c8e-c262-471e-b023-c2f416324f6d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:39.003805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93da3c8e-c262-471e-b023-c2f416324f6d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:39.004422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93da3c8e-c262-471e-b023-c2f416324f6d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:39.004884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93da3c8e-c262-471e-b023-c2f416324f6d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:39.168790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-93da3c8e-c262-471e-b023-c2f416324f6d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lazy-loading 'services' on Instance uuid 3cbe7b40-fde9-4090-8c20-74c27c5af79b {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:53:39.208126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0a70268b-4ae7-490b-9f1a-bacc80cf6ab8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:39.219455 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0a70268b-4ae7-490b-9f1a-bacc80cf6ab8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1696 microversion: 2.1 time: 0.326982 Aug 29 15:53:39.230315 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3171/6150] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:38 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1696 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:39.241776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a3b9d8bf-9d94-4d6c-8c89-eac4ab519736 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:39.252248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a3b9d8bf-9d94-4d6c-8c89-eac4ab519736 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:39.274156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3b9d8bf-9d94-4d6c-8c89-eac4ab519736 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:39.277965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3b9d8bf-9d94-4d6c-8c89-eac4ab519736 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:39.278594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3b9d8bf-9d94-4d6c-8c89-eac4ab519736 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:39.285002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3b9d8bf-9d94-4d6c-8c89-eac4ab519736 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:39.285586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3b9d8bf-9d94-4d6c-8c89-eac4ab519736 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:39.286068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a3b9d8bf-9d94-4d6c-8c89-eac4ab519736 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:39.354281 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-93da3c8e-c262-471e-b023-c2f416324f6d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments/ba7be703-b9c8-49f1-a7a7-01792c699cf4" status: 202 len: 0 microversion: 2.1 time: 0.386019 Aug 29 15:53:39.354993 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2980/6151] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 15:53:38 2022] DELETE /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments/ba7be703-b9c8-49f1-a7a7-01792c699cf4 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:53:39.370471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-82988470-5b41-43fc-9faa-c87b278fe274 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:39.378570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-82988470-5b41-43fc-9faa-c87b278fe274 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:39.394490 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a3b9d8bf-9d94-4d6c-8c89-eac4ab519736 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162696 Aug 29 15:53:39.395122 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3172/6152] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:39 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:39.400684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82988470-5b41-43fc-9faa-c87b278fe274 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:39.402515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82988470-5b41-43fc-9faa-c87b278fe274 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:39.403197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82988470-5b41-43fc-9faa-c87b278fe274 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:39.404147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82988470-5b41-43fc-9faa-c87b278fe274 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:39.404784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82988470-5b41-43fc-9faa-c87b278fe274 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:39.405426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82988470-5b41-43fc-9faa-c87b278fe274 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:39.472008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:39.477468 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-82988470-5b41-43fc-9faa-c87b278fe274 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117836 Aug 29 15:53:39.486402 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2981/6153] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:39 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:53:40.253726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b2403473-199c-41b7-a57c-6a7c2e5bdfe9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:40.255005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b2403473-199c-41b7-a57c-6a7c2e5bdfe9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:40.280791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2403473-199c-41b7-a57c-6a7c2e5bdfe9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.281527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2403473-199c-41b7-a57c-6a7c2e5bdfe9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:40.282187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2403473-199c-41b7-a57c-6a7c2e5bdfe9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:40.283088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2403473-199c-41b7-a57c-6a7c2e5bdfe9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.283702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2403473-199c-41b7-a57c-6a7c2e5bdfe9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:40.284474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2403473-199c-41b7-a57c-6a7c2e5bdfe9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:40.407936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c30d2c08-584f-4182-b1d2-a030e740d4ed tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:40.410605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c30d2c08-584f-4182-b1d2-a030e740d4ed tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:40.426741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c30d2c08-584f-4182-b1d2-a030e740d4ed tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.427434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c30d2c08-584f-4182-b1d2-a030e740d4ed tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:40.428056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c30d2c08-584f-4182-b1d2-a030e740d4ed tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:40.432269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c30d2c08-584f-4182-b1d2-a030e740d4ed tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.433176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c30d2c08-584f-4182-b1d2-a030e740d4ed tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:40.433994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c30d2c08-584f-4182-b1d2-a030e740d4ed tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:40.522202 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c30d2c08-584f-4182-b1d2-a030e740d4ed tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119073 Aug 29 15:53:40.525402 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2982/6154] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:40 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:40.537751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-39bd1ba3-2c32-4e74-abec-57f816ed0ae0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:40.540403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-39bd1ba3-2c32-4e74-abec-57f816ed0ae0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:40.555465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39bd1ba3-2c32-4e74-abec-57f816ed0ae0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.555969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39bd1ba3-2c32-4e74-abec-57f816ed0ae0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:40.556419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39bd1ba3-2c32-4e74-abec-57f816ed0ae0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:40.557169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39bd1ba3-2c32-4e74-abec-57f816ed0ae0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.557636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39bd1ba3-2c32-4e74-abec-57f816ed0ae0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:40.558093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39bd1ba3-2c32-4e74-abec-57f816ed0ae0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:40.631106 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-39bd1ba3-2c32-4e74-abec-57f816ed0ae0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102365 Aug 29 15:53:40.642434 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2983/6155] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:40 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:40.907176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b2403473-199c-41b7-a57c-6a7c2e5bdfe9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:40.935552 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b2403473-199c-41b7-a57c-6a7c2e5bdfe9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1695 microversion: 2.1 time: 0.685635 Aug 29 15:53:40.941290 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3173/6156] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:40 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1695 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:40.958023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-759e235b-1a9d-41d8-96a8-089a904aeef1 req-a7a2e14b-35d8-4c4e-9a27-a07f62fd73b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2e48a2-4790-4e37-98b5-3dcd6375f222", "name": "network-vif-unplugged", "status": "completed", "tag": "daa049ea-5255-46cb-a644-fb8d87623d38"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:40.973230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-759e235b-1a9d-41d8-96a8-089a904aeef1 req-a7a2e14b-35d8-4c4e-9a27-a07f62fd73b9 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.975470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-759e235b-1a9d-41d8-96a8-089a904aeef1 req-a7a2e14b-35d8-4c4e-9a27-a07f62fd73b9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:40.976081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-759e235b-1a9d-41d8-96a8-089a904aeef1 req-a7a2e14b-35d8-4c4e-9a27-a07f62fd73b9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:41.024668 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-759e235b-1a9d-41d8-96a8-089a904aeef1 req-a7a2e14b-35d8-4c4e-9a27-a07f62fd73b9 service nova] Creating event network-vif-unplugged:daa049ea-5255-46cb-a644-fb8d87623d38 for instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 on n-h1-839401-11 Aug 29 15:53:41.037932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-759e235b-1a9d-41d8-96a8-089a904aeef1 req-a7a2e14b-35d8-4c4e-9a27-a07f62fd73b9 service nova] Instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:53:41.091348 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-759e235b-1a9d-41d8-96a8-089a904aeef1 req-a7a2e14b-35d8-4c4e-9a27-a07f62fd73b9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136987 Aug 29 15:53:41.093844 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2984/6157] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:41.538690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ed0235a8-89ee-45b4-9f07-a7743d4273d4 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:41.543701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ed0235a8-89ee-45b4-9f07-a7743d4273d4 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:41.563442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed0235a8-89ee-45b4-9f07-a7743d4273d4 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:41.564634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed0235a8-89ee-45b4-9f07-a7743d4273d4 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.565392 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed0235a8-89ee-45b4-9f07-a7743d4273d4 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:41.566863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed0235a8-89ee-45b4-9f07-a7743d4273d4 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:41.568664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed0235a8-89ee-45b4-9f07-a7743d4273d4 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.570182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed0235a8-89ee-45b4-9f07-a7743d4273d4 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:41.646517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8e655714-fe3a-435d-8f3c-ebae9a154831 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:41.656239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8e655714-fe3a-435d-8f3c-ebae9a154831 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:41.674785 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ed0235a8-89ee-45b4-9f07-a7743d4273d4 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142787 Aug 29 15:53:41.679274 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3174/6158] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:41 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:41.680688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e655714-fe3a-435d-8f3c-ebae9a154831 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:41.681336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e655714-fe3a-435d-8f3c-ebae9a154831 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.682938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e655714-fe3a-435d-8f3c-ebae9a154831 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:41.683776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e655714-fe3a-435d-8f3c-ebae9a154831 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:41.687368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e655714-fe3a-435d-8f3c-ebae9a154831 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.688005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e655714-fe3a-435d-8f3c-ebae9a154831 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:41.777569 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8e655714-fe3a-435d-8f3c-ebae9a154831 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135583 Aug 29 15:53:41.782840 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2985/6159] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:41 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:53:41.961598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3d927b32-5669-46a8-8ffd-b3957846f5c0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:41.962340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3d927b32-5669-46a8-8ffd-b3957846f5c0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:41.974812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d927b32-5669-46a8-8ffd-b3957846f5c0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:41.974980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d927b32-5669-46a8-8ffd-b3957846f5c0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.975599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d927b32-5669-46a8-8ffd-b3957846f5c0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:41.976483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d927b32-5669-46a8-8ffd-b3957846f5c0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:41.977611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d927b32-5669-46a8-8ffd-b3957846f5c0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.979496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d927b32-5669-46a8-8ffd-b3957846f5c0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:42.356841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3d927b32-5669-46a8-8ffd-b3957846f5c0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:42.367003 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3d927b32-5669-46a8-8ffd-b3957846f5c0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1695 microversion: 2.1 time: 0.410541 Aug 29 15:53:42.383489 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3175/6160] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:41 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1695 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:42.691540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ace86363-f206-420c-bbd8-aa8e2c3c86a3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:42.694172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ace86363-f206-420c-bbd8-aa8e2c3c86a3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:42.716488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ace86363-f206-420c-bbd8-aa8e2c3c86a3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:42.719425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ace86363-f206-420c-bbd8-aa8e2c3c86a3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:42.720115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ace86363-f206-420c-bbd8-aa8e2c3c86a3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:42.732709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ace86363-f206-420c-bbd8-aa8e2c3c86a3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:42.733506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ace86363-f206-420c-bbd8-aa8e2c3c86a3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:42.734571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ace86363-f206-420c-bbd8-aa8e2c3c86a3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:42.790458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d7d37ee0-ea6a-40fa-8bae-4058c53f5243 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:42.793342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d7d37ee0-ea6a-40fa-8bae-4058c53f5243 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:42.816291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7d37ee0-ea6a-40fa-8bae-4058c53f5243 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:42.823601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7d37ee0-ea6a-40fa-8bae-4058c53f5243 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:42.824201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7d37ee0-ea6a-40fa-8bae-4058c53f5243 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:42.851088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7d37ee0-ea6a-40fa-8bae-4058c53f5243 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:42.851609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7d37ee0-ea6a-40fa-8bae-4058c53f5243 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:42.852069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7d37ee0-ea6a-40fa-8bae-4058c53f5243 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:42.874759 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ace86363-f206-420c-bbd8-aa8e2c3c86a3 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187928 Aug 29 15:53:42.884118 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2986/6161] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:42 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:42.936858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:42.985919 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d7d37ee0-ea6a-40fa-8bae-4058c53f5243 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199603 Aug 29 15:53:42.993458 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3176/6162] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:42 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:43.214284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-329f4b69-b576-44fa-bc70-dbd54d62ede8 req-feed5fc1-cec9-4149-92b4-516eacbe7f62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed2e48a2-4790-4e37-98b5-3dcd6375f222", "tag": "daa049ea-5255-46cb-a644-fb8d87623d38"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:43.233931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-329f4b69-b576-44fa-bc70-dbd54d62ede8 req-feed5fc1-cec9-4149-92b4-516eacbe7f62 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:43.234441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-329f4b69-b576-44fa-bc70-dbd54d62ede8 req-feed5fc1-cec9-4149-92b4-516eacbe7f62 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:43.235001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-329f4b69-b576-44fa-bc70-dbd54d62ede8 req-feed5fc1-cec9-4149-92b4-516eacbe7f62 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:43.257949 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-329f4b69-b576-44fa-bc70-dbd54d62ede8 req-feed5fc1-cec9-4149-92b4-516eacbe7f62 service nova] Creating event network-changed:daa049ea-5255-46cb-a644-fb8d87623d38 for instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 on n-h1-839401-11 Aug 29 15:53:43.269569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-329f4b69-b576-44fa-bc70-dbd54d62ede8 req-feed5fc1-cec9-4149-92b4-516eacbe7f62 service nova] Instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:53:43.286354 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-329f4b69-b576-44fa-bc70-dbd54d62ede8 req-feed5fc1-cec9-4149-92b4-516eacbe7f62 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081771 Aug 29 15:53:43.286986 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2987/6163] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:43.395850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ac5d3d84-341f-468a-b11c-f57be99d3cdc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:43.396550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ac5d3d84-341f-468a-b11c-f57be99d3cdc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:43.413637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac5d3d84-341f-468a-b11c-f57be99d3cdc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:43.414148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac5d3d84-341f-468a-b11c-f57be99d3cdc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:43.414596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac5d3d84-341f-468a-b11c-f57be99d3cdc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:43.415376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac5d3d84-341f-468a-b11c-f57be99d3cdc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:43.416020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac5d3d84-341f-468a-b11c-f57be99d3cdc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:43.416629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ac5d3d84-341f-468a-b11c-f57be99d3cdc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:43.788078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ac5d3d84-341f-468a-b11c-f57be99d3cdc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:43.805694 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ac5d3d84-341f-468a-b11c-f57be99d3cdc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1695 microversion: 2.1 time: 0.412698 Aug 29 15:53:43.806772 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3177/6164] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:43 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1695 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:43.901257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5098376b-bc63-413e-938d-89c67a9f4b57 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:43.904936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5098376b-bc63-413e-938d-89c67a9f4b57 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:43.928018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5098376b-bc63-413e-938d-89c67a9f4b57 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:43.928560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5098376b-bc63-413e-938d-89c67a9f4b57 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:43.929077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5098376b-bc63-413e-938d-89c67a9f4b57 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:43.929840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5098376b-bc63-413e-938d-89c67a9f4b57 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:43.930296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5098376b-bc63-413e-938d-89c67a9f4b57 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:43.930721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5098376b-bc63-413e-938d-89c67a9f4b57 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:43.998588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1418faad-2e21-45a3-9141-7b55caf13370 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:44.000997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1418faad-2e21-45a3-9141-7b55caf13370 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:44.018491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1418faad-2e21-45a3-9141-7b55caf13370 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:44.019845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1418faad-2e21-45a3-9141-7b55caf13370 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:44.022347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1418faad-2e21-45a3-9141-7b55caf13370 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:44.025507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1418faad-2e21-45a3-9141-7b55caf13370 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:44.026741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1418faad-2e21-45a3-9141-7b55caf13370 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:44.028295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1418faad-2e21-45a3-9141-7b55caf13370 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:44.041518 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5098376b-bc63-413e-938d-89c67a9f4b57 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148273 Aug 29 15:53:44.043896 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2988/6165] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:43 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:44.086651 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1418faad-2e21-45a3-9141-7b55caf13370 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091963 Aug 29 15:53:44.089044 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3178/6166] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:43 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:44.829667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b93a214-4652-4262-8544-49c9ecaddc02 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:44.831163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4b93a214-4652-4262-8544-49c9ecaddc02 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:44.851005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b93a214-4652-4262-8544-49c9ecaddc02 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:44.853208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b93a214-4652-4262-8544-49c9ecaddc02 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:44.856095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b93a214-4652-4262-8544-49c9ecaddc02 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:44.859627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b93a214-4652-4262-8544-49c9ecaddc02 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:44.862471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b93a214-4652-4262-8544-49c9ecaddc02 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:44.869264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b93a214-4652-4262-8544-49c9ecaddc02 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:45.054709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-78cec950-3a9c-40c2-9b0d-a1909374cfeb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:45.057926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-78cec950-3a9c-40c2-9b0d-a1909374cfeb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:45.080559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78cec950-3a9c-40c2-9b0d-a1909374cfeb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:45.082260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78cec950-3a9c-40c2-9b0d-a1909374cfeb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:45.083362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78cec950-3a9c-40c2-9b0d-a1909374cfeb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:45.086327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78cec950-3a9c-40c2-9b0d-a1909374cfeb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:45.087983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78cec950-3a9c-40c2-9b0d-a1909374cfeb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:45.090013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78cec950-3a9c-40c2-9b0d-a1909374cfeb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:45.178985 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-78cec950-3a9c-40c2-9b0d-a1909374cfeb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128312 Aug 29 15:53:45.180069 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3179/6167] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:45 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:45.188454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4bcea379-0707-406f-b4da-a0b760536590 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:45.191462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4bcea379-0707-406f-b4da-a0b760536590 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:45.201263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bcea379-0707-406f-b4da-a0b760536590 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:45.202457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bcea379-0707-406f-b4da-a0b760536590 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:45.203224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bcea379-0707-406f-b4da-a0b760536590 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:45.204285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bcea379-0707-406f-b4da-a0b760536590 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:45.205252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bcea379-0707-406f-b4da-a0b760536590 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:45.205992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bcea379-0707-406f-b4da-a0b760536590 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:45.258324 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4bcea379-0707-406f-b4da-a0b760536590 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075974 Aug 29 15:53:45.259885 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3180/6168] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:45 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:45.929638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4b93a214-4652-4262-8544-49c9ecaddc02 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:45.939241 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4b93a214-4652-4262-8544-49c9ecaddc02 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1693 microversion: 2.1 time: 1.114151 Aug 29 15:53:45.957751 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2989/6169] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:44 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1693 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:46.194809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5a33c6f3-da5c-4abe-afa0-113ccbf6e1bc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:46.197101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5a33c6f3-da5c-4abe-afa0-113ccbf6e1bc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:46.209200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a33c6f3-da5c-4abe-afa0-113ccbf6e1bc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.210789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a33c6f3-da5c-4abe-afa0-113ccbf6e1bc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.211738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a33c6f3-da5c-4abe-afa0-113ccbf6e1bc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.212640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a33c6f3-da5c-4abe-afa0-113ccbf6e1bc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.213363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a33c6f3-da5c-4abe-afa0-113ccbf6e1bc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.214029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a33c6f3-da5c-4abe-afa0-113ccbf6e1bc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.255898 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5a33c6f3-da5c-4abe-afa0-113ccbf6e1bc tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066756 Aug 29 15:53:46.258081 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3181/6170] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:46 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:53:46.280631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5648a3f5-4310-4e55-b2ef-8f03757d7591 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:46.292524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5648a3f5-4310-4e55-b2ef-8f03757d7591 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:46.320463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5648a3f5-4310-4e55-b2ef-8f03757d7591 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.322065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5648a3f5-4310-4e55-b2ef-8f03757d7591 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.324210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5648a3f5-4310-4e55-b2ef-8f03757d7591 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.326831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5648a3f5-4310-4e55-b2ef-8f03757d7591 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.331733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5648a3f5-4310-4e55-b2ef-8f03757d7591 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.332206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5648a3f5-4310-4e55-b2ef-8f03757d7591 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.397525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bd75890d-1aa8-43ca-8460-129092317933 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:46.398191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bd75890d-1aa8-43ca-8460-129092317933 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:46.403289 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5648a3f5-4310-4e55-b2ef-8f03757d7591 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134889 Aug 29 15:53:46.405620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd75890d-1aa8-43ca-8460-129092317933 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.406119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd75890d-1aa8-43ca-8460-129092317933 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.406564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd75890d-1aa8-43ca-8460-129092317933 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.409329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd75890d-1aa8-43ca-8460-129092317933 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.410022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd75890d-1aa8-43ca-8460-129092317933 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.410752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd75890d-1aa8-43ca-8460-129092317933 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.413279 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2990/6171] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:46 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:46.460419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bd75890d-1aa8-43ca-8460-129092317933 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:53:46.616655 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bd75890d-1aa8-43ca-8460-129092317933 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 204 len: 0 microversion: 2.1 time: 0.224892 Aug 29 15:53:46.618231 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3182/6172] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:53:46 2022] DELETE /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:53:46.626608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-355f2394-feb6-4280-a06b-305247b16ddb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:46.627589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-355f2394-feb6-4280-a06b-305247b16ddb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:46.636098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-355f2394-feb6-4280-a06b-305247b16ddb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.637396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-355f2394-feb6-4280-a06b-305247b16ddb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.638139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-355f2394-feb6-4280-a06b-305247b16ddb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.639136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-355f2394-feb6-4280-a06b-305247b16ddb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.639836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-355f2394-feb6-4280-a06b-305247b16ddb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.640673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-355f2394-feb6-4280-a06b-305247b16ddb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.935533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-355f2394-feb6-4280-a06b-305247b16ddb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:46.944553 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-355f2394-feb6-4280-a06b-305247b16ddb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1680 microversion: 2.1 time: 0.321932 Aug 29 15:53:46.948949 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2991/6173] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:46 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1680 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:46.968851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-90146801-99bb-4d65-81ad-20084a45ceb8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:46.969593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-90146801-99bb-4d65-81ad-20084a45ceb8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:46.972099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:46.987174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90146801-99bb-4d65-81ad-20084a45ceb8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.987757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90146801-99bb-4d65-81ad-20084a45ceb8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.988195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90146801-99bb-4d65-81ad-20084a45ceb8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.988905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90146801-99bb-4d65-81ad-20084a45ceb8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.989405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90146801-99bb-4d65-81ad-20084a45ceb8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.989810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90146801-99bb-4d65-81ad-20084a45ceb8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:47.430173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ee088b1f-33f6-43d2-bac7-a67ca80320f7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:47.432815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ee088b1f-33f6-43d2-bac7-a67ca80320f7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:47.468779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee088b1f-33f6-43d2-bac7-a67ca80320f7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:47.469953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee088b1f-33f6-43d2-bac7-a67ca80320f7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:47.472228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee088b1f-33f6-43d2-bac7-a67ca80320f7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:47.477192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee088b1f-33f6-43d2-bac7-a67ca80320f7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:47.477982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee088b1f-33f6-43d2-bac7-a67ca80320f7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:47.480047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee088b1f-33f6-43d2-bac7-a67ca80320f7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:47.530961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-90146801-99bb-4d65-81ad-20084a45ceb8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:47.540186 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-90146801-99bb-4d65-81ad-20084a45ceb8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1693 microversion: 2.1 time: 0.575636 Aug 29 15:53:47.549185 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3183/6174] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:46 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1693 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:47.559933 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ee088b1f-33f6-43d2-bac7-a67ca80320f7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145148 Aug 29 15:53:47.566552 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2992/6175] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:47 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:47.968939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-20b778c7-cf4a-4429-b771-eedd540a1875 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:47.969756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-20b778c7-cf4a-4429-b771-eedd540a1875 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:47.982017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20b778c7-cf4a-4429-b771-eedd540a1875 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:47.985177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20b778c7-cf4a-4429-b771-eedd540a1875 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:47.985746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20b778c7-cf4a-4429-b771-eedd540a1875 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:47.986867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20b778c7-cf4a-4429-b771-eedd540a1875 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:47.987636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20b778c7-cf4a-4429-b771-eedd540a1875 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:47.988226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-20b778c7-cf4a-4429-b771-eedd540a1875 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:48.275394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-20b778c7-cf4a-4429-b771-eedd540a1875 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:48.285340 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-20b778c7-cf4a-4429-b771-eedd540a1875 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1680 microversion: 2.1 time: 0.320400 Aug 29 15:53:48.286700 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3184/6176] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:47 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1680 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:48.574217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d1db800-857d-4b91-b64e-ae88633b43c0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:48.576791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0f3c258d-2787-4cd2-97e2-640b00ecc3ff tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:48.579857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2d1db800-857d-4b91-b64e-ae88633b43c0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:48.580831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0f3c258d-2787-4cd2-97e2-640b00ecc3ff tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:48.592187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d1db800-857d-4b91-b64e-ae88633b43c0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:48.595221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f3c258d-2787-4cd2-97e2-640b00ecc3ff tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:48.595972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f3c258d-2787-4cd2-97e2-640b00ecc3ff tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:48.596529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f3c258d-2787-4cd2-97e2-640b00ecc3ff tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:48.597266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d1db800-857d-4b91-b64e-ae88633b43c0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:48.598128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f3c258d-2787-4cd2-97e2-640b00ecc3ff tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:48.598695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d1db800-857d-4b91-b64e-ae88633b43c0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:48.599395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f3c258d-2787-4cd2-97e2-640b00ecc3ff tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:48.600229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d1db800-857d-4b91-b64e-ae88633b43c0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:48.600699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f3c258d-2787-4cd2-97e2-640b00ecc3ff tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:48.601414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d1db800-857d-4b91-b64e-ae88633b43c0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:48.606398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d1db800-857d-4b91-b64e-ae88633b43c0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:48.690944 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d1db800-857d-4b91-b64e-ae88633b43c0 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120525 Aug 29 15:53:48.695505 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3185/6177] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:48 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:49.006874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0f3c258d-2787-4cd2-97e2-640b00ecc3ff tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:49.026937 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0f3c258d-2787-4cd2-97e2-640b00ecc3ff tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1693 microversion: 2.1 time: 0.459966 Aug 29 15:53:49.034028 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2993/6178] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:48 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1693 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:49.309607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e47bcbf3-8086-4e4d-a71d-4987f8f9eedb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:49.310389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e47bcbf3-8086-4e4d-a71d-4987f8f9eedb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:49.324391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e47bcbf3-8086-4e4d-a71d-4987f8f9eedb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:49.326480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e47bcbf3-8086-4e4d-a71d-4987f8f9eedb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:49.327396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e47bcbf3-8086-4e4d-a71d-4987f8f9eedb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:49.334492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e47bcbf3-8086-4e4d-a71d-4987f8f9eedb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:49.335336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e47bcbf3-8086-4e4d-a71d-4987f8f9eedb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:49.335991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e47bcbf3-8086-4e4d-a71d-4987f8f9eedb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:49.714672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2178f8a8-52fa-479e-b684-ade99821eeef tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:49.718562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2178f8a8-52fa-479e-b684-ade99821eeef tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:49.726177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=53 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:49.744619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2178f8a8-52fa-479e-b684-ade99821eeef tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:49.745386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2178f8a8-52fa-479e-b684-ade99821eeef tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:49.745982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2178f8a8-52fa-479e-b684-ade99821eeef tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:49.747113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2178f8a8-52fa-479e-b684-ade99821eeef tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:49.747865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2178f8a8-52fa-479e-b684-ade99821eeef tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:49.748588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2178f8a8-52fa-479e-b684-ade99821eeef tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:49.816378 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2178f8a8-52fa-479e-b684-ade99821eeef tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106853 Aug 29 15:53:49.820700 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2994/6179] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:49 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:53:50.049614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fb54ea7f-1fdc-4bdb-b836-8689025389d0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:50.050317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fb54ea7f-1fdc-4bdb-b836-8689025389d0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:50.061720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb54ea7f-1fdc-4bdb-b836-8689025389d0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:50.066914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb54ea7f-1fdc-4bdb-b836-8689025389d0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:50.067567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb54ea7f-1fdc-4bdb-b836-8689025389d0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:50.068475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb54ea7f-1fdc-4bdb-b836-8689025389d0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:50.070145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb54ea7f-1fdc-4bdb-b836-8689025389d0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:50.071557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb54ea7f-1fdc-4bdb-b836-8689025389d0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:50.299774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e47bcbf3-8086-4e4d-a71d-4987f8f9eedb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:50.314654 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e47bcbf3-8086-4e4d-a71d-4987f8f9eedb tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1680 microversion: 2.1 time: 1.011847 Aug 29 15:53:50.315469 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3186/6180] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:49 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1680 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:50.854343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-02dc9a3d-6909-4b1b-baf6-f9804feeabf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:50.856574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-02dc9a3d-6909-4b1b-baf6-f9804feeabf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:50.876666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02dc9a3d-6909-4b1b-baf6-f9804feeabf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:50.877195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02dc9a3d-6909-4b1b-baf6-f9804feeabf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:50.877651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02dc9a3d-6909-4b1b-baf6-f9804feeabf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:50.884968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02dc9a3d-6909-4b1b-baf6-f9804feeabf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:50.885514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02dc9a3d-6909-4b1b-baf6-f9804feeabf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:50.886634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02dc9a3d-6909-4b1b-baf6-f9804feeabf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:50.974487 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-02dc9a3d-6909-4b1b-baf6-f9804feeabf3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138576 Aug 29 15:53:50.975820 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3187/6181] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:50 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:51.064257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fb54ea7f-1fdc-4bdb-b836-8689025389d0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:51.078422 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fb54ea7f-1fdc-4bdb-b836-8689025389d0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1690 microversion: 2.1 time: 1.034251 Aug 29 15:53:51.091871 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2995/6182] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:50 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1690 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:51.100085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ef911729-88e9-452a-8a8c-b8c8482f2235 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:51.100993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ef911729-88e9-452a-8a8c-b8c8482f2235 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:51.117521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef911729-88e9-452a-8a8c-b8c8482f2235 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:51.118825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef911729-88e9-452a-8a8c-b8c8482f2235 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:51.120334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef911729-88e9-452a-8a8c-b8c8482f2235 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:51.140027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef911729-88e9-452a-8a8c-b8c8482f2235 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:51.147439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef911729-88e9-452a-8a8c-b8c8482f2235 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:51.149721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef911729-88e9-452a-8a8c-b8c8482f2235 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:51.291696 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ef911729-88e9-452a-8a8c-b8c8482f2235 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222/action" status: 204 len: 0 microversion: 2.1 time: 0.195700 Aug 29 15:53:51.292759 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3188/6183] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:53:51 2022] POST /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222/action => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:53:51.302039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-647ffc36-67ed-4ec0-b601-5c834e212ce0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:51.303842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-647ffc36-67ed-4ec0-b601-5c834e212ce0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:51.314335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-647ffc36-67ed-4ec0-b601-5c834e212ce0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:51.317720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-647ffc36-67ed-4ec0-b601-5c834e212ce0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:51.318359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-647ffc36-67ed-4ec0-b601-5c834e212ce0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:51.319299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-647ffc36-67ed-4ec0-b601-5c834e212ce0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:51.319926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-647ffc36-67ed-4ec0-b601-5c834e212ce0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:51.320587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-647ffc36-67ed-4ec0-b601-5c834e212ce0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:51.337658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0dcfca4d-c313-4f75-94a0-e84adef46068 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:51.338388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0dcfca4d-c313-4f75-94a0-e84adef46068 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:51.354844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0dcfca4d-c313-4f75-94a0-e84adef46068 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:51.355388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0dcfca4d-c313-4f75-94a0-e84adef46068 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:51.355812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0dcfca4d-c313-4f75-94a0-e84adef46068 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:51.356594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0dcfca4d-c313-4f75-94a0-e84adef46068 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:51.357111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0dcfca4d-c313-4f75-94a0-e84adef46068 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:51.357558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0dcfca4d-c313-4f75-94a0-e84adef46068 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:51.468591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0dcfca4d-c313-4f75-94a0-e84adef46068 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:51.482755 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0dcfca4d-c313-4f75-94a0-e84adef46068 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1612 microversion: 2.1 time: 0.149978 Aug 29 15:53:51.498824 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3189/6184] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:51 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1612 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:51.918595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-8721bb8c-2591-4864-b5a2-4ce9f8aeffb0 req-e78041b4-a8b4-4a5c-b96b-c7334c348f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52c16c7d-383b-4572-8c59-982ea4f677d0", "name": "network-vif-deleted", "tag": "5d40b62c-10f3-4b72-bbef-f1f5d5fb1e4b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:51.934967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8721bb8c-2591-4864-b5a2-4ce9f8aeffb0 req-e78041b4-a8b4-4a5c-b96b-c7334c348f25 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:51.935729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8721bb8c-2591-4864-b5a2-4ce9f8aeffb0 req-e78041b4-a8b4-4a5c-b96b-c7334c348f25 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:51.936433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8721bb8c-2591-4864-b5a2-4ce9f8aeffb0 req-e78041b4-a8b4-4a5c-b96b-c7334c348f25 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:51.976744 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-8721bb8c-2591-4864-b5a2-4ce9f8aeffb0 req-e78041b4-a8b4-4a5c-b96b-c7334c348f25 service nova] Creating event network-vif-deleted:5d40b62c-10f3-4b72-bbef-f1f5d5fb1e4b for instance 52c16c7d-383b-4572-8c59-982ea4f677d0 on n-h1-839401-11 Aug 29 15:53:51.990524 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-8721bb8c-2591-4864-b5a2-4ce9f8aeffb0 req-e78041b4-a8b4-4a5c-b96b-c7334c348f25 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075503 Aug 29 15:53:51.996080 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3190/6185] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:53:52.007408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5bfbeddb-6f1a-4906-8b71-f1e6319311e5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:52.013649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5bfbeddb-6f1a-4906-8b71-f1e6319311e5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:52.025790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bfbeddb-6f1a-4906-8b71-f1e6319311e5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:52.029576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bfbeddb-6f1a-4906-8b71-f1e6319311e5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:52.032588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bfbeddb-6f1a-4906-8b71-f1e6319311e5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:52.033717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bfbeddb-6f1a-4906-8b71-f1e6319311e5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:52.035963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bfbeddb-6f1a-4906-8b71-f1e6319311e5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:52.036613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5bfbeddb-6f1a-4906-8b71-f1e6319311e5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:52.115221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:52.131157 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5bfbeddb-6f1a-4906-8b71-f1e6319311e5 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132859 Aug 29 15:53:52.132440 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3191/6186] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:51 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:52.514161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-043802ee-7a2d-48fe-add9-010827ff90ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:52.517776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-043802ee-7a2d-48fe-add9-010827ff90ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:52.562666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-043802ee-7a2d-48fe-add9-010827ff90ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:52.564950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-043802ee-7a2d-48fe-add9-010827ff90ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:52.567251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-043802ee-7a2d-48fe-add9-010827ff90ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:52.570210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-043802ee-7a2d-48fe-add9-010827ff90ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:52.573676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-043802ee-7a2d-48fe-add9-010827ff90ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:52.575793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-043802ee-7a2d-48fe-add9-010827ff90ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:52.724870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-043802ee-7a2d-48fe-add9-010827ff90ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:52.734089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-043802ee-7a2d-48fe-add9-010827ff90ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:52.734849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-043802ee-7a2d-48fe-add9-010827ff90ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:52.735658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-043802ee-7a2d-48fe-add9-010827ff90ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lazy-loading 'fault' on Instance uuid 52c16c7d-383b-4572-8c59-982ea4f677d0 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:53:52.772917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-647ffc36-67ed-4ec0-b601-5c834e212ce0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:52.787659 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-647ffc36-67ed-4ec0-b601-5c834e212ce0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1690 microversion: 2.1 time: 1.488304 Aug 29 15:53:52.789108 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2996/6187] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:51 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1690 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:52.796017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b6b2a528-7584-4804-ac47-333712a03b19 req-2494fe56-5e96-4461-9f87-9d0f212db840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2e48a2-4790-4e37-98b5-3dcd6375f222", "name": "network-vif-plugged", "status": "completed", "tag": "daa049ea-5255-46cb-a644-fb8d87623d38"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:52.807841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b6b2a528-7584-4804-ac47-333712a03b19 req-2494fe56-5e96-4461-9f87-9d0f212db840 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:52.809103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b6b2a528-7584-4804-ac47-333712a03b19 req-2494fe56-5e96-4461-9f87-9d0f212db840 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:52.811514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b6b2a528-7584-4804-ac47-333712a03b19 req-2494fe56-5e96-4461-9f87-9d0f212db840 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:52.853215 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b6b2a528-7584-4804-ac47-333712a03b19 req-2494fe56-5e96-4461-9f87-9d0f212db840 service nova] Creating event network-vif-plugged:daa049ea-5255-46cb-a644-fb8d87623d38 for instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 on n-h1-839401-11 Aug 29 15:53:52.871479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-b6b2a528-7584-4804-ac47-333712a03b19 req-2494fe56-5e96-4461-9f87-9d0f212db840 service nova] Instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:53:52.904446 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b6b2a528-7584-4804-ac47-333712a03b19 req-2494fe56-5e96-4461-9f87-9d0f212db840 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113105 Aug 29 15:53:52.907661 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2997/6188] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:52.931504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-043802ee-7a2d-48fe-add9-010827ff90ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:52.954513 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-043802ee-7a2d-48fe-add9-010827ff90ab tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 200 len: 1331 microversion: 2.1 time: 0.451953 Aug 29 15:53:52.975266 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3192/6189] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:52 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 1331 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:53.148138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a4537eef-3865-4af8-892c-5d2c96c937b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:53.151516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a4537eef-3865-4af8-892c-5d2c96c937b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:53.174887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4537eef-3865-4af8-892c-5d2c96c937b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:53.175397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4537eef-3865-4af8-892c-5d2c96c937b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:53.179220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4537eef-3865-4af8-892c-5d2c96c937b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:53.180069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4537eef-3865-4af8-892c-5d2c96c937b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:53.180569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4537eef-3865-4af8-892c-5d2c96c937b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:53.181016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4537eef-3865-4af8-892c-5d2c96c937b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:53.266807 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a4537eef-3865-4af8-892c-5d2c96c937b9 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125597 Aug 29 15:53:53.267368 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2998/6190] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:53 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:53:53.834055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fbd41db2-18e8-4f21-b84e-7d7a89b2206c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:53.834680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fbd41db2-18e8-4f21-b84e-7d7a89b2206c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:53.850794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbd41db2-18e8-4f21-b84e-7d7a89b2206c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:53.851494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbd41db2-18e8-4f21-b84e-7d7a89b2206c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:53.852121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbd41db2-18e8-4f21-b84e-7d7a89b2206c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:53.852995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbd41db2-18e8-4f21-b84e-7d7a89b2206c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:53.853640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbd41db2-18e8-4f21-b84e-7d7a89b2206c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:53.854226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbd41db2-18e8-4f21-b84e-7d7a89b2206c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:53.995760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-596e67ce-fb27-4777-9b66-addfda681fcd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:53.997034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-596e67ce-fb27-4777-9b66-addfda681fcd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:54.011039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-596e67ce-fb27-4777-9b66-addfda681fcd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:54.012467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-596e67ce-fb27-4777-9b66-addfda681fcd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:54.014348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-596e67ce-fb27-4777-9b66-addfda681fcd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:54.016977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-596e67ce-fb27-4777-9b66-addfda681fcd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:54.017672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-596e67ce-fb27-4777-9b66-addfda681fcd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:54.021312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-596e67ce-fb27-4777-9b66-addfda681fcd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:54.070431 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-596e67ce-fb27-4777-9b66-addfda681fcd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] HTTP exception thrown: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-596e67ce-fb27-4777-9b66-addfda681fcd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Request method failure captured: Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 HTTP/1.1 Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN9tQXht5Cgfnk-DmzN0MSv0rXQhWQjuwOYU5tmb_XOusFJfbKA_p0tIIxvVCByZJRyPrAyx_GOz9WX3qLDWm96rtVzsejl6mJXf7m_CCbLuHpKW-VnQamqEv9ykDteayNDpjpy7E2YIdOozyPaQJ7msypSAairkWE-SbOPzxpLLe7o Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_90cd659e27ab4f5b9c926a11221a8d80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}] Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: a27d353043364e838b7b6db2c5e97215 Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '52c16c7d-383b-4572-8c59-982ea4f677d0'} Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:54.072267 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:53:54.076940 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:54.076940 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:54.076940 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:54.076940 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:54.076940 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:54.076940 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. Aug 29 15:53:54.076940 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:53:54.077477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fbd41db2-18e8-4f21-b84e-7d7a89b2206c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:54.085332 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fbd41db2-18e8-4f21-b84e-7d7a89b2206c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1690 microversion: 2.1 time: 0.255101 Aug 29 15:53:54.085951 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3193/6191] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:53 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1690 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:54.090004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-596e67ce-fb27-4777-9b66-addfda681fcd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Returning 404 to user: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:54.091124 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-596e67ce-fb27-4777-9b66-addfda681fcd tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 404 len: 111 microversion: 2.1 time: 0.102439 Aug 29 15:53:54.093800 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 2999/6192] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:53 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:53:54.126336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-199d9fe5-ca7b-469d-b5af-b515e372a870 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '.version_select at 0x7fc42a65d8b0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:54.167930 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-199d9fe5-ca7b-469d-b5af-b515e372a870 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-385542885" status: 202 len: 0 microversion: 2.1 time: 0.065164 Aug 29 15:53:54.170853 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3194/6193] 10.222.0.62 () {58 vars in 1218 bytes} [Mon Aug 29 15:53:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-385542885 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:53:54.279026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b6a6fed9-d459-4c2d-9da0-6eb1e6065b80 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:54.281637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b6a6fed9-d459-4c2d-9da0-6eb1e6065b80 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:54.303409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6a6fed9-d459-4c2d-9da0-6eb1e6065b80 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:54.309740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6a6fed9-d459-4c2d-9da0-6eb1e6065b80 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:54.310657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6a6fed9-d459-4c2d-9da0-6eb1e6065b80 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:54.311583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6a6fed9-d459-4c2d-9da0-6eb1e6065b80 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:54.312208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6a6fed9-d459-4c2d-9da0-6eb1e6065b80 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:54.312977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6a6fed9-d459-4c2d-9da0-6eb1e6065b80 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:54.331957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:54.430864 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b6a6fed9-d459-4c2d-9da0-6eb1e6065b80 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155700 Aug 29 15:53:54.432206 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3000/6194] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:54 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:55.107471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a9678916-3033-441c-b44b-6d2a6de91a97 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:55.108338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a9678916-3033-441c-b44b-6d2a6de91a97 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:55.119746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9678916-3033-441c-b44b-6d2a6de91a97 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.125878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9678916-3033-441c-b44b-6d2a6de91a97 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.126719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9678916-3033-441c-b44b-6d2a6de91a97 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.128144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9678916-3033-441c-b44b-6d2a6de91a97 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.128778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9678916-3033-441c-b44b-6d2a6de91a97 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.129694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9678916-3033-441c-b44b-6d2a6de91a97 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.436144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a9678916-3033-441c-b44b-6d2a6de91a97 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:55.444225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e5aef79a-ac9e-46ae-be77-f842da7e8bf6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:55.447301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e5aef79a-ac9e-46ae-be77-f842da7e8bf6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:55.460185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5aef79a-ac9e-46ae-be77-f842da7e8bf6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.465257 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a9678916-3033-441c-b44b-6d2a6de91a97 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1690 microversion: 2.1 time: 0.356645 Aug 29 15:53:55.465903 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3195/6195] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:55 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1690 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:55.471511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5aef79a-ac9e-46ae-be77-f842da7e8bf6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.476609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5aef79a-ac9e-46ae-be77-f842da7e8bf6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.477601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5aef79a-ac9e-46ae-be77-f842da7e8bf6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.478192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5aef79a-ac9e-46ae-be77-f842da7e8bf6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.479304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5aef79a-ac9e-46ae-be77-f842da7e8bf6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.555831 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e5aef79a-ac9e-46ae-be77-f842da7e8bf6 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114749 Aug 29 15:53:55.559240 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3001/6196] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:53:55 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:53:55.679410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8df6e5e2-d2d2-4dd7-9dc5-4983e310a3ea tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:55.686600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8df6e5e2-d2d2-4dd7-9dc5-4983e310a3ea tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:55.699118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8df6e5e2-d2d2-4dd7-9dc5-4983e310a3ea tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.700345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8df6e5e2-d2d2-4dd7-9dc5-4983e310a3ea tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.701184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8df6e5e2-d2d2-4dd7-9dc5-4983e310a3ea tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.702181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8df6e5e2-d2d2-4dd7-9dc5-4983e310a3ea tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.702885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8df6e5e2-d2d2-4dd7-9dc5-4983e310a3ea tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.703467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8df6e5e2-d2d2-4dd7-9dc5-4983e310a3ea tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.774087 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-8df6e5e2-d2d2-4dd7-9dc5-4983e310a3ea tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] HTTP exception thrown: Cannot 'reboot' instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 while it is in vm_state rescued Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8df6e5e2-d2d2-4dd7-9dc5-4983e310a3ea tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Request method failure captured: Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504/action HTTP/1.1 Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 28 Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-Shrbl2HxkaYnOtK2CNdk6iJsrlpI7x2pEvqbwalbEhQTR6sDfV2Wu55DTc75O-bivlxXAmF3HFspNNYPdndfOjtbIQTsROFO0VNl42_MzCePBgIneIUPTQCeXIdrBxJJnQjgsKhXk98T5RKZXMNgJMbL43_mClT_pNirw55OB0CI Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bb5330327389417995f14947be334a04 Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bb5330327389417995f14947be334a04", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bb5330327389417995f14947be334a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}] Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bb5330327389417995f14947be334a04 Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e75a8c66c5304e608e2f3120c1192534 Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: {"reboot": {"type": "HARD"}} Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: exception: Cannot 'reboot' instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 while it is in vm_state rescued Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '0bb8465e-a1d5-450b-b8e7-bb5f0c154504', 'body': {'reboot': {'type': 'HARD'}}} Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:53:55.776384 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:53:55.787789 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 while it is in vm_state rescued Aug 29 15:53:55.787789 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:53:55.787789 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:55.787789 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:53:55.787789 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:55.787789 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:55.787789 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:55.787789 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:55.787789 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:55.787789 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 while it is in vm_state rescued Aug 29 15:53:55.787789 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:53:55.787789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8df6e5e2-d2d2-4dd7-9dc5-4983e310a3ea tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Returning 409 to user: Cannot 'reboot' instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 while it is in vm_state rescued {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:55.787789 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8df6e5e2-d2d2-4dd7-9dc5-4983e310a3ea tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504/action" status: 409 len: 145 microversion: 2.1 time: 0.104965 Aug 29 15:53:55.787789 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3196/6197] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:53:55 2022] POST /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504/action => generated 145 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:53:55.796578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb9207cf-fe8b-4944-ae52-55c10d3a2113 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:55.803337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bb9207cf-fe8b-4944-ae52-55c10d3a2113 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:55.822671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb9207cf-fe8b-4944-ae52-55c10d3a2113 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.823258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb9207cf-fe8b-4944-ae52-55c10d3a2113 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.823773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb9207cf-fe8b-4944-ae52-55c10d3a2113 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.832759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb9207cf-fe8b-4944-ae52-55c10d3a2113 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.833419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb9207cf-fe8b-4944-ae52-55c10d3a2113 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.833800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb9207cf-fe8b-4944-ae52-55c10d3a2113 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.879318 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-bb9207cf-fe8b-4944-ae52-55c10d3a2113 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] HTTP exception thrown: Cannot 'rebuild' instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 while it is in vm_state rescued Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb9207cf-fe8b-4944-ae52-55c10d3a2113 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Request method failure captured: Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504/action HTTP/1.1 Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 65 Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-Shrbl2HxkaYnOtK2CNdk6iJsrlpI7x2pEvqbwalbEhQTR6sDfV2Wu55DTc75O-bivlxXAmF3HFspNNYPdndfOjtbIQTsROFO0VNl42_MzCePBgIneIUPTQCeXIdrBxJJnQjgsKhXk98T5RKZXMNgJMbL43_mClT_pNirw55OB0CI Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bb5330327389417995f14947be334a04 Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bb5330327389417995f14947be334a04", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bb5330327389417995f14947be334a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}] Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bb5330327389417995f14947be334a04 Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e75a8c66c5304e608e2f3120c1192534 Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: {"rebuild": {"imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c"}} Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: exception: Cannot 'rebuild' instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 while it is in vm_state rescued Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '0bb8465e-a1d5-450b-b8e7-bb5f0c154504', 'body': {'rebuild': {'imageRef': '2c042d4c-e5f7-47c3-ac9e-1fb093df192c'}}} Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:53:55.882890 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 while it is in vm_state rescued Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 while it is in vm_state rescued Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:53:55.887854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb9207cf-fe8b-4944-ae52-55c10d3a2113 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Returning 409 to user: Cannot 'rebuild' instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 while it is in vm_state rescued {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:55.889976 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bb9207cf-fe8b-4944-ae52-55c10d3a2113 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "POST /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504/action" status: 409 len: 146 microversion: 2.1 time: 0.104600 Aug 29 15:53:55.902999 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3002/6198] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:53:55 2022] POST /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504/action => generated 146 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:53:55.903297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fb68300a-532a-4fe1-9a83-a531fdf54b19 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:55.903297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fb68300a-532a-4fe1-9a83-a531fdf54b19 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:55.919022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-43843e90-60d9-48d9-8ca5-d9e3768ee269 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:55.919240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb68300a-532a-4fe1-9a83-a531fdf54b19 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.919531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb68300a-532a-4fe1-9a83-a531fdf54b19 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.919901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-43843e90-60d9-48d9-8ca5-d9e3768ee269 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:55.920033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb68300a-532a-4fe1-9a83-a531fdf54b19 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.920706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb68300a-532a-4fe1-9a83-a531fdf54b19 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.921199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb68300a-532a-4fe1-9a83-a531fdf54b19 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.921632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb68300a-532a-4fe1-9a83-a531fdf54b19 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.928856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43843e90-60d9-48d9-8ca5-d9e3768ee269 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.931062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43843e90-60d9-48d9-8ca5-d9e3768ee269 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.933452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43843e90-60d9-48d9-8ca5-d9e3768ee269 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.934331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43843e90-60d9-48d9-8ca5-d9e3768ee269 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.934916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43843e90-60d9-48d9-8ca5-d9e3768ee269 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.935466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43843e90-60d9-48d9-8ca5-d9e3768ee269 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.964006 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-43843e90-60d9-48d9-8ca5-d9e3768ee269 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/ips" status: 200 len: 151 microversion: 2.20 time: 0.049613 Aug 29 15:53:55.971792 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3003/6199] 10.222.0.62 () {60 vars in 1289 bytes} [Mon Aug 29 15:53:55 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:53:55.983503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fb68300a-532a-4fe1-9a83-a531fdf54b19 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:53:56.183619 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fb68300a-532a-4fe1-9a83-a531fdf54b19 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 204 len: 0 microversion: 2.1 time: 0.286176 Aug 29 15:53:56.185191 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3197/6200] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:53:55 2022] DELETE /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:53:56.195107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1ace85f3-d491-474a-bda8-be4bd38efc38 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:56.196024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1ace85f3-d491-474a-bda8-be4bd38efc38 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:56.207008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ace85f3-d491-474a-bda8-be4bd38efc38 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:56.208005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ace85f3-d491-474a-bda8-be4bd38efc38 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:56.208704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ace85f3-d491-474a-bda8-be4bd38efc38 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:56.212409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ace85f3-d491-474a-bda8-be4bd38efc38 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:56.213335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ace85f3-d491-474a-bda8-be4bd38efc38 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:56.214027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ace85f3-d491-474a-bda8-be4bd38efc38 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:56.489608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-93fa3dd0-a6ff-42f8-9f0a-ae8bcd91bd3e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:56.490641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-93fa3dd0-a6ff-42f8-9f0a-ae8bcd91bd3e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:56.510327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93fa3dd0-a6ff-42f8-9f0a-ae8bcd91bd3e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:56.510847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93fa3dd0-a6ff-42f8-9f0a-ae8bcd91bd3e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:56.511295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93fa3dd0-a6ff-42f8-9f0a-ae8bcd91bd3e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:56.512022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93fa3dd0-a6ff-42f8-9f0a-ae8bcd91bd3e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:56.512493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93fa3dd0-a6ff-42f8-9f0a-ae8bcd91bd3e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:56.512935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93fa3dd0-a6ff-42f8-9f0a-ae8bcd91bd3e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:56.732642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1ace85f3-d491-474a-bda8-be4bd38efc38 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:56.750191 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1ace85f3-d491-474a-bda8-be4bd38efc38 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1689 microversion: 2.1 time: 0.557288 Aug 29 15:53:56.752231 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3004/6201] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:56 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1689 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:56.896650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-93fa3dd0-a6ff-42f8-9f0a-ae8bcd91bd3e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:56.909175 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-93fa3dd0-a6ff-42f8-9f0a-ae8bcd91bd3e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1682 microversion: 2.1 time: 0.424322 Aug 29 15:53:56.910258 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3198/6202] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:56 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1682 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:57.070846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a93b4a6a-1ba4-4cab-89da-a616cd4db82c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Action: 'create', calling method: .version_select at 0x7fc42a8a54c0>, body: {"keypair": {"name": "tempest-keypair-1126247420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMONVU9iV6y4mXPF917fFe3Hxa1HBzwmDac5aD12r/xKnhVUyIBtcJA3VVwp9lIF8QPnhqfUc1Hbcqz5EwuQAisBZANt/xdf4y0Bk1EMP7ziiJsrrIfU7h8TzI+VESs5Q=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:57.106640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-a93b4a6a-1ba4-4cab-89da-a616cd4db82c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Getting quotas for project 90cd659e27ab4f5b9c926a11221a8d80. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:53:57.134373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-a93b4a6a-1ba4-4cab-89da-a616cd4db82c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Getting quotas for user a27d353043364e838b7b6db2c5e97215 and project 90cd659e27ab4f5b9c926a11221a8d80. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:53:57.189492 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a93b4a6a-1ba4-4cab-89da-a616cd4db82c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129640 Aug 29 15:53:57.192396 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3005/6203] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:53:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:57.779764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24fab4ff-b02e-4e98-87c5-b69551eeaea7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:57.780545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-24fab4ff-b02e-4e98-87c5-b69551eeaea7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:57.794047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24fab4ff-b02e-4e98-87c5-b69551eeaea7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:57.800424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24fab4ff-b02e-4e98-87c5-b69551eeaea7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:57.803513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24fab4ff-b02e-4e98-87c5-b69551eeaea7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:57.806032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24fab4ff-b02e-4e98-87c5-b69551eeaea7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:57.808508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24fab4ff-b02e-4e98-87c5-b69551eeaea7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:57.809945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24fab4ff-b02e-4e98-87c5-b69551eeaea7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:58.567442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-24fab4ff-b02e-4e98-87c5-b69551eeaea7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:58.582865 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-24fab4ff-b02e-4e98-87c5-b69551eeaea7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1689 microversion: 2.1 time: 0.810583 Aug 29 15:53:58.584806 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3199/6204] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:57 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1689 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:59.330580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-20d4e7dc-e5e5-4952-8c04-9f8b398e3619 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:59.331430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-20d4e7dc-e5e5-4952-8c04-9f8b398e3619 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:59.360916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20d4e7dc-e5e5-4952-8c04-9f8b398e3619 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:59.361574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20d4e7dc-e5e5-4952-8c04-9f8b398e3619 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:59.365145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20d4e7dc-e5e5-4952-8c04-9f8b398e3619 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:59.366000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20d4e7dc-e5e5-4952-8c04-9f8b398e3619 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:59.366500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20d4e7dc-e5e5-4952-8c04-9f8b398e3619 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:59.366937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20d4e7dc-e5e5-4952-8c04-9f8b398e3619 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:59.399228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-20d4e7dc-e5e5-4952-8c04-9f8b398e3619 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lazy-loading 'flavor' on Instance uuid 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:53:59.606262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e7078f1b-df4a-4cc1-b4cc-36be615dc997 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:59.606901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e7078f1b-df4a-4cc1-b4cc-36be615dc997 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:59.620965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7078f1b-df4a-4cc1-b4cc-36be615dc997 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:59.621854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7078f1b-df4a-4cc1-b4cc-36be615dc997 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:59.623261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7078f1b-df4a-4cc1-b4cc-36be615dc997 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:59.624877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7078f1b-df4a-4cc1-b4cc-36be615dc997 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:59.626185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7078f1b-df4a-4cc1-b4cc-36be615dc997 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:59.629586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e7078f1b-df4a-4cc1-b4cc-36be615dc997 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:59.713059 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-20d4e7dc-e5e5-4952-8c04-9f8b398e3619 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "POST /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/action" status: 202 len: 0 microversion: 2.20 time: 0.389692 Aug 29 15:53:59.714867 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3006/6205] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 15:53:59 2022] POST /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:53:59.726032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3c5b003a-ebda-447c-b740-fe56abf35e0c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:59.727004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3c5b003a-ebda-447c-b740-fe56abf35e0c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:59.737235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c5b003a-ebda-447c-b740-fe56abf35e0c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:59.738313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c5b003a-ebda-447c-b740-fe56abf35e0c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:59.739081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c5b003a-ebda-447c-b740-fe56abf35e0c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:59.740399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c5b003a-ebda-447c-b740-fe56abf35e0c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:59.742345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c5b003a-ebda-447c-b740-fe56abf35e0c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:59.743123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3c5b003a-ebda-447c-b740-fe56abf35e0c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:59.925241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e7078f1b-df4a-4cc1-b4cc-36be615dc997 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:59.934844 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e7078f1b-df4a-4cc1-b4cc-36be615dc997 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1689 microversion: 2.1 time: 0.334798 Aug 29 15:53:59.938010 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3200/6206] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:59 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1689 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:00.294653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3c5b003a-ebda-447c-b740-fe56abf35e0c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:00.305414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3c5b003a-ebda-447c-b740-fe56abf35e0c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:00.307567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3c5b003a-ebda-447c-b740-fe56abf35e0c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:00.309052 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3c5b003a-ebda-447c-b740-fe56abf35e0c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1721 microversion: 2.20 time: 0.589653 Aug 29 15:54:00.310222 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3007/6207] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:53:59 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1721 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:00.962123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-17284a91-7d6b-48ca-97df-e9d6dc9674dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:00.962645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-17284a91-7d6b-48ca-97df-e9d6dc9674dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:00.986031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17284a91-7d6b-48ca-97df-e9d6dc9674dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:00.989863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17284a91-7d6b-48ca-97df-e9d6dc9674dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:00.990500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17284a91-7d6b-48ca-97df-e9d6dc9674dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:00.993910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17284a91-7d6b-48ca-97df-e9d6dc9674dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:00.994556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17284a91-7d6b-48ca-97df-e9d6dc9674dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:00.995408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17284a91-7d6b-48ca-97df-e9d6dc9674dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:01.332974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-804d64b0-f69b-41de-a8e9-80b328bc9fd9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:01.334471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-804d64b0-f69b-41de-a8e9-80b328bc9fd9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:01.357546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-804d64b0-f69b-41de-a8e9-80b328bc9fd9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:01.358317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-804d64b0-f69b-41de-a8e9-80b328bc9fd9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:01.361283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-804d64b0-f69b-41de-a8e9-80b328bc9fd9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:01.362484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-804d64b0-f69b-41de-a8e9-80b328bc9fd9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:01.365022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-804d64b0-f69b-41de-a8e9-80b328bc9fd9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:01.366809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-804d64b0-f69b-41de-a8e9-80b328bc9fd9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:01.464189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-17284a91-7d6b-48ca-97df-e9d6dc9674dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:01.477340 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-17284a91-7d6b-48ca-97df-e9d6dc9674dd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1689 microversion: 2.1 time: 0.522946 Aug 29 15:54:01.484158 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3201/6208] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:00 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1689 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:02.333110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-804d64b0-f69b-41de-a8e9-80b328bc9fd9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:02.348605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-804d64b0-f69b-41de-a8e9-80b328bc9fd9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:02.359784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-804d64b0-f69b-41de-a8e9-80b328bc9fd9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:02.362382 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-804d64b0-f69b-41de-a8e9-80b328bc9fd9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1721 microversion: 2.20 time: 1.032750 Aug 29 15:54:02.378357 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3008/6209] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:01 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1721 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:02.505449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-68a276a7-6827-45d8-be19-a2b240a5f79a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:02.506069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-68a276a7-6827-45d8-be19-a2b240a5f79a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:02.523719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68a276a7-6827-45d8-be19-a2b240a5f79a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:02.527772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68a276a7-6827-45d8-be19-a2b240a5f79a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:02.528422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68a276a7-6827-45d8-be19-a2b240a5f79a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:02.529353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68a276a7-6827-45d8-be19-a2b240a5f79a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:02.530109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68a276a7-6827-45d8-be19-a2b240a5f79a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:02.537753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68a276a7-6827-45d8-be19-a2b240a5f79a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:02.973955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1064929295", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ebda995-e90a-4f2e-b960-05df0b4c22d1"}], "security_groups": [{"name": "tempest-securitygroup--2104085865"}], "key_name": "tempest-keypair-1126247420", "user_data": "}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:03.278605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-68a276a7-6827-45d8-be19-a2b240a5f79a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:03.310192 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-68a276a7-6827-45d8-be19-a2b240a5f79a tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 200 len: 1689 microversion: 2.1 time: 0.800192 Aug 29 15:54:03.311675 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3202/6210] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:02 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 1689 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:03.404052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a8899089-2b14-45ab-860f-3b2716735081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:03.404890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a8899089-2b14-45ab-860f-3b2716735081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:03.413529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8899089-2b14-45ab-860f-3b2716735081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:03.414287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8899089-2b14-45ab-860f-3b2716735081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:03.415455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8899089-2b14-45ab-860f-3b2716735081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:03.417105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8899089-2b14-45ab-860f-3b2716735081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:03.417768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8899089-2b14-45ab-860f-3b2716735081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:03.418366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8899089-2b14-45ab-860f-3b2716735081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:03.488854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] validate_networks() for [('0ebda995-e90a-4f2e-b960-05df0b4c22d1', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:54:05.068428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:54:05.069792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:54:05.070572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:54:05.072921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:54:05.073535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:54:05.093756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:05.094541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:05.096185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:05.097038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:05.101793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:05.102640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:05.231041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Getting quotas for project 90cd659e27ab4f5b9c926a11221a8d80. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:54:05.262182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Getting quotas for user a27d353043364e838b7b6db2c5e97215 and project 90cd659e27ab4f5b9c926a11221a8d80. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:54:05.303511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:54:05.306689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:54:05.445683 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-16beb414-dc79-49c6-bf4f-34eda47b860c tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.498192 Aug 29 15:54:05.452338 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3009/6211] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:54:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:54:05.459138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d1fba91b-a337-46a1-84d1-26e78be50497 req-f4e66f34-1274-4eb1-9f9a-17f391762167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cbe7b40-fde9-4090-8c20-74c27c5af79b", "name": "network-vif-deleted", "tag": "55968408-6166-427a-867d-93135f6ec6d5"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:05.485809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d1fba91b-a337-46a1-84d1-26e78be50497 req-f4e66f34-1274-4eb1-9f9a-17f391762167 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:05.486295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d1fba91b-a337-46a1-84d1-26e78be50497 req-f4e66f34-1274-4eb1-9f9a-17f391762167 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:05.486868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d1fba91b-a337-46a1-84d1-26e78be50497 req-f4e66f34-1274-4eb1-9f9a-17f391762167 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:05.513600 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d1fba91b-a337-46a1-84d1-26e78be50497 req-f4e66f34-1274-4eb1-9f9a-17f391762167 service nova] Creating event network-vif-deleted:55968408-6166-427a-867d-93135f6ec6d5 for instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b on n-h2-839401-11 Aug 29 15:54:05.562280 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d1fba91b-a337-46a1-84d1-26e78be50497 req-f4e66f34-1274-4eb1-9f9a-17f391762167 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095887 Aug 29 15:54:05.563010 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3010/6212] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:05.590000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cf2dcaff-fecc-4b13-8a28-cc431b52d30d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:05.593533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cf2dcaff-fecc-4b13-8a28-cc431b52d30d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 3cbe7b40-fde9-4090-8c20-74c27c5af79b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:05.617640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf2dcaff-fecc-4b13-8a28-cc431b52d30d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:05.621529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf2dcaff-fecc-4b13-8a28-cc431b52d30d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:05.623969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf2dcaff-fecc-4b13-8a28-cc431b52d30d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:05.625718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf2dcaff-fecc-4b13-8a28-cc431b52d30d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:05.628260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf2dcaff-fecc-4b13-8a28-cc431b52d30d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:05.632923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf2dcaff-fecc-4b13-8a28-cc431b52d30d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:05.693573 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-cf2dcaff-fecc-4b13-8a28-cc431b52d30d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] HTTP exception thrown: Instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b could not be found. Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cf2dcaff-fecc-4b13-8a28-cc431b52d30d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Request method failure captured: Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b HTTP/1.1 Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN-Shrbl2HxkaYnOtK2CNdk6iJsrlpI7x2pEvqbwalbEhQTR6sDfV2Wu55DTc75O-bivlxXAmF3HFspNNYPdndfOjtbIQTsROFO0VNl42_MzCePBgIneIUPTQCeXIdrBxJJnQjgsKhXk98T5RKZXMNgJMbL43_mClT_pNirw55OB0CI Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: bb5330327389417995f14947be334a04 Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bb5330327389417995f14947be334a04", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bb5330327389417995f14947be334a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}] Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: bb5330327389417995f14947be334a04 Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e75a8c66c5304e608e2f3120c1192534 Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b could not be found. Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '3cbe7b40-fde9-4090-8c20-74c27c5af79b'} Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b could not be found. Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b could not be found. Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:54:05.702121 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:05.707456 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:54:05.707456 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:05.707456 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:05.707456 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:05.707456 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:54:05.707456 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:54:05.707456 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b could not be found. Aug 29 15:54:05.707456 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:54:05.708941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cf2dcaff-fecc-4b13-8a28-cc431b52d30d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Returning 404 to user: Instance 3cbe7b40-fde9-4090-8c20-74c27c5af79b could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:54:05.711309 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cf2dcaff-fecc-4b13-8a28-cc431b52d30d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b" status: 404 len: 111 microversion: 2.1 time: 0.146118 Aug 29 15:54:05.716928 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3011/6213] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:05 2022] GET /compute/v2.1/servers/3cbe7b40-fde9-4090-8c20-74c27c5af79b => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:54:05.727437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a8899089-2b14-45ab-860f-3b2716735081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:05.734985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e2fa8201-ba7e-4448-926b-e083dcfc979f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:05.739864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e2fa8201-ba7e-4448-926b-e083dcfc979f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:05.741330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a8899089-2b14-45ab-860f-3b2716735081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:05.742884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a8899089-2b14-45ab-860f-3b2716735081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:05.745416 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a8899089-2b14-45ab-860f-3b2716735081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1721 microversion: 2.20 time: 2.355861 Aug 29 15:54:05.746219 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3203/6214] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:03 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1721 bytes in 2357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:05.762525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6fe07d34-07ee-4442-9d18-4dba0a8a63db tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '.version_select at 0x7fc42a609a60>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:05.811146 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6fe07d34-07ee-4442-9d18-4dba0a8a63db tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-300282973" status: 202 len: 0 microversion: 2.1 time: 0.062361 Aug 29 15:54:05.825324 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3204/6215] 10.222.0.62 () {58 vars in 1218 bytes} [Mon Aug 29 15:54:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-300282973 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:54:06.200418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e2fa8201-ba7e-4448-926b-e083dcfc979f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:06.208845 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e2fa8201-ba7e-4448-926b-e083dcfc979f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 200 len: 1242 microversion: 2.1 time: 0.488884 Aug 29 15:54:06.212250 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3012/6216] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:05 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 1242 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:06.777342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e0980a20-8a4e-458d-b2bc-9de5975faaf3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:06.778885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e0980a20-8a4e-458d-b2bc-9de5975faaf3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:06.788150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0980a20-8a4e-458d-b2bc-9de5975faaf3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:06.789160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0980a20-8a4e-458d-b2bc-9de5975faaf3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:06.790001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0980a20-8a4e-458d-b2bc-9de5975faaf3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:06.791216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0980a20-8a4e-458d-b2bc-9de5975faaf3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:06.793255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0980a20-8a4e-458d-b2bc-9de5975faaf3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:06.793976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0980a20-8a4e-458d-b2bc-9de5975faaf3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:07.231847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4cd09e47-cad8-4661-902c-11e92f9d72ff tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:07.233044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4cd09e47-cad8-4661-902c-11e92f9d72ff tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:07.254213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cd09e47-cad8-4661-902c-11e92f9d72ff tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:07.261567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cd09e47-cad8-4661-902c-11e92f9d72ff tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:07.264669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cd09e47-cad8-4661-902c-11e92f9d72ff tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:07.266330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cd09e47-cad8-4661-902c-11e92f9d72ff tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:07.268868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cd09e47-cad8-4661-902c-11e92f9d72ff tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:07.270218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4cd09e47-cad8-4661-902c-11e92f9d72ff tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:07.360841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e0980a20-8a4e-458d-b2bc-9de5975faaf3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:07.376338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e0980a20-8a4e-458d-b2bc-9de5975faaf3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:07.380935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e0980a20-8a4e-458d-b2bc-9de5975faaf3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:07.386758 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e0980a20-8a4e-458d-b2bc-9de5975faaf3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1721 microversion: 2.20 time: 0.616653 Aug 29 15:54:07.398035 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3205/6217] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:06 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1721 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:07.408305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4cd09e47-cad8-4661-902c-11e92f9d72ff tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:07.424915 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4cd09e47-cad8-4661-902c-11e92f9d72ff tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 200 len: 1294 microversion: 2.1 time: 0.196855 Aug 29 15:54:07.425549 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3013/6218] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:07 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 1294 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:08.411573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a5466d82-0cce-4c7d-86a1-156b89a34af3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:08.412931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a5466d82-0cce-4c7d-86a1-156b89a34af3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:08.426241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5466d82-0cce-4c7d-86a1-156b89a34af3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:08.427085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5466d82-0cce-4c7d-86a1-156b89a34af3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:08.427725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5466d82-0cce-4c7d-86a1-156b89a34af3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:08.428957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5466d82-0cce-4c7d-86a1-156b89a34af3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:08.431383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5466d82-0cce-4c7d-86a1-156b89a34af3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:08.432036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5466d82-0cce-4c7d-86a1-156b89a34af3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:08.451408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-36fcc115-977c-4bee-a219-a62ff5d04e4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:08.452559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-36fcc115-977c-4bee-a219-a62ff5d04e4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:08.470183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36fcc115-977c-4bee-a219-a62ff5d04e4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:08.470793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36fcc115-977c-4bee-a219-a62ff5d04e4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:08.471427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36fcc115-977c-4bee-a219-a62ff5d04e4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:08.472343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36fcc115-977c-4bee-a219-a62ff5d04e4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:08.473511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36fcc115-977c-4bee-a219-a62ff5d04e4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:08.473948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36fcc115-977c-4bee-a219-a62ff5d04e4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:08.618816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36fcc115-977c-4bee-a219-a62ff5d04e4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:08.630478 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-36fcc115-977c-4bee-a219-a62ff5d04e4b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 200 len: 1300 microversion: 2.1 time: 0.183907 Aug 29 15:54:08.632801 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3014/6219] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:08 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 1300 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:08.965961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a5466d82-0cce-4c7d-86a1-156b89a34af3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:08.975768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a5466d82-0cce-4c7d-86a1-156b89a34af3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:08.985056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a5466d82-0cce-4c7d-86a1-156b89a34af3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:08.986775 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a5466d82-0cce-4c7d-86a1-156b89a34af3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1721 microversion: 2.20 time: 0.579292 Aug 29 15:54:08.987456 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3206/6220] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:08 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1721 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:09.654049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d28e6d28-69ee-4bab-8918-95a4b5d2de60 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:09.655226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d28e6d28-69ee-4bab-8918-95a4b5d2de60 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:09.670806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d28e6d28-69ee-4bab-8918-95a4b5d2de60 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:09.671313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d28e6d28-69ee-4bab-8918-95a4b5d2de60 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:09.671754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d28e6d28-69ee-4bab-8918-95a4b5d2de60 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:09.672481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d28e6d28-69ee-4bab-8918-95a4b5d2de60 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:09.673051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d28e6d28-69ee-4bab-8918-95a4b5d2de60 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:09.673502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d28e6d28-69ee-4bab-8918-95a4b5d2de60 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:09.786668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d28e6d28-69ee-4bab-8918-95a4b5d2de60 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:09.822104 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d28e6d28-69ee-4bab-8918-95a4b5d2de60 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 200 len: 1300 microversion: 2.1 time: 0.171954 Aug 29 15:54:09.829140 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3015/6221] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:09 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 1300 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:10.010457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1034a99f-b0dd-4cd5-a76b-31e9c15d3bbc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:10.011788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1034a99f-b0dd-4cd5-a76b-31e9c15d3bbc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:10.026550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1034a99f-b0dd-4cd5-a76b-31e9c15d3bbc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:10.029173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1034a99f-b0dd-4cd5-a76b-31e9c15d3bbc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:10.030145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1034a99f-b0dd-4cd5-a76b-31e9c15d3bbc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:10.034125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1034a99f-b0dd-4cd5-a76b-31e9c15d3bbc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:10.036130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1034a99f-b0dd-4cd5-a76b-31e9c15d3bbc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:10.036836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1034a99f-b0dd-4cd5-a76b-31e9c15d3bbc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:10.846215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c706a58-89a0-4f2f-85a3-4efe1ab8dda0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:10.846839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6c706a58-89a0-4f2f-85a3-4efe1ab8dda0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:10.848318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1034a99f-b0dd-4cd5-a76b-31e9c15d3bbc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:10.860550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1034a99f-b0dd-4cd5-a76b-31e9c15d3bbc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:10.862185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1034a99f-b0dd-4cd5-a76b-31e9c15d3bbc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:10.863384 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1034a99f-b0dd-4cd5-a76b-31e9c15d3bbc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1721 microversion: 2.20 time: 0.857302 Aug 29 15:54:10.863960 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3207/6222] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:10 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1721 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:10.866319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c706a58-89a0-4f2f-85a3-4efe1ab8dda0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:10.866831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c706a58-89a0-4f2f-85a3-4efe1ab8dda0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:10.867294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c706a58-89a0-4f2f-85a3-4efe1ab8dda0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:10.876472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c706a58-89a0-4f2f-85a3-4efe1ab8dda0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:10.876966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c706a58-89a0-4f2f-85a3-4efe1ab8dda0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:10.877469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c706a58-89a0-4f2f-85a3-4efe1ab8dda0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:11.276721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6c706a58-89a0-4f2f-85a3-4efe1ab8dda0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:11.301676 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6c706a58-89a0-4f2f-85a3-4efe1ab8dda0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 200 len: 1368 microversion: 2.1 time: 0.458912 Aug 29 15:54:11.302738 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3016/6223] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:10 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 1368 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:11.891188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f02cbb6a-5bb8-440e-ae63-4d6a6dff9d32 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:11.892900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f02cbb6a-5bb8-440e-ae63-4d6a6dff9d32 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:11.919286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f02cbb6a-5bb8-440e-ae63-4d6a6dff9d32 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:11.921443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f02cbb6a-5bb8-440e-ae63-4d6a6dff9d32 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:11.930355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f02cbb6a-5bb8-440e-ae63-4d6a6dff9d32 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:11.931523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f02cbb6a-5bb8-440e-ae63-4d6a6dff9d32 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:11.932975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f02cbb6a-5bb8-440e-ae63-4d6a6dff9d32 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:11.933704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f02cbb6a-5bb8-440e-ae63-4d6a6dff9d32 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:12.009755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:12.325915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6e280f7a-bbae-4bc7-a0e9-f8f237c81336 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:12.332160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6e280f7a-bbae-4bc7-a0e9-f8f237c81336 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:12.346784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e280f7a-bbae-4bc7-a0e9-f8f237c81336 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:12.349105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e280f7a-bbae-4bc7-a0e9-f8f237c81336 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:12.350529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e280f7a-bbae-4bc7-a0e9-f8f237c81336 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:12.351717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e280f7a-bbae-4bc7-a0e9-f8f237c81336 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:12.354166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e280f7a-bbae-4bc7-a0e9-f8f237c81336 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:12.354796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e280f7a-bbae-4bc7-a0e9-f8f237c81336 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:12.525335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f02cbb6a-5bb8-440e-ae63-4d6a6dff9d32 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:12.538419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f02cbb6a-5bb8-440e-ae63-4d6a6dff9d32 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:12.540233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f02cbb6a-5bb8-440e-ae63-4d6a6dff9d32 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:12.541763 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f02cbb6a-5bb8-440e-ae63-4d6a6dff9d32 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1742 microversion: 2.20 time: 0.655767 Aug 29 15:54:12.559697 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3208/6224] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:11 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1742 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:12.758908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6e280f7a-bbae-4bc7-a0e9-f8f237c81336 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:12.780638 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6e280f7a-bbae-4bc7-a0e9-f8f237c81336 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 200 len: 1368 microversion: 2.1 time: 0.461293 Aug 29 15:54:12.793927 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3017/6225] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:12 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 1368 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:12.860248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-8ffb08fb-14d5-453b-803f-0346c0465d11 req-ec4e0e6e-e398-4cfc-839d-0b9e234226b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ed120d-ed09-4cb8-9dba-c1de224fd6b4", "tag": "e79ba180-15ea-4a42-a607-eacc9ae907e9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:12.878914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8ffb08fb-14d5-453b-803f-0346c0465d11 req-ec4e0e6e-e398-4cfc-839d-0b9e234226b5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:12.882435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8ffb08fb-14d5-453b-803f-0346c0465d11 req-ec4e0e6e-e398-4cfc-839d-0b9e234226b5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:12.883217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8ffb08fb-14d5-453b-803f-0346c0465d11 req-ec4e0e6e-e398-4cfc-839d-0b9e234226b5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:12.927655 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-8ffb08fb-14d5-453b-803f-0346c0465d11 req-ec4e0e6e-e398-4cfc-839d-0b9e234226b5 service nova] Creating event network-changed:e79ba180-15ea-4a42-a607-eacc9ae907e9 for instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 on n-h1-839401-11 Aug 29 15:54:12.938176 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-8ffb08fb-14d5-453b-803f-0346c0465d11 req-ec4e0e6e-e398-4cfc-839d-0b9e234226b5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084472 Aug 29 15:54:12.939044 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3209/6226] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:13.571155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-483abd4d-8049-46b6-bbb8-f2c475dc58b0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:13.571780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-483abd4d-8049-46b6-bbb8-f2c475dc58b0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:13.589161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-483abd4d-8049-46b6-bbb8-f2c475dc58b0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:13.591159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-483abd4d-8049-46b6-bbb8-f2c475dc58b0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:13.591680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-483abd4d-8049-46b6-bbb8-f2c475dc58b0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:13.595242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-483abd4d-8049-46b6-bbb8-f2c475dc58b0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:13.595990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-483abd4d-8049-46b6-bbb8-f2c475dc58b0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:13.598259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-483abd4d-8049-46b6-bbb8-f2c475dc58b0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:13.806755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-805709a3-1300-4594-af61-999c6361a5a6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:13.807455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-805709a3-1300-4594-af61-999c6361a5a6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:13.826659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-805709a3-1300-4594-af61-999c6361a5a6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:13.827162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-805709a3-1300-4594-af61-999c6361a5a6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:13.827612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-805709a3-1300-4594-af61-999c6361a5a6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:13.828397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-805709a3-1300-4594-af61-999c6361a5a6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:13.828872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-805709a3-1300-4594-af61-999c6361a5a6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:13.842873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-805709a3-1300-4594-af61-999c6361a5a6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:14.152207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-483abd4d-8049-46b6-bbb8-f2c475dc58b0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:14.164142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-483abd4d-8049-46b6-bbb8-f2c475dc58b0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:14.178800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-483abd4d-8049-46b6-bbb8-f2c475dc58b0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:14.179293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-805709a3-1300-4594-af61-999c6361a5a6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:14.180078 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-483abd4d-8049-46b6-bbb8-f2c475dc58b0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1742 microversion: 2.20 time: 0.618435 Aug 29 15:54:14.180668 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3018/6227] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:13 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1742 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:14.219801 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-805709a3-1300-4594-af61-999c6361a5a6 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 200 len: 1368 microversion: 2.1 time: 0.417141 Aug 29 15:54:14.221913 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3210/6228] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:13 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 1368 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:15.206251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2fbf972f-92b6-4bb4-bdc4-66b998ac27ea tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:15.206877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2fbf972f-92b6-4bb4-bdc4-66b998ac27ea tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:15.210004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:15.224499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fbf972f-92b6-4bb4-bdc4-66b998ac27ea tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:15.227724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fbf972f-92b6-4bb4-bdc4-66b998ac27ea tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:15.231863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fbf972f-92b6-4bb4-bdc4-66b998ac27ea tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:15.234955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fbf972f-92b6-4bb4-bdc4-66b998ac27ea tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:15.248947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-373771d5-59fc-4c4e-9366-2381d36cd918 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:15.251290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-373771d5-59fc-4c4e-9366-2381d36cd918 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:15.258046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fbf972f-92b6-4bb4-bdc4-66b998ac27ea tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:15.260314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fbf972f-92b6-4bb4-bdc4-66b998ac27ea tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:15.283789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373771d5-59fc-4c4e-9366-2381d36cd918 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:15.286882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373771d5-59fc-4c4e-9366-2381d36cd918 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:15.292537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373771d5-59fc-4c4e-9366-2381d36cd918 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:15.296777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373771d5-59fc-4c4e-9366-2381d36cd918 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:15.297482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373771d5-59fc-4c4e-9366-2381d36cd918 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:15.298075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373771d5-59fc-4c4e-9366-2381d36cd918 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:15.322144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:15.554597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-373771d5-59fc-4c4e-9366-2381d36cd918 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:15.566388 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-373771d5-59fc-4c4e-9366-2381d36cd918 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 200 len: 1368 microversion: 2.1 time: 0.328967 Aug 29 15:54:15.588523 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3211/6229] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:15 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 1368 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:15.598825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-dd973048-b18c-4e6b-8597-e32dc9310e8d req-eb131bf0-5d8d-4c8d-ab7c-dffe105cb257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fba35d0-e4ed-4088-a1d1-ccabdd81c178", "name": "network-vif-plugged", "status": "completed", "tag": "db244ebb-da5f-469b-ae27-7da59496c697"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:15.612602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dd973048-b18c-4e6b-8597-e32dc9310e8d req-eb131bf0-5d8d-4c8d-ab7c-dffe105cb257 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:15.613871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dd973048-b18c-4e6b-8597-e32dc9310e8d req-eb131bf0-5d8d-4c8d-ab7c-dffe105cb257 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:15.614551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dd973048-b18c-4e6b-8597-e32dc9310e8d req-eb131bf0-5d8d-4c8d-ab7c-dffe105cb257 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:15.633390 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-dd973048-b18c-4e6b-8597-e32dc9310e8d req-eb131bf0-5d8d-4c8d-ab7c-dffe105cb257 service nova] Creating event network-vif-plugged:db244ebb-da5f-469b-ae27-7da59496c697 for instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 on n-h2-839401-11 Aug 29 15:54:15.639730 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-dd973048-b18c-4e6b-8597-e32dc9310e8d req-eb131bf0-5d8d-4c8d-ab7c-dffe105cb257 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046124 Aug 29 15:54:15.641118 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3212/6230] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:15.972261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2fbf972f-92b6-4bb4-bdc4-66b998ac27ea tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:15.986447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2fbf972f-92b6-4bb4-bdc4-66b998ac27ea tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:15.987914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2fbf972f-92b6-4bb4-bdc4-66b998ac27ea tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:15.994210 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2fbf972f-92b6-4bb4-bdc4-66b998ac27ea tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1742 microversion: 2.20 time: 0.787045 Aug 29 15:54:16.011124 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3019/6231] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:15 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1742 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:16.589714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ce8d337-479a-4e84-b628-baf9c56dda5a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:16.591107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ce8d337-479a-4e84-b628-baf9c56dda5a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:16.603551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce8d337-479a-4e84-b628-baf9c56dda5a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:16.604060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce8d337-479a-4e84-b628-baf9c56dda5a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:16.604521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce8d337-479a-4e84-b628-baf9c56dda5a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:16.606915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce8d337-479a-4e84-b628-baf9c56dda5a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:16.613056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce8d337-479a-4e84-b628-baf9c56dda5a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:16.613858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce8d337-479a-4e84-b628-baf9c56dda5a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:17.025707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ffdf03d7-a108-4802-8624-9a2bd57f8a68 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:17.026484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ffdf03d7-a108-4802-8624-9a2bd57f8a68 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:17.028582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:17.039458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffdf03d7-a108-4802-8624-9a2bd57f8a68 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:17.039966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffdf03d7-a108-4802-8624-9a2bd57f8a68 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:17.046565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffdf03d7-a108-4802-8624-9a2bd57f8a68 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:17.047465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffdf03d7-a108-4802-8624-9a2bd57f8a68 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:17.048005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffdf03d7-a108-4802-8624-9a2bd57f8a68 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:17.048462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffdf03d7-a108-4802-8624-9a2bd57f8a68 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:17.343377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ffdf03d7-a108-4802-8624-9a2bd57f8a68 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:17.359215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ffdf03d7-a108-4802-8624-9a2bd57f8a68 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:17.363209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ffdf03d7-a108-4802-8624-9a2bd57f8a68 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:17.366015 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ffdf03d7-a108-4802-8624-9a2bd57f8a68 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1742 microversion: 2.20 time: 0.344271 Aug 29 15:54:17.385950 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3020/6232] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:17 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1742 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:17.561833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5ce8d337-479a-4e84-b628-baf9c56dda5a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:17.573928 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ce8d337-479a-4e84-b628-baf9c56dda5a tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 200 len: 1368 microversion: 2.1 time: 0.989726 Aug 29 15:54:17.579425 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3213/6233] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:16 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 1368 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:17.876518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-27548c01-475e-41ea-8b3d-82be0f53ddb3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:17.877379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-27548c01-475e-41ea-8b3d-82be0f53ddb3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:17.898525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27548c01-475e-41ea-8b3d-82be0f53ddb3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:17.899350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27548c01-475e-41ea-8b3d-82be0f53ddb3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:17.900003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27548c01-475e-41ea-8b3d-82be0f53ddb3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:17.906114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27548c01-475e-41ea-8b3d-82be0f53ddb3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:17.907259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27548c01-475e-41ea-8b3d-82be0f53ddb3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:17.913066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27548c01-475e-41ea-8b3d-82be0f53ddb3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:17.997780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-27548c01-475e-41ea-8b3d-82be0f53ddb3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:54:18.205637 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-27548c01-475e-41ea-8b3d-82be0f53ddb3 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 204 len: 0 microversion: 2.1 time: 0.333535 Aug 29 15:54:18.206458 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3021/6234] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:54:17 2022] DELETE /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:54:18.216557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-96510feb-5a04-4278-a58a-5c9cacf2ffbd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:18.217276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-96510feb-5a04-4278-a58a-5c9cacf2ffbd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:18.227982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:18.246816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96510feb-5a04-4278-a58a-5c9cacf2ffbd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:18.251109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96510feb-5a04-4278-a58a-5c9cacf2ffbd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:18.251600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96510feb-5a04-4278-a58a-5c9cacf2ffbd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:18.252378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96510feb-5a04-4278-a58a-5c9cacf2ffbd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:18.256640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96510feb-5a04-4278-a58a-5c9cacf2ffbd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:18.257382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-96510feb-5a04-4278-a58a-5c9cacf2ffbd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:18.394687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-44ef6ca3-c14a-4e49-884d-ab5400fcafb3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:18.395429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-44ef6ca3-c14a-4e49-884d-ab5400fcafb3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:18.406123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44ef6ca3-c14a-4e49-884d-ab5400fcafb3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:18.406645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44ef6ca3-c14a-4e49-884d-ab5400fcafb3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:18.407164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44ef6ca3-c14a-4e49-884d-ab5400fcafb3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:18.407906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44ef6ca3-c14a-4e49-884d-ab5400fcafb3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:18.408380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44ef6ca3-c14a-4e49-884d-ab5400fcafb3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:18.408812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-44ef6ca3-c14a-4e49-884d-ab5400fcafb3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:18.699638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-44ef6ca3-c14a-4e49-884d-ab5400fcafb3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:18.725593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-44ef6ca3-c14a-4e49-884d-ab5400fcafb3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:18.730385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-44ef6ca3-c14a-4e49-884d-ab5400fcafb3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:18.732191 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-44ef6ca3-c14a-4e49-884d-ab5400fcafb3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1737 microversion: 2.20 time: 0.342514 Aug 29 15:54:18.748669 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3022/6235] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:18 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1737 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:18.760331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9b50be14-1ccc-450b-afcd-ce96837c377b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:18.765079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9b50be14-1ccc-450b-afcd-ce96837c377b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:18.778032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b50be14-1ccc-450b-afcd-ce96837c377b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:18.779315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b50be14-1ccc-450b-afcd-ce96837c377b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:18.780244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b50be14-1ccc-450b-afcd-ce96837c377b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:18.782655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b50be14-1ccc-450b-afcd-ce96837c377b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:18.783380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b50be14-1ccc-450b-afcd-ce96837c377b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:18.785175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b50be14-1ccc-450b-afcd-ce96837c377b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:18.938424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-96510feb-5a04-4278-a58a-5c9cacf2ffbd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:18.947151 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-96510feb-5a04-4278-a58a-5c9cacf2ffbd tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1506 microversion: 2.1 time: 0.735496 Aug 29 15:54:18.953406 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3214/6236] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:18 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1506 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:18.972268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e08b4ef4-7a0d-4d22-a8dd-5e37062ab538 req-ac9d2275-50bb-4ce9-9538-b93dcd47d787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ed120d-ed09-4cb8-9dba-c1de224fd6b4", "name": "network-vif-plugged", "status": "completed", "tag": "e79ba180-15ea-4a42-a607-eacc9ae907e9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:19.027365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e08b4ef4-7a0d-4d22-a8dd-5e37062ab538 req-ac9d2275-50bb-4ce9-9538-b93dcd47d787 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:19.031747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e08b4ef4-7a0d-4d22-a8dd-5e37062ab538 req-ac9d2275-50bb-4ce9-9538-b93dcd47d787 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:19.032302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e08b4ef4-7a0d-4d22-a8dd-5e37062ab538 req-ac9d2275-50bb-4ce9-9538-b93dcd47d787 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:19.071323 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e08b4ef4-7a0d-4d22-a8dd-5e37062ab538 req-ac9d2275-50bb-4ce9-9538-b93dcd47d787 service nova] Creating event network-vif-plugged:e79ba180-15ea-4a42-a607-eacc9ae907e9 for instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 on n-h1-839401-11 Aug 29 15:54:19.079270 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e08b4ef4-7a0d-4d22-a8dd-5e37062ab538 req-ac9d2275-50bb-4ce9-9538-b93dcd47d787 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124465 Aug 29 15:54:19.081512 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3215/6237] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:19.172716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9b50be14-1ccc-450b-afcd-ce96837c377b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:19.190189 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9b50be14-1ccc-450b-afcd-ce96837c377b tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 200 len: 1368 microversion: 2.1 time: 0.439896 Aug 29 15:54:19.196428 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3023/6238] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:18 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 1368 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:19.763824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d2cd6620-47ed-4570-b642-b2d1b506de23 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:19.764789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d2cd6620-47ed-4570-b642-b2d1b506de23 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:19.782051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2cd6620-47ed-4570-b642-b2d1b506de23 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:19.785071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2cd6620-47ed-4570-b642-b2d1b506de23 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:19.786935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2cd6620-47ed-4570-b642-b2d1b506de23 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:19.790730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2cd6620-47ed-4570-b642-b2d1b506de23 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:19.792002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2cd6620-47ed-4570-b642-b2d1b506de23 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:19.792678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2cd6620-47ed-4570-b642-b2d1b506de23 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:19.974580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-751fc233-05fe-412e-a746-880b0fcb6068 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:19.975908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-751fc233-05fe-412e-a746-880b0fcb6068 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:19.982014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:19.984277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-751fc233-05fe-412e-a746-880b0fcb6068 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:19.984962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-751fc233-05fe-412e-a746-880b0fcb6068 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:19.985981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-751fc233-05fe-412e-a746-880b0fcb6068 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:19.987074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-751fc233-05fe-412e-a746-880b0fcb6068 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:19.987850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-751fc233-05fe-412e-a746-880b0fcb6068 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:19.988515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-751fc233-05fe-412e-a746-880b0fcb6068 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:20.173220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d2cd6620-47ed-4570-b642-b2d1b506de23 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:20.186260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d2cd6620-47ed-4570-b642-b2d1b506de23 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:20.188436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d2cd6620-47ed-4570-b642-b2d1b506de23 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:20.190058 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d2cd6620-47ed-4570-b642-b2d1b506de23 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1737 microversion: 2.20 time: 0.433947 Aug 29 15:54:20.205376 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3216/6239] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:19 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1737 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:20.219825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dabb573b-427f-4f50-9db1-d32b36bef2ce tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:20.220645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dabb573b-427f-4f50-9db1-d32b36bef2ce tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:20.227373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dabb573b-427f-4f50-9db1-d32b36bef2ce tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:20.228138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dabb573b-427f-4f50-9db1-d32b36bef2ce tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:20.228729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dabb573b-427f-4f50-9db1-d32b36bef2ce tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:20.229701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dabb573b-427f-4f50-9db1-d32b36bef2ce tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:20.230313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dabb573b-427f-4f50-9db1-d32b36bef2ce tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:20.231154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dabb573b-427f-4f50-9db1-d32b36bef2ce tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:20.314501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-751fc233-05fe-412e-a746-880b0fcb6068 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:20.329969 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-751fc233-05fe-412e-a746-880b0fcb6068 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1506 microversion: 2.1 time: 0.358646 Aug 29 15:54:20.330886 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3024/6240] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:19 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:20.429395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d6999886-26f9-4756-9cca-d89f12500652 req-2f1b6d85-775f-4c44-8d0e-fa5265149eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb8465e-a1d5-450b-b8e7-bb5f0c154504", "name": "network-vif-deleted", "tag": "b736d3f3-b308-4ab8-a145-f2ee28009c2e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:20.475283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d6999886-26f9-4756-9cca-d89f12500652 req-2f1b6d85-775f-4c44-8d0e-fa5265149eae service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:20.475778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d6999886-26f9-4756-9cca-d89f12500652 req-2f1b6d85-775f-4c44-8d0e-fa5265149eae service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:20.476241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d6999886-26f9-4756-9cca-d89f12500652 req-2f1b6d85-775f-4c44-8d0e-fa5265149eae service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:20.527886 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d6999886-26f9-4756-9cca-d89f12500652 req-2f1b6d85-775f-4c44-8d0e-fa5265149eae service nova] Creating event network-vif-deleted:b736d3f3-b308-4ab8-a145-f2ee28009c2e for instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 on n-h2-839401-11 Aug 29 15:54:20.562686 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d6999886-26f9-4756-9cca-d89f12500652 req-2f1b6d85-775f-4c44-8d0e-fa5265149eae service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139600 Aug 29 15:54:20.562686 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3025/6241] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:20.943241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dabb573b-427f-4f50-9db1-d32b36bef2ce tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:20.973362 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dabb573b-427f-4f50-9db1-d32b36bef2ce tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 200 len: 1368 microversion: 2.1 time: 0.754528 Aug 29 15:54:20.976815 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3217/6242] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:20 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 1368 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:21.212578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-303b0480-39e3-4ec2-8482-240451f728ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:21.213421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-303b0480-39e3-4ec2-8482-240451f728ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:21.235083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-303b0480-39e3-4ec2-8482-240451f728ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:21.236107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-303b0480-39e3-4ec2-8482-240451f728ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:21.237261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-303b0480-39e3-4ec2-8482-240451f728ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:21.245167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-303b0480-39e3-4ec2-8482-240451f728ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:21.246688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-303b0480-39e3-4ec2-8482-240451f728ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:21.247366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-303b0480-39e3-4ec2-8482-240451f728ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:21.352033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-30902d24-d5b8-49f2-8278-260e7f5291ec tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:21.353272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-30902d24-d5b8-49f2-8278-260e7f5291ec tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:21.367673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30902d24-d5b8-49f2-8278-260e7f5291ec tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:21.373074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30902d24-d5b8-49f2-8278-260e7f5291ec tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:21.376073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30902d24-d5b8-49f2-8278-260e7f5291ec tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:21.377776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30902d24-d5b8-49f2-8278-260e7f5291ec tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:21.385815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30902d24-d5b8-49f2-8278-260e7f5291ec tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:21.387603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30902d24-d5b8-49f2-8278-260e7f5291ec tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:21.511430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30902d24-d5b8-49f2-8278-260e7f5291ec tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:21.517260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30902d24-d5b8-49f2-8278-260e7f5291ec tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:21.518463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30902d24-d5b8-49f2-8278-260e7f5291ec tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:21.523704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-30902d24-d5b8-49f2-8278-260e7f5291ec tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lazy-loading 'fault' on Instance uuid 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:54:21.627497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-30902d24-d5b8-49f2-8278-260e7f5291ec tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:21.636335 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-30902d24-d5b8-49f2-8278-260e7f5291ec tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 200 len: 1311 microversion: 2.1 time: 0.288311 Aug 29 15:54:21.640105 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3218/6243] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:21 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 1311 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:21.825070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-303b0480-39e3-4ec2-8482-240451f728ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:21.843935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-303b0480-39e3-4ec2-8482-240451f728ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:21.853099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-303b0480-39e3-4ec2-8482-240451f728ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:21.854771 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-303b0480-39e3-4ec2-8482-240451f728ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1737 microversion: 2.20 time: 0.646665 Aug 29 15:54:21.869818 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3026/6244] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:21 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1737 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:21.998503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-82cb4399-1239-4993-a910-3b476e247077 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:21.999249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-82cb4399-1239-4993-a910-3b476e247077 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:22.015727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82cb4399-1239-4993-a910-3b476e247077 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.016166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82cb4399-1239-4993-a910-3b476e247077 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.016665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82cb4399-1239-4993-a910-3b476e247077 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:22.017577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82cb4399-1239-4993-a910-3b476e247077 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.018043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82cb4399-1239-4993-a910-3b476e247077 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.018475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-82cb4399-1239-4993-a910-3b476e247077 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:22.394841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-82cb4399-1239-4993-a910-3b476e247077 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:22.405789 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-82cb4399-1239-4993-a910-3b476e247077 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 200 len: 1557 microversion: 2.1 time: 0.410036 Aug 29 15:54:22.406762 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3219/6245] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:21 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 1557 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:22.434945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-839f11b8-d123-48eb-b97f-3832496a6944 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:22.435390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-839f11b8-d123-48eb-b97f-3832496a6944 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:22.447250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-839f11b8-d123-48eb-b97f-3832496a6944 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.447895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-839f11b8-d123-48eb-b97f-3832496a6944 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.449856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-839f11b8-d123-48eb-b97f-3832496a6944 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:22.452375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-839f11b8-d123-48eb-b97f-3832496a6944 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.453035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-839f11b8-d123-48eb-b97f-3832496a6944 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.455728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-839f11b8-d123-48eb-b97f-3832496a6944 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:22.663150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-728e4dfa-d70c-4ac8-9426-b21911f53c2c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:22.663844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-728e4dfa-d70c-4ac8-9426-b21911f53c2c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 0bb8465e-a1d5-450b-b8e7-bb5f0c154504] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:22.673051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-728e4dfa-d70c-4ac8-9426-b21911f53c2c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.674095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-728e4dfa-d70c-4ac8-9426-b21911f53c2c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.674965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-728e4dfa-d70c-4ac8-9426-b21911f53c2c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:22.676126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-728e4dfa-d70c-4ac8-9426-b21911f53c2c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.676953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-728e4dfa-d70c-4ac8-9426-b21911f53c2c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.677832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-728e4dfa-d70c-4ac8-9426-b21911f53c2c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:22.712088 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-728e4dfa-d70c-4ac8-9426-b21911f53c2c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] HTTP exception thrown: Instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 could not be found. Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-728e4dfa-d70c-4ac8-9426-b21911f53c2c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Request method failure captured: Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 HTTP/1.1 Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-Shrbl2HxkaYnOtK2CNdk6iJsrlpI7x2pEvqbwalbEhQTR6sDfV2Wu55DTc75O-bivlxXAmF3HFspNNYPdndfOjtbIQTsROFO0VNl42_MzCePBgIneIUPTQCeXIdrBxJJnQjgsKhXk98T5RKZXMNgJMbL43_mClT_pNirw55OB0CI Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bb5330327389417995f14947be334a04 Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bb5330327389417995f14947be334a04", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bb5330327389417995f14947be334a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}] Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bb5330327389417995f14947be334a04 Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e75a8c66c5304e608e2f3120c1192534 Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 could not be found. Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '0bb8465e-a1d5-450b-b8e7-bb5f0c154504'} Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 could not be found. Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 could not be found. Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:54:22.714175 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:22.719053 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:54:22.719053 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:22.719053 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:22.719053 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:22.719053 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:54:22.719053 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:54:22.719053 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 could not be found. Aug 29 15:54:22.719053 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:54:22.722260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-728e4dfa-d70c-4ac8-9426-b21911f53c2c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Returning 404 to user: Instance 0bb8465e-a1d5-450b-b8e7-bb5f0c154504 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:54:22.723706 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-728e4dfa-d70c-4ac8-9426-b21911f53c2c tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504" status: 404 len: 111 microversion: 2.1 time: 0.065798 Aug 29 15:54:22.729106 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3220/6246] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:22 2022] GET /compute/v2.1/servers/0bb8465e-a1d5-450b-b8e7-bb5f0c154504 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:54:22.735031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c77a8348-455a-4c22-b713-b7778f391bd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:22.735807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c77a8348-455a-4c22-b713-b7778f391bd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:22.746561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c77a8348-455a-4c22-b713-b7778f391bd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.747338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c77a8348-455a-4c22-b713-b7778f391bd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.748064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c77a8348-455a-4c22-b713-b7778f391bd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:22.748985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c77a8348-455a-4c22-b713-b7778f391bd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.749842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c77a8348-455a-4c22-b713-b7778f391bd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.750478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c77a8348-455a-4c22-b713-b7778f391bd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:22.831014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c77a8348-455a-4c22-b713-b7778f391bd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:54:23.084494 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c77a8348-455a-4c22-b713-b7778f391bd7 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "DELETE /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 204 len: 0 microversion: 2.1 time: 0.353648 Aug 29 15:54:23.104248 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3221/6247] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:54:22 2022] DELETE /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:54:23.118731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f8b1621b-a162-465a-ba58-32bf641b46f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:23.120248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f8b1621b-a162-465a-ba58-32bf641b46f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:23.136184 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-839f11b8-d123-48eb-b97f-3832496a6944 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.709059 Aug 29 15:54:23.136701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8b1621b-a162-465a-ba58-32bf641b46f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:23.137357 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3027/6248] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 15:54:22 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-interface => generated 284 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:23.138355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8b1621b-a162-465a-ba58-32bf641b46f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:23.140156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8b1621b-a162-465a-ba58-32bf641b46f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:23.141156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8b1621b-a162-465a-ba58-32bf641b46f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:23.142865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-35f2132a-c8af-432f-999d-5d89c49f3c5d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:23.143239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8b1621b-a162-465a-ba58-32bf641b46f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:23.143486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-35f2132a-c8af-432f-999d-5d89c49f3c5d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:23.144697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8b1621b-a162-465a-ba58-32bf641b46f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:23.162989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35f2132a-c8af-432f-999d-5d89c49f3c5d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:23.164640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35f2132a-c8af-432f-999d-5d89c49f3c5d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:23.168897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35f2132a-c8af-432f-999d-5d89c49f3c5d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:23.170311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35f2132a-c8af-432f-999d-5d89c49f3c5d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:23.174052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35f2132a-c8af-432f-999d-5d89c49f3c5d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:23.179864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35f2132a-c8af-432f-999d-5d89c49f3c5d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:24.035044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f8b1621b-a162-465a-ba58-32bf641b46f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:24.047954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f8b1621b-a162-465a-ba58-32bf641b46f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:24.054515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f8b1621b-a162-465a-ba58-32bf641b46f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:24.058046 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f8b1621b-a162-465a-ba58-32bf641b46f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1737 microversion: 2.20 time: 0.950412 Aug 29 15:54:24.059956 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3222/6249] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:23 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1737 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:24.078000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fe01713a-dc56-408b-a58b-76eb3eb5cfcc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:24.086418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fe01713a-dc56-408b-a58b-76eb3eb5cfcc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:24.096217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe01713a-dc56-408b-a58b-76eb3eb5cfcc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:24.097358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe01713a-dc56-408b-a58b-76eb3eb5cfcc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:24.098038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe01713a-dc56-408b-a58b-76eb3eb5cfcc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:24.098987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe01713a-dc56-408b-a58b-76eb3eb5cfcc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:24.099688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe01713a-dc56-408b-a58b-76eb3eb5cfcc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:24.100537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe01713a-dc56-408b-a58b-76eb3eb5cfcc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:24.197703 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fe01713a-dc56-408b-a58b-76eb3eb5cfcc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222/action" status: 200 len: 24563 microversion: 2.1 time: 0.135580 Aug 29 15:54:24.198647 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3223/6250] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:54:24 2022] POST /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222/action => generated 24563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:54:24.242623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-35f2132a-c8af-432f-999d-5d89c49f3c5d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:24.271438 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-35f2132a-c8af-432f-999d-5d89c49f3c5d tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1521 microversion: 2.1 time: 1.132726 Aug 29 15:54:24.272244 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3028/6251] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:23 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1521 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:25.082723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f40d9c36-f810-4e62-a7e9-b1f9c4bd2ea1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:25.083471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f40d9c36-f810-4e62-a7e9-b1f9c4bd2ea1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:25.101773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f40d9c36-f810-4e62-a7e9-b1f9c4bd2ea1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:25.102596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f40d9c36-f810-4e62-a7e9-b1f9c4bd2ea1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:25.102895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f40d9c36-f810-4e62-a7e9-b1f9c4bd2ea1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:25.105551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f40d9c36-f810-4e62-a7e9-b1f9c4bd2ea1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:25.106030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f40d9c36-f810-4e62-a7e9-b1f9c4bd2ea1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:25.107027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f40d9c36-f810-4e62-a7e9-b1f9c4bd2ea1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:25.293271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3274b3fe-cfc7-4b26-bf34-57f065879e91 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:25.293906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3274b3fe-cfc7-4b26-bf34-57f065879e91 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:25.304943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3274b3fe-cfc7-4b26-bf34-57f065879e91 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:25.308856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3274b3fe-cfc7-4b26-bf34-57f065879e91 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:25.309362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3274b3fe-cfc7-4b26-bf34-57f065879e91 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:25.310601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3274b3fe-cfc7-4b26-bf34-57f065879e91 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:25.311138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3274b3fe-cfc7-4b26-bf34-57f065879e91 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:25.314863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3274b3fe-cfc7-4b26-bf34-57f065879e91 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:25.478034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3274b3fe-cfc7-4b26-bf34-57f065879e91 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75a8c66c5304e608e2f3120c1192534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5330327389417995f14947be334a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:25.489797 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3274b3fe-cfc7-4b26-bf34-57f065879e91 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 200 len: 1479 microversion: 2.1 time: 0.201747 Aug 29 15:54:25.491990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f40d9c36-f810-4e62-a7e9-b1f9c4bd2ea1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:25.493533 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3029/6252] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:25 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 1479 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:25.514267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f40d9c36-f810-4e62-a7e9-b1f9c4bd2ea1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:25.521771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f40d9c36-f810-4e62-a7e9-b1f9c4bd2ea1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:25.524907 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f40d9c36-f810-4e62-a7e9-b1f9c4bd2ea1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1737 microversion: 2.20 time: 0.446444 Aug 29 15:54:25.530306 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3224/6253] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:25 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1737 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:25.560592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f5228d60-4936-4a9c-a6c6-722eee81603e req-edaa163b-3a88-4f67-8b69-92058743c048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0", "name": "network-vif-deleted", "tag": "b30b57e6-adcb-4234-b03e-865b3516daa4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:25.585235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f5228d60-4936-4a9c-a6c6-722eee81603e req-edaa163b-3a88-4f67-8b69-92058743c048 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:25.586950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f5228d60-4936-4a9c-a6c6-722eee81603e req-edaa163b-3a88-4f67-8b69-92058743c048 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:25.587938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f5228d60-4936-4a9c-a6c6-722eee81603e req-edaa163b-3a88-4f67-8b69-92058743c048 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:25.606446 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f5228d60-4936-4a9c-a6c6-722eee81603e req-edaa163b-3a88-4f67-8b69-92058743c048 service nova] Creating event network-vif-deleted:b30b57e6-adcb-4234-b03e-865b3516daa4 for instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 on n-h2-839401-11 Aug 29 15:54:25.613915 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f5228d60-4936-4a9c-a6c6-722eee81603e req-edaa163b-3a88-4f67-8b69-92058743c048 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058588 Aug 29 15:54:25.615516 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3030/6254] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:54:26.516228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b8412e59-e994-487f-bfe9-83d8c4d79f46 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:26.520319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b8412e59-e994-487f-bfe9-83d8c4d79f46 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] [instance: 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:26.563937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-70ab8d7c-ecf6-4140-a70f-91cb863a9c39 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:26.565607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-70ab8d7c-ecf6-4140-a70f-91cb863a9c39 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:26.582182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70ab8d7c-ecf6-4140-a70f-91cb863a9c39 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:26.583286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70ab8d7c-ecf6-4140-a70f-91cb863a9c39 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:26.589568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70ab8d7c-ecf6-4140-a70f-91cb863a9c39 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:26.592505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70ab8d7c-ecf6-4140-a70f-91cb863a9c39 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:26.596201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70ab8d7c-ecf6-4140-a70f-91cb863a9c39 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:26.596934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70ab8d7c-ecf6-4140-a70f-91cb863a9c39 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:26.982994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-70ab8d7c-ecf6-4140-a70f-91cb863a9c39 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:26.995910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-70ab8d7c-ecf6-4140-a70f-91cb863a9c39 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:26.998351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-70ab8d7c-ecf6-4140-a70f-91cb863a9c39 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:27.006507 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-70ab8d7c-ecf6-4140-a70f-91cb863a9c39 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1737 microversion: 2.20 time: 0.448116 Aug 29 15:54:27.010089 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3031/6255] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:26 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1737 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:27.187001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8412e59-e994-487f-bfe9-83d8c4d79f46 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:27.189018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8412e59-e994-487f-bfe9-83d8c4d79f46 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:27.190523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8412e59-e994-487f-bfe9-83d8c4d79f46 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:27.192156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8412e59-e994-487f-bfe9-83d8c4d79f46 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:27.194237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8412e59-e994-487f-bfe9-83d8c4d79f46 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:27.195244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8412e59-e994-487f-bfe9-83d8c4d79f46 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:27.264450 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-b8412e59-e994-487f-bfe9-83d8c4d79f46 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] HTTP exception thrown: Instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 could not be found. Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b8412e59-e994-487f-bfe9-83d8c4d79f46 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Request method failure captured: Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 HTTP/1.1 Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN-Shrbl2HxkaYnOtK2CNdk6iJsrlpI7x2pEvqbwalbEhQTR6sDfV2Wu55DTc75O-bivlxXAmF3HFspNNYPdndfOjtbIQTsROFO0VNl42_MzCePBgIneIUPTQCeXIdrBxJJnQjgsKhXk98T5RKZXMNgJMbL43_mClT_pNirw55OB0CI Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: bb5330327389417995f14947be334a04 Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bb5330327389417995f14947be334a04", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bb5330327389417995f14947be334a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb5330327389417995f14947be334a04"}]}] Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: bb5330327389417995f14947be334a04 Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1787606997 Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e75a8c66c5304e608e2f3120c1192534 Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1787606997-project Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 could not be found. Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0'} Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 could not be found. Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 could not be found. Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:54:27.271389 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:27.276601 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:54:27.276601 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:27.276601 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:27.276601 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:27.276601 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:54:27.276601 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:54:27.276601 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 could not be found. Aug 29 15:54:27.276601 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:54:27.279346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b8412e59-e994-487f-bfe9-83d8c4d79f46 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] Returning 404 to user: Instance 56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:54:27.281370 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b8412e59-e994-487f-bfe9-83d8c4d79f46 tempest-ServerRescueNegativeTestJSON-1787606997 tempest-ServerRescueNegativeTestJSON-1787606997-project] 10.222.0.62 "GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0" status: 404 len: 111 microversion: 2.1 time: 0.770900 Aug 29 15:54:27.289074 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3225/6256] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:26 2022] GET /compute/v2.1/servers/56ba9067-3d70-4d7f-8ea6-ec1ef234dbb0 => generated 111 bytes in 780 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:54:27.724540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-9c3ae45f-a0a0-4a6d-92ee-7eb72fed915f req-f301c9c9-b4f0-41a1-9789-0ece9d253b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ed120d-ed09-4cb8-9dba-c1de224fd6b4", "tag": "e79ba180-15ea-4a42-a607-eacc9ae907e9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:27.765125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9c3ae45f-a0a0-4a6d-92ee-7eb72fed915f req-f301c9c9-b4f0-41a1-9789-0ece9d253b50 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:27.768685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9c3ae45f-a0a0-4a6d-92ee-7eb72fed915f req-f301c9c9-b4f0-41a1-9789-0ece9d253b50 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:27.769991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9c3ae45f-a0a0-4a6d-92ee-7eb72fed915f req-f301c9c9-b4f0-41a1-9789-0ece9d253b50 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:27.822181 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-9c3ae45f-a0a0-4a6d-92ee-7eb72fed915f req-f301c9c9-b4f0-41a1-9789-0ece9d253b50 service nova] Creating event network-changed:e79ba180-15ea-4a42-a607-eacc9ae907e9 for instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 on n-h1-839401-11 Aug 29 15:54:27.843820 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-9c3ae45f-a0a0-4a6d-92ee-7eb72fed915f req-f301c9c9-b4f0-41a1-9789-0ece9d253b50 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123681 Aug 29 15:54:27.854075 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3032/6257] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:54:28.037466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-438e74d4-a2b4-40f7-b290-fb4ba8f5551d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:28.038736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-438e74d4-a2b4-40f7-b290-fb4ba8f5551d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:28.053860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-438e74d4-a2b4-40f7-b290-fb4ba8f5551d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.054615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-438e74d4-a2b4-40f7-b290-fb4ba8f5551d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.055297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-438e74d4-a2b4-40f7-b290-fb4ba8f5551d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.056514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-438e74d4-a2b4-40f7-b290-fb4ba8f5551d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.057652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-438e74d4-a2b4-40f7-b290-fb4ba8f5551d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.059121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-438e74d4-a2b4-40f7-b290-fb4ba8f5551d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.090894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:28.976384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-438e74d4-a2b4-40f7-b290-fb4ba8f5551d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:28.985565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-438e74d4-a2b4-40f7-b290-fb4ba8f5551d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:29.013605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-438e74d4-a2b4-40f7-b290-fb4ba8f5551d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:29.015132 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-438e74d4-a2b4-40f7-b290-fb4ba8f5551d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1737 microversion: 2.20 time: 0.982436 Aug 29 15:54:29.017883 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3226/6258] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:28 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1737 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:30.040346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6ac895bc-f8f4-46b3-92d5-f03edddc204a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:30.041054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6ac895bc-f8f4-46b3-92d5-f03edddc204a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:30.088161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ac895bc-f8f4-46b3-92d5-f03edddc204a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:30.088681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ac895bc-f8f4-46b3-92d5-f03edddc204a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:30.089171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ac895bc-f8f4-46b3-92d5-f03edddc204a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:30.089911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ac895bc-f8f4-46b3-92d5-f03edddc204a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:30.090385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ac895bc-f8f4-46b3-92d5-f03edddc204a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:30.090827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ac895bc-f8f4-46b3-92d5-f03edddc204a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:30.362048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6ac895bc-f8f4-46b3-92d5-f03edddc204a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:30.374769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6ac895bc-f8f4-46b3-92d5-f03edddc204a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:30.376736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6ac895bc-f8f4-46b3-92d5-f03edddc204a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:30.378418 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6ac895bc-f8f4-46b3-92d5-f03edddc204a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1737 microversion: 2.20 time: 0.343444 Aug 29 15:54:30.393642 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3033/6259] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:30 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1737 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:31.402982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-05a70842-507d-4a08-b76c-da0f6710b303 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:31.404552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-05a70842-507d-4a08-b76c-da0f6710b303 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:31.433930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05a70842-507d-4a08-b76c-da0f6710b303 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:31.434989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05a70842-507d-4a08-b76c-da0f6710b303 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:31.436079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05a70842-507d-4a08-b76c-da0f6710b303 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:31.437204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05a70842-507d-4a08-b76c-da0f6710b303 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:31.443300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05a70842-507d-4a08-b76c-da0f6710b303 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:31.444019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-05a70842-507d-4a08-b76c-da0f6710b303 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:31.865723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-05a70842-507d-4a08-b76c-da0f6710b303 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:31.878852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-05a70842-507d-4a08-b76c-da0f6710b303 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:31.889496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-05a70842-507d-4a08-b76c-da0f6710b303 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:31.896198 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-05a70842-507d-4a08-b76c-da0f6710b303 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1737 microversion: 2.20 time: 0.497479 Aug 29 15:54:31.899805 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3227/6260] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:31 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1737 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:32.930675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-851448a5-0616-4074-84f4-f49b76e68a81 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:32.931235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-851448a5-0616-4074-84f4-f49b76e68a81 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:32.948148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-851448a5-0616-4074-84f4-f49b76e68a81 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:32.948658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-851448a5-0616-4074-84f4-f49b76e68a81 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:32.949113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-851448a5-0616-4074-84f4-f49b76e68a81 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:32.954970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-851448a5-0616-4074-84f4-f49b76e68a81 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:32.955645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-851448a5-0616-4074-84f4-f49b76e68a81 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:32.956090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-851448a5-0616-4074-84f4-f49b76e68a81 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:33.636187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-851448a5-0616-4074-84f4-f49b76e68a81 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:33.657125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-851448a5-0616-4074-84f4-f49b76e68a81 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:33.660625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-851448a5-0616-4074-84f4-f49b76e68a81 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:33.663040 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-851448a5-0616-4074-84f4-f49b76e68a81 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1737 microversion: 2.20 time: 0.736228 Aug 29 15:54:33.665625 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3034/6261] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:32 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1737 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:34.687223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2688beec-fa32-411e-b0d7-ed5cda4829bb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:34.687845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2688beec-fa32-411e-b0d7-ed5cda4829bb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:34.714188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2688beec-fa32-411e-b0d7-ed5cda4829bb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:34.716422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2688beec-fa32-411e-b0d7-ed5cda4829bb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:34.717066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2688beec-fa32-411e-b0d7-ed5cda4829bb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:34.720795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2688beec-fa32-411e-b0d7-ed5cda4829bb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:34.721783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2688beec-fa32-411e-b0d7-ed5cda4829bb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:34.723796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2688beec-fa32-411e-b0d7-ed5cda4829bb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:35.474645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2688beec-fa32-411e-b0d7-ed5cda4829bb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:35.485744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2688beec-fa32-411e-b0d7-ed5cda4829bb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:35.491798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2688beec-fa32-411e-b0d7-ed5cda4829bb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:35.494525 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2688beec-fa32-411e-b0d7-ed5cda4829bb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1737 microversion: 2.20 time: 0.812865 Aug 29 15:54:35.499701 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3228/6262] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:34 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1737 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:36.540730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7a87dc49-6abd-4336-81ed-ac5e763d4d6b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:36.541600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7a87dc49-6abd-4336-81ed-ac5e763d4d6b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:36.569896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a87dc49-6abd-4336-81ed-ac5e763d4d6b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:36.570641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a87dc49-6abd-4336-81ed-ac5e763d4d6b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:36.580124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a87dc49-6abd-4336-81ed-ac5e763d4d6b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:36.581522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a87dc49-6abd-4336-81ed-ac5e763d4d6b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:36.586079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a87dc49-6abd-4336-81ed-ac5e763d4d6b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:36.591312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a87dc49-6abd-4336-81ed-ac5e763d4d6b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:37.385404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7a87dc49-6abd-4336-81ed-ac5e763d4d6b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:37.398158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7a87dc49-6abd-4336-81ed-ac5e763d4d6b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:37.407358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7a87dc49-6abd-4336-81ed-ac5e763d4d6b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:37.409120 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7a87dc49-6abd-4336-81ed-ac5e763d4d6b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1737 microversion: 2.20 time: 0.888345 Aug 29 15:54:37.427959 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3035/6263] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:36 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1737 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:38.438121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6e9b0a12-2d93-435a-a0b1-97022b08f653 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:38.438974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6e9b0a12-2d93-435a-a0b1-97022b08f653 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:38.469561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9b0a12-2d93-435a-a0b1-97022b08f653 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.470287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9b0a12-2d93-435a-a0b1-97022b08f653 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.471819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9b0a12-2d93-435a-a0b1-97022b08f653 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:38.472621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9b0a12-2d93-435a-a0b1-97022b08f653 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.473115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9b0a12-2d93-435a-a0b1-97022b08f653 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.477843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e9b0a12-2d93-435a-a0b1-97022b08f653 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:38.820850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6e9b0a12-2d93-435a-a0b1-97022b08f653 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:38.835071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6e9b0a12-2d93-435a-a0b1-97022b08f653 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:38.838915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6e9b0a12-2d93-435a-a0b1-97022b08f653 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:38.847716 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6e9b0a12-2d93-435a-a0b1-97022b08f653 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1737 microversion: 2.20 time: 0.414281 Aug 29 15:54:38.850235 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3229/6264] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:38 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1737 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:39.878633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-811b52df-db8b-4ac2-b426-b21557fb9eda tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:39.879252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-811b52df-db8b-4ac2-b426-b21557fb9eda tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:39.901366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811b52df-db8b-4ac2-b426-b21557fb9eda tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:39.902076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811b52df-db8b-4ac2-b426-b21557fb9eda tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:39.902611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811b52df-db8b-4ac2-b426-b21557fb9eda tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:39.903507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811b52df-db8b-4ac2-b426-b21557fb9eda tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:39.903976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811b52df-db8b-4ac2-b426-b21557fb9eda tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:39.904407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811b52df-db8b-4ac2-b426-b21557fb9eda tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:40.358512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-811b52df-db8b-4ac2-b426-b21557fb9eda tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:40.364428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:40.372139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-811b52df-db8b-4ac2-b426-b21557fb9eda tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:40.373619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-811b52df-db8b-4ac2-b426-b21557fb9eda tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:40.374858 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-811b52df-db8b-4ac2-b426-b21557fb9eda tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1737 microversion: 2.20 time: 0.500558 Aug 29 15:54:40.375443 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3036/6265] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:39 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1737 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:40.399669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-23a29f18-0b89-4ceb-baa1-8706ca015f7a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:40.401019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-23a29f18-0b89-4ceb-baa1-8706ca015f7a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:40.410689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23a29f18-0b89-4ceb-baa1-8706ca015f7a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:40.411655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23a29f18-0b89-4ceb-baa1-8706ca015f7a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:40.412374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23a29f18-0b89-4ceb-baa1-8706ca015f7a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:40.413419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23a29f18-0b89-4ceb-baa1-8706ca015f7a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:40.414132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23a29f18-0b89-4ceb-baa1-8706ca015f7a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:40.414775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23a29f18-0b89-4ceb-baa1-8706ca015f7a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:40.852680 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-23a29f18-0b89-4ceb-baa1-8706ca015f7a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1835 microversion: 2.1 time: 0.458508 Aug 29 15:54:40.856251 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3230/6266] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:40 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1835 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:41.404893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-23de85fa-7b70-4a28-b8f6-192c72e57081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:41.405529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-23de85fa-7b70-4a28-b8f6-192c72e57081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:41.415636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23de85fa-7b70-4a28-b8f6-192c72e57081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:41.421072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23de85fa-7b70-4a28-b8f6-192c72e57081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:41.421751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23de85fa-7b70-4a28-b8f6-192c72e57081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:41.422803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23de85fa-7b70-4a28-b8f6-192c72e57081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:41.423442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23de85fa-7b70-4a28-b8f6-192c72e57081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:41.465649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23de85fa-7b70-4a28-b8f6-192c72e57081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:41.696787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-23de85fa-7b70-4a28-b8f6-192c72e57081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:41.706753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-23de85fa-7b70-4a28-b8f6-192c72e57081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:41.709615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-23de85fa-7b70-4a28-b8f6-192c72e57081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:41.710921 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-23de85fa-7b70-4a28-b8f6-192c72e57081 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1719 microversion: 2.20 time: 0.310552 Aug 29 15:54:41.712008 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3037/6267] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:41 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1719 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:42.751347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a47e8708-5515-4f8b-8678-af3df3b16bd7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:42.752271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a47e8708-5515-4f8b-8678-af3df3b16bd7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:42.783361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47e8708-5515-4f8b-8678-af3df3b16bd7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:42.783361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47e8708-5515-4f8b-8678-af3df3b16bd7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:42.783361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47e8708-5515-4f8b-8678-af3df3b16bd7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:42.784901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47e8708-5515-4f8b-8678-af3df3b16bd7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:42.785409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47e8708-5515-4f8b-8678-af3df3b16bd7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:42.785842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47e8708-5515-4f8b-8678-af3df3b16bd7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:43.726535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-621f174a-63b1-43a0-a05b-f34e27adc55a req-f8f053b4-0943-4bb2-94e9-6064b4f51893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fba35d0-e4ed-4088-a1d1-ccabdd81c178", "name": "network-vif-unplugged", "status": "completed", "tag": "db244ebb-da5f-469b-ae27-7da59496c697"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:43.753960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-621f174a-63b1-43a0-a05b-f34e27adc55a req-f8f053b4-0943-4bb2-94e9-6064b4f51893 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:43.754858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-621f174a-63b1-43a0-a05b-f34e27adc55a req-f8f053b4-0943-4bb2-94e9-6064b4f51893 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:43.755689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-621f174a-63b1-43a0-a05b-f34e27adc55a req-f8f053b4-0943-4bb2-94e9-6064b4f51893 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:43.782508 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-621f174a-63b1-43a0-a05b-f34e27adc55a req-f8f053b4-0943-4bb2-94e9-6064b4f51893 service nova] Creating event network-vif-unplugged:db244ebb-da5f-469b-ae27-7da59496c697 for instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 on n-h2-839401-11 Aug 29 15:54:43.807681 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-621f174a-63b1-43a0-a05b-f34e27adc55a req-f8f053b4-0943-4bb2-94e9-6064b4f51893 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089131 Aug 29 15:54:43.820582 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3038/6268] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:54:44.015782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a47e8708-5515-4f8b-8678-af3df3b16bd7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:44.032207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a47e8708-5515-4f8b-8678-af3df3b16bd7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:44.033700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a47e8708-5515-4f8b-8678-af3df3b16bd7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:44.034924 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a47e8708-5515-4f8b-8678-af3df3b16bd7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1719 microversion: 2.20 time: 1.292300 Aug 29 15:54:44.054837 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3231/6269] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:42 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1719 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:44.605305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5dd59956-e2dc-4bf4-86b8-ff863d8e90a8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:44.605804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5dd59956-e2dc-4bf4-86b8-ff863d8e90a8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:44.616903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5dd59956-e2dc-4bf4-86b8-ff863d8e90a8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:44.617440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5dd59956-e2dc-4bf4-86b8-ff863d8e90a8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:44.617882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5dd59956-e2dc-4bf4-86b8-ff863d8e90a8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:44.618600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5dd59956-e2dc-4bf4-86b8-ff863d8e90a8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:44.624265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-ac6e2f36-859b-4cc2-b8a2-c82d18dff897 req-5f4a402b-ac90-4289-a625-03ecada060d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed2e48a2-4790-4e37-98b5-3dcd6375f222", "tag": "daa049ea-5255-46cb-a644-fb8d87623d38"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:44.633126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5dd59956-e2dc-4bf4-86b8-ff863d8e90a8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:44.634298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5dd59956-e2dc-4bf4-86b8-ff863d8e90a8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:44.635171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ac6e2f36-859b-4cc2-b8a2-c82d18dff897 req-5f4a402b-ac90-4289-a625-03ecada060d6 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:44.635652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ac6e2f36-859b-4cc2-b8a2-c82d18dff897 req-5f4a402b-ac90-4289-a625-03ecada060d6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:44.636064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ac6e2f36-859b-4cc2-b8a2-c82d18dff897 req-5f4a402b-ac90-4289-a625-03ecada060d6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:44.649950 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-ac6e2f36-859b-4cc2-b8a2-c82d18dff897 req-5f4a402b-ac90-4289-a625-03ecada060d6 service nova] Creating event network-changed:daa049ea-5255-46cb-a644-fb8d87623d38 for instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 on n-h1-839401-11 Aug 29 15:54:44.656508 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-ac6e2f36-859b-4cc2-b8a2-c82d18dff897 req-5f4a402b-ac90-4289-a625-03ecada060d6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035804 Aug 29 15:54:44.661406 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3232/6270] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:54:44.680014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5dd59956-e2dc-4bf4-86b8-ff863d8e90a8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:54:44.805265 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5dd59956-e2dc-4bf4-86b8-ff863d8e90a8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 204 len: 0 microversion: 2.1 time: 0.204213 Aug 29 15:54:44.809052 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3039/6271] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:54:44 2022] DELETE /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:54:44.821651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5b4b4d28-2b9e-4af5-a841-32009906db2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:44.822370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5b4b4d28-2b9e-4af5-a841-32009906db2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:44.840001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b4b4d28-2b9e-4af5-a841-32009906db2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:44.840508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b4b4d28-2b9e-4af5-a841-32009906db2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:44.840965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b4b4d28-2b9e-4af5-a841-32009906db2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:44.843034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b4b4d28-2b9e-4af5-a841-32009906db2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:44.843509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b4b4d28-2b9e-4af5-a841-32009906db2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:44.844953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b4b4d28-2b9e-4af5-a841-32009906db2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:45.061674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-29789051-da65-42ce-8f35-8cfa88dba263 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:45.063323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-29789051-da65-42ce-8f35-8cfa88dba263 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:45.082757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29789051-da65-42ce-8f35-8cfa88dba263 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:45.086489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29789051-da65-42ce-8f35-8cfa88dba263 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:45.087353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29789051-da65-42ce-8f35-8cfa88dba263 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:45.090155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29789051-da65-42ce-8f35-8cfa88dba263 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:45.093485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29789051-da65-42ce-8f35-8cfa88dba263 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:45.094831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29789051-da65-42ce-8f35-8cfa88dba263 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:45.208264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5b4b4d28-2b9e-4af5-a841-32009906db2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:45.217667 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5b4b4d28-2b9e-4af5-a841-32009906db2a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1688 microversion: 2.1 time: 0.403278 Aug 29 15:54:45.222160 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3233/6272] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:44 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1688 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:45.477604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-29789051-da65-42ce-8f35-8cfa88dba263 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:45.488326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-29789051-da65-42ce-8f35-8cfa88dba263 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:45.495044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-29789051-da65-42ce-8f35-8cfa88dba263 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:45.503586 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-29789051-da65-42ce-8f35-8cfa88dba263 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1662 microversion: 2.20 time: 0.446683 Aug 29 15:54:45.505179 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3040/6273] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:45 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1662 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:45.533836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-83e46b23-fc3a-4852-bec9-b52f299608e6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "545b7d13-294f-4a87-9005-373e44d9d1bc"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:45.536289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-83e46b23-fc3a-4852-bec9-b52f299608e6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:45.555585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e46b23-fc3a-4852-bec9-b52f299608e6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:45.558381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e46b23-fc3a-4852-bec9-b52f299608e6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:45.558830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e46b23-fc3a-4852-bec9-b52f299608e6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:45.559570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e46b23-fc3a-4852-bec9-b52f299608e6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:45.564066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e46b23-fc3a-4852-bec9-b52f299608e6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:45.564948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83e46b23-fc3a-4852-bec9-b52f299608e6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:46.244741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a25fafa4-8c75-4851-a3c5-d148348c28e2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:46.245396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a25fafa4-8c75-4851-a3c5-d148348c28e2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:46.264636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a25fafa4-8c75-4851-a3c5-d148348c28e2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:46.265209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a25fafa4-8c75-4851-a3c5-d148348c28e2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:46.265660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a25fafa4-8c75-4851-a3c5-d148348c28e2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:46.266425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a25fafa4-8c75-4851-a3c5-d148348c28e2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:46.266925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a25fafa4-8c75-4851-a3c5-d148348c28e2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:46.274801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a25fafa4-8c75-4851-a3c5-d148348c28e2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:46.323700 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-83e46b23-fc3a-4852-bec9-b52f299608e6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "POST /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.794778 Aug 29 15:54:46.324866 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3234/6274] 10.222.0.62 () {62 vars in 1364 bytes} [Mon Aug 29 15:54:45 2022] POST /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments => generated 188 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:54:46.595059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-51418c25-0c81-45d7-b43e-7998bd97ba3d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:46.603795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-51418c25-0c81-45d7-b43e-7998bd97ba3d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:46.627343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51418c25-0c81-45d7-b43e-7998bd97ba3d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:46.629687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51418c25-0c81-45d7-b43e-7998bd97ba3d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:46.630478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51418c25-0c81-45d7-b43e-7998bd97ba3d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:46.631771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51418c25-0c81-45d7-b43e-7998bd97ba3d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:46.633959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51418c25-0c81-45d7-b43e-7998bd97ba3d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:46.636756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51418c25-0c81-45d7-b43e-7998bd97ba3d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:46.735848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-51418c25-0c81-45d7-b43e-7998bd97ba3d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122360) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 15:54:46.907082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a25fafa4-8c75-4851-a3c5-d148348c28e2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:46.916145 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a25fafa4-8c75-4851-a3c5-d148348c28e2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1688 microversion: 2.1 time: 0.675387 Aug 29 15:54:46.925746 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3041/6275] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:46 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1688 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:46.978245 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-51418c25-0c81-45d7-b43e-7998bd97ba3d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "POST /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/action" status: 202 len: 0 microversion: 2.20 time: 0.387376 Aug 29 15:54:46.983673 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3235/6276] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 15:54:46 2022] POST /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:54:46.991216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6379f125-a4ba-41db-9694-544653ffefe1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:46.991819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6379f125-a4ba-41db-9694-544653ffefe1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:47.004823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6379f125-a4ba-41db-9694-544653ffefe1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:47.005351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6379f125-a4ba-41db-9694-544653ffefe1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:47.005788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6379f125-a4ba-41db-9694-544653ffefe1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:47.016944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6379f125-a4ba-41db-9694-544653ffefe1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:47.017698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6379f125-a4ba-41db-9694-544653ffefe1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:47.018153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6379f125-a4ba-41db-9694-544653ffefe1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:47.899684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6379f125-a4ba-41db-9694-544653ffefe1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:47.920458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6379f125-a4ba-41db-9694-544653ffefe1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:47.926727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6379f125-a4ba-41db-9694-544653ffefe1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:47.929788 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6379f125-a4ba-41db-9694-544653ffefe1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1748 microversion: 2.20 time: 0.942481 Aug 29 15:54:47.932324 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3042/6277] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:46 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1748 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:47.953907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6010020e-14e7-4279-91b8-96a45687662d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:47.954668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6010020e-14e7-4279-91b8-96a45687662d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:47.968269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6010020e-14e7-4279-91b8-96a45687662d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:47.977459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6010020e-14e7-4279-91b8-96a45687662d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:47.979016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6010020e-14e7-4279-91b8-96a45687662d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:47.982248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6010020e-14e7-4279-91b8-96a45687662d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:47.984636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6010020e-14e7-4279-91b8-96a45687662d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:47.986779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6010020e-14e7-4279-91b8-96a45687662d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:48.542635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6010020e-14e7-4279-91b8-96a45687662d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:48.568140 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6010020e-14e7-4279-91b8-96a45687662d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1569 microversion: 2.1 time: 0.618260 Aug 29 15:54:48.568962 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3236/6278] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:47 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1569 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:48.767781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-cd9fb7fa-7832-456d-a601-8d9de1c1b3b8 req-99a3fdcc-61df-4d7b-923b-50f6257f44f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2e48a2-4790-4e37-98b5-3dcd6375f222", "name": "network-vif-deleted", "tag": "daa049ea-5255-46cb-a644-fb8d87623d38"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:48.801893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cd9fb7fa-7832-456d-a601-8d9de1c1b3b8 req-99a3fdcc-61df-4d7b-923b-50f6257f44f8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:48.802402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cd9fb7fa-7832-456d-a601-8d9de1c1b3b8 req-99a3fdcc-61df-4d7b-923b-50f6257f44f8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:48.802835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cd9fb7fa-7832-456d-a601-8d9de1c1b3b8 req-99a3fdcc-61df-4d7b-923b-50f6257f44f8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:48.859730 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-cd9fb7fa-7832-456d-a601-8d9de1c1b3b8 req-99a3fdcc-61df-4d7b-923b-50f6257f44f8 service nova] Creating event network-vif-deleted:daa049ea-5255-46cb-a644-fb8d87623d38 for instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 on n-h1-839401-11 Aug 29 15:54:48.873282 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-cd9fb7fa-7832-456d-a601-8d9de1c1b3b8 req-99a3fdcc-61df-4d7b-923b-50f6257f44f8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109784 Aug 29 15:54:48.875601 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3043/6279] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:48.971195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1b835c6b-c53b-4124-b0cd-e611db48a058 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:48.975090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1b835c6b-c53b-4124-b0cd-e611db48a058 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:48.985672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:49.002723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b835c6b-c53b-4124-b0cd-e611db48a058 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:49.004257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b835c6b-c53b-4124-b0cd-e611db48a058 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:49.005034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b835c6b-c53b-4124-b0cd-e611db48a058 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.006134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b835c6b-c53b-4124-b0cd-e611db48a058 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:49.006763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b835c6b-c53b-4124-b0cd-e611db48a058 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:49.007347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1b835c6b-c53b-4124-b0cd-e611db48a058 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.391008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1b835c6b-c53b-4124-b0cd-e611db48a058 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:49.402888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1b835c6b-c53b-4124-b0cd-e611db48a058 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:49.407977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1b835c6b-c53b-4124-b0cd-e611db48a058 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:49.409463 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1b835c6b-c53b-4124-b0cd-e611db48a058 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1748 microversion: 2.20 time: 0.451015 Aug 29 15:54:49.411819 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3237/6280] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:48 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1748 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:49.598222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7e3644ca-fdf9-4186-add5-cf82887b4b13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:49.599708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7e3644ca-fdf9-4186-add5-cf82887b4b13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:49.613640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e3644ca-fdf9-4186-add5-cf82887b4b13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:49.616353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e3644ca-fdf9-4186-add5-cf82887b4b13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:49.622043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e3644ca-fdf9-4186-add5-cf82887b4b13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.625388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e3644ca-fdf9-4186-add5-cf82887b4b13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:49.626804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e3644ca-fdf9-4186-add5-cf82887b4b13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:49.627582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e3644ca-fdf9-4186-add5-cf82887b4b13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.757019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e3644ca-fdf9-4186-add5-cf82887b4b13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:49.757845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e3644ca-fdf9-4186-add5-cf82887b4b13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:49.758726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e3644ca-fdf9-4186-add5-cf82887b4b13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.759416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-7e3644ca-fdf9-4186-add5-cf82887b4b13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lazy-loading 'fault' on Instance uuid ed2e48a2-4790-4e37-98b5-3dcd6375f222 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:54:49.985538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7e3644ca-fdf9-4186-add5-cf82887b4b13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:50.006208 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7e3644ca-fdf9-4186-add5-cf82887b4b13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 200 len: 1356 microversion: 2.1 time: 0.415658 Aug 29 15:54:50.012783 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3044/6281] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:49 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 1356 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:50.437790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-02bcc399-d5cd-4d21-b8cc-127d1dcd13b6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:50.439475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-02bcc399-d5cd-4d21-b8cc-127d1dcd13b6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:50.463157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02bcc399-d5cd-4d21-b8cc-127d1dcd13b6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:50.463894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02bcc399-d5cd-4d21-b8cc-127d1dcd13b6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:50.464554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02bcc399-d5cd-4d21-b8cc-127d1dcd13b6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:50.466859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02bcc399-d5cd-4d21-b8cc-127d1dcd13b6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:50.467865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02bcc399-d5cd-4d21-b8cc-127d1dcd13b6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:50.468399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02bcc399-d5cd-4d21-b8cc-127d1dcd13b6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:50.768591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-02bcc399-d5cd-4d21-b8cc-127d1dcd13b6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:50.780689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-02bcc399-d5cd-4d21-b8cc-127d1dcd13b6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:50.788788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-02bcc399-d5cd-4d21-b8cc-127d1dcd13b6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:50.790263 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-02bcc399-d5cd-4d21-b8cc-127d1dcd13b6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1750 microversion: 2.20 time: 0.358024 Aug 29 15:54:50.797136 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3238/6282] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:50 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1750 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:51.037285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-728a0244-dd65-4fb0-a1e9-e210873b3f94 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:51.038702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-728a0244-dd65-4fb0-a1e9-e210873b3f94 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: ed2e48a2-4790-4e37-98b5-3dcd6375f222] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:51.041934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:51.053844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-728a0244-dd65-4fb0-a1e9-e210873b3f94 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:51.053844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-728a0244-dd65-4fb0-a1e9-e210873b3f94 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:51.053844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-728a0244-dd65-4fb0-a1e9-e210873b3f94 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:51.054132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-728a0244-dd65-4fb0-a1e9-e210873b3f94 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:51.054317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-728a0244-dd65-4fb0-a1e9-e210873b3f94 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:51.054976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-728a0244-dd65-4fb0-a1e9-e210873b3f94 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:51.074380 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-728a0244-dd65-4fb0-a1e9-e210873b3f94 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] HTTP exception thrown: Instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 could not be found. Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-728a0244-dd65-4fb0-a1e9-e210873b3f94 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Request method failure captured: Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 HTTP/1.1 Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOB3Svc4jYi_sdqstP8fut48z-Az-vRMtuk-EyuIwnH-xZ_3sKRpgA4G5XF7KP-cMjjpzT9196nhz_6F5C-ZYBvXK1KNFkDO7Pn9b9qPE-UYVu5R2LY-PIrVIejaJCCfnNMTNd864tfoTDZYIqBxVW7iKDXVNaNr9KOQ6yBnoKzm0XU Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 63c8e858d9064ae3875d91e8a43f7ee4 Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1699754938 Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_63c8e858d9064ae3875d91e8a43f7ee4", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/63c8e858d9064ae3875d91e8a43f7ee4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/63c8e858d9064ae3875d91e8a43f7ee4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/63c8e858d9064ae3875d91e8a43f7ee4"}]}] Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1699754938 Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 63c8e858d9064ae3875d91e8a43f7ee4 Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1699754938 Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestNetworkAdvancedServerOps-1699754938-project Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 008972030ade418cb180f0702ae168b4 Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1699754938-project Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 could not be found. Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'ed2e48a2-4790-4e37-98b5-3dcd6375f222'} Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 could not be found. Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 could not be found. Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:54:51.076390 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:51.080577 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:54:51.080577 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:51.080577 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:51.080577 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:51.080577 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:54:51.080577 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:54:51.080577 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 could not be found. Aug 29 15:54:51.080577 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:54:51.083387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-728a0244-dd65-4fb0-a1e9-e210873b3f94 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Returning 404 to user: Instance ed2e48a2-4790-4e37-98b5-3dcd6375f222 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:54:51.084281 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-728a0244-dd65-4fb0-a1e9-e210873b3f94 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222" status: 404 len: 111 microversion: 2.1 time: 0.053848 Aug 29 15:54:51.085123 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3045/6283] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:51 2022] GET /compute/v2.1/servers/ed2e48a2-4790-4e37-98b5-3dcd6375f222 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:54:51.819412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-80c11b6b-d8ef-43d3-ae77-a5d4b5c0d983 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:51.820030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-80c11b6b-d8ef-43d3-ae77-a5d4b5c0d983 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:51.830685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80c11b6b-d8ef-43d3-ae77-a5d4b5c0d983 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:51.831182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80c11b6b-d8ef-43d3-ae77-a5d4b5c0d983 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:51.831634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80c11b6b-d8ef-43d3-ae77-a5d4b5c0d983 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:51.841316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80c11b6b-d8ef-43d3-ae77-a5d4b5c0d983 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:51.841860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80c11b6b-d8ef-43d3-ae77-a5d4b5c0d983 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:51.842320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80c11b6b-d8ef-43d3-ae77-a5d4b5c0d983 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:51.893745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-362876863", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "caf04e7f-419b-4879-9fe5-957f473a0259"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:51.985612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] validate_networks() for [('caf04e7f-419b-4879-9fe5-957f473a0259', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:54:52.199543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-80c11b6b-d8ef-43d3-ae77-a5d4b5c0d983 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:52.217744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-80c11b6b-d8ef-43d3-ae77-a5d4b5c0d983 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:52.219549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-80c11b6b-d8ef-43d3-ae77-a5d4b5c0d983 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:52.220933 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-80c11b6b-d8ef-43d3-ae77-a5d4b5c0d983 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1750 microversion: 2.20 time: 0.407955 Aug 29 15:54:52.221984 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3046/6284] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:51 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1750 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:53.259853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c31caf40-9d8f-4f59-b977-1c1a5515d965 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:53.271905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c31caf40-9d8f-4f59-b977-1c1a5515d965 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:53.335128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c31caf40-9d8f-4f59-b977-1c1a5515d965 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:53.335871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c31caf40-9d8f-4f59-b977-1c1a5515d965 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:53.336661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c31caf40-9d8f-4f59-b977-1c1a5515d965 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:53.344500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:54:53.345031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:54:53.352529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:54:53.352711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c31caf40-9d8f-4f59-b977-1c1a5515d965 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:53.353190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:54:53.353682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c31caf40-9d8f-4f59-b977-1c1a5515d965 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:53.353915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:54:53.354451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c31caf40-9d8f-4f59-b977-1c1a5515d965 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:53.381347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:53.382446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:53.385115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:53.386141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:53.388734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:53.389797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:53.421462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Getting quotas for project 9b83740bf69449e6bed1916b2eebf0e4. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:54:53.428580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Getting quotas for user fdca41cbe99548298464769a7609a5ff and project 9b83740bf69449e6bed1916b2eebf0e4. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:54:53.444495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:54:53.449498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:54:53.570284 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4754e5f9-d45f-409e-97f0-9804c344aec7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.257153 Aug 29 15:54:53.574269 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3239/6285] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:54:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2262 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:54:53.601406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-35111025-a528-4269-8d78-4aabc6b84939 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:53.602344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-35111025-a528-4269-8d78-4aabc6b84939 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:53.764128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-35111025-a528-4269-8d78-4aabc6b84939 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:53.776337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-35111025-a528-4269-8d78-4aabc6b84939 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:53.778358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-35111025-a528-4269-8d78-4aabc6b84939 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:53.781228 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-35111025-a528-4269-8d78-4aabc6b84939 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1261 microversion: 2.26 time: 0.186062 Aug 29 15:54:53.781881 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3240/6286] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:53 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:53.794514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c31caf40-9d8f-4f59-b977-1c1a5515d965 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:53.805850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c31caf40-9d8f-4f59-b977-1c1a5515d965 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:53.810910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c31caf40-9d8f-4f59-b977-1c1a5515d965 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:53.815715 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c31caf40-9d8f-4f59-b977-1c1a5515d965 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1750 microversion: 2.20 time: 0.570703 Aug 29 15:54:53.819775 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3047/6287] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:53 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1750 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:54.815422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c193f3c1-b8c1-451b-b241-ecdef5350316 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:54.817345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c193f3c1-b8c1-451b-b241-ecdef5350316 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:54.844172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-368b4417-3584-49cb-bbc7-2c0e457a0c75 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:54.845001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-368b4417-3584-49cb-bbc7-2c0e457a0c75 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:54.866607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-368b4417-3584-49cb-bbc7-2c0e457a0c75 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:54.870991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c193f3c1-b8c1-451b-b241-ecdef5350316 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:54.871591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-368b4417-3584-49cb-bbc7-2c0e457a0c75 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:54.874914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c193f3c1-b8c1-451b-b241-ecdef5350316 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:54.875390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-368b4417-3584-49cb-bbc7-2c0e457a0c75 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:54.876081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-368b4417-3584-49cb-bbc7-2c0e457a0c75 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:54.876310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c193f3c1-b8c1-451b-b241-ecdef5350316 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:54.877016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-368b4417-3584-49cb-bbc7-2c0e457a0c75 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:54.877685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-368b4417-3584-49cb-bbc7-2c0e457a0c75 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:54.878092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c193f3c1-b8c1-451b-b241-ecdef5350316 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:54.878579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c193f3c1-b8c1-451b-b241-ecdef5350316 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:54.880140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c193f3c1-b8c1-451b-b241-ecdef5350316 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:55.164449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c193f3c1-b8c1-451b-b241-ecdef5350316 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:55.167407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:55.180706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c193f3c1-b8c1-451b-b241-ecdef5350316 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:55.187604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c193f3c1-b8c1-451b-b241-ecdef5350316 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:55.189011 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c193f3c1-b8c1-451b-b241-ecdef5350316 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1257 microversion: 2.26 time: 0.382287 Aug 29 15:54:55.189649 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3241/6288] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:54 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1257 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:55.783208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-368b4417-3584-49cb-bbc7-2c0e457a0c75 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:55.804391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-368b4417-3584-49cb-bbc7-2c0e457a0c75 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:55.813759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-368b4417-3584-49cb-bbc7-2c0e457a0c75 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:55.820611 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-368b4417-3584-49cb-bbc7-2c0e457a0c75 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1750 microversion: 2.20 time: 0.978617 Aug 29 15:54:55.845543 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3048/6289] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:54 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1750 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:56.215600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ce33041c-cffd-4997-a444-08dda652ba52 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:56.217831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ce33041c-cffd-4997-a444-08dda652ba52 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:56.231143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce33041c-cffd-4997-a444-08dda652ba52 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:56.234107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce33041c-cffd-4997-a444-08dda652ba52 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:56.235072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce33041c-cffd-4997-a444-08dda652ba52 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:56.236017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce33041c-cffd-4997-a444-08dda652ba52 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:56.236707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce33041c-cffd-4997-a444-08dda652ba52 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:56.237383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce33041c-cffd-4997-a444-08dda652ba52 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:56.749972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ce33041c-cffd-4997-a444-08dda652ba52 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:56.773395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ce33041c-cffd-4997-a444-08dda652ba52 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:56.780242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ce33041c-cffd-4997-a444-08dda652ba52 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:56.782568 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ce33041c-cffd-4997-a444-08dda652ba52 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1331 microversion: 2.26 time: 0.571995 Aug 29 15:54:56.799638 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3242/6290] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:56 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1331 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:56.848102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9f679233-d63d-4dae-a393-f4f7db422192 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:56.848700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9f679233-d63d-4dae-a393-f4f7db422192 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:56.860920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f679233-d63d-4dae-a393-f4f7db422192 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:56.862147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f679233-d63d-4dae-a393-f4f7db422192 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:56.869831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f679233-d63d-4dae-a393-f4f7db422192 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:56.870951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f679233-d63d-4dae-a393-f4f7db422192 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:56.871724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f679233-d63d-4dae-a393-f4f7db422192 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:56.872364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9f679233-d63d-4dae-a393-f4f7db422192 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:57.796370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9f679233-d63d-4dae-a393-f4f7db422192 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:57.810798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9f679233-d63d-4dae-a393-f4f7db422192 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:57.811051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-402caec7-8d4f-4340-a5b6-f5947d53cf0a tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:57.811502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-402caec7-8d4f-4340-a5b6-f5947d53cf0a tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:57.816304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9f679233-d63d-4dae-a393-f4f7db422192 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:57.821098 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9f679233-d63d-4dae-a393-f4f7db422192 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1750 microversion: 2.20 time: 0.977103 Aug 29 15:54:57.833706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-402caec7-8d4f-4340-a5b6-f5947d53cf0a tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:57.833706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-402caec7-8d4f-4340-a5b6-f5947d53cf0a tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:57.833706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-402caec7-8d4f-4340-a5b6-f5947d53cf0a tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:57.833706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-402caec7-8d4f-4340-a5b6-f5947d53cf0a tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:57.833706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-402caec7-8d4f-4340-a5b6-f5947d53cf0a tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:57.833706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-402caec7-8d4f-4340-a5b6-f5947d53cf0a tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:57.857172 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3049/6291] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:56 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1750 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:58.008982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-402caec7-8d4f-4340-a5b6-f5947d53cf0a tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:58.026886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-402caec7-8d4f-4340-a5b6-f5947d53cf0a tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:58.028369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-402caec7-8d4f-4340-a5b6-f5947d53cf0a tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:58.029569 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-402caec7-8d4f-4340-a5b6-f5947d53cf0a tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1319 microversion: 2.26 time: 0.222636 Aug 29 15:54:58.030132 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3243/6292] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:57 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:58.857101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c36518cd-ed24-4139-82d0-f9b541b4b0b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:58.857720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c36518cd-ed24-4139-82d0-f9b541b4b0b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:58.888885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c36518cd-ed24-4139-82d0-f9b541b4b0b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:58.889422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c36518cd-ed24-4139-82d0-f9b541b4b0b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:58.889865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c36518cd-ed24-4139-82d0-f9b541b4b0b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:58.890585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c36518cd-ed24-4139-82d0-f9b541b4b0b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:58.891041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c36518cd-ed24-4139-82d0-f9b541b4b0b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:58.896661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c36518cd-ed24-4139-82d0-f9b541b4b0b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:59.052347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d1403b84-a050-43b1-99c5-acbf5a8c78d1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:59.053763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d1403b84-a050-43b1-99c5-acbf5a8c78d1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:59.080680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1403b84-a050-43b1-99c5-acbf5a8c78d1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:59.106910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1403b84-a050-43b1-99c5-acbf5a8c78d1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:59.108049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1403b84-a050-43b1-99c5-acbf5a8c78d1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:59.110588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1403b84-a050-43b1-99c5-acbf5a8c78d1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:59.111358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1403b84-a050-43b1-99c5-acbf5a8c78d1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:59.112675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1403b84-a050-43b1-99c5-acbf5a8c78d1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:59.436217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d1403b84-a050-43b1-99c5-acbf5a8c78d1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:59.447387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d1403b84-a050-43b1-99c5-acbf5a8c78d1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:59.449144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d1403b84-a050-43b1-99c5-acbf5a8c78d1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:59.450564 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d1403b84-a050-43b1-99c5-acbf5a8c78d1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1361 microversion: 2.26 time: 0.402520 Aug 29 15:54:59.452125 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3244/6293] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:59 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1361 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:59.472945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c36518cd-ed24-4139-82d0-f9b541b4b0b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:59.490011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c36518cd-ed24-4139-82d0-f9b541b4b0b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:59.494130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c36518cd-ed24-4139-82d0-f9b541b4b0b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:59.495999 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c36518cd-ed24-4139-82d0-f9b541b4b0b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1750 microversion: 2.20 time: 0.650516 Aug 29 15:54:59.510631 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3050/6294] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:58 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1750 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:00.490661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7ac45a71-43a2-4bf6-9bbd-341413f6da2e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:00.492979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7ac45a71-43a2-4bf6-9bbd-341413f6da2e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:00.529114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ec3f9e97-c9a3-4f7a-9749-b6f2dac763cd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:00.530387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ec3f9e97-c9a3-4f7a-9749-b6f2dac763cd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:00.536239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ac45a71-43a2-4bf6-9bbd-341413f6da2e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.546950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ac45a71-43a2-4bf6-9bbd-341413f6da2e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.549793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ac45a71-43a2-4bf6-9bbd-341413f6da2e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.550861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ac45a71-43a2-4bf6-9bbd-341413f6da2e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.551757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ac45a71-43a2-4bf6-9bbd-341413f6da2e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.553656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ac45a71-43a2-4bf6-9bbd-341413f6da2e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.557590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec3f9e97-c9a3-4f7a-9749-b6f2dac763cd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.560851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec3f9e97-c9a3-4f7a-9749-b6f2dac763cd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.561570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec3f9e97-c9a3-4f7a-9749-b6f2dac763cd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.562542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec3f9e97-c9a3-4f7a-9749-b6f2dac763cd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.563322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec3f9e97-c9a3-4f7a-9749-b6f2dac763cd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.568216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec3f9e97-c9a3-4f7a-9749-b6f2dac763cd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:01.116867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ec3f9e97-c9a3-4f7a-9749-b6f2dac763cd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:01.130891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ec3f9e97-c9a3-4f7a-9749-b6f2dac763cd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:01.135625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ec3f9e97-c9a3-4f7a-9749-b6f2dac763cd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:01.136909 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ec3f9e97-c9a3-4f7a-9749-b6f2dac763cd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1750 microversion: 2.20 time: 0.612854 Aug 29 15:55:01.142460 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3051/6295] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:00 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1750 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:01.266939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7ac45a71-43a2-4bf6-9bbd-341413f6da2e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:01.279681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7ac45a71-43a2-4bf6-9bbd-341413f6da2e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:01.283582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7ac45a71-43a2-4bf6-9bbd-341413f6da2e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:01.288783 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7ac45a71-43a2-4bf6-9bbd-341413f6da2e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1361 microversion: 2.26 time: 0.813987 Aug 29 15:55:01.289794 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3245/6296] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:00 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1361 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:01.595904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-78e292b2-c541-477d-bb34-b808e5f36b2d req-9abc177d-eafb-4d0c-ba99-ee3d0a6bc8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8542672d-e865-4e0e-9626-562d3e0355b7", "tag": "a71b74c3-c4d8-4b6f-9e5b-a0f9a628a486"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:01.619146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-78e292b2-c541-477d-bb34-b808e5f36b2d req-9abc177d-eafb-4d0c-ba99-ee3d0a6bc8f6 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:01.619791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-78e292b2-c541-477d-bb34-b808e5f36b2d req-9abc177d-eafb-4d0c-ba99-ee3d0a6bc8f6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:01.620246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-78e292b2-c541-477d-bb34-b808e5f36b2d req-9abc177d-eafb-4d0c-ba99-ee3d0a6bc8f6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:01.637749 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-78e292b2-c541-477d-bb34-b808e5f36b2d req-9abc177d-eafb-4d0c-ba99-ee3d0a6bc8f6 service nova] Creating event network-changed:a71b74c3-c4d8-4b6f-9e5b-a0f9a628a486 for instance 8542672d-e865-4e0e-9626-562d3e0355b7 on n-h2-839401-11 Aug 29 15:55:01.644458 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-78e292b2-c541-477d-bb34-b808e5f36b2d req-9abc177d-eafb-4d0c-ba99-ee3d0a6bc8f6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052695 Aug 29 15:55:01.645902 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3052/6297] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:01.875816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-38287d54-fe23-45ce-b78b-b38cc4821c87 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '.version_select at 0x7fc42a84f430>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:01.926932 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-38287d54-fe23-45ce-b78b-b38cc4821c87 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1193571999" status: 202 len: 0 microversion: 2.1 time: 0.056382 Aug 29 15:55:01.929473 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3246/6298] 10.222.0.62 () {58 vars in 1284 bytes} [Mon Aug 29 15:55:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1193571999 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:55:01.979804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-82ebeabc-b7a0-459d-b100-32c2f7b63d83 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'create', calling method: .version_select at 0x7fc433aa6940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-794061099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsHuatQY7ld8zZ72EE3Ofz4TIcZubff/Kz17snnbmpdCjok0odyV9saRUFvkf5nmSAr9slh0eGSMyIZZzCu3pKGSrfDEqkNpmLiE6uMjIkhPpLrX/TE8kf3XGMkfUbJ/g=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:02.002337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-82ebeabc-b7a0-459d-b100-32c2f7b63d83 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Getting quotas for project 63c8e858d9064ae3875d91e8a43f7ee4. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:55:02.008109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-82ebeabc-b7a0-459d-b100-32c2f7b63d83 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Getting quotas for user 008972030ade418cb180f0702ae168b4 and project 63c8e858d9064ae3875d91e8a43f7ee4. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:55:02.037965 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-82ebeabc-b7a0-459d-b100-32c2f7b63d83 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.064521 Aug 29 15:55:02.038775 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3053/6299] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:55:01 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:02.166400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-45cbd850-9201-4cdc-9615-f39853c1c9a9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:02.167565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-45cbd850-9201-4cdc-9615-f39853c1c9a9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:02.184762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cbd850-9201-4cdc-9615-f39853c1c9a9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:02.185420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cbd850-9201-4cdc-9615-f39853c1c9a9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:02.185870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cbd850-9201-4cdc-9615-f39853c1c9a9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:02.186808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cbd850-9201-4cdc-9615-f39853c1c9a9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:02.190102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cbd850-9201-4cdc-9615-f39853c1c9a9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:02.190720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-45cbd850-9201-4cdc-9615-f39853c1c9a9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:02.316880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-08723ee8-5a63-4c5b-80c5-f826427124bf tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:02.317741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-08723ee8-5a63-4c5b-80c5-f826427124bf tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:02.328081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08723ee8-5a63-4c5b-80c5-f826427124bf tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:02.331154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08723ee8-5a63-4c5b-80c5-f826427124bf tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:02.332993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08723ee8-5a63-4c5b-80c5-f826427124bf tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:02.334702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08723ee8-5a63-4c5b-80c5-f826427124bf tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:02.337651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08723ee8-5a63-4c5b-80c5-f826427124bf tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:02.338264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-08723ee8-5a63-4c5b-80c5-f826427124bf tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:02.442238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-45cbd850-9201-4cdc-9615-f39853c1c9a9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:02.454309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-45cbd850-9201-4cdc-9615-f39853c1c9a9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:02.456736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-45cbd850-9201-4cdc-9615-f39853c1c9a9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:02.458017 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-45cbd850-9201-4cdc-9615-f39853c1c9a9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.298029 Aug 29 15:55:02.459081 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3247/6300] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:02 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:02.724380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-08723ee8-5a63-4c5b-80c5-f826427124bf tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:02.734229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-08723ee8-5a63-4c5b-80c5-f826427124bf tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:02.743058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-08723ee8-5a63-4c5b-80c5-f826427124bf tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:02.744253 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-08723ee8-5a63-4c5b-80c5-f826427124bf tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1361 microversion: 2.26 time: 0.433334 Aug 29 15:55:02.744819 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3054/6301] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:02 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1361 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:03.480837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d2e9954-b885-4b21-a0f9-74e6211ead9e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:03.482025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2d2e9954-b885-4b21-a0f9-74e6211ead9e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:03.485807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:03.496215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d2e9954-b885-4b21-a0f9-74e6211ead9e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:03.496721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d2e9954-b885-4b21-a0f9-74e6211ead9e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:03.501816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d2e9954-b885-4b21-a0f9-74e6211ead9e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:03.502819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d2e9954-b885-4b21-a0f9-74e6211ead9e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:03.503455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d2e9954-b885-4b21-a0f9-74e6211ead9e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:03.504069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d2e9954-b885-4b21-a0f9-74e6211ead9e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:03.677844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d2e9954-b885-4b21-a0f9-74e6211ead9e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:03.691027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d2e9954-b885-4b21-a0f9-74e6211ead9e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:03.692499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d2e9954-b885-4b21-a0f9-74e6211ead9e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:03.709354 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d2e9954-b885-4b21-a0f9-74e6211ead9e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.232825 Aug 29 15:55:03.710169 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3248/6302] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:03 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:03.770341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8a8120ff-0bea-4eea-9160-6a475f7edc86 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:03.771691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8a8120ff-0bea-4eea-9160-6a475f7edc86 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:03.786363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a8120ff-0bea-4eea-9160-6a475f7edc86 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:03.787085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a8120ff-0bea-4eea-9160-6a475f7edc86 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:03.787684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a8120ff-0bea-4eea-9160-6a475f7edc86 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:03.788566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a8120ff-0bea-4eea-9160-6a475f7edc86 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:03.789444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a8120ff-0bea-4eea-9160-6a475f7edc86 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:03.790032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a8120ff-0bea-4eea-9160-6a475f7edc86 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:03.796373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:04.064893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8a8120ff-0bea-4eea-9160-6a475f7edc86 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:04.083252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8a8120ff-0bea-4eea-9160-6a475f7edc86 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:04.086714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8a8120ff-0bea-4eea-9160-6a475f7edc86 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:04.087924 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8a8120ff-0bea-4eea-9160-6a475f7edc86 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1361 microversion: 2.26 time: 0.321775 Aug 29 15:55:04.088492 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3055/6303] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:03 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1361 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:04.736476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bdb5fe31-4d7b-41d2-8544-2caa4dbf4382 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:04.737240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bdb5fe31-4d7b-41d2-8544-2caa4dbf4382 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:04.739349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:04.751282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdb5fe31-4d7b-41d2-8544-2caa4dbf4382 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:04.751887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdb5fe31-4d7b-41d2-8544-2caa4dbf4382 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:04.752327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdb5fe31-4d7b-41d2-8544-2caa4dbf4382 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:04.757957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdb5fe31-4d7b-41d2-8544-2caa4dbf4382 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:04.758927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdb5fe31-4d7b-41d2-8544-2caa4dbf4382 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:04.761810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bdb5fe31-4d7b-41d2-8544-2caa4dbf4382 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.041049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bdb5fe31-4d7b-41d2-8544-2caa4dbf4382 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:05.051587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bdb5fe31-4d7b-41d2-8544-2caa4dbf4382 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:05.059416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bdb5fe31-4d7b-41d2-8544-2caa4dbf4382 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:05.066059 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bdb5fe31-4d7b-41d2-8544-2caa4dbf4382 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.337445 Aug 29 15:55:05.067369 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3249/6304] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:04 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:05.111968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a3a55d8e-47f3-4237-ab6f-3428f994bacb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:05.117637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a3a55d8e-47f3-4237-ab6f-3428f994bacb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:05.122297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3a55d8e-47f3-4237-ab6f-3428f994bacb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.122950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3a55d8e-47f3-4237-ab6f-3428f994bacb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.123509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3a55d8e-47f3-4237-ab6f-3428f994bacb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.124454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3a55d8e-47f3-4237-ab6f-3428f994bacb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.126463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3a55d8e-47f3-4237-ab6f-3428f994bacb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.126463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3a55d8e-47f3-4237-ab6f-3428f994bacb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:06.095507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-75276c62-c154-4ff3-9de7-2bd2bd2dca0b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:06.098936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-75276c62-c154-4ff3-9de7-2bd2bd2dca0b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:06.114613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75276c62-c154-4ff3-9de7-2bd2bd2dca0b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:06.115577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75276c62-c154-4ff3-9de7-2bd2bd2dca0b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:06.119300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75276c62-c154-4ff3-9de7-2bd2bd2dca0b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:06.120275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75276c62-c154-4ff3-9de7-2bd2bd2dca0b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:06.121283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75276c62-c154-4ff3-9de7-2bd2bd2dca0b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:06.121954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75276c62-c154-4ff3-9de7-2bd2bd2dca0b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:06.235034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a3a55d8e-47f3-4237-ab6f-3428f994bacb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:06.246307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a3a55d8e-47f3-4237-ab6f-3428f994bacb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:06.248047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a3a55d8e-47f3-4237-ab6f-3428f994bacb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:06.260773 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a3a55d8e-47f3-4237-ab6f-3428f994bacb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1361 microversion: 2.26 time: 1.141739 Aug 29 15:55:06.261704 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3056/6305] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:05 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1361 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:06.464879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-75276c62-c154-4ff3-9de7-2bd2bd2dca0b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:06.480869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-75276c62-c154-4ff3-9de7-2bd2bd2dca0b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:06.487196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-75276c62-c154-4ff3-9de7-2bd2bd2dca0b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:06.492534 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-75276c62-c154-4ff3-9de7-2bd2bd2dca0b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.401271 Aug 29 15:55:06.493920 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3250/6306] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:06 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:07.297515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bbbb0745-9f12-4f97-a033-26f99c6720ce tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:07.299557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bbbb0745-9f12-4f97-a033-26f99c6720ce tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:07.327764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbbb0745-9f12-4f97-a033-26f99c6720ce tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.331145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbbb0745-9f12-4f97-a033-26f99c6720ce tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.335510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbbb0745-9f12-4f97-a033-26f99c6720ce tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.350268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbbb0745-9f12-4f97-a033-26f99c6720ce tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.351268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbbb0745-9f12-4f97-a033-26f99c6720ce tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.365037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbbb0745-9f12-4f97-a033-26f99c6720ce tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.516876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-758bbae1-8d74-49df-9762-48318ab87880 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:07.518404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-758bbae1-8d74-49df-9762-48318ab87880 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:07.532831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-758bbae1-8d74-49df-9762-48318ab87880 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.534539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-758bbae1-8d74-49df-9762-48318ab87880 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.538693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-758bbae1-8d74-49df-9762-48318ab87880 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.539635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-758bbae1-8d74-49df-9762-48318ab87880 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.540260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-758bbae1-8d74-49df-9762-48318ab87880 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.540891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-758bbae1-8d74-49df-9762-48318ab87880 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.938850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-758bbae1-8d74-49df-9762-48318ab87880 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:07.951649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-758bbae1-8d74-49df-9762-48318ab87880 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:07.961510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-758bbae1-8d74-49df-9762-48318ab87880 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:07.967645 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-758bbae1-8d74-49df-9762-48318ab87880 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.453410 Aug 29 15:55:07.985345 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3251/6307] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:07 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:08.001134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-1a4f0c20-59eb-44b2-9326-633b3b660579 req-4ce46101-1262-4281-bef6-cb13e994f654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8542672d-e865-4e0e-9626-562d3e0355b7", "name": "network-vif-plugged", "status": "completed", "tag": "a71b74c3-c4d8-4b6f-9e5b-a0f9a628a486"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:08.043838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1a4f0c20-59eb-44b2-9326-633b3b660579 req-4ce46101-1262-4281-bef6-cb13e994f654 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:08.044619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1a4f0c20-59eb-44b2-9326-633b3b660579 req-4ce46101-1262-4281-bef6-cb13e994f654 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:08.047339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-1a4f0c20-59eb-44b2-9326-633b3b660579 req-4ce46101-1262-4281-bef6-cb13e994f654 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:08.060611 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-1a4f0c20-59eb-44b2-9326-633b3b660579 req-4ce46101-1262-4281-bef6-cb13e994f654 service nova] Creating event network-vif-plugged:a71b74c3-c4d8-4b6f-9e5b-a0f9a628a486 for instance 8542672d-e865-4e0e-9626-562d3e0355b7 on n-h2-839401-11 Aug 29 15:55:08.080147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bbbb0745-9f12-4f97-a033-26f99c6720ce tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:08.092142 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-1a4f0c20-59eb-44b2-9326-633b3b660579 req-4ce46101-1262-4281-bef6-cb13e994f654 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104198 Aug 29 15:55:08.094111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bbbb0745-9f12-4f97-a033-26f99c6720ce tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:08.095967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bbbb0745-9f12-4f97-a033-26f99c6720ce tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:08.100128 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3252/6308] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:08.109189 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bbbb0745-9f12-4f97-a033-26f99c6720ce tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1361 microversion: 2.26 time: 0.822730 Aug 29 15:55:08.110546 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3057/6309] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:07 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1361 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:08.995468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-01da3907-ae66-493c-8fce-4504a1dff2d3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:08.996185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-01da3907-ae66-493c-8fce-4504a1dff2d3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:09.029509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01da3907-ae66-493c-8fce-4504a1dff2d3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:09.029509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01da3907-ae66-493c-8fce-4504a1dff2d3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:09.029509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01da3907-ae66-493c-8fce-4504a1dff2d3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:09.029509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01da3907-ae66-493c-8fce-4504a1dff2d3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:09.029509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01da3907-ae66-493c-8fce-4504a1dff2d3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:09.029509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01da3907-ae66-493c-8fce-4504a1dff2d3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:09.132773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c5f34e81-1702-4edb-80b1-2cc789bb3408 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:09.135887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c5f34e81-1702-4edb-80b1-2cc789bb3408 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:09.154783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5f34e81-1702-4edb-80b1-2cc789bb3408 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:09.156456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5f34e81-1702-4edb-80b1-2cc789bb3408 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:09.157236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5f34e81-1702-4edb-80b1-2cc789bb3408 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:09.159716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5f34e81-1702-4edb-80b1-2cc789bb3408 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:09.160507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5f34e81-1702-4edb-80b1-2cc789bb3408 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:09.161114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5f34e81-1702-4edb-80b1-2cc789bb3408 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:09.372258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-01da3907-ae66-493c-8fce-4504a1dff2d3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:09.398597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-01da3907-ae66-493c-8fce-4504a1dff2d3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:09.411059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-01da3907-ae66-493c-8fce-4504a1dff2d3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:09.414768 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-01da3907-ae66-493c-8fce-4504a1dff2d3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.426182 Aug 29 15:55:09.418277 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3253/6310] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:08 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:09.595289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c5f34e81-1702-4edb-80b1-2cc789bb3408 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:09.611430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c5f34e81-1702-4edb-80b1-2cc789bb3408 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:09.617811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c5f34e81-1702-4edb-80b1-2cc789bb3408 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:09.622775 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c5f34e81-1702-4edb-80b1-2cc789bb3408 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1361 microversion: 2.26 time: 0.492352 Aug 29 15:55:09.623863 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3058/6311] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:09 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1361 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:10.442557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0fd9394a-7094-4111-95a2-9a7b9f037e61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:10.443391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0fd9394a-7094-4111-95a2-9a7b9f037e61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:10.457511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fd9394a-7094-4111-95a2-9a7b9f037e61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:10.459231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fd9394a-7094-4111-95a2-9a7b9f037e61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:10.461640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fd9394a-7094-4111-95a2-9a7b9f037e61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:10.465703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fd9394a-7094-4111-95a2-9a7b9f037e61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:10.466582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fd9394a-7094-4111-95a2-9a7b9f037e61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:10.467291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0fd9394a-7094-4111-95a2-9a7b9f037e61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:10.650146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3b58acda-9985-4349-aace-e49831c58fd0 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:10.651549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3b58acda-9985-4349-aace-e49831c58fd0 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:10.658614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b58acda-9985-4349-aace-e49831c58fd0 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:10.667294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b58acda-9985-4349-aace-e49831c58fd0 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:10.668224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b58acda-9985-4349-aace-e49831c58fd0 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:10.670626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b58acda-9985-4349-aace-e49831c58fd0 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:10.677768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b58acda-9985-4349-aace-e49831c58fd0 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:10.678615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b58acda-9985-4349-aace-e49831c58fd0 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:11.026443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0fd9394a-7094-4111-95a2-9a7b9f037e61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:11.036835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0fd9394a-7094-4111-95a2-9a7b9f037e61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:11.057464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0fd9394a-7094-4111-95a2-9a7b9f037e61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:11.070241 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0fd9394a-7094-4111-95a2-9a7b9f037e61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.634239 Aug 29 15:55:11.088807 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3254/6312] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:10 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:12.017283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:12.102260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4acee649-6bae-4852-bb4a-8b6913bc1bdc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:12.102976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4acee649-6bae-4852-bb4a-8b6913bc1bdc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:12.115012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4acee649-6bae-4852-bb4a-8b6913bc1bdc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:12.117712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4acee649-6bae-4852-bb4a-8b6913bc1bdc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:12.118360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4acee649-6bae-4852-bb4a-8b6913bc1bdc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:12.119252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4acee649-6bae-4852-bb4a-8b6913bc1bdc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:12.121099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4acee649-6bae-4852-bb4a-8b6913bc1bdc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:12.123283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4acee649-6bae-4852-bb4a-8b6913bc1bdc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:12.478494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4acee649-6bae-4852-bb4a-8b6913bc1bdc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:12.497358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4acee649-6bae-4852-bb4a-8b6913bc1bdc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:12.499178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4acee649-6bae-4852-bb4a-8b6913bc1bdc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:12.501270 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4acee649-6bae-4852-bb4a-8b6913bc1bdc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.403665 Aug 29 15:55:12.501472 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3255/6313] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:12 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:12.764173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3b58acda-9985-4349-aace-e49831c58fd0 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:12.774198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3b58acda-9985-4349-aace-e49831c58fd0 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:12.781009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3b58acda-9985-4349-aace-e49831c58fd0 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:12.782548 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3b58acda-9985-4349-aace-e49831c58fd0 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1361 microversion: 2.26 time: 2.137098 Aug 29 15:55:12.796132 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3059/6314] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:10 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1361 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:13.529150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b91e162c-b6af-4fde-8962-1210f1ba143f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:13.530322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b91e162c-b6af-4fde-8962-1210f1ba143f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:13.563367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b91e162c-b6af-4fde-8962-1210f1ba143f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:13.564245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b91e162c-b6af-4fde-8962-1210f1ba143f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:13.564755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b91e162c-b6af-4fde-8962-1210f1ba143f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:13.572549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b91e162c-b6af-4fde-8962-1210f1ba143f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:13.573271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b91e162c-b6af-4fde-8962-1210f1ba143f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:13.581944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b91e162c-b6af-4fde-8962-1210f1ba143f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:13.824298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f33b1446-e3dd-4b87-84df-f5fdd758c60d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:13.824935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f33b1446-e3dd-4b87-84df-f5fdd758c60d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:13.878368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f33b1446-e3dd-4b87-84df-f5fdd758c60d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:13.886573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f33b1446-e3dd-4b87-84df-f5fdd758c60d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:13.889833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f33b1446-e3dd-4b87-84df-f5fdd758c60d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:13.896330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f33b1446-e3dd-4b87-84df-f5fdd758c60d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:13.897348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f33b1446-e3dd-4b87-84df-f5fdd758c60d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:13.899307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f33b1446-e3dd-4b87-84df-f5fdd758c60d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:14.061803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b91e162c-b6af-4fde-8962-1210f1ba143f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:14.076161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b91e162c-b6af-4fde-8962-1210f1ba143f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:14.087164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b91e162c-b6af-4fde-8962-1210f1ba143f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:14.130901 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b91e162c-b6af-4fde-8962-1210f1ba143f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.564624 Aug 29 15:55:14.133986 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3256/6315] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:13 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:14.882201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f33b1446-e3dd-4b87-84df-f5fdd758c60d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:14.903416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f33b1446-e3dd-4b87-84df-f5fdd758c60d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:14.924230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f33b1446-e3dd-4b87-84df-f5fdd758c60d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:14.929286 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f33b1446-e3dd-4b87-84df-f5fdd758c60d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1546 microversion: 2.26 time: 1.110027 Aug 29 15:55:14.931218 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3060/6316] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:13 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1546 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:14.959007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc42a890670>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:14.974440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:14.974939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:14.975379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:14.975865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:15.032038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.032532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.032983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.033736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.034198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.034723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.097321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.097831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.098285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.156093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.156815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.158968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.159210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-abd038bb-2472-41b2-be78-38257a91bcf7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:15.159898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-abd038bb-2472-41b2-be78-38257a91bcf7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:15.198332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abd038bb-2472-41b2-be78-38257a91bcf7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.202393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abd038bb-2472-41b2-be78-38257a91bcf7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.208037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abd038bb-2472-41b2-be78-38257a91bcf7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.212967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abd038bb-2472-41b2-be78-38257a91bcf7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.215314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abd038bb-2472-41b2-be78-38257a91bcf7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.218469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-abd038bb-2472-41b2-be78-38257a91bcf7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.305407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lazy-loading 'flavor' on Instance uuid 8542672d-e865-4e0e-9626-562d3e0355b7 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:15.350242 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dfaebcb9-2a39-4448-b789-5f8bf3853128 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "PUT /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags/tempest-tag-1287614641" status: 201 len: 0 microversion: 2.26 time: 0.395384 Aug 29 15:55:15.365581 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3257/6317] 10.222.0.62 () {62 vars in 1380 bytes} [Mon Aug 29 15:55:14 2022] PUT /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags/tempest-tag-1287614641 => generated 0 bytes in 411 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 29 15:55:15.375631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fed6c3f8-9fff-4b43-aa60-0f2b85bcc142 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc43009d5e0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:15.392401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fed6c3f8-9fff-4b43-aa60-0f2b85bcc142 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.396441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fed6c3f8-9fff-4b43-aa60-0f2b85bcc142 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.397251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fed6c3f8-9fff-4b43-aa60-0f2b85bcc142 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.403125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:15.445493 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fed6c3f8-9fff-4b43-aa60-0f2b85bcc142 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags/tempest-tag-1287614641" status: 204 len: 0 microversion: 2.26 time: 0.078561 Aug 29 15:55:15.446564 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3258/6318] 10.222.0.62 () {60 vars in 1361 bytes} [Mon Aug 29 15:55:15 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags/tempest-tag-1287614641 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:55:15.456617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b4cd31ec-7dc1-4942-9759-ea718863853d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc42a6d53a0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:15.480719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4cd31ec-7dc1-4942-9759-ea718863853d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.481648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4cd31ec-7dc1-4942-9759-ea718863853d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.482400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4cd31ec-7dc1-4942-9759-ea718863853d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.483124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b4cd31ec-7dc1-4942-9759-ea718863853d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:15.499694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4cd31ec-7dc1-4942-9759-ea718863853d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.505840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4cd31ec-7dc1-4942-9759-ea718863853d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.506686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4cd31ec-7dc1-4942-9759-ea718863853d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.507680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4cd31ec-7dc1-4942-9759-ea718863853d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.508682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4cd31ec-7dc1-4942-9759-ea718863853d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.509408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4cd31ec-7dc1-4942-9759-ea718863853d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.578093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4cd31ec-7dc1-4942-9759-ea718863853d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.578841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4cd31ec-7dc1-4942-9759-ea718863853d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.579410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b4cd31ec-7dc1-4942-9759-ea718863853d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.615848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-b4cd31ec-7dc1-4942-9759-ea718863853d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lazy-loading 'flavor' on Instance uuid 8542672d-e865-4e0e-9626-562d3e0355b7 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:15.663701 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b4cd31ec-7dc1-4942-9759-ea718863853d tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags" status: 204 len: 0 microversion: 2.26 time: 0.211910 Aug 29 15:55:15.664752 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3259/6319] 10.222.0.62 () {60 vars in 1295 bytes} [Mon Aug 29 15:55:15 2022] DELETE /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:55:15.694534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-72c26c03-dcc0-47bf-8357-fd61d7533a1e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc42a5c1a60>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:15.708502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72c26c03-dcc0-47bf-8357-fd61d7533a1e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.715424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72c26c03-dcc0-47bf-8357-fd61d7533a1e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.725219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-72c26c03-dcc0-47bf-8357-fd61d7533a1e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.785373 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-72c26c03-dcc0-47bf-8357-fd61d7533a1e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags" status: 200 len: 12 microversion: 2.26 time: 0.111872 Aug 29 15:55:15.799914 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3260/6320] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Aug 29 15:55:15 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags => generated 12 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:15.837981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc42a841310>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:15.884725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.889260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.893358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.894184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:15.923299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.927070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.929228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.931463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.934990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.935575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.052068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.056556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.057592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.099753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.105881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.106883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.154809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-abd038bb-2472-41b2-be78-38257a91bcf7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:16.172734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-abd038bb-2472-41b2-be78-38257a91bcf7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:16.180564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-abd038bb-2472-41b2-be78-38257a91bcf7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:16.181843 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-abd038bb-2472-41b2-be78-38257a91bcf7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 1.029447 Aug 29 15:55:16.186105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lazy-loading 'flavor' on Instance uuid 8542672d-e865-4e0e-9626-562d3e0355b7 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:16.192099 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3061/6321] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:15 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:16.263332 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-23e05468-0fa4-485a-b972-4277d419c52b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "PUT /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags/tempest-tag-396126907" status: 201 len: 0 microversion: 2.26 time: 0.455652 Aug 29 15:55:16.270216 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3261/6322] 10.222.0.62 () {62 vars in 1377 bytes} [Mon Aug 29 15:55:15 2022] PUT /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags/tempest-tag-396126907 => generated 0 bytes in 464 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 29 15:55:16.278823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4163b8dd-a1a1-4218-9ba3-20dc1720c3c1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc42bafdb80>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:16.322202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4163b8dd-a1a1-4218-9ba3-20dc1720c3c1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.325964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4163b8dd-a1a1-4218-9ba3-20dc1720c3c1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.329640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4163b8dd-a1a1-4218-9ba3-20dc1720c3c1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.410926 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4163b8dd-a1a1-4218-9ba3-20dc1720c3c1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags" status: 200 len: 35 microversion: 2.26 time: 0.139879 Aug 29 15:55:16.418374 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3062/6323] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Aug 29 15:55:16 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags => generated 35 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:16.429431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0ef6ba8e-08cc-45e5-85ed-eb321cbd85c6 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc42a843c10>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:16.443395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef6ba8e-08cc-45e5-85ed-eb321cbd85c6 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.445664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef6ba8e-08cc-45e5-85ed-eb321cbd85c6 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.447713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef6ba8e-08cc-45e5-85ed-eb321cbd85c6 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.449228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0ef6ba8e-08cc-45e5-85ed-eb321cbd85c6 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:16.465620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef6ba8e-08cc-45e5-85ed-eb321cbd85c6 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.470515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef6ba8e-08cc-45e5-85ed-eb321cbd85c6 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.472488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef6ba8e-08cc-45e5-85ed-eb321cbd85c6 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.473594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef6ba8e-08cc-45e5-85ed-eb321cbd85c6 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.475456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef6ba8e-08cc-45e5-85ed-eb321cbd85c6 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.478130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef6ba8e-08cc-45e5-85ed-eb321cbd85c6 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.540708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef6ba8e-08cc-45e5-85ed-eb321cbd85c6 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.541314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef6ba8e-08cc-45e5-85ed-eb321cbd85c6 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.541686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef6ba8e-08cc-45e5-85ed-eb321cbd85c6 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.625899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-0ef6ba8e-08cc-45e5-85ed-eb321cbd85c6 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lazy-loading 'flavor' on Instance uuid 8542672d-e865-4e0e-9626-562d3e0355b7 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:16.704093 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0ef6ba8e-08cc-45e5-85ed-eb321cbd85c6 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags/tempest-tag-396126907" status: 204 len: 0 microversion: 2.26 time: 0.275285 Aug 29 15:55:16.719417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-30af5db8-5c08-43fb-8a01-e6a128fb24cd tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc42b003820>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:16.724882 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3262/6324] 10.222.0.62 () {60 vars in 1361 bytes} [Mon Aug 29 15:55:16 2022] DELETE /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags/tempest-tag-396126907 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:55:16.735471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30af5db8-5c08-43fb-8a01-e6a128fb24cd tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.738819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30af5db8-5c08-43fb-8a01-e6a128fb24cd tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.745425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-30af5db8-5c08-43fb-8a01-e6a128fb24cd tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.765663 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-30af5db8-5c08-43fb-8a01-e6a128fb24cd tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags" status: 200 len: 12 microversion: 2.26 time: 0.052606 Aug 29 15:55:16.781593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8f0e611a-6979-4d7d-a24b-d5741c41a09e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc42a587a60>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:16.788429 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3063/6325] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Aug 29 15:55:16 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags => generated 12 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:16.795139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0e611a-6979-4d7d-a24b-d5741c41a09e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.803474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0e611a-6979-4d7d-a24b-d5741c41a09e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.804536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0e611a-6979-4d7d-a24b-d5741c41a09e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.805182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8f0e611a-6979-4d7d-a24b-d5741c41a09e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:16.819762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0e611a-6979-4d7d-a24b-d5741c41a09e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.822842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0e611a-6979-4d7d-a24b-d5741c41a09e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.823480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0e611a-6979-4d7d-a24b-d5741c41a09e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.825976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0e611a-6979-4d7d-a24b-d5741c41a09e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.827309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0e611a-6979-4d7d-a24b-d5741c41a09e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.828453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0e611a-6979-4d7d-a24b-d5741c41a09e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.884711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0e611a-6979-4d7d-a24b-d5741c41a09e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.885498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0e611a-6979-4d7d-a24b-d5741c41a09e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.886123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f0e611a-6979-4d7d-a24b-d5741c41a09e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.921309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-8f0e611a-6979-4d7d-a24b-d5741c41a09e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lazy-loading 'flavor' on Instance uuid 8542672d-e865-4e0e-9626-562d3e0355b7 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:16.974447 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8f0e611a-6979-4d7d-a24b-d5741c41a09e tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags" status: 204 len: 0 microversion: 2.26 time: 0.199879 Aug 29 15:55:16.982346 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3263/6326] 10.222.0.62 () {60 vars in 1295 bytes} [Mon Aug 29 15:55:16 2022] DELETE /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:55:16.989898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc42a8959d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:17.024344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.024876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.027003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.029468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:17.048256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.052308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.054761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.056285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.057468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.060393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.123146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.124936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.126333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.156179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.158093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.161828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.216179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-be751716-9124-486e-8ccf-abae1817ed9b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:17.217488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-be751716-9124-486e-8ccf-abae1817ed9b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:17.241625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lazy-loading 'flavor' on Instance uuid 8542672d-e865-4e0e-9626-562d3e0355b7 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:17.242734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be751716-9124-486e-8ccf-abae1817ed9b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.243406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be751716-9124-486e-8ccf-abae1817ed9b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.244032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be751716-9124-486e-8ccf-abae1817ed9b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.247071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be751716-9124-486e-8ccf-abae1817ed9b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.247758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be751716-9124-486e-8ccf-abae1817ed9b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.248375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-be751716-9124-486e-8ccf-abae1817ed9b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.296044 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e745dc5f-5fb9-42d9-b8a3-da01c7139efe tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "PUT /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags/tempest-tag-532334479" status: 201 len: 0 microversion: 2.26 time: 0.313158 Aug 29 15:55:17.301648 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3064/6327] 10.222.0.62 () {62 vars in 1377 bytes} [Mon Aug 29 15:55:16 2022] PUT /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags/tempest-tag-532334479 => generated 0 bytes in 315 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 29 15:55:17.307826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc42a8d7dc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:17.347584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.350482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.351059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.353667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:17.364601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.372182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.375304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.378015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.384101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.384815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.467403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.481757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.482365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.519753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.525915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.526624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.585719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lazy-loading 'flavor' on Instance uuid 8542672d-e865-4e0e-9626-562d3e0355b7 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:17.648491 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a21320da-702b-4393-98f5-550092af427b tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "PUT /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags/tempest-tag-2143109340" status: 201 len: 0 microversion: 2.26 time: 0.345108 Aug 29 15:55:17.654558 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3065/6328] 10.222.0.62 () {62 vars in 1380 bytes} [Mon Aug 29 15:55:17 2022] PUT /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags/tempest-tag-2143109340 => generated 0 bytes in 352 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 29 15:55:17.660750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b8ea622b-bbf4-406a-abbe-cb386b5003be tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc42a8a5310>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:17.701611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8ea622b-bbf4-406a-abbe-cb386b5003be tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.702751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8ea622b-bbf4-406a-abbe-cb386b5003be tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.710111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8ea622b-bbf4-406a-abbe-cb386b5003be tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.710890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b8ea622b-bbf4-406a-abbe-cb386b5003be tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:17.728150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-be751716-9124-486e-8ccf-abae1817ed9b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:17.730315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8ea622b-bbf4-406a-abbe-cb386b5003be tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.733748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8ea622b-bbf4-406a-abbe-cb386b5003be tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.738005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8ea622b-bbf4-406a-abbe-cb386b5003be tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.738355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-be751716-9124-486e-8ccf-abae1817ed9b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:17.739037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8ea622b-bbf4-406a-abbe-cb386b5003be tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.739629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8ea622b-bbf4-406a-abbe-cb386b5003be tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.739863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-be751716-9124-486e-8ccf-abae1817ed9b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:17.741238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8ea622b-bbf4-406a-abbe-cb386b5003be tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.756554 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-be751716-9124-486e-8ccf-abae1817ed9b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.542843 Aug 29 15:55:17.757254 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3264/6329] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:17 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:17.832664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8ea622b-bbf4-406a-abbe-cb386b5003be tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:17.847435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8ea622b-bbf4-406a-abbe-cb386b5003be tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:17.848396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8ea622b-bbf4-406a-abbe-cb386b5003be tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:17.902597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-b8ea622b-bbf4-406a-abbe-cb386b5003be tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lazy-loading 'flavor' on Instance uuid 8542672d-e865-4e0e-9626-562d3e0355b7 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:17.964497 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b8ea622b-bbf4-406a-abbe-cb386b5003be tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags" status: 204 len: 0 microversion: 2.26 time: 0.308127 Aug 29 15:55:17.976641 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3066/6330] 10.222.0.62 () {60 vars in 1295 bytes} [Mon Aug 29 15:55:17 2022] DELETE /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:55:17.985528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a9bf51d1-0e37-45ef-9cf4-f20b20b1b0e1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc42a8f0ca0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:18.003152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9bf51d1-0e37-45ef-9cf4-f20b20b1b0e1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.003692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9bf51d1-0e37-45ef-9cf4-f20b20b1b0e1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.005968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9bf51d1-0e37-45ef-9cf4-f20b20b1b0e1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.031923 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a9bf51d1-0e37-45ef-9cf4-f20b20b1b0e1 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags" status: 200 len: 12 microversion: 2.26 time: 0.053632 Aug 29 15:55:18.040791 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3265/6331] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Aug 29 15:55:17 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags => generated 12 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:18.046872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-160d633a-7633-428c-9988-489f7ca02484 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc433aa64c0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:18.071813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-160d633a-7633-428c-9988-489f7ca02484 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.075660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-160d633a-7633-428c-9988-489f7ca02484 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.076251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-160d633a-7633-428c-9988-489f7ca02484 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.076893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-160d633a-7633-428c-9988-489f7ca02484 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:18.091765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-160d633a-7633-428c-9988-489f7ca02484 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.110064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-160d633a-7633-428c-9988-489f7ca02484 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.110816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-160d633a-7633-428c-9988-489f7ca02484 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.111752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-160d633a-7633-428c-9988-489f7ca02484 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.112343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-160d633a-7633-428c-9988-489f7ca02484 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.112891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-160d633a-7633-428c-9988-489f7ca02484 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.174998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-160d633a-7633-428c-9988-489f7ca02484 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.177858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-160d633a-7633-428c-9988-489f7ca02484 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.185859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-160d633a-7633-428c-9988-489f7ca02484 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.217181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-160d633a-7633-428c-9988-489f7ca02484 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lazy-loading 'flavor' on Instance uuid 8542672d-e865-4e0e-9626-562d3e0355b7 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:18.252371 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-160d633a-7633-428c-9988-489f7ca02484 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags" status: 204 len: 0 microversion: 2.26 time: 0.206352 Aug 29 15:55:18.259790 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3067/6332] 10.222.0.62 () {60 vars in 1295 bytes} [Mon Aug 29 15:55:18 2022] DELETE /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:55:18.273457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc42a8901f0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:18.313339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.318153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.320947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.325918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:18.345289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.351131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.353655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.361937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.363077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.364792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.431996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.433551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.435057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.457480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.459105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.460663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.524802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lazy-loading 'flavor' on Instance uuid 8542672d-e865-4e0e-9626-562d3e0355b7 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:18.561678 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4275471a-d544-4beb-8c45-c4925e1941ec tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "PUT /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags/tempest-tag-357391338" status: 201 len: 0 microversion: 2.26 time: 0.292742 Aug 29 15:55:18.563096 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3266/6333] 10.222.0.62 () {62 vars in 1377 bytes} [Mon Aug 29 15:55:18 2022] PUT /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags/tempest-tag-357391338 => generated 0 bytes in 296 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 29 15:55:18.579376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc433a8ef70>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:18.627004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.627840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.628565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.629694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:18.650763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.657844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.658990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.659915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.662526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.665196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.724077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:18.747138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.748099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.748905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.780355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.780854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.785267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-104d1dab-5736-4d4e-96e8-987c5ca8994a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:18.786116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-104d1dab-5736-4d4e-96e8-987c5ca8994a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:18.788991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.805857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-104d1dab-5736-4d4e-96e8-987c5ca8994a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.808538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-104d1dab-5736-4d4e-96e8-987c5ca8994a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.810395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-104d1dab-5736-4d4e-96e8-987c5ca8994a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.814790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-104d1dab-5736-4d4e-96e8-987c5ca8994a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.816910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-104d1dab-5736-4d4e-96e8-987c5ca8994a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.817876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-104d1dab-5736-4d4e-96e8-987c5ca8994a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.881708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lazy-loading 'flavor' on Instance uuid 8542672d-e865-4e0e-9626-562d3e0355b7 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:18.923101 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1621f01c-2bd7-4850-97bc-f08f828f9824 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "PUT /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags/tempest-tag-1997059060" status: 201 len: 0 microversion: 2.26 time: 0.354428 Aug 29 15:55:18.930740 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3068/6334] 10.222.0.62 () {62 vars in 1380 bytes} [Mon Aug 29 15:55:18 2022] PUT /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags/tempest-tag-1997059060 => generated 0 bytes in 357 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 29 15:55:18.937385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-be9f1661-6f56-4f18-98e1-7ffd7fc1b7f8 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Action: 'update_all', calling method: .version_select at 0x7fc42a894700>, body: {"tags": ["tempest-tag-1896611107", "tempest-tag-1026680730"]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:18.965873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be9f1661-6f56-4f18-98e1-7ffd7fc1b7f8 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.966638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be9f1661-6f56-4f18-98e1-7ffd7fc1b7f8 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.973544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be9f1661-6f56-4f18-98e1-7ffd7fc1b7f8 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.975673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-be9f1661-6f56-4f18-98e1-7ffd7fc1b7f8 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:19.001588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be9f1661-6f56-4f18-98e1-7ffd7fc1b7f8 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:19.002302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be9f1661-6f56-4f18-98e1-7ffd7fc1b7f8 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:19.002775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be9f1661-6f56-4f18-98e1-7ffd7fc1b7f8 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.006622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be9f1661-6f56-4f18-98e1-7ffd7fc1b7f8 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:19.010482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be9f1661-6f56-4f18-98e1-7ffd7fc1b7f8 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:19.011194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be9f1661-6f56-4f18-98e1-7ffd7fc1b7f8 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.074645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be9f1661-6f56-4f18-98e1-7ffd7fc1b7f8 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:19.075156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be9f1661-6f56-4f18-98e1-7ffd7fc1b7f8 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:19.075737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be9f1661-6f56-4f18-98e1-7ffd7fc1b7f8 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.122805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-be9f1661-6f56-4f18-98e1-7ffd7fc1b7f8 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lazy-loading 'flavor' on Instance uuid 8542672d-e865-4e0e-9626-562d3e0355b7 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:19.161831 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-be9f1661-6f56-4f18-98e1-7ffd7fc1b7f8 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "PUT /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags" status: 200 len: 62 microversion: 2.26 time: 0.226779 Aug 29 15:55:19.163828 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3069/6335] 10.222.0.62 () {62 vars in 1312 bytes} [Mon Aug 29 15:55:18 2022] PUT /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags => generated 62 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:19.181925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-61d71c10-f4d3-4013-b40e-21f147c2e7dc tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc42a7d39d0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:19.218524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61d71c10-f4d3-4013-b40e-21f147c2e7dc tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:19.223653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61d71c10-f4d3-4013-b40e-21f147c2e7dc tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:19.227948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61d71c10-f4d3-4013-b40e-21f147c2e7dc tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.249908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-104d1dab-5736-4d4e-96e8-987c5ca8994a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:19.255569 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-61d71c10-f4d3-4013-b40e-21f147c2e7dc tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags" status: 200 len: 62 microversion: 2.26 time: 0.084918 Aug 29 15:55:19.256260 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3070/6336] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Aug 29 15:55:19 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags => generated 62 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:19.267345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-104d1dab-5736-4d4e-96e8-987c5ca8994a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:19.267533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-40254f4c-dc92-4eb6-b88c-5f1a2b54ebc7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '.version_select at 0x7fc42a9535e0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:19.269001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-104d1dab-5736-4d4e-96e8-987c5ca8994a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:19.274447 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-104d1dab-5736-4d4e-96e8-987c5ca8994a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.489831 Aug 29 15:55:19.275338 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3267/6337] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:18 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:19.294997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40254f4c-dc92-4eb6-b88c-5f1a2b54ebc7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:19.295766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40254f4c-dc92-4eb6-b88c-5f1a2b54ebc7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:19.296462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40254f4c-dc92-4eb6-b88c-5f1a2b54ebc7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.297221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-40254f4c-dc92-4eb6-b88c-5f1a2b54ebc7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:19.308027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40254f4c-dc92-4eb6-b88c-5f1a2b54ebc7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:19.308941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40254f4c-dc92-4eb6-b88c-5f1a2b54ebc7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:19.311089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40254f4c-dc92-4eb6-b88c-5f1a2b54ebc7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.312646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40254f4c-dc92-4eb6-b88c-5f1a2b54ebc7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:19.313644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40254f4c-dc92-4eb6-b88c-5f1a2b54ebc7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:19.314476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40254f4c-dc92-4eb6-b88c-5f1a2b54ebc7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.347208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40254f4c-dc92-4eb6-b88c-5f1a2b54ebc7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:19.347994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40254f4c-dc92-4eb6-b88c-5f1a2b54ebc7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:19.348688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40254f4c-dc92-4eb6-b88c-5f1a2b54ebc7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.380371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-40254f4c-dc92-4eb6-b88c-5f1a2b54ebc7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lazy-loading 'flavor' on Instance uuid 8542672d-e865-4e0e-9626-562d3e0355b7 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:19.420990 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-40254f4c-dc92-4eb6-b88c-5f1a2b54ebc7 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags" status: 204 len: 0 microversion: 2.26 time: 0.156682 Aug 29 15:55:19.426330 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3071/6338] 10.222.0.62 () {60 vars in 1295 bytes} [Mon Aug 29 15:55:19 2022] DELETE /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7/tags => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 15:55:19.437423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-88e334af-788a-4717-a72c-f95ae88fcddb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:19.437423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-88e334af-788a-4717-a72c-f95ae88fcddb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:19.440651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:19.452575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88e334af-788a-4717-a72c-f95ae88fcddb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:19.455923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88e334af-788a-4717-a72c-f95ae88fcddb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:19.456425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88e334af-788a-4717-a72c-f95ae88fcddb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.457391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88e334af-788a-4717-a72c-f95ae88fcddb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:19.459471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88e334af-788a-4717-a72c-f95ae88fcddb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:19.460159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88e334af-788a-4717-a72c-f95ae88fcddb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.478622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1009697489", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "f3a6b255-d83a-409b-a104-f0c63b0e0ea1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-794061099", "security_groups": [{"name": "tempest-secgroup-smoke-2126403646"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:19.531934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-88e334af-788a-4717-a72c-f95ae88fcddb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:55:19.689274 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-88e334af-788a-4717-a72c-f95ae88fcddb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 204 len: 0 microversion: 2.26 time: 0.254562 Aug 29 15:55:19.690944 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3268/6339] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:55:19 2022] DELETE /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:55:19.724615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bb3a802e-f920-4322-b1fb-863e5509edae tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:19.726399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bb3a802e-f920-4322-b1fb-863e5509edae tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:19.747402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb3a802e-f920-4322-b1fb-863e5509edae tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:19.750245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb3a802e-f920-4322-b1fb-863e5509edae tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:19.751232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb3a802e-f920-4322-b1fb-863e5509edae tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.751728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb3a802e-f920-4322-b1fb-863e5509edae tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:19.752200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb3a802e-f920-4322-b1fb-863e5509edae tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:19.752637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb3a802e-f920-4322-b1fb-863e5509edae tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.765574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:19.884454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] validate_networks() for [('f3a6b255-d83a-409b-a104-f0c63b0e0ea1', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:55:20.141829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bb3a802e-f920-4322-b1fb-863e5509edae tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:20.157798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bb3a802e-f920-4322-b1fb-863e5509edae tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:20.160008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bb3a802e-f920-4322-b1fb-863e5509edae tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:20.163562 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bb3a802e-f920-4322-b1fb-863e5509edae tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1552 microversion: 2.26 time: 0.457251 Aug 29 15:55:20.168291 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3269/6340] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:19 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1552 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:20.299785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d03c91b6-15f9-4097-a594-764acd0ca8ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:20.300541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d03c91b6-15f9-4097-a594-764acd0ca8ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:20.313343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d03c91b6-15f9-4097-a594-764acd0ca8ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:20.314442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d03c91b6-15f9-4097-a594-764acd0ca8ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:20.315157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d03c91b6-15f9-4097-a594-764acd0ca8ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:20.317801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d03c91b6-15f9-4097-a594-764acd0ca8ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:20.318464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d03c91b6-15f9-4097-a594-764acd0ca8ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:20.321978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d03c91b6-15f9-4097-a594-764acd0ca8ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:20.661495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d03c91b6-15f9-4097-a594-764acd0ca8ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:20.676280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d03c91b6-15f9-4097-a594-764acd0ca8ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:20.682422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d03c91b6-15f9-4097-a594-764acd0ca8ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:20.683663 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d03c91b6-15f9-4097-a594-764acd0ca8ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.389032 Aug 29 15:55:20.684217 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3270/6341] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:20 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:20.784391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:55:20.784979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:55:20.785297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:55:20.786030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:55:20.786634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:55:20.797148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:20.798044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:20.798923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:20.799685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:20.800147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:20.800574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:20.821600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Getting quotas for project 63c8e858d9064ae3875d91e8a43f7ee4. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:55:20.834686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Getting quotas for user 008972030ade418cb180f0702ae168b4 and project 63c8e858d9064ae3875d91e8a43f7ee4. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:55:20.873116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:55:20.875861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:55:20.999157 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6cd94bf4-abc9-42e7-9416-11b53c4bac23 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.525878 Aug 29 15:55:21.009209 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3072/6342] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:55:21.016342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4ac0a4d1-a59f-4805-ab62-9d14f4ca21a7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:21.022580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4ac0a4d1-a59f-4805-ab62-9d14f4ca21a7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:21.163259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4ac0a4d1-a59f-4805-ab62-9d14f4ca21a7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:21.175879 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4ac0a4d1-a59f-4805-ab62-9d14f4ca21a7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1266 microversion: 2.1 time: 0.167212 Aug 29 15:55:21.190684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7452a7de-7f15-47c0-9f50-ea2b79c54e49 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:21.191342 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3271/6343] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:21 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:21.191972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7452a7de-7f15-47c0-9f50-ea2b79c54e49 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:21.200420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:21.239165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7452a7de-7f15-47c0-9f50-ea2b79c54e49 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:21.239693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7452a7de-7f15-47c0-9f50-ea2b79c54e49 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:21.240054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7452a7de-7f15-47c0-9f50-ea2b79c54e49 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:21.251763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7452a7de-7f15-47c0-9f50-ea2b79c54e49 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:21.252346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7452a7de-7f15-47c0-9f50-ea2b79c54e49 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:21.260067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7452a7de-7f15-47c0-9f50-ea2b79c54e49 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:21.662982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7452a7de-7f15-47c0-9f50-ea2b79c54e49 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:21.690603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7452a7de-7f15-47c0-9f50-ea2b79c54e49 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:21.692865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7452a7de-7f15-47c0-9f50-ea2b79c54e49 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:21.694253 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7452a7de-7f15-47c0-9f50-ea2b79c54e49 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1552 microversion: 2.26 time: 0.508247 Aug 29 15:55:21.698713 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3073/6344] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:21 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1552 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:21.709425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-40637836-c111-4674-bb3f-570d0304d9ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:21.710022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-40637836-c111-4674-bb3f-570d0304d9ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:21.723901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40637836-c111-4674-bb3f-570d0304d9ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:21.724400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40637836-c111-4674-bb3f-570d0304d9ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:21.724841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40637836-c111-4674-bb3f-570d0304d9ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:21.726432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40637836-c111-4674-bb3f-570d0304d9ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:21.730540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40637836-c111-4674-bb3f-570d0304d9ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:21.731144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40637836-c111-4674-bb3f-570d0304d9ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:22.098170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-40637836-c111-4674-bb3f-570d0304d9ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:22.123905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-40637836-c111-4674-bb3f-570d0304d9ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:22.127498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-40637836-c111-4674-bb3f-570d0304d9ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:22.131224 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-40637836-c111-4674-bb3f-570d0304d9ee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.426171 Aug 29 15:55:22.151371 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3272/6345] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:21 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:22.201312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-95f13cd1-8e0f-4444-8fe3-ba39800beffe tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:22.202678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-95f13cd1-8e0f-4444-8fe3-ba39800beffe tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:22.221599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95f13cd1-8e0f-4444-8fe3-ba39800beffe tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:22.223463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95f13cd1-8e0f-4444-8fe3-ba39800beffe tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:22.225204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95f13cd1-8e0f-4444-8fe3-ba39800beffe tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:22.227059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95f13cd1-8e0f-4444-8fe3-ba39800beffe tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:22.230416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95f13cd1-8e0f-4444-8fe3-ba39800beffe tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:22.231086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-95f13cd1-8e0f-4444-8fe3-ba39800beffe tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:22.720460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c96b92ca-2154-4fba-b9eb-5b5e818b7162 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:22.722096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c96b92ca-2154-4fba-b9eb-5b5e818b7162 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:22.736255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c96b92ca-2154-4fba-b9eb-5b5e818b7162 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:22.736764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c96b92ca-2154-4fba-b9eb-5b5e818b7162 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:22.737252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c96b92ca-2154-4fba-b9eb-5b5e818b7162 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:22.744382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-95f13cd1-8e0f-4444-8fe3-ba39800beffe tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:22.745793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c96b92ca-2154-4fba-b9eb-5b5e818b7162 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:22.746309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c96b92ca-2154-4fba-b9eb-5b5e818b7162 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:22.746763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c96b92ca-2154-4fba-b9eb-5b5e818b7162 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:22.757950 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-95f13cd1-8e0f-4444-8fe3-ba39800beffe tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1270 microversion: 2.1 time: 0.561285 Aug 29 15:55:22.761187 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3074/6346] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:22 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1270 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:23.158275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a89a1c54-d4b6-41d4-90b2-1f45646495cf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:23.158957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a89a1c54-d4b6-41d4-90b2-1f45646495cf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:23.172398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a89a1c54-d4b6-41d4-90b2-1f45646495cf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:23.178537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a89a1c54-d4b6-41d4-90b2-1f45646495cf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:23.179419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a89a1c54-d4b6-41d4-90b2-1f45646495cf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:23.182094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a89a1c54-d4b6-41d4-90b2-1f45646495cf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:23.185138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a89a1c54-d4b6-41d4-90b2-1f45646495cf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:23.185892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a89a1c54-d4b6-41d4-90b2-1f45646495cf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:23.247781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c96b92ca-2154-4fba-b9eb-5b5e818b7162 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:23.272520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c96b92ca-2154-4fba-b9eb-5b5e818b7162 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:23.276882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c96b92ca-2154-4fba-b9eb-5b5e818b7162 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:23.279642 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c96b92ca-2154-4fba-b9eb-5b5e818b7162 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1552 microversion: 2.26 time: 0.563397 Aug 29 15:55:23.281952 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3273/6347] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:22 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1552 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:23.794936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-637bce80-8eb7-4f81-9f30-644418fd70e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:23.796541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-637bce80-8eb7-4f81-9f30-644418fd70e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:23.838592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-637bce80-8eb7-4f81-9f30-644418fd70e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:23.845904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-637bce80-8eb7-4f81-9f30-644418fd70e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:23.846376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-637bce80-8eb7-4f81-9f30-644418fd70e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:23.851182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-637bce80-8eb7-4f81-9f30-644418fd70e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:23.851767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-637bce80-8eb7-4f81-9f30-644418fd70e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:23.852294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-637bce80-8eb7-4f81-9f30-644418fd70e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:24.179815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-637bce80-8eb7-4f81-9f30-644418fd70e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:24.204798 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-637bce80-8eb7-4f81-9f30-644418fd70e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1326 microversion: 2.1 time: 0.425494 Aug 29 15:55:24.218395 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3274/6348] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:23 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1326 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:24.228773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-2e0430a1-3bd8-418e-a0db-78ce86ba04fa req-0831347a-ad82-41e1-b610-1d468ace7245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8542672d-e865-4e0e-9626-562d3e0355b7", "name": "network-vif-deleted", "tag": "a71b74c3-c4d8-4b6f-9e5b-a0f9a628a486"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:24.242906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2e0430a1-3bd8-418e-a0db-78ce86ba04fa req-0831347a-ad82-41e1-b610-1d468ace7245 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:24.243859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2e0430a1-3bd8-418e-a0db-78ce86ba04fa req-0831347a-ad82-41e1-b610-1d468ace7245 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:24.244626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2e0430a1-3bd8-418e-a0db-78ce86ba04fa req-0831347a-ad82-41e1-b610-1d468ace7245 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:24.262937 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-2e0430a1-3bd8-418e-a0db-78ce86ba04fa req-0831347a-ad82-41e1-b610-1d468ace7245 service nova] Creating event network-vif-deleted:a71b74c3-c4d8-4b6f-9e5b-a0f9a628a486 for instance 8542672d-e865-4e0e-9626-562d3e0355b7 on n-h2-839401-11 Aug 29 15:55:24.271553 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-2e0430a1-3bd8-418e-a0db-78ce86ba04fa req-0831347a-ad82-41e1-b610-1d468ace7245 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045646 Aug 29 15:55:24.273156 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3275/6349] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:24.314463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c885cde7-2f08-4702-b9da-bd3824091486 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:24.315623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c885cde7-2f08-4702-b9da-bd3824091486 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:24.332649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c885cde7-2f08-4702-b9da-bd3824091486 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:24.335715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c885cde7-2f08-4702-b9da-bd3824091486 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:24.336491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c885cde7-2f08-4702-b9da-bd3824091486 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:24.338318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c885cde7-2f08-4702-b9da-bd3824091486 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:24.339863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c885cde7-2f08-4702-b9da-bd3824091486 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:24.342490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c885cde7-2f08-4702-b9da-bd3824091486 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:24.469343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c885cde7-2f08-4702-b9da-bd3824091486 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:24.481905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c885cde7-2f08-4702-b9da-bd3824091486 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:24.488499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c885cde7-2f08-4702-b9da-bd3824091486 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:24.490058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-c885cde7-2f08-4702-b9da-bd3824091486 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lazy-loading 'fault' on Instance uuid 8542672d-e865-4e0e-9626-562d3e0355b7 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:24.508653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a89a1c54-d4b6-41d4-90b2-1f45646495cf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:24.538020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a89a1c54-d4b6-41d4-90b2-1f45646495cf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:24.546655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a89a1c54-d4b6-41d4-90b2-1f45646495cf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:24.558599 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a89a1c54-d4b6-41d4-90b2-1f45646495cf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 1.404544 Aug 29 15:55:24.565775 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3075/6350] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:23 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:24.655652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c885cde7-2f08-4702-b9da-bd3824091486 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:24.677421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c885cde7-2f08-4702-b9da-bd3824091486 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:24.687534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c885cde7-2f08-4702-b9da-bd3824091486 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:24.693201 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c885cde7-2f08-4702-b9da-bd3824091486 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1351 microversion: 2.26 time: 0.386367 Aug 29 15:55:24.699535 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3276/6351] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:24 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1351 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:25.230270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e0bdcb8d-5aec-47a7-a834-2f9d92951656 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:25.231403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e0bdcb8d-5aec-47a7-a834-2f9d92951656 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:25.243300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0bdcb8d-5aec-47a7-a834-2f9d92951656 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:25.246017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0bdcb8d-5aec-47a7-a834-2f9d92951656 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:25.246743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0bdcb8d-5aec-47a7-a834-2f9d92951656 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:25.247857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0bdcb8d-5aec-47a7-a834-2f9d92951656 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:25.248743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0bdcb8d-5aec-47a7-a834-2f9d92951656 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:25.250266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0bdcb8d-5aec-47a7-a834-2f9d92951656 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:25.383947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e0bdcb8d-5aec-47a7-a834-2f9d92951656 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:25.397284 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e0bdcb8d-5aec-47a7-a834-2f9d92951656 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1324 microversion: 2.1 time: 0.170671 Aug 29 15:55:25.398075 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3076/6352] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:25 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1324 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:25.603182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c5782040-910d-4fc0-82e1-ef4cbde4ca80 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:25.605024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c5782040-910d-4fc0-82e1-ef4cbde4ca80 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:25.622188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5782040-910d-4fc0-82e1-ef4cbde4ca80 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:25.623184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5782040-910d-4fc0-82e1-ef4cbde4ca80 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:25.623800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5782040-910d-4fc0-82e1-ef4cbde4ca80 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:25.624685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5782040-910d-4fc0-82e1-ef4cbde4ca80 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:25.625416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5782040-910d-4fc0-82e1-ef4cbde4ca80 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:25.626000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5782040-910d-4fc0-82e1-ef4cbde4ca80 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:25.725484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3d9ff6ad-2793-4dd1-a132-31c6d283d1eb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:25.726759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3d9ff6ad-2793-4dd1-a132-31c6d283d1eb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:25.762561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d9ff6ad-2793-4dd1-a132-31c6d283d1eb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:25.763161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d9ff6ad-2793-4dd1-a132-31c6d283d1eb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:25.763621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d9ff6ad-2793-4dd1-a132-31c6d283d1eb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:25.764386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d9ff6ad-2793-4dd1-a132-31c6d283d1eb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:25.778554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d9ff6ad-2793-4dd1-a132-31c6d283d1eb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:25.779167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d9ff6ad-2793-4dd1-a132-31c6d283d1eb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:25.810227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c5782040-910d-4fc0-82e1-ef4cbde4ca80 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:25.824653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c5782040-910d-4fc0-82e1-ef4cbde4ca80 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:25.828484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c5782040-910d-4fc0-82e1-ef4cbde4ca80 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:25.830062 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c5782040-910d-4fc0-82e1-ef4cbde4ca80 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.242752 Aug 29 15:55:25.831125 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3277/6353] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:25 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:25.870853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d9ff6ad-2793-4dd1-a132-31c6d283d1eb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:25.875429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d9ff6ad-2793-4dd1-a132-31c6d283d1eb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:25.875945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3d9ff6ad-2793-4dd1-a132-31c6d283d1eb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:25.877751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-3d9ff6ad-2793-4dd1-a132-31c6d283d1eb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lazy-loading 'fault' on Instance uuid 8542672d-e865-4e0e-9626-562d3e0355b7 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:25.945531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3d9ff6ad-2793-4dd1-a132-31c6d283d1eb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:25.957033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3d9ff6ad-2793-4dd1-a132-31c6d283d1eb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:25.959274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3d9ff6ad-2793-4dd1-a132-31c6d283d1eb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:25.962327 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3d9ff6ad-2793-4dd1-a132-31c6d283d1eb tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1351 microversion: 2.26 time: 0.243486 Aug 29 15:55:25.966647 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3077/6354] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:25 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1351 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:26.424521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-441e8284-21c6-4896-8c7e-856c47ac61ce tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:26.425495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-441e8284-21c6-4896-8c7e-856c47ac61ce tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:26.442775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-441e8284-21c6-4896-8c7e-856c47ac61ce tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:26.443344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-441e8284-21c6-4896-8c7e-856c47ac61ce tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:26.444968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-441e8284-21c6-4896-8c7e-856c47ac61ce tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:26.445752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-441e8284-21c6-4896-8c7e-856c47ac61ce tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:26.446708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-441e8284-21c6-4896-8c7e-856c47ac61ce tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:26.447141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-441e8284-21c6-4896-8c7e-856c47ac61ce tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:26.651595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-441e8284-21c6-4896-8c7e-856c47ac61ce tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:26.659982 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-441e8284-21c6-4896-8c7e-856c47ac61ce tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1392 microversion: 2.1 time: 0.239855 Aug 29 15:55:26.673315 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3278/6355] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:26 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1392 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:26.733499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-1ea53e2e-e3ec-4801-a8fb-bb20f78a2fb5 req-16bdf8b6-e6c2-43e2-8dc7-09a1261527e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972f2acd-0b31-43ab-93a8-9a2a41be43e1", "tag": "24ac9813-3507-47b6-9e86-582a9ad9ccb4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:26.744192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1ea53e2e-e3ec-4801-a8fb-bb20f78a2fb5 req-16bdf8b6-e6c2-43e2-8dc7-09a1261527e1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:26.744679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1ea53e2e-e3ec-4801-a8fb-bb20f78a2fb5 req-16bdf8b6-e6c2-43e2-8dc7-09a1261527e1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:26.745192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1ea53e2e-e3ec-4801-a8fb-bb20f78a2fb5 req-16bdf8b6-e6c2-43e2-8dc7-09a1261527e1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:26.756536 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-1ea53e2e-e3ec-4801-a8fb-bb20f78a2fb5 req-16bdf8b6-e6c2-43e2-8dc7-09a1261527e1 service nova] Creating event network-changed:24ac9813-3507-47b6-9e86-582a9ad9ccb4 for instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 on n-h1-839401-11 Aug 29 15:55:26.762546 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-1ea53e2e-e3ec-4801-a8fb-bb20f78a2fb5 req-16bdf8b6-e6c2-43e2-8dc7-09a1261527e1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032500 Aug 29 15:55:26.763413 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3078/6356] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:55:26.856350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-59583f75-8535-498e-84b5-f21299d9eab3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:26.856962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-59583f75-8535-498e-84b5-f21299d9eab3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:26.863090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59583f75-8535-498e-84b5-f21299d9eab3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:26.863607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59583f75-8535-498e-84b5-f21299d9eab3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:26.864035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59583f75-8535-498e-84b5-f21299d9eab3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:26.864704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59583f75-8535-498e-84b5-f21299d9eab3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:26.865158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59583f75-8535-498e-84b5-f21299d9eab3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:26.865585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59583f75-8535-498e-84b5-f21299d9eab3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:26.997467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7f4317f9-a60c-47ff-91c4-82b9b4cd0b6c tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:26.998332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7f4317f9-a60c-47ff-91c4-82b9b4cd0b6c tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:27.010520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f4317f9-a60c-47ff-91c4-82b9b4cd0b6c tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:27.012082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f4317f9-a60c-47ff-91c4-82b9b4cd0b6c tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:27.013693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f4317f9-a60c-47ff-91c4-82b9b4cd0b6c tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:27.014955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f4317f9-a60c-47ff-91c4-82b9b4cd0b6c tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:27.016927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f4317f9-a60c-47ff-91c4-82b9b4cd0b6c tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:27.017412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f4317f9-a60c-47ff-91c4-82b9b4cd0b6c tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:27.024674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-59583f75-8535-498e-84b5-f21299d9eab3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:27.034224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-59583f75-8535-498e-84b5-f21299d9eab3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:27.035659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-59583f75-8535-498e-84b5-f21299d9eab3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:27.036956 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-59583f75-8535-498e-84b5-f21299d9eab3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.184654 Aug 29 15:55:27.037571 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3279/6357] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:26 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:27.061160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f4317f9-a60c-47ff-91c4-82b9b4cd0b6c tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:27.061868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f4317f9-a60c-47ff-91c4-82b9b4cd0b6c tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:27.062403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f4317f9-a60c-47ff-91c4-82b9b4cd0b6c tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:27.062992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-7f4317f9-a60c-47ff-91c4-82b9b4cd0b6c tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lazy-loading 'fault' on Instance uuid 8542672d-e865-4e0e-9626-562d3e0355b7 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:27.173027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7f4317f9-a60c-47ff-91c4-82b9b4cd0b6c tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:27.190643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7f4317f9-a60c-47ff-91c4-82b9b4cd0b6c tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:27.192131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7f4317f9-a60c-47ff-91c4-82b9b4cd0b6c tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fdca41cbe99548298464769a7609a5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b83740bf69449e6bed1916b2eebf0e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:27.193395 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7f4317f9-a60c-47ff-91c4-82b9b4cd0b6c tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 200 len: 1351 microversion: 2.26 time: 0.200396 Aug 29 15:55:27.193966 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3079/6358] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:26 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 1351 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:27.689508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-69e49fa9-99c5-41b0-a044-06f35c804ed7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:27.690155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-69e49fa9-99c5-41b0-a044-06f35c804ed7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:27.701107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69e49fa9-99c5-41b0-a044-06f35c804ed7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:27.709115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69e49fa9-99c5-41b0-a044-06f35c804ed7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:27.709689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69e49fa9-99c5-41b0-a044-06f35c804ed7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:27.710740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69e49fa9-99c5-41b0-a044-06f35c804ed7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:27.711227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69e49fa9-99c5-41b0-a044-06f35c804ed7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:27.712559 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69e49fa9-99c5-41b0-a044-06f35c804ed7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:27.969216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-69e49fa9-99c5-41b0-a044-06f35c804ed7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:27.978003 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-69e49fa9-99c5-41b0-a044-06f35c804ed7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1392 microversion: 2.1 time: 0.294450 Aug 29 15:55:27.978601 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3280/6359] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:27 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1392 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:28.072681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6516817a-fdb5-40ea-a0b6-5a0c05dfab90 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:28.073576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6516817a-fdb5-40ea-a0b6-5a0c05dfab90 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:28.093794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6516817a-fdb5-40ea-a0b6-5a0c05dfab90 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:28.094856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6516817a-fdb5-40ea-a0b6-5a0c05dfab90 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:28.095296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6516817a-fdb5-40ea-a0b6-5a0c05dfab90 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:28.096039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6516817a-fdb5-40ea-a0b6-5a0c05dfab90 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:28.096514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6516817a-fdb5-40ea-a0b6-5a0c05dfab90 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:28.096951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6516817a-fdb5-40ea-a0b6-5a0c05dfab90 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:28.216388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-01bcff78-2af8-4b40-86dc-cd22b6a31cf4 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:28.217149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-01bcff78-2af8-4b40-86dc-cd22b6a31cf4 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] [instance: 8542672d-e865-4e0e-9626-562d3e0355b7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:28.232444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01bcff78-2af8-4b40-86dc-cd22b6a31cf4 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:28.240348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01bcff78-2af8-4b40-86dc-cd22b6a31cf4 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:28.240816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01bcff78-2af8-4b40-86dc-cd22b6a31cf4 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:28.242652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01bcff78-2af8-4b40-86dc-cd22b6a31cf4 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:28.243064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01bcff78-2af8-4b40-86dc-cd22b6a31cf4 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:28.245984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01bcff78-2af8-4b40-86dc-cd22b6a31cf4 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:28.283556 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-01bcff78-2af8-4b40-86dc-cd22b6a31cf4 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] HTTP exception thrown: Instance 8542672d-e865-4e0e-9626-562d3e0355b7 could not be found. Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-01bcff78-2af8-4b40-86dc-cd22b6a31cf4 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Request method failure captured: Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 HTTP/1.1 Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOFLZXna-tr807Zc9lhxNE2QWep7m5Rk1N2k67rdC9M9Vk7FCohzfVReEPlrZs8qQ-rTXwk0b5Al5GN_Oa4C_p_TQBtrtdmedoJGUG2uQw1_mdNADaoeLWdDkdG5-wa-eP7HPH7zMfrxt65yxXNLXfgzj1Z1m5o3y3W-QOpfipVwv8Q Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-Openstack-Nova-Api-Version: 2.26 Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 9b83740bf69449e6bed1916b2eebf0e4 Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerTagsTestJSON-2145364252 Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9b83740bf69449e6bed1916b2eebf0e4", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9b83740bf69449e6bed1916b2eebf0e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9b83740bf69449e6bed1916b2eebf0e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9b83740bf69449e6bed1916b2eebf0e4"}]}] Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerTagsTestJSON-2145364252 Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 9b83740bf69449e6bed1916b2eebf0e4 Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerTagsTestJSON-2145364252 Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerTagsTestJSON-2145364252-project Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: fdca41cbe99548298464769a7609a5ff Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerTagsTestJSON-2145364252-project Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 8542672d-e865-4e0e-9626-562d3e0355b7 could not be found. Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '8542672d-e865-4e0e-9626-562d3e0355b7'} Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8542672d-e865-4e0e-9626-562d3e0355b7 could not be found. Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8542672d-e865-4e0e-9626-562d3e0355b7 could not be found. Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:28.285471 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:55:28.290410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:28.290410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:28.290410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:28.290410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:28.290410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:28.290410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8542672d-e865-4e0e-9626-562d3e0355b7 could not be found. Aug 29 15:55:28.290410 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:55:28.290410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-01bcff78-2af8-4b40-86dc-cd22b6a31cf4 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] Returning 404 to user: Instance 8542672d-e865-4e0e-9626-562d3e0355b7 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:28.294586 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-01bcff78-2af8-4b40-86dc-cd22b6a31cf4 tempest-ServerTagsTestJSON-2145364252 tempest-ServerTagsTestJSON-2145364252-project] 10.222.0.62 "GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7" status: 404 len: 111 microversion: 2.26 time: 0.078581 Aug 29 15:55:28.295720 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3281/6360] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:28 2022] GET /compute/v2.1/servers/8542672d-e865-4e0e-9626-562d3e0355b7 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:55:28.590382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6516817a-fdb5-40ea-a0b6-5a0c05dfab90 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:28.625705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6516817a-fdb5-40ea-a0b6-5a0c05dfab90 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:28.631063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6516817a-fdb5-40ea-a0b6-5a0c05dfab90 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:28.632522 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6516817a-fdb5-40ea-a0b6-5a0c05dfab90 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.572618 Aug 29 15:55:28.634197 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3080/6361] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:28 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:28.999896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4edb4312-c971-4820-b312-032385c665ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:29.000595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4edb4312-c971-4820-b312-032385c665ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:29.012850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4edb4312-c971-4820-b312-032385c665ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:29.015525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4edb4312-c971-4820-b312-032385c665ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:29.018037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4edb4312-c971-4820-b312-032385c665ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:29.018831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4edb4312-c971-4820-b312-032385c665ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:29.019313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4edb4312-c971-4820-b312-032385c665ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:29.019759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4edb4312-c971-4820-b312-032385c665ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:29.204130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4edb4312-c971-4820-b312-032385c665ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:29.212990 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4edb4312-c971-4820-b312-032385c665ad tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1392 microversion: 2.1 time: 0.216931 Aug 29 15:55:29.216659 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3282/6362] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:28 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1392 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:29.625236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-df77867f-cae1-498a-901f-859fb303952f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:29.625845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-df77867f-cae1-498a-901f-859fb303952f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:29.642747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df77867f-cae1-498a-901f-859fb303952f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:29.643248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df77867f-cae1-498a-901f-859fb303952f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:29.643720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df77867f-cae1-498a-901f-859fb303952f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:29.644424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df77867f-cae1-498a-901f-859fb303952f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:29.645374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df77867f-cae1-498a-901f-859fb303952f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:29.645960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df77867f-cae1-498a-901f-859fb303952f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:29.659917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6aadd116-81e3-4598-8620-b1d7a8737e4a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:29.661109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6aadd116-81e3-4598-8620-b1d7a8737e4a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:29.669733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6aadd116-81e3-4598-8620-b1d7a8737e4a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:29.671670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6aadd116-81e3-4598-8620-b1d7a8737e4a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:29.672383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6aadd116-81e3-4598-8620-b1d7a8737e4a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:29.673747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6aadd116-81e3-4598-8620-b1d7a8737e4a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:29.675305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6aadd116-81e3-4598-8620-b1d7a8737e4a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:29.676196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6aadd116-81e3-4598-8620-b1d7a8737e4a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:29.721924 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-df77867f-cae1-498a-901f-859fb303952f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/ips" status: 200 len: 148 microversion: 2.1 time: 0.100629 Aug 29 15:55:29.726842 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3081/6363] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:55:29 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/ips => generated 148 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:30.128171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6aadd116-81e3-4598-8620-b1d7a8737e4a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:30.149375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6aadd116-81e3-4598-8620-b1d7a8737e4a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:30.160066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6aadd116-81e3-4598-8620-b1d7a8737e4a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:30.169027 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6aadd116-81e3-4598-8620-b1d7a8737e4a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.511825 Aug 29 15:55:30.171154 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3283/6364] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:29 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:30.236058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-407a2ef6-c07d-4d46-8224-e816888ca083 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:30.236706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-407a2ef6-c07d-4d46-8224-e816888ca083 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:30.254098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-407a2ef6-c07d-4d46-8224-e816888ca083 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:30.255946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-407a2ef6-c07d-4d46-8224-e816888ca083 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:30.256411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-407a2ef6-c07d-4d46-8224-e816888ca083 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:30.260124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-407a2ef6-c07d-4d46-8224-e816888ca083 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:30.260604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-407a2ef6-c07d-4d46-8224-e816888ca083 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:30.261129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-407a2ef6-c07d-4d46-8224-e816888ca083 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:30.601931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-407a2ef6-c07d-4d46-8224-e816888ca083 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:30.612301 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-407a2ef6-c07d-4d46-8224-e816888ca083 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1392 microversion: 2.1 time: 0.380265 Aug 29 15:55:30.631313 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3082/6365] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:30 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1392 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:31.201126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-766cab84-1dfb-4327-869b-e874f72cfdcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:31.209370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-766cab84-1dfb-4327-869b-e874f72cfdcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:31.217623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:31.220297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-766cab84-1dfb-4327-869b-e874f72cfdcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:31.221150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-766cab84-1dfb-4327-869b-e874f72cfdcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:31.221743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-766cab84-1dfb-4327-869b-e874f72cfdcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:31.223440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-766cab84-1dfb-4327-869b-e874f72cfdcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:31.224107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-766cab84-1dfb-4327-869b-e874f72cfdcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:31.224840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-766cab84-1dfb-4327-869b-e874f72cfdcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:31.649863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a8cd1e01-6755-44ab-a39a-3ef5c5bb15eb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:31.650720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a8cd1e01-6755-44ab-a39a-3ef5c5bb15eb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:31.672186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:31.678961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:31.703197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8cd1e01-6755-44ab-a39a-3ef5c5bb15eb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:31.709834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8cd1e01-6755-44ab-a39a-3ef5c5bb15eb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:31.712348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8cd1e01-6755-44ab-a39a-3ef5c5bb15eb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:31.713540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8cd1e01-6755-44ab-a39a-3ef5c5bb15eb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:31.714203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8cd1e01-6755-44ab-a39a-3ef5c5bb15eb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:31.733826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8cd1e01-6755-44ab-a39a-3ef5c5bb15eb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:31.743336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:31.979569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-766cab84-1dfb-4327-869b-e874f72cfdcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:32.005478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-766cab84-1dfb-4327-869b-e874f72cfdcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:32.007702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-766cab84-1dfb-4327-869b-e874f72cfdcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:32.009445 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-766cab84-1dfb-4327-869b-e874f72cfdcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.817398 Aug 29 15:55:32.009986 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3284/6366] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:31 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:32.181025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a8cd1e01-6755-44ab-a39a-3ef5c5bb15eb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:32.190661 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a8cd1e01-6755-44ab-a39a-3ef5c5bb15eb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1392 microversion: 2.1 time: 0.560246 Aug 29 15:55:32.191329 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3083/6367] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:31 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1392 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:32.583526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f77ae824-88b6-4442-b1f2-fe508e3c072f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26299a10-e9b2-480b-8cc3-c28d6c863a63"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:32.587074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f77ae824-88b6-4442-b1f2-fe508e3c072f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:32.607058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f77ae824-88b6-4442-b1f2-fe508e3c072f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:32.607586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f77ae824-88b6-4442-b1f2-fe508e3c072f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:32.609740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f77ae824-88b6-4442-b1f2-fe508e3c072f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:32.612969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f77ae824-88b6-4442-b1f2-fe508e3c072f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:32.613704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f77ae824-88b6-4442-b1f2-fe508e3c072f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:32.614155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f77ae824-88b6-4442-b1f2-fe508e3c072f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:33.035257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cf52c468-2390-42e3-9759-159ebc88660a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:33.036531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cf52c468-2390-42e3-9759-159ebc88660a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:33.059781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf52c468-2390-42e3-9759-159ebc88660a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:33.060667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf52c468-2390-42e3-9759-159ebc88660a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:33.062300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf52c468-2390-42e3-9759-159ebc88660a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:33.064665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf52c468-2390-42e3-9759-159ebc88660a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:33.066489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf52c468-2390-42e3-9759-159ebc88660a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:33.070626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf52c468-2390-42e3-9759-159ebc88660a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:33.227276 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f77ae824-88b6-4442-b1f2-fe508e3c072f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "POST /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.648108 Aug 29 15:55:33.237597 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3285/6368] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 15:55:32 2022] POST /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments => generated 194 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:33.245751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0f49b9a0-5220-4df4-858c-601ec6841249 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:33.248122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0f49b9a0-5220-4df4-858c-601ec6841249 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:33.267040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f49b9a0-5220-4df4-858c-601ec6841249 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:33.269621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f49b9a0-5220-4df4-858c-601ec6841249 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:33.270139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f49b9a0-5220-4df4-858c-601ec6841249 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:33.270908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f49b9a0-5220-4df4-858c-601ec6841249 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:33.275850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f49b9a0-5220-4df4-858c-601ec6841249 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:33.276324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0f49b9a0-5220-4df4-858c-601ec6841249 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:33.310791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:33.490473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cf52c468-2390-42e3-9759-159ebc88660a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:33.503995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cf52c468-2390-42e3-9759-159ebc88660a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:33.512454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cf52c468-2390-42e3-9759-159ebc88660a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:33.520528 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cf52c468-2390-42e3-9759-159ebc88660a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.488882 Aug 29 15:55:33.525213 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3084/6369] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:33 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:33.953535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0f49b9a0-5220-4df4-858c-601ec6841249 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:33.972341 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0f49b9a0-5220-4df4-858c-601ec6841249 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1392 microversion: 2.1 time: 0.729635 Aug 29 15:55:33.981264 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3286/6370] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:33 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1392 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:34.554169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d29a8ab5-2c42-41d4-84c5-75451507bd07 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:34.555475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d29a8ab5-2c42-41d4-84c5-75451507bd07 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:34.593347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d29a8ab5-2c42-41d4-84c5-75451507bd07 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:34.593920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d29a8ab5-2c42-41d4-84c5-75451507bd07 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:34.595735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d29a8ab5-2c42-41d4-84c5-75451507bd07 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:34.599564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d29a8ab5-2c42-41d4-84c5-75451507bd07 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:34.600138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d29a8ab5-2c42-41d4-84c5-75451507bd07 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:34.600649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d29a8ab5-2c42-41d4-84c5-75451507bd07 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:35.009130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-14559a06-8ab8-426f-85ea-4d41d1b2a8e1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:35.009793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-14559a06-8ab8-426f-85ea-4d41d1b2a8e1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:35.034303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14559a06-8ab8-426f-85ea-4d41d1b2a8e1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:35.035785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14559a06-8ab8-426f-85ea-4d41d1b2a8e1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:35.036749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14559a06-8ab8-426f-85ea-4d41d1b2a8e1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:35.040331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14559a06-8ab8-426f-85ea-4d41d1b2a8e1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:35.041025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14559a06-8ab8-426f-85ea-4d41d1b2a8e1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:35.041654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14559a06-8ab8-426f-85ea-4d41d1b2a8e1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:35.275879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d29a8ab5-2c42-41d4-84c5-75451507bd07 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:35.292084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d29a8ab5-2c42-41d4-84c5-75451507bd07 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:35.298333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d29a8ab5-2c42-41d4-84c5-75451507bd07 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:35.300841 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d29a8ab5-2c42-41d4-84c5-75451507bd07 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.751620 Aug 29 15:55:35.302102 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3085/6371] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:34 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:35.472625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-14559a06-8ab8-426f-85ea-4d41d1b2a8e1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:35.489686 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-14559a06-8ab8-426f-85ea-4d41d1b2a8e1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1392 microversion: 2.1 time: 0.489592 Aug 29 15:55:35.490752 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3287/6372] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:34 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1392 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:36.176919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-8d737266-617f-43b4-bf29-3de36e264150 req-58c79b82-3512-4a65-a31e-2ceda871fb2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972f2acd-0b31-43ab-93a8-9a2a41be43e1", "name": "network-vif-plugged", "status": "completed", "tag": "24ac9813-3507-47b6-9e86-582a9ad9ccb4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:36.200161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8d737266-617f-43b4-bf29-3de36e264150 req-58c79b82-3512-4a65-a31e-2ceda871fb2d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:36.200772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8d737266-617f-43b4-bf29-3de36e264150 req-58c79b82-3512-4a65-a31e-2ceda871fb2d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:36.202449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8d737266-617f-43b4-bf29-3de36e264150 req-58c79b82-3512-4a65-a31e-2ceda871fb2d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:36.227620 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-8d737266-617f-43b4-bf29-3de36e264150 req-58c79b82-3512-4a65-a31e-2ceda871fb2d service nova] Creating event network-vif-plugged:24ac9813-3507-47b6-9e86-582a9ad9ccb4 for instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 on n-h1-839401-11 Aug 29 15:55:36.247897 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-8d737266-617f-43b4-bf29-3de36e264150 req-58c79b82-3512-4a65-a31e-2ceda871fb2d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.398790 Aug 29 15:55:36.249826 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3086/6373] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:36.324548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a253d632-e248-44f2-bfda-310a183a013a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:36.329025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a253d632-e248-44f2-bfda-310a183a013a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:36.356911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a253d632-e248-44f2-bfda-310a183a013a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:36.361682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a253d632-e248-44f2-bfda-310a183a013a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:36.362293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a253d632-e248-44f2-bfda-310a183a013a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:36.363162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a253d632-e248-44f2-bfda-310a183a013a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:36.370883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a253d632-e248-44f2-bfda-310a183a013a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:36.371665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a253d632-e248-44f2-bfda-310a183a013a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:36.517932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1c06ba32-0290-4727-911d-d9d9d6b732e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:36.519044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1c06ba32-0290-4727-911d-d9d9d6b732e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:36.542599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c06ba32-0290-4727-911d-d9d9d6b732e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:36.546620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c06ba32-0290-4727-911d-d9d9d6b732e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:36.549693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c06ba32-0290-4727-911d-d9d9d6b732e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:36.552972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c06ba32-0290-4727-911d-d9d9d6b732e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:36.556143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c06ba32-0290-4727-911d-d9d9d6b732e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:36.557621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c06ba32-0290-4727-911d-d9d9d6b732e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:37.018735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1c06ba32-0290-4727-911d-d9d9d6b732e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:37.027500 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1c06ba32-0290-4727-911d-d9d9d6b732e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1392 microversion: 2.1 time: 0.514424 Aug 29 15:55:37.032125 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3087/6374] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:36 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1392 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:37.061992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a253d632-e248-44f2-bfda-310a183a013a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:37.079069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a253d632-e248-44f2-bfda-310a183a013a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:37.080811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a253d632-e248-44f2-bfda-310a183a013a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:37.083977 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a253d632-e248-44f2-bfda-310a183a013a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.763497 Aug 29 15:55:37.102208 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3288/6375] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:36 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:38.055646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b3f6d0fd-138b-4a19-ab11-e80b4ca5099b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:38.056621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b3f6d0fd-138b-4a19-ab11-e80b4ca5099b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:38.067285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3f6d0fd-138b-4a19-ab11-e80b4ca5099b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:38.067716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3f6d0fd-138b-4a19-ab11-e80b4ca5099b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:38.071240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3f6d0fd-138b-4a19-ab11-e80b4ca5099b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:38.073403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3f6d0fd-138b-4a19-ab11-e80b4ca5099b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:38.074815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3f6d0fd-138b-4a19-ab11-e80b4ca5099b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:38.076285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3f6d0fd-138b-4a19-ab11-e80b4ca5099b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:38.117713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bb25537b-d150-47eb-aba2-4a8416df4955 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:38.118839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bb25537b-d150-47eb-aba2-4a8416df4955 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:38.129853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb25537b-d150-47eb-aba2-4a8416df4955 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:38.136480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb25537b-d150-47eb-aba2-4a8416df4955 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:38.136948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb25537b-d150-47eb-aba2-4a8416df4955 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:38.143097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb25537b-d150-47eb-aba2-4a8416df4955 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:38.143648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb25537b-d150-47eb-aba2-4a8416df4955 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:38.144100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb25537b-d150-47eb-aba2-4a8416df4955 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:38.516950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b3f6d0fd-138b-4a19-ab11-e80b4ca5099b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:38.535099 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b3f6d0fd-138b-4a19-ab11-e80b4ca5099b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1392 microversion: 2.1 time: 0.483884 Aug 29 15:55:38.541734 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3088/6376] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:38 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1392 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:38.560668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bb25537b-d150-47eb-aba2-4a8416df4955 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:38.571993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-9b23c816-be07-4d90-827d-e47c46f15da6 req-60e1df69-5e46-44fb-b1f1-146314db5983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fba35d0-e4ed-4088-a1d1-ccabdd81c178", "name": "network-vif-plugged", "status": "completed", "tag": "db244ebb-da5f-469b-ae27-7da59496c697"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:38.577678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bb25537b-d150-47eb-aba2-4a8416df4955 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:38.579560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bb25537b-d150-47eb-aba2-4a8416df4955 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:38.580958 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bb25537b-d150-47eb-aba2-4a8416df4955 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.468658 Aug 29 15:55:38.593163 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3289/6377] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:38 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:38.593620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9b23c816-be07-4d90-827d-e47c46f15da6 req-60e1df69-5e46-44fb-b1f1-146314db5983 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:38.593620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9b23c816-be07-4d90-827d-e47c46f15da6 req-60e1df69-5e46-44fb-b1f1-146314db5983 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:38.593620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9b23c816-be07-4d90-827d-e47c46f15da6 req-60e1df69-5e46-44fb-b1f1-146314db5983 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:38.603531 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-9b23c816-be07-4d90-827d-e47c46f15da6 req-60e1df69-5e46-44fb-b1f1-146314db5983 service nova] Creating event network-vif-plugged:db244ebb-da5f-469b-ae27-7da59496c697 for instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 on n-h2-839401-11 Aug 29 15:55:38.612822 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-9b23c816-be07-4d90-827d-e47c46f15da6 req-60e1df69-5e46-44fb-b1f1-146314db5983 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069293 Aug 29 15:55:38.616858 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3089/6378] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:39.564411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4f3824e4-aec1-42bd-af5c-9d43fe96a2e8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:39.565655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4f3824e4-aec1-42bd-af5c-9d43fe96a2e8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:39.579745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f3824e4-aec1-42bd-af5c-9d43fe96a2e8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:39.580501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f3824e4-aec1-42bd-af5c-9d43fe96a2e8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:39.581321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f3824e4-aec1-42bd-af5c-9d43fe96a2e8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:39.583677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f3824e4-aec1-42bd-af5c-9d43fe96a2e8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:39.585772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f3824e4-aec1-42bd-af5c-9d43fe96a2e8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:39.586463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4f3824e4-aec1-42bd-af5c-9d43fe96a2e8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:39.612352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-32089a79-8b84-464e-b929-36972d74aff9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:39.613678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-32089a79-8b84-464e-b929-36972d74aff9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:39.631919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32089a79-8b84-464e-b929-36972d74aff9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:39.633000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32089a79-8b84-464e-b929-36972d74aff9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:39.634114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32089a79-8b84-464e-b929-36972d74aff9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:39.635317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32089a79-8b84-464e-b929-36972d74aff9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:39.636489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32089a79-8b84-464e-b929-36972d74aff9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:39.637241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32089a79-8b84-464e-b929-36972d74aff9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:40.032411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-32089a79-8b84-464e-b929-36972d74aff9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:40.058732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-32089a79-8b84-464e-b929-36972d74aff9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:40.064815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-32089a79-8b84-464e-b929-36972d74aff9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:40.068434 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-32089a79-8b84-464e-b929-36972d74aff9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.462204 Aug 29 15:55:40.085449 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3090/6379] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:39 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:40.553458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4f3824e4-aec1-42bd-af5c-9d43fe96a2e8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:40.567819 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4f3824e4-aec1-42bd-af5c-9d43fe96a2e8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1564 microversion: 2.1 time: 1.007648 Aug 29 15:55:40.573606 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3290/6380] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:39 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1564 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:40.596343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a0be4c56-882d-4e26-b402-bd033ff67910 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:40.597243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a0be4c56-882d-4e26-b402-bd033ff67910 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:40.615257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0be4c56-882d-4e26-b402-bd033ff67910 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:40.621324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0be4c56-882d-4e26-b402-bd033ff67910 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:40.623341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0be4c56-882d-4e26-b402-bd033ff67910 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:40.624105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0be4c56-882d-4e26-b402-bd033ff67910 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:40.628815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0be4c56-882d-4e26-b402-bd033ff67910 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:40.630676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0be4c56-882d-4e26-b402-bd033ff67910 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:40.938151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a0be4c56-882d-4e26-b402-bd033ff67910 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:40.964795 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a0be4c56-882d-4e26-b402-bd033ff67910 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1564 microversion: 2.1 time: 0.373837 Aug 29 15:55:40.965775 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3091/6381] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:40 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1564 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:41.101664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e032cd34-0a14-4b1b-b01d-94f3cb696bfd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:41.102783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e032cd34-0a14-4b1b-b01d-94f3cb696bfd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:41.116633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e032cd34-0a14-4b1b-b01d-94f3cb696bfd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:41.118635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e032cd34-0a14-4b1b-b01d-94f3cb696bfd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:41.119301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e032cd34-0a14-4b1b-b01d-94f3cb696bfd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:41.120833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e032cd34-0a14-4b1b-b01d-94f3cb696bfd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:41.123851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e032cd34-0a14-4b1b-b01d-94f3cb696bfd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:41.124577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e032cd34-0a14-4b1b-b01d-94f3cb696bfd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:41.500176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e032cd34-0a14-4b1b-b01d-94f3cb696bfd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:41.526003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e032cd34-0a14-4b1b-b01d-94f3cb696bfd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:41.535220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e032cd34-0a14-4b1b-b01d-94f3cb696bfd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:41.537232 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e032cd34-0a14-4b1b-b01d-94f3cb696bfd tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1806 microversion: 2.20 time: 0.443719 Aug 29 15:55:41.557729 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3291/6382] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:41 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1806 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:42.563212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb6fcd3d-37f0-4f67-8764-473d7c56cef9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:42.564567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bb6fcd3d-37f0-4f67-8764-473d7c56cef9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:42.575936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb6fcd3d-37f0-4f67-8764-473d7c56cef9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:42.577801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb6fcd3d-37f0-4f67-8764-473d7c56cef9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:42.589769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb6fcd3d-37f0-4f67-8764-473d7c56cef9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:42.590879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb6fcd3d-37f0-4f67-8764-473d7c56cef9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:42.591514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb6fcd3d-37f0-4f67-8764-473d7c56cef9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:42.592202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb6fcd3d-37f0-4f67-8764-473d7c56cef9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:42.597753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2de45140-5f2e-4180-a302-87602244610d tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] Calling method '.version_select at 0x7fc42a702700>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:42.674405 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2de45140-5f2e-4180-a302-87602244610d tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/bb89d4ad-a082-447e-a8c0-5fd67099bc76" status: 200 len: 351 microversion: 2.1 time: 0.080598 Aug 29 15:55:42.675339 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3292/6383] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:55:42 2022] GET /compute/v2.1/os-volumes/bb89d4ad-a082-447e-a8c0-5fd67099bc76 => generated 351 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:42.813604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bb6fcd3d-37f0-4f67-8764-473d7c56cef9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:42.827784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bb6fcd3d-37f0-4f67-8764-473d7c56cef9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:42.830019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bb6fcd3d-37f0-4f67-8764-473d7c56cef9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:42.831673 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bb6fcd3d-37f0-4f67-8764-473d7c56cef9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1793 microversion: 2.20 time: 0.273148 Aug 29 15:55:42.837103 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3092/6384] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:42 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1793 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:44.295687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-049d8eed-35d1-475f-883f-ebff688fab0a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:44.297110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-049d8eed-35d1-475f-883f-ebff688fab0a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:44.297913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-2aeec47d-36ac-4484-a462-e1183c915056 req-bf474935-3d11-4db7-947c-fdfcc9a04061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972f2acd-0b31-43ab-93a8-9a2a41be43e1", "tag": "24ac9813-3507-47b6-9e86-582a9ad9ccb4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:44.310466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2aeec47d-36ac-4484-a462-e1183c915056 req-bf474935-3d11-4db7-947c-fdfcc9a04061 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:44.311180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2aeec47d-36ac-4484-a462-e1183c915056 req-bf474935-3d11-4db7-947c-fdfcc9a04061 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:44.311770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2aeec47d-36ac-4484-a462-e1183c915056 req-bf474935-3d11-4db7-947c-fdfcc9a04061 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:44.319738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-049d8eed-35d1-475f-883f-ebff688fab0a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:44.325284 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-2aeec47d-36ac-4484-a462-e1183c915056 req-bf474935-3d11-4db7-947c-fdfcc9a04061 service nova] Creating event network-changed:24ac9813-3507-47b6-9e86-582a9ad9ccb4 for instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 on n-h1-839401-11 Aug 29 15:55:44.326261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-049d8eed-35d1-475f-883f-ebff688fab0a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:44.329484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-049d8eed-35d1-475f-883f-ebff688fab0a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:44.334163 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-2aeec47d-36ac-4484-a462-e1183c915056 req-bf474935-3d11-4db7-947c-fdfcc9a04061 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039787 Aug 29 15:55:44.336639 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3093/6385] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:44.337721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-049d8eed-35d1-475f-883f-ebff688fab0a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:44.338343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-049d8eed-35d1-475f-883f-ebff688fab0a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:44.342598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-049d8eed-35d1-475f-883f-ebff688fab0a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:44.663766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-049d8eed-35d1-475f-883f-ebff688fab0a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:44.687069 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-049d8eed-35d1-475f-883f-ebff688fab0a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1564 microversion: 2.1 time: 0.395473 Aug 29 15:55:44.706616 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3293/6386] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:44 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1564 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:45.551002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5062e52c-1b4b-4c43-ac91-c249971d92bd tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] Calling method '.version_select at 0x7fc42a953700>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:45.637996 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5062e52c-1b4b-4c43-ac91-c249971d92bd tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/bf662c38-b665-4a5c-9d89-3f64a83228fb" status: 200 len: 350 microversion: 2.1 time: 0.092750 Aug 29 15:55:45.638600 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3094/6387] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:55:45 2022] GET /compute/v2.1/os-volumes/bf662c38-b665-4a5c-9d89-3f64a83228fb => generated 350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:48.292300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-54ed9671-9502-4fc0-aa69-28acf876f8dc tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] Calling method '.version_select at 0x7fc42a6d5670>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:48.394612 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-54ed9671-9502-4fc0-aa69-28acf876f8dc tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/19741c08-b6f8-4feb-99eb-5f69587005c2" status: 200 len: 351 microversion: 2.1 time: 0.107090 Aug 29 15:55:48.402640 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3294/6388] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:55:48 2022] GET /compute/v2.1/os-volumes/19741c08-b6f8-4feb-99eb-5f69587005c2 => generated 351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:48.410827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0a33c84c-a7a5-492c-a5c7-6a3a2e963d3d tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] Calling method '.version_select at 0x7fc42bac2c10>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:48.560170 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0a33c84c-a7a5-492c-a5c7-6a3a2e963d3d tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.156071 Aug 29 15:55:48.561117 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3095/6389] 10.222.0.62 () {58 vars in 1134 bytes} [Mon Aug 29 15:55:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:48.578169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ea78f00e-207c-4ace-9f68-d0a1a100f705 tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] Calling method '.version_select at 0x7fc42ac76af0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:48.693687 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ea78f00e-207c-4ace-9f68-d0a1a100f705 tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.122318 Aug 29 15:55:48.694269 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3295/6390] 10.222.0.62 () {58 vars in 1149 bytes} [Mon Aug 29 15:55:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:48.708488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c853da0e-3006-4670-ae9d-84c9702c3fb9 tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] Calling method '.version_select at 0x7fc42b6dac10>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:48.823573 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c853da0e-3006-4670-ae9d-84c9702c3fb9 tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.119690 Aug 29 15:55:48.824688 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3096/6391] 10.222.0.62 () {58 vars in 1134 bytes} [Mon Aug 29 15:55:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:48.837934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-113797fa-ddf3-47e2-905d-628406eecf13 tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] Calling method '.version_select at 0x7fc42a8e6790>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:49.015337 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-113797fa-ddf3-47e2-905d-628406eecf13 tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.181653 Aug 29 15:55:49.016337 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3296/6392] 10.222.0.62 () {58 vars in 1167 bytes} [Mon Aug 29 15:55:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:49.030508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-89757648-616d-4389-9c2d-88ee55950257 tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] Calling method '.version_select at 0x7fc42badb940>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:49.158453 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-89757648-616d-4389-9c2d-88ee55950257 tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.132534 Aug 29 15:55:49.159730 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3097/6393] 10.222.0.62 () {58 vars in 1170 bytes} [Mon Aug 29 15:55:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:49.175994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-449fc68c-aeb3-421b-bb4b-3b26155421e9 tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] Calling method '.version_select at 0x7fc42ad03b80>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:49.304682 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-449fc68c-aeb3-421b-bb4b-3b26155421e9 tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.132736 Aug 29 15:55:49.313668 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3297/6394] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 15:55:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:49.325685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3b1583ae-888c-42c1-9904-fa9358021d28 tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] Calling method '.version_select at 0x7fc433a4bdc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:49.480709 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3b1583ae-888c-42c1-9904-fa9358021d28 tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.164457 Aug 29 15:55:49.482816 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3098/6395] 10.222.0.62 () {58 vars in 1188 bytes} [Mon Aug 29 15:55:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:49.515703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3664dead-7fa2-44d4-906b-56effddab4cc tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] Calling method '.version_select at 0x7fc42ada8310>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:49.627630 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3664dead-7fa2-44d4-906b-56effddab4cc tempest-VolumesTestJSON-412365212 tempest-VolumesTestJSON-412365212-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.133774 Aug 29 15:55:49.637636 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3298/6396] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 15:55:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:50.743667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b4f3baec-75bc-440c-96b4-15604427e773 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:50.744331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b4f3baec-75bc-440c-96b4-15604427e773 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:50.752826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4f3baec-75bc-440c-96b4-15604427e773 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:50.753364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4f3baec-75bc-440c-96b4-15604427e773 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:50.753812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4f3baec-75bc-440c-96b4-15604427e773 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:50.754537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4f3baec-75bc-440c-96b4-15604427e773 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:50.755004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4f3baec-75bc-440c-96b4-15604427e773 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:50.755728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b4f3baec-75bc-440c-96b4-15604427e773 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:50.871723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-b4f3baec-75bc-440c-96b4-15604427e773 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lazy-loading 'services' on Instance uuid c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:51.051953 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b4f3baec-75bc-440c-96b4-15604427e773 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments/26299a10-e9b2-480b-8cc3-c28d6c863a63" status: 202 len: 0 microversion: 2.1 time: 0.310662 Aug 29 15:55:51.052916 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3099/6397] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 15:55:50 2022] DELETE /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments/26299a10-e9b2-480b-8cc3-c28d6c863a63 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:55:51.066802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-50f26d34-8985-4593-9c1f-fee7402c6b0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:51.074745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-50f26d34-8985-4593-9c1f-fee7402c6b0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:51.083706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:51.086657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50f26d34-8985-4593-9c1f-fee7402c6b0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:51.087254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50f26d34-8985-4593-9c1f-fee7402c6b0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:51.087762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50f26d34-8985-4593-9c1f-fee7402c6b0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:51.107028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50f26d34-8985-4593-9c1f-fee7402c6b0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:51.110324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50f26d34-8985-4593-9c1f-fee7402c6b0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:51.113312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50f26d34-8985-4593-9c1f-fee7402c6b0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:51.213137 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-50f26d34-8985-4593-9c1f-fee7402c6b0f tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154921 Aug 29 15:55:51.215157 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3299/6398] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:55:51 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:55:52.231474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7b75feb9-dcc1-4378-ae8c-e8b883b89599 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:52.236047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7b75feb9-dcc1-4378-ae8c-e8b883b89599 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:52.243407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=48 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:52.245798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b75feb9-dcc1-4378-ae8c-e8b883b89599 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:52.246795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b75feb9-dcc1-4378-ae8c-e8b883b89599 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:52.247502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b75feb9-dcc1-4378-ae8c-e8b883b89599 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:52.248642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b75feb9-dcc1-4378-ae8c-e8b883b89599 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:52.249369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b75feb9-dcc1-4378-ae8c-e8b883b89599 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:52.250451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b75feb9-dcc1-4378-ae8c-e8b883b89599 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:52.308467 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7b75feb9-dcc1-4378-ae8c-e8b883b89599 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084026 Aug 29 15:55:52.313470 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3100/6399] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:55:52 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:53.322532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98609fbd-d6f3-40fe-99ff-3528abd431b7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:53.324966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-98609fbd-d6f3-40fe-99ff-3528abd431b7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:53.344565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98609fbd-d6f3-40fe-99ff-3528abd431b7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:53.347019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98609fbd-d6f3-40fe-99ff-3528abd431b7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:53.347674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98609fbd-d6f3-40fe-99ff-3528abd431b7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:53.348578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98609fbd-d6f3-40fe-99ff-3528abd431b7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:53.350668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98609fbd-d6f3-40fe-99ff-3528abd431b7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:53.351279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98609fbd-d6f3-40fe-99ff-3528abd431b7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:53.437249 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-98609fbd-d6f3-40fe-99ff-3528abd431b7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119655 Aug 29 15:55:53.440964 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3300/6400] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:55:53 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:54.451861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-97793fe9-5a4c-482b-bebb-78708fd0247e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:54.455255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-97793fe9-5a4c-482b-bebb-78708fd0247e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:54.477997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97793fe9-5a4c-482b-bebb-78708fd0247e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:54.482462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97793fe9-5a4c-482b-bebb-78708fd0247e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:54.483177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97793fe9-5a4c-482b-bebb-78708fd0247e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:54.485190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97793fe9-5a4c-482b-bebb-78708fd0247e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:54.487211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97793fe9-5a4c-482b-bebb-78708fd0247e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:54.488898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97793fe9-5a4c-482b-bebb-78708fd0247e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:54.553502 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-97793fe9-5a4c-482b-bebb-78708fd0247e tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106049 Aug 29 15:55:54.556703 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3101/6401] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:55:54 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:55.572332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8167a043-1ead-48ec-9a11-de36a8efa6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:55.575381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8167a043-1ead-48ec-9a11-de36a8efa6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:55.590340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8167a043-1ead-48ec-9a11-de36a8efa6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:55.592186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8167a043-1ead-48ec-9a11-de36a8efa6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:55.595926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8167a043-1ead-48ec-9a11-de36a8efa6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:55.596918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8167a043-1ead-48ec-9a11-de36a8efa6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:55.598386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8167a043-1ead-48ec-9a11-de36a8efa6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:55.599033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8167a043-1ead-48ec-9a11-de36a8efa6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:55.670995 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8167a043-1ead-48ec-9a11-de36a8efa6db tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106071 Aug 29 15:55:55.672873 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3301/6402] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:55:55 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:56.685412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ed878b0b-e762-4438-b0b7-35fd423ff905 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:56.687878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ed878b0b-e762-4438-b0b7-35fd423ff905 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:56.701004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed878b0b-e762-4438-b0b7-35fd423ff905 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:56.703969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed878b0b-e762-4438-b0b7-35fd423ff905 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:56.704422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed878b0b-e762-4438-b0b7-35fd423ff905 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:56.706027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed878b0b-e762-4438-b0b7-35fd423ff905 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:56.708714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed878b0b-e762-4438-b0b7-35fd423ff905 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:56.709488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed878b0b-e762-4438-b0b7-35fd423ff905 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:56.799359 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ed878b0b-e762-4438-b0b7-35fd423ff905 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118185 Aug 29 15:55:56.800291 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3102/6403] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:55:56 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:55:57.815628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-21875359-0978-4edb-9cc4-4e2b76b76e22 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:57.819335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-21875359-0978-4edb-9cc4-4e2b76b76e22 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:57.856063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21875359-0978-4edb-9cc4-4e2b76b76e22 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:57.858321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21875359-0978-4edb-9cc4-4e2b76b76e22 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:57.859659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21875359-0978-4edb-9cc4-4e2b76b76e22 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:57.865751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21875359-0978-4edb-9cc4-4e2b76b76e22 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:57.866465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21875359-0978-4edb-9cc4-4e2b76b76e22 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:57.868355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21875359-0978-4edb-9cc4-4e2b76b76e22 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:57.971904 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-21875359-0978-4edb-9cc4-4e2b76b76e22 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163230 Aug 29 15:55:57.973726 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3302/6404] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:55:57 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:58.984045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cd691d74-81c3-4e7e-9d0d-588d8523ec2d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:58.986600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cd691d74-81c3-4e7e-9d0d-588d8523ec2d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:59.003840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd691d74-81c3-4e7e-9d0d-588d8523ec2d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:59.004187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd691d74-81c3-4e7e-9d0d-588d8523ec2d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:59.004627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd691d74-81c3-4e7e-9d0d-588d8523ec2d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:59.005365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd691d74-81c3-4e7e-9d0d-588d8523ec2d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:59.005819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd691d74-81c3-4e7e-9d0d-588d8523ec2d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:59.006438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd691d74-81c3-4e7e-9d0d-588d8523ec2d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:59.065483 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cd691d74-81c3-4e7e-9d0d-588d8523ec2d tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085336 Aug 29 15:55:59.076541 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3103/6405] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 15:55:58 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:55:59.200341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-44b70c21-85dd-4558-b966-6945c8136fdf tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:59.200851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-44b70c21-85dd-4558-b966-6945c8136fdf tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:59.217290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44b70c21-85dd-4558-b966-6945c8136fdf tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:59.217290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44b70c21-85dd-4558-b966-6945c8136fdf tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:59.217290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44b70c21-85dd-4558-b966-6945c8136fdf tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:59.217579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44b70c21-85dd-4558-b966-6945c8136fdf tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:59.218000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44b70c21-85dd-4558-b966-6945c8136fdf tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:59.218426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44b70c21-85dd-4558-b966-6945c8136fdf tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:59.248270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-44b70c21-85dd-4558-b966-6945c8136fdf tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:55:59.415641 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-44b70c21-85dd-4558-b966-6945c8136fdf tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 204 len: 0 microversion: 2.1 time: 0.215881 Aug 29 15:55:59.420229 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3303/6406] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:55:59 2022] DELETE /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:55:59.426303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1b3ab0b4-51ac-422f-adc3-15ac0ec6d956 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:59.427236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1b3ab0b4-51ac-422f-adc3-15ac0ec6d956 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:59.437973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b3ab0b4-51ac-422f-adc3-15ac0ec6d956 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:59.438462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b3ab0b4-51ac-422f-adc3-15ac0ec6d956 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:59.438934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b3ab0b4-51ac-422f-adc3-15ac0ec6d956 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:59.443405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b3ab0b4-51ac-422f-adc3-15ac0ec6d956 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:59.445337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b3ab0b4-51ac-422f-adc3-15ac0ec6d956 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:59.445787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b3ab0b4-51ac-422f-adc3-15ac0ec6d956 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:59.736034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1b3ab0b4-51ac-422f-adc3-15ac0ec6d956 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:59.745105 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1b3ab0b4-51ac-422f-adc3-15ac0ec6d956 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 200 len: 1681 microversion: 2.1 time: 0.323843 Aug 29 15:55:59.745704 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3104/6407] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:59 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 1681 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:00.777840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7f4f25c3-d6b0-41db-819e-5563d08838d7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:00.778718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7f4f25c3-d6b0-41db-819e-5563d08838d7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:00.794072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f4f25c3-d6b0-41db-819e-5563d08838d7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:00.794916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f4f25c3-d6b0-41db-819e-5563d08838d7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:00.797178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f4f25c3-d6b0-41db-819e-5563d08838d7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:00.813874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f4f25c3-d6b0-41db-819e-5563d08838d7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:00.816161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f4f25c3-d6b0-41db-819e-5563d08838d7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:00.819346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f4f25c3-d6b0-41db-819e-5563d08838d7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:01.117687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7f4f25c3-d6b0-41db-819e-5563d08838d7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:01.127634 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7f4f25c3-d6b0-41db-819e-5563d08838d7 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 200 len: 1681 microversion: 2.1 time: 0.358495 Aug 29 15:56:01.130829 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3304/6408] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:00 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 1681 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:02.153963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-132b0119-d635-4661-b1c3-9eb849635fc1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:02.154646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-132b0119-d635-4661-b1c3-9eb849635fc1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:02.165968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-132b0119-d635-4661-b1c3-9eb849635fc1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:02.172320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-132b0119-d635-4661-b1c3-9eb849635fc1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:02.173217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-132b0119-d635-4661-b1c3-9eb849635fc1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:02.174006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-132b0119-d635-4661-b1c3-9eb849635fc1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:02.174482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-132b0119-d635-4661-b1c3-9eb849635fc1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:02.175137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-132b0119-d635-4661-b1c3-9eb849635fc1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:02.189315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:02.306576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-132b0119-d635-4661-b1c3-9eb849635fc1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:02.315669 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-132b0119-d635-4661-b1c3-9eb849635fc1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 200 len: 1613 microversion: 2.1 time: 0.167721 Aug 29 15:56:02.317169 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3105/6409] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:02 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 1613 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:03.071936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-602e4237-5a62-4b7b-8699-7fcb9c8a9654 req-53eb571a-936b-433b-a13b-ee8df43119df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ed120d-ed09-4cb8-9dba-c1de224fd6b4", "name": "network-vif-deleted", "tag": "e79ba180-15ea-4a42-a607-eacc9ae907e9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:03.098737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-602e4237-5a62-4b7b-8699-7fcb9c8a9654 req-53eb571a-936b-433b-a13b-ee8df43119df service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:03.100201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-602e4237-5a62-4b7b-8699-7fcb9c8a9654 req-53eb571a-936b-433b-a13b-ee8df43119df service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:03.100898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-602e4237-5a62-4b7b-8699-7fcb9c8a9654 req-53eb571a-936b-433b-a13b-ee8df43119df service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:03.118916 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-602e4237-5a62-4b7b-8699-7fcb9c8a9654 req-53eb571a-936b-433b-a13b-ee8df43119df service nova] Creating event network-vif-deleted:e79ba180-15ea-4a42-a607-eacc9ae907e9 for instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 on n-h1-839401-11 Aug 29 15:56:03.126462 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-602e4237-5a62-4b7b-8699-7fcb9c8a9654 req-53eb571a-936b-433b-a13b-ee8df43119df service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.456662 Aug 29 15:56:03.128767 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3305/6410] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:56:03.338645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2ee65758-2406-4f99-9263-9376396775e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:03.339307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2ee65758-2406-4f99-9263-9376396775e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:03.354539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ee65758-2406-4f99-9263-9376396775e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:03.354751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ee65758-2406-4f99-9263-9376396775e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:03.355075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ee65758-2406-4f99-9263-9376396775e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:03.358772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ee65758-2406-4f99-9263-9376396775e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:03.359293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ee65758-2406-4f99-9263-9376396775e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:03.359779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ee65758-2406-4f99-9263-9376396775e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:03.459319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ee65758-2406-4f99-9263-9376396775e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:03.460081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ee65758-2406-4f99-9263-9376396775e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:03.461309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ee65758-2406-4f99-9263-9376396775e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:03.462601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-2ee65758-2406-4f99-9263-9376396775e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lazy-loading 'fault' on Instance uuid c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:56:03.573539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2ee65758-2406-4f99-9263-9376396775e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27d353043364e838b7b6db2c5e97215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cd659e27ab4f5b9c926a11221a8d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:03.583355 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2ee65758-2406-4f99-9263-9376396775e1 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 200 len: 1332 microversion: 2.1 time: 0.249946 Aug 29 15:56:03.583991 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3106/6411] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:03 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 1332 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:04.609350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d516bf0e-5b5e-470b-b4df-b08c9bb09359 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:04.610737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d516bf0e-5b5e-470b-b4df-b08c9bb09359 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:04.626579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d516bf0e-5b5e-470b-b4df-b08c9bb09359 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:04.627627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d516bf0e-5b5e-470b-b4df-b08c9bb09359 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:04.628225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d516bf0e-5b5e-470b-b4df-b08c9bb09359 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:04.629197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d516bf0e-5b5e-470b-b4df-b08c9bb09359 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:04.629811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d516bf0e-5b5e-470b-b4df-b08c9bb09359 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:04.630416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d516bf0e-5b5e-470b-b4df-b08c9bb09359 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:04.661581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:04.664869 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-d516bf0e-5b5e-470b-b4df-b08c9bb09359 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] HTTP exception thrown: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d516bf0e-5b5e-470b-b4df-b08c9bb09359 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Request method failure captured: Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 HTTP/1.1 Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN9tQXht5Cgfnk-DmzN0MSv0rXQhWQjuwOYU5tmb_XOusFJfbKA_p0tIIxvVCByZJRyPrAyx_GOz9WX3qLDWm96rtVzsejl6mJXf7m_CCbLuHpKW-VnQamqEv9ykDteayNDpjpy7E2YIdOozyPaQJ7msypSAairkWE-SbOPzxpLLe7o Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_90cd659e27ab4f5b9c926a11221a8d80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}] Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: a27d353043364e838b7b6db2c5e97215 Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'c5ed120d-ed09-4cb8-9dba-c1de224fd6b4'} Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:04.671037 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:04.676287 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:04.676287 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:04.676287 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:04.676287 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:04.676287 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:04.676287 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. Aug 29 15:56:04.676287 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:04.691942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d516bf0e-5b5e-470b-b4df-b08c9bb09359 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Returning 404 to user: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:04.695948 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d516bf0e-5b5e-470b-b4df-b08c9bb09359 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 404 len: 111 microversion: 2.1 time: 0.095787 Aug 29 15:56:04.696552 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3306/6412] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:04 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:04.706368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ffc00ec7-a511-4b3c-bf56-9b5b0f3ca0bf tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '.version_select at 0x7fc42b003a60>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:04.765161 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ffc00ec7-a511-4b3c-bf56-9b5b0f3ca0bf tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126247420" status: 202 len: 0 microversion: 2.1 time: 0.063212 Aug 29 15:56:04.766203 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3107/6413] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 15:56:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126247420 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:56:10.686375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-895c91c0-7d75-417c-95b6-b32c810b1952 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:10.688562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-895c91c0-7d75-417c-95b6-b32c810b1952 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:10.708838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-895c91c0-7d75-417c-95b6-b32c810b1952 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:10.710684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-895c91c0-7d75-417c-95b6-b32c810b1952 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:10.711369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-895c91c0-7d75-417c-95b6-b32c810b1952 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:10.712938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-895c91c0-7d75-417c-95b6-b32c810b1952 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:10.714645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-895c91c0-7d75-417c-95b6-b32c810b1952 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:10.715917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-895c91c0-7d75-417c-95b6-b32c810b1952 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:10.739117 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-895c91c0-7d75-417c-95b6-b32c810b1952 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] HTTP exception thrown: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-895c91c0-7d75-417c-95b6-b32c810b1952 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Request method failure captured: Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 HTTP/1.1 Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN9tQXht5Cgfnk-DmzN0MSv0rXQhWQjuwOYU5tmb_XOusFJfbKA_p0tIIxvVCByZJRyPrAyx_GOz9WX3qLDWm96rtVzsejl6mJXf7m_CCbLuHpKW-VnQamqEv9ykDteayNDpjpy7E2YIdOozyPaQJ7msypSAairkWE-SbOPzxpLLe7o Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_90cd659e27ab4f5b9c926a11221a8d80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}] Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: a27d353043364e838b7b6db2c5e97215 Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'c5ed120d-ed09-4cb8-9dba-c1de224fd6b4'} Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:56:10.744798 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:10.749722 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. Aug 29 15:56:10.749722 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:10.749722 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:10.749722 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:10.749722 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:10.749722 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:10.749722 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:10.749722 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:10.749722 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:10.749722 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. Aug 29 15:56:10.749722 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:10.749722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-895c91c0-7d75-417c-95b6-b32c810b1952 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Returning 404 to user: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:10.751627 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-895c91c0-7d75-417c-95b6-b32c810b1952 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 404 len: 111 microversion: 2.1 time: 0.073665 Aug 29 15:56:10.753304 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3307/6414] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:56:10 2022] DELETE /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:10.767102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-23cee19a-0e5c-4fd2-8ebd-125398e2fdef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:10.769812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-23cee19a-0e5c-4fd2-8ebd-125398e2fdef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: c5ed120d-ed09-4cb8-9dba-c1de224fd6b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:10.792650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23cee19a-0e5c-4fd2-8ebd-125398e2fdef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:10.794696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23cee19a-0e5c-4fd2-8ebd-125398e2fdef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:10.795375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23cee19a-0e5c-4fd2-8ebd-125398e2fdef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:10.797318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23cee19a-0e5c-4fd2-8ebd-125398e2fdef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:10.799464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23cee19a-0e5c-4fd2-8ebd-125398e2fdef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:10.799938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23cee19a-0e5c-4fd2-8ebd-125398e2fdef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:10.833043 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-23cee19a-0e5c-4fd2-8ebd-125398e2fdef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] HTTP exception thrown: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-23cee19a-0e5c-4fd2-8ebd-125398e2fdef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Request method failure captured: Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 HTTP/1.1 Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN9tQXht5Cgfnk-DmzN0MSv0rXQhWQjuwOYU5tmb_XOusFJfbKA_p0tIIxvVCByZJRyPrAyx_GOz9WX3qLDWm96rtVzsejl6mJXf7m_CCbLuHpKW-VnQamqEv9ykDteayNDpjpy7E2YIdOozyPaQJ7msypSAairkWE-SbOPzxpLLe7o Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_90cd659e27ab4f5b9c926a11221a8d80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}] Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: a27d353043364e838b7b6db2c5e97215 Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'c5ed120d-ed09-4cb8-9dba-c1de224fd6b4'} Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:10.836678 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:10.841457 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:10.841457 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:10.841457 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:10.841457 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:10.841457 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:10.841457 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. Aug 29 15:56:10.841457 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:10.841457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-23cee19a-0e5c-4fd2-8ebd-125398e2fdef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Returning 404 to user: Instance c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:10.841457 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-23cee19a-0e5c-4fd2-8ebd-125398e2fdef tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4" status: 404 len: 111 microversion: 2.1 time: 0.080772 Aug 29 15:56:10.859085 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3108/6415] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:10 2022] GET /compute/v2.1/servers/c5ed120d-ed09-4cb8-9dba-c1de224fd6b4 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:15.386783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f0c373c-6b43-4716-877c-fac565181258 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:15.387428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3f0c373c-6b43-4716-877c-fac565181258 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:15.411043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f0c373c-6b43-4716-877c-fac565181258 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:15.411521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f0c373c-6b43-4716-877c-fac565181258 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:15.411979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f0c373c-6b43-4716-877c-fac565181258 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:15.412727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f0c373c-6b43-4716-877c-fac565181258 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:15.413231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f0c373c-6b43-4716-877c-fac565181258 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:15.413666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f0c373c-6b43-4716-877c-fac565181258 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:15.454308 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-3f0c373c-6b43-4716-877c-fac565181258 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] HTTP exception thrown: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f0c373c-6b43-4716-877c-fac565181258 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Request method failure captured: Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 HTTP/1.1 Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN9tQXht5Cgfnk-DmzN0MSv0rXQhWQjuwOYU5tmb_XOusFJfbKA_p0tIIxvVCByZJRyPrAyx_GOz9WX3qLDWm96rtVzsejl6mJXf7m_CCbLuHpKW-VnQamqEv9ykDteayNDpjpy7E2YIdOozyPaQJ7msypSAairkWE-SbOPzxpLLe7o Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_90cd659e27ab4f5b9c926a11221a8d80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}] Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: a27d353043364e838b7b6db2c5e97215 Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '52c16c7d-383b-4572-8c59-982ea4f677d0'} Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:56:15.456582 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:15.460868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. Aug 29 15:56:15.460868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.460868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:15.460868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.460868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:15.460868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:15.460868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:15.460868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:15.460868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:15.460868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. Aug 29 15:56:15.460868 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.464230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f0c373c-6b43-4716-877c-fac565181258 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Returning 404 to user: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:15.465147 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3f0c373c-6b43-4716-877c-fac565181258 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 404 len: 111 microversion: 2.1 time: 0.083207 Aug 29 15:56:15.466142 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3308/6416] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:56:15 2022] DELETE /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:15.483291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0e22687c-7ca5-4f5c-873d-a1006c95d6d5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:15.485174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0e22687c-7ca5-4f5c-873d-a1006c95d6d5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 52c16c7d-383b-4572-8c59-982ea4f677d0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:15.494461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e22687c-7ca5-4f5c-873d-a1006c95d6d5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:15.495141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e22687c-7ca5-4f5c-873d-a1006c95d6d5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:15.496199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e22687c-7ca5-4f5c-873d-a1006c95d6d5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:15.497441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e22687c-7ca5-4f5c-873d-a1006c95d6d5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:15.498303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e22687c-7ca5-4f5c-873d-a1006c95d6d5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:15.499265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e22687c-7ca5-4f5c-873d-a1006c95d6d5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:15.519058 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-0e22687c-7ca5-4f5c-873d-a1006c95d6d5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] HTTP exception thrown: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0e22687c-7ca5-4f5c-873d-a1006c95d6d5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Request method failure captured: Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 HTTP/1.1 Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN9tQXht5Cgfnk-DmzN0MSv0rXQhWQjuwOYU5tmb_XOusFJfbKA_p0tIIxvVCByZJRyPrAyx_GOz9WX3qLDWm96rtVzsejl6mJXf7m_CCbLuHpKW-VnQamqEv9ykDteayNDpjpy7E2YIdOozyPaQJ7msypSAairkWE-SbOPzxpLLe7o Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_90cd659e27ab4f5b9c926a11221a8d80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}] Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: a27d353043364e838b7b6db2c5e97215 Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '52c16c7d-383b-4572-8c59-982ea4f677d0'} Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:15.520633 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.526094 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:15.526094 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:15.526094 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:15.526094 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:15.526094 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:15.526094 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. Aug 29 15:56:15.526094 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.526094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0e22687c-7ca5-4f5c-873d-a1006c95d6d5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Returning 404 to user: Instance 52c16c7d-383b-4572-8c59-982ea4f677d0 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:15.531079 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0e22687c-7ca5-4f5c-873d-a1006c95d6d5 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0" status: 404 len: 111 microversion: 2.1 time: 0.051215 Aug 29 15:56:15.531079 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3109/6417] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:15 2022] GET /compute/v2.1/servers/52c16c7d-383b-4572-8c59-982ea4f677d0 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:15.537352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-afa4f71c-0e02-4709-badf-bbb229f4fede tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:15.538123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-afa4f71c-0e02-4709-badf-bbb229f4fede tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:15.548101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afa4f71c-0e02-4709-badf-bbb229f4fede tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:15.552247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afa4f71c-0e02-4709-badf-bbb229f4fede tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:15.552787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afa4f71c-0e02-4709-badf-bbb229f4fede tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:15.553638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afa4f71c-0e02-4709-badf-bbb229f4fede tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:15.554128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afa4f71c-0e02-4709-badf-bbb229f4fede tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:15.557763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afa4f71c-0e02-4709-badf-bbb229f4fede tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:15.581116 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-afa4f71c-0e02-4709-badf-bbb229f4fede tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] HTTP exception thrown: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-afa4f71c-0e02-4709-badf-bbb229f4fede tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Request method failure captured: Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 HTTP/1.1 Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN9tQXht5Cgfnk-DmzN0MSv0rXQhWQjuwOYU5tmb_XOusFJfbKA_p0tIIxvVCByZJRyPrAyx_GOz9WX3qLDWm96rtVzsejl6mJXf7m_CCbLuHpKW-VnQamqEv9ykDteayNDpjpy7E2YIdOozyPaQJ7msypSAairkWE-SbOPzxpLLe7o Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_90cd659e27ab4f5b9c926a11221a8d80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}] Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: a27d353043364e838b7b6db2c5e97215 Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'f0947721-9360-4db5-8636-ac5786d6cbe9'} Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:56:15.592984 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:15.599248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. Aug 29 15:56:15.599248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.599248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:15.599248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.599248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:15.599248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:15.599248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:15.599248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:15.599248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:15.599248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. Aug 29 15:56:15.599248 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.603667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-afa4f71c-0e02-4709-badf-bbb229f4fede tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Returning 404 to user: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:15.604888 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-afa4f71c-0e02-4709-badf-bbb229f4fede tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 404 len: 111 microversion: 2.1 time: 0.072145 Aug 29 15:56:15.606043 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3309/6418] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:56:15 2022] DELETE /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:15.614196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-98b7b504-e6e8-4273-a9a8-82cb99b96830 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:15.614810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-98b7b504-e6e8-4273-a9a8-82cb99b96830 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: f0947721-9360-4db5-8636-ac5786d6cbe9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:15.632746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98b7b504-e6e8-4273-a9a8-82cb99b96830 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:15.633704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98b7b504-e6e8-4273-a9a8-82cb99b96830 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:15.634140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98b7b504-e6e8-4273-a9a8-82cb99b96830 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:15.634953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98b7b504-e6e8-4273-a9a8-82cb99b96830 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:15.635412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98b7b504-e6e8-4273-a9a8-82cb99b96830 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:15.635934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-98b7b504-e6e8-4273-a9a8-82cb99b96830 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:15.655329 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-98b7b504-e6e8-4273-a9a8-82cb99b96830 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] HTTP exception thrown: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-98b7b504-e6e8-4273-a9a8-82cb99b96830 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Request method failure captured: Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 HTTP/1.1 Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN9tQXht5Cgfnk-DmzN0MSv0rXQhWQjuwOYU5tmb_XOusFJfbKA_p0tIIxvVCByZJRyPrAyx_GOz9WX3qLDWm96rtVzsejl6mJXf7m_CCbLuHpKW-VnQamqEv9ykDteayNDpjpy7E2YIdOozyPaQJ7msypSAairkWE-SbOPzxpLLe7o Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_90cd659e27ab4f5b9c926a11221a8d80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}] Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: a27d353043364e838b7b6db2c5e97215 Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'f0947721-9360-4db5-8636-ac5786d6cbe9'} Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:15.657558 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.662563 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:15.662563 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:15.662563 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:15.662563 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:15.662563 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:15.662563 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. Aug 29 15:56:15.662563 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:15.676756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-98b7b504-e6e8-4273-a9a8-82cb99b96830 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Returning 404 to user: Instance f0947721-9360-4db5-8636-ac5786d6cbe9 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:15.682899 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-98b7b504-e6e8-4273-a9a8-82cb99b96830 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9" status: 404 len: 111 microversion: 2.1 time: 0.070606 Aug 29 15:56:15.685874 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3110/6419] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:15 2022] GET /compute/v2.1/servers/f0947721-9360-4db5-8636-ac5786d6cbe9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:15.952163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-33951b07-310e-48eb-ac10-db0c85165930 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:15.957595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-33951b07-310e-48eb-ac10-db0c85165930 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:15.967583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33951b07-310e-48eb-ac10-db0c85165930 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:15.968603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33951b07-310e-48eb-ac10-db0c85165930 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:15.969376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33951b07-310e-48eb-ac10-db0c85165930 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:15.970519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33951b07-310e-48eb-ac10-db0c85165930 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:15.971178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33951b07-310e-48eb-ac10-db0c85165930 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:15.971923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33951b07-310e-48eb-ac10-db0c85165930 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:16.054183 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-33951b07-310e-48eb-ac10-db0c85165930 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1/action" status: 200 len: 24568 microversion: 2.1 time: 0.106252 Aug 29 15:56:16.055393 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3310/6420] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:56:15 2022] POST /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1/action => generated 24568 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:56:20.209236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8d3ce4ba-8b31-4960-bdd5-ff6b3ed525f0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:20.211133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8d3ce4ba-8b31-4960-bdd5-ff6b3ed525f0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:20.222702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d3ce4ba-8b31-4960-bdd5-ff6b3ed525f0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:20.225712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d3ce4ba-8b31-4960-bdd5-ff6b3ed525f0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:20.229276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d3ce4ba-8b31-4960-bdd5-ff6b3ed525f0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:20.230550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d3ce4ba-8b31-4960-bdd5-ff6b3ed525f0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:20.231212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d3ce4ba-8b31-4960-bdd5-ff6b3ed525f0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:20.231817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d3ce4ba-8b31-4960-bdd5-ff6b3ed525f0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:20.267379 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-8d3ce4ba-8b31-4960-bdd5-ff6b3ed525f0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] HTTP exception thrown: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8d3ce4ba-8b31-4960-bdd5-ff6b3ed525f0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Request method failure captured: Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb HTTP/1.1 Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDN9tQXht5Cgfnk-DmzN0MSv0rXQhWQjuwOYU5tmb_XOusFJfbKA_p0tIIxvVCByZJRyPrAyx_GOz9WX3qLDWm96rtVzsejl6mJXf7m_CCbLuHpKW-VnQamqEv9ykDteayNDpjpy7E2YIdOozyPaQJ7msypSAairkWE-SbOPzxpLLe7o Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_90cd659e27ab4f5b9c926a11221a8d80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}] Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: a27d353043364e838b7b6db2c5e97215 Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '646846a6-56c9-4370-8435-da5ae0466afb'} Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:56:20.282215 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:20.286879 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. Aug 29 15:56:20.286879 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:20.286879 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:20.286879 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:20.286879 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:20.286879 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:20.286879 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:20.286879 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:20.286879 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:20.286879 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. Aug 29 15:56:20.286879 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:20.300043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8d3ce4ba-8b31-4960-bdd5-ff6b3ed525f0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Returning 404 to user: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:20.301448 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8d3ce4ba-8b31-4960-bdd5-ff6b3ed525f0 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "DELETE /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 404 len: 111 microversion: 2.1 time: 0.096893 Aug 29 15:56:20.302787 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3111/6421] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:56:20 2022] DELETE /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:20.311360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7676b801-8945-4bee-8818-8bc101e46a33 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:20.312088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7676b801-8945-4bee-8818-8bc101e46a33 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] [instance: 646846a6-56c9-4370-8435-da5ae0466afb] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:20.329442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7676b801-8945-4bee-8818-8bc101e46a33 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:20.330017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7676b801-8945-4bee-8818-8bc101e46a33 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:20.330580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7676b801-8945-4bee-8818-8bc101e46a33 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:20.332998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7676b801-8945-4bee-8818-8bc101e46a33 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:20.333527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7676b801-8945-4bee-8818-8bc101e46a33 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:20.334510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7676b801-8945-4bee-8818-8bc101e46a33 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:20.374331 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-7676b801-8945-4bee-8818-8bc101e46a33 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] HTTP exception thrown: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7676b801-8945-4bee-8818-8bc101e46a33 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Request method failure captured: Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb HTTP/1.1 Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDN9tQXht5Cgfnk-DmzN0MSv0rXQhWQjuwOYU5tmb_XOusFJfbKA_p0tIIxvVCByZJRyPrAyx_GOz9WX3qLDWm96rtVzsejl6mJXf7m_CCbLuHpKW-VnQamqEv9ykDteayNDpjpy7E2YIdOozyPaQJ7msypSAairkWE-SbOPzxpLLe7o Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_90cd659e27ab4f5b9c926a11221a8d80", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/90cd659e27ab4f5b9c926a11221a8d80"}]}] Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 90cd659e27ab4f5b9c926a11221a8d80 Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915304885 Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: a27d353043364e838b7b6db2c5e97215 Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AttachVolumeNegativeTest-1915304885-project Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '646846a6-56c9-4370-8435-da5ae0466afb'} Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:20.380480 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:20.385031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:20.385031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:20.385031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:20.385031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:20.385031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:20.385031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. Aug 29 15:56:20.385031 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:20.385031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7676b801-8945-4bee-8818-8bc101e46a33 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] Returning 404 to user: Instance 646846a6-56c9-4370-8435-da5ae0466afb could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:20.385031 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7676b801-8945-4bee-8818-8bc101e46a33 tempest-AttachVolumeNegativeTest-1915304885 tempest-AttachVolumeNegativeTest-1915304885-project] 10.222.0.62 "GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb" status: 404 len: 111 microversion: 2.1 time: 0.075199 Aug 29 15:56:20.385031 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3311/6422] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:20 2022] GET /compute/v2.1/servers/646846a6-56c9-4370-8435-da5ae0466afb => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:30.343447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:30.344402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=21 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:30.558970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7595daeb-5ee3-459c-89f1-7d006f88bc99 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Action: 'create', calling method: .version_select at 0x7fc42a943ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1842497498", "metadata": {"Type": "work"}}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7595daeb-5ee3-459c-89f1-7d006f88bc99 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Request method failure captured: Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 122 Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOGulQUKWEAOxXKwri6bLwLewbd_hvCcSv84egCkl8GPrbi6c-9dkBXtIUbTPSn4P4o0k0mXxMrmJgLquTFJy6L3pvJhXX6Hg3LJqHyiCG3DhaGDVZHWqIXy9kkCcJDjfc1R-Pbn3s94G81miJFFFWwsptToMXshskws21dMWgivKGk Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 9e23d592723d4944b984c9d0c7a544be Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9e23d592723d4944b984c9d0c7a544be", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9e23d592723d4944b984c9d0c7a544be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e23d592723d4944b984c9d0c7a544be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e23d592723d4944b984c9d0c7a544be"}]}] Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 9e23d592723d4944b984c9d0c7a544be Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-VolumesNegativeTest-1249770566-project Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 28071409312147b0ba42363a77c26690 Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-VolumesNegativeTest-1249770566-project Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1842497498", "metadata": {"Type": "work"}}} Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1842497498', 'metadata': {'Type': 'work'}}}} Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:56:30.563437 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:56:30.567841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 15:56:30.567841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.567841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:30.567841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.567841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.567841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:30.567841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:30.567841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:56:30.567841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:56:30.567841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 15:56:30.567841 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.567841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7595daeb-5ee3-459c-89f1-7d006f88bc99 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:30.567841 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7595daeb-5ee3-459c-89f1-7d006f88bc99 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.230816 Aug 29 15:56:30.576490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9339ad6c-2d15-4031-aac3-5172dc53c3d2 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Action: 'create', calling method: .version_select at 0x7fc42a8f08b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-934266025", "metadata": {"Type": "work"}}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:30.577117 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3112/6423] 10.222.0.62 () {60 vars in 1156 bytes} [Mon Aug 29 15:56:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 243 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9339ad6c-2d15-4031-aac3-5172dc53c3d2 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Request method failure captured: Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 119 Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOGulQUKWEAOxXKwri6bLwLewbd_hvCcSv84egCkl8GPrbi6c-9dkBXtIUbTPSn4P4o0k0mXxMrmJgLquTFJy6L3pvJhXX6Hg3LJqHyiCG3DhaGDVZHWqIXy9kkCcJDjfc1R-Pbn3s94G81miJFFFWwsptToMXshskws21dMWgivKGk Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 9e23d592723d4944b984c9d0c7a544be Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9e23d592723d4944b984c9d0c7a544be", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9e23d592723d4944b984c9d0c7a544be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e23d592723d4944b984c9d0c7a544be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e23d592723d4944b984c9d0c7a544be"}]}] Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 9e23d592723d4944b984c9d0c7a544be Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-VolumesNegativeTest-1249770566-project Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 28071409312147b0ba42363a77c26690 Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-VolumesNegativeTest-1249770566-project Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-934266025", "metadata": {"Type": "work"}}} Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-934266025', 'metadata': {'Type': 'work'}}}} Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi '0' Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:56:30.581013 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:56:30.585516 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 15:56:30.585516 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.585516 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:30.585516 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.585516 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.585516 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:30.585516 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:30.585516 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:56:30.585516 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:56:30.585516 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 15:56:30.585516 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.588558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9339ad6c-2d15-4031-aac3-5172dc53c3d2 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:30.589470 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9339ad6c-2d15-4031-aac3-5172dc53c3d2 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017936 Aug 29 15:56:30.590963 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3312/6424] 10.222.0.62 () {60 vars in 1156 bytes} [Mon Aug 29 15:56:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:56:30.599595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d5d00a59-21cf-450a-99fe-2fcd88e78f93 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Action: 'create', calling method: .version_select at 0x7fc42b7b2670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-574505442", "metadata": {"Type": "work"}}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d5d00a59-21cf-450a-99fe-2fcd88e78f93 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Request method failure captured: Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 118 Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOGulQUKWEAOxXKwri6bLwLewbd_hvCcSv84egCkl8GPrbi6c-9dkBXtIUbTPSn4P4o0k0mXxMrmJgLquTFJy6L3pvJhXX6Hg3LJqHyiCG3DhaGDVZHWqIXy9kkCcJDjfc1R-Pbn3s94G81miJFFFWwsptToMXshskws21dMWgivKGk Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 9e23d592723d4944b984c9d0c7a544be Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9e23d592723d4944b984c9d0c7a544be", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9e23d592723d4944b984c9d0c7a544be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e23d592723d4944b984c9d0c7a544be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e23d592723d4944b984c9d0c7a544be"}]}] Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 9e23d592723d4944b984c9d0c7a544be Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-VolumesNegativeTest-1249770566-project Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 28071409312147b0ba42363a77c26690 Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-VolumesNegativeTest-1249770566-project Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-574505442", "metadata": {"Type": "work"}}} Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-574505442', 'metadata': {'Type': 'work'}}}} Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi '' Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:56:30.604601 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:56:30.610009 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 15:56:30.610009 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.610009 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:30.610009 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.610009 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.610009 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:30.610009 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:30.610009 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:56:30.610009 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:56:30.610009 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 15:56:30.610009 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.610009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d5d00a59-21cf-450a-99fe-2fcd88e78f93 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:30.611030 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d5d00a59-21cf-450a-99fe-2fcd88e78f93 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014929 Aug 29 15:56:30.615521 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3113/6425] 10.222.0.62 () {60 vars in 1156 bytes} [Mon Aug 29 15:56:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:56:30.620564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8eef8017-8030-4355-9303-f68195ccca0c tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Calling method '.version_select at 0x7fc42ada81f0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:30.631565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:30.632363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=13 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:30.690227 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-8eef8017-8030-4355-9303-f68195ccca0c tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] HTTP exception thrown: Volume tempest-invalid-1575967536 could not be found. Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8eef8017-8030-4355-9303-f68195ccca0c tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Request method failure captured: Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1575967536 HTTP/1.1 Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOGulQUKWEAOxXKwri6bLwLewbd_hvCcSv84egCkl8GPrbi6c-9dkBXtIUbTPSn4P4o0k0mXxMrmJgLquTFJy6L3pvJhXX6Hg3LJqHyiCG3DhaGDVZHWqIXy9kkCcJDjfc1R-Pbn3s94G81miJFFFWwsptToMXshskws21dMWgivKGk Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 9e23d592723d4944b984c9d0c7a544be Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9e23d592723d4944b984c9d0c7a544be", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9e23d592723d4944b984c9d0c7a544be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e23d592723d4944b984c9d0c7a544be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e23d592723d4944b984c9d0c7a544be"}]}] Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 9e23d592723d4944b984c9d0c7a544be Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-VolumesNegativeTest-1249770566-project Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 28071409312147b0ba42363a77c26690 Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-VolumesNegativeTest-1249770566-project Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: exception: Volume tempest-invalid-1575967536 could not be found. Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'tempest-invalid-1575967536'} Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1575967536 could not be found. (HTTP 404) (Request-ID: req-3878511a-d61b-4be3-86a6-f9974f16552e) Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:56:30.693298 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1575967536 could not be found. Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1575967536 could not be found. Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1575967536 could not be found. Aug 29 15:56:30.698696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.703571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8eef8017-8030-4355-9303-f68195ccca0c tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Returning 404 to user: Volume tempest-invalid-1575967536 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:30.704688 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8eef8017-8030-4355-9303-f68195ccca0c tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1575967536" status: 404 len: 99 microversion: 2.1 time: 0.088123 Aug 29 15:56:30.705500 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3313/6426] 10.222.0.62 () {58 vars in 1218 bytes} [Mon Aug 29 15:56:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1575967536 => generated 99 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:56:30.716201 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d2e7f8f3-41d1-4c10-98ab-5752ccbf3934 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004689 Aug 29 15:56:30.720639 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3114/6427] 10.222.0.62 () {58 vars in 1140 bytes} [Mon Aug 29 15:56:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 15:56:30.726164 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8f3fdbe9-d1e6-4d9c-9162-edd85475e2d0 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003950 Aug 29 15:56:30.726637 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3314/6428] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 15:56:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 15:56:30.737763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e0dd506d-9e10-4813-8907-3266ddbcdc4f tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Calling method '.version_select at 0x7fc42badb3a0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:30.774154 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-e0dd506d-9e10-4813-8907-3266ddbcdc4f tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] HTTP exception thrown: Volume b2cc32fc-8660-4b38-9646-5f17d7f71f66 could not be found. Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e0dd506d-9e10-4813-8907-3266ddbcdc4f tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Request method failure captured: Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/os-volumes/b2cc32fc-8660-4b38-9646-5f17d7f71f66 HTTP/1.1 Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOGulQUKWEAOxXKwri6bLwLewbd_hvCcSv84egCkl8GPrbi6c-9dkBXtIUbTPSn4P4o0k0mXxMrmJgLquTFJy6L3pvJhXX6Hg3LJqHyiCG3DhaGDVZHWqIXy9kkCcJDjfc1R-Pbn3s94G81miJFFFWwsptToMXshskws21dMWgivKGk Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 9e23d592723d4944b984c9d0c7a544be Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9e23d592723d4944b984c9d0c7a544be", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9e23d592723d4944b984c9d0c7a544be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e23d592723d4944b984c9d0c7a544be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e23d592723d4944b984c9d0c7a544be"}]}] Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 9e23d592723d4944b984c9d0c7a544be Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-VolumesNegativeTest-1249770566-project Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 28071409312147b0ba42363a77c26690 Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-VolumesNegativeTest-1249770566-project Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: method: Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: exception: Volume b2cc32fc-8660-4b38-9646-5f17d7f71f66 could not be found. Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'b2cc32fc-8660-4b38-9646-5f17d7f71f66'} Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b2cc32fc-8660-4b38-9646-5f17d7f71f66 could not be found. (HTTP 404) (Request-ID: req-864638b4-bb9c-4794-940d-d1ae6f8c4037) Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:56:30.776133 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b2cc32fc-8660-4b38-9646-5f17d7f71f66 could not be found. Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b2cc32fc-8660-4b38-9646-5f17d7f71f66 could not be found. Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b2cc32fc-8660-4b38-9646-5f17d7f71f66 could not be found. Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e0dd506d-9e10-4813-8907-3266ddbcdc4f tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Returning 404 to user: Volume b2cc32fc-8660-4b38-9646-5f17d7f71f66 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e0dd506d-9e10-4813-8907-3266ddbcdc4f tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/b2cc32fc-8660-4b38-9646-5f17d7f71f66" status: 404 len: 109 microversion: 2.1 time: 0.045894 Aug 29 15:56:30.780969 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3115/6429] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 15:56:30 2022] DELETE /compute/v2.1/os-volumes/b2cc32fc-8660-4b38-9646-5f17d7f71f66 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:30.789747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9694a505-4ae4-4d78-8eb9-07ae901f0e72 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Calling method '.version_select at 0x7fc42ac02a60>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:30.822207 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-9694a505-4ae4-4d78-8eb9-07ae901f0e72 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] HTTP exception thrown: Volume 4aae1a28-02b5-430e-ae99-2fa854885d6d could not be found. Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9694a505-4ae4-4d78-8eb9-07ae901f0e72 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Request method failure captured: Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/os-volumes/4aae1a28-02b5-430e-ae99-2fa854885d6d HTTP/1.1 Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOGulQUKWEAOxXKwri6bLwLewbd_hvCcSv84egCkl8GPrbi6c-9dkBXtIUbTPSn4P4o0k0mXxMrmJgLquTFJy6L3pvJhXX6Hg3LJqHyiCG3DhaGDVZHWqIXy9kkCcJDjfc1R-Pbn3s94G81miJFFFWwsptToMXshskws21dMWgivKGk Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 9e23d592723d4944b984c9d0c7a544be Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9e23d592723d4944b984c9d0c7a544be", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9e23d592723d4944b984c9d0c7a544be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e23d592723d4944b984c9d0c7a544be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e23d592723d4944b984c9d0c7a544be"}]}] Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 9e23d592723d4944b984c9d0c7a544be Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-VolumesNegativeTest-1249770566 Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-VolumesNegativeTest-1249770566-project Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 28071409312147b0ba42363a77c26690 Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-VolumesNegativeTest-1249770566-project Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: method: Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: exception: Volume 4aae1a28-02b5-430e-ae99-2fa854885d6d could not be found. Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '4aae1a28-02b5-430e-ae99-2fa854885d6d'} Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4aae1a28-02b5-430e-ae99-2fa854885d6d could not be found. (HTTP 404) (Request-ID: req-9ed292b0-37e7-4cea-89fb-abb78d97de83) Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:56:30.824333 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4aae1a28-02b5-430e-ae99-2fa854885d6d could not be found. Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4aae1a28-02b5-430e-ae99-2fa854885d6d could not be found. Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4aae1a28-02b5-430e-ae99-2fa854885d6d could not be found. Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9694a505-4ae4-4d78-8eb9-07ae901f0e72 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] Returning 404 to user: Volume 4aae1a28-02b5-430e-ae99-2fa854885d6d could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9694a505-4ae4-4d78-8eb9-07ae901f0e72 tempest-VolumesNegativeTest-1249770566 tempest-VolumesNegativeTest-1249770566-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/4aae1a28-02b5-430e-ae99-2fa854885d6d" status: 404 len: 109 microversion: 2.1 time: 0.042283 Aug 29 15:56:30.829199 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3315/6430] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 15:56:30 2022] GET /compute/v2.1/os-volumes/4aae1a28-02b5-430e-ae99-2fa854885d6d => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:46.695801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3d6bffb2-ebbc-40ab-83b4-f1df402c5740 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:46.696561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3d6bffb2-ebbc-40ab-83b4-f1df402c5740 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:46.739065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d6bffb2-ebbc-40ab-83b4-f1df402c5740 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:46.745484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d6bffb2-ebbc-40ab-83b4-f1df402c5740 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:46.747663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d6bffb2-ebbc-40ab-83b4-f1df402c5740 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:46.752414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d6bffb2-ebbc-40ab-83b4-f1df402c5740 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:46.753775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d6bffb2-ebbc-40ab-83b4-f1df402c5740 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:46.761376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3d6bffb2-ebbc-40ab-83b4-f1df402c5740 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:46.855839 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3d6bffb2-ebbc-40ab-83b4-f1df402c5740 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments/545b7d13-294f-4a87-9005-373e44d9d1bc" status: 200 len: 194 microversion: 2.20 time: 0.166070 Aug 29 15:56:46.859813 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3316/6431] 10.222.0.62 () {60 vars in 1454 bytes} [Mon Aug 29 15:56:46 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments/545b7d13-294f-4a87-9005-373e44d9d1bc => generated 194 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:56:47.027497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fac80363-0088-492c-b877-bd897786a7de tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:47.028493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fac80363-0088-492c-b877-bd897786a7de tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:47.040448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fac80363-0088-492c-b877-bd897786a7de tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:47.042033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fac80363-0088-492c-b877-bd897786a7de tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:47.042814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fac80363-0088-492c-b877-bd897786a7de tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:47.043845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fac80363-0088-492c-b877-bd897786a7de tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:47.044580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fac80363-0088-492c-b877-bd897786a7de tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:47.045451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fac80363-0088-492c-b877-bd897786a7de tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:47.092419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-354bbd2f-6eed-4a24-a3d0-bb635a92791e tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:47.094053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-354bbd2f-6eed-4a24-a3d0-bb635a92791e tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:47.101798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-354bbd2f-6eed-4a24-a3d0-bb635a92791e tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:47.102541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-354bbd2f-6eed-4a24-a3d0-bb635a92791e tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:47.103163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-354bbd2f-6eed-4a24-a3d0-bb635a92791e tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:47.104047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-354bbd2f-6eed-4a24-a3d0-bb635a92791e tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:47.104931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-354bbd2f-6eed-4a24-a3d0-bb635a92791e tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:47.105998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-354bbd2f-6eed-4a24-a3d0-bb635a92791e tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:47.255962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-fac80363-0088-492c-b877-bd897786a7de tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lazy-loading 'services' on Instance uuid 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:56:47.447368 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fac80363-0088-492c-b877-bd897786a7de tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments/545b7d13-294f-4a87-9005-373e44d9d1bc" status: 202 len: 0 microversion: 2.20 time: 0.423297 Aug 29 15:56:47.449109 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3317/6432] 10.222.0.62 () {60 vars in 1457 bytes} [Mon Aug 29 15:56:47 2022] DELETE /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments/545b7d13-294f-4a87-9005-373e44d9d1bc => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:56:47.459357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f1988f42-854c-4702-ad79-4507046d2700 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:47.466171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f1988f42-854c-4702-ad79-4507046d2700 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:47.519534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1988f42-854c-4702-ad79-4507046d2700 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:47.520667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1988f42-854c-4702-ad79-4507046d2700 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:47.521324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1988f42-854c-4702-ad79-4507046d2700 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:47.524017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1988f42-854c-4702-ad79-4507046d2700 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:47.524921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1988f42-854c-4702-ad79-4507046d2700 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:47.529699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1988f42-854c-4702-ad79-4507046d2700 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:47.636168 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f1988f42-854c-4702-ad79-4507046d2700 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.175508 Aug 29 15:56:47.636881 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3318/6433] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:56:47 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:56:47.641674 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-354bbd2f-6eed-4a24-a3d0-bb635a92791e tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1836 microversion: 2.1 time: 1.085402 Aug 29 15:56:47.661113 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3116/6434] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:46 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1836 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:48.050771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d78087d1-7748-4404-b8da-04b0a410158d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:48.051971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d78087d1-7748-4404-b8da-04b0a410158d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:48.063570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d78087d1-7748-4404-b8da-04b0a410158d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:48.064407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d78087d1-7748-4404-b8da-04b0a410158d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:48.065312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d78087d1-7748-4404-b8da-04b0a410158d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:48.067856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d78087d1-7748-4404-b8da-04b0a410158d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:48.068969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d78087d1-7748-4404-b8da-04b0a410158d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:48.075451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d78087d1-7748-4404-b8da-04b0a410158d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:48.635357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d78087d1-7748-4404-b8da-04b0a410158d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:48.647888 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d78087d1-7748-4404-b8da-04b0a410158d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1683 microversion: 2.1 time: 0.985433 Aug 29 15:56:48.651883 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3319/6435] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:47 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1683 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:56:48.662824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cdb6b1d2-ef4d-4193-b290-3ea3c88eeec3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:48.683171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cdb6b1d2-ef4d-4193-b290-3ea3c88eeec3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:48.702315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdb6b1d2-ef4d-4193-b290-3ea3c88eeec3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:48.707225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdb6b1d2-ef4d-4193-b290-3ea3c88eeec3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:48.709006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdb6b1d2-ef4d-4193-b290-3ea3c88eeec3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:48.710369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdb6b1d2-ef4d-4193-b290-3ea3c88eeec3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:48.711093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdb6b1d2-ef4d-4193-b290-3ea3c88eeec3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:48.711894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdb6b1d2-ef4d-4193-b290-3ea3c88eeec3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:48.883342 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cdb6b1d2-ef4d-4193-b290-3ea3c88eeec3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.237750 Aug 29 15:56:48.890277 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3117/6436] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:56:48 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments => generated 197 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:56:48.916356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ffd18807-11ef-4764-bd4d-f7f41fd98ad9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:48.919015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ffd18807-11ef-4764-bd4d-f7f41fd98ad9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:48.939315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffd18807-11ef-4764-bd4d-f7f41fd98ad9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:48.945686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffd18807-11ef-4764-bd4d-f7f41fd98ad9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:48.946161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffd18807-11ef-4764-bd4d-f7f41fd98ad9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:48.946977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffd18807-11ef-4764-bd4d-f7f41fd98ad9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:48.949398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffd18807-11ef-4764-bd4d-f7f41fd98ad9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:48.949870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ffd18807-11ef-4764-bd4d-f7f41fd98ad9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:49.063475 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ffd18807-11ef-4764-bd4d-f7f41fd98ad9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1/action" status: 200 len: 32641 microversion: 2.1 time: 0.151205 Aug 29 15:56:49.070787 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3320/6437] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:56:48 2022] POST /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1/action => generated 32641 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:56:49.207505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8bc00c1e-be91-434c-a929-916030806f18 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:49.208101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8bc00c1e-be91-434c-a929-916030806f18 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:49.247431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8bc00c1e-be91-434c-a929-916030806f18 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:49.251007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8bc00c1e-be91-434c-a929-916030806f18 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:49.251497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8bc00c1e-be91-434c-a929-916030806f18 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:49.252271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8bc00c1e-be91-434c-a929-916030806f18 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:49.262447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8bc00c1e-be91-434c-a929-916030806f18 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:49.262447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8bc00c1e-be91-434c-a929-916030806f18 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:49.373078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8bc00c1e-be91-434c-a929-916030806f18 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '136896314716474a9f05df902517eee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2d14a536694a9e87634fdd0999e960', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:49.373736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8bc00c1e-be91-434c-a929-916030806f18 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] flavor_id is None. Assuming migration. {{(pid=122361) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 15:56:49.374184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8bc00c1e-be91-434c-a929-916030806f18 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122361) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 15:56:49.759473 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8bc00c1e-be91-434c-a929-916030806f18 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1/action" status: 202 len: 0 microversion: 2.1 time: 0.553690 Aug 29 15:56:49.765206 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3118/6438] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:56:49 2022] POST /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:56:49.771807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-69fc9f56-b116-43f4-b43d-e73c6f0d16a3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:49.773101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-69fc9f56-b116-43f4-b43d-e73c6f0d16a3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:49.810143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69fc9f56-b116-43f4-b43d-e73c6f0d16a3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:49.816180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69fc9f56-b116-43f4-b43d-e73c6f0d16a3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:49.816750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69fc9f56-b116-43f4-b43d-e73c6f0d16a3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:49.817567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69fc9f56-b116-43f4-b43d-e73c6f0d16a3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:49.818060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69fc9f56-b116-43f4-b43d-e73c6f0d16a3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:49.826161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69fc9f56-b116-43f4-b43d-e73c6f0d16a3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:49.904053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2a955094-eb83-4544-8181-a1eb7124ae0f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:49.906949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2a955094-eb83-4544-8181-a1eb7124ae0f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:49.948718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a955094-eb83-4544-8181-a1eb7124ae0f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:49.950491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a955094-eb83-4544-8181-a1eb7124ae0f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:49.951299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a955094-eb83-4544-8181-a1eb7124ae0f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:49.952521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a955094-eb83-4544-8181-a1eb7124ae0f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:49.954985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a955094-eb83-4544-8181-a1eb7124ae0f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:49.955753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a955094-eb83-4544-8181-a1eb7124ae0f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:50.047142 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2a955094-eb83-4544-8181-a1eb7124ae0f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.148026 Aug 29 15:56:50.050744 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3119/6439] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:56:49 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:56:50.235288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-69fc9f56-b116-43f4-b43d-e73c6f0d16a3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:50.248732 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-69fc9f56-b116-43f4-b43d-e73c6f0d16a3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1692 microversion: 2.1 time: 0.483024 Aug 29 15:56:50.252357 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3321/6440] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:49 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1692 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:56:51.062094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6a117756-0d69-4d8f-9eaf-8bb31ffa9341 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:51.064605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6a117756-0d69-4d8f-9eaf-8bb31ffa9341 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:51.077811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a117756-0d69-4d8f-9eaf-8bb31ffa9341 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:51.081051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a117756-0d69-4d8f-9eaf-8bb31ffa9341 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:51.081607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a117756-0d69-4d8f-9eaf-8bb31ffa9341 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:51.082343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a117756-0d69-4d8f-9eaf-8bb31ffa9341 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:51.085587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a117756-0d69-4d8f-9eaf-8bb31ffa9341 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:51.086036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a117756-0d69-4d8f-9eaf-8bb31ffa9341 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:51.203349 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6a117756-0d69-4d8f-9eaf-8bb31ffa9341 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.145499 Aug 29 15:56:51.214128 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3120/6441] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:56:51 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:56:51.276366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2a4a4708-9538-4cee-ae47-1047dc1c6f7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:51.277447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2a4a4708-9538-4cee-ae47-1047dc1c6f7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:51.293222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a4a4708-9538-4cee-ae47-1047dc1c6f7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:51.293776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a4a4708-9538-4cee-ae47-1047dc1c6f7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:51.294992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a4a4708-9538-4cee-ae47-1047dc1c6f7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:51.295652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a4a4708-9538-4cee-ae47-1047dc1c6f7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:51.296421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a4a4708-9538-4cee-ae47-1047dc1c6f7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:51.296971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a4a4708-9538-4cee-ae47-1047dc1c6f7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:51.641933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2a4a4708-9538-4cee-ae47-1047dc1c6f7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:51.656026 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2a4a4708-9538-4cee-ae47-1047dc1c6f7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1692 microversion: 2.1 time: 0.384104 Aug 29 15:56:51.675123 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3322/6442] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:51 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1692 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:52.228003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3939ebee-284c-410f-820c-3745432c711b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:52.231704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3939ebee-284c-410f-820c-3745432c711b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:52.248904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3939ebee-284c-410f-820c-3745432c711b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:52.249469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3939ebee-284c-410f-820c-3745432c711b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:52.249912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3939ebee-284c-410f-820c-3745432c711b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:52.250686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3939ebee-284c-410f-820c-3745432c711b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:52.256286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3939ebee-284c-410f-820c-3745432c711b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:52.256899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3939ebee-284c-410f-820c-3745432c711b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:52.297464 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3939ebee-284c-410f-820c-3745432c711b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074319 Aug 29 15:56:52.302547 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3121/6443] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:56:52 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:56:52.680525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-df31d815-097e-4fed-9c05-7fe5ce353942 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:52.681499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-df31d815-097e-4fed-9c05-7fe5ce353942 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:52.690722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df31d815-097e-4fed-9c05-7fe5ce353942 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:52.691495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df31d815-097e-4fed-9c05-7fe5ce353942 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:52.692169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df31d815-097e-4fed-9c05-7fe5ce353942 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:52.693695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df31d815-097e-4fed-9c05-7fe5ce353942 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:52.694640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df31d815-097e-4fed-9c05-7fe5ce353942 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:52.695434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df31d815-097e-4fed-9c05-7fe5ce353942 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:53.088744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-df31d815-097e-4fed-9c05-7fe5ce353942 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:53.104414 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-df31d815-097e-4fed-9c05-7fe5ce353942 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1692 microversion: 2.1 time: 0.428155 Aug 29 15:56:53.109006 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3323/6444] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:52 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1692 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:53.321578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-36557472-ba96-483d-88e9-926f3df40855 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:53.327617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-36557472-ba96-483d-88e9-926f3df40855 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:53.348056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36557472-ba96-483d-88e9-926f3df40855 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:53.349803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36557472-ba96-483d-88e9-926f3df40855 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:53.350496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36557472-ba96-483d-88e9-926f3df40855 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:53.351447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36557472-ba96-483d-88e9-926f3df40855 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:53.352137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36557472-ba96-483d-88e9-926f3df40855 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:53.355118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36557472-ba96-483d-88e9-926f3df40855 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:53.514532 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-36557472-ba96-483d-88e9-926f3df40855 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.207909 Aug 29 15:56:53.517515 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3122/6445] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:56:53 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:56:54.130739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-157c6318-1273-4b02-ae34-dae32bae1b0d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:54.132041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-157c6318-1273-4b02-ae34-dae32bae1b0d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:54.153285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-157c6318-1273-4b02-ae34-dae32bae1b0d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:54.155447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-157c6318-1273-4b02-ae34-dae32bae1b0d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:54.157185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-157c6318-1273-4b02-ae34-dae32bae1b0d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:54.158356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-157c6318-1273-4b02-ae34-dae32bae1b0d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:54.159679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-157c6318-1273-4b02-ae34-dae32bae1b0d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:54.161185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-157c6318-1273-4b02-ae34-dae32bae1b0d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:54.537442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb12e8a6-1111-4132-8115-a6ab38bb741c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:54.541473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bb12e8a6-1111-4132-8115-a6ab38bb741c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:54.550897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb12e8a6-1111-4132-8115-a6ab38bb741c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:54.551804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb12e8a6-1111-4132-8115-a6ab38bb741c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:54.552434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb12e8a6-1111-4132-8115-a6ab38bb741c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:54.553692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb12e8a6-1111-4132-8115-a6ab38bb741c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:54.554374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb12e8a6-1111-4132-8115-a6ab38bb741c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:54.555221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb12e8a6-1111-4132-8115-a6ab38bb741c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:54.620870 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bb12e8a6-1111-4132-8115-a6ab38bb741c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096663 Aug 29 15:56:54.626786 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3123/6446] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:56:54 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:56:54.670485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-157c6318-1273-4b02-ae34-dae32bae1b0d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:54.706852 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-157c6318-1273-4b02-ae34-dae32bae1b0d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1692 microversion: 2.1 time: 0.579571 Aug 29 15:56:54.708862 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3324/6447] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:54 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1692 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:55.636624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-202a1e47-655b-4556-8598-2fcd69b04833 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:55.641991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-202a1e47-655b-4556-8598-2fcd69b04833 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:55.668989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-202a1e47-655b-4556-8598-2fcd69b04833 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:55.678105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-202a1e47-655b-4556-8598-2fcd69b04833 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:55.679010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-202a1e47-655b-4556-8598-2fcd69b04833 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:55.679422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-202a1e47-655b-4556-8598-2fcd69b04833 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:55.679949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-202a1e47-655b-4556-8598-2fcd69b04833 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:55.680380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-202a1e47-655b-4556-8598-2fcd69b04833 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:55.727875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-17d4ccaa-9b62-4653-8b3f-51d48b7ccddb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:55.729121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-17d4ccaa-9b62-4653-8b3f-51d48b7ccddb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:55.802625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17d4ccaa-9b62-4653-8b3f-51d48b7ccddb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:55.803713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17d4ccaa-9b62-4653-8b3f-51d48b7ccddb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:55.805541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17d4ccaa-9b62-4653-8b3f-51d48b7ccddb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:55.809901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17d4ccaa-9b62-4653-8b3f-51d48b7ccddb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:55.811453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17d4ccaa-9b62-4653-8b3f-51d48b7ccddb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:55.815487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17d4ccaa-9b62-4653-8b3f-51d48b7ccddb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:55.850460 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-202a1e47-655b-4556-8598-2fcd69b04833 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.220472 Aug 29 15:56:55.860830 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3124/6448] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:56:55 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments => generated 197 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:56:56.365994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-17d4ccaa-9b62-4653-8b3f-51d48b7ccddb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:56.375908 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-17d4ccaa-9b62-4653-8b3f-51d48b7ccddb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1692 microversion: 2.1 time: 0.651909 Aug 29 15:56:56.391846 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3325/6449] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:55 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1692 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:56:56.867626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8908d6f5-0355-425c-be19-bf489dbad667 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:56.869933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8908d6f5-0355-425c-be19-bf489dbad667 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:56.882743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8908d6f5-0355-425c-be19-bf489dbad667 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:56.886695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8908d6f5-0355-425c-be19-bf489dbad667 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:56.887225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8908d6f5-0355-425c-be19-bf489dbad667 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:56.888025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8908d6f5-0355-425c-be19-bf489dbad667 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:56.889591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8908d6f5-0355-425c-be19-bf489dbad667 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:56.890296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8908d6f5-0355-425c-be19-bf489dbad667 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:56.961868 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8908d6f5-0355-425c-be19-bf489dbad667 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098709 Aug 29 15:56:56.962586 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3125/6450] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:56:56 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:56:57.402374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9eadefd9-d28b-4ad2-a911-eef8cbb390b2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:57.410261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9eadefd9-d28b-4ad2-a911-eef8cbb390b2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:57.418427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9eadefd9-d28b-4ad2-a911-eef8cbb390b2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:57.422631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9eadefd9-d28b-4ad2-a911-eef8cbb390b2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:57.422631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9eadefd9-d28b-4ad2-a911-eef8cbb390b2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:57.423061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9eadefd9-d28b-4ad2-a911-eef8cbb390b2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:57.427347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9eadefd9-d28b-4ad2-a911-eef8cbb390b2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:57.428224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9eadefd9-d28b-4ad2-a911-eef8cbb390b2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:57.613892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9eadefd9-d28b-4ad2-a911-eef8cbb390b2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:57.627918 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9eadefd9-d28b-4ad2-a911-eef8cbb390b2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1697 microversion: 2.1 time: 0.229409 Aug 29 15:56:57.630877 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3326/6451] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:57 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1697 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:57.976027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-903cfc27-d6ef-4410-bf94-1a79f21b9a31 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:57.978646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-903cfc27-d6ef-4410-bf94-1a79f21b9a31 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:58.011334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-903cfc27-d6ef-4410-bf94-1a79f21b9a31 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:58.011847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-903cfc27-d6ef-4410-bf94-1a79f21b9a31 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:58.012293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-903cfc27-d6ef-4410-bf94-1a79f21b9a31 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:58.014902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-903cfc27-d6ef-4410-bf94-1a79f21b9a31 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:58.015377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-903cfc27-d6ef-4410-bf94-1a79f21b9a31 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:58.015857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-903cfc27-d6ef-4410-bf94-1a79f21b9a31 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:58.106481 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-903cfc27-d6ef-4410-bf94-1a79f21b9a31 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.135497 Aug 29 15:56:58.107410 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3126/6452] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:56:57 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:56:58.658282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cc641a6d-02be-4248-bd45-af4b3eb2404e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:58.659422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cc641a6d-02be-4248-bd45-af4b3eb2404e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:58.673407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc641a6d-02be-4248-bd45-af4b3eb2404e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:58.677350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc641a6d-02be-4248-bd45-af4b3eb2404e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:58.677812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc641a6d-02be-4248-bd45-af4b3eb2404e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:58.678560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc641a6d-02be-4248-bd45-af4b3eb2404e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:58.679033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc641a6d-02be-4248-bd45-af4b3eb2404e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:58.681175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc641a6d-02be-4248-bd45-af4b3eb2404e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:59.087595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cc641a6d-02be-4248-bd45-af4b3eb2404e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:59.101350 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cc641a6d-02be-4248-bd45-af4b3eb2404e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1697 microversion: 2.1 time: 0.447623 Aug 29 15:56:59.102076 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3327/6453] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:58 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1697 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:59.133756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4302615e-e58a-4711-bbb5-4f716903d7a0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:59.138859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4302615e-e58a-4711-bbb5-4f716903d7a0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:59.152285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4302615e-e58a-4711-bbb5-4f716903d7a0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:59.153024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4302615e-e58a-4711-bbb5-4f716903d7a0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:59.153708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4302615e-e58a-4711-bbb5-4f716903d7a0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:59.154859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4302615e-e58a-4711-bbb5-4f716903d7a0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:59.155481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4302615e-e58a-4711-bbb5-4f716903d7a0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:59.156062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4302615e-e58a-4711-bbb5-4f716903d7a0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:59.212994 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4302615e-e58a-4711-bbb5-4f716903d7a0 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.086330 Aug 29 15:56:59.214105 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3127/6454] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 15:56:59 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:59.301629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec8f7d9f-c27f-4910-8f00-87826fb81aee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:59.302826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ec8f7d9f-c27f-4910-8f00-87826fb81aee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:59.319539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec8f7d9f-c27f-4910-8f00-87826fb81aee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:59.324156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec8f7d9f-c27f-4910-8f00-87826fb81aee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:59.325620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec8f7d9f-c27f-4910-8f00-87826fb81aee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:59.326996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec8f7d9f-c27f-4910-8f00-87826fb81aee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:59.328934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec8f7d9f-c27f-4910-8f00-87826fb81aee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:59.331671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec8f7d9f-c27f-4910-8f00-87826fb81aee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:59.381664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ec8f7d9f-c27f-4910-8f00-87826fb81aee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:56:59.538018 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ec8f7d9f-c27f-4910-8f00-87826fb81aee tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 204 len: 0 microversion: 2.20 time: 0.239742 Aug 29 15:56:59.539037 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3328/6455] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 15:56:59 2022] DELETE /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:56:59.548728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fe56d7ce-54c3-42e4-8535-dc79c4de687c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:59.549370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fe56d7ce-54c3-42e4-8535-dc79c4de687c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:59.558704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe56d7ce-54c3-42e4-8535-dc79c4de687c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:59.559206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe56d7ce-54c3-42e4-8535-dc79c4de687c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:59.559640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe56d7ce-54c3-42e4-8535-dc79c4de687c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:59.560467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe56d7ce-54c3-42e4-8535-dc79c4de687c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:59.560925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe56d7ce-54c3-42e4-8535-dc79c4de687c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:59.561373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe56d7ce-54c3-42e4-8535-dc79c4de687c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:59.855643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fe56d7ce-54c3-42e4-8535-dc79c4de687c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:59.872744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fe56d7ce-54c3-42e4-8535-dc79c4de687c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:59.874761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fe56d7ce-54c3-42e4-8535-dc79c4de687c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:59.880073 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fe56d7ce-54c3-42e4-8535-dc79c4de687c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1721 microversion: 2.20 time: 0.336232 Aug 29 15:56:59.880688 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3128/6456] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:56:59 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1721 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:00.126326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f17811fc-9b75-41b9-acfc-1b91d823d65b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:00.128493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f17811fc-9b75-41b9-acfc-1b91d823d65b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:00.148300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f17811fc-9b75-41b9-acfc-1b91d823d65b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:00.150014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f17811fc-9b75-41b9-acfc-1b91d823d65b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:00.151718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f17811fc-9b75-41b9-acfc-1b91d823d65b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:00.153635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f17811fc-9b75-41b9-acfc-1b91d823d65b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:00.157193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f17811fc-9b75-41b9-acfc-1b91d823d65b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:00.157924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f17811fc-9b75-41b9-acfc-1b91d823d65b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:00.667982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f17811fc-9b75-41b9-acfc-1b91d823d65b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:00.681970 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f17811fc-9b75-41b9-acfc-1b91d823d65b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1697 microversion: 2.1 time: 0.560331 Aug 29 15:57:00.682918 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3329/6457] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:00 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1697 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:00.911823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-093835b2-53b3-4b43-96be-f83d73a2177c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:00.913058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-093835b2-53b3-4b43-96be-f83d73a2177c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:00.937296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-093835b2-53b3-4b43-96be-f83d73a2177c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:00.942273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-093835b2-53b3-4b43-96be-f83d73a2177c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:00.946067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-093835b2-53b3-4b43-96be-f83d73a2177c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:00.947110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-093835b2-53b3-4b43-96be-f83d73a2177c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:00.949647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-093835b2-53b3-4b43-96be-f83d73a2177c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:00.950465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-093835b2-53b3-4b43-96be-f83d73a2177c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:01.421334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-093835b2-53b3-4b43-96be-f83d73a2177c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:01.434331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-093835b2-53b3-4b43-96be-f83d73a2177c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:01.439909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-093835b2-53b3-4b43-96be-f83d73a2177c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:01.445437 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-093835b2-53b3-4b43-96be-f83d73a2177c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1721 microversion: 2.20 time: 0.539028 Aug 29 15:57:01.450099 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3129/6458] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:00 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1721 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:01.708104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a54d0ef8-15c8-4d9e-9223-dbf4a514def1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:01.715180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a54d0ef8-15c8-4d9e-9223-dbf4a514def1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:01.743236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a54d0ef8-15c8-4d9e-9223-dbf4a514def1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:01.743862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a54d0ef8-15c8-4d9e-9223-dbf4a514def1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:01.749777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a54d0ef8-15c8-4d9e-9223-dbf4a514def1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:01.750906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a54d0ef8-15c8-4d9e-9223-dbf4a514def1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:01.753741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a54d0ef8-15c8-4d9e-9223-dbf4a514def1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:01.755910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a54d0ef8-15c8-4d9e-9223-dbf4a514def1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:01.839045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:02.377641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a54d0ef8-15c8-4d9e-9223-dbf4a514def1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:02.386348 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a54d0ef8-15c8-4d9e-9223-dbf4a514def1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1697 microversion: 2.1 time: 0.682119 Aug 29 15:57:02.397802 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3330/6459] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:01 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1697 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:02.477340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1dd0aa81-76e0-4909-af79-dd51cfdf14d4 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:02.478616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1dd0aa81-76e0-4909-af79-dd51cfdf14d4 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:02.497783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1dd0aa81-76e0-4909-af79-dd51cfdf14d4 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:02.498715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1dd0aa81-76e0-4909-af79-dd51cfdf14d4 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:02.499362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1dd0aa81-76e0-4909-af79-dd51cfdf14d4 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:02.500578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1dd0aa81-76e0-4909-af79-dd51cfdf14d4 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:02.501571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1dd0aa81-76e0-4909-af79-dd51cfdf14d4 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:02.502370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1dd0aa81-76e0-4909-af79-dd51cfdf14d4 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:03.013703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1dd0aa81-76e0-4909-af79-dd51cfdf14d4 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:03.022590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:03.030731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1dd0aa81-76e0-4909-af79-dd51cfdf14d4 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:03.032505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1dd0aa81-76e0-4909-af79-dd51cfdf14d4 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:03.041174 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1dd0aa81-76e0-4909-af79-dd51cfdf14d4 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1721 microversion: 2.20 time: 0.570932 Aug 29 15:57:03.042069 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3130/6460] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:02 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1721 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:03.419761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-43d222d4-7cd9-490b-b6cb-813fa0623c1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:03.421046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-43d222d4-7cd9-490b-b6cb-813fa0623c1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:03.456687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43d222d4-7cd9-490b-b6cb-813fa0623c1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:03.457605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43d222d4-7cd9-490b-b6cb-813fa0623c1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:03.459670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43d222d4-7cd9-490b-b6cb-813fa0623c1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:03.463943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43d222d4-7cd9-490b-b6cb-813fa0623c1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:03.465271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43d222d4-7cd9-490b-b6cb-813fa0623c1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:03.473218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-43d222d4-7cd9-490b-b6cb-813fa0623c1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:03.780680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d6f7ac42-03dc-4a09-b617-767b1448e8c4 req-fbc81109-5a4a-4cbf-b6b6-1d5886598d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fba35d0-e4ed-4088-a1d1-ccabdd81c178", "name": "network-vif-deleted", "tag": "db244ebb-da5f-469b-ae27-7da59496c697"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:03.797842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d6f7ac42-03dc-4a09-b617-767b1448e8c4 req-fbc81109-5a4a-4cbf-b6b6-1d5886598d8e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:03.798594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d6f7ac42-03dc-4a09-b617-767b1448e8c4 req-fbc81109-5a4a-4cbf-b6b6-1d5886598d8e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:03.799462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d6f7ac42-03dc-4a09-b617-767b1448e8c4 req-fbc81109-5a4a-4cbf-b6b6-1d5886598d8e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:03.820427 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d6f7ac42-03dc-4a09-b617-767b1448e8c4 req-fbc81109-5a4a-4cbf-b6b6-1d5886598d8e service nova] Creating event network-vif-deleted:db244ebb-da5f-469b-ae27-7da59496c697 for instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 on n-h2-839401-11 Aug 29 15:57:03.828752 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d6f7ac42-03dc-4a09-b617-767b1448e8c4 req-fbc81109-5a4a-4cbf-b6b6-1d5886598d8e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053768 Aug 29 15:57:03.834158 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3131/6461] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:57:04.066871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-02cc5b3d-aaf1-419d-a810-25e17a50f1b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:04.067640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-02cc5b3d-aaf1-419d-a810-25e17a50f1b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:04.087838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02cc5b3d-aaf1-419d-a810-25e17a50f1b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:04.091287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02cc5b3d-aaf1-419d-a810-25e17a50f1b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:04.091761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02cc5b3d-aaf1-419d-a810-25e17a50f1b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:04.092527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02cc5b3d-aaf1-419d-a810-25e17a50f1b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:04.093000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02cc5b3d-aaf1-419d-a810-25e17a50f1b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:04.101968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02cc5b3d-aaf1-419d-a810-25e17a50f1b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:04.168355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02cc5b3d-aaf1-419d-a810-25e17a50f1b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:04.168832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02cc5b3d-aaf1-419d-a810-25e17a50f1b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:04.169315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02cc5b3d-aaf1-419d-a810-25e17a50f1b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:04.169777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-02cc5b3d-aaf1-419d-a810-25e17a50f1b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lazy-loading 'fault' on Instance uuid 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:57:04.266196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-02cc5b3d-aaf1-419d-a810-25e17a50f1b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:04.278246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-02cc5b3d-aaf1-419d-a810-25e17a50f1b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:04.280475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-02cc5b3d-aaf1-419d-a810-25e17a50f1b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:04.283351 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-02cc5b3d-aaf1-419d-a810-25e17a50f1b2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 200 len: 1369 microversion: 2.20 time: 0.222087 Aug 29 15:57:04.284791 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3132/6462] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:04 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 1369 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:57:04.935887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-43d222d4-7cd9-490b-b6cb-813fa0623c1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:04.963869 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-43d222d4-7cd9-490b-b6cb-813fa0623c1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1697 microversion: 2.1 time: 1.548016 Aug 29 15:57:04.965218 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3331/6463] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:03 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1697 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:05.307069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c377b20-ee29-4055-b1ff-22b64ce37232 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:05.308430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6c377b20-ee29-4055-b1ff-22b64ce37232 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:05.324994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c377b20-ee29-4055-b1ff-22b64ce37232 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:05.331214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c377b20-ee29-4055-b1ff-22b64ce37232 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:05.332469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c377b20-ee29-4055-b1ff-22b64ce37232 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:05.335597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c377b20-ee29-4055-b1ff-22b64ce37232 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:05.338559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c377b20-ee29-4055-b1ff-22b64ce37232 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:05.341776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c377b20-ee29-4055-b1ff-22b64ce37232 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:05.399275 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-6c377b20-ee29-4055-b1ff-22b64ce37232 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] HTTP exception thrown: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c377b20-ee29-4055-b1ff-22b64ce37232 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Request method failure captured: Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 HTTP/1.1 Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOCyHrNKCg8zS6NWsrQ8Tz5UNYCXmQZVyaaUiqLgBxE8jDIzrjBCk_9JFkRNEI7T0D-WEzZeGD6s-yTFZ9PEqNqtTo9n3YQMORmk3KZOwgPADdh7qR1ERsxoNF2KjSVQvUidO-39oaflSwqxG2BO80xMUZXXfNmo9Ot08n1BMq8bIOA Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 8fce4f5819b946bc907d71bec14ecbdf Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8fce4f5819b946bc907d71bec14ecbdf", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8fce4f5819b946bc907d71bec14ecbdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8fce4f5819b946bc907d71bec14ecbdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8fce4f5819b946bc907d71bec14ecbdf"}]}] Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 8fce4f5819b946bc907d71bec14ecbdf Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachVolumeShelveTestJSON-584137560-project Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: d6fae8e2411942caabfbb819f182a8a5 Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachVolumeShelveTestJSON-584137560-project Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '1fba35d0-e4ed-4088-a1d1-ccabdd81c178'} Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:57:05.406766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:05.410977 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:57:05.410977 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:05.410977 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:05.410977 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:05.410977 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:05.410977 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:05.410977 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. Aug 29 15:57:05.410977 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:57:05.410977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c377b20-ee29-4055-b1ff-22b64ce37232 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Returning 404 to user: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:05.410977 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6c377b20-ee29-4055-b1ff-22b64ce37232 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 404 len: 111 microversion: 2.20 time: 0.106014 Aug 29 15:57:05.410977 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3133/6464] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:05 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:57:05.419127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a3e6e938-88d8-41ff-91c9-6a49d704b6bc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '.version_select at 0x7fc42bc54310>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:05.468859 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a3e6e938-88d8-41ff-91c9-6a49d704b6bc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-61291724" status: 204 len: 0 microversion: 2.20 time: 0.054955 Aug 29 15:57:05.470603 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3332/6465] 10.222.0.62 () {60 vars in 1256 bytes} [Mon Aug 29 15:57:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-61291724 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:57:06.025592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-40b8bff3-2268-431f-887d-5029075f3fd5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:06.030241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-40b8bff3-2268-431f-887d-5029075f3fd5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:06.081942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40b8bff3-2268-431f-887d-5029075f3fd5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:06.083270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40b8bff3-2268-431f-887d-5029075f3fd5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:06.083742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40b8bff3-2268-431f-887d-5029075f3fd5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:06.084791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40b8bff3-2268-431f-887d-5029075f3fd5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:06.085849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40b8bff3-2268-431f-887d-5029075f3fd5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:06.086774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-40b8bff3-2268-431f-887d-5029075f3fd5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:06.600249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-40b8bff3-2268-431f-887d-5029075f3fd5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:06.620617 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-40b8bff3-2268-431f-887d-5029075f3fd5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1697 microversion: 2.1 time: 0.632004 Aug 29 15:57:06.621964 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3134/6466] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:05 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1697 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:07.399752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8f18de3b-a5f6-429c-9fe6-7255f909f172 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Action: 'create', calling method: .version_select at 0x7fc433b74e50>, body: {"keypair": {"name": "tempest-keypair-1918379334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAlZppXa6UN/Dgnh68bw78OTs09D73ZHpLy1WkiFH03xKGM5e1cbukzfQwgx78us4EeqZON9W3CL2m2BcJ05NZ9GQJHmqGhHCoKhkCUyvVcwuHjAt60bGKg2sOK68GqHg=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:07.464625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-8f18de3b-a5f6-429c-9fe6-7255f909f172 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Getting quotas for project 8fce4f5819b946bc907d71bec14ecbdf. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:57:07.480365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-8f18de3b-a5f6-429c-9fe6-7255f909f172 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Getting quotas for user d6fae8e2411942caabfbb819f182a8a5 and project 8fce4f5819b946bc907d71bec14ecbdf. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:57:07.560911 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8f18de3b-a5f6-429c-9fe6-7255f909f172 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.165343 Aug 29 15:57:07.564964 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3333/6467] 10.222.0.62 () {62 vars in 1200 bytes} [Mon Aug 29 15:57:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 170 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:57:07.644573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-60be252a-6450-4ae6-b45e-1efea326d408 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:07.651253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-60be252a-6450-4ae6-b45e-1efea326d408 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:07.682865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60be252a-6450-4ae6-b45e-1efea326d408 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:07.683395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60be252a-6450-4ae6-b45e-1efea326d408 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:07.690499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60be252a-6450-4ae6-b45e-1efea326d408 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:07.698922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60be252a-6450-4ae6-b45e-1efea326d408 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:07.699421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60be252a-6450-4ae6-b45e-1efea326d408 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:07.699891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60be252a-6450-4ae6-b45e-1efea326d408 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:08.118092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-60be252a-6450-4ae6-b45e-1efea326d408 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:08.127881 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-60be252a-6450-4ae6-b45e-1efea326d408 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1697 microversion: 2.1 time: 0.486938 Aug 29 15:57:08.132119 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3135/6468] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:07 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1697 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:09.160283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ff5bede0-3e76-4846-bc3e-1a9b790791ac tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:09.160808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ff5bede0-3e76-4846-bc3e-1a9b790791ac tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:09.194738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff5bede0-3e76-4846-bc3e-1a9b790791ac tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:09.195581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff5bede0-3e76-4846-bc3e-1a9b790791ac tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:09.200238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff5bede0-3e76-4846-bc3e-1a9b790791ac tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:09.209647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff5bede0-3e76-4846-bc3e-1a9b790791ac tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:09.214026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff5bede0-3e76-4846-bc3e-1a9b790791ac tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:09.215867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff5bede0-3e76-4846-bc3e-1a9b790791ac tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:09.579100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ff5bede0-3e76-4846-bc3e-1a9b790791ac tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:09.589208 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ff5bede0-3e76-4846-bc3e-1a9b790791ac tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1697 microversion: 2.1 time: 0.436216 Aug 29 15:57:09.590273 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3334/6469] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:09 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1697 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:10.616417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-79512c4f-5aff-4290-a4dc-cd98f1f49405 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:10.618996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-79512c4f-5aff-4290-a4dc-cd98f1f49405 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:10.656859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79512c4f-5aff-4290-a4dc-cd98f1f49405 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:10.660624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79512c4f-5aff-4290-a4dc-cd98f1f49405 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:10.667263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79512c4f-5aff-4290-a4dc-cd98f1f49405 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:10.670366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79512c4f-5aff-4290-a4dc-cd98f1f49405 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:10.671193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79512c4f-5aff-4290-a4dc-cd98f1f49405 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:10.675292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79512c4f-5aff-4290-a4dc-cd98f1f49405 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:10.686703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-410905972", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75462ae6-c197-4fad-8ddf-2c69c9916b43"}], "security_groups": [{"name": "tempest-securitygroup--1100131532"}], "key_name": "tempest-keypair-1918379334", "user_data": "}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:11.054028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] validate_networks() for [('75462ae6-c197-4fad-8ddf-2c69c9916b43', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:57:11.558243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-79512c4f-5aff-4290-a4dc-cd98f1f49405 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:11.590797 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-79512c4f-5aff-4290-a4dc-cd98f1f49405 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1697 microversion: 2.1 time: 0.980859 Aug 29 15:57:11.591721 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3136/6470] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:10 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1697 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:12.217880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:57:12.218353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:57:12.218947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:57:12.219417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:57:12.219883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:57:12.248233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:12.249107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:12.249809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:12.250818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:12.251441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:12.252105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:12.275932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Getting quotas for project 8fce4f5819b946bc907d71bec14ecbdf. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:57:12.283543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Getting quotas for user d6fae8e2411942caabfbb819f182a8a5 and project 8fce4f5819b946bc907d71bec14ecbdf. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:57:12.304037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:57:12.307296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:57:12.400942 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-79aca7a4-ec5b-49c3-b62e-6062f8e8274d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.721321 Aug 29 15:57:12.402251 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3335/6471] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 15:57:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 15:57:12.414451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b2b06000-47de-4a44-a51f-2cd45913653f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:12.416077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b2b06000-47de-4a44-a51f-2cd45913653f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:12.493012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b2b06000-47de-4a44-a51f-2cd45913653f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:12.502364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b2b06000-47de-4a44-a51f-2cd45913653f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:12.510803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b2b06000-47de-4a44-a51f-2cd45913653f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:12.514672 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b2b06000-47de-4a44-a51f-2cd45913653f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1281 microversion: 2.20 time: 0.103514 Aug 29 15:57:12.517309 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3137/6472] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:12 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1281 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:12.618228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e3240c43-9cb9-443a-b0ca-f8375289e1d9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:12.618868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e3240c43-9cb9-443a-b0ca-f8375289e1d9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:12.639751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3240c43-9cb9-443a-b0ca-f8375289e1d9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:12.640281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3240c43-9cb9-443a-b0ca-f8375289e1d9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:12.640802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3240c43-9cb9-443a-b0ca-f8375289e1d9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:12.641665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3240c43-9cb9-443a-b0ca-f8375289e1d9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:12.644132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3240c43-9cb9-443a-b0ca-f8375289e1d9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:12.644576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3240c43-9cb9-443a-b0ca-f8375289e1d9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:13.295928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e3240c43-9cb9-443a-b0ca-f8375289e1d9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:13.307566 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e3240c43-9cb9-443a-b0ca-f8375289e1d9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1697 microversion: 2.1 time: 0.693441 Aug 29 15:57:13.318691 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3336/6473] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:12 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1697 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:13.540686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7a0e09e7-1041-433e-a35e-9dacba10d496 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:13.542085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7a0e09e7-1041-433e-a35e-9dacba10d496 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:13.564044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a0e09e7-1041-433e-a35e-9dacba10d496 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:13.564741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a0e09e7-1041-433e-a35e-9dacba10d496 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:13.565332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a0e09e7-1041-433e-a35e-9dacba10d496 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:13.574057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a0e09e7-1041-433e-a35e-9dacba10d496 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:13.574658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a0e09e7-1041-433e-a35e-9dacba10d496 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:13.575206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a0e09e7-1041-433e-a35e-9dacba10d496 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:13.800139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7a0e09e7-1041-433e-a35e-9dacba10d496 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:13.820343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7a0e09e7-1041-433e-a35e-9dacba10d496 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:13.821947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7a0e09e7-1041-433e-a35e-9dacba10d496 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:13.823105 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7a0e09e7-1041-433e-a35e-9dacba10d496 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1285 microversion: 2.20 time: 0.286407 Aug 29 15:57:13.823675 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3138/6474] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:13 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1285 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:14.334829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ee8bd5ae-b742-4b14-8aa5-d2dd6c1af497 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:14.335837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ee8bd5ae-b742-4b14-8aa5-d2dd6c1af497 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:14.352027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee8bd5ae-b742-4b14-8aa5-d2dd6c1af497 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:14.355419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee8bd5ae-b742-4b14-8aa5-d2dd6c1af497 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:14.356014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee8bd5ae-b742-4b14-8aa5-d2dd6c1af497 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:14.356906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee8bd5ae-b742-4b14-8aa5-d2dd6c1af497 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:14.358067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee8bd5ae-b742-4b14-8aa5-d2dd6c1af497 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:14.358789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee8bd5ae-b742-4b14-8aa5-d2dd6c1af497 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:14.593252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d5bc1e19-6019-45b1-827a-2df4414b4cfc req-71da6708-b314-4825-9bdc-a9dd854e9565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972f2acd-0b31-43ab-93a8-9a2a41be43e1", "name": "network-vif-unplugged", "status": "completed", "tag": "24ac9813-3507-47b6-9e86-582a9ad9ccb4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:14.634657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d5bc1e19-6019-45b1-827a-2df4414b4cfc req-71da6708-b314-4825-9bdc-a9dd854e9565 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:14.635175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d5bc1e19-6019-45b1-827a-2df4414b4cfc req-71da6708-b314-4825-9bdc-a9dd854e9565 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:14.635628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d5bc1e19-6019-45b1-827a-2df4414b4cfc req-71da6708-b314-4825-9bdc-a9dd854e9565 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:14.664308 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d5bc1e19-6019-45b1-827a-2df4414b4cfc req-71da6708-b314-4825-9bdc-a9dd854e9565 service nova] Creating event network-vif-unplugged:24ac9813-3507-47b6-9e86-582a9ad9ccb4 for instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 on n-h2-839401-11 Aug 29 15:57:14.674167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-d5bc1e19-6019-45b1-827a-2df4414b4cfc req-71da6708-b314-4825-9bdc-a9dd854e9565 service nova] Instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:57:14.708534 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d5bc1e19-6019-45b1-827a-2df4414b4cfc req-71da6708-b314-4825-9bdc-a9dd854e9565 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120529 Aug 29 15:57:14.712137 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3139/6475] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:14.846822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ee8bd5ae-b742-4b14-8aa5-d2dd6c1af497 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:14.858119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-43187bc5-ace4-4342-8d71-313e5ab0aedc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:14.859197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-43187bc5-ace4-4342-8d71-313e5ab0aedc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:14.879916 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ee8bd5ae-b742-4b14-8aa5-d2dd6c1af497 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1696 microversion: 2.1 time: 0.548896 Aug 29 15:57:14.880886 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3337/6476] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:14 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1696 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:14.881356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43187bc5-ace4-4342-8d71-313e5ab0aedc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:14.882033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43187bc5-ace4-4342-8d71-313e5ab0aedc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:14.884027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43187bc5-ace4-4342-8d71-313e5ab0aedc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:14.884919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43187bc5-ace4-4342-8d71-313e5ab0aedc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:14.885654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43187bc5-ace4-4342-8d71-313e5ab0aedc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:14.888177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43187bc5-ace4-4342-8d71-313e5ab0aedc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:15.079710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-43187bc5-ace4-4342-8d71-313e5ab0aedc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:15.095209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-43187bc5-ace4-4342-8d71-313e5ab0aedc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:15.098928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-43187bc5-ace4-4342-8d71-313e5ab0aedc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:15.100123 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-43187bc5-ace4-4342-8d71-313e5ab0aedc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1339 microversion: 2.20 time: 0.251172 Aug 29 15:57:15.104087 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3140/6477] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:14 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1339 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:57:15.908811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b33a1b84-68ae-4f6e-8a71-6a2596909c39 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:15.910775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b33a1b84-68ae-4f6e-8a71-6a2596909c39 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:15.948866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b33a1b84-68ae-4f6e-8a71-6a2596909c39 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:15.950464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b33a1b84-68ae-4f6e-8a71-6a2596909c39 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:15.951617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b33a1b84-68ae-4f6e-8a71-6a2596909c39 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:15.953327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b33a1b84-68ae-4f6e-8a71-6a2596909c39 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:15.954396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b33a1b84-68ae-4f6e-8a71-6a2596909c39 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:15.955462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b33a1b84-68ae-4f6e-8a71-6a2596909c39 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:16.126528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6a6c6f8c-de9a-4ed9-b726-7ac9b9e14670 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:16.128782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6a6c6f8c-de9a-4ed9-b726-7ac9b9e14670 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:16.159730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a6c6f8c-de9a-4ed9-b726-7ac9b9e14670 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:16.160485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a6c6f8c-de9a-4ed9-b726-7ac9b9e14670 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:16.163746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a6c6f8c-de9a-4ed9-b726-7ac9b9e14670 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:16.165267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a6c6f8c-de9a-4ed9-b726-7ac9b9e14670 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:16.166034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a6c6f8c-de9a-4ed9-b726-7ac9b9e14670 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:16.174013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a6c6f8c-de9a-4ed9-b726-7ac9b9e14670 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:16.419709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6a6c6f8c-de9a-4ed9-b726-7ac9b9e14670 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:16.429647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6a6c6f8c-de9a-4ed9-b726-7ac9b9e14670 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:16.458074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6a6c6f8c-de9a-4ed9-b726-7ac9b9e14670 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:16.459589 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6a6c6f8c-de9a-4ed9-b726-7ac9b9e14670 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1339 microversion: 2.20 time: 0.337283 Aug 29 15:57:16.474423 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3141/6478] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:16 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1339 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:16.825278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-de3a995b-ffa9-4ac2-8a49-b8de2322ef2e req-51667026-e7a1-481c-af9a-d10d91094115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972f2acd-0b31-43ab-93a8-9a2a41be43e1", "tag": "24ac9813-3507-47b6-9e86-582a9ad9ccb4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:16.843008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=59 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:16.845676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-de3a995b-ffa9-4ac2-8a49-b8de2322ef2e req-51667026-e7a1-481c-af9a-d10d91094115 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:16.849283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-de3a995b-ffa9-4ac2-8a49-b8de2322ef2e req-51667026-e7a1-481c-af9a-d10d91094115 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:16.856102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-de3a995b-ffa9-4ac2-8a49-b8de2322ef2e req-51667026-e7a1-481c-af9a-d10d91094115 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:16.896757 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-de3a995b-ffa9-4ac2-8a49-b8de2322ef2e req-51667026-e7a1-481c-af9a-d10d91094115 service nova] Creating event network-changed:24ac9813-3507-47b6-9e86-582a9ad9ccb4 for instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 on n-h2-839401-11 Aug 29 15:57:16.918765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-de3a995b-ffa9-4ac2-8a49-b8de2322ef2e req-51667026-e7a1-481c-af9a-d10d91094115 service nova] Instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:57:16.964553 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-de3a995b-ffa9-4ac2-8a49-b8de2322ef2e req-51667026-e7a1-481c-af9a-d10d91094115 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145406 Aug 29 15:57:16.965379 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3142/6479] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:17.441114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b33a1b84-68ae-4f6e-8a71-6a2596909c39 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:17.483807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-487273a2-d1e6-4ee4-a440-ae0a4344057d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:17.485190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-487273a2-d1e6-4ee4-a440-ae0a4344057d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:17.495484 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b33a1b84-68ae-4f6e-8a71-6a2596909c39 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1696 microversion: 2.1 time: 1.594085 Aug 29 15:57:17.506809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487273a2-d1e6-4ee4-a440-ae0a4344057d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:17.508823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487273a2-d1e6-4ee4-a440-ae0a4344057d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:17.509862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487273a2-d1e6-4ee4-a440-ae0a4344057d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:17.514559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487273a2-d1e6-4ee4-a440-ae0a4344057d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:17.514948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487273a2-d1e6-4ee4-a440-ae0a4344057d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:17.515636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487273a2-d1e6-4ee4-a440-ae0a4344057d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:17.516637 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3338/6480] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:15 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1696 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:18.415854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-487273a2-d1e6-4ee4-a440-ae0a4344057d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:18.425582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-487273a2-d1e6-4ee4-a440-ae0a4344057d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:18.430892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-487273a2-d1e6-4ee4-a440-ae0a4344057d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:18.441429 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-487273a2-d1e6-4ee4-a440-ae0a4344057d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1407 microversion: 2.20 time: 0.961849 Aug 29 15:57:18.442735 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3143/6481] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:17 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1407 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:57:18.524637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2706c9d5-27f5-46c1-a036-2689b446495c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:18.526040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2706c9d5-27f5-46c1-a036-2689b446495c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:18.530481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:18.545118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2706c9d5-27f5-46c1-a036-2689b446495c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:18.550438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2706c9d5-27f5-46c1-a036-2689b446495c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:18.551035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2706c9d5-27f5-46c1-a036-2689b446495c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:18.553304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2706c9d5-27f5-46c1-a036-2689b446495c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:18.557634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2706c9d5-27f5-46c1-a036-2689b446495c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:18.558548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2706c9d5-27f5-46c1-a036-2689b446495c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:18.941691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2706c9d5-27f5-46c1-a036-2689b446495c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:18.953268 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2706c9d5-27f5-46c1-a036-2689b446495c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1696 microversion: 2.1 time: 0.432933 Aug 29 15:57:18.955151 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3339/6482] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:18 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1696 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:19.979577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-11bf7bbd-4182-41cd-b4eb-a259da64d119 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:19.980131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-11bf7bbd-4182-41cd-b4eb-a259da64d119 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:19.995253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11bf7bbd-4182-41cd-b4eb-a259da64d119 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:19.995734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11bf7bbd-4182-41cd-b4eb-a259da64d119 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:19.996173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11bf7bbd-4182-41cd-b4eb-a259da64d119 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:20.006501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11bf7bbd-4182-41cd-b4eb-a259da64d119 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:20.007302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11bf7bbd-4182-41cd-b4eb-a259da64d119 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:20.009503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-11bf7bbd-4182-41cd-b4eb-a259da64d119 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:20.286316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-58980b29-faff-4c54-8661-30bedb2c3686 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:20.287867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-58980b29-faff-4c54-8661-30bedb2c3686 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:20.303747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58980b29-faff-4c54-8661-30bedb2c3686 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:20.308317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58980b29-faff-4c54-8661-30bedb2c3686 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:20.308950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58980b29-faff-4c54-8661-30bedb2c3686 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:20.309913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58980b29-faff-4c54-8661-30bedb2c3686 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:20.314007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58980b29-faff-4c54-8661-30bedb2c3686 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:20.314626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58980b29-faff-4c54-8661-30bedb2c3686 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:20.426345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-11bf7bbd-4182-41cd-b4eb-a259da64d119 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:20.438101 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-11bf7bbd-4182-41cd-b4eb-a259da64d119 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1694 microversion: 2.1 time: 0.463200 Aug 29 15:57:20.453618 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3340/6483] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:19 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1694 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:20.809534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-58980b29-faff-4c54-8661-30bedb2c3686 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:20.824460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-58980b29-faff-4c54-8661-30bedb2c3686 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:20.850075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-58980b29-faff-4c54-8661-30bedb2c3686 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:20.851264 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-58980b29-faff-4c54-8661-30bedb2c3686 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1407 microversion: 2.20 time: 1.388218 Aug 29 15:57:20.873503 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3144/6484] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:19 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1407 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:21.030259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-89cec425-b87b-4db8-8d58-8eb56af7761f req-7fc31f81-4691-4ce9-902c-57a11e140972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e1cc03-3a7b-4242-a1a6-98e756d3d326", "tag": "9c67ed58-1b7d-43f4-b23a-74f6094e5f88"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:21.054818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-89cec425-b87b-4db8-8d58-8eb56af7761f req-7fc31f81-4691-4ce9-902c-57a11e140972 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:21.056784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-89cec425-b87b-4db8-8d58-8eb56af7761f req-7fc31f81-4691-4ce9-902c-57a11e140972 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:21.057573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-89cec425-b87b-4db8-8d58-8eb56af7761f req-7fc31f81-4691-4ce9-902c-57a11e140972 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:21.090682 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-89cec425-b87b-4db8-8d58-8eb56af7761f req-7fc31f81-4691-4ce9-902c-57a11e140972 service nova] Creating event network-changed:9c67ed58-1b7d-43f4-b23a-74f6094e5f88 for instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 on n-h2-839401-11 Aug 29 15:57:21.101338 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-89cec425-b87b-4db8-8d58-8eb56af7761f req-7fc31f81-4691-4ce9-902c-57a11e140972 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077159 Aug 29 15:57:21.103723 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3341/6485] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:21.469460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f68b8492-0674-4853-bb2f-daa7a2fcf190 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:21.470164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f68b8492-0674-4853-bb2f-daa7a2fcf190 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:21.483832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f68b8492-0674-4853-bb2f-daa7a2fcf190 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:21.485005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f68b8492-0674-4853-bb2f-daa7a2fcf190 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:21.487719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f68b8492-0674-4853-bb2f-daa7a2fcf190 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:21.488961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f68b8492-0674-4853-bb2f-daa7a2fcf190 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:21.493518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f68b8492-0674-4853-bb2f-daa7a2fcf190 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:21.494209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f68b8492-0674-4853-bb2f-daa7a2fcf190 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:21.884265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b1ebb30a-c327-4171-85c3-653bdb6c85ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:21.885602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b1ebb30a-c327-4171-85c3-653bdb6c85ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:21.907226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1ebb30a-c327-4171-85c3-653bdb6c85ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:21.917871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1ebb30a-c327-4171-85c3-653bdb6c85ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:21.918646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1ebb30a-c327-4171-85c3-653bdb6c85ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:21.919561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1ebb30a-c327-4171-85c3-653bdb6c85ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:21.920177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1ebb30a-c327-4171-85c3-653bdb6c85ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:21.920770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b1ebb30a-c327-4171-85c3-653bdb6c85ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:22.263824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:22.297551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=10 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:22.502072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:22.784007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b1ebb30a-c327-4171-85c3-653bdb6c85ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:22.794264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b1ebb30a-c327-4171-85c3-653bdb6c85ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:22.805492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b1ebb30a-c327-4171-85c3-653bdb6c85ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:22.821575 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b1ebb30a-c327-4171-85c3-653bdb6c85ae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1407 microversion: 2.20 time: 0.940563 Aug 29 15:57:22.830376 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3342/6486] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:21 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1407 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:57:22.931853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f68b8492-0674-4853-bb2f-daa7a2fcf190 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:22.973549 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f68b8492-0674-4853-bb2f-daa7a2fcf190 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1694 microversion: 2.1 time: 1.507984 Aug 29 15:57:22.979059 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3145/6487] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:21 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1694 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:23.869532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-48d22fbc-24c5-48d7-8b9a-85d8eb04b00c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:23.872022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-48d22fbc-24c5-48d7-8b9a-85d8eb04b00c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:23.914673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48d22fbc-24c5-48d7-8b9a-85d8eb04b00c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:23.919381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48d22fbc-24c5-48d7-8b9a-85d8eb04b00c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:23.925585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48d22fbc-24c5-48d7-8b9a-85d8eb04b00c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:23.928211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48d22fbc-24c5-48d7-8b9a-85d8eb04b00c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:23.938480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48d22fbc-24c5-48d7-8b9a-85d8eb04b00c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:23.949334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48d22fbc-24c5-48d7-8b9a-85d8eb04b00c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:24.002262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dc1d4e2b-a0c9-4efb-ae39-185b01c69292 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:24.003414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dc1d4e2b-a0c9-4efb-ae39-185b01c69292 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:24.050691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc1d4e2b-a0c9-4efb-ae39-185b01c69292 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:24.055796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc1d4e2b-a0c9-4efb-ae39-185b01c69292 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:24.067474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc1d4e2b-a0c9-4efb-ae39-185b01c69292 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:24.070985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc1d4e2b-a0c9-4efb-ae39-185b01c69292 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:24.079589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc1d4e2b-a0c9-4efb-ae39-185b01c69292 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:24.085462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc1d4e2b-a0c9-4efb-ae39-185b01c69292 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:25.089332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dc1d4e2b-a0c9-4efb-ae39-185b01c69292 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:25.100688 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dc1d4e2b-a0c9-4efb-ae39-185b01c69292 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1691 microversion: 2.1 time: 1.104089 Aug 29 15:57:25.101310 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3146/6488] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:23 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1691 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:25.138757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d2eff83e-a05c-430a-8877-b91f94722fc4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:25.144647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d2eff83e-a05c-430a-8877-b91f94722fc4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:25.160916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2eff83e-a05c-430a-8877-b91f94722fc4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:25.161729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2eff83e-a05c-430a-8877-b91f94722fc4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:25.162335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2eff83e-a05c-430a-8877-b91f94722fc4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:25.163207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2eff83e-a05c-430a-8877-b91f94722fc4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:25.166131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2eff83e-a05c-430a-8877-b91f94722fc4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:25.166783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2eff83e-a05c-430a-8877-b91f94722fc4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:25.308347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-48d22fbc-24c5-48d7-8b9a-85d8eb04b00c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:25.323054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-48d22fbc-24c5-48d7-8b9a-85d8eb04b00c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:25.324517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-48d22fbc-24c5-48d7-8b9a-85d8eb04b00c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:25.325726 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-48d22fbc-24c5-48d7-8b9a-85d8eb04b00c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1407 microversion: 2.20 time: 1.472442 Aug 29 15:57:25.340704 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3343/6489] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:23 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1407 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:25.556420 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d2eff83e-a05c-430a-8877-b91f94722fc4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1/action" status: 202 len: 0 microversion: 2.1 time: 0.425646 Aug 29 15:57:25.558198 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3147/6490] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:57:25 2022] POST /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:57:25.570384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7e98bdb8-3e53-4ca9-be41-e67cebb697a9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:25.571451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7e98bdb8-3e53-4ca9-be41-e67cebb697a9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:25.586779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e98bdb8-3e53-4ca9-be41-e67cebb697a9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:25.592136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e98bdb8-3e53-4ca9-be41-e67cebb697a9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:25.597275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e98bdb8-3e53-4ca9-be41-e67cebb697a9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:25.600844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e98bdb8-3e53-4ca9-be41-e67cebb697a9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:25.601685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e98bdb8-3e53-4ca9-be41-e67cebb697a9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:25.602439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e98bdb8-3e53-4ca9-be41-e67cebb697a9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:26.254582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7e98bdb8-3e53-4ca9-be41-e67cebb697a9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:26.276706 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7e98bdb8-3e53-4ca9-be41-e67cebb697a9 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1690 microversion: 2.1 time: 0.711890 Aug 29 15:57:26.282382 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3344/6491] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:25 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1690 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:26.373200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8e2ec9f3-23b0-4296-b041-a2874673eede tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:26.373842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8e2ec9f3-23b0-4296-b041-a2874673eede tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:26.399720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e2ec9f3-23b0-4296-b041-a2874673eede tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:26.400583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e2ec9f3-23b0-4296-b041-a2874673eede tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:26.401227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e2ec9f3-23b0-4296-b041-a2874673eede tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:26.410849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e2ec9f3-23b0-4296-b041-a2874673eede tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:26.416512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e2ec9f3-23b0-4296-b041-a2874673eede tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:26.417246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8e2ec9f3-23b0-4296-b041-a2874673eede tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:26.482365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:26.885234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8e2ec9f3-23b0-4296-b041-a2874673eede tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:26.911192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8e2ec9f3-23b0-4296-b041-a2874673eede tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:26.917157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8e2ec9f3-23b0-4296-b041-a2874673eede tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:26.918922 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8e2ec9f3-23b0-4296-b041-a2874673eede tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1407 microversion: 2.20 time: 0.555333 Aug 29 15:57:26.934851 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3148/6492] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:26 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1407 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:27.300618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ddbdc1d9-8130-4391-b471-29bc00ed5897 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:27.301423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ddbdc1d9-8130-4391-b471-29bc00ed5897 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:27.325691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddbdc1d9-8130-4391-b471-29bc00ed5897 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:27.333467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddbdc1d9-8130-4391-b471-29bc00ed5897 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:27.336777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddbdc1d9-8130-4391-b471-29bc00ed5897 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:27.341654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddbdc1d9-8130-4391-b471-29bc00ed5897 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:27.343171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddbdc1d9-8130-4391-b471-29bc00ed5897 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:27.346142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddbdc1d9-8130-4391-b471-29bc00ed5897 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:27.466498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-fdc57988-ec67-48cf-94f6-6134894a23f7 req-932ecca6-c131-4923-b977-15a82d9b6662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972f2acd-0b31-43ab-93a8-9a2a41be43e1", "name": "network-vif-plugged", "status": "completed", "tag": "24ac9813-3507-47b6-9e86-582a9ad9ccb4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:27.516357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fdc57988-ec67-48cf-94f6-6134894a23f7 req-932ecca6-c131-4923-b977-15a82d9b6662 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:27.516978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fdc57988-ec67-48cf-94f6-6134894a23f7 req-932ecca6-c131-4923-b977-15a82d9b6662 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:27.537864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fdc57988-ec67-48cf-94f6-6134894a23f7 req-932ecca6-c131-4923-b977-15a82d9b6662 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:27.614714 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-fdc57988-ec67-48cf-94f6-6134894a23f7 req-932ecca6-c131-4923-b977-15a82d9b6662 service nova] Creating event network-vif-plugged:24ac9813-3507-47b6-9e86-582a9ad9ccb4 for instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 on n-h2-839401-11 Aug 29 15:57:27.674351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-fdc57988-ec67-48cf-94f6-6134894a23f7 req-932ecca6-c131-4923-b977-15a82d9b6662 service nova] Instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:57:27.731722 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-fdc57988-ec67-48cf-94f6-6134894a23f7 req-932ecca6-c131-4923-b977-15a82d9b6662 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.269156 Aug 29 15:57:27.735600 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3149/6493] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:27.947012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5195876f-adb7-43de-9afb-f603ad44a8f1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:27.947824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5195876f-adb7-43de-9afb-f603ad44a8f1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:27.961389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5195876f-adb7-43de-9afb-f603ad44a8f1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:27.962338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5195876f-adb7-43de-9afb-f603ad44a8f1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:27.963057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5195876f-adb7-43de-9afb-f603ad44a8f1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:27.966916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5195876f-adb7-43de-9afb-f603ad44a8f1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:27.967608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5195876f-adb7-43de-9afb-f603ad44a8f1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:27.968229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5195876f-adb7-43de-9afb-f603ad44a8f1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:28.437782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5195876f-adb7-43de-9afb-f603ad44a8f1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:28.453917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5195876f-adb7-43de-9afb-f603ad44a8f1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:28.462096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5195876f-adb7-43de-9afb-f603ad44a8f1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:28.465962 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5195876f-adb7-43de-9afb-f603ad44a8f1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1407 microversion: 2.20 time: 0.527034 Aug 29 15:57:28.481277 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3150/6494] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:27 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:57:28.997615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ddbdc1d9-8130-4391-b471-29bc00ed5897 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:29.014485 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ddbdc1d9-8130-4391-b471-29bc00ed5897 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1690 microversion: 2.1 time: 1.717357 Aug 29 15:57:29.020624 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3345/6495] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:27 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1690 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:29.494690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-220894f5-5b51-4dfd-be89-50fbbcb0de30 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:29.495430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-220894f5-5b51-4dfd-be89-50fbbcb0de30 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:29.513772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-220894f5-5b51-4dfd-be89-50fbbcb0de30 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:29.525688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-220894f5-5b51-4dfd-be89-50fbbcb0de30 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:29.526303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-220894f5-5b51-4dfd-be89-50fbbcb0de30 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:29.527297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-220894f5-5b51-4dfd-be89-50fbbcb0de30 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:29.534019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-220894f5-5b51-4dfd-be89-50fbbcb0de30 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:29.538241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-220894f5-5b51-4dfd-be89-50fbbcb0de30 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:30.048881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-71982747-6e06-4ef6-9e83-9240201c4618 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:30.050190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-71982747-6e06-4ef6-9e83-9240201c4618 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:30.072043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71982747-6e06-4ef6-9e83-9240201c4618 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:30.081230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71982747-6e06-4ef6-9e83-9240201c4618 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:30.083060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71982747-6e06-4ef6-9e83-9240201c4618 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:30.094012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71982747-6e06-4ef6-9e83-9240201c4618 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:30.094922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71982747-6e06-4ef6-9e83-9240201c4618 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:30.096577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71982747-6e06-4ef6-9e83-9240201c4618 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:30.168374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-220894f5-5b51-4dfd-be89-50fbbcb0de30 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:30.186558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-220894f5-5b51-4dfd-be89-50fbbcb0de30 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:30.195536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-220894f5-5b51-4dfd-be89-50fbbcb0de30 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:30.201806 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-220894f5-5b51-4dfd-be89-50fbbcb0de30 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1407 microversion: 2.20 time: 0.709447 Aug 29 15:57:30.218177 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3151/6496] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:29 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1407 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:30.711581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-71982747-6e06-4ef6-9e83-9240201c4618 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:30.730117 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-71982747-6e06-4ef6-9e83-9240201c4618 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1690 microversion: 2.1 time: 0.688273 Aug 29 15:57:30.731148 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3346/6497] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:30 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1690 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:31.233238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4353c2b2-af58-4410-8858-f07e7ff1337f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:31.235134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4353c2b2-af58-4410-8858-f07e7ff1337f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:31.276068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4353c2b2-af58-4410-8858-f07e7ff1337f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:31.281590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4353c2b2-af58-4410-8858-f07e7ff1337f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:31.282196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4353c2b2-af58-4410-8858-f07e7ff1337f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:31.283263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4353c2b2-af58-4410-8858-f07e7ff1337f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:31.283843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4353c2b2-af58-4410-8858-f07e7ff1337f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:31.284388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4353c2b2-af58-4410-8858-f07e7ff1337f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:31.640356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4353c2b2-af58-4410-8858-f07e7ff1337f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:31.652575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4353c2b2-af58-4410-8858-f07e7ff1337f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:31.663759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4353c2b2-af58-4410-8858-f07e7ff1337f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:31.665900 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4353c2b2-af58-4410-8858-f07e7ff1337f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1407 microversion: 2.20 time: 0.439581 Aug 29 15:57:31.667069 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3152/6498] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:31 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:31.764611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7eb649c7-725a-4f8c-b2e6-80e6086bbeec tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:31.768718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7eb649c7-725a-4f8c-b2e6-80e6086bbeec tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:31.796558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eb649c7-725a-4f8c-b2e6-80e6086bbeec tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:31.797155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eb649c7-725a-4f8c-b2e6-80e6086bbeec tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:31.797605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eb649c7-725a-4f8c-b2e6-80e6086bbeec tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:31.798335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eb649c7-725a-4f8c-b2e6-80e6086bbeec tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:31.804851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eb649c7-725a-4f8c-b2e6-80e6086bbeec tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:31.805443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eb649c7-725a-4f8c-b2e6-80e6086bbeec tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:32.316717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-db636f3e-aac2-446d-9969-4ed0ebc3c8ba req-33bce1a1-ae6e-4cc6-b31b-cee5cf530846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e1cc03-3a7b-4242-a1a6-98e756d3d326", "name": "network-vif-plugged", "status": "completed", "tag": "9c67ed58-1b7d-43f4-b23a-74f6094e5f88"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:32.340790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-db636f3e-aac2-446d-9969-4ed0ebc3c8ba req-33bce1a1-ae6e-4cc6-b31b-cee5cf530846 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:32.343046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-db636f3e-aac2-446d-9969-4ed0ebc3c8ba req-33bce1a1-ae6e-4cc6-b31b-cee5cf530846 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:32.344867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-db636f3e-aac2-446d-9969-4ed0ebc3c8ba req-33bce1a1-ae6e-4cc6-b31b-cee5cf530846 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:32.382031 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-db636f3e-aac2-446d-9969-4ed0ebc3c8ba req-33bce1a1-ae6e-4cc6-b31b-cee5cf530846 service nova] Creating event network-vif-plugged:9c67ed58-1b7d-43f4-b23a-74f6094e5f88 for instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 on n-h2-839401-11 Aug 29 15:57:32.395693 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-db636f3e-aac2-446d-9969-4ed0ebc3c8ba req-33bce1a1-ae6e-4cc6-b31b-cee5cf530846 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083506 Aug 29 15:57:32.398198 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3153/6499] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:32.421370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7eb649c7-725a-4f8c-b2e6-80e6086bbeec tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:32.429205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=83 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:32.432768 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7eb649c7-725a-4f8c-b2e6-80e6086bbeec tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1690 microversion: 2.1 time: 0.684873 Aug 29 15:57:32.437587 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3347/6500] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:31 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1690 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:32.691413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-32f0f804-355f-4d0b-b1bb-b4b69290f560 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:32.692928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-32f0f804-355f-4d0b-b1bb-b4b69290f560 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:32.709509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32f0f804-355f-4d0b-b1bb-b4b69290f560 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:32.710131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32f0f804-355f-4d0b-b1bb-b4b69290f560 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:32.710592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32f0f804-355f-4d0b-b1bb-b4b69290f560 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:32.711396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32f0f804-355f-4d0b-b1bb-b4b69290f560 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:32.720267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32f0f804-355f-4d0b-b1bb-b4b69290f560 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:32.720885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-32f0f804-355f-4d0b-b1bb-b4b69290f560 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:33.300291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-32f0f804-355f-4d0b-b1bb-b4b69290f560 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:33.314902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-32f0f804-355f-4d0b-b1bb-b4b69290f560 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:33.316370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-32f0f804-355f-4d0b-b1bb-b4b69290f560 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:33.320282 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-32f0f804-355f-4d0b-b1bb-b4b69290f560 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1407 microversion: 2.20 time: 0.634553 Aug 29 15:57:33.327199 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3154/6501] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:32 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1407 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:33.464250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d4ec34ff-0926-456a-9bcc-147d886653b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:33.464883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d4ec34ff-0926-456a-9bcc-147d886653b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:33.479555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4ec34ff-0926-456a-9bcc-147d886653b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:33.480645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4ec34ff-0926-456a-9bcc-147d886653b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:33.486530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4ec34ff-0926-456a-9bcc-147d886653b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:33.487503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4ec34ff-0926-456a-9bcc-147d886653b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:33.488071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4ec34ff-0926-456a-9bcc-147d886653b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:33.488595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4ec34ff-0926-456a-9bcc-147d886653b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:33.629810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-9ed15496-6c5b-4738-bc7e-b3eb305560d0 req-49b89d0a-326a-4790-bfc8-99867d95c293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972f2acd-0b31-43ab-93a8-9a2a41be43e1", "name": "network-vif-unplugged", "status": "completed", "tag": "24ac9813-3507-47b6-9e86-582a9ad9ccb4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:33.649920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9ed15496-6c5b-4738-bc7e-b3eb305560d0 req-49b89d0a-326a-4790-bfc8-99867d95c293 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:33.651254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9ed15496-6c5b-4738-bc7e-b3eb305560d0 req-49b89d0a-326a-4790-bfc8-99867d95c293 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:33.654120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9ed15496-6c5b-4738-bc7e-b3eb305560d0 req-49b89d0a-326a-4790-bfc8-99867d95c293 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:33.708733 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-9ed15496-6c5b-4738-bc7e-b3eb305560d0 req-49b89d0a-326a-4790-bfc8-99867d95c293 service nova] Creating event network-vif-unplugged:24ac9813-3507-47b6-9e86-582a9ad9ccb4 for instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 on n-h1-839401-11 Aug 29 15:57:33.729624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-9ed15496-6c5b-4738-bc7e-b3eb305560d0 req-49b89d0a-326a-4790-bfc8-99867d95c293 service nova] Instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:57:33.766403 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-9ed15496-6c5b-4738-bc7e-b3eb305560d0 req-49b89d0a-326a-4790-bfc8-99867d95c293 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140839 Aug 29 15:57:33.767194 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3155/6502] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:57:34.014076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d4ec34ff-0926-456a-9bcc-147d886653b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:34.031317 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d4ec34ff-0926-456a-9bcc-147d886653b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1690 microversion: 2.1 time: 0.574972 Aug 29 15:57:34.058767 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3348/6503] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:33 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1690 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:34.354097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-df1db6cd-241d-4168-8b88-1643840cfeab tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:34.355704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-df1db6cd-241d-4168-8b88-1643840cfeab tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:34.387753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df1db6cd-241d-4168-8b88-1643840cfeab tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:34.392856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df1db6cd-241d-4168-8b88-1643840cfeab tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:34.393347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df1db6cd-241d-4168-8b88-1643840cfeab tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:34.394708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df1db6cd-241d-4168-8b88-1643840cfeab tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:34.395189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df1db6cd-241d-4168-8b88-1643840cfeab tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:34.395617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-df1db6cd-241d-4168-8b88-1643840cfeab tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:34.852324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-df1db6cd-241d-4168-8b88-1643840cfeab tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:34.862570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-df1db6cd-241d-4168-8b88-1643840cfeab tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:34.868652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-df1db6cd-241d-4168-8b88-1643840cfeab tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:34.872838 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-df1db6cd-241d-4168-8b88-1643840cfeab tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1599 microversion: 2.20 time: 0.523252 Aug 29 15:57:34.873787 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3156/6504] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:34 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1599 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:57:34.903385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f6bee306-f64c-4438-8f23-1b9d502d4489 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:34.903385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f6bee306-f64c-4438-8f23-1b9d502d4489 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:34.914716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6bee306-f64c-4438-8f23-1b9d502d4489 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:34.915220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6bee306-f64c-4438-8f23-1b9d502d4489 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:34.915663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6bee306-f64c-4438-8f23-1b9d502d4489 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:34.920588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6bee306-f64c-4438-8f23-1b9d502d4489 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:34.921119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6bee306-f64c-4438-8f23-1b9d502d4489 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:34.921575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6bee306-f64c-4438-8f23-1b9d502d4489 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.073881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-72514212-f150-4719-a8f8-e8177cd6809b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:35.074573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-72514212-f150-4719-a8f8-e8177cd6809b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:35.085217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72514212-f150-4719-a8f8-e8177cd6809b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.089334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72514212-f150-4719-a8f8-e8177cd6809b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.096170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72514212-f150-4719-a8f8-e8177cd6809b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.097205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72514212-f150-4719-a8f8-e8177cd6809b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.101586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72514212-f150-4719-a8f8-e8177cd6809b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.102021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72514212-f150-4719-a8f8-e8177cd6809b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.254486 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f6bee306-f64c-4438-8f23-1b9d502d4489 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.355692 Aug 29 15:57:35.255877 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3349/6505] 10.222.0.62 () {60 vars in 1316 bytes} [Mon Aug 29 15:57:34 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326/os-interface => generated 285 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:57:35.828714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-72514212-f150-4719-a8f8-e8177cd6809b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:35.837846 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-72514212-f150-4719-a8f8-e8177cd6809b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1690 microversion: 2.1 time: 0.768648 Aug 29 15:57:35.844721 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3157/6506] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:35 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1690 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:35.864036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e39817be-168f-4fbf-9e44-7a43d66df766 req-767b793b-b8bf-4cf6-88b6-9e3be1f98c78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972f2acd-0b31-43ab-93a8-9a2a41be43e1", "tag": "24ac9813-3507-47b6-9e86-582a9ad9ccb4"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:35.889812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e39817be-168f-4fbf-9e44-7a43d66df766 req-767b793b-b8bf-4cf6-88b6-9e3be1f98c78 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.890655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e39817be-168f-4fbf-9e44-7a43d66df766 req-767b793b-b8bf-4cf6-88b6-9e3be1f98c78 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.893821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e39817be-168f-4fbf-9e44-7a43d66df766 req-767b793b-b8bf-4cf6-88b6-9e3be1f98c78 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.929470 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e39817be-168f-4fbf-9e44-7a43d66df766 req-767b793b-b8bf-4cf6-88b6-9e3be1f98c78 service nova] Creating event network-changed:24ac9813-3507-47b6-9e86-582a9ad9ccb4 for instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 on n-h1-839401-11 Aug 29 15:57:35.945566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-e39817be-168f-4fbf-9e44-7a43d66df766 req-767b793b-b8bf-4cf6-88b6-9e3be1f98c78 service nova] Instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:57:35.976291 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e39817be-168f-4fbf-9e44-7a43d66df766 req-767b793b-b8bf-4cf6-88b6-9e3be1f98c78 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118665 Aug 29 15:57:35.977068 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3350/6507] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:36.866719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-21fb4779-8653-4e34-9bfa-7fb8bba00ab1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:36.867387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-21fb4779-8653-4e34-9bfa-7fb8bba00ab1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:36.882627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21fb4779-8653-4e34-9bfa-7fb8bba00ab1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.888600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21fb4779-8653-4e34-9bfa-7fb8bba00ab1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.889524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21fb4779-8653-4e34-9bfa-7fb8bba00ab1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.892769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21fb4779-8653-4e34-9bfa-7fb8bba00ab1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.893492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21fb4779-8653-4e34-9bfa-7fb8bba00ab1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.894139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-21fb4779-8653-4e34-9bfa-7fb8bba00ab1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:38.143382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-21fb4779-8653-4e34-9bfa-7fb8bba00ab1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:38.156684 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-21fb4779-8653-4e34-9bfa-7fb8bba00ab1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1690 microversion: 2.1 time: 1.294862 Aug 29 15:57:38.160372 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3158/6508] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:36 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1690 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:39.183349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-59ea0079-ff97-4d35-8b8c-80a379d6e053 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:39.184657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-59ea0079-ff97-4d35-8b8c-80a379d6e053 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:39.195504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59ea0079-ff97-4d35-8b8c-80a379d6e053 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:39.198011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59ea0079-ff97-4d35-8b8c-80a379d6e053 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:39.201680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59ea0079-ff97-4d35-8b8c-80a379d6e053 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:39.202635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59ea0079-ff97-4d35-8b8c-80a379d6e053 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:39.203309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59ea0079-ff97-4d35-8b8c-80a379d6e053 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:39.203892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59ea0079-ff97-4d35-8b8c-80a379d6e053 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:40.614217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-59ea0079-ff97-4d35-8b8c-80a379d6e053 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:40.636011 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-59ea0079-ff97-4d35-8b8c-80a379d6e053 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1690 microversion: 2.1 time: 1.454204 Aug 29 15:57:40.637173 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3351/6509] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:39 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1690 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:41.285333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d950873a-b991-43e4-8731-89bac9527093 req-a7aae48b-c293-4723-848b-a80d3163835a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e1cc03-3a7b-4242-a1a6-98e756d3d326", "tag": "9c67ed58-1b7d-43f4-b23a-74f6094e5f88"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:41.303902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d950873a-b991-43e4-8731-89bac9527093 req-a7aae48b-c293-4723-848b-a80d3163835a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:41.307284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d950873a-b991-43e4-8731-89bac9527093 req-a7aae48b-c293-4723-848b-a80d3163835a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:41.307920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d950873a-b991-43e4-8731-89bac9527093 req-a7aae48b-c293-4723-848b-a80d3163835a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:41.334434 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d950873a-b991-43e4-8731-89bac9527093 req-a7aae48b-c293-4723-848b-a80d3163835a service nova] Creating event network-changed:9c67ed58-1b7d-43f4-b23a-74f6094e5f88 for instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 on n-h2-839401-11 Aug 29 15:57:41.354405 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d950873a-b991-43e4-8731-89bac9527093 req-a7aae48b-c293-4723-848b-a80d3163835a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.600563 Aug 29 15:57:41.360132 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3159/6510] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:41.658775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-44d5839a-41c1-4902-910a-9bce681aaf7f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:41.660575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-44d5839a-41c1-4902-910a-9bce681aaf7f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:41.677780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44d5839a-41c1-4902-910a-9bce681aaf7f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:41.680901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44d5839a-41c1-4902-910a-9bce681aaf7f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:41.685278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44d5839a-41c1-4902-910a-9bce681aaf7f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:41.689349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44d5839a-41c1-4902-910a-9bce681aaf7f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:41.692496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44d5839a-41c1-4902-910a-9bce681aaf7f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:41.694901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44d5839a-41c1-4902-910a-9bce681aaf7f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:42.347966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-3b405530-d0a8-431c-a868-ce2cc98ef623 req-482b7454-b9f3-48f9-a0c0-6c929b96df26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972f2acd-0b31-43ab-93a8-9a2a41be43e1", "name": "network-vif-plugged", "status": "completed", "tag": "24ac9813-3507-47b6-9e86-582a9ad9ccb4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:42.384111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3b405530-d0a8-431c-a868-ce2cc98ef623 req-482b7454-b9f3-48f9-a0c0-6c929b96df26 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:42.385577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3b405530-d0a8-431c-a868-ce2cc98ef623 req-482b7454-b9f3-48f9-a0c0-6c929b96df26 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:42.387239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3b405530-d0a8-431c-a868-ce2cc98ef623 req-482b7454-b9f3-48f9-a0c0-6c929b96df26 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:42.404615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-44d5839a-41c1-4902-910a-9bce681aaf7f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:42.423989 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-44d5839a-41c1-4902-910a-9bce681aaf7f tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1683 microversion: 2.1 time: 0.769361 Aug 29 15:57:42.434719 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-3b405530-d0a8-431c-a868-ce2cc98ef623 req-482b7454-b9f3-48f9-a0c0-6c929b96df26 service nova] Creating event network-vif-plugged:24ac9813-3507-47b6-9e86-582a9ad9ccb4 for instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 on n-h1-839401-11 Aug 29 15:57:42.451342 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3352/6511] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:41 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1683 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:42.457774 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-3b405530-d0a8-431c-a868-ce2cc98ef623 req-482b7454-b9f3-48f9-a0c0-6c929b96df26 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112639 Aug 29 15:57:42.464756 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3160/6512] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:10.356530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=27 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:10.358277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=27 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:10.813368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c69fdc6-8a18-4b86-873c-e5b3139a4f78 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Action: 'create', calling method: .version_select at 0x7fc433b51670>, body: {"keypair": {"name": "tempest-TestServerBasicOps-58147319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfB1MZeIo2BEflIkb+QRgj1ejpL+12ljU5dZJ2+o83GCGDY3KXrXFsP/PnJgnvduXp7zBMVQripq6ssY4V6qh/tEUdAv8VhpDybMqgTsVWLrUfnPS1gkT9sP+OybOczgQ=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:10.884825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-5c69fdc6-8a18-4b86-873c-e5b3139a4f78 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Getting quotas for project d302c16ed87f40e7a586c8240f2dcd28. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:58:10.899923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-5c69fdc6-8a18-4b86-873c-e5b3139a4f78 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Getting quotas for user 489ffbc279344b7f9b529123421ec65d and project d302c16ed87f40e7a586c8240f2dcd28. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:58:10.961313 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5c69fdc6-8a18-4b86-873c-e5b3139a4f78 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.612950 Aug 29 15:58:10.969046 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3353/6513] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:58:10 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:13.737368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-723913373", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-58147319", "security_groups": [{"name": "tempest-secgroup-smoke-1871744624"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "5b7c3870-f1b7-4c13-b2a2-ee18d1f6cb8a"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:13.752016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=41 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:13.752909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=59 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:13.937934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] validate_networks() for [('5b7c3870-f1b7-4c13-b2a2-ee18d1f6cb8a', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:58:15.006953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-742548b7-c268-43e9-988c-ee49c1ada47a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:15.009770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-742548b7-c268-43e9-988c-ee49c1ada47a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:15.028657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-742548b7-c268-43e9-988c-ee49c1ada47a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:15.033492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-742548b7-c268-43e9-988c-ee49c1ada47a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:15.034021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-742548b7-c268-43e9-988c-ee49c1ada47a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:15.034796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-742548b7-c268-43e9-988c-ee49c1ada47a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:15.041693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-742548b7-c268-43e9-988c-ee49c1ada47a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:15.042568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-742548b7-c268-43e9-988c-ee49c1ada47a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:15.145290 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-742548b7-c268-43e9-988c-ee49c1ada47a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1/action" status: 200 len: 63204 microversion: 2.1 time: 0.143213 Aug 29 15:58:15.153485 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3354/6514] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 15:58:15 2022] POST /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1/action => generated 63204 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:58:15.709314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Getting quotas for project d302c16ed87f40e7a586c8240f2dcd28. Resources: dict_keys(['metadata_items']) {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:58:15.725442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Getting quotas for user 489ffbc279344b7f9b529123421ec65d and project d302c16ed87f40e7a586c8240f2dcd28. Resources: dict_keys(['metadata_items']) {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:58:15.784111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:58:15.784445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:58:15.785042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:58:15.787089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:58:15.787820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:58:15.799432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:15.800250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:15.800855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:15.801826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:15.802597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:15.803187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:15.855038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Getting quotas for project d302c16ed87f40e7a586c8240f2dcd28. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:58:15.907533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Getting quotas for user 489ffbc279344b7f9b529123421ec65d and project d302c16ed87f40e7a586c8240f2dcd28. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:58:15.951654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:58:15.958281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:58:16.038102 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6056b36a-948c-4105-a2e0-28765486755e tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.305520 Aug 29 15:58:16.040243 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3161/6515] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:58:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 2309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:58:16.052280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1344717d-1633-4028-ba96-3dad45e49045 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:16.053111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1344717d-1633-4028-ba96-3dad45e49045 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:16.212989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1344717d-1633-4028-ba96-3dad45e49045 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:16.222270 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1344717d-1633-4028-ba96-3dad45e49045 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1300 microversion: 2.1 time: 0.174904 Aug 29 15:58:16.222871 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3355/6516] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:16 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1300 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:17.250477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d975e86f-754e-4c6d-9293-35d2361f7752 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:17.250477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d975e86f-754e-4c6d-9293-35d2361f7752 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:17.272115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d975e86f-754e-4c6d-9293-35d2361f7752 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:17.285018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d975e86f-754e-4c6d-9293-35d2361f7752 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:17.290868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d975e86f-754e-4c6d-9293-35d2361f7752 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:17.291862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d975e86f-754e-4c6d-9293-35d2361f7752 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:17.292655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d975e86f-754e-4c6d-9293-35d2361f7752 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:17.293334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d975e86f-754e-4c6d-9293-35d2361f7752 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:17.428823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d975e86f-754e-4c6d-9293-35d2361f7752 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:17.437040 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d975e86f-754e-4c6d-9293-35d2361f7752 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1352 microversion: 2.1 time: 0.195445 Aug 29 15:58:17.437719 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3162/6517] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:17 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1352 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:18.460236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8f989d98-7c20-48c3-a7b2-544942d57df0 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:18.461505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8f989d98-7c20-48c3-a7b2-544942d57df0 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:18.476819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f989d98-7c20-48c3-a7b2-544942d57df0 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:18.477356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f989d98-7c20-48c3-a7b2-544942d57df0 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:18.479782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f989d98-7c20-48c3-a7b2-544942d57df0 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:18.480848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f989d98-7c20-48c3-a7b2-544942d57df0 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:18.483281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f989d98-7c20-48c3-a7b2-544942d57df0 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:18.484809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8f989d98-7c20-48c3-a7b2-544942d57df0 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:18.628788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8f989d98-7c20-48c3-a7b2-544942d57df0 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:18.638409 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8f989d98-7c20-48c3-a7b2-544942d57df0 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1358 microversion: 2.1 time: 0.183864 Aug 29 15:58:18.649471 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3356/6518] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:18 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:19.660404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c54f9ce0-051c-4453-b181-895bae29a727 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:19.660957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c54f9ce0-051c-4453-b181-895bae29a727 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:19.673498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c54f9ce0-051c-4453-b181-895bae29a727 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:19.674293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c54f9ce0-051c-4453-b181-895bae29a727 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:19.677075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c54f9ce0-051c-4453-b181-895bae29a727 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:19.678041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c54f9ce0-051c-4453-b181-895bae29a727 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:19.679010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c54f9ce0-051c-4453-b181-895bae29a727 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:19.679706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c54f9ce0-051c-4453-b181-895bae29a727 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:19.780619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c54f9ce0-051c-4453-b181-895bae29a727 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:19.792210 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c54f9ce0-051c-4453-b181-895bae29a727 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1358 microversion: 2.1 time: 0.136201 Aug 29 15:58:19.818927 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3163/6519] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:19 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1358 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:20.817237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d2996b5a-9e3a-42dc-abeb-dbbaec87b184 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:20.818779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d2996b5a-9e3a-42dc-abeb-dbbaec87b184 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:20.868466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2996b5a-9e3a-42dc-abeb-dbbaec87b184 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:20.869098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2996b5a-9e3a-42dc-abeb-dbbaec87b184 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:20.869568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2996b5a-9e3a-42dc-abeb-dbbaec87b184 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:20.870358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2996b5a-9e3a-42dc-abeb-dbbaec87b184 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:20.870829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2996b5a-9e3a-42dc-abeb-dbbaec87b184 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:20.871267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2996b5a-9e3a-42dc-abeb-dbbaec87b184 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:21.187326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d2996b5a-9e3a-42dc-abeb-dbbaec87b184 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:21.201850 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d2996b5a-9e3a-42dc-abeb-dbbaec87b184 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1426 microversion: 2.1 time: 0.388495 Aug 29 15:58:21.202504 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3357/6520] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:20 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1426 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:21.282646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-3a241938-5210-4908-8096-3cc716e689c5 req-0cde040c-48c2-4291-a2e4-9071dd62b249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046", "tag": "6234a08d-953c-411e-a4f9-341264f6d2d6"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:21.310707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3a241938-5210-4908-8096-3cc716e689c5 req-0cde040c-48c2-4291-a2e4-9071dd62b249 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:21.311199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3a241938-5210-4908-8096-3cc716e689c5 req-0cde040c-48c2-4291-a2e4-9071dd62b249 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:21.311637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3a241938-5210-4908-8096-3cc716e689c5 req-0cde040c-48c2-4291-a2e4-9071dd62b249 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:21.346050 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-3a241938-5210-4908-8096-3cc716e689c5 req-0cde040c-48c2-4291-a2e4-9071dd62b249 service nova] Creating event network-changed:6234a08d-953c-411e-a4f9-341264f6d2d6 for instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 on n-h1-839401-11 Aug 29 15:58:21.357311 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-3a241938-5210-4908-8096-3cc716e689c5 req-0cde040c-48c2-4291-a2e4-9071dd62b249 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078355 Aug 29 15:58:21.361380 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3164/6521] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:22.223635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9f36e3a7-c0cd-4171-8c2e-00581f70de7a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:22.225026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9f36e3a7-c0cd-4171-8c2e-00581f70de7a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:22.250893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f36e3a7-c0cd-4171-8c2e-00581f70de7a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:22.251805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f36e3a7-c0cd-4171-8c2e-00581f70de7a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:22.252473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f36e3a7-c0cd-4171-8c2e-00581f70de7a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:22.253635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f36e3a7-c0cd-4171-8c2e-00581f70de7a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:22.254323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f36e3a7-c0cd-4171-8c2e-00581f70de7a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:22.254974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f36e3a7-c0cd-4171-8c2e-00581f70de7a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:22.809560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9f36e3a7-c0cd-4171-8c2e-00581f70de7a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:22.822051 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9f36e3a7-c0cd-4171-8c2e-00581f70de7a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1426 microversion: 2.1 time: 0.602108 Aug 29 15:58:22.823158 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3358/6522] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:22 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1426 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:23.845766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-37099461-87bf-405a-ad3b-0a78f347afba tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:23.847113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-37099461-87bf-405a-ad3b-0a78f347afba tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:23.859260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37099461-87bf-405a-ad3b-0a78f347afba tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:23.859764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37099461-87bf-405a-ad3b-0a78f347afba tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:23.860213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37099461-87bf-405a-ad3b-0a78f347afba tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:23.860965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37099461-87bf-405a-ad3b-0a78f347afba tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:23.861471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37099461-87bf-405a-ad3b-0a78f347afba tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:23.868191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37099461-87bf-405a-ad3b-0a78f347afba tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:24.163441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-37099461-87bf-405a-ad3b-0a78f347afba tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:24.171964 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-37099461-87bf-405a-ad3b-0a78f347afba tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1426 microversion: 2.1 time: 0.332932 Aug 29 15:58:24.175183 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3165/6523] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:23 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1426 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:25.208186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-436fde32-7489-41e8-b62c-9cceeec2e7f7 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:25.209251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-436fde32-7489-41e8-b62c-9cceeec2e7f7 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:25.222654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-436fde32-7489-41e8-b62c-9cceeec2e7f7 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:25.223678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-436fde32-7489-41e8-b62c-9cceeec2e7f7 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:25.224154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-436fde32-7489-41e8-b62c-9cceeec2e7f7 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:25.224890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-436fde32-7489-41e8-b62c-9cceeec2e7f7 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:25.229525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-436fde32-7489-41e8-b62c-9cceeec2e7f7 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:25.230028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-436fde32-7489-41e8-b62c-9cceeec2e7f7 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:26.221926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-436fde32-7489-41e8-b62c-9cceeec2e7f7 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:26.229871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:26.266889 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-436fde32-7489-41e8-b62c-9cceeec2e7f7 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1426 microversion: 2.1 time: 1.073767 Aug 29 15:58:26.269449 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3359/6524] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:25 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1426 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:27.288838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ae8402a7-739a-4c3b-80e2-2aeb637d625d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:27.290171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ae8402a7-739a-4c3b-80e2-2aeb637d625d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:27.295366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:27.301808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=10 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:27.322960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae8402a7-739a-4c3b-80e2-2aeb637d625d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.331914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae8402a7-739a-4c3b-80e2-2aeb637d625d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.332463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae8402a7-739a-4c3b-80e2-2aeb637d625d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.333336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae8402a7-739a-4c3b-80e2-2aeb637d625d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.334314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae8402a7-739a-4c3b-80e2-2aeb637d625d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.334822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae8402a7-739a-4c3b-80e2-2aeb637d625d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.945854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ae8402a7-739a-4c3b-80e2-2aeb637d625d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:27.966481 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ae8402a7-739a-4c3b-80e2-2aeb637d625d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1426 microversion: 2.1 time: 0.682348 Aug 29 15:58:27.970929 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3166/6525] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:27 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1426 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:28.991307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2b466469-4fbe-4666-9ca3-af62a998ff1d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:28.991926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2b466469-4fbe-4666-9ca3-af62a998ff1d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:29.004315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b466469-4fbe-4666-9ca3-af62a998ff1d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:29.013953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b466469-4fbe-4666-9ca3-af62a998ff1d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:29.015026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b466469-4fbe-4666-9ca3-af62a998ff1d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:29.015896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b466469-4fbe-4666-9ca3-af62a998ff1d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:29.016634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b466469-4fbe-4666-9ca3-af62a998ff1d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:29.018902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b466469-4fbe-4666-9ca3-af62a998ff1d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:29.794209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2b466469-4fbe-4666-9ca3-af62a998ff1d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:29.808256 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2b466469-4fbe-4666-9ca3-af62a998ff1d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1426 microversion: 2.1 time: 0.820913 Aug 29 15:58:29.809188 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3360/6526] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:28 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1426 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:30.834199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2a2b5710-5804-4ee2-b416-a00e0f14d98c tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:30.834675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2a2b5710-5804-4ee2-b416-a00e0f14d98c tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:30.852159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a2b5710-5804-4ee2-b416-a00e0f14d98c tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:30.852665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a2b5710-5804-4ee2-b416-a00e0f14d98c tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:30.862183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a2b5710-5804-4ee2-b416-a00e0f14d98c tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:30.863571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a2b5710-5804-4ee2-b416-a00e0f14d98c tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:30.866658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a2b5710-5804-4ee2-b416-a00e0f14d98c tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:30.867105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a2b5710-5804-4ee2-b416-a00e0f14d98c tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.287398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2a2b5710-5804-4ee2-b416-a00e0f14d98c tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:31.308984 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2a2b5710-5804-4ee2-b416-a00e0f14d98c tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1426 microversion: 2.1 time: 0.478260 Aug 29 15:58:31.316071 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3167/6527] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:30 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1426 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:31.533792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-03a8804b-0df3-43d9-8af1-14de8b88cf44 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:31.537483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-03a8804b-0df3-43d9-8af1-14de8b88cf44 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:31.553350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-5f8c28cd-fe69-428d-8f27-4ce7d61a1213 req-60958be6-f31b-49be-8e53-abc58c7bcada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046", "name": "network-vif-plugged", "status": "completed", "tag": "6234a08d-953c-411e-a4f9-341264f6d2d6"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:31.554944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03a8804b-0df3-43d9-8af1-14de8b88cf44 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.555464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03a8804b-0df3-43d9-8af1-14de8b88cf44 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.555913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03a8804b-0df3-43d9-8af1-14de8b88cf44 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.556652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03a8804b-0df3-43d9-8af1-14de8b88cf44 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.578700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03a8804b-0df3-43d9-8af1-14de8b88cf44 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.579362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03a8804b-0df3-43d9-8af1-14de8b88cf44 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.579608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5f8c28cd-fe69-428d-8f27-4ce7d61a1213 req-60958be6-f31b-49be-8e53-abc58c7bcada service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.580542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5f8c28cd-fe69-428d-8f27-4ce7d61a1213 req-60958be6-f31b-49be-8e53-abc58c7bcada service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.582969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5f8c28cd-fe69-428d-8f27-4ce7d61a1213 req-60958be6-f31b-49be-8e53-abc58c7bcada service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.614240 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5f8c28cd-fe69-428d-8f27-4ce7d61a1213 req-60958be6-f31b-49be-8e53-abc58c7bcada service nova] Creating event network-vif-plugged:6234a08d-953c-411e-a4f9-341264f6d2d6 for instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 on n-h1-839401-11 Aug 29 15:58:31.632025 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-5f8c28cd-fe69-428d-8f27-4ce7d61a1213 req-60958be6-f31b-49be-8e53-abc58c7bcada service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080036 Aug 29 15:58:31.635808 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3168/6528] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:32.343186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b493dcde-a374-45b9-8150-8c7dd9588bd5 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:32.344176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b493dcde-a374-45b9-8150-8c7dd9588bd5 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:32.405746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b493dcde-a374-45b9-8150-8c7dd9588bd5 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:32.406510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b493dcde-a374-45b9-8150-8c7dd9588bd5 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:32.410375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b493dcde-a374-45b9-8150-8c7dd9588bd5 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:32.411544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b493dcde-a374-45b9-8150-8c7dd9588bd5 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:32.413227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b493dcde-a374-45b9-8150-8c7dd9588bd5 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:32.414955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b493dcde-a374-45b9-8150-8c7dd9588bd5 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:32.475043 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-03a8804b-0df3-43d9-8af1-14de8b88cf44 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1836 microversion: 2.1 time: 0.944998 Aug 29 15:58:32.479303 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3361/6529] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:31 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1836 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:33.322641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b493dcde-a374-45b9-8150-8c7dd9588bd5 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:33.341461 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b493dcde-a374-45b9-8150-8c7dd9588bd5 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1426 microversion: 2.1 time: 1.003956 Aug 29 15:58:33.342108 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3169/6530] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:32 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1426 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:34.368915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-907f527a-a739-4914-84c5-dc052d3710ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:34.373264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-907f527a-a739-4914-84c5-dc052d3710ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:34.402006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-907f527a-a739-4914-84c5-dc052d3710ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:34.402510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-907f527a-a739-4914-84c5-dc052d3710ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:34.402977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-907f527a-a739-4914-84c5-dc052d3710ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:34.414158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-907f527a-a739-4914-84c5-dc052d3710ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:34.416344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-907f527a-a739-4914-84c5-dc052d3710ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:34.422171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-907f527a-a739-4914-84c5-dc052d3710ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:35.636915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-907f527a-a739-4914-84c5-dc052d3710ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:35.653182 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-907f527a-a739-4914-84c5-dc052d3710ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1605 microversion: 2.1 time: 1.288540 Aug 29 15:58:35.656773 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3362/6531] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:34 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1605 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:35.681061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-27eb8bc6-e561-49b1-aafd-f116f58f51ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:35.681705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-27eb8bc6-e561-49b1-aafd-f116f58f51ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:35.698486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27eb8bc6-e561-49b1-aafd-f116f58f51ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:35.698991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27eb8bc6-e561-49b1-aafd-f116f58f51ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:35.699434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27eb8bc6-e561-49b1-aafd-f116f58f51ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:35.700158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27eb8bc6-e561-49b1-aafd-f116f58f51ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:35.700824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27eb8bc6-e561-49b1-aafd-f116f58f51ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:35.701121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27eb8bc6-e561-49b1-aafd-f116f58f51ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:36.430590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-27eb8bc6-e561-49b1-aafd-f116f58f51ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:36.442444 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-27eb8bc6-e561-49b1-aafd-f116f58f51ed tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1605 microversion: 2.1 time: 0.765546 Aug 29 15:58:36.443089 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3170/6532] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:35 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1605 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:36.467756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b5213064-ba55-40b9-a4fe-7a6cb09eface tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:36.468675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b5213064-ba55-40b9-a4fe-7a6cb09eface tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:36.488514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5213064-ba55-40b9-a4fe-7a6cb09eface tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:36.489657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5213064-ba55-40b9-a4fe-7a6cb09eface tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:36.490530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5213064-ba55-40b9-a4fe-7a6cb09eface tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:36.491939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5213064-ba55-40b9-a4fe-7a6cb09eface tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:36.492929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5213064-ba55-40b9-a4fe-7a6cb09eface tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:36.493617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5213064-ba55-40b9-a4fe-7a6cb09eface tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:37.154023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b5213064-ba55-40b9-a4fe-7a6cb09eface tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:37.162615 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b5213064-ba55-40b9-a4fe-7a6cb09eface tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1605 microversion: 2.1 time: 0.698651 Aug 29 15:58:37.166522 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3363/6533] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:36 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1605 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:37.198081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d438b2f8-d0c5-4656-956c-71af9c756de5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:37.198712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d438b2f8-d0c5-4656-956c-71af9c756de5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:37.219356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d438b2f8-d0c5-4656-956c-71af9c756de5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:37.219869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d438b2f8-d0c5-4656-956c-71af9c756de5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:37.220314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d438b2f8-d0c5-4656-956c-71af9c756de5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:37.221070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d438b2f8-d0c5-4656-956c-71af9c756de5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:37.229128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d438b2f8-d0c5-4656-956c-71af9c756de5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:37.229631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d438b2f8-d0c5-4656-956c-71af9c756de5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:37.302057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-05cbfe78-6e0b-415a-8478-0440fbeb673f req-ae944e65-5895-40e5-a75f-0baac50c88a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972f2acd-0b31-43ab-93a8-9a2a41be43e1", "tag": "24ac9813-3507-47b6-9e86-582a9ad9ccb4"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:37.307501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d438b2f8-d0c5-4656-956c-71af9c756de5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:58:37.329778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-05cbfe78-6e0b-415a-8478-0440fbeb673f req-ae944e65-5895-40e5-a75f-0baac50c88a4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:37.331949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-05cbfe78-6e0b-415a-8478-0440fbeb673f req-ae944e65-5895-40e5-a75f-0baac50c88a4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:37.334669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-05cbfe78-6e0b-415a-8478-0440fbeb673f req-ae944e65-5895-40e5-a75f-0baac50c88a4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:37.366749 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-05cbfe78-6e0b-415a-8478-0440fbeb673f req-ae944e65-5895-40e5-a75f-0baac50c88a4 service nova] Creating event network-changed:24ac9813-3507-47b6-9e86-582a9ad9ccb4 for instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 on n-h1-839401-11 Aug 29 15:58:37.382281 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-05cbfe78-6e0b-415a-8478-0440fbeb673f req-ae944e65-5895-40e5-a75f-0baac50c88a4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086893 Aug 29 15:58:37.389048 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3364/6534] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:37.512167 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d438b2f8-d0c5-4656-956c-71af9c756de5 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "DELETE /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 204 len: 0 microversion: 2.1 time: 0.318061 Aug 29 15:58:37.513318 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3171/6535] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 15:58:37 2022] DELETE /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:58:37.525535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3dbd2f3f-02f7-4ee6-87f4-8077a9edb1b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:37.526479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3dbd2f3f-02f7-4ee6-87f4-8077a9edb1b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:37.544619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dbd2f3f-02f7-4ee6-87f4-8077a9edb1b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:37.545151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dbd2f3f-02f7-4ee6-87f4-8077a9edb1b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:37.545600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dbd2f3f-02f7-4ee6-87f4-8077a9edb1b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:37.546317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dbd2f3f-02f7-4ee6-87f4-8077a9edb1b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:37.546837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dbd2f3f-02f7-4ee6-87f4-8077a9edb1b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:37.547267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dbd2f3f-02f7-4ee6-87f4-8077a9edb1b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:38.119641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3dbd2f3f-02f7-4ee6-87f4-8077a9edb1b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:38.131451 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3dbd2f3f-02f7-4ee6-87f4-8077a9edb1b8 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1689 microversion: 2.1 time: 0.610893 Aug 29 15:58:38.133798 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3365/6536] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:37 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1689 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:39.159591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d2dd0b67-4fc0-4f5a-a492-a2ad6e5fde13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:39.161007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d2dd0b67-4fc0-4f5a-a492-a2ad6e5fde13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:39.175798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2dd0b67-4fc0-4f5a-a492-a2ad6e5fde13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:39.176807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2dd0b67-4fc0-4f5a-a492-a2ad6e5fde13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:39.177462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2dd0b67-4fc0-4f5a-a492-a2ad6e5fde13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:39.181588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2dd0b67-4fc0-4f5a-a492-a2ad6e5fde13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:39.183225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2dd0b67-4fc0-4f5a-a492-a2ad6e5fde13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:39.184241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2dd0b67-4fc0-4f5a-a492-a2ad6e5fde13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:40.343578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d2dd0b67-4fc0-4f5a-a492-a2ad6e5fde13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:40.359513 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d2dd0b67-4fc0-4f5a-a492-a2ad6e5fde13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1689 microversion: 2.1 time: 1.204881 Aug 29 15:58:40.360376 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3172/6537] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:39 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1689 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:40.972202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aae18fce-2364-46a9-857d-c588d6496d28 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1464519861", "availability_zone": "foo_zone"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:40.978083 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.aggregate [None req-aae18fce-2364-46a9-857d-c588d6496d28 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Generated uuid a361f48a-7942-4ce6-82b9-30416c2ffaa2 for aggregate {{(pid=122360) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:58:40.985585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:41.013651 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aae18fce-2364-46a9-857d-c588d6496d28 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.214071 Aug 29 15:58:41.020924 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3366/6538] 10.222.0.62 () {60 vars in 1164 bytes} [Mon Aug 29 15:58:40 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:41.027843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9b7ae1c9-d87b-4755-8b48-23c0e7fcd83b tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:41.057825 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9b7ae1c9-d87b-4755-8b48-23c0e7fcd83b tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.034658 Aug 29 15:58:41.059475 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3173/6539] 10.222.0.62 () {60 vars in 1194 bytes} [Mon Aug 29 15:58:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:41.070525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c5229df6-e0dc-48b2-8e9b-04c85c30ace8 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:41.074482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5229df6-e0dc-48b2-8e9b-04c85c30ace8 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:41.074978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5229df6-e0dc-48b2-8e9b-04c85c30ace8 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:41.075431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5229df6-e0dc-48b2-8e9b-04c85c30ace8 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:41.076154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5229df6-e0dc-48b2-8e9b-04c85c30ace8 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:41.076793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5229df6-e0dc-48b2-8e9b-04c85c30ace8 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:41.077403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5229df6-e0dc-48b2-8e9b-04c85c30ace8 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:41.084657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=61 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:41.109722 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c5229df6-e0dc-48b2-8e9b-04c85c30ace8 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] 10.222.0.62 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.042956 Aug 29 15:58:41.110968 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3367/6540] 10.222.0.62 () {58 vars in 1176 bytes} [Mon Aug 29 15:58:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:41.123425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b3a3afe6-59b6-45ce-81e6-88251a5d1a50 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:41.133878 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b3a3afe6-59b6-45ce-81e6-88251a5d1a50 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] 10.222.0.62 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.013877 Aug 29 15:58:41.134851 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3174/6541] 10.222.0.62 () {58 vars in 1143 bytes} [Mon Aug 29 15:58:41 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:41.147773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7e134d05-7eb8-454b-b589-4bce2dd29575 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-839401-11"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:41.160176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e134d05-7eb8-454b-b589-4bce2dd29575 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:41.160699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e134d05-7eb8-454b-b589-4bce2dd29575 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:41.161912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e134d05-7eb8-454b-b589-4bce2dd29575 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:41.382677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8f6db524-d397-4aed-9167-6401d2620831 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:41.384304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8f6db524-d397-4aed-9167-6401d2620831 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:41.393591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f6db524-d397-4aed-9167-6401d2620831 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:41.394497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f6db524-d397-4aed-9167-6401d2620831 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:41.395172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f6db524-d397-4aed-9167-6401d2620831 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:41.396229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f6db524-d397-4aed-9167-6401d2620831 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:41.397112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f6db524-d397-4aed-9167-6401d2620831 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:41.397816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f6db524-d397-4aed-9167-6401d2620831 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:41.473159 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7e134d05-7eb8-454b-b589-4bce2dd29575 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.329720 Aug 29 15:58:41.474559 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3368/6542] 10.222.0.62 () {60 vars in 1194 bytes} [Mon Aug 29 15:58:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:41.488499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-30260304-17b1-42e7-8498-9eda831c6e87 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:41.508893 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-30260304-17b1-42e7-8498-9eda831c6e87 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] 10.222.0.62 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.026610 Aug 29 15:58:41.516128 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3369/6543] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:58:41 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:41.523820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7a90cd14-a559-4743-9a41-cfc7ccd91b91 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1975849345", "availability_zone": "foo_zone"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:41.595792 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7a90cd14-a559-4743-9a41-cfc7ccd91b91 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] 10.222.0.62 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.077152 Aug 29 15:58:41.597572 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3370/6544] 10.222.0.62 () {60 vars in 1173 bytes} [Mon Aug 29 15:58:41 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:41.611786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-86ef138e-817b-4fc6-b858-20a84bfb41cd tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:41.656487 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-86ef138e-817b-4fc6-b858-20a84bfb41cd tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.051095 Aug 29 15:58:41.663393 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3371/6545] 10.222.0.62 () {60 vars in 1194 bytes} [Mon Aug 29 15:58:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:41.672767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4147f5be-20e5-46bc-ba13-dc696ff33f22 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:41.701239 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4147f5be-20e5-46bc-ba13-dc696ff33f22 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] 10.222.0.62 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.035984 Aug 29 15:58:41.704210 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3372/6546] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Aug 29 15:58:41 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:41.735364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a2ddf175-648f-4461-9b64-029d6f213f82 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-839401-11"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:41.761079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2ddf175-648f-4461-9b64-029d6f213f82 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:41.764092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2ddf175-648f-4461-9b64-029d6f213f82 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:41.764759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2ddf175-648f-4461-9b64-029d6f213f82 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:42.067713 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a2ddf175-648f-4461-9b64-029d6f213f82 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] 10.222.0.62 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.346461 Aug 29 15:58:42.078837 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3373/6547] 10.222.0.62 () {60 vars in 1194 bytes} [Mon Aug 29 15:58:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:42.100336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d0c7b1db-fea4-44d0-9ccd-62b350f59ed6 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:42.149051 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d0c7b1db-fea4-44d0-9ccd-62b350f59ed6 tempest-TestAggregatesBasicOps-1413771898 tempest-TestAggregatesBasicOps-1413771898-project-admin] 10.222.0.62 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.069095 Aug 29 15:58:42.155072 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3374/6548] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 15:58:42 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:58:42.217442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-7fcbc5a2-3edf-4980-ad78-850a3f4f5997 req-22fa0e78-b87b-48c6-b53c-cf8a5bacc32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972f2acd-0b31-43ab-93a8-9a2a41be43e1", "name": "network-vif-unplugged", "status": "completed", "tag": "24ac9813-3507-47b6-9e86-582a9ad9ccb4"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:42.240524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7fcbc5a2-3edf-4980-ad78-850a3f4f5997 req-22fa0e78-b87b-48c6-b53c-cf8a5bacc32d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:42.241035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7fcbc5a2-3edf-4980-ad78-850a3f4f5997 req-22fa0e78-b87b-48c6-b53c-cf8a5bacc32d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:42.241498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7fcbc5a2-3edf-4980-ad78-850a3f4f5997 req-22fa0e78-b87b-48c6-b53c-cf8a5bacc32d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:42.275936 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-7fcbc5a2-3edf-4980-ad78-850a3f4f5997 req-22fa0e78-b87b-48c6-b53c-cf8a5bacc32d service nova] Creating event network-vif-unplugged:24ac9813-3507-47b6-9e86-582a9ad9ccb4 for instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 on n-h1-839401-11 Aug 29 15:58:42.290149 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-7fcbc5a2-3edf-4980-ad78-850a3f4f5997 req-22fa0e78-b87b-48c6-b53c-cf8a5bacc32d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078116 Aug 29 15:58:42.290149 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3375/6549] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:42.687774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8f6db524-d397-4aed-9167-6401d2620831 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:42.706004 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8f6db524-d397-4aed-9167-6401d2620831 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1689 microversion: 2.1 time: 1.325730 Aug 29 15:58:42.713435 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3175/6550] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:41 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1689 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:43.129194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-17fd163d-39b8-4d01-95c4-59da8f957f34 req-06582b2d-cc08-445a-999e-ccf8ce750974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972f2acd-0b31-43ab-93a8-9a2a41be43e1", "name": "network-vif-deleted", "tag": "24ac9813-3507-47b6-9e86-582a9ad9ccb4"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:43.156690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-17fd163d-39b8-4d01-95c4-59da8f957f34 req-06582b2d-cc08-445a-999e-ccf8ce750974 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:43.159090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-17fd163d-39b8-4d01-95c4-59da8f957f34 req-06582b2d-cc08-445a-999e-ccf8ce750974 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:43.159575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-17fd163d-39b8-4d01-95c4-59da8f957f34 req-06582b2d-cc08-445a-999e-ccf8ce750974 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:43.201895 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-17fd163d-39b8-4d01-95c4-59da8f957f34 req-06582b2d-cc08-445a-999e-ccf8ce750974 service nova] Creating event network-vif-deleted:24ac9813-3507-47b6-9e86-582a9ad9ccb4 for instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 on n-h1-839401-11 Aug 29 15:58:43.231835 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-17fd163d-39b8-4d01-95c4-59da8f957f34 req-06582b2d-cc08-445a-999e-ccf8ce750974 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107794 Aug 29 15:58:43.233290 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3376/6551] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:43.735510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e4431fb2-7c4a-4e9d-b28e-5915f4cffd13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:43.736142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e4431fb2-7c4a-4e9d-b28e-5915f4cffd13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:43.743885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4431fb2-7c4a-4e9d-b28e-5915f4cffd13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:43.744595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4431fb2-7c4a-4e9d-b28e-5915f4cffd13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:43.745486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4431fb2-7c4a-4e9d-b28e-5915f4cffd13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:43.747139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4431fb2-7c4a-4e9d-b28e-5915f4cffd13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:43.747785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4431fb2-7c4a-4e9d-b28e-5915f4cffd13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:43.748380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4431fb2-7c4a-4e9d-b28e-5915f4cffd13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:43.784178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:43.798110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:43.804630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4431fb2-7c4a-4e9d-b28e-5915f4cffd13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:43.805497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4431fb2-7c4a-4e9d-b28e-5915f4cffd13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:43.806127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4431fb2-7c4a-4e9d-b28e-5915f4cffd13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:43.806820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-e4431fb2-7c4a-4e9d-b28e-5915f4cffd13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lazy-loading 'fault' on Instance uuid 972f2acd-0b31-43ab-93a8-9a2a41be43e1 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:58:44.031545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e4431fb2-7c4a-4e9d-b28e-5915f4cffd13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:44.040747 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e4431fb2-7c4a-4e9d-b28e-5915f4cffd13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 200 len: 1356 microversion: 2.1 time: 0.315738 Aug 29 15:58:44.041395 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3176/6552] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:43 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 1356 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:44.691577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d6723e5-0fcb-495d-b220-ba611c1d709f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:44.692175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2d6723e5-0fcb-495d-b220-ba611c1d709f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:44.730913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d6723e5-0fcb-495d-b220-ba611c1d709f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:44.734517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d6723e5-0fcb-495d-b220-ba611c1d709f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:44.739731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d6723e5-0fcb-495d-b220-ba611c1d709f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:44.741809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d6723e5-0fcb-495d-b220-ba611c1d709f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:44.745622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d6723e5-0fcb-495d-b220-ba611c1d709f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:44.746479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d6723e5-0fcb-495d-b220-ba611c1d709f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:44.809610 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d6723e5-0fcb-495d-b220-ba611c1d709f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326/ips" status: 200 len: 152 microversion: 2.20 time: 0.129017 Aug 29 15:58:44.819726 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3377/6553] 10.222.0.62 () {60 vars in 1289 bytes} [Mon Aug 29 15:58:44 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326/ips => generated 152 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:58:45.064558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2ca042ee-72bf-4bac-8e92-b39647e4a890 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:45.065232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2ca042ee-72bf-4bac-8e92-b39647e4a890 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 972f2acd-0b31-43ab-93a8-9a2a41be43e1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:45.082112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ca042ee-72bf-4bac-8e92-b39647e4a890 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:45.082614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ca042ee-72bf-4bac-8e92-b39647e4a890 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:45.086820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ca042ee-72bf-4bac-8e92-b39647e4a890 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:45.087665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ca042ee-72bf-4bac-8e92-b39647e4a890 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:45.090339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ca042ee-72bf-4bac-8e92-b39647e4a890 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:45.090797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ca042ee-72bf-4bac-8e92-b39647e4a890 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:45.129310 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-2ca042ee-72bf-4bac-8e92-b39647e4a890 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] HTTP exception thrown: Instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 could not be found. Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2ca042ee-72bf-4bac-8e92-b39647e4a890 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Request method failure captured: Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 HTTP/1.1 Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOB3Svc4jYi_sdqstP8fut48z-Az-vRMtuk-EyuIwnH-xZ_3sKRpgA4G5XF7KP-cMjjpzT9196nhz_6F5C-ZYBvXK1KNFkDO7Pn9b9qPE-UYVu5R2LY-PIrVIejaJCCfnNMTNd864tfoTDZYIqBxVW7iKDXVNaNr9KOQ6yBnoKzm0XU Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 63c8e858d9064ae3875d91e8a43f7ee4 Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1699754938 Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_63c8e858d9064ae3875d91e8a43f7ee4", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/63c8e858d9064ae3875d91e8a43f7ee4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/63c8e858d9064ae3875d91e8a43f7ee4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/63c8e858d9064ae3875d91e8a43f7ee4"}]}] Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1699754938 Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 63c8e858d9064ae3875d91e8a43f7ee4 Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1699754938 Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestNetworkAdvancedServerOps-1699754938-project Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 008972030ade418cb180f0702ae168b4 Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1699754938-project Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 could not be found. Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '972f2acd-0b31-43ab-93a8-9a2a41be43e1'} Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 could not be found. Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 could not be found. Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:58:45.134061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:45.139414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:58:45.139414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:45.139414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:45.139414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:45.139414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:58:45.139414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:58:45.139414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 could not be found. Aug 29 15:58:45.139414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 15:58:45.139414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2ca042ee-72bf-4bac-8e92-b39647e4a890 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Returning 404 to user: Instance 972f2acd-0b31-43ab-93a8-9a2a41be43e1 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:45.139414 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2ca042ee-72bf-4bac-8e92-b39647e4a890 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1" status: 404 len: 111 microversion: 2.1 time: 0.076914 Aug 29 15:58:45.139414 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3177/6554] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:45 2022] GET /compute/v2.1/servers/972f2acd-0b31-43ab-93a8-9a2a41be43e1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:58:45.365535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-32d10ba6-caf6-421b-b5fb-70aae5bf28ee req-12ec624c-2ad0-44fe-92ee-de804f89b952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046", "tag": "6234a08d-953c-411e-a4f9-341264f6d2d6"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:45.427460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-32d10ba6-caf6-421b-b5fb-70aae5bf28ee req-12ec624c-2ad0-44fe-92ee-de804f89b952 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:45.430177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-32d10ba6-caf6-421b-b5fb-70aae5bf28ee req-12ec624c-2ad0-44fe-92ee-de804f89b952 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:45.432888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-32d10ba6-caf6-421b-b5fb-70aae5bf28ee req-12ec624c-2ad0-44fe-92ee-de804f89b952 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:45.498177 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-32d10ba6-caf6-421b-b5fb-70aae5bf28ee req-12ec624c-2ad0-44fe-92ee-de804f89b952 service nova] Creating event network-changed:6234a08d-953c-411e-a4f9-341264f6d2d6 for instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 on n-h1-839401-11 Aug 29 15:58:45.516257 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-32d10ba6-caf6-421b-b5fb-70aae5bf28ee req-12ec624c-2ad0-44fe-92ee-de804f89b952 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161219 Aug 29 15:58:45.519762 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3378/6555] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:48.261883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e2bbea4f-7ea9-43d9-a57c-eff328c6e60f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:48.263786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e2bbea4f-7ea9-43d9-a57c-eff328c6e60f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:48.290188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2bbea4f-7ea9-43d9-a57c-eff328c6e60f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:48.292048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2bbea4f-7ea9-43d9-a57c-eff328c6e60f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:48.292681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2bbea4f-7ea9-43d9-a57c-eff328c6e60f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:48.296365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2bbea4f-7ea9-43d9-a57c-eff328c6e60f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:48.297150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2bbea4f-7ea9-43d9-a57c-eff328c6e60f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:48.297756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2bbea4f-7ea9-43d9-a57c-eff328c6e60f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:48.358010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-e2bbea4f-7ea9-43d9-a57c-eff328c6e60f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lazy-loading 'flavor' on Instance uuid d8e1cc03-3a7b-4242-a1a6-98e756d3d326 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:58:48.695565 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e2bbea4f-7ea9-43d9-a57c-eff328c6e60f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "POST /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326/action" status: 202 len: 0 microversion: 2.20 time: 0.439466 Aug 29 15:58:48.697745 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3178/6556] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 15:58:48 2022] POST /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:58:48.708754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-abc2db12-7211-4dc4-b4f8-f7fdca4c0325 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:48.710300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-abc2db12-7211-4dc4-b4f8-f7fdca4c0325 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:48.733205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abc2db12-7211-4dc4-b4f8-f7fdca4c0325 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:48.734230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abc2db12-7211-4dc4-b4f8-f7fdca4c0325 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:48.734829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abc2db12-7211-4dc4-b4f8-f7fdca4c0325 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:48.735711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abc2db12-7211-4dc4-b4f8-f7fdca4c0325 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:48.737424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abc2db12-7211-4dc4-b4f8-f7fdca4c0325 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:48.738438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abc2db12-7211-4dc4-b4f8-f7fdca4c0325 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:49.582143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-abc2db12-7211-4dc4-b4f8-f7fdca4c0325 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:49.594551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-abc2db12-7211-4dc4-b4f8-f7fdca4c0325 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:49.595993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-abc2db12-7211-4dc4-b4f8-f7fdca4c0325 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:49.600423 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-abc2db12-7211-4dc4-b4f8-f7fdca4c0325 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1724 microversion: 2.20 time: 0.895821 Aug 29 15:58:49.601055 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3379/6557] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:48 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1724 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:50.627974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9ebbe828-c931-4aa3-8974-d1bc7da12b16 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:50.628696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9ebbe828-c931-4aa3-8974-d1bc7da12b16 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:50.650617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ebbe828-c931-4aa3-8974-d1bc7da12b16 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:50.651129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ebbe828-c931-4aa3-8974-d1bc7da12b16 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:50.651575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ebbe828-c931-4aa3-8974-d1bc7da12b16 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:50.652300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ebbe828-c931-4aa3-8974-d1bc7da12b16 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:50.652763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ebbe828-c931-4aa3-8974-d1bc7da12b16 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:50.653229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ebbe828-c931-4aa3-8974-d1bc7da12b16 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:52.075449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9ebbe828-c931-4aa3-8974-d1bc7da12b16 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:52.089199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9ebbe828-c931-4aa3-8974-d1bc7da12b16 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:52.095916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9ebbe828-c931-4aa3-8974-d1bc7da12b16 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:52.097837 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9ebbe828-c931-4aa3-8974-d1bc7da12b16 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1724 microversion: 2.20 time: 1.474532 Aug 29 15:58:52.098976 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3179/6558] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:50 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1724 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:53.123302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f96c8d6e-6582-41dc-b2c2-b59f7c2e7ed1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:53.124772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f96c8d6e-6582-41dc-b2c2-b59f7c2e7ed1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:53.128329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:53.142650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f96c8d6e-6582-41dc-b2c2-b59f7c2e7ed1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:53.143298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f96c8d6e-6582-41dc-b2c2-b59f7c2e7ed1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:53.143860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f96c8d6e-6582-41dc-b2c2-b59f7c2e7ed1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:53.144808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f96c8d6e-6582-41dc-b2c2-b59f7c2e7ed1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:53.150052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f96c8d6e-6582-41dc-b2c2-b59f7c2e7ed1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:53.152036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f96c8d6e-6582-41dc-b2c2-b59f7c2e7ed1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:53.496854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f96c8d6e-6582-41dc-b2c2-b59f7c2e7ed1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:53.509404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f96c8d6e-6582-41dc-b2c2-b59f7c2e7ed1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:53.510856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f96c8d6e-6582-41dc-b2c2-b59f7c2e7ed1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:53.519020 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f96c8d6e-6582-41dc-b2c2-b59f7c2e7ed1 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1724 microversion: 2.20 time: 0.400916 Aug 29 15:58:53.523985 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3380/6559] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:53 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1724 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:54.549407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c9110d29-19a9-42e5-a16a-2b9771fa33bf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:54.550919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c9110d29-19a9-42e5-a16a-2b9771fa33bf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:54.559219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9110d29-19a9-42e5-a16a-2b9771fa33bf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:54.559995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9110d29-19a9-42e5-a16a-2b9771fa33bf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:54.560675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9110d29-19a9-42e5-a16a-2b9771fa33bf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:54.561801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9110d29-19a9-42e5-a16a-2b9771fa33bf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:54.562537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9110d29-19a9-42e5-a16a-2b9771fa33bf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:54.563180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9110d29-19a9-42e5-a16a-2b9771fa33bf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:54.971686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c9110d29-19a9-42e5-a16a-2b9771fa33bf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:54.980081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c9110d29-19a9-42e5-a16a-2b9771fa33bf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:54.983478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c9110d29-19a9-42e5-a16a-2b9771fa33bf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:54.985886 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c9110d29-19a9-42e5-a16a-2b9771fa33bf tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1724 microversion: 2.20 time: 0.440559 Aug 29 15:58:54.986915 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3180/6560] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:54 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1724 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:58:56.017513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7f2e809-50dc-4f60-8377-08d4b089ffca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:56.019641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f7f2e809-50dc-4f60-8377-08d4b089ffca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:56.031176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7f2e809-50dc-4f60-8377-08d4b089ffca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:56.032333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7f2e809-50dc-4f60-8377-08d4b089ffca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:56.033241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7f2e809-50dc-4f60-8377-08d4b089ffca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:56.034338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7f2e809-50dc-4f60-8377-08d4b089ffca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:56.035178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7f2e809-50dc-4f60-8377-08d4b089ffca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:56.036555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7f2e809-50dc-4f60-8377-08d4b089ffca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:56.351237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f7f2e809-50dc-4f60-8377-08d4b089ffca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:56.397874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f7f2e809-50dc-4f60-8377-08d4b089ffca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:56.399840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f7f2e809-50dc-4f60-8377-08d4b089ffca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:56.402458 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f7f2e809-50dc-4f60-8377-08d4b089ffca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1724 microversion: 2.20 time: 0.394991 Aug 29 15:58:56.413125 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3381/6561] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:56 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1724 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:56.589612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8f857c87-a2ae-4484-a5a8-287140193614 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '.version_select at 0x7fc42a72ddc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:56.643208 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8f857c87-a2ae-4484-a5a8-287140193614 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-794061099" status: 202 len: 0 microversion: 2.1 time: 0.058921 Aug 29 15:58:56.644026 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3181/6562] 10.222.0.62 () {58 vars in 1281 bytes} [Mon Aug 29 15:58:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-794061099 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:58:56.685449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-08548bc4-96ae-4df2-b497-de2d6eacc23b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'create', calling method: .version_select at 0x7fc42ada8b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1467047023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGAOGK5tOEbK9b+GbbgtH4fwkzAyjsz1l+/BBZB8s3jrReR62UUVISsFsEArL76x2Oj9YtpdIhElG+btOzVKIlbLYZygnTrDWwy6HCYjQrR7wvq3wyAbkmpnr+bAbea+g=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:56.708174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-08548bc4-96ae-4df2-b497-de2d6eacc23b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Getting quotas for project 63c8e858d9064ae3875d91e8a43f7ee4. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:58:56.717400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-08548bc4-96ae-4df2-b497-de2d6eacc23b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Getting quotas for user 008972030ade418cb180f0702ae168b4 and project 63c8e858d9064ae3875d91e8a43f7ee4. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:58:56.776393 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-08548bc4-96ae-4df2-b497-de2d6eacc23b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.095359 Aug 29 15:58:56.779010 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3382/6563] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:58:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:57.428696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2803c3f2-42aa-447c-9126-e67af1222a1c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:57.435224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2803c3f2-42aa-447c-9126-e67af1222a1c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:57.450958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2803c3f2-42aa-447c-9126-e67af1222a1c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:57.456355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2803c3f2-42aa-447c-9126-e67af1222a1c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:57.457483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2803c3f2-42aa-447c-9126-e67af1222a1c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:57.461037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2803c3f2-42aa-447c-9126-e67af1222a1c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:57.463483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2803c3f2-42aa-447c-9126-e67af1222a1c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:57.465930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2803c3f2-42aa-447c-9126-e67af1222a1c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:58.066118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2803c3f2-42aa-447c-9126-e67af1222a1c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:58.085398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2803c3f2-42aa-447c-9126-e67af1222a1c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:58.087805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2803c3f2-42aa-447c-9126-e67af1222a1c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:58.090319 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2803c3f2-42aa-447c-9126-e67af1222a1c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1724 microversion: 2.20 time: 0.667056 Aug 29 15:58:58.100204 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3182/6564] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:57 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1724 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:59.125159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4ddbb1bf-a39e-4120-b048-5dae06a338f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:59.126558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4ddbb1bf-a39e-4120-b048-5dae06a338f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:59.135766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ddbb1bf-a39e-4120-b048-5dae06a338f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:59.136738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ddbb1bf-a39e-4120-b048-5dae06a338f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:59.137483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ddbb1bf-a39e-4120-b048-5dae06a338f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:59.138812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ddbb1bf-a39e-4120-b048-5dae06a338f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:59.139521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ddbb1bf-a39e-4120-b048-5dae06a338f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:59.140740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ddbb1bf-a39e-4120-b048-5dae06a338f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:59.659113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4ddbb1bf-a39e-4120-b048-5dae06a338f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:59.678847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4ddbb1bf-a39e-4120-b048-5dae06a338f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:59.680452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4ddbb1bf-a39e-4120-b048-5dae06a338f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:59.681745 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4ddbb1bf-a39e-4120-b048-5dae06a338f7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1724 microversion: 2.20 time: 0.561792 Aug 29 15:58:59.682772 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3383/6565] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:59 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1724 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:00.706729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-92d7c6d2-509f-4a0d-90dc-f4039b23e08b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:00.708020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-92d7c6d2-509f-4a0d-90dc-f4039b23e08b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:00.738087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92d7c6d2-509f-4a0d-90dc-f4039b23e08b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:00.744653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92d7c6d2-509f-4a0d-90dc-f4039b23e08b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:00.745639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92d7c6d2-509f-4a0d-90dc-f4039b23e08b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:00.746821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92d7c6d2-509f-4a0d-90dc-f4039b23e08b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:00.747632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92d7c6d2-509f-4a0d-90dc-f4039b23e08b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:00.748601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92d7c6d2-509f-4a0d-90dc-f4039b23e08b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:01.006869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-92d7c6d2-509f-4a0d-90dc-f4039b23e08b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:01.016370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-92d7c6d2-509f-4a0d-90dc-f4039b23e08b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:01.017744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-92d7c6d2-509f-4a0d-90dc-f4039b23e08b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:01.019015 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-92d7c6d2-509f-4a0d-90dc-f4039b23e08b tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1745 microversion: 2.20 time: 0.317521 Aug 29 15:59:01.033118 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3183/6566] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:00 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1745 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:02.042594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-944a57c6-0c48-45c8-9821-0f34b910f3a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:02.043224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-944a57c6-0c48-45c8-9821-0f34b910f3a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:02.056749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-944a57c6-0c48-45c8-9821-0f34b910f3a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:02.058301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-944a57c6-0c48-45c8-9821-0f34b910f3a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:02.058301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-944a57c6-0c48-45c8-9821-0f34b910f3a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:02.058491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-944a57c6-0c48-45c8-9821-0f34b910f3a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:02.058801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-944a57c6-0c48-45c8-9821-0f34b910f3a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:02.059483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-944a57c6-0c48-45c8-9821-0f34b910f3a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:02.372485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-944a57c6-0c48-45c8-9821-0f34b910f3a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:02.382183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-944a57c6-0c48-45c8-9821-0f34b910f3a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:02.383967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-944a57c6-0c48-45c8-9821-0f34b910f3a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:02.385230 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-944a57c6-0c48-45c8-9821-0f34b910f3a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1745 microversion: 2.20 time: 0.346745 Aug 29 15:59:02.401029 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3384/6567] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:02 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1745 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:03.414155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ae8004fe-c24d-4bd7-ba23-d1063bfa2841 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:03.415895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ae8004fe-c24d-4bd7-ba23-d1063bfa2841 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:03.428235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae8004fe-c24d-4bd7-ba23-d1063bfa2841 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:03.428978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae8004fe-c24d-4bd7-ba23-d1063bfa2841 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:03.429612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae8004fe-c24d-4bd7-ba23-d1063bfa2841 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:03.430862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae8004fe-c24d-4bd7-ba23-d1063bfa2841 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:03.431482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae8004fe-c24d-4bd7-ba23-d1063bfa2841 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:03.432064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae8004fe-c24d-4bd7-ba23-d1063bfa2841 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:03.884356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ae8004fe-c24d-4bd7-ba23-d1063bfa2841 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:03.906096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ae8004fe-c24d-4bd7-ba23-d1063bfa2841 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:03.907833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ae8004fe-c24d-4bd7-ba23-d1063bfa2841 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:03.913889 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ae8004fe-c24d-4bd7-ba23-d1063bfa2841 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1745 microversion: 2.20 time: 0.508418 Aug 29 15:59:03.914589 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3184/6568] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:03 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1745 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:04.399041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-85079955-bc65-4877-83e0-01779660137e req-24de866f-a81c-4261-87db-4df32f5ba442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e1cc03-3a7b-4242-a1a6-98e756d3d326", "name": "network-vif-plugged", "status": "completed", "tag": "9c67ed58-1b7d-43f4-b23a-74f6094e5f88"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:04.416172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-85079955-bc65-4877-83e0-01779660137e req-24de866f-a81c-4261-87db-4df32f5ba442 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:04.416839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-85079955-bc65-4877-83e0-01779660137e req-24de866f-a81c-4261-87db-4df32f5ba442 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:04.417322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-85079955-bc65-4877-83e0-01779660137e req-24de866f-a81c-4261-87db-4df32f5ba442 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:04.435306 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-85079955-bc65-4877-83e0-01779660137e req-24de866f-a81c-4261-87db-4df32f5ba442 service nova] Creating event network-vif-plugged:9c67ed58-1b7d-43f4-b23a-74f6094e5f88 for instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 on n-h2-839401-11 Aug 29 15:59:04.441828 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-85079955-bc65-4877-83e0-01779660137e req-24de866f-a81c-4261-87db-4df32f5ba442 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046546 Aug 29 15:59:04.443198 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3385/6569] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:04.939706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e7bbcc0a-8b2d-4d96-a4a0-8f786b6a0df7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:04.940966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e7bbcc0a-8b2d-4d96-a4a0-8f786b6a0df7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:04.948781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7bbcc0a-8b2d-4d96-a4a0-8f786b6a0df7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:04.949580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7bbcc0a-8b2d-4d96-a4a0-8f786b6a0df7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:04.950206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7bbcc0a-8b2d-4d96-a4a0-8f786b6a0df7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:04.951094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7bbcc0a-8b2d-4d96-a4a0-8f786b6a0df7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:04.951718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7bbcc0a-8b2d-4d96-a4a0-8f786b6a0df7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:04.952142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7bbcc0a-8b2d-4d96-a4a0-8f786b6a0df7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:05.341957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e7bbcc0a-8b2d-4d96-a4a0-8f786b6a0df7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:05.355353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e7bbcc0a-8b2d-4d96-a4a0-8f786b6a0df7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:05.358189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e7bbcc0a-8b2d-4d96-a4a0-8f786b6a0df7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:05.367408 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e7bbcc0a-8b2d-4d96-a4a0-8f786b6a0df7 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1745 microversion: 2.20 time: 0.431983 Aug 29 15:59:05.368595 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3185/6570] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:04 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1745 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:06.393375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3584c304-5dc1-4938-8652-2bd577dae79f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:06.393870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3584c304-5dc1-4938-8652-2bd577dae79f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:06.414067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3584c304-5dc1-4938-8652-2bd577dae79f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:06.415213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3584c304-5dc1-4938-8652-2bd577dae79f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:06.415915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3584c304-5dc1-4938-8652-2bd577dae79f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:06.419898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3584c304-5dc1-4938-8652-2bd577dae79f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:06.420638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3584c304-5dc1-4938-8652-2bd577dae79f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:06.421293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3584c304-5dc1-4938-8652-2bd577dae79f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:06.726994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:07.623291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3584c304-5dc1-4938-8652-2bd577dae79f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:07.689317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3584c304-5dc1-4938-8652-2bd577dae79f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:07.703329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3584c304-5dc1-4938-8652-2bd577dae79f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:07.712904 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3584c304-5dc1-4938-8652-2bd577dae79f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1740 microversion: 2.20 time: 1.325352 Aug 29 15:59:07.714325 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3386/6571] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:06 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1740 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:08.747069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3de50454-9638-4d72-a688-b5bd75a28f71 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:08.747695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3de50454-9638-4d72-a688-b5bd75a28f71 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:08.775819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3de50454-9638-4d72-a688-b5bd75a28f71 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:08.776325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3de50454-9638-4d72-a688-b5bd75a28f71 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:08.776756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3de50454-9638-4d72-a688-b5bd75a28f71 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:08.777718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3de50454-9638-4d72-a688-b5bd75a28f71 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:08.777949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3de50454-9638-4d72-a688-b5bd75a28f71 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:08.778367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3de50454-9638-4d72-a688-b5bd75a28f71 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:09.703495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3de50454-9638-4d72-a688-b5bd75a28f71 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:09.721547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3de50454-9638-4d72-a688-b5bd75a28f71 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:09.724955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3de50454-9638-4d72-a688-b5bd75a28f71 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:09.726323 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3de50454-9638-4d72-a688-b5bd75a28f71 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1740 microversion: 2.20 time: 0.986852 Aug 29 15:59:09.741576 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3186/6572] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:08 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1740 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:10.759588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f62d3204-9b27-4746-8b65-ba5a52497462 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:10.760333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f62d3204-9b27-4746-8b65-ba5a52497462 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:10.772582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f62d3204-9b27-4746-8b65-ba5a52497462 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:10.773109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f62d3204-9b27-4746-8b65-ba5a52497462 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:10.780773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f62d3204-9b27-4746-8b65-ba5a52497462 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:10.780773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f62d3204-9b27-4746-8b65-ba5a52497462 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:10.780773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f62d3204-9b27-4746-8b65-ba5a52497462 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:10.792586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f62d3204-9b27-4746-8b65-ba5a52497462 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:11.378295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f62d3204-9b27-4746-8b65-ba5a52497462 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:11.380923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=62 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:11.393753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f62d3204-9b27-4746-8b65-ba5a52497462 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:11.408869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f62d3204-9b27-4746-8b65-ba5a52497462 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:11.408869 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f62d3204-9b27-4746-8b65-ba5a52497462 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1740 microversion: 2.20 time: 0.649627 Aug 29 15:59:11.418058 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3387/6573] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:10 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1740 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:12.346939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1380920346", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "7f1f2df2-f520-43a8-999a-9f27e8ae3d70"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1467047023", "security_groups": [{"name": "tempest-secgroup-smoke-77287839"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:12.435000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4a3af14e-d7f4-4ac4-be55-0547e2f70853 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:12.435867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4a3af14e-d7f4-4ac4-be55-0547e2f70853 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:12.438663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:12.470717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a3af14e-d7f4-4ac4-be55-0547e2f70853 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:12.471271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a3af14e-d7f4-4ac4-be55-0547e2f70853 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:12.471706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a3af14e-d7f4-4ac4-be55-0547e2f70853 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:12.472432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a3af14e-d7f4-4ac4-be55-0547e2f70853 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:12.482885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a3af14e-d7f4-4ac4-be55-0547e2f70853 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:12.484049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a3af14e-d7f4-4ac4-be55-0547e2f70853 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:13.088905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] validate_networks() for [('7f1f2df2-f520-43a8-999a-9f27e8ae3d70', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:59:13.215664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4a3af14e-d7f4-4ac4-be55-0547e2f70853 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:13.238686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4a3af14e-d7f4-4ac4-be55-0547e2f70853 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:13.250821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4a3af14e-d7f4-4ac4-be55-0547e2f70853 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:13.254610 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4a3af14e-d7f4-4ac4-be55-0547e2f70853 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1740 microversion: 2.20 time: 0.826317 Aug 29 15:59:13.278449 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3388/6574] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:12 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1740 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:59:14.286227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6a0b8b32-6e48-484f-8f29-ff404fccadd6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:14.287927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6a0b8b32-6e48-484f-8f29-ff404fccadd6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:14.313352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0b8b32-6e48-484f-8f29-ff404fccadd6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:14.314259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0b8b32-6e48-484f-8f29-ff404fccadd6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:14.314948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0b8b32-6e48-484f-8f29-ff404fccadd6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:14.316059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0b8b32-6e48-484f-8f29-ff404fccadd6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:14.316764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0b8b32-6e48-484f-8f29-ff404fccadd6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:14.317431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a0b8b32-6e48-484f-8f29-ff404fccadd6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:14.937282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:59:14.937990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:59:14.938513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:59:14.938948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:59:14.939371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:59:14.941594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:14.978846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:14.984066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:14.989519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:14.990400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:14.990886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:14.991321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:15.019752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:15.054239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Getting quotas for project 63c8e858d9064ae3875d91e8a43f7ee4. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:59:15.069504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Getting quotas for user 008972030ade418cb180f0702ae168b4 and project 63c8e858d9064ae3875d91e8a43f7ee4. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:59:15.107774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:59:15.119891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:59:15.249938 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0e66f69c-6c23-4cfd-bde8-49aef27ef102 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.920409 Aug 29 15:59:15.254862 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3187/6575] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:59:12 2022] POST /compute/v2.1/servers => generated 404 bytes in 2927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:59:15.275590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0322e8d3-1568-4675-b27f-ca5db80bed2d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:15.276062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0322e8d3-1568-4675-b27f-ca5db80bed2d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:15.737548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0322e8d3-1568-4675-b27f-ca5db80bed2d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:15.773734 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0322e8d3-1568-4675-b27f-ca5db80bed2d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1267 microversion: 2.1 time: 0.507014 Aug 29 15:59:15.781932 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3188/6576] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:15 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1267 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:15.804782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6a0b8b32-6e48-484f-8f29-ff404fccadd6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:15.831554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6a0b8b32-6e48-484f-8f29-ff404fccadd6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:15.837052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6a0b8b32-6e48-484f-8f29-ff404fccadd6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:15.853742 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6a0b8b32-6e48-484f-8f29-ff404fccadd6 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1740 microversion: 2.20 time: 1.573442 Aug 29 15:59:15.884567 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3389/6577] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:14 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1740 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:59:16.821766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-99ab8e7e-c05e-419b-bcc4-61bac09054f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:16.823030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-99ab8e7e-c05e-419b-bcc4-61bac09054f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:16.871171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99ab8e7e-c05e-419b-bcc4-61bac09054f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:16.872304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99ab8e7e-c05e-419b-bcc4-61bac09054f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:16.873693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99ab8e7e-c05e-419b-bcc4-61bac09054f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:16.875265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99ab8e7e-c05e-419b-bcc4-61bac09054f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:16.878054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99ab8e7e-c05e-419b-bcc4-61bac09054f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:16.880393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99ab8e7e-c05e-419b-bcc4-61bac09054f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:16.890334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0202e989-0f88-4d5e-88f1-8d95245f0f4c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:16.890974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0202e989-0f88-4d5e-88f1-8d95245f0f4c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:16.918487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0202e989-0f88-4d5e-88f1-8d95245f0f4c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:16.918665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0202e989-0f88-4d5e-88f1-8d95245f0f4c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:16.918995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0202e989-0f88-4d5e-88f1-8d95245f0f4c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:16.919745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0202e989-0f88-4d5e-88f1-8d95245f0f4c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:16.926127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0202e989-0f88-4d5e-88f1-8d95245f0f4c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:16.926648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0202e989-0f88-4d5e-88f1-8d95245f0f4c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:17.185280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-99ab8e7e-c05e-419b-bcc4-61bac09054f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:17.196147 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-99ab8e7e-c05e-419b-bcc4-61bac09054f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1263 microversion: 2.1 time: 0.379853 Aug 29 15:59:17.196787 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3189/6578] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:16 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1263 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:17.453624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0202e989-0f88-4d5e-88f1-8d95245f0f4c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:17.497654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0202e989-0f88-4d5e-88f1-8d95245f0f4c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:17.511678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0202e989-0f88-4d5e-88f1-8d95245f0f4c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:17.512724 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0202e989-0f88-4d5e-88f1-8d95245f0f4c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1740 microversion: 2.20 time: 0.626493 Aug 29 15:59:17.526553 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3390/6579] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:16 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1740 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:18.222037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e5638f18-a238-46ad-ac9f-6a2c7c81892b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:18.222661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e5638f18-a238-46ad-ac9f-6a2c7c81892b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:18.260735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5638f18-a238-46ad-ac9f-6a2c7c81892b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:18.261958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5638f18-a238-46ad-ac9f-6a2c7c81892b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:18.262783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5638f18-a238-46ad-ac9f-6a2c7c81892b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:18.268612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5638f18-a238-46ad-ac9f-6a2c7c81892b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:18.272319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5638f18-a238-46ad-ac9f-6a2c7c81892b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:18.274521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5638f18-a238-46ad-ac9f-6a2c7c81892b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:18.540668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3ec1cd17-5cd9-4689-9440-298e3dd6be11 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:18.541897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3ec1cd17-5cd9-4689-9440-298e3dd6be11 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:18.545590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e5638f18-a238-46ad-ac9f-6a2c7c81892b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:18.552305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ec1cd17-5cd9-4689-9440-298e3dd6be11 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:18.552818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ec1cd17-5cd9-4689-9440-298e3dd6be11 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:18.553284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ec1cd17-5cd9-4689-9440-298e3dd6be11 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:18.554005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ec1cd17-5cd9-4689-9440-298e3dd6be11 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:18.554470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ec1cd17-5cd9-4689-9440-298e3dd6be11 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:18.554900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ec1cd17-5cd9-4689-9440-298e3dd6be11 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:18.556330 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e5638f18-a238-46ad-ac9f-6a2c7c81892b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1325 microversion: 2.1 time: 0.336130 Aug 29 15:59:18.558825 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3190/6580] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:18 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1325 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:19.727783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3ec1cd17-5cd9-4689-9440-298e3dd6be11 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:19.737151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3ec1cd17-5cd9-4689-9440-298e3dd6be11 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:19.754330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3ec1cd17-5cd9-4689-9440-298e3dd6be11 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:19.758597 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3ec1cd17-5cd9-4689-9440-298e3dd6be11 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1740 microversion: 2.20 time: 1.220738 Aug 29 15:59:19.773007 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3391/6581] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:18 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1740 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:59:19.799870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-623a4e40-4444-4cdd-8e98-2806a2391972 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:19.806040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-623a4e40-4444-4cdd-8e98-2806a2391972 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:19.836303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-623a4e40-4444-4cdd-8e98-2806a2391972 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:19.837196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-623a4e40-4444-4cdd-8e98-2806a2391972 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:19.838905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-623a4e40-4444-4cdd-8e98-2806a2391972 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:19.841275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-623a4e40-4444-4cdd-8e98-2806a2391972 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:19.847688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-623a4e40-4444-4cdd-8e98-2806a2391972 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:19.850846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-623a4e40-4444-4cdd-8e98-2806a2391972 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:20.012408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f4e8c32a-577a-4a34-a163-7c4d83605b40 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Action: 'create', calling method: .version_select at 0x7fc42a72d940>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1640931793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvulVCB8si8M0ixUd8IP2ySFKnyv6PaxPnUq5B4JP3zo72yTe4BWVwe4FLhnrZAIVILO95lAvzWgkPxuUlQsZHbxyYlHn4sKu+Th7JcijPcKwNFi0G7ZA/I2fCirR+SAg=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:20.047471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-f4e8c32a-577a-4a34-a163-7c4d83605b40 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Getting quotas for project 5cafad4fe369477d8b6e30703075fbf7. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:59:20.062465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-f4e8c32a-577a-4a34-a163-7c4d83605b40 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Getting quotas for user 1c189abdaec94ff690c01ce0b173c15c and project 5cafad4fe369477d8b6e30703075fbf7. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:59:20.107805 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f4e8c32a-577a-4a34-a163-7c4d83605b40 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.542268 Aug 29 15:59:20.113478 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3191/6582] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 15:59:19 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:20.384536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-623a4e40-4444-4cdd-8e98-2806a2391972 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:20.397501 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-623a4e40-4444-4cdd-8e98-2806a2391972 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1391 microversion: 2.1 time: 0.614862 Aug 29 15:59:20.408390 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3392/6583] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:19 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1391 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:20.793865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d0e0e2cc-d84f-4624-a57a-b4fe17e033a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:20.794521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d0e0e2cc-d84f-4624-a57a-b4fe17e033a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:20.826946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0e0e2cc-d84f-4624-a57a-b4fe17e033a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:20.833058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0e0e2cc-d84f-4624-a57a-b4fe17e033a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:20.836222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0e0e2cc-d84f-4624-a57a-b4fe17e033a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:20.837019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0e0e2cc-d84f-4624-a57a-b4fe17e033a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:20.837532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0e0e2cc-d84f-4624-a57a-b4fe17e033a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:20.837976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0e0e2cc-d84f-4624-a57a-b4fe17e033a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:21.216632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d0e0e2cc-d84f-4624-a57a-b4fe17e033a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:21.243216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d0e0e2cc-d84f-4624-a57a-b4fe17e033a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:21.256025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d0e0e2cc-d84f-4624-a57a-b4fe17e033a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:21.264668 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d0e0e2cc-d84f-4624-a57a-b4fe17e033a3 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1740 microversion: 2.20 time: 0.476720 Aug 29 15:59:21.270603 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3192/6584] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:20 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1740 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:21.403995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-becad15f-b366-476a-bb65-d48521d99272 req-4195989b-ede3-43f7-abda-ee229b3a43e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14191e49-0809-49a9-964d-029df9971a62", "tag": "4ce4f64e-0fb4-49d4-b504-519581182ab0"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:21.431838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-94c3310d-2efe-4fd9-aaaf-969691def6c3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:21.433321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-94c3310d-2efe-4fd9-aaaf-969691def6c3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:21.453615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-becad15f-b366-476a-bb65-d48521d99272 req-4195989b-ede3-43f7-abda-ee229b3a43e2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:21.455029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-becad15f-b366-476a-bb65-d48521d99272 req-4195989b-ede3-43f7-abda-ee229b3a43e2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:21.456108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94c3310d-2efe-4fd9-aaaf-969691def6c3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:21.456896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94c3310d-2efe-4fd9-aaaf-969691def6c3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:21.458052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-becad15f-b366-476a-bb65-d48521d99272 req-4195989b-ede3-43f7-abda-ee229b3a43e2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:21.460025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94c3310d-2efe-4fd9-aaaf-969691def6c3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:21.463067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94c3310d-2efe-4fd9-aaaf-969691def6c3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:21.464209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94c3310d-2efe-4fd9-aaaf-969691def6c3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:21.466191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94c3310d-2efe-4fd9-aaaf-969691def6c3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:21.494075 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-becad15f-b366-476a-bb65-d48521d99272 req-4195989b-ede3-43f7-abda-ee229b3a43e2 service nova] Creating event network-changed:4ce4f64e-0fb4-49d4-b504-519581182ab0 for instance 14191e49-0809-49a9-964d-029df9971a62 on n-h2-839401-11 Aug 29 15:59:21.511572 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-becad15f-b366-476a-bb65-d48521d99272 req-4195989b-ede3-43f7-abda-ee229b3a43e2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112269 Aug 29 15:59:21.517072 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3393/6585] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:59:22.288112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-40349bc5-d3a9-400b-bc21-7c31176aa6bc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:22.288822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-40349bc5-d3a9-400b-bc21-7c31176aa6bc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:22.309022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40349bc5-d3a9-400b-bc21-7c31176aa6bc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:22.309641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40349bc5-d3a9-400b-bc21-7c31176aa6bc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:22.310086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40349bc5-d3a9-400b-bc21-7c31176aa6bc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:22.310804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40349bc5-d3a9-400b-bc21-7c31176aa6bc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:22.311370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40349bc5-d3a9-400b-bc21-7c31176aa6bc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:22.311806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40349bc5-d3a9-400b-bc21-7c31176aa6bc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:22.508883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-94c3310d-2efe-4fd9-aaaf-969691def6c3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:22.526300 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-94c3310d-2efe-4fd9-aaaf-969691def6c3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1391 microversion: 2.1 time: 1.091821 Aug 29 15:59:22.527445 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3193/6586] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:21 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1391 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:23.055455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-40349bc5-d3a9-400b-bc21-7c31176aa6bc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:23.067888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-40349bc5-d3a9-400b-bc21-7c31176aa6bc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:23.069700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-40349bc5-d3a9-400b-bc21-7c31176aa6bc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:23.071294 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-40349bc5-d3a9-400b-bc21-7c31176aa6bc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1740 microversion: 2.20 time: 0.787851 Aug 29 15:59:23.097371 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3394/6587] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:22 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1740 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:23.550401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-261fdd57-a1b0-49f4-bf9c-7e5a870f0274 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:23.551722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-261fdd57-a1b0-49f4-bf9c-7e5a870f0274 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:23.566181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-261fdd57-a1b0-49f4-bf9c-7e5a870f0274 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:23.567345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-261fdd57-a1b0-49f4-bf9c-7e5a870f0274 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:23.568090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-261fdd57-a1b0-49f4-bf9c-7e5a870f0274 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:23.569067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-261fdd57-a1b0-49f4-bf9c-7e5a870f0274 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:23.569778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-261fdd57-a1b0-49f4-bf9c-7e5a870f0274 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:23.570320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-261fdd57-a1b0-49f4-bf9c-7e5a870f0274 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:23.842768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-261fdd57-a1b0-49f4-bf9c-7e5a870f0274 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:23.854273 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-261fdd57-a1b0-49f4-bf9c-7e5a870f0274 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1391 microversion: 2.1 time: 0.308454 Aug 29 15:59:23.855338 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3194/6588] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:23 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1391 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:24.107201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2a72ddc2-677e-425f-90ac-da2766d3726c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:24.108739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2a72ddc2-677e-425f-90ac-da2766d3726c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:24.117420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a72ddc2-677e-425f-90ac-da2766d3726c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:24.118213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a72ddc2-677e-425f-90ac-da2766d3726c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:24.118907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a72ddc2-677e-425f-90ac-da2766d3726c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:24.119866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a72ddc2-677e-425f-90ac-da2766d3726c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:24.120557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a72ddc2-677e-425f-90ac-da2766d3726c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:24.124749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2a72ddc2-677e-425f-90ac-da2766d3726c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:24.667541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2a72ddc2-677e-425f-90ac-da2766d3726c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:24.685114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2a72ddc2-677e-425f-90ac-da2766d3726c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:24.689065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2a72ddc2-677e-425f-90ac-da2766d3726c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:24.690659 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2a72ddc2-677e-425f-90ac-da2766d3726c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1740 microversion: 2.20 time: 0.588992 Aug 29 15:59:24.691279 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3395/6589] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:24 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1740 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:24.877743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fd3dad15-07c2-49c6-a8a0-f694c30d223a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:24.878480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fd3dad15-07c2-49c6-a8a0-f694c30d223a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:24.886298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd3dad15-07c2-49c6-a8a0-f694c30d223a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:24.886847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd3dad15-07c2-49c6-a8a0-f694c30d223a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:24.887416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd3dad15-07c2-49c6-a8a0-f694c30d223a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:24.888401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd3dad15-07c2-49c6-a8a0-f694c30d223a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:24.888926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd3dad15-07c2-49c6-a8a0-f694c30d223a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:24.889449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd3dad15-07c2-49c6-a8a0-f694c30d223a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:25.020292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:25.182405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fd3dad15-07c2-49c6-a8a0-f694c30d223a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:25.199274 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fd3dad15-07c2-49c6-a8a0-f694c30d223a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1391 microversion: 2.1 time: 0.322733 Aug 29 15:59:25.213882 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3195/6590] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:24 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1391 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:25.717644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0777c821-4c76-4e72-8d45-4c484bc95cdb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:25.719294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0777c821-4c76-4e72-8d45-4c484bc95cdb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:25.727056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0777c821-4c76-4e72-8d45-4c484bc95cdb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:25.728003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0777c821-4c76-4e72-8d45-4c484bc95cdb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:25.728715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0777c821-4c76-4e72-8d45-4c484bc95cdb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:25.729724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0777c821-4c76-4e72-8d45-4c484bc95cdb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:25.730414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0777c821-4c76-4e72-8d45-4c484bc95cdb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:25.731067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0777c821-4c76-4e72-8d45-4c484bc95cdb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:26.198342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0777c821-4c76-4e72-8d45-4c484bc95cdb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:26.209878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0777c821-4c76-4e72-8d45-4c484bc95cdb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:26.211252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0777c821-4c76-4e72-8d45-4c484bc95cdb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:26.212496 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0777c821-4c76-4e72-8d45-4c484bc95cdb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1740 microversion: 2.20 time: 0.500411 Aug 29 15:59:26.228246 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3396/6591] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:25 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1740 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:26.234562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e9d9f1ac-59e1-48c3-9c52-c921b545acdb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:26.235749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e9d9f1ac-59e1-48c3-9c52-c921b545acdb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:26.250271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9d9f1ac-59e1-48c3-9c52-c921b545acdb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:26.251334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9d9f1ac-59e1-48c3-9c52-c921b545acdb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:26.252026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9d9f1ac-59e1-48c3-9c52-c921b545acdb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:26.253107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9d9f1ac-59e1-48c3-9c52-c921b545acdb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:26.254099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9d9f1ac-59e1-48c3-9c52-c921b545acdb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:26.255065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9d9f1ac-59e1-48c3-9c52-c921b545acdb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:26.494941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e9d9f1ac-59e1-48c3-9c52-c921b545acdb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:26.509590 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e9d9f1ac-59e1-48c3-9c52-c921b545acdb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1391 microversion: 2.1 time: 0.279933 Aug 29 15:59:26.511335 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3196/6592] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:26 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1391 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:27.240792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-643844c9-0815-4593-ae1b-9b211a9528cb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:27.242203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-643844c9-0815-4593-ae1b-9b211a9528cb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:27.254959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-643844c9-0815-4593-ae1b-9b211a9528cb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:27.256705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-643844c9-0815-4593-ae1b-9b211a9528cb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:27.257470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-643844c9-0815-4593-ae1b-9b211a9528cb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:27.259247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-643844c9-0815-4593-ae1b-9b211a9528cb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:27.259963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-643844c9-0815-4593-ae1b-9b211a9528cb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:27.261244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-643844c9-0815-4593-ae1b-9b211a9528cb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:27.540085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-78cef3ee-01e1-4a0a-9f22-3cd8c5473595 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:27.541766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-78cef3ee-01e1-4a0a-9f22-3cd8c5473595 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:27.557494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78cef3ee-01e1-4a0a-9f22-3cd8c5473595 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:27.558684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78cef3ee-01e1-4a0a-9f22-3cd8c5473595 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:27.559941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78cef3ee-01e1-4a0a-9f22-3cd8c5473595 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:27.561480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78cef3ee-01e1-4a0a-9f22-3cd8c5473595 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:27.562328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78cef3ee-01e1-4a0a-9f22-3cd8c5473595 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:27.563534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-78cef3ee-01e1-4a0a-9f22-3cd8c5473595 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:27.742711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-643844c9-0815-4593-ae1b-9b211a9528cb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:27.754413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-643844c9-0815-4593-ae1b-9b211a9528cb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:27.759675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-643844c9-0815-4593-ae1b-9b211a9528cb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:27.761553 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-643844c9-0815-4593-ae1b-9b211a9528cb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1722 microversion: 2.20 time: 0.527827 Aug 29 15:59:27.763611 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3397/6593] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:27 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1722 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:27.869445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-78cef3ee-01e1-4a0a-9f22-3cd8c5473595 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:27.879239 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-78cef3ee-01e1-4a0a-9f22-3cd8c5473595 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1391 microversion: 2.1 time: 0.350274 Aug 29 15:59:27.881612 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3197/6594] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:27 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1391 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:28.788293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f219ae2c-4f7c-45dd-9277-a1e21adc812f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:28.794079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f219ae2c-4f7c-45dd-9277-a1e21adc812f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:28.804889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f219ae2c-4f7c-45dd-9277-a1e21adc812f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:28.806120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f219ae2c-4f7c-45dd-9277-a1e21adc812f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:28.806834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f219ae2c-4f7c-45dd-9277-a1e21adc812f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:28.807973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f219ae2c-4f7c-45dd-9277-a1e21adc812f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:28.808643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f219ae2c-4f7c-45dd-9277-a1e21adc812f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:28.809353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f219ae2c-4f7c-45dd-9277-a1e21adc812f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:28.872024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-5b77aed7-62f2-41d7-8676-63d199560917 req-daa4963a-e28b-4f73-8c17-e2429c7d3538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14191e49-0809-49a9-964d-029df9971a62", "name": "network-vif-plugged", "status": "completed", "tag": "4ce4f64e-0fb4-49d4-b504-519581182ab0"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:28.897202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5b77aed7-62f2-41d7-8676-63d199560917 req-daa4963a-e28b-4f73-8c17-e2429c7d3538 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:28.898287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5b77aed7-62f2-41d7-8676-63d199560917 req-daa4963a-e28b-4f73-8c17-e2429c7d3538 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:28.898900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5b77aed7-62f2-41d7-8676-63d199560917 req-daa4963a-e28b-4f73-8c17-e2429c7d3538 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:28.925600 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5b77aed7-62f2-41d7-8676-63d199560917 req-daa4963a-e28b-4f73-8c17-e2429c7d3538 service nova] Creating event network-vif-plugged:4ce4f64e-0fb4-49d4-b504-519581182ab0 for instance 14191e49-0809-49a9-964d-029df9971a62 on n-h2-839401-11 Aug 29 15:59:28.932135 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-5b77aed7-62f2-41d7-8676-63d199560917 req-daa4963a-e28b-4f73-8c17-e2429c7d3538 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064044 Aug 29 15:59:28.937533 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3198/6595] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:59:28.943507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f927978d-bb0b-471d-8bc1-d66b464ef8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:28.949306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f927978d-bb0b-471d-8bc1-d66b464ef8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:28.966824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f927978d-bb0b-471d-8bc1-d66b464ef8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:28.967589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f927978d-bb0b-471d-8bc1-d66b464ef8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:28.968398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f927978d-bb0b-471d-8bc1-d66b464ef8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:28.971144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f927978d-bb0b-471d-8bc1-d66b464ef8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:28.973794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f927978d-bb0b-471d-8bc1-d66b464ef8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:28.974596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f927978d-bb0b-471d-8bc1-d66b464ef8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:29.134133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f219ae2c-4f7c-45dd-9277-a1e21adc812f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:29.146771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f219ae2c-4f7c-45dd-9277-a1e21adc812f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:29.148235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f219ae2c-4f7c-45dd-9277-a1e21adc812f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:29.151618 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f219ae2c-4f7c-45dd-9277-a1e21adc812f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1722 microversion: 2.20 time: 0.368955 Aug 29 15:59:29.152234 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3398/6596] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:28 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:29.969580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f927978d-bb0b-471d-8bc1-d66b464ef8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:29.980722 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f927978d-bb0b-471d-8bc1-d66b464ef8cd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1391 microversion: 2.1 time: 1.041569 Aug 29 15:59:29.983585 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3199/6597] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:28 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1391 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:30.177077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-330359f2-9100-4f46-8791-0f6ca22a80f2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:30.178445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-330359f2-9100-4f46-8791-0f6ca22a80f2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:30.188836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-330359f2-9100-4f46-8791-0f6ca22a80f2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:30.189845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-330359f2-9100-4f46-8791-0f6ca22a80f2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:30.190529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-330359f2-9100-4f46-8791-0f6ca22a80f2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:30.192249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-330359f2-9100-4f46-8791-0f6ca22a80f2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:30.194175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-330359f2-9100-4f46-8791-0f6ca22a80f2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:30.196778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-330359f2-9100-4f46-8791-0f6ca22a80f2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:30.513456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-330359f2-9100-4f46-8791-0f6ca22a80f2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:30.539028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-330359f2-9100-4f46-8791-0f6ca22a80f2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:30.543485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-330359f2-9100-4f46-8791-0f6ca22a80f2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:30.547078 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-330359f2-9100-4f46-8791-0f6ca22a80f2 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1725 microversion: 2.20 time: 0.374654 Aug 29 15:59:30.549757 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3399/6598] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:30 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1725 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:30.576990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cbbfba51-7ec5-4d6f-9122-2c0f7722aea9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e20f1751-ee69-4e2b-b270-c198b23c4892"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:30.582768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cbbfba51-7ec5-4d6f-9122-2c0f7722aea9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:30.602863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:30.610935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbbfba51-7ec5-4d6f-9122-2c0f7722aea9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:30.612023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbbfba51-7ec5-4d6f-9122-2c0f7722aea9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:30.613708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbbfba51-7ec5-4d6f-9122-2c0f7722aea9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:30.617157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbbfba51-7ec5-4d6f-9122-2c0f7722aea9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:30.619090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbbfba51-7ec5-4d6f-9122-2c0f7722aea9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:30.621289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cbbfba51-7ec5-4d6f-9122-2c0f7722aea9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:30.963272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c4cf27f5-911a-464e-aece-4944aeb1133d req-5843fa08-8560-432b-8260-15bfb505691f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e1cc03-3a7b-4242-a1a6-98e756d3d326", "name": "network-vif-unplugged", "status": "completed", "tag": "9c67ed58-1b7d-43f4-b23a-74f6094e5f88"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:30.979706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c4cf27f5-911a-464e-aece-4944aeb1133d req-5843fa08-8560-432b-8260-15bfb505691f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:30.981927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c4cf27f5-911a-464e-aece-4944aeb1133d req-5843fa08-8560-432b-8260-15bfb505691f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:30.982632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c4cf27f5-911a-464e-aece-4944aeb1133d req-5843fa08-8560-432b-8260-15bfb505691f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:30.997638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.compute.server_external_events [req-c4cf27f5-911a-464e-aece-4944aeb1133d req-5843fa08-8560-432b-8260-15bfb505691f service nova] Unable to find a host for instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326. Dropping event network-vif-unplugged {{(pid=122360) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 15:59:31.001356 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c4cf27f5-911a-464e-aece-4944aeb1133d req-5843fa08-8560-432b-8260-15bfb505691f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041196 Aug 29 15:59:31.007216 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3400/6599] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 29 15:59:31.017925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0d3a6770-77de-4fe2-b649-e7419acb7f05 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:31.021296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0d3a6770-77de-4fe2-b649-e7419acb7f05 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:31.032252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d3a6770-77de-4fe2-b649-e7419acb7f05 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:31.032746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d3a6770-77de-4fe2-b649-e7419acb7f05 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:31.033209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d3a6770-77de-4fe2-b649-e7419acb7f05 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:31.039327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d3a6770-77de-4fe2-b649-e7419acb7f05 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:31.039996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d3a6770-77de-4fe2-b649-e7419acb7f05 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:31.044970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d3a6770-77de-4fe2-b649-e7419acb7f05 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:31.182532 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cbbfba51-7ec5-4d6f-9122-2c0f7722aea9 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "POST /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.615949 Aug 29 15:59:31.183703 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3200/6600] 10.222.0.62 () {62 vars in 1364 bytes} [Mon Aug 29 15:59:30 2022] POST /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326/os-volume_attachments => generated 188 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:59:31.354861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-273de0b1-dc97-4303-a270-525713c4817f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:31.355755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-273de0b1-dc97-4303-a270-525713c4817f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:31.364898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-273de0b1-dc97-4303-a270-525713c4817f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:31.365494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-273de0b1-dc97-4303-a270-525713c4817f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:31.366219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-273de0b1-dc97-4303-a270-525713c4817f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:31.367160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-273de0b1-dc97-4303-a270-525713c4817f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:31.367782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-273de0b1-dc97-4303-a270-525713c4817f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:31.368226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-273de0b1-dc97-4303-a270-525713c4817f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:31.377878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0d3a6770-77de-4fe2-b649-e7419acb7f05 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:31.404893 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0d3a6770-77de-4fe2-b649-e7419acb7f05 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1391 microversion: 2.1 time: 0.395153 Aug 29 15:59:31.406208 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3401/6601] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:31 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1391 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:31.747927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:31.781293 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-273de0b1-dc97-4303-a270-525713c4817f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326/os-volume_attachments/e20f1751-ee69-4e2b-b270-c198b23c4892" status: 202 len: 0 microversion: 2.20 time: 0.423968 Aug 29 15:59:31.782352 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3201/6602] 10.222.0.62 () {60 vars in 1457 bytes} [Mon Aug 29 15:59:31 2022] DELETE /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326/os-volume_attachments/e20f1751-ee69-4e2b-b270-c198b23c4892 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:59:31.903412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5342e4f7-4c3d-4068-a3dc-5d498a296b26 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:31.904506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5342e4f7-4c3d-4068-a3dc-5d498a296b26 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:31.918885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5342e4f7-4c3d-4068-a3dc-5d498a296b26 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:31.923244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5342e4f7-4c3d-4068-a3dc-5d498a296b26 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:31.924077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5342e4f7-4c3d-4068-a3dc-5d498a296b26 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:31.930146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5342e4f7-4c3d-4068-a3dc-5d498a296b26 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:31.931435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5342e4f7-4c3d-4068-a3dc-5d498a296b26 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:31.932261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5342e4f7-4c3d-4068-a3dc-5d498a296b26 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:31.999508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5342e4f7-4c3d-4068-a3dc-5d498a296b26 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122360) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 15:59:32.171448 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5342e4f7-4c3d-4068-a3dc-5d498a296b26 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "POST /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326/action" status: 202 len: 0 microversion: 2.20 time: 0.272382 Aug 29 15:59:32.172688 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3402/6603] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 15:59:31 2022] POST /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:32.183718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4c5288ef-fb71-425e-bf6a-2b25095de595 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:32.185276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4c5288ef-fb71-425e-bf6a-2b25095de595 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:32.199741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c5288ef-fb71-425e-bf6a-2b25095de595 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:32.202849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c5288ef-fb71-425e-bf6a-2b25095de595 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:32.203863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c5288ef-fb71-425e-bf6a-2b25095de595 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:32.206287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c5288ef-fb71-425e-bf6a-2b25095de595 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:32.207675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c5288ef-fb71-425e-bf6a-2b25095de595 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:32.208636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c5288ef-fb71-425e-bf6a-2b25095de595 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:32.432914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2406974d-7e02-4d3e-8f28-8fe772f545e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:32.433890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2406974d-7e02-4d3e-8f28-8fe772f545e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:32.454153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2406974d-7e02-4d3e-8f28-8fe772f545e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:32.454920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2406974d-7e02-4d3e-8f28-8fe772f545e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:32.456168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2406974d-7e02-4d3e-8f28-8fe772f545e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:32.457642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2406974d-7e02-4d3e-8f28-8fe772f545e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:32.459449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2406974d-7e02-4d3e-8f28-8fe772f545e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:32.460000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2406974d-7e02-4d3e-8f28-8fe772f545e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:32.614628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4c5288ef-fb71-425e-bf6a-2b25095de595 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:32.627538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4c5288ef-fb71-425e-bf6a-2b25095de595 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:32.629954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4c5288ef-fb71-425e-bf6a-2b25095de595 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:32.631350 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4c5288ef-fb71-425e-bf6a-2b25095de595 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1673 microversion: 2.20 time: 0.453906 Aug 29 15:59:32.640851 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3202/6604] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:32 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1673 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:32.886218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2406974d-7e02-4d3e-8f28-8fe772f545e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:32.895557 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2406974d-7e02-4d3e-8f28-8fe772f545e7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1563 microversion: 2.1 time: 0.470914 Aug 29 15:59:32.900603 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3403/6605] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:32 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1563 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:59:32.927276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c25bec32-1daf-4ec2-8dbf-4ac5a99dc07b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:32.927977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c25bec32-1daf-4ec2-8dbf-4ac5a99dc07b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:32.941336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c25bec32-1daf-4ec2-8dbf-4ac5a99dc07b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:32.941992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c25bec32-1daf-4ec2-8dbf-4ac5a99dc07b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:32.942540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c25bec32-1daf-4ec2-8dbf-4ac5a99dc07b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:32.943373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c25bec32-1daf-4ec2-8dbf-4ac5a99dc07b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:32.944079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c25bec32-1daf-4ec2-8dbf-4ac5a99dc07b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:32.944890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c25bec32-1daf-4ec2-8dbf-4ac5a99dc07b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:33.024086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-639433183-access_point-1340286111", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "e431f17a-ba27-474a-befc-204fc4fd895b"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1640931793", "security_groups": [{"name": "tempest-secgroup_access--798381070"}, {"name": "tempest-secgroup_general--867700077"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:33.407158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] validate_networks() for [('e431f17a-ba27-474a-befc-204fc4fd895b', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:59:33.637699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c25bec32-1daf-4ec2-8dbf-4ac5a99dc07b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:33.657584 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c25bec32-1daf-4ec2-8dbf-4ac5a99dc07b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1563 microversion: 2.1 time: 0.734735 Aug 29 15:59:33.662501 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3203/6606] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:32 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1563 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:33.682209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0293704d-674c-4301-aab8-d4dbfa797bcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:33.682976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0293704d-674c-4301-aab8-d4dbfa797bcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:33.699101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0293704d-674c-4301-aab8-d4dbfa797bcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:33.699101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0293704d-674c-4301-aab8-d4dbfa797bcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:33.699665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0293704d-674c-4301-aab8-d4dbfa797bcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:33.701358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0293704d-674c-4301-aab8-d4dbfa797bcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:33.703330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0293704d-674c-4301-aab8-d4dbfa797bcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:33.704849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0293704d-674c-4301-aab8-d4dbfa797bcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:34.077446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0293704d-674c-4301-aab8-d4dbfa797bcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:34.092645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0293704d-674c-4301-aab8-d4dbfa797bcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:34.094625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0293704d-674c-4301-aab8-d4dbfa797bcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:34.096472 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0293704d-674c-4301-aab8-d4dbfa797bcc tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1675 microversion: 2.20 time: 0.432063 Aug 29 15:59:34.097381 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3204/6607] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:33 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1675 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:35.043041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:59:35.044420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:59:35.045136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:59:35.045739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:59:35.046630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:59:35.067947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:35.069141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:35.069805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:35.070621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:35.071073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:35.071495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:35.120137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aa663755-9ef2-4a12-9349-f75ade42069e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:35.120768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aa663755-9ef2-4a12-9349-f75ade42069e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:35.128402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Getting quotas for project 5cafad4fe369477d8b6e30703075fbf7. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:59:35.134853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Getting quotas for user 1c189abdaec94ff690c01ce0b173c15c and project 5cafad4fe369477d8b6e30703075fbf7. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:59:35.136056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa663755-9ef2-4a12-9349-f75ade42069e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:35.136569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa663755-9ef2-4a12-9349-f75ade42069e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:35.137011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa663755-9ef2-4a12-9349-f75ade42069e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:35.137762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa663755-9ef2-4a12-9349-f75ade42069e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:35.138223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa663755-9ef2-4a12-9349-f75ade42069e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:35.138655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa663755-9ef2-4a12-9349-f75ade42069e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:35.159057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:59:35.161893 n-d-839401-11 devstack@n-api.service[122360]: WARNING nova.utils [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-639433183-access_point-1340286111 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-639433183-acc Aug 29 15:59:35.163243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:59:35.234121 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-86b0f44e-b137-4445-bf62-65982d9e5aa1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 2.212413 Aug 29 15:59:35.242635 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3404/6608] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 15:59:33 2022] POST /compute/v2.1/servers => generated 456 bytes in 2218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:59:35.249566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-10848c8b-a040-46d5-8e32-68cb1654073e tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:35.250189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-10848c8b-a040-46d5-8e32-68cb1654073e tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:35.411141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-10848c8b-a040-46d5-8e32-68cb1654073e tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:35.421501 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-10848c8b-a040-46d5-8e32-68cb1654073e tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1294 microversion: 2.1 time: 0.177846 Aug 29 15:59:35.437826 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3405/6609] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:35 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1294 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:59:35.859713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aa663755-9ef2-4a12-9349-f75ade42069e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:35.873195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aa663755-9ef2-4a12-9349-f75ade42069e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:35.875057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aa663755-9ef2-4a12-9349-f75ade42069e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:35.876315 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aa663755-9ef2-4a12-9349-f75ade42069e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 0.760279 Aug 29 15:59:35.881325 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3205/6610] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:35 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:59:36.444359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-23bc84e3-9cd9-41a3-b519-dd7b9633b603 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:36.444972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-23bc84e3-9cd9-41a3-b519-dd7b9633b603 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:36.457784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23bc84e3-9cd9-41a3-b519-dd7b9633b603 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:36.461434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23bc84e3-9cd9-41a3-b519-dd7b9633b603 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:36.461943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23bc84e3-9cd9-41a3-b519-dd7b9633b603 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:36.462734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23bc84e3-9cd9-41a3-b519-dd7b9633b603 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:36.463288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23bc84e3-9cd9-41a3-b519-dd7b9633b603 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:36.466018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23bc84e3-9cd9-41a3-b519-dd7b9633b603 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:36.496464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:36.685427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-23bc84e3-9cd9-41a3-b519-dd7b9633b603 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:36.702713 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-23bc84e3-9cd9-41a3-b519-dd7b9633b603 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1290 microversion: 2.1 time: 0.258424 Aug 29 15:59:36.705846 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3406/6611] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:36 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1290 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:59:36.905353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5afa889d-c821-42e3-8d9b-59479bf8129f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:36.906921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5afa889d-c821-42e3-8d9b-59479bf8129f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:36.928610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5afa889d-c821-42e3-8d9b-59479bf8129f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:36.930857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5afa889d-c821-42e3-8d9b-59479bf8129f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:36.932846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5afa889d-c821-42e3-8d9b-59479bf8129f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:36.935346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5afa889d-c821-42e3-8d9b-59479bf8129f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:36.938581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5afa889d-c821-42e3-8d9b-59479bf8129f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:36.939361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5afa889d-c821-42e3-8d9b-59479bf8129f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:37.027850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-79792944-bf1d-4091-a83b-e66f705a25d1 req-cb4fe715-af21-4a6a-8cfd-f0015096fe1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e1cc03-3a7b-4242-a1a6-98e756d3d326", "tag": "9c67ed58-1b7d-43f4-b23a-74f6094e5f88"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:37.058373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-79792944-bf1d-4091-a83b-e66f705a25d1 req-cb4fe715-af21-4a6a-8cfd-f0015096fe1a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:37.060621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-79792944-bf1d-4091-a83b-e66f705a25d1 req-cb4fe715-af21-4a6a-8cfd-f0015096fe1a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:37.061071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-79792944-bf1d-4091-a83b-e66f705a25d1 req-cb4fe715-af21-4a6a-8cfd-f0015096fe1a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:37.110864 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-79792944-bf1d-4091-a83b-e66f705a25d1 req-cb4fe715-af21-4a6a-8cfd-f0015096fe1a service nova] Creating event network-changed:9c67ed58-1b7d-43f4-b23a-74f6094e5f88 for instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 on n-h1-839401-11 Aug 29 15:59:37.133583 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-79792944-bf1d-4091-a83b-e66f705a25d1 req-cb4fe715-af21-4a6a-8cfd-f0015096fe1a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103871 Aug 29 15:59:37.135944 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3407/6612] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:59:37.729934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c49d44ad-fd6e-4503-8a31-f54c0f51a009 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:37.733223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c49d44ad-fd6e-4503-8a31-f54c0f51a009 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:37.752198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c49d44ad-fd6e-4503-8a31-f54c0f51a009 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:37.753231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c49d44ad-fd6e-4503-8a31-f54c0f51a009 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:37.753910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c49d44ad-fd6e-4503-8a31-f54c0f51a009 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:37.755957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c49d44ad-fd6e-4503-8a31-f54c0f51a009 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:37.756816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c49d44ad-fd6e-4503-8a31-f54c0f51a009 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:37.758060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c49d44ad-fd6e-4503-8a31-f54c0f51a009 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:37.868303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c49d44ad-fd6e-4503-8a31-f54c0f51a009 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:37.879410 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c49d44ad-fd6e-4503-8a31-f54c0f51a009 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1352 microversion: 2.1 time: 0.155936 Aug 29 15:59:37.880033 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3408/6613] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:37 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1352 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:37.940240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5afa889d-c821-42e3-8d9b-59479bf8129f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:37.950978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5afa889d-c821-42e3-8d9b-59479bf8129f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:37.952917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5afa889d-c821-42e3-8d9b-59479bf8129f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:37.954186 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5afa889d-c821-42e3-8d9b-59479bf8129f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 1.053787 Aug 29 15:59:37.954951 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3206/6614] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:36 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:38.902623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f80cc907-490f-4f4f-82b5-173a83a2dfe2 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:38.903230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f80cc907-490f-4f4f-82b5-173a83a2dfe2 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:38.911266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f80cc907-490f-4f4f-82b5-173a83a2dfe2 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:38.911883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f80cc907-490f-4f4f-82b5-173a83a2dfe2 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:38.912571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f80cc907-490f-4f4f-82b5-173a83a2dfe2 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:38.913417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f80cc907-490f-4f4f-82b5-173a83a2dfe2 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:38.913875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f80cc907-490f-4f4f-82b5-173a83a2dfe2 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:38.914307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f80cc907-490f-4f4f-82b5-173a83a2dfe2 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:38.979260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1e5c7600-dffb-495d-bf4f-26c627ac0b15 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:38.982027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1e5c7600-dffb-495d-bf4f-26c627ac0b15 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:38.993753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e5c7600-dffb-495d-bf4f-26c627ac0b15 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:38.994349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e5c7600-dffb-495d-bf4f-26c627ac0b15 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:38.995030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e5c7600-dffb-495d-bf4f-26c627ac0b15 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:38.995826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e5c7600-dffb-495d-bf4f-26c627ac0b15 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:38.996366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e5c7600-dffb-495d-bf4f-26c627ac0b15 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:38.996863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1e5c7600-dffb-495d-bf4f-26c627ac0b15 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:39.046396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f80cc907-490f-4f4f-82b5-173a83a2dfe2 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:39.054379 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f80cc907-490f-4f4f-82b5-173a83a2dfe2 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1352 microversion: 2.1 time: 0.155880 Aug 29 15:59:39.055263 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3409/6615] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:38 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1352 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:39.855283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1e5c7600-dffb-495d-bf4f-26c627ac0b15 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:39.868338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1e5c7600-dffb-495d-bf4f-26c627ac0b15 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:39.870139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1e5c7600-dffb-495d-bf4f-26c627ac0b15 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:39.872077 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1e5c7600-dffb-495d-bf4f-26c627ac0b15 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 0.896871 Aug 29 15:59:39.872679 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3207/6616] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:38 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:59:40.075832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f8edc75-d3ca-4a87-8db8-9735dbf6e58a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:40.076436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3f8edc75-d3ca-4a87-8db8-9735dbf6e58a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:40.098512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f8edc75-d3ca-4a87-8db8-9735dbf6e58a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:40.099108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f8edc75-d3ca-4a87-8db8-9735dbf6e58a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:40.099716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f8edc75-d3ca-4a87-8db8-9735dbf6e58a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:40.100994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f8edc75-d3ca-4a87-8db8-9735dbf6e58a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:40.101699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f8edc75-d3ca-4a87-8db8-9735dbf6e58a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:40.102492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f8edc75-d3ca-4a87-8db8-9735dbf6e58a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:40.237264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3f8edc75-d3ca-4a87-8db8-9735dbf6e58a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:40.270981 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3f8edc75-d3ca-4a87-8db8-9735dbf6e58a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1352 microversion: 2.1 time: 0.198837 Aug 29 15:59:40.272309 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3410/6617] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:40 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1352 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:40.903859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-132192a6-5ca3-4434-9507-d662535c1c88 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:40.905276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-132192a6-5ca3-4434-9507-d662535c1c88 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:40.906859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c60ee533-ebcd-447b-9d3f-05deb7061118 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:40.912075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c60ee533-ebcd-447b-9d3f-05deb7061118 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:40.938228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-132192a6-5ca3-4434-9507-d662535c1c88 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:40.943424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-132192a6-5ca3-4434-9507-d662535c1c88 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:40.947699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-132192a6-5ca3-4434-9507-d662535c1c88 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:40.950489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c60ee533-ebcd-447b-9d3f-05deb7061118 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:40.953361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c60ee533-ebcd-447b-9d3f-05deb7061118 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:40.954059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-132192a6-5ca3-4434-9507-d662535c1c88 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:40.958653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c60ee533-ebcd-447b-9d3f-05deb7061118 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:40.959254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-132192a6-5ca3-4434-9507-d662535c1c88 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:40.961712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c60ee533-ebcd-447b-9d3f-05deb7061118 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:40.961943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-132192a6-5ca3-4434-9507-d662535c1c88 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:40.964724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c60ee533-ebcd-447b-9d3f-05deb7061118 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:40.967394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c60ee533-ebcd-447b-9d3f-05deb7061118 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:41.473104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-132192a6-5ca3-4434-9507-d662535c1c88 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:41.489591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-132192a6-5ca3-4434-9507-d662535c1c88 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:41.501649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-132192a6-5ca3-4434-9507-d662535c1c88 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:41.504742 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-132192a6-5ca3-4434-9507-d662535c1c88 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 0.611823 Aug 29 15:59:41.517370 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3411/6618] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:40 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:59:41.569794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-fb3cb94f-9d05-4fcd-befe-3a0e65a3aaca req-6d4868be-4f24-4739-87e4-ed948c64638b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14191e49-0809-49a9-964d-029df9971a62", "tag": "4ce4f64e-0fb4-49d4-b504-519581182ab0"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:41.601927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fb3cb94f-9d05-4fcd-befe-3a0e65a3aaca req-6d4868be-4f24-4739-87e4-ed948c64638b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:41.602675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fb3cb94f-9d05-4fcd-befe-3a0e65a3aaca req-6d4868be-4f24-4739-87e4-ed948c64638b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:41.604149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fb3cb94f-9d05-4fcd-befe-3a0e65a3aaca req-6d4868be-4f24-4739-87e4-ed948c64638b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:41.625413 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-fb3cb94f-9d05-4fcd-befe-3a0e65a3aaca req-6d4868be-4f24-4739-87e4-ed948c64638b service nova] Creating event network-changed:4ce4f64e-0fb4-49d4-b504-519581182ab0 for instance 14191e49-0809-49a9-964d-029df9971a62 on n-h2-839401-11 Aug 29 15:59:41.636206 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-fb3cb94f-9d05-4fcd-befe-3a0e65a3aaca req-6d4868be-4f24-4739-87e4-ed948c64638b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119815 Aug 29 15:59:41.637738 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3412/6619] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:41.644172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b35ada64-6bba-481b-9053-d79e404ea4c3 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:41.645855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b35ada64-6bba-481b-9053-d79e404ea4c3 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:41.654768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b35ada64-6bba-481b-9053-d79e404ea4c3 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:41.655800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b35ada64-6bba-481b-9053-d79e404ea4c3 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:41.656436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b35ada64-6bba-481b-9053-d79e404ea4c3 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:41.657671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b35ada64-6bba-481b-9053-d79e404ea4c3 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:41.658344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b35ada64-6bba-481b-9053-d79e404ea4c3 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:41.658983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b35ada64-6bba-481b-9053-d79e404ea4c3 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:41.993291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c60ee533-ebcd-447b-9d3f-05deb7061118 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:42.003788 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c60ee533-ebcd-447b-9d3f-05deb7061118 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1682 microversion: 2.1 time: 1.122746 Aug 29 15:59:42.008873 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3208/6620] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:40 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1682 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:42.336501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b35ada64-6bba-481b-9053-d79e404ea4c3 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:42.347667 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b35ada64-6bba-481b-9053-d79e404ea4c3 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1470 microversion: 2.1 time: 0.708157 Aug 29 15:59:42.357860 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3413/6621] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:41 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1470 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:42.532337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-60a7406c-d6e2-433a-abce-70d959c0105a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:42.533416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-60a7406c-d6e2-433a-abce-70d959c0105a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:42.548485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60a7406c-d6e2-433a-abce-70d959c0105a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:42.552419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60a7406c-d6e2-433a-abce-70d959c0105a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:42.553468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60a7406c-d6e2-433a-abce-70d959c0105a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:42.554442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60a7406c-d6e2-433a-abce-70d959c0105a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:42.561412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60a7406c-d6e2-433a-abce-70d959c0105a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:42.563095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-60a7406c-d6e2-433a-abce-70d959c0105a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:43.379124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-44714aca-bf2c-49e2-a80d-888ee115a173 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:43.380592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-44714aca-bf2c-49e2-a80d-888ee115a173 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:43.384377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:43.401873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44714aca-bf2c-49e2-a80d-888ee115a173 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:43.402705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44714aca-bf2c-49e2-a80d-888ee115a173 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:43.403306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44714aca-bf2c-49e2-a80d-888ee115a173 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:43.404204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44714aca-bf2c-49e2-a80d-888ee115a173 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:43.404813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44714aca-bf2c-49e2-a80d-888ee115a173 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:43.407326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44714aca-bf2c-49e2-a80d-888ee115a173 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:44.128419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-60a7406c-d6e2-433a-abce-70d959c0105a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:44.146120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-60a7406c-d6e2-433a-abce-70d959c0105a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:44.150039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-60a7406c-d6e2-433a-abce-70d959c0105a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:44.151666 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-60a7406c-d6e2-433a-abce-70d959c0105a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 1.626220 Aug 29 15:59:44.157981 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3209/6622] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:42 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:44.679944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-44714aca-bf2c-49e2-a80d-888ee115a173 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:44.700915 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-44714aca-bf2c-49e2-a80d-888ee115a173 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1470 microversion: 2.1 time: 1.322071 Aug 29 15:59:44.702235 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3414/6623] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:43 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1470 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:45.186350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e7355c0e-5d3e-4342-8ada-34c1aa42e013 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:45.187028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e7355c0e-5d3e-4342-8ada-34c1aa42e013 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:45.204408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:45.206040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7355c0e-5d3e-4342-8ada-34c1aa42e013 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:45.206530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7355c0e-5d3e-4342-8ada-34c1aa42e013 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:45.206971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7355c0e-5d3e-4342-8ada-34c1aa42e013 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:45.207829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7355c0e-5d3e-4342-8ada-34c1aa42e013 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:45.208274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7355c0e-5d3e-4342-8ada-34c1aa42e013 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:45.208705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e7355c0e-5d3e-4342-8ada-34c1aa42e013 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:45.726027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5f029a93-4606-489f-8f88-db2b6a0387c4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:45.727677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5f029a93-4606-489f-8f88-db2b6a0387c4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:45.740485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:45.746186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:45.749310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f029a93-4606-489f-8f88-db2b6a0387c4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:45.753294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f029a93-4606-489f-8f88-db2b6a0387c4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:45.753790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f029a93-4606-489f-8f88-db2b6a0387c4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:45.757115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f029a93-4606-489f-8f88-db2b6a0387c4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:45.761879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f029a93-4606-489f-8f88-db2b6a0387c4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:45.762489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f029a93-4606-489f-8f88-db2b6a0387c4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:46.487798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5f029a93-4606-489f-8f88-db2b6a0387c4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:46.498593 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5f029a93-4606-489f-8f88-db2b6a0387c4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1470 microversion: 2.1 time: 0.777222 Aug 29 15:59:46.503282 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3415/6624] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:45 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1470 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:46.887064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e7355c0e-5d3e-4342-8ada-34c1aa42e013 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:46.904577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e7355c0e-5d3e-4342-8ada-34c1aa42e013 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:46.911661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e7355c0e-5d3e-4342-8ada-34c1aa42e013 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:46.913364 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e7355c0e-5d3e-4342-8ada-34c1aa42e013 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 1.732071 Aug 29 15:59:46.914934 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3210/6625] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:45 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:47.211549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-80dff10e-75a5-4cb7-b651-130a19d7b995 req-8214f943-b6b5-4680-ac0a-ec203d2b11c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f49e97-67ee-4016-aee8-020f1b3773b9", "tag": "acd3d2b6-7116-4164-9b45-62aa74648b76"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:47.236286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-80dff10e-75a5-4cb7-b651-130a19d7b995 req-8214f943-b6b5-4680-ac0a-ec203d2b11c5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:47.238188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-80dff10e-75a5-4cb7-b651-130a19d7b995 req-8214f943-b6b5-4680-ac0a-ec203d2b11c5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:47.239501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-80dff10e-75a5-4cb7-b651-130a19d7b995 req-8214f943-b6b5-4680-ac0a-ec203d2b11c5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:47.285163 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-80dff10e-75a5-4cb7-b651-130a19d7b995 req-8214f943-b6b5-4680-ac0a-ec203d2b11c5 service nova] Creating event network-changed:acd3d2b6-7116-4164-9b45-62aa74648b76 for instance 73f49e97-67ee-4016-aee8-020f1b3773b9 on n-h1-839401-11 Aug 29 15:59:47.308486 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-80dff10e-75a5-4cb7-b651-130a19d7b995 req-8214f943-b6b5-4680-ac0a-ec203d2b11c5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099367 Aug 29 15:59:47.311967 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3416/6626] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:47.524433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6676f452-2a34-4655-af4c-2bafd4efe39d tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:47.525352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6676f452-2a34-4655-af4c-2bafd4efe39d tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:47.544793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6676f452-2a34-4655-af4c-2bafd4efe39d tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:47.545644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6676f452-2a34-4655-af4c-2bafd4efe39d tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:47.546326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6676f452-2a34-4655-af4c-2bafd4efe39d tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:47.547448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6676f452-2a34-4655-af4c-2bafd4efe39d tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:47.548078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6676f452-2a34-4655-af4c-2bafd4efe39d tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:47.549356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6676f452-2a34-4655-af4c-2bafd4efe39d tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:47.855256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4a60cfbd-90c0-419a-b20d-31b1922dc30a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:47.855892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4a60cfbd-90c0-419a-b20d-31b1922dc30a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:47.863610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a60cfbd-90c0-419a-b20d-31b1922dc30a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:47.864120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a60cfbd-90c0-419a-b20d-31b1922dc30a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:47.864565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a60cfbd-90c0-419a-b20d-31b1922dc30a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:47.865328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a60cfbd-90c0-419a-b20d-31b1922dc30a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:47.865849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a60cfbd-90c0-419a-b20d-31b1922dc30a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:47.866283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a60cfbd-90c0-419a-b20d-31b1922dc30a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:47.903270 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4a60cfbd-90c0-419a-b20d-31b1922dc30a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.073985 Aug 29 15:59:47.907206 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3417/6627] 10.222.0.62 () {58 vars in 1293 bytes} [Mon Aug 29 15:59:47 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046/os-server-password => generated 116 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:47.943824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-326aa27f-418d-4b74-a8f8-e0ee8f72b5ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:47.944814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-326aa27f-418d-4b74-a8f8-e0ee8f72b5ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:47.956682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-326aa27f-418d-4b74-a8f8-e0ee8f72b5ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:47.958131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-326aa27f-418d-4b74-a8f8-e0ee8f72b5ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:47.959330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-326aa27f-418d-4b74-a8f8-e0ee8f72b5ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:47.960889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-326aa27f-418d-4b74-a8f8-e0ee8f72b5ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:47.962407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-326aa27f-418d-4b74-a8f8-e0ee8f72b5ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:47.964651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-326aa27f-418d-4b74-a8f8-e0ee8f72b5ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:48.478470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6676f452-2a34-4655-af4c-2bafd4efe39d tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:48.492495 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6676f452-2a34-4655-af4c-2bafd4efe39d tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1470 microversion: 2.1 time: 0.972106 Aug 29 15:59:48.497016 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3211/6628] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:47 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1470 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:48.534617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-326aa27f-418d-4b74-a8f8-e0ee8f72b5ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:48.548670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-326aa27f-418d-4b74-a8f8-e0ee8f72b5ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:48.554650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-326aa27f-418d-4b74-a8f8-e0ee8f72b5ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:48.556088 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-326aa27f-418d-4b74-a8f8-e0ee8f72b5ce tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 0.617752 Aug 29 15:59:48.560357 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3418/6629] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:47 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:59:49.523250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f0d63d5f-6625-4c9c-94e3-2f6b174a98e5 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:49.525238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f0d63d5f-6625-4c9c-94e3-2f6b174a98e5 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:49.544263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0d63d5f-6625-4c9c-94e3-2f6b174a98e5 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:49.547238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0d63d5f-6625-4c9c-94e3-2f6b174a98e5 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:49.549179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0d63d5f-6625-4c9c-94e3-2f6b174a98e5 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:49.552456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0d63d5f-6625-4c9c-94e3-2f6b174a98e5 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:49.553989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0d63d5f-6625-4c9c-94e3-2f6b174a98e5 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:49.555777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f0d63d5f-6625-4c9c-94e3-2f6b174a98e5 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:49.583673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5084a51c-d619-4b92-a849-c9ed61efff61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:49.584547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5084a51c-d619-4b92-a849-c9ed61efff61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:49.601208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5084a51c-d619-4b92-a849-c9ed61efff61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:49.601898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5084a51c-d619-4b92-a849-c9ed61efff61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:49.605933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5084a51c-d619-4b92-a849-c9ed61efff61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:49.607171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5084a51c-d619-4b92-a849-c9ed61efff61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:49.608106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5084a51c-d619-4b92-a849-c9ed61efff61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:49.608904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5084a51c-d619-4b92-a849-c9ed61efff61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:49.905964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5084a51c-d619-4b92-a849-c9ed61efff61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:49.924170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5084a51c-d619-4b92-a849-c9ed61efff61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:49.928215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5084a51c-d619-4b92-a849-c9ed61efff61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:49.932807 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5084a51c-d619-4b92-a849-c9ed61efff61 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 0.353927 Aug 29 15:59:49.935967 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3419/6630] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:49 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:59:50.325331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f0d63d5f-6625-4c9c-94e3-2f6b174a98e5 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:50.341620 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f0d63d5f-6625-4c9c-94e3-2f6b174a98e5 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1470 microversion: 2.1 time: 0.824097 Aug 29 15:59:50.344119 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3212/6631] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:49 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1470 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:50.958714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0c184526-c31a-4ce4-b040-dba20266f733 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:50.959333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0c184526-c31a-4ce4-b040-dba20266f733 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:50.966504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c184526-c31a-4ce4-b040-dba20266f733 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:50.966985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c184526-c31a-4ce4-b040-dba20266f733 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:50.967531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c184526-c31a-4ce4-b040-dba20266f733 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:50.968260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c184526-c31a-4ce4-b040-dba20266f733 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:50.968944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c184526-c31a-4ce4-b040-dba20266f733 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:50.969410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0c184526-c31a-4ce4-b040-dba20266f733 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:51.114143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0c184526-c31a-4ce4-b040-dba20266f733 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:51.123859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0c184526-c31a-4ce4-b040-dba20266f733 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:51.125802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0c184526-c31a-4ce4-b040-dba20266f733 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:51.127012 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0c184526-c31a-4ce4-b040-dba20266f733 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 0.172616 Aug 29 15:59:51.127793 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3420/6632] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:50 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:51.366541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-11ecbdbc-d8da-4325-9775-d382696f59ac tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:51.367501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-11ecbdbc-d8da-4325-9775-d382696f59ac tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:51.378501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11ecbdbc-d8da-4325-9775-d382696f59ac tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:51.379180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11ecbdbc-d8da-4325-9775-d382696f59ac tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:51.379732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11ecbdbc-d8da-4325-9775-d382696f59ac tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:51.381790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11ecbdbc-d8da-4325-9775-d382696f59ac tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:51.382367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11ecbdbc-d8da-4325-9775-d382696f59ac tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:51.383344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11ecbdbc-d8da-4325-9775-d382696f59ac tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:51.788102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-11ecbdbc-d8da-4325-9775-d382696f59ac tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:51.798754 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-11ecbdbc-d8da-4325-9775-d382696f59ac tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1470 microversion: 2.1 time: 0.436339 Aug 29 15:59:51.803185 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3213/6633] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:51 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1470 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:52.154428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-edc2f2f9-9969-4a82-9db6-2b71502db46d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:52.155034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-edc2f2f9-9969-4a82-9db6-2b71502db46d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:52.162685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edc2f2f9-9969-4a82-9db6-2b71502db46d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:52.163203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edc2f2f9-9969-4a82-9db6-2b71502db46d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:52.163666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edc2f2f9-9969-4a82-9db6-2b71502db46d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:52.164360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edc2f2f9-9969-4a82-9db6-2b71502db46d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:52.164810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edc2f2f9-9969-4a82-9db6-2b71502db46d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:52.165252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-edc2f2f9-9969-4a82-9db6-2b71502db46d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:52.442090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-edc2f2f9-9969-4a82-9db6-2b71502db46d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:52.451782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-edc2f2f9-9969-4a82-9db6-2b71502db46d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:52.453330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-edc2f2f9-9969-4a82-9db6-2b71502db46d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:52.454558 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-edc2f2f9-9969-4a82-9db6-2b71502db46d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 0.305657 Aug 29 15:59:52.455144 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3421/6634] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:52 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:52.821240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-07a83629-6f5c-4e3f-a42d-7577dd6bd592 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:52.821969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-07a83629-6f5c-4e3f-a42d-7577dd6bd592 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:52.830386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07a83629-6f5c-4e3f-a42d-7577dd6bd592 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:52.831007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07a83629-6f5c-4e3f-a42d-7577dd6bd592 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:52.831536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07a83629-6f5c-4e3f-a42d-7577dd6bd592 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:52.832366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07a83629-6f5c-4e3f-a42d-7577dd6bd592 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:52.832932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07a83629-6f5c-4e3f-a42d-7577dd6bd592 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:52.833472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07a83629-6f5c-4e3f-a42d-7577dd6bd592 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:53.010726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-07a83629-6f5c-4e3f-a42d-7577dd6bd592 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:53.023715 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-07a83629-6f5c-4e3f-a42d-7577dd6bd592 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1470 microversion: 2.1 time: 0.206982 Aug 29 15:59:53.024410 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3214/6635] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:52 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1470 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:53.479221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-00f44d3e-1e8f-4d0a-af89-de9b33e43393 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:53.479960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-00f44d3e-1e8f-4d0a-af89-de9b33e43393 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:53.487607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00f44d3e-1e8f-4d0a-af89-de9b33e43393 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:53.488443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00f44d3e-1e8f-4d0a-af89-de9b33e43393 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:53.489076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00f44d3e-1e8f-4d0a-af89-de9b33e43393 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:53.490014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00f44d3e-1e8f-4d0a-af89-de9b33e43393 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:53.490478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00f44d3e-1e8f-4d0a-af89-de9b33e43393 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:53.490915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00f44d3e-1e8f-4d0a-af89-de9b33e43393 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:53.743195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-00f44d3e-1e8f-4d0a-af89-de9b33e43393 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:53.753127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-00f44d3e-1e8f-4d0a-af89-de9b33e43393 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:53.755280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-00f44d3e-1e8f-4d0a-af89-de9b33e43393 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:53.757067 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-00f44d3e-1e8f-4d0a-af89-de9b33e43393 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 0.282964 Aug 29 15:59:53.758366 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3422/6636] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:53 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:59:54.046459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-911390bd-7e92-4ab6-b80b-7a2780ad5179 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:54.047866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-911390bd-7e92-4ab6-b80b-7a2780ad5179 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:54.055399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-911390bd-7e92-4ab6-b80b-7a2780ad5179 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:54.056305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-911390bd-7e92-4ab6-b80b-7a2780ad5179 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:54.056806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-911390bd-7e92-4ab6-b80b-7a2780ad5179 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:54.057789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-911390bd-7e92-4ab6-b80b-7a2780ad5179 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:54.058521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-911390bd-7e92-4ab6-b80b-7a2780ad5179 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:54.058998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-911390bd-7e92-4ab6-b80b-7a2780ad5179 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:54.220331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-911390bd-7e92-4ab6-b80b-7a2780ad5179 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:54.229254 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-911390bd-7e92-4ab6-b80b-7a2780ad5179 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1470 microversion: 2.1 time: 0.186725 Aug 29 15:59:54.230301 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3215/6637] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:54 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:59:54.782032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3b9e10bf-b959-417d-b252-367048927649 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:54.783492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3b9e10bf-b959-417d-b252-367048927649 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:54.790550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b9e10bf-b959-417d-b252-367048927649 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:54.791446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b9e10bf-b959-417d-b252-367048927649 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:54.792548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b9e10bf-b959-417d-b252-367048927649 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:54.793604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b9e10bf-b959-417d-b252-367048927649 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:54.794296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b9e10bf-b959-417d-b252-367048927649 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:54.794963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b9e10bf-b959-417d-b252-367048927649 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:54.984476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3b9e10bf-b959-417d-b252-367048927649 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:54.993022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3b9e10bf-b959-417d-b252-367048927649 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:54.994492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3b9e10bf-b959-417d-b252-367048927649 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:54.995718 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3b9e10bf-b959-417d-b252-367048927649 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 0.217855 Aug 29 15:59:54.996277 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3423/6638] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:54 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:55.253667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3b07282a-80e7-4f14-b6ce-721ad5b60aef tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:55.255864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3b07282a-80e7-4f14-b6ce-721ad5b60aef tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:55.266013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b07282a-80e7-4f14-b6ce-721ad5b60aef tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:55.267071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b07282a-80e7-4f14-b6ce-721ad5b60aef tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:55.267780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b07282a-80e7-4f14-b6ce-721ad5b60aef tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:55.268595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b07282a-80e7-4f14-b6ce-721ad5b60aef tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:55.269153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b07282a-80e7-4f14-b6ce-721ad5b60aef tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:55.269840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b07282a-80e7-4f14-b6ce-721ad5b60aef tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:55.493917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3b07282a-80e7-4f14-b6ce-721ad5b60aef tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:55.510425 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3b07282a-80e7-4f14-b6ce-721ad5b60aef tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1470 microversion: 2.1 time: 0.262715 Aug 29 15:59:55.511449 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3216/6639] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:55 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1470 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:56.028620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-390d214a-01be-4d0d-9a79-cd1289411fae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:56.030536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-390d214a-01be-4d0d-9a79-cd1289411fae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:56.042858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-390d214a-01be-4d0d-9a79-cd1289411fae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:56.043982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-390d214a-01be-4d0d-9a79-cd1289411fae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:56.044710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-390d214a-01be-4d0d-9a79-cd1289411fae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:56.045591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-390d214a-01be-4d0d-9a79-cd1289411fae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:56.046287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-390d214a-01be-4d0d-9a79-cd1289411fae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:56.046804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-390d214a-01be-4d0d-9a79-cd1289411fae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:56.403519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-390d214a-01be-4d0d-9a79-cd1289411fae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:56.416568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-390d214a-01be-4d0d-9a79-cd1289411fae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:56.419252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-390d214a-01be-4d0d-9a79-cd1289411fae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:56.420761 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-390d214a-01be-4d0d-9a79-cd1289411fae tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 0.405333 Aug 29 15:59:56.421537 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3424/6640] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:56 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:56.532441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4aba5b64-c6eb-4242-9331-017b57453f35 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:56.533066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4aba5b64-c6eb-4242-9331-017b57453f35 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:56.539747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4aba5b64-c6eb-4242-9331-017b57453f35 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:56.540476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4aba5b64-c6eb-4242-9331-017b57453f35 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:56.541069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4aba5b64-c6eb-4242-9331-017b57453f35 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:56.542094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4aba5b64-c6eb-4242-9331-017b57453f35 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:56.542783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4aba5b64-c6eb-4242-9331-017b57453f35 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:56.543418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4aba5b64-c6eb-4242-9331-017b57453f35 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:56.791442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4aba5b64-c6eb-4242-9331-017b57453f35 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:56.800136 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4aba5b64-c6eb-4242-9331-017b57453f35 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1470 microversion: 2.1 time: 0.271958 Aug 29 15:59:56.800766 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3217/6641] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:56 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1470 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:57.447763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-90e91d38-da03-4bbb-b86e-c924eca6c8af tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:57.448384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-90e91d38-da03-4bbb-b86e-c924eca6c8af tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:57.456918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90e91d38-da03-4bbb-b86e-c924eca6c8af tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:57.457461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90e91d38-da03-4bbb-b86e-c924eca6c8af tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:57.457898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90e91d38-da03-4bbb-b86e-c924eca6c8af tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:57.458624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90e91d38-da03-4bbb-b86e-c924eca6c8af tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:57.459115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90e91d38-da03-4bbb-b86e-c924eca6c8af tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:57.459767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90e91d38-da03-4bbb-b86e-c924eca6c8af tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:57.479220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:57.733944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-90e91d38-da03-4bbb-b86e-c924eca6c8af tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:57.754889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-90e91d38-da03-4bbb-b86e-c924eca6c8af tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:57.760741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-90e91d38-da03-4bbb-b86e-c924eca6c8af tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:57.767410 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-90e91d38-da03-4bbb-b86e-c924eca6c8af tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 0.325640 Aug 29 15:59:57.768715 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3425/6642] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:57 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:57.823030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea64bf8f-65f5-479c-a0d3-878e75f3d617 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:57.824470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ea64bf8f-65f5-479c-a0d3-878e75f3d617 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:57.836006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea64bf8f-65f5-479c-a0d3-878e75f3d617 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:57.836504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea64bf8f-65f5-479c-a0d3-878e75f3d617 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:57.836940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea64bf8f-65f5-479c-a0d3-878e75f3d617 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:57.837925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea64bf8f-65f5-479c-a0d3-878e75f3d617 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:57.838967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea64bf8f-65f5-479c-a0d3-878e75f3d617 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:57.839797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea64bf8f-65f5-479c-a0d3-878e75f3d617 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:57.871470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:58.328886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ea64bf8f-65f5-479c-a0d3-878e75f3d617 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:58.338110 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ea64bf8f-65f5-479c-a0d3-878e75f3d617 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1470 microversion: 2.1 time: 0.520085 Aug 29 15:59:58.351331 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3218/6643] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:57 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1470 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:58.588772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-67f9587d-42d5-411d-b459-b004accc3183 req-40abcba9-65e4-4c6f-96f7-0f18e19f37a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f49e97-67ee-4016-aee8-020f1b3773b9", "name": "network-vif-plugged", "status": "completed", "tag": "acd3d2b6-7116-4164-9b45-62aa74648b76"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:58.608620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-67f9587d-42d5-411d-b459-b004accc3183 req-40abcba9-65e4-4c6f-96f7-0f18e19f37a0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:58.613061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-67f9587d-42d5-411d-b459-b004accc3183 req-40abcba9-65e4-4c6f-96f7-0f18e19f37a0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:58.613589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-67f9587d-42d5-411d-b459-b004accc3183 req-40abcba9-65e4-4c6f-96f7-0f18e19f37a0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:58.639197 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-67f9587d-42d5-411d-b459-b004accc3183 req-40abcba9-65e4-4c6f-96f7-0f18e19f37a0 service nova] Creating event network-vif-plugged:acd3d2b6-7116-4164-9b45-62aa74648b76 for instance 73f49e97-67ee-4016-aee8-020f1b3773b9 on n-h1-839401-11 Aug 29 15:59:58.655780 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-67f9587d-42d5-411d-b459-b004accc3183 req-40abcba9-65e4-4c6f-96f7-0f18e19f37a0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064341 Aug 29 15:59:58.656988 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3426/6644] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:58.800964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-844dc504-4dd9-4197-8ab5-9e17e353c98c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:58.805408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-844dc504-4dd9-4197-8ab5-9e17e353c98c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:58.820118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-844dc504-4dd9-4197-8ab5-9e17e353c98c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:58.823668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-844dc504-4dd9-4197-8ab5-9e17e353c98c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:58.824280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-844dc504-4dd9-4197-8ab5-9e17e353c98c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:58.825615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-844dc504-4dd9-4197-8ab5-9e17e353c98c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:58.826098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-844dc504-4dd9-4197-8ab5-9e17e353c98c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:58.826533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-844dc504-4dd9-4197-8ab5-9e17e353c98c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:59.117552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-844dc504-4dd9-4197-8ab5-9e17e353c98c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:59.150372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-844dc504-4dd9-4197-8ab5-9e17e353c98c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:59.153106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-844dc504-4dd9-4197-8ab5-9e17e353c98c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:59.155478 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-844dc504-4dd9-4197-8ab5-9e17e353c98c tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 0.366133 Aug 29 15:59:59.158414 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3219/6645] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:58 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:59.364383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a6db54b4-7c43-44a5-a305-07d27b27e87f tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:59.365111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a6db54b4-7c43-44a5-a305-07d27b27e87f tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:59.374873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6db54b4-7c43-44a5-a305-07d27b27e87f tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:59.375719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6db54b4-7c43-44a5-a305-07d27b27e87f tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:59.376394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6db54b4-7c43-44a5-a305-07d27b27e87f tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:59.377410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6db54b4-7c43-44a5-a305-07d27b27e87f tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:59.378112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6db54b4-7c43-44a5-a305-07d27b27e87f tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:59.378780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6db54b4-7c43-44a5-a305-07d27b27e87f tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:59.645500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a6db54b4-7c43-44a5-a305-07d27b27e87f tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:59.659880 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a6db54b4-7c43-44a5-a305-07d27b27e87f tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1470 microversion: 2.1 time: 0.298905 Aug 29 15:59:59.662325 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3427/6646] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:59 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1470 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:00.180308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-43477b1a-0e4a-407f-b7f0-0fe134a5581a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:00.181063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-43477b1a-0e4a-407f-b7f0-0fe134a5581a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:00.188154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43477b1a-0e4a-407f-b7f0-0fe134a5581a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:00.188614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43477b1a-0e4a-407f-b7f0-0fe134a5581a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:00.189055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43477b1a-0e4a-407f-b7f0-0fe134a5581a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:00.189781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43477b1a-0e4a-407f-b7f0-0fe134a5581a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:00.191045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43477b1a-0e4a-407f-b7f0-0fe134a5581a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:00.191045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43477b1a-0e4a-407f-b7f0-0fe134a5581a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:00.338139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-43477b1a-0e4a-407f-b7f0-0fe134a5581a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:00.351220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-43477b1a-0e4a-407f-b7f0-0fe134a5581a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:00.353074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-43477b1a-0e4a-407f-b7f0-0fe134a5581a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:00.354941 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-43477b1a-0e4a-407f-b7f0-0fe134a5581a tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 0.178352 Aug 29 16:00:00.356208 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3220/6647] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 16:00:00 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:00:00.675019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-63779800-59c5-4dca-aaee-0dbfb9bec380 req-1f011f72-202c-4f8c-beb2-9770f95afbdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e1cc03-3a7b-4242-a1a6-98e756d3d326", "name": "network-vif-plugged", "status": "completed", "tag": "9c67ed58-1b7d-43f4-b23a-74f6094e5f88"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:00.683562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ed0766a4-4460-4fb1-9eaa-8ffb6b8da7f4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:00.684453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ed0766a4-4460-4fb1-9eaa-8ffb6b8da7f4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:00.691665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed0766a4-4460-4fb1-9eaa-8ffb6b8da7f4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:00.692578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed0766a4-4460-4fb1-9eaa-8ffb6b8da7f4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:00.693596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed0766a4-4460-4fb1-9eaa-8ffb6b8da7f4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:00.694610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed0766a4-4460-4fb1-9eaa-8ffb6b8da7f4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:00.695298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed0766a4-4460-4fb1-9eaa-8ffb6b8da7f4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:00.695927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed0766a4-4460-4fb1-9eaa-8ffb6b8da7f4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:00.700642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-63779800-59c5-4dca-aaee-0dbfb9bec380 req-1f011f72-202c-4f8c-beb2-9770f95afbdd service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:00.701422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-63779800-59c5-4dca-aaee-0dbfb9bec380 req-1f011f72-202c-4f8c-beb2-9770f95afbdd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:00.702052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-63779800-59c5-4dca-aaee-0dbfb9bec380 req-1f011f72-202c-4f8c-beb2-9770f95afbdd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:00.716393 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-63779800-59c5-4dca-aaee-0dbfb9bec380 req-1f011f72-202c-4f8c-beb2-9770f95afbdd service nova] Creating event network-vif-plugged:9c67ed58-1b7d-43f4-b23a-74f6094e5f88 for instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 on n-h1-839401-11 Aug 29 16:00:00.722460 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-63779800-59c5-4dca-aaee-0dbfb9bec380 req-1f011f72-202c-4f8c-beb2-9770f95afbdd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052218 Aug 29 16:00:00.723386 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3428/6648] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:00:01.084463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ed0766a4-4460-4fb1-9eaa-8ffb6b8da7f4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:01.093254 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ed0766a4-4460-4fb1-9eaa-8ffb6b8da7f4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1641 microversion: 2.1 time: 0.413930 Aug 29 16:00:01.093900 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3221/6649] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:00 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1641 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:00:01.115838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-163b1370-168d-48f5-ac9b-7c5a6810ba47 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:01.116551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-163b1370-168d-48f5-ac9b-7c5a6810ba47 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:01.123246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-163b1370-168d-48f5-ac9b-7c5a6810ba47 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:01.123738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-163b1370-168d-48f5-ac9b-7c5a6810ba47 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:01.124168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-163b1370-168d-48f5-ac9b-7c5a6810ba47 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:01.124905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-163b1370-168d-48f5-ac9b-7c5a6810ba47 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:01.125423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-163b1370-168d-48f5-ac9b-7c5a6810ba47 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:01.125845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-163b1370-168d-48f5-ac9b-7c5a6810ba47 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:01.336189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-163b1370-168d-48f5-ac9b-7c5a6810ba47 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:01.344662 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-163b1370-168d-48f5-ac9b-7c5a6810ba47 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1641 microversion: 2.1 time: 0.233568 Aug 29 16:00:01.345400 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3429/6650] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:01 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1641 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:01.364975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-23f0acc9-29ec-48c5-bfc4-79096b8dbb7b tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:01.365693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-23f0acc9-29ec-48c5-bfc4-79096b8dbb7b tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:01.372881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23f0acc9-29ec-48c5-bfc4-79096b8dbb7b tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:01.373646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23f0acc9-29ec-48c5-bfc4-79096b8dbb7b tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:01.374086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23f0acc9-29ec-48c5-bfc4-79096b8dbb7b tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:01.374941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23f0acc9-29ec-48c5-bfc4-79096b8dbb7b tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:01.375386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23f0acc9-29ec-48c5-bfc4-79096b8dbb7b tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:01.376105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23f0acc9-29ec-48c5-bfc4-79096b8dbb7b tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:01.378775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bd74a4dd-d1b6-40e1-9d51-ecfd0e8e8e00 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:01.379416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bd74a4dd-d1b6-40e1-9d51-ecfd0e8e8e00 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:01.386194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd74a4dd-d1b6-40e1-9d51-ecfd0e8e8e00 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:01.387048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd74a4dd-d1b6-40e1-9d51-ecfd0e8e8e00 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:01.388013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd74a4dd-d1b6-40e1-9d51-ecfd0e8e8e00 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:01.388731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd74a4dd-d1b6-40e1-9d51-ecfd0e8e8e00 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:01.389209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd74a4dd-d1b6-40e1-9d51-ecfd0e8e8e00 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:01.389632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd74a4dd-d1b6-40e1-9d51-ecfd0e8e8e00 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:01.528898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bd74a4dd-d1b6-40e1-9d51-ecfd0e8e8e00 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:01.538191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bd74a4dd-d1b6-40e1-9d51-ecfd0e8e8e00 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:01.539669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bd74a4dd-d1b6-40e1-9d51-ecfd0e8e8e00 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:01.541509 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bd74a4dd-d1b6-40e1-9d51-ecfd0e8e8e00 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 0.166836 Aug 29 16:00:01.541509 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3430/6651] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 16:00:01 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:00:02.332072 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-23f0acc9-29ec-48c5-bfc4-79096b8dbb7b tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1794 microversion: 2.1 time: 0.970944 Aug 29 16:00:02.333073 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3222/6652] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:01 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1794 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:02.565934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4ba255ef-477e-40df-aee5-9a58eef0cacb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:02.566634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4ba255ef-477e-40df-aee5-9a58eef0cacb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:02.574402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba255ef-477e-40df-aee5-9a58eef0cacb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:02.574904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba255ef-477e-40df-aee5-9a58eef0cacb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:02.575880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba255ef-477e-40df-aee5-9a58eef0cacb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:02.576761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba255ef-477e-40df-aee5-9a58eef0cacb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:02.577406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba255ef-477e-40df-aee5-9a58eef0cacb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:02.578031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ba255ef-477e-40df-aee5-9a58eef0cacb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:02.816667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4ba255ef-477e-40df-aee5-9a58eef0cacb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:02.838503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4ba255ef-477e-40df-aee5-9a58eef0cacb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:02.847583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4ba255ef-477e-40df-aee5-9a58eef0cacb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:02.849900 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4ba255ef-477e-40df-aee5-9a58eef0cacb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1731 microversion: 2.20 time: 0.287580 Aug 29 16:00:02.850320 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3431/6653] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 16:00:02 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1731 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:00:03.882381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7c8cdadc-3a56-4105-a084-45ea6ba92239 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:03.883574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7c8cdadc-3a56-4105-a084-45ea6ba92239 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:03.903666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8cdadc-3a56-4105-a084-45ea6ba92239 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:03.905892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8cdadc-3a56-4105-a084-45ea6ba92239 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:03.908017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8cdadc-3a56-4105-a084-45ea6ba92239 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:03.911656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8cdadc-3a56-4105-a084-45ea6ba92239 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:03.913685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8cdadc-3a56-4105-a084-45ea6ba92239 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:03.914340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c8cdadc-3a56-4105-a084-45ea6ba92239 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:04.222229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7c8cdadc-3a56-4105-a084-45ea6ba92239 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:04.240393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7c8cdadc-3a56-4105-a084-45ea6ba92239 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:04.242355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7c8cdadc-3a56-4105-a084-45ea6ba92239 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:04.244181 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7c8cdadc-3a56-4105-a084-45ea6ba92239 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1718 microversion: 2.20 time: 0.371998 Aug 29 16:00:04.263998 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3223/6654] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 16:00:03 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1718 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:00:05.308706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-129e8753-039c-4fc3-86f1-6d89a6feb06d req-c9c3b281-b436-478a-a3ff-b11bc34a2ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f49e97-67ee-4016-aee8-020f1b3773b9", "tag": "acd3d2b6-7116-4164-9b45-62aa74648b76"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:05.331545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-129e8753-039c-4fc3-86f1-6d89a6feb06d req-c9c3b281-b436-478a-a3ff-b11bc34a2ea9 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:05.332211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-129e8753-039c-4fc3-86f1-6d89a6feb06d req-c9c3b281-b436-478a-a3ff-b11bc34a2ea9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:05.332755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-129e8753-039c-4fc3-86f1-6d89a6feb06d req-c9c3b281-b436-478a-a3ff-b11bc34a2ea9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:05.351110 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-129e8753-039c-4fc3-86f1-6d89a6feb06d req-c9c3b281-b436-478a-a3ff-b11bc34a2ea9 service nova] Creating event network-changed:acd3d2b6-7116-4164-9b45-62aa74648b76 for instance 73f49e97-67ee-4016-aee8-020f1b3773b9 on n-h1-839401-11 Aug 29 16:00:05.357235 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-129e8753-039c-4fc3-86f1-6d89a6feb06d req-c9c3b281-b436-478a-a3ff-b11bc34a2ea9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052161 Aug 29 16:00:05.358759 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3432/6655] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:08.700647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1a571ca5-bd56-42ff-b0a3-f31f6e8374fa tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:08.704025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1a571ca5-bd56-42ff-b0a3-f31f6e8374fa tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:08.712314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a571ca5-bd56-42ff-b0a3-f31f6e8374fa tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:08.718585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a571ca5-bd56-42ff-b0a3-f31f6e8374fa tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:08.719315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a571ca5-bd56-42ff-b0a3-f31f6e8374fa tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:08.720250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a571ca5-bd56-42ff-b0a3-f31f6e8374fa tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:08.720886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a571ca5-bd56-42ff-b0a3-f31f6e8374fa tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:08.721554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a571ca5-bd56-42ff-b0a3-f31f6e8374fa tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:08.794324 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1a571ca5-bd56-42ff-b0a3-f31f6e8374fa tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62/action" status: 200 len: 24574 microversion: 2.1 time: 0.097787 Aug 29 16:00:08.795315 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3224/6656] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:00:08 2022] POST /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62/action => generated 24574 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:00:47.972393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-426d6747-ebc6-4dc5-abb9-6f6ad82ddcf7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:47.973492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-426d6747-ebc6-4dc5-abb9-6f6ad82ddcf7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:47.976484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=37 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:47.978932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=33 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:47.988638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-426d6747-ebc6-4dc5-abb9-6f6ad82ddcf7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:47.991962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-426d6747-ebc6-4dc5-abb9-6f6ad82ddcf7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:47.994270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-426d6747-ebc6-4dc5-abb9-6f6ad82ddcf7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:47.995084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-426d6747-ebc6-4dc5-abb9-6f6ad82ddcf7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:47.995642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-426d6747-ebc6-4dc5-abb9-6f6ad82ddcf7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:47.996134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-426d6747-ebc6-4dc5-abb9-6f6ad82ddcf7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:48.201786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-426d6747-ebc6-4dc5-abb9-6f6ad82ddcf7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:48.216295 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-426d6747-ebc6-4dc5-abb9-6f6ad82ddcf7 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1682 microversion: 2.1 time: 0.248270 Aug 29 16:00:48.237202 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3433/6657] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:47 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1682 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:48.387248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9fc08307-8d0f-4497-812a-010825fc02f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:48.390358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9fc08307-8d0f-4497-812a-010825fc02f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:48.398087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=29 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:48.398959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=36 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:48.400770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fc08307-8d0f-4497-812a-010825fc02f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:48.401733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fc08307-8d0f-4497-812a-010825fc02f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:48.402388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fc08307-8d0f-4497-812a-010825fc02f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:48.403290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fc08307-8d0f-4497-812a-010825fc02f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:48.403935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fc08307-8d0f-4497-812a-010825fc02f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:48.404537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9fc08307-8d0f-4497-812a-010825fc02f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:48.486608 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9fc08307-8d0f-4497-812a-010825fc02f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62/action" status: 200 len: 32640 microversion: 2.1 time: 0.104114 Aug 29 16:00:48.495063 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3225/6658] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:00:48 2022] POST /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62/action => generated 32640 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:00:48.658117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-284ea29c-d8d5-4141-a0c3-705b3e7dcd3a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:48.659946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-284ea29c-d8d5-4141-a0c3-705b3e7dcd3a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:48.667672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-284ea29c-d8d5-4141-a0c3-705b3e7dcd3a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:48.668266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-284ea29c-d8d5-4141-a0c3-705b3e7dcd3a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:48.668935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-284ea29c-d8d5-4141-a0c3-705b3e7dcd3a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:48.669923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-284ea29c-d8d5-4141-a0c3-705b3e7dcd3a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:48.670576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-284ea29c-d8d5-4141-a0c3-705b3e7dcd3a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:48.671246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-284ea29c-d8d5-4141-a0c3-705b3e7dcd3a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:49.096306 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-284ea29c-d8d5-4141-a0c3-705b3e7dcd3a tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1835 microversion: 2.1 time: 0.443827 Aug 29 16:00:49.113163 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3434/6659] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:48 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1835 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:49.133121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cb481e15-c9f0-44d9-b346-8e4af41954ca tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:49.135684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cb481e15-c9f0-44d9-b346-8e4af41954ca tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:49.143904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb481e15-c9f0-44d9-b346-8e4af41954ca tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:49.146519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb481e15-c9f0-44d9-b346-8e4af41954ca tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:49.147181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb481e15-c9f0-44d9-b346-8e4af41954ca tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:49.148146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb481e15-c9f0-44d9-b346-8e4af41954ca tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:49.148793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb481e15-c9f0-44d9-b346-8e4af41954ca tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:49.151112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb481e15-c9f0-44d9-b346-8e4af41954ca tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:49.186308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-cb481e15-c9f0-44d9-b346-8e4af41954ca tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lazy-loading 'flavor' on Instance uuid 14191e49-0809-49a9-964d-029df9971a62 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:00:49.202715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cb481e15-c9f0-44d9-b346-8e4af41954ca tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] [instance: 14191e49-0809-49a9-964d-029df9971a62] Going to try to live migrate instance to another host {{(pid=122361) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 16:00:52.416988 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cb481e15-c9f0-44d9-b346-8e4af41954ca tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62/action" status: 202 len: 0 microversion: 2.1 time: 3.288600 Aug 29 16:00:52.418112 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3226/6660] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:00:49 2022] POST /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62/action => generated 0 bytes in 3291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:00:52.427706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-915734d9-fe6d-4464-89f6-7f6c148d44c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:52.429268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-915734d9-fe6d-4464-89f6-7f6c148d44c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:52.437740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-915734d9-fe6d-4464-89f6-7f6c148d44c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:52.438823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-915734d9-fe6d-4464-89f6-7f6c148d44c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:52.439453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-915734d9-fe6d-4464-89f6-7f6c148d44c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:52.441067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-915734d9-fe6d-4464-89f6-7f6c148d44c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:52.441790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-915734d9-fe6d-4464-89f6-7f6c148d44c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:52.442572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-915734d9-fe6d-4464-89f6-7f6c148d44c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:52.632921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-915734d9-fe6d-4464-89f6-7f6c148d44c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:52.645472 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-915734d9-fe6d-4464-89f6-7f6c148d44c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1692 microversion: 2.1 time: 0.222265 Aug 29 16:00:52.647119 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3435/6661] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:52 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1692 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:53.681264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-391335c7-6eea-4601-9965-43c158b46a1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:53.682580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-391335c7-6eea-4601-9965-43c158b46a1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:53.691390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-391335c7-6eea-4601-9965-43c158b46a1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:53.692106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-391335c7-6eea-4601-9965-43c158b46a1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:53.692741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-391335c7-6eea-4601-9965-43c158b46a1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:53.693865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-391335c7-6eea-4601-9965-43c158b46a1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:53.694491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-391335c7-6eea-4601-9965-43c158b46a1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:53.695111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-391335c7-6eea-4601-9965-43c158b46a1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:54.220028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-391335c7-6eea-4601-9965-43c158b46a1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:54.235223 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-391335c7-6eea-4601-9965-43c158b46a1c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1692 microversion: 2.1 time: 0.559937 Aug 29 16:00:54.235865 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3227/6662] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:53 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1692 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:55.183027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-ec8767cd-f509-45d4-9b08-8b867075fa9c req-213da4fb-c2a6-40b9-acf8-c4f72987fb78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14191e49-0809-49a9-964d-029df9971a62", "name": "network-vif-unplugged", "status": "completed", "tag": "4ce4f64e-0fb4-49d4-b504-519581182ab0"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:55.195491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ec8767cd-f509-45d4-9b08-8b867075fa9c req-213da4fb-c2a6-40b9-acf8-c4f72987fb78 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:55.196278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ec8767cd-f509-45d4-9b08-8b867075fa9c req-213da4fb-c2a6-40b9-acf8-c4f72987fb78 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:55.197074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ec8767cd-f509-45d4-9b08-8b867075fa9c req-213da4fb-c2a6-40b9-acf8-c4f72987fb78 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:55.219153 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-ec8767cd-f509-45d4-9b08-8b867075fa9c req-213da4fb-c2a6-40b9-acf8-c4f72987fb78 service nova] Creating event network-vif-unplugged:4ce4f64e-0fb4-49d4-b504-519581182ab0 for instance 14191e49-0809-49a9-964d-029df9971a62 on n-h2-839401-11 Aug 29 16:00:55.227845 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-ec8767cd-f509-45d4-9b08-8b867075fa9c req-213da4fb-c2a6-40b9-acf8-c4f72987fb78 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050172 Aug 29 16:00:55.229178 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3436/6663] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:55.262599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0f14dd87-ed5f-41d5-80f5-466f0700934e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:55.263868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0f14dd87-ed5f-41d5-80f5-466f0700934e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:55.278084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f14dd87-ed5f-41d5-80f5-466f0700934e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:55.279613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f14dd87-ed5f-41d5-80f5-466f0700934e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:55.280829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f14dd87-ed5f-41d5-80f5-466f0700934e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:55.282792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f14dd87-ed5f-41d5-80f5-466f0700934e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:55.283466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f14dd87-ed5f-41d5-80f5-466f0700934e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:55.284072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0f14dd87-ed5f-41d5-80f5-466f0700934e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:55.653962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0f14dd87-ed5f-41d5-80f5-466f0700934e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:55.663441 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0f14dd87-ed5f-41d5-80f5-466f0700934e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1692 microversion: 2.1 time: 0.411032 Aug 29 16:00:55.664050 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3228/6664] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:55 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1692 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:56.691524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cda6de99-7dee-4a38-856c-285901eb3256 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:56.692991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cda6de99-7dee-4a38-856c-285901eb3256 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:56.710480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cda6de99-7dee-4a38-856c-285901eb3256 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:56.711292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cda6de99-7dee-4a38-856c-285901eb3256 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:56.712136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cda6de99-7dee-4a38-856c-285901eb3256 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:56.713149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cda6de99-7dee-4a38-856c-285901eb3256 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:56.713895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cda6de99-7dee-4a38-856c-285901eb3256 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:56.715200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cda6de99-7dee-4a38-856c-285901eb3256 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:56.944655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cda6de99-7dee-4a38-856c-285901eb3256 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:56.956371 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cda6de99-7dee-4a38-856c-285901eb3256 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1692 microversion: 2.1 time: 0.269621 Aug 29 16:00:56.956904 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3437/6665] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:56 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1692 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:57.258970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-914d87d7-a961-4670-810f-2ab247cc8f81 req-78b5ec52-e3bf-4f26-9b57-7b681a333034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14191e49-0809-49a9-964d-029df9971a62", "tag": "4ce4f64e-0fb4-49d4-b504-519581182ab0"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:57.274134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-914d87d7-a961-4670-810f-2ab247cc8f81 req-78b5ec52-e3bf-4f26-9b57-7b681a333034 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:57.278105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-914d87d7-a961-4670-810f-2ab247cc8f81 req-78b5ec52-e3bf-4f26-9b57-7b681a333034 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:57.278577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-914d87d7-a961-4670-810f-2ab247cc8f81 req-78b5ec52-e3bf-4f26-9b57-7b681a333034 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:57.299862 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-914d87d7-a961-4670-810f-2ab247cc8f81 req-78b5ec52-e3bf-4f26-9b57-7b681a333034 service nova] Creating event network-changed:4ce4f64e-0fb4-49d4-b504-519581182ab0 for instance 14191e49-0809-49a9-964d-029df9971a62 on n-h2-839401-11 Aug 29 16:00:57.311016 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-914d87d7-a961-4670-810f-2ab247cc8f81 req-78b5ec52-e3bf-4f26-9b57-7b681a333034 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056289 Aug 29 16:00:57.311807 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3229/6666] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:57.979319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aaf23db7-5e3f-4e60-9f8e-18c832f5e94c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:57.980186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aaf23db7-5e3f-4e60-9f8e-18c832f5e94c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:57.992005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf23db7-5e3f-4e60-9f8e-18c832f5e94c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:57.992508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf23db7-5e3f-4e60-9f8e-18c832f5e94c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:57.996031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf23db7-5e3f-4e60-9f8e-18c832f5e94c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:57.998745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf23db7-5e3f-4e60-9f8e-18c832f5e94c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:57.999257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf23db7-5e3f-4e60-9f8e-18c832f5e94c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:58.001033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf23db7-5e3f-4e60-9f8e-18c832f5e94c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:58.345238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aaf23db7-5e3f-4e60-9f8e-18c832f5e94c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:58.362816 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aaf23db7-5e3f-4e60-9f8e-18c832f5e94c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1692 microversion: 2.1 time: 0.387791 Aug 29 16:00:58.364101 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3438/6667] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:57 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1692 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:00:59.387426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6ea1765b-44a1-467d-8a13-336f8a0944f3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:59.390403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6ea1765b-44a1-467d-8a13-336f8a0944f3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:59.400751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ea1765b-44a1-467d-8a13-336f8a0944f3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:59.403984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ea1765b-44a1-467d-8a13-336f8a0944f3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:59.408392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ea1765b-44a1-467d-8a13-336f8a0944f3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:59.409292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ea1765b-44a1-467d-8a13-336f8a0944f3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:59.409843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ea1765b-44a1-467d-8a13-336f8a0944f3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:59.415451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ea1765b-44a1-467d-8a13-336f8a0944f3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:59.603532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6ea1765b-44a1-467d-8a13-336f8a0944f3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:59.614681 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6ea1765b-44a1-467d-8a13-336f8a0944f3 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1692 microversion: 2.1 time: 0.232826 Aug 29 16:00:59.618026 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3230/6668] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:59 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1692 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:00.643505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f824af07-df5d-401c-baf1-e84d59ffb4cc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:00.644067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f824af07-df5d-401c-baf1-e84d59ffb4cc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:00.665975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f824af07-df5d-401c-baf1-e84d59ffb4cc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:00.666851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f824af07-df5d-401c-baf1-e84d59ffb4cc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:00.667503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f824af07-df5d-401c-baf1-e84d59ffb4cc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:00.668592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f824af07-df5d-401c-baf1-e84d59ffb4cc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:00.669253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f824af07-df5d-401c-baf1-e84d59ffb4cc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:00.669856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f824af07-df5d-401c-baf1-e84d59ffb4cc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:00.956246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f824af07-df5d-401c-baf1-e84d59ffb4cc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:00.970415 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f824af07-df5d-401c-baf1-e84d59ffb4cc tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1692 microversion: 2.1 time: 0.334783 Aug 29 16:01:00.971072 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3439/6669] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:00 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1692 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:01.993412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-38e47798-6791-4877-903a-c7428d3416b4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:01.994072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-38e47798-6791-4877-903a-c7428d3416b4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:02.005661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e47798-6791-4877-903a-c7428d3416b4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:02.008892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e47798-6791-4877-903a-c7428d3416b4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:02.009783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e47798-6791-4877-903a-c7428d3416b4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:02.010735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e47798-6791-4877-903a-c7428d3416b4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:02.011383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e47798-6791-4877-903a-c7428d3416b4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:02.011970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-38e47798-6791-4877-903a-c7428d3416b4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:02.288700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-38e47798-6791-4877-903a-c7428d3416b4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:02.297451 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-38e47798-6791-4877-903a-c7428d3416b4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1692 microversion: 2.1 time: 0.309230 Aug 29 16:01:02.312416 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3231/6670] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:01 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1692 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:03.319413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aa8e6e68-a40c-4400-bc0b-a5616fdac21d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:03.320638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aa8e6e68-a40c-4400-bc0b-a5616fdac21d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:03.341360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa8e6e68-a40c-4400-bc0b-a5616fdac21d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:03.342086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa8e6e68-a40c-4400-bc0b-a5616fdac21d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:03.342709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa8e6e68-a40c-4400-bc0b-a5616fdac21d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:03.343915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa8e6e68-a40c-4400-bc0b-a5616fdac21d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:03.344528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa8e6e68-a40c-4400-bc0b-a5616fdac21d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:03.345900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa8e6e68-a40c-4400-bc0b-a5616fdac21d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:03.621880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aa8e6e68-a40c-4400-bc0b-a5616fdac21d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:03.635066 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aa8e6e68-a40c-4400-bc0b-a5616fdac21d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1692 microversion: 2.1 time: 0.319643 Aug 29 16:01:03.637756 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3440/6671] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:03 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1692 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:04.659438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-85ca1f29-796b-4d74-8742-c35c9e55982e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:04.660061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-85ca1f29-796b-4d74-8742-c35c9e55982e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:04.685735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85ca1f29-796b-4d74-8742-c35c9e55982e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:04.686238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85ca1f29-796b-4d74-8742-c35c9e55982e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:04.686897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85ca1f29-796b-4d74-8742-c35c9e55982e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:04.688012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85ca1f29-796b-4d74-8742-c35c9e55982e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:04.688658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85ca1f29-796b-4d74-8742-c35c9e55982e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:04.689125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85ca1f29-796b-4d74-8742-c35c9e55982e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:05.039303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-85ca1f29-796b-4d74-8742-c35c9e55982e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:05.055308 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-85ca1f29-796b-4d74-8742-c35c9e55982e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1692 microversion: 2.1 time: 0.399573 Aug 29 16:01:05.068125 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3232/6672] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:04 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1692 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:06.078962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7a6bc819-2682-4c89-bcd6-18373e0be8a4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:06.079583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7a6bc819-2682-4c89-bcd6-18373e0be8a4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:06.096881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a6bc819-2682-4c89-bcd6-18373e0be8a4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:06.097611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a6bc819-2682-4c89-bcd6-18373e0be8a4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:06.098211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a6bc819-2682-4c89-bcd6-18373e0be8a4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:06.099091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a6bc819-2682-4c89-bcd6-18373e0be8a4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:06.099728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a6bc819-2682-4c89-bcd6-18373e0be8a4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:06.100163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7a6bc819-2682-4c89-bcd6-18373e0be8a4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:06.374967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7a6bc819-2682-4c89-bcd6-18373e0be8a4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:06.396841 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7a6bc819-2682-4c89-bcd6-18373e0be8a4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1692 microversion: 2.1 time: 0.322794 Aug 29 16:01:06.397750 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3441/6673] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:06 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1692 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:07.418514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dac6a71e-2873-4ccc-8e33-c72e446d3d13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:07.419301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dac6a71e-2873-4ccc-8e33-c72e446d3d13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:07.431999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dac6a71e-2873-4ccc-8e33-c72e446d3d13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:07.441348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dac6a71e-2873-4ccc-8e33-c72e446d3d13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:07.442772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dac6a71e-2873-4ccc-8e33-c72e446d3d13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:07.445030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dac6a71e-2873-4ccc-8e33-c72e446d3d13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:07.445962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dac6a71e-2873-4ccc-8e33-c72e446d3d13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:07.446653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dac6a71e-2873-4ccc-8e33-c72e446d3d13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:07.691855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dac6a71e-2873-4ccc-8e33-c72e446d3d13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:07.700198 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dac6a71e-2873-4ccc-8e33-c72e446d3d13 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1692 microversion: 2.1 time: 0.285655 Aug 29 16:01:07.702218 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3233/6674] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:07 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1692 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:08.725114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65b6b4ea-ace7-4679-8742-e7d968bcd00e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:08.725747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-65b6b4ea-ace7-4679-8742-e7d968bcd00e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:08.735545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65b6b4ea-ace7-4679-8742-e7d968bcd00e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:08.736292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65b6b4ea-ace7-4679-8742-e7d968bcd00e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:08.736900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65b6b4ea-ace7-4679-8742-e7d968bcd00e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:08.751376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65b6b4ea-ace7-4679-8742-e7d968bcd00e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:08.756005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65b6b4ea-ace7-4679-8742-e7d968bcd00e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:08.757276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65b6b4ea-ace7-4679-8742-e7d968bcd00e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:09.108130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-65b6b4ea-ace7-4679-8742-e7d968bcd00e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:09.120307 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-65b6b4ea-ace7-4679-8742-e7d968bcd00e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1692 microversion: 2.1 time: 0.396694 Aug 29 16:01:09.139047 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3442/6675] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:08 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1692 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:10.154009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1d2ea1fc-aafd-41e1-88f1-7a4bff0d3dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:10.155480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1d2ea1fc-aafd-41e1-88f1-7a4bff0d3dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:10.171418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d2ea1fc-aafd-41e1-88f1-7a4bff0d3dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:10.172506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d2ea1fc-aafd-41e1-88f1-7a4bff0d3dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:10.173039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d2ea1fc-aafd-41e1-88f1-7a4bff0d3dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:10.174764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d2ea1fc-aafd-41e1-88f1-7a4bff0d3dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:10.175324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d2ea1fc-aafd-41e1-88f1-7a4bff0d3dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:10.175846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d2ea1fc-aafd-41e1-88f1-7a4bff0d3dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:10.370349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1d2ea1fc-aafd-41e1-88f1-7a4bff0d3dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:10.380694 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1d2ea1fc-aafd-41e1-88f1-7a4bff0d3dd4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1682 microversion: 2.1 time: 0.235041 Aug 29 16:01:10.397530 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3234/6676] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:10 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1682 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:10.426525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e9f24dcf-e744-4fc5-a4b8-79d30e7c12d4 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:10.427887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e9f24dcf-e744-4fc5-a4b8-79d30e7c12d4 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:10.437473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9f24dcf-e744-4fc5-a4b8-79d30e7c12d4 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:10.438359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9f24dcf-e744-4fc5-a4b8-79d30e7c12d4 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:10.438985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9f24dcf-e744-4fc5-a4b8-79d30e7c12d4 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:10.444834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9f24dcf-e744-4fc5-a4b8-79d30e7c12d4 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:10.450599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9f24dcf-e744-4fc5-a4b8-79d30e7c12d4 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:10.467462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9f24dcf-e744-4fc5-a4b8-79d30e7c12d4 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:11.021662 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e9f24dcf-e744-4fc5-a4b8-79d30e7c12d4 tempest-TestNetworkAdvancedServerOps-1649647462 tempest-TestNetworkAdvancedServerOps-1649647462-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1835 microversion: 2.1 time: 0.599222 Aug 29 16:01:11.039123 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3443/6677] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:10 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1835 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:11.044710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ff16df4e-700c-4edd-8cfe-be95e3c2089d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:11.045324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ff16df4e-700c-4edd-8cfe-be95e3c2089d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:11.052114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff16df4e-700c-4edd-8cfe-be95e3c2089d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:11.052608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff16df4e-700c-4edd-8cfe-be95e3c2089d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:11.053044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff16df4e-700c-4edd-8cfe-be95e3c2089d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:11.053811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff16df4e-700c-4edd-8cfe-be95e3c2089d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:11.054274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff16df4e-700c-4edd-8cfe-be95e3c2089d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:11.054693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff16df4e-700c-4edd-8cfe-be95e3c2089d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:11.272238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-54466936-9cf0-4906-9ab7-ffffc5321b34 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:11.274555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-54466936-9cf0-4906-9ab7-ffffc5321b34 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:11.280850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54466936-9cf0-4906-9ab7-ffffc5321b34 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:11.281407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54466936-9cf0-4906-9ab7-ffffc5321b34 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:11.281985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54466936-9cf0-4906-9ab7-ffffc5321b34 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:11.282703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54466936-9cf0-4906-9ab7-ffffc5321b34 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:11.283163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54466936-9cf0-4906-9ab7-ffffc5321b34 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:11.283588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54466936-9cf0-4906-9ab7-ffffc5321b34 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:11.297934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ff16df4e-700c-4edd-8cfe-be95e3c2089d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:11.311135 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ff16df4e-700c-4edd-8cfe-be95e3c2089d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1682 microversion: 2.1 time: 0.270523 Aug 29 16:01:11.311746 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3235/6678] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:11 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1682 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:11.345580 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-54466936-9cf0-4906-9ab7-ffffc5321b34 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.079157 Aug 29 16:01:11.357409 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3444/6679] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 16:01:11 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:11.455391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a1e6fd95-79d8-4f74-908f-0f686fe975ca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:11.456496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a1e6fd95-79d8-4f74-908f-0f686fe975ca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:11.479724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1e6fd95-79d8-4f74-908f-0f686fe975ca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:11.480410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1e6fd95-79d8-4f74-908f-0f686fe975ca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:11.480977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1e6fd95-79d8-4f74-908f-0f686fe975ca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:11.481859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1e6fd95-79d8-4f74-908f-0f686fe975ca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:11.484847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1e6fd95-79d8-4f74-908f-0f686fe975ca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:11.485453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1e6fd95-79d8-4f74-908f-0f686fe975ca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:11.561055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a1e6fd95-79d8-4f74-908f-0f686fe975ca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:01:11.707286 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a1e6fd95-79d8-4f74-908f-0f686fe975ca tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 204 len: 0 microversion: 2.20 time: 0.256033 Aug 29 16:01:11.708152 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3236/6680] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 16:01:11 2022] DELETE /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 16:01:11.717910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3ad39f49-7c92-472a-850e-3928e054c0eb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:11.718633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3ad39f49-7c92-472a-850e-3928e054c0eb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:11.726028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ad39f49-7c92-472a-850e-3928e054c0eb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:11.726706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ad39f49-7c92-472a-850e-3928e054c0eb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:11.727297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ad39f49-7c92-472a-850e-3928e054c0eb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:11.728232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ad39f49-7c92-472a-850e-3928e054c0eb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:11.728699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ad39f49-7c92-472a-850e-3928e054c0eb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:11.729183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ad39f49-7c92-472a-850e-3928e054c0eb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:11.946270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3ad39f49-7c92-472a-850e-3928e054c0eb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:11.956180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3ad39f49-7c92-472a-850e-3928e054c0eb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:11.958003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3ad39f49-7c92-472a-850e-3928e054c0eb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:11.959727 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3ad39f49-7c92-472a-850e-3928e054c0eb tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1724 microversion: 2.20 time: 0.247283 Aug 29 16:01:11.961040 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3445/6681] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 16:01:11 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:01:12.985063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5ea749a0-a337-4645-bcac-75f134f2dc4d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:12.985887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5ea749a0-a337-4645-bcac-75f134f2dc4d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:12.994029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ea749a0-a337-4645-bcac-75f134f2dc4d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:12.995056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ea749a0-a337-4645-bcac-75f134f2dc4d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:12.995734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ea749a0-a337-4645-bcac-75f134f2dc4d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:12.996623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ea749a0-a337-4645-bcac-75f134f2dc4d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:12.997288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ea749a0-a337-4645-bcac-75f134f2dc4d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:12.997912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ea749a0-a337-4645-bcac-75f134f2dc4d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:13.240451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5ea749a0-a337-4645-bcac-75f134f2dc4d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:13.249696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5ea749a0-a337-4645-bcac-75f134f2dc4d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:13.254900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5ea749a0-a337-4645-bcac-75f134f2dc4d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:13.256473 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5ea749a0-a337-4645-bcac-75f134f2dc4d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1724 microversion: 2.20 time: 0.275999 Aug 29 16:01:13.257101 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3237/6682] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 16:01:12 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:01:13.475159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f1cf7553-a5d9-4f87-b552-2bf33dd0d412 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:13.478533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f1cf7553-a5d9-4f87-b552-2bf33dd0d412 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:13.487063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1cf7553-a5d9-4f87-b552-2bf33dd0d412 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:13.487766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1cf7553-a5d9-4f87-b552-2bf33dd0d412 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:13.490822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1cf7553-a5d9-4f87-b552-2bf33dd0d412 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:13.491956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1cf7553-a5d9-4f87-b552-2bf33dd0d412 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:13.492893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1cf7553-a5d9-4f87-b552-2bf33dd0d412 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:13.493947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1cf7553-a5d9-4f87-b552-2bf33dd0d412 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:13.567579 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f1cf7553-a5d9-4f87-b552-2bf33dd0d412 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62/action" status: 200 len: 38541 microversion: 2.1 time: 0.096817 Aug 29 16:01:13.576281 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3446/6683] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:01:13 2022] POST /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62/action => generated 38541 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:01:14.286705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e50d1653-0c87-494d-b3ce-cf67d3378f67 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:14.288251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e50d1653-0c87-494d-b3ce-cf67d3378f67 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:14.298063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e50d1653-0c87-494d-b3ce-cf67d3378f67 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:14.298878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e50d1653-0c87-494d-b3ce-cf67d3378f67 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:14.300015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e50d1653-0c87-494d-b3ce-cf67d3378f67 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:14.301315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e50d1653-0c87-494d-b3ce-cf67d3378f67 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:14.302288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e50d1653-0c87-494d-b3ce-cf67d3378f67 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:14.303244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e50d1653-0c87-494d-b3ce-cf67d3378f67 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:14.710987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e50d1653-0c87-494d-b3ce-cf67d3378f67 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:14.726475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e50d1653-0c87-494d-b3ce-cf67d3378f67 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:14.735418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e50d1653-0c87-494d-b3ce-cf67d3378f67 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:14.736702 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e50d1653-0c87-494d-b3ce-cf67d3378f67 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1724 microversion: 2.20 time: 0.456223 Aug 29 16:01:14.737996 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3238/6684] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 16:01:14 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1724 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:01:15.151077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0effa89e-d826-4ae3-885e-49b9b0a82564 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:15.151976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0effa89e-d826-4ae3-885e-49b9b0a82564 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:15.173892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0effa89e-d826-4ae3-885e-49b9b0a82564 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:15.174848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0effa89e-d826-4ae3-885e-49b9b0a82564 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:15.175414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0effa89e-d826-4ae3-885e-49b9b0a82564 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:15.176268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0effa89e-d826-4ae3-885e-49b9b0a82564 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:15.177641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0effa89e-d826-4ae3-885e-49b9b0a82564 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:15.178437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0effa89e-d826-4ae3-885e-49b9b0a82564 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:15.182639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-a04e1429-33ea-4fa0-ae22-f0f6505f400e req-74ba94bd-5ec0-45c0-84d1-aeb6526f978c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14191e49-0809-49a9-964d-029df9971a62", "tag": "4ce4f64e-0fb4-49d4-b504-519581182ab0"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:15.205041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a04e1429-33ea-4fa0-ae22-f0f6505f400e req-74ba94bd-5ec0-45c0-84d1-aeb6526f978c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:15.206815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a04e1429-33ea-4fa0-ae22-f0f6505f400e req-74ba94bd-5ec0-45c0-84d1-aeb6526f978c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:15.208309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a04e1429-33ea-4fa0-ae22-f0f6505f400e req-74ba94bd-5ec0-45c0-84d1-aeb6526f978c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:15.218240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:15.224830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0effa89e-d826-4ae3-885e-49b9b0a82564 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:01:15.264434 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-a04e1429-33ea-4fa0-ae22-f0f6505f400e req-74ba94bd-5ec0-45c0-84d1-aeb6526f978c service nova] Creating event network-changed:4ce4f64e-0fb4-49d4-b504-519581182ab0 for instance 14191e49-0809-49a9-964d-029df9971a62 on n-h1-839401-11 Aug 29 16:01:15.283904 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-a04e1429-33ea-4fa0-ae22-f0f6505f400e req-74ba94bd-5ec0-45c0-84d1-aeb6526f978c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105464 Aug 29 16:01:15.285139 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3239/6685] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:01:15.388039 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0effa89e-d826-4ae3-885e-49b9b0a82564 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "DELETE /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 204 len: 0 microversion: 2.1 time: 0.241055 Aug 29 16:01:15.389744 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3447/6686] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:01:15 2022] DELETE /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:01:15.399222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-db97c99e-07f8-41a1-b013-50738da3a93d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:15.399861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-db97c99e-07f8-41a1-b013-50738da3a93d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:15.418735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db97c99e-07f8-41a1-b013-50738da3a93d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:15.419428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db97c99e-07f8-41a1-b013-50738da3a93d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:15.423115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db97c99e-07f8-41a1-b013-50738da3a93d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:15.426002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db97c99e-07f8-41a1-b013-50738da3a93d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:15.426750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db97c99e-07f8-41a1-b013-50738da3a93d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:15.427679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-db97c99e-07f8-41a1-b013-50738da3a93d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:15.764744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3a020201-1e21-472d-925e-5e5c55458d28 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:15.765694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3a020201-1e21-472d-925e-5e5c55458d28 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:15.781730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a020201-1e21-472d-925e-5e5c55458d28 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:15.788291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a020201-1e21-472d-925e-5e5c55458d28 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:15.788942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a020201-1e21-472d-925e-5e5c55458d28 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:15.797024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a020201-1e21-472d-925e-5e5c55458d28 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:15.800407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a020201-1e21-472d-925e-5e5c55458d28 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:15.802282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a020201-1e21-472d-925e-5e5c55458d28 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:15.834293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-db97c99e-07f8-41a1-b013-50738da3a93d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:15.850251 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-db97c99e-07f8-41a1-b013-50738da3a93d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1688 microversion: 2.1 time: 0.455370 Aug 29 16:01:15.851003 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3240/6687] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:15 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1688 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:01:16.043960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3a020201-1e21-472d-925e-5e5c55458d28 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:16.048693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:16.078371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3a020201-1e21-472d-925e-5e5c55458d28 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:16.079889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3a020201-1e21-472d-925e-5e5c55458d28 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6fae8e2411942caabfbb819f182a8a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fce4f5819b946bc907d71bec14ecbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:16.089834 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3a020201-1e21-472d-925e-5e5c55458d28 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 200 len: 1656 microversion: 2.20 time: 0.321397 Aug 29 16:01:16.090915 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3448/6688] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 16:01:15 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 1656 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:01:16.524933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-0271c568-def4-4485-9f5b-abd3ace79c3a req-d8ecdc32-51bf-4aae-8e28-97fcd67e6240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e1cc03-3a7b-4242-a1a6-98e756d3d326", "name": "network-vif-deleted", "tag": "9c67ed58-1b7d-43f4-b23a-74f6094e5f88"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:16.539834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0271c568-def4-4485-9f5b-abd3ace79c3a req-d8ecdc32-51bf-4aae-8e28-97fcd67e6240 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:16.541045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0271c568-def4-4485-9f5b-abd3ace79c3a req-d8ecdc32-51bf-4aae-8e28-97fcd67e6240 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:16.541678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0271c568-def4-4485-9f5b-abd3ace79c3a req-d8ecdc32-51bf-4aae-8e28-97fcd67e6240 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:16.560296 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-0271c568-def4-4485-9f5b-abd3ace79c3a req-d8ecdc32-51bf-4aae-8e28-97fcd67e6240 service nova] Creating event network-vif-deleted:9c67ed58-1b7d-43f4-b23a-74f6094e5f88 for instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 on n-h1-839401-11 Aug 29 16:01:16.567955 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-0271c568-def4-4485-9f5b-abd3ace79c3a req-d8ecdc32-51bf-4aae-8e28-97fcd67e6240 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.335101 Aug 29 16:01:16.569145 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3241/6689] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:16.876899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d1af9fdb-465c-4af4-8940-1aef20a15626 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:16.877547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d1af9fdb-465c-4af4-8940-1aef20a15626 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:16.888140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1af9fdb-465c-4af4-8940-1aef20a15626 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:16.889168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1af9fdb-465c-4af4-8940-1aef20a15626 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:16.889842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1af9fdb-465c-4af4-8940-1aef20a15626 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:16.890974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1af9fdb-465c-4af4-8940-1aef20a15626 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:16.891777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1af9fdb-465c-4af4-8940-1aef20a15626 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:16.893820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1af9fdb-465c-4af4-8940-1aef20a15626 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:17.116264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-edda5117-cd3c-4ea4-ae85-44e47114683e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:17.116972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-edda5117-cd3c-4ea4-ae85-44e47114683e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:17.129018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edda5117-cd3c-4ea4-ae85-44e47114683e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:17.129925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edda5117-cd3c-4ea4-ae85-44e47114683e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:17.130577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edda5117-cd3c-4ea4-ae85-44e47114683e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:17.131705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edda5117-cd3c-4ea4-ae85-44e47114683e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:17.132351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edda5117-cd3c-4ea4-ae85-44e47114683e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:17.133351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-edda5117-cd3c-4ea4-ae85-44e47114683e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:17.153933 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-edda5117-cd3c-4ea4-ae85-44e47114683e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] HTTP exception thrown: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-edda5117-cd3c-4ea4-ae85-44e47114683e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Request method failure captured: Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 HTTP/1.1 Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOCyHrNKCg8zS6NWsrQ8Tz5UNYCXmQZVyaaUiqLgBxE8jDIzrjBCk_9JFkRNEI7T0D-WEzZeGD6s-yTFZ9PEqNqtTo9n3YQMORmk3KZOwgPADdh7qR1ERsxoNF2KjSVQvUidO-39oaflSwqxG2BO80xMUZXXfNmo9Ot08n1BMq8bIOA Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 8fce4f5819b946bc907d71bec14ecbdf Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8fce4f5819b946bc907d71bec14ecbdf", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8fce4f5819b946bc907d71bec14ecbdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8fce4f5819b946bc907d71bec14ecbdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8fce4f5819b946bc907d71bec14ecbdf"}]}] Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 8fce4f5819b946bc907d71bec14ecbdf Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachVolumeShelveTestJSON-584137560-project Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: d6fae8e2411942caabfbb819f182a8a5 Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachVolumeShelveTestJSON-584137560-project Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'd8e1cc03-3a7b-4242-a1a6-98e756d3d326'} Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:01:17.156243 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:17.160007 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:01:17.160007 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:17.160007 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:17.160007 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:17.160007 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:01:17.160007 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:01:17.160007 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. Aug 29 16:01:17.160007 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:01:17.163264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-edda5117-cd3c-4ea4-ae85-44e47114683e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Returning 404 to user: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:01:17.164455 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-edda5117-cd3c-4ea4-ae85-44e47114683e tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 404 len: 111 microversion: 2.20 time: 0.052637 Aug 29 16:01:17.165299 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3242/6690] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 16:01:17 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 16:01:17.173915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6d5deba2-50a4-4f68-a541-ef4ce721b643 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '.version_select at 0x7fc42a577670>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:17.209344 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6d5deba2-50a4-4f68-a541-ef4ce721b643 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918379334" status: 204 len: 0 microversion: 2.20 time: 0.039387 Aug 29 16:01:17.210673 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3243/6691] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 16:01:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918379334 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 16:01:17.370246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d1af9fdb-465c-4af4-8940-1aef20a15626 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:17.385335 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d1af9fdb-465c-4af4-8940-1aef20a15626 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 200 len: 1688 microversion: 2.1 time: 0.512995 Aug 29 16:01:17.386269 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3449/6692] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:16 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 1688 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:17.727834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-4b8a2e67-caea-40f0-9ae3-63daa689a7c2 req-44292e48-82cb-4f53-b678-ca109c131a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14191e49-0809-49a9-964d-029df9971a62", "name": "network-vif-deleted", "tag": "4ce4f64e-0fb4-49d4-b504-519581182ab0"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:17.758556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4b8a2e67-caea-40f0-9ae3-63daa689a7c2 req-44292e48-82cb-4f53-b678-ca109c131a74 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:17.761796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4b8a2e67-caea-40f0-9ae3-63daa689a7c2 req-44292e48-82cb-4f53-b678-ca109c131a74 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:17.762512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4b8a2e67-caea-40f0-9ae3-63daa689a7c2 req-44292e48-82cb-4f53-b678-ca109c131a74 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:17.792146 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-4b8a2e67-caea-40f0-9ae3-63daa689a7c2 req-44292e48-82cb-4f53-b678-ca109c131a74 service nova] Creating event network-vif-deleted:4ce4f64e-0fb4-49d4-b504-519581182ab0 for instance 14191e49-0809-49a9-964d-029df9971a62 on n-h1-839401-11 Aug 29 16:01:17.804609 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-4b8a2e67-caea-40f0-9ae3-63daa689a7c2 req-44292e48-82cb-4f53-b678-ca109c131a74 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080727 Aug 29 16:01:17.809580 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3244/6693] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:01:18.409272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-35508340-c5c9-41c5-ba58-742c49926503 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:18.410619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-35508340-c5c9-41c5-ba58-742c49926503 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 14191e49-0809-49a9-964d-029df9971a62] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:18.420183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:18.422096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35508340-c5c9-41c5-ba58-742c49926503 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:18.422805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35508340-c5c9-41c5-ba58-742c49926503 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:18.424095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35508340-c5c9-41c5-ba58-742c49926503 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:18.425013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35508340-c5c9-41c5-ba58-742c49926503 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:18.425913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35508340-c5c9-41c5-ba58-742c49926503 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:18.426548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35508340-c5c9-41c5-ba58-742c49926503 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:18.444270 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-35508340-c5c9-41c5-ba58-742c49926503 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] HTTP exception thrown: Instance 14191e49-0809-49a9-964d-029df9971a62 could not be found. Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-35508340-c5c9-41c5-ba58-742c49926503 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Request method failure captured: Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 HTTP/1.1 Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOB3Svc4jYi_sdqstP8fut48z-Az-vRMtuk-EyuIwnH-xZ_3sKRpgA4G5XF7KP-cMjjpzT9196nhz_6F5C-ZYBvXK1KNFkDO7Pn9b9qPE-UYVu5R2LY-PIrVIejaJCCfnNMTNd864tfoTDZYIqBxVW7iKDXVNaNr9KOQ6yBnoKzm0XU Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 63c8e858d9064ae3875d91e8a43f7ee4 Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1699754938 Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_63c8e858d9064ae3875d91e8a43f7ee4", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/63c8e858d9064ae3875d91e8a43f7ee4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/63c8e858d9064ae3875d91e8a43f7ee4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/63c8e858d9064ae3875d91e8a43f7ee4"}]}] Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1699754938 Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 63c8e858d9064ae3875d91e8a43f7ee4 Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1699754938 Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestNetworkAdvancedServerOps-1699754938-project Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 008972030ade418cb180f0702ae168b4 Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1699754938-project Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 14191e49-0809-49a9-964d-029df9971a62 could not be found. Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '14191e49-0809-49a9-964d-029df9971a62'} Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14191e49-0809-49a9-964d-029df9971a62 could not be found. Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14191e49-0809-49a9-964d-029df9971a62 could not be found. Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:01:18.446449 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:18.450495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:01:18.450495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:18.450495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:18.450495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:18.450495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:01:18.450495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:01:18.450495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14191e49-0809-49a9-964d-029df9971a62 could not be found. Aug 29 16:01:18.450495 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:01:18.452532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-35508340-c5c9-41c5-ba58-742c49926503 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Returning 404 to user: Instance 14191e49-0809-49a9-964d-029df9971a62 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:01:18.455239 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-35508340-c5c9-41c5-ba58-742c49926503 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62" status: 404 len: 111 microversion: 2.1 time: 0.049496 Aug 29 16:01:18.460666 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3450/6694] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:18 2022] GET /compute/v2.1/servers/14191e49-0809-49a9-964d-029df9971a62 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:01:22.006094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6a2298c7-5ceb-42fd-8a68-48277ec7d42d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:22.006702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6a2298c7-5ceb-42fd-8a68-48277ec7d42d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:22.010922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:22.026925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a2298c7-5ceb-42fd-8a68-48277ec7d42d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:22.029538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a2298c7-5ceb-42fd-8a68-48277ec7d42d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:22.030066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a2298c7-5ceb-42fd-8a68-48277ec7d42d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:22.030815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a2298c7-5ceb-42fd-8a68-48277ec7d42d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:22.031371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a2298c7-5ceb-42fd-8a68-48277ec7d42d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:22.033423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6a2298c7-5ceb-42fd-8a68-48277ec7d42d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:22.067460 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-6a2298c7-5ceb-42fd-8a68-48277ec7d42d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] HTTP exception thrown: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6a2298c7-5ceb-42fd-8a68-48277ec7d42d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Request method failure captured: Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 HTTP/1.1 Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOCyHrNKCg8zS6NWsrQ8Tz5UNYCXmQZVyaaUiqLgBxE8jDIzrjBCk_9JFkRNEI7T0D-WEzZeGD6s-yTFZ9PEqNqtTo9n3YQMORmk3KZOwgPADdh7qR1ERsxoNF2KjSVQvUidO-39oaflSwqxG2BO80xMUZXXfNmo9Ot08n1BMq8bIOA Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 8fce4f5819b946bc907d71bec14ecbdf Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8fce4f5819b946bc907d71bec14ecbdf", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8fce4f5819b946bc907d71bec14ecbdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8fce4f5819b946bc907d71bec14ecbdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8fce4f5819b946bc907d71bec14ecbdf"}]}] Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 8fce4f5819b946bc907d71bec14ecbdf Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachVolumeShelveTestJSON-584137560-project Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: d6fae8e2411942caabfbb819f182a8a5 Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachVolumeShelveTestJSON-584137560-project Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'd8e1cc03-3a7b-4242-a1a6-98e756d3d326'} Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:01:22.071497 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:01:22.074860 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. Aug 29 16:01:22.074860 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:01:22.074860 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:22.074860 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:01:22.074860 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:22.074860 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:22.074860 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:22.074860 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:01:22.074860 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:01:22.074860 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. Aug 29 16:01:22.074860 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:01:22.081170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6a2298c7-5ceb-42fd-8a68-48277ec7d42d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Returning 404 to user: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:01:22.082112 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6a2298c7-5ceb-42fd-8a68-48277ec7d42d tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 404 len: 111 microversion: 2.20 time: 0.081094 Aug 29 16:01:22.086683 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3245/6695] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 16:01:21 2022] DELETE /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:01:22.091410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d1a80532-b510-4f2f-a491-b9ae55675b3f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:22.092785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d1a80532-b510-4f2f-a491-b9ae55675b3f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: d8e1cc03-3a7b-4242-a1a6-98e756d3d326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:22.110988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1a80532-b510-4f2f-a491-b9ae55675b3f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:22.111492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1a80532-b510-4f2f-a491-b9ae55675b3f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:22.111955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1a80532-b510-4f2f-a491-b9ae55675b3f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:22.121796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1a80532-b510-4f2f-a491-b9ae55675b3f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:22.122313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1a80532-b510-4f2f-a491-b9ae55675b3f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:22.122906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1a80532-b510-4f2f-a491-b9ae55675b3f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:22.164617 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-d1a80532-b510-4f2f-a491-b9ae55675b3f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] HTTP exception thrown: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d1a80532-b510-4f2f-a491-b9ae55675b3f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Request method failure captured: Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 HTTP/1.1 Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOCyHrNKCg8zS6NWsrQ8Tz5UNYCXmQZVyaaUiqLgBxE8jDIzrjBCk_9JFkRNEI7T0D-WEzZeGD6s-yTFZ9PEqNqtTo9n3YQMORmk3KZOwgPADdh7qR1ERsxoNF2KjSVQvUidO-39oaflSwqxG2BO80xMUZXXfNmo9Ot08n1BMq8bIOA Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 8fce4f5819b946bc907d71bec14ecbdf Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8fce4f5819b946bc907d71bec14ecbdf", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8fce4f5819b946bc907d71bec14ecbdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8fce4f5819b946bc907d71bec14ecbdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8fce4f5819b946bc907d71bec14ecbdf"}]}] Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 8fce4f5819b946bc907d71bec14ecbdf Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AttachVolumeShelveTestJSON-584137560-project Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: d6fae8e2411942caabfbb819f182a8a5 Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AttachVolumeShelveTestJSON-584137560-project Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'd8e1cc03-3a7b-4242-a1a6-98e756d3d326'} Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:01:22.166261 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:22.172838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:01:22.172838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:22.172838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:22.172838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:22.172838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:01:22.172838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:01:22.172838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. Aug 29 16:01:22.172838 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:01:22.172838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d1a80532-b510-4f2f-a491-b9ae55675b3f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Returning 404 to user: Instance d8e1cc03-3a7b-4242-a1a6-98e756d3d326 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:01:22.172838 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d1a80532-b510-4f2f-a491-b9ae55675b3f tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326" status: 404 len: 111 microversion: 2.20 time: 0.080395 Aug 29 16:01:22.172838 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3451/6696] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 16:01:22 2022] GET /compute/v2.1/servers/d8e1cc03-3a7b-4242-a1a6-98e756d3d326 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:01:24.495267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-696f1592-512e-4fab-be24-eb1c427c1189 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '.version_select at 0x7fc42a50edc0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:24.539984 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-696f1592-512e-4fab-be24-eb1c427c1189 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1467047023" status: 202 len: 0 microversion: 2.1 time: 0.047694 Aug 29 16:01:24.545329 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3246/6697] 10.222.0.62 () {58 vars in 1284 bytes} [Mon Aug 29 16:01:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1467047023 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:01:24.584761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f899d168-fb00-49d2-9b17-da22af665e45 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'create', calling method: .version_select at 0x7fc42bc24790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2020994708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNa4HWeHSquXUzhkUBlbFHFwIGOVc9wlfJbDW8tkqruhBKwIvipEHjepdURz1kH1R+zZhyM9aCOfPkfCug175xi9bx7SRMs4j1gHuMrcvr5nhrHKWpDhsSYQd7ic3S6XuQ=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:24.602862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-f899d168-fb00-49d2-9b17-da22af665e45 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Getting quotas for project 63c8e858d9064ae3875d91e8a43f7ee4. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:01:24.611037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-f899d168-fb00-49d2-9b17-da22af665e45 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Getting quotas for user 008972030ade418cb180f0702ae168b4 and project 63c8e858d9064ae3875d91e8a43f7ee4. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:01:24.651798 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f899d168-fb00-49d2-9b17-da22af665e45 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.070160 Aug 29 16:01:24.652878 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3452/6698] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:01:24 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:26.747839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e5a412c4-70f6-4d73-9ba4-d42591917577 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:26.748335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e5a412c4-70f6-4d73-9ba4-d42591917577 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:26.760261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5a412c4-70f6-4d73-9ba4-d42591917577 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:26.760740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5a412c4-70f6-4d73-9ba4-d42591917577 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:26.761221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5a412c4-70f6-4d73-9ba4-d42591917577 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:26.772444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5a412c4-70f6-4d73-9ba4-d42591917577 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:26.773041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5a412c4-70f6-4d73-9ba4-d42591917577 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:26.773537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e5a412c4-70f6-4d73-9ba4-d42591917577 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:26.801409 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-e5a412c4-70f6-4d73-9ba4-d42591917577 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] HTTP exception thrown: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e5a412c4-70f6-4d73-9ba4-d42591917577 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Request method failure captured: Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 HTTP/1.1 Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOCyHrNKCg8zS6NWsrQ8Tz5UNYCXmQZVyaaUiqLgBxE8jDIzrjBCk_9JFkRNEI7T0D-WEzZeGD6s-yTFZ9PEqNqtTo9n3YQMORmk3KZOwgPADdh7qR1ERsxoNF2KjSVQvUidO-39oaflSwqxG2BO80xMUZXXfNmo9Ot08n1BMq8bIOA Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 8fce4f5819b946bc907d71bec14ecbdf Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8fce4f5819b946bc907d71bec14ecbdf", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8fce4f5819b946bc907d71bec14ecbdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8fce4f5819b946bc907d71bec14ecbdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8fce4f5819b946bc907d71bec14ecbdf"}]}] Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 8fce4f5819b946bc907d71bec14ecbdf Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-AttachVolumeShelveTestJSON-584137560-project Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: d6fae8e2411942caabfbb819f182a8a5 Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-AttachVolumeShelveTestJSON-584137560-project Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '1fba35d0-e4ed-4088-a1d1-ccabdd81c178'} Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:01:26.810510 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:01:26.817126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. Aug 29 16:01:26.817126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:01:26.817126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:26.817126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:01:26.817126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:26.817126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:26.817126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:26.817126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:01:26.817126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:01:26.817126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. Aug 29 16:01:26.817126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:01:26.817126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e5a412c4-70f6-4d73-9ba4-d42591917577 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Returning 404 to user: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:01:26.817126 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e5a412c4-70f6-4d73-9ba4-d42591917577 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 404 len: 111 microversion: 2.20 time: 0.068371 Aug 29 16:01:26.817126 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3247/6699] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 16:01:26 2022] DELETE /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:01:26.821155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ecdb438-e8fc-4580-b044-a7a4d8ad3e25 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:26.821783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ecdb438-e8fc-4580-b044-a7a4d8ad3e25 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] [instance: 1fba35d0-e4ed-4088-a1d1-ccabdd81c178] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:26.837188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ecdb438-e8fc-4580-b044-a7a4d8ad3e25 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:26.837704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ecdb438-e8fc-4580-b044-a7a4d8ad3e25 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:26.838155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ecdb438-e8fc-4580-b044-a7a4d8ad3e25 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:26.838880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ecdb438-e8fc-4580-b044-a7a4d8ad3e25 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:26.845144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ecdb438-e8fc-4580-b044-a7a4d8ad3e25 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:26.846001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ecdb438-e8fc-4580-b044-a7a4d8ad3e25 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:26.874936 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-5ecdb438-e8fc-4580-b044-a7a4d8ad3e25 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] HTTP exception thrown: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ecdb438-e8fc-4580-b044-a7a4d8ad3e25 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Request method failure captured: Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 HTTP/1.1 Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOCyHrNKCg8zS6NWsrQ8Tz5UNYCXmQZVyaaUiqLgBxE8jDIzrjBCk_9JFkRNEI7T0D-WEzZeGD6s-yTFZ9PEqNqtTo9n3YQMORmk3KZOwgPADdh7qR1ERsxoNF2KjSVQvUidO-39oaflSwqxG2BO80xMUZXXfNmo9Ot08n1BMq8bIOA Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 8fce4f5819b946bc907d71bec14ecbdf Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8fce4f5819b946bc907d71bec14ecbdf", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8fce4f5819b946bc907d71bec14ecbdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8fce4f5819b946bc907d71bec14ecbdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8fce4f5819b946bc907d71bec14ecbdf"}]}] Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 8fce4f5819b946bc907d71bec14ecbdf Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-584137560 Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-AttachVolumeShelveTestJSON-584137560-project Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: d6fae8e2411942caabfbb819f182a8a5 Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-AttachVolumeShelveTestJSON-584137560-project Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '1fba35d0-e4ed-4088-a1d1-ccabdd81c178'} Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:01:26.881302 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:26.885101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:01:26.885101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:26.885101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:26.885101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:26.885101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:01:26.885101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:01:26.885101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. Aug 29 16:01:26.885101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:01:26.888759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ecdb438-e8fc-4580-b044-a7a4d8ad3e25 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] Returning 404 to user: Instance 1fba35d0-e4ed-4088-a1d1-ccabdd81c178 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:01:26.890750 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ecdb438-e8fc-4580-b044-a7a4d8ad3e25 tempest-AttachVolumeShelveTestJSON-584137560 tempest-AttachVolumeShelveTestJSON-584137560-project] 10.222.0.62 "GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178" status: 404 len: 111 microversion: 2.20 time: 0.073599 Aug 29 16:01:26.896617 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3453/6700] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 16:01:26 2022] GET /compute/v2.1/servers/1fba35d0-e4ed-4088-a1d1-ccabdd81c178 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:01:36.695070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1291319942", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "7f179043-234c-40b9-95ef-85057bad9eac"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1640931793", "security_groups": []}, "os:scheduler_hints": {"different_host": ["73f49e97-67ee-4016-aee8-020f1b3773b9"]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:36.787593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=16 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:36.843038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] validate_networks() for [('7f179043-234c-40b9-95ef-85057bad9eac', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:01:38.517876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:01:38.520160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:01:38.520873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:01:38.521520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:01:38.522267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:01:38.541980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:38.550214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:38.550768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:38.551844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:38.552505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:38.556038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:38.616796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Getting quotas for project 5cafad4fe369477d8b6e30703075fbf7. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:01:38.650042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Getting quotas for user 1c189abdaec94ff690c01ce0b173c15c and project 5cafad4fe369477d8b6e30703075fbf7. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:01:38.691928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:01:38.698544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:01:38.818439 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-05176e3a-dae6-4734-9801-8f0b44e22313 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.127475 Aug 29 16:01:38.821512 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3248/6701] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:01:36 2022] POST /compute/v2.1/servers => generated 361 bytes in 2131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:01:38.852739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-60e496e3-5ecb-4222-aa55-9ac6dc181d33 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:38.853512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-60e496e3-5ecb-4222-aa55-9ac6dc181d33 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:38.858997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:38.859734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:38.886023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=12 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:39.222756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-60e496e3-5ecb-4222-aa55-9ac6dc181d33 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:39.237222 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-60e496e3-5ecb-4222-aa55-9ac6dc181d33 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1242 microversion: 2.1 time: 0.408471 Aug 29 16:01:39.238430 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3454/6702] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:38 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1242 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:40.264573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9dceb943-669b-4505-81a3-5a6e13766ed4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:40.266945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9dceb943-669b-4505-81a3-5a6e13766ed4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:40.287942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9dceb943-669b-4505-81a3-5a6e13766ed4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:40.296325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9dceb943-669b-4505-81a3-5a6e13766ed4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:40.306762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9dceb943-669b-4505-81a3-5a6e13766ed4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:40.307712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9dceb943-669b-4505-81a3-5a6e13766ed4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:40.308342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9dceb943-669b-4505-81a3-5a6e13766ed4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:40.308951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9dceb943-669b-4505-81a3-5a6e13766ed4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:40.510302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9dceb943-669b-4505-81a3-5a6e13766ed4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:40.521219 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9dceb943-669b-4505-81a3-5a6e13766ed4 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1238 microversion: 2.1 time: 0.260304 Aug 29 16:01:40.522775 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3249/6703] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:40 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1238 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:41.551278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-71248def-8c27-482d-86df-be70201b4efb tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:41.551901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-71248def-8c27-482d-86df-be70201b4efb tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:41.567110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71248def-8c27-482d-86df-be70201b4efb tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:41.567657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71248def-8c27-482d-86df-be70201b4efb tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:41.568098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71248def-8c27-482d-86df-be70201b4efb tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:41.568828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71248def-8c27-482d-86df-be70201b4efb tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:41.569331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71248def-8c27-482d-86df-be70201b4efb tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:41.569766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-71248def-8c27-482d-86df-be70201b4efb tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:41.637022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-445939262", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "c6ea61b9-6607-4af7-9507-28671003882b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2020994708", "security_groups": [{"name": "tempest-secgroup-smoke-1939190878"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:41.741429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-71248def-8c27-482d-86df-be70201b4efb tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:41.758303 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-71248def-8c27-482d-86df-be70201b4efb tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1300 microversion: 2.1 time: 0.210877 Aug 29 16:01:41.759098 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3455/6704] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:41 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1300 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:42.042274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] validate_networks() for [('c6ea61b9-6607-4af7-9507-28671003882b', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:01:42.780028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5a029ea8-7ba4-4243-ab7d-478c723b848e tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:42.780651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5a029ea8-7ba4-4243-ab7d-478c723b848e tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:42.793689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a029ea8-7ba4-4243-ab7d-478c723b848e tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:42.795145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a029ea8-7ba4-4243-ab7d-478c723b848e tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:42.795753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a029ea8-7ba4-4243-ab7d-478c723b848e tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:42.798042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a029ea8-7ba4-4243-ab7d-478c723b848e tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:42.798600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a029ea8-7ba4-4243-ab7d-478c723b848e tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:42.799061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5a029ea8-7ba4-4243-ab7d-478c723b848e tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:43.048828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5a029ea8-7ba4-4243-ab7d-478c723b848e tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:43.067160 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5a029ea8-7ba4-4243-ab7d-478c723b848e tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1300 microversion: 2.1 time: 0.290259 Aug 29 16:01:43.084137 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3456/6705] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:42 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1300 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:01:43.096481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:01:43.097058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:01:43.097742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:01:43.098465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:01:43.099123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:01:43.120540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:43.123815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:43.126687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:43.131831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:43.132989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:43.134841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:43.191698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Getting quotas for project 63c8e858d9064ae3875d91e8a43f7ee4. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:01:43.209863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Getting quotas for user 008972030ade418cb180f0702ae168b4 and project 63c8e858d9064ae3875d91e8a43f7ee4. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:01:43.243960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:01:43.252357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:01:43.366134 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bb33c82b-861b-4086-8ed0-88e4a6ef6dcb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.735098 Aug 29 16:01:43.374493 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3250/6706] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:01:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:01:43.380323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-43640bcf-eb30-43c6-8ab5-900bec4d6deb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:43.381272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-43640bcf-eb30-43c6-8ab5-900bec4d6deb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:43.626630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-43640bcf-eb30-43c6-8ab5-900bec4d6deb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:43.643705 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-43640bcf-eb30-43c6-8ab5-900bec4d6deb tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1266 microversion: 2.1 time: 0.268781 Aug 29 16:01:43.654907 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3457/6707] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:43 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:01:44.091327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-360277cd-2306-49a0-82e1-915918b57b17 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:44.092268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-360277cd-2306-49a0-82e1-915918b57b17 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:44.106186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-360277cd-2306-49a0-82e1-915918b57b17 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.108739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-360277cd-2306-49a0-82e1-915918b57b17 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.109446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-360277cd-2306-49a0-82e1-915918b57b17 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.123432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-360277cd-2306-49a0-82e1-915918b57b17 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.126529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-360277cd-2306-49a0-82e1-915918b57b17 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.127537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-360277cd-2306-49a0-82e1-915918b57b17 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.455137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-360277cd-2306-49a0-82e1-915918b57b17 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:44.474445 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-360277cd-2306-49a0-82e1-915918b57b17 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1300 microversion: 2.1 time: 0.386433 Aug 29 16:01:44.476669 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3251/6708] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:44 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1300 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:44.675847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-666d6588-470f-4f31-8614-0cbc8c9361d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:44.676338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-666d6588-470f-4f31-8614-0cbc8c9361d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:44.694564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-666d6588-470f-4f31-8614-0cbc8c9361d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.697878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-666d6588-470f-4f31-8614-0cbc8c9361d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.698338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-666d6588-470f-4f31-8614-0cbc8c9361d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.707556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-666d6588-470f-4f31-8614-0cbc8c9361d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.708260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-666d6588-470f-4f31-8614-0cbc8c9361d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.708769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-666d6588-470f-4f31-8614-0cbc8c9361d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.892580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-666d6588-470f-4f31-8614-0cbc8c9361d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:44.958947 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-666d6588-470f-4f31-8614-0cbc8c9361d1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1270 microversion: 2.1 time: 0.278352 Aug 29 16:01:44.963443 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3458/6709] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:44 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1270 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:45.056239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-8055c6ca-394d-4b38-9042-8727dcc18e9b req-dd73a4ea-c43b-4ad3-b919-3b47b04d1048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7345a6c5-b9cd-4b99-a046-4f1fbe78733d", "tag": "b525641e-4ea4-431e-b94a-1131800d179a"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:45.080144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8055c6ca-394d-4b38-9042-8727dcc18e9b req-dd73a4ea-c43b-4ad3-b919-3b47b04d1048 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:45.089444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8055c6ca-394d-4b38-9042-8727dcc18e9b req-dd73a4ea-c43b-4ad3-b919-3b47b04d1048 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:45.091212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8055c6ca-394d-4b38-9042-8727dcc18e9b req-dd73a4ea-c43b-4ad3-b919-3b47b04d1048 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:45.123812 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-8055c6ca-394d-4b38-9042-8727dcc18e9b req-dd73a4ea-c43b-4ad3-b919-3b47b04d1048 service nova] Creating event network-changed:b525641e-4ea4-431e-b94a-1131800d179a for instance 7345a6c5-b9cd-4b99-a046-4f1fbe78733d on n-h2-839401-11 Aug 29 16:01:45.133413 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-8055c6ca-394d-4b38-9042-8727dcc18e9b req-dd73a4ea-c43b-4ad3-b919-3b47b04d1048 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081039 Aug 29 16:01:45.138368 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3252/6710] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:45.500633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fb12410e-8b97-4def-8dd5-76c61bc1963c tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:45.501770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fb12410e-8b97-4def-8dd5-76c61bc1963c tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:45.522253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb12410e-8b97-4def-8dd5-76c61bc1963c tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:45.522769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb12410e-8b97-4def-8dd5-76c61bc1963c tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:45.529244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb12410e-8b97-4def-8dd5-76c61bc1963c tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:45.530114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb12410e-8b97-4def-8dd5-76c61bc1963c tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:45.530611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb12410e-8b97-4def-8dd5-76c61bc1963c tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:45.531104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb12410e-8b97-4def-8dd5-76c61bc1963c tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:45.785020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fb12410e-8b97-4def-8dd5-76c61bc1963c tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:45.807773 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fb12410e-8b97-4def-8dd5-76c61bc1963c tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1300 microversion: 2.1 time: 0.312285 Aug 29 16:01:45.811132 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3459/6711] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:45 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1300 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:45.986187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-865473ff-4b25-4df8-baa4-a4f7d19a6031 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:45.987370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-865473ff-4b25-4df8-baa4-a4f7d19a6031 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:46.005022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-865473ff-4b25-4df8-baa4-a4f7d19a6031 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:46.006336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-865473ff-4b25-4df8-baa4-a4f7d19a6031 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:46.006990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-865473ff-4b25-4df8-baa4-a4f7d19a6031 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:46.008539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-865473ff-4b25-4df8-baa4-a4f7d19a6031 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:46.009453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-865473ff-4b25-4df8-baa4-a4f7d19a6031 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:46.010077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-865473ff-4b25-4df8-baa4-a4f7d19a6031 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:46.161226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-865473ff-4b25-4df8-baa4-a4f7d19a6031 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:46.206046 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-865473ff-4b25-4df8-baa4-a4f7d19a6031 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1326 microversion: 2.1 time: 0.224672 Aug 29 16:01:46.210199 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3253/6712] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:45 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1326 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:46.828462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6ebb5990-9a00-4161-b477-251a37eeea7b tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:46.829552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6ebb5990-9a00-4161-b477-251a37eeea7b tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:46.846654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ebb5990-9a00-4161-b477-251a37eeea7b tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:46.849909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ebb5990-9a00-4161-b477-251a37eeea7b tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:46.850567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ebb5990-9a00-4161-b477-251a37eeea7b tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:46.851624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ebb5990-9a00-4161-b477-251a37eeea7b tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:46.852643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ebb5990-9a00-4161-b477-251a37eeea7b tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:46.853075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ebb5990-9a00-4161-b477-251a37eeea7b tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:47.038004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6ebb5990-9a00-4161-b477-251a37eeea7b tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:47.053550 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6ebb5990-9a00-4161-b477-251a37eeea7b tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1300 microversion: 2.1 time: 0.228570 Aug 29 16:01:47.054636 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3460/6713] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:46 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1300 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:47.233764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c5d798d9-23f7-48c2-a4d2-0452113be191 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:47.235103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c5d798d9-23f7-48c2-a4d2-0452113be191 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:47.248502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5d798d9-23f7-48c2-a4d2-0452113be191 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:47.248856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5d798d9-23f7-48c2-a4d2-0452113be191 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:47.249346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5d798d9-23f7-48c2-a4d2-0452113be191 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:47.250104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5d798d9-23f7-48c2-a4d2-0452113be191 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:47.250577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5d798d9-23f7-48c2-a4d2-0452113be191 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:47.251013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5d798d9-23f7-48c2-a4d2-0452113be191 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:47.343953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c5d798d9-23f7-48c2-a4d2-0452113be191 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:47.362564 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c5d798d9-23f7-48c2-a4d2-0452113be191 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1324 microversion: 2.1 time: 0.133970 Aug 29 16:01:47.363808 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3254/6714] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:47 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1324 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:48.076203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fd792c95-4b78-4683-8c75-5da292232abf tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:48.077469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fd792c95-4b78-4683-8c75-5da292232abf tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:48.107447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd792c95-4b78-4683-8c75-5da292232abf tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:48.108898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd792c95-4b78-4683-8c75-5da292232abf tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:48.110162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd792c95-4b78-4683-8c75-5da292232abf tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:48.111097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd792c95-4b78-4683-8c75-5da292232abf tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:48.111699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd792c95-4b78-4683-8c75-5da292232abf tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:48.112273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd792c95-4b78-4683-8c75-5da292232abf tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:48.309624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd792c95-4b78-4683-8c75-5da292232abf tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:48.320634 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fd792c95-4b78-4683-8c75-5da292232abf tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1300 microversion: 2.1 time: 0.248803 Aug 29 16:01:48.321880 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3461/6715] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:48 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1300 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:48.996930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a2db49b-fc44-4d78-9645-5abdeb6b34e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:48.997600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a2db49b-fc44-4d78-9645-5abdeb6b34e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:49.037645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a2db49b-fc44-4d78-9645-5abdeb6b34e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:49.038125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a2db49b-fc44-4d78-9645-5abdeb6b34e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:49.038553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a2db49b-fc44-4d78-9645-5abdeb6b34e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:49.039276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a2db49b-fc44-4d78-9645-5abdeb6b34e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:49.039742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a2db49b-fc44-4d78-9645-5abdeb6b34e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:49.040177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a2db49b-fc44-4d78-9645-5abdeb6b34e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:49.322526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5a2db49b-fc44-4d78-9645-5abdeb6b34e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:49.338627 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5a2db49b-fc44-4d78-9645-5abdeb6b34e4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1392 microversion: 2.1 time: 0.951348 Aug 29 16:01:49.339911 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3255/6716] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:48 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1392 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:49.344507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3064db61-d224-4e1f-9b58-2099fd38b7ca tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:49.345198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3064db61-d224-4e1f-9b58-2099fd38b7ca tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:49.356360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3064db61-d224-4e1f-9b58-2099fd38b7ca tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:49.357232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3064db61-d224-4e1f-9b58-2099fd38b7ca tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:49.357997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3064db61-d224-4e1f-9b58-2099fd38b7ca tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:49.361441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3064db61-d224-4e1f-9b58-2099fd38b7ca tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:49.362852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3064db61-d224-4e1f-9b58-2099fd38b7ca tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:49.367330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3064db61-d224-4e1f-9b58-2099fd38b7ca tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:49.745691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3064db61-d224-4e1f-9b58-2099fd38b7ca tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:49.758417 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3064db61-d224-4e1f-9b58-2099fd38b7ca tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1300 microversion: 2.1 time: 0.417133 Aug 29 16:01:49.773423 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3462/6717] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:49 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1300 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:50.380082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-708e647b-73d9-4ab9-8baa-3bb462a22b31 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:50.381716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-708e647b-73d9-4ab9-8baa-3bb462a22b31 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:50.405243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-708e647b-73d9-4ab9-8baa-3bb462a22b31 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:50.408890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-708e647b-73d9-4ab9-8baa-3bb462a22b31 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:50.412493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-708e647b-73d9-4ab9-8baa-3bb462a22b31 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:50.426392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-708e647b-73d9-4ab9-8baa-3bb462a22b31 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:50.428580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-708e647b-73d9-4ab9-8baa-3bb462a22b31 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:50.435981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-708e647b-73d9-4ab9-8baa-3bb462a22b31 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:50.491135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-f8f97ac6-268d-485f-a91b-092c427ff63b req-19ff38cc-b6be-4a2c-95f8-314cc29cf10b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0621e034-0d52-4c6e-86f9-d5a206462089", "tag": "5e1e096b-07af-48e7-962f-6dd88bee3062"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:50.527019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f8f97ac6-268d-485f-a91b-092c427ff63b req-19ff38cc-b6be-4a2c-95f8-314cc29cf10b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:50.530297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f8f97ac6-268d-485f-a91b-092c427ff63b req-19ff38cc-b6be-4a2c-95f8-314cc29cf10b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:50.533754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f8f97ac6-268d-485f-a91b-092c427ff63b req-19ff38cc-b6be-4a2c-95f8-314cc29cf10b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:50.580008 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-f8f97ac6-268d-485f-a91b-092c427ff63b req-19ff38cc-b6be-4a2c-95f8-314cc29cf10b service nova] Creating event network-changed:5e1e096b-07af-48e7-962f-6dd88bee3062 for instance 0621e034-0d52-4c6e-86f9-d5a206462089 on n-h1-839401-11 Aug 29 16:01:50.593853 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-f8f97ac6-268d-485f-a91b-092c427ff63b req-19ff38cc-b6be-4a2c-95f8-314cc29cf10b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107412 Aug 29 16:01:50.594967 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3463/6718] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:50.679833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-708e647b-73d9-4ab9-8baa-3bb462a22b31 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:50.701818 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-708e647b-73d9-4ab9-8baa-3bb462a22b31 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1392 microversion: 2.1 time: 0.327213 Aug 29 16:01:50.702478 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3256/6719] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:50 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1392 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:50.785552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-590643cf-ac45-4356-9456-a6ef2851fc15 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:50.787051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-590643cf-ac45-4356-9456-a6ef2851fc15 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:50.796289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-590643cf-ac45-4356-9456-a6ef2851fc15 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:50.797338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-590643cf-ac45-4356-9456-a6ef2851fc15 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:50.797961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-590643cf-ac45-4356-9456-a6ef2851fc15 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:50.799604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-590643cf-ac45-4356-9456-a6ef2851fc15 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:50.800514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-590643cf-ac45-4356-9456-a6ef2851fc15 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:50.801246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-590643cf-ac45-4356-9456-a6ef2851fc15 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:51.095595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-590643cf-ac45-4356-9456-a6ef2851fc15 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:51.109347 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-590643cf-ac45-4356-9456-a6ef2851fc15 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1300 microversion: 2.1 time: 0.332253 Aug 29 16:01:51.122554 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3464/6720] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:50 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1300 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:51.332237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-70e9946a-a825-43bd-bf38-c4e82a5f2945 req-ecb07772-089f-45e1-96ad-e38fb01abb9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7345a6c5-b9cd-4b99-a046-4f1fbe78733d", "name": "network-vif-plugged", "status": "completed", "tag": "b525641e-4ea4-431e-b94a-1131800d179a"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:51.349913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-70e9946a-a825-43bd-bf38-c4e82a5f2945 req-ecb07772-089f-45e1-96ad-e38fb01abb9a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:51.350412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-70e9946a-a825-43bd-bf38-c4e82a5f2945 req-ecb07772-089f-45e1-96ad-e38fb01abb9a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:51.350863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-70e9946a-a825-43bd-bf38-c4e82a5f2945 req-ecb07772-089f-45e1-96ad-e38fb01abb9a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:51.373345 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-70e9946a-a825-43bd-bf38-c4e82a5f2945 req-ecb07772-089f-45e1-96ad-e38fb01abb9a service nova] Creating event network-vif-plugged:b525641e-4ea4-431e-b94a-1131800d179a for instance 7345a6c5-b9cd-4b99-a046-4f1fbe78733d on n-h2-839401-11 Aug 29 16:01:51.381828 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-70e9946a-a825-43bd-bf38-c4e82a5f2945 req-ecb07772-089f-45e1-96ad-e38fb01abb9a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.401622 Aug 29 16:01:51.384287 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3257/6721] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:51.724763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f6602cd9-0126-4b1e-956c-a5dd91aa3777 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:51.726513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f6602cd9-0126-4b1e-956c-a5dd91aa3777 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:51.738843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6602cd9-0126-4b1e-956c-a5dd91aa3777 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:51.739281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6602cd9-0126-4b1e-956c-a5dd91aa3777 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:51.739713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6602cd9-0126-4b1e-956c-a5dd91aa3777 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:51.740493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6602cd9-0126-4b1e-956c-a5dd91aa3777 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:51.740890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6602cd9-0126-4b1e-956c-a5dd91aa3777 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:51.741337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6602cd9-0126-4b1e-956c-a5dd91aa3777 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:52.131286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a3e1879-e83c-4e4c-bd0b-414652ac097a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:52.132284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a3e1879-e83c-4e4c-bd0b-414652ac097a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:52.136345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:52.151144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a3e1879-e83c-4e4c-bd0b-414652ac097a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:52.151705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a3e1879-e83c-4e4c-bd0b-414652ac097a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:52.152298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a3e1879-e83c-4e4c-bd0b-414652ac097a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:52.153133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a3e1879-e83c-4e4c-bd0b-414652ac097a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:52.153654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a3e1879-e83c-4e4c-bd0b-414652ac097a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:52.154152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a3e1879-e83c-4e4c-bd0b-414652ac097a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:52.190201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f6602cd9-0126-4b1e-956c-a5dd91aa3777 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:52.201691 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f6602cd9-0126-4b1e-956c-a5dd91aa3777 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1392 microversion: 2.1 time: 0.481762 Aug 29 16:01:52.204438 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3465/6722] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:51 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1392 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:52.346980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5a3e1879-e83c-4e4c-bd0b-414652ac097a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:52.366589 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5a3e1879-e83c-4e4c-bd0b-414652ac097a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1300 microversion: 2.1 time: 0.239820 Aug 29 16:01:52.386832 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3258/6723] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:52 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1300 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:01:53.227011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-29215c62-f448-4807-b163-11b4b9832fb4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:53.228235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-29215c62-f448-4807-b163-11b4b9832fb4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:53.243934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29215c62-f448-4807-b163-11b4b9832fb4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.245256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29215c62-f448-4807-b163-11b4b9832fb4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.245724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29215c62-f448-4807-b163-11b4b9832fb4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.246466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29215c62-f448-4807-b163-11b4b9832fb4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.246939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29215c62-f448-4807-b163-11b4b9832fb4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.249894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29215c62-f448-4807-b163-11b4b9832fb4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.386445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:53.387324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:53.393817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6f602804-80d3-4148-9950-a6684e604117 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:53.395086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6f602804-80d3-4148-9950-a6684e604117 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:53.410688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f602804-80d3-4148-9950-a6684e604117 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.412321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f602804-80d3-4148-9950-a6684e604117 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.412983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f602804-80d3-4148-9950-a6684e604117 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.413942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f602804-80d3-4148-9950-a6684e604117 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.414691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f602804-80d3-4148-9950-a6684e604117 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.415396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f602804-80d3-4148-9950-a6684e604117 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.481385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-29215c62-f448-4807-b163-11b4b9832fb4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:53.495764 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-29215c62-f448-4807-b163-11b4b9832fb4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1392 microversion: 2.1 time: 0.270931 Aug 29 16:01:53.509191 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3466/6724] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:53 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1392 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:53.535673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6f602804-80d3-4148-9950-a6684e604117 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:53.544131 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6f602804-80d3-4148-9950-a6684e604117 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1473 microversion: 2.1 time: 0.159659 Aug 29 16:01:53.553366 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3259/6725] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:53 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1473 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:53.568431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-405a616e-3933-44a3-8df6-cc242af67886 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:53.569069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-405a616e-3933-44a3-8df6-cc242af67886 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:53.579230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-405a616e-3933-44a3-8df6-cc242af67886 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.581378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-405a616e-3933-44a3-8df6-cc242af67886 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.583494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-405a616e-3933-44a3-8df6-cc242af67886 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.584330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-405a616e-3933-44a3-8df6-cc242af67886 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.586800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-405a616e-3933-44a3-8df6-cc242af67886 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.587389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-405a616e-3933-44a3-8df6-cc242af67886 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.644252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:53.836334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-405a616e-3933-44a3-8df6-cc242af67886 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:53.855314 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-405a616e-3933-44a3-8df6-cc242af67886 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1473 microversion: 2.1 time: 0.292314 Aug 29 16:01:53.860361 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3467/6726] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:53 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1473 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:53.882408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e83cf21b-e6c5-4bbe-a46c-aab43806d8ab tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:53.883579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e83cf21b-e6c5-4bbe-a46c-aab43806d8ab tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:53.893700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e83cf21b-e6c5-4bbe-a46c-aab43806d8ab tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.894214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e83cf21b-e6c5-4bbe-a46c-aab43806d8ab tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.894661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e83cf21b-e6c5-4bbe-a46c-aab43806d8ab tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.895396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e83cf21b-e6c5-4bbe-a46c-aab43806d8ab tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.895855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e83cf21b-e6c5-4bbe-a46c-aab43806d8ab tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.896284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e83cf21b-e6c5-4bbe-a46c-aab43806d8ab tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:54.141274 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e83cf21b-e6c5-4bbe-a46c-aab43806d8ab tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1626 microversion: 2.1 time: 0.262812 Aug 29 16:01:54.161240 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3260/6727] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:53 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1626 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:54.166368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f74520ad-8a32-4f93-9fd3-b812ecebfef1 tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:54.167619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f74520ad-8a32-4f93-9fd3-b812ecebfef1 tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:54.179386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f74520ad-8a32-4f93-9fd3-b812ecebfef1 tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:54.183571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f74520ad-8a32-4f93-9fd3-b812ecebfef1 tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:54.185758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f74520ad-8a32-4f93-9fd3-b812ecebfef1 tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:54.187361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f74520ad-8a32-4f93-9fd3-b812ecebfef1 tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:54.188265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f74520ad-8a32-4f93-9fd3-b812ecebfef1 tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:54.189609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f74520ad-8a32-4f93-9fd3-b812ecebfef1 tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:54.520753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-45ad6de3-9b34-4491-b229-54bd63c5131d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:54.521515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-45ad6de3-9b34-4491-b229-54bd63c5131d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:54.534591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45ad6de3-9b34-4491-b229-54bd63c5131d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:54.537629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45ad6de3-9b34-4491-b229-54bd63c5131d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:54.538259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45ad6de3-9b34-4491-b229-54bd63c5131d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:54.540639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45ad6de3-9b34-4491-b229-54bd63c5131d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:54.541796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45ad6de3-9b34-4491-b229-54bd63c5131d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:54.544824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45ad6de3-9b34-4491-b229-54bd63c5131d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:54.581871 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f74520ad-8a32-4f93-9fd3-b812ecebfef1 tempest-TestSecurityGroupsBasicOps-423868330 tempest-TestSecurityGroupsBasicOps-423868330-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1913 microversion: 2.1 time: 0.419216 Aug 29 16:01:54.585513 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3468/6728] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:54 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1913 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:54.765034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-25570362-5536-40d3-bc79-1a15fbf62516 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:54.765660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-25570362-5536-40d3-bc79-1a15fbf62516 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:54.772094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25570362-5536-40d3-bc79-1a15fbf62516 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:54.772592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25570362-5536-40d3-bc79-1a15fbf62516 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:54.773606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25570362-5536-40d3-bc79-1a15fbf62516 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:54.785620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25570362-5536-40d3-bc79-1a15fbf62516 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:54.786165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25570362-5536-40d3-bc79-1a15fbf62516 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:54.786638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25570362-5536-40d3-bc79-1a15fbf62516 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:54.883031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-45ad6de3-9b34-4491-b229-54bd63c5131d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:54.891946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-25570362-5536-40d3-bc79-1a15fbf62516 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:01:54.892617 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-45ad6de3-9b34-4491-b229-54bd63c5131d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1392 microversion: 2.1 time: 0.376655 Aug 29 16:01:54.893505 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3261/6729] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:54 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1392 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:55.042080 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-25570362-5536-40d3-bc79-1a15fbf62516 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 204 len: 0 microversion: 2.1 time: 0.280815 Aug 29 16:01:55.042933 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3469/6730] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:01:54 2022] DELETE /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:01:55.059594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c20eb6a1-9dc0-41b9-be1d-4f13139b718a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:55.060551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c20eb6a1-9dc0-41b9-be1d-4f13139b718a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:55.068428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c20eb6a1-9dc0-41b9-be1d-4f13139b718a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:55.069395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c20eb6a1-9dc0-41b9-be1d-4f13139b718a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:55.070230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c20eb6a1-9dc0-41b9-be1d-4f13139b718a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:55.071216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c20eb6a1-9dc0-41b9-be1d-4f13139b718a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:55.072077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c20eb6a1-9dc0-41b9-be1d-4f13139b718a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:55.072840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c20eb6a1-9dc0-41b9-be1d-4f13139b718a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:55.305293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c20eb6a1-9dc0-41b9-be1d-4f13139b718a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:55.321711 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c20eb6a1-9dc0-41b9-be1d-4f13139b718a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1479 microversion: 2.1 time: 0.272557 Aug 29 16:01:55.322487 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3262/6731] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:55 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1479 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:55.915209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aec4860c-db8d-4881-8c6f-4fef550b0f9c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:55.916104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aec4860c-db8d-4881-8c6f-4fef550b0f9c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:55.956146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec4860c-db8d-4881-8c6f-4fef550b0f9c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:55.956834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec4860c-db8d-4881-8c6f-4fef550b0f9c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:55.957321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec4860c-db8d-4881-8c6f-4fef550b0f9c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:55.958079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec4860c-db8d-4881-8c6f-4fef550b0f9c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:55.958540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec4860c-db8d-4881-8c6f-4fef550b0f9c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:55.958968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aec4860c-db8d-4881-8c6f-4fef550b0f9c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:56.169544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aec4860c-db8d-4881-8c6f-4fef550b0f9c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:56.181987 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aec4860c-db8d-4881-8c6f-4fef550b0f9c tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1392 microversion: 2.1 time: 0.271621 Aug 29 16:01:56.185368 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3470/6732] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:55 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1392 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:56.344018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-413c69f6-a706-41d5-aad7-c5fec4cb5c7a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:56.348255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-413c69f6-a706-41d5-aad7-c5fec4cb5c7a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:56.376616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-413c69f6-a706-41d5-aad7-c5fec4cb5c7a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:56.377607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-413c69f6-a706-41d5-aad7-c5fec4cb5c7a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:56.378382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-413c69f6-a706-41d5-aad7-c5fec4cb5c7a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:56.379271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-413c69f6-a706-41d5-aad7-c5fec4cb5c7a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:56.379872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-413c69f6-a706-41d5-aad7-c5fec4cb5c7a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:56.380450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-413c69f6-a706-41d5-aad7-c5fec4cb5c7a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:56.586330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-413c69f6-a706-41d5-aad7-c5fec4cb5c7a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:56.612082 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-413c69f6-a706-41d5-aad7-c5fec4cb5c7a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1479 microversion: 2.1 time: 0.272298 Aug 29 16:01:56.617720 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3263/6733] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:56 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1479 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:57.210390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b72d315c-0257-4736-ac9f-9c0e2f34dd14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:57.211025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b72d315c-0257-4736-ac9f-9c0e2f34dd14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:57.230525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b72d315c-0257-4736-ac9f-9c0e2f34dd14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:57.231034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b72d315c-0257-4736-ac9f-9c0e2f34dd14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:57.231644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b72d315c-0257-4736-ac9f-9c0e2f34dd14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:57.232360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b72d315c-0257-4736-ac9f-9c0e2f34dd14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:57.233941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b72d315c-0257-4736-ac9f-9c0e2f34dd14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:57.234808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b72d315c-0257-4736-ac9f-9c0e2f34dd14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:57.288176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:57.499444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b72d315c-0257-4736-ac9f-9c0e2f34dd14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:57.511602 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b72d315c-0257-4736-ac9f-9c0e2f34dd14 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1392 microversion: 2.1 time: 0.309314 Aug 29 16:01:57.512936 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3471/6734] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:57 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1392 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:57.645736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-55e45a50-6fff-4548-b614-ed049d074299 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:57.646594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-55e45a50-6fff-4548-b614-ed049d074299 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:57.655377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55e45a50-6fff-4548-b614-ed049d074299 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:57.656108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55e45a50-6fff-4548-b614-ed049d074299 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:57.656808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55e45a50-6fff-4548-b614-ed049d074299 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:57.657831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55e45a50-6fff-4548-b614-ed049d074299 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:57.658707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55e45a50-6fff-4548-b614-ed049d074299 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:57.662250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55e45a50-6fff-4548-b614-ed049d074299 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:57.948406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-55e45a50-6fff-4548-b614-ed049d074299 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:57.962891 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-55e45a50-6fff-4548-b614-ed049d074299 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1479 microversion: 2.1 time: 0.322282 Aug 29 16:01:57.973275 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3264/6735] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:57 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1479 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:58.194192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-12a21acd-bd9d-4d79-9e36-36065f57a8c3 req-7079b8e7-a513-4ec6-b20a-ab244327818e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7345a6c5-b9cd-4b99-a046-4f1fbe78733d", "name": "network-vif-deleted", "tag": "b525641e-4ea4-431e-b94a-1131800d179a"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:58.239906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-12a21acd-bd9d-4d79-9e36-36065f57a8c3 req-7079b8e7-a513-4ec6-b20a-ab244327818e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:58.240602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-12a21acd-bd9d-4d79-9e36-36065f57a8c3 req-7079b8e7-a513-4ec6-b20a-ab244327818e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:58.240833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-12a21acd-bd9d-4d79-9e36-36065f57a8c3 req-7079b8e7-a513-4ec6-b20a-ab244327818e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:58.289312 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-12a21acd-bd9d-4d79-9e36-36065f57a8c3 req-7079b8e7-a513-4ec6-b20a-ab244327818e service nova] Creating event network-vif-deleted:b525641e-4ea4-431e-b94a-1131800d179a for instance 7345a6c5-b9cd-4b99-a046-4f1fbe78733d on n-h2-839401-11 Aug 29 16:01:58.304268 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-12a21acd-bd9d-4d79-9e36-36065f57a8c3 req-7079b8e7-a513-4ec6-b20a-ab244327818e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119432 Aug 29 16:01:58.309012 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3472/6736] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:58.538001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-82f8aaff-df69-40e9-92c8-d127dbad4e7b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:58.538725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-82f8aaff-df69-40e9-92c8-d127dbad4e7b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:58.547757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82f8aaff-df69-40e9-92c8-d127dbad4e7b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:58.550830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82f8aaff-df69-40e9-92c8-d127dbad4e7b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:58.551290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82f8aaff-df69-40e9-92c8-d127dbad4e7b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:58.556077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82f8aaff-df69-40e9-92c8-d127dbad4e7b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:58.556620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82f8aaff-df69-40e9-92c8-d127dbad4e7b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:58.557070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-82f8aaff-df69-40e9-92c8-d127dbad4e7b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:58.992288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8d181a89-47af-4d71-be5b-b33471922b82 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:58.992288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8d181a89-47af-4d71-be5b-b33471922b82 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:59.005345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d181a89-47af-4d71-be5b-b33471922b82 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:59.013893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d181a89-47af-4d71-be5b-b33471922b82 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:59.014620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d181a89-47af-4d71-be5b-b33471922b82 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:59.016163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d181a89-47af-4d71-be5b-b33471922b82 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:59.020693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d181a89-47af-4d71-be5b-b33471922b82 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:59.023478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d181a89-47af-4d71-be5b-b33471922b82 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:59.032847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-82f8aaff-df69-40e9-92c8-d127dbad4e7b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:59.048578 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-82f8aaff-df69-40e9-92c8-d127dbad4e7b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1392 microversion: 2.1 time: 0.514583 Aug 29 16:01:59.061122 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3265/6737] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:58 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1392 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:59.150709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d181a89-47af-4d71-be5b-b33471922b82 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:59.150848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d181a89-47af-4d71-be5b-b33471922b82 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:59.151194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d181a89-47af-4d71-be5b-b33471922b82 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:59.151666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-8d181a89-47af-4d71-be5b-b33471922b82 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lazy-loading 'fault' on Instance uuid 7345a6c5-b9cd-4b99-a046-4f1fbe78733d {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:01:59.215068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8d181a89-47af-4d71-be5b-b33471922b82 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:59.225657 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8d181a89-47af-4d71-be5b-b33471922b82 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 200 len: 1332 microversion: 2.1 time: 0.239901 Aug 29 16:01:59.226660 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3473/6738] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:58 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 1332 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:00.072353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-246f68c8-6bd1-44af-9dbb-4792c7e32301 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:00.073041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-246f68c8-6bd1-44af-9dbb-4792c7e32301 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:00.085539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-246f68c8-6bd1-44af-9dbb-4792c7e32301 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:00.086042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-246f68c8-6bd1-44af-9dbb-4792c7e32301 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:00.088578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-246f68c8-6bd1-44af-9dbb-4792c7e32301 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:00.090422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-246f68c8-6bd1-44af-9dbb-4792c7e32301 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:00.090917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-246f68c8-6bd1-44af-9dbb-4792c7e32301 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:00.091362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-246f68c8-6bd1-44af-9dbb-4792c7e32301 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:00.250638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a47a4d70-2b99-480d-a5b4-3d808327592a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:00.251381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a47a4d70-2b99-480d-a5b4-3d808327592a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 7345a6c5-b9cd-4b99-a046-4f1fbe78733d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:00.269787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47a4d70-2b99-480d-a5b4-3d808327592a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:00.271257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47a4d70-2b99-480d-a5b4-3d808327592a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:00.272373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47a4d70-2b99-480d-a5b4-3d808327592a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:00.274676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47a4d70-2b99-480d-a5b4-3d808327592a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:00.275356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47a4d70-2b99-480d-a5b4-3d808327592a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:00.276137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a47a4d70-2b99-480d-a5b4-3d808327592a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:00.310687 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-a47a4d70-2b99-480d-a5b4-3d808327592a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] HTTP exception thrown: Instance 7345a6c5-b9cd-4b99-a046-4f1fbe78733d could not be found. Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a47a4d70-2b99-480d-a5b4-3d808327592a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Request method failure captured: Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d HTTP/1.1 Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOJUTNnhhYHeJei2VJE6OaG-YIqT0fPz7rfmoAoSM1LEWRjzxc2kNRG8cCtaAnJzxhpJ0BsKkujgEkkG2OWB25FC2hVQMRqtOECs-KbOtUG-9QkooPBsT7f6iYP8Ikg_-2O0hxp7zbLY82DDRJV5SaTyJqokeQqoPv79kxfFavW9ZTk Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 5cafad4fe369477d8b6e30703075fbf7 Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-639433183 Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5cafad4fe369477d8b6e30703075fbf7", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5cafad4fe369477d8b6e30703075fbf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5cafad4fe369477d8b6e30703075fbf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5cafad4fe369477d8b6e30703075fbf7"}]}] Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestSecurityGroupsBasicOps-639433183 Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 5cafad4fe369477d8b6e30703075fbf7 Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-639433183 Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestSecurityGroupsBasicOps-639433183-project Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 1c189abdaec94ff690c01ce0b173c15c Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestSecurityGroupsBasicOps-639433183-project Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 7345a6c5-b9cd-4b99-a046-4f1fbe78733d could not be found. Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7345a6c5-b9cd-4b99-a046-4f1fbe78733d'} Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7345a6c5-b9cd-4b99-a046-4f1fbe78733d could not be found. Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7345a6c5-b9cd-4b99-a046-4f1fbe78733d could not be found. Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:00.313486 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:02:00.317102 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:00.317102 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:00.317102 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:00.317102 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:02:00.317102 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:02:00.317102 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7345a6c5-b9cd-4b99-a046-4f1fbe78733d could not be found. Aug 29 16:02:00.317102 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:02:00.322045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a47a4d70-2b99-480d-a5b4-3d808327592a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Returning 404 to user: Instance 7345a6c5-b9cd-4b99-a046-4f1fbe78733d could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:02:00.323354 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a47a4d70-2b99-480d-a5b4-3d808327592a tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d" status: 404 len: 111 microversion: 2.1 time: 0.078848 Aug 29 16:02:00.326394 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3474/6739] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:00 2022] GET /compute/v2.1/servers/7345a6c5-b9cd-4b99-a046-4f1fbe78733d => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:02:00.536000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-246f68c8-6bd1-44af-9dbb-4792c7e32301 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:00.549952 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-246f68c8-6bd1-44af-9dbb-4792c7e32301 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1392 microversion: 2.1 time: 0.481633 Aug 29 16:02:00.551688 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3266/6740] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:00 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1392 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:01.472080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-18c3130c-6ec8-40eb-bcad-77e927d162f7 req-c42520a8-8482-40d5-863c-cd7f8dd27204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0621e034-0d52-4c6e-86f9-d5a206462089", "name": "network-vif-plugged", "status": "completed", "tag": "5e1e096b-07af-48e7-962f-6dd88bee3062"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:01.490535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-18c3130c-6ec8-40eb-bcad-77e927d162f7 req-c42520a8-8482-40d5-863c-cd7f8dd27204 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:01.503310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-18c3130c-6ec8-40eb-bcad-77e927d162f7 req-c42520a8-8482-40d5-863c-cd7f8dd27204 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:01.507059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-18c3130c-6ec8-40eb-bcad-77e927d162f7 req-c42520a8-8482-40d5-863c-cd7f8dd27204 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:01.545530 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-18c3130c-6ec8-40eb-bcad-77e927d162f7 req-c42520a8-8482-40d5-863c-cd7f8dd27204 service nova] Creating event network-vif-plugged:5e1e096b-07af-48e7-962f-6dd88bee3062 for instance 0621e034-0d52-4c6e-86f9-d5a206462089 on n-h1-839401-11 Aug 29 16:02:01.560525 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-18c3130c-6ec8-40eb-bcad-77e927d162f7 req-c42520a8-8482-40d5-863c-cd7f8dd27204 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091841 Aug 29 16:02:01.562162 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3475/6741] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:01.570349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-190939d1-82d0-40f5-adfc-639288661869 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:01.571532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-190939d1-82d0-40f5-adfc-639288661869 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:01.597184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-190939d1-82d0-40f5-adfc-639288661869 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:01.599812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-190939d1-82d0-40f5-adfc-639288661869 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:01.600793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-190939d1-82d0-40f5-adfc-639288661869 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:01.607435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-190939d1-82d0-40f5-adfc-639288661869 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:01.610290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-190939d1-82d0-40f5-adfc-639288661869 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:01.610879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-190939d1-82d0-40f5-adfc-639288661869 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:01.717590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:02.161887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-190939d1-82d0-40f5-adfc-639288661869 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:02.175203 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-190939d1-82d0-40f5-adfc-639288661869 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1392 microversion: 2.1 time: 0.608638 Aug 29 16:02:02.190614 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3267/6742] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:01 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1392 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:03.209471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-faa2a5a3-c4bb-4a74-9a78-b06ae94bc705 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:03.210248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-faa2a5a3-c4bb-4a74-9a78-b06ae94bc705 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:03.238838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-faa2a5a3-c4bb-4a74-9a78-b06ae94bc705 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:03.240701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-faa2a5a3-c4bb-4a74-9a78-b06ae94bc705 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:03.242122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-faa2a5a3-c4bb-4a74-9a78-b06ae94bc705 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:03.248698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-faa2a5a3-c4bb-4a74-9a78-b06ae94bc705 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:03.250803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-faa2a5a3-c4bb-4a74-9a78-b06ae94bc705 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:03.251515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-faa2a5a3-c4bb-4a74-9a78-b06ae94bc705 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:03.951181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-faa2a5a3-c4bb-4a74-9a78-b06ae94bc705 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:03.964441 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-faa2a5a3-c4bb-4a74-9a78-b06ae94bc705 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1392 microversion: 2.1 time: 0.769287 Aug 29 16:02:03.965065 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3476/6743] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:03 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1392 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:04.987561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-053ca66c-f326-4c51-bdf8-8d17f600d57a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:04.988161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-053ca66c-f326-4c51-bdf8-8d17f600d57a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:05.024143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-053ca66c-f326-4c51-bdf8-8d17f600d57a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:05.024691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-053ca66c-f326-4c51-bdf8-8d17f600d57a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:05.025175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-053ca66c-f326-4c51-bdf8-8d17f600d57a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:05.025919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-053ca66c-f326-4c51-bdf8-8d17f600d57a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:05.026384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-053ca66c-f326-4c51-bdf8-8d17f600d57a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:05.026819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-053ca66c-f326-4c51-bdf8-8d17f600d57a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:05.496161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-053ca66c-f326-4c51-bdf8-8d17f600d57a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:05.506830 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-053ca66c-f326-4c51-bdf8-8d17f600d57a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1563 microversion: 2.1 time: 0.523265 Aug 29 16:02:05.507440 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3268/6744] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:04 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1563 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:05.532631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ac7f867-4bf5-4a1a-ab92-c5a024aad6e0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:05.533872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ac7f867-4bf5-4a1a-ab92-c5a024aad6e0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:05.550375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ac7f867-4bf5-4a1a-ab92-c5a024aad6e0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:05.551081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ac7f867-4bf5-4a1a-ab92-c5a024aad6e0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:05.551709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ac7f867-4bf5-4a1a-ab92-c5a024aad6e0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:05.552604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ac7f867-4bf5-4a1a-ab92-c5a024aad6e0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:05.553240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ac7f867-4bf5-4a1a-ab92-c5a024aad6e0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:05.553825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ac7f867-4bf5-4a1a-ab92-c5a024aad6e0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:06.728930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5ac7f867-4bf5-4a1a-ab92-c5a024aad6e0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:06.743391 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ac7f867-4bf5-4a1a-ab92-c5a024aad6e0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1563 microversion: 2.1 time: 1.214711 Aug 29 16:02:06.746191 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3477/6745] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:05 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1563 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:10.497052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2c845a3c-7d12-4b22-86e5-6a950780404d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:10.497778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2c845a3c-7d12-4b22-86e5-6a950780404d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:10.501781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-6b00c64b-44a2-47f8-92ac-7ceeb35eb922 req-40396586-9035-42cb-bb07-1a1b97ec692a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0621e034-0d52-4c6e-86f9-d5a206462089", "tag": "5e1e096b-07af-48e7-962f-6dd88bee3062"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:10.518601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c845a3c-7d12-4b22-86e5-6a950780404d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:10.523816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c845a3c-7d12-4b22-86e5-6a950780404d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:10.524558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:10.525568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c845a3c-7d12-4b22-86e5-6a950780404d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:10.526332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c845a3c-7d12-4b22-86e5-6a950780404d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:10.526815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c845a3c-7d12-4b22-86e5-6a950780404d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:10.532992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6b00c64b-44a2-47f8-92ac-7ceeb35eb922 req-40396586-9035-42cb-bb07-1a1b97ec692a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:10.533467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2c845a3c-7d12-4b22-86e5-6a950780404d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:10.537842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6b00c64b-44a2-47f8-92ac-7ceeb35eb922 req-40396586-9035-42cb-bb07-1a1b97ec692a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:10.538347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6b00c64b-44a2-47f8-92ac-7ceeb35eb922 req-40396586-9035-42cb-bb07-1a1b97ec692a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:10.593794 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-6b00c64b-44a2-47f8-92ac-7ceeb35eb922 req-40396586-9035-42cb-bb07-1a1b97ec692a service nova] Creating event network-changed:5e1e096b-07af-48e7-962f-6dd88bee3062 for instance 0621e034-0d52-4c6e-86f9-d5a206462089 on n-h1-839401-11 Aug 29 16:02:10.611844 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-6b00c64b-44a2-47f8-92ac-7ceeb35eb922 req-40396586-9035-42cb-bb07-1a1b97ec692a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112725 Aug 29 16:02:10.612818 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3478/6746] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:02:10.635259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7d7e8c5e-65f1-4b5a-84ea-f9f85d02c980 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:10.636159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7d7e8c5e-65f1-4b5a-84ea-f9f85d02c980 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:10.667638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d7e8c5e-65f1-4b5a-84ea-f9f85d02c980 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:10.668700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d7e8c5e-65f1-4b5a-84ea-f9f85d02c980 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:10.670590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d7e8c5e-65f1-4b5a-84ea-f9f85d02c980 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:10.673059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d7e8c5e-65f1-4b5a-84ea-f9f85d02c980 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:10.673776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d7e8c5e-65f1-4b5a-84ea-f9f85d02c980 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:10.682683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d7e8c5e-65f1-4b5a-84ea-f9f85d02c980 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:10.762450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7d7e8c5e-65f1-4b5a-84ea-f9f85d02c980 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:02:10.969149 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7d7e8c5e-65f1-4b5a-84ea-f9f85d02c980 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "DELETE /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 204 len: 0 microversion: 2.1 time: 0.345769 Aug 29 16:02:10.976703 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3479/6747] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:02:10 2022] DELETE /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:02:10.991222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c58e8290-9983-4e12-905a-a2165137fb47 req-2a2efca9-3994-45f9-89cf-9b4cf8e9d64a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f49e97-67ee-4016-aee8-020f1b3773b9", "tag": "acd3d2b6-7116-4164-9b45-62aa74648b76"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:11.012142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c58e8290-9983-4e12-905a-a2165137fb47 req-2a2efca9-3994-45f9-89cf-9b4cf8e9d64a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:11.012862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c58e8290-9983-4e12-905a-a2165137fb47 req-2a2efca9-3994-45f9-89cf-9b4cf8e9d64a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:11.014449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c58e8290-9983-4e12-905a-a2165137fb47 req-2a2efca9-3994-45f9-89cf-9b4cf8e9d64a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:11.037702 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c58e8290-9983-4e12-905a-a2165137fb47 req-2a2efca9-3994-45f9-89cf-9b4cf8e9d64a service nova] Creating event network-changed:acd3d2b6-7116-4164-9b45-62aa74648b76 for instance 73f49e97-67ee-4016-aee8-020f1b3773b9 on n-h1-839401-11 Aug 29 16:02:11.043140 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c58e8290-9983-4e12-905a-a2165137fb47 req-2a2efca9-3994-45f9-89cf-9b4cf8e9d64a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064923 Aug 29 16:02:11.044445 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3480/6748] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:11.050074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-81339529-be12-47e6-8364-742b43ff47bc tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:11.051039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-81339529-be12-47e6-8364-742b43ff47bc tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:11.074508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81339529-be12-47e6-8364-742b43ff47bc tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:11.076904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81339529-be12-47e6-8364-742b43ff47bc tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:11.077552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81339529-be12-47e6-8364-742b43ff47bc tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:11.078566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81339529-be12-47e6-8364-742b43ff47bc tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:11.081377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81339529-be12-47e6-8364-742b43ff47bc tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:11.082050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81339529-be12-47e6-8364-742b43ff47bc tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:11.451567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-81339529-be12-47e6-8364-742b43ff47bc tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:11.460416 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-81339529-be12-47e6-8364-742b43ff47bc tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1766 microversion: 2.1 time: 0.414572 Aug 29 16:02:11.469241 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3481/6749] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:11 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1766 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:11.932264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2c845a3c-7d12-4b22-86e5-6a950780404d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:11.950387 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2c845a3c-7d12-4b22-86e5-6a950780404d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1563 microversion: 2.1 time: 1.457397 Aug 29 16:02:11.959014 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3269/6750] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:10 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1563 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:12.491541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-59fd81e5-3672-4792-b1ed-7297886338e8 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:12.492166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-59fd81e5-3672-4792-b1ed-7297886338e8 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:12.506380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59fd81e5-3672-4792-b1ed-7297886338e8 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:12.506881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59fd81e5-3672-4792-b1ed-7297886338e8 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:12.507329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59fd81e5-3672-4792-b1ed-7297886338e8 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:12.508362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59fd81e5-3672-4792-b1ed-7297886338e8 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:12.516153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59fd81e5-3672-4792-b1ed-7297886338e8 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:12.516646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59fd81e5-3672-4792-b1ed-7297886338e8 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:13.286988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-59fd81e5-3672-4792-b1ed-7297886338e8 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:13.295441 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-59fd81e5-3672-4792-b1ed-7297886338e8 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1766 microversion: 2.1 time: 0.807980 Aug 29 16:02:13.296044 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3482/6751] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:12 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1766 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:14.319835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-06f0918f-92b7-4f99-9e9c-f3c447c82ba1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:14.320610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-06f0918f-92b7-4f99-9e9c-f3c447c82ba1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:14.346810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06f0918f-92b7-4f99-9e9c-f3c447c82ba1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:14.347489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06f0918f-92b7-4f99-9e9c-f3c447c82ba1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:14.353640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06f0918f-92b7-4f99-9e9c-f3c447c82ba1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:14.361992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06f0918f-92b7-4f99-9e9c-f3c447c82ba1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:14.362715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06f0918f-92b7-4f99-9e9c-f3c447c82ba1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:14.363393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06f0918f-92b7-4f99-9e9c-f3c447c82ba1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:14.376613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-691c632b-4d82-4bb9-a5af-5f2d5a65a074 req-e8e10274-9ac1-4a45-bd99-78d5a4e260cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f49e97-67ee-4016-aee8-020f1b3773b9", "name": "network-vif-deleted", "tag": "acd3d2b6-7116-4164-9b45-62aa74648b76"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:14.397269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-691c632b-4d82-4bb9-a5af-5f2d5a65a074 req-e8e10274-9ac1-4a45-bd99-78d5a4e260cd service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:14.398941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-691c632b-4d82-4bb9-a5af-5f2d5a65a074 req-e8e10274-9ac1-4a45-bd99-78d5a4e260cd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:14.399533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-691c632b-4d82-4bb9-a5af-5f2d5a65a074 req-e8e10274-9ac1-4a45-bd99-78d5a4e260cd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:14.414676 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-691c632b-4d82-4bb9-a5af-5f2d5a65a074 req-e8e10274-9ac1-4a45-bd99-78d5a4e260cd service nova] Creating event network-vif-deleted:acd3d2b6-7116-4164-9b45-62aa74648b76 for instance 73f49e97-67ee-4016-aee8-020f1b3773b9 on n-h1-839401-11 Aug 29 16:02:14.421708 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-691c632b-4d82-4bb9-a5af-5f2d5a65a074 req-e8e10274-9ac1-4a45-bd99-78d5a4e260cd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049293 Aug 29 16:02:14.427313 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3483/6752] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:02:14.540326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-06f0918f-92b7-4f99-9e9c-f3c447c82ba1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c189abdaec94ff690c01ce0b173c15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cafad4fe369477d8b6e30703075fbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:14.554529 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-06f0918f-92b7-4f99-9e9c-f3c447c82ba1 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 200 len: 1529 microversion: 2.1 time: 0.238571 Aug 29 16:02:14.568123 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3270/6753] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:14 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 1529 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:15.595855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-851dd9e1-f79d-45c2-9058-66f933b94715 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:15.597776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-851dd9e1-f79d-45c2-9058-66f933b94715 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] [instance: 73f49e97-67ee-4016-aee8-020f1b3773b9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:15.618117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-851dd9e1-f79d-45c2-9058-66f933b94715 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:15.619050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-851dd9e1-f79d-45c2-9058-66f933b94715 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:15.619711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-851dd9e1-f79d-45c2-9058-66f933b94715 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:15.620690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-851dd9e1-f79d-45c2-9058-66f933b94715 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:15.621433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-851dd9e1-f79d-45c2-9058-66f933b94715 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:15.622201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-851dd9e1-f79d-45c2-9058-66f933b94715 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:15.642941 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-851dd9e1-f79d-45c2-9058-66f933b94715 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] HTTP exception thrown: Instance 73f49e97-67ee-4016-aee8-020f1b3773b9 could not be found. Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-851dd9e1-f79d-45c2-9058-66f933b94715 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Request method failure captured: Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 HTTP/1.1 Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOJUTNnhhYHeJei2VJE6OaG-YIqT0fPz7rfmoAoSM1LEWRjzxc2kNRG8cCtaAnJzxhpJ0BsKkujgEkkG2OWB25FC2hVQMRqtOECs-KbOtUG-9QkooPBsT7f6iYP8Ikg_-2O0hxp7zbLY82DDRJV5SaTyJqokeQqoPv79kxfFavW9ZTk Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 5cafad4fe369477d8b6e30703075fbf7 Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-639433183 Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5cafad4fe369477d8b6e30703075fbf7", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5cafad4fe369477d8b6e30703075fbf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5cafad4fe369477d8b6e30703075fbf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5cafad4fe369477d8b6e30703075fbf7"}]}] Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestSecurityGroupsBasicOps-639433183 Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 5cafad4fe369477d8b6e30703075fbf7 Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-639433183 Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestSecurityGroupsBasicOps-639433183-project Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 1c189abdaec94ff690c01ce0b173c15c Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestSecurityGroupsBasicOps-639433183-project Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 73f49e97-67ee-4016-aee8-020f1b3773b9 could not be found. Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '73f49e97-67ee-4016-aee8-020f1b3773b9'} Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73f49e97-67ee-4016-aee8-020f1b3773b9 could not be found. Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73f49e97-67ee-4016-aee8-020f1b3773b9 could not be found. Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:15.645531 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:02:15.648865 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:15.648865 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:15.648865 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:15.648865 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:02:15.648865 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:02:15.648865 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73f49e97-67ee-4016-aee8-020f1b3773b9 could not be found. Aug 29 16:02:15.648865 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:02:15.652692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-851dd9e1-f79d-45c2-9058-66f933b94715 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Returning 404 to user: Instance 73f49e97-67ee-4016-aee8-020f1b3773b9 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:02:15.654151 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-851dd9e1-f79d-45c2-9058-66f933b94715 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9" status: 404 len: 111 microversion: 2.1 time: 0.065500 Aug 29 16:02:15.655472 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3484/6754] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:15 2022] GET /compute/v2.1/servers/73f49e97-67ee-4016-aee8-020f1b3773b9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:02:21.958943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-06d214e3-b147-43ae-91a5-414b047ab900 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] Calling method '.version_select at 0x7fc42b96ef70>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:22.006665 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-06d214e3-b147-43ae-91a5-414b047ab900 tempest-TestSecurityGroupsBasicOps-639433183 tempest-TestSecurityGroupsBasicOps-639433183-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1640931793" status: 202 len: 0 microversion: 2.1 time: 0.052094 Aug 29 16:02:22.007455 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3271/6755] 10.222.0.62 () {58 vars in 1278 bytes} [Mon Aug 29 16:02:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1640931793 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:02:40.815412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-08d19375-d162-4c01-9359-c1747ec48876 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:40.819024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-08d19375-d162-4c01-9359-c1747ec48876 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:40.850866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:40.851606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:40.858323 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:02:40.858468 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:02:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089/action (ip 10.222.0.62) !!! Aug 29 16:02:40.867233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08d19375-d162-4c01-9359-c1747ec48876 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:40.867737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08d19375-d162-4c01-9359-c1747ec48876 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:40.868181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08d19375-d162-4c01-9359-c1747ec48876 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:40.868904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08d19375-d162-4c01-9359-c1747ec48876 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:40.869381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08d19375-d162-4c01-9359-c1747ec48876 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:40.869807 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08d19375-d162-4c01-9359-c1747ec48876 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:40.998235 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-08d19375-d162-4c01-9359-c1747ec48876 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089/action" status: 200 len: 24570 microversion: 2.1 time: 0.187170 Aug 29 16:02:40.998913 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3485/6756] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:02:40 2022] POST /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089/action => generated 24570 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:02:45.254117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=22 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:45.255830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:45.764363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-137296a1-1a37-4916-b4dd-7700f490a759 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:45.766176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-137296a1-1a37-4916-b4dd-7700f490a759 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:45.766660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-137296a1-1a37-4916-b4dd-7700f490a759 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:45.767092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-137296a1-1a37-4916-b4dd-7700f490a759 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:45.767830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-137296a1-1a37-4916-b4dd-7700f490a759 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:45.768363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-137296a1-1a37-4916-b4dd-7700f490a759 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:45.768789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-137296a1-1a37-4916-b4dd-7700f490a759 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:45.803081 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-137296a1-1a37-4916-b4dd-7700f490a759 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.556319 Aug 29 16:02:45.816556 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3272/6757] 10.222.0.62 () {58 vars in 1185 bytes} [Mon Aug 29 16:02:45 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:46.010367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-403344515", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "availability_zone": "nova:n-h1-839401-11", "networks": [{"uuid": "4e8b4771-256b-4fe3-aa6c-9ea5dcb031dc"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:46.110179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] validate_networks() for [('4e8b4771-256b-4fe3-aa6c-9ea5dcb031dc', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:02:47.012796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:02:47.013471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:02:47.013837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:02:47.014310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:02:47.014814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:02:47.027237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:47.027811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:47.028556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:47.029597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:47.030273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:47.031055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:47.051923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Getting quotas for project f7150a6ff711416eb228306eda9a479a. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:02:47.058054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Getting quotas for user 328e2d2b520c4ca9924d91c98d2adfba and project f7150a6ff711416eb228306eda9a479a. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:02:47.078067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:02:47.082321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:02:47.139270 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d3b5ef1d-0e40-4692-ad33-2316d7a9434e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.144648 Aug 29 16:02:47.140650 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3486/6758] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:02:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:02:47.151173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-261adf3f-9faa-40ac-a686-7a59dcccc633 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:47.151781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-261adf3f-9faa-40ac-a686-7a59dcccc633 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:47.262345 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-261adf3f-9faa-40ac-a686-7a59dcccc633 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1328 microversion: 2.1 time: 0.114791 Aug 29 16:02:47.278643 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3273/6759] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:47 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1328 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:48.289329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1cba72fe-9917-4516-9ad8-0f4e0c1e5c48 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:48.289949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1cba72fe-9917-4516-9ad8-0f4e0c1e5c48 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:48.305825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cba72fe-9917-4516-9ad8-0f4e0c1e5c48 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:48.308128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cba72fe-9917-4516-9ad8-0f4e0c1e5c48 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:48.308839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cba72fe-9917-4516-9ad8-0f4e0c1e5c48 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:48.311525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cba72fe-9917-4516-9ad8-0f4e0c1e5c48 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:48.314235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cba72fe-9917-4516-9ad8-0f4e0c1e5c48 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:48.316525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cba72fe-9917-4516-9ad8-0f4e0c1e5c48 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:48.509102 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1cba72fe-9917-4516-9ad8-0f4e0c1e5c48 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1345 microversion: 2.1 time: 0.222033 Aug 29 16:02:48.511320 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3487/6760] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:48 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1345 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:49.542425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-17a31287-b4c6-4c50-b192-02ff1cbd861e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:49.543760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-17a31287-b4c6-4c50-b192-02ff1cbd861e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:49.559508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a31287-b4c6-4c50-b192-02ff1cbd861e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:49.560294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a31287-b4c6-4c50-b192-02ff1cbd861e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:49.560916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a31287-b4c6-4c50-b192-02ff1cbd861e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:49.562805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a31287-b4c6-4c50-b192-02ff1cbd861e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:49.564604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a31287-b4c6-4c50-b192-02ff1cbd861e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:49.565686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17a31287-b4c6-4c50-b192-02ff1cbd861e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:49.819947 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-17a31287-b4c6-4c50-b192-02ff1cbd861e tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1423 microversion: 2.1 time: 0.282046 Aug 29 16:02:49.826692 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3274/6761] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:49 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1423 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:50.852530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-63b2467b-63c6-4c21-8922-5ce5fb6436a9 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:50.856895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-63b2467b-63c6-4c21-8922-5ce5fb6436a9 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:50.907671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63b2467b-63c6-4c21-8922-5ce5fb6436a9 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:50.911299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63b2467b-63c6-4c21-8922-5ce5fb6436a9 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:50.912054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63b2467b-63c6-4c21-8922-5ce5fb6436a9 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:50.913989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63b2467b-63c6-4c21-8922-5ce5fb6436a9 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:50.914682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63b2467b-63c6-4c21-8922-5ce5fb6436a9 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:50.916309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63b2467b-63c6-4c21-8922-5ce5fb6436a9 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:51.310995 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-63b2467b-63c6-4c21-8922-5ce5fb6436a9 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1465 microversion: 2.1 time: 0.466451 Aug 29 16:02:51.311614 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3488/6762] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:50 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1465 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:52.071180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-5e9875e9-8657-4823-bc6f-4c853e50bedd req-cb718493-b8b8-4148-9627-7c8b69a3d168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a8dadd5-90e2-493d-8777-32673ca83a66", "tag": "ab191de7-ad96-4d7a-8714-4d8436de6693"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:52.093358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5e9875e9-8657-4823-bc6f-4c853e50bedd req-cb718493-b8b8-4148-9627-7c8b69a3d168 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:52.094151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5e9875e9-8657-4823-bc6f-4c853e50bedd req-cb718493-b8b8-4148-9627-7c8b69a3d168 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:52.094759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5e9875e9-8657-4823-bc6f-4c853e50bedd req-cb718493-b8b8-4148-9627-7c8b69a3d168 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:52.125243 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5e9875e9-8657-4823-bc6f-4c853e50bedd req-cb718493-b8b8-4148-9627-7c8b69a3d168 service nova] Creating event network-changed:ab191de7-ad96-4d7a-8714-4d8436de6693 for instance 6a8dadd5-90e2-493d-8777-32673ca83a66 on n-h1-839401-11 Aug 29 16:02:52.140135 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-5e9875e9-8657-4823-bc6f-4c853e50bedd req-cb718493-b8b8-4148-9627-7c8b69a3d168 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072664 Aug 29 16:02:52.144746 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3275/6763] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:52.335007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f16c1bd2-f3c9-49f9-b8ee-93877d24c632 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:52.335928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f16c1bd2-f3c9-49f9-b8ee-93877d24c632 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:52.377896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f16c1bd2-f3c9-49f9-b8ee-93877d24c632 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:52.377896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f16c1bd2-f3c9-49f9-b8ee-93877d24c632 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:52.377896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f16c1bd2-f3c9-49f9-b8ee-93877d24c632 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:52.379915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f16c1bd2-f3c9-49f9-b8ee-93877d24c632 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:52.382837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f16c1bd2-f3c9-49f9-b8ee-93877d24c632 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:52.385648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f16c1bd2-f3c9-49f9-b8ee-93877d24c632 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:53.365531 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f16c1bd2-f3c9-49f9-b8ee-93877d24c632 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1465 microversion: 2.1 time: 1.036257 Aug 29 16:02:53.366156 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3489/6764] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:52 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1465 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:54.389939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dd954d80-4a31-4a09-b789-6b0ac3cd87cc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:54.391099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dd954d80-4a31-4a09-b789-6b0ac3cd87cc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:54.416308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd954d80-4a31-4a09-b789-6b0ac3cd87cc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:54.417136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd954d80-4a31-4a09-b789-6b0ac3cd87cc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:54.417783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd954d80-4a31-4a09-b789-6b0ac3cd87cc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:54.419511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd954d80-4a31-4a09-b789-6b0ac3cd87cc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:54.420424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd954d80-4a31-4a09-b789-6b0ac3cd87cc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:54.421261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd954d80-4a31-4a09-b789-6b0ac3cd87cc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:54.661208 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dd954d80-4a31-4a09-b789-6b0ac3cd87cc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1465 microversion: 2.1 time: 0.277082 Aug 29 16:02:54.662082 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3276/6765] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:54 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1465 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:55.684407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-50d57b36-eca2-422d-8256-cc08beff4d78 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:55.686129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-50d57b36-eca2-422d-8256-cc08beff4d78 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:55.704008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50d57b36-eca2-422d-8256-cc08beff4d78 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:55.705327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50d57b36-eca2-422d-8256-cc08beff4d78 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:55.705974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50d57b36-eca2-422d-8256-cc08beff4d78 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:55.707097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50d57b36-eca2-422d-8256-cc08beff4d78 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:55.707954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50d57b36-eca2-422d-8256-cc08beff4d78 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:55.708604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50d57b36-eca2-422d-8256-cc08beff4d78 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:56.015292 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-50d57b36-eca2-422d-8256-cc08beff4d78 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1465 microversion: 2.1 time: 0.336428 Aug 29 16:02:56.016276 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3490/6766] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:55 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1465 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:57.037855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c91a8cd5-ac10-4a7d-9b4e-3757b83df960 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:57.042739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c91a8cd5-ac10-4a7d-9b4e-3757b83df960 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:57.055896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:57.058980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c91a8cd5-ac10-4a7d-9b4e-3757b83df960 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:57.059831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c91a8cd5-ac10-4a7d-9b4e-3757b83df960 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:57.065688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c91a8cd5-ac10-4a7d-9b4e-3757b83df960 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:57.065688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c91a8cd5-ac10-4a7d-9b4e-3757b83df960 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:57.065688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c91a8cd5-ac10-4a7d-9b4e-3757b83df960 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:57.066683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c91a8cd5-ac10-4a7d-9b4e-3757b83df960 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:57.254611 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c91a8cd5-ac10-4a7d-9b4e-3757b83df960 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1465 microversion: 2.1 time: 0.221440 Aug 29 16:02:57.255592 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3277/6767] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:57 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1465 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:58.277524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24087ae7-365f-4761-883d-46dfaef14722 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:58.278087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-24087ae7-365f-4761-883d-46dfaef14722 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:58.282162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:58.283283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:58.290404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24087ae7-365f-4761-883d-46dfaef14722 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:58.291113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24087ae7-365f-4761-883d-46dfaef14722 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:58.291618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24087ae7-365f-4761-883d-46dfaef14722 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:58.292537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24087ae7-365f-4761-883d-46dfaef14722 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:58.293120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24087ae7-365f-4761-883d-46dfaef14722 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:58.294002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24087ae7-365f-4761-883d-46dfaef14722 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:58.548694 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-24087ae7-365f-4761-883d-46dfaef14722 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1465 microversion: 2.1 time: 0.275071 Aug 29 16:02:58.550335 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3491/6768] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:58 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1465 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:59.462983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-c46d8f60-ec9e-4653-8438-e119ec8272d7 req-92012970-9358-4889-bfe0-bd6fce631c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8dadd5-90e2-493d-8777-32673ca83a66", "name": "network-vif-plugged", "status": "completed", "tag": "ab191de7-ad96-4d7a-8714-4d8436de6693"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:59.503095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:59.512550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c46d8f60-ec9e-4653-8438-e119ec8272d7 req-92012970-9358-4889-bfe0-bd6fce631c91 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:59.515508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c46d8f60-ec9e-4653-8438-e119ec8272d7 req-92012970-9358-4889-bfe0-bd6fce631c91 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:59.519012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c46d8f60-ec9e-4653-8438-e119ec8272d7 req-92012970-9358-4889-bfe0-bd6fce631c91 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:59.562865 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-c46d8f60-ec9e-4653-8438-e119ec8272d7 req-92012970-9358-4889-bfe0-bd6fce631c91 service nova] Creating event network-vif-plugged:ab191de7-ad96-4d7a-8714-4d8436de6693 for instance 6a8dadd5-90e2-493d-8777-32673ca83a66 on n-h1-839401-11 Aug 29 16:02:59.576183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-151d70f5-d91b-4629-8c1d-522003f34164 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:59.576728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-151d70f5-d91b-4629-8c1d-522003f34164 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:59.582191 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-c46d8f60-ec9e-4653-8438-e119ec8272d7 req-92012970-9358-4889-bfe0-bd6fce631c91 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122533 Aug 29 16:02:59.590558 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3278/6769] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:59.594075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-151d70f5-d91b-4629-8c1d-522003f34164 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:59.594602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-151d70f5-d91b-4629-8c1d-522003f34164 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:59.595054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-151d70f5-d91b-4629-8c1d-522003f34164 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:59.598719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-151d70f5-d91b-4629-8c1d-522003f34164 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:59.600011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-151d70f5-d91b-4629-8c1d-522003f34164 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:59.601469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-151d70f5-d91b-4629-8c1d-522003f34164 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:00.004134 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-151d70f5-d91b-4629-8c1d-522003f34164 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1465 microversion: 2.1 time: 0.436959 Aug 29 16:03:00.004744 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3492/6770] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:59 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1465 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:01.027592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-923dfbe0-49bb-49d5-8527-07f3c68f80bd tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:01.028171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-923dfbe0-49bb-49d5-8527-07f3c68f80bd tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:01.037018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-923dfbe0-49bb-49d5-8527-07f3c68f80bd tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:01.037925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-923dfbe0-49bb-49d5-8527-07f3c68f80bd tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:01.038479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-923dfbe0-49bb-49d5-8527-07f3c68f80bd tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:01.039437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-923dfbe0-49bb-49d5-8527-07f3c68f80bd tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:01.040274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-923dfbe0-49bb-49d5-8527-07f3c68f80bd tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:01.040900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-923dfbe0-49bb-49d5-8527-07f3c68f80bd tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:01.209537 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-923dfbe0-49bb-49d5-8527-07f3c68f80bd tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1465 microversion: 2.1 time: 0.186127 Aug 29 16:03:01.223073 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3279/6771] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:01 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1465 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:02.234408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2f2222f8-eab5-412f-9a64-32114e2ab8bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:02.235055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2f2222f8-eab5-412f-9a64-32114e2ab8bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:02.247267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f2222f8-eab5-412f-9a64-32114e2ab8bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:02.247763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f2222f8-eab5-412f-9a64-32114e2ab8bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:02.248199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f2222f8-eab5-412f-9a64-32114e2ab8bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:02.249133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f2222f8-eab5-412f-9a64-32114e2ab8bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:02.249812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f2222f8-eab5-412f-9a64-32114e2ab8bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:02.250423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f2222f8-eab5-412f-9a64-32114e2ab8bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:02.446322 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2f2222f8-eab5-412f-9a64-32114e2ab8bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1649 microversion: 2.1 time: 0.215812 Aug 29 16:03:02.449404 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3493/6772] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:02 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1649 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:02.481630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-314ecad7-23da-491a-879d-0609d469efd4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:02.490404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-314ecad7-23da-491a-879d-0609d469efd4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:02.534749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-314ecad7-23da-491a-879d-0609d469efd4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:02.535690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-314ecad7-23da-491a-879d-0609d469efd4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:02.536313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-314ecad7-23da-491a-879d-0609d469efd4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:02.537267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-314ecad7-23da-491a-879d-0609d469efd4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:02.539653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-314ecad7-23da-491a-879d-0609d469efd4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:02.540292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-314ecad7-23da-491a-879d-0609d469efd4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:02.813120 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-314ecad7-23da-491a-879d-0609d469efd4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1649 microversion: 2.1 time: 0.346820 Aug 29 16:03:02.835247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2003c5ae-0bf2-465a-a838-8dd4ad5aa9dc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:02.836067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2003c5ae-0bf2-465a-a838-8dd4ad5aa9dc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:02.841708 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3280/6773] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:02 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1649 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:02.850157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2003c5ae-0bf2-465a-a838-8dd4ad5aa9dc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:02.853798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2003c5ae-0bf2-465a-a838-8dd4ad5aa9dc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:02.855230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2003c5ae-0bf2-465a-a838-8dd4ad5aa9dc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:02.855995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2003c5ae-0bf2-465a-a838-8dd4ad5aa9dc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:02.856466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2003c5ae-0bf2-465a-a838-8dd4ad5aa9dc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:02.856899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2003c5ae-0bf2-465a-a838-8dd4ad5aa9dc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:03.143222 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2003c5ae-0bf2-465a-a838-8dd4ad5aa9dc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1649 microversion: 2.1 time: 0.311740 Aug 29 16:03:03.144393 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3494/6774] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:02 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1649 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:03.370027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-185158756", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "availability_zone": "nova:n-h2-839401-11", "networks": [{"uuid": "4e8b4771-256b-4fe3-aa6c-9ea5dcb031dc"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:03.438545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] validate_networks() for [('4e8b4771-256b-4fe3-aa6c-9ea5dcb031dc', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:03:03.974876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:03:03.975608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:03:03.975760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:03:03.976171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:03:03.976578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:03:03.986544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:03.987028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:03.990567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:03.992615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:03.993472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:03.995503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:04.042386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Getting quotas for project f7150a6ff711416eb228306eda9a479a. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:03:04.051878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Getting quotas for user 328e2d2b520c4ca9924d91c98d2adfba and project f7150a6ff711416eb228306eda9a479a. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:03:04.077375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:03:04.089710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:03:04.212732 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0e157635-301d-4252-b0d2-b475f5e81881 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.846175 Aug 29 16:03:04.214693 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3281/6775] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:03:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:03:04.226733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-08fb8643-7628-4ac2-b222-98f6ce29fada tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:04.227369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-08fb8643-7628-4ac2-b222-98f6ce29fada tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:04.419139 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-08fb8643-7628-4ac2-b222-98f6ce29fada tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1328 microversion: 2.1 time: 0.196768 Aug 29 16:03:04.422696 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3495/6776] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:04 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1328 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:05.453701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6d105594-301e-44c1-aac4-234c1aeaaacb tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:05.455435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6d105594-301e-44c1-aac4-234c1aeaaacb tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:05.470943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d105594-301e-44c1-aac4-234c1aeaaacb tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:05.471514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d105594-301e-44c1-aac4-234c1aeaaacb tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:05.472099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d105594-301e-44c1-aac4-234c1aeaaacb tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:05.485610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d105594-301e-44c1-aac4-234c1aeaaacb tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:05.489167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d105594-301e-44c1-aac4-234c1aeaaacb tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:05.492994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6d105594-301e-44c1-aac4-234c1aeaaacb tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:05.683937 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6d105594-301e-44c1-aac4-234c1aeaaacb tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1417 microversion: 2.1 time: 0.243332 Aug 29 16:03:05.693255 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3282/6777] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:05 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1417 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:06.710219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e3049444-43a8-4370-9cd9-e6a6e7d50945 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:06.710853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e3049444-43a8-4370-9cd9-e6a6e7d50945 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:06.733143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3049444-43a8-4370-9cd9-e6a6e7d50945 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:06.734023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3049444-43a8-4370-9cd9-e6a6e7d50945 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:06.742599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3049444-43a8-4370-9cd9-e6a6e7d50945 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:06.743653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3049444-43a8-4370-9cd9-e6a6e7d50945 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:06.744288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3049444-43a8-4370-9cd9-e6a6e7d50945 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:06.745074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3049444-43a8-4370-9cd9-e6a6e7d50945 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:06.992462 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e3049444-43a8-4370-9cd9-e6a6e7d50945 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1465 microversion: 2.1 time: 0.286033 Aug 29 16:03:06.993468 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3496/6778] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:06 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1465 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:08.028755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4691dadc-3339-4f15-98cf-2ed6eb6e3ecc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:08.029454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4691dadc-3339-4f15-98cf-2ed6eb6e3ecc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:08.040200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4691dadc-3339-4f15-98cf-2ed6eb6e3ecc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:08.040703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4691dadc-3339-4f15-98cf-2ed6eb6e3ecc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:08.041186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4691dadc-3339-4f15-98cf-2ed6eb6e3ecc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:08.041907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4691dadc-3339-4f15-98cf-2ed6eb6e3ecc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:08.049526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4691dadc-3339-4f15-98cf-2ed6eb6e3ecc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:08.049526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4691dadc-3339-4f15-98cf-2ed6eb6e3ecc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:08.707617 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4691dadc-3339-4f15-98cf-2ed6eb6e3ecc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1465 microversion: 2.1 time: 0.683519 Aug 29 16:03:08.708746 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3283/6779] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:08 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1465 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:08.895515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-42b44803-4f8e-418a-ab51-9b38bede71ca req-10644a70-4d94-4751-be78-3d5e3cf72f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee5a813-ddcc-4f52-85fb-962d58e4ebea", "tag": "52c40643-9d18-4754-974b-db14b245a917"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:08.930381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-42b44803-4f8e-418a-ab51-9b38bede71ca req-10644a70-4d94-4751-be78-3d5e3cf72f6a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:08.931189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-42b44803-4f8e-418a-ab51-9b38bede71ca req-10644a70-4d94-4751-be78-3d5e3cf72f6a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:08.931777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-42b44803-4f8e-418a-ab51-9b38bede71ca req-10644a70-4d94-4751-be78-3d5e3cf72f6a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:08.953731 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-42b44803-4f8e-418a-ab51-9b38bede71ca req-10644a70-4d94-4751-be78-3d5e3cf72f6a service nova] Creating event network-changed:52c40643-9d18-4754-974b-db14b245a917 for instance 7ee5a813-ddcc-4f52-85fb-962d58e4ebea on n-h2-839401-11 Aug 29 16:03:08.970498 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-42b44803-4f8e-418a-ab51-9b38bede71ca req-10644a70-4d94-4751-be78-3d5e3cf72f6a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075999 Aug 29 16:03:08.973511 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3497/6780] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:09.732660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-204998cb-f95c-4a1f-b3cb-e460a03baf8b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:09.734210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-204998cb-f95c-4a1f-b3cb-e460a03baf8b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:09.748658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-204998cb-f95c-4a1f-b3cb-e460a03baf8b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:09.752635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-204998cb-f95c-4a1f-b3cb-e460a03baf8b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:09.754923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-204998cb-f95c-4a1f-b3cb-e460a03baf8b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:09.755786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-204998cb-f95c-4a1f-b3cb-e460a03baf8b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:09.757188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-204998cb-f95c-4a1f-b3cb-e460a03baf8b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:09.760004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-204998cb-f95c-4a1f-b3cb-e460a03baf8b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:10.103430 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-204998cb-f95c-4a1f-b3cb-e460a03baf8b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1465 microversion: 2.1 time: 0.375191 Aug 29 16:03:10.104227 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3284/6781] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:09 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1465 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:11.128946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1e154ad2-21c5-4767-a875-4b842885fe94 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:11.130436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1e154ad2-21c5-4767-a875-4b842885fe94 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:11.142283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:11.149247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e154ad2-21c5-4767-a875-4b842885fe94 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:11.150224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e154ad2-21c5-4767-a875-4b842885fe94 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:11.152699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e154ad2-21c5-4767-a875-4b842885fe94 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:11.158698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e154ad2-21c5-4767-a875-4b842885fe94 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:11.159859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e154ad2-21c5-4767-a875-4b842885fe94 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:11.160534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e154ad2-21c5-4767-a875-4b842885fe94 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:11.226119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=63 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:11.299292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:11.303629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:11.329323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:11.332459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:11.333020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:11.334780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:11.336619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:11.337070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:11.459631 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1e154ad2-21c5-4767-a875-4b842885fe94 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1465 microversion: 2.1 time: 0.337494 Aug 29 16:03:11.469426 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3498/6782] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:11 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1465 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:11.511981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:03:11.512407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:03:11.512886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:03:11.513322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:03:11.514183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:03:11.668260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:11.691564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:11.694188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:11.694643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:11.695405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:11.695868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:11.696301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:11.811467 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b5f75e88-a16e-473a-8507-8c1e82495630 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089/action" status: 202 len: 1136 microversion: 2.1 time: 0.517175 Aug 29 16:03:11.812193 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3285/6783] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:03:11 2022] POST /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089/action => generated 1136 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 29 16:03:11.830853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4ca168b2-6851-4ed1-9fae-6c4b9b434c8b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:11.831866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4ca168b2-6851-4ed1-9fae-6c4b9b434c8b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:11.852229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ca168b2-6851-4ed1-9fae-6c4b9b434c8b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:11.855421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ca168b2-6851-4ed1-9fae-6c4b9b434c8b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:11.857803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ca168b2-6851-4ed1-9fae-6c4b9b434c8b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:11.860994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ca168b2-6851-4ed1-9fae-6c4b9b434c8b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:11.861739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ca168b2-6851-4ed1-9fae-6c4b9b434c8b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:11.862375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ca168b2-6851-4ed1-9fae-6c4b9b434c8b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:12.330584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4ca168b2-6851-4ed1-9fae-6c4b9b434c8b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:12.345515 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4ca168b2-6851-4ed1-9fae-6c4b9b434c8b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1691 microversion: 2.1 time: 0.517809 Aug 29 16:03:12.350563 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3499/6784] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:11 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1691 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:12.490554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bbda0456-11ab-418d-950e-237ae9d9743d tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:12.491327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bbda0456-11ab-418d-950e-237ae9d9743d tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:12.501293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbda0456-11ab-418d-950e-237ae9d9743d tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:12.505132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbda0456-11ab-418d-950e-237ae9d9743d tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:12.507057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbda0456-11ab-418d-950e-237ae9d9743d tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:12.511410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbda0456-11ab-418d-950e-237ae9d9743d tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:12.512282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbda0456-11ab-418d-950e-237ae9d9743d tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:12.513169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bbda0456-11ab-418d-950e-237ae9d9743d tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:12.983651 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bbda0456-11ab-418d-950e-237ae9d9743d tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1465 microversion: 2.1 time: 0.496073 Aug 29 16:03:12.985855 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3286/6785] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:12 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1465 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:13.375758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8334df2a-c23d-4c45-bbaf-4aa74ad10b84 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:13.376764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8334df2a-c23d-4c45-bbaf-4aa74ad10b84 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:13.388689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8334df2a-c23d-4c45-bbaf-4aa74ad10b84 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:13.389221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8334df2a-c23d-4c45-bbaf-4aa74ad10b84 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:13.392523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8334df2a-c23d-4c45-bbaf-4aa74ad10b84 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:13.393709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8334df2a-c23d-4c45-bbaf-4aa74ad10b84 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:13.396024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8334df2a-c23d-4c45-bbaf-4aa74ad10b84 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:13.396656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8334df2a-c23d-4c45-bbaf-4aa74ad10b84 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:13.703952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8334df2a-c23d-4c45-bbaf-4aa74ad10b84 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:13.718188 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8334df2a-c23d-4c45-bbaf-4aa74ad10b84 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1691 microversion: 2.1 time: 0.347100 Aug 29 16:03:13.734248 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3500/6786] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:13 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1691 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:14.009238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ace13a4c-d5bb-4274-aa1e-dfa37587fb08 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:14.010432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ace13a4c-d5bb-4274-aa1e-dfa37587fb08 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:14.022265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:14.035037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ace13a4c-d5bb-4274-aa1e-dfa37587fb08 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:14.035555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ace13a4c-d5bb-4274-aa1e-dfa37587fb08 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:14.035999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ace13a4c-d5bb-4274-aa1e-dfa37587fb08 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:14.037126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ace13a4c-d5bb-4274-aa1e-dfa37587fb08 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:14.037238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ace13a4c-d5bb-4274-aa1e-dfa37587fb08 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:14.037642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ace13a4c-d5bb-4274-aa1e-dfa37587fb08 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:14.071957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:14.283028 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ace13a4c-d5bb-4274-aa1e-dfa37587fb08 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1465 microversion: 2.1 time: 0.278586 Aug 29 16:03:14.284785 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3287/6787] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:14 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1465 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:14.741037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0e36eb21-a12e-420b-937a-9cad86bc0be1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:14.742398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0e36eb21-a12e-420b-937a-9cad86bc0be1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:14.745696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:14.760844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e36eb21-a12e-420b-937a-9cad86bc0be1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:14.773783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e36eb21-a12e-420b-937a-9cad86bc0be1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:14.781862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e36eb21-a12e-420b-937a-9cad86bc0be1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:14.783824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e36eb21-a12e-420b-937a-9cad86bc0be1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:14.784325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e36eb21-a12e-420b-937a-9cad86bc0be1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:14.784773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e36eb21-a12e-420b-937a-9cad86bc0be1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:15.086564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0e36eb21-a12e-420b-937a-9cad86bc0be1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:15.097069 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0e36eb21-a12e-420b-937a-9cad86bc0be1 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1691 microversion: 2.1 time: 0.360826 Aug 29 16:03:15.097975 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3501/6788] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:14 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1691 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:15.305862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-88ff8a50-2577-417a-b3a2-596f53be2379 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:15.307133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-88ff8a50-2577-417a-b3a2-596f53be2379 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:15.317103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:15.320325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88ff8a50-2577-417a-b3a2-596f53be2379 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:15.331039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88ff8a50-2577-417a-b3a2-596f53be2379 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:15.339850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88ff8a50-2577-417a-b3a2-596f53be2379 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:15.344099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88ff8a50-2577-417a-b3a2-596f53be2379 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:15.344710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88ff8a50-2577-417a-b3a2-596f53be2379 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:15.345219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88ff8a50-2577-417a-b3a2-596f53be2379 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:15.373583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:15.582196 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-88ff8a50-2577-417a-b3a2-596f53be2379 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1465 microversion: 2.1 time: 0.279987 Aug 29 16:03:15.583396 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3288/6789] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:15 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1465 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:15.620227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-442513c5-f48c-40d6-a40b-950e40ef068c req-ee180f84-adaf-437a-b186-dbd94506da90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee5a813-ddcc-4f52-85fb-962d58e4ebea", "name": "network-vif-plugged", "status": "completed", "tag": "52c40643-9d18-4754-974b-db14b245a917"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:15.631580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-442513c5-f48c-40d6-a40b-950e40ef068c req-ee180f84-adaf-437a-b186-dbd94506da90 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:15.632269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-442513c5-f48c-40d6-a40b-950e40ef068c req-ee180f84-adaf-437a-b186-dbd94506da90 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:15.633411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-442513c5-f48c-40d6-a40b-950e40ef068c req-ee180f84-adaf-437a-b186-dbd94506da90 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:15.648561 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-442513c5-f48c-40d6-a40b-950e40ef068c req-ee180f84-adaf-437a-b186-dbd94506da90 service nova] Creating event network-vif-plugged:52c40643-9d18-4754-974b-db14b245a917 for instance 7ee5a813-ddcc-4f52-85fb-962d58e4ebea on n-h2-839401-11 Aug 29 16:03:15.655553 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-442513c5-f48c-40d6-a40b-950e40ef068c req-ee180f84-adaf-437a-b186-dbd94506da90 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039593 Aug 29 16:03:15.656794 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3502/6790] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:16.122647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6f6c6197-9a1e-4ff0-be7b-874cb7ab2e8e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:16.123453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6f6c6197-9a1e-4ff0-be7b-874cb7ab2e8e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:16.136885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f6c6197-9a1e-4ff0-be7b-874cb7ab2e8e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:16.137594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f6c6197-9a1e-4ff0-be7b-874cb7ab2e8e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:16.138137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f6c6197-9a1e-4ff0-be7b-874cb7ab2e8e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:16.139070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f6c6197-9a1e-4ff0-be7b-874cb7ab2e8e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:16.148314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f6c6197-9a1e-4ff0-be7b-874cb7ab2e8e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:16.148314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f6c6197-9a1e-4ff0-be7b-874cb7ab2e8e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:16.431169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6f6c6197-9a1e-4ff0-be7b-874cb7ab2e8e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:16.441181 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6f6c6197-9a1e-4ff0-be7b-874cb7ab2e8e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1691 microversion: 2.1 time: 0.325134 Aug 29 16:03:16.445739 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3289/6791] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:16 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1691 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:16.607102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5cb20537-f525-43b0-ac8a-4dfff06edac3 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:16.607846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5cb20537-f525-43b0-ac8a-4dfff06edac3 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:16.617574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5cb20537-f525-43b0-ac8a-4dfff06edac3 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:16.619794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5cb20537-f525-43b0-ac8a-4dfff06edac3 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:16.620509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5cb20537-f525-43b0-ac8a-4dfff06edac3 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:16.622421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5cb20537-f525-43b0-ac8a-4dfff06edac3 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:16.624152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5cb20537-f525-43b0-ac8a-4dfff06edac3 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:16.625425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5cb20537-f525-43b0-ac8a-4dfff06edac3 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:17.283320 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5cb20537-f525-43b0-ac8a-4dfff06edac3 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1465 microversion: 2.1 time: 0.681328 Aug 29 16:03:17.285941 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3503/6792] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:16 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1465 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:17.451248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1726549093", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "7a468f5f-d0ee-4623-b01e-dc25b782b3c2"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:17.468312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8ad4ad86-8aac-4145-8bf1-471c7b9214f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:17.469234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8ad4ad86-8aac-4145-8bf1-471c7b9214f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:17.482429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ad4ad86-8aac-4145-8bf1-471c7b9214f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:17.483434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ad4ad86-8aac-4145-8bf1-471c7b9214f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:17.484137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ad4ad86-8aac-4145-8bf1-471c7b9214f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:17.485121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ad4ad86-8aac-4145-8bf1-471c7b9214f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:17.487073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ad4ad86-8aac-4145-8bf1-471c7b9214f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:17.488132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ad4ad86-8aac-4145-8bf1-471c7b9214f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:17.527373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] validate_networks() for [('7a468f5f-d0ee-4623-b01e-dc25b782b3c2', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:03:17.863016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8ad4ad86-8aac-4145-8bf1-471c7b9214f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:17.875728 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8ad4ad86-8aac-4145-8bf1-471c7b9214f6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1691 microversion: 2.1 time: 0.413088 Aug 29 16:03:17.876757 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3504/6793] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:17 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1691 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:17.949352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:03:17.949780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:03:17.950558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:03:17.951061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:03:17.952404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:03:17.964910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:17.965737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:17.966322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:17.967216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:17.967817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:17.968438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:17.988196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Getting quotas for project 472eeabd8e4d4ef6b0ca61c054989cce. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:03:17.994557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Getting quotas for user 320682cfc39d4b1da34a955d0faf966e and project 472eeabd8e4d4ef6b0ca61c054989cce. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:03:18.011467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:03:18.013767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:03:18.068919 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5e811662-2b92-4e45-acfb-645600ff6744 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870724 Aug 29 16:03:18.070297 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3290/6794] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:03:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:03:18.081370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ac3944d0-39f7-4061-a387-2721fd71154a tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:18.082245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ac3944d0-39f7-4061-a387-2721fd71154a tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:18.187441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ac3944d0-39f7-4061-a387-2721fd71154a tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320682cfc39d4b1da34a955d0faf966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472eeabd8e4d4ef6b0ca61c054989cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:18.209206 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ac3944d0-39f7-4061-a387-2721fd71154a tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 200 len: 1214 microversion: 2.1 time: 0.130620 Aug 29 16:03:18.209895 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3505/6795] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:18 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:18.311025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3fe989d4-187e-4a14-897f-cd45b1800a38 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:18.311664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3fe989d4-187e-4a14-897f-cd45b1800a38 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:18.332057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fe989d4-187e-4a14-897f-cd45b1800a38 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:18.332490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fe989d4-187e-4a14-897f-cd45b1800a38 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:18.333237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fe989d4-187e-4a14-897f-cd45b1800a38 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:18.334234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fe989d4-187e-4a14-897f-cd45b1800a38 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:18.334933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fe989d4-187e-4a14-897f-cd45b1800a38 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:18.335639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3fe989d4-187e-4a14-897f-cd45b1800a38 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:18.604906 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3fe989d4-187e-4a14-897f-cd45b1800a38 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1650 microversion: 2.1 time: 0.299143 Aug 29 16:03:18.605613 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3291/6796] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:18 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1650 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:18.627070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c87ed455-e940-4ff3-be01-c5ee515ef4f1 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:18.627953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c87ed455-e940-4ff3-be01-c5ee515ef4f1 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:18.638629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87ed455-e940-4ff3-be01-c5ee515ef4f1 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:18.639085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87ed455-e940-4ff3-be01-c5ee515ef4f1 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:18.639540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87ed455-e940-4ff3-be01-c5ee515ef4f1 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:18.640539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87ed455-e940-4ff3-be01-c5ee515ef4f1 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:18.641331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87ed455-e940-4ff3-be01-c5ee515ef4f1 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:18.641990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87ed455-e940-4ff3-be01-c5ee515ef4f1 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:18.899856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-07a3506c-46db-4148-9312-d2cf10302d68 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:18.900629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-07a3506c-46db-4148-9312-d2cf10302d68 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:18.910261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07a3506c-46db-4148-9312-d2cf10302d68 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:18.910748 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c87ed455-e940-4ff3-be01-c5ee515ef4f1 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1650 microversion: 2.1 time: 0.288643 Aug 29 16:03:18.911481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07a3506c-46db-4148-9312-d2cf10302d68 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:18.912390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07a3506c-46db-4148-9312-d2cf10302d68 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:18.913539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07a3506c-46db-4148-9312-d2cf10302d68 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:18.914768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07a3506c-46db-4148-9312-d2cf10302d68 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:18.929694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07a3506c-46db-4148-9312-d2cf10302d68 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:18.929905 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3506/6797] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:18 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1650 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:18.936450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-02991b03-fa29-4064-99ba-0d1daae3ad85 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:18.937236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-02991b03-fa29-4064-99ba-0d1daae3ad85 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:18.947664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02991b03-fa29-4064-99ba-0d1daae3ad85 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:18.948165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02991b03-fa29-4064-99ba-0d1daae3ad85 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:18.949518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02991b03-fa29-4064-99ba-0d1daae3ad85 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:18.950234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02991b03-fa29-4064-99ba-0d1daae3ad85 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:18.950702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02991b03-fa29-4064-99ba-0d1daae3ad85 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:18.951129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02991b03-fa29-4064-99ba-0d1daae3ad85 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:19.146712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-07a3506c-46db-4148-9312-d2cf10302d68 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:19.156433 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-07a3506c-46db-4148-9312-d2cf10302d68 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1691 microversion: 2.1 time: 0.261840 Aug 29 16:03:19.157071 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3292/6798] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:18 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1691 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:19.230390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b7d93b45-9422-4360-9fa6-81d867080d74 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:19.230926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b7d93b45-9422-4360-9fa6-81d867080d74 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:19.237603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7d93b45-9422-4360-9fa6-81d867080d74 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:19.238098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7d93b45-9422-4360-9fa6-81d867080d74 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:19.238535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7d93b45-9422-4360-9fa6-81d867080d74 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:19.239277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7d93b45-9422-4360-9fa6-81d867080d74 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:19.239750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7d93b45-9422-4360-9fa6-81d867080d74 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:19.240695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7d93b45-9422-4360-9fa6-81d867080d74 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:19.281614 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-02991b03-fa29-4064-99ba-0d1daae3ad85 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1650 microversion: 2.1 time: 0.350197 Aug 29 16:03:19.283114 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3507/6799] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:18 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1650 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:19.306641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e2a98197-f5ce-4ba2-91dc-f1cc19edbd2f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:19.307495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e2a98197-f5ce-4ba2-91dc-f1cc19edbd2f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:19.315036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2a98197-f5ce-4ba2-91dc-f1cc19edbd2f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:19.315649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2a98197-f5ce-4ba2-91dc-f1cc19edbd2f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:19.316620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2a98197-f5ce-4ba2-91dc-f1cc19edbd2f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:19.317439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2a98197-f5ce-4ba2-91dc-f1cc19edbd2f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:19.318122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2a98197-f5ce-4ba2-91dc-f1cc19edbd2f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:19.318771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2a98197-f5ce-4ba2-91dc-f1cc19edbd2f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:19.325011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b7d93b45-9422-4360-9fa6-81d867080d74 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320682cfc39d4b1da34a955d0faf966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472eeabd8e4d4ef6b0ca61c054989cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:19.335409 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b7d93b45-9422-4360-9fa6-81d867080d74 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 200 len: 1266 microversion: 2.1 time: 0.109117 Aug 29 16:03:19.336501 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3293/6800] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:19 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:19.356253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e2a98197-f5ce-4ba2-91dc-f1cc19edbd2f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:03:19.483077 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e2a98197-f5ce-4ba2-91dc-f1cc19edbd2f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "DELETE /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 204 len: 0 microversion: 2.1 time: 0.181814 Aug 29 16:03:19.486860 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3508/6801] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:03:19 2022] DELETE /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:03:19.492881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6ed266ea-7a47-412c-8b46-bcaf078e16bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:19.493668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6ed266ea-7a47-412c-8b46-bcaf078e16bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:19.503430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ed266ea-7a47-412c-8b46-bcaf078e16bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:19.504265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ed266ea-7a47-412c-8b46-bcaf078e16bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:19.504922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ed266ea-7a47-412c-8b46-bcaf078e16bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:19.505771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ed266ea-7a47-412c-8b46-bcaf078e16bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:19.506301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ed266ea-7a47-412c-8b46-bcaf078e16bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:19.507327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6ed266ea-7a47-412c-8b46-bcaf078e16bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:19.691551 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6ed266ea-7a47-412c-8b46-bcaf078e16bc tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1656 microversion: 2.1 time: 0.202995 Aug 29 16:03:19.692221 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3294/6802] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:19 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1656 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:20.180649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-89996397-e848-45da-892c-8b5034967673 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:20.181425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-89996397-e848-45da-892c-8b5034967673 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:20.194451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89996397-e848-45da-892c-8b5034967673 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:20.194960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89996397-e848-45da-892c-8b5034967673 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:20.195397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89996397-e848-45da-892c-8b5034967673 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:20.196110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89996397-e848-45da-892c-8b5034967673 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:20.196563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89996397-e848-45da-892c-8b5034967673 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:20.197038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89996397-e848-45da-892c-8b5034967673 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:20.362995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0d333556-18f3-42ba-b37a-16342fc7e8a5 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:20.363880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0d333556-18f3-42ba-b37a-16342fc7e8a5 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:20.371490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d333556-18f3-42ba-b37a-16342fc7e8a5 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:20.372000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d333556-18f3-42ba-b37a-16342fc7e8a5 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:20.372434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d333556-18f3-42ba-b37a-16342fc7e8a5 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:20.373177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d333556-18f3-42ba-b37a-16342fc7e8a5 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:20.373636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d333556-18f3-42ba-b37a-16342fc7e8a5 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:20.374060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d333556-18f3-42ba-b37a-16342fc7e8a5 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:20.478011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0d333556-18f3-42ba-b37a-16342fc7e8a5 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320682cfc39d4b1da34a955d0faf966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472eeabd8e4d4ef6b0ca61c054989cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:20.486505 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0d333556-18f3-42ba-b37a-16342fc7e8a5 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 200 len: 1274 microversion: 2.1 time: 0.127589 Aug 29 16:03:20.499716 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3295/6803] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:20 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 1274 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:20.505622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-89996397-e848-45da-892c-8b5034967673 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:20.514251 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-89996397-e848-45da-892c-8b5034967673 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1691 microversion: 2.1 time: 0.338778 Aug 29 16:03:20.514860 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3509/6804] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:20 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1691 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:20.717731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-69ae9b1c-6486-4ded-92ac-db937ff3765a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:20.718344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-69ae9b1c-6486-4ded-92ac-db937ff3765a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:20.730863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69ae9b1c-6486-4ded-92ac-db937ff3765a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:20.734953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69ae9b1c-6486-4ded-92ac-db937ff3765a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:20.735852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69ae9b1c-6486-4ded-92ac-db937ff3765a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:20.737146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69ae9b1c-6486-4ded-92ac-db937ff3765a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:20.737846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69ae9b1c-6486-4ded-92ac-db937ff3765a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:20.739281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-69ae9b1c-6486-4ded-92ac-db937ff3765a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:21.022835 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-69ae9b1c-6486-4ded-92ac-db937ff3765a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1656 microversion: 2.1 time: 0.311875 Aug 29 16:03:21.036374 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3296/6805] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:20 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1656 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:21.527381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4541c1cd-25fb-4a4f-8635-029105f1127c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:21.528988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4541c1cd-25fb-4a4f-8635-029105f1127c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:21.537307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6212b578-bb6b-4e52-9b5e-7a98f9fbfe2b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:21.538291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6212b578-bb6b-4e52-9b5e-7a98f9fbfe2b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:21.552002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4541c1cd-25fb-4a4f-8635-029105f1127c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:21.552735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4541c1cd-25fb-4a4f-8635-029105f1127c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:21.553350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4541c1cd-25fb-4a4f-8635-029105f1127c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:21.553916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6212b578-bb6b-4e52-9b5e-7a98f9fbfe2b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:21.554624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6212b578-bb6b-4e52-9b5e-7a98f9fbfe2b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:21.556049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4541c1cd-25fb-4a4f-8635-029105f1127c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:21.556452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6212b578-bb6b-4e52-9b5e-7a98f9fbfe2b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:21.557611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4541c1cd-25fb-4a4f-8635-029105f1127c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:21.558444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4541c1cd-25fb-4a4f-8635-029105f1127c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:21.559047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6212b578-bb6b-4e52-9b5e-7a98f9fbfe2b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:21.559535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6212b578-bb6b-4e52-9b5e-7a98f9fbfe2b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:21.571879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6212b578-bb6b-4e52-9b5e-7a98f9fbfe2b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:21.708042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4541c1cd-25fb-4a4f-8635-029105f1127c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320682cfc39d4b1da34a955d0faf966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472eeabd8e4d4ef6b0ca61c054989cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:21.718987 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4541c1cd-25fb-4a4f-8635-029105f1127c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 200 len: 1272 microversion: 2.1 time: 0.211968 Aug 29 16:03:21.720753 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3510/6806] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:21 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 1272 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:22.006064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6212b578-bb6b-4e52-9b5e-7a98f9fbfe2b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:22.015409 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6212b578-bb6b-4e52-9b5e-7a98f9fbfe2b tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1691 microversion: 2.1 time: 0.484053 Aug 29 16:03:22.016029 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3297/6807] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:21 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1691 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:22.044128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c3485edb-db7d-4117-bec2-960a7e3bf6aa tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:22.045053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c3485edb-db7d-4117-bec2-960a7e3bf6aa tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:22.055653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3485edb-db7d-4117-bec2-960a7e3bf6aa tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:22.056365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3485edb-db7d-4117-bec2-960a7e3bf6aa tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:22.064350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3485edb-db7d-4117-bec2-960a7e3bf6aa tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:22.065902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3485edb-db7d-4117-bec2-960a7e3bf6aa tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:22.066539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3485edb-db7d-4117-bec2-960a7e3bf6aa tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:22.067129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3485edb-db7d-4117-bec2-960a7e3bf6aa tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:22.584496 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c3485edb-db7d-4117-bec2-960a7e3bf6aa tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1656 microversion: 2.1 time: 0.544138 Aug 29 16:03:22.606107 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3511/6808] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:22 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1656 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:22.708231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-fc50458e-6252-4870-8818-3b5f3e5b7162 req-62da334a-bb5e-487f-98d2-b6b2de8e6cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee5a813-ddcc-4f52-85fb-962d58e4ebea", "name": "network-vif-deleted", "tag": "52c40643-9d18-4754-974b-db14b245a917"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:22.739046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fc50458e-6252-4870-8818-3b5f3e5b7162 req-62da334a-bb5e-487f-98d2-b6b2de8e6cad service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:22.739736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fc50458e-6252-4870-8818-3b5f3e5b7162 req-62da334a-bb5e-487f-98d2-b6b2de8e6cad service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:22.740290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fc50458e-6252-4870-8818-3b5f3e5b7162 req-62da334a-bb5e-487f-98d2-b6b2de8e6cad service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:22.756632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4fe18a85-9923-4927-b95b-bc2763aac9f4 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:22.758299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4fe18a85-9923-4927-b95b-bc2763aac9f4 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:22.776532 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-fc50458e-6252-4870-8818-3b5f3e5b7162 req-62da334a-bb5e-487f-98d2-b6b2de8e6cad service nova] Creating event network-vif-deleted:52c40643-9d18-4754-974b-db14b245a917 for instance 7ee5a813-ddcc-4f52-85fb-962d58e4ebea on n-h2-839401-11 Aug 29 16:03:22.801038 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-fc50458e-6252-4870-8818-3b5f3e5b7162 req-62da334a-bb5e-487f-98d2-b6b2de8e6cad service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099706 Aug 29 16:03:22.804915 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3298/6809] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:22.819817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fe18a85-9923-4927-b95b-bc2763aac9f4 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:22.825815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fe18a85-9923-4927-b95b-bc2763aac9f4 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:22.827791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fe18a85-9923-4927-b95b-bc2763aac9f4 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:22.829348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fe18a85-9923-4927-b95b-bc2763aac9f4 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:22.835540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fe18a85-9923-4927-b95b-bc2763aac9f4 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:22.840739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fe18a85-9923-4927-b95b-bc2763aac9f4 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:23.039476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-87289c8d-fb89-4ec8-a66e-92eb5cdd9a4a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:23.040815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-87289c8d-fb89-4ec8-a66e-92eb5cdd9a4a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:23.050581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87289c8d-fb89-4ec8-a66e-92eb5cdd9a4a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:23.054705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87289c8d-fb89-4ec8-a66e-92eb5cdd9a4a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:23.057394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87289c8d-fb89-4ec8-a66e-92eb5cdd9a4a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:23.058384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87289c8d-fb89-4ec8-a66e-92eb5cdd9a4a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:23.059087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87289c8d-fb89-4ec8-a66e-92eb5cdd9a4a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:23.060388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87289c8d-fb89-4ec8-a66e-92eb5cdd9a4a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:23.443706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-87289c8d-fb89-4ec8-a66e-92eb5cdd9a4a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:23.458023 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-87289c8d-fb89-4ec8-a66e-92eb5cdd9a4a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1691 microversion: 2.1 time: 0.422057 Aug 29 16:03:23.459261 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3299/6810] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:23 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1691 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:23.509204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4fe18a85-9923-4927-b95b-bc2763aac9f4 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320682cfc39d4b1da34a955d0faf966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472eeabd8e4d4ef6b0ca61c054989cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:23.520395 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4fe18a85-9923-4927-b95b-bc2763aac9f4 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 200 len: 1314 microversion: 2.1 time: 0.778170 Aug 29 16:03:23.523864 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3512/6811] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:22 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:23.612416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-16655014-e56b-4c73-8c07-f809028d831f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:23.621575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-16655014-e56b-4c73-8c07-f809028d831f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:23.631646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16655014-e56b-4c73-8c07-f809028d831f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:23.632957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16655014-e56b-4c73-8c07-f809028d831f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:23.633662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16655014-e56b-4c73-8c07-f809028d831f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:23.635405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16655014-e56b-4c73-8c07-f809028d831f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:23.636468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16655014-e56b-4c73-8c07-f809028d831f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:23.637261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16655014-e56b-4c73-8c07-f809028d831f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:23.683523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16655014-e56b-4c73-8c07-f809028d831f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:23.684314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16655014-e56b-4c73-8c07-f809028d831f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:23.684898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-16655014-e56b-4c73-8c07-f809028d831f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:23.685771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-16655014-e56b-4c73-8c07-f809028d831f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lazy-loading 'fault' on Instance uuid 7ee5a813-ddcc-4f52-85fb-962d58e4ebea {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:03:23.799455 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-16655014-e56b-4c73-8c07-f809028d831f tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 200 len: 1455 microversion: 2.1 time: 0.193574 Aug 29 16:03:23.800199 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3300/6812] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:23 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 1455 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:24.483389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eab69cac-8c87-41f9-b324-4619a70d33f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:24.485746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eab69cac-8c87-41f9-b324-4619a70d33f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:24.496183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eab69cac-8c87-41f9-b324-4619a70d33f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:24.497020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eab69cac-8c87-41f9-b324-4619a70d33f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:24.497667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eab69cac-8c87-41f9-b324-4619a70d33f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:24.498607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eab69cac-8c87-41f9-b324-4619a70d33f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:24.499230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eab69cac-8c87-41f9-b324-4619a70d33f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:24.499887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eab69cac-8c87-41f9-b324-4619a70d33f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:24.547392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c0d97848-51d7-4287-8320-ff183c556c39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:24.548747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c0d97848-51d7-4287-8320-ff183c556c39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:24.555678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d97848-51d7-4287-8320-ff183c556c39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:24.556171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d97848-51d7-4287-8320-ff183c556c39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:24.556608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d97848-51d7-4287-8320-ff183c556c39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:24.557355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d97848-51d7-4287-8320-ff183c556c39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:24.557810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d97848-51d7-4287-8320-ff183c556c39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:24.558235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0d97848-51d7-4287-8320-ff183c556c39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:24.922459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eab69cac-8c87-41f9-b324-4619a70d33f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:24.932079 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eab69cac-8c87-41f9-b324-4619a70d33f2 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1691 microversion: 2.1 time: 0.452599 Aug 29 16:03:24.959168 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3513/6813] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:24 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1691 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:24.961818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c0d97848-51d7-4287-8320-ff183c556c39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320682cfc39d4b1da34a955d0faf966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472eeabd8e4d4ef6b0ca61c054989cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:24.966533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f0c26107-8380-46c3-b130-d47b0c8d8c2a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:24.968484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f0c26107-8380-46c3-b130-d47b0c8d8c2a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 7ee5a813-ddcc-4f52-85fb-962d58e4ebea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:24.974137 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c0d97848-51d7-4287-8320-ff183c556c39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 200 len: 1314 microversion: 2.1 time: 0.428456 Aug 29 16:03:24.993117 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3301/6814] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:24 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:24.993117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-badf2c03-3077-4b58-a0dd-2b2cb86917d3 req-1712e96a-1716-487e-9e9e-5c59d4653600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7", "tag": "f85c73af-c192-432a-99c2-853313126f07"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:25.000786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0c26107-8380-46c3-b130-d47b0c8d8c2a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:25.001621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0c26107-8380-46c3-b130-d47b0c8d8c2a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:25.002780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0c26107-8380-46c3-b130-d47b0c8d8c2a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:25.003723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0c26107-8380-46c3-b130-d47b0c8d8c2a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:25.004857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0c26107-8380-46c3-b130-d47b0c8d8c2a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:25.005505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f0c26107-8380-46c3-b130-d47b0c8d8c2a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:25.014079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-badf2c03-3077-4b58-a0dd-2b2cb86917d3 req-1712e96a-1716-487e-9e9e-5c59d4653600 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:25.014759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-badf2c03-3077-4b58-a0dd-2b2cb86917d3 req-1712e96a-1716-487e-9e9e-5c59d4653600 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:25.016447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-badf2c03-3077-4b58-a0dd-2b2cb86917d3 req-1712e96a-1716-487e-9e9e-5c59d4653600 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:25.040208 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-f0c26107-8380-46c3-b130-d47b0c8d8c2a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] HTTP exception thrown: Instance 7ee5a813-ddcc-4f52-85fb-962d58e4ebea could not be found. Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f0c26107-8380-46c3-b130-d47b0c8d8c2a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Request method failure captured: Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea HTTP/1.1 Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOMlYOlu_Bsb9LYSZT_HSNdRalohQVIxNyoJu9cT5UL-G8HMgVFS91AVU3kPmpDaTvtHwxsZDqQ1YWnlQ2JXQWjscUIPFSFtZLqisvXKA5leW_ZXYhAFOmB-DDHGYU_pw4ltL2KI5MRxKF56yTxeYqFaJs9SjssoyQW2jV9SeBRLJVc Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: f7150a6ff711416eb228306eda9a479a Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestServerMultinode-249534412 Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f7150a6ff711416eb228306eda9a479a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f7150a6ff711416eb228306eda9a479a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7150a6ff711416eb228306eda9a479a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7150a6ff711416eb228306eda9a479a"}]}] Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestServerMultinode-249534412 Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: f7150a6ff711416eb228306eda9a479a Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestServerMultinode-249534412 Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestServerMultinode-249534412-project-admin Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 328e2d2b520c4ca9924d91c98d2adfba Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestServerMultinode-249534412-project-admin Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 7ee5a813-ddcc-4f52-85fb-962d58e4ebea could not be found. Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '7ee5a813-ddcc-4f52-85fb-962d58e4ebea'} Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee5a813-ddcc-4f52-85fb-962d58e4ebea could not be found. Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee5a813-ddcc-4f52-85fb-962d58e4ebea could not be found. Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:25.042003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:25.046079 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:25.046079 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:25.046079 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:25.046079 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:03:25.046079 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:03:25.046079 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee5a813-ddcc-4f52-85fb-962d58e4ebea could not be found. Aug 29 16:03:25.046079 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:25.049604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f0c26107-8380-46c3-b130-d47b0c8d8c2a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Returning 404 to user: Instance 7ee5a813-ddcc-4f52-85fb-962d58e4ebea could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:03:25.050476 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f0c26107-8380-46c3-b130-d47b0c8d8c2a tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea" status: 404 len: 111 microversion: 2.1 time: 0.090031 Aug 29 16:03:25.051071 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3514/6815] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:24 2022] GET /compute/v2.1/servers/7ee5a813-ddcc-4f52-85fb-962d58e4ebea => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:03:25.056615 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-badf2c03-3077-4b58-a0dd-2b2cb86917d3 req-1712e96a-1716-487e-9e9e-5c59d4653600 service nova] Creating event network-changed:f85c73af-c192-432a-99c2-853313126f07 for instance 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 on n-h2-839401-11 Aug 29 16:03:25.061244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7eba4711-e42a-422c-97b4-5bd4aa05d207 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:25.061768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7eba4711-e42a-422c-97b4-5bd4aa05d207 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:25.069595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eba4711-e42a-422c-97b4-5bd4aa05d207 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:25.070118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eba4711-e42a-422c-97b4-5bd4aa05d207 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:25.070352 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-badf2c03-3077-4b58-a0dd-2b2cb86917d3 req-1712e96a-1716-487e-9e9e-5c59d4653600 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091355 Aug 29 16:03:25.070568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eba4711-e42a-422c-97b4-5bd4aa05d207 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:25.071290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eba4711-e42a-422c-97b4-5bd4aa05d207 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:25.072082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eba4711-e42a-422c-97b4-5bd4aa05d207 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:25.072674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eba4711-e42a-422c-97b4-5bd4aa05d207 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:25.072895 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3302/6816] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:25.092136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:25.108696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7eba4711-e42a-422c-97b4-5bd4aa05d207 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:03:25.213632 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7eba4711-e42a-422c-97b4-5bd4aa05d207 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "DELETE /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 204 len: 0 microversion: 2.1 time: 0.156948 Aug 29 16:03:25.215579 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3515/6817] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:03:25 2022] DELETE /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:03:25.225391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fd7414f2-842c-4858-b8a9-0a66e9ffdb0b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:25.226539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fd7414f2-842c-4858-b8a9-0a66e9ffdb0b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:25.235146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd7414f2-842c-4858-b8a9-0a66e9ffdb0b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:25.235946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd7414f2-842c-4858-b8a9-0a66e9ffdb0b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:25.236563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd7414f2-842c-4858-b8a9-0a66e9ffdb0b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:25.239022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd7414f2-842c-4858-b8a9-0a66e9ffdb0b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:25.239670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd7414f2-842c-4858-b8a9-0a66e9ffdb0b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:25.240298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd7414f2-842c-4858-b8a9-0a66e9ffdb0b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:25.463682 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fd7414f2-842c-4858-b8a9-0a66e9ffdb0b tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1655 microversion: 2.1 time: 0.243332 Aug 29 16:03:25.465758 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3303/6818] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:25 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1655 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:25.967393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6a2395ec-2d37-41a3-ab84-677829ed187a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:25.967890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6a2395ec-2d37-41a3-ab84-677829ed187a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:25.979077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a2395ec-2d37-41a3-ab84-677829ed187a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:25.979704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a2395ec-2d37-41a3-ab84-677829ed187a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:25.980148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a2395ec-2d37-41a3-ab84-677829ed187a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:25.980984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a2395ec-2d37-41a3-ab84-677829ed187a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:25.988742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a2395ec-2d37-41a3-ab84-677829ed187a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:25.989355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a2395ec-2d37-41a3-ab84-677829ed187a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:26.009328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f53f5a45-6342-4004-b480-1aadfde75053 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:26.010689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f53f5a45-6342-4004-b480-1aadfde75053 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:26.050568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f53f5a45-6342-4004-b480-1aadfde75053 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:26.075010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f53f5a45-6342-4004-b480-1aadfde75053 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:26.075874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f53f5a45-6342-4004-b480-1aadfde75053 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:26.078392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f53f5a45-6342-4004-b480-1aadfde75053 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:26.079145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f53f5a45-6342-4004-b480-1aadfde75053 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:26.080426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f53f5a45-6342-4004-b480-1aadfde75053 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:26.227325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6a2395ec-2d37-41a3-ab84-677829ed187a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:26.244878 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6a2395ec-2d37-41a3-ab84-677829ed187a tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1691 microversion: 2.1 time: 0.282182 Aug 29 16:03:26.245801 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3516/6819] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:25 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1691 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:26.356604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f53f5a45-6342-4004-b480-1aadfde75053 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320682cfc39d4b1da34a955d0faf966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472eeabd8e4d4ef6b0ca61c054989cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:26.365320 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f53f5a45-6342-4004-b480-1aadfde75053 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 200 len: 1314 microversion: 2.1 time: 0.360766 Aug 29 16:03:26.366303 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3304/6820] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:26 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:26.486469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5488a56a-d89e-42eb-9b4a-e0323ac15f83 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:26.487505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5488a56a-d89e-42eb-9b4a-e0323ac15f83 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:26.495531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5488a56a-d89e-42eb-9b4a-e0323ac15f83 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:26.496348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5488a56a-d89e-42eb-9b4a-e0323ac15f83 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:26.497024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5488a56a-d89e-42eb-9b4a-e0323ac15f83 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:26.497977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5488a56a-d89e-42eb-9b4a-e0323ac15f83 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:26.498641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5488a56a-d89e-42eb-9b4a-e0323ac15f83 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:26.499269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5488a56a-d89e-42eb-9b4a-e0323ac15f83 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:26.766692 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5488a56a-d89e-42eb-9b4a-e0323ac15f83 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1655 microversion: 2.1 time: 0.284135 Aug 29 16:03:26.782430 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3517/6821] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:26 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1655 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:27.271456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5b7ae660-a439-4079-9607-dde554c4a4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:27.272082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5b7ae660-a439-4079-9607-dde554c4a4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:27.294804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b7ae660-a439-4079-9607-dde554c4a4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:27.295325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b7ae660-a439-4079-9607-dde554c4a4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:27.295808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b7ae660-a439-4079-9607-dde554c4a4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:27.296595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b7ae660-a439-4079-9607-dde554c4a4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:27.297261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b7ae660-a439-4079-9607-dde554c4a4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:27.297694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b7ae660-a439-4079-9607-dde554c4a4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:27.387721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8fb25768-45d6-46a1-b417-7614dd41d15c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:27.389192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8fb25768-45d6-46a1-b417-7614dd41d15c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:27.421371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8fb25768-45d6-46a1-b417-7614dd41d15c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:27.425876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8fb25768-45d6-46a1-b417-7614dd41d15c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:27.426610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8fb25768-45d6-46a1-b417-7614dd41d15c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:27.428421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8fb25768-45d6-46a1-b417-7614dd41d15c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:27.429146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8fb25768-45d6-46a1-b417-7614dd41d15c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:27.429760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8fb25768-45d6-46a1-b417-7614dd41d15c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:27.753409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5b7ae660-a439-4079-9607-dde554c4a4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:27.770012 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5b7ae660-a439-4079-9607-dde554c4a4bd tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1691 microversion: 2.1 time: 0.503302 Aug 29 16:03:27.783253 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3305/6822] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:27 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1691 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:27.789306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d509ad9c-f66c-4ac6-aa3f-e843c2464faf req-6907c027-d899-492c-bfe0-33075563c56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8dadd5-90e2-493d-8777-32673ca83a66", "name": "network-vif-deleted", "tag": "ab191de7-ad96-4d7a-8714-4d8436de6693"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:27.800039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d509ad9c-f66c-4ac6-aa3f-e843c2464faf req-6907c027-d899-492c-bfe0-33075563c56b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:27.805987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d509ad9c-f66c-4ac6-aa3f-e843c2464faf req-6907c027-d899-492c-bfe0-33075563c56b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:27.806788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d509ad9c-f66c-4ac6-aa3f-e843c2464faf req-6907c027-d899-492c-bfe0-33075563c56b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:27.844189 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d509ad9c-f66c-4ac6-aa3f-e843c2464faf req-6907c027-d899-492c-bfe0-33075563c56b service nova] Creating event network-vif-deleted:ab191de7-ad96-4d7a-8714-4d8436de6693 for instance 6a8dadd5-90e2-493d-8777-32673ca83a66 on n-h1-839401-11 Aug 29 16:03:27.863535 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d509ad9c-f66c-4ac6-aa3f-e843c2464faf req-6907c027-d899-492c-bfe0-33075563c56b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078534 Aug 29 16:03:27.864172 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3306/6823] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:27.877989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b734003c-1b6c-4ed6-9901-ef05ede28104 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:27.878872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b734003c-1b6c-4ed6-9901-ef05ede28104 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:27.887011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b734003c-1b6c-4ed6-9901-ef05ede28104 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:27.887620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b734003c-1b6c-4ed6-9901-ef05ede28104 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:27.888133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b734003c-1b6c-4ed6-9901-ef05ede28104 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:27.888974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b734003c-1b6c-4ed6-9901-ef05ede28104 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:27.890329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b734003c-1b6c-4ed6-9901-ef05ede28104 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:27.891092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b734003c-1b6c-4ed6-9901-ef05ede28104 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:27.899225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:27.980001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:28.145889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:28.145889 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b734003c-1b6c-4ed6-9901-ef05ede28104 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1613 microversion: 2.1 time: 0.160425 Aug 29 16:03:28.145889 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3307/6824] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:27 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1613 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:28.196922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:28.260133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8fb25768-45d6-46a1-b417-7614dd41d15c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320682cfc39d4b1da34a955d0faf966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472eeabd8e4d4ef6b0ca61c054989cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:28.267145 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8fb25768-45d6-46a1-b417-7614dd41d15c tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 200 len: 1314 microversion: 2.1 time: 0.883333 Aug 29 16:03:28.276418 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3518/6825] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:27 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 1314 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:28.792454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2fbffd27-a31a-405b-b3a3-6a37a4891322 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:28.793077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2fbffd27-a31a-405b-b3a3-6a37a4891322 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:28.804195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fbffd27-a31a-405b-b3a3-6a37a4891322 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:28.804982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fbffd27-a31a-405b-b3a3-6a37a4891322 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:28.805528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fbffd27-a31a-405b-b3a3-6a37a4891322 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:28.806257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fbffd27-a31a-405b-b3a3-6a37a4891322 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:28.806712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fbffd27-a31a-405b-b3a3-6a37a4891322 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:28.807132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2fbffd27-a31a-405b-b3a3-6a37a4891322 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:29.050404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-843213a2-a421-400b-94fa-bb52bd3ee936 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:29.051021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-843213a2-a421-400b-94fa-bb52bd3ee936 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:29.060690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-843213a2-a421-400b-94fa-bb52bd3ee936 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:29.061228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-843213a2-a421-400b-94fa-bb52bd3ee936 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:29.061665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-843213a2-a421-400b-94fa-bb52bd3ee936 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:29.062413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-843213a2-a421-400b-94fa-bb52bd3ee936 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:29.062873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-843213a2-a421-400b-94fa-bb52bd3ee936 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:29.063298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-843213a2-a421-400b-94fa-bb52bd3ee936 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:29.124044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-843213a2-a421-400b-94fa-bb52bd3ee936 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:29.124623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-843213a2-a421-400b-94fa-bb52bd3ee936 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:29.125072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-843213a2-a421-400b-94fa-bb52bd3ee936 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:29.125612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-843213a2-a421-400b-94fa-bb52bd3ee936 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lazy-loading 'fault' on Instance uuid 6a8dadd5-90e2-493d-8777-32673ca83a66 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:03:29.143371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2fbffd27-a31a-405b-b3a3-6a37a4891322 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:29.160819 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2fbffd27-a31a-405b-b3a3-6a37a4891322 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1709 microversion: 2.1 time: 0.371844 Aug 29 16:03:29.161931 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3308/6826] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:28 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1709 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:29.204596 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-843213a2-a421-400b-94fa-bb52bd3ee936 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 200 len: 1455 microversion: 2.1 time: 0.161426 Aug 29 16:03:29.205635 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3519/6827] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:29 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:29.294328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-be0e65a0-7b3a-4bbe-87ea-793247c7da39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:29.297839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-be0e65a0-7b3a-4bbe-87ea-793247c7da39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:29.308043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be0e65a0-7b3a-4bbe-87ea-793247c7da39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:29.309591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be0e65a0-7b3a-4bbe-87ea-793247c7da39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:29.310363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be0e65a0-7b3a-4bbe-87ea-793247c7da39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:29.311285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be0e65a0-7b3a-4bbe-87ea-793247c7da39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:29.311963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be0e65a0-7b3a-4bbe-87ea-793247c7da39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:29.312721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be0e65a0-7b3a-4bbe-87ea-793247c7da39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:29.699668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-be0e65a0-7b3a-4bbe-87ea-793247c7da39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320682cfc39d4b1da34a955d0faf966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472eeabd8e4d4ef6b0ca61c054989cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:29.713913 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-be0e65a0-7b3a-4bbe-87ea-793247c7da39 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 200 len: 1314 microversion: 2.1 time: 0.429721 Aug 29 16:03:29.714513 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3309/6828] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:29 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:30.184226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fa27ba34-0860-46e5-b7d3-ce55cab1beb6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:30.185829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fa27ba34-0860-46e5-b7d3-ce55cab1beb6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:30.210723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa27ba34-0860-46e5-b7d3-ce55cab1beb6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:30.210723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa27ba34-0860-46e5-b7d3-ce55cab1beb6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:30.211171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa27ba34-0860-46e5-b7d3-ce55cab1beb6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:30.212252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa27ba34-0860-46e5-b7d3-ce55cab1beb6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:30.212892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa27ba34-0860-46e5-b7d3-ce55cab1beb6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:30.213616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa27ba34-0860-46e5-b7d3-ce55cab1beb6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:30.226093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-81286f95-b94d-494b-a7db-526a00a30ba4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:30.228831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-81286f95-b94d-494b-a7db-526a00a30ba4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] [instance: 6a8dadd5-90e2-493d-8777-32673ca83a66] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:30.256953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81286f95-b94d-494b-a7db-526a00a30ba4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:30.258541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81286f95-b94d-494b-a7db-526a00a30ba4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:30.262938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81286f95-b94d-494b-a7db-526a00a30ba4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:30.263828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81286f95-b94d-494b-a7db-526a00a30ba4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:30.264324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81286f95-b94d-494b-a7db-526a00a30ba4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:30.265774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81286f95-b94d-494b-a7db-526a00a30ba4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:30.297410 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-81286f95-b94d-494b-a7db-526a00a30ba4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] HTTP exception thrown: Instance 6a8dadd5-90e2-493d-8777-32673ca83a66 could not be found. Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-81286f95-b94d-494b-a7db-526a00a30ba4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Request method failure captured: Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 HTTP/1.1 Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOMlYOlu_Bsb9LYSZT_HSNdRalohQVIxNyoJu9cT5UL-G8HMgVFS91AVU3kPmpDaTvtHwxsZDqQ1YWnlQ2JXQWjscUIPFSFtZLqisvXKA5leW_ZXYhAFOmB-DDHGYU_pw4ltL2KI5MRxKF56yTxeYqFaJs9SjssoyQW2jV9SeBRLJVc Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: f7150a6ff711416eb228306eda9a479a Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestServerMultinode-249534412 Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f7150a6ff711416eb228306eda9a479a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f7150a6ff711416eb228306eda9a479a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7150a6ff711416eb228306eda9a479a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7150a6ff711416eb228306eda9a479a"}]}] Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestServerMultinode-249534412 Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: f7150a6ff711416eb228306eda9a479a Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestServerMultinode-249534412 Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestServerMultinode-249534412-project-admin Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 328e2d2b520c4ca9924d91c98d2adfba Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestServerMultinode-249534412-project-admin Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 6a8dadd5-90e2-493d-8777-32673ca83a66 could not be found. Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '6a8dadd5-90e2-493d-8777-32673ca83a66'} Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8dadd5-90e2-493d-8777-32673ca83a66 could not be found. Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8dadd5-90e2-493d-8777-32673ca83a66 could not be found. Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:30.300779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:03:30.307727 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:30.307727 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:30.307727 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:30.307727 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:03:30.307727 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:03:30.307727 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8dadd5-90e2-493d-8777-32673ca83a66 could not be found. Aug 29 16:03:30.307727 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:03:30.307727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-81286f95-b94d-494b-a7db-526a00a30ba4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] Returning 404 to user: Instance 6a8dadd5-90e2-493d-8777-32673ca83a66 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:03:30.309441 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-81286f95-b94d-494b-a7db-526a00a30ba4 tempest-TestServerMultinode-249534412 tempest-TestServerMultinode-249534412-project-admin] 10.222.0.62 "GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66" status: 404 len: 111 microversion: 2.1 time: 0.086627 Aug 29 16:03:30.310717 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3310/6829] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:30 2022] GET /compute/v2.1/servers/6a8dadd5-90e2-493d-8777-32673ca83a66 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:03:30.613792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fa27ba34-0860-46e5-b7d3-ce55cab1beb6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:30.649896 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fa27ba34-0860-46e5-b7d3-ce55cab1beb6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1697 microversion: 2.1 time: 0.467757 Aug 29 16:03:30.651377 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3520/6830] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:30 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1697 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:30.739876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e0dc7338-d006-4e91-a062-0d3dd3ee7413 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:30.740847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e0dc7338-d006-4e91-a062-0d3dd3ee7413 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:30.753967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0dc7338-d006-4e91-a062-0d3dd3ee7413 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:30.754503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0dc7338-d006-4e91-a062-0d3dd3ee7413 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:30.755719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0dc7338-d006-4e91-a062-0d3dd3ee7413 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:30.758337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0dc7338-d006-4e91-a062-0d3dd3ee7413 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:30.760104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0dc7338-d006-4e91-a062-0d3dd3ee7413 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:30.760542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0dc7338-d006-4e91-a062-0d3dd3ee7413 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:31.039059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e0dc7338-d006-4e91-a062-0d3dd3ee7413 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320682cfc39d4b1da34a955d0faf966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472eeabd8e4d4ef6b0ca61c054989cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:31.048323 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e0dc7338-d006-4e91-a062-0d3dd3ee7413 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 200 len: 1314 microversion: 2.1 time: 0.316957 Aug 29 16:03:31.051320 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3311/6831] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:30 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:31.675759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0855a42c-7a58-432f-8aa0-5bf1648afec0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:31.676412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0855a42c-7a58-432f-8aa0-5bf1648afec0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:31.701801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0855a42c-7a58-432f-8aa0-5bf1648afec0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:31.702307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0855a42c-7a58-432f-8aa0-5bf1648afec0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:31.702805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0855a42c-7a58-432f-8aa0-5bf1648afec0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:31.712912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0855a42c-7a58-432f-8aa0-5bf1648afec0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:31.713461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0855a42c-7a58-432f-8aa0-5bf1648afec0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:31.725179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-0be2da98-2c15-462b-8954-bc471287e688 req-77c0d554-dad3-4cf1-9a57-d2862dbc1931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7", "name": "network-vif-plugged", "status": "completed", "tag": "f85c73af-c192-432a-99c2-853313126f07"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:31.725736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0855a42c-7a58-432f-8aa0-5bf1648afec0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:31.778304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0be2da98-2c15-462b-8954-bc471287e688 req-77c0d554-dad3-4cf1-9a57-d2862dbc1931 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:31.791602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0be2da98-2c15-462b-8954-bc471287e688 req-77c0d554-dad3-4cf1-9a57-d2862dbc1931 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:31.794664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0be2da98-2c15-462b-8954-bc471287e688 req-77c0d554-dad3-4cf1-9a57-d2862dbc1931 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:31.829837 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-0be2da98-2c15-462b-8954-bc471287e688 req-77c0d554-dad3-4cf1-9a57-d2862dbc1931 service nova] Creating event network-vif-plugged:f85c73af-c192-432a-99c2-853313126f07 for instance 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 on n-h2-839401-11 Aug 29 16:03:31.844144 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-0be2da98-2c15-462b-8954-bc471287e688 req-77c0d554-dad3-4cf1-9a57-d2862dbc1931 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122601 Aug 29 16:03:31.856006 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3312/6832] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:32.073267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d0b46c61-c236-45d3-8fab-5ebe1b5c5b15 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:32.080981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d0b46c61-c236-45d3-8fab-5ebe1b5c5b15 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:32.095785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0b46c61-c236-45d3-8fab-5ebe1b5c5b15 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:32.097856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0b46c61-c236-45d3-8fab-5ebe1b5c5b15 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:32.098373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0b46c61-c236-45d3-8fab-5ebe1b5c5b15 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:32.101630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0b46c61-c236-45d3-8fab-5ebe1b5c5b15 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:32.105348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0b46c61-c236-45d3-8fab-5ebe1b5c5b15 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:32.106098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0b46c61-c236-45d3-8fab-5ebe1b5c5b15 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:32.134067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0855a42c-7a58-432f-8aa0-5bf1648afec0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:32.145365 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0855a42c-7a58-432f-8aa0-5bf1648afec0 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1697 microversion: 2.1 time: 0.473778 Aug 29 16:03:32.146404 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3521/6833] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:31 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1697 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:32.587056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d0b46c61-c236-45d3-8fab-5ebe1b5c5b15 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320682cfc39d4b1da34a955d0faf966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472eeabd8e4d4ef6b0ca61c054989cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:32.599329 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d0b46c61-c236-45d3-8fab-5ebe1b5c5b15 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 200 len: 1314 microversion: 2.1 time: 0.531943 Aug 29 16:03:32.600301 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3313/6834] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:32 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:33.170143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f372be31-569d-4e4d-a75b-8dd1ec6f3a7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:33.170638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f372be31-569d-4e4d-a75b-8dd1ec6f3a7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:33.192362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f372be31-569d-4e4d-a75b-8dd1ec6f3a7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:33.194693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f372be31-569d-4e4d-a75b-8dd1ec6f3a7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:33.195205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f372be31-569d-4e4d-a75b-8dd1ec6f3a7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:33.196485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f372be31-569d-4e4d-a75b-8dd1ec6f3a7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:33.198037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f372be31-569d-4e4d-a75b-8dd1ec6f3a7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:33.198493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f372be31-569d-4e4d-a75b-8dd1ec6f3a7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:33.528796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f372be31-569d-4e4d-a75b-8dd1ec6f3a7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:33.545737 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f372be31-569d-4e4d-a75b-8dd1ec6f3a7d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1697 microversion: 2.1 time: 0.381322 Aug 29 16:03:33.546840 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3522/6835] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:33 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1697 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:33.620719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-26f98697-0b3a-4eb0-9b4e-d8d24f56d660 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:33.622020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-26f98697-0b3a-4eb0-9b4e-d8d24f56d660 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:33.663288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26f98697-0b3a-4eb0-9b4e-d8d24f56d660 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:33.667646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26f98697-0b3a-4eb0-9b4e-d8d24f56d660 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:33.668364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26f98697-0b3a-4eb0-9b4e-d8d24f56d660 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:33.669344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26f98697-0b3a-4eb0-9b4e-d8d24f56d660 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:33.675141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26f98697-0b3a-4eb0-9b4e-d8d24f56d660 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:33.676059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-26f98697-0b3a-4eb0-9b4e-d8d24f56d660 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:34.285383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-26f98697-0b3a-4eb0-9b4e-d8d24f56d660 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320682cfc39d4b1da34a955d0faf966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472eeabd8e4d4ef6b0ca61c054989cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:34.301521 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-26f98697-0b3a-4eb0-9b4e-d8d24f56d660 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 200 len: 1314 microversion: 2.1 time: 0.683598 Aug 29 16:03:34.321174 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3314/6836] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:33 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:34.380369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-4a2a7c2d-0012-4e85-8b6c-f1bd6b208c8b req-541c6dfc-5384-40a9-9047-504af470a75f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0621e034-0d52-4c6e-86f9-d5a206462089", "name": "network-vif-unplugged", "status": "completed", "tag": "5e1e096b-07af-48e7-962f-6dd88bee3062"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:34.409522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4a2a7c2d-0012-4e85-8b6c-f1bd6b208c8b req-541c6dfc-5384-40a9-9047-504af470a75f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:34.412468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4a2a7c2d-0012-4e85-8b6c-f1bd6b208c8b req-541c6dfc-5384-40a9-9047-504af470a75f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:34.412933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4a2a7c2d-0012-4e85-8b6c-f1bd6b208c8b req-541c6dfc-5384-40a9-9047-504af470a75f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:34.442393 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-4a2a7c2d-0012-4e85-8b6c-f1bd6b208c8b req-541c6dfc-5384-40a9-9047-504af470a75f service nova] Creating event network-vif-unplugged:5e1e096b-07af-48e7-962f-6dd88bee3062 for instance 0621e034-0d52-4c6e-86f9-d5a206462089 on n-h1-839401-11 Aug 29 16:03:34.459413 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-4a2a7c2d-0012-4e85-8b6c-f1bd6b208c8b req-541c6dfc-5384-40a9-9047-504af470a75f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095992 Aug 29 16:03:34.460097 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3523/6837] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:03:34.572819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c8a455f9-1252-40cc-b948-d768c268d76d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:34.576201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c8a455f9-1252-40cc-b948-d768c268d76d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:34.601718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8a455f9-1252-40cc-b948-d768c268d76d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:34.602514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8a455f9-1252-40cc-b948-d768c268d76d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:34.604481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8a455f9-1252-40cc-b948-d768c268d76d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:34.609906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8a455f9-1252-40cc-b948-d768c268d76d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:34.611988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8a455f9-1252-40cc-b948-d768c268d76d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:34.613772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8a455f9-1252-40cc-b948-d768c268d76d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:35.183680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c8a455f9-1252-40cc-b948-d768c268d76d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:35.197802 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c8a455f9-1252-40cc-b948-d768c268d76d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1682 microversion: 2.1 time: 0.630016 Aug 29 16:03:35.198645 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3315/6838] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:34 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1682 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:35.326521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c7a7f54c-80f5-456a-bc82-059107019b03 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:35.327688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c7a7f54c-80f5-456a-bc82-059107019b03 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:35.341970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7a7f54c-80f5-456a-bc82-059107019b03 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:35.343246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7a7f54c-80f5-456a-bc82-059107019b03 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:35.344284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7a7f54c-80f5-456a-bc82-059107019b03 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:35.345272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7a7f54c-80f5-456a-bc82-059107019b03 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:35.345899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7a7f54c-80f5-456a-bc82-059107019b03 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:35.346588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c7a7f54c-80f5-456a-bc82-059107019b03 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:35.710576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c7a7f54c-80f5-456a-bc82-059107019b03 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320682cfc39d4b1da34a955d0faf966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472eeabd8e4d4ef6b0ca61c054989cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:35.719209 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c7a7f54c-80f5-456a-bc82-059107019b03 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 200 len: 1498 microversion: 2.1 time: 0.397449 Aug 29 16:03:35.741600 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3524/6839] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:35 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 1498 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:37.958057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-e46d7871-3a41-486c-b5df-8f8467367d3b req-776dc782-5fba-4166-a4be-2f73f31378a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0621e034-0d52-4c6e-86f9-d5a206462089", "name": "network-vif-plugged", "status": "completed", "tag": "5e1e096b-07af-48e7-962f-6dd88bee3062"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:37.975139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e46d7871-3a41-486c-b5df-8f8467367d3b req-776dc782-5fba-4166-a4be-2f73f31378a1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:37.975847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e46d7871-3a41-486c-b5df-8f8467367d3b req-776dc782-5fba-4166-a4be-2f73f31378a1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:37.976573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e46d7871-3a41-486c-b5df-8f8467367d3b req-776dc782-5fba-4166-a4be-2f73f31378a1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:37.991778 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-e46d7871-3a41-486c-b5df-8f8467367d3b req-776dc782-5fba-4166-a4be-2f73f31378a1 service nova] Creating event network-vif-plugged:5e1e096b-07af-48e7-962f-6dd88bee3062 for instance 0621e034-0d52-4c6e-86f9-d5a206462089 on n-h1-839401-11 Aug 29 16:03:38.006371 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-e46d7871-3a41-486c-b5df-8f8467367d3b req-776dc782-5fba-4166-a4be-2f73f31378a1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051732 Aug 29 16:03:38.008005 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3316/6840] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:40.425451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7e872568-ad52-4588-92e7-5127ddda36ad tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:40.426510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7e872568-ad52-4588-92e7-5127ddda36ad tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:40.434744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e872568-ad52-4588-92e7-5127ddda36ad tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:40.436574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e872568-ad52-4588-92e7-5127ddda36ad tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:40.437675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e872568-ad52-4588-92e7-5127ddda36ad tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:40.440027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e872568-ad52-4588-92e7-5127ddda36ad tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:40.442516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e872568-ad52-4588-92e7-5127ddda36ad tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:40.443139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e872568-ad52-4588-92e7-5127ddda36ad tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:40.481412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7e872568-ad52-4588-92e7-5127ddda36ad tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:03:40.653892 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7e872568-ad52-4588-92e7-5127ddda36ad tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 204 len: 0 microversion: 2.1 time: 0.234731 Aug 29 16:03:40.654832 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3525/6841] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:03:40 2022] DELETE /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:03:40.666756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cb462ba0-8061-4387-8fa4-dccfdc18b0fc tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:40.668133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cb462ba0-8061-4387-8fa4-dccfdc18b0fc tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:40.679270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb462ba0-8061-4387-8fa4-dccfdc18b0fc tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:40.680710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb462ba0-8061-4387-8fa4-dccfdc18b0fc tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:40.681368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb462ba0-8061-4387-8fa4-dccfdc18b0fc tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:40.682957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb462ba0-8061-4387-8fa4-dccfdc18b0fc tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:40.683624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb462ba0-8061-4387-8fa4-dccfdc18b0fc tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:40.684226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb462ba0-8061-4387-8fa4-dccfdc18b0fc tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:40.940920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cb462ba0-8061-4387-8fa4-dccfdc18b0fc tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320682cfc39d4b1da34a955d0faf966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472eeabd8e4d4ef6b0ca61c054989cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:40.952171 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cb462ba0-8061-4387-8fa4-dccfdc18b0fc tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 200 len: 1504 microversion: 2.1 time: 0.291592 Aug 29 16:03:40.953572 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3317/6842] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:40 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 1504 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:41.999502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-089cf4db-ff42-4736-b38a-5b63892124db tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:42.000971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-089cf4db-ff42-4736-b38a-5b63892124db tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:42.011662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:42.048353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-089cf4db-ff42-4736-b38a-5b63892124db tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:42.049332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-089cf4db-ff42-4736-b38a-5b63892124db tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:42.052212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-089cf4db-ff42-4736-b38a-5b63892124db tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:42.053575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-089cf4db-ff42-4736-b38a-5b63892124db tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:42.054265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-089cf4db-ff42-4736-b38a-5b63892124db tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:42.054918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-089cf4db-ff42-4736-b38a-5b63892124db tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:42.419335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-089cf4db-ff42-4736-b38a-5b63892124db tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320682cfc39d4b1da34a955d0faf966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472eeabd8e4d4ef6b0ca61c054989cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:42.427990 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-089cf4db-ff42-4736-b38a-5b63892124db tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 200 len: 1504 microversion: 2.1 time: 0.454180 Aug 29 16:03:42.428600 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3526/6843] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:41 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 1504 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:43.449983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-93ad52bf-cb57-4ce4-96a8-0a16580145a9 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:43.451165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-93ad52bf-cb57-4ce4-96a8-0a16580145a9 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:43.464365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93ad52bf-cb57-4ce4-96a8-0a16580145a9 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:43.465315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93ad52bf-cb57-4ce4-96a8-0a16580145a9 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:43.466035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93ad52bf-cb57-4ce4-96a8-0a16580145a9 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:43.467024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93ad52bf-cb57-4ce4-96a8-0a16580145a9 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:43.467727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93ad52bf-cb57-4ce4-96a8-0a16580145a9 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:43.468461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93ad52bf-cb57-4ce4-96a8-0a16580145a9 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:44.243953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a39445e3-f339-4f67-b4ea-14b6f407eeed req-577cccfe-7488-415b-9602-afc436969c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7", "name": "network-vif-deleted", "tag": "f85c73af-c192-432a-99c2-853313126f07"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:44.263287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a39445e3-f339-4f67-b4ea-14b6f407eeed req-577cccfe-7488-415b-9602-afc436969c59 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:44.263776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a39445e3-f339-4f67-b4ea-14b6f407eeed req-577cccfe-7488-415b-9602-afc436969c59 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:44.264431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a39445e3-f339-4f67-b4ea-14b6f407eeed req-577cccfe-7488-415b-9602-afc436969c59 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:44.305978 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a39445e3-f339-4f67-b4ea-14b6f407eeed req-577cccfe-7488-415b-9602-afc436969c59 service nova] Creating event network-vif-deleted:f85c73af-c192-432a-99c2-853313126f07 for instance 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 on n-h2-839401-11 Aug 29 16:03:44.312923 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a39445e3-f339-4f67-b4ea-14b6f407eeed req-577cccfe-7488-415b-9602-afc436969c59 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075696 Aug 29 16:03:44.314555 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3527/6844] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:03:44.387173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-93ad52bf-cb57-4ce4-96a8-0a16580145a9 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '320682cfc39d4b1da34a955d0faf966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472eeabd8e4d4ef6b0ca61c054989cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:44.401359 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-93ad52bf-cb57-4ce4-96a8-0a16580145a9 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 200 len: 1504 microversion: 2.1 time: 0.955768 Aug 29 16:03:44.402482 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3318/6845] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:43 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 1504 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:45.429327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-21202b06-a51d-4b06-a76a-3438a5957266 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:45.434101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-21202b06-a51d-4b06-a76a-3438a5957266 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] [instance: 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:45.459494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21202b06-a51d-4b06-a76a-3438a5957266 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:45.461755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21202b06-a51d-4b06-a76a-3438a5957266 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:45.462288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21202b06-a51d-4b06-a76a-3438a5957266 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:45.463090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21202b06-a51d-4b06-a76a-3438a5957266 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:45.463561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21202b06-a51d-4b06-a76a-3438a5957266 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:45.465226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21202b06-a51d-4b06-a76a-3438a5957266 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:45.491781 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-21202b06-a51d-4b06-a76a-3438a5957266 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] HTTP exception thrown: Instance 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 could not be found. Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-21202b06-a51d-4b06-a76a-3438a5957266 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Request method failure captured: Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 HTTP/1.1 Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDONC6ii84BYhbZmYEMUcwkAzU4aLY2LgZ9bb3UxoCviiLS5tSxrA7-zQ3nA08pO_HJ352u50lFhxDI2ZOkP1u0NXNK4KegCsp5oHv_Pnmi1sFeb6cXz6k6qkSeG5MAJZYmt9OEcOh8-llSjlLrbAzb5sXuB7KoFmPccB3kizvWY-s_o Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 472eeabd8e4d4ef6b0ca61c054989cce Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-VolumesActionsTest-644732224 Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_472eeabd8e4d4ef6b0ca61c054989cce", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/472eeabd8e4d4ef6b0ca61c054989cce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/472eeabd8e4d4ef6b0ca61c054989cce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/472eeabd8e4d4ef6b0ca61c054989cce"}]}] Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-VolumesActionsTest-644732224 Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 472eeabd8e4d4ef6b0ca61c054989cce Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-VolumesActionsTest-644732224 Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-VolumesActionsTest-644732224-project Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 320682cfc39d4b1da34a955d0faf966e Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-VolumesActionsTest-644732224-project Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 could not be found. Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7'} Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 could not be found. Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 could not be found. Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:45.494000 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:45.499119 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:45.499119 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:45.499119 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:45.499119 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:03:45.499119 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:03:45.499119 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 could not be found. Aug 29 16:03:45.499119 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:45.499119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-21202b06-a51d-4b06-a76a-3438a5957266 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] Returning 404 to user: Instance 4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:03:45.499119 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-21202b06-a51d-4b06-a76a-3438a5957266 tempest-VolumesActionsTest-644732224 tempest-VolumesActionsTest-644732224-project] 10.222.0.62 "GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7" status: 404 len: 111 microversion: 2.1 time: 0.076641 Aug 29 16:03:45.499119 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3528/6846] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:45 2022] GET /compute/v2.1/servers/4ef7c53c-f30d-467a-b635-8c2c6ac6e3e7 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:03:52.138206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-868f075d-4dad-45c5-9b61-6d8e7e986df6 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:52.138742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-868f075d-4dad-45c5-9b61-6d8e7e986df6 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:52.141104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:52.156479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-868f075d-4dad-45c5-9b61-6d8e7e986df6 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:52.157030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-868f075d-4dad-45c5-9b61-6d8e7e986df6 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:52.159674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-868f075d-4dad-45c5-9b61-6d8e7e986df6 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:52.167820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-868f075d-4dad-45c5-9b61-6d8e7e986df6 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:52.168613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-868f075d-4dad-45c5-9b61-6d8e7e986df6 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:52.169441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-868f075d-4dad-45c5-9b61-6d8e7e986df6 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:52.233060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-868f075d-4dad-45c5-9b61-6d8e7e986df6 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:03:52.431483 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-868f075d-4dad-45c5-9b61-6d8e7e986df6 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 204 len: 0 microversion: 2.1 time: 0.845822 Aug 29 16:03:52.435059 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3319/6847] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:03:51 2022] DELETE /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:03:52.442311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-780db47b-b155-4101-ba5d-4930a539010d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:52.443023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-780db47b-b155-4101-ba5d-4930a539010d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:52.454626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-780db47b-b155-4101-ba5d-4930a539010d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:52.458506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-780db47b-b155-4101-ba5d-4930a539010d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:52.459049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-780db47b-b155-4101-ba5d-4930a539010d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:52.461213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-780db47b-b155-4101-ba5d-4930a539010d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:52.461779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-780db47b-b155-4101-ba5d-4930a539010d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:52.464568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-780db47b-b155-4101-ba5d-4930a539010d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:52.813201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-780db47b-b155-4101-ba5d-4930a539010d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:52.822135 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-780db47b-b155-4101-ba5d-4930a539010d tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1729 microversion: 2.1 time: 0.385526 Aug 29 16:03:52.822733 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3529/6848] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:52 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1729 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:53.849016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ff3cd366-a436-4f3e-b8d6-63165dfdfe3a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:53.850638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ff3cd366-a436-4f3e-b8d6-63165dfdfe3a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:53.865752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff3cd366-a436-4f3e-b8d6-63165dfdfe3a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:53.866284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff3cd366-a436-4f3e-b8d6-63165dfdfe3a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:53.866734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff3cd366-a436-4f3e-b8d6-63165dfdfe3a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:53.867617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff3cd366-a436-4f3e-b8d6-63165dfdfe3a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:53.868101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff3cd366-a436-4f3e-b8d6-63165dfdfe3a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:53.868566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff3cd366-a436-4f3e-b8d6-63165dfdfe3a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:54.182460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ff3cd366-a436-4f3e-b8d6-63165dfdfe3a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:54.193443 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ff3cd366-a436-4f3e-b8d6-63165dfdfe3a tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1729 microversion: 2.1 time: 0.350279 Aug 29 16:03:54.194937 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3320/6849] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:53 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1729 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:54.889503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-52e7d6f5-b3c6-4456-bb2c-92310608815d req-e74ccd73-9369-4315-8d73-09d890da93a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046", "name": "network-vif-deleted", "tag": "6234a08d-953c-411e-a4f9-341264f6d2d6"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:54.910310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-52e7d6f5-b3c6-4456-bb2c-92310608815d req-e74ccd73-9369-4315-8d73-09d890da93a9 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:54.913753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-52e7d6f5-b3c6-4456-bb2c-92310608815d req-e74ccd73-9369-4315-8d73-09d890da93a9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:54.950634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-52e7d6f5-b3c6-4456-bb2c-92310608815d req-e74ccd73-9369-4315-8d73-09d890da93a9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:54.966027 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-52e7d6f5-b3c6-4456-bb2c-92310608815d req-e74ccd73-9369-4315-8d73-09d890da93a9 service nova] Creating event network-vif-deleted:6234a08d-953c-411e-a4f9-341264f6d2d6 for instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 on n-h1-839401-11 Aug 29 16:03:54.971352 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-52e7d6f5-b3c6-4456-bb2c-92310608815d req-e74ccd73-9369-4315-8d73-09d890da93a9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085850 Aug 29 16:03:54.972751 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3530/6850] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:03:55.216872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b28f98f7-ab1f-4b39-8d71-f631c5c50da9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:55.218238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b28f98f7-ab1f-4b39-8d71-f631c5c50da9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:55.246198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b28f98f7-ab1f-4b39-8d71-f631c5c50da9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:55.246931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b28f98f7-ab1f-4b39-8d71-f631c5c50da9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:55.248840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b28f98f7-ab1f-4b39-8d71-f631c5c50da9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:55.250218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b28f98f7-ab1f-4b39-8d71-f631c5c50da9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:55.254748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b28f98f7-ab1f-4b39-8d71-f631c5c50da9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:55.255413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b28f98f7-ab1f-4b39-8d71-f631c5c50da9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:55.287697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8de6ad39-506e-4aa3-9f16-0c9bc17738d0 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Action: 'create', calling method: .version_select at 0x7fc42aaf3d30>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-250083554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzFfi7JJMSroq2FSHIiEiyUTDMcX4M23dYY4hgNWE4BJ6eF66ohPv+KWusbnE2SnQaIJbGNlAz7bgildAmSTM0LWr5kd7zh4GvQN6KzaBwnW/XZ+jz23glf68EV8Q7VCQ=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:55.317666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-8de6ad39-506e-4aa3-9f16-0c9bc17738d0 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Getting quotas for project fdc319a3a94e4f73a4d9bfba0621f0f8. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:03:55.345810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-8de6ad39-506e-4aa3-9f16-0c9bc17738d0 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Getting quotas for user 8c817bb696f143adaa7cec391316c043 and project fdc319a3a94e4f73a4d9bfba0621f0f8. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:03:55.360523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b28f98f7-ab1f-4b39-8d71-f631c5c50da9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:55.361218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b28f98f7-ab1f-4b39-8d71-f631c5c50da9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:55.361817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b28f98f7-ab1f-4b39-8d71-f631c5c50da9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:55.362466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-b28f98f7-ab1f-4b39-8d71-f631c5c50da9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lazy-loading 'fault' on Instance uuid bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:03:55.414559 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8de6ad39-506e-4aa3-9f16-0c9bc17738d0 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.145079 Aug 29 16:03:55.415969 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3531/6851] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:03:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:55.424063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b28f98f7-ab1f-4b39-8d71-f631c5c50da9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489ffbc279344b7f9b529123421ec65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd302c16ed87f40e7a586c8240f2dcd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:55.437548 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b28f98f7-ab1f-4b39-8d71-f631c5c50da9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 200 len: 1386 microversion: 2.1 time: 0.225372 Aug 29 16:03:55.438298 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3321/6852] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:55 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 1386 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:56.474418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a6e3e746-7625-4d51-ad6e-d8afe0e70ffe tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:56.476080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a6e3e746-7625-4d51-ad6e-d8afe0e70ffe tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:56.488073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6e3e746-7625-4d51-ad6e-d8afe0e70ffe tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:56.489166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6e3e746-7625-4d51-ad6e-d8afe0e70ffe tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:56.490985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6e3e746-7625-4d51-ad6e-d8afe0e70ffe tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:56.492088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6e3e746-7625-4d51-ad6e-d8afe0e70ffe tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:56.493564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6e3e746-7625-4d51-ad6e-d8afe0e70ffe tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:56.494200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6e3e746-7625-4d51-ad6e-d8afe0e70ffe tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:56.518765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:56.520903 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-a6e3e746-7625-4d51-ad6e-d8afe0e70ffe tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] HTTP exception thrown: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a6e3e746-7625-4d51-ad6e-d8afe0e70ffe tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Request method failure captured: Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 HTTP/1.1 Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOIGySR83i32TH-uCkJU8tpXQY9iWuK4UNjgcGyLdjHNTcLr7mpOrlIowOwkvnqJk_P9pFnKyXP4Bfv5kJSFfNnUDm_dzyOdwqbusychkbCuDIm0fkexMbjuQhkc0pQX0m82qH3sUogajk-QL7UfpObGUIoJ4WaBfU3kNlgSrIPcS9k Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d302c16ed87f40e7a586c8240f2dcd28 Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestServerBasicOps-1882468853 Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d302c16ed87f40e7a586c8240f2dcd28", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d302c16ed87f40e7a586c8240f2dcd28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d302c16ed87f40e7a586c8240f2dcd28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d302c16ed87f40e7a586c8240f2dcd28"}]}] Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestServerBasicOps-1882468853 Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d302c16ed87f40e7a586c8240f2dcd28 Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestServerBasicOps-1882468853 Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestServerBasicOps-1882468853-project Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 489ffbc279344b7f9b529123421ec65d Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestServerBasicOps-1882468853-project Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046'} Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:56.524790 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:56.529461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:56.529461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:56.529461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:56.529461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:03:56.529461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:03:56.529461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. Aug 29 16:03:56.529461 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:56.529461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a6e3e746-7625-4d51-ad6e-d8afe0e70ffe tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Returning 404 to user: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:03:56.529461 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a6e3e746-7625-4d51-ad6e-d8afe0e70ffe tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 404 len: 111 microversion: 2.1 time: 0.073833 Aug 29 16:03:56.534928 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3532/6853] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:56 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:03:57.318986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d6f1c9a0-a65b-4cb0-b35a-30d52f4217e9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:57.319493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d6f1c9a0-a65b-4cb0-b35a-30d52f4217e9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:57.326795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6f1c9a0-a65b-4cb0-b35a-30d52f4217e9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:57.327295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6f1c9a0-a65b-4cb0-b35a-30d52f4217e9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:57.327768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6f1c9a0-a65b-4cb0-b35a-30d52f4217e9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:57.328479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6f1c9a0-a65b-4cb0-b35a-30d52f4217e9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:57.329504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6f1c9a0-a65b-4cb0-b35a-30d52f4217e9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:57.330407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6f1c9a0-a65b-4cb0-b35a-30d52f4217e9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:57.349999 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-d6f1c9a0-a65b-4cb0-b35a-30d52f4217e9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] HTTP exception thrown: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d6f1c9a0-a65b-4cb0-b35a-30d52f4217e9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Request method failure captured: Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 HTTP/1.1 Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOIGySR83i32TH-uCkJU8tpXQY9iWuK4UNjgcGyLdjHNTcLr7mpOrlIowOwkvnqJk_P9pFnKyXP4Bfv5kJSFfNnUDm_dzyOdwqbusychkbCuDIm0fkexMbjuQhkc0pQX0m82qH3sUogajk-QL7UfpObGUIoJ4WaBfU3kNlgSrIPcS9k Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: d302c16ed87f40e7a586c8240f2dcd28 Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestServerBasicOps-1882468853 Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d302c16ed87f40e7a586c8240f2dcd28", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d302c16ed87f40e7a586c8240f2dcd28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d302c16ed87f40e7a586c8240f2dcd28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d302c16ed87f40e7a586c8240f2dcd28"}]}] Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestServerBasicOps-1882468853 Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: d302c16ed87f40e7a586c8240f2dcd28 Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestServerBasicOps-1882468853 Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestServerBasicOps-1882468853-project Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 489ffbc279344b7f9b529123421ec65d Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestServerBasicOps-1882468853-project Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046'} Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:03:57.352817 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:03:57.356478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. Aug 29 16:03:57.356478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:03:57.356478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:57.356478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:03:57.356478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:57.356478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:57.356478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:57.356478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:03:57.356478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:03:57.356478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. Aug 29 16:03:57.356478 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:03:57.358311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d6f1c9a0-a65b-4cb0-b35a-30d52f4217e9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Returning 404 to user: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:03:57.359268 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d6f1c9a0-a65b-4cb0-b35a-30d52f4217e9 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 404 len: 111 microversion: 2.1 time: 0.044398 Aug 29 16:03:57.359875 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3322/6854] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:03:57 2022] DELETE /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:03:57.370671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-625239a6-31b3-45d2-b462-27b58bdfdbce tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:57.371803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-625239a6-31b3-45d2-b462-27b58bdfdbce tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] [instance: bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:57.382127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-625239a6-31b3-45d2-b462-27b58bdfdbce tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:57.384799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-625239a6-31b3-45d2-b462-27b58bdfdbce tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:57.385364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-625239a6-31b3-45d2-b462-27b58bdfdbce tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:57.386355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-625239a6-31b3-45d2-b462-27b58bdfdbce tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:57.387028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-625239a6-31b3-45d2-b462-27b58bdfdbce tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:57.387521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-625239a6-31b3-45d2-b462-27b58bdfdbce tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:57.409778 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-625239a6-31b3-45d2-b462-27b58bdfdbce tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] HTTP exception thrown: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-625239a6-31b3-45d2-b462-27b58bdfdbce tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Request method failure captured: Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 HTTP/1.1 Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOIGySR83i32TH-uCkJU8tpXQY9iWuK4UNjgcGyLdjHNTcLr7mpOrlIowOwkvnqJk_P9pFnKyXP4Bfv5kJSFfNnUDm_dzyOdwqbusychkbCuDIm0fkexMbjuQhkc0pQX0m82qH3sUogajk-QL7UfpObGUIoJ4WaBfU3kNlgSrIPcS9k Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: d302c16ed87f40e7a586c8240f2dcd28 Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestServerBasicOps-1882468853 Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d302c16ed87f40e7a586c8240f2dcd28", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d302c16ed87f40e7a586c8240f2dcd28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d302c16ed87f40e7a586c8240f2dcd28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d302c16ed87f40e7a586c8240f2dcd28"}]}] Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestServerBasicOps-1882468853 Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: d302c16ed87f40e7a586c8240f2dcd28 Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestServerBasicOps-1882468853 Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestServerBasicOps-1882468853-project Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 489ffbc279344b7f9b529123421ec65d Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestServerBasicOps-1882468853-project Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046'} Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:57.411377 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:57.415034 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:57.415034 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:57.415034 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:57.415034 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:03:57.415034 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:03:57.415034 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. Aug 29 16:03:57.415034 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:03:57.415034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-625239a6-31b3-45d2-b462-27b58bdfdbce tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Returning 404 to user: Instance bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:03:57.415034 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-625239a6-31b3-45d2-b462-27b58bdfdbce tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046" status: 404 len: 111 microversion: 2.1 time: 0.048141 Aug 29 16:03:57.415034 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3533/6855] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:57 2022] GET /compute/v2.1/servers/bf8e33ed-9b6f-4bed-9b46-bfbc58ff2046 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:03:57.705401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d87e2e6c-ddd2-4a31-83d4-f76ac7bc7b14 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] Calling method '.version_select at 0x7fc42a41bca0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:57.729150 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d87e2e6c-ddd2-4a31-83d4-f76ac7bc7b14 tempest-TestServerBasicOps-1882468853 tempest-TestServerBasicOps-1882468853-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-58147319" status: 202 len: 0 microversion: 2.1 time: 0.027517 Aug 29 16:03:57.734426 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3323/6856] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 16:03:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-58147319 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:03:58.100820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1521103854", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8e117265-3647-4937-9dd7-cb9a671c5368", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-250083554", "security_groups": [{"name": "tempest-secgroup-smoke-1660124420"}], "networks": [{"uuid": "4060a79d-f12b-4350-a379-a46aca888a40"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:58.361594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] validate_networks() for [('4060a79d-f12b-4350-a379-a46aca888a40', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:03:59.781289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:03:59.782723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:03:59.783450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:03:59.784197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:03:59.785235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:03:59.811321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:59.812091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:59.813009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:59.813973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:59.814785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:59.815431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:59.861482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Getting quotas for project fdc319a3a94e4f73a4d9bfba0621f0f8. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:03:59.875223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Getting quotas for user 8c817bb696f143adaa7cec391316c043 and project fdc319a3a94e4f73a4d9bfba0621f0f8. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:04:00.023992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:04:00.026342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e117265-3647-4937-9dd7-cb9a671c5368',volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:04:00.260653 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-412e501d-e416-4ea9-b0cd-21f1881c5e72 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.163898 Aug 29 16:04:00.261543 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3534/6857] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:03:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 2166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:04:00.272630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-84180a1e-6668-48db-b42d-da73e4364592 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:00.274021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-84180a1e-6668-48db-b42d-da73e4364592 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:00.400090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-84180a1e-6668-48db-b42d-da73e4364592 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:00.408964 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-84180a1e-6668-48db-b42d-da73e4364592 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1098 microversion: 2.1 time: 0.140089 Aug 29 16:04:00.442365 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3324/6858] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:00 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1098 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:01.432003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-601e18b7-04b5-4487-860e-c5a9bdc32c2f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:01.432792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-601e18b7-04b5-4487-860e-c5a9bdc32c2f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:01.460694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-601e18b7-04b5-4487-860e-c5a9bdc32c2f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:01.462472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-601e18b7-04b5-4487-860e-c5a9bdc32c2f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:01.463001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-601e18b7-04b5-4487-860e-c5a9bdc32c2f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:01.465229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-601e18b7-04b5-4487-860e-c5a9bdc32c2f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:01.465921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-601e18b7-04b5-4487-860e-c5a9bdc32c2f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:01.471176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-601e18b7-04b5-4487-860e-c5a9bdc32c2f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:01.666361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-601e18b7-04b5-4487-860e-c5a9bdc32c2f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:01.689937 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-601e18b7-04b5-4487-860e-c5a9bdc32c2f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1196 microversion: 2.1 time: 0.263864 Aug 29 16:04:01.692462 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3535/6859] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:01 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1196 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:02.712076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-959b7f78-ffd0-43ee-8220-05680360da5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:02.712925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-959b7f78-ffd0-43ee-8220-05680360da5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:02.728647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-959b7f78-ffd0-43ee-8220-05680360da5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:02.729394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-959b7f78-ffd0-43ee-8220-05680360da5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:02.732358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-959b7f78-ffd0-43ee-8220-05680360da5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:02.733396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-959b7f78-ffd0-43ee-8220-05680360da5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:02.736085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-959b7f78-ffd0-43ee-8220-05680360da5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:02.736852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-959b7f78-ffd0-43ee-8220-05680360da5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:02.804850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:02.970040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-959b7f78-ffd0-43ee-8220-05680360da5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:02.981673 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-959b7f78-ffd0-43ee-8220-05680360da5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1214 microversion: 2.1 time: 0.270024 Aug 29 16:04:02.982829 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3325/6860] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:02 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1214 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:04.003349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a3ab524-7a9a-4c24-9a5c-f0dd7d2df2aa tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:04.004684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9a3ab524-7a9a-4c24-9a5c-f0dd7d2df2aa tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:04.015951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a3ab524-7a9a-4c24-9a5c-f0dd7d2df2aa tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:04.018875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a3ab524-7a9a-4c24-9a5c-f0dd7d2df2aa tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:04.024100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a3ab524-7a9a-4c24-9a5c-f0dd7d2df2aa tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:04.027050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a3ab524-7a9a-4c24-9a5c-f0dd7d2df2aa tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:04.028555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a3ab524-7a9a-4c24-9a5c-f0dd7d2df2aa tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:04.031180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a3ab524-7a9a-4c24-9a5c-f0dd7d2df2aa tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:04.188652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9a3ab524-7a9a-4c24-9a5c-f0dd7d2df2aa tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:04.200325 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a3ab524-7a9a-4c24-9a5c-f0dd7d2df2aa tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1214 microversion: 2.1 time: 0.199088 Aug 29 16:04:04.202609 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3536/6861] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:03 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:05.227145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-07be3aaf-15ea-44f6-8c53-bb10dc50a2f2 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:05.228683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-07be3aaf-15ea-44f6-8c53-bb10dc50a2f2 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:05.248425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07be3aaf-15ea-44f6-8c53-bb10dc50a2f2 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:05.249820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07be3aaf-15ea-44f6-8c53-bb10dc50a2f2 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:05.251387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07be3aaf-15ea-44f6-8c53-bb10dc50a2f2 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:05.253606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07be3aaf-15ea-44f6-8c53-bb10dc50a2f2 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:05.254383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07be3aaf-15ea-44f6-8c53-bb10dc50a2f2 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:05.256181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07be3aaf-15ea-44f6-8c53-bb10dc50a2f2 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:05.670795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-07be3aaf-15ea-44f6-8c53-bb10dc50a2f2 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:05.679185 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-07be3aaf-15ea-44f6-8c53-bb10dc50a2f2 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1282 microversion: 2.1 time: 0.459977 Aug 29 16:04:05.682654 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3326/6862] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:05 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1282 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:06.710442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0cc5d8da-d6ba-4d37-afb0-1c51ceaf116c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:06.712064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0cc5d8da-d6ba-4d37-afb0-1c51ceaf116c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:06.720205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cc5d8da-d6ba-4d37-afb0-1c51ceaf116c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:06.720895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cc5d8da-d6ba-4d37-afb0-1c51ceaf116c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:06.721518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cc5d8da-d6ba-4d37-afb0-1c51ceaf116c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:06.722425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cc5d8da-d6ba-4d37-afb0-1c51ceaf116c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:06.723048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cc5d8da-d6ba-4d37-afb0-1c51ceaf116c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:06.723637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cc5d8da-d6ba-4d37-afb0-1c51ceaf116c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:06.954691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0cc5d8da-d6ba-4d37-afb0-1c51ceaf116c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:06.969035 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0cc5d8da-d6ba-4d37-afb0-1c51ceaf116c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1282 microversion: 2.1 time: 0.262305 Aug 29 16:04:06.982800 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3537/6863] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:06 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1282 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:07.856374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-14818e3f-3a5b-4632-9db8-c89d1235666b req-ef7d71d8-27c7-4eb5-a3df-7deeaa93ea38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b53b88b-76ce-4b10-9c56-d2bb3fb80e44", "tag": "8437568f-cbe3-4a08-a0b0-51d7e443a4e8"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:07.872616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-14818e3f-3a5b-4632-9db8-c89d1235666b req-ef7d71d8-27c7-4eb5-a3df-7deeaa93ea38 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:07.873399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-14818e3f-3a5b-4632-9db8-c89d1235666b req-ef7d71d8-27c7-4eb5-a3df-7deeaa93ea38 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:07.874003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-14818e3f-3a5b-4632-9db8-c89d1235666b req-ef7d71d8-27c7-4eb5-a3df-7deeaa93ea38 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:07.903961 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-14818e3f-3a5b-4632-9db8-c89d1235666b req-ef7d71d8-27c7-4eb5-a3df-7deeaa93ea38 service nova] Creating event network-changed:8437568f-cbe3-4a08-a0b0-51d7e443a4e8 for instance 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 on n-h2-839401-11 Aug 29 16:04:07.911679 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-14818e3f-3a5b-4632-9db8-c89d1235666b req-ef7d71d8-27c7-4eb5-a3df-7deeaa93ea38 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070365 Aug 29 16:04:07.913442 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3327/6864] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:07.990266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d39be25e-737e-4b58-a6bb-f31878386de7 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:07.990858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d39be25e-737e-4b58-a6bb-f31878386de7 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:08.007106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d39be25e-737e-4b58-a6bb-f31878386de7 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:08.007985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d39be25e-737e-4b58-a6bb-f31878386de7 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:08.008431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d39be25e-737e-4b58-a6bb-f31878386de7 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:08.009198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d39be25e-737e-4b58-a6bb-f31878386de7 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:08.009723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d39be25e-737e-4b58-a6bb-f31878386de7 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:08.010678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d39be25e-737e-4b58-a6bb-f31878386de7 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:08.393723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d39be25e-737e-4b58-a6bb-f31878386de7 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:08.403907 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d39be25e-737e-4b58-a6bb-f31878386de7 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1282 microversion: 2.1 time: 0.417575 Aug 29 16:04:08.419116 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3538/6865] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:07 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1282 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:09.429652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-605657d1-e409-41dd-9118-335a4aa34253 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:09.432126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-605657d1-e409-41dd-9118-335a4aa34253 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:09.451238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605657d1-e409-41dd-9118-335a4aa34253 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:09.456592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605657d1-e409-41dd-9118-335a4aa34253 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:09.457153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605657d1-e409-41dd-9118-335a4aa34253 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:09.459859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605657d1-e409-41dd-9118-335a4aa34253 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:09.462715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605657d1-e409-41dd-9118-335a4aa34253 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:09.464126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-605657d1-e409-41dd-9118-335a4aa34253 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:09.575698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c934b1c8-8424-41f3-b0e6-71aeca6b4df4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:09.578114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c934b1c8-8424-41f3-b0e6-71aeca6b4df4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:09.596086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c934b1c8-8424-41f3-b0e6-71aeca6b4df4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:09.596596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c934b1c8-8424-41f3-b0e6-71aeca6b4df4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:09.597037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c934b1c8-8424-41f3-b0e6-71aeca6b4df4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:09.597778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c934b1c8-8424-41f3-b0e6-71aeca6b4df4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:09.598233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c934b1c8-8424-41f3-b0e6-71aeca6b4df4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:09.598712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c934b1c8-8424-41f3-b0e6-71aeca6b4df4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:09.697997 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c934b1c8-8424-41f3-b0e6-71aeca6b4df4 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "POST /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089/action" status: 200 len: 24571 microversion: 2.1 time: 0.126080 Aug 29 16:04:09.705640 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3539/6866] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:04:09 2022] POST /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089/action => generated 24571 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 16:04:09.967802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-605657d1-e409-41dd-9118-335a4aa34253 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:09.987288 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-605657d1-e409-41dd-9118-335a4aa34253 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1282 microversion: 2.1 time: 0.566839 Aug 29 16:04:09.988207 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3328/6867] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:09 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1282 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:11.014600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-97730f0f-853f-421c-8ce2-aca7a4069b5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:11.015959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-97730f0f-853f-421c-8ce2-aca7a4069b5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:11.018715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:11.026102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=10 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:11.043409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97730f0f-853f-421c-8ce2-aca7a4069b5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:11.043896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97730f0f-853f-421c-8ce2-aca7a4069b5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:11.044336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97730f0f-853f-421c-8ce2-aca7a4069b5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:11.045053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97730f0f-853f-421c-8ce2-aca7a4069b5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:11.072968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97730f0f-853f-421c-8ce2-aca7a4069b5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:11.073467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97730f0f-853f-421c-8ce2-aca7a4069b5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:11.565238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-97730f0f-853f-421c-8ce2-aca7a4069b5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:11.573420 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-97730f0f-853f-421c-8ce2-aca7a4069b5d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1282 microversion: 2.1 time: 0.564196 Aug 29 16:04:11.591659 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3540/6868] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:11 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1282 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:12.599193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d50f6b60-2586-4649-886d-781c04087a8b tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:12.599798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d50f6b60-2586-4649-886d-781c04087a8b tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:12.603048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:12.607875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50f6b60-2586-4649-886d-781c04087a8b tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:12.614561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50f6b60-2586-4649-886d-781c04087a8b tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:12.624447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50f6b60-2586-4649-886d-781c04087a8b tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:12.625533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50f6b60-2586-4649-886d-781c04087a8b tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:12.626173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50f6b60-2586-4649-886d-781c04087a8b tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:12.626791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50f6b60-2586-4649-886d-781c04087a8b tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:13.060789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d50f6b60-2586-4649-886d-781c04087a8b tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:13.072391 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d50f6b60-2586-4649-886d-781c04087a8b tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1270 microversion: 2.1 time: 0.477009 Aug 29 16:04:13.073251 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3329/6869] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:12 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1270 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:04:14.101172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8603dd77-8884-4ba8-84a6-effa380e3b2e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:14.104224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8603dd77-8884-4ba8-84a6-effa380e3b2e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:14.115699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:14.127495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8603dd77-8884-4ba8-84a6-effa380e3b2e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:14.128361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8603dd77-8884-4ba8-84a6-effa380e3b2e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:14.128983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8603dd77-8884-4ba8-84a6-effa380e3b2e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:14.130395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8603dd77-8884-4ba8-84a6-effa380e3b2e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:14.131035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8603dd77-8884-4ba8-84a6-effa380e3b2e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:14.132334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8603dd77-8884-4ba8-84a6-effa380e3b2e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:14.484539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8603dd77-8884-4ba8-84a6-effa380e3b2e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:14.509940 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8603dd77-8884-4ba8-84a6-effa380e3b2e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1270 microversion: 2.1 time: 0.413912 Aug 29 16:04:14.511359 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3541/6870] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:14 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1270 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:15.531491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-040d1d98-82d2-48df-9766-66b9beca220d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:15.532664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-040d1d98-82d2-48df-9766-66b9beca220d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:15.540561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-040d1d98-82d2-48df-9766-66b9beca220d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:15.541427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-040d1d98-82d2-48df-9766-66b9beca220d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:15.542031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-040d1d98-82d2-48df-9766-66b9beca220d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:15.542910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-040d1d98-82d2-48df-9766-66b9beca220d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:15.543527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-040d1d98-82d2-48df-9766-66b9beca220d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:15.544121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-040d1d98-82d2-48df-9766-66b9beca220d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:15.726394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-040d1d98-82d2-48df-9766-66b9beca220d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:15.736091 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-040d1d98-82d2-48df-9766-66b9beca220d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1270 microversion: 2.1 time: 0.208492 Aug 29 16:04:15.740244 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3330/6871] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:15 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1270 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:16.762437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-280ee6bc-eda8-4d9c-80f8-6c2c0d74c21a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:16.764292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-280ee6bc-eda8-4d9c-80f8-6c2c0d74c21a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:16.784222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-280ee6bc-eda8-4d9c-80f8-6c2c0d74c21a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:16.785626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-280ee6bc-eda8-4d9c-80f8-6c2c0d74c21a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:16.787656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-280ee6bc-eda8-4d9c-80f8-6c2c0d74c21a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:16.789132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-280ee6bc-eda8-4d9c-80f8-6c2c0d74c21a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:16.790269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-280ee6bc-eda8-4d9c-80f8-6c2c0d74c21a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:16.791682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-280ee6bc-eda8-4d9c-80f8-6c2c0d74c21a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:17.039630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-280ee6bc-eda8-4d9c-80f8-6c2c0d74c21a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:17.048515 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-280ee6bc-eda8-4d9c-80f8-6c2c0d74c21a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1270 microversion: 2.1 time: 0.294514 Aug 29 16:04:17.053459 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3542/6872] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:16 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1270 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:18.073848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bce29691-a543-4e4b-9c64-03e6fbf6d05c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:18.074464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bce29691-a543-4e4b-9c64-03e6fbf6d05c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:18.091332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce29691-a543-4e4b-9c64-03e6fbf6d05c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:18.092138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce29691-a543-4e4b-9c64-03e6fbf6d05c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:18.092733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce29691-a543-4e4b-9c64-03e6fbf6d05c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:18.093723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce29691-a543-4e4b-9c64-03e6fbf6d05c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:18.094344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce29691-a543-4e4b-9c64-03e6fbf6d05c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:18.094926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bce29691-a543-4e4b-9c64-03e6fbf6d05c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:18.336349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bce29691-a543-4e4b-9c64-03e6fbf6d05c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:18.347773 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bce29691-a543-4e4b-9c64-03e6fbf6d05c tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1270 microversion: 2.1 time: 0.277778 Aug 29 16:04:18.348434 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3331/6873] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:18 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1270 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:19.368338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b62aed6-46e6-41fa-9d0c-3b0304efa79e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:19.369844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8b62aed6-46e6-41fa-9d0c-3b0304efa79e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:19.386384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b62aed6-46e6-41fa-9d0c-3b0304efa79e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:19.387194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b62aed6-46e6-41fa-9d0c-3b0304efa79e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:19.390811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b62aed6-46e6-41fa-9d0c-3b0304efa79e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:19.391925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b62aed6-46e6-41fa-9d0c-3b0304efa79e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:19.392724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b62aed6-46e6-41fa-9d0c-3b0304efa79e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:19.393442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b62aed6-46e6-41fa-9d0c-3b0304efa79e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:19.786751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8b62aed6-46e6-41fa-9d0c-3b0304efa79e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:19.795350 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8b62aed6-46e6-41fa-9d0c-3b0304efa79e tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1270 microversion: 2.1 time: 0.431199 Aug 29 16:04:19.795950 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3543/6874] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:19 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1270 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:20.820334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4499ab8c-f05f-4028-92c7-7f29d4ebe83d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:20.821423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4499ab8c-f05f-4028-92c7-7f29d4ebe83d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:20.855629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4499ab8c-f05f-4028-92c7-7f29d4ebe83d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:20.856407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4499ab8c-f05f-4028-92c7-7f29d4ebe83d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:20.860734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4499ab8c-f05f-4028-92c7-7f29d4ebe83d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:20.864273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4499ab8c-f05f-4028-92c7-7f29d4ebe83d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:20.865486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4499ab8c-f05f-4028-92c7-7f29d4ebe83d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:20.866171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4499ab8c-f05f-4028-92c7-7f29d4ebe83d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:21.113542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4499ab8c-f05f-4028-92c7-7f29d4ebe83d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:21.124317 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4499ab8c-f05f-4028-92c7-7f29d4ebe83d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1270 microversion: 2.1 time: 0.311463 Aug 29 16:04:21.127822 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3332/6875] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:20 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1270 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:21.888118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-106ccb67-a513-4a54-8ed9-34e70af64804 req-4f01be4b-ed52-42b7-a46f-6a1a1479b9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b53b88b-76ce-4b10-9c56-d2bb3fb80e44", "name": "network-vif-plugged", "status": "completed", "tag": "8437568f-cbe3-4a08-a0b0-51d7e443a4e8"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:21.906885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-106ccb67-a513-4a54-8ed9-34e70af64804 req-4f01be4b-ed52-42b7-a46f-6a1a1479b9dd service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:21.907606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-106ccb67-a513-4a54-8ed9-34e70af64804 req-4f01be4b-ed52-42b7-a46f-6a1a1479b9dd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:21.908295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-106ccb67-a513-4a54-8ed9-34e70af64804 req-4f01be4b-ed52-42b7-a46f-6a1a1479b9dd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:21.924969 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-106ccb67-a513-4a54-8ed9-34e70af64804 req-4f01be4b-ed52-42b7-a46f-6a1a1479b9dd service nova] Creating event network-vif-plugged:8437568f-cbe3-4a08-a0b0-51d7e443a4e8 for instance 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 on n-h2-839401-11 Aug 29 16:04:21.931834 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-106ccb67-a513-4a54-8ed9-34e70af64804 req-4f01be4b-ed52-42b7-a46f-6a1a1479b9dd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047918 Aug 29 16:04:21.933804 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3544/6876] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:22.146110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-312865cf-9d2c-49d9-8c68-5b3733add6a5 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:22.147454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-312865cf-9d2c-49d9-8c68-5b3733add6a5 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:22.154511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-312865cf-9d2c-49d9-8c68-5b3733add6a5 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:22.155253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-312865cf-9d2c-49d9-8c68-5b3733add6a5 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:22.155730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-312865cf-9d2c-49d9-8c68-5b3733add6a5 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:22.156611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-312865cf-9d2c-49d9-8c68-5b3733add6a5 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:22.157260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-312865cf-9d2c-49d9-8c68-5b3733add6a5 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:22.157876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-312865cf-9d2c-49d9-8c68-5b3733add6a5 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:22.364485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-312865cf-9d2c-49d9-8c68-5b3733add6a5 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:22.379048 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-312865cf-9d2c-49d9-8c68-5b3733add6a5 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1270 microversion: 2.1 time: 0.237183 Aug 29 16:04:22.380596 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3333/6877] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:22 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1270 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:23.400707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d3bc8674-2f2f-4b5c-b0ba-3b1c01db2a85 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:23.401611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d3bc8674-2f2f-4b5c-b0ba-3b1c01db2a85 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:23.410282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3bc8674-2f2f-4b5c-b0ba-3b1c01db2a85 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:23.410788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3bc8674-2f2f-4b5c-b0ba-3b1c01db2a85 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:23.411219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3bc8674-2f2f-4b5c-b0ba-3b1c01db2a85 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:23.415676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3bc8674-2f2f-4b5c-b0ba-3b1c01db2a85 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:23.416171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3bc8674-2f2f-4b5c-b0ba-3b1c01db2a85 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:23.416612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3bc8674-2f2f-4b5c-b0ba-3b1c01db2a85 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:23.702290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d3bc8674-2f2f-4b5c-b0ba-3b1c01db2a85 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:23.715276 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d3bc8674-2f2f-4b5c-b0ba-3b1c01db2a85 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1270 microversion: 2.1 time: 0.319029 Aug 29 16:04:23.730483 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3545/6878] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:23 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1270 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:24.740621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a9a16968-e352-41c3-a81d-9e270c4c054a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:24.741640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a9a16968-e352-41c3-a81d-9e270c4c054a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:24.748690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:24.756695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9a16968-e352-41c3-a81d-9e270c4c054a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:24.758321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9a16968-e352-41c3-a81d-9e270c4c054a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:24.760992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9a16968-e352-41c3-a81d-9e270c4c054a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:24.761984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9a16968-e352-41c3-a81d-9e270c4c054a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:24.762680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9a16968-e352-41c3-a81d-9e270c4c054a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:24.764329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a9a16968-e352-41c3-a81d-9e270c4c054a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:25.002295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a9a16968-e352-41c3-a81d-9e270c4c054a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:25.011898 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a9a16968-e352-41c3-a81d-9e270c4c054a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1459 microversion: 2.1 time: 0.275628 Aug 29 16:04:25.026963 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3334/6879] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:24 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1459 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:25.032551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7fa1ebdc-3050-4b8a-930d-b40e3a0e6320 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:25.033351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7fa1ebdc-3050-4b8a-930d-b40e3a0e6320 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:25.044513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fa1ebdc-3050-4b8a-930d-b40e3a0e6320 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:25.045121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fa1ebdc-3050-4b8a-930d-b40e3a0e6320 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:25.045571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fa1ebdc-3050-4b8a-930d-b40e3a0e6320 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:25.046626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fa1ebdc-3050-4b8a-930d-b40e3a0e6320 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:25.047096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fa1ebdc-3050-4b8a-930d-b40e3a0e6320 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:25.047543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7fa1ebdc-3050-4b8a-930d-b40e3a0e6320 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:25.314132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7fa1ebdc-3050-4b8a-930d-b40e3a0e6320 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:25.331087 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7fa1ebdc-3050-4b8a-930d-b40e3a0e6320 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1459 microversion: 2.1 time: 0.301690 Aug 29 16:04:25.332815 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3546/6880] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:25 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1459 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:27.743001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-2aeb48c4-539c-4b78-b2d1-98b239098665 req-5fd065d6-6be9-4b3b-9863-c3e3a46c3f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b53b88b-76ce-4b10-9c56-d2bb3fb80e44", "tag": "8437568f-cbe3-4a08-a0b0-51d7e443a4e8"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:27.755964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2aeb48c4-539c-4b78-b2d1-98b239098665 req-5fd065d6-6be9-4b3b-9863-c3e3a46c3f39 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:27.756458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2aeb48c4-539c-4b78-b2d1-98b239098665 req-5fd065d6-6be9-4b3b-9863-c3e3a46c3f39 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:27.756892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-2aeb48c4-539c-4b78-b2d1-98b239098665 req-5fd065d6-6be9-4b3b-9863-c3e3a46c3f39 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:27.772190 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-2aeb48c4-539c-4b78-b2d1-98b239098665 req-5fd065d6-6be9-4b3b-9863-c3e3a46c3f39 service nova] Creating event network-changed:8437568f-cbe3-4a08-a0b0-51d7e443a4e8 for instance 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 on n-h2-839401-11 Aug 29 16:04:27.779299 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-2aeb48c4-539c-4b78-b2d1-98b239098665 req-5fd065d6-6be9-4b3b-9863-c3e3a46c3f39 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041112 Aug 29 16:04:27.784936 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3335/6881] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:29.778806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-67c5cf8f-6b77-4fe8-9247-48f174da6347 req-ea112761-9371-4757-9a41-0b360361199b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b53b88b-76ce-4b10-9c56-d2bb3fb80e44", "tag": "8437568f-cbe3-4a08-a0b0-51d7e443a4e8"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:29.800039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-67c5cf8f-6b77-4fe8-9247-48f174da6347 req-ea112761-9371-4757-9a41-0b360361199b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:29.802691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-67c5cf8f-6b77-4fe8-9247-48f174da6347 req-ea112761-9371-4757-9a41-0b360361199b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:29.805216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-67c5cf8f-6b77-4fe8-9247-48f174da6347 req-ea112761-9371-4757-9a41-0b360361199b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:29.816096 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=72 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:29.835034 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-67c5cf8f-6b77-4fe8-9247-48f174da6347 req-ea112761-9371-4757-9a41-0b360361199b service nova] Creating event network-changed:8437568f-cbe3-4a08-a0b0-51d7e443a4e8 for instance 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 on n-h2-839401-11 Aug 29 16:04:29.842992 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-67c5cf8f-6b77-4fe8-9247-48f174da6347 req-ea112761-9371-4757-9a41-0b360361199b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.302961 Aug 29 16:04:29.844366 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3547/6882] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:32.176913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-66f01f7d-5fbb-4956-a493-54a19faeac00 req-e76c16f7-3191-42a7-80cb-dbe94cc0f8dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b53b88b-76ce-4b10-9c56-d2bb3fb80e44", "tag": "8437568f-cbe3-4a08-a0b0-51d7e443a4e8"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:32.189490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-66f01f7d-5fbb-4956-a493-54a19faeac00 req-e76c16f7-3191-42a7-80cb-dbe94cc0f8dc service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:32.190306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-66f01f7d-5fbb-4956-a493-54a19faeac00 req-e76c16f7-3191-42a7-80cb-dbe94cc0f8dc service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:32.190943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-66f01f7d-5fbb-4956-a493-54a19faeac00 req-e76c16f7-3191-42a7-80cb-dbe94cc0f8dc service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:32.203631 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-66f01f7d-5fbb-4956-a493-54a19faeac00 req-e76c16f7-3191-42a7-80cb-dbe94cc0f8dc service nova] Creating event network-changed:8437568f-cbe3-4a08-a0b0-51d7e443a4e8 for instance 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 on n-h2-839401-11 Aug 29 16:04:32.209223 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-66f01f7d-5fbb-4956-a493-54a19faeac00 req-e76c16f7-3191-42a7-80cb-dbe94cc0f8dc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037666 Aug 29 16:04:32.210355 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3336/6883] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:41.173174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b3808ee1-da71-4c2d-b6eb-974b8d9d4c62 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:41.174819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b3808ee1-da71-4c2d-b6eb-974b8d9d4c62 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:41.178539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=13 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:41.179251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:41.182015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-783b8295-fd6e-4c42-bd65-0259877e2789 req-66bff242-29a9-4f2f-a3d6-f9cd65fd2306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0621e034-0d52-4c6e-86f9-d5a206462089", "tag": "5e1e096b-07af-48e7-962f-6dd88bee3062"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:41.187167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3808ee1-da71-4c2d-b6eb-974b8d9d4c62 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:41.187658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3808ee1-da71-4c2d-b6eb-974b8d9d4c62 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:41.188288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3808ee1-da71-4c2d-b6eb-974b8d9d4c62 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:41.189306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3808ee1-da71-4c2d-b6eb-974b8d9d4c62 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:41.189980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3808ee1-da71-4c2d-b6eb-974b8d9d4c62 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:41.190668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3808ee1-da71-4c2d-b6eb-974b8d9d4c62 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:41.215616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-783b8295-fd6e-4c42-bd65-0259877e2789 req-66bff242-29a9-4f2f-a3d6-f9cd65fd2306 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:41.216401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-783b8295-fd6e-4c42-bd65-0259877e2789 req-66bff242-29a9-4f2f-a3d6-f9cd65fd2306 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:41.217016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-783b8295-fd6e-4c42-bd65-0259877e2789 req-66bff242-29a9-4f2f-a3d6-f9cd65fd2306 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:41.224440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b3808ee1-da71-4c2d-b6eb-974b8d9d4c62 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:04:41.234038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=60 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:41.237936 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-783b8295-fd6e-4c42-bd65-0259877e2789 req-66bff242-29a9-4f2f-a3d6-f9cd65fd2306 service nova] Creating event network-changed:5e1e096b-07af-48e7-962f-6dd88bee3062 for instance 0621e034-0d52-4c6e-86f9-d5a206462089 on n-h1-839401-11 Aug 29 16:04:41.250866 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-783b8295-fd6e-4c42-bd65-0259877e2789 req-66bff242-29a9-4f2f-a3d6-f9cd65fd2306 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078972 Aug 29 16:04:41.251650 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3337/6884] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:41.325449 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b3808ee1-da71-4c2d-b6eb-974b8d9d4c62 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 204 len: 0 microversion: 2.1 time: 0.156183 Aug 29 16:04:41.326095 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3548/6885] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:04:41 2022] DELETE /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:04:41.337114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-56653989-cb4d-4ded-8711-6b0395b725ca tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:41.338712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-56653989-cb4d-4ded-8711-6b0395b725ca tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:41.345853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56653989-cb4d-4ded-8711-6b0395b725ca tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:41.347237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56653989-cb4d-4ded-8711-6b0395b725ca tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:41.347767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56653989-cb4d-4ded-8711-6b0395b725ca tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:41.348550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56653989-cb4d-4ded-8711-6b0395b725ca tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:41.349103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56653989-cb4d-4ded-8711-6b0395b725ca tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:41.349628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56653989-cb4d-4ded-8711-6b0395b725ca tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:41.579020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-56653989-cb4d-4ded-8711-6b0395b725ca tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:41.587959 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-56653989-cb4d-4ded-8711-6b0395b725ca tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1688 microversion: 2.1 time: 0.256558 Aug 29 16:04:41.600390 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3338/6886] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:41 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1688 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:42.618361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a4a333a-0863-4996-985b-40da90827d4d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:42.619234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9a4a333a-0863-4996-985b-40da90827d4d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:42.632088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a4a333a-0863-4996-985b-40da90827d4d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:42.633818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a4a333a-0863-4996-985b-40da90827d4d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:42.634424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a4a333a-0863-4996-985b-40da90827d4d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:42.635546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a4a333a-0863-4996-985b-40da90827d4d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:42.636296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a4a333a-0863-4996-985b-40da90827d4d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:42.636877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a4a333a-0863-4996-985b-40da90827d4d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:42.858229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9a4a333a-0863-4996-985b-40da90827d4d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:42.874105 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a4a333a-0863-4996-985b-40da90827d4d tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1688 microversion: 2.1 time: 0.261974 Aug 29 16:04:42.875089 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3549/6887] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:42 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1688 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:43.897681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fd7467a0-6cb1-4895-b5d9-0ad33c411c5e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:43.898305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fd7467a0-6cb1-4895-b5d9-0ad33c411c5e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:43.908372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd7467a0-6cb1-4895-b5d9-0ad33c411c5e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:43.909055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd7467a0-6cb1-4895-b5d9-0ad33c411c5e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:43.909710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd7467a0-6cb1-4895-b5d9-0ad33c411c5e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:43.930649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd7467a0-6cb1-4895-b5d9-0ad33c411c5e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:43.931098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd7467a0-6cb1-4895-b5d9-0ad33c411c5e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:43.931598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd7467a0-6cb1-4895-b5d9-0ad33c411c5e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:44.057882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fd7467a0-6cb1-4895-b5d9-0ad33c411c5e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008972030ade418cb180f0702ae168b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8e858d9064ae3875d91e8a43f7ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:44.071552 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fd7467a0-6cb1-4895-b5d9-0ad33c411c5e tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 200 len: 1501 microversion: 2.1 time: 0.177598 Aug 29 16:04:44.071803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e5625465-0a51-4967-9ac1-b657de9d3aff req-b12e173d-a02b-4662-863b-3feaa4c1eaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0621e034-0d52-4c6e-86f9-d5a206462089", "name": "network-vif-deleted", "tag": "5e1e096b-07af-48e7-962f-6dd88bee3062"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:44.086076 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3339/6888] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:43 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 1501 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:44.093731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e5625465-0a51-4967-9ac1-b657de9d3aff req-b12e173d-a02b-4662-863b-3feaa4c1eaf8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:44.094488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e5625465-0a51-4967-9ac1-b657de9d3aff req-b12e173d-a02b-4662-863b-3feaa4c1eaf8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:44.095870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e5625465-0a51-4967-9ac1-b657de9d3aff req-b12e173d-a02b-4662-863b-3feaa4c1eaf8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:44.114454 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e5625465-0a51-4967-9ac1-b657de9d3aff req-b12e173d-a02b-4662-863b-3feaa4c1eaf8 service nova] Creating event network-vif-deleted:5e1e096b-07af-48e7-962f-6dd88bee3062 for instance 0621e034-0d52-4c6e-86f9-d5a206462089 on n-h1-839401-11 Aug 29 16:04:44.124533 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e5625465-0a51-4967-9ac1-b657de9d3aff req-b12e173d-a02b-4662-863b-3feaa4c1eaf8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056778 Aug 29 16:04:44.125962 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3550/6889] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:45.096456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5e2829f1-c556-4dc9-b3fe-9c26724db0c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:45.097379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5e2829f1-c556-4dc9-b3fe-9c26724db0c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] [instance: 0621e034-0d52-4c6e-86f9-d5a206462089] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:45.118114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e2829f1-c556-4dc9-b3fe-9c26724db0c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:45.118637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e2829f1-c556-4dc9-b3fe-9c26724db0c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:45.119158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e2829f1-c556-4dc9-b3fe-9c26724db0c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:45.119894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e2829f1-c556-4dc9-b3fe-9c26724db0c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:45.122899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e2829f1-c556-4dc9-b3fe-9c26724db0c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:45.123373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5e2829f1-c556-4dc9-b3fe-9c26724db0c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:45.169843 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-5e2829f1-c556-4dc9-b3fe-9c26724db0c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] HTTP exception thrown: Instance 0621e034-0d52-4c6e-86f9-d5a206462089 could not be found. Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5e2829f1-c556-4dc9-b3fe-9c26724db0c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Request method failure captured: Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 HTTP/1.1 Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOB3Svc4jYi_sdqstP8fut48z-Az-vRMtuk-EyuIwnH-xZ_3sKRpgA4G5XF7KP-cMjjpzT9196nhz_6F5C-ZYBvXK1KNFkDO7Pn9b9qPE-UYVu5R2LY-PIrVIejaJCCfnNMTNd864tfoTDZYIqBxVW7iKDXVNaNr9KOQ6yBnoKzm0XU Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 63c8e858d9064ae3875d91e8a43f7ee4 Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1699754938 Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_63c8e858d9064ae3875d91e8a43f7ee4", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/63c8e858d9064ae3875d91e8a43f7ee4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/63c8e858d9064ae3875d91e8a43f7ee4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/63c8e858d9064ae3875d91e8a43f7ee4"}]}] Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1699754938 Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 63c8e858d9064ae3875d91e8a43f7ee4 Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1699754938 Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestNetworkAdvancedServerOps-1699754938-project Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 008972030ade418cb180f0702ae168b4 Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1699754938-project Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 0621e034-0d52-4c6e-86f9-d5a206462089 could not be found. Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '0621e034-0d52-4c6e-86f9-d5a206462089'} Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0621e034-0d52-4c6e-86f9-d5a206462089 could not be found. Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0621e034-0d52-4c6e-86f9-d5a206462089 could not be found. Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:04:45.174372 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:04:45.179272 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:04:45.179272 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:45.179272 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:04:45.179272 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:04:45.179272 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:04:45.179272 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:04:45.179272 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0621e034-0d52-4c6e-86f9-d5a206462089 could not be found. Aug 29 16:04:45.179272 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:04:45.179272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5e2829f1-c556-4dc9-b3fe-9c26724db0c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Returning 404 to user: Instance 0621e034-0d52-4c6e-86f9-d5a206462089 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:04:45.179272 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5e2829f1-c556-4dc9-b3fe-9c26724db0c6 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089" status: 404 len: 111 microversion: 2.1 time: 0.088958 Aug 29 16:04:45.181427 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3340/6890] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:45 2022] GET /compute/v2.1/servers/0621e034-0d52-4c6e-86f9-d5a206462089 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:04:50.595329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f208e27c-6d61-40c2-9916-79dbd9a70459 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] Calling method '.version_select at 0x7fc42a7540d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:50.635502 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f208e27c-6d61-40c2-9916-79dbd9a70459 tempest-TestNetworkAdvancedServerOps-1699754938 tempest-TestNetworkAdvancedServerOps-1699754938-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2020994708" status: 202 len: 0 microversion: 2.1 time: 0.045668 Aug 29 16:04:50.639585 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3551/6891] 10.222.0.62 () {58 vars in 1284 bytes} [Mon Aug 29 16:04:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2020994708 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:05:03.756327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-25110e01-8d5e-4fff-9e04-0023345181d2 req-06f55c59-fde5-4565-a12b-56f444c6415e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b53b88b-76ce-4b10-9c56-d2bb3fb80e44", "tag": "8437568f-cbe3-4a08-a0b0-51d7e443a4e8"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:03.757194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c997054a-e73c-44aa-9cba-6f18f7a81199 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:03.759138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c997054a-e73c-44aa-9cba-6f18f7a81199 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:03.779789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=13 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:03.780549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:03.784320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=15 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:03.785124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:03.789841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c997054a-e73c-44aa-9cba-6f18f7a81199 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:03.791921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c997054a-e73c-44aa-9cba-6f18f7a81199 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:03.792534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c997054a-e73c-44aa-9cba-6f18f7a81199 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:03.793730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c997054a-e73c-44aa-9cba-6f18f7a81199 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:03.797354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c997054a-e73c-44aa-9cba-6f18f7a81199 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:03.797891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c997054a-e73c-44aa-9cba-6f18f7a81199 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:03.800127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-25110e01-8d5e-4fff-9e04-0023345181d2 req-06f55c59-fde5-4565-a12b-56f444c6415e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:03.800774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-25110e01-8d5e-4fff-9e04-0023345181d2 req-06f55c59-fde5-4565-a12b-56f444c6415e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:03.801396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-25110e01-8d5e-4fff-9e04-0023345181d2 req-06f55c59-fde5-4565-a12b-56f444c6415e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:03.824245 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-25110e01-8d5e-4fff-9e04-0023345181d2 req-06f55c59-fde5-4565-a12b-56f444c6415e service nova] Creating event network-changed:8437568f-cbe3-4a08-a0b0-51d7e443a4e8 for instance 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 on n-h2-839401-11 Aug 29 16:05:03.834572 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-25110e01-8d5e-4fff-9e04-0023345181d2 req-06f55c59-fde5-4565-a12b-56f444c6415e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085290 Aug 29 16:05:03.839595 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3552/6892] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:03.858091 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c997054a-e73c-44aa-9cba-6f18f7a81199 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:05:04.003539 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c997054a-e73c-44aa-9cba-6f18f7a81199 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 204 len: 0 microversion: 2.1 time: 0.260458 Aug 29 16:05:04.005161 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3341/6893] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:05:03 2022] DELETE /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:05:04.015208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b96d89c3-6689-4787-ac83-b305c7e5cbad tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:04.016160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b96d89c3-6689-4787-ac83-b305c7e5cbad tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:04.026781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b96d89c3-6689-4787-ac83-b305c7e5cbad tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:04.027278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b96d89c3-6689-4787-ac83-b305c7e5cbad tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:04.029473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b96d89c3-6689-4787-ac83-b305c7e5cbad tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:04.030345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b96d89c3-6689-4787-ac83-b305c7e5cbad tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:04.030699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b96d89c3-6689-4787-ac83-b305c7e5cbad tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:04.031231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b96d89c3-6689-4787-ac83-b305c7e5cbad tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:04.671732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b96d89c3-6689-4787-ac83-b305c7e5cbad tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:04.680537 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b96d89c3-6689-4787-ac83-b305c7e5cbad tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1583 microversion: 2.1 time: 0.670539 Aug 29 16:05:04.694305 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3553/6894] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:04 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1583 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:05.704647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bf155c16-87ff-4d97-aa75-1bc852025b7a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:05.705260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bf155c16-87ff-4d97-aa75-1bc852025b7a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:05.717988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf155c16-87ff-4d97-aa75-1bc852025b7a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:05.718482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf155c16-87ff-4d97-aa75-1bc852025b7a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:05.718923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf155c16-87ff-4d97-aa75-1bc852025b7a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:05.719630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf155c16-87ff-4d97-aa75-1bc852025b7a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:05.721795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf155c16-87ff-4d97-aa75-1bc852025b7a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:05.723735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf155c16-87ff-4d97-aa75-1bc852025b7a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:05.976954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bf155c16-87ff-4d97-aa75-1bc852025b7a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:05.986452 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bf155c16-87ff-4d97-aa75-1bc852025b7a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1583 microversion: 2.1 time: 0.285446 Aug 29 16:05:05.989824 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3342/6895] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:05 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1583 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:06.770431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-6284ed73-b01d-42fe-b137-adc58c82a1ba req-8874cbc9-9a44-402a-9734-10022c036037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b53b88b-76ce-4b10-9c56-d2bb3fb80e44", "name": "network-vif-deleted", "tag": "8437568f-cbe3-4a08-a0b0-51d7e443a4e8"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:06.800037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6284ed73-b01d-42fe-b137-adc58c82a1ba req-8874cbc9-9a44-402a-9734-10022c036037 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:06.801344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6284ed73-b01d-42fe-b137-adc58c82a1ba req-8874cbc9-9a44-402a-9734-10022c036037 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:06.802112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6284ed73-b01d-42fe-b137-adc58c82a1ba req-8874cbc9-9a44-402a-9734-10022c036037 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:06.831721 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-6284ed73-b01d-42fe-b137-adc58c82a1ba req-8874cbc9-9a44-402a-9734-10022c036037 service nova] Creating event network-vif-deleted:8437568f-cbe3-4a08-a0b0-51d7e443a4e8 for instance 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 on n-h2-839401-11 Aug 29 16:05:06.848488 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-6284ed73-b01d-42fe-b137-adc58c82a1ba req-8874cbc9-9a44-402a-9734-10022c036037 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083881 Aug 29 16:05:06.853941 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3554/6896] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:05:07.014878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4e067c4f-d316-4ab8-9d88-9fde781a9f6d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:07.016273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4e067c4f-d316-4ab8-9d88-9fde781a9f6d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:07.030591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e067c4f-d316-4ab8-9d88-9fde781a9f6d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:07.031427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e067c4f-d316-4ab8-9d88-9fde781a9f6d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:07.032062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e067c4f-d316-4ab8-9d88-9fde781a9f6d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:07.033168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e067c4f-d316-4ab8-9d88-9fde781a9f6d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:07.034483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e067c4f-d316-4ab8-9d88-9fde781a9f6d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:07.035553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e067c4f-d316-4ab8-9d88-9fde781a9f6d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:07.186954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4e067c4f-d316-4ab8-9d88-9fde781a9f6d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:07.197022 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4e067c4f-d316-4ab8-9d88-9fde781a9f6d tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1229 microversion: 2.1 time: 0.190210 Aug 29 16:05:07.212681 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3343/6897] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:07 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1229 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:08.220936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ea73beaa-6c8e-4663-9bd9-719ec6114f43 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:08.221694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ea73beaa-6c8e-4663-9bd9-719ec6114f43 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:08.235343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea73beaa-6c8e-4663-9bd9-719ec6114f43 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:08.236092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea73beaa-6c8e-4663-9bd9-719ec6114f43 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:08.236773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea73beaa-6c8e-4663-9bd9-719ec6114f43 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:08.241601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea73beaa-6c8e-4663-9bd9-719ec6114f43 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:08.242433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea73beaa-6c8e-4663-9bd9-719ec6114f43 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:08.247357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea73beaa-6c8e-4663-9bd9-719ec6114f43 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:08.415237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ea73beaa-6c8e-4663-9bd9-719ec6114f43 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:08.427657 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ea73beaa-6c8e-4663-9bd9-719ec6114f43 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1229 microversion: 2.1 time: 0.212466 Aug 29 16:05:08.428577 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3555/6898] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:08 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1229 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:09.454099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-321f83cc-43f8-4f01-9a6b-e27149e1cebe tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:09.457072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-321f83cc-43f8-4f01-9a6b-e27149e1cebe tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:09.466557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-321f83cc-43f8-4f01-9a6b-e27149e1cebe tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:09.467501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-321f83cc-43f8-4f01-9a6b-e27149e1cebe tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:09.468276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-321f83cc-43f8-4f01-9a6b-e27149e1cebe tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:09.469237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-321f83cc-43f8-4f01-9a6b-e27149e1cebe tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:09.469939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-321f83cc-43f8-4f01-9a6b-e27149e1cebe tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:09.470707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-321f83cc-43f8-4f01-9a6b-e27149e1cebe tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:09.598587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-321f83cc-43f8-4f01-9a6b-e27149e1cebe tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:09.615381 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-321f83cc-43f8-4f01-9a6b-e27149e1cebe tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1229 microversion: 2.1 time: 0.166728 Aug 29 16:05:09.616094 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3344/6899] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:09 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1229 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:10.660140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5f9d5078-4885-46c5-aa54-97f31671191a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:10.660977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5f9d5078-4885-46c5-aa54-97f31671191a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:10.680077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f9d5078-4885-46c5-aa54-97f31671191a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:10.680817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f9d5078-4885-46c5-aa54-97f31671191a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:10.681467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f9d5078-4885-46c5-aa54-97f31671191a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:10.682328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f9d5078-4885-46c5-aa54-97f31671191a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:10.682939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f9d5078-4885-46c5-aa54-97f31671191a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:10.683518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f9d5078-4885-46c5-aa54-97f31671191a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:10.806938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5f9d5078-4885-46c5-aa54-97f31671191a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:10.824822 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5f9d5078-4885-46c5-aa54-97f31671191a tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1229 microversion: 2.1 time: 0.176566 Aug 29 16:05:10.825504 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3556/6900] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:10 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1229 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:11.846822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5f8350a4-fd44-4984-a9e3-34604f635f0f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:11.847534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5f8350a4-fd44-4984-a9e3-34604f635f0f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:11.858218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f8350a4-fd44-4984-a9e3-34604f635f0f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:11.863489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f8350a4-fd44-4984-a9e3-34604f635f0f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:11.863975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f8350a4-fd44-4984-a9e3-34604f635f0f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:11.864723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f8350a4-fd44-4984-a9e3-34604f635f0f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:11.865228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f8350a4-fd44-4984-a9e3-34604f635f0f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:11.865666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5f8350a4-fd44-4984-a9e3-34604f635f0f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:11.978029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5f8350a4-fd44-4984-a9e3-34604f635f0f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c817bb696f143adaa7cec391316c043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc319a3a94e4f73a4d9bfba0621f0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:11.989301 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5f8350a4-fd44-4984-a9e3-34604f635f0f tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 200 len: 1229 microversion: 2.1 time: 0.145702 Aug 29 16:05:11.990427 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3345/6901] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:11 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 1229 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:13.016369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3069b034-7a10-48b0-b99e-a3b686e1fee1 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:13.034520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3069b034-7a10-48b0-b99e-a3b686e1fee1 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] [instance: 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:13.057487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3069b034-7a10-48b0-b99e-a3b686e1fee1 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:13.058218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3069b034-7a10-48b0-b99e-a3b686e1fee1 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:13.058854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3069b034-7a10-48b0-b99e-a3b686e1fee1 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:13.059782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3069b034-7a10-48b0-b99e-a3b686e1fee1 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:13.060426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3069b034-7a10-48b0-b99e-a3b686e1fee1 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:13.061033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3069b034-7a10-48b0-b99e-a3b686e1fee1 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:13.077852 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-3069b034-7a10-48b0-b99e-a3b686e1fee1 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] HTTP exception thrown: Instance 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 could not be found. Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3069b034-7a10-48b0-b99e-a3b686e1fee1 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Request method failure captured: Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 HTTP/1.1 Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOK4KsLzCYoglGD76aAmO_cLgaqptHXRHDkhjrAjIxxP5o3XlMZuqvbhvdxoUMBO8msiCVVsY1x2VQJVlglkzFkQ8p1X7GHbC_EqaqYcnnxIyUBXqRkXa6tC3rsTsU261ReKfzEcBx28Pk3rmMf_-wSqCfvpo6KCjg4mNjLFXsEiJ4k Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: fdc319a3a94e4f73a4d9bfba0621f0f8 Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestVolumeBackupRestore-1577569 Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fdc319a3a94e4f73a4d9bfba0621f0f8", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fdc319a3a94e4f73a4d9bfba0621f0f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fdc319a3a94e4f73a4d9bfba0621f0f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fdc319a3a94e4f73a4d9bfba0621f0f8"}]}] Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestVolumeBackupRestore-1577569 Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: fdc319a3a94e4f73a4d9bfba0621f0f8 Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1577569 Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestVolumeBackupRestore-1577569-project Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 8c817bb696f143adaa7cec391316c043 Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestVolumeBackupRestore-1577569-project Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 could not be found. Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '0b53b88b-76ce-4b10-9c56-d2bb3fb80e44'} Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 could not be found. Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 could not be found. Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:13.079928 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:05:13.085180 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:13.085180 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:13.085180 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:13.085180 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:13.085180 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:13.085180 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 could not be found. Aug 29 16:05:13.085180 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:05:13.087173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3069b034-7a10-48b0-b99e-a3b686e1fee1 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Returning 404 to user: Instance 0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:13.088261 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3069b034-7a10-48b0-b99e-a3b686e1fee1 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44" status: 404 len: 111 microversion: 2.1 time: 0.081520 Aug 29 16:05:13.092589 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3557/6902] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:13 2022] GET /compute/v2.1/servers/0b53b88b-76ce-4b10-9c56-d2bb3fb80e44 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:05:13.351921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3ece1c41-aae9-4190-a568-baae1d5a2018 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] Calling method '.version_select at 0x7fc42a7f6430>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:13.407892 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3ece1c41-aae9-4190-a568-baae1d5a2018 tempest-TestVolumeBackupRestore-1577569 tempest-TestVolumeBackupRestore-1577569-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-250083554" status: 202 len: 0 microversion: 2.1 time: 0.059962 Aug 29 16:05:13.409072 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3346/6903] 10.222.0.62 () {58 vars in 1266 bytes} [Mon Aug 29 16:05:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-250083554 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:05:52.876438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2024634177", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "abec9118-0703-43ba-a149-cb4ced38df75", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "957b06a2-5b5b-41f0-883f-0990cab206d9"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:52.906161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=12 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:52.910667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=24 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:53.035673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] validate_networks() for [('957b06a2-5b5b-41f0-883f-0990cab206d9', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:05:53.893391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:05:53.893973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:05:53.897141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:05:53.897141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:05:53.897141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:05:53.922646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:53.923198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:53.924729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:53.926962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:53.928415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:53.928840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:53.957576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:05:53.964721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for user f07d896c6764402999345759f2348080 and project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:05:54.032836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:05:54.035246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='abec9118-0703-43ba-a149-cb4ced38df75',volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:05:54.214749 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-55e60635-e5ce-40bb-9de0-28df1f406f32 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.345207 Aug 29 16:05:54.215965 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3558/6904] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:05:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:05:54.227911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-598e50dc-778e-4d5f-b373-85b838a348be tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:54.229296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-598e50dc-778e-4d5f-b373-85b838a348be tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:54.251645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:54.254992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:54.356999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-598e50dc-778e-4d5f-b373-85b838a348be tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:54.367082 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-598e50dc-778e-4d5f-b373-85b838a348be tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1057 microversion: 2.1 time: 0.143707 Aug 29 16:05:54.368732 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3347/6905] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:54 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1057 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:55.411141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-44e6a75e-e7a5-4dec-b1c4-c99c96503b2a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:55.425446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-44e6a75e-e7a5-4dec-b1c4-c99c96503b2a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:55.444136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44e6a75e-e7a5-4dec-b1c4-c99c96503b2a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:55.444854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44e6a75e-e7a5-4dec-b1c4-c99c96503b2a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:55.445502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44e6a75e-e7a5-4dec-b1c4-c99c96503b2a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:55.446381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44e6a75e-e7a5-4dec-b1c4-c99c96503b2a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:55.447001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44e6a75e-e7a5-4dec-b1c4-c99c96503b2a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:55.447590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44e6a75e-e7a5-4dec-b1c4-c99c96503b2a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:55.536862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-44e6a75e-e7a5-4dec-b1c4-c99c96503b2a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:55.545503 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-44e6a75e-e7a5-4dec-b1c4-c99c96503b2a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1155 microversion: 2.1 time: 0.159658 Aug 29 16:05:55.546517 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3559/6906] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:55 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1155 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:56.568834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e8857504-a023-480c-9714-cf0bdec82b35 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:56.570380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e8857504-a023-480c-9714-cf0bdec82b35 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:56.587650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8857504-a023-480c-9714-cf0bdec82b35 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:56.589828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8857504-a023-480c-9714-cf0bdec82b35 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:56.590343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8857504-a023-480c-9714-cf0bdec82b35 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:56.591127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8857504-a023-480c-9714-cf0bdec82b35 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:56.591621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8857504-a023-480c-9714-cf0bdec82b35 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:56.592061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e8857504-a023-480c-9714-cf0bdec82b35 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:56.742674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e8857504-a023-480c-9714-cf0bdec82b35 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:56.756242 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e8857504-a023-480c-9714-cf0bdec82b35 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1173 microversion: 2.1 time: 0.191616 Aug 29 16:05:56.773187 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3348/6907] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:56 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1173 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:57.788626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b9ebb05e-b65e-4b18-a731-d736e3ad1feb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:57.789315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b9ebb05e-b65e-4b18-a731-d736e3ad1feb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:57.801361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9ebb05e-b65e-4b18-a731-d736e3ad1feb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:57.801891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9ebb05e-b65e-4b18-a731-d736e3ad1feb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:57.802351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9ebb05e-b65e-4b18-a731-d736e3ad1feb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:57.805478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9ebb05e-b65e-4b18-a731-d736e3ad1feb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:57.805965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9ebb05e-b65e-4b18-a731-d736e3ad1feb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:57.807685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9ebb05e-b65e-4b18-a731-d736e3ad1feb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:57.992875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b9ebb05e-b65e-4b18-a731-d736e3ad1feb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:58.002097 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b9ebb05e-b65e-4b18-a731-d736e3ad1feb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1215 microversion: 2.1 time: 0.218367 Aug 29 16:05:58.014732 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3560/6908] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:57 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1215 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:59.024000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-601a0e73-9067-4a84-a660-a45d77135ca4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:59.024631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-601a0e73-9067-4a84-a660-a45d77135ca4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:59.043331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-cb482ae8-3256-4299-8af0-1055fe43218f req-ff44031c-30d8-4832-9958-fce787c0bcd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9509c4-ad08-4556-ad82-35a78cb8e902", "tag": "52ee53d2-5938-4d69-b660-91e78d7bd300"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:59.050049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601a0e73-9067-4a84-a660-a45d77135ca4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:59.050549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601a0e73-9067-4a84-a660-a45d77135ca4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:59.068593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601a0e73-9067-4a84-a660-a45d77135ca4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:59.069423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601a0e73-9067-4a84-a660-a45d77135ca4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:59.069918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601a0e73-9067-4a84-a660-a45d77135ca4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:59.070363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-601a0e73-9067-4a84-a660-a45d77135ca4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:59.072916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cb482ae8-3256-4299-8af0-1055fe43218f req-ff44031c-30d8-4832-9958-fce787c0bcd7 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:59.075135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cb482ae8-3256-4299-8af0-1055fe43218f req-ff44031c-30d8-4832-9958-fce787c0bcd7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:59.075630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-cb482ae8-3256-4299-8af0-1055fe43218f req-ff44031c-30d8-4832-9958-fce787c0bcd7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:59.094862 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-cb482ae8-3256-4299-8af0-1055fe43218f req-ff44031c-30d8-4832-9958-fce787c0bcd7 service nova] Creating event network-changed:52ee53d2-5938-4d69-b660-91e78d7bd300 for instance ce9509c4-ad08-4556-ad82-35a78cb8e902 on n-h2-839401-11 Aug 29 16:05:59.102961 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-cb482ae8-3256-4299-8af0-1055fe43218f req-ff44031c-30d8-4832-9958-fce787c0bcd7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064163 Aug 29 16:05:59.104932 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3561/6909] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:05:59.772382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-601a0e73-9067-4a84-a660-a45d77135ca4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:59.787839 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-601a0e73-9067-4a84-a660-a45d77135ca4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1215 microversion: 2.1 time: 0.766544 Aug 29 16:05:59.789913 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3349/6910] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:59 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1215 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:00.819185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4df27fc2-385a-4b35-ab31-80cd36a22245 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:00.822638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4df27fc2-385a-4b35-ab31-80cd36a22245 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:00.852623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4df27fc2-385a-4b35-ab31-80cd36a22245 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:00.856849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4df27fc2-385a-4b35-ab31-80cd36a22245 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:00.857356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4df27fc2-385a-4b35-ab31-80cd36a22245 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:00.858310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4df27fc2-385a-4b35-ab31-80cd36a22245 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:00.858968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4df27fc2-385a-4b35-ab31-80cd36a22245 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:00.859544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4df27fc2-385a-4b35-ab31-80cd36a22245 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:01.126334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4df27fc2-385a-4b35-ab31-80cd36a22245 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:01.136944 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4df27fc2-385a-4b35-ab31-80cd36a22245 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1215 microversion: 2.1 time: 0.326624 Aug 29 16:06:01.150346 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3562/6911] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:00 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1215 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:02.161293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5833d8df-3dce-4ca4-aac5-accf1a1b048c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:02.163772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5833d8df-3dce-4ca4-aac5-accf1a1b048c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:02.197048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5833d8df-3dce-4ca4-aac5-accf1a1b048c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:02.197610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5833d8df-3dce-4ca4-aac5-accf1a1b048c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:02.198068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5833d8df-3dce-4ca4-aac5-accf1a1b048c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:02.198850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5833d8df-3dce-4ca4-aac5-accf1a1b048c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:02.199316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5833d8df-3dce-4ca4-aac5-accf1a1b048c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:02.199749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5833d8df-3dce-4ca4-aac5-accf1a1b048c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:02.407603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5833d8df-3dce-4ca4-aac5-accf1a1b048c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:02.418662 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5833d8df-3dce-4ca4-aac5-accf1a1b048c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1215 microversion: 2.1 time: 0.264415 Aug 29 16:06:02.420458 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3350/6912] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:02 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:03.442423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dc6e2eb9-4ceb-4a1b-a48d-4d7f4f67c567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:03.452041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dc6e2eb9-4ceb-4a1b-a48d-4d7f4f67c567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:03.462881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc6e2eb9-4ceb-4a1b-a48d-4d7f4f67c567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:03.463381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc6e2eb9-4ceb-4a1b-a48d-4d7f4f67c567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:03.463822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc6e2eb9-4ceb-4a1b-a48d-4d7f4f67c567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:03.464532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc6e2eb9-4ceb-4a1b-a48d-4d7f4f67c567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:03.464994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc6e2eb9-4ceb-4a1b-a48d-4d7f4f67c567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:03.465463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc6e2eb9-4ceb-4a1b-a48d-4d7f4f67c567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:03.638192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dc6e2eb9-4ceb-4a1b-a48d-4d7f4f67c567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:03.652600 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dc6e2eb9-4ceb-4a1b-a48d-4d7f4f67c567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1203 microversion: 2.1 time: 0.213907 Aug 29 16:06:03.654288 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3563/6913] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:03 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1203 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:04.676571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dd577a27-875e-4e0a-be6b-47fd9b3c785f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:04.677512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dd577a27-875e-4e0a-be6b-47fd9b3c785f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:04.680385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:04.698604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd577a27-875e-4e0a-be6b-47fd9b3c785f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:04.699443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd577a27-875e-4e0a-be6b-47fd9b3c785f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:04.700218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd577a27-875e-4e0a-be6b-47fd9b3c785f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:04.704010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd577a27-875e-4e0a-be6b-47fd9b3c785f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:04.704895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd577a27-875e-4e0a-be6b-47fd9b3c785f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:04.705734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd577a27-875e-4e0a-be6b-47fd9b3c785f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:04.946127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dd577a27-875e-4e0a-be6b-47fd9b3c785f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:04.957177 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dd577a27-875e-4e0a-be6b-47fd9b3c785f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1203 microversion: 2.1 time: 0.286023 Aug 29 16:06:04.957799 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3351/6914] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:04 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1203 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:05.985293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-91eb2803-a051-4878-97d7-1e7bc689d058 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:05.986130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-91eb2803-a051-4878-97d7-1e7bc689d058 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:05.988350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:05.989168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:06.004375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91eb2803-a051-4878-97d7-1e7bc689d058 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:06.004901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91eb2803-a051-4878-97d7-1e7bc689d058 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:06.006224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91eb2803-a051-4878-97d7-1e7bc689d058 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:06.006953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91eb2803-a051-4878-97d7-1e7bc689d058 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:06.007945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91eb2803-a051-4878-97d7-1e7bc689d058 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:06.012501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91eb2803-a051-4878-97d7-1e7bc689d058 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:06.198534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-91eb2803-a051-4878-97d7-1e7bc689d058 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:06.206594 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-91eb2803-a051-4878-97d7-1e7bc689d058 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1203 microversion: 2.1 time: 0.232800 Aug 29 16:06:06.207196 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3564/6915] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:05 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1203 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:07.226640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3469a785-f054-4839-837c-f5cfcc7a82a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:07.228001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3469a785-f054-4839-837c-f5cfcc7a82a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:07.236176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3469a785-f054-4839-837c-f5cfcc7a82a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:07.237035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3469a785-f054-4839-837c-f5cfcc7a82a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:07.237743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3469a785-f054-4839-837c-f5cfcc7a82a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:07.238692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3469a785-f054-4839-837c-f5cfcc7a82a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:07.239347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3469a785-f054-4839-837c-f5cfcc7a82a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:07.239971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3469a785-f054-4839-837c-f5cfcc7a82a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:07.487565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3469a785-f054-4839-837c-f5cfcc7a82a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:07.496288 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3469a785-f054-4839-837c-f5cfcc7a82a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1203 microversion: 2.1 time: 0.273706 Aug 29 16:06:07.496887 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3352/6916] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:07 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1203 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:08.532297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bd65a9b3-1eab-4507-a616-6961c0caa11f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:08.534382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bd65a9b3-1eab-4507-a616-6961c0caa11f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:08.556828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd65a9b3-1eab-4507-a616-6961c0caa11f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:08.558045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd65a9b3-1eab-4507-a616-6961c0caa11f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:08.558668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd65a9b3-1eab-4507-a616-6961c0caa11f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:08.559563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd65a9b3-1eab-4507-a616-6961c0caa11f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:08.560186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd65a9b3-1eab-4507-a616-6961c0caa11f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:08.560799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd65a9b3-1eab-4507-a616-6961c0caa11f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:08.926012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bd65a9b3-1eab-4507-a616-6961c0caa11f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:08.939716 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bd65a9b3-1eab-4507-a616-6961c0caa11f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1203 microversion: 2.1 time: 0.424642 Aug 29 16:06:08.946781 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3565/6917] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:08 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1203 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:09.962318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5b4e66d3-2c6e-47c6-9b19-679474dd98d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:09.963308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5b4e66d3-2c6e-47c6-9b19-679474dd98d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:09.985058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b4e66d3-2c6e-47c6-9b19-679474dd98d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:09.985606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b4e66d3-2c6e-47c6-9b19-679474dd98d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:09.986054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b4e66d3-2c6e-47c6-9b19-679474dd98d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:09.986784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b4e66d3-2c6e-47c6-9b19-679474dd98d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:09.987246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b4e66d3-2c6e-47c6-9b19-679474dd98d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:09.987858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5b4e66d3-2c6e-47c6-9b19-679474dd98d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:10.339363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5b4e66d3-2c6e-47c6-9b19-679474dd98d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:10.348404 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5b4e66d3-2c6e-47c6-9b19-679474dd98d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1203 microversion: 2.1 time: 0.392241 Aug 29 16:06:10.349424 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3353/6918] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:09 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1203 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:11.076246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-03dc504c-ad0d-4256-b2ce-69f8eb9346fe tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Action: 'create', calling method: .version_select at 0x7fc42bbae3a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-366525101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHTOHe21/BGTT6vVV3h+w32qvwAW22q4U6ZhZKeo0NnXFAHsDVGnjpQVbHuWhZj9JcjiTDB8SlLHN7H629waqcSzEQSIbLshqOHNXwl8XSEEDlZAPxPpMdOdsIgYPBl5Q=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:11.115560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-03dc504c-ad0d-4256-b2ce-69f8eb9346fe tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Getting quotas for project dc8a8f9ddd384ca2bcdacb55b92006d9. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:06:11.126043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-03dc504c-ad0d-4256-b2ce-69f8eb9346fe tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Getting quotas for user e2d56709bf4c41eeb6e15bcdfd140999 and project dc8a8f9ddd384ca2bcdacb55b92006d9. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:06:11.181744 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-03dc504c-ad0d-4256-b2ce-69f8eb9346fe tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.109415 Aug 29 16:06:11.182513 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3566/6919] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:06:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:11.370685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-789f1a4b-898f-465b-9010-99f77bf210dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:11.371221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-789f1a4b-898f-465b-9010-99f77bf210dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:11.382228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-789f1a4b-898f-465b-9010-99f77bf210dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:11.386846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-789f1a4b-898f-465b-9010-99f77bf210dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:11.387357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-789f1a4b-898f-465b-9010-99f77bf210dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:11.390266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-789f1a4b-898f-465b-9010-99f77bf210dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:11.390937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-789f1a4b-898f-465b-9010-99f77bf210dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:11.394070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-789f1a4b-898f-465b-9010-99f77bf210dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:12.106775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-789f1a4b-898f-465b-9010-99f77bf210dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:12.118391 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-789f1a4b-898f-465b-9010-99f77bf210dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1203 microversion: 2.1 time: 0.753358 Aug 29 16:06:12.119258 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3354/6920] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:11 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1203 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:12.686292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-477458071", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "3f8cd5d1-19c4-4eeb-8063-7e14196bb265"}], "key_name": "tempest-TestNetworkBasicOps-366525101", "security_groups": [{"name": "tempest-secgroup-smoke-319778882"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:12.812229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] validate_networks() for [('3f8cd5d1-19c4-4eeb-8063-7e14196bb265', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:06:13.153267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d055d9fd-ae84-41b7-ba9c-7a7774489649 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:13.155592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d055d9fd-ae84-41b7-ba9c-7a7774489649 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:13.164239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d055d9fd-ae84-41b7-ba9c-7a7774489649 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:13.165219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d055d9fd-ae84-41b7-ba9c-7a7774489649 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:13.166073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d055d9fd-ae84-41b7-ba9c-7a7774489649 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:13.166973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d055d9fd-ae84-41b7-ba9c-7a7774489649 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:13.168403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d055d9fd-ae84-41b7-ba9c-7a7774489649 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:13.169021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d055d9fd-ae84-41b7-ba9c-7a7774489649 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:13.346808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:06:13.347252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:06:13.347703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:06:13.348109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:06:13.348517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:06:13.357531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:13.358014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:13.358446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:13.359489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:13.359950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:13.360375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:13.378846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Getting quotas for project dc8a8f9ddd384ca2bcdacb55b92006d9. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:06:13.387640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Getting quotas for user e2d56709bf4c41eeb6e15bcdfd140999 and project dc8a8f9ddd384ca2bcdacb55b92006d9. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:06:13.401119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:06:13.403794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:06:13.412050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d055d9fd-ae84-41b7-ba9c-7a7774489649 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:13.422280 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d055d9fd-ae84-41b7-ba9c-7a7774489649 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1203 microversion: 2.1 time: 0.275281 Aug 29 16:06:13.439606 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3355/6921] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:13 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1203 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:13.465324 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f16660a1-1228-40b0-8d47-07fd8eca90da tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.784995 Aug 29 16:06:13.465978 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3567/6922] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:06:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:06:13.478411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7b85e6ad-1c16-4e40-8484-c7923c480d72 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:13.479147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7b85e6ad-1c16-4e40-8484-c7923c480d72 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:13.572680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7b85e6ad-1c16-4e40-8484-c7923c480d72 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:13.581250 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7b85e6ad-1c16-4e40-8484-c7923c480d72 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 200 len: 1247 microversion: 2.1 time: 0.106674 Aug 29 16:06:13.582244 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3356/6923] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:13 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 1247 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:14.228442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-d7dff15a-7f6c-4863-913e-713e255c5626 req-4c843968-6eb2-4b64-860c-99e96664f570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9509c4-ad08-4556-ad82-35a78cb8e902", "name": "network-vif-plugged", "status": "completed", "tag": "52ee53d2-5938-4d69-b660-91e78d7bd300"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:14.241029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d7dff15a-7f6c-4863-913e-713e255c5626 req-4c843968-6eb2-4b64-860c-99e96664f570 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:14.241797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d7dff15a-7f6c-4863-913e-713e255c5626 req-4c843968-6eb2-4b64-860c-99e96664f570 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:14.242409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d7dff15a-7f6c-4863-913e-713e255c5626 req-4c843968-6eb2-4b64-860c-99e96664f570 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:14.260772 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-d7dff15a-7f6c-4863-913e-713e255c5626 req-4c843968-6eb2-4b64-860c-99e96664f570 service nova] Creating event network-vif-plugged:52ee53d2-5938-4d69-b660-91e78d7bd300 for instance ce9509c4-ad08-4556-ad82-35a78cb8e902 on n-h2-839401-11 Aug 29 16:06:14.267769 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-d7dff15a-7f6c-4863-913e-713e255c5626 req-4c843968-6eb2-4b64-860c-99e96664f570 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042845 Aug 29 16:06:14.268897 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3568/6924] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:14.447968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2da5a2be-0bcb-428d-9937-caace2385bc3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:14.448680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2da5a2be-0bcb-428d-9937-caace2385bc3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:14.457399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2da5a2be-0bcb-428d-9937-caace2385bc3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:14.458196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2da5a2be-0bcb-428d-9937-caace2385bc3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:14.459524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2da5a2be-0bcb-428d-9937-caace2385bc3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:14.460748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2da5a2be-0bcb-428d-9937-caace2385bc3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:14.461213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2da5a2be-0bcb-428d-9937-caace2385bc3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:14.461984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2da5a2be-0bcb-428d-9937-caace2385bc3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:14.605766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ca36b1f0-c6c2-4d32-a4c8-425dffa9b7d5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:14.606808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ca36b1f0-c6c2-4d32-a4c8-425dffa9b7d5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:14.620659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca36b1f0-c6c2-4d32-a4c8-425dffa9b7d5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:14.624228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca36b1f0-c6c2-4d32-a4c8-425dffa9b7d5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:14.624762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca36b1f0-c6c2-4d32-a4c8-425dffa9b7d5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:14.628563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2da5a2be-0bcb-428d-9937-caace2385bc3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:14.633323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca36b1f0-c6c2-4d32-a4c8-425dffa9b7d5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:14.633834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca36b1f0-c6c2-4d32-a4c8-425dffa9b7d5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:14.634280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca36b1f0-c6c2-4d32-a4c8-425dffa9b7d5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:14.638275 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2da5a2be-0bcb-428d-9937-caace2385bc3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1203 microversion: 2.1 time: 0.194530 Aug 29 16:06:14.645607 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3357/6925] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:14 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1203 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:14.750117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ca36b1f0-c6c2-4d32-a4c8-425dffa9b7d5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:14.760019 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ca36b1f0-c6c2-4d32-a4c8-425dffa9b7d5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 200 len: 1299 microversion: 2.1 time: 0.159950 Aug 29 16:06:14.770246 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3569/6926] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:14 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 1299 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:15.662196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b6862f8a-6a5b-4dd1-aabc-1e4ba268d3ff tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:15.663544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b6862f8a-6a5b-4dd1-aabc-1e4ba268d3ff tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:15.671317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6862f8a-6a5b-4dd1-aabc-1e4ba268d3ff tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:15.672109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6862f8a-6a5b-4dd1-aabc-1e4ba268d3ff tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:15.672731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6862f8a-6a5b-4dd1-aabc-1e4ba268d3ff tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:15.673669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6862f8a-6a5b-4dd1-aabc-1e4ba268d3ff tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:15.674290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6862f8a-6a5b-4dd1-aabc-1e4ba268d3ff tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:15.674882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6862f8a-6a5b-4dd1-aabc-1e4ba268d3ff tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:15.783051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ca1a9fc6-ec80-4b0b-b4ae-bf6dbed8e9dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:15.783842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ca1a9fc6-ec80-4b0b-b4ae-bf6dbed8e9dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:15.791955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca1a9fc6-ec80-4b0b-b4ae-bf6dbed8e9dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:15.793528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca1a9fc6-ec80-4b0b-b4ae-bf6dbed8e9dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:15.793528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca1a9fc6-ec80-4b0b-b4ae-bf6dbed8e9dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:15.794310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca1a9fc6-ec80-4b0b-b4ae-bf6dbed8e9dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:15.795052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca1a9fc6-ec80-4b0b-b4ae-bf6dbed8e9dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:15.795666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca1a9fc6-ec80-4b0b-b4ae-bf6dbed8e9dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:15.933462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b6862f8a-6a5b-4dd1-aabc-1e4ba268d3ff tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:15.945329 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b6862f8a-6a5b-4dd1-aabc-1e4ba268d3ff tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1203 microversion: 2.1 time: 0.287369 Aug 29 16:06:15.946144 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3358/6927] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:15 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1203 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:16.086219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ca1a9fc6-ec80-4b0b-b4ae-bf6dbed8e9dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:16.094982 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ca1a9fc6-ec80-4b0b-b4ae-bf6dbed8e9dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 200 len: 1372 microversion: 2.1 time: 0.316308 Aug 29 16:06:16.108016 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3570/6928] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:15 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 1372 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:16.846235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-0df60000-2ec9-4ea3-a9c8-25be18ea9fe5 req-2d9e5e48-ca66-4951-9c99-60190c3dd899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea52328-23db-4bc0-966c-4505bcf3e518", "tag": "2e36b390-19b1-4545-8bf2-d5ed43dc59fb"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:16.859849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0df60000-2ec9-4ea3-a9c8-25be18ea9fe5 req-2d9e5e48-ca66-4951-9c99-60190c3dd899 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:16.860567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0df60000-2ec9-4ea3-a9c8-25be18ea9fe5 req-2d9e5e48-ca66-4951-9c99-60190c3dd899 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:16.861243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0df60000-2ec9-4ea3-a9c8-25be18ea9fe5 req-2d9e5e48-ca66-4951-9c99-60190c3dd899 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:16.875921 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-0df60000-2ec9-4ea3-a9c8-25be18ea9fe5 req-2d9e5e48-ca66-4951-9c99-60190c3dd899 service nova] Creating event network-changed:2e36b390-19b1-4545-8bf2-d5ed43dc59fb for instance 8ea52328-23db-4bc0-966c-4505bcf3e518 on n-h1-839401-11 Aug 29 16:06:16.882057 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-0df60000-2ec9-4ea3-a9c8-25be18ea9fe5 req-2d9e5e48-ca66-4951-9c99-60190c3dd899 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251154 Aug 29 16:06:16.883690 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3359/6929] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:16.969716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-60f699c1-61dc-4248-aee5-137e0b8ad706 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:16.970336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-60f699c1-61dc-4248-aee5-137e0b8ad706 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:16.977364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60f699c1-61dc-4248-aee5-137e0b8ad706 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:16.977832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60f699c1-61dc-4248-aee5-137e0b8ad706 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:16.978263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60f699c1-61dc-4248-aee5-137e0b8ad706 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:16.978958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60f699c1-61dc-4248-aee5-137e0b8ad706 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:16.979415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60f699c1-61dc-4248-aee5-137e0b8ad706 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:16.979839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60f699c1-61dc-4248-aee5-137e0b8ad706 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.116718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7ed5d4ac-fe6b-4013-82eb-95ff6e659948 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:17.117455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7ed5d4ac-fe6b-4013-82eb-95ff6e659948 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:17.123677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ed5d4ac-fe6b-4013-82eb-95ff6e659948 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:17.124189 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ed5d4ac-fe6b-4013-82eb-95ff6e659948 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:17.124916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ed5d4ac-fe6b-4013-82eb-95ff6e659948 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.125695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ed5d4ac-fe6b-4013-82eb-95ff6e659948 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:17.126133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ed5d4ac-fe6b-4013-82eb-95ff6e659948 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:17.126555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ed5d4ac-fe6b-4013-82eb-95ff6e659948 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.162552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-60f699c1-61dc-4248-aee5-137e0b8ad706 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:17.171255 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-60f699c1-61dc-4248-aee5-137e0b8ad706 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1390 microversion: 2.1 time: 0.205507 Aug 29 16:06:17.172233 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3571/6930] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:16 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1390 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:17.192689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0566453b-dfba-48f3-814a-d27d72de9a1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:17.193604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0566453b-dfba-48f3-814a-d27d72de9a1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:17.200147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0566453b-dfba-48f3-814a-d27d72de9a1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:17.200710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0566453b-dfba-48f3-814a-d27d72de9a1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:17.201246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0566453b-dfba-48f3-814a-d27d72de9a1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.202046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0566453b-dfba-48f3-814a-d27d72de9a1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:17.202727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0566453b-dfba-48f3-814a-d27d72de9a1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:17.203159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0566453b-dfba-48f3-814a-d27d72de9a1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.337997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0566453b-dfba-48f3-814a-d27d72de9a1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:17.346818 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0566453b-dfba-48f3-814a-d27d72de9a1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1390 microversion: 2.1 time: 0.158205 Aug 29 16:06:17.347429 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3572/6931] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:17 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:17.347774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7ed5d4ac-fe6b-4013-82eb-95ff6e659948 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:17.356114 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7ed5d4ac-fe6b-4013-82eb-95ff6e659948 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 200 len: 1372 microversion: 2.1 time: 0.243627 Aug 29 16:06:17.356687 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3360/6932] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:17 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 1372 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:17.367326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b3fb7874-3172-4e09-8f43-7498099716a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:17.368269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b3fb7874-3172-4e09-8f43-7498099716a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:17.375086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3fb7874-3172-4e09-8f43-7498099716a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:17.375605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3fb7874-3172-4e09-8f43-7498099716a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:17.376101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3fb7874-3172-4e09-8f43-7498099716a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.376940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3fb7874-3172-4e09-8f43-7498099716a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:17.377467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3fb7874-3172-4e09-8f43-7498099716a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:17.377954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b3fb7874-3172-4e09-8f43-7498099716a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.527490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b3fb7874-3172-4e09-8f43-7498099716a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:17.539123 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b3fb7874-3172-4e09-8f43-7498099716a0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1390 microversion: 2.1 time: 0.175367 Aug 29 16:06:17.539731 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3573/6933] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:17 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:17.559218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2a1e8799-5feb-4410-8ed5-5893831e933d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:17.559726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2a1e8799-5feb-4410-8ed5-5893831e933d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:17.565965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a1e8799-5feb-4410-8ed5-5893831e933d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:17.566491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a1e8799-5feb-4410-8ed5-5893831e933d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:17.566934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a1e8799-5feb-4410-8ed5-5893831e933d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.567639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a1e8799-5feb-4410-8ed5-5893831e933d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:17.568096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a1e8799-5feb-4410-8ed5-5893831e933d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:17.568522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a1e8799-5feb-4410-8ed5-5893831e933d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.593502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2a1e8799-5feb-4410-8ed5-5893831e933d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:06:17.701128 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2a1e8799-5feb-4410-8ed5-5893831e933d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 204 len: 0 microversion: 2.1 time: 0.144848 Aug 29 16:06:17.701743 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3361/6934] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:06:17 2022] DELETE /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:06:17.710180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d85433bf-02c9-426e-8a68-53462da67716 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:17.710833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d85433bf-02c9-426e-8a68-53462da67716 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:17.717263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85433bf-02c9-426e-8a68-53462da67716 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:17.717742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85433bf-02c9-426e-8a68-53462da67716 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:17.718289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85433bf-02c9-426e-8a68-53462da67716 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.719205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85433bf-02c9-426e-8a68-53462da67716 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:17.719704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85433bf-02c9-426e-8a68-53462da67716 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:17.720140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d85433bf-02c9-426e-8a68-53462da67716 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.858824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d85433bf-02c9-426e-8a68-53462da67716 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:17.866949 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d85433bf-02c9-426e-8a68-53462da67716 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1396 microversion: 2.1 time: 0.160748 Aug 29 16:06:17.867623 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3574/6935] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:17 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1396 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:18.378546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-881e5cf9-196a-4b65-86d0-8599fe1753f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:18.379921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-881e5cf9-196a-4b65-86d0-8599fe1753f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:18.387148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-881e5cf9-196a-4b65-86d0-8599fe1753f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:18.387717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-881e5cf9-196a-4b65-86d0-8599fe1753f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:18.388265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-881e5cf9-196a-4b65-86d0-8599fe1753f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:18.389215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-881e5cf9-196a-4b65-86d0-8599fe1753f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:18.389778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-881e5cf9-196a-4b65-86d0-8599fe1753f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:18.390232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-881e5cf9-196a-4b65-86d0-8599fe1753f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:18.610551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-881e5cf9-196a-4b65-86d0-8599fe1753f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:18.619147 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-881e5cf9-196a-4b65-86d0-8599fe1753f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 200 len: 1372 microversion: 2.1 time: 0.245478 Aug 29 16:06:18.619756 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3362/6936] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:18 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 1372 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:18.889293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e00e063b-9669-46a2-8ef0-25d96a419833 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:18.890054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e00e063b-9669-46a2-8ef0-25d96a419833 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:18.896992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e00e063b-9669-46a2-8ef0-25d96a419833 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:18.897529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e00e063b-9669-46a2-8ef0-25d96a419833 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:18.897973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e00e063b-9669-46a2-8ef0-25d96a419833 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:18.898669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e00e063b-9669-46a2-8ef0-25d96a419833 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:18.899133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e00e063b-9669-46a2-8ef0-25d96a419833 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:18.899567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e00e063b-9669-46a2-8ef0-25d96a419833 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:19.087297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e00e063b-9669-46a2-8ef0-25d96a419833 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:19.097130 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e00e063b-9669-46a2-8ef0-25d96a419833 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1396 microversion: 2.1 time: 0.211697 Aug 29 16:06:19.120404 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3575/6937] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:18 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1396 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:19.641253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-85c70d30-52b1-4eaf-a15f-751ba7b19a9e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:19.642559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-85c70d30-52b1-4eaf-a15f-751ba7b19a9e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:19.650126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85c70d30-52b1-4eaf-a15f-751ba7b19a9e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:19.650667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85c70d30-52b1-4eaf-a15f-751ba7b19a9e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:19.651103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85c70d30-52b1-4eaf-a15f-751ba7b19a9e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:19.651804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85c70d30-52b1-4eaf-a15f-751ba7b19a9e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:19.652241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85c70d30-52b1-4eaf-a15f-751ba7b19a9e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:19.652838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85c70d30-52b1-4eaf-a15f-751ba7b19a9e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:19.975643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-85c70d30-52b1-4eaf-a15f-751ba7b19a9e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:19.984793 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-85c70d30-52b1-4eaf-a15f-751ba7b19a9e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 200 len: 1372 microversion: 2.1 time: 0.347517 Aug 29 16:06:19.986410 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3363/6938] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:19 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 1372 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:20.120928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-21e0f50c-536b-4565-8c2b-15e9a06535ac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:20.122245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-21e0f50c-536b-4565-8c2b-15e9a06535ac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:20.129845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21e0f50c-536b-4565-8c2b-15e9a06535ac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:20.130512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21e0f50c-536b-4565-8c2b-15e9a06535ac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:20.130963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21e0f50c-536b-4565-8c2b-15e9a06535ac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:20.131697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21e0f50c-536b-4565-8c2b-15e9a06535ac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:20.132157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21e0f50c-536b-4565-8c2b-15e9a06535ac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:20.132951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-21e0f50c-536b-4565-8c2b-15e9a06535ac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:20.246454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-21e0f50c-536b-4565-8c2b-15e9a06535ac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:20.251155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-7ee64b37-db77-4024-bd19-1ac2aea744a2 req-e98e4d66-5e32-4f01-86b6-97000a531789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9509c4-ad08-4556-ad82-35a78cb8e902", "name": "network-vif-deleted", "tag": "52ee53d2-5938-4d69-b660-91e78d7bd300"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:20.266217 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-21e0f50c-536b-4565-8c2b-15e9a06535ac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1354 microversion: 2.1 time: 0.151357 Aug 29 16:06:20.270195 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3576/6939] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:20 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1354 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:20.272352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7ee64b37-db77-4024-bd19-1ac2aea744a2 req-e98e4d66-5e32-4f01-86b6-97000a531789 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:20.273147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7ee64b37-db77-4024-bd19-1ac2aea744a2 req-e98e4d66-5e32-4f01-86b6-97000a531789 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:20.273724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7ee64b37-db77-4024-bd19-1ac2aea744a2 req-e98e4d66-5e32-4f01-86b6-97000a531789 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:20.291480 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-7ee64b37-db77-4024-bd19-1ac2aea744a2 req-e98e4d66-5e32-4f01-86b6-97000a531789 service nova] Creating event network-vif-deleted:52ee53d2-5938-4d69-b660-91e78d7bd300 for instance ce9509c4-ad08-4556-ad82-35a78cb8e902 on n-h2-839401-11 Aug 29 16:06:20.296966 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-7ee64b37-db77-4024-bd19-1ac2aea744a2 req-e98e4d66-5e32-4f01-86b6-97000a531789 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056931 Aug 29 16:06:20.298565 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3364/6940] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:21.008168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0aa90655-9cfe-4405-a102-15d9bca7ed13 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:21.008769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0aa90655-9cfe-4405-a102-15d9bca7ed13 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:21.015431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0aa90655-9cfe-4405-a102-15d9bca7ed13 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:21.015922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0aa90655-9cfe-4405-a102-15d9bca7ed13 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:21.016381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0aa90655-9cfe-4405-a102-15d9bca7ed13 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:21.017140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0aa90655-9cfe-4405-a102-15d9bca7ed13 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:21.017805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0aa90655-9cfe-4405-a102-15d9bca7ed13 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:21.018420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0aa90655-9cfe-4405-a102-15d9bca7ed13 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:21.207968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0aa90655-9cfe-4405-a102-15d9bca7ed13 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:21.216463 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0aa90655-9cfe-4405-a102-15d9bca7ed13 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 200 len: 1372 microversion: 2.1 time: 0.212840 Aug 29 16:06:21.222248 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3577/6941] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:21 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:21.292080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-182e145e-b30c-4743-9dfc-d3b96c8d7074 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:21.292752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-182e145e-b30c-4743-9dfc-d3b96c8d7074 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:21.299967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-182e145e-b30c-4743-9dfc-d3b96c8d7074 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:21.300700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-182e145e-b30c-4743-9dfc-d3b96c8d7074 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:21.301344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-182e145e-b30c-4743-9dfc-d3b96c8d7074 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:21.302242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-182e145e-b30c-4743-9dfc-d3b96c8d7074 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:21.302698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-182e145e-b30c-4743-9dfc-d3b96c8d7074 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:21.303285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-182e145e-b30c-4743-9dfc-d3b96c8d7074 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:21.325206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:21.377851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-182e145e-b30c-4743-9dfc-d3b96c8d7074 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:21.387070 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-182e145e-b30c-4743-9dfc-d3b96c8d7074 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1188 microversion: 2.1 time: 0.100134 Aug 29 16:06:21.387649 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3365/6942] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:21 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1188 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:22.241980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ba3b4b77-ba5c-459b-b3db-63e6a6425439 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:22.242889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ba3b4b77-ba5c-459b-b3db-63e6a6425439 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:22.252309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba3b4b77-ba5c-459b-b3db-63e6a6425439 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:22.253021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba3b4b77-ba5c-459b-b3db-63e6a6425439 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:22.254128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba3b4b77-ba5c-459b-b3db-63e6a6425439 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:22.254855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba3b4b77-ba5c-459b-b3db-63e6a6425439 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:22.255558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba3b4b77-ba5c-459b-b3db-63e6a6425439 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:22.255998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba3b4b77-ba5c-459b-b3db-63e6a6425439 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:22.261436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:22.416940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c800544f-6dc8-4fb6-ac43-a954dfc6901f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:22.419209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c800544f-6dc8-4fb6-ac43-a954dfc6901f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:22.434773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c800544f-6dc8-4fb6-ac43-a954dfc6901f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:22.435719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c800544f-6dc8-4fb6-ac43-a954dfc6901f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:22.436371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c800544f-6dc8-4fb6-ac43-a954dfc6901f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:22.438473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c800544f-6dc8-4fb6-ac43-a954dfc6901f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:22.439354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c800544f-6dc8-4fb6-ac43-a954dfc6901f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:22.440001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c800544f-6dc8-4fb6-ac43-a954dfc6901f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:22.467311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ba3b4b77-ba5c-459b-b3db-63e6a6425439 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:22.487390 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ba3b4b77-ba5c-459b-b3db-63e6a6425439 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 200 len: 1372 microversion: 2.1 time: 0.249410 Aug 29 16:06:22.488401 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3578/6943] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:22 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 1372 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:22.552359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c800544f-6dc8-4fb6-ac43-a954dfc6901f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:22.568576 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c800544f-6dc8-4fb6-ac43-a954dfc6901f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1188 microversion: 2.1 time: 0.159026 Aug 29 16:06:22.575345 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3366/6944] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:22 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1188 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:23.509135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c2a73e2c-a268-45ee-8c3c-d58c63057edd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:23.509758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c2a73e2c-a268-45ee-8c3c-d58c63057edd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:23.512672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:23.513966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=10 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:23.515091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:23.520707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2a73e2c-a268-45ee-8c3c-d58c63057edd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:23.521451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2a73e2c-a268-45ee-8c3c-d58c63057edd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:23.522079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2a73e2c-a268-45ee-8c3c-d58c63057edd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:23.523085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2a73e2c-a268-45ee-8c3c-d58c63057edd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:23.523714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2a73e2c-a268-45ee-8c3c-d58c63057edd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:23.524196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2a73e2c-a268-45ee-8c3c-d58c63057edd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:23.589462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4c0d66e0-204d-47e0-a502-4b53fa932f80 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:23.590078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4c0d66e0-204d-47e0-a502-4b53fa932f80 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:23.593273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:23.599397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c0d66e0-204d-47e0-a502-4b53fa932f80 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:23.600006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c0d66e0-204d-47e0-a502-4b53fa932f80 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:23.600511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c0d66e0-204d-47e0-a502-4b53fa932f80 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:23.601318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c0d66e0-204d-47e0-a502-4b53fa932f80 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:23.601997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c0d66e0-204d-47e0-a502-4b53fa932f80 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:23.602582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4c0d66e0-204d-47e0-a502-4b53fa932f80 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:23.678462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c2a73e2c-a268-45ee-8c3c-d58c63057edd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:23.684757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4c0d66e0-204d-47e0-a502-4b53fa932f80 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:23.688192 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c2a73e2c-a268-45ee-8c3c-d58c63057edd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 200 len: 1372 microversion: 2.1 time: 0.184067 Aug 29 16:06:23.690133 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3579/6945] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:23 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:23.695544 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4c0d66e0-204d-47e0-a502-4b53fa932f80 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1188 microversion: 2.1 time: 0.110069 Aug 29 16:06:23.697153 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3367/6946] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:23 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1188 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:24.531875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a760a39b-68f1-452f-b111-19cd1c0b6b3f req-09f747e9-2c1d-4bfd-95e3-041e712c716a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea52328-23db-4bc0-966c-4505bcf3e518", "name": "network-vif-plugged", "status": "completed", "tag": "2e36b390-19b1-4545-8bf2-d5ed43dc59fb"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:24.543441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a760a39b-68f1-452f-b111-19cd1c0b6b3f req-09f747e9-2c1d-4bfd-95e3-041e712c716a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.544117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a760a39b-68f1-452f-b111-19cd1c0b6b3f req-09f747e9-2c1d-4bfd-95e3-041e712c716a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.544791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a760a39b-68f1-452f-b111-19cd1c0b6b3f req-09f747e9-2c1d-4bfd-95e3-041e712c716a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.558563 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a760a39b-68f1-452f-b111-19cd1c0b6b3f req-09f747e9-2c1d-4bfd-95e3-041e712c716a service nova] Creating event network-vif-plugged:2e36b390-19b1-4545-8bf2-d5ed43dc59fb for instance 8ea52328-23db-4bc0-966c-4505bcf3e518 on n-h1-839401-11 Aug 29 16:06:24.565063 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a760a39b-68f1-452f-b111-19cd1c0b6b3f req-09f747e9-2c1d-4bfd-95e3-041e712c716a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036971 Aug 29 16:06:24.566378 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3580/6947] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:24.713329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-da0c9813-b603-4738-a4fb-5ad572aa493a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:24.714628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-da0c9813-b603-4738-a4fb-5ad572aa493a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:24.718221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-540267e5-0ab0-401c-b90f-bc883a7ca071 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:24.719110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-540267e5-0ab0-401c-b90f-bc883a7ca071 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:24.723231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:24.724922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da0c9813-b603-4738-a4fb-5ad572aa493a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.725494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da0c9813-b603-4738-a4fb-5ad572aa493a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.726196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da0c9813-b603-4738-a4fb-5ad572aa493a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.726943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da0c9813-b603-4738-a4fb-5ad572aa493a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.727416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da0c9813-b603-4738-a4fb-5ad572aa493a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.727855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da0c9813-b603-4738-a4fb-5ad572aa493a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.728249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-540267e5-0ab0-401c-b90f-bc883a7ca071 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.728850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-540267e5-0ab0-401c-b90f-bc883a7ca071 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.729438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-540267e5-0ab0-401c-b90f-bc883a7ca071 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.730583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-540267e5-0ab0-401c-b90f-bc883a7ca071 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.731294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-540267e5-0ab0-401c-b90f-bc883a7ca071 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.731941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-540267e5-0ab0-401c-b90f-bc883a7ca071 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.792842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-540267e5-0ab0-401c-b90f-bc883a7ca071 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.793948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-540267e5-0ab0-401c-b90f-bc883a7ca071 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.794439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-540267e5-0ab0-401c-b90f-bc883a7ca071 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.795472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-540267e5-0ab0-401c-b90f-bc883a7ca071 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lazy-loading 'fault' on Instance uuid ce9509c4-ad08-4556-ad82-35a78cb8e902 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:06:24.854651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-540267e5-0ab0-401c-b90f-bc883a7ca071 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:24.863915 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-540267e5-0ab0-401c-b90f-bc883a7ca071 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 200 len: 1193 microversion: 2.1 time: 0.151595 Aug 29 16:06:24.864839 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3581/6948] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:24 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 1193 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:24.912314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-da0c9813-b603-4738-a4fb-5ad572aa493a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:24.920193 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-da0c9813-b603-4738-a4fb-5ad572aa493a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 200 len: 1372 microversion: 2.1 time: 0.212641 Aug 29 16:06:24.920793 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3368/6949] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:24 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:25.885200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cb8297c2-0381-48d4-b9d9-52b8856b7a5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:25.885826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cb8297c2-0381-48d4-b9d9-52b8856b7a5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: ce9509c4-ad08-4556-ad82-35a78cb8e902] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:25.892904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb8297c2-0381-48d4-b9d9-52b8856b7a5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:25.893422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb8297c2-0381-48d4-b9d9-52b8856b7a5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:25.893858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb8297c2-0381-48d4-b9d9-52b8856b7a5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:25.894548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb8297c2-0381-48d4-b9d9-52b8856b7a5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:25.895001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb8297c2-0381-48d4-b9d9-52b8856b7a5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:25.895441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb8297c2-0381-48d4-b9d9-52b8856b7a5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:25.910171 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-cb8297c2-0381-48d4-b9d9-52b8856b7a5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] HTTP exception thrown: Instance ce9509c4-ad08-4556-ad82-35a78cb8e902 could not be found. Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cb8297c2-0381-48d4-b9d9-52b8856b7a5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Request method failure captured: Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 HTTP/1.1 Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOPVKb3AKf05JOTmVWxg_YSLh_6aJQ1fwERqtRCNq2OGA-TgfvjQkO776TgAknFFnCA3k1v6BcT_thZ3YV-DMceZELFHu1q-Z_h1mjuaQAa75Kym14h4m_K8QcmdN6yIk-IwhACLHvRJHqBNwAzk2eiJecAZxJFQO9-ZjVx01ZUPXeU Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_688ed04d399247f0ac8a204967cdfa2a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}] Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestVolumeBootPattern-201560010 Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: f07d896c6764402999345759f2348080 Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance ce9509c4-ad08-4556-ad82-35a78cb8e902 could not be found. Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'ce9509c4-ad08-4556-ad82-35a78cb8e902'} Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9509c4-ad08-4556-ad82-35a78cb8e902 could not be found. Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9509c4-ad08-4556-ad82-35a78cb8e902 could not be found. Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:06:25.912003 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:06:25.920113 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:25.920113 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:06:25.920113 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:06:25.920113 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:06:25.920113 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:06:25.920113 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9509c4-ad08-4556-ad82-35a78cb8e902 could not be found. Aug 29 16:06:25.920113 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:06:25.920113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cb8297c2-0381-48d4-b9d9-52b8856b7a5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Returning 404 to user: Instance ce9509c4-ad08-4556-ad82-35a78cb8e902 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:06:25.920113 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cb8297c2-0381-48d4-b9d9-52b8856b7a5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902" status: 404 len: 111 microversion: 2.1 time: 0.032914 Aug 29 16:06:25.920113 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3582/6950] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:25 2022] GET /compute/v2.1/servers/ce9509c4-ad08-4556-ad82-35a78cb8e902 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:06:25.941547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-61606296-5c15-4be4-beb2-b704ee7b58ae tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:25.942151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-61606296-5c15-4be4-beb2-b704ee7b58ae tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:25.949044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61606296-5c15-4be4-beb2-b704ee7b58ae tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:25.949574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61606296-5c15-4be4-beb2-b704ee7b58ae tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:25.950016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61606296-5c15-4be4-beb2-b704ee7b58ae tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:25.950713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61606296-5c15-4be4-beb2-b704ee7b58ae tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:25.951380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61606296-5c15-4be4-beb2-b704ee7b58ae tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:25.951805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61606296-5c15-4be4-beb2-b704ee7b58ae tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:26.143484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-61606296-5c15-4be4-beb2-b704ee7b58ae tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:26.151794 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-61606296-5c15-4be4-beb2-b704ee7b58ae tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 200 len: 1372 microversion: 2.1 time: 0.214087 Aug 29 16:06:26.153169 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3369/6951] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:25 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:27.174594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ff1f5424-fc5d-44d8-8f1b-47e1dcdbb7d3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:27.175271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ff1f5424-fc5d-44d8-8f1b-47e1dcdbb7d3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:27.182385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff1f5424-fc5d-44d8-8f1b-47e1dcdbb7d3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:27.182872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff1f5424-fc5d-44d8-8f1b-47e1dcdbb7d3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:27.183309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff1f5424-fc5d-44d8-8f1b-47e1dcdbb7d3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:27.184142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff1f5424-fc5d-44d8-8f1b-47e1dcdbb7d3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:27.184604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff1f5424-fc5d-44d8-8f1b-47e1dcdbb7d3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:27.185029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff1f5424-fc5d-44d8-8f1b-47e1dcdbb7d3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:27.333059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ff1f5424-fc5d-44d8-8f1b-47e1dcdbb7d3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:27.341703 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ff1f5424-fc5d-44d8-8f1b-47e1dcdbb7d3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 200 len: 1543 microversion: 2.1 time: 0.171256 Aug 29 16:06:27.342273 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3583/6952] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:27 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 1543 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:27.364503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a8daefee-e88e-40fb-b187-f96cdcf92c32 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:27.365761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a8daefee-e88e-40fb-b187-f96cdcf92c32 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:27.372752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8daefee-e88e-40fb-b187-f96cdcf92c32 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:27.373292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8daefee-e88e-40fb-b187-f96cdcf92c32 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:27.373738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8daefee-e88e-40fb-b187-f96cdcf92c32 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:27.374474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8daefee-e88e-40fb-b187-f96cdcf92c32 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:27.374935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8daefee-e88e-40fb-b187-f96cdcf92c32 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:27.375366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8daefee-e88e-40fb-b187-f96cdcf92c32 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:27.529803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a8daefee-e88e-40fb-b187-f96cdcf92c32 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:27.538135 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a8daefee-e88e-40fb-b187-f96cdcf92c32 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 200 len: 1543 microversion: 2.1 time: 0.177521 Aug 29 16:06:27.538726 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3370/6953] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:27 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 1543 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:29.733609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-6028d0b2-603d-410a-9c9e-69320b1778b1 req-1f893a71-9b0c-43b7-a869-a696777e7271 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea52328-23db-4bc0-966c-4505bcf3e518", "tag": "2e36b390-19b1-4545-8bf2-d5ed43dc59fb"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:29.751933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6028d0b2-603d-410a-9c9e-69320b1778b1 req-1f893a71-9b0c-43b7-a869-a696777e7271 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:29.759065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6028d0b2-603d-410a-9c9e-69320b1778b1 req-1f893a71-9b0c-43b7-a869-a696777e7271 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:29.775156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6028d0b2-603d-410a-9c9e-69320b1778b1 req-1f893a71-9b0c-43b7-a869-a696777e7271 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:29.814126 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-6028d0b2-603d-410a-9c9e-69320b1778b1 req-1f893a71-9b0c-43b7-a869-a696777e7271 service nova] Creating event network-changed:2e36b390-19b1-4545-8bf2-d5ed43dc59fb for instance 8ea52328-23db-4bc0-966c-4505bcf3e518 on n-h1-839401-11 Aug 29 16:06:29.824456 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-6028d0b2-603d-410a-9c9e-69320b1778b1 req-1f893a71-9b0c-43b7-a869-a696777e7271 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094945 Aug 29 16:06:29.836547 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3584/6954] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:06:32.235466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1536049061", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "94e8ea43-8ea6-41ca-b103-9a4b482ea603", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "957b06a2-5b5b-41f0-883f-0990cab206d9"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:32.297564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] validate_networks() for [('957b06a2-5b5b-41f0-883f-0990cab206d9', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:06:32.837638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:06:32.838142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:06:32.838693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:06:32.839205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:06:32.839691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:06:32.850574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:32.851066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:32.851511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:32.852238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:32.852699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:32.853165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:32.870060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:06:32.875402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for user f07d896c6764402999345759f2348080 and project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:06:32.939758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:06:32.941944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94e8ea43-8ea6-41ca-b103-9a4b482ea603',volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:06:33.080311 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ad6e6f6e-8249-40b6-80e2-789d14f2734f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848759 Aug 29 16:06:33.081371 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3371/6955] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:06:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:06:33.093121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d9c6b1b2-08ba-4131-8ad3-dc921ef822f0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:33.093751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d9c6b1b2-08ba-4131-8ad3-dc921ef822f0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:33.151589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d9c6b1b2-08ba-4131-8ad3-dc921ef822f0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:33.160455 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d9c6b1b2-08ba-4131-8ad3-dc921ef822f0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1057 microversion: 2.1 time: 0.071224 Aug 29 16:06:33.161366 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3585/6956] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:33 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1057 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:34.181949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4271a086-0b0b-4759-b45c-5fcbe78de56f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:34.182677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4271a086-0b0b-4759-b45c-5fcbe78de56f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:34.190405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4271a086-0b0b-4759-b45c-5fcbe78de56f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:34.191198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4271a086-0b0b-4759-b45c-5fcbe78de56f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:34.191860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4271a086-0b0b-4759-b45c-5fcbe78de56f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:34.193033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4271a086-0b0b-4759-b45c-5fcbe78de56f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:34.193697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4271a086-0b0b-4759-b45c-5fcbe78de56f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:34.194339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4271a086-0b0b-4759-b45c-5fcbe78de56f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:34.292382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4271a086-0b0b-4759-b45c-5fcbe78de56f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:34.305587 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4271a086-0b0b-4759-b45c-5fcbe78de56f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1163 microversion: 2.1 time: 0.127964 Aug 29 16:06:34.306167 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3372/6957] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:34 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1163 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:35.327634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-30fc84ee-01c6-42be-a149-565258d74ffa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:35.329152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-30fc84ee-01c6-42be-a149-565258d74ffa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:35.347994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30fc84ee-01c6-42be-a149-565258d74ffa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:35.348883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30fc84ee-01c6-42be-a149-565258d74ffa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:35.349578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30fc84ee-01c6-42be-a149-565258d74ffa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:35.350693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30fc84ee-01c6-42be-a149-565258d74ffa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:35.351358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30fc84ee-01c6-42be-a149-565258d74ffa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:35.351991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30fc84ee-01c6-42be-a149-565258d74ffa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:35.583179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-30fc84ee-01c6-42be-a149-565258d74ffa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:35.592273 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-30fc84ee-01c6-42be-a149-565258d74ffa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1215 microversion: 2.1 time: 0.269180 Aug 29 16:06:35.593250 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3586/6958] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:35 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1215 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:35.876413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-cb632dcf-45c4-4e9c-a72b-0557b0e5e03c req-6d85ff6c-e128-4659-b607-bb5086b12535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e40ebfdc-e7a2-4f20-a67d-1c4c37470bea", "tag": "ca935e5a-7e47-4b9b-ab4a-2ec193cbd524"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:35.889961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cb632dcf-45c4-4e9c-a72b-0557b0e5e03c req-6d85ff6c-e128-4659-b607-bb5086b12535 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:35.890756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cb632dcf-45c4-4e9c-a72b-0557b0e5e03c req-6d85ff6c-e128-4659-b607-bb5086b12535 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:35.891411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-cb632dcf-45c4-4e9c-a72b-0557b0e5e03c req-6d85ff6c-e128-4659-b607-bb5086b12535 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:35.904327 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-cb632dcf-45c4-4e9c-a72b-0557b0e5e03c req-6d85ff6c-e128-4659-b607-bb5086b12535 service nova] Creating event network-changed:ca935e5a-7e47-4b9b-ab4a-2ec193cbd524 for instance e40ebfdc-e7a2-4f20-a67d-1c4c37470bea on n-h2-839401-11 Aug 29 16:06:35.910289 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-cb632dcf-45c4-4e9c-a72b-0557b0e5e03c req-6d85ff6c-e128-4659-b607-bb5086b12535 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038359 Aug 29 16:06:35.911605 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3373/6959] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:36.618765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2df9bd7d-ad03-4394-b9c6-e754f30466c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:36.620232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2df9bd7d-ad03-4394-b9c6-e754f30466c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:36.628629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2df9bd7d-ad03-4394-b9c6-e754f30466c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:36.629502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2df9bd7d-ad03-4394-b9c6-e754f30466c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:36.630160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2df9bd7d-ad03-4394-b9c6-e754f30466c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:36.631152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2df9bd7d-ad03-4394-b9c6-e754f30466c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:36.632008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2df9bd7d-ad03-4394-b9c6-e754f30466c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:36.633195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2df9bd7d-ad03-4394-b9c6-e754f30466c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:36.824531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2df9bd7d-ad03-4394-b9c6-e754f30466c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:36.840775 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2df9bd7d-ad03-4394-b9c6-e754f30466c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1215 microversion: 2.1 time: 0.230653 Aug 29 16:06:36.853124 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3587/6960] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:36 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1215 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:37.865556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f9b0ce6d-ee03-48ab-8f91-31421e657adf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:37.867201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f9b0ce6d-ee03-48ab-8f91-31421e657adf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:37.873930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9b0ce6d-ee03-48ab-8f91-31421e657adf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:37.874742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9b0ce6d-ee03-48ab-8f91-31421e657adf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:37.875402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9b0ce6d-ee03-48ab-8f91-31421e657adf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:37.876303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9b0ce6d-ee03-48ab-8f91-31421e657adf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:37.876922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9b0ce6d-ee03-48ab-8f91-31421e657adf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:37.877620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9b0ce6d-ee03-48ab-8f91-31421e657adf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:38.029185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f9b0ce6d-ee03-48ab-8f91-31421e657adf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:38.040645 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f9b0ce6d-ee03-48ab-8f91-31421e657adf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1215 microversion: 2.1 time: 0.180229 Aug 29 16:06:38.050112 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3374/6961] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:37 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:39.063440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e65aa1cb-4596-4813-8c86-c13c40e00000 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:39.064100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e65aa1cb-4596-4813-8c86-c13c40e00000 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:39.072030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e65aa1cb-4596-4813-8c86-c13c40e00000 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:39.072597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e65aa1cb-4596-4813-8c86-c13c40e00000 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:39.073248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e65aa1cb-4596-4813-8c86-c13c40e00000 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:39.074126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e65aa1cb-4596-4813-8c86-c13c40e00000 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:39.074724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e65aa1cb-4596-4813-8c86-c13c40e00000 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:39.075408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e65aa1cb-4596-4813-8c86-c13c40e00000 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:39.242170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e65aa1cb-4596-4813-8c86-c13c40e00000 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:39.253523 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e65aa1cb-4596-4813-8c86-c13c40e00000 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1215 microversion: 2.1 time: 0.194406 Aug 29 16:06:39.254141 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3588/6962] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:39 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1215 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:40.275213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8a9ce61d-cff8-4355-9658-852bcf55dce6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:40.276555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8a9ce61d-cff8-4355-9658-852bcf55dce6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:40.284327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a9ce61d-cff8-4355-9658-852bcf55dce6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:40.284926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a9ce61d-cff8-4355-9658-852bcf55dce6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:40.285291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a9ce61d-cff8-4355-9658-852bcf55dce6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:40.286018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a9ce61d-cff8-4355-9658-852bcf55dce6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:40.286472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a9ce61d-cff8-4355-9658-852bcf55dce6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:40.286925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a9ce61d-cff8-4355-9658-852bcf55dce6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:40.431317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8a9ce61d-cff8-4355-9658-852bcf55dce6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:40.439693 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8a9ce61d-cff8-4355-9658-852bcf55dce6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1203 microversion: 2.1 time: 0.168851 Aug 29 16:06:40.440503 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3375/6963] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:40 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:41.461942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-79d3d62b-1010-4449-b45c-601ebb87bf38 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:41.463227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-79d3d62b-1010-4449-b45c-601ebb87bf38 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:41.470367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79d3d62b-1010-4449-b45c-601ebb87bf38 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:41.470860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79d3d62b-1010-4449-b45c-601ebb87bf38 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:41.471303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79d3d62b-1010-4449-b45c-601ebb87bf38 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:41.472007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79d3d62b-1010-4449-b45c-601ebb87bf38 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:41.472468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79d3d62b-1010-4449-b45c-601ebb87bf38 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:41.472898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79d3d62b-1010-4449-b45c-601ebb87bf38 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:41.612090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-79d3d62b-1010-4449-b45c-601ebb87bf38 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:41.620695 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-79d3d62b-1010-4449-b45c-601ebb87bf38 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1203 microversion: 2.1 time: 0.162528 Aug 29 16:06:41.625486 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3589/6964] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:41 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:42.641819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fe961b37-5459-4acd-96af-206124e62d21 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:42.642462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fe961b37-5459-4acd-96af-206124e62d21 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:42.649842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe961b37-5459-4acd-96af-206124e62d21 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:42.650327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe961b37-5459-4acd-96af-206124e62d21 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:42.650759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe961b37-5459-4acd-96af-206124e62d21 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:42.651433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe961b37-5459-4acd-96af-206124e62d21 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:42.651885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe961b37-5459-4acd-96af-206124e62d21 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:42.652308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe961b37-5459-4acd-96af-206124e62d21 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:42.796020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fe961b37-5459-4acd-96af-206124e62d21 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:42.804140 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fe961b37-5459-4acd-96af-206124e62d21 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1203 microversion: 2.1 time: 0.166243 Aug 29 16:06:42.804762 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3376/6965] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:42 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:43.825423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1f39d7c5-eb75-4d96-9fec-f1445dacb524 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:43.826106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1f39d7c5-eb75-4d96-9fec-f1445dacb524 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:43.829145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:43.835168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f39d7c5-eb75-4d96-9fec-f1445dacb524 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:43.835660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f39d7c5-eb75-4d96-9fec-f1445dacb524 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:43.836103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f39d7c5-eb75-4d96-9fec-f1445dacb524 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:43.836815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f39d7c5-eb75-4d96-9fec-f1445dacb524 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:43.837437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f39d7c5-eb75-4d96-9fec-f1445dacb524 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:43.837876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f39d7c5-eb75-4d96-9fec-f1445dacb524 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:43.979456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1f39d7c5-eb75-4d96-9fec-f1445dacb524 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:43.988337 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1f39d7c5-eb75-4d96-9fec-f1445dacb524 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1203 microversion: 2.1 time: 0.166892 Aug 29 16:06:43.989270 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3590/6966] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:43 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:45.009261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1459ea8b-f9db-4b98-9d9f-49954c38b4c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:45.009870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1459ea8b-f9db-4b98-9d9f-49954c38b4c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:45.012144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:45.012994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:45.019825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1459ea8b-f9db-4b98-9d9f-49954c38b4c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:45.020332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1459ea8b-f9db-4b98-9d9f-49954c38b4c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:45.020763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1459ea8b-f9db-4b98-9d9f-49954c38b4c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:45.021526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1459ea8b-f9db-4b98-9d9f-49954c38b4c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:45.022005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1459ea8b-f9db-4b98-9d9f-49954c38b4c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:45.022398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1459ea8b-f9db-4b98-9d9f-49954c38b4c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:45.176723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1459ea8b-f9db-4b98-9d9f-49954c38b4c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:45.186701 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1459ea8b-f9db-4b98-9d9f-49954c38b4c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1203 microversion: 2.1 time: 0.181622 Aug 29 16:06:45.187380 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3377/6967] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:45 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1203 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:46.207731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24f3b821-c491-443f-ad6f-8f8128cbd49e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:46.208618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-24f3b821-c491-443f-ad6f-8f8128cbd49e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:46.215836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24f3b821-c491-443f-ad6f-8f8128cbd49e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:46.216322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24f3b821-c491-443f-ad6f-8f8128cbd49e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:46.216757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24f3b821-c491-443f-ad6f-8f8128cbd49e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:46.217511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24f3b821-c491-443f-ad6f-8f8128cbd49e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:46.217967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24f3b821-c491-443f-ad6f-8f8128cbd49e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:46.218567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24f3b821-c491-443f-ad6f-8f8128cbd49e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:46.374255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-24f3b821-c491-443f-ad6f-8f8128cbd49e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:46.384003 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-24f3b821-c491-443f-ad6f-8f8128cbd49e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1203 microversion: 2.1 time: 0.180267 Aug 29 16:06:46.384671 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3591/6968] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:46 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1203 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:47.405904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ae0dccc0-fb34-4048-a040-270d5f1742cb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:47.406543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ae0dccc0-fb34-4048-a040-270d5f1742cb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:47.413770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae0dccc0-fb34-4048-a040-270d5f1742cb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:47.414270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae0dccc0-fb34-4048-a040-270d5f1742cb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:47.414847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae0dccc0-fb34-4048-a040-270d5f1742cb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:47.415568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae0dccc0-fb34-4048-a040-270d5f1742cb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:47.416050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae0dccc0-fb34-4048-a040-270d5f1742cb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:47.416478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ae0dccc0-fb34-4048-a040-270d5f1742cb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:47.896910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ae0dccc0-fb34-4048-a040-270d5f1742cb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:47.904998 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ae0dccc0-fb34-4048-a040-270d5f1742cb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1203 microversion: 2.1 time: 0.504205 Aug 29 16:06:47.905675 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3378/6969] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:47 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1203 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:48.927350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-23af2f79-5398-4c98-9533-54d1f71fa514 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:48.927964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-23af2f79-5398-4c98-9533-54d1f71fa514 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:48.935693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23af2f79-5398-4c98-9533-54d1f71fa514 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:48.936271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23af2f79-5398-4c98-9533-54d1f71fa514 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:48.936860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23af2f79-5398-4c98-9533-54d1f71fa514 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:48.937701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23af2f79-5398-4c98-9533-54d1f71fa514 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:48.938252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23af2f79-5398-4c98-9533-54d1f71fa514 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:48.938755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23af2f79-5398-4c98-9533-54d1f71fa514 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:49.073653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-23af2f79-5398-4c98-9533-54d1f71fa514 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:49.081710 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-23af2f79-5398-4c98-9533-54d1f71fa514 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1203 microversion: 2.1 time: 0.159385 Aug 29 16:06:49.082277 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3592/6970] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:48 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:50.108271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c3b619c1-cf8c-4220-94ec-f62e29cde45b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:50.108956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c3b619c1-cf8c-4220-94ec-f62e29cde45b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:50.116636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3b619c1-cf8c-4220-94ec-f62e29cde45b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:50.116902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3b619c1-cf8c-4220-94ec-f62e29cde45b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:50.117436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3b619c1-cf8c-4220-94ec-f62e29cde45b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:50.118180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3b619c1-cf8c-4220-94ec-f62e29cde45b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:50.118639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3b619c1-cf8c-4220-94ec-f62e29cde45b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:50.119064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3b619c1-cf8c-4220-94ec-f62e29cde45b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:50.262681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c3b619c1-cf8c-4220-94ec-f62e29cde45b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:50.272712 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c3b619c1-cf8c-4220-94ec-f62e29cde45b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1203 microversion: 2.1 time: 0.175139 Aug 29 16:06:50.277196 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3379/6971] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:50 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1203 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:50.345419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-737af613-93a1-4fa9-930e-c9d5961f5dde req-b1e82706-bfe8-47ed-bf2e-18f507668a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40ebfdc-e7a2-4f20-a67d-1c4c37470bea", "name": "network-vif-plugged", "status": "completed", "tag": "ca935e5a-7e47-4b9b-ab4a-2ec193cbd524"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:50.359179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-737af613-93a1-4fa9-930e-c9d5961f5dde req-b1e82706-bfe8-47ed-bf2e-18f507668a92 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:50.359777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-737af613-93a1-4fa9-930e-c9d5961f5dde req-b1e82706-bfe8-47ed-bf2e-18f507668a92 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:50.360264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-737af613-93a1-4fa9-930e-c9d5961f5dde req-b1e82706-bfe8-47ed-bf2e-18f507668a92 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:50.372119 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-737af613-93a1-4fa9-930e-c9d5961f5dde req-b1e82706-bfe8-47ed-bf2e-18f507668a92 service nova] Creating event network-vif-plugged:ca935e5a-7e47-4b9b-ab4a-2ec193cbd524 for instance e40ebfdc-e7a2-4f20-a67d-1c4c37470bea on n-h2-839401-11 Aug 29 16:06:50.378008 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-737af613-93a1-4fa9-930e-c9d5961f5dde req-b1e82706-bfe8-47ed-bf2e-18f507668a92 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036975 Aug 29 16:06:50.379052 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3593/6972] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:06:51.294262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1f741873-213b-4a16-86c7-537530c84040 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:51.294859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1f741873-213b-4a16-86c7-537530c84040 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:51.302003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f741873-213b-4a16-86c7-537530c84040 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:51.302482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f741873-213b-4a16-86c7-537530c84040 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:51.302948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f741873-213b-4a16-86c7-537530c84040 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:51.303668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f741873-213b-4a16-86c7-537530c84040 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:51.304188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f741873-213b-4a16-86c7-537530c84040 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:51.304615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f741873-213b-4a16-86c7-537530c84040 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:51.444481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1f741873-213b-4a16-86c7-537530c84040 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:51.447196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=85 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:51.456727 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1f741873-213b-4a16-86c7-537530c84040 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1203 microversion: 2.1 time: 0.166375 Aug 29 16:06:51.457245 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3380/6973] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:51 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:52.482416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8e4a184a-2ade-4c91-ba8d-419e9342d73c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:52.483570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8e4a184a-2ade-4c91-ba8d-419e9342d73c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:52.495448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e4a184a-2ade-4c91-ba8d-419e9342d73c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.496251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e4a184a-2ade-4c91-ba8d-419e9342d73c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.496970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e4a184a-2ade-4c91-ba8d-419e9342d73c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.498183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e4a184a-2ade-4c91-ba8d-419e9342d73c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.498940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e4a184a-2ade-4c91-ba8d-419e9342d73c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.499614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e4a184a-2ade-4c91-ba8d-419e9342d73c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.502334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=75 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:52.642799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8e4a184a-2ade-4c91-ba8d-419e9342d73c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:52.651865 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8e4a184a-2ade-4c91-ba8d-419e9342d73c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1390 microversion: 2.1 time: 0.176678 Aug 29 16:06:52.652479 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3594/6974] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:52 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1390 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:52.672246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-24600a8f-248e-4094-aa6e-3242f2e8bbbb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:52.672871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-24600a8f-248e-4094-aa6e-3242f2e8bbbb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:52.680385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24600a8f-248e-4094-aa6e-3242f2e8bbbb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.680944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24600a8f-248e-4094-aa6e-3242f2e8bbbb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.681537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24600a8f-248e-4094-aa6e-3242f2e8bbbb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.682346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24600a8f-248e-4094-aa6e-3242f2e8bbbb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.682870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24600a8f-248e-4094-aa6e-3242f2e8bbbb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.683334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24600a8f-248e-4094-aa6e-3242f2e8bbbb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.822355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-24600a8f-248e-4094-aa6e-3242f2e8bbbb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:52.849782 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-24600a8f-248e-4094-aa6e-3242f2e8bbbb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1390 microversion: 2.1 time: 0.181345 Aug 29 16:06:52.850358 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3381/6975] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:52 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1390 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:52.869486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-887a948b-639a-4326-98e8-98a5a2f826a2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:52.870113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-887a948b-639a-4326-98e8-98a5a2f826a2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:52.876974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-887a948b-639a-4326-98e8-98a5a2f826a2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.877515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-887a948b-639a-4326-98e8-98a5a2f826a2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.877961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-887a948b-639a-4326-98e8-98a5a2f826a2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.878675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-887a948b-639a-4326-98e8-98a5a2f826a2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.879136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-887a948b-639a-4326-98e8-98a5a2f826a2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.879568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-887a948b-639a-4326-98e8-98a5a2f826a2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:53.024704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-887a948b-639a-4326-98e8-98a5a2f826a2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:53.032735 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-887a948b-639a-4326-98e8-98a5a2f826a2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1390 microversion: 2.1 time: 0.167523 Aug 29 16:06:53.033360 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3595/6976] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:52 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:53.053664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9ecfe716-ab56-44dd-aff1-2847502d310f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:53.054178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9ecfe716-ab56-44dd-aff1-2847502d310f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:53.060571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ecfe716-ab56-44dd-aff1-2847502d310f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:53.061061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ecfe716-ab56-44dd-aff1-2847502d310f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:53.061562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ecfe716-ab56-44dd-aff1-2847502d310f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:53.062263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ecfe716-ab56-44dd-aff1-2847502d310f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:53.062727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ecfe716-ab56-44dd-aff1-2847502d310f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:53.063162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ecfe716-ab56-44dd-aff1-2847502d310f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:53.088743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9ecfe716-ab56-44dd-aff1-2847502d310f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:06:53.179915 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9ecfe716-ab56-44dd-aff1-2847502d310f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 204 len: 0 microversion: 2.1 time: 0.129887 Aug 29 16:06:53.180538 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3382/6977] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:06:53 2022] DELETE /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:06:53.189228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6754f0bb-035e-4072-9ade-f1f9fb59721c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:53.189925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6754f0bb-035e-4072-9ade-f1f9fb59721c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:53.196241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6754f0bb-035e-4072-9ade-f1f9fb59721c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:53.196844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6754f0bb-035e-4072-9ade-f1f9fb59721c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:53.197372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6754f0bb-035e-4072-9ade-f1f9fb59721c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:53.198090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6754f0bb-035e-4072-9ade-f1f9fb59721c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:53.198548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6754f0bb-035e-4072-9ade-f1f9fb59721c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:53.199134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6754f0bb-035e-4072-9ade-f1f9fb59721c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:53.335218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6754f0bb-035e-4072-9ade-f1f9fb59721c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:53.343617 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6754f0bb-035e-4072-9ade-f1f9fb59721c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1396 microversion: 2.1 time: 0.158691 Aug 29 16:06:53.344224 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3596/6978] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:53 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1396 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:54.369897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-37a5ce0b-8f56-464d-8c78-acd9d657aba0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:54.371159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-37a5ce0b-8f56-464d-8c78-acd9d657aba0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:54.383153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37a5ce0b-8f56-464d-8c78-acd9d657aba0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:54.383955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37a5ce0b-8f56-464d-8c78-acd9d657aba0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:54.384681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37a5ce0b-8f56-464d-8c78-acd9d657aba0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:54.385996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37a5ce0b-8f56-464d-8c78-acd9d657aba0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:54.386764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37a5ce0b-8f56-464d-8c78-acd9d657aba0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:54.387481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37a5ce0b-8f56-464d-8c78-acd9d657aba0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:54.528580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-37a5ce0b-8f56-464d-8c78-acd9d657aba0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:54.536626 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-37a5ce0b-8f56-464d-8c78-acd9d657aba0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1396 microversion: 2.1 time: 0.174108 Aug 29 16:06:54.537236 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3383/6979] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:54 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1396 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:55.481955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e840db71-a788-4ba3-b2d2-741881e7e92b req-3748948b-db54-4d3f-a1dc-9d055a3126b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40ebfdc-e7a2-4f20-a67d-1c4c37470bea", "name": "network-vif-deleted", "tag": "ca935e5a-7e47-4b9b-ab4a-2ec193cbd524"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:55.487868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=40 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:55.494786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e840db71-a788-4ba3-b2d2-741881e7e92b req-3748948b-db54-4d3f-a1dc-9d055a3126b7 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:55.495275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e840db71-a788-4ba3-b2d2-741881e7e92b req-3748948b-db54-4d3f-a1dc-9d055a3126b7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:55.495713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e840db71-a788-4ba3-b2d2-741881e7e92b req-3748948b-db54-4d3f-a1dc-9d055a3126b7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:55.508853 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e840db71-a788-4ba3-b2d2-741881e7e92b req-3748948b-db54-4d3f-a1dc-9d055a3126b7 service nova] Creating event network-vif-deleted:ca935e5a-7e47-4b9b-ab4a-2ec193cbd524 for instance e40ebfdc-e7a2-4f20-a67d-1c4c37470bea on n-h2-839401-11 Aug 29 16:06:55.514429 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e840db71-a788-4ba3-b2d2-741881e7e92b req-3748948b-db54-4d3f-a1dc-9d055a3126b7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036155 Aug 29 16:06:55.515130 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3597/6980] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:55.557899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d6ce8c25-e027-432d-854d-ad86dcd1b0d3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:55.558664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d6ce8c25-e027-432d-854d-ad86dcd1b0d3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:55.562829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:55.567047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6ce8c25-e027-432d-854d-ad86dcd1b0d3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:55.567665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6ce8c25-e027-432d-854d-ad86dcd1b0d3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:55.568173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6ce8c25-e027-432d-854d-ad86dcd1b0d3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:55.568892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6ce8c25-e027-432d-854d-ad86dcd1b0d3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:55.569389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6ce8c25-e027-432d-854d-ad86dcd1b0d3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:55.569818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6ce8c25-e027-432d-854d-ad86dcd1b0d3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:55.642510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d6ce8c25-e027-432d-854d-ad86dcd1b0d3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:55.650769 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d6ce8c25-e027-432d-854d-ad86dcd1b0d3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1188 microversion: 2.1 time: 0.097437 Aug 29 16:06:55.651346 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3384/6981] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:55 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1188 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:56.673363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c853cf8e-b4c4-47e1-9ea7-628fdc0b65a4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:56.674011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c853cf8e-b4c4-47e1-9ea7-628fdc0b65a4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:56.680954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c853cf8e-b4c4-47e1-9ea7-628fdc0b65a4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:56.681488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c853cf8e-b4c4-47e1-9ea7-628fdc0b65a4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:56.681934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c853cf8e-b4c4-47e1-9ea7-628fdc0b65a4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:56.682647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c853cf8e-b4c4-47e1-9ea7-628fdc0b65a4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:56.683123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c853cf8e-b4c4-47e1-9ea7-628fdc0b65a4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:56.683557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c853cf8e-b4c4-47e1-9ea7-628fdc0b65a4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:56.750212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c853cf8e-b4c4-47e1-9ea7-628fdc0b65a4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:56.759000 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c853cf8e-b4c4-47e1-9ea7-628fdc0b65a4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1188 microversion: 2.1 time: 0.091213 Aug 29 16:06:56.759585 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3598/6982] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:56 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:57.779559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-97728fd1-ec63-480f-98d2-93fb800fc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:57.780135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-97728fd1-ec63-480f-98d2-93fb800fc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:57.787971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97728fd1-ec63-480f-98d2-93fb800fc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:57.788509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97728fd1-ec63-480f-98d2-93fb800fc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:57.788906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97728fd1-ec63-480f-98d2-93fb800fc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:57.789686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97728fd1-ec63-480f-98d2-93fb800fc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:57.790154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97728fd1-ec63-480f-98d2-93fb800fc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:57.790585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97728fd1-ec63-480f-98d2-93fb800fc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:57.855897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-97728fd1-ec63-480f-98d2-93fb800fc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:57.864208 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-97728fd1-ec63-480f-98d2-93fb800fc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1188 microversion: 2.1 time: 0.088854 Aug 29 16:06:57.864799 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3385/6983] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:57 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:58.885236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4bcfa4fe-9c22-41ae-923d-be26c06f149c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:58.886148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4bcfa4fe-9c22-41ae-923d-be26c06f149c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:58.893206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bcfa4fe-9c22-41ae-923d-be26c06f149c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:58.893793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bcfa4fe-9c22-41ae-923d-be26c06f149c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:58.894321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bcfa4fe-9c22-41ae-923d-be26c06f149c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:58.895111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bcfa4fe-9c22-41ae-923d-be26c06f149c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:58.895645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bcfa4fe-9c22-41ae-923d-be26c06f149c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:58.896335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bcfa4fe-9c22-41ae-923d-be26c06f149c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:58.972324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4bcfa4fe-9c22-41ae-923d-be26c06f149c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:58.980881 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4bcfa4fe-9c22-41ae-923d-be26c06f149c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1188 microversion: 2.1 time: 0.099924 Aug 29 16:06:58.981862 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3599/6984] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:58 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1188 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:00.003921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c3f160f-34d5-4ed4-9acd-4b33baca40d4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:00.004546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6c3f160f-34d5-4ed4-9acd-4b33baca40d4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:00.012173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c3f160f-34d5-4ed4-9acd-4b33baca40d4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:00.012670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c3f160f-34d5-4ed4-9acd-4b33baca40d4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:00.013131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c3f160f-34d5-4ed4-9acd-4b33baca40d4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:00.013815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c3f160f-34d5-4ed4-9acd-4b33baca40d4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:00.014268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c3f160f-34d5-4ed4-9acd-4b33baca40d4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:00.014689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c3f160f-34d5-4ed4-9acd-4b33baca40d4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:00.047864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c3f160f-34d5-4ed4-9acd-4b33baca40d4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:00.048349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c3f160f-34d5-4ed4-9acd-4b33baca40d4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:00.048780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c3f160f-34d5-4ed4-9acd-4b33baca40d4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:00.049252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-6c3f160f-34d5-4ed4-9acd-4b33baca40d4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lazy-loading 'fault' on Instance uuid e40ebfdc-e7a2-4f20-a67d-1c4c37470bea {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:07:00.100566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6c3f160f-34d5-4ed4-9acd-4b33baca40d4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:00.109809 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6c3f160f-34d5-4ed4-9acd-4b33baca40d4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 200 len: 1193 microversion: 2.1 time: 0.110121 Aug 29 16:07:00.110518 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3386/6985] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:59 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 1193 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:01.133323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-81b896ae-5d90-4c92-99c5-3c61e40604ea tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:01.133905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-81b896ae-5d90-4c92-99c5-3c61e40604ea tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: e40ebfdc-e7a2-4f20-a67d-1c4c37470bea] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:01.141201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81b896ae-5d90-4c92-99c5-3c61e40604ea tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:01.141711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81b896ae-5d90-4c92-99c5-3c61e40604ea tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:01.142164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81b896ae-5d90-4c92-99c5-3c61e40604ea tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:01.143890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81b896ae-5d90-4c92-99c5-3c61e40604ea tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:01.144757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81b896ae-5d90-4c92-99c5-3c61e40604ea tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:01.145253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81b896ae-5d90-4c92-99c5-3c61e40604ea tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:01.161428 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-81b896ae-5d90-4c92-99c5-3c61e40604ea tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] HTTP exception thrown: Instance e40ebfdc-e7a2-4f20-a67d-1c4c37470bea could not be found. Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-81b896ae-5d90-4c92-99c5-3c61e40604ea tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Request method failure captured: Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea HTTP/1.1 Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOPVKb3AKf05JOTmVWxg_YSLh_6aJQ1fwERqtRCNq2OGA-TgfvjQkO776TgAknFFnCA3k1v6BcT_thZ3YV-DMceZELFHu1q-Z_h1mjuaQAa75Kym14h4m_K8QcmdN6yIk-IwhACLHvRJHqBNwAzk2eiJecAZxJFQO9-ZjVx01ZUPXeU Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_688ed04d399247f0ac8a204967cdfa2a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}] Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestVolumeBootPattern-201560010 Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: f07d896c6764402999345759f2348080 Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance e40ebfdc-e7a2-4f20-a67d-1c4c37470bea could not be found. Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'e40ebfdc-e7a2-4f20-a67d-1c4c37470bea'} Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e40ebfdc-e7a2-4f20-a67d-1c4c37470bea could not be found. Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e40ebfdc-e7a2-4f20-a67d-1c4c37470bea could not be found. Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:07:01.163176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:07:01.168274 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:01.168274 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:07:01.168274 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:07:01.168274 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:07:01.168274 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:07:01.168274 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e40ebfdc-e7a2-4f20-a67d-1c4c37470bea could not be found. Aug 29 16:07:01.168274 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:07:01.168274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-81b896ae-5d90-4c92-99c5-3c61e40604ea tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Returning 404 to user: Instance e40ebfdc-e7a2-4f20-a67d-1c4c37470bea could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:07:01.168274 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-81b896ae-5d90-4c92-99c5-3c61e40604ea tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea" status: 404 len: 111 microversion: 2.1 time: 0.036777 Aug 29 16:07:01.168274 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3600/6986] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:01 2022] GET /compute/v2.1/servers/e40ebfdc-e7a2-4f20-a67d-1c4c37470bea => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:07:02.141357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-10b34be5-49fc-4c89-909b-4e4b130d2946 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:02.143882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-10b34be5-49fc-4c89-909b-4e4b130d2946 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:02.155369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-10b34be5-49fc-4c89-909b-4e4b130d2946 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:02.155369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-10b34be5-49fc-4c89-909b-4e4b130d2946 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:02.155369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-10b34be5-49fc-4c89-909b-4e4b130d2946 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:02.155369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-10b34be5-49fc-4c89-909b-4e4b130d2946 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:02.155369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-10b34be5-49fc-4c89-909b-4e4b130d2946 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:02.155369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-10b34be5-49fc-4c89-909b-4e4b130d2946 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:02.230144 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-10b34be5-49fc-4c89-909b-4e4b130d2946 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "POST /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518/action" status: 200 len: 24567 microversion: 2.1 time: 0.092281 Aug 29 16:07:02.234098 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3387/6987] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:07:02 2022] POST /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518/action => generated 24567 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:07:24.611361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1510219793", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cc61194f-feb4-47b5-a606-03566795536c", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "957b06a2-5b5b-41f0-883f-0990cab206d9"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:24.623412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=7 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:24.624032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=33 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:24.704340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] validate_networks() for [('957b06a2-5b5b-41f0-883f-0990cab206d9', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:07:25.112360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:07:25.112779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:07:25.113290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:07:25.113692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:07:25.114099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:07:25.123924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:25.124443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:25.125116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:25.125859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:25.126435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:25.126863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:25.144516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:07:25.150327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for user f07d896c6764402999345759f2348080 and project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:07:25.165230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:07:25.167340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='cc61194f-feb4-47b5-a606-03566795536c',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:07:25.245245 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7e55d1fb-7a29-47de-9e20-5b93af2e4dba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637694 Aug 29 16:07:25.246225 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3601/6988] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:07:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:07:25.259227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dc8400a1-64cc-4538-bd3a-c11a49e8c1ad tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:25.262911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dc8400a1-64cc-4538-bd3a-c11a49e8c1ad tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:25.273425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=9 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:25.274290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:25.336929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dc8400a1-64cc-4538-bd3a-c11a49e8c1ad tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:25.345018 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dc8400a1-64cc-4538-bd3a-c11a49e8c1ad tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1057 microversion: 2.1 time: 0.090678 Aug 29 16:07:25.345834 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3388/6989] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:25 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1057 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:26.367297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b6e37cb2-70e0-4b32-afe1-302257fe0fd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:26.368811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b6e37cb2-70e0-4b32-afe1-302257fe0fd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:26.378951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6e37cb2-70e0-4b32-afe1-302257fe0fd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:26.379752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6e37cb2-70e0-4b32-afe1-302257fe0fd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:26.380368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6e37cb2-70e0-4b32-afe1-302257fe0fd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:26.381534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6e37cb2-70e0-4b32-afe1-302257fe0fd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:26.382266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6e37cb2-70e0-4b32-afe1-302257fe0fd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:26.383441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b6e37cb2-70e0-4b32-afe1-302257fe0fd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:26.471288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b6e37cb2-70e0-4b32-afe1-302257fe0fd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:26.480511 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b6e37cb2-70e0-4b32-afe1-302257fe0fd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1117 microversion: 2.1 time: 0.117982 Aug 29 16:07:26.481753 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3602/6990] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:26 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1117 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:27.504825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e079aeb3-025e-48f8-bd19-9ca2c5e6944b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:27.506436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e079aeb3-025e-48f8-bd19-9ca2c5e6944b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:27.521788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e079aeb3-025e-48f8-bd19-9ca2c5e6944b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:27.523286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e079aeb3-025e-48f8-bd19-9ca2c5e6944b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:27.524073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e079aeb3-025e-48f8-bd19-9ca2c5e6944b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:27.525019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e079aeb3-025e-48f8-bd19-9ca2c5e6944b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:27.526130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e079aeb3-025e-48f8-bd19-9ca2c5e6944b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:27.527256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e079aeb3-025e-48f8-bd19-9ca2c5e6944b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:27.787400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e079aeb3-025e-48f8-bd19-9ca2c5e6944b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:27.813371 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e079aeb3-025e-48f8-bd19-9ca2c5e6944b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1169 microversion: 2.1 time: 0.315021 Aug 29 16:07:27.814365 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3389/6991] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:27 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1169 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:27.935080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-ed5efcbf-6fce-4d2e-a7c6-4361d0990384 req-40fc8b74-d360-44cb-8118-9e16f3591f2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "592d3f5f-ebee-4e9b-82ed-a12057827039", "tag": "c712ce5c-40b3-44c9-b433-c821c813659d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:27.951958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ed5efcbf-6fce-4d2e-a7c6-4361d0990384 req-40fc8b74-d360-44cb-8118-9e16f3591f2a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:27.957304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ed5efcbf-6fce-4d2e-a7c6-4361d0990384 req-40fc8b74-d360-44cb-8118-9e16f3591f2a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:27.957878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ed5efcbf-6fce-4d2e-a7c6-4361d0990384 req-40fc8b74-d360-44cb-8118-9e16f3591f2a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:27.980419 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-ed5efcbf-6fce-4d2e-a7c6-4361d0990384 req-40fc8b74-d360-44cb-8118-9e16f3591f2a service nova] Creating event network-changed:c712ce5c-40b3-44c9-b433-c821c813659d for instance 592d3f5f-ebee-4e9b-82ed-a12057827039 on n-h2-839401-11 Aug 29 16:07:27.988200 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-ed5efcbf-6fce-4d2e-a7c6-4361d0990384 req-40fc8b74-d360-44cb-8118-9e16f3591f2a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057250 Aug 29 16:07:27.989429 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3603/6992] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:28.847498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4d84734e-1ea6-45cd-bb69-e183984d953f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:28.849528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4d84734e-1ea6-45cd-bb69-e183984d953f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:28.858972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d84734e-1ea6-45cd-bb69-e183984d953f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:28.859748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d84734e-1ea6-45cd-bb69-e183984d953f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:28.860383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d84734e-1ea6-45cd-bb69-e183984d953f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:28.861383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d84734e-1ea6-45cd-bb69-e183984d953f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:28.861984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d84734e-1ea6-45cd-bb69-e183984d953f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:28.862427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d84734e-1ea6-45cd-bb69-e183984d953f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:29.125758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4d84734e-1ea6-45cd-bb69-e183984d953f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:29.134391 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4d84734e-1ea6-45cd-bb69-e183984d953f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1169 microversion: 2.1 time: 0.299408 Aug 29 16:07:29.135296 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3390/6993] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:28 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1169 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:30.159171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c4969d61-56bc-4df2-aea1-f3df151daa5e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:30.160762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c4969d61-56bc-4df2-aea1-f3df151daa5e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:30.167695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4969d61-56bc-4df2-aea1-f3df151daa5e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:30.168169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4969d61-56bc-4df2-aea1-f3df151daa5e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:30.168590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4969d61-56bc-4df2-aea1-f3df151daa5e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:30.169521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4969d61-56bc-4df2-aea1-f3df151daa5e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:30.170151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4969d61-56bc-4df2-aea1-f3df151daa5e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:30.170811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4969d61-56bc-4df2-aea1-f3df151daa5e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:30.376491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c4969d61-56bc-4df2-aea1-f3df151daa5e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:30.389163 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c4969d61-56bc-4df2-aea1-f3df151daa5e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1169 microversion: 2.1 time: 0.234368 Aug 29 16:07:30.390121 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3604/6994] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:30 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1169 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:31.419871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-66617ada-41cd-4ef2-9670-193bf1355d76 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:31.420753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-66617ada-41cd-4ef2-9670-193bf1355d76 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:31.435597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66617ada-41cd-4ef2-9670-193bf1355d76 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:31.437746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66617ada-41cd-4ef2-9670-193bf1355d76 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:31.437746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66617ada-41cd-4ef2-9670-193bf1355d76 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:31.439062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66617ada-41cd-4ef2-9670-193bf1355d76 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:31.439676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66617ada-41cd-4ef2-9670-193bf1355d76 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:31.440166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66617ada-41cd-4ef2-9670-193bf1355d76 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:31.668995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-66617ada-41cd-4ef2-9670-193bf1355d76 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:31.678786 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-66617ada-41cd-4ef2-9670-193bf1355d76 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1169 microversion: 2.1 time: 0.267696 Aug 29 16:07:31.679640 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3391/6995] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:31 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1169 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:32.716837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-51e95d9c-c4b1-47c4-a079-84f64b9815c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:32.718769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-51e95d9c-c4b1-47c4-a079-84f64b9815c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:32.725785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51e95d9c-c4b1-47c4-a079-84f64b9815c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:32.726282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51e95d9c-c4b1-47c4-a079-84f64b9815c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:32.727157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51e95d9c-c4b1-47c4-a079-84f64b9815c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:32.727157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51e95d9c-c4b1-47c4-a079-84f64b9815c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:32.728688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51e95d9c-c4b1-47c4-a079-84f64b9815c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:32.729446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51e95d9c-c4b1-47c4-a079-84f64b9815c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:32.944818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-51e95d9c-c4b1-47c4-a079-84f64b9815c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:32.955141 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-51e95d9c-c4b1-47c4-a079-84f64b9815c9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1169 microversion: 2.1 time: 0.245403 Aug 29 16:07:32.955633 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3605/6996] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:32 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1169 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:33.990253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-621f6533-85aa-4b78-8ac4-a1e31387eb27 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:33.991422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-621f6533-85aa-4b78-8ac4-a1e31387eb27 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:33.998375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-621f6533-85aa-4b78-8ac4-a1e31387eb27 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:33.999073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-621f6533-85aa-4b78-8ac4-a1e31387eb27 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:33.999697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-621f6533-85aa-4b78-8ac4-a1e31387eb27 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:34.000434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-621f6533-85aa-4b78-8ac4-a1e31387eb27 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:34.000909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-621f6533-85aa-4b78-8ac4-a1e31387eb27 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:34.001317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-621f6533-85aa-4b78-8ac4-a1e31387eb27 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:34.162140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-621f6533-85aa-4b78-8ac4-a1e31387eb27 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:34.172591 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-621f6533-85aa-4b78-8ac4-a1e31387eb27 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1169 microversion: 2.1 time: 0.187583 Aug 29 16:07:34.185727 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3392/6997] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:33 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1169 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:35.193861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a2615b5c-6f05-4fbe-88a0-458cfada0567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:35.194512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a2615b5c-6f05-4fbe-88a0-458cfada0567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:35.200879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:35.201840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:35.204590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2615b5c-6f05-4fbe-88a0-458cfada0567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:35.205497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2615b5c-6f05-4fbe-88a0-458cfada0567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:35.205939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2615b5c-6f05-4fbe-88a0-458cfada0567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:35.206765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2615b5c-6f05-4fbe-88a0-458cfada0567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:35.207480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2615b5c-6f05-4fbe-88a0-458cfada0567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:35.207997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2615b5c-6f05-4fbe-88a0-458cfada0567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:35.355740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a2615b5c-6f05-4fbe-88a0-458cfada0567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:35.368774 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a2615b5c-6f05-4fbe-88a0-458cfada0567 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1169 microversion: 2.1 time: 0.178479 Aug 29 16:07:35.369381 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3606/6998] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:35 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1169 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:36.390934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ad1894f6-5926-4e1c-ae0a-1ae5b91c463a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:36.391585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ad1894f6-5926-4e1c-ae0a-1ae5b91c463a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:36.395553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:36.399799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad1894f6-5926-4e1c-ae0a-1ae5b91c463a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:36.400295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad1894f6-5926-4e1c-ae0a-1ae5b91c463a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:36.400736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad1894f6-5926-4e1c-ae0a-1ae5b91c463a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:36.401477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad1894f6-5926-4e1c-ae0a-1ae5b91c463a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:36.401951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad1894f6-5926-4e1c-ae0a-1ae5b91c463a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:36.402364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad1894f6-5926-4e1c-ae0a-1ae5b91c463a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:36.549400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ad1894f6-5926-4e1c-ae0a-1ae5b91c463a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:36.559210 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ad1894f6-5926-4e1c-ae0a-1ae5b91c463a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1169 microversion: 2.1 time: 0.171887 Aug 29 16:07:36.560366 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3393/6999] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:36 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1169 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:37.580661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-48cb76ad-e3aa-4da3-b878-4ccba252fe14 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:37.581568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-48cb76ad-e3aa-4da3-b878-4ccba252fe14 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:37.589300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48cb76ad-e3aa-4da3-b878-4ccba252fe14 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:37.590158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48cb76ad-e3aa-4da3-b878-4ccba252fe14 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:37.590835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48cb76ad-e3aa-4da3-b878-4ccba252fe14 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:37.591628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48cb76ad-e3aa-4da3-b878-4ccba252fe14 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:37.592175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48cb76ad-e3aa-4da3-b878-4ccba252fe14 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:37.592705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-48cb76ad-e3aa-4da3-b878-4ccba252fe14 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:37.737790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-48cb76ad-e3aa-4da3-b878-4ccba252fe14 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:37.745920 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-48cb76ad-e3aa-4da3-b878-4ccba252fe14 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1169 microversion: 2.1 time: 0.169799 Aug 29 16:07:37.746525 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3607/7000] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:37 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1169 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:38.767633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0eaf52f2-adf3-4f78-b846-3886103c9b3c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:38.768912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0eaf52f2-adf3-4f78-b846-3886103c9b3c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:38.776272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eaf52f2-adf3-4f78-b846-3886103c9b3c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:38.776995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eaf52f2-adf3-4f78-b846-3886103c9b3c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:38.777624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eaf52f2-adf3-4f78-b846-3886103c9b3c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:38.778523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eaf52f2-adf3-4f78-b846-3886103c9b3c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:38.779156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eaf52f2-adf3-4f78-b846-3886103c9b3c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:38.779754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eaf52f2-adf3-4f78-b846-3886103c9b3c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:39.113500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0eaf52f2-adf3-4f78-b846-3886103c9b3c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:39.121436 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0eaf52f2-adf3-4f78-b846-3886103c9b3c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1169 microversion: 2.1 time: 0.357588 Aug 29 16:07:39.122231 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3394/7001] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:38 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1169 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:39.882969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4da8697a-82fa-4063-8fc7-7f3d1a29c96e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Action: 'create', calling method: .version_select at 0x7fc42a6a3550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-460911193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/JiWkSQgOHKUDT5OGKZhdp7nJxxLjsm0Vol6EFRYiPpMq9kdJ95qDfLp/zlTc5qE1sc9N1f8F4z9QHDwY6HSCD+IQWqwUyDY7P1qo8fliRrHR8s76lssYyhLMMFl6wbg=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:39.907246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-4da8697a-82fa-4063-8fc7-7f3d1a29c96e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Getting quotas for project dc8a8f9ddd384ca2bcdacb55b92006d9. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:07:39.914984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-4da8697a-82fa-4063-8fc7-7f3d1a29c96e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Getting quotas for user e2d56709bf4c41eeb6e15bcdfd140999 and project dc8a8f9ddd384ca2bcdacb55b92006d9. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:07:39.951070 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4da8697a-82fa-4063-8fc7-7f3d1a29c96e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.073181 Aug 29 16:07:39.952236 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3608/7002] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:07:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:40.146796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-64d40184-f933-4ede-98da-b2f4353832de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:40.148941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-64d40184-f933-4ede-98da-b2f4353832de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:40.166852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64d40184-f933-4ede-98da-b2f4353832de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:40.167652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64d40184-f933-4ede-98da-b2f4353832de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:40.169399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64d40184-f933-4ede-98da-b2f4353832de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:40.170390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64d40184-f933-4ede-98da-b2f4353832de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:40.171022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64d40184-f933-4ede-98da-b2f4353832de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:40.171712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-64d40184-f933-4ede-98da-b2f4353832de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:40.458211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-64d40184-f933-4ede-98da-b2f4353832de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:40.472936 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-64d40184-f933-4ede-98da-b2f4353832de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1169 microversion: 2.1 time: 0.331975 Aug 29 16:07:40.474183 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3395/7003] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:40 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1169 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:41.495967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a540b748-2957-44fe-bfea-5ebe06a772bd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:41.496664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a540b748-2957-44fe-bfea-5ebe06a772bd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:41.505305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a540b748-2957-44fe-bfea-5ebe06a772bd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:41.506163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a540b748-2957-44fe-bfea-5ebe06a772bd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:41.506860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a540b748-2957-44fe-bfea-5ebe06a772bd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:41.508132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a540b748-2957-44fe-bfea-5ebe06a772bd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:41.509016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a540b748-2957-44fe-bfea-5ebe06a772bd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:41.509688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a540b748-2957-44fe-bfea-5ebe06a772bd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:41.706521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a540b748-2957-44fe-bfea-5ebe06a772bd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:41.718942 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a540b748-2957-44fe-bfea-5ebe06a772bd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1169 microversion: 2.1 time: 0.228685 Aug 29 16:07:41.727155 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3609/7004] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:41 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1169 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:41.921427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-142124457", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "9989baec-4399-4424-9f89-f5905b8fcaa9"}], "key_name": "tempest-TestNetworkBasicOps-460911193", "security_groups": [{"name": "tempest-secgroup-smoke-724315311"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:42.054313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] validate_networks() for [('9989baec-4399-4424-9f89-f5905b8fcaa9', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:07:42.461076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:07:42.461526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:07:42.462004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:07:42.462421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:07:42.462834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:07:42.473506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:42.473975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:42.474460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:42.475340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:42.475801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:42.476234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:42.496578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Getting quotas for project dc8a8f9ddd384ca2bcdacb55b92006d9. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:07:42.502219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Getting quotas for user e2d56709bf4c41eeb6e15bcdfd140999 and project dc8a8f9ddd384ca2bcdacb55b92006d9. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:07:42.516586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:07:42.519073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:07:42.571160 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a0b3d849-8ceb-438c-8a7f-ea05a57df838 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.653989 Aug 29 16:07:42.572226 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3396/7005] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:07:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:07:42.583629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cc473ed3-358a-499c-afe6-70e091f9b15e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:42.584287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cc473ed3-358a-499c-afe6-70e091f9b15e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:42.646658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cc473ed3-358a-499c-afe6-70e091f9b15e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:42.654466 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cc473ed3-358a-499c-afe6-70e091f9b15e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 200 len: 1247 microversion: 2.1 time: 0.075053 Aug 29 16:07:42.654999 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3610/7006] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:42 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 1247 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:42.750026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5bca7235-56b4-42f2-b819-21b71ea54419 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:42.751109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5bca7235-56b4-42f2-b819-21b71ea54419 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:42.760742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bca7235-56b4-42f2-b819-21b71ea54419 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:42.761703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bca7235-56b4-42f2-b819-21b71ea54419 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:42.763266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bca7235-56b4-42f2-b819-21b71ea54419 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:42.764196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bca7235-56b4-42f2-b819-21b71ea54419 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:42.764843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bca7235-56b4-42f2-b819-21b71ea54419 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:42.765420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bca7235-56b4-42f2-b819-21b71ea54419 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:42.970422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5bca7235-56b4-42f2-b819-21b71ea54419 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:42.980739 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5bca7235-56b4-42f2-b819-21b71ea54419 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1203 microversion: 2.1 time: 0.237034 Aug 29 16:07:42.982052 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3397/7007] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:42 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1203 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:43.676148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-53e7a5e5-feee-4c1b-a866-18bf2f150ff5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:43.676826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-53e7a5e5-feee-4c1b-a866-18bf2f150ff5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:43.685311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53e7a5e5-feee-4c1b-a866-18bf2f150ff5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:43.685804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53e7a5e5-feee-4c1b-a866-18bf2f150ff5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:43.686239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53e7a5e5-feee-4c1b-a866-18bf2f150ff5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:43.687040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53e7a5e5-feee-4c1b-a866-18bf2f150ff5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:43.687529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53e7a5e5-feee-4c1b-a866-18bf2f150ff5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:43.687797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53e7a5e5-feee-4c1b-a866-18bf2f150ff5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:43.759180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-53e7a5e5-feee-4c1b-a866-18bf2f150ff5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:43.768058 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-53e7a5e5-feee-4c1b-a866-18bf2f150ff5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 200 len: 1299 microversion: 2.1 time: 0.096334 Aug 29 16:07:43.769046 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3611/7008] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:43 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:44.002417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-56e8d28a-bb5e-45b1-bc21-c985206c19d7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:44.003733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-56e8d28a-bb5e-45b1-bc21-c985206c19d7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:44.011279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56e8d28a-bb5e-45b1-bc21-c985206c19d7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:44.012052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56e8d28a-bb5e-45b1-bc21-c985206c19d7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:44.012680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56e8d28a-bb5e-45b1-bc21-c985206c19d7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:44.013648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56e8d28a-bb5e-45b1-bc21-c985206c19d7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:44.014295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56e8d28a-bb5e-45b1-bc21-c985206c19d7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:44.014922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56e8d28a-bb5e-45b1-bc21-c985206c19d7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:44.232333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-56e8d28a-bb5e-45b1-bc21-c985206c19d7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:44.241786 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-56e8d28a-bb5e-45b1-bc21-c985206c19d7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1203 microversion: 2.1 time: 0.242452 Aug 29 16:07:44.242481 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3398/7009] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:43 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1203 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:44.790261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-27d2327a-60e0-47e1-bcf8-58f7204cac3f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:44.790937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-27d2327a-60e0-47e1-bcf8-58f7204cac3f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:44.799763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27d2327a-60e0-47e1-bcf8-58f7204cac3f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:44.800659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27d2327a-60e0-47e1-bcf8-58f7204cac3f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:44.801344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27d2327a-60e0-47e1-bcf8-58f7204cac3f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:44.802389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27d2327a-60e0-47e1-bcf8-58f7204cac3f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:44.803084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27d2327a-60e0-47e1-bcf8-58f7204cac3f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:44.803804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27d2327a-60e0-47e1-bcf8-58f7204cac3f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:44.987770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-27d2327a-60e0-47e1-bcf8-58f7204cac3f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:44.996217 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-27d2327a-60e0-47e1-bcf8-58f7204cac3f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 200 len: 1372 microversion: 2.1 time: 0.209850 Aug 29 16:07:44.996816 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3612/7010] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:44 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:45.276538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c5f094f-6bc0-4f24-88c3-34a6cecb2ad1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:45.279932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6c5f094f-6bc0-4f24-88c3-34a6cecb2ad1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:45.288571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c5f094f-6bc0-4f24-88c3-34a6cecb2ad1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:45.289195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c5f094f-6bc0-4f24-88c3-34a6cecb2ad1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:45.289853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c5f094f-6bc0-4f24-88c3-34a6cecb2ad1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:45.290647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c5f094f-6bc0-4f24-88c3-34a6cecb2ad1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:45.291179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c5f094f-6bc0-4f24-88c3-34a6cecb2ad1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:45.291668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c5f094f-6bc0-4f24-88c3-34a6cecb2ad1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:45.513784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-b5b6cd85-fc7a-4eb9-9bd0-0585f7c215d3 req-b94fe61d-f0d9-4776-b262-021032948225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c1bea9-120e-4c7a-9908-a902c4e1e1cf", "tag": "603a3751-4978-4e1e-bde2-4bce0346293e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:45.529833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6c5f094f-6bc0-4f24-88c3-34a6cecb2ad1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:45.530758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b5b6cd85-fc7a-4eb9-9bd0-0585f7c215d3 req-b94fe61d-f0d9-4776-b262-021032948225 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:45.531784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b5b6cd85-fc7a-4eb9-9bd0-0585f7c215d3 req-b94fe61d-f0d9-4776-b262-021032948225 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:45.532699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-b5b6cd85-fc7a-4eb9-9bd0-0585f7c215d3 req-b94fe61d-f0d9-4776-b262-021032948225 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:45.544098 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6c5f094f-6bc0-4f24-88c3-34a6cecb2ad1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1203 microversion: 2.1 time: 0.272980 Aug 29 16:07:45.545126 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3399/7011] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:45 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1203 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:45.560552 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-b5b6cd85-fc7a-4eb9-9bd0-0585f7c215d3 req-b94fe61d-f0d9-4776-b262-021032948225 service nova] Creating event network-changed:603a3751-4978-4e1e-bde2-4bce0346293e for instance b4c1bea9-120e-4c7a-9908-a902c4e1e1cf on n-h1-839401-11 Aug 29 16:07:45.566792 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-b5b6cd85-fc7a-4eb9-9bd0-0585f7c215d3 req-b94fe61d-f0d9-4776-b262-021032948225 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063323 Aug 29 16:07:45.567421 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3613/7012] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:46.018526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-70f3e937-3a6a-46e5-a86c-9eab59bf3a53 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:46.019451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-70f3e937-3a6a-46e5-a86c-9eab59bf3a53 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:46.025772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70f3e937-3a6a-46e5-a86c-9eab59bf3a53 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:46.026255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70f3e937-3a6a-46e5-a86c-9eab59bf3a53 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:46.026685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70f3e937-3a6a-46e5-a86c-9eab59bf3a53 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:46.027692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70f3e937-3a6a-46e5-a86c-9eab59bf3a53 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:46.028411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70f3e937-3a6a-46e5-a86c-9eab59bf3a53 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:46.028943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70f3e937-3a6a-46e5-a86c-9eab59bf3a53 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:46.187662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-70f3e937-3a6a-46e5-a86c-9eab59bf3a53 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:46.198435 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-70f3e937-3a6a-46e5-a86c-9eab59bf3a53 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 200 len: 1372 microversion: 2.1 time: 0.184263 Aug 29 16:07:46.199280 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3400/7013] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:46 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:46.564367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d395e75d-23d7-4920-8278-6ee3745a473b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:46.565039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d395e75d-23d7-4920-8278-6ee3745a473b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:46.573125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d395e75d-23d7-4920-8278-6ee3745a473b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:46.573951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d395e75d-23d7-4920-8278-6ee3745a473b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:46.574341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d395e75d-23d7-4920-8278-6ee3745a473b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:46.575089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d395e75d-23d7-4920-8278-6ee3745a473b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:46.575678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d395e75d-23d7-4920-8278-6ee3745a473b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:46.576362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d395e75d-23d7-4920-8278-6ee3745a473b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:46.725746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d395e75d-23d7-4920-8278-6ee3745a473b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:46.737252 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d395e75d-23d7-4920-8278-6ee3745a473b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1203 microversion: 2.1 time: 0.176924 Aug 29 16:07:46.738212 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3614/7014] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:46 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1203 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:47.220978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e1f8bf48-581a-4ece-9fcc-32348ccfda12 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:47.221696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e1f8bf48-581a-4ece-9fcc-32348ccfda12 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:47.229197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1f8bf48-581a-4ece-9fcc-32348ccfda12 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:47.229662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1f8bf48-581a-4ece-9fcc-32348ccfda12 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:47.230347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1f8bf48-581a-4ece-9fcc-32348ccfda12 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:47.231047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1f8bf48-581a-4ece-9fcc-32348ccfda12 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:47.231502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1f8bf48-581a-4ece-9fcc-32348ccfda12 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:47.231917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1f8bf48-581a-4ece-9fcc-32348ccfda12 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:47.384747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e1f8bf48-581a-4ece-9fcc-32348ccfda12 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:47.392678 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e1f8bf48-581a-4ece-9fcc-32348ccfda12 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 200 len: 1372 microversion: 2.1 time: 0.175937 Aug 29 16:07:47.393381 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3401/7015] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:47 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:47.757429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ca02c633-51d1-4a75-8b85-59cdb9c416b2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:47.758142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ca02c633-51d1-4a75-8b85-59cdb9c416b2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:47.766371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca02c633-51d1-4a75-8b85-59cdb9c416b2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:47.766872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca02c633-51d1-4a75-8b85-59cdb9c416b2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:47.767318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca02c633-51d1-4a75-8b85-59cdb9c416b2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:47.768031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca02c633-51d1-4a75-8b85-59cdb9c416b2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:47.768523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca02c633-51d1-4a75-8b85-59cdb9c416b2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:47.768959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca02c633-51d1-4a75-8b85-59cdb9c416b2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:47.914135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ca02c633-51d1-4a75-8b85-59cdb9c416b2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:47.922608 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ca02c633-51d1-4a75-8b85-59cdb9c416b2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1203 microversion: 2.1 time: 0.169544 Aug 29 16:07:47.923301 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3615/7016] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:47 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:48.416374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ec6c60be-8ea5-46b4-baa8-3544533f4139 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:48.416994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ec6c60be-8ea5-46b4-baa8-3544533f4139 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:48.431415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec6c60be-8ea5-46b4-baa8-3544533f4139 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:48.432224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec6c60be-8ea5-46b4-baa8-3544533f4139 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:48.432825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec6c60be-8ea5-46b4-baa8-3544533f4139 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:48.433916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec6c60be-8ea5-46b4-baa8-3544533f4139 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:48.434406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec6c60be-8ea5-46b4-baa8-3544533f4139 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:48.434842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec6c60be-8ea5-46b4-baa8-3544533f4139 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:48.720627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ec6c60be-8ea5-46b4-baa8-3544533f4139 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:48.730311 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ec6c60be-8ea5-46b4-baa8-3544533f4139 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 200 len: 1372 microversion: 2.1 time: 0.318996 Aug 29 16:07:48.744529 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3402/7017] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:48 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 1372 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:48.943552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-817e3e59-9ad1-43e4-88f6-986d3ea03a07 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:48.944828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-817e3e59-9ad1-43e4-88f6-986d3ea03a07 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:48.955435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817e3e59-9ad1-43e4-88f6-986d3ea03a07 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:48.956455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817e3e59-9ad1-43e4-88f6-986d3ea03a07 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:48.957373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817e3e59-9ad1-43e4-88f6-986d3ea03a07 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:48.958719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817e3e59-9ad1-43e4-88f6-986d3ea03a07 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:48.959632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817e3e59-9ad1-43e4-88f6-986d3ea03a07 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:48.960140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817e3e59-9ad1-43e4-88f6-986d3ea03a07 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:49.119499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-817e3e59-9ad1-43e4-88f6-986d3ea03a07 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:49.130800 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-817e3e59-9ad1-43e4-88f6-986d3ea03a07 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1203 microversion: 2.1 time: 0.190935 Aug 29 16:07:49.131399 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3616/7018] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:48 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1203 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:49.750713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aeaa00b9-d7a9-415c-9f5b-71d104bccf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:49.751345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aeaa00b9-d7a9-415c-9f5b-71d104bccf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:49.759459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aeaa00b9-d7a9-415c-9f5b-71d104bccf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:49.760149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aeaa00b9-d7a9-415c-9f5b-71d104bccf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:49.760790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aeaa00b9-d7a9-415c-9f5b-71d104bccf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:49.761600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aeaa00b9-d7a9-415c-9f5b-71d104bccf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:49.762402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aeaa00b9-d7a9-415c-9f5b-71d104bccf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:49.763072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aeaa00b9-d7a9-415c-9f5b-71d104bccf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:49.916044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aeaa00b9-d7a9-415c-9f5b-71d104bccf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:49.924174 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aeaa00b9-d7a9-415c-9f5b-71d104bccf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 200 len: 1372 microversion: 2.1 time: 0.177420 Aug 29 16:07:49.924820 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3403/7019] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:49 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:50.154143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-016079ed-a550-4ae0-a4cc-ff714cabf7b5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:50.154775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-016079ed-a550-4ae0-a4cc-ff714cabf7b5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:50.162258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-016079ed-a550-4ae0-a4cc-ff714cabf7b5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:50.162760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-016079ed-a550-4ae0-a4cc-ff714cabf7b5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:50.163208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-016079ed-a550-4ae0-a4cc-ff714cabf7b5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:50.163928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-016079ed-a550-4ae0-a4cc-ff714cabf7b5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:50.164436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-016079ed-a550-4ae0-a4cc-ff714cabf7b5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:50.164871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-016079ed-a550-4ae0-a4cc-ff714cabf7b5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:50.306429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-016079ed-a550-4ae0-a4cc-ff714cabf7b5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:50.314513 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-016079ed-a550-4ae0-a4cc-ff714cabf7b5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1203 microversion: 2.1 time: 0.164268 Aug 29 16:07:50.321119 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3617/7020] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:50 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:50.945581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9b6b72b9-c5d3-442c-a48d-4040709a0e2d tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:50.946802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9b6b72b9-c5d3-442c-a48d-4040709a0e2d tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:50.954074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b6b72b9-c5d3-442c-a48d-4040709a0e2d tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:50.954564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b6b72b9-c5d3-442c-a48d-4040709a0e2d tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:50.955040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b6b72b9-c5d3-442c-a48d-4040709a0e2d tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:50.955794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b6b72b9-c5d3-442c-a48d-4040709a0e2d tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:50.956257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b6b72b9-c5d3-442c-a48d-4040709a0e2d tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:50.956688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b6b72b9-c5d3-442c-a48d-4040709a0e2d tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:51.099591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9b6b72b9-c5d3-442c-a48d-4040709a0e2d tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:51.107653 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9b6b72b9-c5d3-442c-a48d-4040709a0e2d tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 200 len: 1372 microversion: 2.1 time: 0.166188 Aug 29 16:07:51.108341 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3404/7021] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:50 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:51.335071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b0132b6a-0f50-4200-b2be-e5ea9e7d3c94 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:51.336578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b0132b6a-0f50-4200-b2be-e5ea9e7d3c94 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:51.343773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0132b6a-0f50-4200-b2be-e5ea9e7d3c94 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:51.344320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0132b6a-0f50-4200-b2be-e5ea9e7d3c94 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:51.344965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0132b6a-0f50-4200-b2be-e5ea9e7d3c94 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:51.345709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0132b6a-0f50-4200-b2be-e5ea9e7d3c94 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:51.346202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0132b6a-0f50-4200-b2be-e5ea9e7d3c94 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:51.346613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0132b6a-0f50-4200-b2be-e5ea9e7d3c94 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:51.487594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b0132b6a-0f50-4200-b2be-e5ea9e7d3c94 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:51.496523 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b0132b6a-0f50-4200-b2be-e5ea9e7d3c94 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1203 microversion: 2.1 time: 0.165312 Aug 29 16:07:51.497134 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3618/7022] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:51 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:52.130671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4869f626-f643-4e17-8b04-2985d36e50e5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:52.131385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4869f626-f643-4e17-8b04-2985d36e50e5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:52.138681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4869f626-f643-4e17-8b04-2985d36e50e5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:52.139161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4869f626-f643-4e17-8b04-2985d36e50e5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:52.139598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4869f626-f643-4e17-8b04-2985d36e50e5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:52.140289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4869f626-f643-4e17-8b04-2985d36e50e5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:52.140746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4869f626-f643-4e17-8b04-2985d36e50e5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:52.141185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4869f626-f643-4e17-8b04-2985d36e50e5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:52.282651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4869f626-f643-4e17-8b04-2985d36e50e5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:52.290593 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4869f626-f643-4e17-8b04-2985d36e50e5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 200 len: 1372 microversion: 2.1 time: 0.163821 Aug 29 16:07:52.291140 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3405/7023] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:52 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:52.519440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0cbe1d2c-f8c4-48db-8af5-53a311b7270c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:52.520549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0cbe1d2c-f8c4-48db-8af5-53a311b7270c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:52.528135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cbe1d2c-f8c4-48db-8af5-53a311b7270c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:52.528762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cbe1d2c-f8c4-48db-8af5-53a311b7270c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:52.529314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cbe1d2c-f8c4-48db-8af5-53a311b7270c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:52.530283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cbe1d2c-f8c4-48db-8af5-53a311b7270c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:52.530835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cbe1d2c-f8c4-48db-8af5-53a311b7270c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:52.531334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0cbe1d2c-f8c4-48db-8af5-53a311b7270c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:52.651170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:52.679047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0cbe1d2c-f8c4-48db-8af5-53a311b7270c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:52.687245 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0cbe1d2c-f8c4-48db-8af5-53a311b7270c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1203 microversion: 2.1 time: 0.173496 Aug 29 16:07:52.688565 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3619/7024] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:52 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:52.856687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:52.858317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:53.082998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-eab5eea0-afd9-4378-8eb5-6f133e0600a8 req-13318f49-ca12-4ebe-8caa-ab7d2a16d598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c1bea9-120e-4c7a-9908-a902c4e1e1cf", "name": "network-vif-plugged", "status": "completed", "tag": "603a3751-4978-4e1e-bde2-4bce0346293e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:53.093949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-eab5eea0-afd9-4378-8eb5-6f133e0600a8 req-13318f49-ca12-4ebe-8caa-ab7d2a16d598 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:53.094435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-eab5eea0-afd9-4378-8eb5-6f133e0600a8 req-13318f49-ca12-4ebe-8caa-ab7d2a16d598 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:53.094870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-eab5eea0-afd9-4378-8eb5-6f133e0600a8 req-13318f49-ca12-4ebe-8caa-ab7d2a16d598 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:53.103363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:53.113743 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-eab5eea0-afd9-4378-8eb5-6f133e0600a8 req-13318f49-ca12-4ebe-8caa-ab7d2a16d598 service nova] Creating event network-vif-plugged:603a3751-4978-4e1e-bde2-4bce0346293e for instance b4c1bea9-120e-4c7a-9908-a902c4e1e1cf on n-h1-839401-11 Aug 29 16:07:53.121056 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-eab5eea0-afd9-4378-8eb5-6f133e0600a8 req-13318f49-ca12-4ebe-8caa-ab7d2a16d598 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268501 Aug 29 16:07:53.121925 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3406/7025] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:53.311897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-02e40f66-2a34-4d2d-ba4a-d03ef95a8268 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:53.312514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-02e40f66-2a34-4d2d-ba4a-d03ef95a8268 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:53.318688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02e40f66-2a34-4d2d-ba4a-d03ef95a8268 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:53.319178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02e40f66-2a34-4d2d-ba4a-d03ef95a8268 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:53.319617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02e40f66-2a34-4d2d-ba4a-d03ef95a8268 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:53.320318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02e40f66-2a34-4d2d-ba4a-d03ef95a8268 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:53.320778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02e40f66-2a34-4d2d-ba4a-d03ef95a8268 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:53.321493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02e40f66-2a34-4d2d-ba4a-d03ef95a8268 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:53.457903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-02e40f66-2a34-4d2d-ba4a-d03ef95a8268 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:53.465722 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-02e40f66-2a34-4d2d-ba4a-d03ef95a8268 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 200 len: 1372 microversion: 2.1 time: 0.157747 Aug 29 16:07:53.466298 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3620/7026] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:53 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:53.710047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6e728355-957b-4fe7-b604-510e8868e34b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:53.710748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6e728355-957b-4fe7-b604-510e8868e34b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:53.717428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e728355-957b-4fe7-b604-510e8868e34b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:53.717916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e728355-957b-4fe7-b604-510e8868e34b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:53.718355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e728355-957b-4fe7-b604-510e8868e34b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:53.719062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e728355-957b-4fe7-b604-510e8868e34b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:53.719509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e728355-957b-4fe7-b604-510e8868e34b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:53.719933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e728355-957b-4fe7-b604-510e8868e34b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:53.870618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6e728355-957b-4fe7-b604-510e8868e34b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:53.878863 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6e728355-957b-4fe7-b604-510e8868e34b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1203 microversion: 2.1 time: 0.174434 Aug 29 16:07:53.879480 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3407/7027] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:53 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1203 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:54.489411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-784a4d10-c0ef-433b-aaeb-372f0fbb6526 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:54.490623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-784a4d10-c0ef-433b-aaeb-372f0fbb6526 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:54.499032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-784a4d10-c0ef-433b-aaeb-372f0fbb6526 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:54.499827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-784a4d10-c0ef-433b-aaeb-372f0fbb6526 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:54.500589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-784a4d10-c0ef-433b-aaeb-372f0fbb6526 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:54.501181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-784a4d10-c0ef-433b-aaeb-372f0fbb6526 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:54.501649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-784a4d10-c0ef-433b-aaeb-372f0fbb6526 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:54.502139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-784a4d10-c0ef-433b-aaeb-372f0fbb6526 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:54.523181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:54.649853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-784a4d10-c0ef-433b-aaeb-372f0fbb6526 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:54.658162 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-784a4d10-c0ef-433b-aaeb-372f0fbb6526 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 200 len: 1372 microversion: 2.1 time: 0.174847 Aug 29 16:07:54.658945 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3621/7028] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:54 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:54.899507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7ad982e0-c916-479d-977d-a9f15e015bf4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:54.900151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7ad982e0-c916-479d-977d-a9f15e015bf4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:54.907462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ad982e0-c916-479d-977d-a9f15e015bf4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:54.907817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ad982e0-c916-479d-977d-a9f15e015bf4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:54.908296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ad982e0-c916-479d-977d-a9f15e015bf4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:54.909018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ad982e0-c916-479d-977d-a9f15e015bf4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:54.909504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ad982e0-c916-479d-977d-a9f15e015bf4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:54.909940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ad982e0-c916-479d-977d-a9f15e015bf4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:55.043964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7ad982e0-c916-479d-977d-a9f15e015bf4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:55.052382 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7ad982e0-c916-479d-977d-a9f15e015bf4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1203 microversion: 2.1 time: 0.156783 Aug 29 16:07:55.052960 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3408/7029] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:54 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:55.136340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-70b2ce6f-625e-49d3-bdf0-4506720dd74c req-ee146190-8684-45bc-b860-c222c8ff6b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592d3f5f-ebee-4e9b-82ed-a12057827039", "name": "network-vif-plugged", "status": "completed", "tag": "c712ce5c-40b3-44c9-b433-c821c813659d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:55.141416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:55.147517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-70b2ce6f-625e-49d3-bdf0-4506720dd74c req-ee146190-8684-45bc-b860-c222c8ff6b7f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:55.148071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-70b2ce6f-625e-49d3-bdf0-4506720dd74c req-ee146190-8684-45bc-b860-c222c8ff6b7f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:55.148632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-70b2ce6f-625e-49d3-bdf0-4506720dd74c req-ee146190-8684-45bc-b860-c222c8ff6b7f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:55.161377 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-70b2ce6f-625e-49d3-bdf0-4506720dd74c req-ee146190-8684-45bc-b860-c222c8ff6b7f service nova] Creating event network-vif-plugged:c712ce5c-40b3-44c9-b433-c821c813659d for instance 592d3f5f-ebee-4e9b-82ed-a12057827039 on n-h2-839401-11 Aug 29 16:07:55.166114 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-70b2ce6f-625e-49d3-bdf0-4506720dd74c req-ee146190-8684-45bc-b860-c222c8ff6b7f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034030 Aug 29 16:07:55.166737 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3622/7030] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:55.683030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e3cc0d92-ca60-428c-8a3a-91d8a9502fd6 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:55.683552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e3cc0d92-ca60-428c-8a3a-91d8a9502fd6 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:55.685618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:55.695830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3cc0d92-ca60-428c-8a3a-91d8a9502fd6 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:55.696362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3cc0d92-ca60-428c-8a3a-91d8a9502fd6 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:55.696813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3cc0d92-ca60-428c-8a3a-91d8a9502fd6 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:55.697668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3cc0d92-ca60-428c-8a3a-91d8a9502fd6 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:55.698162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3cc0d92-ca60-428c-8a3a-91d8a9502fd6 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:55.698631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e3cc0d92-ca60-428c-8a3a-91d8a9502fd6 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:55.849685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e3cc0d92-ca60-428c-8a3a-91d8a9502fd6 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:55.857685 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e3cc0d92-ca60-428c-8a3a-91d8a9502fd6 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 200 len: 1544 microversion: 2.1 time: 0.179467 Aug 29 16:07:55.858272 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3409/7031] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:55 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 1544 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:55.880259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bd76dd7f-4bf5-4c23-b873-388607d66b48 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:55.880960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bd76dd7f-4bf5-4c23-b873-388607d66b48 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:55.887755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd76dd7f-4bf5-4c23-b873-388607d66b48 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:55.888258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd76dd7f-4bf5-4c23-b873-388607d66b48 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:55.888668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd76dd7f-4bf5-4c23-b873-388607d66b48 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:55.889491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd76dd7f-4bf5-4c23-b873-388607d66b48 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:55.890064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd76dd7f-4bf5-4c23-b873-388607d66b48 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:55.890488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd76dd7f-4bf5-4c23-b873-388607d66b48 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:56.028161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bd76dd7f-4bf5-4c23-b873-388607d66b48 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:56.036806 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bd76dd7f-4bf5-4c23-b873-388607d66b48 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 200 len: 1544 microversion: 2.1 time: 0.161726 Aug 29 16:07:56.037664 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3623/7032] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:55 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 1544 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:56.072223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f92b6151-ce69-4d63-86d4-49b7d416a599 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:56.073006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f92b6151-ce69-4d63-86d4-49b7d416a599 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:56.080233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f92b6151-ce69-4d63-86d4-49b7d416a599 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:56.080805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f92b6151-ce69-4d63-86d4-49b7d416a599 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:56.081351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f92b6151-ce69-4d63-86d4-49b7d416a599 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:56.082120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f92b6151-ce69-4d63-86d4-49b7d416a599 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:56.082652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f92b6151-ce69-4d63-86d4-49b7d416a599 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:56.083152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f92b6151-ce69-4d63-86d4-49b7d416a599 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:56.219995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f92b6151-ce69-4d63-86d4-49b7d416a599 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:56.228082 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f92b6151-ce69-4d63-86d4-49b7d416a599 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1203 microversion: 2.1 time: 0.159908 Aug 29 16:07:56.228603 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3410/7033] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:56 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:57.249129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-46f9eb40-2433-4d2f-9355-2b1294f2cfa8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:57.249774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-46f9eb40-2433-4d2f-9355-2b1294f2cfa8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:57.259547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46f9eb40-2433-4d2f-9355-2b1294f2cfa8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:57.260072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46f9eb40-2433-4d2f-9355-2b1294f2cfa8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:57.260552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46f9eb40-2433-4d2f-9355-2b1294f2cfa8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:57.261288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46f9eb40-2433-4d2f-9355-2b1294f2cfa8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:57.261750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46f9eb40-2433-4d2f-9355-2b1294f2cfa8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:57.262184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46f9eb40-2433-4d2f-9355-2b1294f2cfa8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:57.402491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-46f9eb40-2433-4d2f-9355-2b1294f2cfa8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:57.411436 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-46f9eb40-2433-4d2f-9355-2b1294f2cfa8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1391 microversion: 2.1 time: 0.166312 Aug 29 16:07:57.412141 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3624/7034] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:57 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:57.431440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-872cbc53-fdb3-494a-8e81-bc8fb71ca9dc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:57.432054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-872cbc53-fdb3-494a-8e81-bc8fb71ca9dc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:57.438992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-872cbc53-fdb3-494a-8e81-bc8fb71ca9dc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:57.439508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-872cbc53-fdb3-494a-8e81-bc8fb71ca9dc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:57.439940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-872cbc53-fdb3-494a-8e81-bc8fb71ca9dc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:57.440627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-872cbc53-fdb3-494a-8e81-bc8fb71ca9dc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:57.441077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-872cbc53-fdb3-494a-8e81-bc8fb71ca9dc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:57.441536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-872cbc53-fdb3-494a-8e81-bc8fb71ca9dc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:57.578450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-872cbc53-fdb3-494a-8e81-bc8fb71ca9dc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:57.587260 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-872cbc53-fdb3-494a-8e81-bc8fb71ca9dc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1391 microversion: 2.1 time: 0.159661 Aug 29 16:07:57.587999 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3411/7035] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:57 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:57.607631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-119a6b5e-5e74-4d50-bcc0-613c5fbdab5b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:57.608243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-119a6b5e-5e74-4d50-bcc0-613c5fbdab5b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:57.614947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-119a6b5e-5e74-4d50-bcc0-613c5fbdab5b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:57.615595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-119a6b5e-5e74-4d50-bcc0-613c5fbdab5b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:57.616131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-119a6b5e-5e74-4d50-bcc0-613c5fbdab5b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:57.617390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-119a6b5e-5e74-4d50-bcc0-613c5fbdab5b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:57.618238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-119a6b5e-5e74-4d50-bcc0-613c5fbdab5b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:57.619024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-119a6b5e-5e74-4d50-bcc0-613c5fbdab5b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:57.856653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-119a6b5e-5e74-4d50-bcc0-613c5fbdab5b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:57.869493 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-119a6b5e-5e74-4d50-bcc0-613c5fbdab5b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1391 microversion: 2.1 time: 0.265526 Aug 29 16:07:57.870747 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3625/7036] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:57 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1391 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:57.951639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-333468f3-f0a9-41cb-ac30-f52889aa6d9e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:57.952703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-333468f3-f0a9-41cb-ac30-f52889aa6d9e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:57.959427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-333468f3-f0a9-41cb-ac30-f52889aa6d9e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:57.960233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-333468f3-f0a9-41cb-ac30-f52889aa6d9e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:57.960923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-333468f3-f0a9-41cb-ac30-f52889aa6d9e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:57.961984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-333468f3-f0a9-41cb-ac30-f52889aa6d9e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:57.962770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-333468f3-f0a9-41cb-ac30-f52889aa6d9e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:57.963414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-333468f3-f0a9-41cb-ac30-f52889aa6d9e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:57.991602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-333468f3-f0a9-41cb-ac30-f52889aa6d9e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:07:58.081455 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-333468f3-f0a9-41cb-ac30-f52889aa6d9e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "DELETE /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 204 len: 0 microversion: 2.1 time: 0.133113 Aug 29 16:07:58.091442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c8b906e7-a874-43d7-bfb0-fef5c1c8edcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:58.092532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c8b906e7-a874-43d7-bfb0-fef5c1c8edcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:58.095791 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3412/7037] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:07:57 2022] DELETE /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:07:58.099979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8b906e7-a874-43d7-bfb0-fef5c1c8edcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:58.100787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8b906e7-a874-43d7-bfb0-fef5c1c8edcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:58.101505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8b906e7-a874-43d7-bfb0-fef5c1c8edcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:58.102460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8b906e7-a874-43d7-bfb0-fef5c1c8edcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:58.103447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8b906e7-a874-43d7-bfb0-fef5c1c8edcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:58.104110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c8b906e7-a874-43d7-bfb0-fef5c1c8edcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:58.351638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c8b906e7-a874-43d7-bfb0-fef5c1c8edcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:58.366856 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c8b906e7-a874-43d7-bfb0-fef5c1c8edcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1397 microversion: 2.1 time: 0.279726 Aug 29 16:07:58.378525 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3626/7038] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:58 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1397 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:59.390862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b490f47a-43ee-43d0-8a36-54e3a9c4858d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:59.392154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b490f47a-43ee-43d0-8a36-54e3a9c4858d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:59.399357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b490f47a-43ee-43d0-8a36-54e3a9c4858d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:59.400074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b490f47a-43ee-43d0-8a36-54e3a9c4858d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:59.400517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b490f47a-43ee-43d0-8a36-54e3a9c4858d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:59.401228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b490f47a-43ee-43d0-8a36-54e3a9c4858d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:59.401868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b490f47a-43ee-43d0-8a36-54e3a9c4858d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:59.402714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b490f47a-43ee-43d0-8a36-54e3a9c4858d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:59.553974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b490f47a-43ee-43d0-8a36-54e3a9c4858d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:59.562142 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b490f47a-43ee-43d0-8a36-54e3a9c4858d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1397 microversion: 2.1 time: 0.175482 Aug 29 16:07:59.562735 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3413/7039] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:59 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1397 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:00.366901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-814cab0a-13a1-4643-9aee-f2e43045e448 req-d6f36bbf-fdd2-4095-bfa6-f29bd3bbb488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592d3f5f-ebee-4e9b-82ed-a12057827039", "name": "network-vif-deleted", "tag": "c712ce5c-40b3-44c9-b433-c821c813659d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:00.380406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-814cab0a-13a1-4643-9aee-f2e43045e448 req-d6f36bbf-fdd2-4095-bfa6-f29bd3bbb488 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:00.381525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-814cab0a-13a1-4643-9aee-f2e43045e448 req-d6f36bbf-fdd2-4095-bfa6-f29bd3bbb488 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:00.382118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-814cab0a-13a1-4643-9aee-f2e43045e448 req-d6f36bbf-fdd2-4095-bfa6-f29bd3bbb488 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:00.396669 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-814cab0a-13a1-4643-9aee-f2e43045e448 req-d6f36bbf-fdd2-4095-bfa6-f29bd3bbb488 service nova] Creating event network-vif-deleted:c712ce5c-40b3-44c9-b433-c821c813659d for instance 592d3f5f-ebee-4e9b-82ed-a12057827039 on n-h2-839401-11 Aug 29 16:08:00.403004 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-814cab0a-13a1-4643-9aee-f2e43045e448 req-d6f36bbf-fdd2-4095-bfa6-f29bd3bbb488 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040055 Aug 29 16:08:00.404240 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3627/7040] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:00.583357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ec7c379e-ec2a-45ce-9722-e64d09ae9aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:00.583997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ec7c379e-ec2a-45ce-9722-e64d09ae9aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:00.592680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec7c379e-ec2a-45ce-9722-e64d09ae9aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:00.593630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec7c379e-ec2a-45ce-9722-e64d09ae9aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:00.594407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec7c379e-ec2a-45ce-9722-e64d09ae9aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:00.595635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec7c379e-ec2a-45ce-9722-e64d09ae9aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:00.596387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec7c379e-ec2a-45ce-9722-e64d09ae9aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:00.597018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec7c379e-ec2a-45ce-9722-e64d09ae9aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:00.682673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ec7c379e-ec2a-45ce-9722-e64d09ae9aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:00.691689 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ec7c379e-ec2a-45ce-9722-e64d09ae9aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1188 microversion: 2.1 time: 0.112390 Aug 29 16:08:00.693883 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3414/7041] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:00 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1188 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:01.726333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-60db989e-52d9-4c68-b4f2-1f4963f766f1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:01.727674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-60db989e-52d9-4c68-b4f2-1f4963f766f1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:01.741943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60db989e-52d9-4c68-b4f2-1f4963f766f1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:01.743898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60db989e-52d9-4c68-b4f2-1f4963f766f1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:01.745256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60db989e-52d9-4c68-b4f2-1f4963f766f1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:01.746334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60db989e-52d9-4c68-b4f2-1f4963f766f1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:01.747365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60db989e-52d9-4c68-b4f2-1f4963f766f1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:01.748398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60db989e-52d9-4c68-b4f2-1f4963f766f1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:01.857934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-60db989e-52d9-4c68-b4f2-1f4963f766f1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:01.867749 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-60db989e-52d9-4c68-b4f2-1f4963f766f1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1188 microversion: 2.1 time: 0.157597 Aug 29 16:08:01.880797 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3628/7042] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:01 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1188 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:02.889176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d5af4873-aec3-44e5-bbe6-44d6c55e6300 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:02.889793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d5af4873-aec3-44e5-bbe6-44d6c55e6300 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:02.903693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5af4873-aec3-44e5-bbe6-44d6c55e6300 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:02.905607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5af4873-aec3-44e5-bbe6-44d6c55e6300 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:02.906831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5af4873-aec3-44e5-bbe6-44d6c55e6300 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:02.909024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5af4873-aec3-44e5-bbe6-44d6c55e6300 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:02.911770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5af4873-aec3-44e5-bbe6-44d6c55e6300 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:02.917648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5af4873-aec3-44e5-bbe6-44d6c55e6300 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:03.011690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d5af4873-aec3-44e5-bbe6-44d6c55e6300 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:03.023342 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d5af4873-aec3-44e5-bbe6-44d6c55e6300 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1188 microversion: 2.1 time: 0.138993 Aug 29 16:08:03.024278 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3415/7043] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:02 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1188 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:04.045289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bab11633-a411-4b2d-89ad-3733f6b63bec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:04.045914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bab11633-a411-4b2d-89ad-3733f6b63bec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:04.053118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bab11633-a411-4b2d-89ad-3733f6b63bec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:04.053754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bab11633-a411-4b2d-89ad-3733f6b63bec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:04.054210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bab11633-a411-4b2d-89ad-3733f6b63bec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:04.054929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bab11633-a411-4b2d-89ad-3733f6b63bec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:04.055394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bab11633-a411-4b2d-89ad-3733f6b63bec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:04.055820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bab11633-a411-4b2d-89ad-3733f6b63bec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:04.133768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bab11633-a411-4b2d-89ad-3733f6b63bec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:04.143517 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bab11633-a411-4b2d-89ad-3733f6b63bec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1188 microversion: 2.1 time: 0.102130 Aug 29 16:08:04.144507 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3629/7044] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:04 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1188 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:05.165161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-42185f05-c737-4b82-ae20-3db728cdc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:05.166180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-42185f05-c737-4b82-ae20-3db728cdc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:05.174153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42185f05-c737-4b82-ae20-3db728cdc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:05.174715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42185f05-c737-4b82-ae20-3db728cdc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:05.175236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42185f05-c737-4b82-ae20-3db728cdc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:05.175997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42185f05-c737-4b82-ae20-3db728cdc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:05.176509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42185f05-c737-4b82-ae20-3db728cdc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:05.177118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42185f05-c737-4b82-ae20-3db728cdc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:05.211500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42185f05-c737-4b82-ae20-3db728cdc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:05.212002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42185f05-c737-4b82-ae20-3db728cdc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:05.212406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-42185f05-c737-4b82-ae20-3db728cdc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:05.212851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-42185f05-c737-4b82-ae20-3db728cdc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lazy-loading 'fault' on Instance uuid 592d3f5f-ebee-4e9b-82ed-a12057827039 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:08:05.257248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-42185f05-c737-4b82-ae20-3db728cdc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:05.266122 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-42185f05-c737-4b82-ae20-3db728cdc832 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 200 len: 1193 microversion: 2.1 time: 0.106017 Aug 29 16:08:05.266797 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3416/7045] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:05 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 1193 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:06.287245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f6c25c51-ef7b-4f40-8b76-f1725a4c3ab9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:06.287858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f6c25c51-ef7b-4f40-8b76-f1725a4c3ab9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:06.295316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6c25c51-ef7b-4f40-8b76-f1725a4c3ab9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:06.295804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6c25c51-ef7b-4f40-8b76-f1725a4c3ab9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:06.296439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6c25c51-ef7b-4f40-8b76-f1725a4c3ab9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:06.297323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6c25c51-ef7b-4f40-8b76-f1725a4c3ab9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:06.297686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6c25c51-ef7b-4f40-8b76-f1725a4c3ab9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:06.298376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6c25c51-ef7b-4f40-8b76-f1725a4c3ab9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:06.313775 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-f6c25c51-ef7b-4f40-8b76-f1725a4c3ab9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] HTTP exception thrown: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f6c25c51-ef7b-4f40-8b76-f1725a4c3ab9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Request method failure captured: Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 HTTP/1.1 Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOPVKb3AKf05JOTmVWxg_YSLh_6aJQ1fwERqtRCNq2OGA-TgfvjQkO776TgAknFFnCA3k1v6BcT_thZ3YV-DMceZELFHu1q-Z_h1mjuaQAa75Kym14h4m_K8QcmdN6yIk-IwhACLHvRJHqBNwAzk2eiJecAZxJFQO9-ZjVx01ZUPXeU Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_688ed04d399247f0ac8a204967cdfa2a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}] Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestVolumeBootPattern-201560010 Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: f07d896c6764402999345759f2348080 Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '592d3f5f-ebee-4e9b-82ed-a12057827039'} Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:06.315499 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:06.321159 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:06.321159 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:06.321159 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:06.321159 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:08:06.321159 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:08:06.321159 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. Aug 29 16:08:06.321159 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:06.321159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f6c25c51-ef7b-4f40-8b76-f1725a4c3ab9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Returning 404 to user: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:08:06.321159 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f6c25c51-ef7b-4f40-8b76-f1725a4c3ab9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 404 len: 111 microversion: 2.1 time: 0.033732 Aug 29 16:08:06.321159 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3630/7046] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:06 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:08:08.223881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1615684052", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "a619bb56-1a87-401f-85a6-f0ac970634e0"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:08.283301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] validate_networks() for [('a619bb56-1a87-401f-85a6-f0ac970634e0', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:08:08.471685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-abffbda4-6e42-4341-9265-f95408e186ef tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:08.472658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-abffbda4-6e42-4341-9265-f95408e186ef tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:08.479390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abffbda4-6e42-4341-9265-f95408e186ef tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:08.479874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abffbda4-6e42-4341-9265-f95408e186ef tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:08.480313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abffbda4-6e42-4341-9265-f95408e186ef tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:08.481016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abffbda4-6e42-4341-9265-f95408e186ef tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:08.481503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abffbda4-6e42-4341-9265-f95408e186ef tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:08.481935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-abffbda4-6e42-4341-9265-f95408e186ef tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:08.496698 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-abffbda4-6e42-4341-9265-f95408e186ef tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] HTTP exception thrown: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-abffbda4-6e42-4341-9265-f95408e186ef tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Request method failure captured: Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 HTTP/1.1 Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOPVKb3AKf05JOTmVWxg_YSLh_6aJQ1fwERqtRCNq2OGA-TgfvjQkO776TgAknFFnCA3k1v6BcT_thZ3YV-DMceZELFHu1q-Z_h1mjuaQAa75Kym14h4m_K8QcmdN6yIk-IwhACLHvRJHqBNwAzk2eiJecAZxJFQO9-ZjVx01ZUPXeU Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_688ed04d399247f0ac8a204967cdfa2a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}] Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestVolumeBootPattern-201560010 Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: f07d896c6764402999345759f2348080 Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '592d3f5f-ebee-4e9b-82ed-a12057827039'} Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:08:08.498331 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:08:08.502306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. Aug 29 16:08:08.502306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:08.502306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:08.502306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:08.502306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:08.502306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:08.502306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:08.502306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:08:08.502306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:08:08.502306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. Aug 29 16:08:08.502306 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:08.502306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-abffbda4-6e42-4341-9265-f95408e186ef tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Returning 404 to user: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:08:08.502306 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-abffbda4-6e42-4341-9265-f95408e186ef tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "DELETE /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 404 len: 111 microversion: 2.1 time: 0.032075 Aug 29 16:08:08.502306 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3631/7047] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:08:08 2022] DELETE /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:08:08.512583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-70deb165-7378-45ca-aab8-d6e6e2ec85c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:08.513411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-70deb165-7378-45ca-aab8-d6e6e2ec85c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 592d3f5f-ebee-4e9b-82ed-a12057827039] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:08.519751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70deb165-7378-45ca-aab8-d6e6e2ec85c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:08.520294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70deb165-7378-45ca-aab8-d6e6e2ec85c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:08.521309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70deb165-7378-45ca-aab8-d6e6e2ec85c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:08.521670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70deb165-7378-45ca-aab8-d6e6e2ec85c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:08.522231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70deb165-7378-45ca-aab8-d6e6e2ec85c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:08.522898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70deb165-7378-45ca-aab8-d6e6e2ec85c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:08.537791 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-70deb165-7378-45ca-aab8-d6e6e2ec85c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] HTTP exception thrown: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-70deb165-7378-45ca-aab8-d6e6e2ec85c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Request method failure captured: Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 HTTP/1.1 Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOPVKb3AKf05JOTmVWxg_YSLh_6aJQ1fwERqtRCNq2OGA-TgfvjQkO776TgAknFFnCA3k1v6BcT_thZ3YV-DMceZELFHu1q-Z_h1mjuaQAa75Kym14h4m_K8QcmdN6yIk-IwhACLHvRJHqBNwAzk2eiJecAZxJFQO9-ZjVx01ZUPXeU Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_688ed04d399247f0ac8a204967cdfa2a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}] Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestVolumeBootPattern-201560010 Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: f07d896c6764402999345759f2348080 Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '592d3f5f-ebee-4e9b-82ed-a12057827039'} Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:08.539391 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:08.543811 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:08.543811 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:08.543811 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:08.543811 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:08:08.543811 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:08:08.543811 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. Aug 29 16:08:08.543811 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:08.543811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-70deb165-7378-45ca-aab8-d6e6e2ec85c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Returning 404 to user: Instance 592d3f5f-ebee-4e9b-82ed-a12057827039 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:08:08.543811 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-70deb165-7378-45ca-aab8-d6e6e2ec85c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039" status: 404 len: 111 microversion: 2.1 time: 0.032295 Aug 29 16:08:08.543811 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3632/7048] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:08 2022] GET /compute/v2.1/servers/592d3f5f-ebee-4e9b-82ed-a12057827039 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:08:09.022085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:08:09.022602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:08:09.023139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:08:09.023617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:08:09.024103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:08:09.033398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:09.033992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:09.034511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:09.035302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:09.035827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:09.036320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:09.052957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Getting quotas for project f7fd0a668c3c4ad78160b4fc42d01d71. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:08:09.058310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Getting quotas for user 41cbdfff1c6b43998e12d9170cb05b0a and project f7fd0a668c3c4ad78160b4fc42d01d71. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:08:09.070946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:08:09.074798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:08:09.122153 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-43579139-7980-4843-8550-ee240cd40ba6 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.902255 Aug 29 16:08:09.122738 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3417/7049] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:08:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:08:09.134424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7c50e8c2-d4a3-4ba6-9540-25c2d8753456 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:09.135038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7c50e8c2-d4a3-4ba6-9540-25c2d8753456 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:09.197352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7c50e8c2-d4a3-4ba6-9540-25c2d8753456 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:09.206035 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7c50e8c2-d4a3-4ba6-9540-25c2d8753456 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc" status: 200 len: 1214 microversion: 2.1 time: 0.075590 Aug 29 16:08:09.217141 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3633/7050] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:09 2022] GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:10.227073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f690e000-1793-4e64-b03c-f60f4074bb32 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:10.227672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f690e000-1793-4e64-b03c-f60f4074bb32 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:10.235787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f690e000-1793-4e64-b03c-f60f4074bb32 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:10.236320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f690e000-1793-4e64-b03c-f60f4074bb32 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:10.236731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f690e000-1793-4e64-b03c-f60f4074bb32 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:10.237500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f690e000-1793-4e64-b03c-f60f4074bb32 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:10.237945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f690e000-1793-4e64-b03c-f60f4074bb32 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:10.238375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f690e000-1793-4e64-b03c-f60f4074bb32 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:10.304847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f690e000-1793-4e64-b03c-f60f4074bb32 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:10.312624 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f690e000-1793-4e64-b03c-f60f4074bb32 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc" status: 200 len: 1266 microversion: 2.1 time: 0.089661 Aug 29 16:08:10.313211 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3418/7051] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:10 2022] GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:11.334122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-75ff8918-0efc-45b6-960f-b6db58260b35 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:11.335351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-75ff8918-0efc-45b6-960f-b6db58260b35 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:11.343303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75ff8918-0efc-45b6-960f-b6db58260b35 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:11.343963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75ff8918-0efc-45b6-960f-b6db58260b35 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:11.344407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75ff8918-0efc-45b6-960f-b6db58260b35 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:11.345178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75ff8918-0efc-45b6-960f-b6db58260b35 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:11.345641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75ff8918-0efc-45b6-960f-b6db58260b35 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:11.346246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75ff8918-0efc-45b6-960f-b6db58260b35 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:11.514708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-75ff8918-0efc-45b6-960f-b6db58260b35 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:11.523669 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-75ff8918-0efc-45b6-960f-b6db58260b35 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc" status: 200 len: 1314 microversion: 2.1 time: 0.193928 Aug 29 16:08:11.533334 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3634/7052] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:11 2022] GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:11.776145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-84ad7e00-5e7e-4b6b-a6ba-628f4066c75d req-a40e826c-eba0-480f-b6fc-a8817b64cf99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53aa5cc1-6446-4637-a3b2-0325e53f56dc", "tag": "102d9b0c-d196-40ce-b463-c1e81e87cd61"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:11.789231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-84ad7e00-5e7e-4b6b-a6ba-628f4066c75d req-a40e826c-eba0-480f-b6fc-a8817b64cf99 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:11.790684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-84ad7e00-5e7e-4b6b-a6ba-628f4066c75d req-a40e826c-eba0-480f-b6fc-a8817b64cf99 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:11.791332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-84ad7e00-5e7e-4b6b-a6ba-628f4066c75d req-a40e826c-eba0-480f-b6fc-a8817b64cf99 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:11.806965 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-84ad7e00-5e7e-4b6b-a6ba-628f4066c75d req-a40e826c-eba0-480f-b6fc-a8817b64cf99 service nova] Creating event network-changed:102d9b0c-d196-40ce-b463-c1e81e87cd61 for instance 53aa5cc1-6446-4637-a3b2-0325e53f56dc on n-h2-839401-11 Aug 29 16:08:11.812641 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-84ad7e00-5e7e-4b6b-a6ba-628f4066c75d req-a40e826c-eba0-480f-b6fc-a8817b64cf99 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040624 Aug 29 16:08:11.813941 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3419/7053] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:12.548536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ea4876c1-4a5e-40d5-90b8-60003a1c1d3f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:12.549194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ea4876c1-4a5e-40d5-90b8-60003a1c1d3f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:12.556580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea4876c1-4a5e-40d5-90b8-60003a1c1d3f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:12.557110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea4876c1-4a5e-40d5-90b8-60003a1c1d3f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:12.557558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea4876c1-4a5e-40d5-90b8-60003a1c1d3f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:12.558275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea4876c1-4a5e-40d5-90b8-60003a1c1d3f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:12.558722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea4876c1-4a5e-40d5-90b8-60003a1c1d3f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:12.559159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea4876c1-4a5e-40d5-90b8-60003a1c1d3f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:12.701685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ea4876c1-4a5e-40d5-90b8-60003a1c1d3f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:12.710075 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ea4876c1-4a5e-40d5-90b8-60003a1c1d3f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc" status: 200 len: 1314 microversion: 2.1 time: 0.166991 Aug 29 16:08:12.710715 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3635/7054] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:12 2022] GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:13.733595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a2cf1900-4040-4e68-91df-0a95e75c4b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:13.734287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a2cf1900-4040-4e68-91df-0a95e75c4b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:13.742123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2cf1900-4040-4e68-91df-0a95e75c4b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:13.742678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2cf1900-4040-4e68-91df-0a95e75c4b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:13.743153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2cf1900-4040-4e68-91df-0a95e75c4b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:13.744086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2cf1900-4040-4e68-91df-0a95e75c4b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:13.744546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2cf1900-4040-4e68-91df-0a95e75c4b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:13.744967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2cf1900-4040-4e68-91df-0a95e75c4b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:13.897247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a2cf1900-4040-4e68-91df-0a95e75c4b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:13.906283 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a2cf1900-4040-4e68-91df-0a95e75c4b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc" status: 200 len: 1314 microversion: 2.1 time: 0.179159 Aug 29 16:08:13.907169 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3420/7055] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:13 2022] GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:14.927489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a4a965e6-45b7-41d4-b67f-faa27640baca tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:14.928070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a4a965e6-45b7-41d4-b67f-faa27640baca tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:14.935711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4a965e6-45b7-41d4-b67f-faa27640baca tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:14.936212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4a965e6-45b7-41d4-b67f-faa27640baca tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:14.936649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4a965e6-45b7-41d4-b67f-faa27640baca tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:14.937604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4a965e6-45b7-41d4-b67f-faa27640baca tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:14.938074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4a965e6-45b7-41d4-b67f-faa27640baca tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:14.938503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a4a965e6-45b7-41d4-b67f-faa27640baca tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:15.076260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a4a965e6-45b7-41d4-b67f-faa27640baca tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:15.085775 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a4a965e6-45b7-41d4-b67f-faa27640baca tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc" status: 200 len: 1314 microversion: 2.1 time: 0.162428 Aug 29 16:08:15.086561 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3636/7056] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:14 2022] GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:16.106877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c6c701a3-4b7d-4cee-9636-396bbb5917fc tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:16.107597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c6c701a3-4b7d-4cee-9636-396bbb5917fc tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:16.115108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6c701a3-4b7d-4cee-9636-396bbb5917fc tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:16.115682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6c701a3-4b7d-4cee-9636-396bbb5917fc tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:16.116231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6c701a3-4b7d-4cee-9636-396bbb5917fc tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:16.116943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6c701a3-4b7d-4cee-9636-396bbb5917fc tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:16.117440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6c701a3-4b7d-4cee-9636-396bbb5917fc tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:16.117870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c6c701a3-4b7d-4cee-9636-396bbb5917fc tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:16.256957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c6c701a3-4b7d-4cee-9636-396bbb5917fc tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:16.266905 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c6c701a3-4b7d-4cee-9636-396bbb5917fc tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc" status: 200 len: 1314 microversion: 2.1 time: 0.164129 Aug 29 16:08:16.268291 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3421/7057] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:16 2022] GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:17.287983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2054ffe3-e373-43c7-a090-40f114703089 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:17.288596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2054ffe3-e373-43c7-a090-40f114703089 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:17.295900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2054ffe3-e373-43c7-a090-40f114703089 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:17.296434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2054ffe3-e373-43c7-a090-40f114703089 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:17.296882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2054ffe3-e373-43c7-a090-40f114703089 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:17.297656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2054ffe3-e373-43c7-a090-40f114703089 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:17.298117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2054ffe3-e373-43c7-a090-40f114703089 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:17.298548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2054ffe3-e373-43c7-a090-40f114703089 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:17.442645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2054ffe3-e373-43c7-a090-40f114703089 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:17.450706 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2054ffe3-e373-43c7-a090-40f114703089 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc" status: 200 len: 1314 microversion: 2.1 time: 0.166740 Aug 29 16:08:17.451300 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3637/7058] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:17 2022] GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:18.471957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-795efeef-5d26-4fb5-8af0-efcd9973c9f0 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:18.472553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-795efeef-5d26-4fb5-8af0-efcd9973c9f0 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:18.479723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-795efeef-5d26-4fb5-8af0-efcd9973c9f0 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:18.480203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-795efeef-5d26-4fb5-8af0-efcd9973c9f0 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:18.480635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-795efeef-5d26-4fb5-8af0-efcd9973c9f0 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:18.481359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-795efeef-5d26-4fb5-8af0-efcd9973c9f0 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:18.482025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-795efeef-5d26-4fb5-8af0-efcd9973c9f0 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:18.482441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-795efeef-5d26-4fb5-8af0-efcd9973c9f0 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:18.636715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-795efeef-5d26-4fb5-8af0-efcd9973c9f0 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:18.636715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:18.636715 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-795efeef-5d26-4fb5-8af0-efcd9973c9f0 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc" status: 200 len: 1314 microversion: 2.1 time: 0.166837 Aug 29 16:08:18.636715 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3422/7059] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:18 2022] GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:18.694622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e2d8ae70-2d8e-4cf0-85a4-abb04e8a1c3e req-6b431c85-ce10-4c1c-8103-cf8299928c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53aa5cc1-6446-4637-a3b2-0325e53f56dc", "name": "network-vif-plugged", "status": "completed", "tag": "102d9b0c-d196-40ce-b463-c1e81e87cd61"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:18.705701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e2d8ae70-2d8e-4cf0-85a4-abb04e8a1c3e req-6b431c85-ce10-4c1c-8103-cf8299928c24 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:18.706098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e2d8ae70-2d8e-4cf0-85a4-abb04e8a1c3e req-6b431c85-ce10-4c1c-8103-cf8299928c24 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:18.706534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e2d8ae70-2d8e-4cf0-85a4-abb04e8a1c3e req-6b431c85-ce10-4c1c-8103-cf8299928c24 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:18.720075 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e2d8ae70-2d8e-4cf0-85a4-abb04e8a1c3e req-6b431c85-ce10-4c1c-8103-cf8299928c24 service nova] Creating event network-vif-plugged:102d9b0c-d196-40ce-b463-c1e81e87cd61 for instance 53aa5cc1-6446-4637-a3b2-0325e53f56dc on n-h2-839401-11 Aug 29 16:08:18.725514 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e2d8ae70-2d8e-4cf0-85a4-abb04e8a1c3e req-6b431c85-ce10-4c1c-8103-cf8299928c24 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034560 Aug 29 16:08:18.726230 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3638/7060] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:08:19.653598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:19.654484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:19.659736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b28fac56-2faa-4fd9-90f8-68f878716961 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:19.660387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b28fac56-2faa-4fd9-90f8-68f878716961 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:19.668698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b28fac56-2faa-4fd9-90f8-68f878716961 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:19.669490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b28fac56-2faa-4fd9-90f8-68f878716961 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:19.670077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b28fac56-2faa-4fd9-90f8-68f878716961 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:19.670642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b28fac56-2faa-4fd9-90f8-68f878716961 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:19.671150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b28fac56-2faa-4fd9-90f8-68f878716961 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:19.671554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b28fac56-2faa-4fd9-90f8-68f878716961 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:19.833629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b28fac56-2faa-4fd9-90f8-68f878716961 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:19.842064 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b28fac56-2faa-4fd9-90f8-68f878716961 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc" status: 200 len: 1314 microversion: 2.1 time: 0.189653 Aug 29 16:08:19.855137 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3423/7061] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:19 2022] GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:20.860372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:20.866184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-40e283e2-c406-4d0a-b504-db13bc52c367 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:20.866980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-40e283e2-c406-4d0a-b504-db13bc52c367 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:20.873984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40e283e2-c406-4d0a-b504-db13bc52c367 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:20.874480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40e283e2-c406-4d0a-b504-db13bc52c367 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:20.875137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40e283e2-c406-4d0a-b504-db13bc52c367 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:20.875906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40e283e2-c406-4d0a-b504-db13bc52c367 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:20.876575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40e283e2-c406-4d0a-b504-db13bc52c367 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:20.877005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40e283e2-c406-4d0a-b504-db13bc52c367 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:21.010329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-40e283e2-c406-4d0a-b504-db13bc52c367 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:21.019508 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-40e283e2-c406-4d0a-b504-db13bc52c367 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc" status: 200 len: 1497 microversion: 2.1 time: 0.160020 Aug 29 16:08:21.020133 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3639/7062] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:20 2022] GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:21.418099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-713c3aa5-4dd5-4921-a29b-4f62efdf7b82 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:21.418814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-713c3aa5-4dd5-4921-a29b-4f62efdf7b82 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:21.425848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-713c3aa5-4dd5-4921-a29b-4f62efdf7b82 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:21.426335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-713c3aa5-4dd5-4921-a29b-4f62efdf7b82 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:21.426768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-713c3aa5-4dd5-4921-a29b-4f62efdf7b82 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:21.427457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-713c3aa5-4dd5-4921-a29b-4f62efdf7b82 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:21.427908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-713c3aa5-4dd5-4921-a29b-4f62efdf7b82 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:21.428325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-713c3aa5-4dd5-4921-a29b-4f62efdf7b82 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:21.457535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-713c3aa5-4dd5-4921-a29b-4f62efdf7b82 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:08:21.544559 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-713c3aa5-4dd5-4921-a29b-4f62efdf7b82 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "DELETE /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc" status: 204 len: 0 microversion: 2.1 time: 0.129807 Aug 29 16:08:21.545590 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3424/7063] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:08:21 2022] DELETE /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:08:21.554614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-73a50b8b-fe7f-4130-9306-de341e59924d tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:21.555322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-73a50b8b-fe7f-4130-9306-de341e59924d tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:21.561697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73a50b8b-fe7f-4130-9306-de341e59924d tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:21.562196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73a50b8b-fe7f-4130-9306-de341e59924d tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:21.562638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73a50b8b-fe7f-4130-9306-de341e59924d tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:21.563351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73a50b8b-fe7f-4130-9306-de341e59924d tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:21.564066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73a50b8b-fe7f-4130-9306-de341e59924d tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:21.564503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73a50b8b-fe7f-4130-9306-de341e59924d tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:21.706441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-73a50b8b-fe7f-4130-9306-de341e59924d tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:21.714998 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-73a50b8b-fe7f-4130-9306-de341e59924d tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc" status: 200 len: 1503 microversion: 2.1 time: 0.164534 Aug 29 16:08:21.715663 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3640/7064] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:21 2022] GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:22.737945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b62b9b6-d929-4cf3-a17a-33b6b78e4dc9 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:22.738512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4b62b9b6-d929-4cf3-a17a-33b6b78e4dc9 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:22.746093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b62b9b6-d929-4cf3-a17a-33b6b78e4dc9 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:22.746582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b62b9b6-d929-4cf3-a17a-33b6b78e4dc9 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:22.747019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b62b9b6-d929-4cf3-a17a-33b6b78e4dc9 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:22.747732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b62b9b6-d929-4cf3-a17a-33b6b78e4dc9 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:22.748187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b62b9b6-d929-4cf3-a17a-33b6b78e4dc9 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:22.748612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b62b9b6-d929-4cf3-a17a-33b6b78e4dc9 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:22.907286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4b62b9b6-d929-4cf3-a17a-33b6b78e4dc9 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:22.915722 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4b62b9b6-d929-4cf3-a17a-33b6b78e4dc9 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc" status: 200 len: 1503 microversion: 2.1 time: 0.182733 Aug 29 16:08:22.916341 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3425/7065] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:22 2022] GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:23.611821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-d7c58b89-43c6-48b6-8639-44711c35aa06 req-58189e46-42d2-4091-94cc-398353cda071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53aa5cc1-6446-4637-a3b2-0325e53f56dc", "name": "network-vif-deleted", "tag": "102d9b0c-d196-40ce-b463-c1e81e87cd61"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:23.623650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d7c58b89-43c6-48b6-8639-44711c35aa06 req-58189e46-42d2-4091-94cc-398353cda071 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:23.624137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d7c58b89-43c6-48b6-8639-44711c35aa06 req-58189e46-42d2-4091-94cc-398353cda071 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:23.624636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d7c58b89-43c6-48b6-8639-44711c35aa06 req-58189e46-42d2-4091-94cc-398353cda071 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:23.654520 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-d7c58b89-43c6-48b6-8639-44711c35aa06 req-58189e46-42d2-4091-94cc-398353cda071 service nova] Creating event network-vif-deleted:102d9b0c-d196-40ce-b463-c1e81e87cd61 for instance 53aa5cc1-6446-4637-a3b2-0325e53f56dc on n-h2-839401-11 Aug 29 16:08:23.661824 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-d7c58b89-43c6-48b6-8639-44711c35aa06 req-58189e46-42d2-4091-94cc-398353cda071 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053885 Aug 29 16:08:23.662562 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3641/7066] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:23.936195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-90252a9c-b9ed-4c99-8695-1404b199bc8a tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:23.936795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-90252a9c-b9ed-4c99-8695-1404b199bc8a tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:23.944500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90252a9c-b9ed-4c99-8695-1404b199bc8a tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:23.945214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90252a9c-b9ed-4c99-8695-1404b199bc8a tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:23.945926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90252a9c-b9ed-4c99-8695-1404b199bc8a tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:23.946744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90252a9c-b9ed-4c99-8695-1404b199bc8a tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:23.947332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90252a9c-b9ed-4c99-8695-1404b199bc8a tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:23.947860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90252a9c-b9ed-4c99-8695-1404b199bc8a tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:23.983835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90252a9c-b9ed-4c99-8695-1404b199bc8a tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:23.984480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90252a9c-b9ed-4c99-8695-1404b199bc8a tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:23.985152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-90252a9c-b9ed-4c99-8695-1404b199bc8a tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:23.985765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-90252a9c-b9ed-4c99-8695-1404b199bc8a tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lazy-loading 'fault' on Instance uuid 53aa5cc1-6446-4637-a3b2-0325e53f56dc {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:08:24.033697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-90252a9c-b9ed-4c99-8695-1404b199bc8a tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:24.041757 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-90252a9c-b9ed-4c99-8695-1404b199bc8a tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc" status: 200 len: 1304 microversion: 2.1 time: 0.109509 Aug 29 16:08:24.042426 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3426/7067] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:23 2022] GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:25.064948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7aecc444-8b0a-4833-a4e1-b953d4b68bdb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:25.065781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7aecc444-8b0a-4833-a4e1-b953d4b68bdb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 53aa5cc1-6446-4637-a3b2-0325e53f56dc] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:25.073831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7aecc444-8b0a-4833-a4e1-b953d4b68bdb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:25.074329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7aecc444-8b0a-4833-a4e1-b953d4b68bdb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:25.074950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7aecc444-8b0a-4833-a4e1-b953d4b68bdb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:25.075778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7aecc444-8b0a-4833-a4e1-b953d4b68bdb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:25.076250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7aecc444-8b0a-4833-a4e1-b953d4b68bdb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:25.076693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7aecc444-8b0a-4833-a4e1-b953d4b68bdb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:25.079529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=89 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:25.092479 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-7aecc444-8b0a-4833-a4e1-b953d4b68bdb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] HTTP exception thrown: Instance 53aa5cc1-6446-4637-a3b2-0325e53f56dc could not be found. Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7aecc444-8b0a-4833-a4e1-b953d4b68bdb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Request method failure captured: Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc HTTP/1.1 Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDORmWH91fdiL1CDoa8ufnqkxUHsWlEkJNS0X64EC8nDdFmPT_pwmSJ9tJXOmLqVgZoHX3NaxVBcFECXzqHRxMWGJ0ovGho50Rza7oOauUdYTxUWN3kGv-GAE90jqc4jRg4I4HEiqYHhjVQcGd6wUikBJqXJENcfJxNMKOtATkCVBgYU Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: f7fd0a668c3c4ad78160b4fc42d01d71 Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-VolumesActionsTest-1665612634 Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f7fd0a668c3c4ad78160b4fc42d01d71", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f7fd0a668c3c4ad78160b4fc42d01d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7fd0a668c3c4ad78160b4fc42d01d71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7fd0a668c3c4ad78160b4fc42d01d71"}]}] Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-VolumesActionsTest-1665612634 Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: f7fd0a668c3c4ad78160b4fc42d01d71 Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-VolumesActionsTest-1665612634 Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-VolumesActionsTest-1665612634-project Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 41cbdfff1c6b43998e12d9170cb05b0a Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-VolumesActionsTest-1665612634-project Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 53aa5cc1-6446-4637-a3b2-0325e53f56dc could not be found. Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '53aa5cc1-6446-4637-a3b2-0325e53f56dc'} Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53aa5cc1-6446-4637-a3b2-0325e53f56dc could not be found. Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53aa5cc1-6446-4637-a3b2-0325e53f56dc could not be found. Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:25.094195 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:25.099901 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:25.099901 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:25.099901 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:25.099901 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:08:25.099901 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:08:25.099901 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53aa5cc1-6446-4637-a3b2-0325e53f56dc could not be found. Aug 29 16:08:25.099901 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:25.099901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7aecc444-8b0a-4833-a4e1-b953d4b68bdb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Returning 404 to user: Instance 53aa5cc1-6446-4637-a3b2-0325e53f56dc could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:08:25.099901 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7aecc444-8b0a-4833-a4e1-b953d4b68bdb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc" status: 404 len: 111 microversion: 2.1 time: 0.035508 Aug 29 16:08:25.099901 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3642/7068] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:25 2022] GET /compute/v2.1/servers/53aa5cc1-6446-4637-a3b2-0325e53f56dc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:08:25.151735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-467507069", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "a619bb56-1a87-401f-85a6-f0ac970634e0"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:25.210478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] validate_networks() for [('a619bb56-1a87-401f-85a6-f0ac970634e0', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:08:25.586329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:08:25.587000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:08:25.587580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:08:25.588051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:08:25.588531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:08:25.598141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:25.598706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:25.599222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:25.600051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:25.600510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:25.600930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:25.618098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Getting quotas for project f7fd0a668c3c4ad78160b4fc42d01d71. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:08:25.623482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Getting quotas for user 41cbdfff1c6b43998e12d9170cb05b0a and project f7fd0a668c3c4ad78160b4fc42d01d71. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:08:25.636072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:08:25.638437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:08:25.685650 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-22b5a3b2-0643-4753-877f-4adf81496a2c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537827 Aug 29 16:08:25.686529 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3427/7069] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:08:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:08:25.697227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8c14a903-068d-463a-b52e-791fa4045280 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:25.697855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8c14a903-068d-463a-b52e-791fa4045280 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:25.699791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=44 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:25.771683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8c14a903-068d-463a-b52e-791fa4045280 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:25.780081 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8c14a903-068d-463a-b52e-791fa4045280 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1" status: 200 len: 1213 microversion: 2.1 time: 0.086799 Aug 29 16:08:25.781427 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3643/7070] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:25 2022] GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:26.803261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ade9ce7a-0a88-4acd-8c16-addaba5fbc9c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:26.804243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ade9ce7a-0a88-4acd-8c16-addaba5fbc9c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:26.807187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:26.813753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ade9ce7a-0a88-4acd-8c16-addaba5fbc9c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:26.814545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ade9ce7a-0a88-4acd-8c16-addaba5fbc9c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:26.815047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ade9ce7a-0a88-4acd-8c16-addaba5fbc9c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:26.815998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ade9ce7a-0a88-4acd-8c16-addaba5fbc9c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:26.816495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ade9ce7a-0a88-4acd-8c16-addaba5fbc9c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:26.816927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ade9ce7a-0a88-4acd-8c16-addaba5fbc9c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:26.907160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ade9ce7a-0a88-4acd-8c16-addaba5fbc9c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:26.915467 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ade9ce7a-0a88-4acd-8c16-addaba5fbc9c tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1" status: 200 len: 1273 microversion: 2.1 time: 0.117523 Aug 29 16:08:26.916693 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3428/7071] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:26 2022] GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1 => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:27.935999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-55a176ba-897a-496f-b1d3-025386ac74c3 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:27.937342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-55a176ba-897a-496f-b1d3-025386ac74c3 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:27.945777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55a176ba-897a-496f-b1d3-025386ac74c3 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:27.946261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55a176ba-897a-496f-b1d3-025386ac74c3 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:27.946697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55a176ba-897a-496f-b1d3-025386ac74c3 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:27.947387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55a176ba-897a-496f-b1d3-025386ac74c3 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:27.947947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55a176ba-897a-496f-b1d3-025386ac74c3 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:27.948579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-55a176ba-897a-496f-b1d3-025386ac74c3 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:28.098124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-55a176ba-897a-496f-b1d3-025386ac74c3 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:28.110831 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-55a176ba-897a-496f-b1d3-025386ac74c3 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1" status: 200 len: 1313 microversion: 2.1 time: 0.178649 Aug 29 16:08:28.111979 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3644/7072] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:27 2022] GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:28.288007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-38db592d-6bca-4756-a81c-6dc5c1b163d5 req-49fce0e7-b91a-409a-89fa-83c4c9eaa4eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b53d8d0-19f6-4425-ba45-fc6085a468b1", "tag": "a21d3bcc-1064-42b9-8218-e6dbccc409e9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:28.299709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-38db592d-6bca-4756-a81c-6dc5c1b163d5 req-49fce0e7-b91a-409a-89fa-83c4c9eaa4eb service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:28.300453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-38db592d-6bca-4756-a81c-6dc5c1b163d5 req-49fce0e7-b91a-409a-89fa-83c4c9eaa4eb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:28.301224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-38db592d-6bca-4756-a81c-6dc5c1b163d5 req-49fce0e7-b91a-409a-89fa-83c4c9eaa4eb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:28.315159 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-38db592d-6bca-4756-a81c-6dc5c1b163d5 req-49fce0e7-b91a-409a-89fa-83c4c9eaa4eb service nova] Creating event network-changed:a21d3bcc-1064-42b9-8218-e6dbccc409e9 for instance 0b53d8d0-19f6-4425-ba45-fc6085a468b1 on n-h2-839401-11 Aug 29 16:08:28.321356 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-38db592d-6bca-4756-a81c-6dc5c1b163d5 req-49fce0e7-b91a-409a-89fa-83c4c9eaa4eb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037743 Aug 29 16:08:28.322163 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3429/7073] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:29.134348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d1e4d5d9-5587-4000-b22f-521d1fdc5ed7 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:29.135027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d1e4d5d9-5587-4000-b22f-521d1fdc5ed7 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:29.143934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1e4d5d9-5587-4000-b22f-521d1fdc5ed7 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:29.144429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1e4d5d9-5587-4000-b22f-521d1fdc5ed7 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:29.144876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1e4d5d9-5587-4000-b22f-521d1fdc5ed7 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:29.145621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1e4d5d9-5587-4000-b22f-521d1fdc5ed7 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:29.146101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1e4d5d9-5587-4000-b22f-521d1fdc5ed7 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:29.146533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1e4d5d9-5587-4000-b22f-521d1fdc5ed7 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:29.308951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d1e4d5d9-5587-4000-b22f-521d1fdc5ed7 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:29.317439 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d1e4d5d9-5587-4000-b22f-521d1fdc5ed7 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1" status: 200 len: 1313 microversion: 2.1 time: 0.188534 Aug 29 16:08:29.318036 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3645/7074] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:29 2022] GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:29.394643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1233765833", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b4c47014-d9bf-4d3e-a731-5715888afb6d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "957b06a2-5b5b-41f0-883f-0990cab206d9"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:29.457542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] validate_networks() for [('957b06a2-5b5b-41f0-883f-0990cab206d9', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:08:29.877069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:08:29.877528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:08:29.878024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:08:29.878445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:08:29.878871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:08:29.889196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:29.889686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:29.890131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:29.890876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:29.891462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:29.891944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:29.909373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:08:29.915223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for user f07d896c6764402999345759f2348080 and project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:08:29.981670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:08:29.984216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b4c47014-d9bf-4d3e-a731-5715888afb6d',volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:08:30.117869 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:08:30.118131 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 16:08:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.62) !!! Aug 29 16:08:30.140452 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-25750397-6dbd-4555-a83d-2bd2492f9699 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751142 Aug 29 16:08:30.147259 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3430/7075] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:08:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:08:30.153120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a5e00f76-4260-470f-92f6-5ae3afa53dc3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:30.154282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a5e00f76-4260-470f-92f6-5ae3afa53dc3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:30.218838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a5e00f76-4260-470f-92f6-5ae3afa53dc3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:30.226163 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a5e00f76-4260-470f-92f6-5ae3afa53dc3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1071 microversion: 2.1 time: 0.077231 Aug 29 16:08:30.227042 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3646/7076] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:30 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1071 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:30.338001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6f27092c-06fe-4519-8e87-1808f1ff3b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:30.338630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6f27092c-06fe-4519-8e87-1808f1ff3b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:30.346345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f27092c-06fe-4519-8e87-1808f1ff3b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:30.346838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f27092c-06fe-4519-8e87-1808f1ff3b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:30.347285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f27092c-06fe-4519-8e87-1808f1ff3b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:30.347994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f27092c-06fe-4519-8e87-1808f1ff3b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:30.348455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f27092c-06fe-4519-8e87-1808f1ff3b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:30.348885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6f27092c-06fe-4519-8e87-1808f1ff3b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:30.497716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6f27092c-06fe-4519-8e87-1808f1ff3b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:30.505930 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6f27092c-06fe-4519-8e87-1808f1ff3b71 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1" status: 200 len: 1313 microversion: 2.1 time: 0.171902 Aug 29 16:08:30.506751 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3431/7077] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:30 2022] GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:31.247436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1112c16c-fee9-40e0-8e8c-3effddcc514e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:31.248048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1112c16c-fee9-40e0-8e8c-3effddcc514e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:31.256228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1112c16c-fee9-40e0-8e8c-3effddcc514e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:31.256719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1112c16c-fee9-40e0-8e8c-3effddcc514e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:31.257192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1112c16c-fee9-40e0-8e8c-3effddcc514e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:31.257890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1112c16c-fee9-40e0-8e8c-3effddcc514e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:31.258343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1112c16c-fee9-40e0-8e8c-3effddcc514e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:31.259410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1112c16c-fee9-40e0-8e8c-3effddcc514e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:31.325764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1112c16c-fee9-40e0-8e8c-3effddcc514e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:31.334131 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1112c16c-fee9-40e0-8e8c-3effddcc514e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1169 microversion: 2.1 time: 0.091110 Aug 29 16:08:31.334712 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3647/7078] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:31 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1169 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:31.529788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8b599eeb-4f9a-4a99-bf15-2cfd59a9b57b tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:31.530451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8b599eeb-4f9a-4a99-bf15-2cfd59a9b57b tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:31.539447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b599eeb-4f9a-4a99-bf15-2cfd59a9b57b tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:31.539966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b599eeb-4f9a-4a99-bf15-2cfd59a9b57b tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:31.540421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b599eeb-4f9a-4a99-bf15-2cfd59a9b57b tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:31.541198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b599eeb-4f9a-4a99-bf15-2cfd59a9b57b tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:31.541700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b599eeb-4f9a-4a99-bf15-2cfd59a9b57b tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:31.542135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b599eeb-4f9a-4a99-bf15-2cfd59a9b57b tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:31.801567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8b599eeb-4f9a-4a99-bf15-2cfd59a9b57b tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:31.812285 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8b599eeb-4f9a-4a99-bf15-2cfd59a9b57b tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1" status: 200 len: 1313 microversion: 2.1 time: 0.286618 Aug 29 16:08:31.813078 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3432/7079] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:31 2022] GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:32.357339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7020068c-0287-462b-8226-3fd2e9a773ae tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:32.358792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7020068c-0287-462b-8226-3fd2e9a773ae tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:32.368647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7020068c-0287-462b-8226-3fd2e9a773ae tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:32.369496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7020068c-0287-462b-8226-3fd2e9a773ae tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:32.370243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7020068c-0287-462b-8226-3fd2e9a773ae tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:32.371193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7020068c-0287-462b-8226-3fd2e9a773ae tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:32.372172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7020068c-0287-462b-8226-3fd2e9a773ae tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:32.372871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7020068c-0287-462b-8226-3fd2e9a773ae tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:32.475802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7020068c-0287-462b-8226-3fd2e9a773ae tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:32.484709 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7020068c-0287-462b-8226-3fd2e9a773ae tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1187 microversion: 2.1 time: 0.132985 Aug 29 16:08:32.497307 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3648/7080] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:32 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1187 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:32.834044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-89c3a607-c311-428f-b702-66db285cd4eb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:32.835043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-89c3a607-c311-428f-b702-66db285cd4eb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:32.843945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89c3a607-c311-428f-b702-66db285cd4eb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:32.844603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89c3a607-c311-428f-b702-66db285cd4eb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:32.849207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89c3a607-c311-428f-b702-66db285cd4eb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:32.853886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89c3a607-c311-428f-b702-66db285cd4eb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:32.854641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89c3a607-c311-428f-b702-66db285cd4eb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:32.861620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-89c3a607-c311-428f-b702-66db285cd4eb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:33.207408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-89c3a607-c311-428f-b702-66db285cd4eb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:33.216651 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-89c3a607-c311-428f-b702-66db285cd4eb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1" status: 200 len: 1313 microversion: 2.1 time: 0.386604 Aug 29 16:08:33.258143 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3433/7081] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:32 2022] GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1 => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:33.507345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-756f8fad-c33b-47e6-b0a4-a1c161518e77 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:33.508082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-756f8fad-c33b-47e6-b0a4-a1c161518e77 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:33.528214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-756f8fad-c33b-47e6-b0a4-a1c161518e77 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:33.528712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-756f8fad-c33b-47e6-b0a4-a1c161518e77 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:33.530755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-756f8fad-c33b-47e6-b0a4-a1c161518e77 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:33.531553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-756f8fad-c33b-47e6-b0a4-a1c161518e77 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:33.532039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-756f8fad-c33b-47e6-b0a4-a1c161518e77 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:33.532470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-756f8fad-c33b-47e6-b0a4-a1c161518e77 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:33.777548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-756f8fad-c33b-47e6-b0a4-a1c161518e77 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:33.792754 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-756f8fad-c33b-47e6-b0a4-a1c161518e77 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1229 microversion: 2.1 time: 0.289679 Aug 29 16:08:33.808638 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3649/7082] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:33 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1229 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:33.811114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-5c3c2efe-19ee-4480-879e-7cf4300685ad req-0774a485-5999-47d1-9880-c58b9bad2b2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1094df4-9ce0-4389-a24f-b0d65119a7f4", "tag": "d4721e07-ba3d-44c0-ad78-3a003cb28b18"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:33.835256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5c3c2efe-19ee-4480-879e-7cf4300685ad req-0774a485-5999-47d1-9880-c58b9bad2b2a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:33.835911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5c3c2efe-19ee-4480-879e-7cf4300685ad req-0774a485-5999-47d1-9880-c58b9bad2b2a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:33.836327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5c3c2efe-19ee-4480-879e-7cf4300685ad req-0774a485-5999-47d1-9880-c58b9bad2b2a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:33.860913 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5c3c2efe-19ee-4480-879e-7cf4300685ad req-0774a485-5999-47d1-9880-c58b9bad2b2a service nova] Creating event network-changed:d4721e07-ba3d-44c0-ad78-3a003cb28b18 for instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 on n-h2-839401-11 Aug 29 16:08:33.866922 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-5c3c2efe-19ee-4480-879e-7cf4300685ad req-0774a485-5999-47d1-9880-c58b9bad2b2a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060702 Aug 29 16:08:33.868293 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3434/7083] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:08:33.894733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1250badb-ba01-4a8e-ab44-752be48c143f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:33.895583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1250badb-ba01-4a8e-ab44-752be48c143f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:33.903470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1250badb-ba01-4a8e-ab44-752be48c143f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:33.904543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1250badb-ba01-4a8e-ab44-752be48c143f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:33.905218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1250badb-ba01-4a8e-ab44-752be48c143f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:33.906174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1250badb-ba01-4a8e-ab44-752be48c143f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:33.906846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1250badb-ba01-4a8e-ab44-752be48c143f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:33.908087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1250badb-ba01-4a8e-ab44-752be48c143f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:33.951641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1250badb-ba01-4a8e-ab44-752be48c143f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:08:34.058923 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1250badb-ba01-4a8e-ab44-752be48c143f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 204 len: 0 microversion: 2.1 time: 0.169377 Aug 29 16:08:34.061523 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3650/7084] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:08:33 2022] DELETE /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:08:34.070634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-34b8305b-23ab-4342-8d62-9396b62e326b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:34.071805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-34b8305b-23ab-4342-8d62-9396b62e326b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:34.078815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b8305b-23ab-4342-8d62-9396b62e326b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.080259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b8305b-23ab-4342-8d62-9396b62e326b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.080916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b8305b-23ab-4342-8d62-9396b62e326b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:34.084282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b8305b-23ab-4342-8d62-9396b62e326b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.084976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b8305b-23ab-4342-8d62-9396b62e326b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.085642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34b8305b-23ab-4342-8d62-9396b62e326b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:34.242504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b70f7428-ffd0-4860-b134-2b470a0dc986 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:34.244296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b70f7428-ffd0-4860-b134-2b470a0dc986 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:34.252885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b70f7428-ffd0-4860-b134-2b470a0dc986 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.253812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b70f7428-ffd0-4860-b134-2b470a0dc986 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.254887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b70f7428-ffd0-4860-b134-2b470a0dc986 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:34.255940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b70f7428-ffd0-4860-b134-2b470a0dc986 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.256631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b70f7428-ffd0-4860-b134-2b470a0dc986 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.258222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b70f7428-ffd0-4860-b134-2b470a0dc986 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:34.301136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-34b8305b-23ab-4342-8d62-9396b62e326b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:34.321778 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-34b8305b-23ab-4342-8d62-9396b62e326b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 200 len: 1550 microversion: 2.1 time: 0.255346 Aug 29 16:08:34.340457 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3435/7085] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:34 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 1550 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:34.457683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b70f7428-ffd0-4860-b134-2b470a0dc986 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:34.466615 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b70f7428-ffd0-4860-b134-2b470a0dc986 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1" status: 200 len: 1313 microversion: 2.1 time: 0.231413 Aug 29 16:08:34.469165 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3651/7086] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:34 2022] GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:34.816150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0620e47c-96aa-426a-803e-e8484901423b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:34.816950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0620e47c-96aa-426a-803e-e8484901423b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:34.825508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0620e47c-96aa-426a-803e-e8484901423b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.826533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0620e47c-96aa-426a-803e-e8484901423b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.827198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0620e47c-96aa-426a-803e-e8484901423b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:34.828271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0620e47c-96aa-426a-803e-e8484901423b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.829399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0620e47c-96aa-426a-803e-e8484901423b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.830054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0620e47c-96aa-426a-803e-e8484901423b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:34.970738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a8f6cd8c-624c-4e64-b60d-d1c373023cd5 req-18af36c8-8c25-43c3-89bf-46ea710feeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b53d8d0-19f6-4425-ba45-fc6085a468b1", "name": "network-vif-plugged", "status": "completed", "tag": "a21d3bcc-1064-42b9-8218-e6dbccc409e9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:34.983713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a8f6cd8c-624c-4e64-b60d-d1c373023cd5 req-18af36c8-8c25-43c3-89bf-46ea710feeb3 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.984478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a8f6cd8c-624c-4e64-b60d-d1c373023cd5 req-18af36c8-8c25-43c3-89bf-46ea710feeb3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.985106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a8f6cd8c-624c-4e64-b60d-d1c373023cd5 req-18af36c8-8c25-43c3-89bf-46ea710feeb3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:35.002570 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a8f6cd8c-624c-4e64-b60d-d1c373023cd5 req-18af36c8-8c25-43c3-89bf-46ea710feeb3 service nova] Creating event network-vif-plugged:a21d3bcc-1064-42b9-8218-e6dbccc409e9 for instance 0b53d8d0-19f6-4425-ba45-fc6085a468b1 on n-h2-839401-11 Aug 29 16:08:35.009516 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a8f6cd8c-624c-4e64-b60d-d1c373023cd5 req-18af36c8-8c25-43c3-89bf-46ea710feeb3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053399 Aug 29 16:08:35.010589 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3652/7087] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:35.059269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0620e47c-96aa-426a-803e-e8484901423b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:35.076239 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0620e47c-96aa-426a-803e-e8484901423b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1229 microversion: 2.1 time: 0.258105 Aug 29 16:08:35.083796 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3436/7088] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:34 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1229 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:35.345232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0e39dad7-68a7-4458-abd6-3ed36ab391bc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:35.345953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0e39dad7-68a7-4458-abd6-3ed36ab391bc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:35.353544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e39dad7-68a7-4458-abd6-3ed36ab391bc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:35.354087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e39dad7-68a7-4458-abd6-3ed36ab391bc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:35.354555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e39dad7-68a7-4458-abd6-3ed36ab391bc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:35.355320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e39dad7-68a7-4458-abd6-3ed36ab391bc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:35.355731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e39dad7-68a7-4458-abd6-3ed36ab391bc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:35.356165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e39dad7-68a7-4458-abd6-3ed36ab391bc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:35.489077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-09e40411-76ff-46c8-9bf8-e8ad412638e8 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:35.490044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-09e40411-76ff-46c8-9bf8-e8ad412638e8 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:35.497384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09e40411-76ff-46c8-9bf8-e8ad412638e8 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:35.497879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09e40411-76ff-46c8-9bf8-e8ad412638e8 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:35.498321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09e40411-76ff-46c8-9bf8-e8ad412638e8 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:35.499039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09e40411-76ff-46c8-9bf8-e8ad412638e8 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:35.499551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09e40411-76ff-46c8-9bf8-e8ad412638e8 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:35.500186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09e40411-76ff-46c8-9bf8-e8ad412638e8 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:35.506615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0e39dad7-68a7-4458-abd6-3ed36ab391bc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:35.514779 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0e39dad7-68a7-4458-abd6-3ed36ab391bc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 200 len: 1550 microversion: 2.1 time: 0.174883 Aug 29 16:08:35.515685 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3653/7089] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:35 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 1550 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:35.647844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-09e40411-76ff-46c8-9bf8-e8ad412638e8 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:35.655721 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-09e40411-76ff-46c8-9bf8-e8ad412638e8 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1" status: 200 len: 1313 microversion: 2.1 time: 0.170957 Aug 29 16:08:35.656332 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3437/7090] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:35 2022] GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:36.103557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c05de173-db43-4cf0-81e9-81a71452ebcc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:36.105309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c05de173-db43-4cf0-81e9-81a71452ebcc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:36.112389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c05de173-db43-4cf0-81e9-81a71452ebcc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:36.112943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c05de173-db43-4cf0-81e9-81a71452ebcc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:36.113421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c05de173-db43-4cf0-81e9-81a71452ebcc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:36.114157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c05de173-db43-4cf0-81e9-81a71452ebcc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:36.114623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c05de173-db43-4cf0-81e9-81a71452ebcc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:36.115048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c05de173-db43-4cf0-81e9-81a71452ebcc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:36.276117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c05de173-db43-4cf0-81e9-81a71452ebcc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:36.285034 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c05de173-db43-4cf0-81e9-81a71452ebcc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1229 microversion: 2.1 time: 0.187256 Aug 29 16:08:36.285984 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3654/7091] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:36 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1229 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:36.362567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b104c4ca-cfe4-4343-927f-fa0116e11d3b req-0f6078cb-7fd3-4489-af7c-683bb4a1a8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c1bea9-120e-4c7a-9908-a902c4e1e1cf", "name": "network-vif-deleted", "tag": "603a3751-4978-4e1e-bde2-4bce0346293e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:36.373380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b104c4ca-cfe4-4343-927f-fa0116e11d3b req-0f6078cb-7fd3-4489-af7c-683bb4a1a8f6 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:36.373866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b104c4ca-cfe4-4343-927f-fa0116e11d3b req-0f6078cb-7fd3-4489-af7c-683bb4a1a8f6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:36.374297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b104c4ca-cfe4-4343-927f-fa0116e11d3b req-0f6078cb-7fd3-4489-af7c-683bb4a1a8f6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:36.386930 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b104c4ca-cfe4-4343-927f-fa0116e11d3b req-0f6078cb-7fd3-4489-af7c-683bb4a1a8f6 service nova] Creating event network-vif-deleted:603a3751-4978-4e1e-bde2-4bce0346293e for instance b4c1bea9-120e-4c7a-9908-a902c4e1e1cf on n-h1-839401-11 Aug 29 16:08:36.392549 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b104c4ca-cfe4-4343-927f-fa0116e11d3b req-0f6078cb-7fd3-4489-af7c-683bb4a1a8f6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033692 Aug 29 16:08:36.393413 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3438/7092] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:08:36.537192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7ec9d04d-c5c4-4587-bedf-41ededf03ddb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:36.537882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7ec9d04d-c5c4-4587-bedf-41ededf03ddb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:36.546426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ec9d04d-c5c4-4587-bedf-41ededf03ddb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:36.547342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ec9d04d-c5c4-4587-bedf-41ededf03ddb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:36.548165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ec9d04d-c5c4-4587-bedf-41ededf03ddb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:36.549896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ec9d04d-c5c4-4587-bedf-41ededf03ddb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:36.550617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ec9d04d-c5c4-4587-bedf-41ededf03ddb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:36.551053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ec9d04d-c5c4-4587-bedf-41ededf03ddb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:36.586344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ec9d04d-c5c4-4587-bedf-41ededf03ddb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:36.586950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ec9d04d-c5c4-4587-bedf-41ededf03ddb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:36.587275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7ec9d04d-c5c4-4587-bedf-41ededf03ddb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:36.587889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-7ec9d04d-c5c4-4587-bedf-41ededf03ddb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lazy-loading 'fault' on Instance uuid b4c1bea9-120e-4c7a-9908-a902c4e1e1cf {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:08:36.635759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7ec9d04d-c5c4-4587-bedf-41ededf03ddb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:36.652608 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7ec9d04d-c5c4-4587-bedf-41ededf03ddb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 200 len: 1337 microversion: 2.1 time: 0.119413 Aug 29 16:08:36.654566 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3655/7093] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:36 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 1337 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:36.677741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9bc5d629-ad0a-4442-ab01-e5409d46617f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:36.678611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9bc5d629-ad0a-4442-ab01-e5409d46617f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:36.691005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bc5d629-ad0a-4442-ab01-e5409d46617f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:36.692050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bc5d629-ad0a-4442-ab01-e5409d46617f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:36.692735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bc5d629-ad0a-4442-ab01-e5409d46617f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:36.693734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bc5d629-ad0a-4442-ab01-e5409d46617f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:36.694512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bc5d629-ad0a-4442-ab01-e5409d46617f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:36.700481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9bc5d629-ad0a-4442-ab01-e5409d46617f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:36.865067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9bc5d629-ad0a-4442-ab01-e5409d46617f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:36.874155 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9bc5d629-ad0a-4442-ab01-e5409d46617f tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1" status: 200 len: 1497 microversion: 2.1 time: 0.201747 Aug 29 16:08:36.874760 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3439/7094] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:36 2022] GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1 => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:37.307664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-54e062aa-6e33-4a4a-b999-fed1cbe9ae1e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:37.308275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-54e062aa-6e33-4a4a-b999-fed1cbe9ae1e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:37.316309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54e062aa-6e33-4a4a-b999-fed1cbe9ae1e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:37.317062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54e062aa-6e33-4a4a-b999-fed1cbe9ae1e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:37.317528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54e062aa-6e33-4a4a-b999-fed1cbe9ae1e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:37.318233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54e062aa-6e33-4a4a-b999-fed1cbe9ae1e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:37.318688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54e062aa-6e33-4a4a-b999-fed1cbe9ae1e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:37.324187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54e062aa-6e33-4a4a-b999-fed1cbe9ae1e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:37.337549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6acf2cdd-578a-4c45-ae10-d5b9053122fb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:37.338939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6acf2cdd-578a-4c45-ae10-d5b9053122fb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:37.345056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6acf2cdd-578a-4c45-ae10-d5b9053122fb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:37.345575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6acf2cdd-578a-4c45-ae10-d5b9053122fb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:37.346012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6acf2cdd-578a-4c45-ae10-d5b9053122fb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:37.346715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6acf2cdd-578a-4c45-ae10-d5b9053122fb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:37.347169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6acf2cdd-578a-4c45-ae10-d5b9053122fb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:37.347628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6acf2cdd-578a-4c45-ae10-d5b9053122fb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:37.471148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-54e062aa-6e33-4a4a-b999-fed1cbe9ae1e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:37.480480 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-54e062aa-6e33-4a4a-b999-fed1cbe9ae1e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1217 microversion: 2.1 time: 0.176812 Aug 29 16:08:37.481070 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3656/7095] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:37 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:37.663655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6acf2cdd-578a-4c45-ae10-d5b9053122fb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:08:37.666707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:37.675943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f45cc41a-6de4-4a0e-8bbe-dfb5fcdd622a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:37.676758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f45cc41a-6de4-4a0e-8bbe-dfb5fcdd622a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: b4c1bea9-120e-4c7a-9908-a902c4e1e1cf] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:37.683087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f45cc41a-6de4-4a0e-8bbe-dfb5fcdd622a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:37.683585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f45cc41a-6de4-4a0e-8bbe-dfb5fcdd622a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:37.684022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f45cc41a-6de4-4a0e-8bbe-dfb5fcdd622a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:37.684727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f45cc41a-6de4-4a0e-8bbe-dfb5fcdd622a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:37.685207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f45cc41a-6de4-4a0e-8bbe-dfb5fcdd622a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:37.685633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f45cc41a-6de4-4a0e-8bbe-dfb5fcdd622a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:37.699568 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-f45cc41a-6de4-4a0e-8bbe-dfb5fcdd622a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] HTTP exception thrown: Instance b4c1bea9-120e-4c7a-9908-a902c4e1e1cf could not be found. Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f45cc41a-6de4-4a0e-8bbe-dfb5fcdd622a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Request method failure captured: Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf HTTP/1.1 Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOPr44R9z576F5E1d-USYwU1PbIFlpFQAwv-Lo_2zGvPYKWa3vKoxMA2WGcHxbw831FwCjScDG3XbBeWWc9aTxSlqqxsveSnR4R0oeIFQunvxkO4O_OI8Y3OUCZt6qlmkCCT06apMRiuq3TXxgQ5EkG2rnBj1gc_Ma_fTxYGOy4Uw-A Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: dc8a8f9ddd384ca2bcdacb55b92006d9 Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestNetworkBasicOps-2055818920 Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_dc8a8f9ddd384ca2bcdacb55b92006d9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/dc8a8f9ddd384ca2bcdacb55b92006d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc8a8f9ddd384ca2bcdacb55b92006d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc8a8f9ddd384ca2bcdacb55b92006d9"}]}] Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestNetworkBasicOps-2055818920 Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: dc8a8f9ddd384ca2bcdacb55b92006d9 Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestNetworkBasicOps-2055818920 Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestNetworkBasicOps-2055818920-project Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: e2d56709bf4c41eeb6e15bcdfd140999 Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestNetworkBasicOps-2055818920-project Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance b4c1bea9-120e-4c7a-9908-a902c4e1e1cf could not be found. Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b4c1bea9-120e-4c7a-9908-a902c4e1e1cf'} Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c1bea9-120e-4c7a-9908-a902c4e1e1cf could not be found. Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c1bea9-120e-4c7a-9908-a902c4e1e1cf could not be found. Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:37.701321 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:37.706897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:37.706897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:37.706897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:37.706897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:08:37.706897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:08:37.706897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c1bea9-120e-4c7a-9908-a902c4e1e1cf could not be found. Aug 29 16:08:37.706897 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:08:37.706897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f45cc41a-6de4-4a0e-8bbe-dfb5fcdd622a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Returning 404 to user: Instance b4c1bea9-120e-4c7a-9908-a902c4e1e1cf could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:08:37.706897 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f45cc41a-6de4-4a0e-8bbe-dfb5fcdd622a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf" status: 404 len: 111 microversion: 2.1 time: 0.030764 Aug 29 16:08:37.706897 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3657/7096] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:37 2022] GET /compute/v2.1/servers/b4c1bea9-120e-4c7a-9908-a902c4e1e1cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:08:37.748429 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6acf2cdd-578a-4c45-ae10-d5b9053122fb tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1" status: 204 len: 0 microversion: 2.1 time: 0.414593 Aug 29 16:08:37.749327 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3440/7097] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:08:37 2022] DELETE /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:08:37.758314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1c19f5d8-7fad-4e63-a2e2-095102894081 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:37.758940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1c19f5d8-7fad-4e63-a2e2-095102894081 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:37.766053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c19f5d8-7fad-4e63-a2e2-095102894081 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:37.766566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c19f5d8-7fad-4e63-a2e2-095102894081 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:37.767065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c19f5d8-7fad-4e63-a2e2-095102894081 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:37.767819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c19f5d8-7fad-4e63-a2e2-095102894081 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:37.768252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c19f5d8-7fad-4e63-a2e2-095102894081 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:37.768678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c19f5d8-7fad-4e63-a2e2-095102894081 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:37.938084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1c19f5d8-7fad-4e63-a2e2-095102894081 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:37.949305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-68583137-224a-4f12-93cd-517df8fb1111 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '.version_select at 0x7fc42a343670>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:37.960381 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1c19f5d8-7fad-4e63-a2e2-095102894081 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1" status: 200 len: 1503 microversion: 2.1 time: 0.199793 Aug 29 16:08:37.961697 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3658/7098] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:37 2022] GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1 => generated 1503 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:37.979104 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-68583137-224a-4f12-93cd-517df8fb1111 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-460911193" status: 202 len: 0 microversion: 2.1 time: 0.034400 Aug 29 16:08:37.979711 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3441/7099] 10.222.0.62 () {58 vars in 1254 bytes} [Mon Aug 29 16:08:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-460911193 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:08:38.502670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-929fc2b9-b00d-4ee9-a797-eadc4eb8d9e4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:38.504308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-929fc2b9-b00d-4ee9-a797-eadc4eb8d9e4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:38.511244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-929fc2b9-b00d-4ee9-a797-eadc4eb8d9e4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:38.512021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-929fc2b9-b00d-4ee9-a797-eadc4eb8d9e4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:38.512636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-929fc2b9-b00d-4ee9-a797-eadc4eb8d9e4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:38.513532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-929fc2b9-b00d-4ee9-a797-eadc4eb8d9e4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:38.514150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-929fc2b9-b00d-4ee9-a797-eadc4eb8d9e4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:38.514735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-929fc2b9-b00d-4ee9-a797-eadc4eb8d9e4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:38.666258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-929fc2b9-b00d-4ee9-a797-eadc4eb8d9e4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:38.683450 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-929fc2b9-b00d-4ee9-a797-eadc4eb8d9e4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1217 microversion: 2.1 time: 0.184897 Aug 29 16:08:38.684046 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3659/7100] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:38 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1217 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:38.984332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ab3a8869-36a4-4028-988b-cbccc201ae66 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:38.985155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ab3a8869-36a4-4028-988b-cbccc201ae66 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:38.993146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab3a8869-36a4-4028-988b-cbccc201ae66 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:38.993654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab3a8869-36a4-4028-988b-cbccc201ae66 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:38.994138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab3a8869-36a4-4028-988b-cbccc201ae66 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:38.994851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab3a8869-36a4-4028-988b-cbccc201ae66 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:38.995318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab3a8869-36a4-4028-988b-cbccc201ae66 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:38.995750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab3a8869-36a4-4028-988b-cbccc201ae66 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.136883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ab3a8869-36a4-4028-988b-cbccc201ae66 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:39.145904 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ab3a8869-36a4-4028-988b-cbccc201ae66 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1" status: 200 len: 1503 microversion: 2.1 time: 0.165592 Aug 29 16:08:39.146501 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3442/7101] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:38 2022] GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:39.704156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ad7724c0-8c41-4463-8f14-f7c36658981e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:39.704882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ad7724c0-8c41-4463-8f14-f7c36658981e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:39.712575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad7724c0-8c41-4463-8f14-f7c36658981e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.713395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad7724c0-8c41-4463-8f14-f7c36658981e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.713874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad7724c0-8c41-4463-8f14-f7c36658981e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.714596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad7724c0-8c41-4463-8f14-f7c36658981e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.715045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad7724c0-8c41-4463-8f14-f7c36658981e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.715471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ad7724c0-8c41-4463-8f14-f7c36658981e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.960349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ad7724c0-8c41-4463-8f14-f7c36658981e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:39.962819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:39.970678 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ad7724c0-8c41-4463-8f14-f7c36658981e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1217 microversion: 2.1 time: 0.270385 Aug 29 16:08:39.971345 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3660/7102] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:39 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1217 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:40.167619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e0f07a1-325c-454a-bbbd-2c1f9b00fc31 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:40.168391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9e0f07a1-325c-454a-bbbd-2c1f9b00fc31 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:40.171758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:40.173190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:40.180210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e0f07a1-325c-454a-bbbd-2c1f9b00fc31 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:40.181262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e0f07a1-325c-454a-bbbd-2c1f9b00fc31 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:40.181925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e0f07a1-325c-454a-bbbd-2c1f9b00fc31 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:40.183259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e0f07a1-325c-454a-bbbd-2c1f9b00fc31 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:40.183942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e0f07a1-325c-454a-bbbd-2c1f9b00fc31 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:40.184481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e0f07a1-325c-454a-bbbd-2c1f9b00fc31 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:40.186727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6a4d59c4-1ba8-497b-9e8d-ceb323cc56fb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:40.187231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6a4d59c4-1ba8-497b-9e8d-ceb323cc56fb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:40.203011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a4d59c4-1ba8-497b-9e8d-ceb323cc56fb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:40.203781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a4d59c4-1ba8-497b-9e8d-ceb323cc56fb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:40.204380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a4d59c4-1ba8-497b-9e8d-ceb323cc56fb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:40.205958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a4d59c4-1ba8-497b-9e8d-ceb323cc56fb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:40.206657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a4d59c4-1ba8-497b-9e8d-ceb323cc56fb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:40.207255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6a4d59c4-1ba8-497b-9e8d-ceb323cc56fb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:40.225077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:40.237107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6a4d59c4-1ba8-497b-9e8d-ceb323cc56fb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:08:40.325836 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6a4d59c4-1ba8-497b-9e8d-ceb323cc56fb tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 204 len: 0 microversion: 2.1 time: 0.144900 Aug 29 16:08:40.332669 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3661/7103] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:08:40 2022] DELETE /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:08:40.338316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-ff19072a-ce6d-4bf1-b12d-6df600b2578c req-f8233d11-a22e-4dee-a6fc-993a7082562f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea52328-23db-4bc0-966c-4505bcf3e518", "tag": "2e36b390-19b1-4545-8bf2-d5ed43dc59fb"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:40.349195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ff19072a-ce6d-4bf1-b12d-6df600b2578c req-f8233d11-a22e-4dee-a6fc-993a7082562f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:40.349687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ff19072a-ce6d-4bf1-b12d-6df600b2578c req-f8233d11-a22e-4dee-a6fc-993a7082562f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:40.350121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ff19072a-ce6d-4bf1-b12d-6df600b2578c req-f8233d11-a22e-4dee-a6fc-993a7082562f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:40.363378 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-ff19072a-ce6d-4bf1-b12d-6df600b2578c req-f8233d11-a22e-4dee-a6fc-993a7082562f service nova] Creating event network-changed:2e36b390-19b1-4545-8bf2-d5ed43dc59fb for instance 8ea52328-23db-4bc0-966c-4505bcf3e518 on n-h1-839401-11 Aug 29 16:08:40.368974 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-ff19072a-ce6d-4bf1-b12d-6df600b2578c req-f8233d11-a22e-4dee-a6fc-993a7082562f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034574 Aug 29 16:08:40.373755 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3662/7104] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:40.380811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fc9c134e-3622-4840-925a-925bb84f776f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:40.381569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fc9c134e-3622-4840-925a-925bb84f776f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:40.390095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc9c134e-3622-4840-925a-925bb84f776f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:40.390606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc9c134e-3622-4840-925a-925bb84f776f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:40.391612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc9c134e-3622-4840-925a-925bb84f776f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:40.391963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc9c134e-3622-4840-925a-925bb84f776f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:40.392429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc9c134e-3622-4840-925a-925bb84f776f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:40.393171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc9c134e-3622-4840-925a-925bb84f776f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:40.425934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9e0f07a1-325c-454a-bbbd-2c1f9b00fc31 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cbdfff1c6b43998e12d9170cb05b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fd0a668c3c4ad78160b4fc42d01d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:40.448770 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9e0f07a1-325c-454a-bbbd-2c1f9b00fc31 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1" status: 200 len: 1503 microversion: 2.1 time: 0.284878 Aug 29 16:08:40.449930 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3443/7105] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:40 2022] GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1 => generated 1503 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:40.547791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fc9c134e-3622-4840-925a-925bb84f776f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:40.556366 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fc9c134e-3622-4840-925a-925bb84f776f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 200 len: 1668 microversion: 2.1 time: 0.181159 Aug 29 16:08:40.562596 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3663/7106] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:40 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 1668 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:40.669785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-c38ec04c-5e06-4729-be8c-c4f6e40c4d34 req-e2e22e3e-61f9-4ef1-801c-4fdb651a6196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b53d8d0-19f6-4425-ba45-fc6085a468b1", "name": "network-vif-deleted", "tag": "a21d3bcc-1064-42b9-8218-e6dbccc409e9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:40.681120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c38ec04c-5e06-4729-be8c-c4f6e40c4d34 req-e2e22e3e-61f9-4ef1-801c-4fdb651a6196 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:40.682215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c38ec04c-5e06-4729-be8c-c4f6e40c4d34 req-e2e22e3e-61f9-4ef1-801c-4fdb651a6196 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:40.682656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c38ec04c-5e06-4729-be8c-c4f6e40c4d34 req-e2e22e3e-61f9-4ef1-801c-4fdb651a6196 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:40.694715 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-c38ec04c-5e06-4729-be8c-c4f6e40c4d34 req-e2e22e3e-61f9-4ef1-801c-4fdb651a6196 service nova] Creating event network-vif-deleted:a21d3bcc-1064-42b9-8218-e6dbccc409e9 for instance 0b53d8d0-19f6-4425-ba45-fc6085a468b1 on n-h2-839401-11 Aug 29 16:08:40.700257 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-c38ec04c-5e06-4729-be8c-c4f6e40c4d34 req-e2e22e3e-61f9-4ef1-801c-4fdb651a6196 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034265 Aug 29 16:08:40.700865 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3444/7107] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:40.992100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-373cd8d8-24e9-4f65-8719-0916defab237 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:40.992726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-373cd8d8-24e9-4f65-8719-0916defab237 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:41.000170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373cd8d8-24e9-4f65-8719-0916defab237 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:41.000654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373cd8d8-24e9-4f65-8719-0916defab237 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:41.001163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373cd8d8-24e9-4f65-8719-0916defab237 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:41.001910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373cd8d8-24e9-4f65-8719-0916defab237 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:41.002372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373cd8d8-24e9-4f65-8719-0916defab237 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:41.002799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-373cd8d8-24e9-4f65-8719-0916defab237 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:41.157569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-373cd8d8-24e9-4f65-8719-0916defab237 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:41.165855 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-373cd8d8-24e9-4f65-8719-0916defab237 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1217 microversion: 2.1 time: 0.177890 Aug 29 16:08:41.166548 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3664/7108] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:40 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:41.472461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-24f36fe2-3505-4e9b-a56c-10b01c6e7561 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:41.473075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-24f36fe2-3505-4e9b-a56c-10b01c6e7561 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] [instance: 0b53d8d0-19f6-4425-ba45-fc6085a468b1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:41.479732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24f36fe2-3505-4e9b-a56c-10b01c6e7561 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:41.480302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24f36fe2-3505-4e9b-a56c-10b01c6e7561 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:41.480657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24f36fe2-3505-4e9b-a56c-10b01c6e7561 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:41.481395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24f36fe2-3505-4e9b-a56c-10b01c6e7561 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:41.481858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24f36fe2-3505-4e9b-a56c-10b01c6e7561 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:41.482287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24f36fe2-3505-4e9b-a56c-10b01c6e7561 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:41.496142 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-24f36fe2-3505-4e9b-a56c-10b01c6e7561 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] HTTP exception thrown: Instance 0b53d8d0-19f6-4425-ba45-fc6085a468b1 could not be found. Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-24f36fe2-3505-4e9b-a56c-10b01c6e7561 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Request method failure captured: Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1 HTTP/1.1 Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDORmWH91fdiL1CDoa8ufnqkxUHsWlEkJNS0X64EC8nDdFmPT_pwmSJ9tJXOmLqVgZoHX3NaxVBcFECXzqHRxMWGJ0ovGho50Rza7oOauUdYTxUWN3kGv-GAE90jqc4jRg4I4HEiqYHhjVQcGd6wUikBJqXJENcfJxNMKOtATkCVBgYU Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: f7fd0a668c3c4ad78160b4fc42d01d71 Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-VolumesActionsTest-1665612634 Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f7fd0a668c3c4ad78160b4fc42d01d71", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f7fd0a668c3c4ad78160b4fc42d01d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7fd0a668c3c4ad78160b4fc42d01d71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f7fd0a668c3c4ad78160b4fc42d01d71"}]}] Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-VolumesActionsTest-1665612634 Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: f7fd0a668c3c4ad78160b4fc42d01d71 Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-VolumesActionsTest-1665612634 Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-VolumesActionsTest-1665612634-project Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 41cbdfff1c6b43998e12d9170cb05b0a Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-VolumesActionsTest-1665612634-project Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 0b53d8d0-19f6-4425-ba45-fc6085a468b1 could not be found. Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '0b53d8d0-19f6-4425-ba45-fc6085a468b1'} Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b53d8d0-19f6-4425-ba45-fc6085a468b1 could not be found. Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b53d8d0-19f6-4425-ba45-fc6085a468b1 could not be found. Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:41.497871 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:08:41.502806 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:41.502806 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:41.502806 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:41.502806 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:08:41.502806 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:08:41.502806 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b53d8d0-19f6-4425-ba45-fc6085a468b1 could not be found. Aug 29 16:08:41.502806 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:08:41.502806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-24f36fe2-3505-4e9b-a56c-10b01c6e7561 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] Returning 404 to user: Instance 0b53d8d0-19f6-4425-ba45-fc6085a468b1 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:08:41.502806 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-24f36fe2-3505-4e9b-a56c-10b01c6e7561 tempest-VolumesActionsTest-1665612634 tempest-VolumesActionsTest-1665612634-project] 10.222.0.62 "GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1" status: 404 len: 111 microversion: 2.1 time: 0.032245 Aug 29 16:08:41.502806 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3445/7109] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:41 2022] GET /compute/v2.1/servers/0b53d8d0-19f6-4425-ba45-fc6085a468b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:08:41.578864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-60c60aec-2de6-4e4a-9a12-08b46f945804 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:41.579488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-60c60aec-2de6-4e4a-9a12-08b46f945804 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:41.585548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60c60aec-2de6-4e4a-9a12-08b46f945804 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:41.586037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60c60aec-2de6-4e4a-9a12-08b46f945804 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:41.586680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60c60aec-2de6-4e4a-9a12-08b46f945804 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:41.587386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60c60aec-2de6-4e4a-9a12-08b46f945804 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:41.587851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60c60aec-2de6-4e4a-9a12-08b46f945804 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:41.588286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60c60aec-2de6-4e4a-9a12-08b46f945804 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:41.734556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-60c60aec-2de6-4e4a-9a12-08b46f945804 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:41.745073 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-60c60aec-2de6-4e4a-9a12-08b46f945804 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 200 len: 1668 microversion: 2.1 time: 0.170004 Aug 29 16:08:41.760524 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3665/7110] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:41 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:42.187533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5c45d946-f4b4-4f8c-ba99-2144b0a2c01e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:42.188679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5c45d946-f4b4-4f8c-ba99-2144b0a2c01e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:42.195693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c45d946-f4b4-4f8c-ba99-2144b0a2c01e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:42.195782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c45d946-f4b4-4f8c-ba99-2144b0a2c01e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:42.196195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c45d946-f4b4-4f8c-ba99-2144b0a2c01e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:42.196894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c45d946-f4b4-4f8c-ba99-2144b0a2c01e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:42.197383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c45d946-f4b4-4f8c-ba99-2144b0a2c01e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:42.198072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c45d946-f4b4-4f8c-ba99-2144b0a2c01e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:42.508231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5c45d946-f4b4-4f8c-ba99-2144b0a2c01e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:42.517171 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5c45d946-f4b4-4f8c-ba99-2144b0a2c01e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1217 microversion: 2.1 time: 0.333678 Aug 29 16:08:42.517922 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3446/7111] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:42 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1217 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:42.731440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-9fc44cea-2d03-4ef8-974c-8b60fe92710d req-26dcf562-a52a-402d-be0b-f3824285cdcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea52328-23db-4bc0-966c-4505bcf3e518", "name": "network-vif-deleted", "tag": "2e36b390-19b1-4545-8bf2-d5ed43dc59fb"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:42.745027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9fc44cea-2d03-4ef8-974c-8b60fe92710d req-26dcf562-a52a-402d-be0b-f3824285cdcb service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:42.745627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9fc44cea-2d03-4ef8-974c-8b60fe92710d req-26dcf562-a52a-402d-be0b-f3824285cdcb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:42.746305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9fc44cea-2d03-4ef8-974c-8b60fe92710d req-26dcf562-a52a-402d-be0b-f3824285cdcb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:42.760598 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-9fc44cea-2d03-4ef8-974c-8b60fe92710d req-26dcf562-a52a-402d-be0b-f3824285cdcb service nova] Creating event network-vif-deleted:2e36b390-19b1-4545-8bf2-d5ed43dc59fb for instance 8ea52328-23db-4bc0-966c-4505bcf3e518 on n-h1-839401-11 Aug 29 16:08:42.766652 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-9fc44cea-2d03-4ef8-974c-8b60fe92710d req-26dcf562-a52a-402d-be0b-f3824285cdcb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039150 Aug 29 16:08:42.767505 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3666/7112] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:42.769365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d1f2a3eb-15a2-480d-a8a0-5e9e30ae63f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:42.770076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d1f2a3eb-15a2-480d-a8a0-5e9e30ae63f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:42.779693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1f2a3eb-15a2-480d-a8a0-5e9e30ae63f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:42.780211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1f2a3eb-15a2-480d-a8a0-5e9e30ae63f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:42.780667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1f2a3eb-15a2-480d-a8a0-5e9e30ae63f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:42.781445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1f2a3eb-15a2-480d-a8a0-5e9e30ae63f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:42.781931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1f2a3eb-15a2-480d-a8a0-5e9e30ae63f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:42.782368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1f2a3eb-15a2-480d-a8a0-5e9e30ae63f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:42.898231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d1f2a3eb-15a2-480d-a8a0-5e9e30ae63f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:42.908472 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d1f2a3eb-15a2-480d-a8a0-5e9e30ae63f3 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 200 len: 1332 microversion: 2.1 time: 0.144156 Aug 29 16:08:42.911686 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3447/7113] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:42 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 1332 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:43.539057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-17e09508-95d4-4e81-b215-e3cdb4252982 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:43.539929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-17e09508-95d4-4e81-b215-e3cdb4252982 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:43.547533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17e09508-95d4-4e81-b215-e3cdb4252982 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:43.548278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17e09508-95d4-4e81-b215-e3cdb4252982 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:43.548888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17e09508-95d4-4e81-b215-e3cdb4252982 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:43.550030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17e09508-95d4-4e81-b215-e3cdb4252982 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:43.550478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17e09508-95d4-4e81-b215-e3cdb4252982 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:43.550924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-17e09508-95d4-4e81-b215-e3cdb4252982 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:43.706423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-17e09508-95d4-4e81-b215-e3cdb4252982 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:43.715230 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-17e09508-95d4-4e81-b215-e3cdb4252982 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1217 microversion: 2.1 time: 0.180885 Aug 29 16:08:43.715991 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3667/7114] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:43 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1217 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:43.934411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b9160ba1-d1a8-4c1d-a8b2-bdcee30eeac5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:43.935847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b9160ba1-d1a8-4c1d-a8b2-bdcee30eeac5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: 8ea52328-23db-4bc0-966c-4505bcf3e518] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:43.943847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9160ba1-d1a8-4c1d-a8b2-bdcee30eeac5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:43.944725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9160ba1-d1a8-4c1d-a8b2-bdcee30eeac5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:43.945363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9160ba1-d1a8-4c1d-a8b2-bdcee30eeac5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:43.946244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9160ba1-d1a8-4c1d-a8b2-bdcee30eeac5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:43.946864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9160ba1-d1a8-4c1d-a8b2-bdcee30eeac5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:43.947495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9160ba1-d1a8-4c1d-a8b2-bdcee30eeac5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:43.962201 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-b9160ba1-d1a8-4c1d-a8b2-bdcee30eeac5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] HTTP exception thrown: Instance 8ea52328-23db-4bc0-966c-4505bcf3e518 could not be found. Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b9160ba1-d1a8-4c1d-a8b2-bdcee30eeac5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Request method failure captured: Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 HTTP/1.1 Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOPr44R9z576F5E1d-USYwU1PbIFlpFQAwv-Lo_2zGvPYKWa3vKoxMA2WGcHxbw831FwCjScDG3XbBeWWc9aTxSlqqxsveSnR4R0oeIFQunvxkO4O_OI8Y3OUCZt6qlmkCCT06apMRiuq3TXxgQ5EkG2rnBj1gc_Ma_fTxYGOy4Uw-A Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: dc8a8f9ddd384ca2bcdacb55b92006d9 Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestNetworkBasicOps-2055818920 Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_dc8a8f9ddd384ca2bcdacb55b92006d9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/dc8a8f9ddd384ca2bcdacb55b92006d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc8a8f9ddd384ca2bcdacb55b92006d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc8a8f9ddd384ca2bcdacb55b92006d9"}]}] Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestNetworkBasicOps-2055818920 Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: dc8a8f9ddd384ca2bcdacb55b92006d9 Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestNetworkBasicOps-2055818920 Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestNetworkBasicOps-2055818920-project Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e2d56709bf4c41eeb6e15bcdfd140999 Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestNetworkBasicOps-2055818920-project Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 8ea52328-23db-4bc0-966c-4505bcf3e518 could not be found. Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '8ea52328-23db-4bc0-966c-4505bcf3e518'} Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea52328-23db-4bc0-966c-4505bcf3e518 could not be found. Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea52328-23db-4bc0-966c-4505bcf3e518 could not be found. Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:43.964132 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:08:43.968568 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:43.968568 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:43.968568 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:43.968568 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:08:43.968568 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:08:43.968568 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea52328-23db-4bc0-966c-4505bcf3e518 could not be found. Aug 29 16:08:43.968568 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:08:43.970046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b9160ba1-d1a8-4c1d-a8b2-bdcee30eeac5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Returning 404 to user: Instance 8ea52328-23db-4bc0-966c-4505bcf3e518 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:08:43.971141 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b9160ba1-d1a8-4c1d-a8b2-bdcee30eeac5 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518" status: 404 len: 111 microversion: 2.1 time: 0.043262 Aug 29 16:08:43.971968 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3448/7115] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:43 2022] GET /compute/v2.1/servers/8ea52328-23db-4bc0-966c-4505bcf3e518 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:08:44.210884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8a4ce3d9-4b83-4107-9220-236348294ec4 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '.version_select at 0x7fc433bc3e50>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:44.238016 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8a4ce3d9-4b83-4107-9220-236348294ec4 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-366525101" status: 202 len: 0 microversion: 2.1 time: 0.031593 Aug 29 16:08:44.249790 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3668/7116] 10.222.0.62 () {58 vars in 1254 bytes} [Mon Aug 29 16:08:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-366525101 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:08:44.737816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e2384264-55f0-472e-9c64-1b2946aa04dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:44.739932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e2384264-55f0-472e-9c64-1b2946aa04dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:44.747649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2384264-55f0-472e-9c64-1b2946aa04dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:44.748289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2384264-55f0-472e-9c64-1b2946aa04dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:44.748859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2384264-55f0-472e-9c64-1b2946aa04dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:44.750291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2384264-55f0-472e-9c64-1b2946aa04dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:44.750979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2384264-55f0-472e-9c64-1b2946aa04dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:44.751648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2384264-55f0-472e-9c64-1b2946aa04dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:44.919076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e2384264-55f0-472e-9c64-1b2946aa04dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:44.935565 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e2384264-55f0-472e-9c64-1b2946aa04dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1217 microversion: 2.1 time: 0.203158 Aug 29 16:08:44.937404 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3449/7117] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:44 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1217 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:45.959734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9434b2fd-b256-4eda-962c-bf5bfaaee9c6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:45.961656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9434b2fd-b256-4eda-962c-bf5bfaaee9c6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:45.974871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9434b2fd-b256-4eda-962c-bf5bfaaee9c6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:45.975364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9434b2fd-b256-4eda-962c-bf5bfaaee9c6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:45.978745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9434b2fd-b256-4eda-962c-bf5bfaaee9c6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:45.979660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9434b2fd-b256-4eda-962c-bf5bfaaee9c6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:45.985691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9434b2fd-b256-4eda-962c-bf5bfaaee9c6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:45.986319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9434b2fd-b256-4eda-962c-bf5bfaaee9c6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:46.279013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9434b2fd-b256-4eda-962c-bf5bfaaee9c6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:46.287726 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9434b2fd-b256-4eda-962c-bf5bfaaee9c6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1217 microversion: 2.1 time: 0.333436 Aug 29 16:08:46.303738 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3669/7118] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:45 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1217 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:47.308202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-72a19b28-3e2c-4017-b226-b5ff5b7ec4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:47.311106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-72a19b28-3e2c-4017-b226-b5ff5b7ec4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:47.319812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72a19b28-3e2c-4017-b226-b5ff5b7ec4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:47.320499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72a19b28-3e2c-4017-b226-b5ff5b7ec4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:47.321144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72a19b28-3e2c-4017-b226-b5ff5b7ec4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:47.322022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72a19b28-3e2c-4017-b226-b5ff5b7ec4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:47.322635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72a19b28-3e2c-4017-b226-b5ff5b7ec4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:47.323221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72a19b28-3e2c-4017-b226-b5ff5b7ec4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:47.607295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-72a19b28-3e2c-4017-b226-b5ff5b7ec4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:47.616377 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-72a19b28-3e2c-4017-b226-b5ff5b7ec4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1217 microversion: 2.1 time: 0.312253 Aug 29 16:08:47.629578 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3450/7119] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:47 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1217 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:48.642890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-37ad414d-0b22-4855-a12f-ef3cd968e6d1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:48.646544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-37ad414d-0b22-4855-a12f-ef3cd968e6d1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:48.674981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37ad414d-0b22-4855-a12f-ef3cd968e6d1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:48.676635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37ad414d-0b22-4855-a12f-ef3cd968e6d1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:48.679847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37ad414d-0b22-4855-a12f-ef3cd968e6d1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:48.683884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37ad414d-0b22-4855-a12f-ef3cd968e6d1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:48.685326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37ad414d-0b22-4855-a12f-ef3cd968e6d1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:48.685799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37ad414d-0b22-4855-a12f-ef3cd968e6d1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:49.096742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-37ad414d-0b22-4855-a12f-ef3cd968e6d1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:49.108118 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-37ad414d-0b22-4855-a12f-ef3cd968e6d1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1217 microversion: 2.1 time: 0.472661 Aug 29 16:08:49.109058 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3670/7120] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:48 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1217 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:50.130220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eca95702-8b53-4455-a06e-c5072d3b8907 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:50.131015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eca95702-8b53-4455-a06e-c5072d3b8907 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:50.139150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca95702-8b53-4455-a06e-c5072d3b8907 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:50.139776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca95702-8b53-4455-a06e-c5072d3b8907 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:50.140304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca95702-8b53-4455-a06e-c5072d3b8907 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:50.141287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca95702-8b53-4455-a06e-c5072d3b8907 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:50.141980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca95702-8b53-4455-a06e-c5072d3b8907 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:50.142613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eca95702-8b53-4455-a06e-c5072d3b8907 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:50.379807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eca95702-8b53-4455-a06e-c5072d3b8907 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:50.397603 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eca95702-8b53-4455-a06e-c5072d3b8907 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1217 microversion: 2.1 time: 0.270594 Aug 29 16:08:50.399765 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3451/7121] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:50 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1217 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:50.930143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-dac0493c-1dd0-4b7d-8f9c-3e13b5e75625 req-0f84d5b3-dee8-4207-a286-653f3fb34d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1094df4-9ce0-4389-a24f-b0d65119a7f4", "name": "network-vif-plugged", "status": "completed", "tag": "d4721e07-ba3d-44c0-ad78-3a003cb28b18"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:50.943677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dac0493c-1dd0-4b7d-8f9c-3e13b5e75625 req-0f84d5b3-dee8-4207-a286-653f3fb34d64 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:50.954342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dac0493c-1dd0-4b7d-8f9c-3e13b5e75625 req-0f84d5b3-dee8-4207-a286-653f3fb34d64 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:50.956917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dac0493c-1dd0-4b7d-8f9c-3e13b5e75625 req-0f84d5b3-dee8-4207-a286-653f3fb34d64 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:50.976319 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-dac0493c-1dd0-4b7d-8f9c-3e13b5e75625 req-0f84d5b3-dee8-4207-a286-653f3fb34d64 service nova] Creating event network-vif-plugged:d4721e07-ba3d-44c0-ad78-3a003cb28b18 for instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 on n-h2-839401-11 Aug 29 16:08:50.982309 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-dac0493c-1dd0-4b7d-8f9c-3e13b5e75625 req-0f84d5b3-dee8-4207-a286-653f3fb34d64 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056268 Aug 29 16:08:50.983675 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3671/7122] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:08:51.420904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fe069a94-2d4d-4b87-9ca7-18c1fba8e389 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:51.426120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fe069a94-2d4d-4b87-9ca7-18c1fba8e389 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:51.454940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe069a94-2d4d-4b87-9ca7-18c1fba8e389 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:51.457613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe069a94-2d4d-4b87-9ca7-18c1fba8e389 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:51.458108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe069a94-2d4d-4b87-9ca7-18c1fba8e389 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:51.458873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe069a94-2d4d-4b87-9ca7-18c1fba8e389 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:51.464436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe069a94-2d4d-4b87-9ca7-18c1fba8e389 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:51.466813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe069a94-2d4d-4b87-9ca7-18c1fba8e389 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:51.680154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fe069a94-2d4d-4b87-9ca7-18c1fba8e389 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:51.694489 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fe069a94-2d4d-4b87-9ca7-18c1fba8e389 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1217 microversion: 2.1 time: 0.278320 Aug 29 16:08:51.710248 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3452/7123] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:51 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1217 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:52.717418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eb3a2d92-b41c-4d64-98d3-c20f25884a7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:52.718832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eb3a2d92-b41c-4d64-98d3-c20f25884a7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:52.729067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb3a2d92-b41c-4d64-98d3-c20f25884a7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:52.740501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb3a2d92-b41c-4d64-98d3-c20f25884a7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:52.741318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb3a2d92-b41c-4d64-98d3-c20f25884a7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:52.742272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb3a2d92-b41c-4d64-98d3-c20f25884a7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:52.742899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb3a2d92-b41c-4d64-98d3-c20f25884a7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:52.743508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb3a2d92-b41c-4d64-98d3-c20f25884a7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:53.205345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eb3a2d92-b41c-4d64-98d3-c20f25884a7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:53.225519 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eb3a2d92-b41c-4d64-98d3-c20f25884a7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1405 microversion: 2.1 time: 0.508981 Aug 29 16:08:53.227662 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3672/7124] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:52 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1405 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:53.250466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1f515c85-60ce-4900-a42c-9d053a180dd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:53.251805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1f515c85-60ce-4900-a42c-9d053a180dd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:53.263554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f515c85-60ce-4900-a42c-9d053a180dd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:53.264755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f515c85-60ce-4900-a42c-9d053a180dd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:53.265630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f515c85-60ce-4900-a42c-9d053a180dd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:53.266661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f515c85-60ce-4900-a42c-9d053a180dd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:53.267288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f515c85-60ce-4900-a42c-9d053a180dd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:53.268119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1f515c85-60ce-4900-a42c-9d053a180dd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:53.575688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1f515c85-60ce-4900-a42c-9d053a180dd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:53.587854 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1f515c85-60ce-4900-a42c-9d053a180dd8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1405 microversion: 2.1 time: 0.341950 Aug 29 16:08:53.589953 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3453/7125] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:53 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1405 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:53.619555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c5e85f29-38e0-43fc-92ca-905c6a94462a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1194614846"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:53.622160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c5e85f29-38e0-43fc-92ca-905c6a94462a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:53.680669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5e85f29-38e0-43fc-92ca-905c6a94462a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:53.681171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5e85f29-38e0-43fc-92ca-905c6a94462a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:53.681637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5e85f29-38e0-43fc-92ca-905c6a94462a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:53.686461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5e85f29-38e0-43fc-92ca-905c6a94462a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:53.686968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5e85f29-38e0-43fc-92ca-905c6a94462a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:53.687423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5e85f29-38e0-43fc-92ca-905c6a94462a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:53.927067 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.compute.api [None req-c5e85f29-38e0-43fc-92ca-905c6a94462a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Attempting to quiesce instance before volume snapshot. Aug 29 16:08:53.996872 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.compute.api [None req-c5e85f29-38e0-43fc-92ca-905c6a94462a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 29 16:08:54.142032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c5e85f29-38e0-43fc-92ca-905c6a94462a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Creating snapshot from volume b4c47014-d9bf-4d3e-a731-5715888afb6d. {{(pid=122360) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 29 16:08:55.683510 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c5e85f29-38e0-43fc-92ca-905c6a94462a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "POST /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4/action" status: 202 len: 0 microversion: 2.1 time: 2.075937 Aug 29 16:08:55.684510 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3673/7126] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:53 2022] POST /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4/action => generated 0 bytes in 2078 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 29 16:08:57.145044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5ba16a8d-9fec-4ba7-a3e1-c3101c567c2f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Action: 'create', calling method: .version_select at 0x7fc42a356550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1721457566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9BJji0XRrrfEX3YgixSDcovJezoTRWqAAXt5aywsd+2uoScJjO9w1XlhGaObD9sFv0qKFxJvH19h1YqsQTt0wjyN1sr8AE2wNdx7SvpjhpnYWwV6ETH5m+Ie3sXIsofA=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:57.166174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:57.177125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5ba16a8d-9fec-4ba7-a3e1-c3101c567c2f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Getting quotas for project dc8a8f9ddd384ca2bcdacb55b92006d9. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:08:57.183977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5ba16a8d-9fec-4ba7-a3e1-c3101c567c2f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Getting quotas for user e2d56709bf4c41eeb6e15bcdfd140999 and project dc8a8f9ddd384ca2bcdacb55b92006d9. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:08:57.232842 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5ba16a8d-9fec-4ba7-a3e1-c3101c567c2f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.095987 Aug 29 16:08:57.233515 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3454/7127] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:08:57 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:58.080046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1284537294", "imageRef": "8499f78f-ca38-4084-95be-ed50ab767cb3", "flavorRef": "452", "networks": [{"uuid": "957b06a2-5b5b-41f0-883f-0990cab206d9"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:58.110759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:58.211007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] validate_networks() for [('957b06a2-5b5b-41f0-883f-0990cab206d9', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:08:59.015471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:08:59.016411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:08:59.017218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:08:59.018022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:08:59.018911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:08:59.041157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:59.043919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:59.044646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:59.048550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:59.052940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:59.053715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:59.114288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:08:59.128852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for user f07d896c6764402999345759f2348080 and project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:08:59.151962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:08:59.155337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='dde2ef30-3931-46e5-a1e9-1397c4cf95e1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:08:59.319634 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5628fc7a-dd64-4b56-973a-bd475973717a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.254866 Aug 29 16:08:59.323355 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3674/7128] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:08:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:08:59.328362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-322750388", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "9a7e4aed-2444-415e-ada4-c66f3d54c47f"}], "key_name": "tempest-TestNetworkBasicOps-1721457566", "security_groups": [{"name": "tempest-secgroup-smoke-1012122821"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:59.337236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9832c47d-d41b-4e2a-ae91-3530aec9fb23 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:59.338433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9832c47d-d41b-4e2a-ae91-3530aec9fb23 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:59.490850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9832c47d-d41b-4e2a-ae91-3530aec9fb23 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:59.499526 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9832c47d-d41b-4e2a-ae91-3530aec9fb23 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1230 microversion: 2.1 time: 0.169035 Aug 29 16:08:59.501069 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3675/7129] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:59 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1230 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:59.533118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] validate_networks() for [('9a7e4aed-2444-415e-ada4-c66f3d54c47f', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:09:00.400007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:09:00.400736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:09:00.400895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:09:00.401567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:09:00.402223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:09:00.417282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:00.418177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:00.418830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:00.420361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:00.421127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:00.421980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:00.448583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Getting quotas for project dc8a8f9ddd384ca2bcdacb55b92006d9. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:09:00.463174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Getting quotas for user e2d56709bf4c41eeb6e15bcdfd140999 and project dc8a8f9ddd384ca2bcdacb55b92006d9. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:09:00.505624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:09:00.508786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:09:00.528426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e9d1f068-679d-485f-857f-0aba7bc82438 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:00.529471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e9d1f068-679d-485f-857f-0aba7bc82438 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:00.544822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9d1f068-679d-485f-857f-0aba7bc82438 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:00.547922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9d1f068-679d-485f-857f-0aba7bc82438 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:00.549876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9d1f068-679d-485f-857f-0aba7bc82438 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:00.552201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9d1f068-679d-485f-857f-0aba7bc82438 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:00.553162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9d1f068-679d-485f-857f-0aba7bc82438 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:00.554150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e9d1f068-679d-485f-857f-0aba7bc82438 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:00.606885 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ef041e95-743c-420a-85ea-20d69b594e01 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.289903 Aug 29 16:09:00.614277 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3455/7130] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:08:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:09:00.620331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-89a04055-33bb-40c5-b88e-a69f5c3143fc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:00.621367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-89a04055-33bb-40c5-b88e-a69f5c3143fc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:00.699478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-89a04055-33bb-40c5-b88e-a69f5c3143fc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:00.731041 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-89a04055-33bb-40c5-b88e-a69f5c3143fc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1248 microversion: 2.1 time: 0.115023 Aug 29 16:09:00.732003 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3456/7131] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:00 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1248 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:00.760618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e9d1f068-679d-485f-857f-0aba7bc82438 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:00.775134 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e9d1f068-679d-485f-857f-0aba7bc82438 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1226 microversion: 2.1 time: 0.253349 Aug 29 16:09:00.776625 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3676/7132] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:00 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1226 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:01.754081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b52cd5c3-01d4-4579-8804-cccce147c901 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:01.754717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b52cd5c3-01d4-4579-8804-cccce147c901 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:01.771757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b52cd5c3-01d4-4579-8804-cccce147c901 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:01.777878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b52cd5c3-01d4-4579-8804-cccce147c901 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:01.778670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b52cd5c3-01d4-4579-8804-cccce147c901 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:01.779702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b52cd5c3-01d4-4579-8804-cccce147c901 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:01.780381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b52cd5c3-01d4-4579-8804-cccce147c901 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:01.781019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b52cd5c3-01d4-4579-8804-cccce147c901 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:01.805677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dfc9cd2e-1f01-4a7d-919b-3de0ab1782de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:01.810633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dfc9cd2e-1f01-4a7d-919b-3de0ab1782de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:01.841062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfc9cd2e-1f01-4a7d-919b-3de0ab1782de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:01.841891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfc9cd2e-1f01-4a7d-919b-3de0ab1782de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:01.843458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfc9cd2e-1f01-4a7d-919b-3de0ab1782de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:01.845444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfc9cd2e-1f01-4a7d-919b-3de0ab1782de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:01.852058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfc9cd2e-1f01-4a7d-919b-3de0ab1782de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:01.853341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfc9cd2e-1f01-4a7d-919b-3de0ab1782de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:02.031322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dfc9cd2e-1f01-4a7d-919b-3de0ab1782de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:02.050301 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dfc9cd2e-1f01-4a7d-919b-3de0ab1782de tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1300 microversion: 2.1 time: 0.250824 Aug 29 16:09:02.066025 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3677/7133] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:01 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1300 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:02.200266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b52cd5c3-01d4-4579-8804-cccce147c901 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:02.214213 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b52cd5c3-01d4-4579-8804-cccce147c901 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1244 microversion: 2.1 time: 0.465877 Aug 29 16:09:02.215188 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3457/7134] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:01 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1244 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:03.072840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1c48395c-623f-4c49-aeb0-d4d65b6ba286 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:03.074729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1c48395c-623f-4c49-aeb0-d4d65b6ba286 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:03.112216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c48395c-623f-4c49-aeb0-d4d65b6ba286 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:03.117074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c48395c-623f-4c49-aeb0-d4d65b6ba286 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:03.120331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c48395c-623f-4c49-aeb0-d4d65b6ba286 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:03.122024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c48395c-623f-4c49-aeb0-d4d65b6ba286 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:03.130465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c48395c-623f-4c49-aeb0-d4d65b6ba286 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:03.132200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c48395c-623f-4c49-aeb0-d4d65b6ba286 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:03.210636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:03.240013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f793a2ab-73bb-41ef-94a8-34b21e3aee72 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:03.241693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f793a2ab-73bb-41ef-94a8-34b21e3aee72 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:03.263317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f793a2ab-73bb-41ef-94a8-34b21e3aee72 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:03.271416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f793a2ab-73bb-41ef-94a8-34b21e3aee72 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:03.271959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f793a2ab-73bb-41ef-94a8-34b21e3aee72 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:03.276906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f793a2ab-73bb-41ef-94a8-34b21e3aee72 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:03.277690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f793a2ab-73bb-41ef-94a8-34b21e3aee72 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:03.281218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f793a2ab-73bb-41ef-94a8-34b21e3aee72 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:03.501279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1c48395c-623f-4c49-aeb0-d4d65b6ba286 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:03.526115 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1c48395c-623f-4c49-aeb0-d4d65b6ba286 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1342 microversion: 2.1 time: 0.457915 Aug 29 16:09:03.538419 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3678/7135] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:03 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1342 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:03.614360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f793a2ab-73bb-41ef-94a8-34b21e3aee72 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:03.652650 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f793a2ab-73bb-41ef-94a8-34b21e3aee72 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1306 microversion: 2.1 time: 0.418807 Aug 29 16:09:03.654687 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3458/7136] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:03 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1306 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:04.555506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5b9f963b-5982-472f-a907-05ee943cec18 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:04.557690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5b9f963b-5982-472f-a907-05ee943cec18 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:04.572494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b9f963b-5982-472f-a907-05ee943cec18 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:04.573751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b9f963b-5982-472f-a907-05ee943cec18 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:04.575534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b9f963b-5982-472f-a907-05ee943cec18 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:04.595243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b9f963b-5982-472f-a907-05ee943cec18 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:04.596725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b9f963b-5982-472f-a907-05ee943cec18 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:04.604184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b9f963b-5982-472f-a907-05ee943cec18 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:04.686651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f4877db5-31cb-4bf4-9340-f40e4f7cbf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:04.687937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f4877db5-31cb-4bf4-9340-f40e4f7cbf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:04.716190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4877db5-31cb-4bf4-9340-f40e4f7cbf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:04.731871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4877db5-31cb-4bf4-9340-f40e4f7cbf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:04.751516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4877db5-31cb-4bf4-9340-f40e4f7cbf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:04.766891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4877db5-31cb-4bf4-9340-f40e4f7cbf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:04.772802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4877db5-31cb-4bf4-9340-f40e4f7cbf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:04.777060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4877db5-31cb-4bf4-9340-f40e4f7cbf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:05.041156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5b9f963b-5982-472f-a907-05ee943cec18 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:05.065367 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5b9f963b-5982-472f-a907-05ee943cec18 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1342 microversion: 2.1 time: 0.512895 Aug 29 16:09:05.066872 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3679/7137] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:04 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1342 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:05.071813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-58a337d4-b002-4ee6-b06b-79a2f8855758 req-4a02073b-1b94-46d6-aecf-a4e8190a6c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e49ff7-4599-4df3-9cf3-90278816cd8e", "tag": "c018e7a9-b613-422a-ba70-98b66f55034f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:05.082786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-58a337d4-b002-4ee6-b06b-79a2f8855758 req-4a02073b-1b94-46d6-aecf-a4e8190a6c3e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:05.083549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-58a337d4-b002-4ee6-b06b-79a2f8855758 req-4a02073b-1b94-46d6-aecf-a4e8190a6c3e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:05.084172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-58a337d4-b002-4ee6-b06b-79a2f8855758 req-4a02073b-1b94-46d6-aecf-a4e8190a6c3e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:05.099610 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-58a337d4-b002-4ee6-b06b-79a2f8855758 req-4a02073b-1b94-46d6-aecf-a4e8190a6c3e service nova] Creating event network-changed:c018e7a9-b613-422a-ba70-98b66f55034f for instance 62e49ff7-4599-4df3-9cf3-90278816cd8e on n-h1-839401-11 Aug 29 16:09:05.106072 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-58a337d4-b002-4ee6-b06b-79a2f8855758 req-4a02073b-1b94-46d6-aecf-a4e8190a6c3e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037626 Aug 29 16:09:05.107041 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3680/7138] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:05.901449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f4877db5-31cb-4bf4-9340-f40e4f7cbf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:05.914105 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f4877db5-31cb-4bf4-9340-f40e4f7cbf7b tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1374 microversion: 2.1 time: 1.234050 Aug 29 16:09:05.923434 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3459/7139] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:04 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1374 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:06.092175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-546ec33c-fd6e-4fcc-bb1e-670212029f82 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:06.094247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-546ec33c-fd6e-4fcc-bb1e-670212029f82 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:06.108447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-546ec33c-fd6e-4fcc-bb1e-670212029f82 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:06.110552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-546ec33c-fd6e-4fcc-bb1e-670212029f82 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:06.112114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-546ec33c-fd6e-4fcc-bb1e-670212029f82 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:06.113222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-546ec33c-fd6e-4fcc-bb1e-670212029f82 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:06.113802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-546ec33c-fd6e-4fcc-bb1e-670212029f82 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:06.114465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-546ec33c-fd6e-4fcc-bb1e-670212029f82 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:06.341499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-546ec33c-fd6e-4fcc-bb1e-670212029f82 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:06.351716 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-546ec33c-fd6e-4fcc-bb1e-670212029f82 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1342 microversion: 2.1 time: 0.268873 Aug 29 16:09:06.353306 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3681/7140] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:06 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1342 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:06.942104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3763e45a-5dbf-47f5-809e-8330a4c8a748 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:06.942714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3763e45a-5dbf-47f5-809e-8330a4c8a748 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:06.957680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3763e45a-5dbf-47f5-809e-8330a4c8a748 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:06.958180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3763e45a-5dbf-47f5-809e-8330a4c8a748 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:06.959508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3763e45a-5dbf-47f5-809e-8330a4c8a748 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:06.960413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3763e45a-5dbf-47f5-809e-8330a4c8a748 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:06.973907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3763e45a-5dbf-47f5-809e-8330a4c8a748 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:06.974659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3763e45a-5dbf-47f5-809e-8330a4c8a748 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:07.232556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-8f9d7450-bdee-4149-bfd2-74b294c8d97c req-2f97de27-f76a-4d90-a0f8-c82de973fb1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcb0c4b7-071f-4988-93f8-25e896c4133d", "tag": "b1511c51-70dc-43ae-8b29-03c66dbc86a4"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:07.261372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8f9d7450-bdee-4149-bfd2-74b294c8d97c req-2f97de27-f76a-4d90-a0f8-c82de973fb1a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:07.262182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8f9d7450-bdee-4149-bfd2-74b294c8d97c req-2f97de27-f76a-4d90-a0f8-c82de973fb1a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:07.263626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8f9d7450-bdee-4149-bfd2-74b294c8d97c req-2f97de27-f76a-4d90-a0f8-c82de973fb1a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:07.279283 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-8f9d7450-bdee-4149-bfd2-74b294c8d97c req-2f97de27-f76a-4d90-a0f8-c82de973fb1a service nova] Creating event network-changed:b1511c51-70dc-43ae-8b29-03c66dbc86a4 for instance fcb0c4b7-071f-4988-93f8-25e896c4133d on n-h2-839401-11 Aug 29 16:09:07.286312 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-8f9d7450-bdee-4149-bfd2-74b294c8d97c req-2f97de27-f76a-4d90-a0f8-c82de973fb1a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066334 Aug 29 16:09:07.287982 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3682/7141] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:09:07.352774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3763e45a-5dbf-47f5-809e-8330a4c8a748 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:07.367186 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3763e45a-5dbf-47f5-809e-8330a4c8a748 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1374 microversion: 2.1 time: 0.428667 Aug 29 16:09:07.369555 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3460/7142] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:06 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1374 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:07.384895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-526d4ce9-291c-49fc-9232-71c1d371eb08 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:07.387145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-526d4ce9-291c-49fc-9232-71c1d371eb08 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:07.396197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-526d4ce9-291c-49fc-9232-71c1d371eb08 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:07.396197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-526d4ce9-291c-49fc-9232-71c1d371eb08 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:07.396197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-526d4ce9-291c-49fc-9232-71c1d371eb08 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:07.397467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-526d4ce9-291c-49fc-9232-71c1d371eb08 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:07.397467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-526d4ce9-291c-49fc-9232-71c1d371eb08 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:07.398371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-526d4ce9-291c-49fc-9232-71c1d371eb08 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:08.040479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-526d4ce9-291c-49fc-9232-71c1d371eb08 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:08.107025 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-526d4ce9-291c-49fc-9232-71c1d371eb08 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1342 microversion: 2.1 time: 0.725914 Aug 29 16:09:08.108889 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3683/7143] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:07 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1342 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:08.393028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ed6ff07c-880e-4a0c-b703-e45de06372dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:08.395402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ed6ff07c-880e-4a0c-b703-e45de06372dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:08.403192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed6ff07c-880e-4a0c-b703-e45de06372dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:08.404208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed6ff07c-880e-4a0c-b703-e45de06372dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:08.405138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed6ff07c-880e-4a0c-b703-e45de06372dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:08.406755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed6ff07c-880e-4a0c-b703-e45de06372dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:08.407446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed6ff07c-880e-4a0c-b703-e45de06372dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:08.408161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ed6ff07c-880e-4a0c-b703-e45de06372dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:08.411733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:08.639943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ed6ff07c-880e-4a0c-b703-e45de06372dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:08.655405 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ed6ff07c-880e-4a0c-b703-e45de06372dd tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1374 microversion: 2.1 time: 0.267652 Aug 29 16:09:08.669526 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3461/7144] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:08 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1374 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:09.139435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-073361f9-bf24-4356-b9f7-b88201c1f575 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:09.140109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-073361f9-bf24-4356-b9f7-b88201c1f575 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:09.143455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:09.155457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-073361f9-bf24-4356-b9f7-b88201c1f575 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:09.156172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-073361f9-bf24-4356-b9f7-b88201c1f575 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:09.156444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-073361f9-bf24-4356-b9f7-b88201c1f575 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:09.157240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-073361f9-bf24-4356-b9f7-b88201c1f575 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:09.158528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-073361f9-bf24-4356-b9f7-b88201c1f575 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:09.158528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-073361f9-bf24-4356-b9f7-b88201c1f575 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:09.378307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-073361f9-bf24-4356-b9f7-b88201c1f575 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:09.390980 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-073361f9-bf24-4356-b9f7-b88201c1f575 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1342 microversion: 2.1 time: 0.262649 Aug 29 16:09:09.392174 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3684/7145] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:09 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1342 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:09.680850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0fd51304-5949-4500-bda1-7fd68a3778e7 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:09.681536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0fd51304-5949-4500-bda1-7fd68a3778e7 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:09.690735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fd51304-5949-4500-bda1-7fd68a3778e7 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:09.691699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fd51304-5949-4500-bda1-7fd68a3778e7 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:09.693451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fd51304-5949-4500-bda1-7fd68a3778e7 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:09.693451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fd51304-5949-4500-bda1-7fd68a3778e7 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:09.693451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fd51304-5949-4500-bda1-7fd68a3778e7 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:09.694443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0fd51304-5949-4500-bda1-7fd68a3778e7 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:09.911963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0fd51304-5949-4500-bda1-7fd68a3778e7 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:09.920840 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0fd51304-5949-4500-bda1-7fd68a3778e7 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1374 microversion: 2.1 time: 0.244701 Aug 29 16:09:09.921663 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3462/7146] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:09 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1374 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:10.431318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f6eab284-4554-4e6a-9600-bd1bdebba281 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:10.432193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f6eab284-4554-4e6a-9600-bd1bdebba281 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:10.434457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:10.445940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6eab284-4554-4e6a-9600-bd1bdebba281 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:10.445940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6eab284-4554-4e6a-9600-bd1bdebba281 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:10.446903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6eab284-4554-4e6a-9600-bd1bdebba281 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:10.447758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6eab284-4554-4e6a-9600-bd1bdebba281 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:10.448482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6eab284-4554-4e6a-9600-bd1bdebba281 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:10.449168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6eab284-4554-4e6a-9600-bd1bdebba281 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:10.664632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f6eab284-4554-4e6a-9600-bd1bdebba281 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:10.674700 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f6eab284-4554-4e6a-9600-bd1bdebba281 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1342 microversion: 2.1 time: 0.247511 Aug 29 16:09:10.689245 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3685/7147] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:10 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1342 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:10.942976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f474ec45-6f63-4438-9f1c-9abc45c4769f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:10.944474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f474ec45-6f63-4438-9f1c-9abc45c4769f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:10.946374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:10.948024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:10.976584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f474ec45-6f63-4438-9f1c-9abc45c4769f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:10.977184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f474ec45-6f63-4438-9f1c-9abc45c4769f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:10.977811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f474ec45-6f63-4438-9f1c-9abc45c4769f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:10.984222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f474ec45-6f63-4438-9f1c-9abc45c4769f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:10.984739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f474ec45-6f63-4438-9f1c-9abc45c4769f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:10.985219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f474ec45-6f63-4438-9f1c-9abc45c4769f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:11.295216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f474ec45-6f63-4438-9f1c-9abc45c4769f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:11.305470 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f474ec45-6f63-4438-9f1c-9abc45c4769f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1374 microversion: 2.1 time: 0.366909 Aug 29 16:09:11.329290 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3463/7148] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:10 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1374 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:11.700054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f358ff6f-4a22-42e5-ad1b-31a96d335377 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:11.700694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f358ff6f-4a22-42e5-ad1b-31a96d335377 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:11.718583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f358ff6f-4a22-42e5-ad1b-31a96d335377 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:11.721587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f358ff6f-4a22-42e5-ad1b-31a96d335377 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:11.726338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f358ff6f-4a22-42e5-ad1b-31a96d335377 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:11.730018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f358ff6f-4a22-42e5-ad1b-31a96d335377 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:11.731877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f358ff6f-4a22-42e5-ad1b-31a96d335377 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:11.736359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f358ff6f-4a22-42e5-ad1b-31a96d335377 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:11.996017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f358ff6f-4a22-42e5-ad1b-31a96d335377 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:12.004357 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f358ff6f-4a22-42e5-ad1b-31a96d335377 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1342 microversion: 2.1 time: 0.312248 Aug 29 16:09:12.005389 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3686/7149] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:11 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1342 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:12.328553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c804be6d-a1df-414a-8734-57fdbf33778c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:12.329938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c804be6d-a1df-414a-8734-57fdbf33778c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:12.338371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c804be6d-a1df-414a-8734-57fdbf33778c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:12.339088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c804be6d-a1df-414a-8734-57fdbf33778c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:12.339806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c804be6d-a1df-414a-8734-57fdbf33778c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:12.340645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c804be6d-a1df-414a-8734-57fdbf33778c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:12.341323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c804be6d-a1df-414a-8734-57fdbf33778c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:12.341923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c804be6d-a1df-414a-8734-57fdbf33778c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:12.505334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c804be6d-a1df-414a-8734-57fdbf33778c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:12.513953 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c804be6d-a1df-414a-8734-57fdbf33778c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1374 microversion: 2.1 time: 0.189762 Aug 29 16:09:12.514764 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3464/7150] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:12 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1374 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:13.026568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7df71a1b-dff5-4426-aa8f-88714cae2a5a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:13.028172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7df71a1b-dff5-4426-aa8f-88714cae2a5a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:13.041640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df71a1b-dff5-4426-aa8f-88714cae2a5a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:13.043901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df71a1b-dff5-4426-aa8f-88714cae2a5a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:13.044890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df71a1b-dff5-4426-aa8f-88714cae2a5a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:13.045866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df71a1b-dff5-4426-aa8f-88714cae2a5a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:13.046607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df71a1b-dff5-4426-aa8f-88714cae2a5a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:13.047308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7df71a1b-dff5-4426-aa8f-88714cae2a5a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:13.270686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7df71a1b-dff5-4426-aa8f-88714cae2a5a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:13.279070 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7df71a1b-dff5-4426-aa8f-88714cae2a5a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1342 microversion: 2.1 time: 0.256920 Aug 29 16:09:13.280053 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3687/7151] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:13 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1342 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:13.542293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8db34e58-3c13-419c-93d9-bb1f3ce1e3c1 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:13.543015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8db34e58-3c13-419c-93d9-bb1f3ce1e3c1 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:13.552763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8db34e58-3c13-419c-93d9-bb1f3ce1e3c1 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:13.553292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8db34e58-3c13-419c-93d9-bb1f3ce1e3c1 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:13.553735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8db34e58-3c13-419c-93d9-bb1f3ce1e3c1 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:13.554447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8db34e58-3c13-419c-93d9-bb1f3ce1e3c1 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:13.554908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8db34e58-3c13-419c-93d9-bb1f3ce1e3c1 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:13.555666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8db34e58-3c13-419c-93d9-bb1f3ce1e3c1 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:13.723494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8db34e58-3c13-419c-93d9-bb1f3ce1e3c1 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:13.732165 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8db34e58-3c13-419c-93d9-bb1f3ce1e3c1 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1374 microversion: 2.1 time: 0.199796 Aug 29 16:09:13.732995 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3465/7152] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:13 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1374 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:14.300331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dce4e9b5-3023-41c0-9193-9372f147735d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:14.300967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dce4e9b5-3023-41c0-9193-9372f147735d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:14.308169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dce4e9b5-3023-41c0-9193-9372f147735d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:14.308744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dce4e9b5-3023-41c0-9193-9372f147735d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:14.309352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dce4e9b5-3023-41c0-9193-9372f147735d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:14.310134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dce4e9b5-3023-41c0-9193-9372f147735d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:14.310704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dce4e9b5-3023-41c0-9193-9372f147735d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:14.311215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dce4e9b5-3023-41c0-9193-9372f147735d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:14.464007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dce4e9b5-3023-41c0-9193-9372f147735d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:14.472317 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dce4e9b5-3023-41c0-9193-9372f147735d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1342 microversion: 2.1 time: 0.176281 Aug 29 16:09:14.472938 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3688/7153] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:14 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1342 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:14.756560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1ce7e9e5-29a6-43aa-b012-2a94d5426fed tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:14.758304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1ce7e9e5-29a6-43aa-b012-2a94d5426fed tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:14.773345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ce7e9e5-29a6-43aa-b012-2a94d5426fed tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:14.774807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ce7e9e5-29a6-43aa-b012-2a94d5426fed tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:14.775343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ce7e9e5-29a6-43aa-b012-2a94d5426fed tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:14.776075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ce7e9e5-29a6-43aa-b012-2a94d5426fed tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:14.776548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ce7e9e5-29a6-43aa-b012-2a94d5426fed tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:14.777389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1ce7e9e5-29a6-43aa-b012-2a94d5426fed tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:14.962736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1ce7e9e5-29a6-43aa-b012-2a94d5426fed tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:14.972891 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1ce7e9e5-29a6-43aa-b012-2a94d5426fed tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1374 microversion: 2.1 time: 0.222595 Aug 29 16:09:14.973980 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3466/7154] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:14 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1374 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:14.991499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-094694ef-7d32-4d3f-89ad-55366441ec35 req-397a62ef-a3b4-4025-87e4-c3639ee9e30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcb0c4b7-071f-4988-93f8-25e896c4133d", "name": "network-vif-plugged", "status": "completed", "tag": "b1511c51-70dc-43ae-8b29-03c66dbc86a4"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:15.003002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-094694ef-7d32-4d3f-89ad-55366441ec35 req-397a62ef-a3b4-4025-87e4-c3639ee9e30c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:15.004311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-094694ef-7d32-4d3f-89ad-55366441ec35 req-397a62ef-a3b4-4025-87e4-c3639ee9e30c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:15.004768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-094694ef-7d32-4d3f-89ad-55366441ec35 req-397a62ef-a3b4-4025-87e4-c3639ee9e30c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:15.021853 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-094694ef-7d32-4d3f-89ad-55366441ec35 req-397a62ef-a3b4-4025-87e4-c3639ee9e30c service nova] Creating event network-vif-plugged:b1511c51-70dc-43ae-8b29-03c66dbc86a4 for instance fcb0c4b7-071f-4988-93f8-25e896c4133d on n-h2-839401-11 Aug 29 16:09:15.027348 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-094694ef-7d32-4d3f-89ad-55366441ec35 req-397a62ef-a3b4-4025-87e4-c3639ee9e30c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043619 Aug 29 16:09:15.028408 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3689/7155] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:15.493837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0e0c6404-b255-4a90-bae9-968db1ca2f91 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:15.494762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0e0c6404-b255-4a90-bae9-968db1ca2f91 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:15.501518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e0c6404-b255-4a90-bae9-968db1ca2f91 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:15.502066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e0c6404-b255-4a90-bae9-968db1ca2f91 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:15.502483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e0c6404-b255-4a90-bae9-968db1ca2f91 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:15.503446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e0c6404-b255-4a90-bae9-968db1ca2f91 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:15.503919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e0c6404-b255-4a90-bae9-968db1ca2f91 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:15.504354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e0c6404-b255-4a90-bae9-968db1ca2f91 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:15.653050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0e0c6404-b255-4a90-bae9-968db1ca2f91 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:15.661989 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0e0c6404-b255-4a90-bae9-968db1ca2f91 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1342 microversion: 2.1 time: 0.172214 Aug 29 16:09:15.662632 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3467/7156] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:15 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:15.996640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8511ae70-ffde-493d-8b52-0b408cfede43 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:15.997676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8511ae70-ffde-493d-8b52-0b408cfede43 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:16.006553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8511ae70-ffde-493d-8b52-0b408cfede43 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:16.007191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8511ae70-ffde-493d-8b52-0b408cfede43 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:16.007975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8511ae70-ffde-493d-8b52-0b408cfede43 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:16.008723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8511ae70-ffde-493d-8b52-0b408cfede43 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:16.009222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8511ae70-ffde-493d-8b52-0b408cfede43 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:16.009663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8511ae70-ffde-493d-8b52-0b408cfede43 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:16.171938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8511ae70-ffde-493d-8b52-0b408cfede43 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:16.181784 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8511ae70-ffde-493d-8b52-0b408cfede43 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1374 microversion: 2.1 time: 0.189569 Aug 29 16:09:16.182937 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3690/7157] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:15 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:16.684293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fd8ba230-7beb-435f-adfd-951e9805ee78 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:16.685218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fd8ba230-7beb-435f-adfd-951e9805ee78 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:16.693856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd8ba230-7beb-435f-adfd-951e9805ee78 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:16.694841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd8ba230-7beb-435f-adfd-951e9805ee78 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:16.695669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd8ba230-7beb-435f-adfd-951e9805ee78 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:16.696668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd8ba230-7beb-435f-adfd-951e9805ee78 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:16.698661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd8ba230-7beb-435f-adfd-951e9805ee78 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:16.699344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd8ba230-7beb-435f-adfd-951e9805ee78 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:16.891632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fd8ba230-7beb-435f-adfd-951e9805ee78 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:16.900842 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fd8ba230-7beb-435f-adfd-951e9805ee78 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1342 microversion: 2.1 time: 0.221380 Aug 29 16:09:16.901847 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3468/7158] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:16 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1342 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:16.999267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-835638374", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:17.058362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] validate_networks() for None {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:09:17.204083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-54a9ac63-e240-48e0-aabc-6abf3a9b7f1f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:17.205186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-54a9ac63-e240-48e0-aabc-6abf3a9b7f1f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:17.211894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54a9ac63-e240-48e0-aabc-6abf3a9b7f1f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:17.212398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54a9ac63-e240-48e0-aabc-6abf3a9b7f1f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:17.212841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54a9ac63-e240-48e0-aabc-6abf3a9b7f1f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:17.213605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54a9ac63-e240-48e0-aabc-6abf3a9b7f1f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:17.214068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54a9ac63-e240-48e0-aabc-6abf3a9b7f1f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:17.214795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54a9ac63-e240-48e0-aabc-6abf3a9b7f1f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:17.366913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:09:17.367524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:09:17.368336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:09:17.368858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:09:17.369810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:09:17.371605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-54a9ac63-e240-48e0-aabc-6abf3a9b7f1f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:17.380533 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-54a9ac63-e240-48e0-aabc-6abf3a9b7f1f tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1546 microversion: 2.1 time: 0.180804 Aug 29 16:09:17.381483 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3469/7159] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:17 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1546 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:17.382069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:17.382648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:17.383099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:17.384144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:17.384623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:17.385058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:17.402679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0eedccf2-e449-475c-b421-97e03713598a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:17.403393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0eedccf2-e449-475c-b421-97e03713598a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:17.404568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Getting quotas for project 40cc430424134758ad6d727bf22ff55f. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:09:17.410577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eedccf2-e449-475c-b421-97e03713598a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:17.411017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Getting quotas for user 28313da30c6d4d8c8c675a8ac0c5e0bb and project 40cc430424134758ad6d727bf22ff55f. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:09:17.411435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eedccf2-e449-475c-b421-97e03713598a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:17.411886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eedccf2-e449-475c-b421-97e03713598a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:17.412806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eedccf2-e449-475c-b421-97e03713598a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:17.413321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eedccf2-e449-475c-b421-97e03713598a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:17.413973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eedccf2-e449-475c-b421-97e03713598a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:17.427803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:09:17.431344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:09:17.485695 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-636d95ec-e747-4a35-8447-5caa8b2cd11f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.490554 Aug 29 16:09:17.486530 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3691/7160] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:09:17.498004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cf8245a8-cbd4-4424-9631-fea5656d3595 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:17.498926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cf8245a8-cbd4-4424-9631-fea5656d3595 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:17.570048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cf8245a8-cbd4-4424-9631-fea5656d3595 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313da30c6d4d8c8c675a8ac0c5e0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cc430424134758ad6d727bf22ff55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:17.581969 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cf8245a8-cbd4-4424-9631-fea5656d3595 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 200 len: 1213 microversion: 2.1 time: 0.088057 Aug 29 16:09:17.590976 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3692/7161] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:17 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:17.600222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0eedccf2-e449-475c-b421-97e03713598a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:17.609232 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0eedccf2-e449-475c-b421-97e03713598a tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1546 microversion: 2.1 time: 0.210542 Aug 29 16:09:17.611072 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3470/7162] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:17 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1546 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:17.922181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fb45f69d-bf8c-4222-a1bf-f17977038217 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:17.923177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fb45f69d-bf8c-4222-a1bf-f17977038217 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:17.929679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb45f69d-bf8c-4222-a1bf-f17977038217 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:17.930425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb45f69d-bf8c-4222-a1bf-f17977038217 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:17.931060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb45f69d-bf8c-4222-a1bf-f17977038217 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:17.932474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb45f69d-bf8c-4222-a1bf-f17977038217 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:17.933316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb45f69d-bf8c-4222-a1bf-f17977038217 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:17.934017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fb45f69d-bf8c-4222-a1bf-f17977038217 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:18.105738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fb45f69d-bf8c-4222-a1bf-f17977038217 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:18.115219 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fb45f69d-bf8c-4222-a1bf-f17977038217 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1342 microversion: 2.1 time: 0.197329 Aug 29 16:09:18.132779 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3693/7163] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:17 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:18.604689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-80475a29-9e40-4f22-8354-c62f2b83371f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:18.606090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-80475a29-9e40-4f22-8354-c62f2b83371f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:18.613239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80475a29-9e40-4f22-8354-c62f2b83371f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:18.613897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80475a29-9e40-4f22-8354-c62f2b83371f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:18.614510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80475a29-9e40-4f22-8354-c62f2b83371f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:18.615538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80475a29-9e40-4f22-8354-c62f2b83371f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:18.616126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80475a29-9e40-4f22-8354-c62f2b83371f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:18.616648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80475a29-9e40-4f22-8354-c62f2b83371f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:18.698309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-80475a29-9e40-4f22-8354-c62f2b83371f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313da30c6d4d8c8c675a8ac0c5e0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cc430424134758ad6d727bf22ff55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:18.711940 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-80475a29-9e40-4f22-8354-c62f2b83371f tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 200 len: 1265 microversion: 2.1 time: 0.111644 Aug 29 16:09:18.725119 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3471/7164] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:18 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:19.140695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d44dab65-b2de-40dd-bcdf-4dce2be98ddb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:19.142131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d44dab65-b2de-40dd-bcdf-4dce2be98ddb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:19.151235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d44dab65-b2de-40dd-bcdf-4dce2be98ddb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:19.152059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d44dab65-b2de-40dd-bcdf-4dce2be98ddb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:19.152754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d44dab65-b2de-40dd-bcdf-4dce2be98ddb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:19.153604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d44dab65-b2de-40dd-bcdf-4dce2be98ddb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:19.154283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d44dab65-b2de-40dd-bcdf-4dce2be98ddb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:19.154761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d44dab65-b2de-40dd-bcdf-4dce2be98ddb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:19.342489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d44dab65-b2de-40dd-bcdf-4dce2be98ddb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:19.356729 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d44dab65-b2de-40dd-bcdf-4dce2be98ddb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1342 microversion: 2.1 time: 0.220443 Aug 29 16:09:19.368901 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3694/7165] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:19 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1342 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:19.734486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7db28f01-ef00-4e54-b72f-8126c5b681e2 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:19.735091 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7db28f01-ef00-4e54-b72f-8126c5b681e2 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:19.742732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7db28f01-ef00-4e54-b72f-8126c5b681e2 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:19.743561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7db28f01-ef00-4e54-b72f-8126c5b681e2 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:19.744222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7db28f01-ef00-4e54-b72f-8126c5b681e2 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:19.744913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7db28f01-ef00-4e54-b72f-8126c5b681e2 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:19.745733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7db28f01-ef00-4e54-b72f-8126c5b681e2 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:19.746467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7db28f01-ef00-4e54-b72f-8126c5b681e2 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:19.879430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7db28f01-ef00-4e54-b72f-8126c5b681e2 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313da30c6d4d8c8c675a8ac0c5e0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cc430424134758ad6d727bf22ff55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:19.887886 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7db28f01-ef00-4e54-b72f-8126c5b681e2 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 200 len: 1271 microversion: 2.1 time: 0.157508 Aug 29 16:09:19.888794 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3472/7166] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:19 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:20.383472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-14518b9b-fedf-44a3-b0c7-85b308e3f23c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:20.385240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-14518b9b-fedf-44a3-b0c7-85b308e3f23c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:20.392912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14518b9b-fedf-44a3-b0c7-85b308e3f23c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:20.393467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14518b9b-fedf-44a3-b0c7-85b308e3f23c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:20.394001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14518b9b-fedf-44a3-b0c7-85b308e3f23c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:20.394835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14518b9b-fedf-44a3-b0c7-85b308e3f23c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:20.395548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14518b9b-fedf-44a3-b0c7-85b308e3f23c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:20.396236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14518b9b-fedf-44a3-b0c7-85b308e3f23c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:20.538994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-14518b9b-fedf-44a3-b0c7-85b308e3f23c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:20.547444 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-14518b9b-fedf-44a3-b0c7-85b308e3f23c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1388 microversion: 2.1 time: 0.168073 Aug 29 16:09:20.548098 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3695/7167] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:20 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1388 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:20.745303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-fc379564-77df-4d30-956e-7529471280da req-97e59e0e-9cfa-49a6-84b8-cc1260738e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcb0c4b7-071f-4988-93f8-25e896c4133d", "tag": "b1511c51-70dc-43ae-8b29-03c66dbc86a4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:20.769325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fc379564-77df-4d30-956e-7529471280da req-97e59e0e-9cfa-49a6-84b8-cc1260738e28 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:20.769829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fc379564-77df-4d30-956e-7529471280da req-97e59e0e-9cfa-49a6-84b8-cc1260738e28 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:20.770268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fc379564-77df-4d30-956e-7529471280da req-97e59e0e-9cfa-49a6-84b8-cc1260738e28 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:20.795357 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-fc379564-77df-4d30-956e-7529471280da req-97e59e0e-9cfa-49a6-84b8-cc1260738e28 service nova] Creating event network-changed:b1511c51-70dc-43ae-8b29-03c66dbc86a4 for instance fcb0c4b7-071f-4988-93f8-25e896c4133d on n-h2-839401-11 Aug 29 16:09:20.801173 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-fc379564-77df-4d30-956e-7529471280da req-97e59e0e-9cfa-49a6-84b8-cc1260738e28 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061817 Aug 29 16:09:20.802108 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3473/7168] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:20.909839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2537abbc-37df-48d6-9a70-9d8c3b3b343e tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:20.910488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2537abbc-37df-48d6-9a70-9d8c3b3b343e tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:20.919294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2537abbc-37df-48d6-9a70-9d8c3b3b343e tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:20.920014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2537abbc-37df-48d6-9a70-9d8c3b3b343e tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:20.920637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2537abbc-37df-48d6-9a70-9d8c3b3b343e tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:20.921578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2537abbc-37df-48d6-9a70-9d8c3b3b343e tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:20.922201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2537abbc-37df-48d6-9a70-9d8c3b3b343e tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:20.922913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2537abbc-37df-48d6-9a70-9d8c3b3b343e tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:21.064285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2537abbc-37df-48d6-9a70-9d8c3b3b343e tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313da30c6d4d8c8c675a8ac0c5e0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cc430424134758ad6d727bf22ff55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:21.072784 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2537abbc-37df-48d6-9a70-9d8c3b3b343e tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 200 len: 1313 microversion: 2.1 time: 0.167391 Aug 29 16:09:21.073796 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3696/7169] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:20 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:21.569038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fd333302-2da6-4528-8934-b0aebfd8b63a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:21.569807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fd333302-2da6-4528-8934-b0aebfd8b63a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:21.576918 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd333302-2da6-4528-8934-b0aebfd8b63a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:21.577461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd333302-2da6-4528-8934-b0aebfd8b63a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:21.577892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd333302-2da6-4528-8934-b0aebfd8b63a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:21.579064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd333302-2da6-4528-8934-b0aebfd8b63a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:21.579536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd333302-2da6-4528-8934-b0aebfd8b63a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:21.579958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fd333302-2da6-4528-8934-b0aebfd8b63a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:21.818708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fd333302-2da6-4528-8934-b0aebfd8b63a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:21.830677 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fd333302-2da6-4528-8934-b0aebfd8b63a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1376 microversion: 2.1 time: 0.266188 Aug 29 16:09:21.831665 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3474/7170] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:21 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1376 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:22.096705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b17a014b-0dd4-4fee-be72-6c83c946fb3c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:22.097367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b17a014b-0dd4-4fee-be72-6c83c946fb3c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:22.105313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b17a014b-0dd4-4fee-be72-6c83c946fb3c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:22.105794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b17a014b-0dd4-4fee-be72-6c83c946fb3c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:22.106584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b17a014b-0dd4-4fee-be72-6c83c946fb3c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:22.107381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b17a014b-0dd4-4fee-be72-6c83c946fb3c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:22.107949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b17a014b-0dd4-4fee-be72-6c83c946fb3c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:22.108391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b17a014b-0dd4-4fee-be72-6c83c946fb3c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:22.254826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b17a014b-0dd4-4fee-be72-6c83c946fb3c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313da30c6d4d8c8c675a8ac0c5e0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cc430424134758ad6d727bf22ff55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:22.266717 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b17a014b-0dd4-4fee-be72-6c83c946fb3c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 200 len: 1313 microversion: 2.1 time: 0.174889 Aug 29 16:09:22.280396 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3697/7171] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:22 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:22.823743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-0e39bf89-ba02-4d64-9fbf-365edbf5bb1e req-88ed312c-4f7c-4184-9e7d-c3482d43bb22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bf97cbe-89d3-4bde-b683-9ae85af91277", "tag": "ff14074a-dcaf-4ea8-9cba-6187b25bf9df"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:22.842760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0e39bf89-ba02-4d64-9fbf-365edbf5bb1e req-88ed312c-4f7c-4184-9e7d-c3482d43bb22 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:22.842760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0e39bf89-ba02-4d64-9fbf-365edbf5bb1e req-88ed312c-4f7c-4184-9e7d-c3482d43bb22 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:22.843261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0e39bf89-ba02-4d64-9fbf-365edbf5bb1e req-88ed312c-4f7c-4184-9e7d-c3482d43bb22 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:22.854371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a8c96971-465c-4aa1-bb67-38d840c975d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:22.855331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a8c96971-465c-4aa1-bb67-38d840c975d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:22.862922 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-0e39bf89-ba02-4d64-9fbf-365edbf5bb1e req-88ed312c-4f7c-4184-9e7d-c3482d43bb22 service nova] Creating event network-changed:ff14074a-dcaf-4ea8-9cba-6187b25bf9df for instance 0bf97cbe-89d3-4bde-b683-9ae85af91277 on n-h1-839401-11 Aug 29 16:09:22.866265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8c96971-465c-4aa1-bb67-38d840c975d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:22.866849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8c96971-465c-4aa1-bb67-38d840c975d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:22.867556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8c96971-465c-4aa1-bb67-38d840c975d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:22.868409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8c96971-465c-4aa1-bb67-38d840c975d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:22.868959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8c96971-465c-4aa1-bb67-38d840c975d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:22.869470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8c96971-465c-4aa1-bb67-38d840c975d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:22.869665 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-0e39bf89-ba02-4d64-9fbf-365edbf5bb1e req-88ed312c-4f7c-4184-9e7d-c3482d43bb22 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050617 Aug 29 16:09:22.870366 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3475/7172] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:22.889697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:23.011009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a8c96971-465c-4aa1-bb67-38d840c975d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:23.019378 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a8c96971-465c-4aa1-bb67-38d840c975d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1376 microversion: 2.1 time: 0.169444 Aug 29 16:09:23.019976 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3698/7173] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:22 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1376 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:23.289316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-85d71f91-eb50-4283-8d75-8d58d30a15fe tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:23.290271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-85d71f91-eb50-4283-8d75-8d58d30a15fe tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:23.297879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85d71f91-eb50-4283-8d75-8d58d30a15fe tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:23.298611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85d71f91-eb50-4283-8d75-8d58d30a15fe tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:23.299126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85d71f91-eb50-4283-8d75-8d58d30a15fe tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:23.299952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85d71f91-eb50-4283-8d75-8d58d30a15fe tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:23.300555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85d71f91-eb50-4283-8d75-8d58d30a15fe tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:23.301012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85d71f91-eb50-4283-8d75-8d58d30a15fe tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:23.450887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-85d71f91-eb50-4283-8d75-8d58d30a15fe tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313da30c6d4d8c8c675a8ac0c5e0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cc430424134758ad6d727bf22ff55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:23.462437 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-85d71f91-eb50-4283-8d75-8d58d30a15fe tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 200 len: 1313 microversion: 2.1 time: 0.177969 Aug 29 16:09:23.463570 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3476/7174] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:23 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:24.041503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e0465889-35f9-4660-af65-fac353284927 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:24.042099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e0465889-35f9-4660-af65-fac353284927 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:24.050196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0465889-35f9-4660-af65-fac353284927 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:24.050775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0465889-35f9-4660-af65-fac353284927 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:24.051272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0465889-35f9-4660-af65-fac353284927 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:24.052072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0465889-35f9-4660-af65-fac353284927 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:24.052554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0465889-35f9-4660-af65-fac353284927 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:24.053050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0465889-35f9-4660-af65-fac353284927 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:24.194270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e0465889-35f9-4660-af65-fac353284927 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:24.205510 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e0465889-35f9-4660-af65-fac353284927 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1376 microversion: 2.1 time: 0.167924 Aug 29 16:09:24.206518 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3699/7175] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:24 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1376 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:24.486227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5ccf6041-8930-4d18-a409-7132d9142eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:24.486884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5ccf6041-8930-4d18-a409-7132d9142eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:24.493883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ccf6041-8930-4d18-a409-7132d9142eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:24.494424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ccf6041-8930-4d18-a409-7132d9142eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:24.494824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ccf6041-8930-4d18-a409-7132d9142eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:24.495503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ccf6041-8930-4d18-a409-7132d9142eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:24.495964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ccf6041-8930-4d18-a409-7132d9142eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:24.496395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5ccf6041-8930-4d18-a409-7132d9142eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:24.633866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5ccf6041-8930-4d18-a409-7132d9142eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313da30c6d4d8c8c675a8ac0c5e0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cc430424134758ad6d727bf22ff55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:24.644242 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5ccf6041-8930-4d18-a409-7132d9142eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 200 len: 1313 microversion: 2.1 time: 0.161952 Aug 29 16:09:24.645113 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3477/7176] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:24 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:25.233975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2b581a18-5db6-41d3-8d0f-11084fddc261 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:25.235426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2b581a18-5db6-41d3-8d0f-11084fddc261 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:25.249357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b581a18-5db6-41d3-8d0f-11084fddc261 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:25.250147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b581a18-5db6-41d3-8d0f-11084fddc261 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:25.250955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b581a18-5db6-41d3-8d0f-11084fddc261 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:25.251681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b581a18-5db6-41d3-8d0f-11084fddc261 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:25.252146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b581a18-5db6-41d3-8d0f-11084fddc261 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:25.252583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b581a18-5db6-41d3-8d0f-11084fddc261 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:25.409027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2b581a18-5db6-41d3-8d0f-11084fddc261 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:25.417518 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2b581a18-5db6-41d3-8d0f-11084fddc261 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1376 microversion: 2.1 time: 0.189055 Aug 29 16:09:25.418087 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3700/7177] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:25 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1376 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:25.667952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8327c05f-a569-4735-9386-16561e63f938 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:25.668505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8327c05f-a569-4735-9386-16561e63f938 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:25.676655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8327c05f-a569-4735-9386-16561e63f938 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:25.677174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8327c05f-a569-4735-9386-16561e63f938 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:25.677612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8327c05f-a569-4735-9386-16561e63f938 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:25.678308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8327c05f-a569-4735-9386-16561e63f938 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:25.678766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8327c05f-a569-4735-9386-16561e63f938 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:25.679192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8327c05f-a569-4735-9386-16561e63f938 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:25.816978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8327c05f-a569-4735-9386-16561e63f938 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313da30c6d4d8c8c675a8ac0c5e0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cc430424134758ad6d727bf22ff55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:25.826145 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8327c05f-a569-4735-9386-16561e63f938 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 200 len: 1313 microversion: 2.1 time: 0.164649 Aug 29 16:09:25.826833 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3478/7178] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:25 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:26.442103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-286016f0-73ff-43f0-a107-930a875191b0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:26.442746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-286016f0-73ff-43f0-a107-930a875191b0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:26.453512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-286016f0-73ff-43f0-a107-930a875191b0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:26.454160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-286016f0-73ff-43f0-a107-930a875191b0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:26.454608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-286016f0-73ff-43f0-a107-930a875191b0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:26.455478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-286016f0-73ff-43f0-a107-930a875191b0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:26.455951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-286016f0-73ff-43f0-a107-930a875191b0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:26.456429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-286016f0-73ff-43f0-a107-930a875191b0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:26.623485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-286016f0-73ff-43f0-a107-930a875191b0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:26.633021 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-286016f0-73ff-43f0-a107-930a875191b0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1376 microversion: 2.1 time: 0.197700 Aug 29 16:09:26.633882 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3701/7179] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:26 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1376 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:26.848043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-efba9b13-6a62-4a5c-ac92-c60f9725ff4d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:26.849186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-efba9b13-6a62-4a5c-ac92-c60f9725ff4d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:26.856817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-efba9b13-6a62-4a5c-ac92-c60f9725ff4d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:26.857426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-efba9b13-6a62-4a5c-ac92-c60f9725ff4d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:26.858090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-efba9b13-6a62-4a5c-ac92-c60f9725ff4d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:26.859030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-efba9b13-6a62-4a5c-ac92-c60f9725ff4d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:26.859504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-efba9b13-6a62-4a5c-ac92-c60f9725ff4d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:26.860012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-efba9b13-6a62-4a5c-ac92-c60f9725ff4d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:26.863405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=100 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:27.002033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-efba9b13-6a62-4a5c-ac92-c60f9725ff4d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313da30c6d4d8c8c675a8ac0c5e0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cc430424134758ad6d727bf22ff55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:27.014246 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-efba9b13-6a62-4a5c-ac92-c60f9725ff4d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 200 len: 1313 microversion: 2.1 time: 0.170071 Aug 29 16:09:27.015133 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3479/7180] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:26 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:27.655049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a1ec3fc1-f190-4590-96fb-a667bf1176f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:27.655685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a1ec3fc1-f190-4590-96fb-a667bf1176f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:27.657776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:27.659358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:27.665428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ec3fc1-f190-4590-96fb-a667bf1176f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:27.665943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ec3fc1-f190-4590-96fb-a667bf1176f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:27.666405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ec3fc1-f190-4590-96fb-a667bf1176f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:27.667163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ec3fc1-f190-4590-96fb-a667bf1176f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:27.667701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ec3fc1-f190-4590-96fb-a667bf1176f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:27.668087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ec3fc1-f190-4590-96fb-a667bf1176f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:27.815214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a1ec3fc1-f190-4590-96fb-a667bf1176f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:27.824618 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a1ec3fc1-f190-4590-96fb-a667bf1176f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1376 microversion: 2.1 time: 0.173481 Aug 29 16:09:27.825215 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3702/7181] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:27 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1376 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:28.035406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3b60aea0-b0f4-488a-99f2-0e3b79a38c0c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:28.036040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3b60aea0-b0f4-488a-99f2-0e3b79a38c0c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:28.038800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:28.044544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b60aea0-b0f4-488a-99f2-0e3b79a38c0c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:28.045043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b60aea0-b0f4-488a-99f2-0e3b79a38c0c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:28.045517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b60aea0-b0f4-488a-99f2-0e3b79a38c0c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:28.046223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b60aea0-b0f4-488a-99f2-0e3b79a38c0c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:28.046689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b60aea0-b0f4-488a-99f2-0e3b79a38c0c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:28.047178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b60aea0-b0f4-488a-99f2-0e3b79a38c0c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:28.194357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3b60aea0-b0f4-488a-99f2-0e3b79a38c0c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313da30c6d4d8c8c675a8ac0c5e0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cc430424134758ad6d727bf22ff55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:28.202621 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3b60aea0-b0f4-488a-99f2-0e3b79a38c0c tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 200 len: 1313 microversion: 2.1 time: 0.171191 Aug 29 16:09:28.203217 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3480/7182] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:28 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:28.846180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d35f115-c016-48d0-b5ec-4b70148674f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:28.846768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2d35f115-c016-48d0-b5ec-4b70148674f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:28.849600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:28.855635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d35f115-c016-48d0-b5ec-4b70148674f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:28.856140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d35f115-c016-48d0-b5ec-4b70148674f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:28.856599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d35f115-c016-48d0-b5ec-4b70148674f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:28.857344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d35f115-c016-48d0-b5ec-4b70148674f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:28.857825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d35f115-c016-48d0-b5ec-4b70148674f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:28.858269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d35f115-c016-48d0-b5ec-4b70148674f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:29.006496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d35f115-c016-48d0-b5ec-4b70148674f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:29.018719 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d35f115-c016-48d0-b5ec-4b70148674f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1376 microversion: 2.1 time: 0.176174 Aug 29 16:09:29.019537 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3703/7183] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:28 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1376 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:29.223864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-79dc09bc-a3ce-4fab-b06f-f0c8edb33722 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:29.224600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-79dc09bc-a3ce-4fab-b06f-f0c8edb33722 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:29.231680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79dc09bc-a3ce-4fab-b06f-f0c8edb33722 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:29.232169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79dc09bc-a3ce-4fab-b06f-f0c8edb33722 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:29.232860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79dc09bc-a3ce-4fab-b06f-f0c8edb33722 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:29.233601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79dc09bc-a3ce-4fab-b06f-f0c8edb33722 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:29.234053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79dc09bc-a3ce-4fab-b06f-f0c8edb33722 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:29.234506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79dc09bc-a3ce-4fab-b06f-f0c8edb33722 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:29.372630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-79dc09bc-a3ce-4fab-b06f-f0c8edb33722 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313da30c6d4d8c8c675a8ac0c5e0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cc430424134758ad6d727bf22ff55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:29.381191 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-79dc09bc-a3ce-4fab-b06f-f0c8edb33722 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 200 len: 1313 microversion: 2.1 time: 0.161237 Aug 29 16:09:29.381775 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3481/7184] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:29 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:29.460403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e8686e2a-e6b1-47b1-be96-3ce54e770302 req-2275f0aa-6b24-4957-917f-74ef53c1f1ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf97cbe-89d3-4bde-b683-9ae85af91277", "name": "network-vif-plugged", "status": "completed", "tag": "ff14074a-dcaf-4ea8-9cba-6187b25bf9df"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:29.472068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e8686e2a-e6b1-47b1-be96-3ce54e770302 req-2275f0aa-6b24-4957-917f-74ef53c1f1ce service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:29.472545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e8686e2a-e6b1-47b1-be96-3ce54e770302 req-2275f0aa-6b24-4957-917f-74ef53c1f1ce service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:29.473024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e8686e2a-e6b1-47b1-be96-3ce54e770302 req-2275f0aa-6b24-4957-917f-74ef53c1f1ce service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:29.484719 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e8686e2a-e6b1-47b1-be96-3ce54e770302 req-2275f0aa-6b24-4957-917f-74ef53c1f1ce service nova] Creating event network-vif-plugged:ff14074a-dcaf-4ea8-9cba-6187b25bf9df for instance 0bf97cbe-89d3-4bde-b683-9ae85af91277 on n-h1-839401-11 Aug 29 16:09:29.489874 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e8686e2a-e6b1-47b1-be96-3ce54e770302 req-2275f0aa-6b24-4957-917f-74ef53c1f1ce service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033408 Aug 29 16:09:29.490488 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3704/7185] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:09:30.044822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0b438721-ecbb-4bb9-a296-3fb362ce214d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:30.045437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0b438721-ecbb-4bb9-a296-3fb362ce214d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:30.052456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b438721-ecbb-4bb9-a296-3fb362ce214d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:30.052962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b438721-ecbb-4bb9-a296-3fb362ce214d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:30.053505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b438721-ecbb-4bb9-a296-3fb362ce214d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:30.054366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b438721-ecbb-4bb9-a296-3fb362ce214d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:30.054923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b438721-ecbb-4bb9-a296-3fb362ce214d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:30.055348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b438721-ecbb-4bb9-a296-3fb362ce214d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:30.188387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0b438721-ecbb-4bb9-a296-3fb362ce214d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:30.196612 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0b438721-ecbb-4bb9-a296-3fb362ce214d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1376 microversion: 2.1 time: 0.156288 Aug 29 16:09:30.197260 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3482/7186] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:30 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:30.405803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cf92eaae-0bed-4be3-8f99-0f6aea0a95f3 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:30.406690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cf92eaae-0bed-4be3-8f99-0f6aea0a95f3 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:30.415344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf92eaae-0bed-4be3-8f99-0f6aea0a95f3 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:30.416011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf92eaae-0bed-4be3-8f99-0f6aea0a95f3 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:30.416619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf92eaae-0bed-4be3-8f99-0f6aea0a95f3 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:30.417583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf92eaae-0bed-4be3-8f99-0f6aea0a95f3 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:30.418239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf92eaae-0bed-4be3-8f99-0f6aea0a95f3 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:30.418827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cf92eaae-0bed-4be3-8f99-0f6aea0a95f3 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:30.563515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cf92eaae-0bed-4be3-8f99-0f6aea0a95f3 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313da30c6d4d8c8c675a8ac0c5e0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cc430424134758ad6d727bf22ff55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:30.573014 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cf92eaae-0bed-4be3-8f99-0f6aea0a95f3 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 200 len: 1313 microversion: 2.1 time: 0.174019 Aug 29 16:09:30.574010 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3705/7187] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:30 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:31.218091 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9adc2cd1-1165-45b7-873c-6190885e961f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:31.219222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9adc2cd1-1165-45b7-873c-6190885e961f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:31.230613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9adc2cd1-1165-45b7-873c-6190885e961f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:31.231112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9adc2cd1-1165-45b7-873c-6190885e961f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:31.231554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9adc2cd1-1165-45b7-873c-6190885e961f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:31.232262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9adc2cd1-1165-45b7-873c-6190885e961f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:31.232705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9adc2cd1-1165-45b7-873c-6190885e961f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:31.233354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9adc2cd1-1165-45b7-873c-6190885e961f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:31.381022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9adc2cd1-1165-45b7-873c-6190885e961f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:31.389661 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9adc2cd1-1165-45b7-873c-6190885e961f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1376 microversion: 2.1 time: 0.175523 Aug 29 16:09:31.390263 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3483/7188] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:31 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1376 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:31.508444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-50514ad0-a283-4402-ae42-a46f315f7ac6 req-8ae16767-a5e0-46c2-a123-9f609226d6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e49ff7-4599-4df3-9cf3-90278816cd8e", "name": "network-vif-plugged", "status": "completed", "tag": "c018e7a9-b613-422a-ba70-98b66f55034f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:31.521397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-50514ad0-a283-4402-ae42-a46f315f7ac6 req-8ae16767-a5e0-46c2-a123-9f609226d6f4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:31.521890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-50514ad0-a283-4402-ae42-a46f315f7ac6 req-8ae16767-a5e0-46c2-a123-9f609226d6f4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:31.522381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-50514ad0-a283-4402-ae42-a46f315f7ac6 req-8ae16767-a5e0-46c2-a123-9f609226d6f4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:31.535789 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-50514ad0-a283-4402-ae42-a46f315f7ac6 req-8ae16767-a5e0-46c2-a123-9f609226d6f4 service nova] Creating event network-vif-plugged:c018e7a9-b613-422a-ba70-98b66f55034f for instance 62e49ff7-4599-4df3-9cf3-90278816cd8e on n-h1-839401-11 Aug 29 16:09:31.541077 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-50514ad0-a283-4402-ae42-a46f315f7ac6 req-8ae16767-a5e0-46c2-a123-9f609226d6f4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037363 Aug 29 16:09:31.541656 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3706/7189] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:31.607177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cde3c783-3d6e-47ab-b596-3297f360714a tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:31.607787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cde3c783-3d6e-47ab-b596-3297f360714a tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:31.614435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde3c783-3d6e-47ab-b596-3297f360714a tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:31.614783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde3c783-3d6e-47ab-b596-3297f360714a tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:31.615218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde3c783-3d6e-47ab-b596-3297f360714a tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:31.615917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde3c783-3d6e-47ab-b596-3297f360714a tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:31.616374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde3c783-3d6e-47ab-b596-3297f360714a tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:31.616801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde3c783-3d6e-47ab-b596-3297f360714a tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:31.826863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cde3c783-3d6e-47ab-b596-3297f360714a tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313da30c6d4d8c8c675a8ac0c5e0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cc430424134758ad6d727bf22ff55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:31.834949 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cde3c783-3d6e-47ab-b596-3297f360714a tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 200 len: 1463 microversion: 2.1 time: 0.236499 Aug 29 16:09:31.835539 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3484/7190] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:31 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 1463 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:31.855636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-04c11b76-e777-4d5c-85e8-c14f65a1865d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a89f556-37b7-4251-8793-c615f7ca89a6", "device": "/dev/sdb"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:31.858217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-04c11b76-e777-4d5c-85e8-c14f65a1865d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:31.864960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-04c11b76-e777-4d5c-85e8-c14f65a1865d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:31.865487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-04c11b76-e777-4d5c-85e8-c14f65a1865d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:31.865941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-04c11b76-e777-4d5c-85e8-c14f65a1865d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:31.866664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-04c11b76-e777-4d5c-85e8-c14f65a1865d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:31.867121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-04c11b76-e777-4d5c-85e8-c14f65a1865d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:31.867566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-04c11b76-e777-4d5c-85e8-c14f65a1865d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:32.393072 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-04c11b76-e777-4d5c-85e8-c14f65a1865d tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "POST /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.541629 Aug 29 16:09:32.393735 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3707/7191] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 16:09:31 2022] POST /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277/os-volume_attachments => generated 194 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:32.410353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-27236d9c-f78a-4655-a8fc-4c25497347f8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:32.410976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-27236d9c-f78a-4655-a8fc-4c25497347f8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:32.418038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27236d9c-f78a-4655-a8fc-4c25497347f8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:32.418531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27236d9c-f78a-4655-a8fc-4c25497347f8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:32.418971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27236d9c-f78a-4655-a8fc-4c25497347f8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:32.419673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27236d9c-f78a-4655-a8fc-4c25497347f8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:32.420126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27236d9c-f78a-4655-a8fc-4c25497347f8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:32.420561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27236d9c-f78a-4655-a8fc-4c25497347f8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:32.556198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-27236d9c-f78a-4655-a8fc-4c25497347f8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:32.564723 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-27236d9c-f78a-4655-a8fc-4c25497347f8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1376 microversion: 2.1 time: 0.158279 Aug 29 16:09:32.565349 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3485/7192] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:32 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:33.586236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e30fe468-564a-4f27-8aca-b9abe22c0f59 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:33.587045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e30fe468-564a-4f27-8aca-b9abe22c0f59 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:33.595024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e30fe468-564a-4f27-8aca-b9abe22c0f59 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:33.595529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e30fe468-564a-4f27-8aca-b9abe22c0f59 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:33.595983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e30fe468-564a-4f27-8aca-b9abe22c0f59 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:33.596708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e30fe468-564a-4f27-8aca-b9abe22c0f59 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:33.597202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e30fe468-564a-4f27-8aca-b9abe22c0f59 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:33.597645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e30fe468-564a-4f27-8aca-b9abe22c0f59 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:33.737159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e30fe468-564a-4f27-8aca-b9abe22c0f59 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:33.745895 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e30fe468-564a-4f27-8aca-b9abe22c0f59 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1563 microversion: 2.1 time: 0.164065 Aug 29 16:09:33.746513 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3708/7193] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:33 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:33.766597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9dc73a8e-f956-4929-bb7b-92831ad1968f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:33.767296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9dc73a8e-f956-4929-bb7b-92831ad1968f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:33.775078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9dc73a8e-f956-4929-bb7b-92831ad1968f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:33.775597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9dc73a8e-f956-4929-bb7b-92831ad1968f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:33.776020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9dc73a8e-f956-4929-bb7b-92831ad1968f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:33.776751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9dc73a8e-f956-4929-bb7b-92831ad1968f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:33.777298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9dc73a8e-f956-4929-bb7b-92831ad1968f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:33.777715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9dc73a8e-f956-4929-bb7b-92831ad1968f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:33.911674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9dc73a8e-f956-4929-bb7b-92831ad1968f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:33.919981 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9dc73a8e-f956-4929-bb7b-92831ad1968f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1563 microversion: 2.1 time: 0.157364 Aug 29 16:09:33.920562 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3486/7194] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:33 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:33.996004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6268b53c-511a-4acd-82d4-179a12688148 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:33.996518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6268b53c-511a-4acd-82d4-179a12688148 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:34.003450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6268b53c-511a-4acd-82d4-179a12688148 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:34.003950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6268b53c-511a-4acd-82d4-179a12688148 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:34.004401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6268b53c-511a-4acd-82d4-179a12688148 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:34.005121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6268b53c-511a-4acd-82d4-179a12688148 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:34.005577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6268b53c-511a-4acd-82d4-179a12688148 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:34.006013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6268b53c-511a-4acd-82d4-179a12688148 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:34.032626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6268b53c-511a-4acd-82d4-179a12688148 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:09:34.113276 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6268b53c-511a-4acd-82d4-179a12688148 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "DELETE /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 204 len: 0 microversion: 2.1 time: 0.120613 Aug 29 16:09:34.117125 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3709/7195] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:09:33 2022] DELETE /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:09:34.122621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-788ef4b1-dcc3-4c14-86c8-8aa04d4be7d0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:34.123247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-788ef4b1-dcc3-4c14-86c8-8aa04d4be7d0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:34.130045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-788ef4b1-dcc3-4c14-86c8-8aa04d4be7d0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:34.130547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-788ef4b1-dcc3-4c14-86c8-8aa04d4be7d0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:34.130993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-788ef4b1-dcc3-4c14-86c8-8aa04d4be7d0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:34.131709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-788ef4b1-dcc3-4c14-86c8-8aa04d4be7d0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:34.132176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-788ef4b1-dcc3-4c14-86c8-8aa04d4be7d0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:34.132613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-788ef4b1-dcc3-4c14-86c8-8aa04d4be7d0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:34.271087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-788ef4b1-dcc3-4c14-86c8-8aa04d4be7d0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:34.280079 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-788ef4b1-dcc3-4c14-86c8-8aa04d4be7d0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1569 microversion: 2.1 time: 0.161582 Aug 29 16:09:34.280679 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3487/7196] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:34 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:35.302251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ba1e54ff-d7ef-4172-ae76-8dff0723b01f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:35.302994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ba1e54ff-d7ef-4172-ae76-8dff0723b01f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:35.310293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba1e54ff-d7ef-4172-ae76-8dff0723b01f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:35.310800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba1e54ff-d7ef-4172-ae76-8dff0723b01f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:35.311256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba1e54ff-d7ef-4172-ae76-8dff0723b01f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:35.311965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba1e54ff-d7ef-4172-ae76-8dff0723b01f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:35.312518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba1e54ff-d7ef-4172-ae76-8dff0723b01f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:35.312961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba1e54ff-d7ef-4172-ae76-8dff0723b01f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:35.449975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ba1e54ff-d7ef-4172-ae76-8dff0723b01f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:35.458812 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ba1e54ff-d7ef-4172-ae76-8dff0723b01f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1569 microversion: 2.1 time: 0.160848 Aug 29 16:09:35.459510 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3710/7197] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:35 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:36.481596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-420e9092-bfe8-4a2d-afdd-41a2e4b8ad20 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:36.482944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-420e9092-bfe8-4a2d-afdd-41a2e4b8ad20 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:36.509901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-420e9092-bfe8-4a2d-afdd-41a2e4b8ad20 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:36.510899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-420e9092-bfe8-4a2d-afdd-41a2e4b8ad20 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:36.511611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-420e9092-bfe8-4a2d-afdd-41a2e4b8ad20 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:36.512613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-420e9092-bfe8-4a2d-afdd-41a2e4b8ad20 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:36.513122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-420e9092-bfe8-4a2d-afdd-41a2e4b8ad20 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:36.513571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-420e9092-bfe8-4a2d-afdd-41a2e4b8ad20 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:36.880295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-420e9092-bfe8-4a2d-afdd-41a2e4b8ad20 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:36.889302 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-420e9092-bfe8-4a2d-afdd-41a2e4b8ad20 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1569 microversion: 2.1 time: 0.412987 Aug 29 16:09:36.890182 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3488/7198] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:36 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1569 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:37.126505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-47ccbd35-63b8-4bf1-8c53-6362435cea84 req-a9c3af25-4bfe-4de3-9d01-2973603861db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e49ff7-4599-4df3-9cf3-90278816cd8e", "name": "network-vif-deleted", "tag": "c018e7a9-b613-422a-ba70-98b66f55034f"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:37.141683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-47ccbd35-63b8-4bf1-8c53-6362435cea84 req-a9c3af25-4bfe-4de3-9d01-2973603861db service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:37.142228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-47ccbd35-63b8-4bf1-8c53-6362435cea84 req-a9c3af25-4bfe-4de3-9d01-2973603861db service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:37.142699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-47ccbd35-63b8-4bf1-8c53-6362435cea84 req-a9c3af25-4bfe-4de3-9d01-2973603861db service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:37.165986 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-47ccbd35-63b8-4bf1-8c53-6362435cea84 req-a9c3af25-4bfe-4de3-9d01-2973603861db service nova] Creating event network-vif-deleted:c018e7a9-b613-422a-ba70-98b66f55034f for instance 62e49ff7-4599-4df3-9cf3-90278816cd8e on n-h1-839401-11 Aug 29 16:09:37.174075 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-47ccbd35-63b8-4bf1-8c53-6362435cea84 req-a9c3af25-4bfe-4de3-9d01-2973603861db service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052050 Aug 29 16:09:37.175241 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3711/7199] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:37.911989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9aaab83f-3853-4356-b801-c85895e7dabc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:37.912617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9aaab83f-3853-4356-b801-c85895e7dabc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:37.920054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9aaab83f-3853-4356-b801-c85895e7dabc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:37.920559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9aaab83f-3853-4356-b801-c85895e7dabc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:37.921010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9aaab83f-3853-4356-b801-c85895e7dabc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:37.921871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9aaab83f-3853-4356-b801-c85895e7dabc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:37.922350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9aaab83f-3853-4356-b801-c85895e7dabc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:37.922789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9aaab83f-3853-4356-b801-c85895e7dabc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:37.991803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9aaab83f-3853-4356-b801-c85895e7dabc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:38.001021 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9aaab83f-3853-4356-b801-c85895e7dabc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1361 microversion: 2.1 time: 0.093001 Aug 29 16:09:38.001774 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3489/7200] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:37 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1361 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:39.024139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7d1c39a9-5ee8-4fe3-b84b-9335eabd2980 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:39.024699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7d1c39a9-5ee8-4fe3-b84b-9335eabd2980 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:39.031578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d1c39a9-5ee8-4fe3-b84b-9335eabd2980 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:39.032076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d1c39a9-5ee8-4fe3-b84b-9335eabd2980 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:39.032525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d1c39a9-5ee8-4fe3-b84b-9335eabd2980 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:39.033267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d1c39a9-5ee8-4fe3-b84b-9335eabd2980 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:39.033732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d1c39a9-5ee8-4fe3-b84b-9335eabd2980 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:39.034167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d1c39a9-5ee8-4fe3-b84b-9335eabd2980 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:39.099134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7d1c39a9-5ee8-4fe3-b84b-9335eabd2980 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:39.107240 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7d1c39a9-5ee8-4fe3-b84b-9335eabd2980 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1361 microversion: 2.1 time: 0.088747 Aug 29 16:09:39.107804 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3712/7201] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:39 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1361 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:40.128154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d94bce19-900c-4122-be6d-ff9fceed861b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:40.128723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d94bce19-900c-4122-be6d-ff9fceed861b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:40.136622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d94bce19-900c-4122-be6d-ff9fceed861b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:40.137120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d94bce19-900c-4122-be6d-ff9fceed861b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:40.137572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d94bce19-900c-4122-be6d-ff9fceed861b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:40.138315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d94bce19-900c-4122-be6d-ff9fceed861b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:40.138780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d94bce19-900c-4122-be6d-ff9fceed861b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:40.139216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d94bce19-900c-4122-be6d-ff9fceed861b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:40.204853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d94bce19-900c-4122-be6d-ff9fceed861b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:40.214269 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d94bce19-900c-4122-be6d-ff9fceed861b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1361 microversion: 2.1 time: 0.090611 Aug 29 16:09:40.218652 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3490/7202] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:40 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1361 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:41.235241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-db921341-6cf8-4103-ab2e-4f6f78194a31 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:41.235815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-db921341-6cf8-4103-ab2e-4f6f78194a31 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:41.243285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db921341-6cf8-4103-ab2e-4f6f78194a31 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:41.243782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db921341-6cf8-4103-ab2e-4f6f78194a31 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:41.244238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db921341-6cf8-4103-ab2e-4f6f78194a31 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:41.244951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db921341-6cf8-4103-ab2e-4f6f78194a31 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:41.245454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db921341-6cf8-4103-ab2e-4f6f78194a31 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:41.245896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-db921341-6cf8-4103-ab2e-4f6f78194a31 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:41.318846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-db921341-6cf8-4103-ab2e-4f6f78194a31 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:41.327127 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-db921341-6cf8-4103-ab2e-4f6f78194a31 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1361 microversion: 2.1 time: 0.095850 Aug 29 16:09:41.327849 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3713/7203] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:41 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1361 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:42.348825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e1b47a93-cb74-4d08-bbd3-d26402763719 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:42.349563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e1b47a93-cb74-4d08-bbd3-d26402763719 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:42.364219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1b47a93-cb74-4d08-bbd3-d26402763719 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:42.364219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1b47a93-cb74-4d08-bbd3-d26402763719 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:42.364219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1b47a93-cb74-4d08-bbd3-d26402763719 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:42.364219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1b47a93-cb74-4d08-bbd3-d26402763719 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:42.364219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1b47a93-cb74-4d08-bbd3-d26402763719 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:42.364219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1b47a93-cb74-4d08-bbd3-d26402763719 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:42.396214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1b47a93-cb74-4d08-bbd3-d26402763719 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:42.396611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1b47a93-cb74-4d08-bbd3-d26402763719 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:42.397059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1b47a93-cb74-4d08-bbd3-d26402763719 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:42.397551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-e1b47a93-cb74-4d08-bbd3-d26402763719 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lazy-loading 'fault' on Instance uuid 62e49ff7-4599-4df3-9cf3-90278816cd8e {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:09:42.438958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e1b47a93-cb74-4d08-bbd3-d26402763719 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:42.447137 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e1b47a93-cb74-4d08-bbd3-d26402763719 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 200 len: 1366 microversion: 2.1 time: 0.103213 Aug 29 16:09:42.447741 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3491/7204] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:42 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:43.468484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6c2f568d-5f09-4e2b-94b6-d4b9829ab422 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:43.469107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6c2f568d-5f09-4e2b-94b6-d4b9829ab422 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:43.476456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c2f568d-5f09-4e2b-94b6-d4b9829ab422 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:43.476964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c2f568d-5f09-4e2b-94b6-d4b9829ab422 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:43.477467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c2f568d-5f09-4e2b-94b6-d4b9829ab422 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:43.478186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c2f568d-5f09-4e2b-94b6-d4b9829ab422 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:43.478657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c2f568d-5f09-4e2b-94b6-d4b9829ab422 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:43.479102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c2f568d-5f09-4e2b-94b6-d4b9829ab422 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:43.483293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:43.493876 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-6c2f568d-5f09-4e2b-94b6-d4b9829ab422 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] HTTP exception thrown: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6c2f568d-5f09-4e2b-94b6-d4b9829ab422 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Request method failure captured: Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e HTTP/1.1 Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOPVKb3AKf05JOTmVWxg_YSLh_6aJQ1fwERqtRCNq2OGA-TgfvjQkO776TgAknFFnCA3k1v6BcT_thZ3YV-DMceZELFHu1q-Z_h1mjuaQAa75Kym14h4m_K8QcmdN6yIk-IwhACLHvRJHqBNwAzk2eiJecAZxJFQO9-ZjVx01ZUPXeU Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_688ed04d399247f0ac8a204967cdfa2a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}] Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: f07d896c6764402999345759f2348080 Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '62e49ff7-4599-4df3-9cf3-90278816cd8e'} Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:09:43.495649 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:09:43.501771 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:43.501771 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:09:43.501771 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:09:43.501771 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:09:43.501771 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:09:43.501771 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. Aug 29 16:09:43.501771 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:09:43.501771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6c2f568d-5f09-4e2b-94b6-d4b9829ab422 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Returning 404 to user: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:09:43.501771 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6c2f568d-5f09-4e2b-94b6-d4b9829ab422 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 404 len: 111 microversion: 2.1 time: 0.032902 Aug 29 16:09:43.501771 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3714/7205] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:43 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:09:47.816921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1cb228d7-a3fc-4828-8f69-73144d808e60 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:47.817512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1cb228d7-a3fc-4828-8f69-73144d808e60 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:47.824531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb228d7-a3fc-4828-8f69-73144d808e60 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:47.825211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb228d7-a3fc-4828-8f69-73144d808e60 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:47.825774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb228d7-a3fc-4828-8f69-73144d808e60 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:47.826548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb228d7-a3fc-4828-8f69-73144d808e60 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:47.827223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb228d7-a3fc-4828-8f69-73144d808e60 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:47.827591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1cb228d7-a3fc-4828-8f69-73144d808e60 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:47.858473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1cb228d7-a3fc-4828-8f69-73144d808e60 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:09:47.944289 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1cb228d7-a3fc-4828-8f69-73144d808e60 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 204 len: 0 microversion: 2.1 time: 0.131199 Aug 29 16:09:47.944918 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3492/7206] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:09:47 2022] DELETE /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:09:47.955072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3199111f-5eaf-4b85-a8d5-d17e2004c078 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:47.955701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3199111f-5eaf-4b85-a8d5-d17e2004c078 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:47.963896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3199111f-5eaf-4b85-a8d5-d17e2004c078 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:47.964400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3199111f-5eaf-4b85-a8d5-d17e2004c078 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:47.964836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3199111f-5eaf-4b85-a8d5-d17e2004c078 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:47.965568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3199111f-5eaf-4b85-a8d5-d17e2004c078 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:47.966031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3199111f-5eaf-4b85-a8d5-d17e2004c078 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:47.966465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3199111f-5eaf-4b85-a8d5-d17e2004c078 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:48.116367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3199111f-5eaf-4b85-a8d5-d17e2004c078 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:48.125271 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3199111f-5eaf-4b85-a8d5-d17e2004c078 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1411 microversion: 2.1 time: 0.175297 Aug 29 16:09:48.125845 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3715/7207] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:47 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1411 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:49.147435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1876125a-9bc6-4cd2-87c1-96253f5eb4ad tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:49.149321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1876125a-9bc6-4cd2-87c1-96253f5eb4ad tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:49.156795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1876125a-9bc6-4cd2-87c1-96253f5eb4ad tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:49.157339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1876125a-9bc6-4cd2-87c1-96253f5eb4ad tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:49.157784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1876125a-9bc6-4cd2-87c1-96253f5eb4ad tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:49.158496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1876125a-9bc6-4cd2-87c1-96253f5eb4ad tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:49.159098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1876125a-9bc6-4cd2-87c1-96253f5eb4ad tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:49.159536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1876125a-9bc6-4cd2-87c1-96253f5eb4ad tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:49.567780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1876125a-9bc6-4cd2-87c1-96253f5eb4ad tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:49.570336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:49.578524 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1876125a-9bc6-4cd2-87c1-96253f5eb4ad tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1411 microversion: 2.1 time: 0.435919 Aug 29 16:09:49.579537 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3493/7208] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:49 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1411 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:50.600329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-154a42d3-7ee4-48b9-b3fe-85c32e9d39b6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:50.601686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-154a42d3-7ee4-48b9-b3fe-85c32e9d39b6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:50.608904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154a42d3-7ee4-48b9-b3fe-85c32e9d39b6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:50.609860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154a42d3-7ee4-48b9-b3fe-85c32e9d39b6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:50.610547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154a42d3-7ee4-48b9-b3fe-85c32e9d39b6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:50.611529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154a42d3-7ee4-48b9-b3fe-85c32e9d39b6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:50.612220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154a42d3-7ee4-48b9-b3fe-85c32e9d39b6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:50.612883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-154a42d3-7ee4-48b9-b3fe-85c32e9d39b6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:50.743117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-154a42d3-7ee4-48b9-b3fe-85c32e9d39b6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:50.752207 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-154a42d3-7ee4-48b9-b3fe-85c32e9d39b6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1369 microversion: 2.1 time: 0.155918 Aug 29 16:09:50.753356 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3716/7209] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:50 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:50.855732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-24931dc5-e5ab-46d5-84e0-106759abc141 req-e7f52f99-0ede-4f3d-9d38-e8101a4d8496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1094df4-9ce0-4389-a24f-b0d65119a7f4", "name": "network-vif-deleted", "tag": "d4721e07-ba3d-44c0-ad78-3a003cb28b18"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:50.869050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-24931dc5-e5ab-46d5-84e0-106759abc141 req-e7f52f99-0ede-4f3d-9d38-e8101a4d8496 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:50.869686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-24931dc5-e5ab-46d5-84e0-106759abc141 req-e7f52f99-0ede-4f3d-9d38-e8101a4d8496 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:50.870126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-24931dc5-e5ab-46d5-84e0-106759abc141 req-e7f52f99-0ede-4f3d-9d38-e8101a4d8496 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:50.883535 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-24931dc5-e5ab-46d5-84e0-106759abc141 req-e7f52f99-0ede-4f3d-9d38-e8101a4d8496 service nova] Creating event network-vif-deleted:d4721e07-ba3d-44c0-ad78-3a003cb28b18 for instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 on n-h2-839401-11 Aug 29 16:09:50.889209 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-24931dc5-e5ab-46d5-84e0-106759abc141 req-e7f52f99-0ede-4f3d-9d38-e8101a4d8496 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037164 Aug 29 16:09:50.890037 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3494/7210] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:51.776058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-930d2ba6-7cd4-4e73-b7c9-48d461bb3102 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:51.777531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-930d2ba6-7cd4-4e73-b7c9-48d461bb3102 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:51.784793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-930d2ba6-7cd4-4e73-b7c9-48d461bb3102 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:51.785565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-930d2ba6-7cd4-4e73-b7c9-48d461bb3102 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:51.786228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-930d2ba6-7cd4-4e73-b7c9-48d461bb3102 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:51.787030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-930d2ba6-7cd4-4e73-b7c9-48d461bb3102 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:51.787674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-930d2ba6-7cd4-4e73-b7c9-48d461bb3102 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:51.788112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-930d2ba6-7cd4-4e73-b7c9-48d461bb3102 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:51.877476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-930d2ba6-7cd4-4e73-b7c9-48d461bb3102 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:51.887384 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-930d2ba6-7cd4-4e73-b7c9-48d461bb3102 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1202 microversion: 2.1 time: 0.116214 Aug 29 16:09:51.901557 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3717/7211] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:51 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1202 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:52.918196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7917666e-e7a7-4c2e-b31d-08853be96ac9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:52.920762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7917666e-e7a7-4c2e-b31d-08853be96ac9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:52.933827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7917666e-e7a7-4c2e-b31d-08853be96ac9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:52.937069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7917666e-e7a7-4c2e-b31d-08853be96ac9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:52.938388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7917666e-e7a7-4c2e-b31d-08853be96ac9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:52.939519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7917666e-e7a7-4c2e-b31d-08853be96ac9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:52.941035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7917666e-e7a7-4c2e-b31d-08853be96ac9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:52.949455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7917666e-e7a7-4c2e-b31d-08853be96ac9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:53.023181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7917666e-e7a7-4c2e-b31d-08853be96ac9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:53.033070 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7917666e-e7a7-4c2e-b31d-08853be96ac9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1202 microversion: 2.1 time: 0.128621 Aug 29 16:09:53.034194 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3495/7212] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:52 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1202 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:53.193502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-959d48c8-1afd-41b3-992a-714743ba5892 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:53.196627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-959d48c8-1afd-41b3-992a-714743ba5892 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:53.204891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-959d48c8-1afd-41b3-992a-714743ba5892 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:53.205701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-959d48c8-1afd-41b3-992a-714743ba5892 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:53.206354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-959d48c8-1afd-41b3-992a-714743ba5892 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:53.207355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-959d48c8-1afd-41b3-992a-714743ba5892 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:53.208064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-959d48c8-1afd-41b3-992a-714743ba5892 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:53.208772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-959d48c8-1afd-41b3-992a-714743ba5892 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:53.296093 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-959d48c8-1afd-41b3-992a-714743ba5892 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "POST /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d/action" status: 200 len: 24569 microversion: 2.1 time: 0.108588 Aug 29 16:09:53.304208 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3718/7213] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:09:53 2022] POST /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d/action => generated 24569 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:09:54.054397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d42415e6-085d-439f-831f-968c38043606 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:54.055388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d42415e6-085d-439f-831f-968c38043606 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:54.062685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d42415e6-085d-439f-831f-968c38043606 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:54.063267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d42415e6-085d-439f-831f-968c38043606 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:54.063780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d42415e6-085d-439f-831f-968c38043606 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:54.064607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d42415e6-085d-439f-831f-968c38043606 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:54.065298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d42415e6-085d-439f-831f-968c38043606 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:54.065806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d42415e6-085d-439f-831f-968c38043606 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:54.153068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d42415e6-085d-439f-831f-968c38043606 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:54.161874 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d42415e6-085d-439f-831f-968c38043606 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1202 microversion: 2.1 time: 0.111617 Aug 29 16:09:54.162540 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3496/7214] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:54 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1202 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:55.184077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7396972c-f8b5-4a71-b29b-83039d787356 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:55.184811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7396972c-f8b5-4a71-b29b-83039d787356 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:55.193679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7396972c-f8b5-4a71-b29b-83039d787356 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:55.194190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7396972c-f8b5-4a71-b29b-83039d787356 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:55.194645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7396972c-f8b5-4a71-b29b-83039d787356 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:55.195370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7396972c-f8b5-4a71-b29b-83039d787356 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:55.195843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7396972c-f8b5-4a71-b29b-83039d787356 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:55.196281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7396972c-f8b5-4a71-b29b-83039d787356 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:55.274058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7396972c-f8b5-4a71-b29b-83039d787356 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:55.282098 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7396972c-f8b5-4a71-b29b-83039d787356 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 200 len: 1202 microversion: 2.1 time: 0.102892 Aug 29 16:09:55.282701 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3719/7215] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:55 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 1202 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:56.304288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3baeb8a3-00ce-4217-9415-b17e3c9e23cc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:56.305375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3baeb8a3-00ce-4217-9415-b17e3c9e23cc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:56.312832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3baeb8a3-00ce-4217-9415-b17e3c9e23cc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:56.313424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3baeb8a3-00ce-4217-9415-b17e3c9e23cc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:56.313956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3baeb8a3-00ce-4217-9415-b17e3c9e23cc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:56.314731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3baeb8a3-00ce-4217-9415-b17e3c9e23cc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:56.315412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3baeb8a3-00ce-4217-9415-b17e3c9e23cc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:56.315924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3baeb8a3-00ce-4217-9415-b17e3c9e23cc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:56.330187 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-3baeb8a3-00ce-4217-9415-b17e3c9e23cc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] HTTP exception thrown: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3baeb8a3-00ce-4217-9415-b17e3c9e23cc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Request method failure captured: Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 HTTP/1.1 Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOPVKb3AKf05JOTmVWxg_YSLh_6aJQ1fwERqtRCNq2OGA-TgfvjQkO776TgAknFFnCA3k1v6BcT_thZ3YV-DMceZELFHu1q-Z_h1mjuaQAa75Kym14h4m_K8QcmdN6yIk-IwhACLHvRJHqBNwAzk2eiJecAZxJFQO9-ZjVx01ZUPXeU Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_688ed04d399247f0ac8a204967cdfa2a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}] Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: f07d896c6764402999345759f2348080 Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'c1094df4-9ce0-4389-a24f-b0d65119a7f4'} Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:09:56.332211 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:09:56.336812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:56.336812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:09:56.336812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:09:56.336812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:09:56.336812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:09:56.336812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. Aug 29 16:09:56.336812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:09:56.336812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3baeb8a3-00ce-4217-9415-b17e3c9e23cc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Returning 404 to user: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:09:56.336812 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3baeb8a3-00ce-4217-9415-b17e3c9e23cc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 404 len: 111 microversion: 2.1 time: 0.033959 Aug 29 16:09:56.336812 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3497/7216] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:56 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:09:58.480459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-79f955bf-90af-4f13-8da9-c4cf8834bb9b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:58.481903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-79f955bf-90af-4f13-8da9-c4cf8834bb9b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:58.489612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79f955bf-90af-4f13-8da9-c4cf8834bb9b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:58.490133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79f955bf-90af-4f13-8da9-c4cf8834bb9b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:58.490651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79f955bf-90af-4f13-8da9-c4cf8834bb9b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:58.491443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79f955bf-90af-4f13-8da9-c4cf8834bb9b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:58.491935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79f955bf-90af-4f13-8da9-c4cf8834bb9b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:58.492384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-79f955bf-90af-4f13-8da9-c4cf8834bb9b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:58.509232 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-79f955bf-90af-4f13-8da9-c4cf8834bb9b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] HTTP exception thrown: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-79f955bf-90af-4f13-8da9-c4cf8834bb9b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Request method failure captured: Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e HTTP/1.1 Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOPVKb3AKf05JOTmVWxg_YSLh_6aJQ1fwERqtRCNq2OGA-TgfvjQkO776TgAknFFnCA3k1v6BcT_thZ3YV-DMceZELFHu1q-Z_h1mjuaQAa75Kym14h4m_K8QcmdN6yIk-IwhACLHvRJHqBNwAzk2eiJecAZxJFQO9-ZjVx01ZUPXeU Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_688ed04d399247f0ac8a204967cdfa2a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}] Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: f07d896c6764402999345759f2348080 Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '62e49ff7-4599-4df3-9cf3-90278816cd8e'} Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:09:58.511014 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:09:58.515727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. Aug 29 16:09:58.515727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:09:58.515727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:09:58.515727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:09:58.515727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:58.515727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:09:58.515727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:09:58.515727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:09:58.515727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:09:58.515727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. Aug 29 16:09:58.515727 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:09:58.515727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-79f955bf-90af-4f13-8da9-c4cf8834bb9b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Returning 404 to user: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:09:58.515727 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-79f955bf-90af-4f13-8da9-c4cf8834bb9b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "DELETE /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 404 len: 111 microversion: 2.1 time: 0.036326 Aug 29 16:09:58.515727 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3720/7217] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:09:58 2022] DELETE /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:09:58.522593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-76d0d0b9-be48-46dd-a678-72ef1ec834c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:58.523360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-76d0d0b9-be48-46dd-a678-72ef1ec834c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 62e49ff7-4599-4df3-9cf3-90278816cd8e] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:58.526377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:58.532482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76d0d0b9-be48-46dd-a678-72ef1ec834c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:58.533165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76d0d0b9-be48-46dd-a678-72ef1ec834c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:58.533691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76d0d0b9-be48-46dd-a678-72ef1ec834c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:58.534498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76d0d0b9-be48-46dd-a678-72ef1ec834c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:58.535041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76d0d0b9-be48-46dd-a678-72ef1ec834c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:58.535545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76d0d0b9-be48-46dd-a678-72ef1ec834c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:58.551751 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-76d0d0b9-be48-46dd-a678-72ef1ec834c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] HTTP exception thrown: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-76d0d0b9-be48-46dd-a678-72ef1ec834c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Request method failure captured: Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e HTTP/1.1 Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOPVKb3AKf05JOTmVWxg_YSLh_6aJQ1fwERqtRCNq2OGA-TgfvjQkO776TgAknFFnCA3k1v6BcT_thZ3YV-DMceZELFHu1q-Z_h1mjuaQAa75Kym14h4m_K8QcmdN6yIk-IwhACLHvRJHqBNwAzk2eiJecAZxJFQO9-ZjVx01ZUPXeU Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_688ed04d399247f0ac8a204967cdfa2a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}] Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: f07d896c6764402999345759f2348080 Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '62e49ff7-4599-4df3-9cf3-90278816cd8e'} Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:09:58.553615 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:09:58.558900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:58.558900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:09:58.558900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:09:58.558900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:09:58.558900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:09:58.558900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. Aug 29 16:09:58.558900 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:09:58.558900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-76d0d0b9-be48-46dd-a678-72ef1ec834c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Returning 404 to user: Instance 62e49ff7-4599-4df3-9cf3-90278816cd8e could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:09:58.558900 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-76d0d0b9-be48-46dd-a678-72ef1ec834c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e" status: 404 len: 111 microversion: 2.1 time: 0.037915 Aug 29 16:09:58.560382 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3498/7218] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:58 2022] GET /compute/v2.1/servers/62e49ff7-4599-4df3-9cf3-90278816cd8e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:09:59.116234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d765f47b-7a08-4b74-b4db-82d99808d75f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:59.116836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d765f47b-7a08-4b74-b4db-82d99808d75f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:59.123989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:59.125557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d765f47b-7a08-4b74-b4db-82d99808d75f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:59.126352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d765f47b-7a08-4b74-b4db-82d99808d75f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:59.126899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d765f47b-7a08-4b74-b4db-82d99808d75f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:59.128001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d765f47b-7a08-4b74-b4db-82d99808d75f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:59.128712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d765f47b-7a08-4b74-b4db-82d99808d75f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:59.129465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d765f47b-7a08-4b74-b4db-82d99808d75f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:59.151193 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-d765f47b-7a08-4b74-b4db-82d99808d75f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] HTTP exception thrown: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d765f47b-7a08-4b74-b4db-82d99808d75f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Request method failure captured: Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 HTTP/1.1 Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOPVKb3AKf05JOTmVWxg_YSLh_6aJQ1fwERqtRCNq2OGA-TgfvjQkO776TgAknFFnCA3k1v6BcT_thZ3YV-DMceZELFHu1q-Z_h1mjuaQAa75Kym14h4m_K8QcmdN6yIk-IwhACLHvRJHqBNwAzk2eiJecAZxJFQO9-ZjVx01ZUPXeU Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_688ed04d399247f0ac8a204967cdfa2a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}] Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: f07d896c6764402999345759f2348080 Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'c1094df4-9ce0-4389-a24f-b0d65119a7f4'} Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:09:59.152913 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:09:59.158941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. Aug 29 16:09:59.158941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:09:59.158941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:09:59.158941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:09:59.158941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:59.158941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:09:59.158941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:09:59.158941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:09:59.158941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:09:59.158941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. Aug 29 16:09:59.158941 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:09:59.158941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d765f47b-7a08-4b74-b4db-82d99808d75f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Returning 404 to user: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:09:59.158941 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d765f47b-7a08-4b74-b4db-82d99808d75f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 404 len: 111 microversion: 2.1 time: 0.044984 Aug 29 16:09:59.159864 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3721/7219] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:09:59 2022] DELETE /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:09:59.167184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-94eed145-e901-47ac-bfd9-933e86d5b0b8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:59.167884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-94eed145-e901-47ac-bfd9-933e86d5b0b8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: c1094df4-9ce0-4389-a24f-b0d65119a7f4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:59.174248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94eed145-e901-47ac-bfd9-933e86d5b0b8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:59.174813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94eed145-e901-47ac-bfd9-933e86d5b0b8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:59.175339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94eed145-e901-47ac-bfd9-933e86d5b0b8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:59.176132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94eed145-e901-47ac-bfd9-933e86d5b0b8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:59.176664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94eed145-e901-47ac-bfd9-933e86d5b0b8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:59.177221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94eed145-e901-47ac-bfd9-933e86d5b0b8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:59.191159 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-94eed145-e901-47ac-bfd9-933e86d5b0b8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] HTTP exception thrown: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-94eed145-e901-47ac-bfd9-933e86d5b0b8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Request method failure captured: Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 HTTP/1.1 Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOPVKb3AKf05JOTmVWxg_YSLh_6aJQ1fwERqtRCNq2OGA-TgfvjQkO776TgAknFFnCA3k1v6BcT_thZ3YV-DMceZELFHu1q-Z_h1mjuaQAa75Kym14h4m_K8QcmdN6yIk-IwhACLHvRJHqBNwAzk2eiJecAZxJFQO9-ZjVx01ZUPXeU Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_688ed04d399247f0ac8a204967cdfa2a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}] Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: f07d896c6764402999345759f2348080 Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'c1094df4-9ce0-4389-a24f-b0d65119a7f4'} Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:09:59.192780 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:09:59.197822 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:59.197822 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:09:59.197822 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:09:59.197822 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:09:59.197822 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:09:59.197822 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. Aug 29 16:09:59.197822 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:09:59.197822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-94eed145-e901-47ac-bfd9-933e86d5b0b8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Returning 404 to user: Instance c1094df4-9ce0-4389-a24f-b0d65119a7f4 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:09:59.197822 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-94eed145-e901-47ac-bfd9-933e86d5b0b8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4" status: 404 len: 111 microversion: 2.1 time: 0.031085 Aug 29 16:09:59.197822 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3499/7220] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:59 2022] GET /compute/v2.1/servers/c1094df4-9ce0-4389-a24f-b0d65119a7f4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:09:59.277610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bf7cb394-836a-4c68-9c93-0d9962f61996 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Action: 'create', calling method: .version_select at 0x7fc42a6799d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1233251043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp5VMKd2lj8I8okDs0Hk25xjGjIf5FWwGxjTZfQVkJVBOTm9him6F/nMtK02hw2ZFA9yrwlGwHvatLvreNqU0VrASDc0w8Zyh3xZLT0OypdYgsFJtbXlYdiA12fKqXePw=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:59.299449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-bf7cb394-836a-4c68-9c93-0d9962f61996 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:09:59.306401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-bf7cb394-836a-4c68-9c93-0d9962f61996 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for user f07d896c6764402999345759f2348080 and project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:09:59.333902 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bf7cb394-836a-4c68-9c93-0d9962f61996 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.060913 Aug 29 16:09:59.334545 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3722/7221] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:09:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:16.889202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1339266197", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1233251043", "security_groups": [{"name": "tempest-secgroup-smoke-1377313980"}], "block_device_mapping_v2": [{"uuid": "2e50ff76-3e7a-4da0-8478-6be7e6b7e5be", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "957b06a2-5b5b-41f0-883f-0990cab206d9"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:16.900876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:16.901672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=21 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:17.145621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] validate_networks() for [('957b06a2-5b5b-41f0-883f-0990cab206d9', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:10:17.550916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:10:17.551368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:10:17.551853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:10:17.552256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:10:17.552681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:10:17.562179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:17.562849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:17.563299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:17.564191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:17.564664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:17.565114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:17.583587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:10:17.589295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for user f07d896c6764402999345759f2348080 and project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:10:17.651756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:10:17.654160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e50ff76-3e7a-4da0-8478-6be7e6b7e5be',volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:10:17.794739 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8246fa39-ce24-4a2e-bd55-cd6425e7f23b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.909685 Aug 29 16:10:17.795550 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3500/7222] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:10:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:10:17.804206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=32 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:17.805371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:17.806279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:17.810978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f9579c7f-dc0c-40e7-9771-b15776699435 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:17.811626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f9579c7f-dc0c-40e7-9771-b15776699435 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:18.027056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f9579c7f-dc0c-40e7-9771-b15776699435 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:18.034671 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f9579c7f-dc0c-40e7-9771-b15776699435 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1095 microversion: 2.1 time: 0.232182 Aug 29 16:10:18.035230 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3723/7223] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:17 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1095 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:19.055536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-367acc2e-04a7-45ad-baef-db914e5576c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:19.056958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-367acc2e-04a7-45ad-baef-db914e5576c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:19.066253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-367acc2e-04a7-45ad-baef-db914e5576c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:19.067039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-367acc2e-04a7-45ad-baef-db914e5576c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:19.067685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-367acc2e-04a7-45ad-baef-db914e5576c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:19.068608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-367acc2e-04a7-45ad-baef-db914e5576c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:19.069277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-367acc2e-04a7-45ad-baef-db914e5576c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:19.069877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-367acc2e-04a7-45ad-baef-db914e5576c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:19.157328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-367acc2e-04a7-45ad-baef-db914e5576c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:19.172963 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-367acc2e-04a7-45ad-baef-db914e5576c1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1211 microversion: 2.1 time: 0.121256 Aug 29 16:10:19.183497 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3501/7224] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:19 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1211 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:20.194885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b0abf755-b9fd-4b48-b86b-d52006f2849d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:20.196672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b0abf755-b9fd-4b48-b86b-d52006f2849d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:20.206574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0abf755-b9fd-4b48-b86b-d52006f2849d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:20.207457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0abf755-b9fd-4b48-b86b-d52006f2849d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:20.208171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0abf755-b9fd-4b48-b86b-d52006f2849d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:20.209174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0abf755-b9fd-4b48-b86b-d52006f2849d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:20.209872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0abf755-b9fd-4b48-b86b-d52006f2849d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:20.210558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b0abf755-b9fd-4b48-b86b-d52006f2849d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:20.387350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b0abf755-b9fd-4b48-b86b-d52006f2849d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:20.402083 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b0abf755-b9fd-4b48-b86b-d52006f2849d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1279 microversion: 2.1 time: 0.211468 Aug 29 16:10:20.417583 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3724/7225] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:20 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1279 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:20.580555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-75925dfb-1881-4ae4-a1ab-f727f28048ce req-0965d3e4-502f-4167-83c9-d8d5b0199cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78a123e9-9e6e-4b33-8cfd-68c12107984b", "tag": "cafd7d97-6e19-40a5-ad38-86ec72ee7ae1"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:20.611436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-75925dfb-1881-4ae4-a1ab-f727f28048ce req-0965d3e4-502f-4167-83c9-d8d5b0199cf7 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:20.611993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-75925dfb-1881-4ae4-a1ab-f727f28048ce req-0965d3e4-502f-4167-83c9-d8d5b0199cf7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:20.612536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-75925dfb-1881-4ae4-a1ab-f727f28048ce req-0965d3e4-502f-4167-83c9-d8d5b0199cf7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:20.631029 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-75925dfb-1881-4ae4-a1ab-f727f28048ce req-0965d3e4-502f-4167-83c9-d8d5b0199cf7 service nova] Creating event network-changed:cafd7d97-6e19-40a5-ad38-86ec72ee7ae1 for instance 78a123e9-9e6e-4b33-8cfd-68c12107984b on n-h2-839401-11 Aug 29 16:10:20.639831 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-75925dfb-1881-4ae4-a1ab-f727f28048ce req-0965d3e4-502f-4167-83c9-d8d5b0199cf7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063730 Aug 29 16:10:20.643745 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3502/7226] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:21.426815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-70a8bb8d-bbb4-4d6f-9072-5f7a599553fc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:21.428040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-70a8bb8d-bbb4-4d6f-9072-5f7a599553fc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:21.436630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70a8bb8d-bbb4-4d6f-9072-5f7a599553fc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:21.437164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70a8bb8d-bbb4-4d6f-9072-5f7a599553fc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:21.437779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70a8bb8d-bbb4-4d6f-9072-5f7a599553fc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:21.438912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70a8bb8d-bbb4-4d6f-9072-5f7a599553fc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:21.439545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70a8bb8d-bbb4-4d6f-9072-5f7a599553fc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:21.440141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70a8bb8d-bbb4-4d6f-9072-5f7a599553fc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:21.592044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-70a8bb8d-bbb4-4d6f-9072-5f7a599553fc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:21.605388 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-70a8bb8d-bbb4-4d6f-9072-5f7a599553fc tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1279 microversion: 2.1 time: 0.183320 Aug 29 16:10:21.605996 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3725/7227] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:21 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1279 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:22.628032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-04c675a8-6bd1-46b8-b130-7809bb2c9486 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:22.628989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-04c675a8-6bd1-46b8-b130-7809bb2c9486 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:22.637000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04c675a8-6bd1-46b8-b130-7809bb2c9486 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:22.637523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04c675a8-6bd1-46b8-b130-7809bb2c9486 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:22.638065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04c675a8-6bd1-46b8-b130-7809bb2c9486 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:22.639007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04c675a8-6bd1-46b8-b130-7809bb2c9486 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:22.639465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04c675a8-6bd1-46b8-b130-7809bb2c9486 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:22.639898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-04c675a8-6bd1-46b8-b130-7809bb2c9486 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:22.799953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-04c675a8-6bd1-46b8-b130-7809bb2c9486 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:22.808571 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-04c675a8-6bd1-46b8-b130-7809bb2c9486 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1279 microversion: 2.1 time: 0.185325 Aug 29 16:10:22.809403 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3503/7228] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:22 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1279 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:23.830337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f77c7ce4-8d11-47a4-84e8-765bdf0fa0aa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:23.831169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f77c7ce4-8d11-47a4-84e8-765bdf0fa0aa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:23.839462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f77c7ce4-8d11-47a4-84e8-765bdf0fa0aa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:23.841041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f77c7ce4-8d11-47a4-84e8-765bdf0fa0aa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:23.841692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f77c7ce4-8d11-47a4-84e8-765bdf0fa0aa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:23.842709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f77c7ce4-8d11-47a4-84e8-765bdf0fa0aa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:23.843465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f77c7ce4-8d11-47a4-84e8-765bdf0fa0aa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:23.844564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f77c7ce4-8d11-47a4-84e8-765bdf0fa0aa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:24.006170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f77c7ce4-8d11-47a4-84e8-765bdf0fa0aa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:24.015010 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f77c7ce4-8d11-47a4-84e8-765bdf0fa0aa tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1279 microversion: 2.1 time: 0.189189 Aug 29 16:10:24.015599 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3726/7229] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:23 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:25.035372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d91607d1-c03c-4265-8777-c0bc23c40902 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:25.036896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d91607d1-c03c-4265-8777-c0bc23c40902 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:25.044013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d91607d1-c03c-4265-8777-c0bc23c40902 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:25.044858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d91607d1-c03c-4265-8777-c0bc23c40902 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:25.045647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d91607d1-c03c-4265-8777-c0bc23c40902 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:25.046500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d91607d1-c03c-4265-8777-c0bc23c40902 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:25.047064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d91607d1-c03c-4265-8777-c0bc23c40902 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:25.047560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d91607d1-c03c-4265-8777-c0bc23c40902 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:25.193408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d91607d1-c03c-4265-8777-c0bc23c40902 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:25.201777 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d91607d1-c03c-4265-8777-c0bc23c40902 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1267 microversion: 2.1 time: 0.170694 Aug 29 16:10:25.202430 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3504/7230] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:25 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:26.223000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c5c16181-3ebe-49f9-9b32-c7fdbab52183 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:26.223670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c5c16181-3ebe-49f9-9b32-c7fdbab52183 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:26.231184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5c16181-3ebe-49f9-9b32-c7fdbab52183 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:26.231684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5c16181-3ebe-49f9-9b32-c7fdbab52183 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:26.232193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5c16181-3ebe-49f9-9b32-c7fdbab52183 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:26.232992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5c16181-3ebe-49f9-9b32-c7fdbab52183 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:26.233548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5c16181-3ebe-49f9-9b32-c7fdbab52183 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:26.234015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5c16181-3ebe-49f9-9b32-c7fdbab52183 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:26.371208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c5c16181-3ebe-49f9-9b32-c7fdbab52183 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:26.380071 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c5c16181-3ebe-49f9-9b32-c7fdbab52183 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1267 microversion: 2.1 time: 0.160983 Aug 29 16:10:26.380690 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3727/7231] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:26 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:27.401642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dc757bc7-b6bc-48fa-af10-07184d785e95 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:27.402236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dc757bc7-b6bc-48fa-af10-07184d785e95 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:27.409179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc757bc7-b6bc-48fa-af10-07184d785e95 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:27.409680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc757bc7-b6bc-48fa-af10-07184d785e95 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:27.410126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc757bc7-b6bc-48fa-af10-07184d785e95 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:27.410847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc757bc7-b6bc-48fa-af10-07184d785e95 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:27.411306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc757bc7-b6bc-48fa-af10-07184d785e95 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:27.411738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc757bc7-b6bc-48fa-af10-07184d785e95 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:27.558026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dc757bc7-b6bc-48fa-af10-07184d785e95 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:27.566411 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dc757bc7-b6bc-48fa-af10-07184d785e95 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1267 microversion: 2.1 time: 0.168796 Aug 29 16:10:27.567208 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3505/7232] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:27 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:28.589952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-593dbfe2-f4a0-4c65-934d-9e7aea54bb67 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:28.593860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-593dbfe2-f4a0-4c65-934d-9e7aea54bb67 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:28.598463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:28.607354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-593dbfe2-f4a0-4c65-934d-9e7aea54bb67 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:28.607919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-593dbfe2-f4a0-4c65-934d-9e7aea54bb67 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:28.608353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-593dbfe2-f4a0-4c65-934d-9e7aea54bb67 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:28.609210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-593dbfe2-f4a0-4c65-934d-9e7aea54bb67 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:28.609714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-593dbfe2-f4a0-4c65-934d-9e7aea54bb67 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:28.610212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-593dbfe2-f4a0-4c65-934d-9e7aea54bb67 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:29.028679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-593dbfe2-f4a0-4c65-934d-9e7aea54bb67 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:29.037132 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-593dbfe2-f4a0-4c65-934d-9e7aea54bb67 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1267 microversion: 2.1 time: 0.453241 Aug 29 16:10:29.037718 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3728/7233] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:28 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1267 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:30.058621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-da3db633-52b1-4bb9-a6b5-93a4c964d07c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:30.059218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-da3db633-52b1-4bb9-a6b5-93a4c964d07c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:30.061299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:30.061976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:30.069209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da3db633-52b1-4bb9-a6b5-93a4c964d07c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:30.069686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da3db633-52b1-4bb9-a6b5-93a4c964d07c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:30.070125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da3db633-52b1-4bb9-a6b5-93a4c964d07c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:30.070882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da3db633-52b1-4bb9-a6b5-93a4c964d07c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:30.071347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da3db633-52b1-4bb9-a6b5-93a4c964d07c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:30.071765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da3db633-52b1-4bb9-a6b5-93a4c964d07c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:30.220012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-da3db633-52b1-4bb9-a6b5-93a4c964d07c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:30.228908 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-da3db633-52b1-4bb9-a6b5-93a4c964d07c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1267 microversion: 2.1 time: 0.174627 Aug 29 16:10:30.229577 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3506/7234] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:30 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:31.252403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2b9ccefe-fbb0-4b62-a452-0925fb7080dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:31.253013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2b9ccefe-fbb0-4b62-a452-0925fb7080dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:31.260598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b9ccefe-fbb0-4b62-a452-0925fb7080dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:31.261133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b9ccefe-fbb0-4b62-a452-0925fb7080dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:31.261691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b9ccefe-fbb0-4b62-a452-0925fb7080dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:31.262442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b9ccefe-fbb0-4b62-a452-0925fb7080dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:31.262912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b9ccefe-fbb0-4b62-a452-0925fb7080dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:31.263351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2b9ccefe-fbb0-4b62-a452-0925fb7080dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:31.405877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2b9ccefe-fbb0-4b62-a452-0925fb7080dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:31.414935 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2b9ccefe-fbb0-4b62-a452-0925fb7080dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1267 microversion: 2.1 time: 0.166528 Aug 29 16:10:31.415520 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3729/7235] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:31 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:32.436798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1b02f8f9-3b95-44ec-9df6-840a6f9ade19 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:32.437420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1b02f8f9-3b95-44ec-9df6-840a6f9ade19 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:32.445629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b02f8f9-3b95-44ec-9df6-840a6f9ade19 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:32.446130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b02f8f9-3b95-44ec-9df6-840a6f9ade19 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:32.446806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b02f8f9-3b95-44ec-9df6-840a6f9ade19 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:32.447552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b02f8f9-3b95-44ec-9df6-840a6f9ade19 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:32.448028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b02f8f9-3b95-44ec-9df6-840a6f9ade19 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:32.448738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b02f8f9-3b95-44ec-9df6-840a6f9ade19 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:32.460397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-12801f84-58fb-47b2-805e-d80d72cb3919 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:32.464918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-12801f84-58fb-47b2-805e-d80d72cb3919 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:32.477248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12801f84-58fb-47b2-805e-d80d72cb3919 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:32.477901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12801f84-58fb-47b2-805e-d80d72cb3919 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:32.478341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12801f84-58fb-47b2-805e-d80d72cb3919 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:32.479225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12801f84-58fb-47b2-805e-d80d72cb3919 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:32.479693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12801f84-58fb-47b2-805e-d80d72cb3919 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:32.480528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12801f84-58fb-47b2-805e-d80d72cb3919 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:32.554391 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-12801f84-58fb-47b2-805e-d80d72cb3919 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "POST /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d/action" status: 200 len: 32640 microversion: 2.1 time: 0.099058 Aug 29 16:10:32.555514 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3730/7236] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:10:32 2022] POST /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d/action => generated 32640 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 16:10:32.846717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1b02f8f9-3b95-44ec-9df6-840a6f9ade19 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:32.856624 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1b02f8f9-3b95-44ec-9df6-840a6f9ade19 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1267 microversion: 2.1 time: 0.424057 Aug 29 16:10:32.861480 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3507/7237] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:32 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1267 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:33.623783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-70dea6df-b343-4048-969d-09ac187ba1a4 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:33.624411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-70dea6df-b343-4048-969d-09ac187ba1a4 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:33.632495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70dea6df-b343-4048-969d-09ac187ba1a4 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:33.633012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70dea6df-b343-4048-969d-09ac187ba1a4 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:33.633535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70dea6df-b343-4048-969d-09ac187ba1a4 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:33.634264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70dea6df-b343-4048-969d-09ac187ba1a4 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:33.634746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70dea6df-b343-4048-969d-09ac187ba1a4 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:33.635188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70dea6df-b343-4048-969d-09ac187ba1a4 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:33.663846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-70dea6df-b343-4048-969d-09ac187ba1a4 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:10:33.718436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-49f10981-25d2-4ecc-816e-13abf04681ce req-4f23e297-601f-4dc9-bee5-a4fcd0fade0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcb0c4b7-071f-4988-93f8-25e896c4133d", "tag": "b1511c51-70dc-43ae-8b29-03c66dbc86a4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:33.732013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-49f10981-25d2-4ecc-816e-13abf04681ce req-4f23e297-601f-4dc9-bee5-a4fcd0fade0b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:33.732776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-49f10981-25d2-4ecc-816e-13abf04681ce req-4f23e297-601f-4dc9-bee5-a4fcd0fade0b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:33.733666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-49f10981-25d2-4ecc-816e-13abf04681ce req-4f23e297-601f-4dc9-bee5-a4fcd0fade0b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:33.758381 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-49f10981-25d2-4ecc-816e-13abf04681ce req-4f23e297-601f-4dc9-bee5-a4fcd0fade0b service nova] Creating event network-changed:b1511c51-70dc-43ae-8b29-03c66dbc86a4 for instance fcb0c4b7-071f-4988-93f8-25e896c4133d on n-h2-839401-11 Aug 29 16:10:33.758665 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-70dea6df-b343-4048-969d-09ac187ba1a4 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "DELETE /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 204 len: 0 microversion: 2.1 time: 0.139206 Aug 29 16:10:33.762396 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3731/7238] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:10:33 2022] DELETE /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:10:33.767884 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-49f10981-25d2-4ecc-816e-13abf04681ce req-4f23e297-601f-4dc9-bee5-a4fcd0fade0b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146261 Aug 29 16:10:33.768977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dcf4d867-a49b-4850-8b66-a29a744e0c7e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:33.769462 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3508/7239] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:33.769928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dcf4d867-a49b-4850-8b66-a29a744e0c7e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:33.781305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcf4d867-a49b-4850-8b66-a29a744e0c7e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:33.781821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcf4d867-a49b-4850-8b66-a29a744e0c7e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:33.782272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcf4d867-a49b-4850-8b66-a29a744e0c7e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:33.783023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcf4d867-a49b-4850-8b66-a29a744e0c7e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:33.783495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcf4d867-a49b-4850-8b66-a29a744e0c7e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:33.783939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcf4d867-a49b-4850-8b66-a29a744e0c7e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:33.883490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dda0af0c-d8a9-491e-a52b-d113ddd106c5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:33.884269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dda0af0c-d8a9-491e-a52b-d113ddd106c5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:33.892423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dda0af0c-d8a9-491e-a52b-d113ddd106c5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:33.893194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dda0af0c-d8a9-491e-a52b-d113ddd106c5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:33.893842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dda0af0c-d8a9-491e-a52b-d113ddd106c5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:33.894737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dda0af0c-d8a9-491e-a52b-d113ddd106c5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:33.895372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dda0af0c-d8a9-491e-a52b-d113ddd106c5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:33.895976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dda0af0c-d8a9-491e-a52b-d113ddd106c5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:33.943119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dcf4d867-a49b-4850-8b66-a29a744e0c7e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:33.952775 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dcf4d867-a49b-4850-8b66-a29a744e0c7e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1670 microversion: 2.1 time: 0.188682 Aug 29 16:10:33.954272 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3732/7240] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:33 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1670 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:34.055030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dda0af0c-d8a9-491e-a52b-d113ddd106c5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:34.064139 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dda0af0c-d8a9-491e-a52b-d113ddd106c5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1267 microversion: 2.1 time: 0.187850 Aug 29 16:10:34.069134 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3509/7241] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:33 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:34.975845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c0a2e556-ec4a-4977-9bc1-37b4a75f3f65 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:34.977250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c0a2e556-ec4a-4977-9bc1-37b4a75f3f65 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:34.985757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a2e556-ec4a-4977-9bc1-37b4a75f3f65 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:34.986593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a2e556-ec4a-4977-9bc1-37b4a75f3f65 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:34.987228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a2e556-ec4a-4977-9bc1-37b4a75f3f65 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:34.988210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a2e556-ec4a-4977-9bc1-37b4a75f3f65 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:34.988885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a2e556-ec4a-4977-9bc1-37b4a75f3f65 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:34.989566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0a2e556-ec4a-4977-9bc1-37b4a75f3f65 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:35.084981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-874e1455-f929-4045-bfe5-9da142dbaba9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:35.085886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-874e1455-f929-4045-bfe5-9da142dbaba9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:35.093338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-874e1455-f929-4045-bfe5-9da142dbaba9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:35.093838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-874e1455-f929-4045-bfe5-9da142dbaba9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:35.094280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-874e1455-f929-4045-bfe5-9da142dbaba9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:35.095000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-874e1455-f929-4045-bfe5-9da142dbaba9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:35.099196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-874e1455-f929-4045-bfe5-9da142dbaba9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:35.099876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-874e1455-f929-4045-bfe5-9da142dbaba9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:35.175657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c0a2e556-ec4a-4977-9bc1-37b4a75f3f65 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:35.183861 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c0a2e556-ec4a-4977-9bc1-37b4a75f3f65 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1670 microversion: 2.1 time: 0.212281 Aug 29 16:10:35.184725 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3733/7242] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:34 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1670 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:35.280036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-874e1455-f929-4045-bfe5-9da142dbaba9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:35.294388 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-874e1455-f929-4045-bfe5-9da142dbaba9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1267 microversion: 2.1 time: 0.213185 Aug 29 16:10:35.295655 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3510/7243] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:35 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:35.478062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-efff441f-0460-45c5-9883-f5fc65b8b83c req-912e18df-1a43-4258-aa95-e840b83ec103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a123e9-9e6e-4b33-8cfd-68c12107984b", "name": "network-vif-plugged", "status": "completed", "tag": "cafd7d97-6e19-40a5-ad38-86ec72ee7ae1"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:35.491131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-efff441f-0460-45c5-9883-f5fc65b8b83c req-912e18df-1a43-4258-aa95-e840b83ec103 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:35.491758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-efff441f-0460-45c5-9883-f5fc65b8b83c req-912e18df-1a43-4258-aa95-e840b83ec103 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:35.492312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-efff441f-0460-45c5-9883-f5fc65b8b83c req-912e18df-1a43-4258-aa95-e840b83ec103 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:35.505950 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-efff441f-0460-45c5-9883-f5fc65b8b83c req-912e18df-1a43-4258-aa95-e840b83ec103 service nova] Creating event network-vif-plugged:cafd7d97-6e19-40a5-ad38-86ec72ee7ae1 for instance 78a123e9-9e6e-4b33-8cfd-68c12107984b on n-h2-839401-11 Aug 29 16:10:35.512003 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-efff441f-0460-45c5-9883-f5fc65b8b83c req-912e18df-1a43-4258-aa95-e840b83ec103 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042652 Aug 29 16:10:35.513539 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3734/7244] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:36.206097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb70435d-21ec-479d-bb7a-b9589859d911 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:36.206835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bb70435d-21ec-479d-bb7a-b9589859d911 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:36.223697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb70435d-21ec-479d-bb7a-b9589859d911 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:36.226537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb70435d-21ec-479d-bb7a-b9589859d911 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:36.227441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb70435d-21ec-479d-bb7a-b9589859d911 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:36.228541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb70435d-21ec-479d-bb7a-b9589859d911 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:36.229304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb70435d-21ec-479d-bb7a-b9589859d911 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:36.229778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb70435d-21ec-479d-bb7a-b9589859d911 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:36.315989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-50873a1b-27b1-48e3-92e3-d7bccf61dc1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:36.316664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-50873a1b-27b1-48e3-92e3-d7bccf61dc1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:36.323420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50873a1b-27b1-48e3-92e3-d7bccf61dc1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:36.324182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50873a1b-27b1-48e3-92e3-d7bccf61dc1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:36.324884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50873a1b-27b1-48e3-92e3-d7bccf61dc1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:36.325912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50873a1b-27b1-48e3-92e3-d7bccf61dc1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:36.326569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50873a1b-27b1-48e3-92e3-d7bccf61dc1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:36.327175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50873a1b-27b1-48e3-92e3-d7bccf61dc1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:36.459904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bb70435d-21ec-479d-bb7a-b9589859d911 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:36.473322 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bb70435d-21ec-479d-bb7a-b9589859d911 tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1552 microversion: 2.1 time: 0.271211 Aug 29 16:10:36.473926 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3511/7245] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:36 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1552 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:36.498687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-50873a1b-27b1-48e3-92e3-d7bccf61dc1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:36.508018 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-50873a1b-27b1-48e3-92e3-d7bccf61dc1d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1267 microversion: 2.1 time: 0.196727 Aug 29 16:10:36.508872 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3735/7246] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:36 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:36.740466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-968293b7-5b38-4cbd-a919-b27c63ed0e3c req-86c30933-d6b1-4922-9560-91721549aa22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcb0c4b7-071f-4988-93f8-25e896c4133d", "name": "network-vif-deleted", "tag": "b1511c51-70dc-43ae-8b29-03c66dbc86a4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:36.753692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-968293b7-5b38-4cbd-a919-b27c63ed0e3c req-86c30933-d6b1-4922-9560-91721549aa22 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:36.754188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-968293b7-5b38-4cbd-a919-b27c63ed0e3c req-86c30933-d6b1-4922-9560-91721549aa22 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:36.754623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-968293b7-5b38-4cbd-a919-b27c63ed0e3c req-86c30933-d6b1-4922-9560-91721549aa22 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:36.769748 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-968293b7-5b38-4cbd-a919-b27c63ed0e3c req-86c30933-d6b1-4922-9560-91721549aa22 service nova] Creating event network-vif-deleted:b1511c51-70dc-43ae-8b29-03c66dbc86a4 for instance fcb0c4b7-071f-4988-93f8-25e896c4133d on n-h2-839401-11 Aug 29 16:10:36.776574 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-968293b7-5b38-4cbd-a919-b27c63ed0e3c req-86c30933-d6b1-4922-9560-91721549aa22 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039903 Aug 29 16:10:36.781456 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3512/7247] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:10:37.495044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1dcd9ef9-2b84-4bed-991b-8f13df4f9bfc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:37.495676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1dcd9ef9-2b84-4bed-991b-8f13df4f9bfc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:37.513279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1dcd9ef9-2b84-4bed-991b-8f13df4f9bfc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:37.513896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1dcd9ef9-2b84-4bed-991b-8f13df4f9bfc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:37.514184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1dcd9ef9-2b84-4bed-991b-8f13df4f9bfc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:37.515056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1dcd9ef9-2b84-4bed-991b-8f13df4f9bfc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:37.515656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1dcd9ef9-2b84-4bed-991b-8f13df4f9bfc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:37.522628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1dcd9ef9-2b84-4bed-991b-8f13df4f9bfc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:37.532554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eba78ef2-5004-4cb9-a3c8-b8cae5c4c7fb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:37.533518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eba78ef2-5004-4cb9-a3c8-b8cae5c4c7fb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:37.542752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eba78ef2-5004-4cb9-a3c8-b8cae5c4c7fb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:37.543376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eba78ef2-5004-4cb9-a3c8-b8cae5c4c7fb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:37.544333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eba78ef2-5004-4cb9-a3c8-b8cae5c4c7fb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:37.546032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eba78ef2-5004-4cb9-a3c8-b8cae5c4c7fb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:37.546683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eba78ef2-5004-4cb9-a3c8-b8cae5c4c7fb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:37.547380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eba78ef2-5004-4cb9-a3c8-b8cae5c4c7fb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:37.562833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1dcd9ef9-2b84-4bed-991b-8f13df4f9bfc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:37.563563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1dcd9ef9-2b84-4bed-991b-8f13df4f9bfc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:37.564172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1dcd9ef9-2b84-4bed-991b-8f13df4f9bfc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:37.564790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-1dcd9ef9-2b84-4bed-991b-8f13df4f9bfc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lazy-loading 'fault' on Instance uuid fcb0c4b7-071f-4988-93f8-25e896c4133d {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:10:37.630690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1dcd9ef9-2b84-4bed-991b-8f13df4f9bfc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d56709bf4c41eeb6e15bcdfd140999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a8f9ddd384ca2bcdacb55b92006d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:37.639238 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1dcd9ef9-2b84-4bed-991b-8f13df4f9bfc tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 200 len: 1338 microversion: 2.1 time: 0.148310 Aug 29 16:10:37.655604 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3736/7248] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:37 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 1338 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:37.741813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eba78ef2-5004-4cb9-a3c8-b8cae5c4c7fb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:37.751034 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eba78ef2-5004-4cb9-a3c8-b8cae5c4c7fb tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1455 microversion: 2.1 time: 0.223481 Aug 29 16:10:37.751657 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3513/7249] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:37 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1455 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:37.771147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1faeb5f9-4cfc-4515-8fac-8b802bd8de5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:37.771818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1faeb5f9-4cfc-4515-8fac-8b802bd8de5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:37.778475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1faeb5f9-4cfc-4515-8fac-8b802bd8de5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:37.779023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1faeb5f9-4cfc-4515-8fac-8b802bd8de5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:37.779681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1faeb5f9-4cfc-4515-8fac-8b802bd8de5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:37.780548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1faeb5f9-4cfc-4515-8fac-8b802bd8de5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:37.781332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1faeb5f9-4cfc-4515-8fac-8b802bd8de5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:37.781800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1faeb5f9-4cfc-4515-8fac-8b802bd8de5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:37.939818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1faeb5f9-4cfc-4515-8fac-8b802bd8de5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:37.949828 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1faeb5f9-4cfc-4515-8fac-8b802bd8de5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1455 microversion: 2.1 time: 0.182480 Aug 29 16:10:37.950335 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3737/7250] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:37 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1455 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:38.664204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-11fc558a-b5df-4508-9819-b5c04851437c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:38.665581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-11fc558a-b5df-4508-9819-b5c04851437c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] [instance: fcb0c4b7-071f-4988-93f8-25e896c4133d] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:38.674364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11fc558a-b5df-4508-9819-b5c04851437c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:38.675557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11fc558a-b5df-4508-9819-b5c04851437c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:38.676232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11fc558a-b5df-4508-9819-b5c04851437c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:38.676966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11fc558a-b5df-4508-9819-b5c04851437c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:38.680158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11fc558a-b5df-4508-9819-b5c04851437c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:38.680647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11fc558a-b5df-4508-9819-b5c04851437c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:38.695249 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-11fc558a-b5df-4508-9819-b5c04851437c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] HTTP exception thrown: Instance fcb0c4b7-071f-4988-93f8-25e896c4133d could not be found. Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-11fc558a-b5df-4508-9819-b5c04851437c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Request method failure captured: Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d HTTP/1.1 Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOPr44R9z576F5E1d-USYwU1PbIFlpFQAwv-Lo_2zGvPYKWa3vKoxMA2WGcHxbw831FwCjScDG3XbBeWWc9aTxSlqqxsveSnR4R0oeIFQunvxkO4O_OI8Y3OUCZt6qlmkCCT06apMRiuq3TXxgQ5EkG2rnBj1gc_Ma_fTxYGOy4Uw-A Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: dc8a8f9ddd384ca2bcdacb55b92006d9 Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestNetworkBasicOps-2055818920 Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_dc8a8f9ddd384ca2bcdacb55b92006d9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/dc8a8f9ddd384ca2bcdacb55b92006d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc8a8f9ddd384ca2bcdacb55b92006d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/dc8a8f9ddd384ca2bcdacb55b92006d9"}]}] Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestNetworkBasicOps-2055818920 Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: dc8a8f9ddd384ca2bcdacb55b92006d9 Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestNetworkBasicOps-2055818920 Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestNetworkBasicOps-2055818920-project Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: e2d56709bf4c41eeb6e15bcdfd140999 Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestNetworkBasicOps-2055818920-project Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance fcb0c4b7-071f-4988-93f8-25e896c4133d could not be found. Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'fcb0c4b7-071f-4988-93f8-25e896c4133d'} Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcb0c4b7-071f-4988-93f8-25e896c4133d could not be found. Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcb0c4b7-071f-4988-93f8-25e896c4133d could not be found. Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:10:38.697556 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:10:38.706163 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:38.706163 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:10:38.706163 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:10:38.706163 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:10:38.706163 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:10:38.706163 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcb0c4b7-071f-4988-93f8-25e896c4133d could not be found. Aug 29 16:10:38.706163 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:10:38.706163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-11fc558a-b5df-4508-9819-b5c04851437c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Returning 404 to user: Instance fcb0c4b7-071f-4988-93f8-25e896c4133d could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:10:38.706163 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-11fc558a-b5df-4508-9819-b5c04851437c tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d" status: 404 len: 111 microversion: 2.1 time: 0.040734 Aug 29 16:10:38.706163 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3514/7251] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:38 2022] GET /compute/v2.1/servers/fcb0c4b7-071f-4988-93f8-25e896c4133d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:10:38.956988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c155a477-ef33-4148-b34f-e255248bc78e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] Calling method '.version_select at 0x7fc42a72f0d0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:38.989833 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c155a477-ef33-4148-b34f-e255248bc78e tempest-TestNetworkBasicOps-2055818920 tempest-TestNetworkBasicOps-2055818920-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1721457566" status: 202 len: 0 microversion: 2.1 time: 0.033555 Aug 29 16:10:38.994189 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3738/7252] 10.222.0.62 () {58 vars in 1257 bytes} [Mon Aug 29 16:10:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1721457566 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:10:39.878512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-7edc3f72-3818-4d59-aa24-bff23faa0d31 req-246644fb-f167-48b3-ad03-8274a1765c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78a123e9-9e6e-4b33-8cfd-68c12107984b", "tag": "cafd7d97-6e19-40a5-ad38-86ec72ee7ae1"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:39.892095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7edc3f72-3818-4d59-aa24-bff23faa0d31 req-246644fb-f167-48b3-ad03-8274a1765c57 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:39.892853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7edc3f72-3818-4d59-aa24-bff23faa0d31 req-246644fb-f167-48b3-ad03-8274a1765c57 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:39.893556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7edc3f72-3818-4d59-aa24-bff23faa0d31 req-246644fb-f167-48b3-ad03-8274a1765c57 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:39.905326 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-7edc3f72-3818-4d59-aa24-bff23faa0d31 req-246644fb-f167-48b3-ad03-8274a1765c57 service nova] Creating event network-changed:cafd7d97-6e19-40a5-ad38-86ec72ee7ae1 for instance 78a123e9-9e6e-4b33-8cfd-68c12107984b on n-h2-839401-11 Aug 29 16:10:39.910440 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-7edc3f72-3818-4d59-aa24-bff23faa0d31 req-246644fb-f167-48b3-ad03-8274a1765c57 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035582 Aug 29 16:10:39.911537 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3515/7253] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:40.628076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5d721e7f-7b46-4fd9-b610-02dd630f2eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:40.628649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5d721e7f-7b46-4fd9-b610-02dd630f2eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:40.638647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d721e7f-7b46-4fd9-b610-02dd630f2eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:40.639180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d721e7f-7b46-4fd9-b610-02dd630f2eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:40.639646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d721e7f-7b46-4fd9-b610-02dd630f2eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:40.640579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d721e7f-7b46-4fd9-b610-02dd630f2eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:40.641290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d721e7f-7b46-4fd9-b610-02dd630f2eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:40.641745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d721e7f-7b46-4fd9-b610-02dd630f2eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:40.744088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-5d721e7f-7b46-4fd9-b610-02dd630f2eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lazy-loading 'services' on Instance uuid 0bf97cbe-89d3-4bde-b683-9ae85af91277 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:10:40.832851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:40.841239 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5d721e7f-7b46-4fd9-b610-02dd630f2eb8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277/os-volume_attachments/2a89f556-37b7-4251-8793-c615f7ca89a6" status: 202 len: 0 microversion: 2.1 time: 0.219876 Aug 29 16:10:40.842356 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3739/7254] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 16:10:40 2022] DELETE /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277/os-volume_attachments/2a89f556-37b7-4251-8793-c615f7ca89a6 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:10:46.282018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-614042c3-8511-4699-9da1-2eae047fe0fa tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:46.282627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-614042c3-8511-4699-9da1-2eae047fe0fa tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:46.290782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-614042c3-8511-4699-9da1-2eae047fe0fa tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:46.291286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-614042c3-8511-4699-9da1-2eae047fe0fa tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:46.291760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-614042c3-8511-4699-9da1-2eae047fe0fa tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:46.292514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-614042c3-8511-4699-9da1-2eae047fe0fa tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:46.293065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-614042c3-8511-4699-9da1-2eae047fe0fa tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:46.293521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-614042c3-8511-4699-9da1-2eae047fe0fa tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:46.321179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-614042c3-8511-4699-9da1-2eae047fe0fa tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:10:46.401541 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-614042c3-8511-4699-9da1-2eae047fe0fa tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 204 len: 0 microversion: 2.1 time: 0.124516 Aug 29 16:10:46.402111 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3516/7255] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:10:46 2022] DELETE /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:10:46.412662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b570a73e-32e5-4b21-bfa0-015719a11068 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:46.413498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b570a73e-32e5-4b21-bfa0-015719a11068 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:46.420725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b570a73e-32e5-4b21-bfa0-015719a11068 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:46.421259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b570a73e-32e5-4b21-bfa0-015719a11068 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:46.421739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b570a73e-32e5-4b21-bfa0-015719a11068 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:46.422455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b570a73e-32e5-4b21-bfa0-015719a11068 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:46.422925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b570a73e-32e5-4b21-bfa0-015719a11068 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:46.423364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b570a73e-32e5-4b21-bfa0-015719a11068 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:46.646425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b570a73e-32e5-4b21-bfa0-015719a11068 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313da30c6d4d8c8c675a8ac0c5e0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cc430424134758ad6d727bf22ff55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:46.655546 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b570a73e-32e5-4b21-bfa0-015719a11068 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 200 len: 1469 microversion: 2.1 time: 0.248527 Aug 29 16:10:46.656144 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3740/7256] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:46 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 1469 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:47.679173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-14f52a2f-074d-4bc1-a6fb-6bde81a35d21 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:47.680124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-14f52a2f-074d-4bc1-a6fb-6bde81a35d21 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:47.683220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:47.698014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14f52a2f-074d-4bc1-a6fb-6bde81a35d21 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:47.699192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14f52a2f-074d-4bc1-a6fb-6bde81a35d21 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:47.700522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14f52a2f-074d-4bc1-a6fb-6bde81a35d21 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:47.701518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14f52a2f-074d-4bc1-a6fb-6bde81a35d21 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:47.702204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14f52a2f-074d-4bc1-a6fb-6bde81a35d21 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:47.702855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-14f52a2f-074d-4bc1-a6fb-6bde81a35d21 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:47.730172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:47.995302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-14f52a2f-074d-4bc1-a6fb-6bde81a35d21 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313da30c6d4d8c8c675a8ac0c5e0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cc430424134758ad6d727bf22ff55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:48.004359 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-14f52a2f-074d-4bc1-a6fb-6bde81a35d21 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 200 len: 1469 microversion: 2.1 time: 0.330465 Aug 29 16:10:48.012695 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3517/7257] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:47 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 1469 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:49.026743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7eea4d9d-64d9-45df-935c-0a3541ae834b tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:49.028417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7eea4d9d-64d9-45df-935c-0a3541ae834b tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:49.036646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:49.038546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eea4d9d-64d9-45df-935c-0a3541ae834b tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:49.039277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eea4d9d-64d9-45df-935c-0a3541ae834b tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:49.039990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eea4d9d-64d9-45df-935c-0a3541ae834b tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:49.040909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eea4d9d-64d9-45df-935c-0a3541ae834b tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:49.041582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eea4d9d-64d9-45df-935c-0a3541ae834b tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:49.042192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eea4d9d-64d9-45df-935c-0a3541ae834b tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:49.208406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7eea4d9d-64d9-45df-935c-0a3541ae834b tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313da30c6d4d8c8c675a8ac0c5e0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cc430424134758ad6d727bf22ff55f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:49.217115 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7eea4d9d-64d9-45df-935c-0a3541ae834b tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 200 len: 1469 microversion: 2.1 time: 0.194837 Aug 29 16:10:49.219045 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3741/7258] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:49 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 1469 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:49.457272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-1229642a-927e-41ef-880d-6eb97f758fe4 req-8a6bcb94-30b4-4d4d-8b48-d5ada4f0427a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf97cbe-89d3-4bde-b683-9ae85af91277", "name": "network-vif-deleted", "tag": "ff14074a-dcaf-4ea8-9cba-6187b25bf9df"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:49.472144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1229642a-927e-41ef-880d-6eb97f758fe4 req-8a6bcb94-30b4-4d4d-8b48-d5ada4f0427a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:49.472866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1229642a-927e-41ef-880d-6eb97f758fe4 req-8a6bcb94-30b4-4d4d-8b48-d5ada4f0427a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:49.473542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1229642a-927e-41ef-880d-6eb97f758fe4 req-8a6bcb94-30b4-4d4d-8b48-d5ada4f0427a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:49.487433 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-1229642a-927e-41ef-880d-6eb97f758fe4 req-8a6bcb94-30b4-4d4d-8b48-d5ada4f0427a service nova] Creating event network-vif-deleted:ff14074a-dcaf-4ea8-9cba-6187b25bf9df for instance 0bf97cbe-89d3-4bde-b683-9ae85af91277 on n-h1-839401-11 Aug 29 16:10:49.492414 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-1229642a-927e-41ef-880d-6eb97f758fe4 req-8a6bcb94-30b4-4d4d-8b48-d5ada4f0427a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040607 Aug 29 16:10:49.493138 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3518/7259] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:10:50.238172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d35fbf16-f768-475a-afd1-f66b6d0532b8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:50.239428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d35fbf16-f768-475a-afd1-f66b6d0532b8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] [instance: 0bf97cbe-89d3-4bde-b683-9ae85af91277] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:50.247120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d35fbf16-f768-475a-afd1-f66b6d0532b8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:50.247688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d35fbf16-f768-475a-afd1-f66b6d0532b8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:50.258962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d35fbf16-f768-475a-afd1-f66b6d0532b8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:50.260505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d35fbf16-f768-475a-afd1-f66b6d0532b8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:50.261489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d35fbf16-f768-475a-afd1-f66b6d0532b8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:50.262387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d35fbf16-f768-475a-afd1-f66b6d0532b8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:50.285518 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-d35fbf16-f768-475a-afd1-f66b6d0532b8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] HTTP exception thrown: Instance 0bf97cbe-89d3-4bde-b683-9ae85af91277 could not be found. Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d35fbf16-f768-475a-afd1-f66b6d0532b8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Request method failure captured: Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 HTTP/1.1 Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOSrg-Ut073gXSUSMpqyZ6qOTnKRdKV7JRn7PQ0mzFQi_KcoMDPd9vnUCTS-iU-2ZxijU1saKTZ84BZ3uo9iCUDftzYqSP4JAU-N3s32eKcVp0N3DXnxZ1Q-RQNoZMk7y76fNLxFkYYKFL4xBcfq9W66CxCbwkiHSpXk9fhk3OGyFQA Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 40cc430424134758ad6d727bf22ff55f Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-VolumesBackupsTest-1140477412 Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_40cc430424134758ad6d727bf22ff55f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/40cc430424134758ad6d727bf22ff55f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/40cc430424134758ad6d727bf22ff55f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/40cc430424134758ad6d727bf22ff55f"}]}] Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-VolumesBackupsTest-1140477412 Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 40cc430424134758ad6d727bf22ff55f Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-VolumesBackupsTest-1140477412 Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-VolumesBackupsTest-1140477412-project Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 28313da30c6d4d8c8c675a8ac0c5e0bb Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-VolumesBackupsTest-1140477412-project Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 0bf97cbe-89d3-4bde-b683-9ae85af91277 could not be found. Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '0bf97cbe-89d3-4bde-b683-9ae85af91277'} Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bf97cbe-89d3-4bde-b683-9ae85af91277 could not be found. Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf97cbe-89d3-4bde-b683-9ae85af91277 could not be found. Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:10:50.287590 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:10:50.293021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:50.293021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:10:50.293021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:10:50.293021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:10:50.293021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:10:50.293021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf97cbe-89d3-4bde-b683-9ae85af91277 could not be found. Aug 29 16:10:50.293021 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:10:50.295303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d35fbf16-f768-475a-afd1-f66b6d0532b8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] Returning 404 to user: Instance 0bf97cbe-89d3-4bde-b683-9ae85af91277 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:10:50.296200 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d35fbf16-f768-475a-afd1-f66b6d0532b8 tempest-VolumesBackupsTest-1140477412 tempest-VolumesBackupsTest-1140477412-project] 10.222.0.62 "GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277" status: 404 len: 111 microversion: 2.1 time: 0.062058 Aug 29 16:10:50.296763 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3742/7260] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:50 2022] GET /compute/v2.1/servers/0bf97cbe-89d3-4bde-b683-9ae85af91277 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:12:37.424321 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eda7f439-560f-4fda-a0c4-47b93d5f6cfd] AMQP server on 10.222.0.62:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 16:12:37.425305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:37.426173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=7 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:37.428124 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:12:37.428316 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 16:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b (ip 10.222.0.62) !!! Aug 29 16:12:37.617027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-17024c63-a8cd-4cf0-a81d-0eca8aadcb8d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:37.617701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-17024c63-a8cd-4cf0-a81d-0eca8aadcb8d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:37.624590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17024c63-a8cd-4cf0-a81d-0eca8aadcb8d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:37.625121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17024c63-a8cd-4cf0-a81d-0eca8aadcb8d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:37.625582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17024c63-a8cd-4cf0-a81d-0eca8aadcb8d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:37.626338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17024c63-a8cd-4cf0-a81d-0eca8aadcb8d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:37.626825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17024c63-a8cd-4cf0-a81d-0eca8aadcb8d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:37.627269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-17024c63-a8cd-4cf0-a81d-0eca8aadcb8d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:37.654008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-17024c63-a8cd-4cf0-a81d-0eca8aadcb8d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:12:37.746785 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-17024c63-a8cd-4cf0-a81d-0eca8aadcb8d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "DELETE /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 204 len: 0 microversion: 2.1 time: 0.325465 Aug 29 16:12:37.748045 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3519/7261] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:12:37 2022] DELETE /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:12:37.754280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:37.755064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=14 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:37.756557 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:12:37.756871 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b (ip 10.222.0.62) !!! Aug 29 16:12:37.761672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85aa46fb-b913-4cbd-9103-50cb25c8f3a5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:37.762298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-85aa46fb-b913-4cbd-9103-50cb25c8f3a5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:37.770787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85aa46fb-b913-4cbd-9103-50cb25c8f3a5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:37.771283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85aa46fb-b913-4cbd-9103-50cb25c8f3a5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:37.771734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85aa46fb-b913-4cbd-9103-50cb25c8f3a5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:37.772440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85aa46fb-b913-4cbd-9103-50cb25c8f3a5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:37.772904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85aa46fb-b913-4cbd-9103-50cb25c8f3a5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:37.773367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85aa46fb-b913-4cbd-9103-50cb25c8f3a5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:37.934968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-85aa46fb-b913-4cbd-9103-50cb25c8f3a5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:37.943047 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85aa46fb-b913-4cbd-9103-50cb25c8f3a5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1580 microversion: 2.1 time: 0.190930 Aug 29 16:12:37.943640 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3743/7262] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:37 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1580 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:38.964410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ee2d64f3-5235-4125-9d45-218670fc8b5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:38.965134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ee2d64f3-5235-4125-9d45-218670fc8b5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:38.975402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee2d64f3-5235-4125-9d45-218670fc8b5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:38.976014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee2d64f3-5235-4125-9d45-218670fc8b5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:38.976418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee2d64f3-5235-4125-9d45-218670fc8b5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:38.977399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee2d64f3-5235-4125-9d45-218670fc8b5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:38.977920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee2d64f3-5235-4125-9d45-218670fc8b5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:38.978255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ee2d64f3-5235-4125-9d45-218670fc8b5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:38.998539 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] [eda7f439-560f-4fda-a0c4-47b93d5f6cfd] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 35764. Aug 29 16:12:39.126951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ee2d64f3-5235-4125-9d45-218670fc8b5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:39.135577 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ee2d64f3-5235-4125-9d45-218670fc8b5f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1580 microversion: 2.1 time: 0.175363 Aug 29 16:12:39.137482 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3520/7263] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:38 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1580 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:40.158153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-afc18b96-3ad3-4b29-99b1-42e4e606539f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:40.159282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-afc18b96-3ad3-4b29-99b1-42e4e606539f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:40.167693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afc18b96-3ad3-4b29-99b1-42e4e606539f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:40.168276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afc18b96-3ad3-4b29-99b1-42e4e606539f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:40.168738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afc18b96-3ad3-4b29-99b1-42e4e606539f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:40.169503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afc18b96-3ad3-4b29-99b1-42e4e606539f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:40.169984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afc18b96-3ad3-4b29-99b1-42e4e606539f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:40.170427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-afc18b96-3ad3-4b29-99b1-42e4e606539f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:40.690991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-afc18b96-3ad3-4b29-99b1-42e4e606539f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:40.702850 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-afc18b96-3ad3-4b29-99b1-42e4e606539f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1580 microversion: 2.1 time: 0.548923 Aug 29 16:12:40.703424 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3744/7264] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:40 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1580 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:40.988736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-af57d682-da18-4a91-9120-0f07be038fd3 req-cc0f9516-2027-472b-ba5f-cb6da1dfe112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a123e9-9e6e-4b33-8cfd-68c12107984b", "name": "network-vif-deleted", "tag": "cafd7d97-6e19-40a5-ad38-86ec72ee7ae1"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:41.001210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-af57d682-da18-4a91-9120-0f07be038fd3 req-cc0f9516-2027-472b-ba5f-cb6da1dfe112 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:41.001905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-af57d682-da18-4a91-9120-0f07be038fd3 req-cc0f9516-2027-472b-ba5f-cb6da1dfe112 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:41.002575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-af57d682-da18-4a91-9120-0f07be038fd3 req-cc0f9516-2027-472b-ba5f-cb6da1dfe112 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:41.023407 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-af57d682-da18-4a91-9120-0f07be038fd3 req-cc0f9516-2027-472b-ba5f-cb6da1dfe112 service nova] Creating event network-vif-deleted:cafd7d97-6e19-40a5-ad38-86ec72ee7ae1 for instance 78a123e9-9e6e-4b33-8cfd-68c12107984b on n-h2-839401-11 Aug 29 16:12:41.032072 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-af57d682-da18-4a91-9120-0f07be038fd3 req-cc0f9516-2027-472b-ba5f-cb6da1dfe112 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169004 Aug 29 16:12:41.033419 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3521/7265] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:41.724341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5b4d75b5-2f46-4396-81c0-d8af25b73b4f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:41.725716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5b4d75b5-2f46-4396-81c0-d8af25b73b4f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:41.735459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b4d75b5-2f46-4396-81c0-d8af25b73b4f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:41.738989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b4d75b5-2f46-4396-81c0-d8af25b73b4f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:41.740223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b4d75b5-2f46-4396-81c0-d8af25b73b4f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:41.742176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b4d75b5-2f46-4396-81c0-d8af25b73b4f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:41.743011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b4d75b5-2f46-4396-81c0-d8af25b73b4f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:41.743763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b4d75b5-2f46-4396-81c0-d8af25b73b4f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:41.826764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5b4d75b5-2f46-4396-81c0-d8af25b73b4f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:41.836308 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5b4d75b5-2f46-4396-81c0-d8af25b73b4f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1226 microversion: 2.1 time: 0.115850 Aug 29 16:12:41.836844 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3745/7266] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:41 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:42.859052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2ef2ba7c-383d-4733-a037-18a1e96d37d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:42.859760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2ef2ba7c-383d-4733-a037-18a1e96d37d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:42.866890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ef2ba7c-383d-4733-a037-18a1e96d37d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:42.867518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ef2ba7c-383d-4733-a037-18a1e96d37d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:42.867960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ef2ba7c-383d-4733-a037-18a1e96d37d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:42.868684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ef2ba7c-383d-4733-a037-18a1e96d37d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:42.869180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ef2ba7c-383d-4733-a037-18a1e96d37d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:42.869612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2ef2ba7c-383d-4733-a037-18a1e96d37d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:42.937962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2ef2ba7c-383d-4733-a037-18a1e96d37d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:42.946351 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2ef2ba7c-383d-4733-a037-18a1e96d37d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1226 microversion: 2.1 time: 0.092430 Aug 29 16:12:42.946841 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3522/7267] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:42 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:43.966948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9acba5bb-8f51-4c10-8f63-6f3492842aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:43.967571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9acba5bb-8f51-4c10-8f63-6f3492842aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:43.974669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9acba5bb-8f51-4c10-8f63-6f3492842aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:43.975177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9acba5bb-8f51-4c10-8f63-6f3492842aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:43.975635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9acba5bb-8f51-4c10-8f63-6f3492842aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:43.976385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9acba5bb-8f51-4c10-8f63-6f3492842aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:43.976863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9acba5bb-8f51-4c10-8f63-6f3492842aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:43.977372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9acba5bb-8f51-4c10-8f63-6f3492842aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:44.039884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9acba5bb-8f51-4c10-8f63-6f3492842aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:44.048115 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9acba5bb-8f51-4c10-8f63-6f3492842aa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1226 microversion: 2.1 time: 0.085143 Aug 29 16:12:44.048694 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3746/7268] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:43 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:45.068524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0215f722-d8f9-4399-bfa7-d222b67a0f6c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:45.069195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0215f722-d8f9-4399-bfa7-d222b67a0f6c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:45.076691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0215f722-d8f9-4399-bfa7-d222b67a0f6c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:45.077130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0215f722-d8f9-4399-bfa7-d222b67a0f6c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:45.077594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0215f722-d8f9-4399-bfa7-d222b67a0f6c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:45.078307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0215f722-d8f9-4399-bfa7-d222b67a0f6c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:45.078761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0215f722-d8f9-4399-bfa7-d222b67a0f6c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:45.079184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0215f722-d8f9-4399-bfa7-d222b67a0f6c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:45.152277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0215f722-d8f9-4399-bfa7-d222b67a0f6c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:45.161273 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0215f722-d8f9-4399-bfa7-d222b67a0f6c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 200 len: 1226 microversion: 2.1 time: 0.096681 Aug 29 16:12:45.161898 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3523/7269] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:45 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:46.182507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-791f49c6-9629-49f5-bb9b-8e1e693064c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:46.183075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-791f49c6-9629-49f5-bb9b-8e1e693064c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:46.190346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-791f49c6-9629-49f5-bb9b-8e1e693064c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:46.190862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-791f49c6-9629-49f5-bb9b-8e1e693064c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:46.191324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-791f49c6-9629-49f5-bb9b-8e1e693064c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:46.192060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-791f49c6-9629-49f5-bb9b-8e1e693064c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:46.192537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-791f49c6-9629-49f5-bb9b-8e1e693064c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:46.192983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-791f49c6-9629-49f5-bb9b-8e1e693064c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:46.207525 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-791f49c6-9629-49f5-bb9b-8e1e693064c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] HTTP exception thrown: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-791f49c6-9629-49f5-bb9b-8e1e693064c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Request method failure captured: Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b HTTP/1.1 Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOPVKb3AKf05JOTmVWxg_YSLh_6aJQ1fwERqtRCNq2OGA-TgfvjQkO776TgAknFFnCA3k1v6BcT_thZ3YV-DMceZELFHu1q-Z_h1mjuaQAa75Kym14h4m_K8QcmdN6yIk-IwhACLHvRJHqBNwAzk2eiJecAZxJFQO9-ZjVx01ZUPXeU Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_688ed04d399247f0ac8a204967cdfa2a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}] Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestVolumeBootPattern-201560010 Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: f07d896c6764402999345759f2348080 Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '78a123e9-9e6e-4b33-8cfd-68c12107984b'} Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:46.209125 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:12:46.214103 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:46.214103 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:46.214103 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:46.214103 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:12:46.214103 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:12:46.214103 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. Aug 29 16:12:46.214103 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:12:46.214103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-791f49c6-9629-49f5-bb9b-8e1e693064c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Returning 404 to user: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:12:46.214103 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-791f49c6-9629-49f5-bb9b-8e1e693064c4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 404 len: 111 microversion: 2.1 time: 0.032346 Aug 29 16:12:46.214103 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3747/7270] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:46 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:12:46.262569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1268198626", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1233251043", "security_groups": [{"name": "tempest-secgroup-smoke-1377313980"}], "block_device_mapping_v2": [{"uuid": "2e50ff76-3e7a-4da0-8478-6be7e6b7e5be", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "957b06a2-5b5b-41f0-883f-0990cab206d9"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:46.376811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] validate_networks() for [('957b06a2-5b5b-41f0-883f-0990cab206d9', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:12:46.847511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:12:46.847944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:12:46.848897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:12:46.848897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:12:46.849237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:12:46.859195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:46.859687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:46.860132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:46.860849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:46.861358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:46.861785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:46.879613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:12:46.885367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for user f07d896c6764402999345759f2348080 and project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:12:46.944018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:12:46.946244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e50ff76-3e7a-4da0-8478-6be7e6b7e5be',volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:12:47.079071 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c7c72d10-8131-4f56-abab-9ec0afc05821 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.820682 Aug 29 16:12:47.079733 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3524/7271] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:12:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:12:47.090674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d17c5199-513d-43a3-83cc-9c23e462e08f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:47.091509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d17c5199-513d-43a3-83cc-9c23e462e08f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:47.150463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d17c5199-513d-43a3-83cc-9c23e462e08f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:47.157937 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d17c5199-513d-43a3-83cc-9c23e462e08f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1095 microversion: 2.1 time: 0.071229 Aug 29 16:12:47.164050 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3748/7272] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:47 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:48.184632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-65660cd5-61f6-4906-9dfd-d396a65c94b3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:48.185481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-65660cd5-61f6-4906-9dfd-d396a65c94b3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:48.193426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65660cd5-61f6-4906-9dfd-d396a65c94b3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:48.193912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65660cd5-61f6-4906-9dfd-d396a65c94b3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:48.194355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65660cd5-61f6-4906-9dfd-d396a65c94b3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:48.195052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65660cd5-61f6-4906-9dfd-d396a65c94b3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:48.195513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65660cd5-61f6-4906-9dfd-d396a65c94b3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:48.195928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65660cd5-61f6-4906-9dfd-d396a65c94b3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:48.310818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-65660cd5-61f6-4906-9dfd-d396a65c94b3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:48.320176 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-65660cd5-61f6-4906-9dfd-d396a65c94b3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1201 microversion: 2.1 time: 0.140426 Aug 29 16:12:48.320920 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3525/7273] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:48 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1201 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:49.341468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e94b83b8-0ccc-4c5c-aab2-f0bcd0a21ce8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:49.342263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e94b83b8-0ccc-4c5c-aab2-f0bcd0a21ce8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:49.355227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e94b83b8-0ccc-4c5c-aab2-f0bcd0a21ce8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:49.356270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e94b83b8-0ccc-4c5c-aab2-f0bcd0a21ce8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:49.356824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e94b83b8-0ccc-4c5c-aab2-f0bcd0a21ce8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:49.357908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e94b83b8-0ccc-4c5c-aab2-f0bcd0a21ce8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:49.358419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e94b83b8-0ccc-4c5c-aab2-f0bcd0a21ce8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:49.358984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e94b83b8-0ccc-4c5c-aab2-f0bcd0a21ce8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:49.495837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e94b83b8-0ccc-4c5c-aab2-f0bcd0a21ce8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:49.504058 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e94b83b8-0ccc-4c5c-aab2-f0bcd0a21ce8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1279 microversion: 2.1 time: 0.166711 Aug 29 16:12:49.504645 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3749/7274] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:49 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1279 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:49.771482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-0522cf8b-4855-42a7-99c0-7d54cf383abc req-b1639266-715b-49bf-a141-c23681e30b80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86222f5-e0ca-4e09-8601-7c28597c1338", "tag": "aa335498-8803-4a83-9df8-614c3884f4b8"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:49.792172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0522cf8b-4855-42a7-99c0-7d54cf383abc req-b1639266-715b-49bf-a141-c23681e30b80 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:49.792797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0522cf8b-4855-42a7-99c0-7d54cf383abc req-b1639266-715b-49bf-a141-c23681e30b80 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:49.793352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0522cf8b-4855-42a7-99c0-7d54cf383abc req-b1639266-715b-49bf-a141-c23681e30b80 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:49.811062 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-0522cf8b-4855-42a7-99c0-7d54cf383abc req-b1639266-715b-49bf-a141-c23681e30b80 service nova] Creating event network-changed:aa335498-8803-4a83-9df8-614c3884f4b8 for instance f86222f5-e0ca-4e09-8601-7c28597c1338 on n-h1-839401-11 Aug 29 16:12:49.819814 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-0522cf8b-4855-42a7-99c0-7d54cf383abc req-b1639266-715b-49bf-a141-c23681e30b80 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052204 Aug 29 16:12:49.820641 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3526/7275] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:50.525437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2ac99792-e665-4566-9fe7-0e5dadf1e762 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:50.526288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2ac99792-e665-4566-9fe7-0e5dadf1e762 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:50.533944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ac99792-e665-4566-9fe7-0e5dadf1e762 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:50.533944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ac99792-e665-4566-9fe7-0e5dadf1e762 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:50.534299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ac99792-e665-4566-9fe7-0e5dadf1e762 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:50.535054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ac99792-e665-4566-9fe7-0e5dadf1e762 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:50.535536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ac99792-e665-4566-9fe7-0e5dadf1e762 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:50.536011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ac99792-e665-4566-9fe7-0e5dadf1e762 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:50.680411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2ac99792-e665-4566-9fe7-0e5dadf1e762 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:50.689068 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2ac99792-e665-4566-9fe7-0e5dadf1e762 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1279 microversion: 2.1 time: 0.167600 Aug 29 16:12:50.689999 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3750/7276] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:50 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1279 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:51.711467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3ee75d89-0843-4a72-8df7-3c93be5bf4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:51.712168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3ee75d89-0843-4a72-8df7-3c93be5bf4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:51.718801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ee75d89-0843-4a72-8df7-3c93be5bf4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:51.719292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ee75d89-0843-4a72-8df7-3c93be5bf4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:51.719735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ee75d89-0843-4a72-8df7-3c93be5bf4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:51.720441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ee75d89-0843-4a72-8df7-3c93be5bf4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:51.720905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ee75d89-0843-4a72-8df7-3c93be5bf4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:51.721368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ee75d89-0843-4a72-8df7-3c93be5bf4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:51.869075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3ee75d89-0843-4a72-8df7-3c93be5bf4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:51.877410 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3ee75d89-0843-4a72-8df7-3c93be5bf4f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1279 microversion: 2.1 time: 0.171158 Aug 29 16:12:51.878086 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3527/7277] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:51 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:52.897755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-df65d082-f05e-4972-9631-d65481afa031 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:52.898523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-df65d082-f05e-4972-9631-d65481afa031 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:52.905503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df65d082-f05e-4972-9631-d65481afa031 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:52.906015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df65d082-f05e-4972-9631-d65481afa031 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:52.906467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df65d082-f05e-4972-9631-d65481afa031 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:52.907189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df65d082-f05e-4972-9631-d65481afa031 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:52.907663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df65d082-f05e-4972-9631-d65481afa031 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:52.908145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-df65d082-f05e-4972-9631-d65481afa031 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:53.055183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-df65d082-f05e-4972-9631-d65481afa031 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:53.063896 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-df65d082-f05e-4972-9631-d65481afa031 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1279 microversion: 2.1 time: 0.170394 Aug 29 16:12:53.064454 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3751/7278] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:52 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1279 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:54.095249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e43de353-0c74-46c7-9a66-05041cae078d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:54.095888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e43de353-0c74-46c7-9a66-05041cae078d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:54.108715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e43de353-0c74-46c7-9a66-05041cae078d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:54.109251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e43de353-0c74-46c7-9a66-05041cae078d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:54.112724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e43de353-0c74-46c7-9a66-05041cae078d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:54.113382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e43de353-0c74-46c7-9a66-05041cae078d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:54.114124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e43de353-0c74-46c7-9a66-05041cae078d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:54.115276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e43de353-0c74-46c7-9a66-05041cae078d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:54.282592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e43de353-0c74-46c7-9a66-05041cae078d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:54.294246 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e43de353-0c74-46c7-9a66-05041cae078d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1279 microversion: 2.1 time: 0.204235 Aug 29 16:12:54.295673 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3528/7279] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:54 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1279 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:55.316143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ca0610dd-566e-4af9-a678-917112c5eeba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:55.316845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ca0610dd-566e-4af9-a678-917112c5eeba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:55.323933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca0610dd-566e-4af9-a678-917112c5eeba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:55.324671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca0610dd-566e-4af9-a678-917112c5eeba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:55.325359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca0610dd-566e-4af9-a678-917112c5eeba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:55.326359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca0610dd-566e-4af9-a678-917112c5eeba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:55.330093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca0610dd-566e-4af9-a678-917112c5eeba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:55.330568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ca0610dd-566e-4af9-a678-917112c5eeba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:55.478195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ca0610dd-566e-4af9-a678-917112c5eeba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:55.489961 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ca0610dd-566e-4af9-a678-917112c5eeba tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1267 microversion: 2.1 time: 0.177494 Aug 29 16:12:55.490743 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3752/7280] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:55 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:56.511680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-06095309-deb2-4f7f-bb37-c0acb5b0ce36 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:56.512388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-06095309-deb2-4f7f-bb37-c0acb5b0ce36 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:56.520017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06095309-deb2-4f7f-bb37-c0acb5b0ce36 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:56.520723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06095309-deb2-4f7f-bb37-c0acb5b0ce36 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:56.521216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06095309-deb2-4f7f-bb37-c0acb5b0ce36 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:56.522143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06095309-deb2-4f7f-bb37-c0acb5b0ce36 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:56.522821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06095309-deb2-4f7f-bb37-c0acb5b0ce36 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:56.523256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-06095309-deb2-4f7f-bb37-c0acb5b0ce36 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:56.667664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-06095309-deb2-4f7f-bb37-c0acb5b0ce36 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:56.676139 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-06095309-deb2-4f7f-bb37-c0acb5b0ce36 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1267 microversion: 2.1 time: 0.168778 Aug 29 16:12:56.676776 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3529/7281] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:56 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:57.697698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f2fac5ea-c7a1-4cab-b811-131947f79ff4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:57.698358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f2fac5ea-c7a1-4cab-b811-131947f79ff4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:57.701055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:57.706898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2fac5ea-c7a1-4cab-b811-131947f79ff4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:57.707414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2fac5ea-c7a1-4cab-b811-131947f79ff4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:57.707880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2fac5ea-c7a1-4cab-b811-131947f79ff4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:57.708727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2fac5ea-c7a1-4cab-b811-131947f79ff4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:57.709108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2fac5ea-c7a1-4cab-b811-131947f79ff4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:57.709563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f2fac5ea-c7a1-4cab-b811-131947f79ff4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:57.855864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f2fac5ea-c7a1-4cab-b811-131947f79ff4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:57.864289 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f2fac5ea-c7a1-4cab-b811-131947f79ff4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1267 microversion: 2.1 time: 0.170494 Aug 29 16:12:57.865248 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3753/7282] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:57 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:58.887249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ea61af9c-58da-40f9-a9ae-412ed0f19940 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:58.887909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ea61af9c-58da-40f9-a9ae-412ed0f19940 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:58.889973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:58.890640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:58.897847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea61af9c-58da-40f9-a9ae-412ed0f19940 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:58.898348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea61af9c-58da-40f9-a9ae-412ed0f19940 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:58.898792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea61af9c-58da-40f9-a9ae-412ed0f19940 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:58.899486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea61af9c-58da-40f9-a9ae-412ed0f19940 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:58.899946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea61af9c-58da-40f9-a9ae-412ed0f19940 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:58.900378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ea61af9c-58da-40f9-a9ae-412ed0f19940 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:59.041071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ea61af9c-58da-40f9-a9ae-412ed0f19940 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:59.050077 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ea61af9c-58da-40f9-a9ae-412ed0f19940 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1267 microversion: 2.1 time: 0.167583 Aug 29 16:12:59.050981 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3530/7283] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:58 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:00.073723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-56ad3a71-1acc-40de-9df0-9a12d2043a63 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:00.075084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-56ad3a71-1acc-40de-9df0-9a12d2043a63 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:00.082399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56ad3a71-1acc-40de-9df0-9a12d2043a63 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:00.082917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56ad3a71-1acc-40de-9df0-9a12d2043a63 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:00.083377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56ad3a71-1acc-40de-9df0-9a12d2043a63 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:00.084103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56ad3a71-1acc-40de-9df0-9a12d2043a63 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:00.084581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56ad3a71-1acc-40de-9df0-9a12d2043a63 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:00.085027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56ad3a71-1acc-40de-9df0-9a12d2043a63 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:00.219969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-56ad3a71-1acc-40de-9df0-9a12d2043a63 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:00.228358 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-56ad3a71-1acc-40de-9df0-9a12d2043a63 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1267 microversion: 2.1 time: 0.158756 Aug 29 16:13:00.228993 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3754/7284] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:00 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:01.250049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1b90e4ef-8b58-4daf-ae01-032349eb3909 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:01.250621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1b90e4ef-8b58-4daf-ae01-032349eb3909 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:01.258405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b90e4ef-8b58-4daf-ae01-032349eb3909 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:01.258895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b90e4ef-8b58-4daf-ae01-032349eb3909 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:01.259330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b90e4ef-8b58-4daf-ae01-032349eb3909 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:01.260035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b90e4ef-8b58-4daf-ae01-032349eb3909 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:01.260492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b90e4ef-8b58-4daf-ae01-032349eb3909 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:01.260915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b90e4ef-8b58-4daf-ae01-032349eb3909 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:01.398325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1b90e4ef-8b58-4daf-ae01-032349eb3909 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:01.406686 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1b90e4ef-8b58-4daf-ae01-032349eb3909 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1267 microversion: 2.1 time: 0.160967 Aug 29 16:13:01.407267 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3531/7285] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:01 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:02.427809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-12f16c0e-27a8-44aa-be72-97c961f15897 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:02.428428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-12f16c0e-27a8-44aa-be72-97c961f15897 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:02.436126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12f16c0e-27a8-44aa-be72-97c961f15897 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:02.436640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12f16c0e-27a8-44aa-be72-97c961f15897 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:02.437115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12f16c0e-27a8-44aa-be72-97c961f15897 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:02.437894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12f16c0e-27a8-44aa-be72-97c961f15897 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:02.438381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12f16c0e-27a8-44aa-be72-97c961f15897 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:02.438830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12f16c0e-27a8-44aa-be72-97c961f15897 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:02.590945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-12f16c0e-27a8-44aa-be72-97c961f15897 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:02.599272 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-12f16c0e-27a8-44aa-be72-97c961f15897 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1267 microversion: 2.1 time: 0.175625 Aug 29 16:13:02.599872 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3755/7286] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:02 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:03.620293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-67dd8d7b-bfbc-4a0b-8c42-8415e4287dda tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:03.621047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-67dd8d7b-bfbc-4a0b-8c42-8415e4287dda tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:03.628857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67dd8d7b-bfbc-4a0b-8c42-8415e4287dda tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:03.629430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67dd8d7b-bfbc-4a0b-8c42-8415e4287dda tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:03.629874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67dd8d7b-bfbc-4a0b-8c42-8415e4287dda tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:03.630592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67dd8d7b-bfbc-4a0b-8c42-8415e4287dda tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:03.631057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67dd8d7b-bfbc-4a0b-8c42-8415e4287dda tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:03.631493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-67dd8d7b-bfbc-4a0b-8c42-8415e4287dda tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:03.778722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-67dd8d7b-bfbc-4a0b-8c42-8415e4287dda tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:03.787133 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-67dd8d7b-bfbc-4a0b-8c42-8415e4287dda tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1267 microversion: 2.1 time: 0.170829 Aug 29 16:13:03.787711 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3532/7287] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:03 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:04.360829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-8f71b875-1026-46f5-b3bf-ee2b62f36379 req-32b0fab4-82a1-4deb-b314-04babf3e0d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86222f5-e0ca-4e09-8601-7c28597c1338", "name": "network-vif-plugged", "status": "completed", "tag": "aa335498-8803-4a83-9df8-614c3884f4b8"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:04.371053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8f71b875-1026-46f5-b3bf-ee2b62f36379 req-32b0fab4-82a1-4deb-b314-04babf3e0d01 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:04.371551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8f71b875-1026-46f5-b3bf-ee2b62f36379 req-32b0fab4-82a1-4deb-b314-04babf3e0d01 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:04.372004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8f71b875-1026-46f5-b3bf-ee2b62f36379 req-32b0fab4-82a1-4deb-b314-04babf3e0d01 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:04.383396 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-8f71b875-1026-46f5-b3bf-ee2b62f36379 req-32b0fab4-82a1-4deb-b314-04babf3e0d01 service nova] Creating event network-vif-plugged:aa335498-8803-4a83-9df8-614c3884f4b8 for instance f86222f5-e0ca-4e09-8601-7c28597c1338 on n-h1-839401-11 Aug 29 16:13:04.388559 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-8f71b875-1026-46f5-b3bf-ee2b62f36379 req-32b0fab4-82a1-4deb-b314-04babf3e0d01 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134469 Aug 29 16:13:04.389396 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3756/7288] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:04.808310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f925550d-5f42-4baa-aad1-bd3409422094 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:04.809058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f925550d-5f42-4baa-aad1-bd3409422094 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:04.816591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f925550d-5f42-4baa-aad1-bd3409422094 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:04.817104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f925550d-5f42-4baa-aad1-bd3409422094 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:04.817566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f925550d-5f42-4baa-aad1-bd3409422094 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:04.818274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f925550d-5f42-4baa-aad1-bd3409422094 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:04.818745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f925550d-5f42-4baa-aad1-bd3409422094 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:04.819162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f925550d-5f42-4baa-aad1-bd3409422094 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:04.964124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f925550d-5f42-4baa-aad1-bd3409422094 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:04.972115 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f925550d-5f42-4baa-aad1-bd3409422094 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1267 microversion: 2.1 time: 0.168501 Aug 29 16:13:04.972698 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3533/7289] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:04 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:05.994815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-60c2a647-79a5-4bc9-8384-faca7801452d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:05.995544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-60c2a647-79a5-4bc9-8384-faca7801452d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:06.002707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60c2a647-79a5-4bc9-8384-faca7801452d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:06.003166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60c2a647-79a5-4bc9-8384-faca7801452d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:06.003722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60c2a647-79a5-4bc9-8384-faca7801452d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:06.004515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60c2a647-79a5-4bc9-8384-faca7801452d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:06.005062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60c2a647-79a5-4bc9-8384-faca7801452d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:06.005598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60c2a647-79a5-4bc9-8384-faca7801452d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:06.153031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-60c2a647-79a5-4bc9-8384-faca7801452d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:06.162579 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-60c2a647-79a5-4bc9-8384-faca7801452d tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1267 microversion: 2.1 time: 0.173534 Aug 29 16:13:06.170581 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3757/7290] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:05 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:07.183737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb99bc05-d81c-4d29-80f2-8d4cc8492b58 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:07.184547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bb99bc05-d81c-4d29-80f2-8d4cc8492b58 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:07.191895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb99bc05-d81c-4d29-80f2-8d4cc8492b58 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:07.192401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb99bc05-d81c-4d29-80f2-8d4cc8492b58 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:07.192851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb99bc05-d81c-4d29-80f2-8d4cc8492b58 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:07.193589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb99bc05-d81c-4d29-80f2-8d4cc8492b58 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:07.194053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb99bc05-d81c-4d29-80f2-8d4cc8492b58 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:07.194488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb99bc05-d81c-4d29-80f2-8d4cc8492b58 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:07.331357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bb99bc05-d81c-4d29-80f2-8d4cc8492b58 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:07.340248 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bb99bc05-d81c-4d29-80f2-8d4cc8492b58 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1454 microversion: 2.1 time: 0.160444 Aug 29 16:13:07.340903 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3534/7291] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:07 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:07.361374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d5cc518-020e-428f-ab3a-b0fea687f63b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:07.361962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2d5cc518-020e-428f-ab3a-b0fea687f63b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:07.369582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5cc518-020e-428f-ab3a-b0fea687f63b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:07.370090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5cc518-020e-428f-ab3a-b0fea687f63b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:07.370553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5cc518-020e-428f-ab3a-b0fea687f63b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:07.371271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5cc518-020e-428f-ab3a-b0fea687f63b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:07.371750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5cc518-020e-428f-ab3a-b0fea687f63b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:07.372199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d5cc518-020e-428f-ab3a-b0fea687f63b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:07.512710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d5cc518-020e-428f-ab3a-b0fea687f63b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:07.520604 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d5cc518-020e-428f-ab3a-b0fea687f63b tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1454 microversion: 2.1 time: 0.163329 Aug 29 16:13:07.521204 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3758/7292] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:07 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:09.364422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-99f9bb63-7ccf-451e-beac-fb0b1fd4b3e4 req-7278fa44-8c45-4858-942b-3a30270d9644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86222f5-e0ca-4e09-8601-7c28597c1338", "tag": "aa335498-8803-4a83-9df8-614c3884f4b8"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:09.375505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:09.387612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-99f9bb63-7ccf-451e-beac-fb0b1fd4b3e4 req-7278fa44-8c45-4858-942b-3a30270d9644 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:09.388430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-99f9bb63-7ccf-451e-beac-fb0b1fd4b3e4 req-7278fa44-8c45-4858-942b-3a30270d9644 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:09.388885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-99f9bb63-7ccf-451e-beac-fb0b1fd4b3e4 req-7278fa44-8c45-4858-942b-3a30270d9644 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:09.392113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:09.405776 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-99f9bb63-7ccf-451e-beac-fb0b1fd4b3e4 req-7278fa44-8c45-4858-942b-3a30270d9644 service nova] Creating event network-changed:aa335498-8803-4a83-9df8-614c3884f4b8 for instance f86222f5-e0ca-4e09-8601-7c28597c1338 on n-h1-839401-11 Aug 29 16:13:09.411107 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-99f9bb63-7ccf-451e-beac-fb0b1fd4b3e4 req-7278fa44-8c45-4858-942b-3a30270d9644 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051757 Aug 29 16:13:09.412547 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3535/7293] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:14:59.814736 n-d-839401-11 devstack@n-api.service[122360]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edb16f3c-d8bd-4396-8d00-d7897b8393bf] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:14:59.815827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=34 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:59.816607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=82 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:59.817506 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:14:59.817682 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:14:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.62) !!! Aug 29 16:14:59.823013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1916500924", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1233251043", "security_groups": [{"name": "tempest-secgroup-smoke-1377313980"}], "block_device_mapping_v2": [{"uuid": "0e00fd29-7179-4619-9b1b-32da3d75ada6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "957b06a2-5b5b-41f0-883f-0990cab206d9"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:59.942953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] validate_networks() for [('957b06a2-5b5b-41f0-883f-0990cab206d9', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:15:00.449429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:15:00.450050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:15:00.450727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:15:00.451317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:15:00.451920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:15:00.462496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:00.463005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:00.463462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:00.464214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:00.464692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:00.465166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:00.482895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:15:00.488810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Getting quotas for user f07d896c6764402999345759f2348080 and project 688ed04d399247f0ac8a204967cdfa2a. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:15:00.552276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:15:00.554571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e00fd29-7179-4619-9b1b-32da3d75ada6',volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:15:00.696101 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-39fcbcd4-ae1a-4c98-b8a6-719b9e264928 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.883312 Aug 29 16:15:00.696777 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3759/7294] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:14:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:15:00.707057 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [-] [564df600-0953-4421-a68a-24b5a0a40919] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:15:00.712999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-03dab061-f1db-403f-b677-e8a3e3c7a9d2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:00.713755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-03dab061-f1db-403f-b677-e8a3e3c7a9d2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:00.777028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-03dab061-f1db-403f-b677-e8a3e3c7a9d2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:00.784235 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-03dab061-f1db-403f-b677-e8a3e3c7a9d2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1095 microversion: 2.1 time: 0.080006 Aug 29 16:15:00.784817 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3536/7295] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:00 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:01.809656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b8ee8259-ef71-4fcb-ac0d-bc1f343b5d6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:01.810273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b8ee8259-ef71-4fcb-ac0d-bc1f343b5d6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:01.819395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8ee8259-ef71-4fcb-ac0d-bc1f343b5d6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:01.819910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8ee8259-ef71-4fcb-ac0d-bc1f343b5d6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:01.820369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8ee8259-ef71-4fcb-ac0d-bc1f343b5d6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:01.821144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8ee8259-ef71-4fcb-ac0d-bc1f343b5d6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:01.821600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8ee8259-ef71-4fcb-ac0d-bc1f343b5d6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:01.822051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8ee8259-ef71-4fcb-ac0d-bc1f343b5d6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:01.825627 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] [edb16f3c-d8bd-4396-8d00-d7897b8393bf] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 37790. Aug 29 16:15:01.897997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b8ee8259-ef71-4fcb-ac0d-bc1f343b5d6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:01.906895 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b8ee8259-ef71-4fcb-ac0d-bc1f343b5d6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1193 microversion: 2.1 time: 0.105944 Aug 29 16:15:01.907486 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3760/7296] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:01 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1193 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:02.928005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-706fd9ca-0ec4-4b78-9eae-8baf8adcefec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:02.928757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-706fd9ca-0ec4-4b78-9eae-8baf8adcefec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:02.937531 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-706fd9ca-0ec4-4b78-9eae-8baf8adcefec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:02.938437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-706fd9ca-0ec4-4b78-9eae-8baf8adcefec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:02.939131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-706fd9ca-0ec4-4b78-9eae-8baf8adcefec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:02.940449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-706fd9ca-0ec4-4b78-9eae-8baf8adcefec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:02.941156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-706fd9ca-0ec4-4b78-9eae-8baf8adcefec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:02.941839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-706fd9ca-0ec4-4b78-9eae-8baf8adcefec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:02.964833 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] [564df600-0953-4421-a68a-24b5a0a40919] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 37800. Aug 29 16:15:03.154969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-706fd9ca-0ec4-4b78-9eae-8baf8adcefec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:03.163989 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-706fd9ca-0ec4-4b78-9eae-8baf8adcefec tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1279 microversion: 2.1 time: 0.239952 Aug 29 16:15:03.164568 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3537/7297] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:02 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1279 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:03.403858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e748adff-364a-416e-85ba-3ea1acf536e1 req-19d587b1-eab8-43ac-bdf7-2ff7772da751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1dd9b9-6785-405b-b5be-83d881463fe2", "tag": "c758f20a-4f3b-4a22-a4ce-bd3cc37ac921"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:03.420328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e748adff-364a-416e-85ba-3ea1acf536e1 req-19d587b1-eab8-43ac-bdf7-2ff7772da751 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:03.420992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e748adff-364a-416e-85ba-3ea1acf536e1 req-19d587b1-eab8-43ac-bdf7-2ff7772da751 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:03.421658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e748adff-364a-416e-85ba-3ea1acf536e1 req-19d587b1-eab8-43ac-bdf7-2ff7772da751 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:03.434260 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e748adff-364a-416e-85ba-3ea1acf536e1 req-19d587b1-eab8-43ac-bdf7-2ff7772da751 service nova] Creating event network-changed:c758f20a-4f3b-4a22-a4ce-bd3cc37ac921 for instance 2e1dd9b9-6785-405b-b5be-83d881463fe2 on n-h2-839401-11 Aug 29 16:15:03.440678 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e748adff-364a-416e-85ba-3ea1acf536e1 req-19d587b1-eab8-43ac-bdf7-2ff7772da751 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042449 Aug 29 16:15:03.441963 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3761/7298] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:04.185717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d81b7322-04a3-4495-adc3-d46053cfaa15 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:04.186995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d81b7322-04a3-4495-adc3-d46053cfaa15 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:04.194462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d81b7322-04a3-4495-adc3-d46053cfaa15 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:04.194960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d81b7322-04a3-4495-adc3-d46053cfaa15 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:04.195405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d81b7322-04a3-4495-adc3-d46053cfaa15 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:04.196135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d81b7322-04a3-4495-adc3-d46053cfaa15 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:04.196790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d81b7322-04a3-4495-adc3-d46053cfaa15 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:04.197340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d81b7322-04a3-4495-adc3-d46053cfaa15 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:04.413288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d81b7322-04a3-4495-adc3-d46053cfaa15 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:04.421953 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d81b7322-04a3-4495-adc3-d46053cfaa15 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1279 microversion: 2.1 time: 0.240566 Aug 29 16:15:04.422951 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3538/7299] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:04 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1279 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:05.442955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f8761ccc-ce6d-4ad9-a314-797d0f7b12e6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:05.443646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f8761ccc-ce6d-4ad9-a314-797d0f7b12e6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:05.451125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8761ccc-ce6d-4ad9-a314-797d0f7b12e6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:05.451660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8761ccc-ce6d-4ad9-a314-797d0f7b12e6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:05.452121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8761ccc-ce6d-4ad9-a314-797d0f7b12e6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:05.452841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8761ccc-ce6d-4ad9-a314-797d0f7b12e6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:05.453356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8761ccc-ce6d-4ad9-a314-797d0f7b12e6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:05.453798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f8761ccc-ce6d-4ad9-a314-797d0f7b12e6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:05.592894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f8761ccc-ce6d-4ad9-a314-797d0f7b12e6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:05.601184 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f8761ccc-ce6d-4ad9-a314-797d0f7b12e6 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1279 microversion: 2.1 time: 0.162680 Aug 29 16:15:05.601758 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3762/7300] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:05 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:06.622664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-35470f58-ca16-49ef-8350-b87ab9086418 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:06.623322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-35470f58-ca16-49ef-8350-b87ab9086418 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:06.630786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35470f58-ca16-49ef-8350-b87ab9086418 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:06.631282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35470f58-ca16-49ef-8350-b87ab9086418 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:06.631724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35470f58-ca16-49ef-8350-b87ab9086418 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:06.632411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35470f58-ca16-49ef-8350-b87ab9086418 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:06.632906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35470f58-ca16-49ef-8350-b87ab9086418 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:06.633345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35470f58-ca16-49ef-8350-b87ab9086418 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:06.777222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-35470f58-ca16-49ef-8350-b87ab9086418 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:06.785905 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-35470f58-ca16-49ef-8350-b87ab9086418 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1279 microversion: 2.1 time: 0.167215 Aug 29 16:15:06.786518 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3539/7301] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:06 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1279 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:07.812712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-77531461-2d4d-414a-adf1-202056f6253e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:07.813855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-77531461-2d4d-414a-adf1-202056f6253e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:07.823981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77531461-2d4d-414a-adf1-202056f6253e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:07.824828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77531461-2d4d-414a-adf1-202056f6253e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:07.825645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77531461-2d4d-414a-adf1-202056f6253e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:07.826835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77531461-2d4d-414a-adf1-202056f6253e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:07.827605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77531461-2d4d-414a-adf1-202056f6253e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:07.828429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77531461-2d4d-414a-adf1-202056f6253e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:07.970931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-77531461-2d4d-414a-adf1-202056f6253e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:07.980097 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-77531461-2d4d-414a-adf1-202056f6253e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1267 microversion: 2.1 time: 0.175416 Aug 29 16:15:07.980675 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3763/7302] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:07 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:09.003374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-58c9f593-a238-417d-b65f-8b325aa416a9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:09.004037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-58c9f593-a238-417d-b65f-8b325aa416a9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:09.011117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58c9f593-a238-417d-b65f-8b325aa416a9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:09.011609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58c9f593-a238-417d-b65f-8b325aa416a9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:09.012047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58c9f593-a238-417d-b65f-8b325aa416a9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:09.012768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58c9f593-a238-417d-b65f-8b325aa416a9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:09.013273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58c9f593-a238-417d-b65f-8b325aa416a9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:09.013707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58c9f593-a238-417d-b65f-8b325aa416a9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:09.153450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-58c9f593-a238-417d-b65f-8b325aa416a9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:09.162589 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-58c9f593-a238-417d-b65f-8b325aa416a9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1267 microversion: 2.1 time: 0.164000 Aug 29 16:15:09.163219 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3540/7303] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:08 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:10.183785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8cdb1115-3755-452e-bc60-e6970757cff0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:10.184349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8cdb1115-3755-452e-bc60-e6970757cff0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:10.191764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cdb1115-3755-452e-bc60-e6970757cff0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:10.192268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cdb1115-3755-452e-bc60-e6970757cff0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:10.192721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cdb1115-3755-452e-bc60-e6970757cff0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:10.193470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cdb1115-3755-452e-bc60-e6970757cff0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:10.193946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cdb1115-3755-452e-bc60-e6970757cff0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:10.194391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cdb1115-3755-452e-bc60-e6970757cff0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:10.328637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8cdb1115-3755-452e-bc60-e6970757cff0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:10.336633 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8cdb1115-3755-452e-bc60-e6970757cff0 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1267 microversion: 2.1 time: 0.156923 Aug 29 16:15:10.337232 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3764/7304] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:10 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:11.358530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1582e00f-2a22-4a30-bdaa-5ee7614714ca tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:11.359280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1582e00f-2a22-4a30-bdaa-5ee7614714ca tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:11.362133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:11.367715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1582e00f-2a22-4a30-bdaa-5ee7614714ca tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:11.368213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1582e00f-2a22-4a30-bdaa-5ee7614714ca tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:11.368722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1582e00f-2a22-4a30-bdaa-5ee7614714ca tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:11.369521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1582e00f-2a22-4a30-bdaa-5ee7614714ca tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:11.369997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1582e00f-2a22-4a30-bdaa-5ee7614714ca tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:11.370417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1582e00f-2a22-4a30-bdaa-5ee7614714ca tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:11.526224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1582e00f-2a22-4a30-bdaa-5ee7614714ca tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:11.534603 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1582e00f-2a22-4a30-bdaa-5ee7614714ca tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1267 microversion: 2.1 time: 0.180191 Aug 29 16:15:11.535188 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3541/7305] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:11 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:12.559156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-91259c8b-a7b1-45f5-af95-26957e774ebf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:12.559943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-91259c8b-a7b1-45f5-af95-26957e774ebf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:12.562919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:12.563686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:12.572839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91259c8b-a7b1-45f5-af95-26957e774ebf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:12.573377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91259c8b-a7b1-45f5-af95-26957e774ebf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:12.573831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91259c8b-a7b1-45f5-af95-26957e774ebf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:12.574539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91259c8b-a7b1-45f5-af95-26957e774ebf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:12.575014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91259c8b-a7b1-45f5-af95-26957e774ebf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:12.575456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91259c8b-a7b1-45f5-af95-26957e774ebf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:12.722282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-91259c8b-a7b1-45f5-af95-26957e774ebf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:12.730500 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-91259c8b-a7b1-45f5-af95-26957e774ebf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1267 microversion: 2.1 time: 0.178483 Aug 29 16:15:12.731096 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3765/7306] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:12 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:13.755437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f4444d74-cf9a-4cf4-9a70-b91cd7190f6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:13.756393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f4444d74-cf9a-4cf4-9a70-b91cd7190f6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:13.768535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4444d74-cf9a-4cf4-9a70-b91cd7190f6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:13.769418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4444d74-cf9a-4cf4-9a70-b91cd7190f6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:13.770183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4444d74-cf9a-4cf4-9a70-b91cd7190f6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:13.771306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4444d74-cf9a-4cf4-9a70-b91cd7190f6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:13.772070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4444d74-cf9a-4cf4-9a70-b91cd7190f6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:13.772775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4444d74-cf9a-4cf4-9a70-b91cd7190f6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:13.913785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f4444d74-cf9a-4cf4-9a70-b91cd7190f6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:13.922415 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f4444d74-cf9a-4cf4-9a70-b91cd7190f6a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1267 microversion: 2.1 time: 0.173685 Aug 29 16:15:13.923002 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3542/7307] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:13 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:14.947046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-29fa21aa-edb1-4d0b-9183-ff1223adfc5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:14.947674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-29fa21aa-edb1-4d0b-9183-ff1223adfc5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:14.955085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29fa21aa-edb1-4d0b-9183-ff1223adfc5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:14.955617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29fa21aa-edb1-4d0b-9183-ff1223adfc5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:14.956079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29fa21aa-edb1-4d0b-9183-ff1223adfc5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:14.956803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29fa21aa-edb1-4d0b-9183-ff1223adfc5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:14.957348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29fa21aa-edb1-4d0b-9183-ff1223adfc5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:14.957805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-29fa21aa-edb1-4d0b-9183-ff1223adfc5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:15.099722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-29fa21aa-edb1-4d0b-9183-ff1223adfc5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:15.112210 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-29fa21aa-edb1-4d0b-9183-ff1223adfc5c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1267 microversion: 2.1 time: 0.171102 Aug 29 16:15:15.112869 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3766/7308] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:14 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:16.137683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fead5400-3023-42fd-bf80-04827d2125dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:16.138549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fead5400-3023-42fd-bf80-04827d2125dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:16.150220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fead5400-3023-42fd-bf80-04827d2125dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:16.150715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fead5400-3023-42fd-bf80-04827d2125dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:16.151166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fead5400-3023-42fd-bf80-04827d2125dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:16.151903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fead5400-3023-42fd-bf80-04827d2125dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:16.152365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fead5400-3023-42fd-bf80-04827d2125dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:16.152795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fead5400-3023-42fd-bf80-04827d2125dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:16.303972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fead5400-3023-42fd-bf80-04827d2125dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:16.311939 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fead5400-3023-42fd-bf80-04827d2125dd tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1267 microversion: 2.1 time: 0.181152 Aug 29 16:15:16.312519 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3543/7309] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:16 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:17.337513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d68dfc55-66b2-4e39-a3ad-2d575f7b7621 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:17.338432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d68dfc55-66b2-4e39-a3ad-2d575f7b7621 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:17.347105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d68dfc55-66b2-4e39-a3ad-2d575f7b7621 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:17.347719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d68dfc55-66b2-4e39-a3ad-2d575f7b7621 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:17.348268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d68dfc55-66b2-4e39-a3ad-2d575f7b7621 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:17.349160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d68dfc55-66b2-4e39-a3ad-2d575f7b7621 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:17.349757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d68dfc55-66b2-4e39-a3ad-2d575f7b7621 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:17.350288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d68dfc55-66b2-4e39-a3ad-2d575f7b7621 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:17.492639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d68dfc55-66b2-4e39-a3ad-2d575f7b7621 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:17.501064 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d68dfc55-66b2-4e39-a3ad-2d575f7b7621 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1267 microversion: 2.1 time: 0.170491 Aug 29 16:15:17.501635 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3767/7310] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:17 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:18.522406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-333b66b9-d7ef-4038-8f48-12b97dcf2552 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:18.523122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-333b66b9-d7ef-4038-8f48-12b97dcf2552 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:18.530347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-333b66b9-d7ef-4038-8f48-12b97dcf2552 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:18.531056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-333b66b9-d7ef-4038-8f48-12b97dcf2552 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:18.531476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-333b66b9-d7ef-4038-8f48-12b97dcf2552 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:18.532187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-333b66b9-d7ef-4038-8f48-12b97dcf2552 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:18.532654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-333b66b9-d7ef-4038-8f48-12b97dcf2552 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:18.533098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-333b66b9-d7ef-4038-8f48-12b97dcf2552 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:18.580627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-7dd3fb2a-41ad-4308-acd7-189cb11c4891 req-96ae135a-a07a-4f24-b8fa-e9bc1ce0c72c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1dd9b9-6785-405b-b5be-83d881463fe2", "name": "network-vif-plugged", "status": "completed", "tag": "c758f20a-4f3b-4a22-a4ce-bd3cc37ac921"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:18.592029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7dd3fb2a-41ad-4308-acd7-189cb11c4891 req-96ae135a-a07a-4f24-b8fa-e9bc1ce0c72c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:18.592847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7dd3fb2a-41ad-4308-acd7-189cb11c4891 req-96ae135a-a07a-4f24-b8fa-e9bc1ce0c72c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:18.593433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7dd3fb2a-41ad-4308-acd7-189cb11c4891 req-96ae135a-a07a-4f24-b8fa-e9bc1ce0c72c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:18.610232 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-7dd3fb2a-41ad-4308-acd7-189cb11c4891 req-96ae135a-a07a-4f24-b8fa-e9bc1ce0c72c service nova] Creating event network-vif-plugged:c758f20a-4f3b-4a22-a4ce-bd3cc37ac921 for instance 2e1dd9b9-6785-405b-b5be-83d881463fe2 on n-h2-839401-11 Aug 29 16:15:18.617207 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-7dd3fb2a-41ad-4308-acd7-189cb11c4891 req-96ae135a-a07a-4f24-b8fa-e9bc1ce0c72c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040708 Aug 29 16:15:18.618098 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3768/7311] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:18.903084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-333b66b9-d7ef-4038-8f48-12b97dcf2552 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:18.911464 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-333b66b9-d7ef-4038-8f48-12b97dcf2552 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1267 microversion: 2.1 time: 0.393149 Aug 29 16:15:18.912024 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3544/7312] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:18 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1267 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:19.933981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b2dc29bc-99ce-42c4-b559-b915cd4e1cac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:19.935116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b2dc29bc-99ce-42c4-b559-b915cd4e1cac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:19.941199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2dc29bc-99ce-42c4-b559-b915cd4e1cac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:19.941693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2dc29bc-99ce-42c4-b559-b915cd4e1cac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:19.942138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2dc29bc-99ce-42c4-b559-b915cd4e1cac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:19.942839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2dc29bc-99ce-42c4-b559-b915cd4e1cac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:19.943308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2dc29bc-99ce-42c4-b559-b915cd4e1cac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:19.943789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2dc29bc-99ce-42c4-b559-b915cd4e1cac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:20.157271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b2dc29bc-99ce-42c4-b559-b915cd4e1cac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:20.165696 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b2dc29bc-99ce-42c4-b559-b915cd4e1cac tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1267 microversion: 2.1 time: 0.237136 Aug 29 16:15:20.169002 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3769/7313] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:19 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:21.188458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2cdd6586-3003-45b5-a886-db7d98c6e5a8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:21.189200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2cdd6586-3003-45b5-a886-db7d98c6e5a8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:21.198219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cdd6586-3003-45b5-a886-db7d98c6e5a8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:21.198832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cdd6586-3003-45b5-a886-db7d98c6e5a8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:21.199395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cdd6586-3003-45b5-a886-db7d98c6e5a8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:21.200290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cdd6586-3003-45b5-a886-db7d98c6e5a8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:21.200874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cdd6586-3003-45b5-a886-db7d98c6e5a8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:21.201452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cdd6586-3003-45b5-a886-db7d98c6e5a8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:21.343487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2cdd6586-3003-45b5-a886-db7d98c6e5a8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:21.352176 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2cdd6586-3003-45b5-a886-db7d98c6e5a8 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1455 microversion: 2.1 time: 0.168844 Aug 29 16:15:21.352736 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3545/7314] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:21 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1455 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:21.373033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-005b8a3c-eb4b-44c3-a309-aebb09531c51 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:21.373710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-005b8a3c-eb4b-44c3-a309-aebb09531c51 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:21.380613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-005b8a3c-eb4b-44c3-a309-aebb09531c51 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:21.381147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-005b8a3c-eb4b-44c3-a309-aebb09531c51 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:21.381606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-005b8a3c-eb4b-44c3-a309-aebb09531c51 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:21.382401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-005b8a3c-eb4b-44c3-a309-aebb09531c51 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:21.382867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-005b8a3c-eb4b-44c3-a309-aebb09531c51 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:21.383313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-005b8a3c-eb4b-44c3-a309-aebb09531c51 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:21.523189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-005b8a3c-eb4b-44c3-a309-aebb09531c51 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:21.535050 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-005b8a3c-eb4b-44c3-a309-aebb09531c51 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1455 microversion: 2.1 time: 0.166011 Aug 29 16:15:21.535765 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3770/7315] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:21 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1455 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:23.292010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-014a3b18-44b1-4c20-b244-3ceb84c9e269 req-d3d61636-7791-4d4b-bb00-a7d810ad3ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1dd9b9-6785-405b-b5be-83d881463fe2", "tag": "c758f20a-4f3b-4a22-a4ce-bd3cc37ac921"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:23.303807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-014a3b18-44b1-4c20-b244-3ceb84c9e269 req-d3d61636-7791-4d4b-bb00-a7d810ad3ebd service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:23.304354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-014a3b18-44b1-4c20-b244-3ceb84c9e269 req-d3d61636-7791-4d4b-bb00-a7d810ad3ebd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:23.304860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-014a3b18-44b1-4c20-b244-3ceb84c9e269 req-d3d61636-7791-4d4b-bb00-a7d810ad3ebd service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:23.318318 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-014a3b18-44b1-4c20-b244-3ceb84c9e269 req-d3d61636-7791-4d4b-bb00-a7d810ad3ebd service nova] Creating event network-changed:c758f20a-4f3b-4a22-a4ce-bd3cc37ac921 for instance 2e1dd9b9-6785-405b-b5be-83d881463fe2 on n-h2-839401-11 Aug 29 16:15:23.324393 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-014a3b18-44b1-4c20-b244-3ceb84c9e269 req-d3d61636-7791-4d4b-bb00-a7d810ad3ebd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036484 Aug 29 16:15:23.325566 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3546/7316] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:17:03.708134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85ebdc21-c785-47bf-9d87-bc0f261b57d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:03.709655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-85ebdc21-c785-47bf-9d87-bc0f261b57d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:03.709798 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [-] [564df600-0953-4421-a68a-24b5a0a40919] AMQP server on 10.222.0.62:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 16:17:03.710292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=25 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:03.711245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=57 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:03.712644 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:17:03.712821 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 16:17:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Aug 29 16:17:03.715139 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:17:03.715254 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 16:17:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Aug 29 16:17:03.716137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:03.717057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=60 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:03.722250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85ebdc21-c785-47bf-9d87-bc0f261b57d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:03.723415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85ebdc21-c785-47bf-9d87-bc0f261b57d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:03.724478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85ebdc21-c785-47bf-9d87-bc0f261b57d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:03.724896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85ebdc21-c785-47bf-9d87-bc0f261b57d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:03.725407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85ebdc21-c785-47bf-9d87-bc0f261b57d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:03.725860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85ebdc21-c785-47bf-9d87-bc0f261b57d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:03.755557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-85ebdc21-c785-47bf-9d87-bc0f261b57d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:17:03.809314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-295f605a-cc7f-4ca5-bccb-04af962972f7 req-91b48110-fa93-4142-8fba-0d0d6eec69a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1dd9b9-6785-405b-b5be-83d881463fe2", "tag": "c758f20a-4f3b-4a22-a4ce-bd3cc37ac921"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:03.820121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-295f605a-cc7f-4ca5-bccb-04af962972f7 req-91b48110-fa93-4142-8fba-0d0d6eec69a4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:03.820613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-295f605a-cc7f-4ca5-bccb-04af962972f7 req-91b48110-fa93-4142-8fba-0d0d6eec69a4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:03.821054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-295f605a-cc7f-4ca5-bccb-04af962972f7 req-91b48110-fa93-4142-8fba-0d0d6eec69a4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:03.832840 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-295f605a-cc7f-4ca5-bccb-04af962972f7 req-91b48110-fa93-4142-8fba-0d0d6eec69a4 service nova] Creating event network-changed:c758f20a-4f3b-4a22-a4ce-bd3cc37ac921 for instance 2e1dd9b9-6785-405b-b5be-83d881463fe2 on n-h2-839401-11 Aug 29 16:17:03.837608 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-295f605a-cc7f-4ca5-bccb-04af962972f7 req-91b48110-fa93-4142-8fba-0d0d6eec69a4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131651 Aug 29 16:17:03.838549 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3547/7317] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:17:03.851379 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85ebdc21-c785-47bf-9d87-bc0f261b57d9 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 204 len: 0 microversion: 2.1 time: 0.147758 Aug 29 16:17:03.852220 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3771/7318] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:03 2022] DELETE /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:17:03.862203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f54eae9b-f743-48f4-bb61-f2fd115623f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:03.863005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f54eae9b-f743-48f4-bb61-f2fd115623f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:03.870183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f54eae9b-f743-48f4-bb61-f2fd115623f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:03.871914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f54eae9b-f743-48f4-bb61-f2fd115623f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:03.873321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f54eae9b-f743-48f4-bb61-f2fd115623f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:03.873519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f54eae9b-f743-48f4-bb61-f2fd115623f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:03.874010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f54eae9b-f743-48f4-bb61-f2fd115623f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:03.874445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f54eae9b-f743-48f4-bb61-f2fd115623f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:04.016317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f54eae9b-f743-48f4-bb61-f2fd115623f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:04.024394 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f54eae9b-f743-48f4-bb61-f2fd115623f7 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1579 microversion: 2.1 time: 0.167108 Aug 29 16:17:04.024992 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3548/7319] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:03 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1579 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:05.046362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f49e6c1d-81f4-4045-9e92-51fe50f2bd7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:05.047138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f49e6c1d-81f4-4045-9e92-51fe50f2bd7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:05.054332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f49e6c1d-81f4-4045-9e92-51fe50f2bd7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:05.054852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f49e6c1d-81f4-4045-9e92-51fe50f2bd7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:05.055304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f49e6c1d-81f4-4045-9e92-51fe50f2bd7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:05.056013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f49e6c1d-81f4-4045-9e92-51fe50f2bd7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:05.056525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f49e6c1d-81f4-4045-9e92-51fe50f2bd7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:05.057031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f49e6c1d-81f4-4045-9e92-51fe50f2bd7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:05.201041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f49e6c1d-81f4-4045-9e92-51fe50f2bd7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:05.210419 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f49e6c1d-81f4-4045-9e92-51fe50f2bd7c tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1579 microversion: 2.1 time: 0.168413 Aug 29 16:17:05.211380 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3772/7320] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:05 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:06.232493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-942c46aa-decb-46bb-a9a9-01b371490fa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:06.233489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-942c46aa-decb-46bb-a9a9-01b371490fa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:06.246424 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] [564df600-0953-4421-a68a-24b5a0a40919] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 37912. Aug 29 16:17:06.250987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-942c46aa-decb-46bb-a9a9-01b371490fa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:06.251492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-942c46aa-decb-46bb-a9a9-01b371490fa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:06.251935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-942c46aa-decb-46bb-a9a9-01b371490fa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:06.252651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-942c46aa-decb-46bb-a9a9-01b371490fa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:06.253117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-942c46aa-decb-46bb-a9a9-01b371490fa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:06.253589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-942c46aa-decb-46bb-a9a9-01b371490fa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:06.280977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-871c2e83-5044-426a-ab76-64cb519470e9 req-0068bdcf-09b5-4831-98c6-5585a6915482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1dd9b9-6785-405b-b5be-83d881463fe2", "name": "network-vif-deleted", "tag": "c758f20a-4f3b-4a22-a4ce-bd3cc37ac921"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:06.293250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-871c2e83-5044-426a-ab76-64cb519470e9 req-0068bdcf-09b5-4831-98c6-5585a6915482 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:06.293877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-871c2e83-5044-426a-ab76-64cb519470e9 req-0068bdcf-09b5-4831-98c6-5585a6915482 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:06.294387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-871c2e83-5044-426a-ab76-64cb519470e9 req-0068bdcf-09b5-4831-98c6-5585a6915482 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:06.307043 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-871c2e83-5044-426a-ab76-64cb519470e9 req-0068bdcf-09b5-4831-98c6-5585a6915482 service nova] Creating event network-vif-deleted:c758f20a-4f3b-4a22-a4ce-bd3cc37ac921 for instance 2e1dd9b9-6785-405b-b5be-83d881463fe2 on n-h2-839401-11 Aug 29 16:17:06.313713 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-871c2e83-5044-426a-ab76-64cb519470e9 req-0068bdcf-09b5-4831-98c6-5585a6915482 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036321 Aug 29 16:17:06.314960 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3773/7321] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:17:06.328838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-942c46aa-decb-46bb-a9a9-01b371490fa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:06.337838 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-942c46aa-decb-46bb-a9a9-01b371490fa1 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1393 microversion: 2.1 time: 0.109794 Aug 29 16:17:06.338426 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3549/7322] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:06 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1393 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:07.362033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1a27466a-bb91-4999-83f6-df5c78b04d92 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:07.362823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1a27466a-bb91-4999-83f6-df5c78b04d92 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:07.369915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a27466a-bb91-4999-83f6-df5c78b04d92 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:07.370426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a27466a-bb91-4999-83f6-df5c78b04d92 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:07.370910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a27466a-bb91-4999-83f6-df5c78b04d92 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:07.371635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a27466a-bb91-4999-83f6-df5c78b04d92 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:07.372114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a27466a-bb91-4999-83f6-df5c78b04d92 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:07.372562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a27466a-bb91-4999-83f6-df5c78b04d92 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:07.441257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1a27466a-bb91-4999-83f6-df5c78b04d92 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:07.449568 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1a27466a-bb91-4999-83f6-df5c78b04d92 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1226 microversion: 2.1 time: 0.093021 Aug 29 16:17:07.450406 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3774/7323] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:07 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:08.470961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-01871afc-a694-4d73-a898-4c364b9b94d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:08.471534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-01871afc-a694-4d73-a898-4c364b9b94d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:08.478847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01871afc-a694-4d73-a898-4c364b9b94d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:08.479347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01871afc-a694-4d73-a898-4c364b9b94d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:08.479792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01871afc-a694-4d73-a898-4c364b9b94d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:08.480504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01871afc-a694-4d73-a898-4c364b9b94d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:08.481328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01871afc-a694-4d73-a898-4c364b9b94d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:08.481756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-01871afc-a694-4d73-a898-4c364b9b94d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:08.547817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-01871afc-a694-4d73-a898-4c364b9b94d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:08.556255 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-01871afc-a694-4d73-a898-4c364b9b94d5 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1226 microversion: 2.1 time: 0.089514 Aug 29 16:17:08.556836 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3550/7324] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:08 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:09.580627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dcdb042d-cd52-44e3-b735-1963363cf802 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:09.581437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dcdb042d-cd52-44e3-b735-1963363cf802 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:09.589019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcdb042d-cd52-44e3-b735-1963363cf802 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:09.589566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcdb042d-cd52-44e3-b735-1963363cf802 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:09.590024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcdb042d-cd52-44e3-b735-1963363cf802 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:09.590759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcdb042d-cd52-44e3-b735-1963363cf802 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:09.591259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcdb042d-cd52-44e3-b735-1963363cf802 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:09.591684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dcdb042d-cd52-44e3-b735-1963363cf802 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:09.663678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dcdb042d-cd52-44e3-b735-1963363cf802 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:09.672934 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dcdb042d-cd52-44e3-b735-1963363cf802 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1226 microversion: 2.1 time: 0.098654 Aug 29 16:17:09.673657 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3775/7325] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:09 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:10.693881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3885b132-ea3a-4f73-b39d-0104a1854d3e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:10.696356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3885b132-ea3a-4f73-b39d-0104a1854d3e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:10.704382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3885b132-ea3a-4f73-b39d-0104a1854d3e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:10.704963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3885b132-ea3a-4f73-b39d-0104a1854d3e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:10.705496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3885b132-ea3a-4f73-b39d-0104a1854d3e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:10.706309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3885b132-ea3a-4f73-b39d-0104a1854d3e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:10.706866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3885b132-ea3a-4f73-b39d-0104a1854d3e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:10.707369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3885b132-ea3a-4f73-b39d-0104a1854d3e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:10.742987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3885b132-ea3a-4f73-b39d-0104a1854d3e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:10.743395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3885b132-ea3a-4f73-b39d-0104a1854d3e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:10.743899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3885b132-ea3a-4f73-b39d-0104a1854d3e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:10.744373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-3885b132-ea3a-4f73-b39d-0104a1854d3e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lazy-loading 'fault' on Instance uuid 2e1dd9b9-6785-405b-b5be-83d881463fe2 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:17:10.785681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3885b132-ea3a-4f73-b39d-0104a1854d3e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:10.793740 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3885b132-ea3a-4f73-b39d-0104a1854d3e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 200 len: 1231 microversion: 2.1 time: 0.104100 Aug 29 16:17:10.794319 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3551/7326] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:10 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 1231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:11.814854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-291b247c-42c4-40c7-9baf-906d10aca16f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:11.815527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-291b247c-42c4-40c7-9baf-906d10aca16f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 2e1dd9b9-6785-405b-b5be-83d881463fe2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:11.823768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-291b247c-42c4-40c7-9baf-906d10aca16f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:11.824360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-291b247c-42c4-40c7-9baf-906d10aca16f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:11.824868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-291b247c-42c4-40c7-9baf-906d10aca16f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:11.825691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-291b247c-42c4-40c7-9baf-906d10aca16f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:11.826249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-291b247c-42c4-40c7-9baf-906d10aca16f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:11.826740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-291b247c-42c4-40c7-9baf-906d10aca16f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:11.841470 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-291b247c-42c4-40c7-9baf-906d10aca16f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] HTTP exception thrown: Instance 2e1dd9b9-6785-405b-b5be-83d881463fe2 could not be found. Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-291b247c-42c4-40c7-9baf-906d10aca16f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Request method failure captured: Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 HTTP/1.1 Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOPVKb3AKf05JOTmVWxg_YSLh_6aJQ1fwERqtRCNq2OGA-TgfvjQkO776TgAknFFnCA3k1v6BcT_thZ3YV-DMceZELFHu1q-Z_h1mjuaQAa75Kym14h4m_K8QcmdN6yIk-IwhACLHvRJHqBNwAzk2eiJecAZxJFQO9-ZjVx01ZUPXeU Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_688ed04d399247f0ac8a204967cdfa2a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}] Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestVolumeBootPattern-201560010 Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: f07d896c6764402999345759f2348080 Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 2e1dd9b9-6785-405b-b5be-83d881463fe2 could not be found. Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '2e1dd9b9-6785-405b-b5be-83d881463fe2'} Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1dd9b9-6785-405b-b5be-83d881463fe2 could not be found. Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1dd9b9-6785-405b-b5be-83d881463fe2 could not be found. Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:11.843176 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:17:11.847517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:11.847517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:11.847517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:11.847517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:11.847517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:11.847517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1dd9b9-6785-405b-b5be-83d881463fe2 could not be found. Aug 29 16:17:11.847517 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:17:11.847517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-291b247c-42c4-40c7-9baf-906d10aca16f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Returning 404 to user: Instance 2e1dd9b9-6785-405b-b5be-83d881463fe2 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:11.847517 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-291b247c-42c4-40c7-9baf-906d10aca16f tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2" status: 404 len: 111 microversion: 2.1 time: 0.034333 Aug 29 16:17:11.847517 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3776/7327] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:11 2022] GET /compute/v2.1/servers/2e1dd9b9-6785-405b-b5be-83d881463fe2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:18.142459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-87da5de4-23f7-4ca2-b790-6e15dd1937f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:18.142960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-87da5de4-23f7-4ca2-b790-6e15dd1937f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:18.144475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-0d1382d6-4a8a-4193-8755-f2b46a3e16f4 req-a5fcf885-1f6c-4a3e-ab10-a71a835a84d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86222f5-e0ca-4e09-8601-7c28597c1338", "tag": "aa335498-8803-4a83-9df8-614c3884f4b8"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:18.151274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87da5de4-23f7-4ca2-b790-6e15dd1937f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:18.151747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87da5de4-23f7-4ca2-b790-6e15dd1937f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:18.152380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87da5de4-23f7-4ca2-b790-6e15dd1937f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:18.153300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87da5de4-23f7-4ca2-b790-6e15dd1937f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:18.153959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87da5de4-23f7-4ca2-b790-6e15dd1937f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:18.154627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87da5de4-23f7-4ca2-b790-6e15dd1937f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:18.155907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0d1382d6-4a8a-4193-8755-f2b46a3e16f4 req-a5fcf885-1f6c-4a3e-ab10-a71a835a84d5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:18.156725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0d1382d6-4a8a-4193-8755-f2b46a3e16f4 req-a5fcf885-1f6c-4a3e-ab10-a71a835a84d5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:18.157382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0d1382d6-4a8a-4193-8755-f2b46a3e16f4 req-a5fcf885-1f6c-4a3e-ab10-a71a835a84d5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:18.169446 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-0d1382d6-4a8a-4193-8755-f2b46a3e16f4 req-a5fcf885-1f6c-4a3e-ab10-a71a835a84d5 service nova] Creating event network-changed:aa335498-8803-4a83-9df8-614c3884f4b8 for instance f86222f5-e0ca-4e09-8601-7c28597c1338 on n-h1-839401-11 Aug 29 16:17:18.175200 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-0d1382d6-4a8a-4193-8755-f2b46a3e16f4 req-a5fcf885-1f6c-4a3e-ab10-a71a835a84d5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034427 Aug 29 16:17:18.176108 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3777/7328] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:17:18.181807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-87da5de4-23f7-4ca2-b790-6e15dd1937f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:17:18.272846 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-87da5de4-23f7-4ca2-b790-6e15dd1937f4 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 204 len: 0 microversion: 2.1 time: 0.134106 Aug 29 16:17:18.273494 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3552/7329] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:18 2022] DELETE /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:17:18.282724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c1d8c270-381f-48f5-855f-60f887cd88c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:18.283441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c1d8c270-381f-48f5-855f-60f887cd88c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:18.290255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1d8c270-381f-48f5-855f-60f887cd88c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:18.290766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1d8c270-381f-48f5-855f-60f887cd88c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:18.291241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1d8c270-381f-48f5-855f-60f887cd88c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:18.291995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1d8c270-381f-48f5-855f-60f887cd88c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:18.292469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1d8c270-381f-48f5-855f-60f887cd88c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:18.292912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1d8c270-381f-48f5-855f-60f887cd88c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:18.430396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c1d8c270-381f-48f5-855f-60f887cd88c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:18.438567 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c1d8c270-381f-48f5-855f-60f887cd88c3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1579 microversion: 2.1 time: 0.160330 Aug 29 16:17:18.439181 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3778/7330] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:18 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:19.460548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cb916fc8-c715-4fde-940d-b94d65b9532e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:19.461912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cb916fc8-c715-4fde-940d-b94d65b9532e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:19.468966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb916fc8-c715-4fde-940d-b94d65b9532e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:19.469496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb916fc8-c715-4fde-940d-b94d65b9532e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:19.469957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb916fc8-c715-4fde-940d-b94d65b9532e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:19.470666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb916fc8-c715-4fde-940d-b94d65b9532e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:19.471132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb916fc8-c715-4fde-940d-b94d65b9532e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:19.471572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb916fc8-c715-4fde-940d-b94d65b9532e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:19.638698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cb916fc8-c715-4fde-940d-b94d65b9532e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:19.650420 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cb916fc8-c715-4fde-940d-b94d65b9532e tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1579 microversion: 2.1 time: 0.194150 Aug 29 16:17:19.651208 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3553/7331] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:19 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1579 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:20.672187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-795d6744-d3dc-402d-88f5-a7063c08ed7a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:20.672820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-795d6744-d3dc-402d-88f5-a7063c08ed7a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:20.680401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-795d6744-d3dc-402d-88f5-a7063c08ed7a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:20.680936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-795d6744-d3dc-402d-88f5-a7063c08ed7a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:20.681425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-795d6744-d3dc-402d-88f5-a7063c08ed7a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:20.682150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-795d6744-d3dc-402d-88f5-a7063c08ed7a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:20.682652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-795d6744-d3dc-402d-88f5-a7063c08ed7a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:20.683089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-795d6744-d3dc-402d-88f5-a7063c08ed7a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:20.719205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-760e8c86-77d8-447b-b880-5aa3c4c2b526 req-0a48baa3-a155-4442-b7a8-366ccf500bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86222f5-e0ca-4e09-8601-7c28597c1338", "name": "network-vif-deleted", "tag": "aa335498-8803-4a83-9df8-614c3884f4b8"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:20.730530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-760e8c86-77d8-447b-b880-5aa3c4c2b526 req-0a48baa3-a155-4442-b7a8-366ccf500bde service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:20.731036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-760e8c86-77d8-447b-b880-5aa3c4c2b526 req-0a48baa3-a155-4442-b7a8-366ccf500bde service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:20.731475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-760e8c86-77d8-447b-b880-5aa3c4c2b526 req-0a48baa3-a155-4442-b7a8-366ccf500bde service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:20.743802 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-760e8c86-77d8-447b-b880-5aa3c4c2b526 req-0a48baa3-a155-4442-b7a8-366ccf500bde service nova] Creating event network-vif-deleted:aa335498-8803-4a83-9df8-614c3884f4b8 for instance f86222f5-e0ca-4e09-8601-7c28597c1338 on n-h1-839401-11 Aug 29 16:17:20.749057 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-760e8c86-77d8-447b-b880-5aa3c4c2b526 req-0a48baa3-a155-4442-b7a8-366ccf500bde service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033695 Aug 29 16:17:20.749766 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3554/7332] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:17:20.758397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-795d6744-d3dc-402d-88f5-a7063c08ed7a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:20.766534 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-795d6744-d3dc-402d-88f5-a7063c08ed7a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1392 microversion: 2.1 time: 0.098585 Aug 29 16:17:20.767140 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3779/7333] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:20 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1392 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:21.790047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c2a8c53d-3c29-491b-a2a9-c982f64fe0f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.790743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c2a8c53d-3c29-491b-a2a9-c982f64fe0f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.797581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c2a8c53d-3c29-491b-a2a9-c982f64fe0f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.798074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c2a8c53d-3c29-491b-a2a9-c982f64fe0f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.798542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c2a8c53d-3c29-491b-a2a9-c982f64fe0f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.799234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c2a8c53d-3c29-491b-a2a9-c982f64fe0f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.799698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c2a8c53d-3c29-491b-a2a9-c982f64fe0f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.800133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c2a8c53d-3c29-491b-a2a9-c982f64fe0f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.869826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c2a8c53d-3c29-491b-a2a9-c982f64fe0f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:21.878437 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c2a8c53d-3c29-491b-a2a9-c982f64fe0f3 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1226 microversion: 2.1 time: 0.093835 Aug 29 16:17:21.879001 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3555/7334] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:21 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:22.899711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2bd969fe-7aff-4508-8c27-e44f85d3951a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:22.900366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2bd969fe-7aff-4508-8c27-e44f85d3951a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:22.907695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2bd969fe-7aff-4508-8c27-e44f85d3951a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:22.908213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2bd969fe-7aff-4508-8c27-e44f85d3951a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:22.908667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2bd969fe-7aff-4508-8c27-e44f85d3951a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:22.909442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2bd969fe-7aff-4508-8c27-e44f85d3951a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:22.909922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2bd969fe-7aff-4508-8c27-e44f85d3951a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:22.910368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2bd969fe-7aff-4508-8c27-e44f85d3951a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:22.974826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2bd969fe-7aff-4508-8c27-e44f85d3951a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:22.983543 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2bd969fe-7aff-4508-8c27-e44f85d3951a tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1226 microversion: 2.1 time: 0.087992 Aug 29 16:17:22.984142 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3780/7335] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:22 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:24.004598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9eeec888-4721-4098-93cf-65099c3b7b10 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:24.005259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9eeec888-4721-4098-93cf-65099c3b7b10 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:24.012773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eeec888-4721-4098-93cf-65099c3b7b10 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:24.013327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eeec888-4721-4098-93cf-65099c3b7b10 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:24.013776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eeec888-4721-4098-93cf-65099c3b7b10 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:24.014675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eeec888-4721-4098-93cf-65099c3b7b10 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:24.015149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eeec888-4721-4098-93cf-65099c3b7b10 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:24.015587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9eeec888-4721-4098-93cf-65099c3b7b10 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:24.081824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9eeec888-4721-4098-93cf-65099c3b7b10 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:24.090607 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9eeec888-4721-4098-93cf-65099c3b7b10 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1226 microversion: 2.1 time: 0.090282 Aug 29 16:17:24.091220 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3556/7336] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:23 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:25.114998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c1420e62-ac79-45b1-a923-b77ad7dcb862 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:25.115582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c1420e62-ac79-45b1-a923-b77ad7dcb862 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:25.123556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1420e62-ac79-45b1-a923-b77ad7dcb862 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:25.124091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1420e62-ac79-45b1-a923-b77ad7dcb862 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:25.124578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1420e62-ac79-45b1-a923-b77ad7dcb862 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:25.125418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1420e62-ac79-45b1-a923-b77ad7dcb862 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:25.125915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1420e62-ac79-45b1-a923-b77ad7dcb862 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:25.126399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1420e62-ac79-45b1-a923-b77ad7dcb862 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:25.159881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1420e62-ac79-45b1-a923-b77ad7dcb862 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:25.160385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1420e62-ac79-45b1-a923-b77ad7dcb862 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:25.160849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1420e62-ac79-45b1-a923-b77ad7dcb862 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:25.161376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-c1420e62-ac79-45b1-a923-b77ad7dcb862 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lazy-loading 'fault' on Instance uuid f86222f5-e0ca-4e09-8601-7c28597c1338 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:17:25.204372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c1420e62-ac79-45b1-a923-b77ad7dcb862 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07d896c6764402999345759f2348080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688ed04d399247f0ac8a204967cdfa2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:25.215539 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c1420e62-ac79-45b1-a923-b77ad7dcb862 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 200 len: 1231 microversion: 2.1 time: 0.105489 Aug 29 16:17:25.221391 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3781/7337] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:25 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 1231 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:26.241878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f13828af-b17c-48c2-864b-3550a1e88dcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:26.242734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f13828af-b17c-48c2-864b-3550a1e88dcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: f86222f5-e0ca-4e09-8601-7c28597c1338] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:26.253016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f13828af-b17c-48c2-864b-3550a1e88dcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:26.253553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f13828af-b17c-48c2-864b-3550a1e88dcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:26.254002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f13828af-b17c-48c2-864b-3550a1e88dcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:26.254709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f13828af-b17c-48c2-864b-3550a1e88dcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:26.255178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f13828af-b17c-48c2-864b-3550a1e88dcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:26.255615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f13828af-b17c-48c2-864b-3550a1e88dcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:26.269692 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-f13828af-b17c-48c2-864b-3550a1e88dcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] HTTP exception thrown: Instance f86222f5-e0ca-4e09-8601-7c28597c1338 could not be found. Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f13828af-b17c-48c2-864b-3550a1e88dcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Request method failure captured: Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 HTTP/1.1 Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOPVKb3AKf05JOTmVWxg_YSLh_6aJQ1fwERqtRCNq2OGA-TgfvjQkO776TgAknFFnCA3k1v6BcT_thZ3YV-DMceZELFHu1q-Z_h1mjuaQAa75Kym14h4m_K8QcmdN6yIk-IwhACLHvRJHqBNwAzk2eiJecAZxJFQO9-ZjVx01ZUPXeU Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_688ed04d399247f0ac8a204967cdfa2a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}] Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestVolumeBootPattern-201560010 Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: f07d896c6764402999345759f2348080 Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance f86222f5-e0ca-4e09-8601-7c28597c1338 could not be found. Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'f86222f5-e0ca-4e09-8601-7c28597c1338'} Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86222f5-e0ca-4e09-8601-7c28597c1338 could not be found. Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86222f5-e0ca-4e09-8601-7c28597c1338 could not be found. Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:26.271385 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.274991 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:26.274991 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:26.274991 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:26.274991 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:26.274991 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:26.274991 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86222f5-e0ca-4e09-8601-7c28597c1338 could not be found. Aug 29 16:17:26.274991 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.274991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f13828af-b17c-48c2-864b-3550a1e88dcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Returning 404 to user: Instance f86222f5-e0ca-4e09-8601-7c28597c1338 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:26.274991 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f13828af-b17c-48c2-864b-3550a1e88dcf tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338" status: 404 len: 111 microversion: 2.1 time: 0.037964 Aug 29 16:17:26.274991 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3557/7338] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:26 2022] GET /compute/v2.1/servers/f86222f5-e0ca-4e09-8601-7c28597c1338 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:26.731271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c1bd0a73-a4ae-4406-9af7-6460bf1ad366 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:26.731771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c1bd0a73-a4ae-4406-9af7-6460bf1ad366 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:26.738969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bd0a73-a4ae-4406-9af7-6460bf1ad366 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:26.739475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bd0a73-a4ae-4406-9af7-6460bf1ad366 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:26.739934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bd0a73-a4ae-4406-9af7-6460bf1ad366 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:26.740674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bd0a73-a4ae-4406-9af7-6460bf1ad366 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:26.741177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bd0a73-a4ae-4406-9af7-6460bf1ad366 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:26.741625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c1bd0a73-a4ae-4406-9af7-6460bf1ad366 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:26.757856 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-c1bd0a73-a4ae-4406-9af7-6460bf1ad366 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] HTTP exception thrown: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c1bd0a73-a4ae-4406-9af7-6460bf1ad366 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Request method failure captured: Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b HTTP/1.1 Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOPVKb3AKf05JOTmVWxg_YSLh_6aJQ1fwERqtRCNq2OGA-TgfvjQkO776TgAknFFnCA3k1v6BcT_thZ3YV-DMceZELFHu1q-Z_h1mjuaQAa75Kym14h4m_K8QcmdN6yIk-IwhACLHvRJHqBNwAzk2eiJecAZxJFQO9-ZjVx01ZUPXeU Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_688ed04d399247f0ac8a204967cdfa2a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}] Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestVolumeBootPattern-201560010 Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: f07d896c6764402999345759f2348080 Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '78a123e9-9e6e-4b33-8cfd-68c12107984b'} Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:26.759445 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:26.763343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. Aug 29 16:17:26.763343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.763343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:26.763343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.763343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:26.763343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:26.763343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:26.763343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:26.763343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:26.763343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. Aug 29 16:17:26.763343 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.763343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c1bd0a73-a4ae-4406-9af7-6460bf1ad366 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Returning 404 to user: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:26.763343 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c1bd0a73-a4ae-4406-9af7-6460bf1ad366 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "DELETE /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 404 len: 111 microversion: 2.1 time: 0.034116 Aug 29 16:17:26.763343 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3782/7339] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:26 2022] DELETE /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:26.769818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-86504eac-fdf2-425f-a8a7-6bab8acf20f2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:26.770464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-86504eac-fdf2-425f-a8a7-6bab8acf20f2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] [instance: 78a123e9-9e6e-4b33-8cfd-68c12107984b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:26.776537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86504eac-fdf2-425f-a8a7-6bab8acf20f2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:26.777025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86504eac-fdf2-425f-a8a7-6bab8acf20f2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:26.777512 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86504eac-fdf2-425f-a8a7-6bab8acf20f2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:26.778199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86504eac-fdf2-425f-a8a7-6bab8acf20f2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:26.778687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86504eac-fdf2-425f-a8a7-6bab8acf20f2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:26.779112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86504eac-fdf2-425f-a8a7-6bab8acf20f2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:26.796240 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-86504eac-fdf2-425f-a8a7-6bab8acf20f2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] HTTP exception thrown: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-86504eac-fdf2-425f-a8a7-6bab8acf20f2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Request method failure captured: Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b HTTP/1.1 Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOPVKb3AKf05JOTmVWxg_YSLh_6aJQ1fwERqtRCNq2OGA-TgfvjQkO776TgAknFFnCA3k1v6BcT_thZ3YV-DMceZELFHu1q-Z_h1mjuaQAa75Kym14h4m_K8QcmdN6yIk-IwhACLHvRJHqBNwAzk2eiJecAZxJFQO9-ZjVx01ZUPXeU Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_688ed04d399247f0ac8a204967cdfa2a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/688ed04d399247f0ac8a204967cdfa2a"}]}] Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestVolumeBootPattern-201560010 Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 688ed04d399247f0ac8a204967cdfa2a Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestVolumeBootPattern-201560010 Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: f07d896c6764402999345759f2348080 Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestVolumeBootPattern-201560010-project Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '78a123e9-9e6e-4b33-8cfd-68c12107984b'} Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:26.797921 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.802008 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:26.802008 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:26.802008 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:26.802008 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:26.802008 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:26.802008 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. Aug 29 16:17:26.802008 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:17:26.802008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-86504eac-fdf2-425f-a8a7-6bab8acf20f2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Returning 404 to user: Instance 78a123e9-9e6e-4b33-8cfd-68c12107984b could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:26.802008 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-86504eac-fdf2-425f-a8a7-6bab8acf20f2 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b" status: 404 len: 111 microversion: 2.1 time: 0.033571 Aug 29 16:17:26.802008 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3558/7340] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:26 2022] GET /compute/v2.1/servers/78a123e9-9e6e-4b33-8cfd-68c12107984b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:30.242613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-37380820-bd41-4b24-96fa-cad692aa5650 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] Calling method '.version_select at 0x7fc42a9ca700>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:30.295053 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-37380820-bd41-4b24-96fa-cad692aa5650 tempest-TestVolumeBootPattern-201560010 tempest-TestVolumeBootPattern-201560010-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1233251043" status: 202 len: 0 microversion: 2.1 time: 0.056268 Aug 29 16:17:30.295747 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3783/7341] 10.222.0.62 () {58 vars in 1263 bytes} [Mon Aug 29 16:17:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1233251043 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:17:49.314911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:49.315678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:49.442574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-414441988", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:49.499509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] validate_networks() for None {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:17:49.697638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:17:49.698238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:17:49.698944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:17:49.699523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:17:49.700120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:17:49.713204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:49.713617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:49.714048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:49.714779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:49.715232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:49.715690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:49.738419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Getting quotas for project c54a29f1809f404280cd0e5ba42d3e9a. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:17:49.744608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Getting quotas for user 34785fc699ed40d88bd6f1329518cf23 and project c54a29f1809f404280cd0e5ba42d3e9a. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:17:49.757350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:17:49.759750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:17:49.807620 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-27869d6e-70da-4ed0-bc04-5f9490f8e0f5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500855 Aug 29 16:17:49.808519 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3559/7342] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:17:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:17:49.819121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:49.820604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:49.824764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5f79d5d1-4753-4df1-b856-402a7f03bf4b tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:49.825452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5f79d5d1-4753-4df1-b856-402a7f03bf4b tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:49.906064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5f79d5d1-4753-4df1-b856-402a7f03bf4b tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34785fc699ed40d88bd6f1329518cf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a29f1809f404280cd0e5ba42d3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:49.913609 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5f79d5d1-4753-4df1-b856-402a7f03bf4b tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] 10.222.0.62 "GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592" status: 200 len: 1221 microversion: 2.1 time: 0.096208 Aug 29 16:17:49.914312 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3784/7343] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:49 2022] GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592 => generated 1221 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:50.941394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2746683a-cfcf-4de5-bd5f-d8a0940798c8 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:50.942805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2746683a-cfcf-4de5-bd5f-d8a0940798c8 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:50.949686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2746683a-cfcf-4de5-bd5f-d8a0940798c8 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:50.950177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2746683a-cfcf-4de5-bd5f-d8a0940798c8 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:50.950628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2746683a-cfcf-4de5-bd5f-d8a0940798c8 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:50.951323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2746683a-cfcf-4de5-bd5f-d8a0940798c8 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:50.951778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2746683a-cfcf-4de5-bd5f-d8a0940798c8 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:50.952206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2746683a-cfcf-4de5-bd5f-d8a0940798c8 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:51.017362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2746683a-cfcf-4de5-bd5f-d8a0940798c8 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34785fc699ed40d88bd6f1329518cf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a29f1809f404280cd0e5ba42d3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:51.025593 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2746683a-cfcf-4de5-bd5f-d8a0940798c8 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] 10.222.0.62 "GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592" status: 200 len: 1273 microversion: 2.1 time: 0.092330 Aug 29 16:17:51.026199 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3560/7344] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:50 2022] GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:52.048394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-322c8bc9-bcbc-4d5f-9e33-5f700f723448 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:52.049434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-322c8bc9-bcbc-4d5f-9e33-5f700f723448 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:52.059279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-322c8bc9-bcbc-4d5f-9e33-5f700f723448 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:52.059921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-322c8bc9-bcbc-4d5f-9e33-5f700f723448 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:52.060582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-322c8bc9-bcbc-4d5f-9e33-5f700f723448 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:52.061384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-322c8bc9-bcbc-4d5f-9e33-5f700f723448 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:52.061832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-322c8bc9-bcbc-4d5f-9e33-5f700f723448 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:52.062308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-322c8bc9-bcbc-4d5f-9e33-5f700f723448 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:52.209682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-322c8bc9-bcbc-4d5f-9e33-5f700f723448 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34785fc699ed40d88bd6f1329518cf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a29f1809f404280cd0e5ba42d3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:52.217894 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-322c8bc9-bcbc-4d5f-9e33-5f700f723448 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] 10.222.0.62 "GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592" status: 200 len: 1321 microversion: 2.1 time: 0.174011 Aug 29 16:17:52.218485 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3785/7345] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:52 2022] GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:52.869064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-12c9c5c2-7d3c-4046-9adc-c92e671bfcad req-21672cc2-a402-478d-8f0d-2fd83fc19af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "117865bb-40ca-4131-b2eb-5d02fe095592", "tag": "96fb5c84-0405-40c9-a0ed-752e006292b9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:52.880045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-12c9c5c2-7d3c-4046-9adc-c92e671bfcad req-21672cc2-a402-478d-8f0d-2fd83fc19af9 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:52.880550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-12c9c5c2-7d3c-4046-9adc-c92e671bfcad req-21672cc2-a402-478d-8f0d-2fd83fc19af9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:52.880979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-12c9c5c2-7d3c-4046-9adc-c92e671bfcad req-21672cc2-a402-478d-8f0d-2fd83fc19af9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:52.893238 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-12c9c5c2-7d3c-4046-9adc-c92e671bfcad req-21672cc2-a402-478d-8f0d-2fd83fc19af9 service nova] Creating event network-changed:96fb5c84-0405-40c9-a0ed-752e006292b9 for instance 117865bb-40ca-4131-b2eb-5d02fe095592 on n-h1-839401-11 Aug 29 16:17:52.899530 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-12c9c5c2-7d3c-4046-9adc-c92e671bfcad req-21672cc2-a402-478d-8f0d-2fd83fc19af9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107184 Aug 29 16:17:52.900188 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3561/7346] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:17:53.239704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-215a81ed-c67d-4617-a640-c90a8f0c4867 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:53.240399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-215a81ed-c67d-4617-a640-c90a8f0c4867 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:53.248013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215a81ed-c67d-4617-a640-c90a8f0c4867 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:53.248525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215a81ed-c67d-4617-a640-c90a8f0c4867 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:53.248983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215a81ed-c67d-4617-a640-c90a8f0c4867 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:53.249737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215a81ed-c67d-4617-a640-c90a8f0c4867 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:53.250294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215a81ed-c67d-4617-a640-c90a8f0c4867 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:53.250640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215a81ed-c67d-4617-a640-c90a8f0c4867 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:53.389914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-215a81ed-c67d-4617-a640-c90a8f0c4867 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34785fc699ed40d88bd6f1329518cf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a29f1809f404280cd0e5ba42d3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:53.398132 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-215a81ed-c67d-4617-a640-c90a8f0c4867 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] 10.222.0.62 "GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592" status: 200 len: 1321 microversion: 2.1 time: 0.162524 Aug 29 16:17:53.398694 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3786/7347] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:53 2022] GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:54.425548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f8a150aa-6fd0-44c4-8d52-223fb98df388 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:54.426780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f8a150aa-6fd0-44c4-8d52-223fb98df388 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:54.433868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8a150aa-6fd0-44c4-8d52-223fb98df388 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:54.434372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8a150aa-6fd0-44c4-8d52-223fb98df388 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:54.434817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8a150aa-6fd0-44c4-8d52-223fb98df388 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:54.435515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8a150aa-6fd0-44c4-8d52-223fb98df388 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:54.435972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8a150aa-6fd0-44c4-8d52-223fb98df388 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:54.436399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8a150aa-6fd0-44c4-8d52-223fb98df388 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:54.574706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f8a150aa-6fd0-44c4-8d52-223fb98df388 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34785fc699ed40d88bd6f1329518cf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a29f1809f404280cd0e5ba42d3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:54.583061 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f8a150aa-6fd0-44c4-8d52-223fb98df388 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] 10.222.0.62 "GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592" status: 200 len: 1321 microversion: 2.1 time: 0.166140 Aug 29 16:17:54.583625 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3562/7348] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:54 2022] GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:55.604823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-904a59b6-b5c9-48ef-ade1-b917670203d5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:55.605823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-904a59b6-b5c9-48ef-ade1-b917670203d5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:55.614574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-904a59b6-b5c9-48ef-ade1-b917670203d5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:55.615088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-904a59b6-b5c9-48ef-ade1-b917670203d5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:55.615544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-904a59b6-b5c9-48ef-ade1-b917670203d5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:55.616300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-904a59b6-b5c9-48ef-ade1-b917670203d5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:55.616779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-904a59b6-b5c9-48ef-ade1-b917670203d5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:55.617266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-904a59b6-b5c9-48ef-ade1-b917670203d5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:55.777903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-904a59b6-b5c9-48ef-ade1-b917670203d5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34785fc699ed40d88bd6f1329518cf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a29f1809f404280cd0e5ba42d3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:55.786006 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-904a59b6-b5c9-48ef-ade1-b917670203d5 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] 10.222.0.62 "GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592" status: 200 len: 1321 microversion: 2.1 time: 0.185552 Aug 29 16:17:55.786843 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3787/7349] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:55 2022] GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:56.811466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a3f6ab64-1849-4431-9faa-9d9c252cb632 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:56.812478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a3f6ab64-1849-4431-9faa-9d9c252cb632 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:56.822795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f6ab64-1849-4431-9faa-9d9c252cb632 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:56.823417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f6ab64-1849-4431-9faa-9d9c252cb632 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:56.823862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f6ab64-1849-4431-9faa-9d9c252cb632 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:56.824585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f6ab64-1849-4431-9faa-9d9c252cb632 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:56.825047 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f6ab64-1849-4431-9faa-9d9c252cb632 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:56.825511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3f6ab64-1849-4431-9faa-9d9c252cb632 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:56.958967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a3f6ab64-1849-4431-9faa-9d9c252cb632 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34785fc699ed40d88bd6f1329518cf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a29f1809f404280cd0e5ba42d3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:56.966908 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a3f6ab64-1849-4431-9faa-9d9c252cb632 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] 10.222.0.62 "GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592" status: 200 len: 1321 microversion: 2.1 time: 0.162314 Aug 29 16:17:56.967488 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3563/7350] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:56 2022] GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:57.895918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-6211423e-7fa8-4781-880e-a960f98345a5 req-e94981c7-6276-4a2d-b3fe-2f28a3f1c6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117865bb-40ca-4131-b2eb-5d02fe095592", "name": "network-vif-plugged", "status": "completed", "tag": "96fb5c84-0405-40c9-a0ed-752e006292b9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:57.907072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6211423e-7fa8-4781-880e-a960f98345a5 req-e94981c7-6276-4a2d-b3fe-2f28a3f1c6b7 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:57.907570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6211423e-7fa8-4781-880e-a960f98345a5 req-e94981c7-6276-4a2d-b3fe-2f28a3f1c6b7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:57.908016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6211423e-7fa8-4781-880e-a960f98345a5 req-e94981c7-6276-4a2d-b3fe-2f28a3f1c6b7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:57.920530 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-6211423e-7fa8-4781-880e-a960f98345a5 req-e94981c7-6276-4a2d-b3fe-2f28a3f1c6b7 service nova] Creating event network-vif-plugged:96fb5c84-0405-40c9-a0ed-752e006292b9 for instance 117865bb-40ca-4131-b2eb-5d02fe095592 on n-h1-839401-11 Aug 29 16:17:57.926397 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-6211423e-7fa8-4781-880e-a960f98345a5 req-e94981c7-6276-4a2d-b3fe-2f28a3f1c6b7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034475 Aug 29 16:17:57.926983 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3788/7351] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:17:57.988232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b6a67576-f7b3-4326-9960-1eb02dd010a7 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:57.988847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b6a67576-f7b3-4326-9960-1eb02dd010a7 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:57.996214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6a67576-f7b3-4326-9960-1eb02dd010a7 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:57.996704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6a67576-f7b3-4326-9960-1eb02dd010a7 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:57.997190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6a67576-f7b3-4326-9960-1eb02dd010a7 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:57.997895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6a67576-f7b3-4326-9960-1eb02dd010a7 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:57.998354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6a67576-f7b3-4326-9960-1eb02dd010a7 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:57.998781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6a67576-f7b3-4326-9960-1eb02dd010a7 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:58.202765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b6a67576-f7b3-4326-9960-1eb02dd010a7 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34785fc699ed40d88bd6f1329518cf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a29f1809f404280cd0e5ba42d3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:58.210931 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b6a67576-f7b3-4326-9960-1eb02dd010a7 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] 10.222.0.62 "GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592" status: 200 len: 1321 microversion: 2.1 time: 0.226839 Aug 29 16:17:58.211518 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3564/7352] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:57 2022] GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:59.244769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-efd26537-f81a-44fd-a3a3-9e6a5e9e0797 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:59.245910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-efd26537-f81a-44fd-a3a3-9e6a5e9e0797 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:59.257492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efd26537-f81a-44fd-a3a3-9e6a5e9e0797 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:59.257972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efd26537-f81a-44fd-a3a3-9e6a5e9e0797 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:59.258431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efd26537-f81a-44fd-a3a3-9e6a5e9e0797 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:59.259154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efd26537-f81a-44fd-a3a3-9e6a5e9e0797 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:59.259618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efd26537-f81a-44fd-a3a3-9e6a5e9e0797 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:59.260061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-efd26537-f81a-44fd-a3a3-9e6a5e9e0797 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:59.410677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-efd26537-f81a-44fd-a3a3-9e6a5e9e0797 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34785fc699ed40d88bd6f1329518cf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a29f1809f404280cd0e5ba42d3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:59.419164 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-efd26537-f81a-44fd-a3a3-9e6a5e9e0797 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] 10.222.0.62 "GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592" status: 200 len: 1321 microversion: 2.1 time: 0.182282 Aug 29 16:17:59.419750 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3789/7353] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:59 2022] GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:00.440019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f51b3a05-6fae-40f6-b086-c56ec5bb5d95 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:00.440643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f51b3a05-6fae-40f6-b086-c56ec5bb5d95 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:00.443668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:00.444400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:00.450329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f51b3a05-6fae-40f6-b086-c56ec5bb5d95 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:00.450797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f51b3a05-6fae-40f6-b086-c56ec5bb5d95 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:00.451254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f51b3a05-6fae-40f6-b086-c56ec5bb5d95 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:00.451963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f51b3a05-6fae-40f6-b086-c56ec5bb5d95 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:00.452424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f51b3a05-6fae-40f6-b086-c56ec5bb5d95 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:00.452853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f51b3a05-6fae-40f6-b086-c56ec5bb5d95 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:00.588740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f51b3a05-6fae-40f6-b086-c56ec5bb5d95 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34785fc699ed40d88bd6f1329518cf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a29f1809f404280cd0e5ba42d3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:00.597619 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f51b3a05-6fae-40f6-b086-c56ec5bb5d95 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] 10.222.0.62 "GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592" status: 200 len: 1471 microversion: 2.1 time: 0.161632 Aug 29 16:18:00.598256 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3565/7354] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:00 2022] GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:00.623531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:00.682505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-784bc875-ea0a-44f0-b9f2-226689b58ae7 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Calling method '.version_select at 0x7fc433ad34c0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:00.762949 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-784bc875-ea0a-44f0-b9f2-226689b58ae7 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/1c95550c69cc469483a13102b5576ace" status: 200 len: 371 microversion: 2.1 time: 0.144143 Aug 29 16:18:00.763528 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3790/7355] 10.222.0.62 () {58 vars in 1242 bytes} [Mon Aug 29 16:18:00 2022] GET /compute/v2.1/os-quota-sets/1c95550c69cc469483a13102b5576ace => generated 371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:18:00.775413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c8dcc30c-c75c-4f9b-9fb9-2cba61750bd4 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-997734482", "id": 639845587, "os-flavor-access:is_public": "True"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:00.796174 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c8dcc30c-c75c-4f9b-9fb9-2cba61750bd4 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.024760 Aug 29 16:18:00.796744 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3566/7356] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:18:00 2022] POST /compute/v2.1/flavors => generated 434 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:18:00.812212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "639845587"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:00.815962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:00.823587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:00.824092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:00.824546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:00.825305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:00.825806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:00.826241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:00.919784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd571eb8d753444ba826b2b2824f76e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c95550c69cc469483a13102b5576ace', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:00.926436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-997734482 {{(pid=122360) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:18:00.933742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:00.934240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:00.934696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:00.935434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:00.935901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:00.936333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:00.956884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Getting quotas for project c54a29f1809f404280cd0e5ba42d3e9a. Resources: {'ram', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:18:00.962144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Getting quotas for user 34785fc699ed40d88bd6f1329518cf23 and project c54a29f1809f404280cd0e5ba42d3e9a. Resources: {'ram', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:18:00.974848 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.compute.api [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] ram quota exceeded for 1c95550c69cc469483a13102b5576ace, tried to resize instance. Aug 29 16:18:00.975449 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Request method failure captured: Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592/action HTTP/1.1 Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 38 Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOatSj-8_xKEn8uQyEnDmhQthYWaH2FrLP8F5uaQ7Vo11ILyms-TBxR4yVIopePcTNI8mYaJo3wqWD2myJUA3r2lIOKonJar6Zz3lxZrN11-zCBgYz8g3UyXiybItihSOQYGlFII8t7FQH1HGgKUn_RQLuKukFReJ_lz307KVT33vl4 Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 1c95550c69cc469483a13102b5576ace Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2078464706 Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member,admin Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member,admin Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1c95550c69cc469483a13102b5576ace", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1c95550c69cc469483a13102b5576ace"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1c95550c69cc469483a13102b5576ace"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1c95550c69cc469483a13102b5576ace"}]}] Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2078464706 Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 1c95550c69cc469483a13102b5576ace Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2078464706 Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersAdminNegativeTestJSON-2078464706-project-admin Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: d571eb8d753444ba826b2b2824f76e18 Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2078464706-project-admin Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: {"resize": {"flavorRef": "639845587"}} Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '117865bb-40ca-4131-b2eb-5d02fe095592', 'body': {'resize': {'flavorRef': '639845587'}}} Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:18:00.982768 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2f9dff3e-f342-4895-8e77-ab147011f495 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592/action" status: 403 len: 118 microversion: 2.1 time: 0.178872 Aug 29 16:18:00.986796 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3791/7357] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:18:00 2022] POST /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592/action => generated 118 bytes in 181 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:18:00.993675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d23b2728-f35b-4d3c-b234-807978576d98 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:01.013896 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d23b2728-f35b-4d3c-b234-807978576d98 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/639845587" status: 202 len: 0 microversion: 2.1 time: 0.024286 Aug 29 16:18:01.014429 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3567/7358] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 16:18:00 2022] DELETE /compute/v2.1/flavors/639845587 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:18:01.022876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2606d0ab-e3e2-4469-9eb5-e8d66c86cd49 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:01.043712 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2606d0ab-e3e2-4469-9eb5-e8d66c86cd49 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024724 Aug 29 16:18:01.044414 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3792/7359] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 16:18:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:01.063935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-306969ff-537f-4ebc-8528-d68cd1a07710 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Calling method '.version_select at 0x7fc42aa68a60>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:01.143224 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-306969ff-537f-4ebc-8528-d68cd1a07710 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] 10.222.0.62 "GET /compute/v2.1/os-quota-sets/1c95550c69cc469483a13102b5576ace" status: 200 len: 371 microversion: 2.1 time: 0.082939 Aug 29 16:18:01.143923 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3568/7360] 10.222.0.62 () {58 vars in 1242 bytes} [Mon Aug 29 16:18:01 2022] GET /compute/v2.1/os-quota-sets/1c95550c69cc469483a13102b5576ace => generated 371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:18:01.155682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-412b4933-bd30-47a5-827e-2310d6eca4ec tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-20371737", "id": 360765842, "os-flavor-access:is_public": "True"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:01.176556 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-412b4933-bd30-47a5-827e-2310d6eca4ec tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.024720 Aug 29 16:18:01.177197 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3793/7361] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:18:01 2022] POST /compute/v2.1/flavors => generated 432 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:18:01.189154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "360765842"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:01.191570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:01.197837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:01.198329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:01.198767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:01.199461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:01.199915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:01.200333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:01.338978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd571eb8d753444ba826b2b2824f76e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c95550c69cc469483a13102b5576ace', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:01.346022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-20371737 {{(pid=122361) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:18:01.353247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:01.353722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:01.354496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:01.355220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:01.355680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:01.356106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:01.377073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Getting quotas for project c54a29f1809f404280cd0e5ba42d3e9a. Resources: {'ram', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:18:01.382564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Getting quotas for user 34785fc699ed40d88bd6f1329518cf23 and project c54a29f1809f404280cd0e5ba42d3e9a. Resources: {'ram', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:18:01.395914 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.compute.api [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] cores quota exceeded for 1c95550c69cc469483a13102b5576ace, tried to resize instance. Aug 29 16:18:01.396453 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Request method failure captured: Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592/action HTTP/1.1 Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 38 Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOatSj-8_xKEn8uQyEnDmhQthYWaH2FrLP8F5uaQ7Vo11ILyms-TBxR4yVIopePcTNI8mYaJo3wqWD2myJUA3r2lIOKonJar6Zz3lxZrN11-zCBgYz8g3UyXiybItihSOQYGlFII8t7FQH1HGgKUn_RQLuKukFReJ_lz307KVT33vl4 Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 1c95550c69cc469483a13102b5576ace Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2078464706 Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member,admin Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member,admin Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1c95550c69cc469483a13102b5576ace", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1c95550c69cc469483a13102b5576ace"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1c95550c69cc469483a13102b5576ace"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1c95550c69cc469483a13102b5576ace"}]}] Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2078464706 Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 1c95550c69cc469483a13102b5576ace Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2078464706 Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersAdminNegativeTestJSON-2078464706-project-admin Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: d571eb8d753444ba826b2b2824f76e18 Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2078464706-project-admin Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: {"resize": {"flavorRef": "360765842"}} Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '117865bb-40ca-4131-b2eb-5d02fe095592', 'body': {'resize': {'flavorRef': '360765842'}}} Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:18:01.398771 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5d88605b-6eed-4f74-89dc-b3daab780eef tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] 10.222.0.62 "POST /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592/action" status: 403 len: 113 microversion: 2.1 time: 0.215127 Aug 29 16:18:01.402414 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3569/7362] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:18:01 2022] POST /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592/action => generated 113 bytes in 216 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:18:01.409221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9b0e8266-55ac-4e88-a776-722d9131d626 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:01.433694 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9b0e8266-55ac-4e88-a776-722d9131d626 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] 10.222.0.62 "DELETE /compute/v2.1/flavors/360765842" status: 202 len: 0 microversion: 2.1 time: 0.027775 Aug 29 16:18:01.434329 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3794/7363] 10.222.0.62 () {58 vars in 1158 bytes} [Mon Aug 29 16:18:01 2022] DELETE /compute/v2.1/flavors/360765842 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:18:01.444973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9ec82df7-0d67-4e42-b477-617890d93961 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:01.465974 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9ec82df7-0d67-4e42-b477-617890d93961 tempest-ServersAdminNegativeTestJSON-2078464706 tempest-ServersAdminNegativeTestJSON-2078464706-project-admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026622 Aug 29 16:18:01.466502 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3570/7364] 10.222.0.62 () {58 vars in 1146 bytes} [Mon Aug 29 16:18:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:01.486545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d698b7a3-02f5-459b-854e-d15293722306 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:01.487067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d698b7a3-02f5-459b-854e-d15293722306 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:01.493774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d698b7a3-02f5-459b-854e-d15293722306 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:01.494310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d698b7a3-02f5-459b-854e-d15293722306 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:01.494777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d698b7a3-02f5-459b-854e-d15293722306 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:01.495585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d698b7a3-02f5-459b-854e-d15293722306 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:01.496057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d698b7a3-02f5-459b-854e-d15293722306 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:01.496494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d698b7a3-02f5-459b-854e-d15293722306 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:01.522619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d698b7a3-02f5-459b-854e-d15293722306 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:18:01.605870 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d698b7a3-02f5-459b-854e-d15293722306 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] 10.222.0.62 "DELETE /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592" status: 204 len: 0 microversion: 2.1 time: 0.122860 Aug 29 16:18:01.606845 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3795/7365] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:18:01 2022] DELETE /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:18:01.615482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-964a7ddb-3125-4a8a-90cb-0b9f874f16fb tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:01.616103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-964a7ddb-3125-4a8a-90cb-0b9f874f16fb tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:01.622315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-964a7ddb-3125-4a8a-90cb-0b9f874f16fb tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:01.622798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-964a7ddb-3125-4a8a-90cb-0b9f874f16fb tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:01.623244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-964a7ddb-3125-4a8a-90cb-0b9f874f16fb tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:01.623935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-964a7ddb-3125-4a8a-90cb-0b9f874f16fb tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:01.624389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-964a7ddb-3125-4a8a-90cb-0b9f874f16fb tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:01.624813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-964a7ddb-3125-4a8a-90cb-0b9f874f16fb tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:01.761461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-964a7ddb-3125-4a8a-90cb-0b9f874f16fb tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34785fc699ed40d88bd6f1329518cf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a29f1809f404280cd0e5ba42d3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:01.769766 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-964a7ddb-3125-4a8a-90cb-0b9f874f16fb tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] 10.222.0.62 "GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592" status: 200 len: 1477 microversion: 2.1 time: 0.158516 Aug 29 16:18:01.770379 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3571/7366] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:01 2022] GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592 => generated 1477 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:02.792900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9e8ef65b-5f3b-4545-b4f2-0880f89c540e tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:02.793658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9e8ef65b-5f3b-4545-b4f2-0880f89c540e tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:02.800918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e8ef65b-5f3b-4545-b4f2-0880f89c540e tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:02.801445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e8ef65b-5f3b-4545-b4f2-0880f89c540e tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:02.801900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e8ef65b-5f3b-4545-b4f2-0880f89c540e tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:02.802629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e8ef65b-5f3b-4545-b4f2-0880f89c540e tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:02.803074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e8ef65b-5f3b-4545-b4f2-0880f89c540e tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:02.803513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e8ef65b-5f3b-4545-b4f2-0880f89c540e tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:02.939448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e8ef65b-5f3b-4545-b4f2-0880f89c540e tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34785fc699ed40d88bd6f1329518cf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a29f1809f404280cd0e5ba42d3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:02.948009 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9e8ef65b-5f3b-4545-b4f2-0880f89c540e tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] 10.222.0.62 "GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592" status: 200 len: 1477 microversion: 2.1 time: 0.159871 Aug 29 16:18:02.948619 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3796/7367] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:02 2022] GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592 => generated 1477 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:03.735567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-a0f69d04-3317-41f5-a9f2-1f93cd8cd36b req-ac90b7b8-528f-45ff-97ba-355eab84286b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117865bb-40ca-4131-b2eb-5d02fe095592", "name": "network-vif-deleted", "tag": "96fb5c84-0405-40c9-a0ed-752e006292b9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:03.749981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a0f69d04-3317-41f5-a9f2-1f93cd8cd36b req-ac90b7b8-528f-45ff-97ba-355eab84286b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:03.750551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a0f69d04-3317-41f5-a9f2-1f93cd8cd36b req-ac90b7b8-528f-45ff-97ba-355eab84286b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:03.750996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a0f69d04-3317-41f5-a9f2-1f93cd8cd36b req-ac90b7b8-528f-45ff-97ba-355eab84286b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:03.763342 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-a0f69d04-3317-41f5-a9f2-1f93cd8cd36b req-ac90b7b8-528f-45ff-97ba-355eab84286b service nova] Creating event network-vif-deleted:96fb5c84-0405-40c9-a0ed-752e006292b9 for instance 117865bb-40ca-4131-b2eb-5d02fe095592 on n-h1-839401-11 Aug 29 16:18:03.769153 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-a0f69d04-3317-41f5-a9f2-1f93cd8cd36b req-ac90b7b8-528f-45ff-97ba-355eab84286b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037339 Aug 29 16:18:03.769825 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3572/7368] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:18:03.969597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6e6bfba6-c93c-4f22-851b-4c5b7e7625ee tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:03.970231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6e6bfba6-c93c-4f22-851b-4c5b7e7625ee tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:03.977676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e6bfba6-c93c-4f22-851b-4c5b7e7625ee tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:03.978162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e6bfba6-c93c-4f22-851b-4c5b7e7625ee tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:03.978843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e6bfba6-c93c-4f22-851b-4c5b7e7625ee tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:03.979916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e6bfba6-c93c-4f22-851b-4c5b7e7625ee tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:03.980384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e6bfba6-c93c-4f22-851b-4c5b7e7625ee tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:03.980824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e6bfba6-c93c-4f22-851b-4c5b7e7625ee tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:04.012623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e6bfba6-c93c-4f22-851b-4c5b7e7625ee tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:04.013177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e6bfba6-c93c-4f22-851b-4c5b7e7625ee tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:04.013622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6e6bfba6-c93c-4f22-851b-4c5b7e7625ee tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:04.014088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-6e6bfba6-c93c-4f22-851b-4c5b7e7625ee tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lazy-loading 'fault' on Instance uuid 117865bb-40ca-4131-b2eb-5d02fe095592 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:18:04.058780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6e6bfba6-c93c-4f22-851b-4c5b7e7625ee tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34785fc699ed40d88bd6f1329518cf23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54a29f1809f404280cd0e5ba42d3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:04.071153 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6e6bfba6-c93c-4f22-851b-4c5b7e7625ee tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] 10.222.0.62 "GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592" status: 200 len: 1311 microversion: 2.1 time: 0.105604 Aug 29 16:18:04.071990 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3797/7369] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:03 2022] GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:05.105193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-966a8f60-6e0e-4524-bc38-6e0cd7dcbf48 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:05.105920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-966a8f60-6e0e-4524-bc38-6e0cd7dcbf48 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] [instance: 117865bb-40ca-4131-b2eb-5d02fe095592] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:05.113624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-966a8f60-6e0e-4524-bc38-6e0cd7dcbf48 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:05.114174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-966a8f60-6e0e-4524-bc38-6e0cd7dcbf48 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:05.114704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-966a8f60-6e0e-4524-bc38-6e0cd7dcbf48 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:05.115487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-966a8f60-6e0e-4524-bc38-6e0cd7dcbf48 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:05.116034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-966a8f60-6e0e-4524-bc38-6e0cd7dcbf48 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:05.116521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-966a8f60-6e0e-4524-bc38-6e0cd7dcbf48 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:05.131817 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-966a8f60-6e0e-4524-bc38-6e0cd7dcbf48 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] HTTP exception thrown: Instance 117865bb-40ca-4131-b2eb-5d02fe095592 could not be found. Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-966a8f60-6e0e-4524-bc38-6e0cd7dcbf48 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Request method failure captured: Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592 HTTP/1.1 Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOasR67XgSiMak1sH96Pgzc6aYnOmnGGr_ggxKTrX_OG-EzEzj_xM0WIjUgIiBT9pX6sARWB8CRBCMTN1cTV4u7kCXo_yQmrVnwY_p8rhTzL7tmgWqoEAyC6zSPkwQOuVTEaZhe4jeQo_4lgVSQ7mT4SyBBi8qfB1xa5diDN4POxtKI Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: c54a29f1809f404280cd0e5ba42d3e9a Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1576686959 Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c54a29f1809f404280cd0e5ba42d3e9a", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c54a29f1809f404280cd0e5ba42d3e9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c54a29f1809f404280cd0e5ba42d3e9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c54a29f1809f404280cd0e5ba42d3e9a"}]}] Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1576686959 Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: c54a29f1809f404280cd0e5ba42d3e9a Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1576686959 Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersAdminNegativeTestJSON-1576686959-project Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 34785fc699ed40d88bd6f1329518cf23 Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1576686959-project Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 117865bb-40ca-4131-b2eb-5d02fe095592 could not be found. Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '117865bb-40ca-4131-b2eb-5d02fe095592'} Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 117865bb-40ca-4131-b2eb-5d02fe095592 could not be found. Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 117865bb-40ca-4131-b2eb-5d02fe095592 could not be found. Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:18:05.133833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:18:05.138109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:18:05.138109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:18:05.138109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:18:05.138109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:18:05.138109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:18:05.138109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:18:05.138109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 117865bb-40ca-4131-b2eb-5d02fe095592 could not be found. Aug 29 16:18:05.138109 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:18:05.138109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-966a8f60-6e0e-4524-bc38-6e0cd7dcbf48 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] Returning 404 to user: Instance 117865bb-40ca-4131-b2eb-5d02fe095592 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:18:05.138109 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-966a8f60-6e0e-4524-bc38-6e0cd7dcbf48 tempest-ServersAdminNegativeTestJSON-1576686959 tempest-ServersAdminNegativeTestJSON-1576686959-project] 10.222.0.62 "GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592" status: 404 len: 111 microversion: 2.1 time: 0.038604 Aug 29 16:18:05.138109 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3573/7370] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:05 2022] GET /compute/v2.1/servers/117865bb-40ca-4131-b2eb-5d02fe095592 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:18:11.262438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:11.274180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:11.410832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1999272176", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "e2cde304-74a4-4a43-b7ab-1a4ab6852214"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:11.476243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] validate_networks() for [('e2cde304-74a4-4a43-b7ab-1a4ab6852214', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:18:11.918324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:18:11.920010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:18:11.920698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:18:11.922299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:18:11.922903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:18:11.933814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:11.934361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:11.934830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:11.935594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:11.936114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:11.936512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:11.954363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Getting quotas for project 0cfbbe043d8a461a8f33128b10e82df7. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:18:11.960091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Getting quotas for user a422266039944a0397ba8d45167f053a and project 0cfbbe043d8a461a8f33128b10e82df7. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:18:11.973106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:18:11.975545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:18:12.023912 n-d-839401-11 devstack@n-api.service[122360]: ERROR oslo.messaging._drivers.impl_rabbit [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [167c4920-9caa-49a0-9a9b-abb44ca65d4c] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:18:13.033062 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [167c4920-9caa-49a0-9a9b-abb44ca65d4c] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38240. Aug 29 16:18:13.046805 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-62fd007d-6fc3-4b68-a036-beb37f9f8300 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.812003 Aug 29 16:18:13.048019 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3798/7371] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:18:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:18:13.059560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9c0fce41-8bd5-4a6f-afa2-29125b495739 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:13.060268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9c0fce41-8bd5-4a6f-afa2-29125b495739 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:13.066041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:13.071156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:13.130490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9c0fce41-8bd5-4a6f-afa2-29125b495739 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:13.137925 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9c0fce41-8bd5-4a6f-afa2-29125b495739 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1215 microversion: 2.1 time: 0.082467 Aug 29 16:18:13.138849 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3574/7372] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:13 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:14.161879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8fa2cb05-5b65-4d84-bcf2-0cea3c96beb6 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:14.163270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8fa2cb05-5b65-4d84-bcf2-0cea3c96beb6 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:14.218694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8fa2cb05-5b65-4d84-bcf2-0cea3c96beb6 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:14.226083 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8fa2cb05-5b65-4d84-bcf2-0cea3c96beb6 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1215 microversion: 2.1 time: 0.070899 Aug 29 16:18:14.226692 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3799/7373] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:14 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:15.250245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7b28f035-8ef1-47ab-b997-411d8ca945bd tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:15.251471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7b28f035-8ef1-47ab-b997-411d8ca945bd tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:15.259906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=57 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:15.323722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7b28f035-8ef1-47ab-b997-411d8ca945bd tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:15.336493 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7b28f035-8ef1-47ab-b997-411d8ca945bd tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1215 microversion: 2.1 time: 0.092191 Aug 29 16:18:15.337365 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3575/7374] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:15 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:16.360833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e83cf45c-af94-4daa-8812-7cbdf0a5be58 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:16.361672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e83cf45c-af94-4daa-8812-7cbdf0a5be58 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:16.423010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e83cf45c-af94-4daa-8812-7cbdf0a5be58 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:16.430568 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e83cf45c-af94-4daa-8812-7cbdf0a5be58 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1215 microversion: 2.1 time: 0.075102 Aug 29 16:18:16.431189 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3800/7375] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:16 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:17.457473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4bf9daa7-a945-4760-9c16-6d96fbbb5aba tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:17.458484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4bf9daa7-a945-4760-9c16-6d96fbbb5aba tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:17.467523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bf9daa7-a945-4760-9c16-6d96fbbb5aba tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:17.468020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bf9daa7-a945-4760-9c16-6d96fbbb5aba tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:17.468459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bf9daa7-a945-4760-9c16-6d96fbbb5aba tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:17.469200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bf9daa7-a945-4760-9c16-6d96fbbb5aba tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:17.469664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bf9daa7-a945-4760-9c16-6d96fbbb5aba tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:17.470081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bf9daa7-a945-4760-9c16-6d96fbbb5aba tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:17.534629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4bf9daa7-a945-4760-9c16-6d96fbbb5aba tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:17.543304 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4bf9daa7-a945-4760-9c16-6d96fbbb5aba tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1219 microversion: 2.1 time: 0.092892 Aug 29 16:18:17.543906 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3576/7376] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:17 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:18.564679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-173a5c86-d5de-4a83-9063-f32f53b8c1f7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:18.565307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-173a5c86-d5de-4a83-9063-f32f53b8c1f7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:18.573607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-173a5c86-d5de-4a83-9063-f32f53b8c1f7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:18.574147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-173a5c86-d5de-4a83-9063-f32f53b8c1f7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:18.574605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-173a5c86-d5de-4a83-9063-f32f53b8c1f7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:18.575331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-173a5c86-d5de-4a83-9063-f32f53b8c1f7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:18.575812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-173a5c86-d5de-4a83-9063-f32f53b8c1f7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:18.576448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-173a5c86-d5de-4a83-9063-f32f53b8c1f7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:18.642992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-173a5c86-d5de-4a83-9063-f32f53b8c1f7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:18.651662 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-173a5c86-d5de-4a83-9063-f32f53b8c1f7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1273 microversion: 2.1 time: 0.091036 Aug 29 16:18:18.652252 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3801/7377] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:18 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:19.673943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2cbe4f61-62a4-4823-a3c2-a9aa920c7b5a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:19.674603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2cbe4f61-62a4-4823-a3c2-a9aa920c7b5a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:19.677709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:19.683953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cbe4f61-62a4-4823-a3c2-a9aa920c7b5a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:19.684623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cbe4f61-62a4-4823-a3c2-a9aa920c7b5a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:19.685067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cbe4f61-62a4-4823-a3c2-a9aa920c7b5a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:19.685928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cbe4f61-62a4-4823-a3c2-a9aa920c7b5a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:19.686397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cbe4f61-62a4-4823-a3c2-a9aa920c7b5a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:19.686829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2cbe4f61-62a4-4823-a3c2-a9aa920c7b5a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:19.883496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2cbe4f61-62a4-4823-a3c2-a9aa920c7b5a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:19.891996 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2cbe4f61-62a4-4823-a3c2-a9aa920c7b5a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1315 microversion: 2.1 time: 0.222199 Aug 29 16:18:19.892657 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3577/7378] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:19 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:19.940043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a402b049-c1a0-470a-a16f-b48fa142713b req-64c649a2-cd06-4407-aec0-4c1e9dfa4d30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed301ced-99d7-4185-aa84-d6d13707b8ac", "tag": "dcc67635-6f76-4c90-8b7c-f16a7e6f386d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:19.947119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:19.955196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a402b049-c1a0-470a-a16f-b48fa142713b req-64c649a2-cd06-4407-aec0-4c1e9dfa4d30 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:19.955734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a402b049-c1a0-470a-a16f-b48fa142713b req-64c649a2-cd06-4407-aec0-4c1e9dfa4d30 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:19.956277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a402b049-c1a0-470a-a16f-b48fa142713b req-64c649a2-cd06-4407-aec0-4c1e9dfa4d30 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:19.960928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:19.970025 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a402b049-c1a0-470a-a16f-b48fa142713b req-64c649a2-cd06-4407-aec0-4c1e9dfa4d30 service nova] Creating event network-changed:dcc67635-6f76-4c90-8b7c-f16a7e6f386d for instance ed301ced-99d7-4185-aa84-d6d13707b8ac on n-h2-839401-11 Aug 29 16:18:19.976833 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a402b049-c1a0-470a-a16f-b48fa142713b req-64c649a2-cd06-4407-aec0-4c1e9dfa4d30 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041738 Aug 29 16:18:19.977497 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3802/7379] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:18:20.914062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1a6d2abf-084a-4ec1-a3fb-ecc9866390a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:20.914642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1a6d2abf-084a-4ec1-a3fb-ecc9866390a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:20.922117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a6d2abf-084a-4ec1-a3fb-ecc9866390a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:20.922617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a6d2abf-084a-4ec1-a3fb-ecc9866390a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:20.923063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a6d2abf-084a-4ec1-a3fb-ecc9866390a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:20.923752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a6d2abf-084a-4ec1-a3fb-ecc9866390a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:20.924233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a6d2abf-084a-4ec1-a3fb-ecc9866390a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:20.924661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1a6d2abf-084a-4ec1-a3fb-ecc9866390a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:21.073660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1a6d2abf-084a-4ec1-a3fb-ecc9866390a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:21.082164 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1a6d2abf-084a-4ec1-a3fb-ecc9866390a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1315 microversion: 2.1 time: 0.172202 Aug 29 16:18:21.082780 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3578/7380] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:20 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:22.109606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c409624d-6be8-4647-9c54-d4370ca110f3 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:22.110776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c409624d-6be8-4647-9c54-d4370ca110f3 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:22.116169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:22.126397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c409624d-6be8-4647-9c54-d4370ca110f3 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:22.126904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c409624d-6be8-4647-9c54-d4370ca110f3 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:22.127361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c409624d-6be8-4647-9c54-d4370ca110f3 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:22.128113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c409624d-6be8-4647-9c54-d4370ca110f3 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:22.128612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c409624d-6be8-4647-9c54-d4370ca110f3 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:22.129049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c409624d-6be8-4647-9c54-d4370ca110f3 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:22.268233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c409624d-6be8-4647-9c54-d4370ca110f3 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:22.277027 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c409624d-6be8-4647-9c54-d4370ca110f3 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1315 microversion: 2.1 time: 0.175502 Aug 29 16:18:22.277674 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3803/7381] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:22 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:23.298913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b6d416b1-6050-412f-87ee-b75c5de0ec95 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:23.299687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b6d416b1-6050-412f-87ee-b75c5de0ec95 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:23.307046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6d416b1-6050-412f-87ee-b75c5de0ec95 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:23.307522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6d416b1-6050-412f-87ee-b75c5de0ec95 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:23.307958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6d416b1-6050-412f-87ee-b75c5de0ec95 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:23.308807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6d416b1-6050-412f-87ee-b75c5de0ec95 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:23.309299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6d416b1-6050-412f-87ee-b75c5de0ec95 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:23.309805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b6d416b1-6050-412f-87ee-b75c5de0ec95 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:23.446586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b6d416b1-6050-412f-87ee-b75c5de0ec95 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:23.455229 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b6d416b1-6050-412f-87ee-b75c5de0ec95 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1315 microversion: 2.1 time: 0.160390 Aug 29 16:18:23.455835 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3579/7382] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:23 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:24.481969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fa20de36-8c08-440e-9a82-70e7f96e74b6 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:24.482527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fa20de36-8c08-440e-9a82-70e7f96e74b6 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:24.492217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa20de36-8c08-440e-9a82-70e7f96e74b6 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:24.493059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa20de36-8c08-440e-9a82-70e7f96e74b6 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:24.493726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa20de36-8c08-440e-9a82-70e7f96e74b6 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:24.494940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa20de36-8c08-440e-9a82-70e7f96e74b6 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:24.495626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa20de36-8c08-440e-9a82-70e7f96e74b6 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:24.496263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa20de36-8c08-440e-9a82-70e7f96e74b6 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:24.641489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fa20de36-8c08-440e-9a82-70e7f96e74b6 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:24.651745 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fa20de36-8c08-440e-9a82-70e7f96e74b6 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1315 microversion: 2.1 time: 0.177555 Aug 29 16:18:24.652688 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3804/7383] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:24 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:25.418873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:25.502492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f66ad41a-423e-4536-9dfd-469f4b4b151e req-7085246c-f23c-43d5-b51a-99a8adebce56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed301ced-99d7-4185-aa84-d6d13707b8ac", "name": "network-vif-plugged", "status": "completed", "tag": "dcc67635-6f76-4c90-8b7c-f16a7e6f386d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:25.512387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f66ad41a-423e-4536-9dfd-469f4b4b151e req-7085246c-f23c-43d5-b51a-99a8adebce56 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:25.512867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f66ad41a-423e-4536-9dfd-469f4b4b151e req-7085246c-f23c-43d5-b51a-99a8adebce56 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:25.513511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f66ad41a-423e-4536-9dfd-469f4b4b151e req-7085246c-f23c-43d5-b51a-99a8adebce56 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:25.524715 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f66ad41a-423e-4536-9dfd-469f4b4b151e req-7085246c-f23c-43d5-b51a-99a8adebce56 service nova] Creating event network-vif-plugged:dcc67635-6f76-4c90-8b7c-f16a7e6f386d for instance ed301ced-99d7-4185-aa84-d6d13707b8ac on n-h2-839401-11 Aug 29 16:18:25.530800 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f66ad41a-423e-4536-9dfd-469f4b4b151e req-7085246c-f23c-43d5-b51a-99a8adebce56 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117428 Aug 29 16:18:25.531427 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3580/7384] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:18:25.680171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7d870efc-b36d-4ff2-9880-83b9112e5650 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:25.680828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7d870efc-b36d-4ff2-9880-83b9112e5650 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:25.688540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d870efc-b36d-4ff2-9880-83b9112e5650 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:25.689064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d870efc-b36d-4ff2-9880-83b9112e5650 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:25.689547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d870efc-b36d-4ff2-9880-83b9112e5650 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:25.690284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d870efc-b36d-4ff2-9880-83b9112e5650 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:25.690764 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d870efc-b36d-4ff2-9880-83b9112e5650 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:25.691216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7d870efc-b36d-4ff2-9880-83b9112e5650 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:25.829468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7d870efc-b36d-4ff2-9880-83b9112e5650 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:25.841559 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7d870efc-b36d-4ff2-9880-83b9112e5650 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1315 microversion: 2.1 time: 0.165731 Aug 29 16:18:25.842167 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3805/7385] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:25 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:26.868580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-089f2b8c-64b0-473d-87d0-6fe11b317b29 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:26.869747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-089f2b8c-64b0-473d-87d0-6fe11b317b29 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:26.879572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-089f2b8c-64b0-473d-87d0-6fe11b317b29 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:26.880374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-089f2b8c-64b0-473d-87d0-6fe11b317b29 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:26.881032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-089f2b8c-64b0-473d-87d0-6fe11b317b29 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:26.882042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-089f2b8c-64b0-473d-87d0-6fe11b317b29 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:26.882594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-089f2b8c-64b0-473d-87d0-6fe11b317b29 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:26.883274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-089f2b8c-64b0-473d-87d0-6fe11b317b29 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:27.029848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-089f2b8c-64b0-473d-87d0-6fe11b317b29 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:27.039189 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-089f2b8c-64b0-473d-87d0-6fe11b317b29 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1315 microversion: 2.1 time: 0.179112 Aug 29 16:18:27.039711 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3581/7386] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:26 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:28.064530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fa3ab62c-0ee8-443b-a1d4-ffad702f7d09 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:28.065659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fa3ab62c-0ee8-443b-a1d4-ffad702f7d09 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:28.068738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=10 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:28.079386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa3ab62c-0ee8-443b-a1d4-ffad702f7d09 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:28.080229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa3ab62c-0ee8-443b-a1d4-ffad702f7d09 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:28.081009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa3ab62c-0ee8-443b-a1d4-ffad702f7d09 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:28.082237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa3ab62c-0ee8-443b-a1d4-ffad702f7d09 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:28.083049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa3ab62c-0ee8-443b-a1d4-ffad702f7d09 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:28.083827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fa3ab62c-0ee8-443b-a1d4-ffad702f7d09 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:28.238123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fa3ab62c-0ee8-443b-a1d4-ffad702f7d09 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:28.249944 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fa3ab62c-0ee8-443b-a1d4-ffad702f7d09 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1502 microversion: 2.1 time: 0.192120 Aug 29 16:18:28.250840 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3806/7387] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:28 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1502 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:28.275413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cf22bcec-961f-42b2-ac3a-12118822d420 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:18:28.277863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cf22bcec-961f-42b2-ac3a-12118822d420 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:28.285454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf22bcec-961f-42b2-ac3a-12118822d420 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:28.285932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf22bcec-961f-42b2-ac3a-12118822d420 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:28.286370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf22bcec-961f-42b2-ac3a-12118822d420 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:28.287090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf22bcec-961f-42b2-ac3a-12118822d420 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:28.287535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf22bcec-961f-42b2-ac3a-12118822d420 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:28.287958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf22bcec-961f-42b2-ac3a-12118822d420 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:28.364300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cf22bcec-961f-42b2-ac3a-12118822d420 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:28.370768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cf22bcec-961f-42b2-ac3a-12118822d420 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Old instance type m1.heat2, new instance type m1.heat {{(pid=122361) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:18:28.377723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-cf22bcec-961f-42b2-ac3a-12118822d420 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:18:28.378136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-cf22bcec-961f-42b2-ac3a-12118822d420 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:18:28.378610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-cf22bcec-961f-42b2-ac3a-12118822d420 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:18:28.379021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-cf22bcec-961f-42b2-ac3a-12118822d420 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:18:28.379438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-cf22bcec-961f-42b2-ac3a-12118822d420 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:18:28.492608 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cf22bcec-961f-42b2-ac3a-12118822d420 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "POST /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac/action" status: 202 len: 0 microversion: 2.1 time: 0.221058 Aug 29 16:18:28.493400 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3582/7388] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:18:28 2022] POST /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:18:28.501826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-80c433b6-84f0-41d5-b7f8-0f443e22698f tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:28.502460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-80c433b6-84f0-41d5-b7f8-0f443e22698f tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:28.508407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80c433b6-84f0-41d5-b7f8-0f443e22698f tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:28.508902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80c433b6-84f0-41d5-b7f8-0f443e22698f tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:28.509385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80c433b6-84f0-41d5-b7f8-0f443e22698f tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:28.510155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80c433b6-84f0-41d5-b7f8-0f443e22698f tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:28.510609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80c433b6-84f0-41d5-b7f8-0f443e22698f tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:28.511047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80c433b6-84f0-41d5-b7f8-0f443e22698f tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:28.650456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-80c433b6-84f0-41d5-b7f8-0f443e22698f tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:28.658524 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-80c433b6-84f0-41d5-b7f8-0f443e22698f tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1511 microversion: 2.1 time: 0.160743 Aug 29 16:18:28.659108 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3807/7389] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:28 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:29.681230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-45dc2a91-4c7b-4c89-96e4-789049d87f35 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:29.681861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-45dc2a91-4c7b-4c89-96e4-789049d87f35 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:29.689608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45dc2a91-4c7b-4c89-96e4-789049d87f35 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:29.690103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45dc2a91-4c7b-4c89-96e4-789049d87f35 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:29.690685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45dc2a91-4c7b-4c89-96e4-789049d87f35 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:29.691305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45dc2a91-4c7b-4c89-96e4-789049d87f35 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:29.691750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45dc2a91-4c7b-4c89-96e4-789049d87f35 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:29.692202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-45dc2a91-4c7b-4c89-96e4-789049d87f35 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:29.835203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-45dc2a91-4c7b-4c89-96e4-789049d87f35 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:29.843295 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-45dc2a91-4c7b-4c89-96e4-789049d87f35 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1511 microversion: 2.1 time: 0.167101 Aug 29 16:18:29.843957 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3583/7390] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:29 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:30.864336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98bc4350-3a9d-41a9-8a92-b1770e018106 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:30.865003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-98bc4350-3a9d-41a9-8a92-b1770e018106 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:30.872561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98bc4350-3a9d-41a9-8a92-b1770e018106 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:30.873344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98bc4350-3a9d-41a9-8a92-b1770e018106 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:30.873774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98bc4350-3a9d-41a9-8a92-b1770e018106 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:30.874472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98bc4350-3a9d-41a9-8a92-b1770e018106 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:30.874942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98bc4350-3a9d-41a9-8a92-b1770e018106 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:30.875379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98bc4350-3a9d-41a9-8a92-b1770e018106 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:31.020385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-98bc4350-3a9d-41a9-8a92-b1770e018106 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:31.028495 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-98bc4350-3a9d-41a9-8a92-b1770e018106 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.168297 Aug 29 16:18:31.029133 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3808/7391] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:30 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:32.053960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ad192668-3e51-4fc5-930e-d4dd517476a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:32.055007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ad192668-3e51-4fc5-930e-d4dd517476a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:32.067081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad192668-3e51-4fc5-930e-d4dd517476a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:32.067920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad192668-3e51-4fc5-930e-d4dd517476a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:32.068668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad192668-3e51-4fc5-930e-d4dd517476a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:32.069920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad192668-3e51-4fc5-930e-d4dd517476a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:32.070699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad192668-3e51-4fc5-930e-d4dd517476a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:32.071464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ad192668-3e51-4fc5-930e-d4dd517476a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:32.229433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ad192668-3e51-4fc5-930e-d4dd517476a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:32.241266 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ad192668-3e51-4fc5-930e-d4dd517476a7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.193950 Aug 29 16:18:32.242303 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3584/7392] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:32 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:33.268236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c6eeb64b-7c6f-43a4-b901-6b24f0e54b62 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:33.269421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c6eeb64b-7c6f-43a4-b901-6b24f0e54b62 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:33.280820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6eeb64b-7c6f-43a4-b901-6b24f0e54b62 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:33.281366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6eeb64b-7c6f-43a4-b901-6b24f0e54b62 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:33.281811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6eeb64b-7c6f-43a4-b901-6b24f0e54b62 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:33.282538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6eeb64b-7c6f-43a4-b901-6b24f0e54b62 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:33.283002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6eeb64b-7c6f-43a4-b901-6b24f0e54b62 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:33.283436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6eeb64b-7c6f-43a4-b901-6b24f0e54b62 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:33.418599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c6eeb64b-7c6f-43a4-b901-6b24f0e54b62 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:33.427118 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c6eeb64b-7c6f-43a4-b901-6b24f0e54b62 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.166346 Aug 29 16:18:33.427936 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3809/7393] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:33 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:34.453633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fcbc3e3e-2d6d-4308-b014-582e7c8f2b87 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:34.454697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fcbc3e3e-2d6d-4308-b014-582e7c8f2b87 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:34.466561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fcbc3e3e-2d6d-4308-b014-582e7c8f2b87 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:34.467453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fcbc3e3e-2d6d-4308-b014-582e7c8f2b87 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:34.467903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fcbc3e3e-2d6d-4308-b014-582e7c8f2b87 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:34.468628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fcbc3e3e-2d6d-4308-b014-582e7c8f2b87 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:34.469069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fcbc3e3e-2d6d-4308-b014-582e7c8f2b87 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:34.469523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fcbc3e3e-2d6d-4308-b014-582e7c8f2b87 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:34.610433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fcbc3e3e-2d6d-4308-b014-582e7c8f2b87 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:34.619267 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fcbc3e3e-2d6d-4308-b014-582e7c8f2b87 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.172550 Aug 29 16:18:34.619866 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3585/7394] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:34 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:35.652264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9aff8ddf-7e16-4be9-81d9-384ea79287ec tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:35.653452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9aff8ddf-7e16-4be9-81d9-384ea79287ec tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:35.665485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9aff8ddf-7e16-4be9-81d9-384ea79287ec tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:35.666322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9aff8ddf-7e16-4be9-81d9-384ea79287ec tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:35.667093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9aff8ddf-7e16-4be9-81d9-384ea79287ec tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:35.668273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9aff8ddf-7e16-4be9-81d9-384ea79287ec tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:35.669064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9aff8ddf-7e16-4be9-81d9-384ea79287ec tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:35.669850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9aff8ddf-7e16-4be9-81d9-384ea79287ec tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:35.811399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9aff8ddf-7e16-4be9-81d9-384ea79287ec tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:35.820023 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9aff8ddf-7e16-4be9-81d9-384ea79287ec tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.174555 Aug 29 16:18:35.820605 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3810/7395] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:35 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:36.844557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d61440b7-9738-4a5b-920b-908913be4392 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:36.845606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d61440b7-9738-4a5b-920b-908913be4392 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:36.857658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d61440b7-9738-4a5b-920b-908913be4392 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:36.858448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d61440b7-9738-4a5b-920b-908913be4392 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:36.858893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d61440b7-9738-4a5b-920b-908913be4392 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:36.859633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d61440b7-9738-4a5b-920b-908913be4392 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:36.860082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d61440b7-9738-4a5b-920b-908913be4392 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:36.860522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d61440b7-9738-4a5b-920b-908913be4392 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:37.019256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d61440b7-9738-4a5b-920b-908913be4392 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:37.030534 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d61440b7-9738-4a5b-920b-908913be4392 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.192262 Aug 29 16:18:37.031449 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3586/7396] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:36 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:38.060003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-51ed3640-afda-4ccf-8cb0-3adfe41b09a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:38.061011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-51ed3640-afda-4ccf-8cb0-3adfe41b09a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:38.069283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51ed3640-afda-4ccf-8cb0-3adfe41b09a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:38.069797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51ed3640-afda-4ccf-8cb0-3adfe41b09a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:38.070257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51ed3640-afda-4ccf-8cb0-3adfe41b09a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:38.070975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51ed3640-afda-4ccf-8cb0-3adfe41b09a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:38.071456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51ed3640-afda-4ccf-8cb0-3adfe41b09a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:38.071903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-51ed3640-afda-4ccf-8cb0-3adfe41b09a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:38.220510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-51ed3640-afda-4ccf-8cb0-3adfe41b09a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:38.228973 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-51ed3640-afda-4ccf-8cb0-3adfe41b09a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.175860 Aug 29 16:18:38.229591 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3811/7397] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:38 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:39.254395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d946e9e1-1280-4708-bcc3-fa904c083f69 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:39.255318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d946e9e1-1280-4708-bcc3-fa904c083f69 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:39.266264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d946e9e1-1280-4708-bcc3-fa904c083f69 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:39.266771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d946e9e1-1280-4708-bcc3-fa904c083f69 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:39.267202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d946e9e1-1280-4708-bcc3-fa904c083f69 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:39.267885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d946e9e1-1280-4708-bcc3-fa904c083f69 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:39.268339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d946e9e1-1280-4708-bcc3-fa904c083f69 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:39.268762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d946e9e1-1280-4708-bcc3-fa904c083f69 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:39.420269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d946e9e1-1280-4708-bcc3-fa904c083f69 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:39.428748 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d946e9e1-1280-4708-bcc3-fa904c083f69 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.181649 Aug 29 16:18:39.429367 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3587/7398] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:39 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:40.453934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-39e0c1e2-c897-47e9-8f7a-98f2ab688da8 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:40.454929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-39e0c1e2-c897-47e9-8f7a-98f2ab688da8 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:40.467104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39e0c1e2-c897-47e9-8f7a-98f2ab688da8 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:40.467940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39e0c1e2-c897-47e9-8f7a-98f2ab688da8 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:40.468723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39e0c1e2-c897-47e9-8f7a-98f2ab688da8 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:40.469480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39e0c1e2-c897-47e9-8f7a-98f2ab688da8 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:40.469959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39e0c1e2-c897-47e9-8f7a-98f2ab688da8 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:40.470408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-39e0c1e2-c897-47e9-8f7a-98f2ab688da8 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:40.609153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-39e0c1e2-c897-47e9-8f7a-98f2ab688da8 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:40.617538 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-39e0c1e2-c897-47e9-8f7a-98f2ab688da8 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.170337 Aug 29 16:18:40.618132 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3812/7399] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:40 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:41.642638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5747f70b-2c49-444e-bdc6-7ad67c5fd9dc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:41.643422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5747f70b-2c49-444e-bdc6-7ad67c5fd9dc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:41.652497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5747f70b-2c49-444e-bdc6-7ad67c5fd9dc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:41.653130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5747f70b-2c49-444e-bdc6-7ad67c5fd9dc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:41.653716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5747f70b-2c49-444e-bdc6-7ad67c5fd9dc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:41.654571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5747f70b-2c49-444e-bdc6-7ad67c5fd9dc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:41.655133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5747f70b-2c49-444e-bdc6-7ad67c5fd9dc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:41.655657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5747f70b-2c49-444e-bdc6-7ad67c5fd9dc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:41.787721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5747f70b-2c49-444e-bdc6-7ad67c5fd9dc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:41.795843 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5747f70b-2c49-444e-bdc6-7ad67c5fd9dc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.159488 Aug 29 16:18:41.796400 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3588/7400] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:41 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:42.821892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b809eb2-7bf2-4859-b875-b98cdf566105 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:42.822918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6b809eb2-7bf2-4859-b875-b98cdf566105 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:42.832752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b809eb2-7bf2-4859-b875-b98cdf566105 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:42.833298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b809eb2-7bf2-4859-b875-b98cdf566105 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:42.833759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b809eb2-7bf2-4859-b875-b98cdf566105 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:42.834485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b809eb2-7bf2-4859-b875-b98cdf566105 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:42.834990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b809eb2-7bf2-4859-b875-b98cdf566105 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:42.835412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b809eb2-7bf2-4859-b875-b98cdf566105 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:42.975573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b809eb2-7bf2-4859-b875-b98cdf566105 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:42.984399 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6b809eb2-7bf2-4859-b875-b98cdf566105 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.169290 Aug 29 16:18:42.985031 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3813/7401] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:42 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:44.010224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a443b3f0-77b9-4c25-a036-c5a1702a32c7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:44.011241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a443b3f0-77b9-4c25-a036-c5a1702a32c7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:44.024225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a443b3f0-77b9-4c25-a036-c5a1702a32c7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:44.025051 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a443b3f0-77b9-4c25-a036-c5a1702a32c7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:44.025880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a443b3f0-77b9-4c25-a036-c5a1702a32c7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:44.027017 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a443b3f0-77b9-4c25-a036-c5a1702a32c7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:44.027786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a443b3f0-77b9-4c25-a036-c5a1702a32c7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:44.028511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a443b3f0-77b9-4c25-a036-c5a1702a32c7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:44.173577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a443b3f0-77b9-4c25-a036-c5a1702a32c7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:44.182079 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a443b3f0-77b9-4c25-a036-c5a1702a32c7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.178532 Aug 29 16:18:44.182662 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3589/7402] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:44 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:45.203615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-484715c7-93ca-4785-9511-8147695ed043 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:45.204310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-484715c7-93ca-4785-9511-8147695ed043 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:45.212265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-484715c7-93ca-4785-9511-8147695ed043 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:45.212785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-484715c7-93ca-4785-9511-8147695ed043 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:45.213277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-484715c7-93ca-4785-9511-8147695ed043 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:45.213990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-484715c7-93ca-4785-9511-8147695ed043 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:45.214473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-484715c7-93ca-4785-9511-8147695ed043 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:45.214914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-484715c7-93ca-4785-9511-8147695ed043 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:45.354453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-484715c7-93ca-4785-9511-8147695ed043 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:45.366485 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-484715c7-93ca-4785-9511-8147695ed043 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.166871 Aug 29 16:18:45.367087 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3814/7403] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:45 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:46.391675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7259036c-d4fb-4a90-b5f0-e0ffff7de2e7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:46.392308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7259036c-d4fb-4a90-b5f0-e0ffff7de2e7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:46.402636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7259036c-d4fb-4a90-b5f0-e0ffff7de2e7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:46.403241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7259036c-d4fb-4a90-b5f0-e0ffff7de2e7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:46.403758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7259036c-d4fb-4a90-b5f0-e0ffff7de2e7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:46.404557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7259036c-d4fb-4a90-b5f0-e0ffff7de2e7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:46.405213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7259036c-d4fb-4a90-b5f0-e0ffff7de2e7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:46.405706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7259036c-d4fb-4a90-b5f0-e0ffff7de2e7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:46.410066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:46.567511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7259036c-d4fb-4a90-b5f0-e0ffff7de2e7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:46.579650 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7259036c-d4fb-4a90-b5f0-e0ffff7de2e7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.194223 Aug 29 16:18:46.580199 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3590/7404] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:46 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:47.605742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eff88e92-8273-4ffc-b1b5-3a45f6c86d78 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:47.606895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eff88e92-8273-4ffc-b1b5-3a45f6c86d78 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:47.615610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eff88e92-8273-4ffc-b1b5-3a45f6c86d78 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:47.616118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eff88e92-8273-4ffc-b1b5-3a45f6c86d78 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:47.616576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eff88e92-8273-4ffc-b1b5-3a45f6c86d78 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:47.617346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eff88e92-8273-4ffc-b1b5-3a45f6c86d78 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:47.617827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eff88e92-8273-4ffc-b1b5-3a45f6c86d78 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:47.618300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eff88e92-8273-4ffc-b1b5-3a45f6c86d78 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:47.759808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eff88e92-8273-4ffc-b1b5-3a45f6c86d78 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:47.772884 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eff88e92-8273-4ffc-b1b5-3a45f6c86d78 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.174037 Aug 29 16:18:47.773809 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3815/7405] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:47 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:48.798409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-acd5ccfc-3f72-4ce4-b5e9-f131a01893c5 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:48.799020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-acd5ccfc-3f72-4ce4-b5e9-f131a01893c5 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:48.806856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acd5ccfc-3f72-4ce4-b5e9-f131a01893c5 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:48.807337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acd5ccfc-3f72-4ce4-b5e9-f131a01893c5 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:48.807767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acd5ccfc-3f72-4ce4-b5e9-f131a01893c5 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:48.808460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acd5ccfc-3f72-4ce4-b5e9-f131a01893c5 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:48.808938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acd5ccfc-3f72-4ce4-b5e9-f131a01893c5 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:48.809384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acd5ccfc-3f72-4ce4-b5e9-f131a01893c5 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:48.950633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-acd5ccfc-3f72-4ce4-b5e9-f131a01893c5 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:48.959214 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-acd5ccfc-3f72-4ce4-b5e9-f131a01893c5 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.165015 Aug 29 16:18:48.959809 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3591/7406] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:48 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:49.982390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-64ce2593-bbe5-4dc3-922f-7598436f96de tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:49.983019 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-64ce2593-bbe5-4dc3-922f-7598436f96de tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:49.991580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64ce2593-bbe5-4dc3-922f-7598436f96de tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:49.992163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64ce2593-bbe5-4dc3-922f-7598436f96de tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:49.992678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64ce2593-bbe5-4dc3-922f-7598436f96de tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:49.993564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64ce2593-bbe5-4dc3-922f-7598436f96de tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:49.994117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64ce2593-bbe5-4dc3-922f-7598436f96de tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:49.994660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64ce2593-bbe5-4dc3-922f-7598436f96de tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:50.154135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-64ce2593-bbe5-4dc3-922f-7598436f96de tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:50.162552 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-64ce2593-bbe5-4dc3-922f-7598436f96de tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.185921 Aug 29 16:18:50.163135 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3816/7407] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:49 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:51.183419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e9b94e23-e324-4f2d-871c-e5d56e56b58e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:51.183967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e9b94e23-e324-4f2d-871c-e5d56e56b58e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:51.186638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=34 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:51.192819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9b94e23-e324-4f2d-871c-e5d56e56b58e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:51.193243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9b94e23-e324-4f2d-871c-e5d56e56b58e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:51.193670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9b94e23-e324-4f2d-871c-e5d56e56b58e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:51.194367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9b94e23-e324-4f2d-871c-e5d56e56b58e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:51.194809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9b94e23-e324-4f2d-871c-e5d56e56b58e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:51.195227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9b94e23-e324-4f2d-871c-e5d56e56b58e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:51.335983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e9b94e23-e324-4f2d-871c-e5d56e56b58e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:51.344156 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e9b94e23-e324-4f2d-871c-e5d56e56b58e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.164820 Aug 29 16:18:51.344841 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3592/7408] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:51 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:52.365591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a50162d8-9774-41a6-b9d5-44ebf578e89a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:52.366184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a50162d8-9774-41a6-b9d5-44ebf578e89a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:52.368776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=30 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:52.374666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a50162d8-9774-41a6-b9d5-44ebf578e89a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:52.375149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a50162d8-9774-41a6-b9d5-44ebf578e89a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:52.375668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a50162d8-9774-41a6-b9d5-44ebf578e89a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:52.376381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a50162d8-9774-41a6-b9d5-44ebf578e89a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:52.376866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a50162d8-9774-41a6-b9d5-44ebf578e89a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:52.377316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a50162d8-9774-41a6-b9d5-44ebf578e89a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:52.380042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=86 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:18:52.522117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a50162d8-9774-41a6-b9d5-44ebf578e89a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:52.531677 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a50162d8-9774-41a6-b9d5-44ebf578e89a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.170118 Aug 29 16:18:52.532317 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3817/7409] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:52 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:53.555823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d64b3d02-ed97-4f53-9bf0-35937372fe20 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:53.556414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d64b3d02-ed97-4f53-9bf0-35937372fe20 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:53.565601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d64b3d02-ed97-4f53-9bf0-35937372fe20 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:53.566266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d64b3d02-ed97-4f53-9bf0-35937372fe20 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:53.566874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d64b3d02-ed97-4f53-9bf0-35937372fe20 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:53.567929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d64b3d02-ed97-4f53-9bf0-35937372fe20 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:53.568473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d64b3d02-ed97-4f53-9bf0-35937372fe20 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:53.568926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d64b3d02-ed97-4f53-9bf0-35937372fe20 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:53.714643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d64b3d02-ed97-4f53-9bf0-35937372fe20 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:53.723155 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d64b3d02-ed97-4f53-9bf0-35937372fe20 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.171664 Aug 29 16:18:53.723755 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3593/7410] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:53 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:54.748607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-06683ea0-dcc3-4e13-abf6-ef096f66a6b7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:54.749249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-06683ea0-dcc3-4e13-abf6-ef096f66a6b7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:54.757424 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06683ea0-dcc3-4e13-abf6-ef096f66a6b7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:54.757917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06683ea0-dcc3-4e13-abf6-ef096f66a6b7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:54.758369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06683ea0-dcc3-4e13-abf6-ef096f66a6b7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:54.759072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06683ea0-dcc3-4e13-abf6-ef096f66a6b7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:54.759538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06683ea0-dcc3-4e13-abf6-ef096f66a6b7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:54.759971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-06683ea0-dcc3-4e13-abf6-ef096f66a6b7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:54.924801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-06683ea0-dcc3-4e13-abf6-ef096f66a6b7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:54.935894 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-06683ea0-dcc3-4e13-abf6-ef096f66a6b7 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.193869 Aug 29 16:18:54.936503 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3818/7411] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:54 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:55.965925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-517553a2-0894-45c8-90b8-f04e023470f9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:55.966937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-517553a2-0894-45c8-90b8-f04e023470f9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:55.978430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-517553a2-0894-45c8-90b8-f04e023470f9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:55.979022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-517553a2-0894-45c8-90b8-f04e023470f9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:55.979558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-517553a2-0894-45c8-90b8-f04e023470f9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:55.980596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-517553a2-0894-45c8-90b8-f04e023470f9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:55.981244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-517553a2-0894-45c8-90b8-f04e023470f9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:55.981764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-517553a2-0894-45c8-90b8-f04e023470f9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:56.127534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-517553a2-0894-45c8-90b8-f04e023470f9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:56.138990 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-517553a2-0894-45c8-90b8-f04e023470f9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.179498 Aug 29 16:18:56.139832 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3594/7412] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:55 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:57.161453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-12f43837-d7e7-4b9e-801e-4955e426d4fe tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:57.162103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-12f43837-d7e7-4b9e-801e-4955e426d4fe tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:57.171533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12f43837-d7e7-4b9e-801e-4955e426d4fe tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:57.172375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12f43837-d7e7-4b9e-801e-4955e426d4fe tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:57.172794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12f43837-d7e7-4b9e-801e-4955e426d4fe tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:57.173546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12f43837-d7e7-4b9e-801e-4955e426d4fe tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:57.174017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12f43837-d7e7-4b9e-801e-4955e426d4fe tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:57.174453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12f43837-d7e7-4b9e-801e-4955e426d4fe tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:57.316644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-12f43837-d7e7-4b9e-801e-4955e426d4fe tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:57.324808 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-12f43837-d7e7-4b9e-801e-4955e426d4fe tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.167197 Aug 29 16:18:57.325446 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3819/7413] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:57 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:58.347377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-265ace7f-8a75-40cf-a28c-3f8e3e8d4607 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:58.347999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-265ace7f-8a75-40cf-a28c-3f8e3e8d4607 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:58.356148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-265ace7f-8a75-40cf-a28c-3f8e3e8d4607 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:58.356663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-265ace7f-8a75-40cf-a28c-3f8e3e8d4607 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:58.357112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-265ace7f-8a75-40cf-a28c-3f8e3e8d4607 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:58.357841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-265ace7f-8a75-40cf-a28c-3f8e3e8d4607 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:58.358278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-265ace7f-8a75-40cf-a28c-3f8e3e8d4607 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:58.358702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-265ace7f-8a75-40cf-a28c-3f8e3e8d4607 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:58.494838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-265ace7f-8a75-40cf-a28c-3f8e3e8d4607 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:58.502802 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-265ace7f-8a75-40cf-a28c-3f8e3e8d4607 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.159609 Aug 29 16:18:58.503377 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3595/7414] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:58 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:18:59.530857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a49f4744-4491-46f4-9bb5-2038187dcb1c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:18:59.531928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a49f4744-4491-46f4-9bb5-2038187dcb1c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:18:59.543189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a49f4744-4491-46f4-9bb5-2038187dcb1c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:59.543953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a49f4744-4491-46f4-9bb5-2038187dcb1c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:59.544642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a49f4744-4491-46f4-9bb5-2038187dcb1c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:59.545759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a49f4744-4491-46f4-9bb5-2038187dcb1c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:18:59.546466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a49f4744-4491-46f4-9bb5-2038187dcb1c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:18:59.547180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a49f4744-4491-46f4-9bb5-2038187dcb1c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:18:59.689139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a49f4744-4491-46f4-9bb5-2038187dcb1c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:18:59.697728 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a49f4744-4491-46f4-9bb5-2038187dcb1c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.172933 Aug 29 16:18:59.698313 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3820/7415] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:18:59 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:00.723247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2f896bdd-f056-44cd-a305-955cbdd6bef9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:00.724222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2f896bdd-f056-44cd-a305-955cbdd6bef9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:00.736476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f896bdd-f056-44cd-a305-955cbdd6bef9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:00.737463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f896bdd-f056-44cd-a305-955cbdd6bef9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:00.738364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f896bdd-f056-44cd-a305-955cbdd6bef9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:00.739104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f896bdd-f056-44cd-a305-955cbdd6bef9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:00.739566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f896bdd-f056-44cd-a305-955cbdd6bef9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:00.739984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f896bdd-f056-44cd-a305-955cbdd6bef9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:00.885784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2f896bdd-f056-44cd-a305-955cbdd6bef9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:00.894435 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2f896bdd-f056-44cd-a305-955cbdd6bef9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.177943 Aug 29 16:19:00.895071 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3596/7416] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:00 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:01.919720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3dc9df64-f945-43bb-9e12-ac60ec801090 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:01.920665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3dc9df64-f945-43bb-9e12-ac60ec801090 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:01.931131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dc9df64-f945-43bb-9e12-ac60ec801090 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:01.931969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dc9df64-f945-43bb-9e12-ac60ec801090 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:01.932718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dc9df64-f945-43bb-9e12-ac60ec801090 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:01.933922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dc9df64-f945-43bb-9e12-ac60ec801090 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:01.934712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dc9df64-f945-43bb-9e12-ac60ec801090 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:01.935448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3dc9df64-f945-43bb-9e12-ac60ec801090 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:02.082532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3dc9df64-f945-43bb-9e12-ac60ec801090 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:02.094475 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3dc9df64-f945-43bb-9e12-ac60ec801090 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.181575 Aug 29 16:19:02.095344 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3821/7417] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:01 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:03.117319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-603c2ecd-9f86-4e82-b396-85f8cc4f5d4c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:03.117834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-603c2ecd-9f86-4e82-b396-85f8cc4f5d4c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:03.125006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-603c2ecd-9f86-4e82-b396-85f8cc4f5d4c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:03.125568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-603c2ecd-9f86-4e82-b396-85f8cc4f5d4c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:03.125966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-603c2ecd-9f86-4e82-b396-85f8cc4f5d4c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:03.126692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-603c2ecd-9f86-4e82-b396-85f8cc4f5d4c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:03.127179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-603c2ecd-9f86-4e82-b396-85f8cc4f5d4c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:03.127605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-603c2ecd-9f86-4e82-b396-85f8cc4f5d4c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:03.264311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-603c2ecd-9f86-4e82-b396-85f8cc4f5d4c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:03.273777 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-603c2ecd-9f86-4e82-b396-85f8cc4f5d4c tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.160651 Aug 29 16:19:03.274549 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3597/7418] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:03 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:04.295697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9e52eb5a-0921-461d-b687-0ff1648d8509 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:04.296354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9e52eb5a-0921-461d-b687-0ff1648d8509 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:04.303816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e52eb5a-0921-461d-b687-0ff1648d8509 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:04.304320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e52eb5a-0921-461d-b687-0ff1648d8509 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:04.304769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e52eb5a-0921-461d-b687-0ff1648d8509 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:04.305517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e52eb5a-0921-461d-b687-0ff1648d8509 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:04.305992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e52eb5a-0921-461d-b687-0ff1648d8509 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:04.306429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9e52eb5a-0921-461d-b687-0ff1648d8509 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:04.445008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9e52eb5a-0921-461d-b687-0ff1648d8509 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:04.453295 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9e52eb5a-0921-461d-b687-0ff1648d8509 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.161561 Aug 29 16:19:04.453879 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3822/7419] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:04 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:05.478935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2752d5a1-a505-43b9-b13f-8937b229379b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:05.479929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2752d5a1-a505-43b9-b13f-8937b229379b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:05.491063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2752d5a1-a505-43b9-b13f-8937b229379b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:05.491550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2752d5a1-a505-43b9-b13f-8937b229379b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:05.491987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2752d5a1-a505-43b9-b13f-8937b229379b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:05.492688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2752d5a1-a505-43b9-b13f-8937b229379b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:05.493174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2752d5a1-a505-43b9-b13f-8937b229379b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:05.493607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2752d5a1-a505-43b9-b13f-8937b229379b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:05.634631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2752d5a1-a505-43b9-b13f-8937b229379b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:05.646210 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2752d5a1-a505-43b9-b13f-8937b229379b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.173954 Aug 29 16:19:05.646987 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3598/7420] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:05 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:06.676992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ed9cc614-53c4-41b5-a1b1-34bc0a0e1b92 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:06.677972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ed9cc614-53c4-41b5-a1b1-34bc0a0e1b92 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:06.686412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed9cc614-53c4-41b5-a1b1-34bc0a0e1b92 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:06.686969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed9cc614-53c4-41b5-a1b1-34bc0a0e1b92 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:06.687469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed9cc614-53c4-41b5-a1b1-34bc0a0e1b92 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:06.688253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed9cc614-53c4-41b5-a1b1-34bc0a0e1b92 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:06.688789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed9cc614-53c4-41b5-a1b1-34bc0a0e1b92 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:06.689306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ed9cc614-53c4-41b5-a1b1-34bc0a0e1b92 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:06.830350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ed9cc614-53c4-41b5-a1b1-34bc0a0e1b92 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:06.838381 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ed9cc614-53c4-41b5-a1b1-34bc0a0e1b92 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.167959 Aug 29 16:19:06.838958 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3823/7421] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:06 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:07.859554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1d854f3c-229f-4c20-8466-961665650f9e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:07.860174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1d854f3c-229f-4c20-8466-961665650f9e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:07.867255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d854f3c-229f-4c20-8466-961665650f9e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:07.867749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d854f3c-229f-4c20-8466-961665650f9e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:07.868190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d854f3c-229f-4c20-8466-961665650f9e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:07.868896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d854f3c-229f-4c20-8466-961665650f9e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:07.869394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d854f3c-229f-4c20-8466-961665650f9e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:07.869826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1d854f3c-229f-4c20-8466-961665650f9e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:08.039633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1d854f3c-229f-4c20-8466-961665650f9e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:08.047672 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1d854f3c-229f-4c20-8466-961665650f9e tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1516 microversion: 2.1 time: 0.192289 Aug 29 16:19:08.048260 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3599/7422] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:07 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1516 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:08.617406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-d11360bd-bfc4-45d7-b4c6-f741098feeb7 req-34cb600a-ae1f-4f63-beb3-d30dd3edaa39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed301ced-99d7-4185-aa84-d6d13707b8ac", "name": "network-vif-unplugged", "status": "completed", "tag": "dcc67635-6f76-4c90-8b7c-f16a7e6f386d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:08.629142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d11360bd-bfc4-45d7-b4c6-f741098feeb7 req-34cb600a-ae1f-4f63-beb3-d30dd3edaa39 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:08.629730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d11360bd-bfc4-45d7-b4c6-f741098feeb7 req-34cb600a-ae1f-4f63-beb3-d30dd3edaa39 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:08.630535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d11360bd-bfc4-45d7-b4c6-f741098feeb7 req-34cb600a-ae1f-4f63-beb3-d30dd3edaa39 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:08.643264 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-d11360bd-bfc4-45d7-b4c6-f741098feeb7 req-34cb600a-ae1f-4f63-beb3-d30dd3edaa39 service nova] Creating event network-vif-unplugged:dcc67635-6f76-4c90-8b7c-f16a7e6f386d for instance ed301ced-99d7-4185-aa84-d6d13707b8ac on n-h1-839401-11 Aug 29 16:19:08.648922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-d11360bd-bfc4-45d7-b4c6-f741098feeb7 req-34cb600a-ae1f-4f63-beb3-d30dd3edaa39 service nova] Instance ed301ced-99d7-4185-aa84-d6d13707b8ac is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:19:08.660231 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-d11360bd-bfc4-45d7-b4c6-f741098feeb7 req-34cb600a-ae1f-4f63-beb3-d30dd3edaa39 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046759 Aug 29 16:19:08.660815 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3824/7423] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:19:09.068494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b8206b6d-1949-4154-aee6-4fd2e9c8ecef tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:09.069468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b8206b6d-1949-4154-aee6-4fd2e9c8ecef tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:09.076781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8206b6d-1949-4154-aee6-4fd2e9c8ecef tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:09.077297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8206b6d-1949-4154-aee6-4fd2e9c8ecef tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:09.077745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8206b6d-1949-4154-aee6-4fd2e9c8ecef tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:09.078473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8206b6d-1949-4154-aee6-4fd2e9c8ecef tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:09.079049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8206b6d-1949-4154-aee6-4fd2e9c8ecef tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:09.079475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b8206b6d-1949-4154-aee6-4fd2e9c8ecef tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:09.310413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b8206b6d-1949-4154-aee6-4fd2e9c8ecef tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:09.319802 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b8206b6d-1949-4154-aee6-4fd2e9c8ecef tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1515 microversion: 2.1 time: 0.255688 Aug 29 16:19:09.320341 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3600/7424] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:09 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:10.344197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fc6cd55a-7678-430a-8317-82e2dcff52bc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:10.344919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fc6cd55a-7678-430a-8317-82e2dcff52bc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:10.352815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc6cd55a-7678-430a-8317-82e2dcff52bc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:10.353384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc6cd55a-7678-430a-8317-82e2dcff52bc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:10.353845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc6cd55a-7678-430a-8317-82e2dcff52bc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:10.354551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc6cd55a-7678-430a-8317-82e2dcff52bc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:10.355030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc6cd55a-7678-430a-8317-82e2dcff52bc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:10.355464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc6cd55a-7678-430a-8317-82e2dcff52bc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:10.512031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fc6cd55a-7678-430a-8317-82e2dcff52bc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:10.520355 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fc6cd55a-7678-430a-8317-82e2dcff52bc tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1513 microversion: 2.1 time: 0.181442 Aug 29 16:19:10.520958 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3825/7425] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:10 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:10.686604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-5eb669a6-8ba4-4c84-ab03-c8412cac5ff7 req-3f8b70b8-cc40-49fe-87f3-4440eec84a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed301ced-99d7-4185-aa84-d6d13707b8ac", "tag": "dcc67635-6f76-4c90-8b7c-f16a7e6f386d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:10.697777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5eb669a6-8ba4-4c84-ab03-c8412cac5ff7 req-3f8b70b8-cc40-49fe-87f3-4440eec84a99 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:10.698252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5eb669a6-8ba4-4c84-ab03-c8412cac5ff7 req-3f8b70b8-cc40-49fe-87f3-4440eec84a99 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:10.698677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5eb669a6-8ba4-4c84-ab03-c8412cac5ff7 req-3f8b70b8-cc40-49fe-87f3-4440eec84a99 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:10.711051 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5eb669a6-8ba4-4c84-ab03-c8412cac5ff7 req-3f8b70b8-cc40-49fe-87f3-4440eec84a99 service nova] Creating event network-changed:dcc67635-6f76-4c90-8b7c-f16a7e6f386d for instance ed301ced-99d7-4185-aa84-d6d13707b8ac on n-h1-839401-11 Aug 29 16:19:10.716824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-5eb669a6-8ba4-4c84-ab03-c8412cac5ff7 req-3f8b70b8-cc40-49fe-87f3-4440eec84a99 service nova] Instance ed301ced-99d7-4185-aa84-d6d13707b8ac is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:19:10.728513 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-5eb669a6-8ba4-4c84-ab03-c8412cac5ff7 req-3f8b70b8-cc40-49fe-87f3-4440eec84a99 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045829 Aug 29 16:19:10.729389 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3601/7426] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:19:11.542185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2da45752-19ea-4cc5-a892-90e4df334baf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:11.542804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2da45752-19ea-4cc5-a892-90e4df334baf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:11.550179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2da45752-19ea-4cc5-a892-90e4df334baf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:11.550693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2da45752-19ea-4cc5-a892-90e4df334baf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:11.551149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2da45752-19ea-4cc5-a892-90e4df334baf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:11.552024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2da45752-19ea-4cc5-a892-90e4df334baf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:11.552538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2da45752-19ea-4cc5-a892-90e4df334baf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:11.552982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2da45752-19ea-4cc5-a892-90e4df334baf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:11.695344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2da45752-19ea-4cc5-a892-90e4df334baf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:11.704480 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2da45752-19ea-4cc5-a892-90e4df334baf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1513 microversion: 2.1 time: 0.166426 Aug 29 16:19:11.705442 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3826/7427] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:11 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:12.727065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-00877372-5ccf-4660-9d97-4897f204d954 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:12.728224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-00877372-5ccf-4660-9d97-4897f204d954 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:12.736310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00877372-5ccf-4660-9d97-4897f204d954 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:12.736770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00877372-5ccf-4660-9d97-4897f204d954 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:12.737260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00877372-5ccf-4660-9d97-4897f204d954 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:12.738126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00877372-5ccf-4660-9d97-4897f204d954 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:12.738578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00877372-5ccf-4660-9d97-4897f204d954 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:12.739006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00877372-5ccf-4660-9d97-4897f204d954 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:12.945226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-00877372-5ccf-4660-9d97-4897f204d954 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:12.953239 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-00877372-5ccf-4660-9d97-4897f204d954 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1510 microversion: 2.1 time: 0.230708 Aug 29 16:19:12.953830 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3602/7428] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:12 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:12.974120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9c8ebbf7-05c5-4e5b-9060-ae06541b0cae tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:12.974735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9c8ebbf7-05c5-4e5b-9060-ae06541b0cae tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:12.982622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c8ebbf7-05c5-4e5b-9060-ae06541b0cae tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:12.983125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c8ebbf7-05c5-4e5b-9060-ae06541b0cae tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:12.983706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c8ebbf7-05c5-4e5b-9060-ae06541b0cae tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:12.984404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c8ebbf7-05c5-4e5b-9060-ae06541b0cae tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:12.984900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c8ebbf7-05c5-4e5b-9060-ae06541b0cae tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:12.985372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c8ebbf7-05c5-4e5b-9060-ae06541b0cae tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:13.014197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9c8ebbf7-05c5-4e5b-9060-ae06541b0cae tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:19:13.069380 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.compute.api [None req-9c8ebbf7-05c5-4e5b-9060-ae06541b0cae tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Found an unconfirmed migration during delete, id: 16, status: finished Aug 29 16:19:14.213389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-22ddb973-d2e2-489c-b127-83c39cf2857a req-dab334a9-48d0-4641-86a0-d0068b7ab3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed301ced-99d7-4185-aa84-d6d13707b8ac", "name": "network-vif-plugged", "status": "completed", "tag": "dcc67635-6f76-4c90-8b7c-f16a7e6f386d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:14.224955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-22ddb973-d2e2-489c-b127-83c39cf2857a req-dab334a9-48d0-4641-86a0-d0068b7ab3f5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:14.225473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-22ddb973-d2e2-489c-b127-83c39cf2857a req-dab334a9-48d0-4641-86a0-d0068b7ab3f5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:14.225900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-22ddb973-d2e2-489c-b127-83c39cf2857a req-dab334a9-48d0-4641-86a0-d0068b7ab3f5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:14.241941 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-22ddb973-d2e2-489c-b127-83c39cf2857a req-dab334a9-48d0-4641-86a0-d0068b7ab3f5 service nova] Creating event network-vif-plugged:dcc67635-6f76-4c90-8b7c-f16a7e6f386d for instance ed301ced-99d7-4185-aa84-d6d13707b8ac on n-h1-839401-11 Aug 29 16:19:14.247602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-22ddb973-d2e2-489c-b127-83c39cf2857a req-dab334a9-48d0-4641-86a0-d0068b7ab3f5 service nova] Instance ed301ced-99d7-4185-aa84-d6d13707b8ac is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:19:14.259030 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-22ddb973-d2e2-489c-b127-83c39cf2857a req-dab334a9-48d0-4641-86a0-d0068b7ab3f5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049499 Aug 29 16:19:14.259655 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3603/7429] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:19:14.663302 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9c8ebbf7-05c5-4e5b-9060-ae06541b0cae tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 204 len: 0 microversion: 2.1 time: 1.693050 Aug 29 16:19:14.663948 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3827/7430] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:19:12 2022] DELETE /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 0 bytes in 1695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:19:14.672831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e8c3fa8-4536-43cd-bfe7-c3f755404aa9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:14.673556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9e8c3fa8-4536-43cd-bfe7-c3f755404aa9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:14.680027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e8c3fa8-4536-43cd-bfe7-c3f755404aa9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:14.680458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e8c3fa8-4536-43cd-bfe7-c3f755404aa9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:14.680897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e8c3fa8-4536-43cd-bfe7-c3f755404aa9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:14.681618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e8c3fa8-4536-43cd-bfe7-c3f755404aa9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:14.682077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e8c3fa8-4536-43cd-bfe7-c3f755404aa9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:14.682505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e8c3fa8-4536-43cd-bfe7-c3f755404aa9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:14.816480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9e8c3fa8-4536-43cd-bfe7-c3f755404aa9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:14.825059 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9e8c3fa8-4536-43cd-bfe7-c3f755404aa9 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1502 microversion: 2.1 time: 0.156549 Aug 29 16:19:14.825714 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3604/7431] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:14 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:15.852755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-69fa592d-7826-4b71-9257-24fe3c69cb76 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:15.854015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-69fa592d-7826-4b71-9257-24fe3c69cb76 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:15.865492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69fa592d-7826-4b71-9257-24fe3c69cb76 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:15.865992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69fa592d-7826-4b71-9257-24fe3c69cb76 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:15.866440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69fa592d-7826-4b71-9257-24fe3c69cb76 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:15.867148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69fa592d-7826-4b71-9257-24fe3c69cb76 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:15.867615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69fa592d-7826-4b71-9257-24fe3c69cb76 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:15.868072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-69fa592d-7826-4b71-9257-24fe3c69cb76 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:16.001331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-69fa592d-7826-4b71-9257-24fe3c69cb76 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:16.009727 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-69fa592d-7826-4b71-9257-24fe3c69cb76 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1502 microversion: 2.1 time: 0.164536 Aug 29 16:19:16.010308 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3828/7432] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:15 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:16.825801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-a585ab98-d914-439e-9dd5-33e994eb7f67 req-795e27dd-a5bc-4638-bf12-7b4652e9b64e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed301ced-99d7-4185-aa84-d6d13707b8ac", "name": "network-vif-deleted", "tag": "dcc67635-6f76-4c90-8b7c-f16a7e6f386d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:16.849078 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a585ab98-d914-439e-9dd5-33e994eb7f67 req-795e27dd-a5bc-4638-bf12-7b4652e9b64e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:16.849653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a585ab98-d914-439e-9dd5-33e994eb7f67 req-795e27dd-a5bc-4638-bf12-7b4652e9b64e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:16.850087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a585ab98-d914-439e-9dd5-33e994eb7f67 req-795e27dd-a5bc-4638-bf12-7b4652e9b64e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:16.860527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=86 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:16.863182 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-a585ab98-d914-439e-9dd5-33e994eb7f67 req-795e27dd-a5bc-4638-bf12-7b4652e9b64e service nova] Creating event network-vif-deleted:dcc67635-6f76-4c90-8b7c-f16a7e6f386d for instance ed301ced-99d7-4185-aa84-d6d13707b8ac on n-h1-839401-11 Aug 29 16:19:16.868910 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-a585ab98-d914-439e-9dd5-33e994eb7f67 req-795e27dd-a5bc-4638-bf12-7b4652e9b64e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047000 Aug 29 16:19:16.869565 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3605/7433] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:19:17.030833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0254ddab-0dd7-485d-80bb-4028620185bf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:17.031463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0254ddab-0dd7-485d-80bb-4028620185bf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:17.039172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0254ddab-0dd7-485d-80bb-4028620185bf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:17.039675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0254ddab-0dd7-485d-80bb-4028620185bf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:17.040127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0254ddab-0dd7-485d-80bb-4028620185bf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:17.040842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0254ddab-0dd7-485d-80bb-4028620185bf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:17.041347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0254ddab-0dd7-485d-80bb-4028620185bf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:17.041814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0254ddab-0dd7-485d-80bb-4028620185bf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:17.074199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0254ddab-0dd7-485d-80bb-4028620185bf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:17.074954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0254ddab-0dd7-485d-80bb-4028620185bf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:17.075547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0254ddab-0dd7-485d-80bb-4028620185bf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:17.075998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-0254ddab-0dd7-485d-80bb-4028620185bf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lazy-loading 'fault' on Instance uuid ed301ced-99d7-4185-aa84-d6d13707b8ac {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:19:17.119259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0254ddab-0dd7-485d-80bb-4028620185bf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a422266039944a0397ba8d45167f053a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cfbbe043d8a461a8f33128b10e82df7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:17.126418 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0254ddab-0dd7-485d-80bb-4028620185bf tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 200 len: 1305 microversion: 2.1 time: 0.099626 Aug 29 16:19:17.127003 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3829/7434] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:17 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:18.152235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-757409f4-0e2f-4907-beac-2d687566c6a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:18.152977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-757409f4-0e2f-4907-beac-2d687566c6a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:18.159667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-757409f4-0e2f-4907-beac-2d687566c6a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:18.160146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-757409f4-0e2f-4907-beac-2d687566c6a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:18.160581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-757409f4-0e2f-4907-beac-2d687566c6a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:18.161306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-757409f4-0e2f-4907-beac-2d687566c6a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:18.161762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-757409f4-0e2f-4907-beac-2d687566c6a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:18.162195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-757409f4-0e2f-4907-beac-2d687566c6a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:18.176027 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-757409f4-0e2f-4907-beac-2d687566c6a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] HTTP exception thrown: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-757409f4-0e2f-4907-beac-2d687566c6a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Request method failure captured: Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac HTTP/1.1 Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDObDrW233D2Peszf8cMmae2R8o9cZ2zFsHwW4TPYu6aRinemChgwVTwTtzDop3UGXfPx6d4ogi0ZeB5yXdU5_GDhwAwXaoLP6Ccnc3ZzpQTGmT1PpJbQDSeBHBffikVIi3aZa7uc7UUjw6mFjOsXPir4vgRfHvmHhYzCAQIwGIi1zTI Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 0cfbbe043d8a461a8f33128b10e82df7 Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-DeleteServersTestJSON-17556089 Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0cfbbe043d8a461a8f33128b10e82df7", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0cfbbe043d8a461a8f33128b10e82df7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0cfbbe043d8a461a8f33128b10e82df7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0cfbbe043d8a461a8f33128b10e82df7"}]}] Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-DeleteServersTestJSON-17556089 Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 0cfbbe043d8a461a8f33128b10e82df7 Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-DeleteServersTestJSON-17556089 Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-DeleteServersTestJSON-17556089-project Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: a422266039944a0397ba8d45167f053a Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-DeleteServersTestJSON-17556089-project Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'ed301ced-99d7-4185-aa84-d6d13707b8ac'} Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:19:18.177743 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:19:18.182249 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:19:18.182249 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:19:18.182249 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:19:18.182249 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:19:18.182249 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:19:18.182249 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. Aug 29 16:19:18.182249 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:19:18.182249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-757409f4-0e2f-4907-beac-2d687566c6a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Returning 404 to user: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:19:18.182249 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-757409f4-0e2f-4907-beac-2d687566c6a2 tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 404 len: 111 microversion: 2.1 time: 0.032892 Aug 29 16:19:18.182249 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3606/7435] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:18 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:19:18.196616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4c5a8e28-6d73-48d5-926c-cf73eae3077b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:18.197136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4c5a8e28-6d73-48d5-926c-cf73eae3077b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:18.204444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c5a8e28-6d73-48d5-926c-cf73eae3077b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:18.204935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c5a8e28-6d73-48d5-926c-cf73eae3077b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:18.205413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c5a8e28-6d73-48d5-926c-cf73eae3077b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:18.206113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c5a8e28-6d73-48d5-926c-cf73eae3077b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:18.206576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c5a8e28-6d73-48d5-926c-cf73eae3077b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:18.207008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c5a8e28-6d73-48d5-926c-cf73eae3077b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:18.220705 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-4c5a8e28-6d73-48d5-926c-cf73eae3077b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] HTTP exception thrown: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4c5a8e28-6d73-48d5-926c-cf73eae3077b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Request method failure captured: Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac HTTP/1.1 Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDObDrW233D2Peszf8cMmae2R8o9cZ2zFsHwW4TPYu6aRinemChgwVTwTtzDop3UGXfPx6d4ogi0ZeB5yXdU5_GDhwAwXaoLP6Ccnc3ZzpQTGmT1PpJbQDSeBHBffikVIi3aZa7uc7UUjw6mFjOsXPir4vgRfHvmHhYzCAQIwGIi1zTI Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 0cfbbe043d8a461a8f33128b10e82df7 Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-DeleteServersTestJSON-17556089 Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0cfbbe043d8a461a8f33128b10e82df7", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0cfbbe043d8a461a8f33128b10e82df7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0cfbbe043d8a461a8f33128b10e82df7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0cfbbe043d8a461a8f33128b10e82df7"}]}] Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-DeleteServersTestJSON-17556089 Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 0cfbbe043d8a461a8f33128b10e82df7 Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-DeleteServersTestJSON-17556089 Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-DeleteServersTestJSON-17556089-project Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: a422266039944a0397ba8d45167f053a Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-DeleteServersTestJSON-17556089-project Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'ed301ced-99d7-4185-aa84-d6d13707b8ac'} Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:19:18.222415 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:19:18.226285 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. Aug 29 16:19:18.226285 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:19:18.226285 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:19:18.226285 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:19:18.226285 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:19:18.226285 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:19:18.226285 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:19:18.226285 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:19:18.226285 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:19:18.226285 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. Aug 29 16:19:18.226285 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:19:18.226285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4c5a8e28-6d73-48d5-926c-cf73eae3077b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Returning 404 to user: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:19:18.226285 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4c5a8e28-6d73-48d5-926c-cf73eae3077b tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 404 len: 111 microversion: 2.1 time: 0.031290 Aug 29 16:19:18.226285 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3830/7436] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:19:18 2022] DELETE /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:19:18.235503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a5ff95da-0705-4a37-9b52-b8e04636526a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:18.236321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a5ff95da-0705-4a37-9b52-b8e04636526a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] [instance: ed301ced-99d7-4185-aa84-d6d13707b8ac] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:18.243593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5ff95da-0705-4a37-9b52-b8e04636526a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:18.244093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5ff95da-0705-4a37-9b52-b8e04636526a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:18.244536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5ff95da-0705-4a37-9b52-b8e04636526a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:18.245264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5ff95da-0705-4a37-9b52-b8e04636526a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:18.245723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5ff95da-0705-4a37-9b52-b8e04636526a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:18.246156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5ff95da-0705-4a37-9b52-b8e04636526a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:18.260249 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-a5ff95da-0705-4a37-9b52-b8e04636526a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] HTTP exception thrown: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a5ff95da-0705-4a37-9b52-b8e04636526a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Request method failure captured: Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac HTTP/1.1 Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDObDrW233D2Peszf8cMmae2R8o9cZ2zFsHwW4TPYu6aRinemChgwVTwTtzDop3UGXfPx6d4ogi0ZeB5yXdU5_GDhwAwXaoLP6Ccnc3ZzpQTGmT1PpJbQDSeBHBffikVIi3aZa7uc7UUjw6mFjOsXPir4vgRfHvmHhYzCAQIwGIi1zTI Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 0cfbbe043d8a461a8f33128b10e82df7 Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-DeleteServersTestJSON-17556089 Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0cfbbe043d8a461a8f33128b10e82df7", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0cfbbe043d8a461a8f33128b10e82df7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0cfbbe043d8a461a8f33128b10e82df7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0cfbbe043d8a461a8f33128b10e82df7"}]}] Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-DeleteServersTestJSON-17556089 Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 0cfbbe043d8a461a8f33128b10e82df7 Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-DeleteServersTestJSON-17556089 Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-DeleteServersTestJSON-17556089-project Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: a422266039944a0397ba8d45167f053a Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-DeleteServersTestJSON-17556089-project Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'ed301ced-99d7-4185-aa84-d6d13707b8ac'} Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:19:18.261833 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:19:18.266221 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:19:18.266221 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:19:18.266221 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:19:18.266221 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:19:18.266221 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:19:18.266221 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. Aug 29 16:19:18.266221 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:19:18.266221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a5ff95da-0705-4a37-9b52-b8e04636526a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] Returning 404 to user: Instance ed301ced-99d7-4185-aa84-d6d13707b8ac could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:19:18.266221 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a5ff95da-0705-4a37-9b52-b8e04636526a tempest-DeleteServersTestJSON-17556089 tempest-DeleteServersTestJSON-17556089-project] 10.222.0.62 "GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac" status: 404 len: 111 microversion: 2.1 time: 0.034079 Aug 29 16:19:18.266221 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3607/7437] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:18 2022] GET /compute/v2.1/servers/ed301ced-99d7-4185-aa84-d6d13707b8ac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:19:27.403089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-365130305", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "b5e1c5a9-e638-492e-a23c-f5febb70ca3d"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:27.411760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:27.465904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] validate_networks() for [('b5e1c5a9-e638-492e-a23c-f5febb70ca3d', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:19:27.860741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:19:27.861201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:19:27.861714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:19:27.862133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:19:27.862550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:19:27.871655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:27.872143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:27.872593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:27.873352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:27.873883 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:27.874364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:27.879927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:27.895692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Getting quotas for project 37ae7640021d470ba9a940c1728f10bb. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:19:27.901256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Getting quotas for user b050c7905fc242fe976bedb3bf3705ff and project 37ae7640021d470ba9a940c1728f10bb. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:19:27.913810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:19:27.916289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:19:27.973711 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6b652a94-b641-44a7-bf31-9457951e4d69 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695416 Aug 29 16:19:27.981012 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3831/7438] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:19:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:19:27.986830 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e2fa7ebd-42af-4a95-a042-1d9815fbadab tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:27.988037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e2fa7ebd-42af-4a95-a042-1d9815fbadab tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:27.992358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=32 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:28.052927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e2fa7ebd-42af-4a95-a042-1d9815fbadab tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:28.062522 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e2fa7ebd-42af-4a95-a042-1d9815fbadab tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1217 microversion: 2.1 time: 0.079561 Aug 29 16:19:28.063562 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3608/7439] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:27 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:29.083962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bae7fa09-04f7-4d71-8872-cc3f0cabc56f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:29.084589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bae7fa09-04f7-4d71-8872-cc3f0cabc56f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:29.096271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bae7fa09-04f7-4d71-8872-cc3f0cabc56f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:29.101606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bae7fa09-04f7-4d71-8872-cc3f0cabc56f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:29.102401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bae7fa09-04f7-4d71-8872-cc3f0cabc56f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:29.103311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bae7fa09-04f7-4d71-8872-cc3f0cabc56f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:29.103791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bae7fa09-04f7-4d71-8872-cc3f0cabc56f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:29.104232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bae7fa09-04f7-4d71-8872-cc3f0cabc56f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:29.225675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bae7fa09-04f7-4d71-8872-cc3f0cabc56f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:29.239612 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bae7fa09-04f7-4d71-8872-cc3f0cabc56f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1277 microversion: 2.1 time: 0.159387 Aug 29 16:19:29.240572 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3832/7440] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:29 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:19:30.264018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c69f2c6a-7130-4e4f-935c-9f48e6941d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:30.265071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c69f2c6a-7130-4e4f-935c-9f48e6941d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:30.267382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=5 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:30.276155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c69f2c6a-7130-4e4f-935c-9f48e6941d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:30.276753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c69f2c6a-7130-4e4f-935c-9f48e6941d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:30.277318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c69f2c6a-7130-4e4f-935c-9f48e6941d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:30.278109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c69f2c6a-7130-4e4f-935c-9f48e6941d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:30.278644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c69f2c6a-7130-4e4f-935c-9f48e6941d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:30.279148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c69f2c6a-7130-4e4f-935c-9f48e6941d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:30.503217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c69f2c6a-7130-4e4f-935c-9f48e6941d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:30.511865 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c69f2c6a-7130-4e4f-935c-9f48e6941d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1317 microversion: 2.1 time: 0.251873 Aug 29 16:19:30.512543 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3609/7441] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:30 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:30.662641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-376e769a-eb7c-47bd-a8ff-2421e34735c6 req-c5af43f6-d9ee-4da8-a100-76ab9beb87dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986b8f30-da8a-43cc-bc22-adbfa4a11733", "tag": "bc45b4f3-f579-4179-b3fe-de5c89eae33e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:30.676827 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-376e769a-eb7c-47bd-a8ff-2421e34735c6 req-c5af43f6-d9ee-4da8-a100-76ab9beb87dc service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:30.677536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-376e769a-eb7c-47bd-a8ff-2421e34735c6 req-c5af43f6-d9ee-4da8-a100-76ab9beb87dc service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:30.677989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-376e769a-eb7c-47bd-a8ff-2421e34735c6 req-c5af43f6-d9ee-4da8-a100-76ab9beb87dc service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:30.689582 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-376e769a-eb7c-47bd-a8ff-2421e34735c6 req-c5af43f6-d9ee-4da8-a100-76ab9beb87dc service nova] Creating event network-changed:bc45b4f3-f579-4179-b3fe-de5c89eae33e for instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 on n-h1-839401-11 Aug 29 16:19:30.694687 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-376e769a-eb7c-47bd-a8ff-2421e34735c6 req-c5af43f6-d9ee-4da8-a100-76ab9beb87dc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036144 Aug 29 16:19:30.695280 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3833/7442] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:19:31.538901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c8d60040-b2ed-4b9e-ba89-6aef8ca4d8bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:31.539927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c8d60040-b2ed-4b9e-ba89-6aef8ca4d8bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:31.551695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8d60040-b2ed-4b9e-ba89-6aef8ca4d8bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:31.552430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8d60040-b2ed-4b9e-ba89-6aef8ca4d8bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:31.552864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8d60040-b2ed-4b9e-ba89-6aef8ca4d8bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:31.553633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8d60040-b2ed-4b9e-ba89-6aef8ca4d8bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:31.554080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8d60040-b2ed-4b9e-ba89-6aef8ca4d8bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:31.554509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8d60040-b2ed-4b9e-ba89-6aef8ca4d8bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:31.707396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c8d60040-b2ed-4b9e-ba89-6aef8ca4d8bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:31.715478 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c8d60040-b2ed-4b9e-ba89-6aef8ca4d8bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1317 microversion: 2.1 time: 0.183254 Aug 29 16:19:31.716064 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3610/7443] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:31 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:32.741132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-93a94cda-486e-4787-9f14-6d260750755a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:32.742172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-93a94cda-486e-4787-9f14-6d260750755a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:32.752497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93a94cda-486e-4787-9f14-6d260750755a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:32.753433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93a94cda-486e-4787-9f14-6d260750755a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:32.754243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93a94cda-486e-4787-9f14-6d260750755a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:32.755466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93a94cda-486e-4787-9f14-6d260750755a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:32.755944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93a94cda-486e-4787-9f14-6d260750755a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:32.756414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93a94cda-486e-4787-9f14-6d260750755a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:32.910041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-93a94cda-486e-4787-9f14-6d260750755a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:32.923193 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-93a94cda-486e-4787-9f14-6d260750755a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1317 microversion: 2.1 time: 0.189533 Aug 29 16:19:32.924151 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3834/7444] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:32 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:33.949861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-61db09c5-7060-443f-bd0e-392d56e32644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:33.950749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-61db09c5-7060-443f-bd0e-392d56e32644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:33.961013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61db09c5-7060-443f-bd0e-392d56e32644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:33.961534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61db09c5-7060-443f-bd0e-392d56e32644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:33.961975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61db09c5-7060-443f-bd0e-392d56e32644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:33.962677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61db09c5-7060-443f-bd0e-392d56e32644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:33.963137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61db09c5-7060-443f-bd0e-392d56e32644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:33.963567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-61db09c5-7060-443f-bd0e-392d56e32644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:34.096214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-61db09c5-7060-443f-bd0e-392d56e32644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:34.105119 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-61db09c5-7060-443f-bd0e-392d56e32644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1317 microversion: 2.1 time: 0.162247 Aug 29 16:19:34.105705 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3611/7445] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:33 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:35.134140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3ccba75e-0cd0-474e-9362-82becfc60e7d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:35.134750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3ccba75e-0cd0-474e-9362-82becfc60e7d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:35.142582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ccba75e-0cd0-474e-9362-82becfc60e7d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:35.143825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ccba75e-0cd0-474e-9362-82becfc60e7d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:35.146785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ccba75e-0cd0-474e-9362-82becfc60e7d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:35.148907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ccba75e-0cd0-474e-9362-82becfc60e7d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:35.149523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ccba75e-0cd0-474e-9362-82becfc60e7d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:35.149974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3ccba75e-0cd0-474e-9362-82becfc60e7d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:35.286798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3ccba75e-0cd0-474e-9362-82becfc60e7d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:35.295378 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3ccba75e-0cd0-474e-9362-82becfc60e7d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1317 microversion: 2.1 time: 0.165530 Aug 29 16:19:35.296018 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3835/7446] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:35 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:36.316759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f8e89303-a0b0-4a01-bc9d-7e3d3942a344 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:36.317415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f8e89303-a0b0-4a01-bc9d-7e3d3942a344 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:36.324491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8e89303-a0b0-4a01-bc9d-7e3d3942a344 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:36.324989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8e89303-a0b0-4a01-bc9d-7e3d3942a344 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:36.325626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8e89303-a0b0-4a01-bc9d-7e3d3942a344 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:36.326488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8e89303-a0b0-4a01-bc9d-7e3d3942a344 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:36.326945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8e89303-a0b0-4a01-bc9d-7e3d3942a344 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:36.327360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8e89303-a0b0-4a01-bc9d-7e3d3942a344 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:36.459779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-323187c1-e989-4f37-ae0d-856589785ecf req-49592882-71f2-41c8-86ca-d9a941079002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986b8f30-da8a-43cc-bc22-adbfa4a11733", "name": "network-vif-plugged", "status": "completed", "tag": "bc45b4f3-f579-4179-b3fe-de5c89eae33e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:36.462550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f8e89303-a0b0-4a01-bc9d-7e3d3942a344 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:36.470740 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f8e89303-a0b0-4a01-bc9d-7e3d3942a344 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1317 microversion: 2.1 time: 0.158381 Aug 29 16:19:36.484667 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3612/7447] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:36 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:36.484793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-323187c1-e989-4f37-ae0d-856589785ecf req-49592882-71f2-41c8-86ca-d9a941079002 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:36.484793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-323187c1-e989-4f37-ae0d-856589785ecf req-49592882-71f2-41c8-86ca-d9a941079002 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:36.484793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-323187c1-e989-4f37-ae0d-856589785ecf req-49592882-71f2-41c8-86ca-d9a941079002 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:36.486722 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-323187c1-e989-4f37-ae0d-856589785ecf req-49592882-71f2-41c8-86ca-d9a941079002 service nova] Creating event network-vif-plugged:bc45b4f3-f579-4179-b3fe-de5c89eae33e for instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 on n-h1-839401-11 Aug 29 16:19:36.492075 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-323187c1-e989-4f37-ae0d-856589785ecf req-49592882-71f2-41c8-86ca-d9a941079002 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036875 Aug 29 16:19:36.492930 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3836/7448] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:19:37.492209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-03723126-1e65-4871-a5f6-d30575a36fd8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:37.492816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-03723126-1e65-4871-a5f6-d30575a36fd8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:37.500220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03723126-1e65-4871-a5f6-d30575a36fd8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:37.500712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03723126-1e65-4871-a5f6-d30575a36fd8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:37.501172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03723126-1e65-4871-a5f6-d30575a36fd8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:37.501852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03723126-1e65-4871-a5f6-d30575a36fd8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:37.502299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03723126-1e65-4871-a5f6-d30575a36fd8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:37.502720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03723126-1e65-4871-a5f6-d30575a36fd8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:37.650028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-03723126-1e65-4871-a5f6-d30575a36fd8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:37.658065 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-03723126-1e65-4871-a5f6-d30575a36fd8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1317 microversion: 2.1 time: 0.170207 Aug 29 16:19:37.658648 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3613/7449] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:37 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:38.683815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f3a2c833-3781-400b-a127-a8f8881d6e2e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:38.684402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f3a2c833-3781-400b-a127-a8f8881d6e2e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:38.688583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:38.689374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:38.699156 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3a2c833-3781-400b-a127-a8f8881d6e2e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:38.699927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3a2c833-3781-400b-a127-a8f8881d6e2e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:38.700554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3a2c833-3781-400b-a127-a8f8881d6e2e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:38.701616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3a2c833-3781-400b-a127-a8f8881d6e2e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:38.702389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3a2c833-3781-400b-a127-a8f8881d6e2e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:38.702952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f3a2c833-3781-400b-a127-a8f8881d6e2e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:38.860486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f3a2c833-3781-400b-a127-a8f8881d6e2e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:38.868851 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f3a2c833-3781-400b-a127-a8f8881d6e2e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1505 microversion: 2.1 time: 0.192461 Aug 29 16:19:38.869473 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3837/7450] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:38 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:38.889148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-88c28fe8-a966-4334-96d8-56af5d24db55 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:38.889765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-88c28fe8-a966-4334-96d8-56af5d24db55 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:38.891684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:38.898014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88c28fe8-a966-4334-96d8-56af5d24db55 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:38.898497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88c28fe8-a966-4334-96d8-56af5d24db55 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:38.898932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88c28fe8-a966-4334-96d8-56af5d24db55 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:38.899625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88c28fe8-a966-4334-96d8-56af5d24db55 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:38.900082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88c28fe8-a966-4334-96d8-56af5d24db55 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:38.900529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88c28fe8-a966-4334-96d8-56af5d24db55 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:39.048402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-88c28fe8-a966-4334-96d8-56af5d24db55 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:39.056562 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-88c28fe8-a966-4334-96d8-56af5d24db55 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1505 microversion: 2.1 time: 0.171435 Aug 29 16:19:39.057158 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3614/7451] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:38 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:39.076521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-541c7e8d-ceb5-4f6c-9d4d-00e5ae788b61 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:39.079063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-541c7e8d-ceb5-4f6c-9d4d-00e5ae788b61 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:39.085329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-541c7e8d-ceb5-4f6c-9d4d-00e5ae788b61 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:39.085837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-541c7e8d-ceb5-4f6c-9d4d-00e5ae788b61 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:39.086286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-541c7e8d-ceb5-4f6c-9d4d-00e5ae788b61 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:39.087000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-541c7e8d-ceb5-4f6c-9d4d-00e5ae788b61 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:39.087469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-541c7e8d-ceb5-4f6c-9d4d-00e5ae788b61 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:39.087902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-541c7e8d-ceb5-4f6c-9d4d-00e5ae788b61 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:39.161235 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-541c7e8d-ceb5-4f6c-9d4d-00e5ae788b61 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "PUT /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1077 microversion: 2.1 time: 0.088561 Aug 29 16:19:39.161925 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3838/7452] 10.222.0.62 () {60 vars in 1256 bytes} [Mon Aug 29 16:19:39 2022] PUT /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1077 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:39.180127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0e97dc54-26a9-4b4a-823e-963e7e1f9d54 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:39.180755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0e97dc54-26a9-4b4a-823e-963e7e1f9d54 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:39.187121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e97dc54-26a9-4b4a-823e-963e7e1f9d54 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:39.187669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e97dc54-26a9-4b4a-823e-963e7e1f9d54 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:39.188112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e97dc54-26a9-4b4a-823e-963e7e1f9d54 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:39.188897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e97dc54-26a9-4b4a-823e-963e7e1f9d54 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:39.189379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e97dc54-26a9-4b4a-823e-963e7e1f9d54 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:39.189780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0e97dc54-26a9-4b4a-823e-963e7e1f9d54 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:39.330183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0e97dc54-26a9-4b4a-823e-963e7e1f9d54 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:39.338935 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0e97dc54-26a9-4b4a-823e-963e7e1f9d54 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1503 microversion: 2.1 time: 0.163775 Aug 29 16:19:39.339520 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3615/7453] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:39 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:39.360388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-350a57f4-01fa-4e24-aed9-974fe32a2863 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:39.361022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-350a57f4-01fa-4e24-aed9-974fe32a2863 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:39.367857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-350a57f4-01fa-4e24-aed9-974fe32a2863 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:39.368364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-350a57f4-01fa-4e24-aed9-974fe32a2863 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:39.368820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-350a57f4-01fa-4e24-aed9-974fe32a2863 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:39.369598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-350a57f4-01fa-4e24-aed9-974fe32a2863 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:39.370079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-350a57f4-01fa-4e24-aed9-974fe32a2863 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:39.370514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-350a57f4-01fa-4e24-aed9-974fe32a2863 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:39.512933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-350a57f4-01fa-4e24-aed9-974fe32a2863 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:39.521566 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-350a57f4-01fa-4e24-aed9-974fe32a2863 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1503 microversion: 2.1 time: 0.165137 Aug 29 16:19:39.522207 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3839/7454] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:39 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:39.544588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b7830430-3fb1-417e-980a-53cd0718a26c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:19:39.548083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b7830430-3fb1-417e-980a-53cd0718a26c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:39.557007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7830430-3fb1-417e-980a-53cd0718a26c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:39.557733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7830430-3fb1-417e-980a-53cd0718a26c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:39.558324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7830430-3fb1-417e-980a-53cd0718a26c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:39.559309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7830430-3fb1-417e-980a-53cd0718a26c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:39.559869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7830430-3fb1-417e-980a-53cd0718a26c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:39.560438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7830430-3fb1-417e-980a-53cd0718a26c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:39.591514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b7830430-3fb1-417e-980a-53cd0718a26c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:39.597778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b7830430-3fb1-417e-980a-53cd0718a26c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Old instance type m1.heat2, new instance type m1.heat {{(pid=122361) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:19:39.605729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b7830430-3fb1-417e-980a-53cd0718a26c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:19:39.606144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b7830430-3fb1-417e-980a-53cd0718a26c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:19:39.606613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b7830430-3fb1-417e-980a-53cd0718a26c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:19:39.607018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b7830430-3fb1-417e-980a-53cd0718a26c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:19:39.607426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-b7830430-3fb1-417e-980a-53cd0718a26c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:19:39.677400 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b7830430-3fb1-417e-980a-53cd0718a26c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "POST /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733/action" status: 202 len: 0 microversion: 2.1 time: 0.139141 Aug 29 16:19:39.678052 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3616/7455] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:19:39 2022] POST /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:19:39.686789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4856de08-1732-416e-b9a1-b07a697fbe6d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:39.687454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4856de08-1732-416e-b9a1-b07a697fbe6d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:39.694895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4856de08-1732-416e-b9a1-b07a697fbe6d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:39.695554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4856de08-1732-416e-b9a1-b07a697fbe6d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:39.696004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4856de08-1732-416e-b9a1-b07a697fbe6d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:39.696736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4856de08-1732-416e-b9a1-b07a697fbe6d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:39.697227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4856de08-1732-416e-b9a1-b07a697fbe6d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:39.697673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4856de08-1732-416e-b9a1-b07a697fbe6d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:39.836275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4856de08-1732-416e-b9a1-b07a697fbe6d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:39.845827 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4856de08-1732-416e-b9a1-b07a697fbe6d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1514 microversion: 2.1 time: 0.163035 Aug 29 16:19:39.846468 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3840/7456] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:39 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:40.868388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-644bba0a-7c07-4cd2-a451-a494d430a303 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:40.869016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-644bba0a-7c07-4cd2-a451-a494d430a303 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:40.876688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-644bba0a-7c07-4cd2-a451-a494d430a303 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:40.877119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-644bba0a-7c07-4cd2-a451-a494d430a303 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:40.877579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-644bba0a-7c07-4cd2-a451-a494d430a303 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:40.878291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-644bba0a-7c07-4cd2-a451-a494d430a303 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:40.878745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-644bba0a-7c07-4cd2-a451-a494d430a303 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:40.879170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-644bba0a-7c07-4cd2-a451-a494d430a303 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:41.066200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-644bba0a-7c07-4cd2-a451-a494d430a303 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:41.075084 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-644bba0a-7c07-4cd2-a451-a494d430a303 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1514 microversion: 2.1 time: 0.211333 Aug 29 16:19:41.075748 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3617/7457] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:40 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:42.100881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fceb2d54-9e35-4fac-99d6-45f9407d5a6b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:42.102185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fceb2d54-9e35-4fac-99d6-45f9407d5a6b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:42.114320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fceb2d54-9e35-4fac-99d6-45f9407d5a6b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:42.115162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fceb2d54-9e35-4fac-99d6-45f9407d5a6b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:42.115929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fceb2d54-9e35-4fac-99d6-45f9407d5a6b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:42.117295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fceb2d54-9e35-4fac-99d6-45f9407d5a6b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:42.117801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fceb2d54-9e35-4fac-99d6-45f9407d5a6b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:42.118251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fceb2d54-9e35-4fac-99d6-45f9407d5a6b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:42.254735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fceb2d54-9e35-4fac-99d6-45f9407d5a6b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:42.262775 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fceb2d54-9e35-4fac-99d6-45f9407d5a6b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.169048 Aug 29 16:19:42.263345 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3841/7458] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:42 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:43.284518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1470efe7-784c-4f66-ab8b-3a3f40117b93 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:43.285072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1470efe7-784c-4f66-ab8b-3a3f40117b93 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:43.292190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1470efe7-784c-4f66-ab8b-3a3f40117b93 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:43.292680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1470efe7-784c-4f66-ab8b-3a3f40117b93 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:43.293126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1470efe7-784c-4f66-ab8b-3a3f40117b93 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:43.293832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1470efe7-784c-4f66-ab8b-3a3f40117b93 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:43.294299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1470efe7-784c-4f66-ab8b-3a3f40117b93 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:43.294729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1470efe7-784c-4f66-ab8b-3a3f40117b93 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:43.432316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1470efe7-784c-4f66-ab8b-3a3f40117b93 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:43.440696 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1470efe7-784c-4f66-ab8b-3a3f40117b93 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.160810 Aug 29 16:19:43.441308 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3618/7459] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:43 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:44.466312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e4e2c7a8-f344-4ab6-9c4a-723f3bc4b118 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:44.467363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e4e2c7a8-f344-4ab6-9c4a-723f3bc4b118 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:44.479492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4e2c7a8-f344-4ab6-9c4a-723f3bc4b118 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:44.480001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4e2c7a8-f344-4ab6-9c4a-723f3bc4b118 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:44.480461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4e2c7a8-f344-4ab6-9c4a-723f3bc4b118 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:44.481216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4e2c7a8-f344-4ab6-9c4a-723f3bc4b118 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:44.481700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4e2c7a8-f344-4ab6-9c4a-723f3bc4b118 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:44.482146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4e2c7a8-f344-4ab6-9c4a-723f3bc4b118 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:44.633345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e4e2c7a8-f344-4ab6-9c4a-723f3bc4b118 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:44.642052 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e4e2c7a8-f344-4ab6-9c4a-723f3bc4b118 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.182319 Aug 29 16:19:44.642694 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3842/7460] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:44 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:45.670662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8f938287-c0fd-4ac1-a018-203f088f07c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:45.671321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8f938287-c0fd-4ac1-a018-203f088f07c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:45.679312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f938287-c0fd-4ac1-a018-203f088f07c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:45.679839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f938287-c0fd-4ac1-a018-203f088f07c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:45.680313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f938287-c0fd-4ac1-a018-203f088f07c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:45.681072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f938287-c0fd-4ac1-a018-203f088f07c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:45.681606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f938287-c0fd-4ac1-a018-203f088f07c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:45.682074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f938287-c0fd-4ac1-a018-203f088f07c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:45.833132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8f938287-c0fd-4ac1-a018-203f088f07c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:45.841816 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8f938287-c0fd-4ac1-a018-203f088f07c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.175593 Aug 29 16:19:45.842377 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3619/7461] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:45 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:46.864331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-817e259b-b5dc-4544-ab74-051d39a27618 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:46.864970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-817e259b-b5dc-4544-ab74-051d39a27618 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:46.872618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817e259b-b5dc-4544-ab74-051d39a27618 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:46.873127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817e259b-b5dc-4544-ab74-051d39a27618 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:46.873612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817e259b-b5dc-4544-ab74-051d39a27618 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:46.874351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817e259b-b5dc-4544-ab74-051d39a27618 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:46.874824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817e259b-b5dc-4544-ab74-051d39a27618 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:46.875278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-817e259b-b5dc-4544-ab74-051d39a27618 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:47.025194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-817e259b-b5dc-4544-ab74-051d39a27618 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:47.034933 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-817e259b-b5dc-4544-ab74-051d39a27618 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.174802 Aug 29 16:19:47.035510 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3843/7462] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:46 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:48.060800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8a6e1513-e8fc-411a-ae5e-bd4d8819952d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:48.061553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8a6e1513-e8fc-411a-ae5e-bd4d8819952d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:48.069197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a6e1513-e8fc-411a-ae5e-bd4d8819952d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:48.069706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a6e1513-e8fc-411a-ae5e-bd4d8819952d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:48.070174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a6e1513-e8fc-411a-ae5e-bd4d8819952d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:48.070909 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a6e1513-e8fc-411a-ae5e-bd4d8819952d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:48.071395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a6e1513-e8fc-411a-ae5e-bd4d8819952d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:48.071841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a6e1513-e8fc-411a-ae5e-bd4d8819952d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:48.209526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8a6e1513-e8fc-411a-ae5e-bd4d8819952d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:48.221606 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8a6e1513-e8fc-411a-ae5e-bd4d8819952d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.167168 Aug 29 16:19:48.222414 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3620/7463] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:48 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:49.247809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-329db6b7-1a84-452a-9bc7-9675778ba644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:49.248733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-329db6b7-1a84-452a-9bc7-9675778ba644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:49.256654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-329db6b7-1a84-452a-9bc7-9675778ba644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:49.257196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-329db6b7-1a84-452a-9bc7-9675778ba644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:49.257663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-329db6b7-1a84-452a-9bc7-9675778ba644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:49.258388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-329db6b7-1a84-452a-9bc7-9675778ba644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:49.258874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-329db6b7-1a84-452a-9bc7-9675778ba644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:49.259323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-329db6b7-1a84-452a-9bc7-9675778ba644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:49.395707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-329db6b7-1a84-452a-9bc7-9675778ba644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:49.404269 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-329db6b7-1a84-452a-9bc7-9675778ba644 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.163617 Aug 29 16:19:49.404860 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3844/7464] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:49 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:50.429027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5c82e315-f0a4-43a5-9bb5-e0102daa2fa0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:50.429933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5c82e315-f0a4-43a5-9bb5-e0102daa2fa0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:50.441411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c82e315-f0a4-43a5-9bb5-e0102daa2fa0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:50.442164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c82e315-f0a4-43a5-9bb5-e0102daa2fa0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:50.442839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c82e315-f0a4-43a5-9bb5-e0102daa2fa0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:50.443876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c82e315-f0a4-43a5-9bb5-e0102daa2fa0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:50.444630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c82e315-f0a4-43a5-9bb5-e0102daa2fa0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:50.445345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5c82e315-f0a4-43a5-9bb5-e0102daa2fa0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:50.585783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5c82e315-f0a4-43a5-9bb5-e0102daa2fa0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:50.593918 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5c82e315-f0a4-43a5-9bb5-e0102daa2fa0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.171209 Aug 29 16:19:50.594481 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3621/7465] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:50 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:51.619962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3267c10d-b84a-4da4-b489-2d269d68384c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:51.621017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3267c10d-b84a-4da4-b489-2d269d68384c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:51.629948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3267c10d-b84a-4da4-b489-2d269d68384c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:51.630453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3267c10d-b84a-4da4-b489-2d269d68384c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:51.630907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3267c10d-b84a-4da4-b489-2d269d68384c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:51.631623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3267c10d-b84a-4da4-b489-2d269d68384c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:51.632102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3267c10d-b84a-4da4-b489-2d269d68384c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:51.632545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3267c10d-b84a-4da4-b489-2d269d68384c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:51.778921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3267c10d-b84a-4da4-b489-2d269d68384c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:51.790997 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3267c10d-b84a-4da4-b489-2d269d68384c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.177728 Aug 29 16:19:51.791677 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3845/7466] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:51 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:52.818571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-97760dbe-5849-4933-963a-da4a1c94eca0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:52.819448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-97760dbe-5849-4933-963a-da4a1c94eca0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:52.830225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97760dbe-5849-4933-963a-da4a1c94eca0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:52.830731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97760dbe-5849-4933-963a-da4a1c94eca0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:52.831285 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97760dbe-5849-4933-963a-da4a1c94eca0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:52.832016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97760dbe-5849-4933-963a-da4a1c94eca0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:52.832471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97760dbe-5849-4933-963a-da4a1c94eca0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:52.832879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97760dbe-5849-4933-963a-da4a1c94eca0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:52.974331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-97760dbe-5849-4933-963a-da4a1c94eca0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:52.983052 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-97760dbe-5849-4933-963a-da4a1c94eca0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.171408 Aug 29 16:19:52.983680 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3622/7467] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:52 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:54.006051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-963402f9-ac65-47c1-b8bf-a1c2d499ef0f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:54.006836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-963402f9-ac65-47c1-b8bf-a1c2d499ef0f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:54.016113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-963402f9-ac65-47c1-b8bf-a1c2d499ef0f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:54.016632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-963402f9-ac65-47c1-b8bf-a1c2d499ef0f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:54.017113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-963402f9-ac65-47c1-b8bf-a1c2d499ef0f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:54.017863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-963402f9-ac65-47c1-b8bf-a1c2d499ef0f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:54.018342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-963402f9-ac65-47c1-b8bf-a1c2d499ef0f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:54.018793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-963402f9-ac65-47c1-b8bf-a1c2d499ef0f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:54.160337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-963402f9-ac65-47c1-b8bf-a1c2d499ef0f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:54.173023 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-963402f9-ac65-47c1-b8bf-a1c2d499ef0f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.172180 Aug 29 16:19:54.173651 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3846/7468] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:53 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:19:55.197640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-53d7c9ea-241e-4f2b-9cca-adb01813c127 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:55.198547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-53d7c9ea-241e-4f2b-9cca-adb01813c127 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:55.209673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53d7c9ea-241e-4f2b-9cca-adb01813c127 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:55.210413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53d7c9ea-241e-4f2b-9cca-adb01813c127 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:55.211091 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53d7c9ea-241e-4f2b-9cca-adb01813c127 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:55.212154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53d7c9ea-241e-4f2b-9cca-adb01813c127 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:55.212855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53d7c9ea-241e-4f2b-9cca-adb01813c127 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:55.213565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53d7c9ea-241e-4f2b-9cca-adb01813c127 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:55.350497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-53d7c9ea-241e-4f2b-9cca-adb01813c127 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:55.359171 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-53d7c9ea-241e-4f2b-9cca-adb01813c127 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.167570 Aug 29 16:19:55.359947 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3623/7469] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:55 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:56.380216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a469c7be-a43b-4393-af76-3e375a9bbf5f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:56.380865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a469c7be-a43b-4393-af76-3e375a9bbf5f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:56.388293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a469c7be-a43b-4393-af76-3e375a9bbf5f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:56.388948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a469c7be-a43b-4393-af76-3e375a9bbf5f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:56.389497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a469c7be-a43b-4393-af76-3e375a9bbf5f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:56.390345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a469c7be-a43b-4393-af76-3e375a9bbf5f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:56.390627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a469c7be-a43b-4393-af76-3e375a9bbf5f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:56.391081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a469c7be-a43b-4393-af76-3e375a9bbf5f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:56.548250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a469c7be-a43b-4393-af76-3e375a9bbf5f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:56.556761 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a469c7be-a43b-4393-af76-3e375a9bbf5f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.180581 Aug 29 16:19:56.557646 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3847/7470] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:56 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:57.584095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a93726b7-8b46-49b9-9473-48d8464d4a4e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:57.585143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a93726b7-8b46-49b9-9473-48d8464d4a4e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:57.599077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a93726b7-8b46-49b9-9473-48d8464d4a4e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:57.599982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a93726b7-8b46-49b9-9473-48d8464d4a4e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:57.600792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a93726b7-8b46-49b9-9473-48d8464d4a4e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:57.602468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a93726b7-8b46-49b9-9473-48d8464d4a4e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:57.603320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a93726b7-8b46-49b9-9473-48d8464d4a4e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:57.604112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a93726b7-8b46-49b9-9473-48d8464d4a4e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:57.611775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:57.757273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a93726b7-8b46-49b9-9473-48d8464d4a4e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:57.765795 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a93726b7-8b46-49b9-9473-48d8464d4a4e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.188516 Aug 29 16:19:57.766382 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3624/7471] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:57 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:58.797439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fc646d84-227b-4daa-b795-67dbcc0e7820 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:58.798681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fc646d84-227b-4daa-b795-67dbcc0e7820 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:58.802008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:58.807592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc646d84-227b-4daa-b795-67dbcc0e7820 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:58.808094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc646d84-227b-4daa-b795-67dbcc0e7820 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:58.808573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc646d84-227b-4daa-b795-67dbcc0e7820 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:58.809382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc646d84-227b-4daa-b795-67dbcc0e7820 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:58.809857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc646d84-227b-4daa-b795-67dbcc0e7820 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:58.810311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fc646d84-227b-4daa-b795-67dbcc0e7820 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:19:58.813911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:58.951222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fc646d84-227b-4daa-b795-67dbcc0e7820 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:19:58.963774 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fc646d84-227b-4daa-b795-67dbcc0e7820 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.172667 Aug 29 16:19:58.964604 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3848/7472] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:58 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:19:59.989389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e1270897-4d57-4df9-aee4-6540b86fc808 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:19:59.989957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e1270897-4d57-4df9-aee4-6540b86fc808 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:19:59.992835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=40 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:19:59.998436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1270897-4d57-4df9-aee4-6540b86fc808 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:19:59.998927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1270897-4d57-4df9-aee4-6540b86fc808 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:19:59.999362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1270897-4d57-4df9-aee4-6540b86fc808 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:00.000066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1270897-4d57-4df9-aee4-6540b86fc808 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:00.000521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1270897-4d57-4df9-aee4-6540b86fc808 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:00.001022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e1270897-4d57-4df9-aee4-6540b86fc808 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:00.218275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e1270897-4d57-4df9-aee4-6540b86fc808 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:00.227073 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e1270897-4d57-4df9-aee4-6540b86fc808 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.242376 Aug 29 16:20:00.227747 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3625/7473] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:19:59 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:01.253018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-80a76b24-5758-4233-891e-1c7310c5a481 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:01.253989 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-80a76b24-5758-4233-891e-1c7310c5a481 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:01.261587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80a76b24-5758-4233-891e-1c7310c5a481 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:01.262062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80a76b24-5758-4233-891e-1c7310c5a481 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:01.262534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80a76b24-5758-4233-891e-1c7310c5a481 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:01.263236 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80a76b24-5758-4233-891e-1c7310c5a481 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:01.263702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80a76b24-5758-4233-891e-1c7310c5a481 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:01.264138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80a76b24-5758-4233-891e-1c7310c5a481 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:01.405637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-80a76b24-5758-4233-891e-1c7310c5a481 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:01.414133 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-80a76b24-5758-4233-891e-1c7310c5a481 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.167952 Aug 29 16:20:01.414722 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3849/7474] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:01 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:02.438767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c417680b-086f-49d5-aa15-553034f2de36 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:02.439734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c417680b-086f-49d5-aa15-553034f2de36 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:02.451813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c417680b-086f-49d5-aa15-553034f2de36 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:02.452635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c417680b-086f-49d5-aa15-553034f2de36 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:02.453481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c417680b-086f-49d5-aa15-553034f2de36 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:02.454683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c417680b-086f-49d5-aa15-553034f2de36 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:02.455420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c417680b-086f-49d5-aa15-553034f2de36 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:02.456134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c417680b-086f-49d5-aa15-553034f2de36 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:02.597821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c417680b-086f-49d5-aa15-553034f2de36 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:02.606222 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c417680b-086f-49d5-aa15-553034f2de36 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.174178 Aug 29 16:20:02.606812 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3626/7475] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:02 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:03.631513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-13999cc6-322d-47d2-afc5-95d95d403d46 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:03.632270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-13999cc6-322d-47d2-afc5-95d95d403d46 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:03.641013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13999cc6-322d-47d2-afc5-95d95d403d46 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:03.641719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13999cc6-322d-47d2-afc5-95d95d403d46 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:03.642232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13999cc6-322d-47d2-afc5-95d95d403d46 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:03.643144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13999cc6-322d-47d2-afc5-95d95d403d46 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:03.643702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13999cc6-322d-47d2-afc5-95d95d403d46 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:03.644275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-13999cc6-322d-47d2-afc5-95d95d403d46 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:03.804339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-13999cc6-322d-47d2-afc5-95d95d403d46 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:03.812989 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-13999cc6-322d-47d2-afc5-95d95d403d46 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.188038 Aug 29 16:20:03.813702 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3850/7476] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:03 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:04.838517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e1d2230-9041-45df-bbe6-788ec1261e1b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:04.840405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9e1d2230-9041-45df-bbe6-788ec1261e1b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:04.852405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e1d2230-9041-45df-bbe6-788ec1261e1b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:04.852899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e1d2230-9041-45df-bbe6-788ec1261e1b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:04.853365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e1d2230-9041-45df-bbe6-788ec1261e1b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:04.854073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e1d2230-9041-45df-bbe6-788ec1261e1b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:04.854529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e1d2230-9041-45df-bbe6-788ec1261e1b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:04.854955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e1d2230-9041-45df-bbe6-788ec1261e1b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:04.991251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9e1d2230-9041-45df-bbe6-788ec1261e1b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:04.999480 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9e1d2230-9041-45df-bbe6-788ec1261e1b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.167788 Aug 29 16:20:05.000072 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3627/7477] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:04 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:06.025310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6fc0177b-c53e-40c6-8a00-bc1283dc611f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:06.026348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6fc0177b-c53e-40c6-8a00-bc1283dc611f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:06.038324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fc0177b-c53e-40c6-8a00-bc1283dc611f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:06.039151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fc0177b-c53e-40c6-8a00-bc1283dc611f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:06.039904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fc0177b-c53e-40c6-8a00-bc1283dc611f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:06.041071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fc0177b-c53e-40c6-8a00-bc1283dc611f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:06.041908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fc0177b-c53e-40c6-8a00-bc1283dc611f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:06.042641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6fc0177b-c53e-40c6-8a00-bc1283dc611f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:06.193593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6fc0177b-c53e-40c6-8a00-bc1283dc611f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:06.202084 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6fc0177b-c53e-40c6-8a00-bc1283dc611f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.183570 Aug 29 16:20:06.202662 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3851/7478] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:06 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:07.227441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-55ff7136-2f1e-42a2-b67f-44c0348ecb57 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:07.228012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-55ff7136-2f1e-42a2-b67f-44c0348ecb57 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:07.235093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55ff7136-2f1e-42a2-b67f-44c0348ecb57 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:07.235540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55ff7136-2f1e-42a2-b67f-44c0348ecb57 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:07.235979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55ff7136-2f1e-42a2-b67f-44c0348ecb57 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:07.236677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55ff7136-2f1e-42a2-b67f-44c0348ecb57 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:07.237135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55ff7136-2f1e-42a2-b67f-44c0348ecb57 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:07.237591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55ff7136-2f1e-42a2-b67f-44c0348ecb57 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:07.374793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-55ff7136-2f1e-42a2-b67f-44c0348ecb57 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:07.383239 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-55ff7136-2f1e-42a2-b67f-44c0348ecb57 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.162172 Aug 29 16:20:07.383837 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3628/7479] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:07 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:08.408995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-46334e68-450b-47a5-9c4c-7cf57c37c31e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:08.410087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-46334e68-450b-47a5-9c4c-7cf57c37c31e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:08.421914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46334e68-450b-47a5-9c4c-7cf57c37c31e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:08.422746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46334e68-450b-47a5-9c4c-7cf57c37c31e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:08.423503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46334e68-450b-47a5-9c4c-7cf57c37c31e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:08.424679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46334e68-450b-47a5-9c4c-7cf57c37c31e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:08.425527 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46334e68-450b-47a5-9c4c-7cf57c37c31e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:08.426264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-46334e68-450b-47a5-9c4c-7cf57c37c31e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:08.571194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-46334e68-450b-47a5-9c4c-7cf57c37c31e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:08.579704 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-46334e68-450b-47a5-9c4c-7cf57c37c31e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1519 microversion: 2.1 time: 0.177386 Aug 29 16:20:08.580301 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3852/7480] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:08 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:09.602140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c32f2a7a-1866-4389-a36c-248336d0a02b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:09.602957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c32f2a7a-1866-4389-a36c-248336d0a02b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:09.610283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c32f2a7a-1866-4389-a36c-248336d0a02b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:09.610770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c32f2a7a-1866-4389-a36c-248336d0a02b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:09.611200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c32f2a7a-1866-4389-a36c-248336d0a02b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:09.611982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c32f2a7a-1866-4389-a36c-248336d0a02b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:09.612440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c32f2a7a-1866-4389-a36c-248336d0a02b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:09.612863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c32f2a7a-1866-4389-a36c-248336d0a02b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:09.622596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-959102e4-5222-417d-9161-4a28cac62d11 req-efbaa35d-5ac0-4f30-a550-743f01429f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986b8f30-da8a-43cc-bc22-adbfa4a11733", "name": "network-vif-unplugged", "status": "completed", "tag": "bc45b4f3-f579-4179-b3fe-de5c89eae33e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:09.634493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-959102e4-5222-417d-9161-4a28cac62d11 req-efbaa35d-5ac0-4f30-a550-743f01429f7c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:09.635016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-959102e4-5222-417d-9161-4a28cac62d11 req-efbaa35d-5ac0-4f30-a550-743f01429f7c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:09.635601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-959102e4-5222-417d-9161-4a28cac62d11 req-efbaa35d-5ac0-4f30-a550-743f01429f7c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:09.648608 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-959102e4-5222-417d-9161-4a28cac62d11 req-efbaa35d-5ac0-4f30-a550-743f01429f7c service nova] Creating event network-vif-unplugged:bc45b4f3-f579-4179-b3fe-de5c89eae33e for instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 on n-h2-839401-11 Aug 29 16:20:09.655119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-959102e4-5222-417d-9161-4a28cac62d11 req-efbaa35d-5ac0-4f30-a550-743f01429f7c service nova] Instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:20:09.666568 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-959102e4-5222-417d-9161-4a28cac62d11 req-efbaa35d-5ac0-4f30-a550-743f01429f7c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049190 Aug 29 16:20:09.667218 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3853/7481] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:20:09.845701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c32f2a7a-1866-4389-a36c-248336d0a02b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:09.854295 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c32f2a7a-1866-4389-a36c-248336d0a02b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1518 microversion: 2.1 time: 0.256739 Aug 29 16:20:09.855586 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3629/7482] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:09 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1518 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:10.877762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-50a3bb02-504b-42d2-a7fb-7e79c6c8062f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:10.878494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-50a3bb02-504b-42d2-a7fb-7e79c6c8062f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:10.885721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50a3bb02-504b-42d2-a7fb-7e79c6c8062f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:10.886228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50a3bb02-504b-42d2-a7fb-7e79c6c8062f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:10.886660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50a3bb02-504b-42d2-a7fb-7e79c6c8062f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:10.887391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50a3bb02-504b-42d2-a7fb-7e79c6c8062f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:10.887869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50a3bb02-504b-42d2-a7fb-7e79c6c8062f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:10.888345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-50a3bb02-504b-42d2-a7fb-7e79c6c8062f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:11.027198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-50a3bb02-504b-42d2-a7fb-7e79c6c8062f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:11.038987 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-50a3bb02-504b-42d2-a7fb-7e79c6c8062f tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1516 microversion: 2.1 time: 0.166549 Aug 29 16:20:11.039551 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3854/7483] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:10 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:11.707079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-a26dcf0a-eccf-4c2f-885e-dfe9cb6a6661 req-32b31176-1b88-485e-a3d9-76e0694aa04b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986b8f30-da8a-43cc-bc22-adbfa4a11733", "tag": "bc45b4f3-f579-4179-b3fe-de5c89eae33e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:11.718683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a26dcf0a-eccf-4c2f-885e-dfe9cb6a6661 req-32b31176-1b88-485e-a3d9-76e0694aa04b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:11.719158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a26dcf0a-eccf-4c2f-885e-dfe9cb6a6661 req-32b31176-1b88-485e-a3d9-76e0694aa04b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:11.719579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a26dcf0a-eccf-4c2f-885e-dfe9cb6a6661 req-32b31176-1b88-485e-a3d9-76e0694aa04b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:11.732702 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-a26dcf0a-eccf-4c2f-885e-dfe9cb6a6661 req-32b31176-1b88-485e-a3d9-76e0694aa04b service nova] Creating event network-changed:bc45b4f3-f579-4179-b3fe-de5c89eae33e for instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 on n-h2-839401-11 Aug 29 16:20:11.739046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-a26dcf0a-eccf-4c2f-885e-dfe9cb6a6661 req-32b31176-1b88-485e-a3d9-76e0694aa04b service nova] Instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:20:11.751354 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-a26dcf0a-eccf-4c2f-885e-dfe9cb6a6661 req-32b31176-1b88-485e-a3d9-76e0694aa04b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047957 Aug 29 16:20:11.752027 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3630/7484] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:20:12.066630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1e2775d9-db4b-4d20-aa77-ef4f729578e0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:12.067370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1e2775d9-db4b-4d20-aa77-ef4f729578e0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:12.074848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e2775d9-db4b-4d20-aa77-ef4f729578e0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:12.075369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e2775d9-db4b-4d20-aa77-ef4f729578e0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:12.075818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e2775d9-db4b-4d20-aa77-ef4f729578e0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:12.076698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e2775d9-db4b-4d20-aa77-ef4f729578e0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:12.077400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e2775d9-db4b-4d20-aa77-ef4f729578e0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:12.077839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1e2775d9-db4b-4d20-aa77-ef4f729578e0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:12.217728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1e2775d9-db4b-4d20-aa77-ef4f729578e0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:12.226201 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1e2775d9-db4b-4d20-aa77-ef4f729578e0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1516 microversion: 2.1 time: 0.163085 Aug 29 16:20:12.226992 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3855/7485] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:12 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:13.254980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6e5cf9f8-3bc4-4db4-b53d-3a899ca633c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:13.256218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6e5cf9f8-3bc4-4db4-b53d-3a899ca633c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:13.263320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e5cf9f8-3bc4-4db4-b53d-3a899ca633c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:13.263807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e5cf9f8-3bc4-4db4-b53d-3a899ca633c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:13.264267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e5cf9f8-3bc4-4db4-b53d-3a899ca633c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:13.264950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e5cf9f8-3bc4-4db4-b53d-3a899ca633c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:13.265461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e5cf9f8-3bc4-4db4-b53d-3a899ca633c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:13.265883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6e5cf9f8-3bc4-4db4-b53d-3a899ca633c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:13.409955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6e5cf9f8-3bc4-4db4-b53d-3a899ca633c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:13.418422 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6e5cf9f8-3bc4-4db4-b53d-3a899ca633c0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1516 microversion: 2.1 time: 0.172372 Aug 29 16:20:13.419066 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3631/7486] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:13 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:14.440094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3b466ebc-3187-448d-a991-2649e93ec369 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:14.440784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3b466ebc-3187-448d-a991-2649e93ec369 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:14.448748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b466ebc-3187-448d-a991-2649e93ec369 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:14.449393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b466ebc-3187-448d-a991-2649e93ec369 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:14.449842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b466ebc-3187-448d-a991-2649e93ec369 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:14.450582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b466ebc-3187-448d-a991-2649e93ec369 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:14.451035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b466ebc-3187-448d-a991-2649e93ec369 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:14.451482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b466ebc-3187-448d-a991-2649e93ec369 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:14.596272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3b466ebc-3187-448d-a991-2649e93ec369 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:14.606440 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3b466ebc-3187-448d-a991-2649e93ec369 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1513 microversion: 2.1 time: 0.170532 Aug 29 16:20:14.607002 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3856/7487] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:14 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:14.626733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-43564a0f-5539-4989-9e2c-4c9a8a018c19 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:14.627322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-43564a0f-5539-4989-9e2c-4c9a8a018c19 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:14.635392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43564a0f-5539-4989-9e2c-4c9a8a018c19 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:14.635886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43564a0f-5539-4989-9e2c-4c9a8a018c19 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:14.636334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43564a0f-5539-4989-9e2c-4c9a8a018c19 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:14.637038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43564a0f-5539-4989-9e2c-4c9a8a018c19 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:14.637561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43564a0f-5539-4989-9e2c-4c9a8a018c19 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:14.637977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-43564a0f-5539-4989-9e2c-4c9a8a018c19 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:14.703022 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-43564a0f-5539-4989-9e2c-4c9a8a018c19 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "POST /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733/action" status: 204 len: 0 microversion: 2.1 time: 0.080079 Aug 29 16:20:14.703691 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3632/7488] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:20:14 2022] POST /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:20:14.713640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ddcfe3e1-e88a-47a8-9e29-76f393f7732a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:14.714754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ddcfe3e1-e88a-47a8-9e29-76f393f7732a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:14.721305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddcfe3e1-e88a-47a8-9e29-76f393f7732a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:14.721822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddcfe3e1-e88a-47a8-9e29-76f393f7732a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:14.722324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddcfe3e1-e88a-47a8-9e29-76f393f7732a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:14.722996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddcfe3e1-e88a-47a8-9e29-76f393f7732a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:14.723504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddcfe3e1-e88a-47a8-9e29-76f393f7732a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:14.723920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddcfe3e1-e88a-47a8-9e29-76f393f7732a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:14.866305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ddcfe3e1-e88a-47a8-9e29-76f393f7732a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:14.874452 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ddcfe3e1-e88a-47a8-9e29-76f393f7732a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1513 microversion: 2.1 time: 0.164918 Aug 29 16:20:14.875067 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3857/7489] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:14 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:15.896853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4126b41c-4500-4c1f-8fc2-9ce8ed5ef094 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:15.897510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4126b41c-4500-4c1f-8fc2-9ce8ed5ef094 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:15.904812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4126b41c-4500-4c1f-8fc2-9ce8ed5ef094 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:15.905565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4126b41c-4500-4c1f-8fc2-9ce8ed5ef094 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:15.906053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4126b41c-4500-4c1f-8fc2-9ce8ed5ef094 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:15.906802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4126b41c-4500-4c1f-8fc2-9ce8ed5ef094 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:15.907254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4126b41c-4500-4c1f-8fc2-9ce8ed5ef094 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:15.907677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4126b41c-4500-4c1f-8fc2-9ce8ed5ef094 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:15.952582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-aabc1606-83f8-40ba-b930-2eb915c9cf27 req-569acaf1-c66c-48d9-8cb6-4927b88c521a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986b8f30-da8a-43cc-bc22-adbfa4a11733", "name": "network-vif-plugged", "status": "completed", "tag": "bc45b4f3-f579-4179-b3fe-de5c89eae33e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:15.964342 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-aabc1606-83f8-40ba-b930-2eb915c9cf27 req-569acaf1-c66c-48d9-8cb6-4927b88c521a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:15.964866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-aabc1606-83f8-40ba-b930-2eb915c9cf27 req-569acaf1-c66c-48d9-8cb6-4927b88c521a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:15.965337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-aabc1606-83f8-40ba-b930-2eb915c9cf27 req-569acaf1-c66c-48d9-8cb6-4927b88c521a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:15.978493 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-aabc1606-83f8-40ba-b930-2eb915c9cf27 req-569acaf1-c66c-48d9-8cb6-4927b88c521a service nova] Creating event network-vif-plugged:bc45b4f3-f579-4179-b3fe-de5c89eae33e for instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 on n-h2-839401-11 Aug 29 16:20:15.983995 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-aabc1606-83f8-40ba-b930-2eb915c9cf27 req-569acaf1-c66c-48d9-8cb6-4927b88c521a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035866 Aug 29 16:20:15.984951 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3858/7490] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:20:16.063970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4126b41c-4500-4c1f-8fc2-9ce8ed5ef094 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:16.073139 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4126b41c-4500-4c1f-8fc2-9ce8ed5ef094 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1513 microversion: 2.1 time: 0.181247 Aug 29 16:20:16.073730 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3633/7491] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:15 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:17.101632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e90cbd87-5e17-401f-82f7-aff63ef5ef81 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:17.102711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e90cbd87-5e17-401f-82f7-aff63ef5ef81 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:17.114093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e90cbd87-5e17-401f-82f7-aff63ef5ef81 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:17.114945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e90cbd87-5e17-401f-82f7-aff63ef5ef81 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:17.115872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e90cbd87-5e17-401f-82f7-aff63ef5ef81 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:17.116597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e90cbd87-5e17-401f-82f7-aff63ef5ef81 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:17.117123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e90cbd87-5e17-401f-82f7-aff63ef5ef81 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:17.117556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e90cbd87-5e17-401f-82f7-aff63ef5ef81 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:17.265644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e90cbd87-5e17-401f-82f7-aff63ef5ef81 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:17.273860 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e90cbd87-5e17-401f-82f7-aff63ef5ef81 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1505 microversion: 2.1 time: 0.181483 Aug 29 16:20:17.274492 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3859/7492] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:17 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:17.294417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a26cb22e-f051-47b8-9254-93d151b480a3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:17.295041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a26cb22e-f051-47b8-9254-93d151b480a3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:17.302508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a26cb22e-f051-47b8-9254-93d151b480a3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:17.303138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a26cb22e-f051-47b8-9254-93d151b480a3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:17.303611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a26cb22e-f051-47b8-9254-93d151b480a3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:17.304333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a26cb22e-f051-47b8-9254-93d151b480a3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:17.305023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a26cb22e-f051-47b8-9254-93d151b480a3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:17.306573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a26cb22e-f051-47b8-9254-93d151b480a3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:17.463782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a26cb22e-f051-47b8-9254-93d151b480a3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:17.473566 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a26cb22e-f051-47b8-9254-93d151b480a3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1505 microversion: 2.1 time: 0.183171 Aug 29 16:20:17.474143 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3634/7493] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:17 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1505 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:17.500581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b59eb385-1e28-4892-ab6f-514878daa533 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Action: 'create', calling method: .version_select at 0x7fc42b7865e0>, body: {"keypair": {"name": "tempest-keypair-1449821492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGz0sPi9dl/WlebelkSnCuzZzTIsYfNI+WMPeiLndoKupZzTyswAG+cBB2sbKAsQl6QX8yTGHldRWiWN8grR3dDa57SgIfS9on2VVIU/VwAzz6r1SrW1H6MMQdLEvDLPSQ=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:17.520037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-b59eb385-1e28-4892-ab6f-514878daa533 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Getting quotas for project 37ae7640021d470ba9a940c1728f10bb. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:20:17.525680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-b59eb385-1e28-4892-ab6f-514878daa533 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Getting quotas for user b050c7905fc242fe976bedb3bf3705ff and project 37ae7640021d470ba9a940c1728f10bb. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:20:17.540834 n-d-839401-11 devstack@n-api.service[122360]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b59eb385-1e28-4892-ab6f-514878daa533 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [c4fea839-36b3-431f-8bb6-ddea9bf9c77e] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:20:18.553067 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [None req-b59eb385-1e28-4892-ab6f-514878daa533 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [c4fea839-36b3-431f-8bb6-ddea9bf9c77e] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38626. Aug 29 16:20:18.578821 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b59eb385-1e28-4892-ab6f-514878daa533 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.084820 Aug 29 16:20:18.579633 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3860/7494] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:20:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:20:19.848145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fbef04fe-a73c-467f-bfb3-1acbe33cbc24 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:19.848571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fbef04fe-a73c-467f-bfb3-1acbe33cbc24 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:19.856153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbef04fe-a73c-467f-bfb3-1acbe33cbc24 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:19.856641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbef04fe-a73c-467f-bfb3-1acbe33cbc24 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:19.857116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbef04fe-a73c-467f-bfb3-1acbe33cbc24 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:19.857804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbef04fe-a73c-467f-bfb3-1acbe33cbc24 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:19.858263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbef04fe-a73c-467f-bfb3-1acbe33cbc24 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:19.858683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fbef04fe-a73c-467f-bfb3-1acbe33cbc24 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:20.054728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fbef04fe-a73c-467f-bfb3-1acbe33cbc24 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:20.062915 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fbef04fe-a73c-467f-bfb3-1acbe33cbc24 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 200 len: 1505 microversion: 2.1 time: 0.219170 Aug 29 16:20:20.063501 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3635/7495] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:19 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:20.084790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-15989aa1-643e-44f5-92b7-9e3c3e93351d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:20.085431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-15989aa1-643e-44f5-92b7-9e3c3e93351d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:20.092102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15989aa1-643e-44f5-92b7-9e3c3e93351d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:20.092629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15989aa1-643e-44f5-92b7-9e3c3e93351d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:20.093108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15989aa1-643e-44f5-92b7-9e3c3e93351d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:20.093933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15989aa1-643e-44f5-92b7-9e3c3e93351d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:20.094410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15989aa1-643e-44f5-92b7-9e3c3e93351d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:20.094853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-15989aa1-643e-44f5-92b7-9e3c3e93351d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:20.121300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-15989aa1-643e-44f5-92b7-9e3c3e93351d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:20:20.205996 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-15989aa1-643e-44f5-92b7-9e3c3e93351d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "DELETE /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 204 len: 0 microversion: 2.1 time: 0.126547 Aug 29 16:20:20.206666 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3861/7496] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:20:20 2022] DELETE /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:20:20.271741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-273646713", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "b5e1c5a9-e638-492e-a23c-f5febb70ca3d"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:20.338093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] validate_networks() for [('b5e1c5a9-e638-492e-a23c-f5febb70ca3d', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:20:20.744101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:20:20.744638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:20:20.745306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:20:20.745839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:20:20.746409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:20:20.759739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:20.760228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:20.760671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:20.761445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:20.761908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:20.762342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:20.779895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Getting quotas for project 37ae7640021d470ba9a940c1728f10bb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:20:20.785650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Getting quotas for user b050c7905fc242fe976bedb3bf3705ff and project 37ae7640021d470ba9a940c1728f10bb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:20:20.798627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:20:20.801021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:20:20.855451 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-80031812-1519-4ef7-a9eb-7ffaf66b8fec tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587707 Aug 29 16:20:20.856407 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3636/7497] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:20:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:20:20.868250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-94cb3f7d-2b02-4be2-a316-ad9051ba8707 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:20.869109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-94cb3f7d-2b02-4be2-a316-ad9051ba8707 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:20.987119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-94cb3f7d-2b02-4be2-a316-ad9051ba8707 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:20.994510 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-94cb3f7d-2b02-4be2-a316-ad9051ba8707 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1217 microversion: 2.1 time: 0.130975 Aug 29 16:20:20.995097 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3862/7498] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:20 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:22.015359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c52a6de3-21d4-4bd7-858c-b0d89e17b200 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:22.016069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c52a6de3-21d4-4bd7-858c-b0d89e17b200 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:22.023685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c52a6de3-21d4-4bd7-858c-b0d89e17b200 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:22.024253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c52a6de3-21d4-4bd7-858c-b0d89e17b200 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:22.024729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c52a6de3-21d4-4bd7-858c-b0d89e17b200 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:22.025467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c52a6de3-21d4-4bd7-858c-b0d89e17b200 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:22.025931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c52a6de3-21d4-4bd7-858c-b0d89e17b200 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:22.026369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c52a6de3-21d4-4bd7-858c-b0d89e17b200 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:22.099378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c52a6de3-21d4-4bd7-858c-b0d89e17b200 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:22.108196 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c52a6de3-21d4-4bd7-858c-b0d89e17b200 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1269 microversion: 2.1 time: 0.097716 Aug 29 16:20:22.108768 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3637/7499] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:22 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1269 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:20:22.684992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-053b5c3d-176a-4edb-90f3-f9638ff76988 req-54dde292-7b38-43b2-b808-66219f56f765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986b8f30-da8a-43cc-bc22-adbfa4a11733", "name": "network-vif-deleted", "tag": "bc45b4f3-f579-4179-b3fe-de5c89eae33e"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:22.698303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-053b5c3d-176a-4edb-90f3-f9638ff76988 req-54dde292-7b38-43b2-b808-66219f56f765 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:22.698813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-053b5c3d-176a-4edb-90f3-f9638ff76988 req-54dde292-7b38-43b2-b808-66219f56f765 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:22.699250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-053b5c3d-176a-4edb-90f3-f9638ff76988 req-54dde292-7b38-43b2-b808-66219f56f765 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:22.710827 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-053b5c3d-176a-4edb-90f3-f9638ff76988 req-54dde292-7b38-43b2-b808-66219f56f765 service nova] Creating event network-vif-deleted:bc45b4f3-f579-4179-b3fe-de5c89eae33e for instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 on n-h2-839401-11 Aug 29 16:20:22.715955 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-053b5c3d-176a-4edb-90f3-f9638ff76988 req-54dde292-7b38-43b2-b808-66219f56f765 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036016 Aug 29 16:20:22.716757 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3863/7500] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:20:23.129250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6b5844ca-fede-4d79-b634-8fa7699987e5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:23.129884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6b5844ca-fede-4d79-b634-8fa7699987e5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:23.137211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b5844ca-fede-4d79-b634-8fa7699987e5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:23.137721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b5844ca-fede-4d79-b634-8fa7699987e5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:23.138172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b5844ca-fede-4d79-b634-8fa7699987e5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:23.138922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b5844ca-fede-4d79-b634-8fa7699987e5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:23.139368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b5844ca-fede-4d79-b634-8fa7699987e5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:23.139796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b5844ca-fede-4d79-b634-8fa7699987e5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:23.222061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6b5844ca-fede-4d79-b634-8fa7699987e5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:23.231020 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6b5844ca-fede-4d79-b634-8fa7699987e5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1275 microversion: 2.1 time: 0.106001 Aug 29 16:20:23.231854 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3638/7501] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:23 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1275 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:24.253761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1d210199-bfaa-4d7c-949f-874add88370a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:24.254546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1d210199-bfaa-4d7c-949f-874add88370a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:24.261290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d210199-bfaa-4d7c-949f-874add88370a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:24.261793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d210199-bfaa-4d7c-949f-874add88370a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:24.262247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d210199-bfaa-4d7c-949f-874add88370a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:24.262961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d210199-bfaa-4d7c-949f-874add88370a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:24.263427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d210199-bfaa-4d7c-949f-874add88370a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:24.263882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d210199-bfaa-4d7c-949f-874add88370a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:24.399954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1d210199-bfaa-4d7c-949f-874add88370a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:24.408497 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1d210199-bfaa-4d7c-949f-874add88370a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1317 microversion: 2.1 time: 0.160093 Aug 29 16:20:24.409117 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3864/7502] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:24 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:24.738533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d2e19970-8110-4acd-8674-8d256178c381 req-5234a887-09c5-4b03-bf75-8558e5c61917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0750e030-738d-4b71-a00a-76e0ef8536fd", "tag": "48e910f5-e598-4cf1-8351-d7a43d48f5ce"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:24.745424 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:20:24.745602 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 16:20:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Aug 29 16:20:24.753306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d2e19970-8110-4acd-8674-8d256178c381 req-5234a887-09c5-4b03-bf75-8558e5c61917 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:24.753772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d2e19970-8110-4acd-8674-8d256178c381 req-5234a887-09c5-4b03-bf75-8558e5c61917 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:24.754202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d2e19970-8110-4acd-8674-8d256178c381 req-5234a887-09c5-4b03-bf75-8558e5c61917 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:24.766267 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d2e19970-8110-4acd-8674-8d256178c381 req-5234a887-09c5-4b03-bf75-8558e5c61917 service nova] Creating event network-changed:48e910f5-e598-4cf1-8351-d7a43d48f5ce for instance 0750e030-738d-4b71-a00a-76e0ef8536fd on n-h2-839401-11 Aug 29 16:20:24.771486 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d2e19970-8110-4acd-8674-8d256178c381 req-5234a887-09c5-4b03-bf75-8558e5c61917 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039574 Aug 29 16:20:24.772066 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3639/7503] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:20:25.429538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ebaca2f6-7757-42b2-83d9-afe089aef45e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:25.430398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ebaca2f6-7757-42b2-83d9-afe089aef45e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:25.439235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebaca2f6-7757-42b2-83d9-afe089aef45e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:25.439736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebaca2f6-7757-42b2-83d9-afe089aef45e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:25.440194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebaca2f6-7757-42b2-83d9-afe089aef45e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:25.440922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebaca2f6-7757-42b2-83d9-afe089aef45e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:25.441425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebaca2f6-7757-42b2-83d9-afe089aef45e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:25.441867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebaca2f6-7757-42b2-83d9-afe089aef45e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:25.582301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ebaca2f6-7757-42b2-83d9-afe089aef45e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:25.590724 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ebaca2f6-7757-42b2-83d9-afe089aef45e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1317 microversion: 2.1 time: 0.165493 Aug 29 16:20:25.591357 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3865/7504] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:25 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:26.619300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-754f4619-9559-4091-9adb-5cf522bc55c2 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:26.620318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-754f4619-9559-4091-9adb-5cf522bc55c2 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:26.631221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-754f4619-9559-4091-9adb-5cf522bc55c2 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:26.632028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-754f4619-9559-4091-9adb-5cf522bc55c2 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:26.632875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-754f4619-9559-4091-9adb-5cf522bc55c2 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:26.633789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-754f4619-9559-4091-9adb-5cf522bc55c2 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:26.634256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-754f4619-9559-4091-9adb-5cf522bc55c2 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:26.634682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-754f4619-9559-4091-9adb-5cf522bc55c2 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:26.779258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-754f4619-9559-4091-9adb-5cf522bc55c2 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:26.788050 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-754f4619-9559-4091-9adb-5cf522bc55c2 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1317 microversion: 2.1 time: 0.178039 Aug 29 16:20:26.788636 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3640/7505] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:26 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:27.810012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c76adddc-6862-4aa8-8d6a-6327627a8301 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:27.811180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c76adddc-6862-4aa8-8d6a-6327627a8301 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:27.819442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c76adddc-6862-4aa8-8d6a-6327627a8301 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:27.819965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c76adddc-6862-4aa8-8d6a-6327627a8301 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:27.820441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c76adddc-6862-4aa8-8d6a-6327627a8301 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:27.821268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c76adddc-6862-4aa8-8d6a-6327627a8301 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:27.821730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c76adddc-6862-4aa8-8d6a-6327627a8301 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:27.822168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c76adddc-6862-4aa8-8d6a-6327627a8301 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:27.985987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c76adddc-6862-4aa8-8d6a-6327627a8301 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:27.988450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:27.995792 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c76adddc-6862-4aa8-8d6a-6327627a8301 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1317 microversion: 2.1 time: 0.189934 Aug 29 16:20:27.996400 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3866/7506] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:27 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:29.021238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1765f136-dbee-4186-a88a-1c2a8e332fe0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:29.022163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1765f136-dbee-4186-a88a-1c2a8e332fe0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:29.041187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1765f136-dbee-4186-a88a-1c2a8e332fe0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:29.041694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1765f136-dbee-4186-a88a-1c2a8e332fe0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:29.042134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1765f136-dbee-4186-a88a-1c2a8e332fe0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:29.042867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1765f136-dbee-4186-a88a-1c2a8e332fe0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:29.043320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1765f136-dbee-4186-a88a-1c2a8e332fe0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:29.043762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1765f136-dbee-4186-a88a-1c2a8e332fe0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:29.046667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:29.188964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1765f136-dbee-4186-a88a-1c2a8e332fe0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:29.196963 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1765f136-dbee-4186-a88a-1c2a8e332fe0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1317 microversion: 2.1 time: 0.182831 Aug 29 16:20:29.197733 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3641/7507] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:29 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:29.996443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-bcf8e3b8-e9a7-43fb-a151-6960d77dfb84 req-bd745731-1863-4f90-8baf-d083226b07b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0750e030-738d-4b71-a00a-76e0ef8536fd", "name": "network-vif-plugged", "status": "completed", "tag": "48e910f5-e598-4cf1-8351-d7a43d48f5ce"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:30.003425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:30.010468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-bcf8e3b8-e9a7-43fb-a151-6960d77dfb84 req-bd745731-1863-4f90-8baf-d083226b07b1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:30.010993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-bcf8e3b8-e9a7-43fb-a151-6960d77dfb84 req-bd745731-1863-4f90-8baf-d083226b07b1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:30.011402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-bcf8e3b8-e9a7-43fb-a151-6960d77dfb84 req-bd745731-1863-4f90-8baf-d083226b07b1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:30.025222 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-bcf8e3b8-e9a7-43fb-a151-6960d77dfb84 req-bd745731-1863-4f90-8baf-d083226b07b1 service nova] Creating event network-vif-plugged:48e910f5-e598-4cf1-8351-d7a43d48f5ce for instance 0750e030-738d-4b71-a00a-76e0ef8536fd on n-h2-839401-11 Aug 29 16:20:30.030548 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-bcf8e3b8-e9a7-43fb-a151-6960d77dfb84 req-bd745731-1863-4f90-8baf-d083226b07b1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038441 Aug 29 16:20:30.031164 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3867/7508] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:20:30.223943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-41f3c7af-9c58-4d3e-be01-f68c9d009490 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:30.224560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-41f3c7af-9c58-4d3e-be01-f68c9d009490 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:30.228341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:30.234457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41f3c7af-9c58-4d3e-be01-f68c9d009490 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:30.235119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41f3c7af-9c58-4d3e-be01-f68c9d009490 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:30.235565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41f3c7af-9c58-4d3e-be01-f68c9d009490 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:30.236273 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41f3c7af-9c58-4d3e-be01-f68c9d009490 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:30.236728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41f3c7af-9c58-4d3e-be01-f68c9d009490 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:30.237175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41f3c7af-9c58-4d3e-be01-f68c9d009490 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:30.383553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-41f3c7af-9c58-4d3e-be01-f68c9d009490 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:30.391870 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-41f3c7af-9c58-4d3e-be01-f68c9d009490 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1317 microversion: 2.1 time: 0.172266 Aug 29 16:20:30.392460 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3642/7509] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:30 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:31.412748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:31.421015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-44745e8b-9e39-4c0b-9c66-8d6a249602fc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:31.422265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-44745e8b-9e39-4c0b-9c66-8d6a249602fc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:31.432685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44745e8b-9e39-4c0b-9c66-8d6a249602fc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:31.433234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44745e8b-9e39-4c0b-9c66-8d6a249602fc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:31.433701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44745e8b-9e39-4c0b-9c66-8d6a249602fc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:31.434417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44745e8b-9e39-4c0b-9c66-8d6a249602fc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:31.434891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44745e8b-9e39-4c0b-9c66-8d6a249602fc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:31.435339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-44745e8b-9e39-4c0b-9c66-8d6a249602fc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:31.590932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-44745e8b-9e39-4c0b-9c66-8d6a249602fc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:31.599603 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-44745e8b-9e39-4c0b-9c66-8d6a249602fc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1317 microversion: 2.1 time: 0.189036 Aug 29 16:20:31.600303 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3868/7510] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:31 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:32.624859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-235d6ab2-571d-4422-b5a2-4e123c4682a9 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:32.625854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-235d6ab2-571d-4422-b5a2-4e123c4682a9 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:32.628780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:32.629911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:32.638988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-235d6ab2-571d-4422-b5a2-4e123c4682a9 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:32.639466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-235d6ab2-571d-4422-b5a2-4e123c4682a9 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:32.639900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-235d6ab2-571d-4422-b5a2-4e123c4682a9 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:32.640573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-235d6ab2-571d-4422-b5a2-4e123c4682a9 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:32.641027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-235d6ab2-571d-4422-b5a2-4e123c4682a9 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:32.641482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-235d6ab2-571d-4422-b5a2-4e123c4682a9 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:32.776879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-235d6ab2-571d-4422-b5a2-4e123c4682a9 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:32.784907 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-235d6ab2-571d-4422-b5a2-4e123c4682a9 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1505 microversion: 2.1 time: 0.167128 Aug 29 16:20:32.785569 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3643/7511] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:32 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:32.805996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6d252928-817e-4500-94e7-243c3b2bf9f3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:32.806727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6d252928-817e-4500-94e7-243c3b2bf9f3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:32.814176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d252928-817e-4500-94e7-243c3b2bf9f3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:32.814684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d252928-817e-4500-94e7-243c3b2bf9f3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:32.815139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d252928-817e-4500-94e7-243c3b2bf9f3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:32.815847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d252928-817e-4500-94e7-243c3b2bf9f3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:32.816316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d252928-817e-4500-94e7-243c3b2bf9f3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:32.816755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d252928-817e-4500-94e7-243c3b2bf9f3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:32.962047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6d252928-817e-4500-94e7-243c3b2bf9f3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:32.970250 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6d252928-817e-4500-94e7-243c3b2bf9f3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1505 microversion: 2.1 time: 0.168515 Aug 29 16:20:32.970818 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3869/7512] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:32 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:32.998842 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-834d6879-affd-4b33-a8b4-a6a0f50c4928 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:33.001268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-834d6879-affd-4b33-a8b4-a6a0f50c4928 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:33.009000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-834d6879-affd-4b33-a8b4-a6a0f50c4928 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:33.009595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-834d6879-affd-4b33-a8b4-a6a0f50c4928 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:33.010039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-834d6879-affd-4b33-a8b4-a6a0f50c4928 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:33.010718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-834d6879-affd-4b33-a8b4-a6a0f50c4928 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:33.011200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-834d6879-affd-4b33-a8b4-a6a0f50c4928 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:33.011680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-834d6879-affd-4b33-a8b4-a6a0f50c4928 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:33.041927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-834d6879-affd-4b33-a8b4-a6a0f50c4928 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:33.047986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-834d6879-affd-4b33-a8b4-a6a0f50c4928 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Old instance type m1.heat2, new instance type m1.heat {{(pid=122361) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:20:33.054871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-834d6879-affd-4b33-a8b4-a6a0f50c4928 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:20:33.055290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-834d6879-affd-4b33-a8b4-a6a0f50c4928 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:20:33.055767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-834d6879-affd-4b33-a8b4-a6a0f50c4928 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:20:33.056173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-834d6879-affd-4b33-a8b4-a6a0f50c4928 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:20:33.056616 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-834d6879-affd-4b33-a8b4-a6a0f50c4928 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:20:33.130161 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-834d6879-affd-4b33-a8b4-a6a0f50c4928 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "POST /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd/action" status: 202 len: 0 microversion: 2.1 time: 0.135329 Aug 29 16:20:33.130779 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3644/7513] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:20:32 2022] POST /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:20:33.139500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9ad96584-5f9f-4751-8533-44200cfd8d66 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:33.140441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9ad96584-5f9f-4751-8533-44200cfd8d66 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:33.147354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ad96584-5f9f-4751-8533-44200cfd8d66 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:33.148066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ad96584-5f9f-4751-8533-44200cfd8d66 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:33.148481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ad96584-5f9f-4751-8533-44200cfd8d66 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:33.149414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ad96584-5f9f-4751-8533-44200cfd8d66 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:33.149886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ad96584-5f9f-4751-8533-44200cfd8d66 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:33.150320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ad96584-5f9f-4751-8533-44200cfd8d66 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:33.290910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9ad96584-5f9f-4751-8533-44200cfd8d66 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:33.299731 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9ad96584-5f9f-4751-8533-44200cfd8d66 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1512 microversion: 2.1 time: 0.164411 Aug 29 16:20:33.300340 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3870/7514] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:33 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:34.326850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d3385c0c-2970-4454-a19e-d139a3277b39 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:34.327924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d3385c0c-2970-4454-a19e-d139a3277b39 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:34.338308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3385c0c-2970-4454-a19e-d139a3277b39 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:34.338816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3385c0c-2970-4454-a19e-d139a3277b39 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:34.339258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3385c0c-2970-4454-a19e-d139a3277b39 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:34.339948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3385c0c-2970-4454-a19e-d139a3277b39 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:34.340397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3385c0c-2970-4454-a19e-d139a3277b39 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:34.340820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3385c0c-2970-4454-a19e-d139a3277b39 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:34.519185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d3385c0c-2970-4454-a19e-d139a3277b39 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:34.529360 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d3385c0c-2970-4454-a19e-d139a3277b39 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1512 microversion: 2.1 time: 0.210740 Aug 29 16:20:34.529948 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3645/7515] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:34 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1512 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:35.554687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1a436415-5180-4387-bec2-4c68b60398d7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:35.555734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1a436415-5180-4387-bec2-4c68b60398d7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:35.564301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a436415-5180-4387-bec2-4c68b60398d7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:35.564815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a436415-5180-4387-bec2-4c68b60398d7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:35.565306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a436415-5180-4387-bec2-4c68b60398d7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:35.566024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a436415-5180-4387-bec2-4c68b60398d7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:35.566501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a436415-5180-4387-bec2-4c68b60398d7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:35.566958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1a436415-5180-4387-bec2-4c68b60398d7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:35.710954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1a436415-5180-4387-bec2-4c68b60398d7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:35.719608 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1a436415-5180-4387-bec2-4c68b60398d7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.171651 Aug 29 16:20:35.720198 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3871/7516] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:35 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:36.746245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6466b36c-5959-4c2d-a33f-f31362e1e3c4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:36.747557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6466b36c-5959-4c2d-a33f-f31362e1e3c4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:36.758792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6466b36c-5959-4c2d-a33f-f31362e1e3c4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:36.759624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6466b36c-5959-4c2d-a33f-f31362e1e3c4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:36.760496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6466b36c-5959-4c2d-a33f-f31362e1e3c4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:36.761248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6466b36c-5959-4c2d-a33f-f31362e1e3c4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:36.761741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6466b36c-5959-4c2d-a33f-f31362e1e3c4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:36.762174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6466b36c-5959-4c2d-a33f-f31362e1e3c4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:36.899524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6466b36c-5959-4c2d-a33f-f31362e1e3c4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:36.908036 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6466b36c-5959-4c2d-a33f-f31362e1e3c4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.169392 Aug 29 16:20:36.908618 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3646/7517] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:36 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:37.930624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-52acd7e2-856a-41c1-a615-43cfbd8c64c5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:37.933611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-52acd7e2-856a-41c1-a615-43cfbd8c64c5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:37.941334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52acd7e2-856a-41c1-a615-43cfbd8c64c5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:37.941852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52acd7e2-856a-41c1-a615-43cfbd8c64c5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:37.942306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52acd7e2-856a-41c1-a615-43cfbd8c64c5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:37.943040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52acd7e2-856a-41c1-a615-43cfbd8c64c5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:37.943517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52acd7e2-856a-41c1-a615-43cfbd8c64c5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:37.943991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-52acd7e2-856a-41c1-a615-43cfbd8c64c5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:38.108787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-52acd7e2-856a-41c1-a615-43cfbd8c64c5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:38.117353 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-52acd7e2-856a-41c1-a615-43cfbd8c64c5 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.191745 Aug 29 16:20:38.117946 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3872/7518] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:37 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:39.138183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-873414d5-d4c9-4331-9a6b-219362ba7d2a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:39.138878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-873414d5-d4c9-4331-9a6b-219362ba7d2a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:39.146232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-873414d5-d4c9-4331-9a6b-219362ba7d2a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:39.146750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-873414d5-d4c9-4331-9a6b-219362ba7d2a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:39.147222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-873414d5-d4c9-4331-9a6b-219362ba7d2a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:39.147921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-873414d5-d4c9-4331-9a6b-219362ba7d2a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:39.148381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-873414d5-d4c9-4331-9a6b-219362ba7d2a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:39.148807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-873414d5-d4c9-4331-9a6b-219362ba7d2a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:39.293679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-873414d5-d4c9-4331-9a6b-219362ba7d2a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:39.306435 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-873414d5-d4c9-4331-9a6b-219362ba7d2a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.172331 Aug 29 16:20:39.307032 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3647/7519] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:39 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:40.334965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a39c853e-83f9-4858-af54-12d42e8b7e41 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:40.335574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a39c853e-83f9-4858-af54-12d42e8b7e41 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:40.342986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a39c853e-83f9-4858-af54-12d42e8b7e41 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:40.343484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a39c853e-83f9-4858-af54-12d42e8b7e41 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:40.344033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a39c853e-83f9-4858-af54-12d42e8b7e41 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:40.344761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a39c853e-83f9-4858-af54-12d42e8b7e41 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:40.345270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a39c853e-83f9-4858-af54-12d42e8b7e41 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:40.345747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a39c853e-83f9-4858-af54-12d42e8b7e41 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:40.492880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a39c853e-83f9-4858-af54-12d42e8b7e41 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:40.505580 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a39c853e-83f9-4858-af54-12d42e8b7e41 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.174431 Aug 29 16:20:40.506299 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3873/7520] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:40 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:41.530396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4d5a4391-3bd2-485b-ba16-443e4d0719dc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:41.531127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4d5a4391-3bd2-485b-ba16-443e4d0719dc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:41.540619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d5a4391-3bd2-485b-ba16-443e4d0719dc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:41.541327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d5a4391-3bd2-485b-ba16-443e4d0719dc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:41.541910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d5a4391-3bd2-485b-ba16-443e4d0719dc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:41.542875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d5a4391-3bd2-485b-ba16-443e4d0719dc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:41.543488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d5a4391-3bd2-485b-ba16-443e4d0719dc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:41.544148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4d5a4391-3bd2-485b-ba16-443e4d0719dc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:41.702880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4d5a4391-3bd2-485b-ba16-443e4d0719dc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:41.715475 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4d5a4391-3bd2-485b-ba16-443e4d0719dc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.191135 Aug 29 16:20:41.716268 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3648/7521] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:41 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:42.739508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dc0705f3-6962-4062-8815-b99d2cf5b791 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:42.740155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dc0705f3-6962-4062-8815-b99d2cf5b791 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:42.749052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc0705f3-6962-4062-8815-b99d2cf5b791 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:42.749689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc0705f3-6962-4062-8815-b99d2cf5b791 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:42.750227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc0705f3-6962-4062-8815-b99d2cf5b791 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:42.751070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc0705f3-6962-4062-8815-b99d2cf5b791 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:42.751629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc0705f3-6962-4062-8815-b99d2cf5b791 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:42.752153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dc0705f3-6962-4062-8815-b99d2cf5b791 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:42.888006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dc0705f3-6962-4062-8815-b99d2cf5b791 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:42.901755 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dc0705f3-6962-4062-8815-b99d2cf5b791 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.166695 Aug 29 16:20:42.902345 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3874/7522] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:42 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:20:43.923853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-487c5be3-3abe-439a-b265-32d4c98423ee tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:43.924389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-487c5be3-3abe-439a-b265-32d4c98423ee tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:43.932128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487c5be3-3abe-439a-b265-32d4c98423ee tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:43.932625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487c5be3-3abe-439a-b265-32d4c98423ee tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:43.933128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487c5be3-3abe-439a-b265-32d4c98423ee tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:43.933871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487c5be3-3abe-439a-b265-32d4c98423ee tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:43.934335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487c5be3-3abe-439a-b265-32d4c98423ee tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:43.934764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-487c5be3-3abe-439a-b265-32d4c98423ee tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:44.075142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-487c5be3-3abe-439a-b265-32d4c98423ee tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:44.083476 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-487c5be3-3abe-439a-b265-32d4c98423ee tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.163834 Aug 29 16:20:44.084076 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3649/7523] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:43 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:45.113450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a802b3ec-4e7b-41a8-8371-9e637dd52da1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:45.114147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a802b3ec-4e7b-41a8-8371-9e637dd52da1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:45.121843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a802b3ec-4e7b-41a8-8371-9e637dd52da1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:45.122354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a802b3ec-4e7b-41a8-8371-9e637dd52da1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:45.122804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a802b3ec-4e7b-41a8-8371-9e637dd52da1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:45.123520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a802b3ec-4e7b-41a8-8371-9e637dd52da1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:45.123988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a802b3ec-4e7b-41a8-8371-9e637dd52da1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:45.124421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a802b3ec-4e7b-41a8-8371-9e637dd52da1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:45.264900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a802b3ec-4e7b-41a8-8371-9e637dd52da1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:45.273283 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a802b3ec-4e7b-41a8-8371-9e637dd52da1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.164171 Aug 29 16:20:45.273891 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3875/7524] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:45 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:46.297180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aebeb4c6-8221-463e-990a-a372ba769533 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:46.297816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aebeb4c6-8221-463e-990a-a372ba769533 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:46.305523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aebeb4c6-8221-463e-990a-a372ba769533 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:46.306031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aebeb4c6-8221-463e-990a-a372ba769533 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:46.306485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aebeb4c6-8221-463e-990a-a372ba769533 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:46.307211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aebeb4c6-8221-463e-990a-a372ba769533 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:46.307719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aebeb4c6-8221-463e-990a-a372ba769533 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:46.308163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aebeb4c6-8221-463e-990a-a372ba769533 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:46.455184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aebeb4c6-8221-463e-990a-a372ba769533 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:46.467309 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aebeb4c6-8221-463e-990a-a372ba769533 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.174291 Aug 29 16:20:46.468088 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3650/7525] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:46 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:47.497140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24000e98-eec6-4b32-97b2-1d99fe19a42d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:47.498003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-24000e98-eec6-4b32-97b2-1d99fe19a42d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:47.506089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24000e98-eec6-4b32-97b2-1d99fe19a42d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:47.506639 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24000e98-eec6-4b32-97b2-1d99fe19a42d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:47.507134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24000e98-eec6-4b32-97b2-1d99fe19a42d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:47.507932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24000e98-eec6-4b32-97b2-1d99fe19a42d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:47.508450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24000e98-eec6-4b32-97b2-1d99fe19a42d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:47.508935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24000e98-eec6-4b32-97b2-1d99fe19a42d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:47.663180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-24000e98-eec6-4b32-97b2-1d99fe19a42d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:47.671754 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-24000e98-eec6-4b32-97b2-1d99fe19a42d tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.181365 Aug 29 16:20:47.672348 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3876/7526] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:47 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:48.693426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ac31413b-e4a3-40f5-843d-f57bf61fb261 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:48.693958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ac31413b-e4a3-40f5-843d-f57bf61fb261 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:48.701913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac31413b-e4a3-40f5-843d-f57bf61fb261 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:48.702439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac31413b-e4a3-40f5-843d-f57bf61fb261 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:48.702881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac31413b-e4a3-40f5-843d-f57bf61fb261 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:48.703589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac31413b-e4a3-40f5-843d-f57bf61fb261 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:48.704053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac31413b-e4a3-40f5-843d-f57bf61fb261 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:48.704482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac31413b-e4a3-40f5-843d-f57bf61fb261 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:48.854021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ac31413b-e4a3-40f5-843d-f57bf61fb261 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:48.861992 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ac31413b-e4a3-40f5-843d-f57bf61fb261 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.172832 Aug 29 16:20:48.862547 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3651/7527] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:48 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:49.883493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4d28500c-fa84-4d28-aa5e-479863111d08 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:49.884184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4d28500c-fa84-4d28-aa5e-479863111d08 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:49.892709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d28500c-fa84-4d28-aa5e-479863111d08 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:49.893460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d28500c-fa84-4d28-aa5e-479863111d08 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:49.893915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d28500c-fa84-4d28-aa5e-479863111d08 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:49.894665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d28500c-fa84-4d28-aa5e-479863111d08 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:49.895266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d28500c-fa84-4d28-aa5e-479863111d08 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:49.895737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d28500c-fa84-4d28-aa5e-479863111d08 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:50.030447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4d28500c-fa84-4d28-aa5e-479863111d08 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:50.038831 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4d28500c-fa84-4d28-aa5e-479863111d08 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.159514 Aug 29 16:20:50.039420 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3877/7528] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:49 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:51.063037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0631a4a4-39ab-45e1-95c4-5e8a43e527bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:51.063823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0631a4a4-39ab-45e1-95c4-5e8a43e527bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:51.073150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0631a4a4-39ab-45e1-95c4-5e8a43e527bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:51.073795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0631a4a4-39ab-45e1-95c4-5e8a43e527bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:51.074369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0631a4a4-39ab-45e1-95c4-5e8a43e527bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:51.075370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0631a4a4-39ab-45e1-95c4-5e8a43e527bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:51.076033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0631a4a4-39ab-45e1-95c4-5e8a43e527bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:51.076597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0631a4a4-39ab-45e1-95c4-5e8a43e527bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:51.219565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0631a4a4-39ab-45e1-95c4-5e8a43e527bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:51.228410 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0631a4a4-39ab-45e1-95c4-5e8a43e527bc tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.171546 Aug 29 16:20:51.228990 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3652/7529] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:51 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:52.250298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-186f48c6-091d-4085-ab93-1a6fbc428512 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:52.250843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-186f48c6-091d-4085-ab93-1a6fbc428512 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:52.258182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-186f48c6-091d-4085-ab93-1a6fbc428512 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:52.258680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-186f48c6-091d-4085-ab93-1a6fbc428512 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:52.259129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-186f48c6-091d-4085-ab93-1a6fbc428512 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:52.259834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-186f48c6-091d-4085-ab93-1a6fbc428512 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:52.260301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-186f48c6-091d-4085-ab93-1a6fbc428512 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:52.260738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-186f48c6-091d-4085-ab93-1a6fbc428512 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:52.414360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-186f48c6-091d-4085-ab93-1a6fbc428512 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:52.424228 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-186f48c6-091d-4085-ab93-1a6fbc428512 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.178149 Aug 29 16:20:52.424820 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3878/7530] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:52 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:53.452204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-24136006-3f2c-45df-91af-d4467bd53912 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:53.452768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-24136006-3f2c-45df-91af-d4467bd53912 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:53.459981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24136006-3f2c-45df-91af-d4467bd53912 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:53.460464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24136006-3f2c-45df-91af-d4467bd53912 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:53.460898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24136006-3f2c-45df-91af-d4467bd53912 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:53.461646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24136006-3f2c-45df-91af-d4467bd53912 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:53.462095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24136006-3f2c-45df-91af-d4467bd53912 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:53.462528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-24136006-3f2c-45df-91af-d4467bd53912 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:53.613721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-24136006-3f2c-45df-91af-d4467bd53912 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:53.622044 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-24136006-3f2c-45df-91af-d4467bd53912 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.173843 Aug 29 16:20:53.622623 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3653/7531] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:53 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:54.648175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-12945f35-b600-434b-aa70-d857464ed0e4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:54.650055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-12945f35-b600-434b-aa70-d857464ed0e4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:54.662334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12945f35-b600-434b-aa70-d857464ed0e4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:54.663167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12945f35-b600-434b-aa70-d857464ed0e4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:54.663925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12945f35-b600-434b-aa70-d857464ed0e4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:54.665137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12945f35-b600-434b-aa70-d857464ed0e4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:54.665932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12945f35-b600-434b-aa70-d857464ed0e4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:54.666671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-12945f35-b600-434b-aa70-d857464ed0e4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:54.815995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-12945f35-b600-434b-aa70-d857464ed0e4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:54.824291 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-12945f35-b600-434b-aa70-d857464ed0e4 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.182848 Aug 29 16:20:54.824882 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3879/7532] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:54 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:55.845214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1de1a366-6f42-4113-a5cb-a10f011650be tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:55.845802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1de1a366-6f42-4113-a5cb-a10f011650be tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:55.854031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1de1a366-6f42-4113-a5cb-a10f011650be tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:55.854526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1de1a366-6f42-4113-a5cb-a10f011650be tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:55.854970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1de1a366-6f42-4113-a5cb-a10f011650be tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:55.855683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1de1a366-6f42-4113-a5cb-a10f011650be tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:55.856149 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1de1a366-6f42-4113-a5cb-a10f011650be tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:55.856586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1de1a366-6f42-4113-a5cb-a10f011650be tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:55.996159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1de1a366-6f42-4113-a5cb-a10f011650be tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:56.004115 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1de1a366-6f42-4113-a5cb-a10f011650be tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.162942 Aug 29 16:20:56.004703 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3654/7533] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:55 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:57.025391 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-33bec8f3-a067-454a-8e19-d23fddb3e8b7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:57.025992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-33bec8f3-a067-454a-8e19-d23fddb3e8b7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:57.033403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33bec8f3-a067-454a-8e19-d23fddb3e8b7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:57.033912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33bec8f3-a067-454a-8e19-d23fddb3e8b7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:57.034371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33bec8f3-a067-454a-8e19-d23fddb3e8b7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:57.035081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33bec8f3-a067-454a-8e19-d23fddb3e8b7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:57.035558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33bec8f3-a067-454a-8e19-d23fddb3e8b7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:57.036001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33bec8f3-a067-454a-8e19-d23fddb3e8b7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:57.172713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-33bec8f3-a067-454a-8e19-d23fddb3e8b7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:57.180947 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-33bec8f3-a067-454a-8e19-d23fddb3e8b7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.159626 Aug 29 16:20:57.181573 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3880/7534] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:57 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:58.203900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fdca4ce1-02be-48cd-8f45-3e8216a36b22 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:58.204632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fdca4ce1-02be-48cd-8f45-3e8216a36b22 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:58.212250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fdca4ce1-02be-48cd-8f45-3e8216a36b22 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:58.212751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fdca4ce1-02be-48cd-8f45-3e8216a36b22 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:58.213406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fdca4ce1-02be-48cd-8f45-3e8216a36b22 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:58.214128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fdca4ce1-02be-48cd-8f45-3e8216a36b22 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:58.214587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fdca4ce1-02be-48cd-8f45-3e8216a36b22 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:58.215023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fdca4ce1-02be-48cd-8f45-3e8216a36b22 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:58.356861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fdca4ce1-02be-48cd-8f45-3e8216a36b22 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:58.365579 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fdca4ce1-02be-48cd-8f45-3e8216a36b22 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.166830 Aug 29 16:20:58.366139 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3655/7535] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:58 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:59.398638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e2a2e386-75c4-4203-ae01-7cc2e3ea78f7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:59.399605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e2a2e386-75c4-4203-ae01-7cc2e3ea78f7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:59.409404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2a2e386-75c4-4203-ae01-7cc2e3ea78f7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:59.409910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2a2e386-75c4-4203-ae01-7cc2e3ea78f7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:59.410366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2a2e386-75c4-4203-ae01-7cc2e3ea78f7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:59.411098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2a2e386-75c4-4203-ae01-7cc2e3ea78f7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:59.411578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2a2e386-75c4-4203-ae01-7cc2e3ea78f7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:59.412028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2a2e386-75c4-4203-ae01-7cc2e3ea78f7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:59.553937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e2a2e386-75c4-4203-ae01-7cc2e3ea78f7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:59.562361 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e2a2e386-75c4-4203-ae01-7cc2e3ea78f7 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.170707 Aug 29 16:20:59.562934 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3881/7536] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:59 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:00.595159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b5b5e9c8-7766-47ca-b8bf-714f21939067 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:00.596087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b5b5e9c8-7766-47ca-b8bf-714f21939067 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:00.600781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=32 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:00.609779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5b5e9c8-7766-47ca-b8bf-714f21939067 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:00.610784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5b5e9c8-7766-47ca-b8bf-714f21939067 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:00.610784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5b5e9c8-7766-47ca-b8bf-714f21939067 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:00.611425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5b5e9c8-7766-47ca-b8bf-714f21939067 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:00.611883 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5b5e9c8-7766-47ca-b8bf-714f21939067 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:00.612324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b5b5e9c8-7766-47ca-b8bf-714f21939067 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:00.615265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:00.765238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b5b5e9c8-7766-47ca-b8bf-714f21939067 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:00.773830 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b5b5e9c8-7766-47ca-b8bf-714f21939067 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.185791 Aug 29 16:21:00.774399 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3656/7537] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:00 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:01.798569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c4db9f87-f8d0-4410-b33b-6671019983b8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:01.799594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c4db9f87-f8d0-4410-b33b-6671019983b8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:01.803730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=30 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:01.812026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4db9f87-f8d0-4410-b33b-6671019983b8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:01.812528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4db9f87-f8d0-4410-b33b-6671019983b8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:01.812976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4db9f87-f8d0-4410-b33b-6671019983b8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:01.813718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4db9f87-f8d0-4410-b33b-6671019983b8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:01.814196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4db9f87-f8d0-4410-b33b-6671019983b8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:01.814636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4db9f87-f8d0-4410-b33b-6671019983b8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:01.817517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=88 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:01.955663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c4db9f87-f8d0-4410-b33b-6671019983b8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:01.964406 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c4db9f87-f8d0-4410-b33b-6671019983b8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1517 microversion: 2.1 time: 0.172148 Aug 29 16:21:01.964975 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3882/7538] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:01 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:02.681217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-0707c00a-590f-4fff-b64c-329f59c87cf5 req-56f52e94-6a6f-4706-9e1a-fffa6118d340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0750e030-738d-4b71-a00a-76e0ef8536fd", "name": "network-vif-unplugged", "status": "completed", "tag": "48e910f5-e598-4cf1-8351-d7a43d48f5ce"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:02.692240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0707c00a-590f-4fff-b64c-329f59c87cf5 req-56f52e94-6a6f-4706-9e1a-fffa6118d340 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:02.692657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0707c00a-590f-4fff-b64c-329f59c87cf5 req-56f52e94-6a6f-4706-9e1a-fffa6118d340 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:02.693141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0707c00a-590f-4fff-b64c-329f59c87cf5 req-56f52e94-6a6f-4706-9e1a-fffa6118d340 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:02.705783 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-0707c00a-590f-4fff-b64c-329f59c87cf5 req-56f52e94-6a6f-4706-9e1a-fffa6118d340 service nova] Creating event network-vif-unplugged:48e910f5-e598-4cf1-8351-d7a43d48f5ce for instance 0750e030-738d-4b71-a00a-76e0ef8536fd on n-h1-839401-11 Aug 29 16:21:02.711169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-0707c00a-590f-4fff-b64c-329f59c87cf5 req-56f52e94-6a6f-4706-9e1a-fffa6118d340 service nova] Instance 0750e030-738d-4b71-a00a-76e0ef8536fd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:21:02.722218 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-0707c00a-590f-4fff-b64c-329f59c87cf5 req-56f52e94-6a6f-4706-9e1a-fffa6118d340 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045047 Aug 29 16:21:02.723012 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3657/7539] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:02.986907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a8e1a7f4-be31-43d6-9f01-1e8e69623d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:02.987544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a8e1a7f4-be31-43d6-9f01-1e8e69623d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:02.994622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8e1a7f4-be31-43d6-9f01-1e8e69623d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:02.995117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8e1a7f4-be31-43d6-9f01-1e8e69623d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:02.995568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8e1a7f4-be31-43d6-9f01-1e8e69623d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:02.996279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8e1a7f4-be31-43d6-9f01-1e8e69623d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:02.996742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8e1a7f4-be31-43d6-9f01-1e8e69623d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:02.997244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8e1a7f4-be31-43d6-9f01-1e8e69623d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:03.130237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a8e1a7f4-be31-43d6-9f01-1e8e69623d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:03.139095 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a8e1a7f4-be31-43d6-9f01-1e8e69623d9a tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1516 microversion: 2.1 time: 0.156389 Aug 29 16:21:03.139749 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3883/7540] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:02 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:04.168960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-749ea5ee-3f19-4c14-91bb-5fd6209ec83b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:04.170014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-749ea5ee-3f19-4c14-91bb-5fd6209ec83b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:04.177055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-749ea5ee-3f19-4c14-91bb-5fd6209ec83b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:04.177571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-749ea5ee-3f19-4c14-91bb-5fd6209ec83b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:04.178003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-749ea5ee-3f19-4c14-91bb-5fd6209ec83b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:04.178692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-749ea5ee-3f19-4c14-91bb-5fd6209ec83b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:04.179144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-749ea5ee-3f19-4c14-91bb-5fd6209ec83b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:04.179590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-749ea5ee-3f19-4c14-91bb-5fd6209ec83b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:04.314278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-749ea5ee-3f19-4c14-91bb-5fd6209ec83b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:04.324588 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-749ea5ee-3f19-4c14-91bb-5fd6209ec83b tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1514 microversion: 2.1 time: 0.163932 Aug 29 16:21:04.325372 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3658/7541] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:04 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:04.743806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-7405a049-0daa-4f7d-b92e-3722134532fc req-2ab678c4-15bd-4d67-97e8-7a3303130eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0750e030-738d-4b71-a00a-76e0ef8536fd", "tag": "48e910f5-e598-4cf1-8351-d7a43d48f5ce"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:04.756868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7405a049-0daa-4f7d-b92e-3722134532fc req-2ab678c4-15bd-4d67-97e8-7a3303130eb5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:04.757396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7405a049-0daa-4f7d-b92e-3722134532fc req-2ab678c4-15bd-4d67-97e8-7a3303130eb5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:04.757843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7405a049-0daa-4f7d-b92e-3722134532fc req-2ab678c4-15bd-4d67-97e8-7a3303130eb5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:04.770108 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-7405a049-0daa-4f7d-b92e-3722134532fc req-2ab678c4-15bd-4d67-97e8-7a3303130eb5 service nova] Creating event network-changed:48e910f5-e598-4cf1-8351-d7a43d48f5ce for instance 0750e030-738d-4b71-a00a-76e0ef8536fd on n-h1-839401-11 Aug 29 16:21:04.775925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-7405a049-0daa-4f7d-b92e-3722134532fc req-2ab678c4-15bd-4d67-97e8-7a3303130eb5 service nova] Instance 0750e030-738d-4b71-a00a-76e0ef8536fd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:21:04.787890 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-7405a049-0daa-4f7d-b92e-3722134532fc req-2ab678c4-15bd-4d67-97e8-7a3303130eb5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050687 Aug 29 16:21:04.788484 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3884/7542] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:05.346839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0d8d9a6a-7410-46e4-b40c-b801c23ab230 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:05.348578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0d8d9a6a-7410-46e4-b40c-b801c23ab230 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:05.357431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d8d9a6a-7410-46e4-b40c-b801c23ab230 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:05.357927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d8d9a6a-7410-46e4-b40c-b801c23ab230 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:05.358363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d8d9a6a-7410-46e4-b40c-b801c23ab230 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:05.359073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d8d9a6a-7410-46e4-b40c-b801c23ab230 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:05.359525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d8d9a6a-7410-46e4-b40c-b801c23ab230 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:05.359961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d8d9a6a-7410-46e4-b40c-b801c23ab230 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:05.494686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0d8d9a6a-7410-46e4-b40c-b801c23ab230 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:05.503383 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0d8d9a6a-7410-46e4-b40c-b801c23ab230 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1514 microversion: 2.1 time: 0.160807 Aug 29 16:21:05.503936 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3659/7543] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:05 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:06.525720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e611b5d5-d282-4c39-9c3c-d98b13b0fa0e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:06.526452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e611b5d5-d282-4c39-9c3c-d98b13b0fa0e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:06.549478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e611b5d5-d282-4c39-9c3c-d98b13b0fa0e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:06.549957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e611b5d5-d282-4c39-9c3c-d98b13b0fa0e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:06.550419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e611b5d5-d282-4c39-9c3c-d98b13b0fa0e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:06.551175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e611b5d5-d282-4c39-9c3c-d98b13b0fa0e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:06.551791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e611b5d5-d282-4c39-9c3c-d98b13b0fa0e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:06.552049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e611b5d5-d282-4c39-9c3c-d98b13b0fa0e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:06.718412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e611b5d5-d282-4c39-9c3c-d98b13b0fa0e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:06.744750 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e611b5d5-d282-4c39-9c3c-d98b13b0fa0e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1514 microversion: 2.1 time: 0.223530 Aug 29 16:21:06.745778 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3885/7544] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:06 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:07.770339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb38fcf1-8309-4a8a-a9d8-6282b65f06a6 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:07.771430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bb38fcf1-8309-4a8a-a9d8-6282b65f06a6 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:07.782132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb38fcf1-8309-4a8a-a9d8-6282b65f06a6 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:07.782623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb38fcf1-8309-4a8a-a9d8-6282b65f06a6 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:07.783059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb38fcf1-8309-4a8a-a9d8-6282b65f06a6 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:07.783781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb38fcf1-8309-4a8a-a9d8-6282b65f06a6 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:07.784221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb38fcf1-8309-4a8a-a9d8-6282b65f06a6 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:07.784646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb38fcf1-8309-4a8a-a9d8-6282b65f06a6 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:07.941074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bb38fcf1-8309-4a8a-a9d8-6282b65f06a6 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:07.953322 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bb38fcf1-8309-4a8a-a9d8-6282b65f06a6 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1511 microversion: 2.1 time: 0.189847 Aug 29 16:21:07.953919 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3660/7545] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:07 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:07.973686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ce0bf38-16d6-4795-99b2-c47ab0bdb867 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:07.974243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ce0bf38-16d6-4795-99b2-c47ab0bdb867 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:07.981880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce0bf38-16d6-4795-99b2-c47ab0bdb867 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:07.982384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce0bf38-16d6-4795-99b2-c47ab0bdb867 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:07.982841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce0bf38-16d6-4795-99b2-c47ab0bdb867 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:07.983519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce0bf38-16d6-4795-99b2-c47ab0bdb867 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:07.984106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce0bf38-16d6-4795-99b2-c47ab0bdb867 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:07.984549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce0bf38-16d6-4795-99b2-c47ab0bdb867 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:08.047829 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ce0bf38-16d6-4795-99b2-c47ab0bdb867 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "POST /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd/action" status: 204 len: 0 microversion: 2.1 time: 0.078052 Aug 29 16:21:08.048663 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3886/7546] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:21:07 2022] POST /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:21:08.056867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dca1be5f-289f-41f3-8a47-e3cae4b5ea48 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:08.057504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dca1be5f-289f-41f3-8a47-e3cae4b5ea48 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:08.063780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dca1be5f-289f-41f3-8a47-e3cae4b5ea48 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:08.064383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dca1be5f-289f-41f3-8a47-e3cae4b5ea48 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:08.064798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dca1be5f-289f-41f3-8a47-e3cae4b5ea48 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:08.065629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dca1be5f-289f-41f3-8a47-e3cae4b5ea48 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:08.066155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dca1be5f-289f-41f3-8a47-e3cae4b5ea48 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:08.066622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dca1be5f-289f-41f3-8a47-e3cae4b5ea48 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:08.285756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dca1be5f-289f-41f3-8a47-e3cae4b5ea48 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:08.295667 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dca1be5f-289f-41f3-8a47-e3cae4b5ea48 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1511 microversion: 2.1 time: 0.242362 Aug 29 16:21:08.296454 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3661/7547] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:08 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1511 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:08.747933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-7466bf78-bcc7-4dc6-a40c-4fa0b2b4ef63 req-0ce44dcf-f0f8-475e-9797-6ae1227ec54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0750e030-738d-4b71-a00a-76e0ef8536fd", "name": "network-vif-plugged", "status": "completed", "tag": "48e910f5-e598-4cf1-8351-d7a43d48f5ce"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:08.761496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7466bf78-bcc7-4dc6-a40c-4fa0b2b4ef63 req-0ce44dcf-f0f8-475e-9797-6ae1227ec54e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:08.762022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7466bf78-bcc7-4dc6-a40c-4fa0b2b4ef63 req-0ce44dcf-f0f8-475e-9797-6ae1227ec54e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:08.762471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7466bf78-bcc7-4dc6-a40c-4fa0b2b4ef63 req-0ce44dcf-f0f8-475e-9797-6ae1227ec54e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:08.775433 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-7466bf78-bcc7-4dc6-a40c-4fa0b2b4ef63 req-0ce44dcf-f0f8-475e-9797-6ae1227ec54e service nova] Creating event network-vif-plugged:48e910f5-e598-4cf1-8351-d7a43d48f5ce for instance 0750e030-738d-4b71-a00a-76e0ef8536fd on n-h1-839401-11 Aug 29 16:21:08.781053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-7466bf78-bcc7-4dc6-a40c-4fa0b2b4ef63 req-0ce44dcf-f0f8-475e-9797-6ae1227ec54e service nova] Instance 0750e030-738d-4b71-a00a-76e0ef8536fd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:21:08.793648 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-7466bf78-bcc7-4dc6-a40c-4fa0b2b4ef63 req-0ce44dcf-f0f8-475e-9797-6ae1227ec54e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049733 Aug 29 16:21:08.794987 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3887/7548] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:09.326733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9125872f-c02d-4bc9-b022-f65c5539ee9c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:09.327772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9125872f-c02d-4bc9-b022-f65c5539ee9c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:09.339097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9125872f-c02d-4bc9-b022-f65c5539ee9c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:09.339916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9125872f-c02d-4bc9-b022-f65c5539ee9c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:09.340632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9125872f-c02d-4bc9-b022-f65c5539ee9c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:09.341916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9125872f-c02d-4bc9-b022-f65c5539ee9c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:09.342698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9125872f-c02d-4bc9-b022-f65c5539ee9c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:09.343503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9125872f-c02d-4bc9-b022-f65c5539ee9c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:09.492509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9125872f-c02d-4bc9-b022-f65c5539ee9c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:09.500878 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9125872f-c02d-4bc9-b022-f65c5539ee9c tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1511 microversion: 2.1 time: 0.180839 Aug 29 16:21:09.501531 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3662/7549] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:09 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:10.524467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7eaac957-9530-4775-8c2e-a82460f65ee0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:10.525289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7eaac957-9530-4775-8c2e-a82460f65ee0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:10.532757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eaac957-9530-4775-8c2e-a82460f65ee0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:10.533355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eaac957-9530-4775-8c2e-a82460f65ee0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:10.533825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eaac957-9530-4775-8c2e-a82460f65ee0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:10.534534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eaac957-9530-4775-8c2e-a82460f65ee0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:10.535013 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eaac957-9530-4775-8c2e-a82460f65ee0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:10.535440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7eaac957-9530-4775-8c2e-a82460f65ee0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:10.673637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7eaac957-9530-4775-8c2e-a82460f65ee0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:10.682101 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7eaac957-9530-4775-8c2e-a82460f65ee0 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1503 microversion: 2.1 time: 0.162194 Aug 29 16:21:10.682684 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3888/7550] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:10 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:10.702709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cb131ceb-b1f5-4ba8-9dca-dee9931f0a72 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:10.703402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cb131ceb-b1f5-4ba8-9dca-dee9931f0a72 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:10.710907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb131ceb-b1f5-4ba8-9dca-dee9931f0a72 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:10.711911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb131ceb-b1f5-4ba8-9dca-dee9931f0a72 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:10.712424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb131ceb-b1f5-4ba8-9dca-dee9931f0a72 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:10.713229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb131ceb-b1f5-4ba8-9dca-dee9931f0a72 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:10.713751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb131ceb-b1f5-4ba8-9dca-dee9931f0a72 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:10.714258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb131ceb-b1f5-4ba8-9dca-dee9931f0a72 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:10.847517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cb131ceb-b1f5-4ba8-9dca-dee9931f0a72 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:10.856405 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cb131ceb-b1f5-4ba8-9dca-dee9931f0a72 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1503 microversion: 2.1 time: 0.157539 Aug 29 16:21:10.857160 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3663/7551] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:10 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:10.876613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4319090d-a997-41e9-8501-5d5518d6b4ab tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:10.877293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4319090d-a997-41e9-8501-5d5518d6b4ab tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:10.883986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4319090d-a997-41e9-8501-5d5518d6b4ab tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:10.884456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4319090d-a997-41e9-8501-5d5518d6b4ab tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:10.884933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4319090d-a997-41e9-8501-5d5518d6b4ab tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:10.885787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4319090d-a997-41e9-8501-5d5518d6b4ab tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:10.886257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4319090d-a997-41e9-8501-5d5518d6b4ab tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:10.886690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4319090d-a997-41e9-8501-5d5518d6b4ab tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:11.022080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4319090d-a997-41e9-8501-5d5518d6b4ab tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:11.034197 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4319090d-a997-41e9-8501-5d5518d6b4ab tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1503 microversion: 2.1 time: 0.161227 Aug 29 16:21:11.034922 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3889/7552] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:10 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:11.056847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c8c82269-4207-465e-9f3a-1c03c44a6868 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:11.057440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c8c82269-4207-465e-9f3a-1c03c44a6868 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:11.065269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8c82269-4207-465e-9f3a-1c03c44a6868 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:11.065776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8c82269-4207-465e-9f3a-1c03c44a6868 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:11.066220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8c82269-4207-465e-9f3a-1c03c44a6868 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:11.066967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8c82269-4207-465e-9f3a-1c03c44a6868 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:11.067433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8c82269-4207-465e-9f3a-1c03c44a6868 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:11.067864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c8c82269-4207-465e-9f3a-1c03c44a6868 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:11.096154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c8c82269-4207-465e-9f3a-1c03c44a6868 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:21:11.181475 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c8c82269-4207-465e-9f3a-1c03c44a6868 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 204 len: 0 microversion: 2.1 time: 0.130454 Aug 29 16:21:11.182354 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3664/7553] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:21:11 2022] DELETE /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:21:11.197956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9521a20d-3943-4e64-93dc-98bd851f7ad3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:11.198669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9521a20d-3943-4e64-93dc-98bd851f7ad3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:11.204973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9521a20d-3943-4e64-93dc-98bd851f7ad3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:11.205576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9521a20d-3943-4e64-93dc-98bd851f7ad3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:11.206029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9521a20d-3943-4e64-93dc-98bd851f7ad3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:11.206769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9521a20d-3943-4e64-93dc-98bd851f7ad3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:11.207265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9521a20d-3943-4e64-93dc-98bd851f7ad3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:11.207692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9521a20d-3943-4e64-93dc-98bd851f7ad3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:11.234263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9521a20d-3943-4e64-93dc-98bd851f7ad3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:21:11.280221 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.compute.api [None req-9521a20d-3943-4e64-93dc-98bd851f7ad3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Instance is already in deleting state, ignoring this request Aug 29 16:21:11.281104 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9521a20d-3943-4e64-93dc-98bd851f7ad3 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 204 len: 0 microversion: 2.1 time: 0.087214 Aug 29 16:21:11.281701 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3890/7554] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:21:11 2022] DELETE /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:21:11.290818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-649ce5b6-9e70-4e6a-b7a3-9633601f52a1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:11.291526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-649ce5b6-9e70-4e6a-b7a3-9633601f52a1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:11.297985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-649ce5b6-9e70-4e6a-b7a3-9633601f52a1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:11.298502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-649ce5b6-9e70-4e6a-b7a3-9633601f52a1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:11.298944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-649ce5b6-9e70-4e6a-b7a3-9633601f52a1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:11.299653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-649ce5b6-9e70-4e6a-b7a3-9633601f52a1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:11.300115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-649ce5b6-9e70-4e6a-b7a3-9633601f52a1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:11.300551 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-649ce5b6-9e70-4e6a-b7a3-9633601f52a1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:11.438573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-649ce5b6-9e70-4e6a-b7a3-9633601f52a1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:11.446905 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-649ce5b6-9e70-4e6a-b7a3-9633601f52a1 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1509 microversion: 2.1 time: 0.160636 Aug 29 16:21:11.447474 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3665/7555] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:11 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:12.468579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6ca3122b-2d1a-4394-951a-37257974bde8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:12.469247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6ca3122b-2d1a-4394-951a-37257974bde8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:12.485599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ca3122b-2d1a-4394-951a-37257974bde8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:12.486089 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ca3122b-2d1a-4394-951a-37257974bde8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:12.486546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ca3122b-2d1a-4394-951a-37257974bde8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:12.487267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ca3122b-2d1a-4394-951a-37257974bde8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:12.487740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ca3122b-2d1a-4394-951a-37257974bde8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:12.488183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6ca3122b-2d1a-4394-951a-37257974bde8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:12.634313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6ca3122b-2d1a-4394-951a-37257974bde8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b050c7905fc242fe976bedb3bf3705ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ae7640021d470ba9a940c1728f10bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:12.645754 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6ca3122b-2d1a-4394-951a-37257974bde8 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 200 len: 1509 microversion: 2.1 time: 0.181350 Aug 29 16:21:12.646494 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3891/7556] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:12 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:13.408686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-bbd972ca-7566-4525-8722-99577fea4bde req-7e5b7cd3-b9c7-4d50-9527-9c89a20a5480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0750e030-738d-4b71-a00a-76e0ef8536fd", "name": "network-vif-deleted", "tag": "48e910f5-e598-4cf1-8351-d7a43d48f5ce"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:13.420560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-bbd972ca-7566-4525-8722-99577fea4bde req-7e5b7cd3-b9c7-4d50-9527-9c89a20a5480 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:13.421187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-bbd972ca-7566-4525-8722-99577fea4bde req-7e5b7cd3-b9c7-4d50-9527-9c89a20a5480 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:13.421700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-bbd972ca-7566-4525-8722-99577fea4bde req-7e5b7cd3-b9c7-4d50-9527-9c89a20a5480 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:13.434241 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-bbd972ca-7566-4525-8722-99577fea4bde req-7e5b7cd3-b9c7-4d50-9527-9c89a20a5480 service nova] Creating event network-vif-deleted:48e910f5-e598-4cf1-8351-d7a43d48f5ce for instance 0750e030-738d-4b71-a00a-76e0ef8536fd on n-h1-839401-11 Aug 29 16:21:13.439209 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-bbd972ca-7566-4525-8722-99577fea4bde req-7e5b7cd3-b9c7-4d50-9527-9c89a20a5480 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035084 Aug 29 16:21:13.439929 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3666/7557] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:13.671688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-14fb0353-50a1-479c-a795-24c3f86ff1de tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:13.672386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-14fb0353-50a1-479c-a795-24c3f86ff1de tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 0750e030-738d-4b71-a00a-76e0ef8536fd] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:13.680246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14fb0353-50a1-479c-a795-24c3f86ff1de tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:13.680864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14fb0353-50a1-479c-a795-24c3f86ff1de tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:13.681504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14fb0353-50a1-479c-a795-24c3f86ff1de tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:13.682385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14fb0353-50a1-479c-a795-24c3f86ff1de tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:13.682816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14fb0353-50a1-479c-a795-24c3f86ff1de tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:13.683265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-14fb0353-50a1-479c-a795-24c3f86ff1de tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:13.702344 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-14fb0353-50a1-479c-a795-24c3f86ff1de tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] HTTP exception thrown: Instance 0750e030-738d-4b71-a00a-76e0ef8536fd could not be found. Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-14fb0353-50a1-479c-a795-24c3f86ff1de tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Request method failure captured: Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd HTTP/1.1 Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOcP31mcmV92MPbMXdVz9mgPGDzIrjIlO0Cb-vkHlPkOA_ViMjjH7A03H2xgxDlLSsq2WhPnxskEo3XkF-j1EcRt1nVb1s9NOn7hVMwWBQG3KvxqAG7IC_Kqc9uD9HCio710vhFTk_DIqc3-Zh3-9XkO3HJoFfgosapvTm-0urLI3-8 Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 37ae7640021d470ba9a940c1728f10bb Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerDiskConfigTestJSON-291561579 Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_37ae7640021d470ba9a940c1728f10bb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/37ae7640021d470ba9a940c1728f10bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/37ae7640021d470ba9a940c1728f10bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/37ae7640021d470ba9a940c1728f10bb"}]}] Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerDiskConfigTestJSON-291561579 Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 37ae7640021d470ba9a940c1728f10bb Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-291561579 Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerDiskConfigTestJSON-291561579-project Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b050c7905fc242fe976bedb3bf3705ff Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerDiskConfigTestJSON-291561579-project Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 0750e030-738d-4b71-a00a-76e0ef8536fd could not be found. Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '0750e030-738d-4b71-a00a-76e0ef8536fd'} Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0750e030-738d-4b71-a00a-76e0ef8536fd could not be found. Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0750e030-738d-4b71-a00a-76e0ef8536fd could not be found. Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:21:13.704101 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:21:13.711616 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:13.711616 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:21:13.711616 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:21:13.711616 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:21:13.711616 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:21:13.711616 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0750e030-738d-4b71-a00a-76e0ef8536fd could not be found. Aug 29 16:21:13.711616 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:21:13.711616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-14fb0353-50a1-479c-a795-24c3f86ff1de tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Returning 404 to user: Instance 0750e030-738d-4b71-a00a-76e0ef8536fd could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:21:13.711616 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-14fb0353-50a1-479c-a795-24c3f86ff1de tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd" status: 404 len: 111 microversion: 2.1 time: 0.038365 Aug 29 16:21:13.711616 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3892/7558] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:13 2022] GET /compute/v2.1/servers/0750e030-738d-4b71-a00a-76e0ef8536fd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:21:13.716271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d74db634-7e93-43a1-b988-8610a135c38e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '.version_select at 0x7fc42bafdb80>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:13.741680 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d74db634-7e93-43a1-b988-8610a135c38e tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1449821492" status: 202 len: 0 microversion: 2.1 time: 0.030644 Aug 29 16:21:13.742264 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3667/7559] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 16:21:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1449821492 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:21:14.399822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ea1c6ac5-b818-4c45-9728-68028d584083 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:14.400535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ea1c6ac5-b818-4c45-9728-68028d584083 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:14.410074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea1c6ac5-b818-4c45-9728-68028d584083 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:14.410860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea1c6ac5-b818-4c45-9728-68028d584083 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:14.411482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea1c6ac5-b818-4c45-9728-68028d584083 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:14.412198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea1c6ac5-b818-4c45-9728-68028d584083 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:14.412677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea1c6ac5-b818-4c45-9728-68028d584083 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:14.413158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea1c6ac5-b818-4c45-9728-68028d584083 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:14.432550 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-ea1c6ac5-b818-4c45-9728-68028d584083 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] HTTP exception thrown: Instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 could not be found. Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ea1c6ac5-b818-4c45-9728-68028d584083 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Request method failure captured: Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 HTTP/1.1 Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOcP31mcmV92MPbMXdVz9mgPGDzIrjIlO0Cb-vkHlPkOA_ViMjjH7A03H2xgxDlLSsq2WhPnxskEo3XkF-j1EcRt1nVb1s9NOn7hVMwWBQG3KvxqAG7IC_Kqc9uD9HCio710vhFTk_DIqc3-Zh3-9XkO3HJoFfgosapvTm-0urLI3-8 Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 37ae7640021d470ba9a940c1728f10bb Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerDiskConfigTestJSON-291561579 Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_37ae7640021d470ba9a940c1728f10bb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/37ae7640021d470ba9a940c1728f10bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/37ae7640021d470ba9a940c1728f10bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/37ae7640021d470ba9a940c1728f10bb"}]}] Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerDiskConfigTestJSON-291561579 Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 37ae7640021d470ba9a940c1728f10bb Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-291561579 Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerDiskConfigTestJSON-291561579-project Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: b050c7905fc242fe976bedb3bf3705ff Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerDiskConfigTestJSON-291561579-project Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 could not be found. Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '986b8f30-da8a-43cc-bc22-adbfa4a11733'} Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 could not be found. Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:21:14.435310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:21:14.439032 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 could not be found. Aug 29 16:21:14.439032 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:21:14.439032 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:21:14.439032 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:21:14.439032 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:14.439032 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:21:14.439032 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:21:14.439032 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:21:14.439032 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:21:14.439032 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 could not be found. Aug 29 16:21:14.439032 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:21:14.439032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ea1c6ac5-b818-4c45-9728-68028d584083 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Returning 404 to user: Instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:21:14.439032 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ea1c6ac5-b818-4c45-9728-68028d584083 tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "DELETE /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 404 len: 111 microversion: 2.1 time: 0.042578 Aug 29 16:21:14.439032 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3893/7560] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:21:14 2022] DELETE /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:21:14.446871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-39fe0d84-f75e-4cc7-8417-7c7a21cd9ced tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:14.447745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-39fe0d84-f75e-4cc7-8417-7c7a21cd9ced tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] [instance: 986b8f30-da8a-43cc-bc22-adbfa4a11733] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:14.455718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39fe0d84-f75e-4cc7-8417-7c7a21cd9ced tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:14.456229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39fe0d84-f75e-4cc7-8417-7c7a21cd9ced tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:14.456667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39fe0d84-f75e-4cc7-8417-7c7a21cd9ced tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:14.457410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39fe0d84-f75e-4cc7-8417-7c7a21cd9ced tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:14.457869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39fe0d84-f75e-4cc7-8417-7c7a21cd9ced tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:14.458626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-39fe0d84-f75e-4cc7-8417-7c7a21cd9ced tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:14.473232 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-39fe0d84-f75e-4cc7-8417-7c7a21cd9ced tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] HTTP exception thrown: Instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 could not be found. Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-39fe0d84-f75e-4cc7-8417-7c7a21cd9ced tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Request method failure captured: Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 HTTP/1.1 Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOcP31mcmV92MPbMXdVz9mgPGDzIrjIlO0Cb-vkHlPkOA_ViMjjH7A03H2xgxDlLSsq2WhPnxskEo3XkF-j1EcRt1nVb1s9NOn7hVMwWBQG3KvxqAG7IC_Kqc9uD9HCio710vhFTk_DIqc3-Zh3-9XkO3HJoFfgosapvTm-0urLI3-8 Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 37ae7640021d470ba9a940c1728f10bb Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerDiskConfigTestJSON-291561579 Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_37ae7640021d470ba9a940c1728f10bb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/37ae7640021d470ba9a940c1728f10bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/37ae7640021d470ba9a940c1728f10bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/37ae7640021d470ba9a940c1728f10bb"}]}] Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerDiskConfigTestJSON-291561579 Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 37ae7640021d470ba9a940c1728f10bb Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-291561579 Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerDiskConfigTestJSON-291561579-project Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: b050c7905fc242fe976bedb3bf3705ff Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerDiskConfigTestJSON-291561579-project Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 could not be found. Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '986b8f30-da8a-43cc-bc22-adbfa4a11733'} Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 could not be found. Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 could not be found. Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:21:14.475305 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:21:14.480383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:14.480383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:21:14.480383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:21:14.480383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:21:14.480383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:21:14.480383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 could not be found. Aug 29 16:21:14.480383 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:21:14.480383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-39fe0d84-f75e-4cc7-8417-7c7a21cd9ced tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] Returning 404 to user: Instance 986b8f30-da8a-43cc-bc22-adbfa4a11733 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:21:14.480383 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-39fe0d84-f75e-4cc7-8417-7c7a21cd9ced tempest-ServerDiskConfigTestJSON-291561579 tempest-ServerDiskConfigTestJSON-291561579-project] 10.222.0.62 "GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733" status: 404 len: 111 microversion: 2.1 time: 0.035028 Aug 29 16:21:14.480383 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3668/7561] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:14 2022] GET /compute/v2.1/servers/986b8f30-da8a-43cc-bc22-adbfa4a11733 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:21:23.082154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0e072edf-1f84-4d4c-a8c1-91b349c904e4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Action: 'create', calling method: .version_select at 0x7fc433b6c3a0>, body: {"keypair": {"name": "tempest-keypair-1856537733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPVGBzKwFq8p9o1gx2/2oTHbYPUf0bvoWmiAfK6TiaEhIE9yzybydbWkBh+S+wmt5iw9RaCwp1gSomP4asSGN93N/VSy77JM3VN6G9KRkyE3LDzQb8AGvCfP2tnMgacZg=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:23.102902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-0e072edf-1f84-4d4c-a8c1-91b349c904e4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Getting quotas for project 1a3432e106e74db480a1f7a17af514fb. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:21:23.108752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-0e072edf-1f84-4d4c-a8c1-91b349c904e4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Getting quotas for user 6658968475ea487ea0aba9be50d861fe and project 1a3432e106e74db480a1f7a17af514fb. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:21:23.135812 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0e072edf-1f84-4d4c-a8c1-91b349c904e4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179855 Aug 29 16:21:23.143882 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3894/7562] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:21:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:24.911071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-281550054", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "827789af-a96a-4564-a015-c53c7c9ca929"}], "security_groups": [{"name": "tempest-securitygroup--825674519"}], "key_name": "tempest-keypair-1856537733", "user_data": "}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:24.921292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:24.922158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:25.027662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] validate_networks() for [('827789af-a96a-4564-a015-c53c7c9ca929', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:21:25.437460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:21:25.438378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:21:25.438859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:21:25.439272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:21:25.439679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:21:25.448923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:25.449536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:25.449970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:25.450712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:25.451170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:25.452160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:25.469076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Getting quotas for project 1a3432e106e74db480a1f7a17af514fb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:21:25.474916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Getting quotas for user 6658968475ea487ea0aba9be50d861fe and project 1a3432e106e74db480a1f7a17af514fb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:21:25.487635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:21:25.490064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:21:25.539745 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f641bf8d-f3c5-4830-8f57-11f974904ee1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.633429 Aug 29 16:21:25.540780 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3669/7563] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:21:24 2022] POST /compute/v2.1/servers => generated 408 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:21:25.549694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:25.554442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5bc92ddb-cf4a-4a5d-a181-eade58feaceb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:25.555273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5bc92ddb-cf4a-4a5d-a181-eade58feaceb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:25.628624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5bc92ddb-cf4a-4a5d-a181-eade58feaceb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:25.638268 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5bc92ddb-cf4a-4a5d-a181-eade58feaceb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1238 microversion: 2.1 time: 0.090403 Aug 29 16:21:25.639325 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3895/7564] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:25 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:26.662374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f17cc850-8339-4751-aaa9-0164ac31f1f7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:26.662844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f17cc850-8339-4751-aaa9-0164ac31f1f7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:26.670676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f17cc850-8339-4751-aaa9-0164ac31f1f7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:26.671428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f17cc850-8339-4751-aaa9-0164ac31f1f7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:26.671937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f17cc850-8339-4751-aaa9-0164ac31f1f7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:26.672679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f17cc850-8339-4751-aaa9-0164ac31f1f7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:26.673431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f17cc850-8339-4751-aaa9-0164ac31f1f7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:26.673878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f17cc850-8339-4751-aaa9-0164ac31f1f7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:26.788570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f17cc850-8339-4751-aaa9-0164ac31f1f7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:26.799717 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f17cc850-8339-4751-aaa9-0164ac31f1f7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1298 microversion: 2.1 time: 0.143206 Aug 29 16:21:26.800646 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3670/7565] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:26 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1298 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:27.825759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d22b582-cc34-4b11-aa15-f63aaa0b6f4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:27.828605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2d22b582-cc34-4b11-aa15-f63aaa0b6f4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:27.836770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d22b582-cc34-4b11-aa15-f63aaa0b6f4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:27.837648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d22b582-cc34-4b11-aa15-f63aaa0b6f4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:27.838088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d22b582-cc34-4b11-aa15-f63aaa0b6f4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:27.838802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d22b582-cc34-4b11-aa15-f63aaa0b6f4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:27.839446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d22b582-cc34-4b11-aa15-f63aaa0b6f4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:27.839959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2d22b582-cc34-4b11-aa15-f63aaa0b6f4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:27.993919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2d22b582-cc34-4b11-aa15-f63aaa0b6f4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:28.002620 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d22b582-cc34-4b11-aa15-f63aaa0b6f4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1363 microversion: 2.1 time: 0.184986 Aug 29 16:21:28.012611 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3896/7566] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:27 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:28.499647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f5ee701e-7daa-4764-b57b-55468428b0da req-2e4ff735-c99b-4be1-bee0-a4566ae23914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d81fbbfc-83ef-4f12-8fb2-821092dd4367", "tag": "cd309788-59cc-48cd-9e13-e4c5d49f57c9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:28.513010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f5ee701e-7daa-4764-b57b-55468428b0da req-2e4ff735-c99b-4be1-bee0-a4566ae23914 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:28.513523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f5ee701e-7daa-4764-b57b-55468428b0da req-2e4ff735-c99b-4be1-bee0-a4566ae23914 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:28.514134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f5ee701e-7daa-4764-b57b-55468428b0da req-2e4ff735-c99b-4be1-bee0-a4566ae23914 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:28.527674 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f5ee701e-7daa-4764-b57b-55468428b0da req-2e4ff735-c99b-4be1-bee0-a4566ae23914 service nova] Creating event network-changed:cd309788-59cc-48cd-9e13-e4c5d49f57c9 for instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 on n-h1-839401-11 Aug 29 16:21:28.532893 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f5ee701e-7daa-4764-b57b-55468428b0da req-2e4ff735-c99b-4be1-bee0-a4566ae23914 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038038 Aug 29 16:21:28.533539 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3671/7567] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:29.025115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2dd2a8e0-b7ea-45b6-92cc-02cdb1ed107c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:29.025657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2dd2a8e0-b7ea-45b6-92cc-02cdb1ed107c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:29.033196 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dd2a8e0-b7ea-45b6-92cc-02cdb1ed107c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:29.033735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dd2a8e0-b7ea-45b6-92cc-02cdb1ed107c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:29.034298 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dd2a8e0-b7ea-45b6-92cc-02cdb1ed107c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:29.035070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dd2a8e0-b7ea-45b6-92cc-02cdb1ed107c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:29.035556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dd2a8e0-b7ea-45b6-92cc-02cdb1ed107c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:29.036103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2dd2a8e0-b7ea-45b6-92cc-02cdb1ed107c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:29.174361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2dd2a8e0-b7ea-45b6-92cc-02cdb1ed107c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:29.182799 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2dd2a8e0-b7ea-45b6-92cc-02cdb1ed107c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1363 microversion: 2.1 time: 0.162392 Aug 29 16:21:29.183592 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3897/7568] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:29 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:30.206314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7ddf80a3-e6f9-4f7d-a6f9-6f0a086e1dc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:30.206861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7ddf80a3-e6f9-4f7d-a6f9-6f0a086e1dc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:30.213854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ddf80a3-e6f9-4f7d-a6f9-6f0a086e1dc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:30.214333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ddf80a3-e6f9-4f7d-a6f9-6f0a086e1dc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:30.214772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ddf80a3-e6f9-4f7d-a6f9-6f0a086e1dc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:30.215482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ddf80a3-e6f9-4f7d-a6f9-6f0a086e1dc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:30.215935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ddf80a3-e6f9-4f7d-a6f9-6f0a086e1dc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:30.216361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ddf80a3-e6f9-4f7d-a6f9-6f0a086e1dc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:30.352910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7ddf80a3-e6f9-4f7d-a6f9-6f0a086e1dc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:30.361047 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7ddf80a3-e6f9-4f7d-a6f9-6f0a086e1dc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1363 microversion: 2.1 time: 0.160166 Aug 29 16:21:30.361673 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3672/7569] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:30 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:31.382352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e0d1f4df-9262-417e-9754-726673de885e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:31.382999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e0d1f4df-9262-417e-9754-726673de885e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:31.390409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0d1f4df-9262-417e-9754-726673de885e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:31.390859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0d1f4df-9262-417e-9754-726673de885e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:31.391320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0d1f4df-9262-417e-9754-726673de885e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:31.392042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0d1f4df-9262-417e-9754-726673de885e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:31.392518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0d1f4df-9262-417e-9754-726673de885e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:31.392964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0d1f4df-9262-417e-9754-726673de885e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:31.539386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e0d1f4df-9262-417e-9754-726673de885e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:31.548071 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e0d1f4df-9262-417e-9754-726673de885e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1363 microversion: 2.1 time: 0.170058 Aug 29 16:21:31.548655 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3898/7570] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:31 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:32.569493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ca1f4f06-533f-4972-8203-c248ee29bbf4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:32.570165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ca1f4f06-533f-4972-8203-c248ee29bbf4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:32.577745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca1f4f06-533f-4972-8203-c248ee29bbf4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:32.578257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca1f4f06-533f-4972-8203-c248ee29bbf4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:32.578670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca1f4f06-533f-4972-8203-c248ee29bbf4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:32.579397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca1f4f06-533f-4972-8203-c248ee29bbf4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:32.579858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca1f4f06-533f-4972-8203-c248ee29bbf4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:32.580284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca1f4f06-533f-4972-8203-c248ee29bbf4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:32.725397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ca1f4f06-533f-4972-8203-c248ee29bbf4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:32.734106 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ca1f4f06-533f-4972-8203-c248ee29bbf4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1363 microversion: 2.1 time: 0.168564 Aug 29 16:21:32.734828 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3673/7571] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:32 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:33.758646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-00966556-83e8-46ed-91cf-9faa57c13e4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:33.759286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-00966556-83e8-46ed-91cf-9faa57c13e4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:33.761841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:33.767572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00966556-83e8-46ed-91cf-9faa57c13e4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:33.768080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00966556-83e8-46ed-91cf-9faa57c13e4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:33.768535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00966556-83e8-46ed-91cf-9faa57c13e4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:33.769314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00966556-83e8-46ed-91cf-9faa57c13e4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:33.769796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00966556-83e8-46ed-91cf-9faa57c13e4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:33.770246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-00966556-83e8-46ed-91cf-9faa57c13e4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:33.902737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-00966556-83e8-46ed-91cf-9faa57c13e4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:33.910909 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-00966556-83e8-46ed-91cf-9faa57c13e4c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1363 microversion: 2.1 time: 0.158304 Aug 29 16:21:33.911507 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3899/7572] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:33 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:34.868436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f1d26ae0-2e2d-43ae-9da3-26c69b9fde3f req-62508686-1300-4c31-a4fa-ab235a324ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d81fbbfc-83ef-4f12-8fb2-821092dd4367", "name": "network-vif-plugged", "status": "completed", "tag": "cd309788-59cc-48cd-9e13-e4c5d49f57c9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:34.879586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f1d26ae0-2e2d-43ae-9da3-26c69b9fde3f req-62508686-1300-4c31-a4fa-ab235a324ec3 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:34.880853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f1d26ae0-2e2d-43ae-9da3-26c69b9fde3f req-62508686-1300-4c31-a4fa-ab235a324ec3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:34.881311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f1d26ae0-2e2d-43ae-9da3-26c69b9fde3f req-62508686-1300-4c31-a4fa-ab235a324ec3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:34.893723 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f1d26ae0-2e2d-43ae-9da3-26c69b9fde3f req-62508686-1300-4c31-a4fa-ab235a324ec3 service nova] Creating event network-vif-plugged:cd309788-59cc-48cd-9e13-e4c5d49f57c9 for instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 on n-h1-839401-11 Aug 29 16:21:34.899721 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f1d26ae0-2e2d-43ae-9da3-26c69b9fde3f req-62508686-1300-4c31-a4fa-ab235a324ec3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035143 Aug 29 16:21:34.900348 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3674/7573] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:21:34.932456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dbb49369-3d3f-4e04-a236-088d63be05e1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:34.933111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dbb49369-3d3f-4e04-a236-088d63be05e1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:34.943141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbb49369-3d3f-4e04-a236-088d63be05e1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:34.944036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbb49369-3d3f-4e04-a236-088d63be05e1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:34.944553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbb49369-3d3f-4e04-a236-088d63be05e1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:34.945409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbb49369-3d3f-4e04-a236-088d63be05e1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:34.945954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbb49369-3d3f-4e04-a236-088d63be05e1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:34.946408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbb49369-3d3f-4e04-a236-088d63be05e1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:35.086970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dbb49369-3d3f-4e04-a236-088d63be05e1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:35.095998 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dbb49369-3d3f-4e04-a236-088d63be05e1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1363 microversion: 2.1 time: 0.167916 Aug 29 16:21:35.096868 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3900/7574] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:34 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:36.118832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:36.120185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:36.129467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f09d146b-4beb-4977-ae4c-36b0718765c8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:36.130620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f09d146b-4beb-4977-ae4c-36b0718765c8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:36.138705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f09d146b-4beb-4977-ae4c-36b0718765c8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:36.139188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f09d146b-4beb-4977-ae4c-36b0718765c8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:36.139627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f09d146b-4beb-4977-ae4c-36b0718765c8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:36.140328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f09d146b-4beb-4977-ae4c-36b0718765c8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:36.140808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f09d146b-4beb-4977-ae4c-36b0718765c8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:36.141258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f09d146b-4beb-4977-ae4c-36b0718765c8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:36.286327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f09d146b-4beb-4977-ae4c-36b0718765c8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:36.298314 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f09d146b-4beb-4977-ae4c-36b0718765c8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1363 microversion: 2.1 time: 0.181072 Aug 29 16:21:36.299110 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3675/7575] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:36 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:37.323108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e399b57b-ade0-4f63-bd40-98985d798f7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:37.323844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e399b57b-ade0-4f63-bd40-98985d798f7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:37.326093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:37.333893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e399b57b-ade0-4f63-bd40-98985d798f7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:37.334475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e399b57b-ade0-4f63-bd40-98985d798f7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:37.335007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e399b57b-ade0-4f63-bd40-98985d798f7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:37.335876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e399b57b-ade0-4f63-bd40-98985d798f7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:37.336463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e399b57b-ade0-4f63-bd40-98985d798f7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:37.336992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e399b57b-ade0-4f63-bd40-98985d798f7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:37.486873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e399b57b-ade0-4f63-bd40-98985d798f7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:37.498502 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e399b57b-ade0-4f63-bd40-98985d798f7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1550 microversion: 2.1 time: 0.181093 Aug 29 16:21:37.499296 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3901/7576] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:37 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1550 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:37.518992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f4560bff-97a8-4016-b38c-61aa26e53c3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:37.519562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f4560bff-97a8-4016-b38c-61aa26e53c3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:37.526565 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4560bff-97a8-4016-b38c-61aa26e53c3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:37.527052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4560bff-97a8-4016-b38c-61aa26e53c3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:37.527480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4560bff-97a8-4016-b38c-61aa26e53c3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:37.528169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4560bff-97a8-4016-b38c-61aa26e53c3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:37.528635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4560bff-97a8-4016-b38c-61aa26e53c3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:37.529050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f4560bff-97a8-4016-b38c-61aa26e53c3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:37.615421 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f4560bff-97a8-4016-b38c-61aa26e53c3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099935 Aug 29 16:21:37.616476 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3676/7577] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 16:21:37 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:38.671071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-24c37327-76fc-4dbe-bd68-f5ed7452a63e req-703d4a03-582c-4d1c-bff6-12f2ecdddf6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d81fbbfc-83ef-4f12-8fb2-821092dd4367", "tag": "cd309788-59cc-48cd-9e13-e4c5d49f57c9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:38.681649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-24c37327-76fc-4dbe-bd68-f5ed7452a63e req-703d4a03-582c-4d1c-bff6-12f2ecdddf6a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:38.682134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-24c37327-76fc-4dbe-bd68-f5ed7452a63e req-703d4a03-582c-4d1c-bff6-12f2ecdddf6a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:38.682570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-24c37327-76fc-4dbe-bd68-f5ed7452a63e req-703d4a03-582c-4d1c-bff6-12f2ecdddf6a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:38.693925 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-24c37327-76fc-4dbe-bd68-f5ed7452a63e req-703d4a03-582c-4d1c-bff6-12f2ecdddf6a service nova] Creating event network-changed:cd309788-59cc-48cd-9e13-e4c5d49f57c9 for instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 on n-h1-839401-11 Aug 29 16:21:38.699295 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-24c37327-76fc-4dbe-bd68-f5ed7452a63e req-703d4a03-582c-4d1c-bff6-12f2ecdddf6a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031984 Aug 29 16:21:38.699979 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3902/7578] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:22:53.866011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:53.866801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=34 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:53.872391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-038d1581-7961-4a2c-a376-a2a5e9dfa19b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:53.873000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-038d1581-7961-4a2c-a376-a2a5e9dfa19b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:53.880498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-038d1581-7961-4a2c-a376-a2a5e9dfa19b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:53.881186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-038d1581-7961-4a2c-a376-a2a5e9dfa19b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:53.881626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-038d1581-7961-4a2c-a376-a2a5e9dfa19b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:53.882329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-038d1581-7961-4a2c-a376-a2a5e9dfa19b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:53.882780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-038d1581-7961-4a2c-a376-a2a5e9dfa19b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:53.883206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-038d1581-7961-4a2c-a376-a2a5e9dfa19b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:54.086161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-038d1581-7961-4a2c-a376-a2a5e9dfa19b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:54.094534 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-038d1581-7961-4a2c-a376-a2a5e9dfa19b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1668 microversion: 2.1 time: 0.232035 Aug 29 16:22:54.095106 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3677/7579] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:53 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1668 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:54.115908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=7 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:54.116611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=38 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:54.117837 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:22:54.118046 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:22:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 (ip 10.222.0.62) !!! Aug 29 16:22:54.123937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e76e4e87-0c15-4cac-9d80-08cd74e8d1c5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:54.124655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e76e4e87-0c15-4cac-9d80-08cd74e8d1c5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:54.133141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e76e4e87-0c15-4cac-9d80-08cd74e8d1c5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:54.133625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e76e4e87-0c15-4cac-9d80-08cd74e8d1c5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:54.134082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e76e4e87-0c15-4cac-9d80-08cd74e8d1c5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:54.134788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e76e4e87-0c15-4cac-9d80-08cd74e8d1c5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:54.135260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e76e4e87-0c15-4cac-9d80-08cd74e8d1c5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:54.135710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e76e4e87-0c15-4cac-9d80-08cd74e8d1c5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:54.321581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e76e4e87-0c15-4cac-9d80-08cd74e8d1c5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:54.329747 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e76e4e87-0c15-4cac-9d80-08cd74e8d1c5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1668 microversion: 2.1 time: 0.218233 Aug 29 16:22:54.330339 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3903/7580] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:54 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1668 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:54.350723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-93fe40e0-a9c1-49ba-81fe-03a5b1e25d6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:54.351430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-93fe40e0-a9c1-49ba-81fe-03a5b1e25d6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:54.357618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93fe40e0-a9c1-49ba-81fe-03a5b1e25d6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:54.358107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93fe40e0-a9c1-49ba-81fe-03a5b1e25d6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:54.358548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93fe40e0-a9c1-49ba-81fe-03a5b1e25d6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:54.359242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93fe40e0-a9c1-49ba-81fe-03a5b1e25d6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:54.359722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93fe40e0-a9c1-49ba-81fe-03a5b1e25d6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:54.360138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93fe40e0-a9c1-49ba-81fe-03a5b1e25d6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:54.498613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-93fe40e0-a9c1-49ba-81fe-03a5b1e25d6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:54.507201 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-93fe40e0-a9c1-49ba-81fe-03a5b1e25d6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1668 microversion: 2.1 time: 0.160876 Aug 29 16:22:54.507844 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3678/7581] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:54 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:22:54.528151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cbb81655-7034-4c56-97e5-e869593e76c7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:54.531288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cbb81655-7034-4c56-97e5-e869593e76c7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:54.538035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbb81655-7034-4c56-97e5-e869593e76c7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:54.538549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbb81655-7034-4c56-97e5-e869593e76c7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:54.539001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbb81655-7034-4c56-97e5-e869593e76c7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:54.539747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbb81655-7034-4c56-97e5-e869593e76c7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:54.540215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbb81655-7034-4c56-97e5-e869593e76c7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:54.540656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cbb81655-7034-4c56-97e5-e869593e76c7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:54.572517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cbb81655-7034-4c56-97e5-e869593e76c7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:54.578683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cbb81655-7034-4c56-97e5-e869593e76c7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Old instance type m1.heat2, new instance type m1.heat {{(pid=122360) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:22:54.585998 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-cbb81655-7034-4c56-97e5-e869593e76c7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:22:54.586441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-cbb81655-7034-4c56-97e5-e869593e76c7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:22:54.586925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-cbb81655-7034-4c56-97e5-e869593e76c7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:22:54.587350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-cbb81655-7034-4c56-97e5-e869593e76c7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:22:54.587779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-cbb81655-7034-4c56-97e5-e869593e76c7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:22:54.660262 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cbb81655-7034-4c56-97e5-e869593e76c7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "POST /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367/action" status: 202 len: 0 microversion: 2.1 time: 0.136181 Aug 29 16:22:54.660943 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3904/7582] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:22:54 2022] POST /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:22:54.669645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-727e98b1-a13a-4975-9f48-cde6edb9f813 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:54.670359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-727e98b1-a13a-4975-9f48-cde6edb9f813 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:54.676870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-727e98b1-a13a-4975-9f48-cde6edb9f813 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:54.677497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-727e98b1-a13a-4975-9f48-cde6edb9f813 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:54.678011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-727e98b1-a13a-4975-9f48-cde6edb9f813 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:54.678785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-727e98b1-a13a-4975-9f48-cde6edb9f813 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:54.679415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-727e98b1-a13a-4975-9f48-cde6edb9f813 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:54.679928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-727e98b1-a13a-4975-9f48-cde6edb9f813 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:54.840753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-727e98b1-a13a-4975-9f48-cde6edb9f813 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:54.850636 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-727e98b1-a13a-4975-9f48-cde6edb9f813 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1677 microversion: 2.1 time: 0.185089 Aug 29 16:22:54.864147 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3679/7583] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:54 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:55.874676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-37c1e4cb-503d-4f26-947a-8d8db0b32d78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:55.875286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-37c1e4cb-503d-4f26-947a-8d8db0b32d78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:55.883930 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37c1e4cb-503d-4f26-947a-8d8db0b32d78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:55.884433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37c1e4cb-503d-4f26-947a-8d8db0b32d78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:55.884929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37c1e4cb-503d-4f26-947a-8d8db0b32d78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:55.885820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37c1e4cb-503d-4f26-947a-8d8db0b32d78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:55.886287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37c1e4cb-503d-4f26-947a-8d8db0b32d78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:55.886729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37c1e4cb-503d-4f26-947a-8d8db0b32d78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:56.025323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-37c1e4cb-503d-4f26-947a-8d8db0b32d78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:56.034132 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-37c1e4cb-503d-4f26-947a-8d8db0b32d78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1677 microversion: 2.1 time: 0.166520 Aug 29 16:22:56.034733 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3905/7584] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:55 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:57.056419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-925932f2-3a51-440c-bad0-2f31409f8b32 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:57.057185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-925932f2-3a51-440c-bad0-2f31409f8b32 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:57.064846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-925932f2-3a51-440c-bad0-2f31409f8b32 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:57.065384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-925932f2-3a51-440c-bad0-2f31409f8b32 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:57.065818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-925932f2-3a51-440c-bad0-2f31409f8b32 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:57.066523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-925932f2-3a51-440c-bad0-2f31409f8b32 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:57.066978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-925932f2-3a51-440c-bad0-2f31409f8b32 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:57.067579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-925932f2-3a51-440c-bad0-2f31409f8b32 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:57.290711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-925932f2-3a51-440c-bad0-2f31409f8b32 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:57.299070 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-925932f2-3a51-440c-bad0-2f31409f8b32 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1677 microversion: 2.1 time: 0.247315 Aug 29 16:22:57.299660 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3680/7585] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:57 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1677 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:58.325269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4ef88a07-e8ae-4092-b7e7-676a1b953eee tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:58.326334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4ef88a07-e8ae-4092-b7e7-676a1b953eee tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:58.337915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ef88a07-e8ae-4092-b7e7-676a1b953eee tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:58.338471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ef88a07-e8ae-4092-b7e7-676a1b953eee tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:58.338960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ef88a07-e8ae-4092-b7e7-676a1b953eee tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:58.339677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ef88a07-e8ae-4092-b7e7-676a1b953eee tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:58.340159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ef88a07-e8ae-4092-b7e7-676a1b953eee tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:58.340603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ef88a07-e8ae-4092-b7e7-676a1b953eee tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:58.480101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4ef88a07-e8ae-4092-b7e7-676a1b953eee tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:58.492398 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4ef88a07-e8ae-4092-b7e7-676a1b953eee tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1682 microversion: 2.1 time: 0.173648 Aug 29 16:22:58.493344 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3906/7586] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:58 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:59.517880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8d94bdac-4c74-4d8c-9aab-91a0fbd2f9f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:59.518893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8d94bdac-4c74-4d8c-9aab-91a0fbd2f9f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:59.530744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d94bdac-4c74-4d8c-9aab-91a0fbd2f9f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:59.531559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d94bdac-4c74-4d8c-9aab-91a0fbd2f9f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:59.532294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d94bdac-4c74-4d8c-9aab-91a0fbd2f9f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:59.533526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d94bdac-4c74-4d8c-9aab-91a0fbd2f9f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:59.534305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d94bdac-4c74-4d8c-9aab-91a0fbd2f9f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:59.535022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d94bdac-4c74-4d8c-9aab-91a0fbd2f9f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:59.686821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8d94bdac-4c74-4d8c-9aab-91a0fbd2f9f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:59.695214 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8d94bdac-4c74-4d8c-9aab-91a0fbd2f9f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1682 microversion: 2.1 time: 0.184139 Aug 29 16:22:59.695792 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3681/7587] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:59 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:00.716369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f254b968-0c99-4331-8cc1-7c0ad63ea7df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:00.716982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f254b968-0c99-4331-8cc1-7c0ad63ea7df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:00.724387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f254b968-0c99-4331-8cc1-7c0ad63ea7df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:00.724897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f254b968-0c99-4331-8cc1-7c0ad63ea7df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:00.725394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f254b968-0c99-4331-8cc1-7c0ad63ea7df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:00.726147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f254b968-0c99-4331-8cc1-7c0ad63ea7df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:00.726633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f254b968-0c99-4331-8cc1-7c0ad63ea7df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:00.727086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f254b968-0c99-4331-8cc1-7c0ad63ea7df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:00.992436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f254b968-0c99-4331-8cc1-7c0ad63ea7df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:01.004352 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f254b968-0c99-4331-8cc1-7c0ad63ea7df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1682 microversion: 2.1 time: 0.291779 Aug 29 16:23:01.005149 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3907/7588] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:00 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1682 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:02.030447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d90dc7da-b9e4-4cb5-9961-ef55db8bdb77 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:02.031182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d90dc7da-b9e4-4cb5-9961-ef55db8bdb77 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:02.039782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d90dc7da-b9e4-4cb5-9961-ef55db8bdb77 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:02.040366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d90dc7da-b9e4-4cb5-9961-ef55db8bdb77 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:02.040891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d90dc7da-b9e4-4cb5-9961-ef55db8bdb77 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:02.041771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d90dc7da-b9e4-4cb5-9961-ef55db8bdb77 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:02.042324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d90dc7da-b9e4-4cb5-9961-ef55db8bdb77 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:02.042840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d90dc7da-b9e4-4cb5-9961-ef55db8bdb77 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:02.190248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d90dc7da-b9e4-4cb5-9961-ef55db8bdb77 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:02.198494 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d90dc7da-b9e4-4cb5-9961-ef55db8bdb77 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1682 microversion: 2.1 time: 0.173388 Aug 29 16:23:02.199044 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3682/7589] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:02 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:03.220119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d1513b37-845c-42f6-8cc9-a66b2e25460b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:03.220722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d1513b37-845c-42f6-8cc9-a66b2e25460b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:03.227971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1513b37-845c-42f6-8cc9-a66b2e25460b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:03.228483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1513b37-845c-42f6-8cc9-a66b2e25460b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:03.228938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1513b37-845c-42f6-8cc9-a66b2e25460b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:03.229713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1513b37-845c-42f6-8cc9-a66b2e25460b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:03.230226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1513b37-845c-42f6-8cc9-a66b2e25460b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:03.230687 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1513b37-845c-42f6-8cc9-a66b2e25460b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:03.367524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d1513b37-845c-42f6-8cc9-a66b2e25460b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:03.375874 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d1513b37-845c-42f6-8cc9-a66b2e25460b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1682 microversion: 2.1 time: 0.160026 Aug 29 16:23:03.376478 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3908/7590] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:03 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:04.401626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5df8b5ae-427c-497f-81e3-2d5e4cc6ad7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:04.402637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5df8b5ae-427c-497f-81e3-2d5e4cc6ad7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:04.410362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5df8b5ae-427c-497f-81e3-2d5e4cc6ad7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:04.410849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5df8b5ae-427c-497f-81e3-2d5e4cc6ad7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:04.411292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5df8b5ae-427c-497f-81e3-2d5e4cc6ad7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:04.411992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5df8b5ae-427c-497f-81e3-2d5e4cc6ad7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:04.412450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5df8b5ae-427c-497f-81e3-2d5e4cc6ad7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:04.412878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5df8b5ae-427c-497f-81e3-2d5e4cc6ad7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:04.553570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5df8b5ae-427c-497f-81e3-2d5e4cc6ad7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:04.562174 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5df8b5ae-427c-497f-81e3-2d5e4cc6ad7f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1682 microversion: 2.1 time: 0.167327 Aug 29 16:23:04.562772 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3683/7591] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:04 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:05.587737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-78a5f3ac-ae4f-4972-a2d6-560d4330c2a3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:05.588826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-78a5f3ac-ae4f-4972-a2d6-560d4330c2a3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:05.601381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a5f3ac-ae4f-4972-a2d6-560d4330c2a3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:05.602194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a5f3ac-ae4f-4972-a2d6-560d4330c2a3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:05.602671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a5f3ac-ae4f-4972-a2d6-560d4330c2a3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:05.603382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a5f3ac-ae4f-4972-a2d6-560d4330c2a3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:05.603859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a5f3ac-ae4f-4972-a2d6-560d4330c2a3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:05.604301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78a5f3ac-ae4f-4972-a2d6-560d4330c2a3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:05.756326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-78a5f3ac-ae4f-4972-a2d6-560d4330c2a3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:05.765222 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-78a5f3ac-ae4f-4972-a2d6-560d4330c2a3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1682 microversion: 2.1 time: 0.184352 Aug 29 16:23:05.765812 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3909/7592] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:05 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:06.791161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-245b30cb-4817-499c-93cf-c8703916a35a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:06.792228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-245b30cb-4817-499c-93cf-c8703916a35a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:06.803684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-245b30cb-4817-499c-93cf-c8703916a35a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:06.804508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-245b30cb-4817-499c-93cf-c8703916a35a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:06.805245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-245b30cb-4817-499c-93cf-c8703916a35a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:06.805954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-245b30cb-4817-499c-93cf-c8703916a35a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:06.806414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-245b30cb-4817-499c-93cf-c8703916a35a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:06.806847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-245b30cb-4817-499c-93cf-c8703916a35a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:06.946036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-245b30cb-4817-499c-93cf-c8703916a35a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:06.954593 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-245b30cb-4817-499c-93cf-c8703916a35a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1682 microversion: 2.1 time: 0.170242 Aug 29 16:23:06.955163 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3684/7593] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:06 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:07.981057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c9f5da56-3a78-4a8a-be63-6258602921ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:07.982153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c9f5da56-3a78-4a8a-be63-6258602921ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:07.994181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9f5da56-3a78-4a8a-be63-6258602921ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:07.994698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9f5da56-3a78-4a8a-be63-6258602921ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:07.995160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9f5da56-3a78-4a8a-be63-6258602921ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:07.995889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9f5da56-3a78-4a8a-be63-6258602921ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:07.996362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9f5da56-3a78-4a8a-be63-6258602921ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:07.996809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9f5da56-3a78-4a8a-be63-6258602921ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:08.132823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c9f5da56-3a78-4a8a-be63-6258602921ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:08.141192 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c9f5da56-3a78-4a8a-be63-6258602921ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1682 microversion: 2.1 time: 0.166846 Aug 29 16:23:08.141748 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3910/7594] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:07 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:09.168338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c1d46a7b-8ed8-433e-9d27-4eb3c0b95c78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:09.168945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c1d46a7b-8ed8-433e-9d27-4eb3c0b95c78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:09.175760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1d46a7b-8ed8-433e-9d27-4eb3c0b95c78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:09.176253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1d46a7b-8ed8-433e-9d27-4eb3c0b95c78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:09.176676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1d46a7b-8ed8-433e-9d27-4eb3c0b95c78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:09.177404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1d46a7b-8ed8-433e-9d27-4eb3c0b95c78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:09.177871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1d46a7b-8ed8-433e-9d27-4eb3c0b95c78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:09.178296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1d46a7b-8ed8-433e-9d27-4eb3c0b95c78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:09.364410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c1d46a7b-8ed8-433e-9d27-4eb3c0b95c78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:09.373141 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c1d46a7b-8ed8-433e-9d27-4eb3c0b95c78 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1682 microversion: 2.1 time: 0.210277 Aug 29 16:23:09.374007 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3685/7595] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:09 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1682 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:10.211143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-5e50c295-0ea7-4a44-8cfb-dc8823431419 req-ec90ac74-0d73-4082-b577-01e1536e93cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d81fbbfc-83ef-4f12-8fb2-821092dd4367", "name": "network-vif-unplugged", "status": "completed", "tag": "cd309788-59cc-48cd-9e13-e4c5d49f57c9"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:10.223497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5e50c295-0ea7-4a44-8cfb-dc8823431419 req-ec90ac74-0d73-4082-b577-01e1536e93cf service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:10.223497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5e50c295-0ea7-4a44-8cfb-dc8823431419 req-ec90ac74-0d73-4082-b577-01e1536e93cf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:10.223497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5e50c295-0ea7-4a44-8cfb-dc8823431419 req-ec90ac74-0d73-4082-b577-01e1536e93cf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:10.235499 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-5e50c295-0ea7-4a44-8cfb-dc8823431419 req-ec90ac74-0d73-4082-b577-01e1536e93cf service nova] Creating event network-vif-unplugged:cd309788-59cc-48cd-9e13-e4c5d49f57c9 for instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 on n-h2-839401-11 Aug 29 16:23:10.241216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-5e50c295-0ea7-4a44-8cfb-dc8823431419 req-ec90ac74-0d73-4082-b577-01e1536e93cf service nova] Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:23:10.252368 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-5e50c295-0ea7-4a44-8cfb-dc8823431419 req-ec90ac74-0d73-4082-b577-01e1536e93cf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103100 Aug 29 16:23:10.253033 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3911/7596] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:23:10.395967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aeb12aa9-18ae-43b3-953d-bef837799fe1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:10.396721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aeb12aa9-18ae-43b3-953d-bef837799fe1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:10.404410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aeb12aa9-18ae-43b3-953d-bef837799fe1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:10.404914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aeb12aa9-18ae-43b3-953d-bef837799fe1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:10.405391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aeb12aa9-18ae-43b3-953d-bef837799fe1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:10.406112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aeb12aa9-18ae-43b3-953d-bef837799fe1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:10.406598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aeb12aa9-18ae-43b3-953d-bef837799fe1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:10.406999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aeb12aa9-18ae-43b3-953d-bef837799fe1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:10.650297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aeb12aa9-18ae-43b3-953d-bef837799fe1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:10.668647 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aeb12aa9-18ae-43b3-953d-bef837799fe1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1681 microversion: 2.1 time: 0.277041 Aug 29 16:23:10.683963 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3686/7597] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:10 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1681 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:11.693129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-063ce9cd-50a1-4c0c-8df4-2251ec0ba06b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:11.693947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-063ce9cd-50a1-4c0c-8df4-2251ec0ba06b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:11.701422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063ce9cd-50a1-4c0c-8df4-2251ec0ba06b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:11.701934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063ce9cd-50a1-4c0c-8df4-2251ec0ba06b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:11.702577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063ce9cd-50a1-4c0c-8df4-2251ec0ba06b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:11.703131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063ce9cd-50a1-4c0c-8df4-2251ec0ba06b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:11.703610 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063ce9cd-50a1-4c0c-8df4-2251ec0ba06b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:11.704037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-063ce9cd-50a1-4c0c-8df4-2251ec0ba06b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:11.848669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-063ce9cd-50a1-4c0c-8df4-2251ec0ba06b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:11.857076 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-063ce9cd-50a1-4c0c-8df4-2251ec0ba06b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1679 microversion: 2.1 time: 0.169218 Aug 29 16:23:11.857713 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3912/7598] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:11 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:12.300645 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-1581edcb-64ef-4d17-8841-7404933c7634 req-0010ab64-4639-433c-8be4-45f255d0d135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d81fbbfc-83ef-4f12-8fb2-821092dd4367", "tag": "cd309788-59cc-48cd-9e13-e4c5d49f57c9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:12.313887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1581edcb-64ef-4d17-8841-7404933c7634 req-0010ab64-4639-433c-8be4-45f255d0d135 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:12.314486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1581edcb-64ef-4d17-8841-7404933c7634 req-0010ab64-4639-433c-8be4-45f255d0d135 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:12.315026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1581edcb-64ef-4d17-8841-7404933c7634 req-0010ab64-4639-433c-8be4-45f255d0d135 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:12.328884 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-1581edcb-64ef-4d17-8841-7404933c7634 req-0010ab64-4639-433c-8be4-45f255d0d135 service nova] Creating event network-changed:cd309788-59cc-48cd-9e13-e4c5d49f57c9 for instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 on n-h2-839401-11 Aug 29 16:23:12.341543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-1581edcb-64ef-4d17-8841-7404933c7634 req-0010ab64-4639-433c-8be4-45f255d0d135 service nova] Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:23:12.353730 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-1581edcb-64ef-4d17-8841-7404933c7634 req-0010ab64-4639-433c-8be4-45f255d0d135 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057783 Aug 29 16:23:12.354398 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3687/7599] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:12.878885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-833b12b0-2590-43b9-834f-ded36311853c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:12.879633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-833b12b0-2590-43b9-834f-ded36311853c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:12.887558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-833b12b0-2590-43b9-834f-ded36311853c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:12.888142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-833b12b0-2590-43b9-834f-ded36311853c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:12.888655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-833b12b0-2590-43b9-834f-ded36311853c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:12.889448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-833b12b0-2590-43b9-834f-ded36311853c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:12.890010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-833b12b0-2590-43b9-834f-ded36311853c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:12.890526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-833b12b0-2590-43b9-834f-ded36311853c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:13.031459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-833b12b0-2590-43b9-834f-ded36311853c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:13.039612 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-833b12b0-2590-43b9-834f-ded36311853c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1679 microversion: 2.1 time: 0.164738 Aug 29 16:23:13.040227 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3913/7600] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:12 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:14.063083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b582e8d4-9621-4b29-b59d-6ea4b4cef3f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:14.063774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b582e8d4-9621-4b29-b59d-6ea4b4cef3f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:14.070266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b582e8d4-9621-4b29-b59d-6ea4b4cef3f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:14.070745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b582e8d4-9621-4b29-b59d-6ea4b4cef3f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:14.071174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b582e8d4-9621-4b29-b59d-6ea4b4cef3f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:14.071863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b582e8d4-9621-4b29-b59d-6ea4b4cef3f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:14.072311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b582e8d4-9621-4b29-b59d-6ea4b4cef3f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:14.072731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b582e8d4-9621-4b29-b59d-6ea4b4cef3f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:14.254870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b582e8d4-9621-4b29-b59d-6ea4b4cef3f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:14.263827 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b582e8d4-9621-4b29-b59d-6ea4b4cef3f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1679 microversion: 2.1 time: 0.206058 Aug 29 16:23:14.264422 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3688/7601] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:14 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1679 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:15.290474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a57f0b2f-563c-457b-9ff7-98f691365ea9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:15.291509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a57f0b2f-563c-457b-9ff7-98f691365ea9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:15.299340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a57f0b2f-563c-457b-9ff7-98f691365ea9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:15.299851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a57f0b2f-563c-457b-9ff7-98f691365ea9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:15.300315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a57f0b2f-563c-457b-9ff7-98f691365ea9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:15.301020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a57f0b2f-563c-457b-9ff7-98f691365ea9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:15.301534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a57f0b2f-563c-457b-9ff7-98f691365ea9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:15.301955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a57f0b2f-563c-457b-9ff7-98f691365ea9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:15.454797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a57f0b2f-563c-457b-9ff7-98f691365ea9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:15.463827 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a57f0b2f-563c-457b-9ff7-98f691365ea9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1676 microversion: 2.1 time: 0.180040 Aug 29 16:23:15.464456 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3914/7602] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:15 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:15.487633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2a7db0a2-c4f7-4c08-a36e-49b4906165d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:15.488200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2a7db0a2-c4f7-4c08-a36e-49b4906165d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:15.497378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a7db0a2-c4f7-4c08-a36e-49b4906165d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:15.497870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a7db0a2-c4f7-4c08-a36e-49b4906165d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:15.498317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a7db0a2-c4f7-4c08-a36e-49b4906165d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:15.499046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a7db0a2-c4f7-4c08-a36e-49b4906165d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:15.499495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a7db0a2-c4f7-4c08-a36e-49b4906165d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:15.499927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a7db0a2-c4f7-4c08-a36e-49b4906165d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:15.571466 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2a7db0a2-c4f7-4c08-a36e-49b4906165d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "POST /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367/action" status: 204 len: 0 microversion: 2.1 time: 0.089656 Aug 29 16:23:15.572323 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3689/7603] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:23:15 2022] POST /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367/action => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:23:15.581191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-97d66671-7b8d-4084-8277-10605067519e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:15.581904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-97d66671-7b8d-4084-8277-10605067519e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:15.588375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97d66671-7b8d-4084-8277-10605067519e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:15.588866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97d66671-7b8d-4084-8277-10605067519e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:15.589409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97d66671-7b8d-4084-8277-10605067519e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:15.590131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97d66671-7b8d-4084-8277-10605067519e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:15.590582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97d66671-7b8d-4084-8277-10605067519e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:15.591039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-97d66671-7b8d-4084-8277-10605067519e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:15.728174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-97d66671-7b8d-4084-8277-10605067519e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:15.738972 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-97d66671-7b8d-4084-8277-10605067519e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1676 microversion: 2.1 time: 0.161759 Aug 29 16:23:15.739569 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3915/7604] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:15 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:16.761426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8d3e5317-da26-4637-90ae-2ae5cb116836 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:16.762322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8d3e5317-da26-4637-90ae-2ae5cb116836 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:16.769021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d3e5317-da26-4637-90ae-2ae5cb116836 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:16.769540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d3e5317-da26-4637-90ae-2ae5cb116836 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:16.770009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d3e5317-da26-4637-90ae-2ae5cb116836 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:16.770712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d3e5317-da26-4637-90ae-2ae5cb116836 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:16.771170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d3e5317-da26-4637-90ae-2ae5cb116836 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:16.771596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d3e5317-da26-4637-90ae-2ae5cb116836 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:16.912888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8d3e5317-da26-4637-90ae-2ae5cb116836 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:16.921216 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8d3e5317-da26-4637-90ae-2ae5cb116836 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1676 microversion: 2.1 time: 0.164939 Aug 29 16:23:16.921819 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3690/7605] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:16 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:17.947147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ea8fae98-fa52-4785-aae7-bd2d02f73e44 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:17.948234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ea8fae98-fa52-4785-aae7-bd2d02f73e44 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:17.960063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea8fae98-fa52-4785-aae7-bd2d02f73e44 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:17.960897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea8fae98-fa52-4785-aae7-bd2d02f73e44 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:17.961716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea8fae98-fa52-4785-aae7-bd2d02f73e44 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:17.962887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea8fae98-fa52-4785-aae7-bd2d02f73e44 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:17.963758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea8fae98-fa52-4785-aae7-bd2d02f73e44 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:17.964505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ea8fae98-fa52-4785-aae7-bd2d02f73e44 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:18.107952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ea8fae98-fa52-4785-aae7-bd2d02f73e44 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:18.116374 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ea8fae98-fa52-4785-aae7-bd2d02f73e44 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1668 microversion: 2.1 time: 0.175927 Aug 29 16:23:18.116965 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3916/7606] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:17 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1668 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:18.143722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c175dec6-ce35-4798-af6c-d34e0150b06e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:18.144329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c175dec6-ce35-4798-af6c-d34e0150b06e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:18.151726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c175dec6-ce35-4798-af6c-d34e0150b06e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:18.152231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c175dec6-ce35-4798-af6c-d34e0150b06e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:18.152680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c175dec6-ce35-4798-af6c-d34e0150b06e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:18.153415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c175dec6-ce35-4798-af6c-d34e0150b06e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:18.153881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c175dec6-ce35-4798-af6c-d34e0150b06e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:18.154318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c175dec6-ce35-4798-af6c-d34e0150b06e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:18.285353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c175dec6-ce35-4798-af6c-d34e0150b06e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:18.293582 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c175dec6-ce35-4798-af6c-d34e0150b06e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1668 microversion: 2.1 time: 0.153723 Aug 29 16:23:18.294169 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3691/7607] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:18 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:18.314048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e054b172-3493-4c3c-8a19-25f047a01c49 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:18.314674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e054b172-3493-4c3c-8a19-25f047a01c49 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:18.321339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e054b172-3493-4c3c-8a19-25f047a01c49 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:18.321841 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e054b172-3493-4c3c-8a19-25f047a01c49 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:18.322430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e054b172-3493-4c3c-8a19-25f047a01c49 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:18.323151 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e054b172-3493-4c3c-8a19-25f047a01c49 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:18.323615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e054b172-3493-4c3c-8a19-25f047a01c49 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:18.324047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e054b172-3493-4c3c-8a19-25f047a01c49 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:18.462002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e054b172-3493-4c3c-8a19-25f047a01c49 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:18.470337 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e054b172-3493-4c3c-8a19-25f047a01c49 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1668 microversion: 2.1 time: 0.160119 Aug 29 16:23:18.470890 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3917/7608] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:18 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:18.490943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-da90f003-d2ef-4958-8998-a6a9af0cb427 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:18.491442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-da90f003-d2ef-4958-8998-a6a9af0cb427 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:18.497833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da90f003-d2ef-4958-8998-a6a9af0cb427 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:18.498315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da90f003-d2ef-4958-8998-a6a9af0cb427 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:18.498752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da90f003-d2ef-4958-8998-a6a9af0cb427 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:18.499442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da90f003-d2ef-4958-8998-a6a9af0cb427 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:18.499896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da90f003-d2ef-4958-8998-a6a9af0cb427 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:18.500315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da90f003-d2ef-4958-8998-a6a9af0cb427 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:18.531053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-da90f003-d2ef-4958-8998-a6a9af0cb427 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:23:18.533032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:18.620273 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-da90f003-d2ef-4958-8998-a6a9af0cb427 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 204 len: 0 microversion: 2.1 time: 0.132951 Aug 29 16:23:18.621293 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3692/7609] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:23:18 2022] DELETE /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:23:18.629965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4106db97-f08d-4db7-a86a-60e2e9db486e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:18.630611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4106db97-f08d-4db7-a86a-60e2e9db486e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:18.636904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4106db97-f08d-4db7-a86a-60e2e9db486e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:18.637471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4106db97-f08d-4db7-a86a-60e2e9db486e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:18.637924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4106db97-f08d-4db7-a86a-60e2e9db486e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:18.638662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4106db97-f08d-4db7-a86a-60e2e9db486e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:18.639138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4106db97-f08d-4db7-a86a-60e2e9db486e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:18.639578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4106db97-f08d-4db7-a86a-60e2e9db486e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:18.659129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:18.688332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-7ea3ca6b-98a7-4b69-9595-36ec83096754 req-c57eb0dd-0d7c-4225-a5c8-c36c44ce9388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d81fbbfc-83ef-4f12-8fb2-821092dd4367", "name": "network-vif-plugged", "status": "completed", "tag": "cd309788-59cc-48cd-9e13-e4c5d49f57c9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:18.698138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7ea3ca6b-98a7-4b69-9595-36ec83096754 req-c57eb0dd-0d7c-4225-a5c8-c36c44ce9388 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:18.698663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7ea3ca6b-98a7-4b69-9595-36ec83096754 req-c57eb0dd-0d7c-4225-a5c8-c36c44ce9388 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:18.699244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7ea3ca6b-98a7-4b69-9595-36ec83096754 req-c57eb0dd-0d7c-4225-a5c8-c36c44ce9388 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:18.712030 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-7ea3ca6b-98a7-4b69-9595-36ec83096754 req-c57eb0dd-0d7c-4225-a5c8-c36c44ce9388 service nova] Creating event network-vif-plugged:cd309788-59cc-48cd-9e13-e4c5d49f57c9 for instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 on n-h2-839401-11 Aug 29 16:23:18.717258 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-7ea3ca6b-98a7-4b69-9595-36ec83096754 req-c57eb0dd-0d7c-4225-a5c8-c36c44ce9388 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033580 Aug 29 16:23:18.717871 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3693/7610] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:23:18.784810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4106db97-f08d-4db7-a86a-60e2e9db486e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:18.793076 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4106db97-f08d-4db7-a86a-60e2e9db486e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1674 microversion: 2.1 time: 0.167452 Aug 29 16:23:18.793804 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3918/7611] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:18 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:19.816428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a829db15-68c8-4135-98b0-6625098a1cc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:19.817104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a829db15-68c8-4135-98b0-6625098a1cc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:19.823924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a829db15-68c8-4135-98b0-6625098a1cc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.824416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a829db15-68c8-4135-98b0-6625098a1cc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.824850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a829db15-68c8-4135-98b0-6625098a1cc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.825569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a829db15-68c8-4135-98b0-6625098a1cc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:19.826023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a829db15-68c8-4135-98b0-6625098a1cc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:19.826487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a829db15-68c8-4135-98b0-6625098a1cc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:19.968624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a829db15-68c8-4135-98b0-6625098a1cc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:19.977621 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a829db15-68c8-4135-98b0-6625098a1cc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1674 microversion: 2.1 time: 0.166480 Aug 29 16:23:19.978211 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3694/7612] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:19 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:20.999277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-80955b80-4d42-4dcf-b366-3f05bc582004 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:20.999848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-80955b80-4d42-4dcf-b366-3f05bc582004 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:21.007043 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80955b80-4d42-4dcf-b366-3f05bc582004 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:21.007549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80955b80-4d42-4dcf-b366-3f05bc582004 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:21.007992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80955b80-4d42-4dcf-b366-3f05bc582004 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:21.008695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80955b80-4d42-4dcf-b366-3f05bc582004 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:21.009337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80955b80-4d42-4dcf-b366-3f05bc582004 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:21.009962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80955b80-4d42-4dcf-b366-3f05bc582004 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:21.148828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-80955b80-4d42-4dcf-b366-3f05bc582004 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:21.157503 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-80955b80-4d42-4dcf-b366-3f05bc582004 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 200 len: 1674 microversion: 2.1 time: 0.162341 Aug 29 16:23:21.169154 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3919/7613] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:20 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:21.421982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d6cd4444-a7cb-4330-a9eb-34d3f191473c req-8e73ab5d-14ab-483b-a528-6a0060083d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d81fbbfc-83ef-4f12-8fb2-821092dd4367", "name": "network-vif-deleted", "tag": "cd309788-59cc-48cd-9e13-e4c5d49f57c9"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:21.434389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d6cd4444-a7cb-4330-a9eb-34d3f191473c req-8e73ab5d-14ab-483b-a528-6a0060083d8d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:21.434919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d6cd4444-a7cb-4330-a9eb-34d3f191473c req-8e73ab5d-14ab-483b-a528-6a0060083d8d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:21.435350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d6cd4444-a7cb-4330-a9eb-34d3f191473c req-8e73ab5d-14ab-483b-a528-6a0060083d8d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:21.457692 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d6cd4444-a7cb-4330-a9eb-34d3f191473c req-8e73ab5d-14ab-483b-a528-6a0060083d8d service nova] Creating event network-vif-deleted:cd309788-59cc-48cd-9e13-e4c5d49f57c9 for instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 on n-h2-839401-11 Aug 29 16:23:21.463851 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d6cd4444-a7cb-4330-a9eb-34d3f191473c req-8e73ab5d-14ab-483b-a528-6a0060083d8d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045829 Aug 29 16:23:21.465344 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3695/7614] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:22.179629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-474f3a9a-fab4-46b5-8e1e-36b51e0dffe4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:22.180378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-474f3a9a-fab4-46b5-8e1e-36b51e0dffe4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:22.188297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-474f3a9a-fab4-46b5-8e1e-36b51e0dffe4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:22.188814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-474f3a9a-fab4-46b5-8e1e-36b51e0dffe4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:22.189306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-474f3a9a-fab4-46b5-8e1e-36b51e0dffe4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:22.190105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-474f3a9a-fab4-46b5-8e1e-36b51e0dffe4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:22.190585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-474f3a9a-fab4-46b5-8e1e-36b51e0dffe4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:22.191033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-474f3a9a-fab4-46b5-8e1e-36b51e0dffe4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:22.208372 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-474f3a9a-fab4-46b5-8e1e-36b51e0dffe4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] HTTP exception thrown: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-474f3a9a-fab4-46b5-8e1e-36b51e0dffe4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Request method failure captured: Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 HTTP/1.1 Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOeCmxszHic3fR-dD_FiVESHdRYratk0u2UW9FXU2W3acquSUUlqZBMx4K0KtqOALAZPC24K6LNbNevDXRbYlme3cOp5pFNwEiKyAZ1t4P951EcRw9FjJ4SV_PAxR4V5iAAz1_B-GZ6uA0zFPfIDeLmTpv-TVgqY352WqC50xTbg0HI Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a3432e106e74db480a1f7a17af514fb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}] Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerActionsTestJSON-546053265 Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6658968475ea487ea0aba9be50d861fe Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'd81fbbfc-83ef-4f12-8fb2-821092dd4367'} Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:22.210146 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:23:22.214355 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:22.214355 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:22.214355 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:22.214355 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:22.214355 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:22.214355 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:23:22.214355 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:23:22.214355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-474f3a9a-fab4-46b5-8e1e-36b51e0dffe4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Returning 404 to user: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:22.214355 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-474f3a9a-fab4-46b5-8e1e-36b51e0dffe4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 404 len: 111 microversion: 2.1 time: 0.036092 Aug 29 16:23:22.214355 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3920/7615] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:22 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:22.227721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-def6057b-9cee-4c2a-b95d-3508ca805fa4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:22.228448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-def6057b-9cee-4c2a-b95d-3508ca805fa4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:22.235374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def6057b-9cee-4c2a-b95d-3508ca805fa4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:22.235878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def6057b-9cee-4c2a-b95d-3508ca805fa4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:22.236314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def6057b-9cee-4c2a-b95d-3508ca805fa4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:22.237026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def6057b-9cee-4c2a-b95d-3508ca805fa4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:22.237513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def6057b-9cee-4c2a-b95d-3508ca805fa4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:22.237944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-def6057b-9cee-4c2a-b95d-3508ca805fa4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:22.252671 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-def6057b-9cee-4c2a-b95d-3508ca805fa4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] HTTP exception thrown: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-def6057b-9cee-4c2a-b95d-3508ca805fa4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Request method failure captured: Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 HTTP/1.1 Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOeCmxszHic3fR-dD_FiVESHdRYratk0u2UW9FXU2W3acquSUUlqZBMx4K0KtqOALAZPC24K6LNbNevDXRbYlme3cOp5pFNwEiKyAZ1t4P951EcRw9FjJ4SV_PAxR4V5iAAz1_B-GZ6uA0zFPfIDeLmTpv-TVgqY352WqC50xTbg0HI Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a3432e106e74db480a1f7a17af514fb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}] Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerActionsTestJSON-546053265 Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6658968475ea487ea0aba9be50d861fe Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'd81fbbfc-83ef-4f12-8fb2-821092dd4367'} Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:22.254470 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:23:22.259423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:22.259423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:22.259423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:22.259423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:22.259423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:22.259423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:23:22.259423 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:23:22.259423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-def6057b-9cee-4c2a-b95d-3508ca805fa4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Returning 404 to user: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:22.259423 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-def6057b-9cee-4c2a-b95d-3508ca805fa4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 404 len: 111 microversion: 2.1 time: 0.032503 Aug 29 16:23:22.259423 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3696/7616] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:22 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:22.310711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1958254370", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "827789af-a96a-4564-a015-c53c7c9ca929"}], "security_groups": [{"name": "tempest-securitygroup--825674519"}], "key_name": "tempest-keypair-1856537733", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:22.417320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] validate_networks() for [('827789af-a96a-4564-a015-c53c7c9ca929', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:23:22.869594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:23:22.870034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:23:22.870526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:23:22.870980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:23:22.871410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:23:22.881332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:22.881849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:22.882304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:22.883045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:22.883520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:22.883964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:22.901447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Getting quotas for project 1a3432e106e74db480a1f7a17af514fb. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:23:22.906804 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Getting quotas for user 6658968475ea487ea0aba9be50d861fe and project 1a3432e106e74db480a1f7a17af514fb. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:23:22.920201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:23:22.922699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:23:22.977001 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9466b510-db5c-40fa-8699-3bbb0f0eb7b9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.670290 Aug 29 16:23:22.977697 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3921/7617] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:23:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:23:22.988984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a73a0288-2aa1-4e36-86a5-73a70d068cc7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:22.989704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a73a0288-2aa1-4e36-86a5-73a70d068cc7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:23.051896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a73a0288-2aa1-4e36-86a5-73a70d068cc7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:23.060105 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a73a0288-2aa1-4e36-86a5-73a70d068cc7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1239 microversion: 2.1 time: 0.075138 Aug 29 16:23:23.060792 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3697/7618] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:22 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:24.082698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9b1e3a3d-35d7-4089-80b1-8f369498b34b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:24.083340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9b1e3a3d-35d7-4089-80b1-8f369498b34b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:24.089861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b1e3a3d-35d7-4089-80b1-8f369498b34b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:24.090394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b1e3a3d-35d7-4089-80b1-8f369498b34b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:24.090910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b1e3a3d-35d7-4089-80b1-8f369498b34b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:24.091630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b1e3a3d-35d7-4089-80b1-8f369498b34b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:24.092176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b1e3a3d-35d7-4089-80b1-8f369498b34b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:24.092724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b1e3a3d-35d7-4089-80b1-8f369498b34b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:24.164222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9b1e3a3d-35d7-4089-80b1-8f369498b34b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:24.173308 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9b1e3a3d-35d7-4089-80b1-8f369498b34b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1299 microversion: 2.1 time: 0.095444 Aug 29 16:23:24.173916 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3922/7619] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:24 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:25.195300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ac8fe19d-1b3c-47f4-a505-6640025b78a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:25.195880 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ac8fe19d-1b3c-47f4-a505-6640025b78a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:25.198794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:25.204268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac8fe19d-1b3c-47f4-a505-6640025b78a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:25.204788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac8fe19d-1b3c-47f4-a505-6640025b78a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:25.205252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac8fe19d-1b3c-47f4-a505-6640025b78a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:25.205964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac8fe19d-1b3c-47f4-a505-6640025b78a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:25.206407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac8fe19d-1b3c-47f4-a505-6640025b78a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:25.207029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac8fe19d-1b3c-47f4-a505-6640025b78a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:25.437820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ac8fe19d-1b3c-47f4-a505-6640025b78a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:25.450363 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ac8fe19d-1b3c-47f4-a505-6640025b78a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1364 microversion: 2.1 time: 0.259102 Aug 29 16:23:25.450993 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3698/7620] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:25 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:25.605006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-d021349e-fc91-4179-a7ec-a34f6f440710 req-3d6c87fe-7a77-4449-bd24-528708d55a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b30609c4-2104-4b7a-ba81-6746b4353dd1", "tag": "d1bcfcdb-8db4-4c16-8c73-c1cf694fbf95"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:25.611412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:25.619586 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d021349e-fc91-4179-a7ec-a34f6f440710 req-3d6c87fe-7a77-4449-bd24-528708d55a94 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:25.620099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d021349e-fc91-4179-a7ec-a34f6f440710 req-3d6c87fe-7a77-4449-bd24-528708d55a94 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:25.620541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d021349e-fc91-4179-a7ec-a34f6f440710 req-3d6c87fe-7a77-4449-bd24-528708d55a94 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:25.633039 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-d021349e-fc91-4179-a7ec-a34f6f440710 req-3d6c87fe-7a77-4449-bd24-528708d55a94 service nova] Creating event network-changed:d1bcfcdb-8db4-4c16-8c73-c1cf694fbf95 for instance b30609c4-2104-4b7a-ba81-6746b4353dd1 on n-h1-839401-11 Aug 29 16:23:25.638368 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-d021349e-fc91-4179-a7ec-a34f6f440710 req-3d6c87fe-7a77-4449-bd24-528708d55a94 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038151 Aug 29 16:23:25.640113 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3923/7621] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:23:26.477210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5de663e1-4812-4b38-a776-89574332fc9f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:26.478479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5de663e1-4812-4b38-a776-89574332fc9f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:26.488543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5de663e1-4812-4b38-a776-89574332fc9f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:26.489008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5de663e1-4812-4b38-a776-89574332fc9f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:26.489484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5de663e1-4812-4b38-a776-89574332fc9f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:26.490199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5de663e1-4812-4b38-a776-89574332fc9f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:26.490660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5de663e1-4812-4b38-a776-89574332fc9f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:26.491091 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5de663e1-4812-4b38-a776-89574332fc9f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:26.622434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5de663e1-4812-4b38-a776-89574332fc9f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:26.632055 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5de663e1-4812-4b38-a776-89574332fc9f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1364 microversion: 2.1 time: 0.160589 Aug 29 16:23:26.632055 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3699/7622] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:26 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:27.658066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9ba83488-7f1d-46f0-a781-c74fb02e8127 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:27.659254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9ba83488-7f1d-46f0-a781-c74fb02e8127 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:27.670242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ba83488-7f1d-46f0-a781-c74fb02e8127 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:27.671075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ba83488-7f1d-46f0-a781-c74fb02e8127 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:27.671832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ba83488-7f1d-46f0-a781-c74fb02e8127 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:27.673122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ba83488-7f1d-46f0-a781-c74fb02e8127 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:27.673615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ba83488-7f1d-46f0-a781-c74fb02e8127 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:27.674061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9ba83488-7f1d-46f0-a781-c74fb02e8127 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:27.823450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9ba83488-7f1d-46f0-a781-c74fb02e8127 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:27.834622 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9ba83488-7f1d-46f0-a781-c74fb02e8127 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1364 microversion: 2.1 time: 0.185116 Aug 29 16:23:27.835438 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3924/7623] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:27 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:28.862339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ab6e200b-5b5d-4357-b893-b508d173304c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:28.862962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ab6e200b-5b5d-4357-b893-b508d173304c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:28.870476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab6e200b-5b5d-4357-b893-b508d173304c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:28.870901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab6e200b-5b5d-4357-b893-b508d173304c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:28.871339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab6e200b-5b5d-4357-b893-b508d173304c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:28.872045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab6e200b-5b5d-4357-b893-b508d173304c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:28.872503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab6e200b-5b5d-4357-b893-b508d173304c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:28.872936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab6e200b-5b5d-4357-b893-b508d173304c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:29.013067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ab6e200b-5b5d-4357-b893-b508d173304c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:29.025685 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ab6e200b-5b5d-4357-b893-b508d173304c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1364 microversion: 2.1 time: 0.167019 Aug 29 16:23:29.026717 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3700/7624] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:28 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:23:30.059305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0beb9913-9497-41f2-aad1-bc483dfbefba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:30.060358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0beb9913-9497-41f2-aad1-bc483dfbefba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:30.072502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0beb9913-9497-41f2-aad1-bc483dfbefba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:30.073421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0beb9913-9497-41f2-aad1-bc483dfbefba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:30.074473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0beb9913-9497-41f2-aad1-bc483dfbefba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:30.077884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0beb9913-9497-41f2-aad1-bc483dfbefba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:30.078799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0beb9913-9497-41f2-aad1-bc483dfbefba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:30.079617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0beb9913-9497-41f2-aad1-bc483dfbefba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:30.226452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0beb9913-9497-41f2-aad1-bc483dfbefba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:30.237669 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0beb9913-9497-41f2-aad1-bc483dfbefba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1364 microversion: 2.1 time: 0.190107 Aug 29 16:23:30.238256 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3925/7625] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:30 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:31.259399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cd8fc56e-6992-4b88-84de-c226a15436d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:31.260003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cd8fc56e-6992-4b88-84de-c226a15436d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:31.267205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd8fc56e-6992-4b88-84de-c226a15436d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:31.267689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd8fc56e-6992-4b88-84de-c226a15436d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:31.268117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd8fc56e-6992-4b88-84de-c226a15436d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:31.268814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd8fc56e-6992-4b88-84de-c226a15436d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:31.269325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd8fc56e-6992-4b88-84de-c226a15436d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:31.269749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cd8fc56e-6992-4b88-84de-c226a15436d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:31.405587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cd8fc56e-6992-4b88-84de-c226a15436d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:31.414527 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cd8fc56e-6992-4b88-84de-c226a15436d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1364 microversion: 2.1 time: 0.159231 Aug 29 16:23:31.427902 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3701/7626] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:31 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:32.440352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8d41dbd6-7a99-4414-8d4f-852a59e63392 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:32.441454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8d41dbd6-7a99-4414-8d4f-852a59e63392 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:32.448894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d41dbd6-7a99-4414-8d4f-852a59e63392 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:32.449439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d41dbd6-7a99-4414-8d4f-852a59e63392 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:32.449898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d41dbd6-7a99-4414-8d4f-852a59e63392 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:32.450622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d41dbd6-7a99-4414-8d4f-852a59e63392 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:32.451119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d41dbd6-7a99-4414-8d4f-852a59e63392 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:32.451564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8d41dbd6-7a99-4414-8d4f-852a59e63392 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:32.593368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8d41dbd6-7a99-4414-8d4f-852a59e63392 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:32.602057 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8d41dbd6-7a99-4414-8d4f-852a59e63392 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1364 microversion: 2.1 time: 0.168722 Aug 29 16:23:32.602644 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3926/7627] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:32 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:33.589244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:33.623778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e3c232ac-2f69-4298-a494-3b0b536d401f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:33.624412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e3c232ac-2f69-4298-a494-3b0b536d401f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:33.626477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:33.627638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:33.634877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3c232ac-2f69-4298-a494-3b0b536d401f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:33.635446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3c232ac-2f69-4298-a494-3b0b536d401f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:33.635944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3c232ac-2f69-4298-a494-3b0b536d401f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:33.636663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3c232ac-2f69-4298-a494-3b0b536d401f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:33.637154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3c232ac-2f69-4298-a494-3b0b536d401f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:33.637590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3c232ac-2f69-4298-a494-3b0b536d401f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:33.645342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-8da6295a-0463-4914-a623-7b72bfd5ebf4 req-c7450c18-c9fd-4873-91d6-8d4d261ee16c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30609c4-2104-4b7a-ba81-6746b4353dd1", "name": "network-vif-plugged", "status": "completed", "tag": "d1bcfcdb-8db4-4c16-8c73-c1cf694fbf95"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:33.655784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8da6295a-0463-4914-a623-7b72bfd5ebf4 req-c7450c18-c9fd-4873-91d6-8d4d261ee16c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:33.656272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8da6295a-0463-4914-a623-7b72bfd5ebf4 req-c7450c18-c9fd-4873-91d6-8d4d261ee16c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:33.656706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8da6295a-0463-4914-a623-7b72bfd5ebf4 req-c7450c18-c9fd-4873-91d6-8d4d261ee16c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:33.667999 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-8da6295a-0463-4914-a623-7b72bfd5ebf4 req-c7450c18-c9fd-4873-91d6-8d4d261ee16c service nova] Creating event network-vif-plugged:d1bcfcdb-8db4-4c16-8c73-c1cf694fbf95 for instance b30609c4-2104-4b7a-ba81-6746b4353dd1 on n-h1-839401-11 Aug 29 16:23:33.673545 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-8da6295a-0463-4914-a623-7b72bfd5ebf4 req-c7450c18-c9fd-4873-91d6-8d4d261ee16c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089686 Aug 29 16:23:33.674152 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3702/7628] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:33.783810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e3c232ac-2f69-4298-a494-3b0b536d401f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:33.792017 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e3c232ac-2f69-4298-a494-3b0b536d401f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1364 microversion: 2.1 time: 0.172230 Aug 29 16:23:33.792628 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3927/7629] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:33 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:23:34.818824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-87aa5d05-cfd3-4cef-8be1-80a9058a08ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:34.819529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-87aa5d05-cfd3-4cef-8be1-80a9058a08ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:34.826407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87aa5d05-cfd3-4cef-8be1-80a9058a08ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:34.826906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87aa5d05-cfd3-4cef-8be1-80a9058a08ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:34.827343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87aa5d05-cfd3-4cef-8be1-80a9058a08ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:34.828054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87aa5d05-cfd3-4cef-8be1-80a9058a08ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:34.828520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87aa5d05-cfd3-4cef-8be1-80a9058a08ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:34.828955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87aa5d05-cfd3-4cef-8be1-80a9058a08ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:34.972271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-87aa5d05-cfd3-4cef-8be1-80a9058a08ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:34.982618 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-87aa5d05-cfd3-4cef-8be1-80a9058a08ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1364 microversion: 2.1 time: 0.171558 Aug 29 16:23:34.983479 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3703/7630] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:34 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:36.015226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7331794b-cf79-4530-97a3-5c9e2f7a4331 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:36.016137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7331794b-cf79-4530-97a3-5c9e2f7a4331 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:36.024858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7331794b-cf79-4530-97a3-5c9e2f7a4331 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:36.025390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7331794b-cf79-4530-97a3-5c9e2f7a4331 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:36.025853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7331794b-cf79-4530-97a3-5c9e2f7a4331 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:36.026574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7331794b-cf79-4530-97a3-5c9e2f7a4331 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:36.027050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7331794b-cf79-4530-97a3-5c9e2f7a4331 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:36.027496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7331794b-cf79-4530-97a3-5c9e2f7a4331 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:36.169037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7331794b-cf79-4530-97a3-5c9e2f7a4331 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:36.177792 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7331794b-cf79-4530-97a3-5c9e2f7a4331 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1552 microversion: 2.1 time: 0.168984 Aug 29 16:23:36.178372 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3928/7631] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:36 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:36.199003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-242eb8a7-5ca5-4552-b1c7-3b125f3d29bd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:36.199650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-242eb8a7-5ca5-4552-b1c7-3b125f3d29bd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:36.209026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-242eb8a7-5ca5-4552-b1c7-3b125f3d29bd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:36.209557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-242eb8a7-5ca5-4552-b1c7-3b125f3d29bd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:36.209994 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-242eb8a7-5ca5-4552-b1c7-3b125f3d29bd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:36.210705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-242eb8a7-5ca5-4552-b1c7-3b125f3d29bd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:36.211161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-242eb8a7-5ca5-4552-b1c7-3b125f3d29bd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:36.211654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-242eb8a7-5ca5-4552-b1c7-3b125f3d29bd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:36.300852 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-242eb8a7-5ca5-4552-b1c7-3b125f3d29bd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105708 Aug 29 16:23:36.301508 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3704/7632] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 16:23:36 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:37.342664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e9ce2df1-1462-4cd0-b29e-5fc7c264713f req-08fd345d-c97f-47cd-a7db-fd63beb49ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b30609c4-2104-4b7a-ba81-6746b4353dd1", "tag": "d1bcfcdb-8db4-4c16-8c73-c1cf694fbf95"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:37.352901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e9ce2df1-1462-4cd0-b29e-5fc7c264713f req-08fd345d-c97f-47cd-a7db-fd63beb49ad0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:37.353439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e9ce2df1-1462-4cd0-b29e-5fc7c264713f req-08fd345d-c97f-47cd-a7db-fd63beb49ad0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:37.353880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e9ce2df1-1462-4cd0-b29e-5fc7c264713f req-08fd345d-c97f-47cd-a7db-fd63beb49ad0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:37.365616 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e9ce2df1-1462-4cd0-b29e-5fc7c264713f req-08fd345d-c97f-47cd-a7db-fd63beb49ad0 service nova] Creating event network-changed:d1bcfcdb-8db4-4c16-8c73-c1cf694fbf95 for instance b30609c4-2104-4b7a-ba81-6746b4353dd1 on n-h1-839401-11 Aug 29 16:23:37.371502 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e9ce2df1-1462-4cd0-b29e-5fc7c264713f req-08fd345d-c97f-47cd-a7db-fd63beb49ad0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092312 Aug 29 16:23:37.372355 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3929/7633] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:24:49.344243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=13 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:49.345805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:49.347580 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:24:49.347808 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 16:24:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1/action (ip 10.222.0.62) !!! Aug 29 16:24:49.349541 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:24:49.349758 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 16:24:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1/action (ip 10.222.0.62) !!! Aug 29 16:24:49.358980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a2986617-0857-409f-873a-7e7b547d1b6b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:24:49.371779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2986617-0857-409f-873a-7e7b547d1b6b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:49.372284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2986617-0857-409f-873a-7e7b547d1b6b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:49.372727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2986617-0857-409f-873a-7e7b547d1b6b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:49.399653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a2986617-0857-409f-873a-7e7b547d1b6b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Going to try to stop instance {{(pid=122361) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 16:24:49.447744 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a2986617-0857-409f-873a-7e7b547d1b6b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "POST /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1/action" status: 202 len: 0 microversion: 2.1 time: 0.107647 Aug 29 16:24:49.448464 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3705/7634] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:24:49 2022] POST /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:24:49.455942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=13 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:49.457425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=52 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:49.458573 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:24:49.458757 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:24:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 (ip 10.222.0.62) !!! Aug 29 16:24:49.465811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c12cf3c7-6a88-492c-b70f-119a47edf9b3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:49.466578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c12cf3c7-6a88-492c-b70f-119a47edf9b3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:49.480232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c12cf3c7-6a88-492c-b70f-119a47edf9b3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:49.480752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c12cf3c7-6a88-492c-b70f-119a47edf9b3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:49.481255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c12cf3c7-6a88-492c-b70f-119a47edf9b3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:49.482002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c12cf3c7-6a88-492c-b70f-119a47edf9b3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:49.482472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c12cf3c7-6a88-492c-b70f-119a47edf9b3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:49.483021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c12cf3c7-6a88-492c-b70f-119a47edf9b3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:49.629595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c12cf3c7-6a88-492c-b70f-119a47edf9b3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:49.638493 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c12cf3c7-6a88-492c-b70f-119a47edf9b3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1680 microversion: 2.1 time: 0.184948 Aug 29 16:24:49.639087 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3930/7635] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:49 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:50.663315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-03b0646e-101d-4650-a97b-435df86137a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:50.663991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-03b0646e-101d-4650-a97b-435df86137a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:50.672628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03b0646e-101d-4650-a97b-435df86137a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:50.673157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03b0646e-101d-4650-a97b-435df86137a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:50.673613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03b0646e-101d-4650-a97b-435df86137a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:50.674337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03b0646e-101d-4650-a97b-435df86137a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:50.674806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03b0646e-101d-4650-a97b-435df86137a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:50.675244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03b0646e-101d-4650-a97b-435df86137a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:50.825578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-03b0646e-101d-4650-a97b-435df86137a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:50.834348 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-03b0646e-101d-4650-a97b-435df86137a7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1680 microversion: 2.1 time: 0.176447 Aug 29 16:24:50.834967 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3706/7636] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:50 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:51.856313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bb31e308-b15d-4e5e-9709-248f51330472 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:51.856917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bb31e308-b15d-4e5e-9709-248f51330472 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:51.867542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb31e308-b15d-4e5e-9709-248f51330472 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:51.868046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb31e308-b15d-4e5e-9709-248f51330472 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:51.868507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb31e308-b15d-4e5e-9709-248f51330472 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:51.869267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb31e308-b15d-4e5e-9709-248f51330472 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:51.869740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb31e308-b15d-4e5e-9709-248f51330472 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:51.870187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bb31e308-b15d-4e5e-9709-248f51330472 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:52.009848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bb31e308-b15d-4e5e-9709-248f51330472 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:52.018165 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bb31e308-b15d-4e5e-9709-248f51330472 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1680 microversion: 2.1 time: 0.165910 Aug 29 16:24:52.018753 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3931/7637] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:51 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:53.039741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a64127f4-1f51-4832-b30f-c8dda1432eac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:53.040364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a64127f4-1f51-4832-b30f-c8dda1432eac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:53.047879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a64127f4-1f51-4832-b30f-c8dda1432eac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:53.048370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a64127f4-1f51-4832-b30f-c8dda1432eac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:53.048815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a64127f4-1f51-4832-b30f-c8dda1432eac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:53.049560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a64127f4-1f51-4832-b30f-c8dda1432eac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:53.050020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a64127f4-1f51-4832-b30f-c8dda1432eac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:53.050447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a64127f4-1f51-4832-b30f-c8dda1432eac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:53.185608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a64127f4-1f51-4832-b30f-c8dda1432eac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:53.193809 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a64127f4-1f51-4832-b30f-c8dda1432eac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1680 microversion: 2.1 time: 0.158001 Aug 29 16:24:53.194402 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3707/7638] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:53 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:54.217420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d9cbaf91-0f2a-4567-96c8-ac394e5ff64a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:54.217980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d9cbaf91-0f2a-4567-96c8-ac394e5ff64a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:54.226217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9cbaf91-0f2a-4567-96c8-ac394e5ff64a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:54.226818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9cbaf91-0f2a-4567-96c8-ac394e5ff64a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:54.227290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9cbaf91-0f2a-4567-96c8-ac394e5ff64a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:54.228001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9cbaf91-0f2a-4567-96c8-ac394e5ff64a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:54.228468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9cbaf91-0f2a-4567-96c8-ac394e5ff64a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:54.228903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d9cbaf91-0f2a-4567-96c8-ac394e5ff64a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:54.361470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d9cbaf91-0f2a-4567-96c8-ac394e5ff64a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:54.375918 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d9cbaf91-0f2a-4567-96c8-ac394e5ff64a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1680 microversion: 2.1 time: 0.163987 Aug 29 16:24:54.376528 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3932/7639] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:54 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:55.401131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a1996670-e794-4d06-a1ec-89ad8dc6d918 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:55.402136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a1996670-e794-4d06-a1ec-89ad8dc6d918 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:55.414015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1996670-e794-4d06-a1ec-89ad8dc6d918 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:55.414974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1996670-e794-4d06-a1ec-89ad8dc6d918 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:55.415680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1996670-e794-4d06-a1ec-89ad8dc6d918 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:55.417128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1996670-e794-4d06-a1ec-89ad8dc6d918 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:55.418060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1996670-e794-4d06-a1ec-89ad8dc6d918 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:55.418468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a1996670-e794-4d06-a1ec-89ad8dc6d918 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:55.549345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a1996670-e794-4d06-a1ec-89ad8dc6d918 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:55.557415 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a1996670-e794-4d06-a1ec-89ad8dc6d918 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1680 microversion: 2.1 time: 0.162902 Aug 29 16:24:55.558002 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3708/7640] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:55 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:56.583526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e301d51f-1774-4ca7-b546-9ba0bb89df4b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:56.584621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e301d51f-1774-4ca7-b546-9ba0bb89df4b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:56.594114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e301d51f-1774-4ca7-b546-9ba0bb89df4b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:56.594618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e301d51f-1774-4ca7-b546-9ba0bb89df4b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:56.595077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e301d51f-1774-4ca7-b546-9ba0bb89df4b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:56.596126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e301d51f-1774-4ca7-b546-9ba0bb89df4b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:56.596603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e301d51f-1774-4ca7-b546-9ba0bb89df4b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:56.597044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e301d51f-1774-4ca7-b546-9ba0bb89df4b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:56.744282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e301d51f-1774-4ca7-b546-9ba0bb89df4b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:56.752740 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e301d51f-1774-4ca7-b546-9ba0bb89df4b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1680 microversion: 2.1 time: 0.176086 Aug 29 16:24:56.753364 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3933/7641] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:56 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:57.778343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8144878f-23f4-40a8-bd20-2a7049b0cd53 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:57.779358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8144878f-23f4-40a8-bd20-2a7049b0cd53 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:57.790545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8144878f-23f4-40a8-bd20-2a7049b0cd53 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:57.791366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8144878f-23f4-40a8-bd20-2a7049b0cd53 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:57.792081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8144878f-23f4-40a8-bd20-2a7049b0cd53 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:57.793254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8144878f-23f4-40a8-bd20-2a7049b0cd53 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:57.793725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8144878f-23f4-40a8-bd20-2a7049b0cd53 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:57.794154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8144878f-23f4-40a8-bd20-2a7049b0cd53 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:57.930159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8144878f-23f4-40a8-bd20-2a7049b0cd53 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:57.938107 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8144878f-23f4-40a8-bd20-2a7049b0cd53 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1680 microversion: 2.1 time: 0.166331 Aug 29 16:24:57.938699 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3709/7642] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:57 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:58.962891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4052d83b-5929-4add-8906-66f18703cb54 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:58.963991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4052d83b-5929-4add-8906-66f18703cb54 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:58.980427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4052d83b-5929-4add-8906-66f18703cb54 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:58.980940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4052d83b-5929-4add-8906-66f18703cb54 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:58.981432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4052d83b-5929-4add-8906-66f18703cb54 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:58.982153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4052d83b-5929-4add-8906-66f18703cb54 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:58.982633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4052d83b-5929-4add-8906-66f18703cb54 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:58.983076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4052d83b-5929-4add-8906-66f18703cb54 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:59.119133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4052d83b-5929-4add-8906-66f18703cb54 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:59.130850 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4052d83b-5929-4add-8906-66f18703cb54 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1680 microversion: 2.1 time: 0.174414 Aug 29 16:24:59.131594 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3934/7643] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:58 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:00.155408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f45bb6a9-6ece-4c5a-804c-c8d0627b1e9c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:00.156029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f45bb6a9-6ece-4c5a-804c-c8d0627b1e9c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:00.164245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f45bb6a9-6ece-4c5a-804c-c8d0627b1e9c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:00.164727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f45bb6a9-6ece-4c5a-804c-c8d0627b1e9c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:00.165272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f45bb6a9-6ece-4c5a-804c-c8d0627b1e9c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:00.165971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f45bb6a9-6ece-4c5a-804c-c8d0627b1e9c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:00.166441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f45bb6a9-6ece-4c5a-804c-c8d0627b1e9c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:00.166867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f45bb6a9-6ece-4c5a-804c-c8d0627b1e9c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:00.322555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f45bb6a9-6ece-4c5a-804c-c8d0627b1e9c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:00.331430 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f45bb6a9-6ece-4c5a-804c-c8d0627b1e9c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1680 microversion: 2.1 time: 0.180755 Aug 29 16:25:00.332595 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3710/7644] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:00 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:01.356910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9f7ffeeb-401a-4d57-83ce-e8acf989b302 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:01.357831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9f7ffeeb-401a-4d57-83ce-e8acf989b302 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:01.366456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f7ffeeb-401a-4d57-83ce-e8acf989b302 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:01.367028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f7ffeeb-401a-4d57-83ce-e8acf989b302 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:01.367589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f7ffeeb-401a-4d57-83ce-e8acf989b302 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:01.368457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f7ffeeb-401a-4d57-83ce-e8acf989b302 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:01.369021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f7ffeeb-401a-4d57-83ce-e8acf989b302 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:01.369580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f7ffeeb-401a-4d57-83ce-e8acf989b302 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:01.523199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9f7ffeeb-401a-4d57-83ce-e8acf989b302 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:01.532000 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9f7ffeeb-401a-4d57-83ce-e8acf989b302 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1680 microversion: 2.1 time: 0.181347 Aug 29 16:25:01.532571 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3935/7645] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:01 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:02.558090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b637a718-a943-4343-b4e2-280a36cdef61 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:02.559013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b637a718-a943-4343-b4e2-280a36cdef61 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:02.567139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b637a718-a943-4343-b4e2-280a36cdef61 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:02.567671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b637a718-a943-4343-b4e2-280a36cdef61 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:02.568150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b637a718-a943-4343-b4e2-280a36cdef61 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:02.568936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b637a718-a943-4343-b4e2-280a36cdef61 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:02.569475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b637a718-a943-4343-b4e2-280a36cdef61 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:02.569941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b637a718-a943-4343-b4e2-280a36cdef61 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:02.718096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b637a718-a943-4343-b4e2-280a36cdef61 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:02.729832 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b637a718-a943-4343-b4e2-280a36cdef61 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1680 microversion: 2.1 time: 0.178622 Aug 29 16:25:02.730485 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3711/7646] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:02 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:03.755280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-78de5961-36ed-4554-8657-3d8993275e9a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:03.756218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-78de5961-36ed-4554-8657-3d8993275e9a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:03.765313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78de5961-36ed-4554-8657-3d8993275e9a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:03.765812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78de5961-36ed-4554-8657-3d8993275e9a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:03.766260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78de5961-36ed-4554-8657-3d8993275e9a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:03.766964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78de5961-36ed-4554-8657-3d8993275e9a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:03.767429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78de5961-36ed-4554-8657-3d8993275e9a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:03.767869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-78de5961-36ed-4554-8657-3d8993275e9a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:03.904454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-78de5961-36ed-4554-8657-3d8993275e9a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:03.912651 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-78de5961-36ed-4554-8657-3d8993275e9a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1680 microversion: 2.1 time: 0.164428 Aug 29 16:25:03.913258 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3936/7647] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:03 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:04.934655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a573ad23-b4e8-4028-b600-630ebd1dfb37 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:04.935241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a573ad23-b4e8-4028-b600-630ebd1dfb37 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:04.942333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a573ad23-b4e8-4028-b600-630ebd1dfb37 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:04.942764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a573ad23-b4e8-4028-b600-630ebd1dfb37 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:04.943203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a573ad23-b4e8-4028-b600-630ebd1dfb37 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:04.943900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a573ad23-b4e8-4028-b600-630ebd1dfb37 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:04.944363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a573ad23-b4e8-4028-b600-630ebd1dfb37 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:04.944793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a573ad23-b4e8-4028-b600-630ebd1dfb37 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:05.188928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a573ad23-b4e8-4028-b600-630ebd1dfb37 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:05.198456 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a573ad23-b4e8-4028-b600-630ebd1dfb37 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1657 microversion: 2.1 time: 0.267451 Aug 29 16:25:05.199356 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3712/7648] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:04 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1657 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:05.219673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1768491d-508a-4a94-9629-73ede553aa1f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:05.222462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1768491d-508a-4a94-9629-73ede553aa1f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:05.229190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1768491d-508a-4a94-9629-73ede553aa1f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:05.229685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1768491d-508a-4a94-9629-73ede553aa1f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:05.230138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1768491d-508a-4a94-9629-73ede553aa1f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:05.230858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1768491d-508a-4a94-9629-73ede553aa1f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:05.231340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1768491d-508a-4a94-9629-73ede553aa1f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:05.231816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1768491d-508a-4a94-9629-73ede553aa1f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:05.260763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1768491d-508a-4a94-9629-73ede553aa1f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:05.267126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1768491d-508a-4a94-9629-73ede553aa1f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Old instance type m1.heat2, new instance type m1.heat {{(pid=122360) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:25:05.273908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1768491d-508a-4a94-9629-73ede553aa1f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:25:05.274340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1768491d-508a-4a94-9629-73ede553aa1f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:25:05.274830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1768491d-508a-4a94-9629-73ede553aa1f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:25:05.275257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1768491d-508a-4a94-9629-73ede553aa1f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:25:05.275679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1768491d-508a-4a94-9629-73ede553aa1f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:25:05.340854 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1768491d-508a-4a94-9629-73ede553aa1f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "POST /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1/action" status: 202 len: 0 microversion: 2.1 time: 0.125319 Aug 29 16:25:05.344600 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3937/7649] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:25:05 2022] POST /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:25:05.351233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a4ce56c1-df42-4436-81ec-54762f096cd8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:05.351965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a4ce56c1-df42-4436-81ec-54762f096cd8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:05.358549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4ce56c1-df42-4436-81ec-54762f096cd8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:05.359049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4ce56c1-df42-4436-81ec-54762f096cd8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:05.359496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4ce56c1-df42-4436-81ec-54762f096cd8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:05.360226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4ce56c1-df42-4436-81ec-54762f096cd8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:05.360710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4ce56c1-df42-4436-81ec-54762f096cd8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:05.361168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a4ce56c1-df42-4436-81ec-54762f096cd8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:05.541578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a4ce56c1-df42-4436-81ec-54762f096cd8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:05.549567 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a4ce56c1-df42-4436-81ec-54762f096cd8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1680 microversion: 2.1 time: 0.202532 Aug 29 16:25:05.550145 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3713/7650] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:05 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1680 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:06.572252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f97dc69-73dc-4e18-90f1-0a0e3e35c314 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:06.572895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3f97dc69-73dc-4e18-90f1-0a0e3e35c314 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:06.580172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f97dc69-73dc-4e18-90f1-0a0e3e35c314 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:06.580670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f97dc69-73dc-4e18-90f1-0a0e3e35c314 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:06.581133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f97dc69-73dc-4e18-90f1-0a0e3e35c314 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:06.582082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f97dc69-73dc-4e18-90f1-0a0e3e35c314 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:06.582553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f97dc69-73dc-4e18-90f1-0a0e3e35c314 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:06.582978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f97dc69-73dc-4e18-90f1-0a0e3e35c314 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:06.729926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3f97dc69-73dc-4e18-90f1-0a0e3e35c314 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:06.738395 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3f97dc69-73dc-4e18-90f1-0a0e3e35c314 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1680 microversion: 2.1 time: 0.170129 Aug 29 16:25:06.738979 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3938/7651] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:06 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:07.762378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-101bc2ce-89ec-4590-b4f5-0b6d2847e11d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:07.763230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-101bc2ce-89ec-4590-b4f5-0b6d2847e11d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:07.772413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-101bc2ce-89ec-4590-b4f5-0b6d2847e11d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:07.773178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-101bc2ce-89ec-4590-b4f5-0b6d2847e11d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:07.773744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-101bc2ce-89ec-4590-b4f5-0b6d2847e11d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:07.774701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-101bc2ce-89ec-4590-b4f5-0b6d2847e11d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:07.775318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-101bc2ce-89ec-4590-b4f5-0b6d2847e11d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:07.775892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-101bc2ce-89ec-4590-b4f5-0b6d2847e11d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:07.920807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-101bc2ce-89ec-4590-b4f5-0b6d2847e11d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:07.932862 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-101bc2ce-89ec-4590-b4f5-0b6d2847e11d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1685 microversion: 2.1 time: 0.175666 Aug 29 16:25:07.933759 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3714/7652] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:07 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1685 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:08.965024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0af54c8a-52c4-4737-b262-4dbe54075e07 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:08.966118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0af54c8a-52c4-4737-b262-4dbe54075e07 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:08.977840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0af54c8a-52c4-4737-b262-4dbe54075e07 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:08.978643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0af54c8a-52c4-4737-b262-4dbe54075e07 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:08.979366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0af54c8a-52c4-4737-b262-4dbe54075e07 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:08.980514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0af54c8a-52c4-4737-b262-4dbe54075e07 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:08.981467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0af54c8a-52c4-4737-b262-4dbe54075e07 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:08.982173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0af54c8a-52c4-4737-b262-4dbe54075e07 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:09.129633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0af54c8a-52c4-4737-b262-4dbe54075e07 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:09.142028 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0af54c8a-52c4-4737-b262-4dbe54075e07 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1685 microversion: 2.1 time: 0.183285 Aug 29 16:25:09.142878 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3939/7653] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:08 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:10.167153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6aaf9919-c0dc-4f30-ac7b-5391d51f1c96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:10.167692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6aaf9919-c0dc-4f30-ac7b-5391d51f1c96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:10.174756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aaf9919-c0dc-4f30-ac7b-5391d51f1c96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:10.175245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aaf9919-c0dc-4f30-ac7b-5391d51f1c96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:10.175668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aaf9919-c0dc-4f30-ac7b-5391d51f1c96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:10.176378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aaf9919-c0dc-4f30-ac7b-5391d51f1c96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:10.176825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aaf9919-c0dc-4f30-ac7b-5391d51f1c96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:10.177272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6aaf9919-c0dc-4f30-ac7b-5391d51f1c96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:10.428936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6aaf9919-c0dc-4f30-ac7b-5391d51f1c96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:10.437454 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6aaf9919-c0dc-4f30-ac7b-5391d51f1c96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1684 microversion: 2.1 time: 0.274739 Aug 29 16:25:10.438039 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3715/7654] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:10 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1684 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:10.594694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-811854a9-a59e-48fc-9336-daa43ecf2dec req-7724bf06-7664-43c8-9fae-8241432fb3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30609c4-2104-4b7a-ba81-6746b4353dd1", "name": "network-vif-unplugged", "status": "completed", "tag": "d1bcfcdb-8db4-4c16-8c73-c1cf694fbf95"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:10.606520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-811854a9-a59e-48fc-9336-daa43ecf2dec req-7724bf06-7664-43c8-9fae-8241432fb3cf service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:10.607179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-811854a9-a59e-48fc-9336-daa43ecf2dec req-7724bf06-7664-43c8-9fae-8241432fb3cf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:10.607931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-811854a9-a59e-48fc-9336-daa43ecf2dec req-7724bf06-7664-43c8-9fae-8241432fb3cf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:10.623304 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-811854a9-a59e-48fc-9336-daa43ecf2dec req-7724bf06-7664-43c8-9fae-8241432fb3cf service nova] Creating event network-vif-unplugged:d1bcfcdb-8db4-4c16-8c73-c1cf694fbf95 for instance b30609c4-2104-4b7a-ba81-6746b4353dd1 on n-h2-839401-11 Aug 29 16:25:10.629265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-811854a9-a59e-48fc-9336-daa43ecf2dec req-7724bf06-7664-43c8-9fae-8241432fb3cf service nova] Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:25:10.642111 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-811854a9-a59e-48fc-9336-daa43ecf2dec req-7724bf06-7664-43c8-9fae-8241432fb3cf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051496 Aug 29 16:25:10.642734 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3940/7655] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:25:11.459537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9702a8a4-6ab2-4423-97b9-2c4c7368462d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:11.460136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9702a8a4-6ab2-4423-97b9-2c4c7368462d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:11.470709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9702a8a4-6ab2-4423-97b9-2c4c7368462d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:11.471204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9702a8a4-6ab2-4423-97b9-2c4c7368462d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:11.471648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9702a8a4-6ab2-4423-97b9-2c4c7368462d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:11.472409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9702a8a4-6ab2-4423-97b9-2c4c7368462d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:11.472811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9702a8a4-6ab2-4423-97b9-2c4c7368462d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:11.473270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9702a8a4-6ab2-4423-97b9-2c4c7368462d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:11.633548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9702a8a4-6ab2-4423-97b9-2c4c7368462d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:11.643598 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9702a8a4-6ab2-4423-97b9-2c4c7368462d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1684 microversion: 2.1 time: 0.187859 Aug 29 16:25:11.644465 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3716/7656] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:11 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1684 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:12.670214 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c376075c-972a-4fad-99d7-8ce745086e2e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:12.670932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c376075c-972a-4fad-99d7-8ce745086e2e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:12.679706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-81e0159c-8e51-4cc8-beb1-053da19a174c req-669c73aa-b89b-40ff-afea-01a8f9256b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b30609c4-2104-4b7a-ba81-6746b4353dd1", "tag": "d1bcfcdb-8db4-4c16-8c73-c1cf694fbf95"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:12.690896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c376075c-972a-4fad-99d7-8ce745086e2e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:12.691097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-81e0159c-8e51-4cc8-beb1-053da19a174c req-669c73aa-b89b-40ff-afea-01a8f9256b3b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:12.691414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c376075c-972a-4fad-99d7-8ce745086e2e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:12.691556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-81e0159c-8e51-4cc8-beb1-053da19a174c req-669c73aa-b89b-40ff-afea-01a8f9256b3b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:12.691879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c376075c-972a-4fad-99d7-8ce745086e2e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:12.692024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-81e0159c-8e51-4cc8-beb1-053da19a174c req-669c73aa-b89b-40ff-afea-01a8f9256b3b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:12.692612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c376075c-972a-4fad-99d7-8ce745086e2e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:12.693108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c376075c-972a-4fad-99d7-8ce745086e2e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:12.693541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c376075c-972a-4fad-99d7-8ce745086e2e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:12.707235 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-81e0159c-8e51-4cc8-beb1-053da19a174c req-669c73aa-b89b-40ff-afea-01a8f9256b3b service nova] Creating event network-changed:d1bcfcdb-8db4-4c16-8c73-c1cf694fbf95 for instance b30609c4-2104-4b7a-ba81-6746b4353dd1 on n-h2-839401-11 Aug 29 16:25:12.713214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-81e0159c-8e51-4cc8-beb1-053da19a174c req-669c73aa-b89b-40ff-afea-01a8f9256b3b service nova] Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:25:12.725010 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-81e0159c-8e51-4cc8-beb1-053da19a174c req-669c73aa-b89b-40ff-afea-01a8f9256b3b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050492 Aug 29 16:25:12.725707 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3717/7657] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:12.837437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c376075c-972a-4fad-99d7-8ce745086e2e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:12.847087 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c376075c-972a-4fad-99d7-8ce745086e2e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1682 microversion: 2.1 time: 0.183638 Aug 29 16:25:12.847832 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3941/7658] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:12 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:13.869687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2101f000-9885-48f7-8ede-3f5c27e00a1d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:13.870405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2101f000-9885-48f7-8ede-3f5c27e00a1d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:13.877260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2101f000-9885-48f7-8ede-3f5c27e00a1d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:13.877783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2101f000-9885-48f7-8ede-3f5c27e00a1d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:13.878222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2101f000-9885-48f7-8ede-3f5c27e00a1d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:13.878922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2101f000-9885-48f7-8ede-3f5c27e00a1d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:13.879383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2101f000-9885-48f7-8ede-3f5c27e00a1d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:13.879816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2101f000-9885-48f7-8ede-3f5c27e00a1d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:14.025667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2101f000-9885-48f7-8ede-3f5c27e00a1d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:14.034147 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2101f000-9885-48f7-8ede-3f5c27e00a1d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1682 microversion: 2.1 time: 0.169772 Aug 29 16:25:14.034705 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3718/7659] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:13 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:15.059718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-80362a51-135c-4834-b961-76f510683063 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:15.060435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-80362a51-135c-4834-b961-76f510683063 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:15.067942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80362a51-135c-4834-b961-76f510683063 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:15.068449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80362a51-135c-4834-b961-76f510683063 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:15.068906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80362a51-135c-4834-b961-76f510683063 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:15.069662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80362a51-135c-4834-b961-76f510683063 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:15.070133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80362a51-135c-4834-b961-76f510683063 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:15.070563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-80362a51-135c-4834-b961-76f510683063 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:15.213736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-80362a51-135c-4834-b961-76f510683063 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:15.222064 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-80362a51-135c-4834-b961-76f510683063 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1678 microversion: 2.1 time: 0.169112 Aug 29 16:25:15.222661 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3942/7660] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:15 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:15.242390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b9b01be5-b2cf-43e6-9dd8-fc2ef828ffc6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:15.242980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b9b01be5-b2cf-43e6-9dd8-fc2ef828ffc6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:15.249955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9b01be5-b2cf-43e6-9dd8-fc2ef828ffc6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:15.250442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9b01be5-b2cf-43e6-9dd8-fc2ef828ffc6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:15.250876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9b01be5-b2cf-43e6-9dd8-fc2ef828ffc6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:15.251570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9b01be5-b2cf-43e6-9dd8-fc2ef828ffc6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:15.252026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9b01be5-b2cf-43e6-9dd8-fc2ef828ffc6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:15.252478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9b01be5-b2cf-43e6-9dd8-fc2ef828ffc6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:15.302169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:15.316160 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b9b01be5-b2cf-43e6-9dd8-fc2ef828ffc6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "POST /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1/action" status: 204 len: 0 microversion: 2.1 time: 0.077541 Aug 29 16:25:15.316876 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3719/7661] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:25:15 2022] POST /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:25:15.330483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0614bf81-a680-43ec-8bc0-d459b4d06e96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:15.331147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0614bf81-a680-43ec-8bc0-d459b4d06e96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:15.342795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0614bf81-a680-43ec-8bc0-d459b4d06e96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:15.343541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0614bf81-a680-43ec-8bc0-d459b4d06e96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:15.344463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0614bf81-a680-43ec-8bc0-d459b4d06e96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:15.345525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0614bf81-a680-43ec-8bc0-d459b4d06e96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:15.346001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0614bf81-a680-43ec-8bc0-d459b4d06e96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:15.346600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0614bf81-a680-43ec-8bc0-d459b4d06e96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:15.488008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0614bf81-a680-43ec-8bc0-d459b4d06e96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:15.496187 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0614bf81-a680-43ec-8bc0-d459b4d06e96 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1678 microversion: 2.1 time: 0.175079 Aug 29 16:25:15.496812 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3943/7662] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:15 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:16.520220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b1581222-c259-4e26-829c-7d2afa368dfd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:16.520878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b1581222-c259-4e26-829c-7d2afa368dfd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:16.528564 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1581222-c259-4e26-829c-7d2afa368dfd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:16.530000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1581222-c259-4e26-829c-7d2afa368dfd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:16.530987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1581222-c259-4e26-829c-7d2afa368dfd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:16.531700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1581222-c259-4e26-829c-7d2afa368dfd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:16.532160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1581222-c259-4e26-829c-7d2afa368dfd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:16.532587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b1581222-c259-4e26-829c-7d2afa368dfd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:16.685105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b1581222-c259-4e26-829c-7d2afa368dfd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:16.693158 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b1581222-c259-4e26-829c-7d2afa368dfd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1678 microversion: 2.1 time: 0.178756 Aug 29 16:25:16.693838 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3720/7663] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:16 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:17.393654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-0695a1c6-7ecc-429b-ad04-4516d69a38ff req-f3d8565f-fefc-4c8a-8a23-16d10bede8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30609c4-2104-4b7a-ba81-6746b4353dd1", "name": "network-vif-plugged", "status": "completed", "tag": "d1bcfcdb-8db4-4c16-8c73-c1cf694fbf95"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:17.404944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0695a1c6-7ecc-429b-ad04-4516d69a38ff req-f3d8565f-fefc-4c8a-8a23-16d10bede8b6 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:17.405503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0695a1c6-7ecc-429b-ad04-4516d69a38ff req-f3d8565f-fefc-4c8a-8a23-16d10bede8b6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:17.405962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0695a1c6-7ecc-429b-ad04-4516d69a38ff req-f3d8565f-fefc-4c8a-8a23-16d10bede8b6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:17.418157 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-0695a1c6-7ecc-429b-ad04-4516d69a38ff req-f3d8565f-fefc-4c8a-8a23-16d10bede8b6 service nova] Creating event network-vif-plugged:d1bcfcdb-8db4-4c16-8c73-c1cf694fbf95 for instance b30609c4-2104-4b7a-ba81-6746b4353dd1 on n-h2-839401-11 Aug 29 16:25:17.423433 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-0695a1c6-7ecc-429b-ad04-4516d69a38ff req-f3d8565f-fefc-4c8a-8a23-16d10bede8b6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033787 Aug 29 16:25:17.424063 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3944/7664] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:17.719307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c9ff4c39-1d16-4d3c-9bf1-59de02bf67e9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:17.721164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c9ff4c39-1d16-4d3c-9bf1-59de02bf67e9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:17.732696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9ff4c39-1d16-4d3c-9bf1-59de02bf67e9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:17.733290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9ff4c39-1d16-4d3c-9bf1-59de02bf67e9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:17.733734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9ff4c39-1d16-4d3c-9bf1-59de02bf67e9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:17.734447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9ff4c39-1d16-4d3c-9bf1-59de02bf67e9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:17.734903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9ff4c39-1d16-4d3c-9bf1-59de02bf67e9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:17.735328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c9ff4c39-1d16-4d3c-9bf1-59de02bf67e9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:17.880267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c9ff4c39-1d16-4d3c-9bf1-59de02bf67e9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:17.888913 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c9ff4c39-1d16-4d3c-9bf1-59de02bf67e9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1657 microversion: 2.1 time: 0.176728 Aug 29 16:25:17.889561 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3721/7665] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:17 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1657 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:17.909763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8728baed-6973-46fc-9b9c-b49f9dec92ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:17.910487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8728baed-6973-46fc-9b9c-b49f9dec92ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:17.917135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8728baed-6973-46fc-9b9c-b49f9dec92ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:17.917678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8728baed-6973-46fc-9b9c-b49f9dec92ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:17.918126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8728baed-6973-46fc-9b9c-b49f9dec92ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:17.918832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8728baed-6973-46fc-9b9c-b49f9dec92ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:17.919302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8728baed-6973-46fc-9b9c-b49f9dec92ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:17.919789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8728baed-6973-46fc-9b9c-b49f9dec92ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:18.075352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8728baed-6973-46fc-9b9c-b49f9dec92ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:18.084296 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8728baed-6973-46fc-9b9c-b49f9dec92ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1657 microversion: 2.1 time: 0.178817 Aug 29 16:25:18.084868 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3945/7666] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:17 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1657 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:18.105451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ffb1e32a-2b9f-41e3-8a62-1612b9a6f10c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:18.111815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffb1e32a-2b9f-41e3-8a62-1612b9a6f10c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:18.112329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffb1e32a-2b9f-41e3-8a62-1612b9a6f10c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:18.112769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ffb1e32a-2b9f-41e3-8a62-1612b9a6f10c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:18.136218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ffb1e32a-2b9f-41e3-8a62-1612b9a6f10c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Going to try to start instance {{(pid=122361) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 16:25:18.190307 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ffb1e32a-2b9f-41e3-8a62-1612b9a6f10c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "POST /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1/action" status: 202 len: 0 microversion: 2.1 time: 0.088850 Aug 29 16:25:18.191006 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3722/7667] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:25:18 2022] POST /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:25:18.199652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a1dab6e6-4a05-4594-8d3b-81616498b357 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:18.200288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a1dab6e6-4a05-4594-8d3b-81616498b357 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:18.206810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1dab6e6-4a05-4594-8d3b-81616498b357 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:18.207318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1dab6e6-4a05-4594-8d3b-81616498b357 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:18.207778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1dab6e6-4a05-4594-8d3b-81616498b357 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:18.208551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1dab6e6-4a05-4594-8d3b-81616498b357 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:18.209008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1dab6e6-4a05-4594-8d3b-81616498b357 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:18.209515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1dab6e6-4a05-4594-8d3b-81616498b357 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:18.214152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:18.349778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a1dab6e6-4a05-4594-8d3b-81616498b357 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:18.358229 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a1dab6e6-4a05-4594-8d3b-81616498b357 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1666 microversion: 2.1 time: 0.162387 Aug 29 16:25:18.358794 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3946/7668] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:18 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1666 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:19.384333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-47c8b9e2-ed64-4bf1-aab1-f6e57e3efddd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:19.385400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-47c8b9e2-ed64-4bf1-aab1-f6e57e3efddd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:19.388044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=37 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:19.393972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47c8b9e2-ed64-4bf1-aab1-f6e57e3efddd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:19.394478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47c8b9e2-ed64-4bf1-aab1-f6e57e3efddd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:19.394949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47c8b9e2-ed64-4bf1-aab1-f6e57e3efddd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:19.395643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47c8b9e2-ed64-4bf1-aab1-f6e57e3efddd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:19.396097 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47c8b9e2-ed64-4bf1-aab1-f6e57e3efddd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:19.396527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47c8b9e2-ed64-4bf1-aab1-f6e57e3efddd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:19.545715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-47c8b9e2-ed64-4bf1-aab1-f6e57e3efddd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:19.554609 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-47c8b9e2-ed64-4bf1-aab1-f6e57e3efddd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1666 microversion: 2.1 time: 0.177732 Aug 29 16:25:19.555343 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3723/7669] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:19 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1666 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:20.580195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5c7e9660-5599-4cc7-b008-070421b282fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:20.580857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5c7e9660-5599-4cc7-b008-070421b282fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:20.583642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=39 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:20.589536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c7e9660-5599-4cc7-b008-070421b282fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:20.590033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c7e9660-5599-4cc7-b008-070421b282fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:20.590497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c7e9660-5599-4cc7-b008-070421b282fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:20.591206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c7e9660-5599-4cc7-b008-070421b282fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:20.591680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c7e9660-5599-4cc7-b008-070421b282fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:20.592130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5c7e9660-5599-4cc7-b008-070421b282fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:20.736066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5c7e9660-5599-4cc7-b008-070421b282fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:20.744804 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5c7e9660-5599-4cc7-b008-070421b282fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1670 microversion: 2.1 time: 0.170621 Aug 29 16:25:20.745436 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3947/7670] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:20 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:20.780688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-79e616bb-fdca-48c0-961a-1277ffc230af tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:20.781795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-79e616bb-fdca-48c0-961a-1277ffc230af tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:20.793261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79e616bb-fdca-48c0-961a-1277ffc230af tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:20.793766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79e616bb-fdca-48c0-961a-1277ffc230af tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:20.794429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79e616bb-fdca-48c0-961a-1277ffc230af tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:20.795558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79e616bb-fdca-48c0-961a-1277ffc230af tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:20.796240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79e616bb-fdca-48c0-961a-1277ffc230af tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:20.796920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-79e616bb-fdca-48c0-961a-1277ffc230af tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:20.823500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-79e616bb-fdca-48c0-961a-1277ffc230af tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:25:20.907928 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-79e616bb-fdca-48c0-961a-1277ffc230af tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 204 len: 0 microversion: 2.1 time: 0.134033 Aug 29 16:25:20.908540 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3724/7671] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:25:20 2022] DELETE /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:25:20.918044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5fa6f31c-8667-4f6b-9081-3eebc15f7b7a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:20.918709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5fa6f31c-8667-4f6b-9081-3eebc15f7b7a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:20.926849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fa6f31c-8667-4f6b-9081-3eebc15f7b7a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:20.927673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fa6f31c-8667-4f6b-9081-3eebc15f7b7a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:20.927888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fa6f31c-8667-4f6b-9081-3eebc15f7b7a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:20.928510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fa6f31c-8667-4f6b-9081-3eebc15f7b7a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:20.928982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fa6f31c-8667-4f6b-9081-3eebc15f7b7a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:20.929486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fa6f31c-8667-4f6b-9081-3eebc15f7b7a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:21.069645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5fa6f31c-8667-4f6b-9081-3eebc15f7b7a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:21.078010 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5fa6f31c-8667-4f6b-9081-3eebc15f7b7a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1676 microversion: 2.1 time: 0.164354 Aug 29 16:25:21.078600 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3948/7672] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:20 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:22.100857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3efcf212-4f53-438c-b7d1-982da919c4ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:22.101620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3efcf212-4f53-438c-b7d1-982da919c4ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:22.108705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3efcf212-4f53-438c-b7d1-982da919c4ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:22.109215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3efcf212-4f53-438c-b7d1-982da919c4ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:22.109675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3efcf212-4f53-438c-b7d1-982da919c4ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:22.110367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3efcf212-4f53-438c-b7d1-982da919c4ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:22.110866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3efcf212-4f53-438c-b7d1-982da919c4ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:22.111294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3efcf212-4f53-438c-b7d1-982da919c4ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:22.257655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3efcf212-4f53-438c-b7d1-982da919c4ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:22.269325 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3efcf212-4f53-438c-b7d1-982da919c4ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1676 microversion: 2.1 time: 0.172920 Aug 29 16:25:22.269961 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3725/7673] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:22 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:23.295742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8cad6d1e-cc45-4690-8c52-749bafc49bf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:23.296418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8cad6d1e-cc45-4690-8c52-749bafc49bf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:23.305434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cad6d1e-cc45-4690-8c52-749bafc49bf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:23.306513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cad6d1e-cc45-4690-8c52-749bafc49bf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:23.306957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cad6d1e-cc45-4690-8c52-749bafc49bf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:23.308673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cad6d1e-cc45-4690-8c52-749bafc49bf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:23.309360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cad6d1e-cc45-4690-8c52-749bafc49bf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:23.309799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cad6d1e-cc45-4690-8c52-749bafc49bf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:23.384954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8cad6d1e-cc45-4690-8c52-749bafc49bf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:23.394108 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8cad6d1e-cc45-4690-8c52-749bafc49bf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 200 len: 1609 microversion: 2.1 time: 0.102387 Aug 29 16:25:23.394728 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3949/7674] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:23 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 1609 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:23.771075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-54bed854-67e9-4f04-9ce1-fb0597f05599 req-fd00a1f3-d315-4fe3-9d0e-1fe00d67ec8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30609c4-2104-4b7a-ba81-6746b4353dd1", "name": "network-vif-deleted", "tag": "d1bcfcdb-8db4-4c16-8c73-c1cf694fbf95"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:23.781968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-54bed854-67e9-4f04-9ce1-fb0597f05599 req-fd00a1f3-d315-4fe3-9d0e-1fe00d67ec8a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:23.782443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-54bed854-67e9-4f04-9ce1-fb0597f05599 req-fd00a1f3-d315-4fe3-9d0e-1fe00d67ec8a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:23.782906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-54bed854-67e9-4f04-9ce1-fb0597f05599 req-fd00a1f3-d315-4fe3-9d0e-1fe00d67ec8a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:23.794821 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-54bed854-67e9-4f04-9ce1-fb0597f05599 req-fd00a1f3-d315-4fe3-9d0e-1fe00d67ec8a service nova] Creating event network-vif-deleted:d1bcfcdb-8db4-4c16-8c73-c1cf694fbf95 for instance b30609c4-2104-4b7a-ba81-6746b4353dd1 on n-h2-839401-11 Aug 29 16:25:23.800519 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-54bed854-67e9-4f04-9ce1-fb0597f05599 req-fd00a1f3-d315-4fe3-9d0e-1fe00d67ec8a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033370 Aug 29 16:25:23.801308 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3726/7675] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:24.416677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-179907bb-a300-4835-a22a-5d599f062e8f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:24.417305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-179907bb-a300-4835-a22a-5d599f062e8f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:24.424823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-179907bb-a300-4835-a22a-5d599f062e8f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:24.425387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-179907bb-a300-4835-a22a-5d599f062e8f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:24.425842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-179907bb-a300-4835-a22a-5d599f062e8f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:24.426558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-179907bb-a300-4835-a22a-5d599f062e8f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:24.427034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-179907bb-a300-4835-a22a-5d599f062e8f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:24.427472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-179907bb-a300-4835-a22a-5d599f062e8f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:24.441838 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-179907bb-a300-4835-a22a-5d599f062e8f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] HTTP exception thrown: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-179907bb-a300-4835-a22a-5d599f062e8f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Request method failure captured: Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 HTTP/1.1 Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOeCmxszHic3fR-dD_FiVESHdRYratk0u2UW9FXU2W3acquSUUlqZBMx4K0KtqOALAZPC24K6LNbNevDXRbYlme3cOp5pFNwEiKyAZ1t4P951EcRw9FjJ4SV_PAxR4V5iAAz1_B-GZ6uA0zFPfIDeLmTpv-TVgqY352WqC50xTbg0HI Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a3432e106e74db480a1f7a17af514fb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}] Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerActionsTestJSON-546053265 Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6658968475ea487ea0aba9be50d861fe Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b30609c4-2104-4b7a-ba81-6746b4353dd1'} Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:25:24.443572 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:25:24.451444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:25:24.451444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:25:24.451444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:25:24.451444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:25:24.451444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:25:24.451444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:25:24.451444 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:25:24.451444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-179907bb-a300-4835-a22a-5d599f062e8f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Returning 404 to user: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:25:24.451444 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-179907bb-a300-4835-a22a-5d599f062e8f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 404 len: 111 microversion: 2.1 time: 0.032795 Aug 29 16:25:24.451444 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3950/7676] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:24 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:25:24.463109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5684232d-8c2f-48fe-93b7-a8f8f83aa90e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:24.464040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5684232d-8c2f-48fe-93b7-a8f8f83aa90e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:24.470960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5684232d-8c2f-48fe-93b7-a8f8f83aa90e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:24.471449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5684232d-8c2f-48fe-93b7-a8f8f83aa90e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:24.471886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5684232d-8c2f-48fe-93b7-a8f8f83aa90e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:24.472576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5684232d-8c2f-48fe-93b7-a8f8f83aa90e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:24.473036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5684232d-8c2f-48fe-93b7-a8f8f83aa90e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:24.473658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5684232d-8c2f-48fe-93b7-a8f8f83aa90e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:24.487975 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-5684232d-8c2f-48fe-93b7-a8f8f83aa90e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] HTTP exception thrown: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5684232d-8c2f-48fe-93b7-a8f8f83aa90e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Request method failure captured: Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 HTTP/1.1 Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOeCmxszHic3fR-dD_FiVESHdRYratk0u2UW9FXU2W3acquSUUlqZBMx4K0KtqOALAZPC24K6LNbNevDXRbYlme3cOp5pFNwEiKyAZ1t4P951EcRw9FjJ4SV_PAxR4V5iAAz1_B-GZ6uA0zFPfIDeLmTpv-TVgqY352WqC50xTbg0HI Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a3432e106e74db480a1f7a17af514fb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}] Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerActionsTestJSON-546053265 Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6658968475ea487ea0aba9be50d861fe Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'b30609c4-2104-4b7a-ba81-6746b4353dd1'} Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:25:24.489899 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:25:24.502468 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:25:24.502468 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:25:24.502468 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:25:24.502468 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:25:24.502468 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:25:24.502468 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:25:24.502468 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:25:24.502468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5684232d-8c2f-48fe-93b7-a8f8f83aa90e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Returning 404 to user: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:25:24.502468 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5684232d-8c2f-48fe-93b7-a8f8f83aa90e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 404 len: 111 microversion: 2.1 time: 0.032612 Aug 29 16:25:24.502468 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3727/7677] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:24 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:25:24.542644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-800720338", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "827789af-a96a-4564-a015-c53c7c9ca929"}], "security_groups": [{"name": "tempest-securitygroup--825674519"}], "key_name": "tempest-keypair-1856537733", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:24.652350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] validate_networks() for [('827789af-a96a-4564-a015-c53c7c9ca929', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:25:25.164203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:25:25.164636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:25:25.165138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:25:25.165556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:25:25.165976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:25:25.179466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:25.180002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:25.180459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:25.181257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:25.181713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:25.182160 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:25.202361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Getting quotas for project 1a3432e106e74db480a1f7a17af514fb. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:25:25.208347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Getting quotas for user 6658968475ea487ea0aba9be50d861fe and project 1a3432e106e74db480a1f7a17af514fb. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:25:25.222211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:25:25.224626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:25:25.272223 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fe2f9640-ad07-4a18-aab8-46efa7696832 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.733548 Aug 29 16:25:25.272906 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3951/7678] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:25:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:25:25.284648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2af53777-0065-4eaa-9fac-82805f6d2dfa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:25.285651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2af53777-0065-4eaa-9fac-82805f6d2dfa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:25.343445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2af53777-0065-4eaa-9fac-82805f6d2dfa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:25.355278 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2af53777-0065-4eaa-9fac-82805f6d2dfa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1238 microversion: 2.1 time: 0.075191 Aug 29 16:25:25.355941 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3728/7679] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:25 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:26.377380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e4865615-733e-4393-b271-e2ad0fd96d70 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:26.378009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e4865615-733e-4393-b271-e2ad0fd96d70 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:26.385263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4865615-733e-4393-b271-e2ad0fd96d70 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:26.385771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4865615-733e-4393-b271-e2ad0fd96d70 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:26.386215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4865615-733e-4393-b271-e2ad0fd96d70 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:26.386933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4865615-733e-4393-b271-e2ad0fd96d70 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:26.387426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4865615-733e-4393-b271-e2ad0fd96d70 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:26.387855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4865615-733e-4393-b271-e2ad0fd96d70 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:26.461234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e4865615-733e-4393-b271-e2ad0fd96d70 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:26.469496 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e4865615-733e-4393-b271-e2ad0fd96d70 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1290 microversion: 2.1 time: 0.097105 Aug 29 16:25:26.470440 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3952/7680] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:26 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1290 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:27.492085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9b539fd6-741c-4ab2-a90a-5e0f01b28ee9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:27.492849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9b539fd6-741c-4ab2-a90a-5e0f01b28ee9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:27.500456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b539fd6-741c-4ab2-a90a-5e0f01b28ee9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:27.501122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b539fd6-741c-4ab2-a90a-5e0f01b28ee9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:27.501682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b539fd6-741c-4ab2-a90a-5e0f01b28ee9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:27.502492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b539fd6-741c-4ab2-a90a-5e0f01b28ee9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:27.503212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b539fd6-741c-4ab2-a90a-5e0f01b28ee9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:27.503720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b539fd6-741c-4ab2-a90a-5e0f01b28ee9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:27.707280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9b539fd6-741c-4ab2-a90a-5e0f01b28ee9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:27.716239 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9b539fd6-741c-4ab2-a90a-5e0f01b28ee9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1363 microversion: 2.1 time: 0.228772 Aug 29 16:25:27.716850 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3729/7681] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:27 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:27.939920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-40c3e30c-4930-4a60-9cbe-087990d74f75 req-9b8c8115-be98-4d4d-baa6-2b1d8ebb09f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7730fa-cc54-496c-99e2-68e699089960", "tag": "764ceb17-45fc-4b56-9aee-8b4ae0b815bd"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:27.953681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-40c3e30c-4930-4a60-9cbe-087990d74f75 req-9b8c8115-be98-4d4d-baa6-2b1d8ebb09f8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:27.954190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-40c3e30c-4930-4a60-9cbe-087990d74f75 req-9b8c8115-be98-4d4d-baa6-2b1d8ebb09f8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:27.954650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-40c3e30c-4930-4a60-9cbe-087990d74f75 req-9b8c8115-be98-4d4d-baa6-2b1d8ebb09f8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:27.966602 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-40c3e30c-4930-4a60-9cbe-087990d74f75 req-9b8c8115-be98-4d4d-baa6-2b1d8ebb09f8 service nova] Creating event network-changed:764ceb17-45fc-4b56-9aee-8b4ae0b815bd for instance 8c7730fa-cc54-496c-99e2-68e699089960 on n-h1-839401-11 Aug 29 16:25:27.973671 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-40c3e30c-4930-4a60-9cbe-087990d74f75 req-9b8c8115-be98-4d4d-baa6-2b1d8ebb09f8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038714 Aug 29 16:25:27.974476 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3953/7682] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:28.742991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4e2f1d18-c0bc-4b2b-8ae1-c7c62bdad29a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:28.743893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4e2f1d18-c0bc-4b2b-8ae1-c7c62bdad29a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:28.754430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e2f1d18-c0bc-4b2b-8ae1-c7c62bdad29a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:28.754930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e2f1d18-c0bc-4b2b-8ae1-c7c62bdad29a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:28.755382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e2f1d18-c0bc-4b2b-8ae1-c7c62bdad29a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:28.756116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e2f1d18-c0bc-4b2b-8ae1-c7c62bdad29a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:28.756580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e2f1d18-c0bc-4b2b-8ae1-c7c62bdad29a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:28.757012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4e2f1d18-c0bc-4b2b-8ae1-c7c62bdad29a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:28.907697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4e2f1d18-c0bc-4b2b-8ae1-c7c62bdad29a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:28.915872 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4e2f1d18-c0bc-4b2b-8ae1-c7c62bdad29a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1363 microversion: 2.1 time: 0.179803 Aug 29 16:25:28.916461 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3730/7683] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:28 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:29.939666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-02975e74-d5e7-406b-a09a-121662e83098 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:29.940433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-02975e74-d5e7-406b-a09a-121662e83098 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:29.948427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02975e74-d5e7-406b-a09a-121662e83098 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:29.948934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02975e74-d5e7-406b-a09a-121662e83098 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:29.949422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02975e74-d5e7-406b-a09a-121662e83098 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:29.950130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02975e74-d5e7-406b-a09a-121662e83098 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:29.950605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02975e74-d5e7-406b-a09a-121662e83098 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:29.951046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02975e74-d5e7-406b-a09a-121662e83098 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:30.093994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-02975e74-d5e7-406b-a09a-121662e83098 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:30.102856 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-02975e74-d5e7-406b-a09a-121662e83098 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1363 microversion: 2.1 time: 0.168218 Aug 29 16:25:30.103370 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3954/7684] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:29 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:31.124426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cc651036-18af-451a-8670-04636267323d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:31.125016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cc651036-18af-451a-8670-04636267323d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:31.132493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc651036-18af-451a-8670-04636267323d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:31.132993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc651036-18af-451a-8670-04636267323d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:31.133496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc651036-18af-451a-8670-04636267323d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:31.134185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc651036-18af-451a-8670-04636267323d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:31.134643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc651036-18af-451a-8670-04636267323d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:31.135138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc651036-18af-451a-8670-04636267323d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:31.297393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cc651036-18af-451a-8670-04636267323d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:31.305726 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cc651036-18af-451a-8670-04636267323d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1363 microversion: 2.1 time: 0.185525 Aug 29 16:25:31.306313 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3731/7685] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:31 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:32.332365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5089f195-7d8a-400d-a34b-d87cd309d61b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:32.333520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5089f195-7d8a-400d-a34b-d87cd309d61b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:32.345560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5089f195-7d8a-400d-a34b-d87cd309d61b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:32.346411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5089f195-7d8a-400d-a34b-d87cd309d61b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:32.347103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5089f195-7d8a-400d-a34b-d87cd309d61b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:32.347888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5089f195-7d8a-400d-a34b-d87cd309d61b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:32.348362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5089f195-7d8a-400d-a34b-d87cd309d61b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:32.348800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5089f195-7d8a-400d-a34b-d87cd309d61b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:32.494167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5089f195-7d8a-400d-a34b-d87cd309d61b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:32.502672 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5089f195-7d8a-400d-a34b-d87cd309d61b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1363 microversion: 2.1 time: 0.177687 Aug 29 16:25:32.503381 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3955/7686] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:32 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:33.527196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4128429c-77d2-4fe1-8770-4da2ced0fd6f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:33.528132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4128429c-77d2-4fe1-8770-4da2ced0fd6f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:33.539338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4128429c-77d2-4fe1-8770-4da2ced0fd6f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:33.540069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4128429c-77d2-4fe1-8770-4da2ced0fd6f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:33.540732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4128429c-77d2-4fe1-8770-4da2ced0fd6f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:33.541962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4128429c-77d2-4fe1-8770-4da2ced0fd6f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:33.542655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4128429c-77d2-4fe1-8770-4da2ced0fd6f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:33.543300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4128429c-77d2-4fe1-8770-4da2ced0fd6f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:33.682140 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4128429c-77d2-4fe1-8770-4da2ced0fd6f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:33.690242 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4128429c-77d2-4fe1-8770-4da2ced0fd6f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1363 microversion: 2.1 time: 0.169247 Aug 29 16:25:33.690989 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3732/7687] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:33 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:34.716306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-84c0dd18-b5db-40b4-87c8-f5636e0f7c13 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:34.717212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-84c0dd18-b5db-40b4-87c8-f5636e0f7c13 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:34.726854 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84c0dd18-b5db-40b4-87c8-f5636e0f7c13 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:34.727362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84c0dd18-b5db-40b4-87c8-f5636e0f7c13 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:34.727817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84c0dd18-b5db-40b4-87c8-f5636e0f7c13 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:34.728535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84c0dd18-b5db-40b4-87c8-f5636e0f7c13 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:34.729010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84c0dd18-b5db-40b4-87c8-f5636e0f7c13 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:34.729491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84c0dd18-b5db-40b4-87c8-f5636e0f7c13 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:34.873483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-84c0dd18-b5db-40b4-87c8-f5636e0f7c13 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:34.882857 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-84c0dd18-b5db-40b4-87c8-f5636e0f7c13 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1363 microversion: 2.1 time: 0.173473 Aug 29 16:25:34.883679 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3956/7688] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:34 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:35.909057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2915871c-30f8-4917-8b21-1c32b2ec0299 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:35.909929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2915871c-30f8-4917-8b21-1c32b2ec0299 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:35.912789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:35.919240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2915871c-30f8-4917-8b21-1c32b2ec0299 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:35.919731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2915871c-30f8-4917-8b21-1c32b2ec0299 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:35.920165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2915871c-30f8-4917-8b21-1c32b2ec0299 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:35.920858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2915871c-30f8-4917-8b21-1c32b2ec0299 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:35.921456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2915871c-30f8-4917-8b21-1c32b2ec0299 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:35.921877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2915871c-30f8-4917-8b21-1c32b2ec0299 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:36.058773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2915871c-30f8-4917-8b21-1c32b2ec0299 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:36.066691 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2915871c-30f8-4917-8b21-1c32b2ec0299 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1363 microversion: 2.1 time: 0.164368 Aug 29 16:25:36.067267 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3733/7689] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:35 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:36.087226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-197930be-ad82-4ed0-a7f5-270440815b89 req-be353717-5806-407a-8741-7d7ab498945a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7730fa-cc54-496c-99e2-68e699089960", "name": "network-vif-plugged", "status": "completed", "tag": "764ceb17-45fc-4b56-9aee-8b4ae0b815bd"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:36.093023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:36.093832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:36.103410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-197930be-ad82-4ed0-a7f5-270440815b89 req-be353717-5806-407a-8741-7d7ab498945a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:36.103927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-197930be-ad82-4ed0-a7f5-270440815b89 req-be353717-5806-407a-8741-7d7ab498945a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:36.104381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-197930be-ad82-4ed0-a7f5-270440815b89 req-be353717-5806-407a-8741-7d7ab498945a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:36.116353 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-197930be-ad82-4ed0-a7f5-270440815b89 req-be353717-5806-407a-8741-7d7ab498945a service nova] Creating event network-vif-plugged:764ceb17-45fc-4b56-9aee-8b4ae0b815bd for instance 8c7730fa-cc54-496c-99e2-68e699089960 on n-h1-839401-11 Aug 29 16:25:36.121853 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-197930be-ad82-4ed0-a7f5-270440815b89 req-be353717-5806-407a-8741-7d7ab498945a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039329 Aug 29 16:25:36.122473 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3957/7690] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:37.092822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e70103b3-2dba-4357-9786-1ab7841f33ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:37.093915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e70103b3-2dba-4357-9786-1ab7841f33ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:37.106430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e70103b3-2dba-4357-9786-1ab7841f33ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:37.107129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e70103b3-2dba-4357-9786-1ab7841f33ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:37.107813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e70103b3-2dba-4357-9786-1ab7841f33ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:37.108988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e70103b3-2dba-4357-9786-1ab7841f33ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:37.109795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e70103b3-2dba-4357-9786-1ab7841f33ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:37.110548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e70103b3-2dba-4357-9786-1ab7841f33ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:37.254137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e70103b3-2dba-4357-9786-1ab7841f33ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:37.266289 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e70103b3-2dba-4357-9786-1ab7841f33ae tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1363 microversion: 2.1 time: 0.179876 Aug 29 16:25:37.267272 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3734/7691] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:37 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:38.290020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4aa87ea3-cdaa-4f25-82e7-c72f67498cb9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:38.290777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4aa87ea3-cdaa-4f25-82e7-c72f67498cb9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:38.299005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4aa87ea3-cdaa-4f25-82e7-c72f67498cb9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:38.299562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4aa87ea3-cdaa-4f25-82e7-c72f67498cb9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:38.299994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4aa87ea3-cdaa-4f25-82e7-c72f67498cb9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:38.300796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4aa87ea3-cdaa-4f25-82e7-c72f67498cb9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:38.301362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4aa87ea3-cdaa-4f25-82e7-c72f67498cb9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:38.301844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4aa87ea3-cdaa-4f25-82e7-c72f67498cb9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:38.449926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4aa87ea3-cdaa-4f25-82e7-c72f67498cb9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:38.458869 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4aa87ea3-cdaa-4f25-82e7-c72f67498cb9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1550 microversion: 2.1 time: 0.173943 Aug 29 16:25:38.459842 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3958/7692] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:38 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1550 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:38.480775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-00899198-e270-47c3-a510-4c69c3b54d50 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:38.481298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-00899198-e270-47c3-a510-4c69c3b54d50 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:38.488683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00899198-e270-47c3-a510-4c69c3b54d50 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:38.489201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00899198-e270-47c3-a510-4c69c3b54d50 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:38.489640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00899198-e270-47c3-a510-4c69c3b54d50 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:38.490328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00899198-e270-47c3-a510-4c69c3b54d50 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:38.490791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00899198-e270-47c3-a510-4c69c3b54d50 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:38.491220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00899198-e270-47c3-a510-4c69c3b54d50 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:38.581943 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-00899198-e270-47c3-a510-4c69c3b54d50 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105260 Aug 29 16:25:38.582580 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3735/7693] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 16:25:38 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:40.009979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c26cb2ac-3c79-42dc-a9ed-f98e0f9cb8d4 req-d14dccf8-3aaf-470f-b2a2-9b0f64c882a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7730fa-cc54-496c-99e2-68e699089960", "tag": "764ceb17-45fc-4b56-9aee-8b4ae0b815bd"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:40.019340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c26cb2ac-3c79-42dc-a9ed-f98e0f9cb8d4 req-d14dccf8-3aaf-470f-b2a2-9b0f64c882a6 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:40.019840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c26cb2ac-3c79-42dc-a9ed-f98e0f9cb8d4 req-d14dccf8-3aaf-470f-b2a2-9b0f64c882a6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:40.020293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c26cb2ac-3c79-42dc-a9ed-f98e0f9cb8d4 req-d14dccf8-3aaf-470f-b2a2-9b0f64c882a6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:40.031689 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c26cb2ac-3c79-42dc-a9ed-f98e0f9cb8d4 req-d14dccf8-3aaf-470f-b2a2-9b0f64c882a6 service nova] Creating event network-changed:764ceb17-45fc-4b56-9aee-8b4ae0b815bd for instance 8c7730fa-cc54-496c-99e2-68e699089960 on n-h1-839401-11 Aug 29 16:25:40.036921 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c26cb2ac-3c79-42dc-a9ed-f98e0f9cb8d4 req-d14dccf8-3aaf-470f-b2a2-9b0f64c882a6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081606 Aug 29 16:25:40.037904 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3959/7694] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:26:51.968127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:51.969307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=92,nova_cell1:UPDATE=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:52.021682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-23cbf8b4-2850-420b-954c-3428fb204c52 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:26:52.024052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-23cbf8b4-2850-420b-954c-3428fb204c52 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:52.030165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23cbf8b4-2850-420b-954c-3428fb204c52 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:52.030659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23cbf8b4-2850-420b-954c-3428fb204c52 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:52.031101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23cbf8b4-2850-420b-954c-3428fb204c52 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:52.031793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23cbf8b4-2850-420b-954c-3428fb204c52 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:52.032255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23cbf8b4-2850-420b-954c-3428fb204c52 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:52.032682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-23cbf8b4-2850-420b-954c-3428fb204c52 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:52.064499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-23cbf8b4-2850-420b-954c-3428fb204c52 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:52.073959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-23cbf8b4-2850-420b-954c-3428fb204c52 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Old instance type m1.heat2, new instance type m1.heat {{(pid=122361) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:26:52.080910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-23cbf8b4-2850-420b-954c-3428fb204c52 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:26:52.081385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-23cbf8b4-2850-420b-954c-3428fb204c52 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:26:52.081875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-23cbf8b4-2850-420b-954c-3428fb204c52 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:26:52.082296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-23cbf8b4-2850-420b-954c-3428fb204c52 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:26:52.082712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-23cbf8b4-2850-420b-954c-3428fb204c52 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:26:52.152734 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-23cbf8b4-2850-420b-954c-3428fb204c52 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "POST /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960/action" status: 202 len: 0 microversion: 2.1 time: 0.187495 Aug 29 16:26:52.153411 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3736/7695] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:26:51 2022] POST /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:26:52.160731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:52.161538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=62 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:26:52.167654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-70962ddf-e356-4963-9e2e-5330753aac5f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:52.168377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-70962ddf-e356-4963-9e2e-5330753aac5f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:52.176340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70962ddf-e356-4963-9e2e-5330753aac5f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:52.176825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70962ddf-e356-4963-9e2e-5330753aac5f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:52.177313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70962ddf-e356-4963-9e2e-5330753aac5f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:52.178046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70962ddf-e356-4963-9e2e-5330753aac5f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:52.178519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70962ddf-e356-4963-9e2e-5330753aac5f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:52.178983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-70962ddf-e356-4963-9e2e-5330753aac5f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:52.316139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-70962ddf-e356-4963-9e2e-5330753aac5f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:52.323999 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-70962ddf-e356-4963-9e2e-5330753aac5f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1677 microversion: 2.1 time: 0.166095 Aug 29 16:26:52.324587 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3960/7696] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:52 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:53.348371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f08524b5-a1e5-438c-82d6-92dfa52f29f3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:53.349054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f08524b5-a1e5-438c-82d6-92dfa52f29f3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:53.356013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f08524b5-a1e5-438c-82d6-92dfa52f29f3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:53.356783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f08524b5-a1e5-438c-82d6-92dfa52f29f3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:53.357278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f08524b5-a1e5-438c-82d6-92dfa52f29f3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:53.357995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f08524b5-a1e5-438c-82d6-92dfa52f29f3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:53.358435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f08524b5-a1e5-438c-82d6-92dfa52f29f3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:53.359069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f08524b5-a1e5-438c-82d6-92dfa52f29f3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:53.497347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f08524b5-a1e5-438c-82d6-92dfa52f29f3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:53.507299 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f08524b5-a1e5-438c-82d6-92dfa52f29f3 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1677 microversion: 2.1 time: 0.164429 Aug 29 16:26:53.508087 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3737/7697] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:53 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:54.533183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-32488ef4-736f-480a-8468-99b965030291 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:54.534036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-32488ef4-736f-480a-8468-99b965030291 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:54.542923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32488ef4-736f-480a-8468-99b965030291 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:54.543423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32488ef4-736f-480a-8468-99b965030291 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:54.543877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32488ef4-736f-480a-8468-99b965030291 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:54.544597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32488ef4-736f-480a-8468-99b965030291 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:54.545068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32488ef4-736f-480a-8468-99b965030291 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:54.545522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-32488ef4-736f-480a-8468-99b965030291 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:54.690721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-32488ef4-736f-480a-8468-99b965030291 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:54.699004 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-32488ef4-736f-480a-8468-99b965030291 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1682 microversion: 2.1 time: 0.172379 Aug 29 16:26:54.699613 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3961/7698] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:54 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:55.724837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ec8f222b-2dbb-491a-a4bf-c12c67ab463f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:55.725866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ec8f222b-2dbb-491a-a4bf-c12c67ab463f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:55.737500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec8f222b-2dbb-491a-a4bf-c12c67ab463f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:55.737989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec8f222b-2dbb-491a-a4bf-c12c67ab463f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:55.738427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec8f222b-2dbb-491a-a4bf-c12c67ab463f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:55.739123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec8f222b-2dbb-491a-a4bf-c12c67ab463f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:55.739580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec8f222b-2dbb-491a-a4bf-c12c67ab463f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:55.740020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec8f222b-2dbb-491a-a4bf-c12c67ab463f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:55.878858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ec8f222b-2dbb-491a-a4bf-c12c67ab463f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:55.887471 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ec8f222b-2dbb-491a-a4bf-c12c67ab463f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1682 microversion: 2.1 time: 0.169685 Aug 29 16:26:55.888036 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3738/7699] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:55 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:56.913478 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65e2b0b9-b760-4f6c-9e2b-26a6817d98d2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:56.914504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-65e2b0b9-b760-4f6c-9e2b-26a6817d98d2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:56.925734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65e2b0b9-b760-4f6c-9e2b-26a6817d98d2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:56.926250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65e2b0b9-b760-4f6c-9e2b-26a6817d98d2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:56.926655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65e2b0b9-b760-4f6c-9e2b-26a6817d98d2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:56.927409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65e2b0b9-b760-4f6c-9e2b-26a6817d98d2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:56.927876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65e2b0b9-b760-4f6c-9e2b-26a6817d98d2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:56.928683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65e2b0b9-b760-4f6c-9e2b-26a6817d98d2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:57.069040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-65e2b0b9-b760-4f6c-9e2b-26a6817d98d2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:57.080343 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-65e2b0b9-b760-4f6c-9e2b-26a6817d98d2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1682 microversion: 2.1 time: 0.173722 Aug 29 16:26:57.081111 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3962/7700] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:56 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:58.106844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b2bef0b6-0d0b-4dc2-85cb-81353a7ad02e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:58.107746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b2bef0b6-0d0b-4dc2-85cb-81353a7ad02e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:58.119118 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2bef0b6-0d0b-4dc2-85cb-81353a7ad02e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:58.119938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2bef0b6-0d0b-4dc2-85cb-81353a7ad02e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:58.120672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2bef0b6-0d0b-4dc2-85cb-81353a7ad02e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:58.121903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2bef0b6-0d0b-4dc2-85cb-81353a7ad02e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:58.122679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2bef0b6-0d0b-4dc2-85cb-81353a7ad02e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:58.123409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2bef0b6-0d0b-4dc2-85cb-81353a7ad02e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:58.270957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b2bef0b6-0d0b-4dc2-85cb-81353a7ad02e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:58.283200 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b2bef0b6-0d0b-4dc2-85cb-81353a7ad02e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1682 microversion: 2.1 time: 0.182922 Aug 29 16:26:58.283859 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3739/7701] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:58 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:26:59.308338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8e65d445-df43-44fc-9a75-0688dce84dc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:26:59.309390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8e65d445-df43-44fc-9a75-0688dce84dc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:26:59.320339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e65d445-df43-44fc-9a75-0688dce84dc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:59.321139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e65d445-df43-44fc-9a75-0688dce84dc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:59.321880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e65d445-df43-44fc-9a75-0688dce84dc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:59.322992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e65d445-df43-44fc-9a75-0688dce84dc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:26:59.323719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e65d445-df43-44fc-9a75-0688dce84dc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:26:59.325249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8e65d445-df43-44fc-9a75-0688dce84dc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:26:59.462452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8e65d445-df43-44fc-9a75-0688dce84dc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:26:59.474458 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8e65d445-df43-44fc-9a75-0688dce84dc9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1682 microversion: 2.1 time: 0.172058 Aug 29 16:26:59.475260 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3963/7702] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:26:59 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:00.504107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c602151d-6f52-46a5-bc2e-2a4596045e43 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:00.504695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c602151d-6f52-46a5-bc2e-2a4596045e43 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:00.511789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c602151d-6f52-46a5-bc2e-2a4596045e43 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:00.512281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c602151d-6f52-46a5-bc2e-2a4596045e43 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:00.512720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c602151d-6f52-46a5-bc2e-2a4596045e43 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:00.513453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c602151d-6f52-46a5-bc2e-2a4596045e43 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:00.513916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c602151d-6f52-46a5-bc2e-2a4596045e43 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:00.514351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c602151d-6f52-46a5-bc2e-2a4596045e43 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:00.651719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c602151d-6f52-46a5-bc2e-2a4596045e43 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:00.661897 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c602151d-6f52-46a5-bc2e-2a4596045e43 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1682 microversion: 2.1 time: 0.164370 Aug 29 16:27:00.662497 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3740/7703] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:00 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:01.692504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-921f8e8f-af57-4fce-b6c6-c961cf967792 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:01.693659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-921f8e8f-af57-4fce-b6c6-c961cf967792 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:01.705588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-921f8e8f-af57-4fce-b6c6-c961cf967792 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:01.706125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-921f8e8f-af57-4fce-b6c6-c961cf967792 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:01.706574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-921f8e8f-af57-4fce-b6c6-c961cf967792 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:01.707296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-921f8e8f-af57-4fce-b6c6-c961cf967792 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:01.707738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-921f8e8f-af57-4fce-b6c6-c961cf967792 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:01.708216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-921f8e8f-af57-4fce-b6c6-c961cf967792 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:01.855644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-921f8e8f-af57-4fce-b6c6-c961cf967792 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:01.864583 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-921f8e8f-af57-4fce-b6c6-c961cf967792 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1682 microversion: 2.1 time: 0.179044 Aug 29 16:27:01.865257 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3964/7704] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:01 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:02.888428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b98720d-0e3d-4f6a-bbf8-f63ebf1f6bfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:02.889041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4b98720d-0e3d-4f6a-bbf8-f63ebf1f6bfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:02.897558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b98720d-0e3d-4f6a-bbf8-f63ebf1f6bfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:02.898040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b98720d-0e3d-4f6a-bbf8-f63ebf1f6bfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:02.898498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b98720d-0e3d-4f6a-bbf8-f63ebf1f6bfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:02.899194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b98720d-0e3d-4f6a-bbf8-f63ebf1f6bfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:02.899648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b98720d-0e3d-4f6a-bbf8-f63ebf1f6bfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:02.900064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b98720d-0e3d-4f6a-bbf8-f63ebf1f6bfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:03.038487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4b98720d-0e3d-4f6a-bbf8-f63ebf1f6bfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:03.046676 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4b98720d-0e3d-4f6a-bbf8-f63ebf1f6bfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1682 microversion: 2.1 time: 0.163081 Aug 29 16:27:03.047253 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3741/7705] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:02 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:04.069502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f26172b3-a3bd-487b-9784-05ec5f0704ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:04.070240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f26172b3-a3bd-487b-9784-05ec5f0704ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:04.080165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f26172b3-a3bd-487b-9784-05ec5f0704ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:04.080800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f26172b3-a3bd-487b-9784-05ec5f0704ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:04.081437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f26172b3-a3bd-487b-9784-05ec5f0704ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:04.082338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f26172b3-a3bd-487b-9784-05ec5f0704ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:04.082929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f26172b3-a3bd-487b-9784-05ec5f0704ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:04.083488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f26172b3-a3bd-487b-9784-05ec5f0704ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:04.225697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f26172b3-a3bd-487b-9784-05ec5f0704ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:04.238017 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f26172b3-a3bd-487b-9784-05ec5f0704ab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1682 microversion: 2.1 time: 0.173316 Aug 29 16:27:04.238687 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3965/7706] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:04 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:05.270131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-41209ded-b961-46c9-b72e-0e0c0216edb0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:05.270720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-41209ded-b961-46c9-b72e-0e0c0216edb0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:05.278343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41209ded-b961-46c9-b72e-0e0c0216edb0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:05.278871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41209ded-b961-46c9-b72e-0e0c0216edb0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:05.279332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41209ded-b961-46c9-b72e-0e0c0216edb0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:05.280073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41209ded-b961-46c9-b72e-0e0c0216edb0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:05.280570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41209ded-b961-46c9-b72e-0e0c0216edb0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:05.281023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41209ded-b961-46c9-b72e-0e0c0216edb0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:05.433617 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-41209ded-b961-46c9-b72e-0e0c0216edb0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:05.444339 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-41209ded-b961-46c9-b72e-0e0c0216edb0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1682 microversion: 2.1 time: 0.180889 Aug 29 16:27:05.444955 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3742/7707] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:05 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:06.468324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a9c021f6-fd8c-4e74-86fc-9c06c6d35815 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:06.469357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a9c021f6-fd8c-4e74-86fc-9c06c6d35815 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:06.476735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9c021f6-fd8c-4e74-86fc-9c06c6d35815 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:06.477360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9c021f6-fd8c-4e74-86fc-9c06c6d35815 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:06.478030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9c021f6-fd8c-4e74-86fc-9c06c6d35815 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:06.478834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9c021f6-fd8c-4e74-86fc-9c06c6d35815 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:06.479371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9c021f6-fd8c-4e74-86fc-9c06c6d35815 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:06.479928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a9c021f6-fd8c-4e74-86fc-9c06c6d35815 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:06.619011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a9c021f6-fd8c-4e74-86fc-9c06c6d35815 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:06.627212 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a9c021f6-fd8c-4e74-86fc-9c06c6d35815 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1682 microversion: 2.1 time: 0.163083 Aug 29 16:27:06.627920 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3966/7708] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:06 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:07.023519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-66102041-f1a3-4793-88e7-7835f68f76e8 req-979783a4-5367-411a-ab9f-f86556fcc4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7730fa-cc54-496c-99e2-68e699089960", "name": "network-vif-unplugged", "status": "completed", "tag": "764ceb17-45fc-4b56-9aee-8b4ae0b815bd"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:07.035530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-66102041-f1a3-4793-88e7-7835f68f76e8 req-979783a4-5367-411a-ab9f-f86556fcc4b4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:07.036467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-66102041-f1a3-4793-88e7-7835f68f76e8 req-979783a4-5367-411a-ab9f-f86556fcc4b4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:07.037159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-66102041-f1a3-4793-88e7-7835f68f76e8 req-979783a4-5367-411a-ab9f-f86556fcc4b4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:07.050781 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-66102041-f1a3-4793-88e7-7835f68f76e8 req-979783a4-5367-411a-ab9f-f86556fcc4b4 service nova] Creating event network-vif-unplugged:764ceb17-45fc-4b56-9aee-8b4ae0b815bd for instance 8c7730fa-cc54-496c-99e2-68e699089960 on n-h2-839401-11 Aug 29 16:27:07.056415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-66102041-f1a3-4793-88e7-7835f68f76e8 req-979783a4-5367-411a-ab9f-f86556fcc4b4 service nova] Instance 8c7730fa-cc54-496c-99e2-68e699089960 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:27:07.069890 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-66102041-f1a3-4793-88e7-7835f68f76e8 req-979783a4-5367-411a-ab9f-f86556fcc4b4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050229 Aug 29 16:27:07.070793 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3743/7709] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:27:07.648943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3168222e-aa33-46bf-9263-e9aa0732f2cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:07.649715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3168222e-aa33-46bf-9263-e9aa0732f2cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:07.657560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3168222e-aa33-46bf-9263-e9aa0732f2cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:07.658073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3168222e-aa33-46bf-9263-e9aa0732f2cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:07.658531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3168222e-aa33-46bf-9263-e9aa0732f2cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:07.659254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3168222e-aa33-46bf-9263-e9aa0732f2cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:07.659762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3168222e-aa33-46bf-9263-e9aa0732f2cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:07.660454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3168222e-aa33-46bf-9263-e9aa0732f2cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:07.802316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3168222e-aa33-46bf-9263-e9aa0732f2cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:07.810385 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3168222e-aa33-46bf-9263-e9aa0732f2cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1681 microversion: 2.1 time: 0.165514 Aug 29 16:27:07.810966 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3967/7710] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:07 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:08.836130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fb038dd8-cd27-42a0-9e27-2593a68c763a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:08.836852 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fb038dd8-cd27-42a0-9e27-2593a68c763a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:08.844215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb038dd8-cd27-42a0-9e27-2593a68c763a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:08.844740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb038dd8-cd27-42a0-9e27-2593a68c763a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:08.845220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb038dd8-cd27-42a0-9e27-2593a68c763a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:08.845933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb038dd8-cd27-42a0-9e27-2593a68c763a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:08.846423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb038dd8-cd27-42a0-9e27-2593a68c763a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:08.846849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb038dd8-cd27-42a0-9e27-2593a68c763a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:08.988661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fb038dd8-cd27-42a0-9e27-2593a68c763a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:09.001171 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fb038dd8-cd27-42a0-9e27-2593a68c763a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1679 microversion: 2.1 time: 0.170738 Aug 29 16:27:09.002203 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3744/7711] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:08 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:09.420165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-7ac1779f-bf84-4095-b886-ff79d9ec8511 req-a9e312cb-c8d1-4282-84ed-e78ee39fd0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7730fa-cc54-496c-99e2-68e699089960", "tag": "764ceb17-45fc-4b56-9aee-8b4ae0b815bd"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:09.433378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7ac1779f-bf84-4095-b886-ff79d9ec8511 req-a9e312cb-c8d1-4282-84ed-e78ee39fd0f2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:09.433868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7ac1779f-bf84-4095-b886-ff79d9ec8511 req-a9e312cb-c8d1-4282-84ed-e78ee39fd0f2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:09.434313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7ac1779f-bf84-4095-b886-ff79d9ec8511 req-a9e312cb-c8d1-4282-84ed-e78ee39fd0f2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:09.446562 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-7ac1779f-bf84-4095-b886-ff79d9ec8511 req-a9e312cb-c8d1-4282-84ed-e78ee39fd0f2 service nova] Creating event network-changed:764ceb17-45fc-4b56-9aee-8b4ae0b815bd for instance 8c7730fa-cc54-496c-99e2-68e699089960 on n-h2-839401-11 Aug 29 16:27:09.452327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-7ac1779f-bf84-4095-b886-ff79d9ec8511 req-a9e312cb-c8d1-4282-84ed-e78ee39fd0f2 service nova] Instance 8c7730fa-cc54-496c-99e2-68e699089960 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:27:09.463606 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-7ac1779f-bf84-4095-b886-ff79d9ec8511 req-a9e312cb-c8d1-4282-84ed-e78ee39fd0f2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049853 Aug 29 16:27:09.464200 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3968/7712] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:27:10.022659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ab6fc316-8c03-4aac-bc1a-4963204b6d40 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:10.023229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ab6fc316-8c03-4aac-bc1a-4963204b6d40 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:10.030036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab6fc316-8c03-4aac-bc1a-4963204b6d40 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:10.030526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab6fc316-8c03-4aac-bc1a-4963204b6d40 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:10.030967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab6fc316-8c03-4aac-bc1a-4963204b6d40 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:10.031650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab6fc316-8c03-4aac-bc1a-4963204b6d40 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:10.032315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab6fc316-8c03-4aac-bc1a-4963204b6d40 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:10.032749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ab6fc316-8c03-4aac-bc1a-4963204b6d40 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:10.172719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ab6fc316-8c03-4aac-bc1a-4963204b6d40 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:10.181123 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ab6fc316-8c03-4aac-bc1a-4963204b6d40 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1679 microversion: 2.1 time: 0.162652 Aug 29 16:27:10.181788 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3745/7713] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:10 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:11.203297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ba55c59a-aeda-4e9d-9fc9-3f134a12631b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:11.203979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ba55c59a-aeda-4e9d-9fc9-3f134a12631b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:11.210761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba55c59a-aeda-4e9d-9fc9-3f134a12631b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:11.211223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba55c59a-aeda-4e9d-9fc9-3f134a12631b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:11.211698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba55c59a-aeda-4e9d-9fc9-3f134a12631b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:11.212458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba55c59a-aeda-4e9d-9fc9-3f134a12631b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:11.212931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba55c59a-aeda-4e9d-9fc9-3f134a12631b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:11.213403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ba55c59a-aeda-4e9d-9fc9-3f134a12631b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:11.364310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ba55c59a-aeda-4e9d-9fc9-3f134a12631b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:11.375190 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ba55c59a-aeda-4e9d-9fc9-3f134a12631b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1679 microversion: 2.1 time: 0.177000 Aug 29 16:27:11.376451 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3969/7714] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:11 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:12.397983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-81ee9e86-2d63-4f13-a55f-6fe8b0f63fc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:12.398594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-81ee9e86-2d63-4f13-a55f-6fe8b0f63fc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:12.405837 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81ee9e86-2d63-4f13-a55f-6fe8b0f63fc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:12.406334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81ee9e86-2d63-4f13-a55f-6fe8b0f63fc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:12.406766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81ee9e86-2d63-4f13-a55f-6fe8b0f63fc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:12.407469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81ee9e86-2d63-4f13-a55f-6fe8b0f63fc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:12.407923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81ee9e86-2d63-4f13-a55f-6fe8b0f63fc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:12.408350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-81ee9e86-2d63-4f13-a55f-6fe8b0f63fc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:12.543018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-81ee9e86-2d63-4f13-a55f-6fe8b0f63fc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:12.554126 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-81ee9e86-2d63-4f13-a55f-6fe8b0f63fc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1676 microversion: 2.1 time: 0.160228 Aug 29 16:27:12.554729 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3746/7715] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:12 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:12.577743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:12.578671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:12.590165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:12.590885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:12.591633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:12.592794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:12.593922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:12.594663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:12.634923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:12.635458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:12.635905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:12.636640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:12.637126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:12.637574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:12.658093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Getting quotas for project 1a3432e106e74db480a1f7a17af514fb. Resources: {'ram', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:27:12.663775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Getting quotas for user 6658968475ea487ea0aba9be50d861fe and project 1a3432e106e74db480a1f7a17af514fb. Resources: {'ram', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:27:12.773289 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-65f8c668-4a93-4487-8526-5936930f8fab tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "POST /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960/action" status: 202 len: 0 microversion: 2.1 time: 0.201797 Aug 29 16:27:12.773920 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3970/7716] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:27:12 2022] POST /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:27:12.782440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3a29aed1-dfc7-46be-95a0-abaf9229407e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:12.783089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3a29aed1-dfc7-46be-95a0-abaf9229407e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:12.789508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a29aed1-dfc7-46be-95a0-abaf9229407e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:12.790003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a29aed1-dfc7-46be-95a0-abaf9229407e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:12.790430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a29aed1-dfc7-46be-95a0-abaf9229407e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:12.791150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a29aed1-dfc7-46be-95a0-abaf9229407e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:12.791601 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a29aed1-dfc7-46be-95a0-abaf9229407e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:12.792032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a29aed1-dfc7-46be-95a0-abaf9229407e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:12.998434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3a29aed1-dfc7-46be-95a0-abaf9229407e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:13.011551 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3a29aed1-dfc7-46be-95a0-abaf9229407e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1675 microversion: 2.1 time: 0.232760 Aug 29 16:27:13.012388 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3747/7717] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:12 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:13.914078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-52cbc1a5-189b-4f3a-ae45-db431ad93d2f req-d0e946c9-0f37-40c0-8081-d44a6633736c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7730fa-cc54-496c-99e2-68e699089960", "name": "network-vif-plugged", "status": "completed", "tag": "764ceb17-45fc-4b56-9aee-8b4ae0b815bd"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:13.925525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-52cbc1a5-189b-4f3a-ae45-db431ad93d2f req-d0e946c9-0f37-40c0-8081-d44a6633736c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:13.926026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-52cbc1a5-189b-4f3a-ae45-db431ad93d2f req-d0e946c9-0f37-40c0-8081-d44a6633736c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:13.926464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-52cbc1a5-189b-4f3a-ae45-db431ad93d2f req-d0e946c9-0f37-40c0-8081-d44a6633736c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:13.939955 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-52cbc1a5-189b-4f3a-ae45-db431ad93d2f req-d0e946c9-0f37-40c0-8081-d44a6633736c service nova] Creating event network-vif-plugged:764ceb17-45fc-4b56-9aee-8b4ae0b815bd for instance 8c7730fa-cc54-496c-99e2-68e699089960 on n-h2-839401-11 Aug 29 16:27:13.945680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-52cbc1a5-189b-4f3a-ae45-db431ad93d2f req-d0e946c9-0f37-40c0-8081-d44a6633736c service nova] Instance 8c7730fa-cc54-496c-99e2-68e699089960 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:27:13.957153 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-52cbc1a5-189b-4f3a-ae45-db431ad93d2f req-d0e946c9-0f37-40c0-8081-d44a6633736c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048095 Aug 29 16:27:13.958198 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3971/7718] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:27:14.033962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c159ebf6-ff40-40b1-a622-f329ffdb7181 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:14.034506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c159ebf6-ff40-40b1-a622-f329ffdb7181 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:14.043239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c159ebf6-ff40-40b1-a622-f329ffdb7181 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:14.043889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c159ebf6-ff40-40b1-a622-f329ffdb7181 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:14.044529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c159ebf6-ff40-40b1-a622-f329ffdb7181 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:14.045873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c159ebf6-ff40-40b1-a622-f329ffdb7181 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:14.046481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c159ebf6-ff40-40b1-a622-f329ffdb7181 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:14.047083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c159ebf6-ff40-40b1-a622-f329ffdb7181 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:14.195581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c159ebf6-ff40-40b1-a622-f329ffdb7181 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:14.203570 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c159ebf6-ff40-40b1-a622-f329ffdb7181 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1675 microversion: 2.1 time: 0.173799 Aug 29 16:27:14.204156 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3748/7719] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:14 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:15.232320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dbbe940c-4af0-40dc-a875-ec64f63f1222 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:15.233428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dbbe940c-4af0-40dc-a875-ec64f63f1222 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:15.243299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbbe940c-4af0-40dc-a875-ec64f63f1222 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:15.243887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbbe940c-4af0-40dc-a875-ec64f63f1222 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:15.244343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbbe940c-4af0-40dc-a875-ec64f63f1222 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:15.245040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbbe940c-4af0-40dc-a875-ec64f63f1222 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:15.245539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbbe940c-4af0-40dc-a875-ec64f63f1222 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:15.245971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbbe940c-4af0-40dc-a875-ec64f63f1222 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:15.384428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dbbe940c-4af0-40dc-a875-ec64f63f1222 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:15.393962 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dbbe940c-4af0-40dc-a875-ec64f63f1222 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1675 microversion: 2.1 time: 0.170502 Aug 29 16:27:15.394711 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3972/7720] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:15 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:16.121554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b438e4d1-8bc0-400c-b720-d3cdf40ca069 req-611c8b19-0c74-401e-93cb-c67994d96dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7730fa-cc54-496c-99e2-68e699089960", "name": "network-vif-unplugged", "status": "completed", "tag": "764ceb17-45fc-4b56-9aee-8b4ae0b815bd"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:16.133701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b438e4d1-8bc0-400c-b720-d3cdf40ca069 req-611c8b19-0c74-401e-93cb-c67994d96dd1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:16.134199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b438e4d1-8bc0-400c-b720-d3cdf40ca069 req-611c8b19-0c74-401e-93cb-c67994d96dd1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:16.134631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b438e4d1-8bc0-400c-b720-d3cdf40ca069 req-611c8b19-0c74-401e-93cb-c67994d96dd1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:16.147060 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b438e4d1-8bc0-400c-b720-d3cdf40ca069 req-611c8b19-0c74-401e-93cb-c67994d96dd1 service nova] Creating event network-vif-unplugged:764ceb17-45fc-4b56-9aee-8b4ae0b815bd for instance 8c7730fa-cc54-496c-99e2-68e699089960 on n-h1-839401-11 Aug 29 16:27:16.152619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-b438e4d1-8bc0-400c-b720-d3cdf40ca069 req-611c8b19-0c74-401e-93cb-c67994d96dd1 service nova] Instance 8c7730fa-cc54-496c-99e2-68e699089960 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:27:16.163816 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b438e4d1-8bc0-400c-b720-d3cdf40ca069 req-611c8b19-0c74-401e-93cb-c67994d96dd1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046085 Aug 29 16:27:16.164501 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3749/7721] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:27:16.417633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-455c11c2-afeb-4e2c-961f-8202a562c957 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:16.418472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-455c11c2-afeb-4e2c-961f-8202a562c957 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:16.425330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-455c11c2-afeb-4e2c-961f-8202a562c957 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:16.425811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-455c11c2-afeb-4e2c-961f-8202a562c957 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:16.426267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-455c11c2-afeb-4e2c-961f-8202a562c957 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:16.426972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-455c11c2-afeb-4e2c-961f-8202a562c957 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:16.427439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-455c11c2-afeb-4e2c-961f-8202a562c957 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:16.427879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-455c11c2-afeb-4e2c-961f-8202a562c957 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:16.567091 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-455c11c2-afeb-4e2c-961f-8202a562c957 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:16.575210 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-455c11c2-afeb-4e2c-961f-8202a562c957 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1675 microversion: 2.1 time: 0.161497 Aug 29 16:27:16.575815 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3973/7722] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:16 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:17.603257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6b03785e-dab7-4f51-8849-ce39a8ef9372 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:17.604250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6b03785e-dab7-4f51-8849-ce39a8ef9372 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:17.614973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b03785e-dab7-4f51-8849-ce39a8ef9372 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:17.615774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b03785e-dab7-4f51-8849-ce39a8ef9372 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:17.616490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b03785e-dab7-4f51-8849-ce39a8ef9372 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:17.617470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b03785e-dab7-4f51-8849-ce39a8ef9372 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:17.617930 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b03785e-dab7-4f51-8849-ce39a8ef9372 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:17.618351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b03785e-dab7-4f51-8849-ce39a8ef9372 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:17.768507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6b03785e-dab7-4f51-8849-ce39a8ef9372 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:17.776853 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6b03785e-dab7-4f51-8849-ce39a8ef9372 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1675 microversion: 2.1 time: 0.182448 Aug 29 16:27:17.777479 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3750/7723] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:17 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:18.210153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-f05ee2e0-5439-4a98-b75e-6d3ef77b0bfa req-10ffb93d-dbcc-4cd5-9505-6c3d5b882090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7730fa-cc54-496c-99e2-68e699089960", "tag": "764ceb17-45fc-4b56-9aee-8b4ae0b815bd"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:18.222271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f05ee2e0-5439-4a98-b75e-6d3ef77b0bfa req-10ffb93d-dbcc-4cd5-9505-6c3d5b882090 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:18.222770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f05ee2e0-5439-4a98-b75e-6d3ef77b0bfa req-10ffb93d-dbcc-4cd5-9505-6c3d5b882090 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:18.223222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f05ee2e0-5439-4a98-b75e-6d3ef77b0bfa req-10ffb93d-dbcc-4cd5-9505-6c3d5b882090 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:18.227234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:18.236102 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-f05ee2e0-5439-4a98-b75e-6d3ef77b0bfa req-10ffb93d-dbcc-4cd5-9505-6c3d5b882090 service nova] Creating event network-changed:764ceb17-45fc-4b56-9aee-8b4ae0b815bd for instance 8c7730fa-cc54-496c-99e2-68e699089960 on n-h1-839401-11 Aug 29 16:27:18.242940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-f05ee2e0-5439-4a98-b75e-6d3ef77b0bfa req-10ffb93d-dbcc-4cd5-9505-6c3d5b882090 service nova] Instance 8c7730fa-cc54-496c-99e2-68e699089960 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:27:18.253655 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-f05ee2e0-5439-4a98-b75e-6d3ef77b0bfa req-10ffb93d-dbcc-4cd5-9505-6c3d5b882090 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050018 Aug 29 16:27:18.254266 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3974/7724] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:27:18.798284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2e2eee8f-720e-42d5-82c4-bacf80e761ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:18.798933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2e2eee8f-720e-42d5-82c4-bacf80e761ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:18.806267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e2eee8f-720e-42d5-82c4-bacf80e761ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:18.806772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e2eee8f-720e-42d5-82c4-bacf80e761ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:18.807223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e2eee8f-720e-42d5-82c4-bacf80e761ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:18.807947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e2eee8f-720e-42d5-82c4-bacf80e761ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:18.808409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e2eee8f-720e-42d5-82c4-bacf80e761ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:18.808844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2e2eee8f-720e-42d5-82c4-bacf80e761ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:19.155169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2e2eee8f-720e-42d5-82c4-bacf80e761ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:19.159010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:19.163854 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2e2eee8f-720e-42d5-82c4-bacf80e761ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1675 microversion: 2.1 time: 0.369615 Aug 29 16:27:19.164461 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3751/7725] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:18 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1675 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:20.187103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85193000-3085-4177-9ef4-2e957d55a476 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:20.187891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-85193000-3085-4177-9ef4-2e957d55a476 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:20.195371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85193000-3085-4177-9ef4-2e957d55a476 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:20.195933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85193000-3085-4177-9ef4-2e957d55a476 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:20.196418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85193000-3085-4177-9ef4-2e957d55a476 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:20.197307 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85193000-3085-4177-9ef4-2e957d55a476 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:20.198444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85193000-3085-4177-9ef4-2e957d55a476 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:20.198931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85193000-3085-4177-9ef4-2e957d55a476 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:20.345363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-85193000-3085-4177-9ef4-2e957d55a476 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:20.353909 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85193000-3085-4177-9ef4-2e957d55a476 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1675 microversion: 2.1 time: 0.171959 Aug 29 16:27:20.361223 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3975/7726] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:20 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:21.377713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a33017f5-0fca-47e3-8823-3a87f84b5abc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:21.378380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a33017f5-0fca-47e3-8823-3a87f84b5abc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:21.387337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a33017f5-0fca-47e3-8823-3a87f84b5abc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:21.387868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a33017f5-0fca-47e3-8823-3a87f84b5abc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:21.388351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a33017f5-0fca-47e3-8823-3a87f84b5abc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:21.389134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a33017f5-0fca-47e3-8823-3a87f84b5abc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:21.389619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a33017f5-0fca-47e3-8823-3a87f84b5abc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:21.390128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a33017f5-0fca-47e3-8823-3a87f84b5abc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:21.529119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a33017f5-0fca-47e3-8823-3a87f84b5abc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:21.540648 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a33017f5-0fca-47e3-8823-3a87f84b5abc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1668 microversion: 2.1 time: 0.167610 Aug 29 16:27:21.541246 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3752/7727] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:21 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:21.561030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f4a4dff6-cc79-47b4-a6bc-0b60188fe6f4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:21.561698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f4a4dff6-cc79-47b4-a6bc-0b60188fe6f4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:21.568755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4a4dff6-cc79-47b4-a6bc-0b60188fe6f4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:21.569292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4a4dff6-cc79-47b4-a6bc-0b60188fe6f4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:21.569747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4a4dff6-cc79-47b4-a6bc-0b60188fe6f4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:21.570506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4a4dff6-cc79-47b4-a6bc-0b60188fe6f4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:21.570991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4a4dff6-cc79-47b4-a6bc-0b60188fe6f4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:21.571435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4a4dff6-cc79-47b4-a6bc-0b60188fe6f4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:21.721483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f4a4dff6-cc79-47b4-a6bc-0b60188fe6f4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:21.729866 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f4a4dff6-cc79-47b4-a6bc-0b60188fe6f4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1668 microversion: 2.1 time: 0.172884 Aug 29 16:27:21.730453 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3976/7728] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:21 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1668 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:21.753976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a5d85551-5592-4ed6-b78c-0965611d37d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:21.754746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a5d85551-5592-4ed6-b78c-0965611d37d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:21.761779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5d85551-5592-4ed6-b78c-0965611d37d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:21.762268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5d85551-5592-4ed6-b78c-0965611d37d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:21.762703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5d85551-5592-4ed6-b78c-0965611d37d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:21.763394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5d85551-5592-4ed6-b78c-0965611d37d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:21.763857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5d85551-5592-4ed6-b78c-0965611d37d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:21.764281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5d85551-5592-4ed6-b78c-0965611d37d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:21.905237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a5d85551-5592-4ed6-b78c-0965611d37d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:21.917032 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a5d85551-5592-4ed6-b78c-0965611d37d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1668 microversion: 2.1 time: 0.168736 Aug 29 16:27:21.917734 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3753/7729] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:21 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:21.937444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-75b60b08-b107-4869-a44f-06f9614486f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:21.937967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-75b60b08-b107-4869-a44f-06f9614486f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:21.944690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75b60b08-b107-4869-a44f-06f9614486f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:21.945275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75b60b08-b107-4869-a44f-06f9614486f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:21.945762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75b60b08-b107-4869-a44f-06f9614486f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:21.946548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75b60b08-b107-4869-a44f-06f9614486f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:21.947048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75b60b08-b107-4869-a44f-06f9614486f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:21.947552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-75b60b08-b107-4869-a44f-06f9614486f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:21.974544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-75b60b08-b107-4869-a44f-06f9614486f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:27:22.059082 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-75b60b08-b107-4869-a44f-06f9614486f5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 204 len: 0 microversion: 2.1 time: 0.125459 Aug 29 16:27:22.059842 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3977/7730] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:27:21 2022] DELETE /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:27:22.069057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cde56b1d-ce02-437d-a1ba-12a177a2ac3a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:22.069721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cde56b1d-ce02-437d-a1ba-12a177a2ac3a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:22.071610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=41 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:22.077672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde56b1d-ce02-437d-a1ba-12a177a2ac3a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:22.078167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde56b1d-ce02-437d-a1ba-12a177a2ac3a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:22.078607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde56b1d-ce02-437d-a1ba-12a177a2ac3a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:22.079353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde56b1d-ce02-437d-a1ba-12a177a2ac3a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:22.079815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde56b1d-ce02-437d-a1ba-12a177a2ac3a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:22.080244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cde56b1d-ce02-437d-a1ba-12a177a2ac3a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:22.221950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cde56b1d-ce02-437d-a1ba-12a177a2ac3a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:22.232547 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cde56b1d-ce02-437d-a1ba-12a177a2ac3a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1674 microversion: 2.1 time: 0.168198 Aug 29 16:27:22.233118 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3754/7731] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:22 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:23.254518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ee4d54ed-f40b-44e5-b6e0-9f6fd5809d39 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:23.255248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ee4d54ed-f40b-44e5-b6e0-9f6fd5809d39 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:23.258108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:23.258929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:23.264944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4d54ed-f40b-44e5-b6e0-9f6fd5809d39 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:23.265475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4d54ed-f40b-44e5-b6e0-9f6fd5809d39 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:23.265947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4d54ed-f40b-44e5-b6e0-9f6fd5809d39 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:23.266664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4d54ed-f40b-44e5-b6e0-9f6fd5809d39 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:23.267134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4d54ed-f40b-44e5-b6e0-9f6fd5809d39 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:23.267574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee4d54ed-f40b-44e5-b6e0-9f6fd5809d39 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:23.404964 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ee4d54ed-f40b-44e5-b6e0-9f6fd5809d39 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:23.416429 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ee4d54ed-f40b-44e5-b6e0-9f6fd5809d39 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1674 microversion: 2.1 time: 0.166280 Aug 29 16:27:23.417010 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3978/7732] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:23 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:24.438016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0a7dbaa5-c4f8-4360-b9ae-3625663651cd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:24.438611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0a7dbaa5-c4f8-4360-b9ae-3625663651cd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:24.446145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a7dbaa5-c4f8-4360-b9ae-3625663651cd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:24.446762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a7dbaa5-c4f8-4360-b9ae-3625663651cd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:24.447197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a7dbaa5-c4f8-4360-b9ae-3625663651cd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:24.447910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a7dbaa5-c4f8-4360-b9ae-3625663651cd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:24.448366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a7dbaa5-c4f8-4360-b9ae-3625663651cd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:24.448769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0a7dbaa5-c4f8-4360-b9ae-3625663651cd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:24.539495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0a7dbaa5-c4f8-4360-b9ae-3625663651cd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:24.548116 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0a7dbaa5-c4f8-4360-b9ae-3625663651cd tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 200 len: 1607 microversion: 2.1 time: 0.114166 Aug 29 16:27:24.548933 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3755/7733] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:24 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 1607 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:24.815886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-a94659dd-fb22-400c-9428-bd4bc02f8f46 req-85f42b31-3d84-40a4-b0db-31e8ae063f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7730fa-cc54-496c-99e2-68e699089960", "name": "network-vif-deleted", "tag": "764ceb17-45fc-4b56-9aee-8b4ae0b815bd"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:24.828460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a94659dd-fb22-400c-9428-bd4bc02f8f46 req-85f42b31-3d84-40a4-b0db-31e8ae063f26 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:24.829343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a94659dd-fb22-400c-9428-bd4bc02f8f46 req-85f42b31-3d84-40a4-b0db-31e8ae063f26 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:24.829860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-a94659dd-fb22-400c-9428-bd4bc02f8f46 req-85f42b31-3d84-40a4-b0db-31e8ae063f26 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:24.844342 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-a94659dd-fb22-400c-9428-bd4bc02f8f46 req-85f42b31-3d84-40a4-b0db-31e8ae063f26 service nova] Creating event network-vif-deleted:764ceb17-45fc-4b56-9aee-8b4ae0b815bd for instance 8c7730fa-cc54-496c-99e2-68e699089960 on n-h1-839401-11 Aug 29 16:27:24.851807 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-a94659dd-fb22-400c-9428-bd4bc02f8f46 req-85f42b31-3d84-40a4-b0db-31e8ae063f26 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039625 Aug 29 16:27:24.852744 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3979/7734] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:27:25.570188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4a6964ab-0bae-40a2-82d4-f27115bf5553 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:25.570820 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4a6964ab-0bae-40a2-82d4-f27115bf5553 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:25.578181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a6964ab-0bae-40a2-82d4-f27115bf5553 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:25.578887 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a6964ab-0bae-40a2-82d4-f27115bf5553 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:25.579647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a6964ab-0bae-40a2-82d4-f27115bf5553 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:25.580542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a6964ab-0bae-40a2-82d4-f27115bf5553 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:25.581191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a6964ab-0bae-40a2-82d4-f27115bf5553 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:25.581619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4a6964ab-0bae-40a2-82d4-f27115bf5553 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:25.598721 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-4a6964ab-0bae-40a2-82d4-f27115bf5553 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] HTTP exception thrown: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4a6964ab-0bae-40a2-82d4-f27115bf5553 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Request method failure captured: Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 HTTP/1.1 Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOeCmxszHic3fR-dD_FiVESHdRYratk0u2UW9FXU2W3acquSUUlqZBMx4K0KtqOALAZPC24K6LNbNevDXRbYlme3cOp5pFNwEiKyAZ1t4P951EcRw9FjJ4SV_PAxR4V5iAAz1_B-GZ6uA0zFPfIDeLmTpv-TVgqY352WqC50xTbg0HI Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a3432e106e74db480a1f7a17af514fb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}] Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerActionsTestJSON-546053265 Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6658968475ea487ea0aba9be50d861fe Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '8c7730fa-cc54-496c-99e2-68e699089960'} Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:27:25.600389 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:27:25.605125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:27:25.605125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:27:25.605125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:27:25.605125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:27:25.605125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:27:25.605125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:27:25.605125 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:27:25.605125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4a6964ab-0bae-40a2-82d4-f27115bf5553 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Returning 404 to user: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:27:25.605125 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4a6964ab-0bae-40a2-82d4-f27115bf5553 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 404 len: 111 microversion: 2.1 time: 0.036062 Aug 29 16:27:25.605125 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3756/7735] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:25 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:27:25.621466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1cd41874-2ab1-40e5-9376-b3d4af784b1c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:25.622270 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1cd41874-2ab1-40e5-9376-b3d4af784b1c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:25.631760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cd41874-2ab1-40e5-9376-b3d4af784b1c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:25.632432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cd41874-2ab1-40e5-9376-b3d4af784b1c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:25.633143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cd41874-2ab1-40e5-9376-b3d4af784b1c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:25.634095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cd41874-2ab1-40e5-9376-b3d4af784b1c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:25.634644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cd41874-2ab1-40e5-9376-b3d4af784b1c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:25.635202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1cd41874-2ab1-40e5-9376-b3d4af784b1c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:25.650582 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-1cd41874-2ab1-40e5-9376-b3d4af784b1c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] HTTP exception thrown: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1cd41874-2ab1-40e5-9376-b3d4af784b1c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Request method failure captured: Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 HTTP/1.1 Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOeCmxszHic3fR-dD_FiVESHdRYratk0u2UW9FXU2W3acquSUUlqZBMx4K0KtqOALAZPC24K6LNbNevDXRbYlme3cOp5pFNwEiKyAZ1t4P951EcRw9FjJ4SV_PAxR4V5iAAz1_B-GZ6uA0zFPfIDeLmTpv-TVgqY352WqC50xTbg0HI Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a3432e106e74db480a1f7a17af514fb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}] Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerActionsTestJSON-546053265 Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6658968475ea487ea0aba9be50d861fe Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '8c7730fa-cc54-496c-99e2-68e699089960'} Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:27:25.652295 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:27:25.660310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:27:25.660310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:27:25.660310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:27:25.660310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:27:25.660310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:27:25.660310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:27:25.660310 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:27:25.660310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1cd41874-2ab1-40e5-9376-b3d4af784b1c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Returning 404 to user: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:27:25.660310 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1cd41874-2ab1-40e5-9376-b3d4af784b1c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 404 len: 111 microversion: 2.1 time: 0.037233 Aug 29 16:27:25.660310 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3980/7736] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:25 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:27:25.705356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1814913655", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "827789af-a96a-4564-a015-c53c7c9ca929"}], "security_groups": [{"name": "tempest-securitygroup--825674519"}], "key_name": "tempest-keypair-1856537733", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:25.812537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] validate_networks() for [('827789af-a96a-4564-a015-c53c7c9ca929', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:27:26.316122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:27:26.316573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:27:26.317258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:27:26.317857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:27:26.318584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:27:26.333664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:26.334200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:26.334790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:26.335850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:26.336481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:26.337092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:26.357891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Getting quotas for project 1a3432e106e74db480a1f7a17af514fb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:27:26.363490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Getting quotas for user 6658968475ea487ea0aba9be50d861fe and project 1a3432e106e74db480a1f7a17af514fb. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:27:26.377464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:27:26.379871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:27:26.427093 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a0ebd724-fdd7-4a79-8cb5-82ab1b59795c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.725768 Aug 29 16:27:26.427794 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3757/7737] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:27:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:27:26.439153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-60d3843a-60d6-44cb-88c2-e17a0aa53ba4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:26.439931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-60d3843a-60d6-44cb-88c2-e17a0aa53ba4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:26.499471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-60d3843a-60d6-44cb-88c2-e17a0aa53ba4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:26.509675 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-60d3843a-60d6-44cb-88c2-e17a0aa53ba4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1239 microversion: 2.1 time: 0.074311 Aug 29 16:27:26.510236 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3981/7738] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:26 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:27.531826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f1a11bf3-9dfb-4040-919b-12c148687d2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:27.532378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f1a11bf3-9dfb-4040-919b-12c148687d2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:27.540398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1a11bf3-9dfb-4040-919b-12c148687d2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:27.540398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1a11bf3-9dfb-4040-919b-12c148687d2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:27.540829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1a11bf3-9dfb-4040-919b-12c148687d2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:27.541554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1a11bf3-9dfb-4040-919b-12c148687d2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:27.542506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1a11bf3-9dfb-4040-919b-12c148687d2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:27.543037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f1a11bf3-9dfb-4040-919b-12c148687d2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:27.622602 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f1a11bf3-9dfb-4040-919b-12c148687d2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:27.631660 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f1a11bf3-9dfb-4040-919b-12c148687d2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1299 microversion: 2.1 time: 0.105032 Aug 29 16:27:27.632459 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3758/7739] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:27 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:28.654427 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-81628a8e-9f04-4ad4-99b9-2a1cbf97594e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:28.655050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-81628a8e-9f04-4ad4-99b9-2a1cbf97594e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:28.662570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81628a8e-9f04-4ad4-99b9-2a1cbf97594e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:28.663339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81628a8e-9f04-4ad4-99b9-2a1cbf97594e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:28.663793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81628a8e-9f04-4ad4-99b9-2a1cbf97594e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:28.664507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81628a8e-9f04-4ad4-99b9-2a1cbf97594e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:28.664978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81628a8e-9f04-4ad4-99b9-2a1cbf97594e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:28.665450 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81628a8e-9f04-4ad4-99b9-2a1cbf97594e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:28.800401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-81628a8e-9f04-4ad4-99b9-2a1cbf97594e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:28.808435 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-81628a8e-9f04-4ad4-99b9-2a1cbf97594e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1364 microversion: 2.1 time: 0.158659 Aug 29 16:27:28.821107 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3982/7740] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:28 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:28.985461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-8f816e4b-f42f-4339-a1fb-0ea36c444706 req-06e68f12-f9dc-43a7-89d9-1945596bc48b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "361348ed-6459-404b-a1ef-84b4df3f5d80", "tag": "8674d13e-76b4-4954-9db8-93524f000a3c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:29.001154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8f816e4b-f42f-4339-a1fb-0ea36c444706 req-06e68f12-f9dc-43a7-89d9-1945596bc48b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:29.001641 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8f816e4b-f42f-4339-a1fb-0ea36c444706 req-06e68f12-f9dc-43a7-89d9-1945596bc48b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:29.002071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-8f816e4b-f42f-4339-a1fb-0ea36c444706 req-06e68f12-f9dc-43a7-89d9-1945596bc48b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:29.013713 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-8f816e4b-f42f-4339-a1fb-0ea36c444706 req-06e68f12-f9dc-43a7-89d9-1945596bc48b service nova] Creating event network-changed:8674d13e-76b4-4954-9db8-93524f000a3c for instance 361348ed-6459-404b-a1ef-84b4df3f5d80 on n-h2-839401-11 Aug 29 16:27:29.020838 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-8f816e4b-f42f-4339-a1fb-0ea36c444706 req-06e68f12-f9dc-43a7-89d9-1945596bc48b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039395 Aug 29 16:27:29.021809 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3759/7741] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:27:29.831257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3f78dc6f-740e-42a7-932d-dbb7bbd04645 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:29.831860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3f78dc6f-740e-42a7-932d-dbb7bbd04645 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:29.839598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f78dc6f-740e-42a7-932d-dbb7bbd04645 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:29.840101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f78dc6f-740e-42a7-932d-dbb7bbd04645 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:29.840553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f78dc6f-740e-42a7-932d-dbb7bbd04645 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:29.841310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f78dc6f-740e-42a7-932d-dbb7bbd04645 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:29.841785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f78dc6f-740e-42a7-932d-dbb7bbd04645 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:29.842222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3f78dc6f-740e-42a7-932d-dbb7bbd04645 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:29.982656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3f78dc6f-740e-42a7-932d-dbb7bbd04645 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:29.994453 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3f78dc6f-740e-42a7-932d-dbb7bbd04645 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1364 microversion: 2.1 time: 0.166926 Aug 29 16:27:29.995045 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3983/7742] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:29 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:31.022489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-46991d6a-d65b-4b12-815b-4abd792e0e4d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:31.023613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-46991d6a-d65b-4b12-815b-4abd792e0e4d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:31.034346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46991d6a-d65b-4b12-815b-4abd792e0e4d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:31.035158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46991d6a-d65b-4b12-815b-4abd792e0e4d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:31.035889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46991d6a-d65b-4b12-815b-4abd792e0e4d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:31.037031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46991d6a-d65b-4b12-815b-4abd792e0e4d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:31.037864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46991d6a-d65b-4b12-815b-4abd792e0e4d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:31.038573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-46991d6a-d65b-4b12-815b-4abd792e0e4d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:31.189672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-46991d6a-d65b-4b12-815b-4abd792e0e4d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:31.197575 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-46991d6a-d65b-4b12-815b-4abd792e0e4d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1364 microversion: 2.1 time: 0.183406 Aug 29 16:27:31.198124 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3760/7743] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:31 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:32.223590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-755ee93d-3a74-4f46-b74e-50d5be5301ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:32.224154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-755ee93d-3a74-4f46-b74e-50d5be5301ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:32.234287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-755ee93d-3a74-4f46-b74e-50d5be5301ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:32.234934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-755ee93d-3a74-4f46-b74e-50d5be5301ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:32.235513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-755ee93d-3a74-4f46-b74e-50d5be5301ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:32.236528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-755ee93d-3a74-4f46-b74e-50d5be5301ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:32.237216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-755ee93d-3a74-4f46-b74e-50d5be5301ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:32.237774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-755ee93d-3a74-4f46-b74e-50d5be5301ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:32.381250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-755ee93d-3a74-4f46-b74e-50d5be5301ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:32.389560 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-755ee93d-3a74-4f46-b74e-50d5be5301ef tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1364 microversion: 2.1 time: 0.172965 Aug 29 16:27:32.390149 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3984/7744] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:32 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:33.415771 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-56832074-19cc-4379-8510-badeac9f1158 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:33.416811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-56832074-19cc-4379-8510-badeac9f1158 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:33.424541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56832074-19cc-4379-8510-badeac9f1158 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:33.425033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56832074-19cc-4379-8510-badeac9f1158 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:33.425508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56832074-19cc-4379-8510-badeac9f1158 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:33.426211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56832074-19cc-4379-8510-badeac9f1158 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:33.426673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56832074-19cc-4379-8510-badeac9f1158 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:33.427105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-56832074-19cc-4379-8510-badeac9f1158 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:33.573696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-56832074-19cc-4379-8510-badeac9f1158 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:33.585383 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-56832074-19cc-4379-8510-badeac9f1158 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1364 microversion: 2.1 time: 0.175905 Aug 29 16:27:33.586003 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3761/7745] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:33 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:34.613031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-59007665-b861-4b8d-9ff4-2f1949a71495 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:34.614121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-59007665-b861-4b8d-9ff4-2f1949a71495 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:34.623927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59007665-b861-4b8d-9ff4-2f1949a71495 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:34.624555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59007665-b861-4b8d-9ff4-2f1949a71495 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:34.625050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59007665-b861-4b8d-9ff4-2f1949a71495 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:34.625952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59007665-b861-4b8d-9ff4-2f1949a71495 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:34.626473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59007665-b861-4b8d-9ff4-2f1949a71495 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:34.626914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-59007665-b861-4b8d-9ff4-2f1949a71495 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:34.761711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-59007665-b861-4b8d-9ff4-2f1949a71495 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:34.769853 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-59007665-b861-4b8d-9ff4-2f1949a71495 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1364 microversion: 2.1 time: 0.165057 Aug 29 16:27:34.770430 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3985/7746] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:34 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:35.795224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cfcd806c-fb2e-4f63-bdf9-f55dad4e301a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:35.796165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cfcd806c-fb2e-4f63-bdf9-f55dad4e301a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:35.807754 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfcd806c-fb2e-4f63-bdf9-f55dad4e301a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:35.808247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfcd806c-fb2e-4f63-bdf9-f55dad4e301a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:35.808682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfcd806c-fb2e-4f63-bdf9-f55dad4e301a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:35.809502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfcd806c-fb2e-4f63-bdf9-f55dad4e301a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:35.809962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfcd806c-fb2e-4f63-bdf9-f55dad4e301a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:35.810388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cfcd806c-fb2e-4f63-bdf9-f55dad4e301a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:35.945973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cfcd806c-fb2e-4f63-bdf9-f55dad4e301a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:35.953898 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cfcd806c-fb2e-4f63-bdf9-f55dad4e301a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1364 microversion: 2.1 time: 0.165181 Aug 29 16:27:35.954425 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3762/7747] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:35 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:35.988440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-6098f652-bffc-4358-ae70-4cba0b74d160 req-2d3fd2fc-6faa-4eee-be4a-5babed383318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361348ed-6459-404b-a1ef-84b4df3f5d80", "name": "network-vif-plugged", "status": "completed", "tag": "8674d13e-76b4-4954-9db8-93524f000a3c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:35.999368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6098f652-bffc-4358-ae70-4cba0b74d160 req-2d3fd2fc-6faa-4eee-be4a-5babed383318 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:36.000092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6098f652-bffc-4358-ae70-4cba0b74d160 req-2d3fd2fc-6faa-4eee-be4a-5babed383318 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:36.000675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6098f652-bffc-4358-ae70-4cba0b74d160 req-2d3fd2fc-6faa-4eee-be4a-5babed383318 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:36.012561 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-6098f652-bffc-4358-ae70-4cba0b74d160 req-2d3fd2fc-6faa-4eee-be4a-5babed383318 service nova] Creating event network-vif-plugged:8674d13e-76b4-4954-9db8-93524f000a3c for instance 361348ed-6459-404b-a1ef-84b4df3f5d80 on n-h2-839401-11 Aug 29 16:27:36.017973 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-6098f652-bffc-4358-ae70-4cba0b74d160 req-2d3fd2fc-6faa-4eee-be4a-5babed383318 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033426 Aug 29 16:27:36.018671 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3986/7748] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:27:36.979401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aa82e5ac-9656-4ef7-b46a-fbde7bb9f9a4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:36.980023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aa82e5ac-9656-4ef7-b46a-fbde7bb9f9a4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:36.982162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:36.982862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:36.989368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa82e5ac-9656-4ef7-b46a-fbde7bb9f9a4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:36.989901 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa82e5ac-9656-4ef7-b46a-fbde7bb9f9a4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:36.990360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa82e5ac-9656-4ef7-b46a-fbde7bb9f9a4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:36.991073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa82e5ac-9656-4ef7-b46a-fbde7bb9f9a4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:36.991554 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa82e5ac-9656-4ef7-b46a-fbde7bb9f9a4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:36.991995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa82e5ac-9656-4ef7-b46a-fbde7bb9f9a4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:37.130858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aa82e5ac-9656-4ef7-b46a-fbde7bb9f9a4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:37.139075 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aa82e5ac-9656-4ef7-b46a-fbde7bb9f9a4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1364 microversion: 2.1 time: 0.166364 Aug 29 16:27:37.139673 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3763/7749] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:36 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:38.164388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:38.172616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d5c3183-942e-4bb2-acfb-76c589163a6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:38.173848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9d5c3183-942e-4bb2-acfb-76c589163a6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:38.183801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d5c3183-942e-4bb2-acfb-76c589163a6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:38.184300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d5c3183-942e-4bb2-acfb-76c589163a6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:38.184751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d5c3183-942e-4bb2-acfb-76c589163a6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:38.185570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d5c3183-942e-4bb2-acfb-76c589163a6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:38.186060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d5c3183-942e-4bb2-acfb-76c589163a6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:38.186481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d5c3183-942e-4bb2-acfb-76c589163a6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:38.319314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9d5c3183-942e-4bb2-acfb-76c589163a6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:38.327790 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d5c3183-942e-4bb2-acfb-76c589163a6e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1551 microversion: 2.1 time: 0.165278 Aug 29 16:27:38.328374 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3987/7750] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:38 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1551 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:38.351802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cab30127-2177-4f29-90ae-8c090a187ac1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:38.352339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cab30127-2177-4f29-90ae-8c090a187ac1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:38.359505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cab30127-2177-4f29-90ae-8c090a187ac1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:38.360001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cab30127-2177-4f29-90ae-8c090a187ac1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:38.360441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cab30127-2177-4f29-90ae-8c090a187ac1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:38.361187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cab30127-2177-4f29-90ae-8c090a187ac1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:38.361657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cab30127-2177-4f29-90ae-8c090a187ac1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:38.362090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cab30127-2177-4f29-90ae-8c090a187ac1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:38.449866 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cab30127-2177-4f29-90ae-8c090a187ac1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102150 Aug 29 16:27:38.450481 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3764/7751] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 16:27:38 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:27:39.419794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-5c633ceb-6504-4aef-a3f7-bc5a4bf4be12 req-1c8df888-c2ef-4e06-9eb9-34c16f875239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "361348ed-6459-404b-a1ef-84b4df3f5d80", "tag": "8674d13e-76b4-4954-9db8-93524f000a3c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:39.430925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5c633ceb-6504-4aef-a3f7-bc5a4bf4be12 req-1c8df888-c2ef-4e06-9eb9-34c16f875239 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:39.431421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5c633ceb-6504-4aef-a3f7-bc5a4bf4be12 req-1c8df888-c2ef-4e06-9eb9-34c16f875239 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:39.431869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-5c633ceb-6504-4aef-a3f7-bc5a4bf4be12 req-1c8df888-c2ef-4e06-9eb9-34c16f875239 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:39.443419 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-5c633ceb-6504-4aef-a3f7-bc5a4bf4be12 req-1c8df888-c2ef-4e06-9eb9-34c16f875239 service nova] Creating event network-changed:8674d13e-76b4-4954-9db8-93524f000a3c for instance 361348ed-6459-404b-a1ef-84b4df3f5d80 on n-h2-839401-11 Aug 29 16:27:39.448704 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-5c633ceb-6504-4aef-a3f7-bc5a4bf4be12 req-1c8df888-c2ef-4e06-9eb9-34c16f875239 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032866 Aug 29 16:27:39.449671 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3988/7752] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:28:44.501777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:28:44.502538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=64 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:28:44.503674 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:28:44.503851 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 16:28:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 (ip 10.222.0.62) !!! Aug 29 16:28:44.512350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d376f240-c82e-468c-8b2e-bfa08091ea97 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:28:44.513317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d376f240-c82e-468c-8b2e-bfa08091ea97 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:28:44.524666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d376f240-c82e-468c-8b2e-bfa08091ea97 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:44.525276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d376f240-c82e-468c-8b2e-bfa08091ea97 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:44.525905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d376f240-c82e-468c-8b2e-bfa08091ea97 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:44.526968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d376f240-c82e-468c-8b2e-bfa08091ea97 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:44.527633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d376f240-c82e-468c-8b2e-bfa08091ea97 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:44.528226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d376f240-c82e-468c-8b2e-bfa08091ea97 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:44.713107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d376f240-c82e-468c-8b2e-bfa08091ea97 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:28:44.721508 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d376f240-c82e-468c-8b2e-bfa08091ea97 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1669 microversion: 2.1 time: 0.222926 Aug 29 16:28:44.722098 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3765/7753] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:28:44 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1669 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:28:44.740153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=23 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:28:44.741017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:28:44.742187 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:28:44.742341 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:28:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80/os-volume_attachments (ip 10.222.0.62) !!! Aug 29 16:28:44.743330 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:28:44.743501 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:28:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80/os-volume_attachments (ip 10.222.0.62) !!! Aug 29 16:28:44.749164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-53275b2d-3ad5-4275-b844-4d9a21f42b92 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fda3b954-33e9-4ffd-ad78-d5065330df40"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:28:44.751645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-53275b2d-3ad5-4275-b844-4d9a21f42b92 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:28:44.761961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53275b2d-3ad5-4275-b844-4d9a21f42b92 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:44.762468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53275b2d-3ad5-4275-b844-4d9a21f42b92 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:44.762918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53275b2d-3ad5-4275-b844-4d9a21f42b92 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:44.763634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53275b2d-3ad5-4275-b844-4d9a21f42b92 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:44.764110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53275b2d-3ad5-4275-b844-4d9a21f42b92 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:44.764553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-53275b2d-3ad5-4275-b844-4d9a21f42b92 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:45.231877 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-53275b2d-3ad5-4275-b844-4d9a21f42b92 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "POST /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.493672 Aug 29 16:28:45.232598 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3989/7754] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 16:28:44 2022] POST /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80/os-volume_attachments => generated 194 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:28:55.993329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c7975e7e-ccbf-49a6-b2d7-653b1644d6f1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:28:55.995659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c7975e7e-ccbf-49a6-b2d7-653b1644d6f1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:28:55.998494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:28:55.999158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:28:56.005309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7975e7e-ccbf-49a6-b2d7-653b1644d6f1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:56.005796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7975e7e-ccbf-49a6-b2d7-653b1644d6f1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:56.006232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7975e7e-ccbf-49a6-b2d7-653b1644d6f1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:56.007110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7975e7e-ccbf-49a6-b2d7-653b1644d6f1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:56.007605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7975e7e-ccbf-49a6-b2d7-653b1644d6f1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:56.008023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7975e7e-ccbf-49a6-b2d7-653b1644d6f1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:56.052913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c7975e7e-ccbf-49a6-b2d7-653b1644d6f1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:28:56.060075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c7975e7e-ccbf-49a6-b2d7-653b1644d6f1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Old instance type m1.heat2, new instance type m1.heat {{(pid=122361) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:28:56.067194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c7975e7e-ccbf-49a6-b2d7-653b1644d6f1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:28:56.067623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c7975e7e-ccbf-49a6-b2d7-653b1644d6f1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:28:56.068109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c7975e7e-ccbf-49a6-b2d7-653b1644d6f1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:28:56.068522 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c7975e7e-ccbf-49a6-b2d7-653b1644d6f1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:28:56.068937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-c7975e7e-ccbf-49a6-b2d7-653b1644d6f1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:28:56.137549 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c7975e7e-ccbf-49a6-b2d7-653b1644d6f1 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "POST /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80/action" status: 202 len: 0 microversion: 2.1 time: 0.148277 Aug 29 16:28:56.138165 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3766/7755] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:28:55 2022] POST /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:28:56.147064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d5946080-35e2-4afd-8613-cca85fbd9300 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:28:56.147791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d5946080-35e2-4afd-8613-cca85fbd9300 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:28:56.154029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:28:56.156364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:28:56.158190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5946080-35e2-4afd-8613-cca85fbd9300 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:56.158707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5946080-35e2-4afd-8613-cca85fbd9300 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:56.159190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5946080-35e2-4afd-8613-cca85fbd9300 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:56.159889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5946080-35e2-4afd-8613-cca85fbd9300 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:56.160367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5946080-35e2-4afd-8613-cca85fbd9300 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:56.160817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d5946080-35e2-4afd-8613-cca85fbd9300 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:56.305717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d5946080-35e2-4afd-8613-cca85fbd9300 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:28:56.314564 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d5946080-35e2-4afd-8613-cca85fbd9300 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1724 microversion: 2.1 time: 0.171893 Aug 29 16:28:56.315158 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3990/7756] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:28:56 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:28:57.341313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-993f855b-f225-4034-9b10-87fda66624ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:28:57.342697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-993f855b-f225-4034-9b10-87fda66624ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:28:57.353125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-993f855b-f225-4034-9b10-87fda66624ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:57.353954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-993f855b-f225-4034-9b10-87fda66624ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:57.354743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-993f855b-f225-4034-9b10-87fda66624ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:57.355540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-993f855b-f225-4034-9b10-87fda66624ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:57.356022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-993f855b-f225-4034-9b10-87fda66624ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:57.356740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-993f855b-f225-4034-9b10-87fda66624ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:57.508747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-993f855b-f225-4034-9b10-87fda66624ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:28:57.517498 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-993f855b-f225-4034-9b10-87fda66624ba tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1724 microversion: 2.1 time: 0.184111 Aug 29 16:28:57.518322 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3767/7757] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:28:57 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:28:58.544090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-91a3235d-78ba-44e0-9c14-30dc1935fdfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:28:58.545026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-91a3235d-78ba-44e0-9c14-30dc1935fdfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:28:58.556081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91a3235d-78ba-44e0-9c14-30dc1935fdfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:58.556580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91a3235d-78ba-44e0-9c14-30dc1935fdfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:58.557025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91a3235d-78ba-44e0-9c14-30dc1935fdfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:58.557760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91a3235d-78ba-44e0-9c14-30dc1935fdfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:58.558226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91a3235d-78ba-44e0-9c14-30dc1935fdfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:58.558659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91a3235d-78ba-44e0-9c14-30dc1935fdfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:58.695445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-91a3235d-78ba-44e0-9c14-30dc1935fdfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:28:58.704005 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-91a3235d-78ba-44e0-9c14-30dc1935fdfb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.166750 Aug 29 16:28:58.704591 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3991/7758] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:28:58 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:28:59.728876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8839d8fb-2de9-417f-82b6-648c06e67db9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:28:59.729505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8839d8fb-2de9-417f-82b6-648c06e67db9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:28:59.737071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8839d8fb-2de9-417f-82b6-648c06e67db9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:59.737622 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8839d8fb-2de9-417f-82b6-648c06e67db9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:59.738093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8839d8fb-2de9-417f-82b6-648c06e67db9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:59.738835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8839d8fb-2de9-417f-82b6-648c06e67db9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:59.739323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8839d8fb-2de9-417f-82b6-648c06e67db9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:59.739776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8839d8fb-2de9-417f-82b6-648c06e67db9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:59.876759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8839d8fb-2de9-417f-82b6-648c06e67db9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:28:59.885698 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8839d8fb-2de9-417f-82b6-648c06e67db9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.162522 Aug 29 16:28:59.886295 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3768/7759] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:28:59 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:00.908438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c5555e04-4754-4471-9c55-b1242005140f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:00.909049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c5555e04-4754-4471-9c55-b1242005140f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:00.916456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5555e04-4754-4471-9c55-b1242005140f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:00.916990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5555e04-4754-4471-9c55-b1242005140f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:00.917487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5555e04-4754-4471-9c55-b1242005140f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:00.918205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5555e04-4754-4471-9c55-b1242005140f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:00.918699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5555e04-4754-4471-9c55-b1242005140f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:00.919130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c5555e04-4754-4471-9c55-b1242005140f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:01.066378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c5555e04-4754-4471-9c55-b1242005140f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:01.077312 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c5555e04-4754-4471-9c55-b1242005140f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.172927 Aug 29 16:29:01.077912 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3992/7760] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:00 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:02.104418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-19ed3291-6b07-4e81-a6df-5e42b7da3093 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:02.106303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-19ed3291-6b07-4e81-a6df-5e42b7da3093 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:02.120072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19ed3291-6b07-4e81-a6df-5e42b7da3093 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:02.120596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19ed3291-6b07-4e81-a6df-5e42b7da3093 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:02.121030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19ed3291-6b07-4e81-a6df-5e42b7da3093 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:02.121770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19ed3291-6b07-4e81-a6df-5e42b7da3093 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:02.122230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19ed3291-6b07-4e81-a6df-5e42b7da3093 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:02.122656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19ed3291-6b07-4e81-a6df-5e42b7da3093 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:02.269071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-19ed3291-6b07-4e81-a6df-5e42b7da3093 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:02.277541 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-19ed3291-6b07-4e81-a6df-5e42b7da3093 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.180122 Aug 29 16:29:02.278136 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3769/7761] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:02 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:03.298692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3b487955-b50b-455f-bb68-2140dd7bd486 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:03.299381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3b487955-b50b-455f-bb68-2140dd7bd486 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:03.307808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b487955-b50b-455f-bb68-2140dd7bd486 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:03.308318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b487955-b50b-455f-bb68-2140dd7bd486 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:03.308773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b487955-b50b-455f-bb68-2140dd7bd486 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:03.309512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b487955-b50b-455f-bb68-2140dd7bd486 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:03.309986 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b487955-b50b-455f-bb68-2140dd7bd486 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:03.310428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b487955-b50b-455f-bb68-2140dd7bd486 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:03.443312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3b487955-b50b-455f-bb68-2140dd7bd486 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:03.457806 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3b487955-b50b-455f-bb68-2140dd7bd486 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.163216 Aug 29 16:29:03.458398 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3993/7762] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:03 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:04.483746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7908306b-7075-40da-96f1-5e852cf4565a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:04.484762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7908306b-7075-40da-96f1-5e852cf4565a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:04.495663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7908306b-7075-40da-96f1-5e852cf4565a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:04.496164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7908306b-7075-40da-96f1-5e852cf4565a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:04.496598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7908306b-7075-40da-96f1-5e852cf4565a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:04.497342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7908306b-7075-40da-96f1-5e852cf4565a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:04.497806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7908306b-7075-40da-96f1-5e852cf4565a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:04.498239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7908306b-7075-40da-96f1-5e852cf4565a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:04.630131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7908306b-7075-40da-96f1-5e852cf4565a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:04.639226 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7908306b-7075-40da-96f1-5e852cf4565a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.162071 Aug 29 16:29:04.639812 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3770/7763] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:04 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:05.665425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-280c9407-350f-4227-88e7-c19e5d29011a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:05.666297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-280c9407-350f-4227-88e7-c19e5d29011a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:05.674357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-280c9407-350f-4227-88e7-c19e5d29011a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:05.674867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-280c9407-350f-4227-88e7-c19e5d29011a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:05.675318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-280c9407-350f-4227-88e7-c19e5d29011a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:05.676033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-280c9407-350f-4227-88e7-c19e5d29011a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:05.676505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-280c9407-350f-4227-88e7-c19e5d29011a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:05.676947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-280c9407-350f-4227-88e7-c19e5d29011a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:05.834501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-280c9407-350f-4227-88e7-c19e5d29011a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:05.843834 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-280c9407-350f-4227-88e7-c19e5d29011a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.185176 Aug 29 16:29:05.844402 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3994/7764] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:05 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:06.865534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-52f55daf-221e-455c-9210-a98e94faec60 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:06.866145 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-52f55daf-221e-455c-9210-a98e94faec60 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:06.873317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52f55daf-221e-455c-9210-a98e94faec60 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:06.873798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52f55daf-221e-455c-9210-a98e94faec60 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:06.874235 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52f55daf-221e-455c-9210-a98e94faec60 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:06.874926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52f55daf-221e-455c-9210-a98e94faec60 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:06.875381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52f55daf-221e-455c-9210-a98e94faec60 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:06.875805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-52f55daf-221e-455c-9210-a98e94faec60 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:07.012686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-52f55daf-221e-455c-9210-a98e94faec60 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:07.024344 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-52f55daf-221e-455c-9210-a98e94faec60 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.162609 Aug 29 16:29:07.025114 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3771/7765] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:06 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:08.056267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f4dd8e1a-69e8-40b6-b1a2-0841898b262c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:08.057332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f4dd8e1a-69e8-40b6-b1a2-0841898b262c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:08.065491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4dd8e1a-69e8-40b6-b1a2-0841898b262c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:08.066001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4dd8e1a-69e8-40b6-b1a2-0841898b262c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:08.066470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4dd8e1a-69e8-40b6-b1a2-0841898b262c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:08.067194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4dd8e1a-69e8-40b6-b1a2-0841898b262c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:08.067665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4dd8e1a-69e8-40b6-b1a2-0841898b262c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:08.068109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f4dd8e1a-69e8-40b6-b1a2-0841898b262c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:08.204575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f4dd8e1a-69e8-40b6-b1a2-0841898b262c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:08.215690 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f4dd8e1a-69e8-40b6-b1a2-0841898b262c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.166158 Aug 29 16:29:08.216277 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3995/7766] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:08 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:09.239165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c038147-4e38-4a66-a395-c395d3c91b7b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:09.239851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6c038147-4e38-4a66-a395-c395d3c91b7b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:09.248855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c038147-4e38-4a66-a395-c395d3c91b7b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:09.249553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c038147-4e38-4a66-a395-c395d3c91b7b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:09.250151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c038147-4e38-4a66-a395-c395d3c91b7b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:09.251080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c038147-4e38-4a66-a395-c395d3c91b7b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:09.251657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c038147-4e38-4a66-a395-c395d3c91b7b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:09.252272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c038147-4e38-4a66-a395-c395d3c91b7b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:09.391200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6c038147-4e38-4a66-a395-c395d3c91b7b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:09.400150 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6c038147-4e38-4a66-a395-c395d3c91b7b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.166651 Aug 29 16:29:09.400740 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3772/7767] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:09 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:10.421605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-34b0a7ed-43aa-4b57-9006-175dd0253eff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:10.422141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-34b0a7ed-43aa-4b57-9006-175dd0253eff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:10.429273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34b0a7ed-43aa-4b57-9006-175dd0253eff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:10.429739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34b0a7ed-43aa-4b57-9006-175dd0253eff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:10.430414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34b0a7ed-43aa-4b57-9006-175dd0253eff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:10.431126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34b0a7ed-43aa-4b57-9006-175dd0253eff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:10.431593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34b0a7ed-43aa-4b57-9006-175dd0253eff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:10.432030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-34b0a7ed-43aa-4b57-9006-175dd0253eff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:10.568472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-34b0a7ed-43aa-4b57-9006-175dd0253eff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:10.577215 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-34b0a7ed-43aa-4b57-9006-175dd0253eff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.159813 Aug 29 16:29:10.577792 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3996/7768] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:10 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:11.598517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e3ce063-67e1-4550-83e0-79eda0f3e3ff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:11.599427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9e3ce063-67e1-4550-83e0-79eda0f3e3ff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:11.607791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e3ce063-67e1-4550-83e0-79eda0f3e3ff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:11.608279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e3ce063-67e1-4550-83e0-79eda0f3e3ff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:11.608715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e3ce063-67e1-4550-83e0-79eda0f3e3ff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:11.609507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e3ce063-67e1-4550-83e0-79eda0f3e3ff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:11.609982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e3ce063-67e1-4550-83e0-79eda0f3e3ff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:11.610384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e3ce063-67e1-4550-83e0-79eda0f3e3ff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:11.743244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9e3ce063-67e1-4550-83e0-79eda0f3e3ff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:11.752381 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9e3ce063-67e1-4550-83e0-79eda0f3e3ff tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.157877 Aug 29 16:29:11.752961 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3773/7769] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:11 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:12.778944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5b295d45-9159-4ec1-a409-bff4ada9a6fc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:12.779981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5b295d45-9159-4ec1-a409-bff4ada9a6fc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:12.791823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b295d45-9159-4ec1-a409-bff4ada9a6fc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:12.792661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b295d45-9159-4ec1-a409-bff4ada9a6fc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:12.793497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b295d45-9159-4ec1-a409-bff4ada9a6fc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:12.794671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b295d45-9159-4ec1-a409-bff4ada9a6fc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:12.795468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b295d45-9159-4ec1-a409-bff4ada9a6fc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:12.796328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b295d45-9159-4ec1-a409-bff4ada9a6fc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:12.944957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5b295d45-9159-4ec1-a409-bff4ada9a6fc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:12.953864 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5b295d45-9159-4ec1-a409-bff4ada9a6fc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.181710 Aug 29 16:29:12.954441 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3997/7770] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:12 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:13.982679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f7c88d4b-19de-4680-b0df-d7cec480534d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:13.983257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f7c88d4b-19de-4680-b0df-d7cec480534d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:13.991113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7c88d4b-19de-4680-b0df-d7cec480534d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:13.991596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7c88d4b-19de-4680-b0df-d7cec480534d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:13.992033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7c88d4b-19de-4680-b0df-d7cec480534d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:13.992724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7c88d4b-19de-4680-b0df-d7cec480534d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:13.993185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7c88d4b-19de-4680-b0df-d7cec480534d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:13.993633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f7c88d4b-19de-4680-b0df-d7cec480534d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:14.127416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f7c88d4b-19de-4680-b0df-d7cec480534d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:14.136763 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f7c88d4b-19de-4680-b0df-d7cec480534d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.158121 Aug 29 16:29:14.137372 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3774/7771] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:13 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:15.163499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ebad6d9d-4152-46b9-a9dd-76b2abfb9733 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:15.164496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ebad6d9d-4152-46b9-a9dd-76b2abfb9733 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:15.174732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebad6d9d-4152-46b9-a9dd-76b2abfb9733 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:15.175246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebad6d9d-4152-46b9-a9dd-76b2abfb9733 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:15.175708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebad6d9d-4152-46b9-a9dd-76b2abfb9733 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:15.176434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebad6d9d-4152-46b9-a9dd-76b2abfb9733 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:15.176924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebad6d9d-4152-46b9-a9dd-76b2abfb9733 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:15.177372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ebad6d9d-4152-46b9-a9dd-76b2abfb9733 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:15.315656 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ebad6d9d-4152-46b9-a9dd-76b2abfb9733 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:15.328297 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ebad6d9d-4152-46b9-a9dd-76b2abfb9733 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.171731 Aug 29 16:29:15.328904 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3998/7772] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:15 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:16.349502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-88be28ca-ea32-4960-88eb-199c64fb4af0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:16.350109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-88be28ca-ea32-4960-88eb-199c64fb4af0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:16.357770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88be28ca-ea32-4960-88eb-199c64fb4af0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:16.358259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88be28ca-ea32-4960-88eb-199c64fb4af0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:16.358697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88be28ca-ea32-4960-88eb-199c64fb4af0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:16.359400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88be28ca-ea32-4960-88eb-199c64fb4af0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:16.359858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88be28ca-ea32-4960-88eb-199c64fb4af0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:16.360284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88be28ca-ea32-4960-88eb-199c64fb4af0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:16.499063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-88be28ca-ea32-4960-88eb-199c64fb4af0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:16.508147 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-88be28ca-ea32-4960-88eb-199c64fb4af0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.162551 Aug 29 16:29:16.508750 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3775/7773] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:16 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:17.530018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-37651d3f-1df0-4198-a28d-3a775a0a77df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:17.530674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-37651d3f-1df0-4198-a28d-3a775a0a77df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:17.537950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37651d3f-1df0-4198-a28d-3a775a0a77df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:17.538459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37651d3f-1df0-4198-a28d-3a775a0a77df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:17.538916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37651d3f-1df0-4198-a28d-3a775a0a77df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:17.539640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37651d3f-1df0-4198-a28d-3a775a0a77df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:17.540116 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37651d3f-1df0-4198-a28d-3a775a0a77df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:17.540560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-37651d3f-1df0-4198-a28d-3a775a0a77df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:17.686117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-37651d3f-1df0-4198-a28d-3a775a0a77df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:17.695191 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-37651d3f-1df0-4198-a28d-3a775a0a77df tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1729 microversion: 2.1 time: 0.169276 Aug 29 16:29:17.695812 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 3999/7774] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:17 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:18.191741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-5cab6956-3b27-4578-abd8-18b86d404a85 req-073bb827-b889-4de8-9c7f-c0f38f803096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361348ed-6459-404b-a1ef-84b4df3f5d80", "name": "network-vif-unplugged", "status": "completed", "tag": "8674d13e-76b4-4954-9db8-93524f000a3c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:29:18.201333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5cab6956-3b27-4578-abd8-18b86d404a85 req-073bb827-b889-4de8-9c7f-c0f38f803096 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:18.201819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5cab6956-3b27-4578-abd8-18b86d404a85 req-073bb827-b889-4de8-9c7f-c0f38f803096 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:18.202253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5cab6956-3b27-4578-abd8-18b86d404a85 req-073bb827-b889-4de8-9c7f-c0f38f803096 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:18.214901 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5cab6956-3b27-4578-abd8-18b86d404a85 req-073bb827-b889-4de8-9c7f-c0f38f803096 service nova] Creating event network-vif-unplugged:8674d13e-76b4-4954-9db8-93524f000a3c for instance 361348ed-6459-404b-a1ef-84b4df3f5d80 on n-h1-839401-11 Aug 29 16:29:18.221026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-5cab6956-3b27-4578-abd8-18b86d404a85 req-073bb827-b889-4de8-9c7f-c0f38f803096 service nova] Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:29:18.232386 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-5cab6956-3b27-4578-abd8-18b86d404a85 req-073bb827-b889-4de8-9c7f-c0f38f803096 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100826 Aug 29 16:29:18.233275 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3776/7775] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:29:18.717110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8393e87e-4913-4207-9397-aa0b58d509ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:18.717771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8393e87e-4913-4207-9397-aa0b58d509ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:18.725542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8393e87e-4913-4207-9397-aa0b58d509ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:18.726122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8393e87e-4913-4207-9397-aa0b58d509ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:18.726905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8393e87e-4913-4207-9397-aa0b58d509ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:18.728255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8393e87e-4913-4207-9397-aa0b58d509ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:18.728751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8393e87e-4913-4207-9397-aa0b58d509ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:18.729244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8393e87e-4913-4207-9397-aa0b58d509ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:18.871701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8393e87e-4913-4207-9397-aa0b58d509ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:18.880482 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8393e87e-4913-4207-9397-aa0b58d509ca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1728 microversion: 2.1 time: 0.167611 Aug 29 16:29:18.881046 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4000/7776] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:18 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:19.904388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-91bb9a3c-8033-4717-8194-c36ef9011297 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:19.906320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-91bb9a3c-8033-4717-8194-c36ef9011297 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:19.913393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91bb9a3c-8033-4717-8194-c36ef9011297 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:19.913874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91bb9a3c-8033-4717-8194-c36ef9011297 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:19.914367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91bb9a3c-8033-4717-8194-c36ef9011297 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:19.915085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91bb9a3c-8033-4717-8194-c36ef9011297 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:19.915618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91bb9a3c-8033-4717-8194-c36ef9011297 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:19.916121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91bb9a3c-8033-4717-8194-c36ef9011297 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:20.058818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-91bb9a3c-8033-4717-8194-c36ef9011297 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:20.067631 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-91bb9a3c-8033-4717-8194-c36ef9011297 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1726 microversion: 2.1 time: 0.168664 Aug 29 16:29:20.068213 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3777/7777] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:19 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:20.250349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c7a90042-c10b-482e-bbcb-238086ab46d6 req-974ff9a1-cce0-4ce9-b09a-2fa25ba83508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "361348ed-6459-404b-a1ef-84b4df3f5d80", "tag": "8674d13e-76b4-4954-9db8-93524f000a3c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:29:20.261071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c7a90042-c10b-482e-bbcb-238086ab46d6 req-974ff9a1-cce0-4ce9-b09a-2fa25ba83508 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:20.261589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c7a90042-c10b-482e-bbcb-238086ab46d6 req-974ff9a1-cce0-4ce9-b09a-2fa25ba83508 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:20.262036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c7a90042-c10b-482e-bbcb-238086ab46d6 req-974ff9a1-cce0-4ce9-b09a-2fa25ba83508 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:20.274870 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c7a90042-c10b-482e-bbcb-238086ab46d6 req-974ff9a1-cce0-4ce9-b09a-2fa25ba83508 service nova] Creating event network-changed:8674d13e-76b4-4954-9db8-93524f000a3c for instance 361348ed-6459-404b-a1ef-84b4df3f5d80 on n-h1-839401-11 Aug 29 16:29:20.280689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-c7a90042-c10b-482e-bbcb-238086ab46d6 req-974ff9a1-cce0-4ce9-b09a-2fa25ba83508 service nova] Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:29:20.291921 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c7a90042-c10b-482e-bbcb-238086ab46d6 req-974ff9a1-cce0-4ce9-b09a-2fa25ba83508 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045367 Aug 29 16:29:20.292534 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4001/7778] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:29:21.089832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bf1a2292-b088-4a8f-b977-e30f67092ec4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:21.090540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bf1a2292-b088-4a8f-b977-e30f67092ec4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:21.098058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf1a2292-b088-4a8f-b977-e30f67092ec4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:21.098449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf1a2292-b088-4a8f-b977-e30f67092ec4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:21.099115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf1a2292-b088-4a8f-b977-e30f67092ec4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:21.099813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf1a2292-b088-4a8f-b977-e30f67092ec4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:21.100308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf1a2292-b088-4a8f-b977-e30f67092ec4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:21.100704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf1a2292-b088-4a8f-b977-e30f67092ec4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:21.400687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bf1a2292-b088-4a8f-b977-e30f67092ec4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:21.410356 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bf1a2292-b088-4a8f-b977-e30f67092ec4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1726 microversion: 2.1 time: 0.324746 Aug 29 16:29:21.421752 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3778/7779] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:21 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1726 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:22.433612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eee4b00b-a2de-4d96-b3f9-efe80bacb897 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:22.434462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eee4b00b-a2de-4d96-b3f9-efe80bacb897 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:22.441237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eee4b00b-a2de-4d96-b3f9-efe80bacb897 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:22.441774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eee4b00b-a2de-4d96-b3f9-efe80bacb897 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:22.442232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eee4b00b-a2de-4d96-b3f9-efe80bacb897 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:22.442950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eee4b00b-a2de-4d96-b3f9-efe80bacb897 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:22.443421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eee4b00b-a2de-4d96-b3f9-efe80bacb897 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:22.443875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eee4b00b-a2de-4d96-b3f9-efe80bacb897 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:22.583734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eee4b00b-a2de-4d96-b3f9-efe80bacb897 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:22.592595 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eee4b00b-a2de-4d96-b3f9-efe80bacb897 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1726 microversion: 2.1 time: 0.164352 Aug 29 16:29:22.593221 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4002/7780] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:22 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:23.614421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8b2eddef-361a-4301-88b9-449204930ca2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:23.615054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8b2eddef-361a-4301-88b9-449204930ca2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:23.622405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b2eddef-361a-4301-88b9-449204930ca2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:23.622900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b2eddef-361a-4301-88b9-449204930ca2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:23.623375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b2eddef-361a-4301-88b9-449204930ca2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:23.624085 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b2eddef-361a-4301-88b9-449204930ca2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:23.624546 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b2eddef-361a-4301-88b9-449204930ca2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:23.625012 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8b2eddef-361a-4301-88b9-449204930ca2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:23.771932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8b2eddef-361a-4301-88b9-449204930ca2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:23.780973 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8b2eddef-361a-4301-88b9-449204930ca2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1726 microversion: 2.1 time: 0.170506 Aug 29 16:29:23.781727 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3779/7781] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:23 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:24.808023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3247a628-1e12-44a6-ae7b-46b89d684186 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:24.809130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3247a628-1e12-44a6-ae7b-46b89d684186 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:24.820906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3247a628-1e12-44a6-ae7b-46b89d684186 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:24.821799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3247a628-1e12-44a6-ae7b-46b89d684186 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:24.822567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3247a628-1e12-44a6-ae7b-46b89d684186 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:24.823750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3247a628-1e12-44a6-ae7b-46b89d684186 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:24.824556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3247a628-1e12-44a6-ae7b-46b89d684186 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:24.825348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3247a628-1e12-44a6-ae7b-46b89d684186 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:24.972341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3247a628-1e12-44a6-ae7b-46b89d684186 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:24.981347 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3247a628-1e12-44a6-ae7b-46b89d684186 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1726 microversion: 2.1 time: 0.179939 Aug 29 16:29:24.981892 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4003/7782] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:24 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:26.004250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-57f31a31-3994-4032-a83e-e66268312254 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:26.004835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-57f31a31-3994-4032-a83e-e66268312254 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:26.012200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57f31a31-3994-4032-a83e-e66268312254 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:26.012690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57f31a31-3994-4032-a83e-e66268312254 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:26.013114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57f31a31-3994-4032-a83e-e66268312254 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:26.013864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57f31a31-3994-4032-a83e-e66268312254 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:26.014320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57f31a31-3994-4032-a83e-e66268312254 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:26.014749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57f31a31-3994-4032-a83e-e66268312254 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:26.017424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:29:26.154300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-57f31a31-3994-4032-a83e-e66268312254 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:26.163026 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-57f31a31-3994-4032-a83e-e66268312254 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1726 microversion: 2.1 time: 0.163690 Aug 29 16:29:26.163595 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3780/7783] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:25 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:27.188997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-568d24c2-5e20-477c-8d6b-0fcadc088ab8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:27.190022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-568d24c2-5e20-477c-8d6b-0fcadc088ab8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:27.194591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=29 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:29:27.203701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-568d24c2-5e20-477c-8d6b-0fcadc088ab8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:27.204532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-568d24c2-5e20-477c-8d6b-0fcadc088ab8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:27.205361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-568d24c2-5e20-477c-8d6b-0fcadc088ab8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:27.206643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-568d24c2-5e20-477c-8d6b-0fcadc088ab8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:27.207119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-568d24c2-5e20-477c-8d6b-0fcadc088ab8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:27.207565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-568d24c2-5e20-477c-8d6b-0fcadc088ab8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:27.210251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=83 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:29:27.360983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-568d24c2-5e20-477c-8d6b-0fcadc088ab8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:27.374239 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-568d24c2-5e20-477c-8d6b-0fcadc088ab8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1726 microversion: 2.1 time: 0.191771 Aug 29 16:29:27.375089 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4004/7784] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:27 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1726 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:28.400763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-35027681-5abf-4a25-895d-ea18a80fb19d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:28.401751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-35027681-5abf-4a25-895d-ea18a80fb19d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:28.406350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=35 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:29:28.415236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35027681-5abf-4a25-895d-ea18a80fb19d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:28.416041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35027681-5abf-4a25-895d-ea18a80fb19d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:28.416768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35027681-5abf-4a25-895d-ea18a80fb19d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:28.417966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35027681-5abf-4a25-895d-ea18a80fb19d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:28.418735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35027681-5abf-4a25-895d-ea18a80fb19d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:28.419452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35027681-5abf-4a25-895d-ea18a80fb19d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:28.565388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-35027681-5abf-4a25-895d-ea18a80fb19d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:28.574347 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-35027681-5abf-4a25-895d-ea18a80fb19d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1726 microversion: 2.1 time: 0.180309 Aug 29 16:29:28.574924 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3781/7785] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:28 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:29.597114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-513cf568-bede-4e5e-a7a6-a593238c41ac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:29.597741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-513cf568-bede-4e5e-a7a6-a593238c41ac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:29.605339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-513cf568-bede-4e5e-a7a6-a593238c41ac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:29.605852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-513cf568-bede-4e5e-a7a6-a593238c41ac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:29.606306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-513cf568-bede-4e5e-a7a6-a593238c41ac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:29.607021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-513cf568-bede-4e5e-a7a6-a593238c41ac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:29.607491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-513cf568-bede-4e5e-a7a6-a593238c41ac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:29.607933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-513cf568-bede-4e5e-a7a6-a593238c41ac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:29.750487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-513cf568-bede-4e5e-a7a6-a593238c41ac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:29.759369 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-513cf568-bede-4e5e-a7a6-a593238c41ac tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1726 microversion: 2.1 time: 0.166370 Aug 29 16:29:29.759970 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4005/7786] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:29 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:30.785317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7285abfa-256a-42a4-8490-870bf44bc2d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:30.786197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7285abfa-256a-42a4-8490-870bf44bc2d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:30.797252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7285abfa-256a-42a4-8490-870bf44bc2d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:30.798059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7285abfa-256a-42a4-8490-870bf44bc2d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:30.798785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7285abfa-256a-42a4-8490-870bf44bc2d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:30.799931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7285abfa-256a-42a4-8490-870bf44bc2d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:30.800579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7285abfa-256a-42a4-8490-870bf44bc2d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:30.801000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7285abfa-256a-42a4-8490-870bf44bc2d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:30.942504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7285abfa-256a-42a4-8490-870bf44bc2d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:30.951050 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7285abfa-256a-42a4-8490-870bf44bc2d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1726 microversion: 2.1 time: 0.173016 Aug 29 16:29:30.951675 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3782/7787] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:30 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:31.975269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d2b1552d-9e67-4ce2-9bdd-2e20f70132b0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:31.975861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d2b1552d-9e67-4ce2-9bdd-2e20f70132b0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:31.982814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2b1552d-9e67-4ce2-9bdd-2e20f70132b0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:31.983330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2b1552d-9e67-4ce2-9bdd-2e20f70132b0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:31.983786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2b1552d-9e67-4ce2-9bdd-2e20f70132b0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:31.984501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2b1552d-9e67-4ce2-9bdd-2e20f70132b0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:31.984978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2b1552d-9e67-4ce2-9bdd-2e20f70132b0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:31.985462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d2b1552d-9e67-4ce2-9bdd-2e20f70132b0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:32.122932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d2b1552d-9e67-4ce2-9bdd-2e20f70132b0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:32.136441 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d2b1552d-9e67-4ce2-9bdd-2e20f70132b0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1726 microversion: 2.1 time: 0.166113 Aug 29 16:29:32.137370 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4006/7788] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:31 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:33.160253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-393e38f9-7dfe-40f2-a694-b548fe7e48f8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:33.160929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-393e38f9-7dfe-40f2-a694-b548fe7e48f8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:33.167668 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-393e38f9-7dfe-40f2-a694-b548fe7e48f8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:33.168153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-393e38f9-7dfe-40f2-a694-b548fe7e48f8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:33.168572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-393e38f9-7dfe-40f2-a694-b548fe7e48f8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:33.169299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-393e38f9-7dfe-40f2-a694-b548fe7e48f8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:33.169764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-393e38f9-7dfe-40f2-a694-b548fe7e48f8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:33.170195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-393e38f9-7dfe-40f2-a694-b548fe7e48f8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:33.311026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-393e38f9-7dfe-40f2-a694-b548fe7e48f8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:33.320738 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-393e38f9-7dfe-40f2-a694-b548fe7e48f8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1726 microversion: 2.1 time: 0.164415 Aug 29 16:29:33.321357 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3783/7789] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:33 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:34.347524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c0d611d9-3c89-49af-aa6f-18c80518a686 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:34.348399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c0d611d9-3c89-49af-aa6f-18c80518a686 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:34.355798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0d611d9-3c89-49af-aa6f-18c80518a686 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:34.356304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0d611d9-3c89-49af-aa6f-18c80518a686 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:34.356762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0d611d9-3c89-49af-aa6f-18c80518a686 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:34.357513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0d611d9-3c89-49af-aa6f-18c80518a686 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:34.358000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0d611d9-3c89-49af-aa6f-18c80518a686 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:34.358447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c0d611d9-3c89-49af-aa6f-18c80518a686 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:34.492967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c0d611d9-3c89-49af-aa6f-18c80518a686 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:34.501684 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c0d611d9-3c89-49af-aa6f-18c80518a686 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1723 microversion: 2.1 time: 0.161165 Aug 29 16:29:34.502239 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4007/7790] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:34 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:34.530330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:29:34.531004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:34.538710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:34.539204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:34.539646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:34.540348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:34.540811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:34.541282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:34.588503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:34.588981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:34.589451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:34.590170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:34.590618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:34.591044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:34.612432 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Getting quotas for project 1a3432e106e74db480a1f7a17af514fb. Resources: {'ram', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:29:34.618033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Getting quotas for user 6658968475ea487ea0aba9be50d861fe and project 1a3432e106e74db480a1f7a17af514fb. Resources: {'ram', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:29:34.733647 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-47134b89-8ad8-45dc-934f-dbe115c2755a tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "POST /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80/action" status: 202 len: 0 microversion: 2.1 time: 0.208243 Aug 29 16:29:34.734264 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3784/7791] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:29:34 2022] POST /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:29:34.742787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-989de33c-fe08-446c-924c-54b4519ba861 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:34.743422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-989de33c-fe08-446c-924c-54b4519ba861 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:34.750003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-989de33c-fe08-446c-924c-54b4519ba861 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:34.750532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-989de33c-fe08-446c-924c-54b4519ba861 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:34.750977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-989de33c-fe08-446c-924c-54b4519ba861 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:34.751720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-989de33c-fe08-446c-924c-54b4519ba861 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:34.752195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-989de33c-fe08-446c-924c-54b4519ba861 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:34.752637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-989de33c-fe08-446c-924c-54b4519ba861 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:34.889682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-989de33c-fe08-446c-924c-54b4519ba861 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:34.902855 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-989de33c-fe08-446c-924c-54b4519ba861 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.163785 Aug 29 16:29:34.903711 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4008/7792] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:34 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:35.930672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e2ef19c4-4be7-4f17-abd4-2c31489a054b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:35.931372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e2ef19c4-4be7-4f17-abd4-2c31489a054b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:35.939863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2ef19c4-4be7-4f17-abd4-2c31489a054b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:35.940359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2ef19c4-4be7-4f17-abd4-2c31489a054b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:35.940803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2ef19c4-4be7-4f17-abd4-2c31489a054b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:35.941535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2ef19c4-4be7-4f17-abd4-2c31489a054b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:35.942022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2ef19c4-4be7-4f17-abd4-2c31489a054b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:35.942454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e2ef19c4-4be7-4f17-abd4-2c31489a054b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:36.085939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e2ef19c4-4be7-4f17-abd4-2c31489a054b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:36.099042 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e2ef19c4-4be7-4f17-abd4-2c31489a054b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.172855 Aug 29 16:29:36.099804 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3785/7793] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:35 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:37.129776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-83df8f90-6d5a-4314-aeaa-ed30c0f126fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:37.130375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-83df8f90-6d5a-4314-aeaa-ed30c0f126fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:37.137627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83df8f90-6d5a-4314-aeaa-ed30c0f126fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:37.138120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83df8f90-6d5a-4314-aeaa-ed30c0f126fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:37.138571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83df8f90-6d5a-4314-aeaa-ed30c0f126fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:37.139277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83df8f90-6d5a-4314-aeaa-ed30c0f126fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:37.139738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83df8f90-6d5a-4314-aeaa-ed30c0f126fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:37.140178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-83df8f90-6d5a-4314-aeaa-ed30c0f126fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:37.274294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-83df8f90-6d5a-4314-aeaa-ed30c0f126fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:37.284031 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-83df8f90-6d5a-4314-aeaa-ed30c0f126fa tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.160614 Aug 29 16:29:37.296256 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4009/7794] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:37 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:37.342262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f4880a05-5b86-45d7-8696-3e074f7d56a5 req-3f2bf71b-68c6-4a01-bc4e-7a0565d0630b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361348ed-6459-404b-a1ef-84b4df3f5d80", "name": "network-vif-plugged", "status": "completed", "tag": "8674d13e-76b4-4954-9db8-93524f000a3c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:29:37.352066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f4880a05-5b86-45d7-8696-3e074f7d56a5 req-3f2bf71b-68c6-4a01-bc4e-7a0565d0630b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:37.352538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f4880a05-5b86-45d7-8696-3e074f7d56a5 req-3f2bf71b-68c6-4a01-bc4e-7a0565d0630b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:37.352980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f4880a05-5b86-45d7-8696-3e074f7d56a5 req-3f2bf71b-68c6-4a01-bc4e-7a0565d0630b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:37.365307 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f4880a05-5b86-45d7-8696-3e074f7d56a5 req-3f2bf71b-68c6-4a01-bc4e-7a0565d0630b service nova] Creating event network-vif-plugged:8674d13e-76b4-4954-9db8-93524f000a3c for instance 361348ed-6459-404b-a1ef-84b4df3f5d80 on n-h1-839401-11 Aug 29 16:29:37.370926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-f4880a05-5b86-45d7-8696-3e074f7d56a5 req-3f2bf71b-68c6-4a01-bc4e-7a0565d0630b service nova] Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:29:37.382622 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f4880a05-5b86-45d7-8696-3e074f7d56a5 req-3f2bf71b-68c6-4a01-bc4e-7a0565d0630b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098157 Aug 29 16:29:37.383513 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3786/7795] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:29:38.308130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-489fb6dd-a34d-4412-8e28-85361fadfb7e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:38.308752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-489fb6dd-a34d-4412-8e28-85361fadfb7e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:38.316319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-489fb6dd-a34d-4412-8e28-85361fadfb7e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:38.316806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-489fb6dd-a34d-4412-8e28-85361fadfb7e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:38.317340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-489fb6dd-a34d-4412-8e28-85361fadfb7e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:38.318074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-489fb6dd-a34d-4412-8e28-85361fadfb7e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:38.318556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-489fb6dd-a34d-4412-8e28-85361fadfb7e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:38.319008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-489fb6dd-a34d-4412-8e28-85361fadfb7e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:38.465191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-489fb6dd-a34d-4412-8e28-85361fadfb7e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:38.474225 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-489fb6dd-a34d-4412-8e28-85361fadfb7e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.170291 Aug 29 16:29:38.474819 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4010/7796] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:38 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:39.502425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b2960153-2a36-4e73-aeda-772b22b1fe95 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:39.503579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b2960153-2a36-4e73-aeda-772b22b1fe95 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:39.510714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2960153-2a36-4e73-aeda-772b22b1fe95 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:39.511200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2960153-2a36-4e73-aeda-772b22b1fe95 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:39.511639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2960153-2a36-4e73-aeda-772b22b1fe95 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:39.512329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2960153-2a36-4e73-aeda-772b22b1fe95 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:39.512783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2960153-2a36-4e73-aeda-772b22b1fe95 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:39.513244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b2960153-2a36-4e73-aeda-772b22b1fe95 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:39.654712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b2960153-2a36-4e73-aeda-772b22b1fe95 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:39.663441 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b2960153-2a36-4e73-aeda-772b22b1fe95 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.169937 Aug 29 16:29:39.664224 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3787/7797] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:39 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:40.441575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-ff8b1e8b-6789-4372-b00f-91e2bbe34d23 req-f4bc2147-cc08-4525-8590-36ad3c716341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361348ed-6459-404b-a1ef-84b4df3f5d80", "name": "network-vif-unplugged", "status": "completed", "tag": "8674d13e-76b4-4954-9db8-93524f000a3c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:29:40.452843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ff8b1e8b-6789-4372-b00f-91e2bbe34d23 req-f4bc2147-cc08-4525-8590-36ad3c716341 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:40.453379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ff8b1e8b-6789-4372-b00f-91e2bbe34d23 req-f4bc2147-cc08-4525-8590-36ad3c716341 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:40.453993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ff8b1e8b-6789-4372-b00f-91e2bbe34d23 req-f4bc2147-cc08-4525-8590-36ad3c716341 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:40.467373 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-ff8b1e8b-6789-4372-b00f-91e2bbe34d23 req-f4bc2147-cc08-4525-8590-36ad3c716341 service nova] Creating event network-vif-unplugged:8674d13e-76b4-4954-9db8-93524f000a3c for instance 361348ed-6459-404b-a1ef-84b4df3f5d80 on n-h2-839401-11 Aug 29 16:29:40.472924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [req-ff8b1e8b-6789-4372-b00f-91e2bbe34d23 req-f4bc2147-cc08-4525-8590-36ad3c716341 service nova] Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122360) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:29:40.484660 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-ff8b1e8b-6789-4372-b00f-91e2bbe34d23 req-f4bc2147-cc08-4525-8590-36ad3c716341 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046909 Aug 29 16:29:40.485450 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4011/7798] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:29:40.691798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d5e2b6b0-3832-434a-b14f-7d464ccfb022 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:40.692455 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d5e2b6b0-3832-434a-b14f-7d464ccfb022 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:40.709284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5e2b6b0-3832-434a-b14f-7d464ccfb022 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:40.710383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5e2b6b0-3832-434a-b14f-7d464ccfb022 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:40.710383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5e2b6b0-3832-434a-b14f-7d464ccfb022 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:40.710905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5e2b6b0-3832-434a-b14f-7d464ccfb022 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:40.711361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5e2b6b0-3832-434a-b14f-7d464ccfb022 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:40.711786 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5e2b6b0-3832-434a-b14f-7d464ccfb022 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:40.949478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d5e2b6b0-3832-434a-b14f-7d464ccfb022 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:40.958389 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d5e2b6b0-3832-434a-b14f-7d464ccfb022 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.270692 Aug 29 16:29:40.959279 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3788/7799] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:40 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:41.981768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8ade262e-38d5-4f53-8199-8b1e56836347 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:41.982488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8ade262e-38d5-4f53-8199-8b1e56836347 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:41.989742 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ade262e-38d5-4f53-8199-8b1e56836347 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:41.990251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ade262e-38d5-4f53-8199-8b1e56836347 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:41.990704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ade262e-38d5-4f53-8199-8b1e56836347 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:41.991429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ade262e-38d5-4f53-8199-8b1e56836347 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:41.991909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ade262e-38d5-4f53-8199-8b1e56836347 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:41.992341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8ade262e-38d5-4f53-8199-8b1e56836347 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:42.132397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8ade262e-38d5-4f53-8199-8b1e56836347 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:42.141023 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8ade262e-38d5-4f53-8199-8b1e56836347 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.164618 Aug 29 16:29:42.141697 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4012/7800] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:41 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:42.499854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-1436048d-51a0-433e-9ae6-17e94ab5d57a req-28534fce-452d-467a-b792-d133d0d3abaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "361348ed-6459-404b-a1ef-84b4df3f5d80", "tag": "8674d13e-76b4-4954-9db8-93524f000a3c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:29:42.510688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1436048d-51a0-433e-9ae6-17e94ab5d57a req-28534fce-452d-467a-b792-d133d0d3abaf service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:42.511181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1436048d-51a0-433e-9ae6-17e94ab5d57a req-28534fce-452d-467a-b792-d133d0d3abaf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:42.511618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1436048d-51a0-433e-9ae6-17e94ab5d57a req-28534fce-452d-467a-b792-d133d0d3abaf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:42.523686 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-1436048d-51a0-433e-9ae6-17e94ab5d57a req-28534fce-452d-467a-b792-d133d0d3abaf service nova] Creating event network-changed:8674d13e-76b4-4954-9db8-93524f000a3c for instance 361348ed-6459-404b-a1ef-84b4df3f5d80 on n-h2-839401-11 Aug 29 16:29:42.529349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-1436048d-51a0-433e-9ae6-17e94ab5d57a req-28534fce-452d-467a-b792-d133d0d3abaf service nova] Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:29:42.540438 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-1436048d-51a0-433e-9ae6-17e94ab5d57a req-28534fce-452d-467a-b792-d133d0d3abaf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044416 Aug 29 16:29:42.541061 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3789/7801] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:29:43.221159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f258bfce-3893-409e-9dcb-4a7c73b0c431 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:43.221873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f258bfce-3893-409e-9dcb-4a7c73b0c431 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:43.229230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f258bfce-3893-409e-9dcb-4a7c73b0c431 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:43.230102 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f258bfce-3893-409e-9dcb-4a7c73b0c431 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:43.230626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f258bfce-3893-409e-9dcb-4a7c73b0c431 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:43.231662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f258bfce-3893-409e-9dcb-4a7c73b0c431 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:43.232216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f258bfce-3893-409e-9dcb-4a7c73b0c431 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:43.232951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f258bfce-3893-409e-9dcb-4a7c73b0c431 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:43.389059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f258bfce-3893-409e-9dcb-4a7c73b0c431 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:43.399653 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f258bfce-3893-409e-9dcb-4a7c73b0c431 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.183421 Aug 29 16:29:43.400683 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4013/7802] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:43 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:44.430773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-afad2f4d-3370-40e8-8913-d8b784ca8bb4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:44.431490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-afad2f4d-3370-40e8-8913-d8b784ca8bb4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:44.438483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afad2f4d-3370-40e8-8913-d8b784ca8bb4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:44.438982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afad2f4d-3370-40e8-8913-d8b784ca8bb4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:44.439421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afad2f4d-3370-40e8-8913-d8b784ca8bb4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:44.440105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afad2f4d-3370-40e8-8913-d8b784ca8bb4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:44.440593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afad2f4d-3370-40e8-8913-d8b784ca8bb4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:44.441018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-afad2f4d-3370-40e8-8913-d8b784ca8bb4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:44.578520 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-afad2f4d-3370-40e8-8913-d8b784ca8bb4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:44.587258 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-afad2f4d-3370-40e8-8913-d8b784ca8bb4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.164370 Aug 29 16:29:44.587806 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3790/7803] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:44 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:45.609021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d1d6b1bc-6bba-4d30-b87f-6aa7243e7168 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:45.609711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d1d6b1bc-6bba-4d30-b87f-6aa7243e7168 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:45.617631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1bc-6bba-4d30-b87f-6aa7243e7168 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:45.618134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1bc-6bba-4d30-b87f-6aa7243e7168 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:45.618578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1bc-6bba-4d30-b87f-6aa7243e7168 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:45.619290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1bc-6bba-4d30-b87f-6aa7243e7168 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:45.619761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1bc-6bba-4d30-b87f-6aa7243e7168 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:45.620201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1bc-6bba-4d30-b87f-6aa7243e7168 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:45.753603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d1d6b1bc-6bba-4d30-b87f-6aa7243e7168 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:45.762142 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d1d6b1bc-6bba-4d30-b87f-6aa7243e7168 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.157175 Aug 29 16:29:45.762700 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4014/7804] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:45 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:46.783973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-72073e40-9822-4b8a-9de9-4d873e2ccd00 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:46.784545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-72073e40-9822-4b8a-9de9-4d873e2ccd00 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:46.786609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:29:46.793251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72073e40-9822-4b8a-9de9-4d873e2ccd00 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:46.793723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72073e40-9822-4b8a-9de9-4d873e2ccd00 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:46.794158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72073e40-9822-4b8a-9de9-4d873e2ccd00 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:46.794863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72073e40-9822-4b8a-9de9-4d873e2ccd00 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:46.795319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72073e40-9822-4b8a-9de9-4d873e2ccd00 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:46.795749 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72073e40-9822-4b8a-9de9-4d873e2ccd00 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:47.237021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-72073e40-9822-4b8a-9de9-4d873e2ccd00 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:47.245918 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-72073e40-9822-4b8a-9de9-4d873e2ccd00 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.466070 Aug 29 16:29:47.246500 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3791/7805] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:46 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:48.271907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-94ed7746-1ac2-494b-be64-1432c28a06e5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:48.272774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-94ed7746-1ac2-494b-be64-1432c28a06e5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:48.284789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ed7746-1ac2-494b-be64-1432c28a06e5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:48.285598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ed7746-1ac2-494b-be64-1432c28a06e5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:48.286060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ed7746-1ac2-494b-be64-1432c28a06e5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:48.286813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ed7746-1ac2-494b-be64-1432c28a06e5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:48.287292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ed7746-1ac2-494b-be64-1432c28a06e5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:48.287739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ed7746-1ac2-494b-be64-1432c28a06e5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:48.426139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-94ed7746-1ac2-494b-be64-1432c28a06e5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:48.435089 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-94ed7746-1ac2-494b-be64-1432c28a06e5 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.170191 Aug 29 16:29:48.435693 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4015/7806] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:48 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:49.460334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cdd44174-f620-4a9a-9290-cbd6b5bfa6cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:49.461656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cdd44174-f620-4a9a-9290-cbd6b5bfa6cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:49.471262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdd44174-f620-4a9a-9290-cbd6b5bfa6cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:49.471758 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdd44174-f620-4a9a-9290-cbd6b5bfa6cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:49.472509 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdd44174-f620-4a9a-9290-cbd6b5bfa6cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:49.473541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdd44174-f620-4a9a-9290-cbd6b5bfa6cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:49.473999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdd44174-f620-4a9a-9290-cbd6b5bfa6cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:49.474461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cdd44174-f620-4a9a-9290-cbd6b5bfa6cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:49.628358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cdd44174-f620-4a9a-9290-cbd6b5bfa6cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:49.637625 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cdd44174-f620-4a9a-9290-cbd6b5bfa6cb tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.183549 Aug 29 16:29:49.638218 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3792/7807] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:49 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:50.660159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4b2fb87c-78be-455b-bd44-5a4f9df2ce72 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:50.660808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4b2fb87c-78be-455b-bd44-5a4f9df2ce72 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:50.668443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b2fb87c-78be-455b-bd44-5a4f9df2ce72 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:50.668941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b2fb87c-78be-455b-bd44-5a4f9df2ce72 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:50.669423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b2fb87c-78be-455b-bd44-5a4f9df2ce72 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:50.670121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b2fb87c-78be-455b-bd44-5a4f9df2ce72 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:50.670589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b2fb87c-78be-455b-bd44-5a4f9df2ce72 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:50.671023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4b2fb87c-78be-455b-bd44-5a4f9df2ce72 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:50.830914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4b2fb87c-78be-455b-bd44-5a4f9df2ce72 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:50.839916 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4b2fb87c-78be-455b-bd44-5a4f9df2ce72 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.183834 Aug 29 16:29:50.840776 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4016/7808] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:50 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:51.862206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7727a639-bcae-4d66-9975-91d1bbda1a45 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:51.862953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7727a639-bcae-4d66-9975-91d1bbda1a45 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:51.870232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7727a639-bcae-4d66-9975-91d1bbda1a45 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:51.870714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7727a639-bcae-4d66-9975-91d1bbda1a45 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:51.871139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7727a639-bcae-4d66-9975-91d1bbda1a45 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:51.871827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7727a639-bcae-4d66-9975-91d1bbda1a45 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:51.872279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7727a639-bcae-4d66-9975-91d1bbda1a45 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:51.872702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7727a639-bcae-4d66-9975-91d1bbda1a45 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:52.014724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7727a639-bcae-4d66-9975-91d1bbda1a45 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:52.023339 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7727a639-bcae-4d66-9975-91d1bbda1a45 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.165042 Aug 29 16:29:52.023919 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3793/7809] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:51 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:53.048105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6d03fb2c-9a3c-4363-9d18-bfb4f4f92f27 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:53.049127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6d03fb2c-9a3c-4363-9d18-bfb4f4f92f27 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:53.058591 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d03fb2c-9a3c-4363-9d18-bfb4f4f92f27 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:53.059093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d03fb2c-9a3c-4363-9d18-bfb4f4f92f27 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:53.059569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d03fb2c-9a3c-4363-9d18-bfb4f4f92f27 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:53.060283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d03fb2c-9a3c-4363-9d18-bfb4f4f92f27 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:53.060753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d03fb2c-9a3c-4363-9d18-bfb4f4f92f27 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:53.061225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d03fb2c-9a3c-4363-9d18-bfb4f4f92f27 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:53.194271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6d03fb2c-9a3c-4363-9d18-bfb4f4f92f27 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:53.203195 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6d03fb2c-9a3c-4363-9d18-bfb4f4f92f27 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.161802 Aug 29 16:29:53.203783 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4017/7810] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:53 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:54.225074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-62ae840e-edd2-4c0f-b78e-4e5c63d74d03 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:54.225691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-62ae840e-edd2-4c0f-b78e-4e5c63d74d03 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:54.233239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62ae840e-edd2-4c0f-b78e-4e5c63d74d03 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:54.233734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62ae840e-edd2-4c0f-b78e-4e5c63d74d03 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:54.234175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62ae840e-edd2-4c0f-b78e-4e5c63d74d03 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:54.234878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62ae840e-edd2-4c0f-b78e-4e5c63d74d03 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:54.235345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62ae840e-edd2-4c0f-b78e-4e5c63d74d03 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:54.235773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-62ae840e-edd2-4c0f-b78e-4e5c63d74d03 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:54.250987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:29:54.369408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-62ae840e-edd2-4c0f-b78e-4e5c63d74d03 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:54.378237 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-62ae840e-edd2-4c0f-b78e-4e5c63d74d03 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1722 microversion: 2.1 time: 0.157075 Aug 29 16:29:54.378772 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3794/7811] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:54 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:55.408338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0646d2c3-a0d5-47b6-b9ff-887232665aa0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:55.409266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0646d2c3-a0d5-47b6-b9ff-887232665aa0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:55.418040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0646d2c3-a0d5-47b6-b9ff-887232665aa0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:55.418547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0646d2c3-a0d5-47b6-b9ff-887232665aa0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:55.419005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0646d2c3-a0d5-47b6-b9ff-887232665aa0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:55.419718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0646d2c3-a0d5-47b6-b9ff-887232665aa0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:55.420195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0646d2c3-a0d5-47b6-b9ff-887232665aa0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:55.420638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0646d2c3-a0d5-47b6-b9ff-887232665aa0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:55.572322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0646d2c3-a0d5-47b6-b9ff-887232665aa0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:55.580936 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0646d2c3-a0d5-47b6-b9ff-887232665aa0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1715 microversion: 2.1 time: 0.177916 Aug 29 16:29:55.581688 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4018/7812] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:55 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1715 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:55.601995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-20670a75-328f-4396-a046-3db30f04d1d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:55.604497 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-20670a75-328f-4396-a046-3db30f04d1d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:55.612082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20670a75-328f-4396-a046-3db30f04d1d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:55.612606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20670a75-328f-4396-a046-3db30f04d1d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:55.613049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20670a75-328f-4396-a046-3db30f04d1d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:55.613791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20670a75-328f-4396-a046-3db30f04d1d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:55.614254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20670a75-328f-4396-a046-3db30f04d1d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:55.614687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20670a75-328f-4396-a046-3db30f04d1d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:55.752528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-20670a75-328f-4396-a046-3db30f04d1d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:55.765468 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-20670a75-328f-4396-a046-3db30f04d1d7 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1715 microversion: 2.1 time: 0.167068 Aug 29 16:29:55.766091 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3795/7813] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:55 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1715 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:55.792444 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-08d0e46e-57bc-487b-90dc-058d2287ea3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:55.793398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-08d0e46e-57bc-487b-90dc-058d2287ea3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:55.802760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08d0e46e-57bc-487b-90dc-058d2287ea3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:55.803403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08d0e46e-57bc-487b-90dc-058d2287ea3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:55.803996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08d0e46e-57bc-487b-90dc-058d2287ea3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:55.805027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08d0e46e-57bc-487b-90dc-058d2287ea3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:55.805734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08d0e46e-57bc-487b-90dc-058d2287ea3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:55.806174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-08d0e46e-57bc-487b-90dc-058d2287ea3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:55.946596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-08d0e46e-57bc-487b-90dc-058d2287ea3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:55.957496 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-08d0e46e-57bc-487b-90dc-058d2287ea3e tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1715 microversion: 2.1 time: 0.171232 Aug 29 16:29:55.958619 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4019/7814] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:55 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1715 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:55.979697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0eadc024-7dc5-485a-a6b4-4dfe0ff766f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:55.980209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0eadc024-7dc5-485a-a6b4-4dfe0ff766f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:55.986426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eadc024-7dc5-485a-a6b4-4dfe0ff766f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:55.986921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eadc024-7dc5-485a-a6b4-4dfe0ff766f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:55.987361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eadc024-7dc5-485a-a6b4-4dfe0ff766f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:55.988061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eadc024-7dc5-485a-a6b4-4dfe0ff766f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:55.988524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eadc024-7dc5-485a-a6b4-4dfe0ff766f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:55.988949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0eadc024-7dc5-485a-a6b4-4dfe0ff766f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:56.016147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0eadc024-7dc5-485a-a6b4-4dfe0ff766f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:29:56.098051 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0eadc024-7dc5-485a-a6b4-4dfe0ff766f9 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "DELETE /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 204 len: 0 microversion: 2.1 time: 0.122049 Aug 29 16:29:56.098665 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3796/7815] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:29:55 2022] DELETE /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:29:56.107606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cc75ebcb-d8fa-40ef-b35b-40b92b92b496 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:56.108292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cc75ebcb-d8fa-40ef-b35b-40b92b92b496 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:56.114541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc75ebcb-d8fa-40ef-b35b-40b92b92b496 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:56.115044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc75ebcb-d8fa-40ef-b35b-40b92b92b496 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:56.115496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc75ebcb-d8fa-40ef-b35b-40b92b92b496 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:56.116216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc75ebcb-d8fa-40ef-b35b-40b92b92b496 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:56.116677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc75ebcb-d8fa-40ef-b35b-40b92b92b496 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:56.117145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc75ebcb-d8fa-40ef-b35b-40b92b92b496 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:56.257378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cc75ebcb-d8fa-40ef-b35b-40b92b92b496 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:56.266230 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cc75ebcb-d8fa-40ef-b35b-40b92b92b496 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1721 microversion: 2.1 time: 0.162527 Aug 29 16:29:56.266736 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4020/7816] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:56 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:57.288430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7217b172-d1ee-47a4-9869-82897435358f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:57.289260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7217b172-d1ee-47a4-9869-82897435358f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:57.297387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7217b172-d1ee-47a4-9869-82897435358f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:57.297894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7217b172-d1ee-47a4-9869-82897435358f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:57.298337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7217b172-d1ee-47a4-9869-82897435358f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:57.299054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7217b172-d1ee-47a4-9869-82897435358f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:57.299524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7217b172-d1ee-47a4-9869-82897435358f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:57.299956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7217b172-d1ee-47a4-9869-82897435358f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:57.434506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7217b172-d1ee-47a4-9869-82897435358f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:57.443169 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7217b172-d1ee-47a4-9869-82897435358f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1721 microversion: 2.1 time: 0.159172 Aug 29 16:29:57.443807 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3797/7817] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:57 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:58.464432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dde462ef-bc8a-4474-b402-f213f090fcc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:58.465044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dde462ef-bc8a-4474-b402-f213f090fcc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:58.468250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=34 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:29:58.473850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde462ef-bc8a-4474-b402-f213f090fcc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:58.474359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde462ef-bc8a-4474-b402-f213f090fcc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:58.474814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde462ef-bc8a-4474-b402-f213f090fcc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:58.475503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde462ef-bc8a-4474-b402-f213f090fcc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:58.475984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde462ef-bc8a-4474-b402-f213f090fcc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:58.477120 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dde462ef-bc8a-4474-b402-f213f090fcc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:58.479425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=100 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:29:58.543195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dde462ef-bc8a-4474-b402-f213f090fcc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:58.553759 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dde462ef-bc8a-4474-b402-f213f090fcc2 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1654 microversion: 2.1 time: 0.093548 Aug 29 16:29:58.554361 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4021/7818] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:58 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1654 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:58.820713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-5ea1de97-69c9-41df-af31-4a32218c4189 req-87530c6f-693d-43e0-a324-7cedf862b814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361348ed-6459-404b-a1ef-84b4df3f5d80", "name": "network-vif-deleted", "tag": "8674d13e-76b4-4954-9db8-93524f000a3c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:29:58.827978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:29:58.840111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5ea1de97-69c9-41df-af31-4a32218c4189 req-87530c6f-693d-43e0-a324-7cedf862b814 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:58.840984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5ea1de97-69c9-41df-af31-4a32218c4189 req-87530c6f-693d-43e0-a324-7cedf862b814 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:58.842922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5ea1de97-69c9-41df-af31-4a32218c4189 req-87530c6f-693d-43e0-a324-7cedf862b814 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:58.859507 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5ea1de97-69c9-41df-af31-4a32218c4189 req-87530c6f-693d-43e0-a324-7cedf862b814 service nova] Creating event network-vif-deleted:8674d13e-76b4-4954-9db8-93524f000a3c for instance 361348ed-6459-404b-a1ef-84b4df3f5d80 on n-h2-839401-11 Aug 29 16:29:58.868675 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-5ea1de97-69c9-41df-af31-4a32218c4189 req-87530c6f-693d-43e0-a324-7cedf862b814 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051419 Aug 29 16:29:58.869534 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3798/7819] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:29:59.575685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a9f39d9-2bdd-4c81-af7e-5d1149c6d2e8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:59.576276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9a9f39d9-2bdd-4c81-af7e-5d1149c6d2e8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:59.583761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a9f39d9-2bdd-4c81-af7e-5d1149c6d2e8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:59.584324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a9f39d9-2bdd-4c81-af7e-5d1149c6d2e8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:59.584748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a9f39d9-2bdd-4c81-af7e-5d1149c6d2e8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:59.585521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a9f39d9-2bdd-4c81-af7e-5d1149c6d2e8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:59.585994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a9f39d9-2bdd-4c81-af7e-5d1149c6d2e8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:59.586436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9a9f39d9-2bdd-4c81-af7e-5d1149c6d2e8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:59.658275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9a9f39d9-2bdd-4c81-af7e-5d1149c6d2e8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:59.667463 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a9f39d9-2bdd-4c81-af7e-5d1149c6d2e8 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1370 microversion: 2.1 time: 0.095702 Aug 29 16:29:59.668369 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4022/7820] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:59 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1370 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:00.695629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-29e95bea-0d09-4410-8f33-9c4b82a54956 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:00.698187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-29e95bea-0d09-4410-8f33-9c4b82a54956 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:00.705939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29e95bea-0d09-4410-8f33-9c4b82a54956 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:00.706457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29e95bea-0d09-4410-8f33-9c4b82a54956 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:00.706896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29e95bea-0d09-4410-8f33-9c4b82a54956 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:00.707597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29e95bea-0d09-4410-8f33-9c4b82a54956 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:00.708073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29e95bea-0d09-4410-8f33-9c4b82a54956 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:00.708502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-29e95bea-0d09-4410-8f33-9c4b82a54956 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:00.773224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-29e95bea-0d09-4410-8f33-9c4b82a54956 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:00.781797 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-29e95bea-0d09-4410-8f33-9c4b82a54956 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1370 microversion: 2.1 time: 0.096156 Aug 29 16:30:00.782401 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3799/7821] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:00 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:01.802648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-25397235-f056-48b0-b384-c2bccd6816e6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:01.803397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-25397235-f056-48b0-b384-c2bccd6816e6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:01.810928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25397235-f056-48b0-b384-c2bccd6816e6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:01.811548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25397235-f056-48b0-b384-c2bccd6816e6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:01.812074 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25397235-f056-48b0-b384-c2bccd6816e6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:01.812861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25397235-f056-48b0-b384-c2bccd6816e6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:01.813441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25397235-f056-48b0-b384-c2bccd6816e6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:01.813963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-25397235-f056-48b0-b384-c2bccd6816e6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:01.879570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-25397235-f056-48b0-b384-c2bccd6816e6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:01.888313 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-25397235-f056-48b0-b384-c2bccd6816e6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1370 microversion: 2.1 time: 0.089736 Aug 29 16:30:01.888899 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4023/7822] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:01 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1370 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:02.909874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-76f52733-8e0a-480f-bba0-2a3c340dc868 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:02.910430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-76f52733-8e0a-480f-bba0-2a3c340dc868 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:02.918081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76f52733-8e0a-480f-bba0-2a3c340dc868 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:02.918590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76f52733-8e0a-480f-bba0-2a3c340dc868 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:02.919034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76f52733-8e0a-480f-bba0-2a3c340dc868 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:02.919777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76f52733-8e0a-480f-bba0-2a3c340dc868 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:02.920229 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76f52733-8e0a-480f-bba0-2a3c340dc868 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:02.920661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-76f52733-8e0a-480f-bba0-2a3c340dc868 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:02.987415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-76f52733-8e0a-480f-bba0-2a3c340dc868 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:02.995824 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-76f52733-8e0a-480f-bba0-2a3c340dc868 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1370 microversion: 2.1 time: 0.090092 Aug 29 16:30:02.996408 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3800/7823] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:02 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1370 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:04.016962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f817ff41-107e-49e7-8ccd-110168b484d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:04.017791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f817ff41-107e-49e7-8ccd-110168b484d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:04.025092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f817ff41-107e-49e7-8ccd-110168b484d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:04.025627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f817ff41-107e-49e7-8ccd-110168b484d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:04.026087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f817ff41-107e-49e7-8ccd-110168b484d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:04.026888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f817ff41-107e-49e7-8ccd-110168b484d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:04.027364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f817ff41-107e-49e7-8ccd-110168b484d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:04.027809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f817ff41-107e-49e7-8ccd-110168b484d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:04.063738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f817ff41-107e-49e7-8ccd-110168b484d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:04.064263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f817ff41-107e-49e7-8ccd-110168b484d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:04.064706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f817ff41-107e-49e7-8ccd-110168b484d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:04.065195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-f817ff41-107e-49e7-8ccd-110168b484d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lazy-loading 'fault' on Instance uuid 361348ed-6459-404b-a1ef-84b4df3f5d80 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:30:04.113460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f817ff41-107e-49e7-8ccd-110168b484d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658968475ea487ea0aba9be50d861fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a3432e106e74db480a1f7a17af514fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:04.121261 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f817ff41-107e-49e7-8ccd-110168b484d0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 200 len: 1329 microversion: 2.1 time: 0.108477 Aug 29 16:30:04.121848 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4024/7824] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:04 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 1329 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:05.146281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2f9e1857-51ba-4aa4-800e-4bf2698d3a0b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:05.147198 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2f9e1857-51ba-4aa4-800e-4bf2698d3a0b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:05.159258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f9e1857-51ba-4aa4-800e-4bf2698d3a0b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:05.160208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f9e1857-51ba-4aa4-800e-4bf2698d3a0b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:05.161258 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f9e1857-51ba-4aa4-800e-4bf2698d3a0b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:05.162427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f9e1857-51ba-4aa4-800e-4bf2698d3a0b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:05.163192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f9e1857-51ba-4aa4-800e-4bf2698d3a0b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:05.163911 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2f9e1857-51ba-4aa4-800e-4bf2698d3a0b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:05.181958 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-2f9e1857-51ba-4aa4-800e-4bf2698d3a0b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] HTTP exception thrown: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2f9e1857-51ba-4aa4-800e-4bf2698d3a0b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Request method failure captured: Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 HTTP/1.1 Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOeCmxszHic3fR-dD_FiVESHdRYratk0u2UW9FXU2W3acquSUUlqZBMx4K0KtqOALAZPC24K6LNbNevDXRbYlme3cOp5pFNwEiKyAZ1t4P951EcRw9FjJ4SV_PAxR4V5iAAz1_B-GZ6uA0zFPfIDeLmTpv-TVgqY352WqC50xTbg0HI Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a3432e106e74db480a1f7a17af514fb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}] Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6658968475ea487ea0aba9be50d861fe Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '361348ed-6459-404b-a1ef-84b4df3f5d80'} Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:05.183636 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:05.188123 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:05.188123 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:05.188123 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:05.188123 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:05.188123 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:05.188123 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:05.188123 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:05.188123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2f9e1857-51ba-4aa4-800e-4bf2698d3a0b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Returning 404 to user: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:05.188123 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2f9e1857-51ba-4aa4-800e-4bf2698d3a0b tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 404 len: 111 microversion: 2.1 time: 0.045460 Aug 29 16:30:05.188123 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3801/7825] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:05 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:05.246520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-01cc6881-06a4-4715-ac44-d0355a95667c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:05.248903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-01cc6881-06a4-4715-ac44-d0355a95667c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:05.260797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01cc6881-06a4-4715-ac44-d0355a95667c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:05.261384 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01cc6881-06a4-4715-ac44-d0355a95667c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:05.261844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01cc6881-06a4-4715-ac44-d0355a95667c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:05.262560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01cc6881-06a4-4715-ac44-d0355a95667c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:05.263034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01cc6881-06a4-4715-ac44-d0355a95667c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:05.263472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01cc6881-06a4-4715-ac44-d0355a95667c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:05.277271 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-01cc6881-06a4-4715-ac44-d0355a95667c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] HTTP exception thrown: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-01cc6881-06a4-4715-ac44-d0355a95667c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Request method failure captured: Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80/os-volume_attachments HTTP/1.1 Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOeCmxszHic3fR-dD_FiVESHdRYratk0u2UW9FXU2W3acquSUUlqZBMx4K0KtqOALAZPC24K6LNbNevDXRbYlme3cOp5pFNwEiKyAZ1t4P951EcRw9FjJ4SV_PAxR4V5iAAz1_B-GZ6uA0zFPfIDeLmTpv-TVgqY352WqC50xTbg0HI Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a3432e106e74db480a1f7a17af514fb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}] Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6658968475ea487ea0aba9be50d861fe Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'server_id': '361348ed-6459-404b-a1ef-84b4df3f5d80'} Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:30:05.279136 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:30:05.283262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:05.283262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:05.283262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:05.283262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:05.283262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:05.283262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:05.283262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:05.283262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:05.283262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:05.283262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:05.283262 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:05.283262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-01cc6881-06a4-4715-ac44-d0355a95667c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Returning 404 to user: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:05.283262 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-01cc6881-06a4-4715-ac44-d0355a95667c tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038254 Aug 29 16:30:05.283262 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4025/7826] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:30:05 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:08.619212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8970170d-2625-40e3-99e0-8b53c9e63cf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:08.619736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8970170d-2625-40e3-99e0-8b53c9e63cf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:08.626934 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8970170d-2625-40e3-99e0-8b53c9e63cf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.627428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8970170d-2625-40e3-99e0-8b53c9e63cf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.627895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8970170d-2625-40e3-99e0-8b53c9e63cf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.628583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8970170d-2625-40e3-99e0-8b53c9e63cf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.629046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8970170d-2625-40e3-99e0-8b53c9e63cf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.629515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8970170d-2625-40e3-99e0-8b53c9e63cf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.643456 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-8970170d-2625-40e3-99e0-8b53c9e63cf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] HTTP exception thrown: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8970170d-2625-40e3-99e0-8b53c9e63cf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Request method failure captured: Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 HTTP/1.1 Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOeCmxszHic3fR-dD_FiVESHdRYratk0u2UW9FXU2W3acquSUUlqZBMx4K0KtqOALAZPC24K6LNbNevDXRbYlme3cOp5pFNwEiKyAZ1t4P951EcRw9FjJ4SV_PAxR4V5iAAz1_B-GZ6uA0zFPfIDeLmTpv-TVgqY352WqC50xTbg0HI Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a3432e106e74db480a1f7a17af514fb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}] Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6658968475ea487ea0aba9be50d861fe Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '361348ed-6459-404b-a1ef-84b4df3f5d80'} Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:30:08.645126 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:30:08.649463 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:08.649463 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.649463 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:08.649463 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.649463 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.649463 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:08.649463 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:08.649463 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:08.649463 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:08.649463 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:08.649463 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.649463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8970170d-2625-40e3-99e0-8b53c9e63cf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Returning 404 to user: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:08.649463 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8970170d-2625-40e3-99e0-8b53c9e63cf0 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "DELETE /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 404 len: 111 microversion: 2.1 time: 0.031446 Aug 29 16:30:08.649463 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3802/7827] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:30:08 2022] DELETE /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:08.655268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-adb684ad-1830-4b7a-a7f7-8296b6d3cfb6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:08.655909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-adb684ad-1830-4b7a-a7f7-8296b6d3cfb6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 361348ed-6459-404b-a1ef-84b4df3f5d80] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:08.664003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-adb684ad-1830-4b7a-a7f7-8296b6d3cfb6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.664500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-adb684ad-1830-4b7a-a7f7-8296b6d3cfb6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.664959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-adb684ad-1830-4b7a-a7f7-8296b6d3cfb6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.665731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-adb684ad-1830-4b7a-a7f7-8296b6d3cfb6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.666207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-adb684ad-1830-4b7a-a7f7-8296b6d3cfb6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.666650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-adb684ad-1830-4b7a-a7f7-8296b6d3cfb6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.680795 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-adb684ad-1830-4b7a-a7f7-8296b6d3cfb6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] HTTP exception thrown: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-adb684ad-1830-4b7a-a7f7-8296b6d3cfb6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Request method failure captured: Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 HTTP/1.1 Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOeCmxszHic3fR-dD_FiVESHdRYratk0u2UW9FXU2W3acquSUUlqZBMx4K0KtqOALAZPC24K6LNbNevDXRbYlme3cOp5pFNwEiKyAZ1t4P951EcRw9FjJ4SV_PAxR4V5iAAz1_B-GZ6uA0zFPfIDeLmTpv-TVgqY352WqC50xTbg0HI Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a3432e106e74db480a1f7a17af514fb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}] Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6658968475ea487ea0aba9be50d861fe Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '361348ed-6459-404b-a1ef-84b4df3f5d80'} Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:08.682398 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.687699 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.687699 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:08.687699 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:08.687699 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:08.687699 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:08.687699 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. Aug 29 16:30:08.687699 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.687699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-adb684ad-1830-4b7a-a7f7-8296b6d3cfb6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Returning 404 to user: Instance 361348ed-6459-404b-a1ef-84b4df3f5d80 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:08.687699 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-adb684ad-1830-4b7a-a7f7-8296b6d3cfb6 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80" status: 404 len: 111 microversion: 2.1 time: 0.032694 Aug 29 16:30:08.687699 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4026/7828] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:08 2022] GET /compute/v2.1/servers/361348ed-6459-404b-a1ef-84b4df3f5d80 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:08.695778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-07c1b95d-3eab-4b3e-981d-de2f2bc06dca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:08.696484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-07c1b95d-3eab-4b3e-981d-de2f2bc06dca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:08.705775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07c1b95d-3eab-4b3e-981d-de2f2bc06dca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.706381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07c1b95d-3eab-4b3e-981d-de2f2bc06dca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.707021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07c1b95d-3eab-4b3e-981d-de2f2bc06dca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.707919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07c1b95d-3eab-4b3e-981d-de2f2bc06dca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.708611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07c1b95d-3eab-4b3e-981d-de2f2bc06dca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.709159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-07c1b95d-3eab-4b3e-981d-de2f2bc06dca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.725153 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-07c1b95d-3eab-4b3e-981d-de2f2bc06dca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] HTTP exception thrown: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-07c1b95d-3eab-4b3e-981d-de2f2bc06dca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Request method failure captured: Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 HTTP/1.1 Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOeCmxszHic3fR-dD_FiVESHdRYratk0u2UW9FXU2W3acquSUUlqZBMx4K0KtqOALAZPC24K6LNbNevDXRbYlme3cOp5pFNwEiKyAZ1t4P951EcRw9FjJ4SV_PAxR4V5iAAz1_B-GZ6uA0zFPfIDeLmTpv-TVgqY352WqC50xTbg0HI Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a3432e106e74db480a1f7a17af514fb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}] Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6658968475ea487ea0aba9be50d861fe Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '8c7730fa-cc54-496c-99e2-68e699089960'} Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:30:08.726722 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:30:08.731259 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:30:08.731259 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.731259 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:08.731259 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.731259 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.731259 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:08.731259 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:08.731259 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:08.731259 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:08.731259 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:30:08.731259 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.731259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-07c1b95d-3eab-4b3e-981d-de2f2bc06dca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Returning 404 to user: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:08.731259 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-07c1b95d-3eab-4b3e-981d-de2f2bc06dca tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 404 len: 111 microversion: 2.1 time: 0.038282 Aug 29 16:30:08.731259 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3803/7829] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:30:08 2022] DELETE /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:08.739722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7b252a40-d430-4b05-8724-a4988eb3fe74 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:08.740695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7b252a40-d430-4b05-8724-a4988eb3fe74 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: 8c7730fa-cc54-496c-99e2-68e699089960] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:08.748618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b252a40-d430-4b05-8724-a4988eb3fe74 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.749117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b252a40-d430-4b05-8724-a4988eb3fe74 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.749597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b252a40-d430-4b05-8724-a4988eb3fe74 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.750300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b252a40-d430-4b05-8724-a4988eb3fe74 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.750768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b252a40-d430-4b05-8724-a4988eb3fe74 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.751338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b252a40-d430-4b05-8724-a4988eb3fe74 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.765122 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-7b252a40-d430-4b05-8724-a4988eb3fe74 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] HTTP exception thrown: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7b252a40-d430-4b05-8724-a4988eb3fe74 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Request method failure captured: Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 HTTP/1.1 Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOeCmxszHic3fR-dD_FiVESHdRYratk0u2UW9FXU2W3acquSUUlqZBMx4K0KtqOALAZPC24K6LNbNevDXRbYlme3cOp5pFNwEiKyAZ1t4P951EcRw9FjJ4SV_PAxR4V5iAAz1_B-GZ6uA0zFPfIDeLmTpv-TVgqY352WqC50xTbg0HI Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a3432e106e74db480a1f7a17af514fb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}] Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6658968475ea487ea0aba9be50d861fe Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '8c7730fa-cc54-496c-99e2-68e699089960'} Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:08.766678 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.771348 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.771348 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:08.771348 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:08.771348 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:08.771348 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:08.771348 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. Aug 29 16:30:08.771348 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.771348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7b252a40-d430-4b05-8724-a4988eb3fe74 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Returning 404 to user: Instance 8c7730fa-cc54-496c-99e2-68e699089960 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:08.771348 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7b252a40-d430-4b05-8724-a4988eb3fe74 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960" status: 404 len: 111 microversion: 2.1 time: 0.034811 Aug 29 16:30:08.771348 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4027/7830] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:08 2022] GET /compute/v2.1/servers/8c7730fa-cc54-496c-99e2-68e699089960 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:08.777321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7452615f-056c-4eb2-bddc-c99753758a2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:08.777826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7452615f-056c-4eb2-bddc-c99753758a2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:08.784208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7452615f-056c-4eb2-bddc-c99753758a2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.784710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7452615f-056c-4eb2-bddc-c99753758a2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.785175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7452615f-056c-4eb2-bddc-c99753758a2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.785864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7452615f-056c-4eb2-bddc-c99753758a2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.786313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7452615f-056c-4eb2-bddc-c99753758a2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.786735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7452615f-056c-4eb2-bddc-c99753758a2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.800524 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-7452615f-056c-4eb2-bddc-c99753758a2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] HTTP exception thrown: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7452615f-056c-4eb2-bddc-c99753758a2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Request method failure captured: Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 HTTP/1.1 Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOeCmxszHic3fR-dD_FiVESHdRYratk0u2UW9FXU2W3acquSUUlqZBMx4K0KtqOALAZPC24K6LNbNevDXRbYlme3cOp5pFNwEiKyAZ1t4P951EcRw9FjJ4SV_PAxR4V5iAAz1_B-GZ6uA0zFPfIDeLmTpv-TVgqY352WqC50xTbg0HI Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a3432e106e74db480a1f7a17af514fb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}] Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6658968475ea487ea0aba9be50d861fe Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'b30609c4-2104-4b7a-ba81-6746b4353dd1'} Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:30:08.802129 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:30:08.806310 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:30:08.806310 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.806310 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:08.806310 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.806310 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.806310 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:08.806310 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:08.806310 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:08.806310 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:08.806310 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:30:08.806310 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.806310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7452615f-056c-4eb2-bddc-c99753758a2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Returning 404 to user: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:08.806310 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7452615f-056c-4eb2-bddc-c99753758a2f tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 404 len: 111 microversion: 2.1 time: 0.030296 Aug 29 16:30:08.806310 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3804/7831] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:30:08 2022] DELETE /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:08.812411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-094dd8de-84b4-4379-97b1-502d268a0dbc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:08.813234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-094dd8de-84b4-4379-97b1-502d268a0dbc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: b30609c4-2104-4b7a-ba81-6746b4353dd1] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:08.819973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-094dd8de-84b4-4379-97b1-502d268a0dbc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.820480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-094dd8de-84b4-4379-97b1-502d268a0dbc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.820935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-094dd8de-84b4-4379-97b1-502d268a0dbc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.821711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-094dd8de-84b4-4379-97b1-502d268a0dbc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.822187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-094dd8de-84b4-4379-97b1-502d268a0dbc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.822627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-094dd8de-84b4-4379-97b1-502d268a0dbc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.838221 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-094dd8de-84b4-4379-97b1-502d268a0dbc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] HTTP exception thrown: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-094dd8de-84b4-4379-97b1-502d268a0dbc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Request method failure captured: Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 HTTP/1.1 Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOeCmxszHic3fR-dD_FiVESHdRYratk0u2UW9FXU2W3acquSUUlqZBMx4K0KtqOALAZPC24K6LNbNevDXRbYlme3cOp5pFNwEiKyAZ1t4P951EcRw9FjJ4SV_PAxR4V5iAAz1_B-GZ6uA0zFPfIDeLmTpv-TVgqY352WqC50xTbg0HI Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a3432e106e74db480a1f7a17af514fb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}] Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6658968475ea487ea0aba9be50d861fe Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b30609c4-2104-4b7a-ba81-6746b4353dd1'} Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:08.839855 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.844329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.844329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:08.844329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:08.844329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:08.844329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:08.844329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. Aug 29 16:30:08.844329 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.844329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-094dd8de-84b4-4379-97b1-502d268a0dbc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Returning 404 to user: Instance b30609c4-2104-4b7a-ba81-6746b4353dd1 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:08.844329 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-094dd8de-84b4-4379-97b1-502d268a0dbc tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1" status: 404 len: 111 microversion: 2.1 time: 0.033079 Aug 29 16:30:08.845598 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4028/7832] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:08 2022] GET /compute/v2.1/servers/b30609c4-2104-4b7a-ba81-6746b4353dd1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:08.852364 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-73dcfdce-2bbf-4d12-8c1a-9e9dd0f4ee63 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:08.852870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-73dcfdce-2bbf-4d12-8c1a-9e9dd0f4ee63 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:08.859458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73dcfdce-2bbf-4d12-8c1a-9e9dd0f4ee63 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.859952 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73dcfdce-2bbf-4d12-8c1a-9e9dd0f4ee63 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.860386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73dcfdce-2bbf-4d12-8c1a-9e9dd0f4ee63 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.861134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73dcfdce-2bbf-4d12-8c1a-9e9dd0f4ee63 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.861615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73dcfdce-2bbf-4d12-8c1a-9e9dd0f4ee63 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.862040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73dcfdce-2bbf-4d12-8c1a-9e9dd0f4ee63 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.876981 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-73dcfdce-2bbf-4d12-8c1a-9e9dd0f4ee63 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] HTTP exception thrown: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-73dcfdce-2bbf-4d12-8c1a-9e9dd0f4ee63 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Request method failure captured: Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 HTTP/1.1 Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOeCmxszHic3fR-dD_FiVESHdRYratk0u2UW9FXU2W3acquSUUlqZBMx4K0KtqOALAZPC24K6LNbNevDXRbYlme3cOp5pFNwEiKyAZ1t4P951EcRw9FjJ4SV_PAxR4V5iAAz1_B-GZ6uA0zFPfIDeLmTpv-TVgqY352WqC50xTbg0HI Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a3432e106e74db480a1f7a17af514fb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}] Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6658968475ea487ea0aba9be50d861fe Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'd81fbbfc-83ef-4f12-8fb2-821092dd4367'} Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:30:08.878886 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:30:08.886277 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:30:08.886277 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.886277 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:08.886277 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.886277 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.886277 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:08.886277 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:08.886277 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:08.886277 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:08.886277 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:30:08.886277 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.886277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-73dcfdce-2bbf-4d12-8c1a-9e9dd0f4ee63 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Returning 404 to user: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:08.886277 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-73dcfdce-2bbf-4d12-8c1a-9e9dd0f4ee63 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 404 len: 111 microversion: 2.1 time: 0.031959 Aug 29 16:30:08.886277 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3805/7833] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:30:08 2022] DELETE /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:08.888960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4c8a5c4b-4c5f-4f9e-bbc0-89cef4e834d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:08.889617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4c8a5c4b-4c5f-4f9e-bbc0-89cef4e834d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] [instance: d81fbbfc-83ef-4f12-8fb2-821092dd4367] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:08.896008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c8a5c4b-4c5f-4f9e-bbc0-89cef4e834d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.896502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c8a5c4b-4c5f-4f9e-bbc0-89cef4e834d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.896946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c8a5c4b-4c5f-4f9e-bbc0-89cef4e834d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.897708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c8a5c4b-4c5f-4f9e-bbc0-89cef4e834d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.898172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c8a5c4b-4c5f-4f9e-bbc0-89cef4e834d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.898602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c8a5c4b-4c5f-4f9e-bbc0-89cef4e834d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.912514 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-4c8a5c4b-4c5f-4f9e-bbc0-89cef4e834d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] HTTP exception thrown: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4c8a5c4b-4c5f-4f9e-bbc0-89cef4e834d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Request method failure captured: Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 HTTP/1.1 Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOeCmxszHic3fR-dD_FiVESHdRYratk0u2UW9FXU2W3acquSUUlqZBMx4K0KtqOALAZPC24K6LNbNevDXRbYlme3cOp5pFNwEiKyAZ1t4P951EcRw9FjJ4SV_PAxR4V5iAAz1_B-GZ6uA0zFPfIDeLmTpv-TVgqY352WqC50xTbg0HI Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_1a3432e106e74db480a1f7a17af514fb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/1a3432e106e74db480a1f7a17af514fb"}]}] Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 1a3432e106e74db480a1f7a17af514fb Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServerActionsTestJSON-546053265 Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6658968475ea487ea0aba9be50d861fe Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServerActionsTestJSON-546053265-project Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'd81fbbfc-83ef-4f12-8fb2-821092dd4367'} Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:08.914085 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.918979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:08.918979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:08.918979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:08.918979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:08.918979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:08.918979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. Aug 29 16:30:08.918979 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:08.918979 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4c8a5c4b-4c5f-4f9e-bbc0-89cef4e834d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Returning 404 to user: Instance d81fbbfc-83ef-4f12-8fb2-821092dd4367 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:08.918979 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4c8a5c4b-4c5f-4f9e-bbc0-89cef4e834d4 tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367" status: 404 len: 111 microversion: 2.1 time: 0.030501 Aug 29 16:30:08.918979 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4029/7834] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:08 2022] GET /compute/v2.1/servers/d81fbbfc-83ef-4f12-8fb2-821092dd4367 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:08.924784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1c587f76-21d6-462e-927b-6cfa6250110d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] Calling method '.version_select at 0x7fc42a7578b0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:08.950359 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1c587f76-21d6-462e-927b-6cfa6250110d tempest-ServerActionsTestJSON-546053265 tempest-ServerActionsTestJSON-546053265-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1856537733" status: 202 len: 0 microversion: 2.1 time: 0.029521 Aug 29 16:30:08.950935 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3806/7835] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 16:30:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1856537733 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:30:18.653516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1609849217", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "ed429ec9-b95b-429d-b254-bf5745ce47f9"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:18.716763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] validate_networks() for [('ed429ec9-b95b-429d-b254-bf5745ce47f9', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:30:18.909228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=35 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:19.112546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:30:19.113072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:30:19.113574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:30:19.114001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:30:19.114429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:30:19.123821 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:19.124326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:19.124779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:19.125583 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:19.126060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:19.126504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:19.143749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Getting quotas for project b2f1ece12aec47a296a184a3bc361fd9. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:30:19.149526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Getting quotas for user ba304cedaa8b47f2ba039e956e335dc0 and project b2f1ece12aec47a296a184a3bc361fd9. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:30:19.162648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:30:19.165133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:30:19.214316 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cc21418f-5f44-4bf4-b173-9f6cef7165e4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685105 Aug 29 16:30:19.215157 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4030/7836] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:30:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:30:19.226718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f9e2d0d3-9b4d-49ba-ae06-a3644a79939d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:19.227339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f9e2d0d3-9b4d-49ba-ae06-a3644a79939d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:19.230143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:19.230853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:19.290757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f9e2d0d3-9b4d-49ba-ae06-a3644a79939d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:19.298172 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f9e2d0d3-9b4d-49ba-ae06-a3644a79939d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1217 microversion: 2.1 time: 0.075827 Aug 29 16:30:19.298829 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3807/7837] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:19 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:20.319774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4174c0dc-bcc7-46ae-ac60-67657df32ccc tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:20.320485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4174c0dc-bcc7-46ae-ac60-67657df32ccc tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:20.329678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4174c0dc-bcc7-46ae-ac60-67657df32ccc tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:20.330132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4174c0dc-bcc7-46ae-ac60-67657df32ccc tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:20.330578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4174c0dc-bcc7-46ae-ac60-67657df32ccc tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:20.331488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4174c0dc-bcc7-46ae-ac60-67657df32ccc tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:20.331954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4174c0dc-bcc7-46ae-ac60-67657df32ccc tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:20.332390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4174c0dc-bcc7-46ae-ac60-67657df32ccc tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:20.409379 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4174c0dc-bcc7-46ae-ac60-67657df32ccc tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:20.426177 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4174c0dc-bcc7-46ae-ac60-67657df32ccc tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1277 microversion: 2.1 time: 0.110734 Aug 29 16:30:20.440565 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4031/7838] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:20 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1277 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:21.447336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8f8e251d-2c8f-49f0-8501-ff1b738b5216 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:21.447921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8f8e251d-2c8f-49f0-8501-ff1b738b5216 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:21.455499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f8e251d-2c8f-49f0-8501-ff1b738b5216 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:21.456191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f8e251d-2c8f-49f0-8501-ff1b738b5216 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:21.457557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f8e251d-2c8f-49f0-8501-ff1b738b5216 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:21.458998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f8e251d-2c8f-49f0-8501-ff1b738b5216 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:21.460335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f8e251d-2c8f-49f0-8501-ff1b738b5216 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:21.460960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f8e251d-2c8f-49f0-8501-ff1b738b5216 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:21.723921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8f8e251d-2c8f-49f0-8501-ff1b738b5216 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:21.741263 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8f8e251d-2c8f-49f0-8501-ff1b738b5216 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1317 microversion: 2.1 time: 0.297907 Aug 29 16:30:21.745028 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3808/7839] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:21 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:21.854261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-d644c7db-d6be-45af-8c82-2b93bc8caad2 req-67d6e014-831c-405a-bf92-5a3eb64876a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a92f0b-589a-403b-8770-0c808ca1a458", "tag": "99a34f37-da09-4152-9318-ff79ae9ba3b2"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:21.868788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d644c7db-d6be-45af-8c82-2b93bc8caad2 req-67d6e014-831c-405a-bf92-5a3eb64876a4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:21.869452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d644c7db-d6be-45af-8c82-2b93bc8caad2 req-67d6e014-831c-405a-bf92-5a3eb64876a4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:21.869917 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d644c7db-d6be-45af-8c82-2b93bc8caad2 req-67d6e014-831c-405a-bf92-5a3eb64876a4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:21.883537 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-d644c7db-d6be-45af-8c82-2b93bc8caad2 req-67d6e014-831c-405a-bf92-5a3eb64876a4 service nova] Creating event network-changed:99a34f37-da09-4152-9318-ff79ae9ba3b2 for instance 46a92f0b-589a-403b-8770-0c808ca1a458 on n-h2-839401-11 Aug 29 16:30:21.888902 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-d644c7db-d6be-45af-8c82-2b93bc8caad2 req-67d6e014-831c-405a-bf92-5a3eb64876a4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039694 Aug 29 16:30:21.890050 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4032/7840] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:22.765618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-928fd210-66fc-47de-9dde-29f40bdf2d6a tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:22.766459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-928fd210-66fc-47de-9dde-29f40bdf2d6a tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:22.776234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-928fd210-66fc-47de-9dde-29f40bdf2d6a tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:22.776876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-928fd210-66fc-47de-9dde-29f40bdf2d6a tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:22.777504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-928fd210-66fc-47de-9dde-29f40bdf2d6a tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:22.778422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-928fd210-66fc-47de-9dde-29f40bdf2d6a tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:22.779027 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-928fd210-66fc-47de-9dde-29f40bdf2d6a tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:22.779588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-928fd210-66fc-47de-9dde-29f40bdf2d6a tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:22.921682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-928fd210-66fc-47de-9dde-29f40bdf2d6a tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:22.929920 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-928fd210-66fc-47de-9dde-29f40bdf2d6a tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1317 microversion: 2.1 time: 0.169507 Aug 29 16:30:22.930492 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3809/7841] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:22 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:23.957748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-377d2407-7387-4925-9880-7b6c6c4e4f99 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:23.959409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-377d2407-7387-4925-9880-7b6c6c4e4f99 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:23.970329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-377d2407-7387-4925-9880-7b6c6c4e4f99 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:23.970848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-377d2407-7387-4925-9880-7b6c6c4e4f99 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:23.971275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-377d2407-7387-4925-9880-7b6c6c4e4f99 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:23.972015 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-377d2407-7387-4925-9880-7b6c6c4e4f99 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:23.972620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-377d2407-7387-4925-9880-7b6c6c4e4f99 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:23.972981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-377d2407-7387-4925-9880-7b6c6c4e4f99 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:24.121772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-377d2407-7387-4925-9880-7b6c6c4e4f99 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:24.130227 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-377d2407-7387-4925-9880-7b6c6c4e4f99 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1317 microversion: 2.1 time: 0.181133 Aug 29 16:30:24.130807 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4033/7842] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:23 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:30:25.151875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4600cd12-79a8-4955-80b6-7debb3db99b7 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:25.152511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4600cd12-79a8-4955-80b6-7debb3db99b7 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:25.161062 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4600cd12-79a8-4955-80b6-7debb3db99b7 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:25.161686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4600cd12-79a8-4955-80b6-7debb3db99b7 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:25.162224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4600cd12-79a8-4955-80b6-7debb3db99b7 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:25.163041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4600cd12-79a8-4955-80b6-7debb3db99b7 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:25.163583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4600cd12-79a8-4955-80b6-7debb3db99b7 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:25.164081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4600cd12-79a8-4955-80b6-7debb3db99b7 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:25.298307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4600cd12-79a8-4955-80b6-7debb3db99b7 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:25.306167 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4600cd12-79a8-4955-80b6-7debb3db99b7 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1317 microversion: 2.1 time: 0.158631 Aug 29 16:30:25.306749 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3810/7843] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:25 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:26.329878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8cb00b24-ba34-4d75-8072-f9a9eb042721 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:26.330475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8cb00b24-ba34-4d75-8072-f9a9eb042721 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:26.338828 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cb00b24-ba34-4d75-8072-f9a9eb042721 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:26.339335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cb00b24-ba34-4d75-8072-f9a9eb042721 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:26.339777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cb00b24-ba34-4d75-8072-f9a9eb042721 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:26.340485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cb00b24-ba34-4d75-8072-f9a9eb042721 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:26.341332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cb00b24-ba34-4d75-8072-f9a9eb042721 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:26.341771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8cb00b24-ba34-4d75-8072-f9a9eb042721 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:26.481813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8cb00b24-ba34-4d75-8072-f9a9eb042721 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:26.489958 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8cb00b24-ba34-4d75-8072-f9a9eb042721 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1317 microversion: 2.1 time: 0.165036 Aug 29 16:30:26.490530 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4034/7844] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:26 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:27.514210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-34304a4c-3050-4c46-b777-26e13d9c85d1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:27.514989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-34304a4c-3050-4c46-b777-26e13d9c85d1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:27.525854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34304a4c-3050-4c46-b777-26e13d9c85d1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:27.526594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34304a4c-3050-4c46-b777-26e13d9c85d1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:27.527263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34304a4c-3050-4c46-b777-26e13d9c85d1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:27.528357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34304a4c-3050-4c46-b777-26e13d9c85d1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:27.529029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34304a4c-3050-4c46-b777-26e13d9c85d1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:27.529833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-34304a4c-3050-4c46-b777-26e13d9c85d1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:27.668107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-34304a4c-3050-4c46-b777-26e13d9c85d1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:27.676071 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-34304a4c-3050-4c46-b777-26e13d9c85d1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1317 microversion: 2.1 time: 0.168257 Aug 29 16:30:27.676648 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3811/7845] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:27 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:28.698779 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b641420b-b302-407c-a714-384a800350a8 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:28.699529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b641420b-b302-407c-a714-384a800350a8 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:28.702755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:28.709174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b641420b-b302-407c-a714-384a800350a8 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:28.709686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b641420b-b302-407c-a714-384a800350a8 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:28.710141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b641420b-b302-407c-a714-384a800350a8 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:28.710903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b641420b-b302-407c-a714-384a800350a8 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:28.711707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b641420b-b302-407c-a714-384a800350a8 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:28.711812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b641420b-b302-407c-a714-384a800350a8 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:28.846887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b641420b-b302-407c-a714-384a800350a8 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:28.855524 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b641420b-b302-407c-a714-384a800350a8 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1317 microversion: 2.1 time: 0.161868 Aug 29 16:30:28.856219 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4035/7846] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:28 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:28.882257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-361d94fb-6f9a-40e0-a983-b5de92702389 req-eaca089a-001f-4dac-8de6-eadf40062606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a92f0b-589a-403b-8770-0c808ca1a458", "name": "network-vif-plugged", "status": "completed", "tag": "99a34f37-da09-4152-9318-ff79ae9ba3b2"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:28.892800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-361d94fb-6f9a-40e0-a983-b5de92702389 req-eaca089a-001f-4dac-8de6-eadf40062606 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:28.893320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-361d94fb-6f9a-40e0-a983-b5de92702389 req-eaca089a-001f-4dac-8de6-eadf40062606 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:28.893750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-361d94fb-6f9a-40e0-a983-b5de92702389 req-eaca089a-001f-4dac-8de6-eadf40062606 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:28.906679 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-361d94fb-6f9a-40e0-a983-b5de92702389 req-eaca089a-001f-4dac-8de6-eadf40062606 service nova] Creating event network-vif-plugged:99a34f37-da09-4152-9318-ff79ae9ba3b2 for instance 46a92f0b-589a-403b-8770-0c808ca1a458 on n-h2-839401-11 Aug 29 16:30:28.911792 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-361d94fb-6f9a-40e0-a983-b5de92702389 req-eaca089a-001f-4dac-8de6-eadf40062606 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033312 Aug 29 16:30:28.912403 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3812/7847] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:29.876698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-27d697eb-50ec-44b9-b116-2fea4564a270 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:29.877250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-27d697eb-50ec-44b9-b116-2fea4564a270 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:29.879217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:29.879948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:29.887273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27d697eb-50ec-44b9-b116-2fea4564a270 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:29.887769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27d697eb-50ec-44b9-b116-2fea4564a270 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:29.888223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27d697eb-50ec-44b9-b116-2fea4564a270 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:29.889014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27d697eb-50ec-44b9-b116-2fea4564a270 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:29.889514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27d697eb-50ec-44b9-b116-2fea4564a270 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:29.889997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-27d697eb-50ec-44b9-b116-2fea4564a270 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:30.039273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-27d697eb-50ec-44b9-b116-2fea4564a270 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:30.047593 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-27d697eb-50ec-44b9-b116-2fea4564a270 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1317 microversion: 2.1 time: 0.175066 Aug 29 16:30:30.048178 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4036/7848] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:29 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:31.067570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:31.075767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-18aa087c-b24a-478d-ac02-44ffbf7953f3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:31.076974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-18aa087c-b24a-478d-ac02-44ffbf7953f3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:31.088338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18aa087c-b24a-478d-ac02-44ffbf7953f3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:31.089163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18aa087c-b24a-478d-ac02-44ffbf7953f3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:31.089886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18aa087c-b24a-478d-ac02-44ffbf7953f3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:31.091410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18aa087c-b24a-478d-ac02-44ffbf7953f3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:31.092217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18aa087c-b24a-478d-ac02-44ffbf7953f3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:31.092917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-18aa087c-b24a-478d-ac02-44ffbf7953f3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:31.242811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-18aa087c-b24a-478d-ac02-44ffbf7953f3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:31.254441 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-18aa087c-b24a-478d-ac02-44ffbf7953f3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1505 microversion: 2.1 time: 0.188437 Aug 29 16:30:31.255280 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3813/7849] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:31 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:31.320511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-618830870", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "ed429ec9-b95b-429d-b254-bf5745ce47f9"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:31.377045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] validate_networks() for [('ed429ec9-b95b-429d-b254-bf5745ce47f9', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:30:31.807767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:30:31.808212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:30:31.808705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:30:31.809162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:30:31.809596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:30:31.818975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:31.819480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:31.819907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:31.820655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:31.821155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:31.821601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:31.843121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Getting quotas for project b2f1ece12aec47a296a184a3bc361fd9. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:30:31.849170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Getting quotas for user ba304cedaa8b47f2ba039e956e335dc0 and project b2f1ece12aec47a296a184a3bc361fd9. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:30:31.862097 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:30:31.864500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:30:31.910958 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1c457578-fbd9-4601-88ae-747fc36aa53b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596046 Aug 29 16:30:31.911635 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4037/7850] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:30:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:30:31.922495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2d2c8b39-e502-477f-b8d2-0d6a20ef1872 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:31.923152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2d2c8b39-e502-477f-b8d2-0d6a20ef1872 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:31.977847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2d2c8b39-e502-477f-b8d2-0d6a20ef1872 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:31.984998 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2d2c8b39-e502-477f-b8d2-0d6a20ef1872 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 200 len: 1216 microversion: 2.1 time: 0.066419 Aug 29 16:30:31.985822 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3814/7851] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:31 2022] GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 1216 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:33.009490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d3ade72f-f006-4777-af51-ca91036eed2b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:33.010126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d3ade72f-f006-4777-af51-ca91036eed2b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:33.018294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ade72f-f006-4777-af51-ca91036eed2b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:33.018805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ade72f-f006-4777-af51-ca91036eed2b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:33.019512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ade72f-f006-4777-af51-ca91036eed2b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:33.020711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ade72f-f006-4777-af51-ca91036eed2b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:33.021238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ade72f-f006-4777-af51-ca91036eed2b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:33.021685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d3ade72f-f006-4777-af51-ca91036eed2b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:33.094824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d3ade72f-f006-4777-af51-ca91036eed2b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:33.104225 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d3ade72f-f006-4777-af51-ca91036eed2b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 200 len: 1276 microversion: 2.1 time: 0.101584 Aug 29 16:30:33.104857 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4038/7852] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:33 2022] GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 1276 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:34.125506 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-55999360-c690-4910-97ee-2be62df7f535 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:34.126122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-55999360-c690-4910-97ee-2be62df7f535 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:34.134068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55999360-c690-4910-97ee-2be62df7f535 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:34.135003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55999360-c690-4910-97ee-2be62df7f535 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:34.135447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55999360-c690-4910-97ee-2be62df7f535 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:34.136171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55999360-c690-4910-97ee-2be62df7f535 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:34.136630 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55999360-c690-4910-97ee-2be62df7f535 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:34.137064 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-55999360-c690-4910-97ee-2be62df7f535 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:34.403556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-55999360-c690-4910-97ee-2be62df7f535 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:34.411655 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-55999360-c690-4910-97ee-2be62df7f535 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 200 len: 1316 microversion: 2.1 time: 0.290004 Aug 29 16:30:34.412220 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3815/7853] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:34 2022] GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:34.761674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-406afeec-4925-4713-8a09-aa7ae18e7318 req-4491f18a-a3e2-460c-996d-4c1ee694f983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cf51871-896d-4f53-aa0f-28efdae3e9b4", "tag": "5ce0f96d-b523-47ed-bc75-747ef89d27bc"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:34.773923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-406afeec-4925-4713-8a09-aa7ae18e7318 req-4491f18a-a3e2-460c-996d-4c1ee694f983 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:34.774481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-406afeec-4925-4713-8a09-aa7ae18e7318 req-4491f18a-a3e2-460c-996d-4c1ee694f983 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:34.774977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-406afeec-4925-4713-8a09-aa7ae18e7318 req-4491f18a-a3e2-460c-996d-4c1ee694f983 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:34.786900 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-406afeec-4925-4713-8a09-aa7ae18e7318 req-4491f18a-a3e2-460c-996d-4c1ee694f983 service nova] Creating event network-changed:5ce0f96d-b523-47ed-bc75-747ef89d27bc for instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 on n-h1-839401-11 Aug 29 16:30:34.792198 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-406afeec-4925-4713-8a09-aa7ae18e7318 req-4491f18a-a3e2-460c-996d-4c1ee694f983 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035597 Aug 29 16:30:34.792872 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4039/7854] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:35.438745 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0d3b49ef-c79c-4373-86ff-5b1e75ca3893 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:35.439814 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0d3b49ef-c79c-4373-86ff-5b1e75ca3893 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:35.447991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d3b49ef-c79c-4373-86ff-5b1e75ca3893 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:35.448461 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d3b49ef-c79c-4373-86ff-5b1e75ca3893 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:35.448897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d3b49ef-c79c-4373-86ff-5b1e75ca3893 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:35.449639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d3b49ef-c79c-4373-86ff-5b1e75ca3893 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:35.450099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d3b49ef-c79c-4373-86ff-5b1e75ca3893 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:35.450524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0d3b49ef-c79c-4373-86ff-5b1e75ca3893 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:35.595537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0d3b49ef-c79c-4373-86ff-5b1e75ca3893 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:35.604056 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0d3b49ef-c79c-4373-86ff-5b1e75ca3893 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 200 len: 1316 microversion: 2.1 time: 0.172005 Aug 29 16:30:35.604637 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3816/7855] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:35 2022] GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:36.629959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-87560207-366b-483c-9091-ad779dbcb702 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:36.631136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-87560207-366b-483c-9091-ad779dbcb702 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:36.643357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87560207-366b-483c-9091-ad779dbcb702 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:36.644139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87560207-366b-483c-9091-ad779dbcb702 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:36.644916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87560207-366b-483c-9091-ad779dbcb702 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:36.645689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87560207-366b-483c-9091-ad779dbcb702 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:36.646154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87560207-366b-483c-9091-ad779dbcb702 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:36.646711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87560207-366b-483c-9091-ad779dbcb702 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:36.801786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-87560207-366b-483c-9091-ad779dbcb702 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:36.810357 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-87560207-366b-483c-9091-ad779dbcb702 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 200 len: 1316 microversion: 2.1 time: 0.187650 Aug 29 16:30:36.810942 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4040/7856] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:36 2022] GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 1316 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:37.831524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cb736b52-d009-4ac8-a7bd-ab5c1a762fae tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:37.832216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cb736b52-d009-4ac8-a7bd-ab5c1a762fae tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:37.839344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb736b52-d009-4ac8-a7bd-ab5c1a762fae tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:37.839816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb736b52-d009-4ac8-a7bd-ab5c1a762fae tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:37.840260 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb736b52-d009-4ac8-a7bd-ab5c1a762fae tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:37.845422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb736b52-d009-4ac8-a7bd-ab5c1a762fae tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:37.845422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb736b52-d009-4ac8-a7bd-ab5c1a762fae tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:37.845422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb736b52-d009-4ac8-a7bd-ab5c1a762fae tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:37.980559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cb736b52-d009-4ac8-a7bd-ab5c1a762fae tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:37.988918 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cb736b52-d009-4ac8-a7bd-ab5c1a762fae tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 200 len: 1316 microversion: 2.1 time: 0.161271 Aug 29 16:30:37.989536 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3817/7857] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:37 2022] GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:39.011139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f6a4ceae-3e22-4bbc-bd19-36c9f6a4a24b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:39.011767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f6a4ceae-3e22-4bbc-bd19-36c9f6a4a24b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:39.020057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6a4ceae-3e22-4bbc-bd19-36c9f6a4a24b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:39.020614 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6a4ceae-3e22-4bbc-bd19-36c9f6a4a24b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:39.021129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6a4ceae-3e22-4bbc-bd19-36c9f6a4a24b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:39.022045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6a4ceae-3e22-4bbc-bd19-36c9f6a4a24b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:39.022600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6a4ceae-3e22-4bbc-bd19-36c9f6a4a24b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:39.023063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f6a4ceae-3e22-4bbc-bd19-36c9f6a4a24b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:39.171651 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f6a4ceae-3e22-4bbc-bd19-36c9f6a4a24b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:39.179757 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f6a4ceae-3e22-4bbc-bd19-36c9f6a4a24b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 200 len: 1316 microversion: 2.1 time: 0.173314 Aug 29 16:30:39.180333 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4041/7858] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:39 2022] GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:40.200284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fb9e1d75-1405-4aad-94ff-c8d91d695517 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:40.200900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fb9e1d75-1405-4aad-94ff-c8d91d695517 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:40.207625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb9e1d75-1405-4aad-94ff-c8d91d695517 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:40.208112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb9e1d75-1405-4aad-94ff-c8d91d695517 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:40.208550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb9e1d75-1405-4aad-94ff-c8d91d695517 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:40.209289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb9e1d75-1405-4aad-94ff-c8d91d695517 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:40.209756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb9e1d75-1405-4aad-94ff-c8d91d695517 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:40.210184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fb9e1d75-1405-4aad-94ff-c8d91d695517 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:40.355682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fb9e1d75-1405-4aad-94ff-c8d91d695517 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:40.363791 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fb9e1d75-1405-4aad-94ff-c8d91d695517 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 200 len: 1316 microversion: 2.1 time: 0.167750 Aug 29 16:30:40.364375 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3818/7859] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:40 2022] GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:41.389541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b447e004-6dac-4ee5-9f5f-5e9a32db9b4e tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:41.390592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b447e004-6dac-4ee5-9f5f-5e9a32db9b4e tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:41.402492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b447e004-6dac-4ee5-9f5f-5e9a32db9b4e tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:41.403332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b447e004-6dac-4ee5-9f5f-5e9a32db9b4e tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:41.404081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b447e004-6dac-4ee5-9f5f-5e9a32db9b4e tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:41.405340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b447e004-6dac-4ee5-9f5f-5e9a32db9b4e tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:41.406142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b447e004-6dac-4ee5-9f5f-5e9a32db9b4e tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:41.406879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b447e004-6dac-4ee5-9f5f-5e9a32db9b4e tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:41.542905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b447e004-6dac-4ee5-9f5f-5e9a32db9b4e tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:41.551183 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b447e004-6dac-4ee5-9f5f-5e9a32db9b4e tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 200 len: 1316 microversion: 2.1 time: 0.168944 Aug 29 16:30:41.551666 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4042/7860] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:41 2022] GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:41.578001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-59a76deb-9707-41df-9e88-9222816a8d90 req-760da295-5c9e-4da2-a8fa-50a0c7d0cc66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf51871-896d-4f53-aa0f-28efdae3e9b4", "name": "network-vif-plugged", "status": "completed", "tag": "5ce0f96d-b523-47ed-bc75-747ef89d27bc"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:41.589022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-59a76deb-9707-41df-9e88-9222816a8d90 req-760da295-5c9e-4da2-a8fa-50a0c7d0cc66 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:41.589547 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-59a76deb-9707-41df-9e88-9222816a8d90 req-760da295-5c9e-4da2-a8fa-50a0c7d0cc66 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:41.589979 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-59a76deb-9707-41df-9e88-9222816a8d90 req-760da295-5c9e-4da2-a8fa-50a0c7d0cc66 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:41.601609 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-59a76deb-9707-41df-9e88-9222816a8d90 req-760da295-5c9e-4da2-a8fa-50a0c7d0cc66 service nova] Creating event network-vif-plugged:5ce0f96d-b523-47ed-bc75-747ef89d27bc for instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 on n-h1-839401-11 Aug 29 16:30:41.606693 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-59a76deb-9707-41df-9e88-9222816a8d90 req-760da295-5c9e-4da2-a8fa-50a0c7d0cc66 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032686 Aug 29 16:30:41.607379 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3819/7861] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:42.576261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b125c984-3709-4372-a901-cac6965f46b1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:42.577382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b125c984-3709-4372-a901-cac6965f46b1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:42.580732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:42.581943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:42.588776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b125c984-3709-4372-a901-cac6965f46b1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:42.589335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b125c984-3709-4372-a901-cac6965f46b1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:42.589798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b125c984-3709-4372-a901-cac6965f46b1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:42.590515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b125c984-3709-4372-a901-cac6965f46b1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:42.591316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b125c984-3709-4372-a901-cac6965f46b1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:42.591761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b125c984-3709-4372-a901-cac6965f46b1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:42.736111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b125c984-3709-4372-a901-cac6965f46b1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:42.748966 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b125c984-3709-4372-a901-cac6965f46b1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 200 len: 1316 microversion: 2.1 time: 0.179091 Aug 29 16:30:42.749872 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4043/7862] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:42 2022] GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:43.770789 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:43.778685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-37723f42-d6e0-4dc5-a7f3-8934c939881f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:43.779838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-37723f42-d6e0-4dc5-a7f3-8934c939881f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:43.788693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37723f42-d6e0-4dc5-a7f3-8934c939881f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:43.789231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37723f42-d6e0-4dc5-a7f3-8934c939881f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:43.789654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37723f42-d6e0-4dc5-a7f3-8934c939881f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:43.790388 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37723f42-d6e0-4dc5-a7f3-8934c939881f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:43.790874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37723f42-d6e0-4dc5-a7f3-8934c939881f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:43.791274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-37723f42-d6e0-4dc5-a7f3-8934c939881f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:43.932926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-37723f42-d6e0-4dc5-a7f3-8934c939881f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:43.944480 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-37723f42-d6e0-4dc5-a7f3-8934c939881f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 200 len: 1504 microversion: 2.1 time: 0.175465 Aug 29 16:30:43.945255 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3820/7863] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:43 2022] GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:43.964931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-092a3d54-2d6f-4539-bdfd-f72c53f16301 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:43.965948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-092a3d54-2d6f-4539-bdfd-f72c53f16301 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:43.973863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092a3d54-2d6f-4539-bdfd-f72c53f16301 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:43.974406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092a3d54-2d6f-4539-bdfd-f72c53f16301 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:43.974893 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092a3d54-2d6f-4539-bdfd-f72c53f16301 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:43.975641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092a3d54-2d6f-4539-bdfd-f72c53f16301 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:43.976142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092a3d54-2d6f-4539-bdfd-f72c53f16301 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:43.976675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092a3d54-2d6f-4539-bdfd-f72c53f16301 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:44.006428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-092a3d54-2d6f-4539-bdfd-f72c53f16301 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:30:44.091771 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-092a3d54-2d6f-4539-bdfd-f72c53f16301 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 204 len: 0 microversion: 2.1 time: 0.130749 Aug 29 16:30:44.092410 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4044/7864] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:30:43 2022] DELETE /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:30:44.100721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1b86d6fe-8d97-48c9-ad23-9ad5dde4c2b9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:44.103153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1b86d6fe-8d97-48c9-ad23-9ad5dde4c2b9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:44.109518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b86d6fe-8d97-48c9-ad23-9ad5dde4c2b9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:44.110015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b86d6fe-8d97-48c9-ad23-9ad5dde4c2b9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:44.110457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b86d6fe-8d97-48c9-ad23-9ad5dde4c2b9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:44.111163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b86d6fe-8d97-48c9-ad23-9ad5dde4c2b9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:44.111623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b86d6fe-8d97-48c9-ad23-9ad5dde4c2b9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:44.112054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1b86d6fe-8d97-48c9-ad23-9ad5dde4c2b9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:44.252311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1b86d6fe-8d97-48c9-ad23-9ad5dde4c2b9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:44.260818 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1b86d6fe-8d97-48c9-ad23-9ad5dde4c2b9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 200 len: 1510 microversion: 2.1 time: 0.164092 Aug 29 16:30:44.261446 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3821/7865] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:44 2022] GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:45.286405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-54342275-f0f2-41bf-a443-0b4f4aa11ee3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:45.287167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-54342275-f0f2-41bf-a443-0b4f4aa11ee3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:45.294526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54342275-f0f2-41bf-a443-0b4f4aa11ee3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:45.295037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54342275-f0f2-41bf-a443-0b4f4aa11ee3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:45.295857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54342275-f0f2-41bf-a443-0b4f4aa11ee3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:45.296579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54342275-f0f2-41bf-a443-0b4f4aa11ee3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:45.297054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54342275-f0f2-41bf-a443-0b4f4aa11ee3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:45.297529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54342275-f0f2-41bf-a443-0b4f4aa11ee3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:45.434511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-54342275-f0f2-41bf-a443-0b4f4aa11ee3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:45.443048 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-54342275-f0f2-41bf-a443-0b4f4aa11ee3 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 200 len: 1510 microversion: 2.1 time: 0.163465 Aug 29 16:30:45.443611 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4045/7866] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:45 2022] GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:46.189927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-60021945-3287-4450-b4e8-1d4d4e2fee91 req-cbf76994-1fbf-4b1e-ba09-fd0b7d0e2a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf51871-896d-4f53-aa0f-28efdae3e9b4", "name": "network-vif-deleted", "tag": "5ce0f96d-b523-47ed-bc75-747ef89d27bc"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:46.200467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-60021945-3287-4450-b4e8-1d4d4e2fee91 req-cbf76994-1fbf-4b1e-ba09-fd0b7d0e2a8d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:46.200945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-60021945-3287-4450-b4e8-1d4d4e2fee91 req-cbf76994-1fbf-4b1e-ba09-fd0b7d0e2a8d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:46.201588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-60021945-3287-4450-b4e8-1d4d4e2fee91 req-cbf76994-1fbf-4b1e-ba09-fd0b7d0e2a8d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:46.218831 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-60021945-3287-4450-b4e8-1d4d4e2fee91 req-cbf76994-1fbf-4b1e-ba09-fd0b7d0e2a8d service nova] Creating event network-vif-deleted:5ce0f96d-b523-47ed-bc75-747ef89d27bc for instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 on n-h1-839401-11 Aug 29 16:30:46.224616 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-60021945-3287-4450-b4e8-1d4d4e2fee91 req-cbf76994-1fbf-4b1e-ba09-fd0b7d0e2a8d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038560 Aug 29 16:30:46.226059 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3822/7867] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:46.468499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-933b7437-faba-4b66-86e1-c5763a0c9525 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:46.469499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-933b7437-faba-4b66-86e1-c5763a0c9525 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:46.478056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-933b7437-faba-4b66-86e1-c5763a0c9525 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:46.478553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-933b7437-faba-4b66-86e1-c5763a0c9525 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:46.479008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-933b7437-faba-4b66-86e1-c5763a0c9525 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:46.479722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-933b7437-faba-4b66-86e1-c5763a0c9525 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:46.480193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-933b7437-faba-4b66-86e1-c5763a0c9525 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:46.480624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-933b7437-faba-4b66-86e1-c5763a0c9525 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:46.512200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-933b7437-faba-4b66-86e1-c5763a0c9525 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:46.512690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-933b7437-faba-4b66-86e1-c5763a0c9525 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:46.513177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-933b7437-faba-4b66-86e1-c5763a0c9525 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:46.513638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-933b7437-faba-4b66-86e1-c5763a0c9525 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lazy-loading 'fault' on Instance uuid 6cf51871-896d-4f53-aa0f-28efdae3e9b4 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:30:46.555312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-933b7437-faba-4b66-86e1-c5763a0c9525 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:46.563387 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-933b7437-faba-4b66-86e1-c5763a0c9525 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 200 len: 1306 microversion: 2.1 time: 0.102068 Aug 29 16:30:46.563972 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4046/7868] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:46 2022] GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:47.591917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-65c736c9-d042-43ff-88a0-f83ed9f7e58d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:47.593116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-65c736c9-d042-43ff-88a0-f83ed9f7e58d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:47.603739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65c736c9-d042-43ff-88a0-f83ed9f7e58d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:47.604550 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65c736c9-d042-43ff-88a0-f83ed9f7e58d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:47.605348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65c736c9-d042-43ff-88a0-f83ed9f7e58d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:47.606502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65c736c9-d042-43ff-88a0-f83ed9f7e58d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:47.607323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65c736c9-d042-43ff-88a0-f83ed9f7e58d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:47.608044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-65c736c9-d042-43ff-88a0-f83ed9f7e58d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:47.624780 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-65c736c9-d042-43ff-88a0-f83ed9f7e58d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] HTTP exception thrown: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-65c736c9-d042-43ff-88a0-f83ed9f7e58d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Request method failure captured: Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 HTTP/1.1 Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOma1lKK1cKPZI9XXtUbxw0Y7CQp-IPH3_UjMv5z_44-b4a3M1kIugCAfb5_nyDQVyL1i24zrXXSyI7kRjzKO29z3bXQULN5QXqWai9_BWtkR86EFL3q3-sCUoBE88ySek0_xAg4PLnetATjiZNuYG0OgrFhGqXcmAItPb8lB-q2RFM Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: b2f1ece12aec47a296a184a3bc361fd9 Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b2f1ece12aec47a296a184a3bc361fd9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b2f1ece12aec47a296a184a3bc361fd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2f1ece12aec47a296a184a3bc361fd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2f1ece12aec47a296a184a3bc361fd9"}]}] Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: b2f1ece12aec47a296a184a3bc361fd9 Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-160038552-project Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: ba304cedaa8b47f2ba039e956e335dc0 Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-160038552-project Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '6cf51871-896d-4f53-aa0f-28efdae3e9b4'} Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:47.626452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:47.631061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:47.631061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:47.631061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:47.631061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:47.631061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:47.631061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. Aug 29 16:30:47.631061 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:47.631061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-65c736c9-d042-43ff-88a0-f83ed9f7e58d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Returning 404 to user: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:47.631061 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-65c736c9-d042-43ff-88a0-f83ed9f7e58d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 404 len: 111 microversion: 2.1 time: 0.045616 Aug 29 16:30:47.631061 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3823/7869] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:47 2022] GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:47.637238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4e772b3e-640d-4e70-8476-f3957353a1db tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:47.637881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4e772b3e-640d-4e70-8476-f3957353a1db tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:47.645400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e772b3e-640d-4e70-8476-f3957353a1db tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:47.645951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e772b3e-640d-4e70-8476-f3957353a1db tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:47.646409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e772b3e-640d-4e70-8476-f3957353a1db tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:47.647133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e772b3e-640d-4e70-8476-f3957353a1db tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:47.647611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e772b3e-640d-4e70-8476-f3957353a1db tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:47.648179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4e772b3e-640d-4e70-8476-f3957353a1db tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:47.652488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:47.796452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4e772b3e-640d-4e70-8476-f3957353a1db tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:47.804835 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4e772b3e-640d-4e70-8476-f3957353a1db tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1505 microversion: 2.1 time: 0.171590 Aug 29 16:30:47.805508 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4047/7870] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:47 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:47.825060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7c9a0b00-023c-4b79-a540-be08c004ef1d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:47.827374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7c9a0b00-023c-4b79-a540-be08c004ef1d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 2bee5142-d604-4acf-a015-8c0a5b8592e0] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:47.833525 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-7c9a0b00-023c-4b79-a540-be08c004ef1d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] HTTP exception thrown: Instance 2bee5142-d604-4acf-a015-8c0a5b8592e0 could not be found. Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7c9a0b00-023c-4b79-a540-be08c004ef1d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Request method failure captured: Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/2bee5142-d604-4acf-a015-8c0a5b8592e0/action HTTP/1.1 Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 32 Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOma1lKK1cKPZI9XXtUbxw0Y7CQp-IPH3_UjMv5z_44-b4a3M1kIugCAfb5_nyDQVyL1i24zrXXSyI7kRjzKO29z3bXQULN5QXqWai9_BWtkR86EFL3q3-sCUoBE88ySek0_xAg4PLnetATjiZNuYG0OgrFhGqXcmAItPb8lB-q2RFM Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: b2f1ece12aec47a296a184a3bc361fd9 Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b2f1ece12aec47a296a184a3bc361fd9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b2f1ece12aec47a296a184a3bc361fd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2f1ece12aec47a296a184a3bc361fd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2f1ece12aec47a296a184a3bc361fd9"}]}] Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: b2f1ece12aec47a296a184a3bc361fd9 Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-160038552-project Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: ba304cedaa8b47f2ba039e956e335dc0 Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-160038552-project Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: {"resize": {"flavorRef": "452"}} Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 2bee5142-d604-4acf-a015-8c0a5b8592e0 could not be found. Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '2bee5142-d604-4acf-a015-8c0a5b8592e0', 'body': {'resize': {'flavorRef': '452'}}} Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bee5142-d604-4acf-a015-8c0a5b8592e0 could not be found. Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:30:47.835098 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:30:47.839528 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bee5142-d604-4acf-a015-8c0a5b8592e0 could not be found. Aug 29 16:30:47.839528 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:47.839528 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:47.839528 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:47.839528 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:47.839528 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:47.839528 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:47.839528 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:47.839528 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:47.839528 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bee5142-d604-4acf-a015-8c0a5b8592e0 could not be found. Aug 29 16:30:47.839528 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:47.839528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7c9a0b00-023c-4b79-a540-be08c004ef1d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Returning 404 to user: Instance 2bee5142-d604-4acf-a015-8c0a5b8592e0 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:47.839528 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7c9a0b00-023c-4b79-a540-be08c004ef1d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "POST /compute/v2.1/servers/2bee5142-d604-4acf-a015-8c0a5b8592e0/action" status: 404 len: 111 microversion: 2.1 time: 0.015474 Aug 29 16:30:47.839528 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3824/7871] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:30:47 2022] POST /compute/v2.1/servers/2bee5142-d604-4acf-a015-8c0a5b8592e0/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:47.845905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-93ee48e5-040c-4046-9ea1-2893a51c70a9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:47.846579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-93ee48e5-040c-4046-9ea1-2893a51c70a9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:47.853215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ee48e5-040c-4046-9ea1-2893a51c70a9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:47.853738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ee48e5-040c-4046-9ea1-2893a51c70a9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:47.854162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ee48e5-040c-4046-9ea1-2893a51c70a9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:47.854834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ee48e5-040c-4046-9ea1-2893a51c70a9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:47.855300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ee48e5-040c-4046-9ea1-2893a51c70a9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:47.855734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-93ee48e5-040c-4046-9ea1-2893a51c70a9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:47.992469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-93ee48e5-040c-4046-9ea1-2893a51c70a9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:48.001817 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-93ee48e5-040c-4046-9ea1-2893a51c70a9 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1505 microversion: 2.1 time: 0.159667 Aug 29 16:30:48.002878 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4048/7872] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:47 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:48.027154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-09c3dafb-20e6-4c03-9536-9495063a836d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:48.028125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-09c3dafb-20e6-4c03-9536-9495063a836d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:48.038619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09c3dafb-20e6-4c03-9536-9495063a836d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.039106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09c3dafb-20e6-4c03-9536-9495063a836d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.039534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09c3dafb-20e6-4c03-9536-9495063a836d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.040234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09c3dafb-20e6-4c03-9536-9495063a836d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.040710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09c3dafb-20e6-4c03-9536-9495063a836d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.041186 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-09c3dafb-20e6-4c03-9536-9495063a836d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.189108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-09c3dafb-20e6-4c03-9536-9495063a836d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:48.198322 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-09c3dafb-20e6-4c03-9536-9495063a836d tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1505 microversion: 2.1 time: 0.177890 Aug 29 16:30:48.198892 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3825/7873] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:48 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:48.222445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0ac275f2-401b-493b-8ef3-f935411dd129 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "8b51355b-fbc4-425a-bcc0-7d8a0b9faf9e"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:48.225505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0ac275f2-401b-493b-8ef3-f935411dd129 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:48.232176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ac275f2-401b-493b-8ef3-f935411dd129 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.232685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ac275f2-401b-493b-8ef3-f935411dd129 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.233143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ac275f2-401b-493b-8ef3-f935411dd129 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.233860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ac275f2-401b-493b-8ef3-f935411dd129 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.234336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ac275f2-401b-493b-8ef3-f935411dd129 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.234783 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ac275f2-401b-493b-8ef3-f935411dd129 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.281374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0ac275f2-401b-493b-8ef3-f935411dd129 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:48.287418 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-0ac275f2-401b-493b-8ef3-f935411dd129 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] HTTP exception thrown: Flavor 8b51355b-fbc4-425a-bcc0-7d8a0b9faf9e could not be found. Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0ac275f2-401b-493b-8ef3-f935411dd129 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Request method failure captured: Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: request: POST /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458/action HTTP/1.1 Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 65 Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOma1lKK1cKPZI9XXtUbxw0Y7CQp-IPH3_UjMv5z_44-b4a3M1kIugCAfb5_nyDQVyL1i24zrXXSyI7kRjzKO29z3bXQULN5QXqWai9_BWtkR86EFL3q3-sCUoBE88ySek0_xAg4PLnetATjiZNuYG0OgrFhGqXcmAItPb8lB-q2RFM Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: b2f1ece12aec47a296a184a3bc361fd9 Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b2f1ece12aec47a296a184a3bc361fd9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b2f1ece12aec47a296a184a3bc361fd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2f1ece12aec47a296a184a3bc361fd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2f1ece12aec47a296a184a3bc361fd9"}]}] Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: b2f1ece12aec47a296a184a3bc361fd9 Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-160038552-project Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: ba304cedaa8b47f2ba039e956e335dc0 Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-160038552-project Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: {"resize": {"flavorRef": "8b51355b-fbc4-425a-bcc0-7d8a0b9faf9e"}} Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: exception: Flavor 8b51355b-fbc4-425a-bcc0-7d8a0b9faf9e could not be found. Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '46a92f0b-589a-403b-8770-0c808ca1a458', 'body': {'resize': {'flavorRef': '8b51355b-fbc4-425a-bcc0-7d8a0b9faf9e'}}} Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:48.296192 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 8b51355b-fbc4-425a-bcc0-7d8a0b9faf9e could not be found. Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 8b51355b-fbc4-425a-bcc0-7d8a0b9faf9e could not be found. Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 8b51355b-fbc4-425a-bcc0-7d8a0b9faf9e could not be found. Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0ac275f2-401b-493b-8ef3-f935411dd129 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Returning 400 to user: Flavor 8b51355b-fbc4-425a-bcc0-7d8a0b9faf9e could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0ac275f2-401b-493b-8ef3-f935411dd129 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "POST /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458/action" status: 400 len: 107 microversion: 2.1 time: 0.082481 Aug 29 16:30:48.300178 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4049/7874] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:30:48 2022] POST /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458/action => generated 107 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:30:48.306821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6dd3047a-bf63-4c53-8105-e1c96713319b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:48.307442 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6dd3047a-bf63-4c53-8105-e1c96713319b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:48.313609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6dd3047a-bf63-4c53-8105-e1c96713319b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.314096 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6dd3047a-bf63-4c53-8105-e1c96713319b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.314545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6dd3047a-bf63-4c53-8105-e1c96713319b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.315259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6dd3047a-bf63-4c53-8105-e1c96713319b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.315696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6dd3047a-bf63-4c53-8105-e1c96713319b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.316127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6dd3047a-bf63-4c53-8105-e1c96713319b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.455881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6dd3047a-bf63-4c53-8105-e1c96713319b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:48.464094 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6dd3047a-bf63-4c53-8105-e1c96713319b tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1505 microversion: 2.1 time: 0.161246 Aug 29 16:30:48.464703 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3826/7875] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:48 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:48.485872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7f2276e4-e0c0-4101-88d0-2a951fcd06d4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:48.486504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7f2276e4-e0c0-4101-88d0-2a951fcd06d4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:48.493291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f2276e4-e0c0-4101-88d0-2a951fcd06d4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.493799 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f2276e4-e0c0-4101-88d0-2a951fcd06d4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.494256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f2276e4-e0c0-4101-88d0-2a951fcd06d4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.494965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f2276e4-e0c0-4101-88d0-2a951fcd06d4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.495443 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f2276e4-e0c0-4101-88d0-2a951fcd06d4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.495867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f2276e4-e0c0-4101-88d0-2a951fcd06d4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.646912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7f2276e4-e0c0-4101-88d0-2a951fcd06d4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:48.655294 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7f2276e4-e0c0-4101-88d0-2a951fcd06d4 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1505 microversion: 2.1 time: 0.173527 Aug 29 16:30:48.655875 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4050/7876] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:48 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:48.675389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4338e9c6-fd59-477b-a935-be9aeeb6752f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4338e9c6-fd59-477b-a935-be9aeeb6752f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Request method failure captured: Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: request: POST /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458/action HTTP/1.1 Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 29 Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOma1lKK1cKPZI9XXtUbxw0Y7CQp-IPH3_UjMv5z_44-b4a3M1kIugCAfb5_nyDQVyL1i24zrXXSyI7kRjzKO29z3bXQULN5QXqWai9_BWtkR86EFL3q3-sCUoBE88ySek0_xAg4PLnetATjiZNuYG0OgrFhGqXcmAItPb8lB-q2RFM Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: b2f1ece12aec47a296a184a3bc361fd9 Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b2f1ece12aec47a296a184a3bc361fd9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b2f1ece12aec47a296a184a3bc361fd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2f1ece12aec47a296a184a3bc361fd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2f1ece12aec47a296a184a3bc361fd9"}]}] Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: b2f1ece12aec47a296a184a3bc361fd9 Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-160038552-project Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: ba304cedaa8b47f2ba039e956e335dc0 Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-160038552-project Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: {"resize": {"flavorRef": ""}} Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '46a92f0b-589a-403b-8770-0c808ca1a458', 'body': {'resize': {'flavorRef': ''}}} Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise error Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi '' Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.679336 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:48.684766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.684766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:48.684766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:48.684766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:48.684766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 16:30:48.684766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 16:30:48.684766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 29 16:30:48.684766 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.684766 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4338e9c6-fd59-477b-a935-be9aeeb6752f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:48.684766 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4338e9c6-fd59-477b-a935-be9aeeb6752f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "POST /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458/action" status: 400 len: 113 microversion: 2.1 time: 0.009507 Aug 29 16:30:48.684766 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3827/7877] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:30:48 2022] POST /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:30:48.689425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b8528baf-2c5f-4dec-83be-510aa3461768 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:48.690044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b8528baf-2c5f-4dec-83be-510aa3461768 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:48.696558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8528baf-2c5f-4dec-83be-510aa3461768 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.697055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8528baf-2c5f-4dec-83be-510aa3461768 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.697529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8528baf-2c5f-4dec-83be-510aa3461768 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.698234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8528baf-2c5f-4dec-83be-510aa3461768 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.698699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8528baf-2c5f-4dec-83be-510aa3461768 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.699130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b8528baf-2c5f-4dec-83be-510aa3461768 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.843290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b8528baf-2c5f-4dec-83be-510aa3461768 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:48.852099 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b8528baf-2c5f-4dec-83be-510aa3461768 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1505 microversion: 2.1 time: 0.166469 Aug 29 16:30:48.852706 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4051/7878] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:48 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:48.876752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d6e1a9aa-c306-430f-8d34-1f4b08254a29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:48.877290 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d6e1a9aa-c306-430f-8d34-1f4b08254a29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:48.885348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6e1a9aa-c306-430f-8d34-1f4b08254a29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.885834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6e1a9aa-c306-430f-8d34-1f4b08254a29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.886271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6e1a9aa-c306-430f-8d34-1f4b08254a29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.887000 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6e1a9aa-c306-430f-8d34-1f4b08254a29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.887453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6e1a9aa-c306-430f-8d34-1f4b08254a29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.887873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6e1a9aa-c306-430f-8d34-1f4b08254a29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.902111 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-d6e1a9aa-c306-430f-8d34-1f4b08254a29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] HTTP exception thrown: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d6e1a9aa-c306-430f-8d34-1f4b08254a29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Request method failure captured: Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 HTTP/1.1 Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOma1lKK1cKPZI9XXtUbxw0Y7CQp-IPH3_UjMv5z_44-b4a3M1kIugCAfb5_nyDQVyL1i24zrXXSyI7kRjzKO29z3bXQULN5QXqWai9_BWtkR86EFL3q3-sCUoBE88ySek0_xAg4PLnetATjiZNuYG0OgrFhGqXcmAItPb8lB-q2RFM Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: b2f1ece12aec47a296a184a3bc361fd9 Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b2f1ece12aec47a296a184a3bc361fd9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b2f1ece12aec47a296a184a3bc361fd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2f1ece12aec47a296a184a3bc361fd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2f1ece12aec47a296a184a3bc361fd9"}]}] Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: b2f1ece12aec47a296a184a3bc361fd9 Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-ServersNegativeTestJSON-160038552-project Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: ba304cedaa8b47f2ba039e956e335dc0 Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-ServersNegativeTestJSON-160038552-project Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '6cf51871-896d-4f53-aa0f-28efdae3e9b4'} Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:30:48.903711 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:30:48.907489 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. Aug 29 16:30:48.907489 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.907489 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:48.907489 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.907489 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:48.907489 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:48.907489 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:48.907489 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:48.907489 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:48.907489 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. Aug 29 16:30:48.907489 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.907489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d6e1a9aa-c306-430f-8d34-1f4b08254a29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Returning 404 to user: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:48.907489 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d6e1a9aa-c306-430f-8d34-1f4b08254a29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 404 len: 111 microversion: 2.1 time: 0.033386 Aug 29 16:30:48.907489 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3828/7879] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:30:48 2022] DELETE /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:48.914265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6eb4ed53-2a2d-4d6c-898c-be3d22fe3dff tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:48.914890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6eb4ed53-2a2d-4d6c-898c-be3d22fe3dff tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 6cf51871-896d-4f53-aa0f-28efdae3e9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:48.921577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eb4ed53-2a2d-4d6c-898c-be3d22fe3dff tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.922071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eb4ed53-2a2d-4d6c-898c-be3d22fe3dff tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.922516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eb4ed53-2a2d-4d6c-898c-be3d22fe3dff tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.923218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eb4ed53-2a2d-4d6c-898c-be3d22fe3dff tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.923679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eb4ed53-2a2d-4d6c-898c-be3d22fe3dff tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.924272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6eb4ed53-2a2d-4d6c-898c-be3d22fe3dff tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.938021 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-6eb4ed53-2a2d-4d6c-898c-be3d22fe3dff tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] HTTP exception thrown: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6eb4ed53-2a2d-4d6c-898c-be3d22fe3dff tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Request method failure captured: Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 HTTP/1.1 Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOma1lKK1cKPZI9XXtUbxw0Y7CQp-IPH3_UjMv5z_44-b4a3M1kIugCAfb5_nyDQVyL1i24zrXXSyI7kRjzKO29z3bXQULN5QXqWai9_BWtkR86EFL3q3-sCUoBE88ySek0_xAg4PLnetATjiZNuYG0OgrFhGqXcmAItPb8lB-q2RFM Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: b2f1ece12aec47a296a184a3bc361fd9 Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b2f1ece12aec47a296a184a3bc361fd9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b2f1ece12aec47a296a184a3bc361fd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2f1ece12aec47a296a184a3bc361fd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2f1ece12aec47a296a184a3bc361fd9"}]}] Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: b2f1ece12aec47a296a184a3bc361fd9 Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-160038552-project Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: ba304cedaa8b47f2ba039e956e335dc0 Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-160038552-project Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '6cf51871-896d-4f53-aa0f-28efdae3e9b4'} Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:48.939743 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.945914 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:48.945914 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:48.945914 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:48.945914 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:48.945914 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:48.945914 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. Aug 29 16:30:48.945914 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:48.945914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6eb4ed53-2a2d-4d6c-898c-be3d22fe3dff tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Returning 404 to user: Instance 6cf51871-896d-4f53-aa0f-28efdae3e9b4 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:48.945914 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6eb4ed53-2a2d-4d6c-898c-be3d22fe3dff tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4" status: 404 len: 111 microversion: 2.1 time: 0.031096 Aug 29 16:30:48.945914 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4052/7880] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:48 2022] GET /compute/v2.1/servers/6cf51871-896d-4f53-aa0f-28efdae3e9b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:30:48.950262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-833b5b25-f742-4edf-854c-e70968fc2f29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:48.950759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-833b5b25-f742-4edf-854c-e70968fc2f29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:48.956990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-833b5b25-f742-4edf-854c-e70968fc2f29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.957504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-833b5b25-f742-4edf-854c-e70968fc2f29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.957923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-833b5b25-f742-4edf-854c-e70968fc2f29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.958696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-833b5b25-f742-4edf-854c-e70968fc2f29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:48.959142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-833b5b25-f742-4edf-854c-e70968fc2f29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:48.959561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-833b5b25-f742-4edf-854c-e70968fc2f29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:48.989141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-833b5b25-f742-4edf-854c-e70968fc2f29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:30:49.025305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:49.089543 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-833b5b25-f742-4edf-854c-e70968fc2f29 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "DELETE /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 204 len: 0 microversion: 2.1 time: 0.142959 Aug 29 16:30:49.093525 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3829/7881] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:30:48 2022] DELETE /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:30:49.098761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e287ddb1-e7f3-4810-a0c6-c057f938a00f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:49.099400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e287ddb1-e7f3-4810-a0c6-c057f938a00f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:49.106179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e287ddb1-e7f3-4810-a0c6-c057f938a00f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:49.107078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e287ddb1-e7f3-4810-a0c6-c057f938a00f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:49.107602 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e287ddb1-e7f3-4810-a0c6-c057f938a00f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:49.108325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e287ddb1-e7f3-4810-a0c6-c057f938a00f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:49.108801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e287ddb1-e7f3-4810-a0c6-c057f938a00f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:49.109278 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e287ddb1-e7f3-4810-a0c6-c057f938a00f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:49.258974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e287ddb1-e7f3-4810-a0c6-c057f938a00f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:49.271227 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e287ddb1-e7f3-4810-a0c6-c057f938a00f tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1511 microversion: 2.1 time: 0.176085 Aug 29 16:30:49.271855 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4053/7882] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:49 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:50.298810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9ef1b131-c7c5-4723-8bb1-cad5501afb63 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:50.300001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9ef1b131-c7c5-4723-8bb1-cad5501afb63 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:50.305113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:50.314534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ef1b131-c7c5-4723-8bb1-cad5501afb63 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:50.315347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ef1b131-c7c5-4723-8bb1-cad5501afb63 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:50.316086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ef1b131-c7c5-4723-8bb1-cad5501afb63 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:50.317268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ef1b131-c7c5-4723-8bb1-cad5501afb63 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:50.318086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ef1b131-c7c5-4723-8bb1-cad5501afb63 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:50.318499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9ef1b131-c7c5-4723-8bb1-cad5501afb63 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:50.451160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9ef1b131-c7c5-4723-8bb1-cad5501afb63 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:50.459516 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9ef1b131-c7c5-4723-8bb1-cad5501afb63 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1511 microversion: 2.1 time: 0.168760 Aug 29 16:30:50.460089 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3830/7883] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:50 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:51.299011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-7652bf3f-da83-4623-903e-80c7e4860794 req-87ca5cd8-1b47-4a3c-b81b-41eff88667e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a92f0b-589a-403b-8770-0c808ca1a458", "name": "network-vif-deleted", "tag": "99a34f37-da09-4152-9318-ff79ae9ba3b2"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:51.313882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7652bf3f-da83-4623-903e-80c7e4860794 req-87ca5cd8-1b47-4a3c-b81b-41eff88667e0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:51.314380 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7652bf3f-da83-4623-903e-80c7e4860794 req-87ca5cd8-1b47-4a3c-b81b-41eff88667e0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:51.314836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7652bf3f-da83-4623-903e-80c7e4860794 req-87ca5cd8-1b47-4a3c-b81b-41eff88667e0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:51.327444 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-7652bf3f-da83-4623-903e-80c7e4860794 req-87ca5cd8-1b47-4a3c-b81b-41eff88667e0 service nova] Creating event network-vif-deleted:99a34f37-da09-4152-9318-ff79ae9ba3b2 for instance 46a92f0b-589a-403b-8770-0c808ca1a458 on n-h2-839401-11 Aug 29 16:30:51.333416 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-7652bf3f-da83-4623-903e-80c7e4860794 req-87ca5cd8-1b47-4a3c-b81b-41eff88667e0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037874 Aug 29 16:30:51.334115 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4054/7884] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:30:51.480108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-914c2265-1fa2-42d3-a1bb-9c3df744af81 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:51.480673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-914c2265-1fa2-42d3-a1bb-9c3df744af81 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:51.488032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-914c2265-1fa2-42d3-a1bb-9c3df744af81 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:51.488528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-914c2265-1fa2-42d3-a1bb-9c3df744af81 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:51.488960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-914c2265-1fa2-42d3-a1bb-9c3df744af81 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:51.489732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-914c2265-1fa2-42d3-a1bb-9c3df744af81 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:51.490173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-914c2265-1fa2-42d3-a1bb-9c3df744af81 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:51.490794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-914c2265-1fa2-42d3-a1bb-9c3df744af81 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:51.522228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-914c2265-1fa2-42d3-a1bb-9c3df744af81 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:51.522650 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-914c2265-1fa2-42d3-a1bb-9c3df744af81 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:51.523087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-914c2265-1fa2-42d3-a1bb-9c3df744af81 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:51.523536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-914c2265-1fa2-42d3-a1bb-9c3df744af81 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lazy-loading 'fault' on Instance uuid 46a92f0b-589a-403b-8770-0c808ca1a458 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:30:51.565412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-914c2265-1fa2-42d3-a1bb-9c3df744af81 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba304cedaa8b47f2ba039e956e335dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f1ece12aec47a296a184a3bc361fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:51.573383 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-914c2265-1fa2-42d3-a1bb-9c3df744af81 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 200 len: 1307 microversion: 2.1 time: 0.097243 Aug 29 16:30:51.573963 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3831/7885] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:51 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:52.599503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65b28a00-3e46-4a16-aadc-1866bc7915c1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:52.600329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-65b28a00-3e46-4a16-aadc-1866bc7915c1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] [instance: 46a92f0b-589a-403b-8770-0c808ca1a458] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:52.607266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65b28a00-3e46-4a16-aadc-1866bc7915c1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:52.607769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65b28a00-3e46-4a16-aadc-1866bc7915c1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:52.608226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65b28a00-3e46-4a16-aadc-1866bc7915c1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:52.608935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65b28a00-3e46-4a16-aadc-1866bc7915c1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:52.609446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65b28a00-3e46-4a16-aadc-1866bc7915c1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:52.609895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65b28a00-3e46-4a16-aadc-1866bc7915c1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:52.623784 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-65b28a00-3e46-4a16-aadc-1866bc7915c1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] HTTP exception thrown: Instance 46a92f0b-589a-403b-8770-0c808ca1a458 could not be found. Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65b28a00-3e46-4a16-aadc-1866bc7915c1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Request method failure captured: Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 HTTP/1.1 Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOma1lKK1cKPZI9XXtUbxw0Y7CQp-IPH3_UjMv5z_44-b4a3M1kIugCAfb5_nyDQVyL1i24zrXXSyI7kRjzKO29z3bXQULN5QXqWai9_BWtkR86EFL3q3-sCUoBE88ySek0_xAg4PLnetATjiZNuYG0OgrFhGqXcmAItPb8lB-q2RFM Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: b2f1ece12aec47a296a184a3bc361fd9 Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b2f1ece12aec47a296a184a3bc361fd9", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b2f1ece12aec47a296a184a3bc361fd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2f1ece12aec47a296a184a3bc361fd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b2f1ece12aec47a296a184a3bc361fd9"}]}] Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: b2f1ece12aec47a296a184a3bc361fd9 Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-ServersNegativeTestJSON-160038552 Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-ServersNegativeTestJSON-160038552-project Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: ba304cedaa8b47f2ba039e956e335dc0 Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-ServersNegativeTestJSON-160038552-project Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 46a92f0b-589a-403b-8770-0c808ca1a458 could not be found. Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '46a92f0b-589a-403b-8770-0c808ca1a458'} Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46a92f0b-589a-403b-8770-0c808ca1a458 could not be found. Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46a92f0b-589a-403b-8770-0c808ca1a458 could not be found. Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:30:52.625470 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:52.630290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:30:52.630290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:30:52.630290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:30:52.630290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:30:52.630290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:30:52.630290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46a92f0b-589a-403b-8770-0c808ca1a458 could not be found. Aug 29 16:30:52.630290 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:30:52.630290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65b28a00-3e46-4a16-aadc-1866bc7915c1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] Returning 404 to user: Instance 46a92f0b-589a-403b-8770-0c808ca1a458 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:30:52.630290 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-65b28a00-3e46-4a16-aadc-1866bc7915c1 tempest-ServersNegativeTestJSON-160038552 tempest-ServersNegativeTestJSON-160038552-project] 10.222.0.62 "GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458" status: 404 len: 111 microversion: 2.1 time: 0.035514 Aug 29 16:30:52.630290 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4055/7886] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:52 2022] GET /compute/v2.1/servers/46a92f0b-589a-403b-8770-0c808ca1a458 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:31:25.335365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=5 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:25.336153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:25.531464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a9d6d316-ab7a-4d1a-9c56-de929e4e25bd tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Action: 'create', calling method: .version_select at 0x7fc42a8a9af0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1297556863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbFCW4wu0lbuOfBBhJVnmeSr03gNqf4guwkwc2MMJ6cfNtpBPtdSVm37SBtMrsK+80fQo8yLxpdBQNLCXlxD0iJ/DLuBcupV5Tn8Ge11OeHANrgzQYYIyYtVFJtpV7YJg=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:31:25.550982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-a9d6d316-ab7a-4d1a-9c56-de929e4e25bd tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Getting quotas for project 6cb497f7e81d4f7789e13e10efc77054. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:31:25.556536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-a9d6d316-ab7a-4d1a-9c56-de929e4e25bd tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Getting quotas for user d269a24074194580972e03422b9ce3c6 and project 6cb497f7e81d4f7789e13e10efc77054. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:31:25.592729 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a9d6d316-ab7a-4d1a-9c56-de929e4e25bd tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.262606 Aug 29 16:31:25.593567 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3832/7887] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:31:25 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:31:25.651856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1578757576", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1297556863", "networks": [{"uuid": "f925e3e5-bf79-462a-a630-e5d2cd736dab"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:31:25.665765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:25.667221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=38 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:25.719039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] validate_networks() for [('f925e3e5-bf79-462a-a630-e5d2cd736dab', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:31:26.144983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:31:26.145535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:31:26.146028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:31:26.146529 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:31:26.146978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:31:26.160510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:26.161016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:26.161495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:26.162272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:26.162739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:26.163171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:26.181202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Getting quotas for project 6cb497f7e81d4f7789e13e10efc77054. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:31:26.189555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Getting quotas for user d269a24074194580972e03422b9ce3c6 and project 6cb497f7e81d4f7789e13e10efc77054. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:31:26.207558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:31:26.210047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:31:26.261424 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ab3a9adc-2653-404c-a7e1-5c80f980076a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612256 Aug 29 16:31:26.262726 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4056/7888] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:31:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:31:26.273304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-28ccbc75-304d-4114-bcd2-4e7c73c4137c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:26.273850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-28ccbc75-304d-4114-bcd2-4e7c73c4137c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:26.331139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-28ccbc75-304d-4114-bcd2-4e7c73c4137c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:26.341005 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-28ccbc75-304d-4114-bcd2-4e7c73c4137c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 200 len: 1263 microversion: 2.1 time: 0.071677 Aug 29 16:31:26.353226 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3833/7889] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:26 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 1263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:27.364453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5f3f9581-04fc-41ff-b225-07a476ef4ca2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:27.365105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5f3f9581-04fc-41ff-b225-07a476ef4ca2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:27.372648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f3f9581-04fc-41ff-b225-07a476ef4ca2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:27.373174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f3f9581-04fc-41ff-b225-07a476ef4ca2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:27.373636 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f3f9581-04fc-41ff-b225-07a476ef4ca2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:27.374349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f3f9581-04fc-41ff-b225-07a476ef4ca2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:27.374820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f3f9581-04fc-41ff-b225-07a476ef4ca2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:27.375274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f3f9581-04fc-41ff-b225-07a476ef4ca2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:27.441530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5f3f9581-04fc-41ff-b225-07a476ef4ca2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:27.449824 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5f3f9581-04fc-41ff-b225-07a476ef4ca2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 200 len: 1315 microversion: 2.1 time: 0.090430 Aug 29 16:31:27.450405 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4057/7890] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:27 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 1315 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:28.471529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5d12e4d1-0204-4aa7-9ce9-b0a129b0bba5 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:28.472827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5d12e4d1-0204-4aa7-9ce9-b0a129b0bba5 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:28.479825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d12e4d1-0204-4aa7-9ce9-b0a129b0bba5 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:28.486943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d12e4d1-0204-4aa7-9ce9-b0a129b0bba5 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:28.487631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d12e4d1-0204-4aa7-9ce9-b0a129b0bba5 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:28.490297 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d12e4d1-0204-4aa7-9ce9-b0a129b0bba5 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:28.490974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d12e4d1-0204-4aa7-9ce9-b0a129b0bba5 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:28.491556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5d12e4d1-0204-4aa7-9ce9-b0a129b0bba5 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:28.736112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5d12e4d1-0204-4aa7-9ce9-b0a129b0bba5 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:28.744985 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5d12e4d1-0204-4aa7-9ce9-b0a129b0bba5 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 200 len: 1363 microversion: 2.1 time: 0.277293 Aug 29 16:31:28.753592 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3834/7891] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:28 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:29.026207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e2ce08c1-f290-4e38-84a7-3315e129d312 req-4d32777f-8a3a-4b2e-ab03-88a778bbd538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1b6a9f-49b3-4496-998e-907d41f9c127", "tag": "ff3181e8-4b97-49fd-b505-291464c90919"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:31:29.041999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e2ce08c1-f290-4e38-84a7-3315e129d312 req-4d32777f-8a3a-4b2e-ab03-88a778bbd538 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:29.042790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e2ce08c1-f290-4e38-84a7-3315e129d312 req-4d32777f-8a3a-4b2e-ab03-88a778bbd538 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:29.043657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e2ce08c1-f290-4e38-84a7-3315e129d312 req-4d32777f-8a3a-4b2e-ab03-88a778bbd538 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:29.056647 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e2ce08c1-f290-4e38-84a7-3315e129d312 req-4d32777f-8a3a-4b2e-ab03-88a778bbd538 service nova] Creating event network-changed:ff3181e8-4b97-49fd-b505-291464c90919 for instance 0a1b6a9f-49b3-4496-998e-907d41f9c127 on n-h2-839401-11 Aug 29 16:31:29.062320 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e2ce08c1-f290-4e38-84a7-3315e129d312 req-4d32777f-8a3a-4b2e-ab03-88a778bbd538 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039873 Aug 29 16:31:29.063344 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4058/7892] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:31:29.771119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-93bad50e-54ed-454a-9ddf-abcdd5ae49f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:29.771942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-93bad50e-54ed-454a-9ddf-abcdd5ae49f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:29.779236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93bad50e-54ed-454a-9ddf-abcdd5ae49f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:29.779728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93bad50e-54ed-454a-9ddf-abcdd5ae49f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:29.780174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93bad50e-54ed-454a-9ddf-abcdd5ae49f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:29.780891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93bad50e-54ed-454a-9ddf-abcdd5ae49f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:29.781380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93bad50e-54ed-454a-9ddf-abcdd5ae49f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:29.781946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-93bad50e-54ed-454a-9ddf-abcdd5ae49f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:29.919951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-93bad50e-54ed-454a-9ddf-abcdd5ae49f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:29.928246 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-93bad50e-54ed-454a-9ddf-abcdd5ae49f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 200 len: 1363 microversion: 2.1 time: 0.163828 Aug 29 16:31:29.928834 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3835/7893] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:29 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:30.955292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eb18b5d1-a0a3-43fe-8ea2-35af24bc52f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:30.956514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eb18b5d1-a0a3-43fe-8ea2-35af24bc52f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:30.967837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb18b5d1-a0a3-43fe-8ea2-35af24bc52f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:30.968965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb18b5d1-a0a3-43fe-8ea2-35af24bc52f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:30.969746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb18b5d1-a0a3-43fe-8ea2-35af24bc52f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:30.971266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb18b5d1-a0a3-43fe-8ea2-35af24bc52f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:30.972105 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb18b5d1-a0a3-43fe-8ea2-35af24bc52f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:30.972980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb18b5d1-a0a3-43fe-8ea2-35af24bc52f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:31.127348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eb18b5d1-a0a3-43fe-8ea2-35af24bc52f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:31.135804 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eb18b5d1-a0a3-43fe-8ea2-35af24bc52f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 200 len: 1363 microversion: 2.1 time: 0.189512 Aug 29 16:31:31.136385 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4059/7894] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:30 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:32.164435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2a47db0f-e848-4f49-9157-10dafa91a85f tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:32.165631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2a47db0f-e848-4f49-9157-10dafa91a85f tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:32.177023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a47db0f-e848-4f49-9157-10dafa91a85f tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:32.178016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a47db0f-e848-4f49-9157-10dafa91a85f tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:32.178825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a47db0f-e848-4f49-9157-10dafa91a85f tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:32.179898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a47db0f-e848-4f49-9157-10dafa91a85f tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:32.180598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a47db0f-e848-4f49-9157-10dafa91a85f tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:32.181240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a47db0f-e848-4f49-9157-10dafa91a85f tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:32.338423 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2a47db0f-e848-4f49-9157-10dafa91a85f tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:32.347299 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2a47db0f-e848-4f49-9157-10dafa91a85f tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 200 len: 1363 microversion: 2.1 time: 0.189544 Aug 29 16:31:32.347863 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3836/7895] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:32 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:33.368409 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-faf0a6da-4fea-4fc6-a615-e80d653954cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:33.368993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-faf0a6da-4fea-4fc6-a615-e80d653954cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:33.376261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-faf0a6da-4fea-4fc6-a615-e80d653954cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:33.376766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-faf0a6da-4fea-4fc6-a615-e80d653954cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:33.377261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-faf0a6da-4fea-4fc6-a615-e80d653954cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:33.377952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-faf0a6da-4fea-4fc6-a615-e80d653954cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:33.378462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-faf0a6da-4fea-4fc6-a615-e80d653954cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:33.378909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-faf0a6da-4fea-4fc6-a615-e80d653954cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:33.510503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-faf0a6da-4fea-4fc6-a615-e80d653954cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:33.518726 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-faf0a6da-4fea-4fc6-a615-e80d653954cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 200 len: 1363 microversion: 2.1 time: 0.154603 Aug 29 16:31:33.519316 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4060/7896] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:33 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:34.541238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4b056096-b0e0-4b3b-a642-04ecdc971202 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:34.541970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4b056096-b0e0-4b3b-a642-04ecdc971202 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:34.550643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b056096-b0e0-4b3b-a642-04ecdc971202 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:34.551196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b056096-b0e0-4b3b-a642-04ecdc971202 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:34.551718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b056096-b0e0-4b3b-a642-04ecdc971202 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:34.552587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b056096-b0e0-4b3b-a642-04ecdc971202 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:34.553128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b056096-b0e0-4b3b-a642-04ecdc971202 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:34.553673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4b056096-b0e0-4b3b-a642-04ecdc971202 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:34.697609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4b056096-b0e0-4b3b-a642-04ecdc971202 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:34.706000 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4b056096-b0e0-4b3b-a642-04ecdc971202 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 200 len: 1363 microversion: 2.1 time: 0.169837 Aug 29 16:31:34.706575 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3837/7897] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:34 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:35.497540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-0b3fb0aa-92c0-4374-9989-5b132218f8cb req-bedb1a34-5b65-42ac-aa83-fc976d132ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1b6a9f-49b3-4496-998e-907d41f9c127", "name": "network-vif-plugged", "status": "completed", "tag": "ff3181e8-4b97-49fd-b505-291464c90919"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:31:35.509131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0b3fb0aa-92c0-4374-9989-5b132218f8cb req-bedb1a34-5b65-42ac-aa83-fc976d132ae8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:35.509635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0b3fb0aa-92c0-4374-9989-5b132218f8cb req-bedb1a34-5b65-42ac-aa83-fc976d132ae8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:35.510088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0b3fb0aa-92c0-4374-9989-5b132218f8cb req-bedb1a34-5b65-42ac-aa83-fc976d132ae8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:35.522249 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-0b3fb0aa-92c0-4374-9989-5b132218f8cb req-bedb1a34-5b65-42ac-aa83-fc976d132ae8 service nova] Creating event network-vif-plugged:ff3181e8-4b97-49fd-b505-291464c90919 for instance 0a1b6a9f-49b3-4496-998e-907d41f9c127 on n-h2-839401-11 Aug 29 16:31:35.527466 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-0b3fb0aa-92c0-4374-9989-5b132218f8cb req-bedb1a34-5b65-42ac-aa83-fc976d132ae8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034003 Aug 29 16:31:35.528280 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4061/7898] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:31:35.728324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a5051a49-c839-4f78-bd9e-242f7de2582d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:35.728847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a5051a49-c839-4f78-bd9e-242f7de2582d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:35.736161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5051a49-c839-4f78-bd9e-242f7de2582d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:35.736655 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5051a49-c839-4f78-bd9e-242f7de2582d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:35.737120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5051a49-c839-4f78-bd9e-242f7de2582d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:35.737816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5051a49-c839-4f78-bd9e-242f7de2582d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:35.738266 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5051a49-c839-4f78-bd9e-242f7de2582d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:35.738695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5051a49-c839-4f78-bd9e-242f7de2582d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:35.878214 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a5051a49-c839-4f78-bd9e-242f7de2582d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:35.886101 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a5051a49-c839-4f78-bd9e-242f7de2582d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 200 len: 1363 microversion: 2.1 time: 0.161917 Aug 29 16:31:35.886679 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3838/7899] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:35 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:36.908603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-092c3a0e-e504-4e1f-997d-2444c8372ca8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:36.923168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-092c3a0e-e504-4e1f-997d-2444c8372ca8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:36.923168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:36.923168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:36.926866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092c3a0e-e504-4e1f-997d-2444c8372ca8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:36.927376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092c3a0e-e504-4e1f-997d-2444c8372ca8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:36.927830 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092c3a0e-e504-4e1f-997d-2444c8372ca8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:36.928553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092c3a0e-e504-4e1f-997d-2444c8372ca8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:36.929068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092c3a0e-e504-4e1f-997d-2444c8372ca8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:36.929536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-092c3a0e-e504-4e1f-997d-2444c8372ca8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:37.075446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-092c3a0e-e504-4e1f-997d-2444c8372ca8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:37.088231 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-092c3a0e-e504-4e1f-997d-2444c8372ca8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 200 len: 1363 microversion: 2.1 time: 0.183977 Aug 29 16:31:37.089118 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4062/7900] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:36 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:38.120111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-413bd461-3e15-4dc6-8232-876b2f35549b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:38.121003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-413bd461-3e15-4dc6-8232-876b2f35549b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:38.124221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:38.134191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-413bd461-3e15-4dc6-8232-876b2f35549b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:38.134688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-413bd461-3e15-4dc6-8232-876b2f35549b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:38.135111 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-413bd461-3e15-4dc6-8232-876b2f35549b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:38.135818 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-413bd461-3e15-4dc6-8232-876b2f35549b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:38.136279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-413bd461-3e15-4dc6-8232-876b2f35549b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:38.136714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-413bd461-3e15-4dc6-8232-876b2f35549b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:38.269279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-413bd461-3e15-4dc6-8232-876b2f35549b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:38.277750 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-413bd461-3e15-4dc6-8232-876b2f35549b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 200 len: 1555 microversion: 2.1 time: 0.164432 Aug 29 16:31:38.278334 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3839/7901] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:38 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:38.298065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-353b307c-4ad3-4436-b457-40ac2a3d82cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:38.298705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-353b307c-4ad3-4436-b457-40ac2a3d82cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:38.305914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-353b307c-4ad3-4436-b457-40ac2a3d82cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:38.306415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-353b307c-4ad3-4436-b457-40ac2a3d82cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:38.306863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-353b307c-4ad3-4436-b457-40ac2a3d82cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:38.307569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-353b307c-4ad3-4436-b457-40ac2a3d82cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:38.308008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-353b307c-4ad3-4436-b457-40ac2a3d82cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:38.308447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-353b307c-4ad3-4436-b457-40ac2a3d82cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:38.446241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-353b307c-4ad3-4436-b457-40ac2a3d82cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:38.454243 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-353b307c-4ad3-4436-b457-40ac2a3d82cb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 200 len: 1555 microversion: 2.1 time: 0.160133 Aug 29 16:31:38.454823 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4063/7902] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:38 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:40.117985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-28f30a3c-efb9-4b9f-8528-7343effad2d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ed300aa-b202-407b-ae64-f8d198c088ef"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:31:40.120403 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-28f30a3c-efb9-4b9f-8528-7343effad2d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:40.127225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28f30a3c-efb9-4b9f-8528-7343effad2d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:40.127713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28f30a3c-efb9-4b9f-8528-7343effad2d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:40.128153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28f30a3c-efb9-4b9f-8528-7343effad2d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:40.128857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28f30a3c-efb9-4b9f-8528-7343effad2d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:40.129354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28f30a3c-efb9-4b9f-8528-7343effad2d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:40.129787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28f30a3c-efb9-4b9f-8528-7343effad2d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:40.468529 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-28f30a3c-efb9-4b9f-8528-7343effad2d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "POST /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354424 Aug 29 16:31:40.469221 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3840/7903] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 16:31:40 2022] POST /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:31:51.221279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2ccf7780-888f-4851-afa8-43f773bb241b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:51.221820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2ccf7780-888f-4851-afa8-43f773bb241b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:51.224361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:51.225044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=36 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:51.230708 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ccf7780-888f-4851-afa8-43f773bb241b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:51.231246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ccf7780-888f-4851-afa8-43f773bb241b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:51.231702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ccf7780-888f-4851-afa8-43f773bb241b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:51.232448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ccf7780-888f-4851-afa8-43f773bb241b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:51.232921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ccf7780-888f-4851-afa8-43f773bb241b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:51.233390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2ccf7780-888f-4851-afa8-43f773bb241b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:51.328294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-2ccf7780-888f-4851-afa8-43f773bb241b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lazy-loading 'services' on Instance uuid 0a1b6a9f-49b3-4496-998e-907d41f9c127 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:31:51.408929 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2ccf7780-888f-4851-afa8-43f773bb241b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments/4ed300aa-b202-407b-ae64-f8d198c088ef" status: 202 len: 0 microversion: 2.1 time: 0.191754 Aug 29 16:31:51.409594 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4064/7904] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 16:31:51 2022] DELETE /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments/4ed300aa-b202-407b-ae64-f8d198c088ef => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:31:51.418661 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-57fee07b-bb89-4552-ab60-9bdee9247672 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:51.421265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-57fee07b-bb89-4552-ab60-9bdee9247672 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:51.424234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:51.425132 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:51.430912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57fee07b-bb89-4552-ab60-9bdee9247672 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:51.431400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57fee07b-bb89-4552-ab60-9bdee9247672 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:51.431829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57fee07b-bb89-4552-ab60-9bdee9247672 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:51.432523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57fee07b-bb89-4552-ab60-9bdee9247672 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:51.432975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57fee07b-bb89-4552-ab60-9bdee9247672 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:51.433425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57fee07b-bb89-4552-ab60-9bdee9247672 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:51.466894 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-57fee07b-bb89-4552-ab60-9bdee9247672 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052596 Aug 29 16:31:51.467459 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3841/7905] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:31:51 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:31:52.481502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eed0df73-dffb-4a8b-aeb0-97dc524afd4c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:52.483727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eed0df73-dffb-4a8b-aeb0-97dc524afd4c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:52.490432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eed0df73-dffb-4a8b-aeb0-97dc524afd4c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:52.490936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eed0df73-dffb-4a8b-aeb0-97dc524afd4c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:52.491387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eed0df73-dffb-4a8b-aeb0-97dc524afd4c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:52.492123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eed0df73-dffb-4a8b-aeb0-97dc524afd4c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:52.492593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eed0df73-dffb-4a8b-aeb0-97dc524afd4c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:52.493032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eed0df73-dffb-4a8b-aeb0-97dc524afd4c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:52.524201 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eed0df73-dffb-4a8b-aeb0-97dc524afd4c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048159 Aug 29 16:31:52.524997 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4065/7906] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:31:52 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:31:53.536315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7ed11634-7ab5-485c-822a-d131b2102aa6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:53.538593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7ed11634-7ab5-485c-822a-d131b2102aa6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:53.546088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ed11634-7ab5-485c-822a-d131b2102aa6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:53.546593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ed11634-7ab5-485c-822a-d131b2102aa6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:53.547034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ed11634-7ab5-485c-822a-d131b2102aa6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:53.547747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ed11634-7ab5-485c-822a-d131b2102aa6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:53.548212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ed11634-7ab5-485c-822a-d131b2102aa6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:53.548642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ed11634-7ab5-485c-822a-d131b2102aa6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:53.582580 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7ed11634-7ab5-485c-822a-d131b2102aa6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050261 Aug 29 16:31:53.583177 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3842/7907] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:31:53 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:31:54.595782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-68a77ae7-0c77-495f-8795-0be3dabe8e71 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:54.598042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-68a77ae7-0c77-495f-8795-0be3dabe8e71 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:54.605634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68a77ae7-0c77-495f-8795-0be3dabe8e71 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:54.606180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68a77ae7-0c77-495f-8795-0be3dabe8e71 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:54.606637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68a77ae7-0c77-495f-8795-0be3dabe8e71 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:54.607354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68a77ae7-0c77-495f-8795-0be3dabe8e71 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:54.607831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68a77ae7-0c77-495f-8795-0be3dabe8e71 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:54.608280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68a77ae7-0c77-495f-8795-0be3dabe8e71 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:54.640194 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-68a77ae7-0c77-495f-8795-0be3dabe8e71 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048607 Aug 29 16:31:54.641073 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4066/7908] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:31:54 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:31:55.652429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6999b039-8dd9-426a-b766-a4e6b425311b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:55.655553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6999b039-8dd9-426a-b766-a4e6b425311b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:55.662936 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6999b039-8dd9-426a-b766-a4e6b425311b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:55.663430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6999b039-8dd9-426a-b766-a4e6b425311b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:55.663893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6999b039-8dd9-426a-b766-a4e6b425311b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:55.664593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6999b039-8dd9-426a-b766-a4e6b425311b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:55.665054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6999b039-8dd9-426a-b766-a4e6b425311b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:55.665519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6999b039-8dd9-426a-b766-a4e6b425311b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:55.696347 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6999b039-8dd9-426a-b766-a4e6b425311b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048078 Aug 29 16:31:55.696919 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3843/7909] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:31:55 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:31:56.713729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ef10912b-9636-438a-aa00-30e8c8191aa2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:56.717528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ef10912b-9636-438a-aa00-30e8c8191aa2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:56.729222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef10912b-9636-438a-aa00-30e8c8191aa2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:56.730040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef10912b-9636-438a-aa00-30e8c8191aa2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:56.730775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef10912b-9636-438a-aa00-30e8c8191aa2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:56.731968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef10912b-9636-438a-aa00-30e8c8191aa2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:56.732696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef10912b-9636-438a-aa00-30e8c8191aa2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:56.733491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef10912b-9636-438a-aa00-30e8c8191aa2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:56.764992 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ef10912b-9636-438a-aa00-30e8c8191aa2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058061 Aug 29 16:31:56.765569 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4067/7910] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:31:56 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:31:56.777833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-35a79299-1612-4958-90b4-d6ae9e0b0eeb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:56.778693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-35a79299-1612-4958-90b4-d6ae9e0b0eeb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:56.787581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35a79299-1612-4958-90b4-d6ae9e0b0eeb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:56.788076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35a79299-1612-4958-90b4-d6ae9e0b0eeb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:56.788523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35a79299-1612-4958-90b4-d6ae9e0b0eeb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:56.789271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35a79299-1612-4958-90b4-d6ae9e0b0eeb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:56.789737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35a79299-1612-4958-90b4-d6ae9e0b0eeb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:56.790168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35a79299-1612-4958-90b4-d6ae9e0b0eeb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:56.873454 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-35a79299-1612-4958-90b4-d6ae9e0b0eeb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] HTTP exception thrown: Instance 0a1b6a9f-49b3-4496-998e-907d41f9c127 is not attached to volume 4ed300aa-b202-407b-ae64-f8d198c088ef Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-35a79299-1612-4958-90b4-d6ae9e0b0eeb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Request method failure captured: Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments/4ed300aa-b202-407b-ae64-f8d198c088ef HTTP/1.1 Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOnXKNjOC748qJh_Cd1aoj5tLD1YyVb4nB2-AehuRjEfgBjAntC1F-_D1fOzMqrUpjZKRy1PzIMijKhx8nZ-CYQAUqcxukBaceIFbdLTTeBOcdXUwbJchcBdlvfkBQIefBy_F0NGNV4bFLarDXcjRjhIGlfMjtHFFOu9pn610SfqUfc Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 6cb497f7e81d4f7789e13e10efc77054 Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6cb497f7e81d4f7789e13e10efc77054", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6cb497f7e81d4f7789e13e10efc77054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6cb497f7e81d4f7789e13e10efc77054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6cb497f7e81d4f7789e13e10efc77054"}]}] Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 6cb497f7e81d4f7789e13e10efc77054 Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestEncryptedCinderVolumes-634067533-project Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: d269a24074194580972e03422b9ce3c6 Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestEncryptedCinderVolumes-634067533-project Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 0a1b6a9f-49b3-4496-998e-907d41f9c127 is not attached to volume 4ed300aa-b202-407b-ae64-f8d198c088ef Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'server_id': '0a1b6a9f-49b3-4496-998e-907d41f9c127', 'id': '4ed300aa-b202-407b-ae64-f8d198c088ef'} Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4ed300aa-b202-407b-ae64-f8d198c088ef. Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1b6a9f-49b3-4496-998e-907d41f9c127 is not attached to volume 4ed300aa-b202-407b-ae64-f8d198c088ef Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:31:56.885869 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:31:56.890045 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:31:56.890045 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:31:56.890045 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1b6a9f-49b3-4496-998e-907d41f9c127 is not attached to volume 4ed300aa-b202-407b-ae64-f8d198c088ef Aug 29 16:31:56.890045 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:31:56.890045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-35a79299-1612-4958-90b4-d6ae9e0b0eeb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Returning 404 to user: Instance 0a1b6a9f-49b3-4496-998e-907d41f9c127 is not attached to volume 4ed300aa-b202-407b-ae64-f8d198c088ef {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:31:56.890045 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-35a79299-1612-4958-90b4-d6ae9e0b0eeb tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments/4ed300aa-b202-407b-ae64-f8d198c088ef" status: 404 len: 154 microversion: 2.1 time: 0.114882 Aug 29 16:31:56.890045 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3844/7911] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 16:31:56 2022] DELETE /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127/os-volume_attachments/4ed300aa-b202-407b-ae64-f8d198c088ef => generated 154 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:32:00.260778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bd190f3a-6d2f-468c-a4d6-a44f406710f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:00.261339 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bd190f3a-6d2f-468c-a4d6-a44f406710f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:00.268763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd190f3a-6d2f-468c-a4d6-a44f406710f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:00.269558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd190f3a-6d2f-468c-a4d6-a44f406710f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:00.270052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd190f3a-6d2f-468c-a4d6-a44f406710f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:00.270773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd190f3a-6d2f-468c-a4d6-a44f406710f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:00.271404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd190f3a-6d2f-468c-a4d6-a44f406710f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:00.271702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bd190f3a-6d2f-468c-a4d6-a44f406710f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:00.300411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bd190f3a-6d2f-468c-a4d6-a44f406710f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:32:00.386773 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bd190f3a-6d2f-468c-a4d6-a44f406710f6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 204 len: 0 microversion: 2.1 time: 0.129582 Aug 29 16:32:00.387298 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4068/7912] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:32:00 2022] DELETE /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:32:00.397886 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f8c1793e-8aee-4228-980a-ac87d88905ec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:00.398498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f8c1793e-8aee-4228-980a-ac87d88905ec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:00.407634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8c1793e-8aee-4228-980a-ac87d88905ec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:00.408116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8c1793e-8aee-4228-980a-ac87d88905ec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:00.408776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8c1793e-8aee-4228-980a-ac87d88905ec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:00.409703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8c1793e-8aee-4228-980a-ac87d88905ec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:00.410341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8c1793e-8aee-4228-980a-ac87d88905ec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:00.411164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f8c1793e-8aee-4228-980a-ac87d88905ec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:00.550527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f8c1793e-8aee-4228-980a-ac87d88905ec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:00.559042 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f8c1793e-8aee-4228-980a-ac87d88905ec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 200 len: 1561 microversion: 2.1 time: 0.166739 Aug 29 16:32:00.559586 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3845/7913] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:00 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:01.585488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0962a995-36fa-4b66-ade9-a836a5db7f1c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:01.586649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0962a995-36fa-4b66-ade9-a836a5db7f1c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:01.596846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0962a995-36fa-4b66-ade9-a836a5db7f1c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:01.597368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0962a995-36fa-4b66-ade9-a836a5db7f1c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:01.597823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0962a995-36fa-4b66-ade9-a836a5db7f1c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:01.598521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0962a995-36fa-4b66-ade9-a836a5db7f1c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:01.599028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0962a995-36fa-4b66-ade9-a836a5db7f1c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:01.599541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0962a995-36fa-4b66-ade9-a836a5db7f1c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:01.757623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0962a995-36fa-4b66-ade9-a836a5db7f1c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:01.766166 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0962a995-36fa-4b66-ade9-a836a5db7f1c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 200 len: 1561 microversion: 2.1 time: 0.188801 Aug 29 16:32:01.766759 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4069/7914] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:01 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 1561 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:02.656963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-865f8a31-2d31-4e22-9c40-869c4e8f18b8 req-b600e93b-ac9b-451f-b4e7-144886b69b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1b6a9f-49b3-4496-998e-907d41f9c127", "name": "network-vif-deleted", "tag": "ff3181e8-4b97-49fd-b505-291464c90919"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:02.670627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-865f8a31-2d31-4e22-9c40-869c4e8f18b8 req-b600e93b-ac9b-451f-b4e7-144886b69b1d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:02.671169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-865f8a31-2d31-4e22-9c40-869c4e8f18b8 req-b600e93b-ac9b-451f-b4e7-144886b69b1d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:02.671609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-865f8a31-2d31-4e22-9c40-869c4e8f18b8 req-b600e93b-ac9b-451f-b4e7-144886b69b1d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:02.687172 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-865f8a31-2d31-4e22-9c40-869c4e8f18b8 req-b600e93b-ac9b-451f-b4e7-144886b69b1d service nova] Creating event network-vif-deleted:ff3181e8-4b97-49fd-b505-291464c90919 for instance 0a1b6a9f-49b3-4496-998e-907d41f9c127 on n-h2-839401-11 Aug 29 16:32:02.693424 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-865f8a31-2d31-4e22-9c40-869c4e8f18b8 req-b600e93b-ac9b-451f-b4e7-144886b69b1d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040069 Aug 29 16:32:02.695012 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3846/7915] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:02.794745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a21a4087-de44-47ed-baf1-c8dabeb2267a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:02.795364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a21a4087-de44-47ed-baf1-c8dabeb2267a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:02.802138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a21a4087-de44-47ed-baf1-c8dabeb2267a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:02.802634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a21a4087-de44-47ed-baf1-c8dabeb2267a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:02.803075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a21a4087-de44-47ed-baf1-c8dabeb2267a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:02.803778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a21a4087-de44-47ed-baf1-c8dabeb2267a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:02.804243 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a21a4087-de44-47ed-baf1-c8dabeb2267a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:02.804685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a21a4087-de44-47ed-baf1-c8dabeb2267a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:02.841897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a21a4087-de44-47ed-baf1-c8dabeb2267a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:02.842441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a21a4087-de44-47ed-baf1-c8dabeb2267a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:02.842911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a21a4087-de44-47ed-baf1-c8dabeb2267a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:02.843573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-a21a4087-de44-47ed-baf1-c8dabeb2267a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lazy-loading 'fault' on Instance uuid 0a1b6a9f-49b3-4496-998e-907d41f9c127 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:32:02.887552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a21a4087-de44-47ed-baf1-c8dabeb2267a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:02.896467 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a21a4087-de44-47ed-baf1-c8dabeb2267a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 200 len: 1353 microversion: 2.1 time: 0.105964 Aug 29 16:32:02.897063 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4070/7916] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:02 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 1353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:03.922780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ff1d5757-3733-4164-b3e1-ad86bdb6e962 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:03.923518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ff1d5757-3733-4164-b3e1-ad86bdb6e962 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 0a1b6a9f-49b3-4496-998e-907d41f9c127] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:03.931462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff1d5757-3733-4164-b3e1-ad86bdb6e962 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:03.931947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff1d5757-3733-4164-b3e1-ad86bdb6e962 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:03.932386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff1d5757-3733-4164-b3e1-ad86bdb6e962 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:03.933079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff1d5757-3733-4164-b3e1-ad86bdb6e962 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:03.933583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff1d5757-3733-4164-b3e1-ad86bdb6e962 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:03.934011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ff1d5757-3733-4164-b3e1-ad86bdb6e962 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:03.947773 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-ff1d5757-3733-4164-b3e1-ad86bdb6e962 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] HTTP exception thrown: Instance 0a1b6a9f-49b3-4496-998e-907d41f9c127 could not be found. Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ff1d5757-3733-4164-b3e1-ad86bdb6e962 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Request method failure captured: Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 HTTP/1.1 Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOnXKNjOC748qJh_Cd1aoj5tLD1YyVb4nB2-AehuRjEfgBjAntC1F-_D1fOzMqrUpjZKRy1PzIMijKhx8nZ-CYQAUqcxukBaceIFbdLTTeBOcdXUwbJchcBdlvfkBQIefBy_F0NGNV4bFLarDXcjRjhIGlfMjtHFFOu9pn610SfqUfc Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 6cb497f7e81d4f7789e13e10efc77054 Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6cb497f7e81d4f7789e13e10efc77054", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6cb497f7e81d4f7789e13e10efc77054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6cb497f7e81d4f7789e13e10efc77054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6cb497f7e81d4f7789e13e10efc77054"}]}] Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 6cb497f7e81d4f7789e13e10efc77054 Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestEncryptedCinderVolumes-634067533-project Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: d269a24074194580972e03422b9ce3c6 Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestEncryptedCinderVolumes-634067533-project Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 0a1b6a9f-49b3-4496-998e-907d41f9c127 could not be found. Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '0a1b6a9f-49b3-4496-998e-907d41f9c127'} Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1b6a9f-49b3-4496-998e-907d41f9c127 could not be found. Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1b6a9f-49b3-4496-998e-907d41f9c127 could not be found. Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:03.949452 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:32:03.954166 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:03.954166 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:03.954166 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:03.954166 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:32:03.954166 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:32:03.954166 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1b6a9f-49b3-4496-998e-907d41f9c127 could not be found. Aug 29 16:32:03.954166 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:32:03.954166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ff1d5757-3733-4164-b3e1-ad86bdb6e962 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Returning 404 to user: Instance 0a1b6a9f-49b3-4496-998e-907d41f9c127 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:32:03.954166 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ff1d5757-3733-4164-b3e1-ad86bdb6e962 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127" status: 404 len: 111 microversion: 2.1 time: 0.035004 Aug 29 16:32:03.954166 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3847/7917] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:03 2022] GET /compute/v2.1/servers/0a1b6a9f-49b3-4496-998e-907d41f9c127 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:32:03.959838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-831154be-5ad9-49ad-a54a-03ef91909507 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '.version_select at 0x7fc42a93fe50>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:03.964381 n-d-839401-11 devstack@n-api.service[122360]: ERROR oslo.messaging._drivers.impl_rabbit [None req-831154be-5ad9-49ad-a54a-03ef91909507 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [c4fea839-36b3-431f-8bb6-ddea9bf9c77e] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:32:04.975958 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [None req-831154be-5ad9-49ad-a54a-03ef91909507 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [c4fea839-36b3-431f-8bb6-ddea9bf9c77e] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 40560. Aug 29 16:32:05.004222 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-831154be-5ad9-49ad-a54a-03ef91909507 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1297556863" status: 202 len: 0 microversion: 2.1 time: 1.048258 Aug 29 16:32:05.005133 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4071/7918] 10.222.0.62 () {58 vars in 1278 bytes} [Mon Aug 29 16:32:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1297556863 => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:32:05.019960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3cbf151f-05c9-4325-96f7-a4f8ca47da05 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Action: 'create', calling method: .version_select at 0x7fc42a7f6040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2093526483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9j8ph0YR0DT1mSFH2a326/GQ3aui72X9aVhy7XfdMkUnyiyC8K/VVeQpxKXFiKXjV2mHKv3xdN5lPpyf3euLKSd/9lDK6WQWA9GVXbCMY96FGa8sqoR73w8R8JRjSgUA=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:05.038277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-3cbf151f-05c9-4325-96f7-a4f8ca47da05 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Getting quotas for project 6cb497f7e81d4f7789e13e10efc77054. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:32:05.043815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-3cbf151f-05c9-4325-96f7-a4f8ca47da05 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Getting quotas for user d269a24074194580972e03422b9ce3c6 and project 6cb497f7e81d4f7789e13e10efc77054. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:32:05.070786 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3cbf151f-05c9-4325-96f7-a4f8ca47da05 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.054864 Aug 29 16:32:05.071420 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3848/7919] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:32:05 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:05.130975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1965646534", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2093526483", "networks": [{"uuid": "f925e3e5-bf79-462a-a630-e5d2cd736dab"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:05.189626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] validate_networks() for [('f925e3e5-bf79-462a-a630-e5d2cd736dab', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:32:05.580988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:32:05.581458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:32:05.581946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:32:05.582363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:32:05.582812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:32:05.592710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:05.593254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:05.593703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:05.594420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:05.594885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:05.595314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:05.613125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Getting quotas for project 6cb497f7e81d4f7789e13e10efc77054. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:32:05.618699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Getting quotas for user d269a24074194580972e03422b9ce3c6 and project 6cb497f7e81d4f7789e13e10efc77054. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:32:05.632452 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:32:05.634778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:32:05.684195 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d855fe5f-5958-440b-8c68-5a8da4923a4d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557588 Aug 29 16:32:05.685068 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4072/7920] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:32:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:32:05.693019 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:32:05.693240 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 16:32:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 (ip 10.222.0.62) !!! Aug 29 16:32:05.704803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-07d4dc51-27ea-4358-bb92-70225aa588f9 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:05.705811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-07d4dc51-27ea-4358-bb92-70225aa588f9 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:05.761358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-07d4dc51-27ea-4358-bb92-70225aa588f9 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:05.768545 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-07d4dc51-27ea-4358-bb92-70225aa588f9 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 200 len: 1263 microversion: 2.1 time: 0.076644 Aug 29 16:32:05.769204 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3849/7921] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:05 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 1263 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:06.796115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4884d899-2fba-4be0-90d4-0e06a5aeba8d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:06.797145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4884d899-2fba-4be0-90d4-0e06a5aeba8d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:06.808471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4884d899-2fba-4be0-90d4-0e06a5aeba8d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:06.809389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4884d899-2fba-4be0-90d4-0e06a5aeba8d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:06.810137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4884d899-2fba-4be0-90d4-0e06a5aeba8d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:06.811337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4884d899-2fba-4be0-90d4-0e06a5aeba8d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:06.812112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4884d899-2fba-4be0-90d4-0e06a5aeba8d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:06.812790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4884d899-2fba-4be0-90d4-0e06a5aeba8d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:06.879668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4884d899-2fba-4be0-90d4-0e06a5aeba8d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:06.891080 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4884d899-2fba-4be0-90d4-0e06a5aeba8d tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 200 len: 1315 microversion: 2.1 time: 0.103983 Aug 29 16:32:06.891663 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4073/7922] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:06 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 1315 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:07.912634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-874fdc0a-18de-474e-a43a-c4a245483e61 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:07.913953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-874fdc0a-18de-474e-a43a-c4a245483e61 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:07.921462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-874fdc0a-18de-474e-a43a-c4a245483e61 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:07.922247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-874fdc0a-18de-474e-a43a-c4a245483e61 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:07.922682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-874fdc0a-18de-474e-a43a-c4a245483e61 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:07.923360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-874fdc0a-18de-474e-a43a-c4a245483e61 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:07.923815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-874fdc0a-18de-474e-a43a-c4a245483e61 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:07.924249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-874fdc0a-18de-474e-a43a-c4a245483e61 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:08.124417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-874fdc0a-18de-474e-a43a-c4a245483e61 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:08.132962 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-874fdc0a-18de-474e-a43a-c4a245483e61 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 200 len: 1363 microversion: 2.1 time: 0.224510 Aug 29 16:32:08.146608 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3850/7923] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:07 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:08.382213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-646369ba-9c58-4489-b139-88c348a7446e req-e6aac684-08fe-45e8-a2c6-564cda567be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9933aca7-636c-4500-8eca-1a42f39779e3", "tag": "d8f48d8c-fa50-4551-b522-164ac77d2f7d"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:08.396377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-646369ba-9c58-4489-b139-88c348a7446e req-e6aac684-08fe-45e8-a2c6-564cda567be7 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:08.397188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-646369ba-9c58-4489-b139-88c348a7446e req-e6aac684-08fe-45e8-a2c6-564cda567be7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:08.397642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-646369ba-9c58-4489-b139-88c348a7446e req-e6aac684-08fe-45e8-a2c6-564cda567be7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:08.409651 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-646369ba-9c58-4489-b139-88c348a7446e req-e6aac684-08fe-45e8-a2c6-564cda567be7 service nova] Creating event network-changed:d8f48d8c-fa50-4551-b522-164ac77d2f7d for instance 9933aca7-636c-4500-8eca-1a42f39779e3 on n-h2-839401-11 Aug 29 16:32:08.414880 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-646369ba-9c58-4489-b139-88c348a7446e req-e6aac684-08fe-45e8-a2c6-564cda567be7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036530 Aug 29 16:32:08.415506 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4074/7924] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:09.159850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c3388d7f-1a0a-43bc-bf00-ec01eeec1c8a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:09.160544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c3388d7f-1a0a-43bc-bf00-ec01eeec1c8a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:09.171113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3388d7f-1a0a-43bc-bf00-ec01eeec1c8a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:09.171743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3388d7f-1a0a-43bc-bf00-ec01eeec1c8a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:09.172219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3388d7f-1a0a-43bc-bf00-ec01eeec1c8a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:09.172924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3388d7f-1a0a-43bc-bf00-ec01eeec1c8a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:09.173404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3388d7f-1a0a-43bc-bf00-ec01eeec1c8a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:09.173848 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c3388d7f-1a0a-43bc-bf00-ec01eeec1c8a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:09.315694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c3388d7f-1a0a-43bc-bf00-ec01eeec1c8a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:09.324454 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c3388d7f-1a0a-43bc-bf00-ec01eeec1c8a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 200 len: 1363 microversion: 2.1 time: 0.171233 Aug 29 16:32:09.325026 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3851/7925] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:09 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:10.356152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-36a6a47d-1715-4227-8083-c1ca040af9cc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:10.357383 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-36a6a47d-1715-4227-8083-c1ca040af9cc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:10.365204 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36a6a47d-1715-4227-8083-c1ca040af9cc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:10.365698 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36a6a47d-1715-4227-8083-c1ca040af9cc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:10.366149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36a6a47d-1715-4227-8083-c1ca040af9cc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:10.366848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36a6a47d-1715-4227-8083-c1ca040af9cc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:10.367312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36a6a47d-1715-4227-8083-c1ca040af9cc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:10.367745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36a6a47d-1715-4227-8083-c1ca040af9cc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:10.509871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-36a6a47d-1715-4227-8083-c1ca040af9cc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:10.518178 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-36a6a47d-1715-4227-8083-c1ca040af9cc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 200 len: 1363 microversion: 2.1 time: 0.170591 Aug 29 16:32:10.518774 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4075/7926] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:10 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:11.539707 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-594623a4-c4c4-41de-a213-c2a0c3a0bfef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:11.540320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-594623a4-c4c4-41de-a213-c2a0c3a0bfef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:11.548408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-594623a4-c4c4-41de-a213-c2a0c3a0bfef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:11.548950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-594623a4-c4c4-41de-a213-c2a0c3a0bfef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:11.549415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-594623a4-c4c4-41de-a213-c2a0c3a0bfef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:11.550139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-594623a4-c4c4-41de-a213-c2a0c3a0bfef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:11.550597 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-594623a4-c4c4-41de-a213-c2a0c3a0bfef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:11.551032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-594623a4-c4c4-41de-a213-c2a0c3a0bfef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:11.829008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-594623a4-c4c4-41de-a213-c2a0c3a0bfef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:11.838005 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-594623a4-c4c4-41de-a213-c2a0c3a0bfef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 200 len: 1363 microversion: 2.1 time: 0.302376 Aug 29 16:32:11.838629 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3852/7927] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:11 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:12.862770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-86bc83ee-2f55-4e17-8823-56ff63251c46 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:12.863403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-86bc83ee-2f55-4e17-8823-56ff63251c46 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:12.870933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86bc83ee-2f55-4e17-8823-56ff63251c46 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:12.871461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86bc83ee-2f55-4e17-8823-56ff63251c46 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:12.871908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86bc83ee-2f55-4e17-8823-56ff63251c46 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:12.872603 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86bc83ee-2f55-4e17-8823-56ff63251c46 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:12.873121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86bc83ee-2f55-4e17-8823-56ff63251c46 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:12.873569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86bc83ee-2f55-4e17-8823-56ff63251c46 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:13.042915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-86bc83ee-2f55-4e17-8823-56ff63251c46 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:13.055841 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-86bc83ee-2f55-4e17-8823-56ff63251c46 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 200 len: 1363 microversion: 2.1 time: 0.198489 Aug 29 16:32:13.056731 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4076/7928] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:12 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:14.081669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e33e01c7-e85d-43f8-884d-798ec5b4bb66 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:14.082315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e33e01c7-e85d-43f8-884d-798ec5b4bb66 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:14.090636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e33e01c7-e85d-43f8-884d-798ec5b4bb66 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:14.091127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e33e01c7-e85d-43f8-884d-798ec5b4bb66 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:14.091558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e33e01c7-e85d-43f8-884d-798ec5b4bb66 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:14.092244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e33e01c7-e85d-43f8-884d-798ec5b4bb66 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:14.092702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e33e01c7-e85d-43f8-884d-798ec5b4bb66 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:14.093162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e33e01c7-e85d-43f8-884d-798ec5b4bb66 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:14.228680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e33e01c7-e85d-43f8-884d-798ec5b4bb66 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:14.236583 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e33e01c7-e85d-43f8-884d-798ec5b4bb66 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 200 len: 1363 microversion: 2.1 time: 0.160237 Aug 29 16:32:14.237172 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3853/7929] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:14 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:15.261036 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3b4b93ad-9168-48c0-a6e6-0e1aca7e81c2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:15.261990 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3b4b93ad-9168-48c0-a6e6-0e1aca7e81c2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:15.272978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b4b93ad-9168-48c0-a6e6-0e1aca7e81c2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:15.273819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b4b93ad-9168-48c0-a6e6-0e1aca7e81c2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:15.274481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b4b93ad-9168-48c0-a6e6-0e1aca7e81c2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:15.275563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b4b93ad-9168-48c0-a6e6-0e1aca7e81c2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:15.276285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b4b93ad-9168-48c0-a6e6-0e1aca7e81c2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:15.276963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3b4b93ad-9168-48c0-a6e6-0e1aca7e81c2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:15.414416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3b4b93ad-9168-48c0-a6e6-0e1aca7e81c2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:15.422515 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3b4b93ad-9168-48c0-a6e6-0e1aca7e81c2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 200 len: 1363 microversion: 2.1 time: 0.167760 Aug 29 16:32:15.423104 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4077/7930] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:15 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:15.454510 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-97d3fa99-5212-445b-a4b3-c3cf69b376ed req-ea9c3083-e2de-487a-acf8-38748fe5e9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9933aca7-636c-4500-8eca-1a42f39779e3", "name": "network-vif-plugged", "status": "completed", "tag": "d8f48d8c-fa50-4551-b522-164ac77d2f7d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:15.465810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-97d3fa99-5212-445b-a4b3-c3cf69b376ed req-ea9c3083-e2de-487a-acf8-38748fe5e9ed service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:15.466584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-97d3fa99-5212-445b-a4b3-c3cf69b376ed req-ea9c3083-e2de-487a-acf8-38748fe5e9ed service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:15.467067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-97d3fa99-5212-445b-a4b3-c3cf69b376ed req-ea9c3083-e2de-487a-acf8-38748fe5e9ed service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:15.478323 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-97d3fa99-5212-445b-a4b3-c3cf69b376ed req-ea9c3083-e2de-487a-acf8-38748fe5e9ed service nova] Creating event network-vif-plugged:d8f48d8c-fa50-4551-b522-164ac77d2f7d for instance 9933aca7-636c-4500-8eca-1a42f39779e3 on n-h2-839401-11 Aug 29 16:32:15.483407 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-97d3fa99-5212-445b-a4b3-c3cf69b376ed req-ea9c3083-e2de-487a-acf8-38748fe5e9ed service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032685 Aug 29 16:32:15.484004 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3854/7931] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:16.444260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a5adf775-88dc-4357-8c0e-4406a3e029a7 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:16.444851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a5adf775-88dc-4357-8c0e-4406a3e029a7 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:16.446913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:16.447605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:16.454240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5adf775-88dc-4357-8c0e-4406a3e029a7 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:16.454725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5adf775-88dc-4357-8c0e-4406a3e029a7 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:16.455235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5adf775-88dc-4357-8c0e-4406a3e029a7 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:16.455932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5adf775-88dc-4357-8c0e-4406a3e029a7 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:16.456395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5adf775-88dc-4357-8c0e-4406a3e029a7 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:16.456824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a5adf775-88dc-4357-8c0e-4406a3e029a7 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:16.606103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a5adf775-88dc-4357-8c0e-4406a3e029a7 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:16.615855 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a5adf775-88dc-4357-8c0e-4406a3e029a7 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 200 len: 1363 microversion: 2.1 time: 0.175605 Aug 29 16:32:16.616487 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4078/7932] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:16 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:17.640366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:17.648729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e0d06f90-f489-45dc-b41a-ad17c6c82cef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:17.649943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e0d06f90-f489-45dc-b41a-ad17c6c82cef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:17.660376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0d06f90-f489-45dc-b41a-ad17c6c82cef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:17.661043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0d06f90-f489-45dc-b41a-ad17c6c82cef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:17.661541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0d06f90-f489-45dc-b41a-ad17c6c82cef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:17.662256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0d06f90-f489-45dc-b41a-ad17c6c82cef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:17.662739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0d06f90-f489-45dc-b41a-ad17c6c82cef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:17.663168 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0d06f90-f489-45dc-b41a-ad17c6c82cef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:17.808321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e0d06f90-f489-45dc-b41a-ad17c6c82cef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:17.820090 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e0d06f90-f489-45dc-b41a-ad17c6c82cef tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 200 len: 1555 microversion: 2.1 time: 0.181301 Aug 29 16:32:17.820875 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3855/7933] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:17 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:17.843135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-22d4d30f-748f-4834-99ca-26f807b8a6b9 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:17.843895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-22d4d30f-748f-4834-99ca-26f807b8a6b9 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:17.851330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22d4d30f-748f-4834-99ca-26f807b8a6b9 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:17.851832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22d4d30f-748f-4834-99ca-26f807b8a6b9 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:17.852283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22d4d30f-748f-4834-99ca-26f807b8a6b9 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:17.853004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22d4d30f-748f-4834-99ca-26f807b8a6b9 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:17.853511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22d4d30f-748f-4834-99ca-26f807b8a6b9 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:17.853954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-22d4d30f-748f-4834-99ca-26f807b8a6b9 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:17.995661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-22d4d30f-748f-4834-99ca-26f807b8a6b9 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:18.007245 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-22d4d30f-748f-4834-99ca-26f807b8a6b9 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 200 len: 1555 microversion: 2.1 time: 0.168263 Aug 29 16:32:18.007999 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4079/7934] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:17 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:19.523079 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-77a0aff1-ca4e-4338-87b3-88fd5ce3a275 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f70cadd-a250-48af-a19b-3893d532f13b"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:19.525801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-77a0aff1-ca4e-4338-87b3-88fd5ce3a275 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:19.534004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77a0aff1-ca4e-4338-87b3-88fd5ce3a275 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:19.534499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77a0aff1-ca4e-4338-87b3-88fd5ce3a275 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:19.534942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77a0aff1-ca4e-4338-87b3-88fd5ce3a275 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:19.535657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77a0aff1-ca4e-4338-87b3-88fd5ce3a275 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:19.536117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77a0aff1-ca4e-4338-87b3-88fd5ce3a275 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:19.536698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-77a0aff1-ca4e-4338-87b3-88fd5ce3a275 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:19.830050 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-77a0aff1-ca4e-4338-87b3-88fd5ce3a275 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "POST /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310879 Aug 29 16:32:19.830691 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3856/7935] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 16:32:19 2022] POST /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:30.600254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-89dc3d35-f615-433d-b82e-4c6a1cf0289b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:30.601272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-89dc3d35-f615-433d-b82e-4c6a1cf0289b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:30.605551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:30.606755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:30.614373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89dc3d35-f615-433d-b82e-4c6a1cf0289b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:30.614886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89dc3d35-f615-433d-b82e-4c6a1cf0289b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:30.615348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89dc3d35-f615-433d-b82e-4c6a1cf0289b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:30.616095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89dc3d35-f615-433d-b82e-4c6a1cf0289b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:30.616574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89dc3d35-f615-433d-b82e-4c6a1cf0289b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:30.617024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89dc3d35-f615-433d-b82e-4c6a1cf0289b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:30.701650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-89dc3d35-f615-433d-b82e-4c6a1cf0289b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lazy-loading 'services' on Instance uuid 9933aca7-636c-4500-8eca-1a42f39779e3 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:32:30.785982 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-89dc3d35-f615-433d-b82e-4c6a1cf0289b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments/1f70cadd-a250-48af-a19b-3893d532f13b" status: 202 len: 0 microversion: 2.1 time: 0.192261 Aug 29 16:32:30.786617 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4080/7936] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 16:32:30 2022] DELETE /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments/1f70cadd-a250-48af-a19b-3893d532f13b => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:32:30.795568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-11bc22ef-c326-4913-b4f2-df08859615f8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:30.798113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-11bc22ef-c326-4913-b4f2-df08859615f8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:30.801464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:30.802176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:30.808244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11bc22ef-c326-4913-b4f2-df08859615f8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:30.808858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11bc22ef-c326-4913-b4f2-df08859615f8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:30.809333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11bc22ef-c326-4913-b4f2-df08859615f8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:30.810046 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11bc22ef-c326-4913-b4f2-df08859615f8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:30.810502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11bc22ef-c326-4913-b4f2-df08859615f8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:30.810923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11bc22ef-c326-4913-b4f2-df08859615f8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:30.846872 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-11bc22ef-c326-4913-b4f2-df08859615f8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055498 Aug 29 16:32:30.847440 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3857/7937] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:32:30 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:32:31.860471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a66fd94c-bade-4afc-8a09-cedbfba48197 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:31.862946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a66fd94c-bade-4afc-8a09-cedbfba48197 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:31.870462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a66fd94c-bade-4afc-8a09-cedbfba48197 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:31.871004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a66fd94c-bade-4afc-8a09-cedbfba48197 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:31.871464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a66fd94c-bade-4afc-8a09-cedbfba48197 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:31.872188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a66fd94c-bade-4afc-8a09-cedbfba48197 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:31.872665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a66fd94c-bade-4afc-8a09-cedbfba48197 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:31.873126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a66fd94c-bade-4afc-8a09-cedbfba48197 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:31.904038 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a66fd94c-bade-4afc-8a09-cedbfba48197 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048042 Aug 29 16:32:31.904819 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4081/7938] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:32:31 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:32.917563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0b364c16-7b40-4f31-9e64-180df8199ec8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:32.919782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0b364c16-7b40-4f31-9e64-180df8199ec8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:32.927116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b364c16-7b40-4f31-9e64-180df8199ec8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:32.927610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b364c16-7b40-4f31-9e64-180df8199ec8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:32.928044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b364c16-7b40-4f31-9e64-180df8199ec8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:32.928765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b364c16-7b40-4f31-9e64-180df8199ec8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:32.929250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b364c16-7b40-4f31-9e64-180df8199ec8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:32.929678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0b364c16-7b40-4f31-9e64-180df8199ec8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:32.961511 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0b364c16-7b40-4f31-9e64-180df8199ec8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048637 Aug 29 16:32:32.962101 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3858/7939] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:32:32 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:33.975053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-156ac311-35fa-4ed4-9788-e842eb7cb26b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:33.977836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-156ac311-35fa-4ed4-9788-e842eb7cb26b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:33.985340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-156ac311-35fa-4ed4-9788-e842eb7cb26b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:33.985844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-156ac311-35fa-4ed4-9788-e842eb7cb26b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:33.986297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-156ac311-35fa-4ed4-9788-e842eb7cb26b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:33.987011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-156ac311-35fa-4ed4-9788-e842eb7cb26b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:33.987480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-156ac311-35fa-4ed4-9788-e842eb7cb26b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:33.987903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-156ac311-35fa-4ed4-9788-e842eb7cb26b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:34.022412 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-156ac311-35fa-4ed4-9788-e842eb7cb26b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051766 Aug 29 16:32:34.023099 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4082/7940] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:32:33 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:35.035315 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-776689e4-b61f-40f8-b266-e96dea0591af tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:35.037687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-776689e4-b61f-40f8-b266-e96dea0591af tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:35.044636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-776689e4-b61f-40f8-b266-e96dea0591af tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:35.045248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-776689e4-b61f-40f8-b266-e96dea0591af tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:35.045695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-776689e4-b61f-40f8-b266-e96dea0591af tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:35.046575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-776689e4-b61f-40f8-b266-e96dea0591af tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:35.047038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-776689e4-b61f-40f8-b266-e96dea0591af tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:35.047465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-776689e4-b61f-40f8-b266-e96dea0591af tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:35.079611 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-776689e4-b61f-40f8-b266-e96dea0591af tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048512 Aug 29 16:32:35.080191 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3859/7941] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:32:35 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:36.096916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6c44fa5c-b337-43f3-bd25-568dae8290ea tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:36.099512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6c44fa5c-b337-43f3-bd25-568dae8290ea tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:36.106870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c44fa5c-b337-43f3-bd25-568dae8290ea tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:36.107369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c44fa5c-b337-43f3-bd25-568dae8290ea tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:36.107823 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c44fa5c-b337-43f3-bd25-568dae8290ea tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:36.108536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c44fa5c-b337-43f3-bd25-568dae8290ea tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:36.109001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c44fa5c-b337-43f3-bd25-568dae8290ea tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:36.109479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6c44fa5c-b337-43f3-bd25-568dae8290ea tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:36.139421 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6c44fa5c-b337-43f3-bd25-568dae8290ea tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049729 Aug 29 16:32:36.139994 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4083/7942] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:32:36 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:32:36.157181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d78ca207-802d-495f-9a95-5ed145dfc193 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:36.157831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d78ca207-802d-495f-9a95-5ed145dfc193 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:36.165933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d78ca207-802d-495f-9a95-5ed145dfc193 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:36.166422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d78ca207-802d-495f-9a95-5ed145dfc193 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:36.166832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d78ca207-802d-495f-9a95-5ed145dfc193 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:36.167535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d78ca207-802d-495f-9a95-5ed145dfc193 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:36.167991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d78ca207-802d-495f-9a95-5ed145dfc193 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:36.168417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d78ca207-802d-495f-9a95-5ed145dfc193 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:36.252729 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-d78ca207-802d-495f-9a95-5ed145dfc193 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] HTTP exception thrown: Instance 9933aca7-636c-4500-8eca-1a42f39779e3 is not attached to volume 1f70cadd-a250-48af-a19b-3893d532f13b Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d78ca207-802d-495f-9a95-5ed145dfc193 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Request method failure captured: Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments/1f70cadd-a250-48af-a19b-3893d532f13b HTTP/1.1 Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOnXKNjOC748qJh_Cd1aoj5tLD1YyVb4nB2-AehuRjEfgBjAntC1F-_D1fOzMqrUpjZKRy1PzIMijKhx8nZ-CYQAUqcxukBaceIFbdLTTeBOcdXUwbJchcBdlvfkBQIefBy_F0NGNV4bFLarDXcjRjhIGlfMjtHFFOu9pn610SfqUfc Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 6cb497f7e81d4f7789e13e10efc77054 Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6cb497f7e81d4f7789e13e10efc77054", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6cb497f7e81d4f7789e13e10efc77054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6cb497f7e81d4f7789e13e10efc77054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6cb497f7e81d4f7789e13e10efc77054"}]}] Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 6cb497f7e81d4f7789e13e10efc77054 Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestEncryptedCinderVolumes-634067533-project Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: d269a24074194580972e03422b9ce3c6 Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestEncryptedCinderVolumes-634067533-project Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 9933aca7-636c-4500-8eca-1a42f39779e3 is not attached to volume 1f70cadd-a250-48af-a19b-3893d532f13b Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'server_id': '9933aca7-636c-4500-8eca-1a42f39779e3', 'id': '1f70cadd-a250-48af-a19b-3893d532f13b'} Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1f70cadd-a250-48af-a19b-3893d532f13b. Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9933aca7-636c-4500-8eca-1a42f39779e3 is not attached to volume 1f70cadd-a250-48af-a19b-3893d532f13b Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:36.254490 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:36.259005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:32:36.259005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:32:36.259005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9933aca7-636c-4500-8eca-1a42f39779e3 is not attached to volume 1f70cadd-a250-48af-a19b-3893d532f13b Aug 29 16:32:36.259005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.259005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d78ca207-802d-495f-9a95-5ed145dfc193 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Returning 404 to user: Instance 9933aca7-636c-4500-8eca-1a42f39779e3 is not attached to volume 1f70cadd-a250-48af-a19b-3893d532f13b {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:32:36.259005 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d78ca207-802d-495f-9a95-5ed145dfc193 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments/1f70cadd-a250-48af-a19b-3893d532f13b" status: 404 len: 154 microversion: 2.1 time: 0.105390 Aug 29 16:32:36.259005 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3860/7943] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 16:32:36 2022] DELETE /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3/os-volume_attachments/1f70cadd-a250-48af-a19b-3893d532f13b => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:32:39.621328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-18a665cd-33fa-4962-a141-b4f28a202dec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:39.621948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-18a665cd-33fa-4962-a141-b4f28a202dec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:39.629275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18a665cd-33fa-4962-a141-b4f28a202dec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:39.629820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18a665cd-33fa-4962-a141-b4f28a202dec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:39.630276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18a665cd-33fa-4962-a141-b4f28a202dec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:39.631000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18a665cd-33fa-4962-a141-b4f28a202dec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:39.631466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18a665cd-33fa-4962-a141-b4f28a202dec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:39.631899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18a665cd-33fa-4962-a141-b4f28a202dec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:39.662953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-18a665cd-33fa-4962-a141-b4f28a202dec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:32:39.745173 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-18a665cd-33fa-4962-a141-b4f28a202dec tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 204 len: 0 microversion: 2.1 time: 0.127744 Aug 29 16:32:39.745682 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4084/7944] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:32:39 2022] DELETE /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:32:39.754399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8ad3463d-92e8-4221-9353-26b0eaba46e2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:39.755112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8ad3463d-92e8-4221-9353-26b0eaba46e2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:39.762279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ad3463d-92e8-4221-9353-26b0eaba46e2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:39.762772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ad3463d-92e8-4221-9353-26b0eaba46e2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:39.763207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ad3463d-92e8-4221-9353-26b0eaba46e2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:39.763889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ad3463d-92e8-4221-9353-26b0eaba46e2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:39.764576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ad3463d-92e8-4221-9353-26b0eaba46e2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:39.765002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8ad3463d-92e8-4221-9353-26b0eaba46e2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:39.897538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8ad3463d-92e8-4221-9353-26b0eaba46e2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:39.905699 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8ad3463d-92e8-4221-9353-26b0eaba46e2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 200 len: 1561 microversion: 2.1 time: 0.155625 Aug 29 16:32:39.906282 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3861/7945] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:39 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:40.930411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a2799daa-0a5b-4ca9-b1af-1dc2b1be99b2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:40.931144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a2799daa-0a5b-4ca9-b1af-1dc2b1be99b2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:40.938739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2799daa-0a5b-4ca9-b1af-1dc2b1be99b2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:40.939244 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2799daa-0a5b-4ca9-b1af-1dc2b1be99b2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:40.939699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2799daa-0a5b-4ca9-b1af-1dc2b1be99b2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:40.940417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2799daa-0a5b-4ca9-b1af-1dc2b1be99b2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:40.940895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2799daa-0a5b-4ca9-b1af-1dc2b1be99b2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:40.941372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a2799daa-0a5b-4ca9-b1af-1dc2b1be99b2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:41.079070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a2799daa-0a5b-4ca9-b1af-1dc2b1be99b2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:41.087379 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a2799daa-0a5b-4ca9-b1af-1dc2b1be99b2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 200 len: 1561 microversion: 2.1 time: 0.162387 Aug 29 16:32:41.087939 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4085/7946] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:40 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:42.001984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-7629cc64-5001-453e-89dc-26a58e172158 req-6e995bd6-4321-4444-9a7c-af6f05c4266f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9933aca7-636c-4500-8eca-1a42f39779e3", "name": "network-vif-deleted", "tag": "d8f48d8c-fa50-4551-b522-164ac77d2f7d"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:42.013294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7629cc64-5001-453e-89dc-26a58e172158 req-6e995bd6-4321-4444-9a7c-af6f05c4266f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:42.013874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7629cc64-5001-453e-89dc-26a58e172158 req-6e995bd6-4321-4444-9a7c-af6f05c4266f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:42.014382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7629cc64-5001-453e-89dc-26a58e172158 req-6e995bd6-4321-4444-9a7c-af6f05c4266f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:42.036291 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-7629cc64-5001-453e-89dc-26a58e172158 req-6e995bd6-4321-4444-9a7c-af6f05c4266f service nova] Creating event network-vif-deleted:d8f48d8c-fa50-4551-b522-164ac77d2f7d for instance 9933aca7-636c-4500-8eca-1a42f39779e3 on n-h2-839401-11 Aug 29 16:32:42.041520 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-7629cc64-5001-453e-89dc-26a58e172158 req-6e995bd6-4321-4444-9a7c-af6f05c4266f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043276 Aug 29 16:32:42.042355 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3862/7947] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:42.108789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b35fece-79c9-4079-b25c-7f216dd395b8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:42.109589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8b35fece-79c9-4079-b25c-7f216dd395b8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:42.116557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b35fece-79c9-4079-b25c-7f216dd395b8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:42.117060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b35fece-79c9-4079-b25c-7f216dd395b8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:42.117531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b35fece-79c9-4079-b25c-7f216dd395b8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:42.118350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b35fece-79c9-4079-b25c-7f216dd395b8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:42.118692 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b35fece-79c9-4079-b25c-7f216dd395b8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:42.119130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b35fece-79c9-4079-b25c-7f216dd395b8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:42.151240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b35fece-79c9-4079-b25c-7f216dd395b8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:42.151727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b35fece-79c9-4079-b25c-7f216dd395b8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:42.152170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b35fece-79c9-4079-b25c-7f216dd395b8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:42.152625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-8b35fece-79c9-4079-b25c-7f216dd395b8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lazy-loading 'fault' on Instance uuid 9933aca7-636c-4500-8eca-1a42f39779e3 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:32:42.198477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8b35fece-79c9-4079-b25c-7f216dd395b8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:42.207004 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8b35fece-79c9-4079-b25c-7f216dd395b8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 200 len: 1353 microversion: 2.1 time: 0.102273 Aug 29 16:32:42.207602 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4086/7948] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:42 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 1353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:43.237143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ebcb199a-2144-439a-bd87-1a65bd57ce49 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:43.238160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ebcb199a-2144-439a-bd87-1a65bd57ce49 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: 9933aca7-636c-4500-8eca-1a42f39779e3] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:43.245722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebcb199a-2144-439a-bd87-1a65bd57ce49 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:43.246205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebcb199a-2144-439a-bd87-1a65bd57ce49 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:43.246644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebcb199a-2144-439a-bd87-1a65bd57ce49 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:43.247337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebcb199a-2144-439a-bd87-1a65bd57ce49 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:43.247792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebcb199a-2144-439a-bd87-1a65bd57ce49 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:43.248219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebcb199a-2144-439a-bd87-1a65bd57ce49 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:43.262461 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-ebcb199a-2144-439a-bd87-1a65bd57ce49 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] HTTP exception thrown: Instance 9933aca7-636c-4500-8eca-1a42f39779e3 could not be found. Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ebcb199a-2144-439a-bd87-1a65bd57ce49 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Request method failure captured: Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 HTTP/1.1 Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOnXKNjOC748qJh_Cd1aoj5tLD1YyVb4nB2-AehuRjEfgBjAntC1F-_D1fOzMqrUpjZKRy1PzIMijKhx8nZ-CYQAUqcxukBaceIFbdLTTeBOcdXUwbJchcBdlvfkBQIefBy_F0NGNV4bFLarDXcjRjhIGlfMjtHFFOu9pn610SfqUfc Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 6cb497f7e81d4f7789e13e10efc77054 Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6cb497f7e81d4f7789e13e10efc77054", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6cb497f7e81d4f7789e13e10efc77054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6cb497f7e81d4f7789e13e10efc77054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6cb497f7e81d4f7789e13e10efc77054"}]}] Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 6cb497f7e81d4f7789e13e10efc77054 Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestEncryptedCinderVolumes-634067533-project Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: d269a24074194580972e03422b9ce3c6 Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestEncryptedCinderVolumes-634067533-project Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 9933aca7-636c-4500-8eca-1a42f39779e3 could not be found. Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '9933aca7-636c-4500-8eca-1a42f39779e3'} Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9933aca7-636c-4500-8eca-1a42f39779e3 could not be found. Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9933aca7-636c-4500-8eca-1a42f39779e3 could not be found. Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:43.264075 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:32:43.268812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:43.268812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:43.268812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:43.268812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:32:43.268812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:32:43.268812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9933aca7-636c-4500-8eca-1a42f39779e3 could not be found. Aug 29 16:32:43.268812 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:32:43.268812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ebcb199a-2144-439a-bd87-1a65bd57ce49 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Returning 404 to user: Instance 9933aca7-636c-4500-8eca-1a42f39779e3 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:32:43.268812 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ebcb199a-2144-439a-bd87-1a65bd57ce49 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3" status: 404 len: 111 microversion: 2.1 time: 0.037065 Aug 29 16:32:43.268812 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3863/7949] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:43 2022] GET /compute/v2.1/servers/9933aca7-636c-4500-8eca-1a42f39779e3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:32:43.274677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-39edee3d-b7c1-43ac-8e43-9cfe5f7fa670 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '.version_select at 0x7fc42a754b80>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:43.298413 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-39edee3d-b7c1-43ac-8e43-9cfe5f7fa670 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2093526483" status: 202 len: 0 microversion: 2.1 time: 0.027635 Aug 29 16:32:43.298994 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4087/7950] 10.222.0.62 () {58 vars in 1278 bytes} [Mon Aug 29 16:32:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2093526483 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:32:43.317031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-40854a72-38bc-4261-8c8c-6ebb2f3c0881 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Action: 'create', calling method: .version_select at 0x7fc42ba6f820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-840416668", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG52kIfN3do6ysPDt/8x+ipeJdY8s5PHLC64KdhtE4JtqPEV2kqEeBOXdQES8ERMwnBVPMx+BVUlhH2MwMjQNE+z8krDVt1KpZaJD9NQwV2S/UR4aZINTf8F0SfE+9BB7w=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:43.333334 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-40854a72-38bc-4261-8c8c-6ebb2f3c0881 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Getting quotas for project 6cb497f7e81d4f7789e13e10efc77054. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:32:43.340194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-40854a72-38bc-4261-8c8c-6ebb2f3c0881 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Getting quotas for user d269a24074194580972e03422b9ce3c6 and project 6cb497f7e81d4f7789e13e10efc77054. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:32:43.365834 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-40854a72-38bc-4261-8c8c-6ebb2f3c0881 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.052852 Aug 29 16:32:43.366431 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3864/7951] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:32:43 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:43.417767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-520749506", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-840416668", "networks": [{"uuid": "f925e3e5-bf79-462a-a630-e5d2cd736dab"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:43.472662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] validate_networks() for [('f925e3e5-bf79-462a-a630-e5d2cd736dab', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:32:43.867445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:32:43.868076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:32:43.868750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:32:43.869365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:32:43.869942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:32:43.882836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:43.883317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:43.883771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:43.884539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:43.885014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:43.885488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:43.902493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Getting quotas for project 6cb497f7e81d4f7789e13e10efc77054. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:32:43.907988 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Getting quotas for user d269a24074194580972e03422b9ce3c6 and project 6cb497f7e81d4f7789e13e10efc77054. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:32:43.920699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:32:43.923078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:32:43.972231 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7b8a7a3c-c858-40c8-84df-0601f69e5ae4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558476 Aug 29 16:32:43.972888 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4088/7952] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:32:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:32:43.984284 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9256b280-bf54-4c2e-8242-e3125d933331 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:43.985193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9256b280-bf54-4c2e-8242-e3125d933331 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:44.041737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9256b280-bf54-4c2e-8242-e3125d933331 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:44.048989 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9256b280-bf54-4c2e-8242-e3125d933331 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 200 len: 1261 microversion: 2.1 time: 0.069234 Aug 29 16:32:44.049604 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3865/7953] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:43 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 1261 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:45.072161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ce0aef3f-4f66-455d-8bf7-d55d9ee38457 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:45.072936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ce0aef3f-4f66-455d-8bf7-d55d9ee38457 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:45.079206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce0aef3f-4f66-455d-8bf7-d55d9ee38457 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:45.079720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce0aef3f-4f66-455d-8bf7-d55d9ee38457 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:45.080171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce0aef3f-4f66-455d-8bf7-d55d9ee38457 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:45.081139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce0aef3f-4f66-455d-8bf7-d55d9ee38457 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:45.081853 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce0aef3f-4f66-455d-8bf7-d55d9ee38457 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:45.082461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce0aef3f-4f66-455d-8bf7-d55d9ee38457 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:45.146747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ce0aef3f-4f66-455d-8bf7-d55d9ee38457 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:45.156197 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ce0aef3f-4f66-455d-8bf7-d55d9ee38457 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 200 len: 1321 microversion: 2.1 time: 0.090188 Aug 29 16:32:45.156777 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4089/7954] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:45 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 1321 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:46.178828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6b04850c-192c-4174-98e5-b072fab25573 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:46.179535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6b04850c-192c-4174-98e5-b072fab25573 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:46.186948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b04850c-192c-4174-98e5-b072fab25573 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:46.187576 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b04850c-192c-4174-98e5-b072fab25573 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:46.188019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b04850c-192c-4174-98e5-b072fab25573 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:46.188720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b04850c-192c-4174-98e5-b072fab25573 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:46.189216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b04850c-192c-4174-98e5-b072fab25573 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:46.189642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6b04850c-192c-4174-98e5-b072fab25573 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:46.400001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6b04850c-192c-4174-98e5-b072fab25573 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:46.409137 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6b04850c-192c-4174-98e5-b072fab25573 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 200 len: 1361 microversion: 2.1 time: 0.235198 Aug 29 16:32:46.418718 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3866/7955] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:46 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:46.482073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-56d4b58d-28d5-48c1-975b-f470b248eb98 req-9c269aeb-136a-4a51-8262-a8ced420b9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e60fcf82-3902-4490-a74b-5a0ded5337ca", "tag": "95927091-6fae-4ef7-a355-884eb51f412c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:46.495635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-56d4b58d-28d5-48c1-975b-f470b248eb98 req-9c269aeb-136a-4a51-8262-a8ced420b9f6 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:46.496119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-56d4b58d-28d5-48c1-975b-f470b248eb98 req-9c269aeb-136a-4a51-8262-a8ced420b9f6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:46.496544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-56d4b58d-28d5-48c1-975b-f470b248eb98 req-9c269aeb-136a-4a51-8262-a8ced420b9f6 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:46.508099 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-56d4b58d-28d5-48c1-975b-f470b248eb98 req-9c269aeb-136a-4a51-8262-a8ced420b9f6 service nova] Creating event network-changed:95927091-6fae-4ef7-a355-884eb51f412c for instance e60fcf82-3902-4490-a74b-5a0ded5337ca on n-h2-839401-11 Aug 29 16:32:46.513455 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-56d4b58d-28d5-48c1-975b-f470b248eb98 req-9c269aeb-136a-4a51-8262-a8ced420b9f6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035188 Aug 29 16:32:46.514062 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4090/7956] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:47.435306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-af20a6f2-dcaa-4450-bafa-2f12b2200cf8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:47.436300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-af20a6f2-dcaa-4450-bafa-2f12b2200cf8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:47.446751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af20a6f2-dcaa-4450-bafa-2f12b2200cf8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:47.447246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af20a6f2-dcaa-4450-bafa-2f12b2200cf8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:47.447687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af20a6f2-dcaa-4450-bafa-2f12b2200cf8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:47.448391 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af20a6f2-dcaa-4450-bafa-2f12b2200cf8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:47.448856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af20a6f2-dcaa-4450-bafa-2f12b2200cf8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:47.449357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-af20a6f2-dcaa-4450-bafa-2f12b2200cf8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:47.582427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-af20a6f2-dcaa-4450-bafa-2f12b2200cf8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:47.591108 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-af20a6f2-dcaa-4450-bafa-2f12b2200cf8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 200 len: 1361 microversion: 2.1 time: 0.162480 Aug 29 16:32:47.591690 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3867/7957] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:47 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:48.618267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-36952733-85c4-4c97-8ca2-0ad0a8cfed1b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:48.618984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-36952733-85c4-4c97-8ca2-0ad0a8cfed1b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:48.625724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36952733-85c4-4c97-8ca2-0ad0a8cfed1b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:48.626222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36952733-85c4-4c97-8ca2-0ad0a8cfed1b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:48.626666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36952733-85c4-4c97-8ca2-0ad0a8cfed1b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:48.627374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36952733-85c4-4c97-8ca2-0ad0a8cfed1b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:48.627843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36952733-85c4-4c97-8ca2-0ad0a8cfed1b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:48.628284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36952733-85c4-4c97-8ca2-0ad0a8cfed1b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:48.773289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-36952733-85c4-4c97-8ca2-0ad0a8cfed1b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:48.785687 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-36952733-85c4-4c97-8ca2-0ad0a8cfed1b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 200 len: 1361 microversion: 2.1 time: 0.175358 Aug 29 16:32:48.786493 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4091/7958] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:48 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:49.808999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bcd2e51c-276d-4fda-93ec-4d96b1ee7bdc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:49.809652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bcd2e51c-276d-4fda-93ec-4d96b1ee7bdc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:49.818158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcd2e51c-276d-4fda-93ec-4d96b1ee7bdc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:49.818940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcd2e51c-276d-4fda-93ec-4d96b1ee7bdc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:49.819651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcd2e51c-276d-4fda-93ec-4d96b1ee7bdc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:49.820851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcd2e51c-276d-4fda-93ec-4d96b1ee7bdc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:49.821437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcd2e51c-276d-4fda-93ec-4d96b1ee7bdc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:49.821859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcd2e51c-276d-4fda-93ec-4d96b1ee7bdc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:49.960374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bcd2e51c-276d-4fda-93ec-4d96b1ee7bdc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:49.968616 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bcd2e51c-276d-4fda-93ec-4d96b1ee7bdc tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 200 len: 1361 microversion: 2.1 time: 0.163682 Aug 29 16:32:49.969207 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3868/7959] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:49 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:50.991490 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b907e413-dbab-457f-bf29-943cdaf2f061 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:50.992158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b907e413-dbab-457f-bf29-943cdaf2f061 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:51.002561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b907e413-dbab-457f-bf29-943cdaf2f061 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:51.003389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b907e413-dbab-457f-bf29-943cdaf2f061 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:51.004126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b907e413-dbab-457f-bf29-943cdaf2f061 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:51.005285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b907e413-dbab-457f-bf29-943cdaf2f061 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:51.005868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b907e413-dbab-457f-bf29-943cdaf2f061 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:51.006318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b907e413-dbab-457f-bf29-943cdaf2f061 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:51.155153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b907e413-dbab-457f-bf29-943cdaf2f061 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:51.166484 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b907e413-dbab-457f-bf29-943cdaf2f061 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 200 len: 1361 microversion: 2.1 time: 0.179917 Aug 29 16:32:51.167087 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4092/7960] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:50 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:52.194052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cb5acb2c-47ea-42df-8bd5-0f3cf5fe46b4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:52.194638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cb5acb2c-47ea-42df-8bd5-0f3cf5fe46b4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:52.202146 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb5acb2c-47ea-42df-8bd5-0f3cf5fe46b4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:52.202642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb5acb2c-47ea-42df-8bd5-0f3cf5fe46b4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:52.203084 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb5acb2c-47ea-42df-8bd5-0f3cf5fe46b4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:52.203792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb5acb2c-47ea-42df-8bd5-0f3cf5fe46b4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:52.204302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb5acb2c-47ea-42df-8bd5-0f3cf5fe46b4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:52.204865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb5acb2c-47ea-42df-8bd5-0f3cf5fe46b4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:52.338988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cb5acb2c-47ea-42df-8bd5-0f3cf5fe46b4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:52.347262 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cb5acb2c-47ea-42df-8bd5-0f3cf5fe46b4 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 200 len: 1361 microversion: 2.1 time: 0.157456 Aug 29 16:32:52.347840 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3869/7961] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:52 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:53.368453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-31d21db5-92fb-4a84-820b-86ee3882a255 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:53.369115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-31d21db5-92fb-4a84-820b-86ee3882a255 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:53.376354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31d21db5-92fb-4a84-820b-86ee3882a255 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:53.376844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31d21db5-92fb-4a84-820b-86ee3882a255 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:53.377338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31d21db5-92fb-4a84-820b-86ee3882a255 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:53.378025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31d21db5-92fb-4a84-820b-86ee3882a255 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:53.378514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31d21db5-92fb-4a84-820b-86ee3882a255 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:53.378958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-31d21db5-92fb-4a84-820b-86ee3882a255 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:53.523350 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-31d21db5-92fb-4a84-820b-86ee3882a255 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:53.531865 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-31d21db5-92fb-4a84-820b-86ee3882a255 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 200 len: 1361 microversion: 2.1 time: 0.167459 Aug 29 16:32:53.532555 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4093/7962] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:53 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:53.664449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-0d0809ca-cbe7-4f0b-9951-5fe3d13bf3e4 req-c8b254bc-6bc7-4cbe-b79b-c423ae6f456c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60fcf82-3902-4490-a74b-5a0ded5337ca", "name": "network-vif-plugged", "status": "completed", "tag": "95927091-6fae-4ef7-a355-884eb51f412c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:53.676413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0d0809ca-cbe7-4f0b-9951-5fe3d13bf3e4 req-c8b254bc-6bc7-4cbe-b79b-c423ae6f456c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:53.677654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0d0809ca-cbe7-4f0b-9951-5fe3d13bf3e4 req-c8b254bc-6bc7-4cbe-b79b-c423ae6f456c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:53.678089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0d0809ca-cbe7-4f0b-9951-5fe3d13bf3e4 req-c8b254bc-6bc7-4cbe-b79b-c423ae6f456c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:53.689891 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-0d0809ca-cbe7-4f0b-9951-5fe3d13bf3e4 req-c8b254bc-6bc7-4cbe-b79b-c423ae6f456c service nova] Creating event network-vif-plugged:95927091-6fae-4ef7-a355-884eb51f412c for instance e60fcf82-3902-4490-a74b-5a0ded5337ca on n-h2-839401-11 Aug 29 16:32:53.694905 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-0d0809ca-cbe7-4f0b-9951-5fe3d13bf3e4 req-c8b254bc-6bc7-4cbe-b79b-c423ae6f456c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034401 Aug 29 16:32:53.695528 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3870/7963] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:54.557056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1ae0db13-f471-4057-b590-2eb7a0c7b722 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:54.557920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1ae0db13-f471-4057-b590-2eb7a0c7b722 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:54.560040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:54.560835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:54.568547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ae0db13-f471-4057-b590-2eb7a0c7b722 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:54.569132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ae0db13-f471-4057-b590-2eb7a0c7b722 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:54.569693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ae0db13-f471-4057-b590-2eb7a0c7b722 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:54.570518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ae0db13-f471-4057-b590-2eb7a0c7b722 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:54.571068 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ae0db13-f471-4057-b590-2eb7a0c7b722 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:54.571580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ae0db13-f471-4057-b590-2eb7a0c7b722 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:54.711811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1ae0db13-f471-4057-b590-2eb7a0c7b722 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:54.720094 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1ae0db13-f471-4057-b590-2eb7a0c7b722 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 200 len: 1361 microversion: 2.1 time: 0.169390 Aug 29 16:32:54.720680 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4094/7964] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:54 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:55.743874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a5478bb-e1c9-4141-b019-67721bcfe054 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:55.744800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a5478bb-e1c9-4141-b019-67721bcfe054 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:55.747447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:55.756028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a5478bb-e1c9-4141-b019-67721bcfe054 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:55.756676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a5478bb-e1c9-4141-b019-67721bcfe054 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:55.757299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a5478bb-e1c9-4141-b019-67721bcfe054 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:55.758392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a5478bb-e1c9-4141-b019-67721bcfe054 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:55.758885 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a5478bb-e1c9-4141-b019-67721bcfe054 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:55.759318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a5478bb-e1c9-4141-b019-67721bcfe054 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:55.900727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5a5478bb-e1c9-4141-b019-67721bcfe054 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:55.908865 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5a5478bb-e1c9-4141-b019-67721bcfe054 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 200 len: 1554 microversion: 2.1 time: 0.170815 Aug 29 16:32:55.909485 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3871/7965] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:55 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:55.931463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-23c3428a-4236-49ab-a7fb-9a8213d4bd43 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:55.932094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-23c3428a-4236-49ab-a7fb-9a8213d4bd43 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:55.939200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23c3428a-4236-49ab-a7fb-9a8213d4bd43 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:55.939711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23c3428a-4236-49ab-a7fb-9a8213d4bd43 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:55.940167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23c3428a-4236-49ab-a7fb-9a8213d4bd43 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:55.940850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23c3428a-4236-49ab-a7fb-9a8213d4bd43 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:55.941458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23c3428a-4236-49ab-a7fb-9a8213d4bd43 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:55.941899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-23c3428a-4236-49ab-a7fb-9a8213d4bd43 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:56.082899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-23c3428a-4236-49ab-a7fb-9a8213d4bd43 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:56.091572 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-23c3428a-4236-49ab-a7fb-9a8213d4bd43 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 200 len: 1554 microversion: 2.1 time: 0.166072 Aug 29 16:32:56.092084 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4095/7966] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:55 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:57.620945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-661c204a-ea1e-4d7c-b70b-586778b5b505 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab54f8c9-0c77-4e53-b581-0c4b60c1c9cc"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:57.623271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-661c204a-ea1e-4d7c-b70b-586778b5b505 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:57.630567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-661c204a-ea1e-4d7c-b70b-586778b5b505 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:57.631048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-661c204a-ea1e-4d7c-b70b-586778b5b505 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:57.631481 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-661c204a-ea1e-4d7c-b70b-586778b5b505 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:57.632164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-661c204a-ea1e-4d7c-b70b-586778b5b505 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:57.632613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-661c204a-ea1e-4d7c-b70b-586778b5b505 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:57.633031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-661c204a-ea1e-4d7c-b70b-586778b5b505 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:57.925376 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-661c204a-ea1e-4d7c-b70b-586778b5b505 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "POST /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308365 Aug 29 16:32:57.926042 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3872/7967] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 16:32:57 2022] POST /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:08.664774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e59a5f7b-3682-4dc1-a15e-d25d866769d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:08.665319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e59a5f7b-3682-4dc1-a15e-d25d866769d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:08.668176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:08.668849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:08.674786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e59a5f7b-3682-4dc1-a15e-d25d866769d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:08.675281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e59a5f7b-3682-4dc1-a15e-d25d866769d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:08.675728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e59a5f7b-3682-4dc1-a15e-d25d866769d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:08.676777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e59a5f7b-3682-4dc1-a15e-d25d866769d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:08.677356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e59a5f7b-3682-4dc1-a15e-d25d866769d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:08.677797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e59a5f7b-3682-4dc1-a15e-d25d866769d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:08.769595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-e59a5f7b-3682-4dc1-a15e-d25d866769d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lazy-loading 'services' on Instance uuid e60fcf82-3902-4490-a74b-5a0ded5337ca {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:33:08.851635 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e59a5f7b-3682-4dc1-a15e-d25d866769d2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments/ab54f8c9-0c77-4e53-b581-0c4b60c1c9cc" status: 202 len: 0 microversion: 2.1 time: 0.190897 Aug 29 16:33:08.852388 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4096/7968] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 16:33:08 2022] DELETE /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments/ab54f8c9-0c77-4e53-b581-0c4b60c1c9cc => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:33:08.859184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:08.860029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:08.864411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7602b7e1-f30e-4406-8e66-9499d1cba03c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:08.866796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7602b7e1-f30e-4406-8e66-9499d1cba03c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:08.874802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7602b7e1-f30e-4406-8e66-9499d1cba03c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:08.875296 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7602b7e1-f30e-4406-8e66-9499d1cba03c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:08.875743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7602b7e1-f30e-4406-8e66-9499d1cba03c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:08.876440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7602b7e1-f30e-4406-8e66-9499d1cba03c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:08.876898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7602b7e1-f30e-4406-8e66-9499d1cba03c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:08.877348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7602b7e1-f30e-4406-8e66-9499d1cba03c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:08.908721 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7602b7e1-f30e-4406-8e66-9499d1cba03c tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051521 Aug 29 16:33:08.909302 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3873/7969] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:33:08 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:09.923174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e89c206d-82a9-4dd3-9cf8-b5ca6ec1b2a2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:09.925706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e89c206d-82a9-4dd3-9cf8-b5ca6ec1b2a2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:09.932548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e89c206d-82a9-4dd3-9cf8-b5ca6ec1b2a2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:09.933050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e89c206d-82a9-4dd3-9cf8-b5ca6ec1b2a2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:09.933539 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e89c206d-82a9-4dd3-9cf8-b5ca6ec1b2a2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:09.934262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e89c206d-82a9-4dd3-9cf8-b5ca6ec1b2a2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:09.934735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e89c206d-82a9-4dd3-9cf8-b5ca6ec1b2a2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:09.935179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e89c206d-82a9-4dd3-9cf8-b5ca6ec1b2a2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:09.967180 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e89c206d-82a9-4dd3-9cf8-b5ca6ec1b2a2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049395 Aug 29 16:33:09.967765 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4097/7970] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:33:09 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:10.979860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e72c36bb-afe1-4e44-80a2-1fde6c65f784 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:10.982119 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e72c36bb-afe1-4e44-80a2-1fde6c65f784 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:10.989505 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e72c36bb-afe1-4e44-80a2-1fde6c65f784 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:10.990002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e72c36bb-afe1-4e44-80a2-1fde6c65f784 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:10.990440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e72c36bb-afe1-4e44-80a2-1fde6c65f784 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:10.991150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e72c36bb-afe1-4e44-80a2-1fde6c65f784 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:10.991591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e72c36bb-afe1-4e44-80a2-1fde6c65f784 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:10.992013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e72c36bb-afe1-4e44-80a2-1fde6c65f784 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:11.025584 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e72c36bb-afe1-4e44-80a2-1fde6c65f784 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049982 Aug 29 16:33:11.026211 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3874/7971] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:33:10 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:12.037843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65849a3f-efe8-47e6-8c41-8e38cde23258 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:12.040268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-65849a3f-efe8-47e6-8c41-8e38cde23258 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:12.048137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65849a3f-efe8-47e6-8c41-8e38cde23258 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:12.048633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65849a3f-efe8-47e6-8c41-8e38cde23258 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:12.049115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65849a3f-efe8-47e6-8c41-8e38cde23258 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:12.049855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65849a3f-efe8-47e6-8c41-8e38cde23258 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:12.050325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65849a3f-efe8-47e6-8c41-8e38cde23258 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:12.050776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-65849a3f-efe8-47e6-8c41-8e38cde23258 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:12.081631 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-65849a3f-efe8-47e6-8c41-8e38cde23258 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047963 Aug 29 16:33:12.082217 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4098/7972] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:33:12 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:13.093975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-35709782-c808-498a-b44b-b80a9e8a0238 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:13.096213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-35709782-c808-498a-b44b-b80a9e8a0238 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:13.103415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35709782-c808-498a-b44b-b80a9e8a0238 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:13.103910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35709782-c808-498a-b44b-b80a9e8a0238 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:13.104340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35709782-c808-498a-b44b-b80a9e8a0238 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:13.105030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35709782-c808-498a-b44b-b80a9e8a0238 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:13.105496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35709782-c808-498a-b44b-b80a9e8a0238 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:13.105919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-35709782-c808-498a-b44b-b80a9e8a0238 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:13.136528 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-35709782-c808-498a-b44b-b80a9e8a0238 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046728 Aug 29 16:33:13.137128 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3875/7973] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:33:13 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:14.153296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d048b421-1b14-4a4b-bf82-0f13f50270f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:14.157073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d048b421-1b14-4a4b-bf82-0f13f50270f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:14.168448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d048b421-1b14-4a4b-bf82-0f13f50270f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:14.168954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d048b421-1b14-4a4b-bf82-0f13f50270f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:14.169448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d048b421-1b14-4a4b-bf82-0f13f50270f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:14.170164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d048b421-1b14-4a4b-bf82-0f13f50270f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:14.170644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d048b421-1b14-4a4b-bf82-0f13f50270f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:14.171092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d048b421-1b14-4a4b-bf82-0f13f50270f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:14.201516 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d048b421-1b14-4a4b-bf82-0f13f50270f2 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055146 Aug 29 16:33:14.202091 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4099/7974] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:33:14 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:33:14.214734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a82534a9-ecd3-431b-9f10-0ec25842bd2b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:14.215299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a82534a9-ecd3-431b-9f10-0ec25842bd2b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:14.222393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a82534a9-ecd3-431b-9f10-0ec25842bd2b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:14.222879 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a82534a9-ecd3-431b-9f10-0ec25842bd2b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:14.223317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a82534a9-ecd3-431b-9f10-0ec25842bd2b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:14.224014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a82534a9-ecd3-431b-9f10-0ec25842bd2b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:14.224471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a82534a9-ecd3-431b-9f10-0ec25842bd2b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:14.224898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a82534a9-ecd3-431b-9f10-0ec25842bd2b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:14.304359 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-a82534a9-ecd3-431b-9f10-0ec25842bd2b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] HTTP exception thrown: Instance e60fcf82-3902-4490-a74b-5a0ded5337ca is not attached to volume ab54f8c9-0c77-4e53-b581-0c4b60c1c9cc Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a82534a9-ecd3-431b-9f10-0ec25842bd2b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Request method failure captured: Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments/ab54f8c9-0c77-4e53-b581-0c4b60c1c9cc HTTP/1.1 Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOnXKNjOC748qJh_Cd1aoj5tLD1YyVb4nB2-AehuRjEfgBjAntC1F-_D1fOzMqrUpjZKRy1PzIMijKhx8nZ-CYQAUqcxukBaceIFbdLTTeBOcdXUwbJchcBdlvfkBQIefBy_F0NGNV4bFLarDXcjRjhIGlfMjtHFFOu9pn610SfqUfc Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 6cb497f7e81d4f7789e13e10efc77054 Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6cb497f7e81d4f7789e13e10efc77054", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6cb497f7e81d4f7789e13e10efc77054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6cb497f7e81d4f7789e13e10efc77054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6cb497f7e81d4f7789e13e10efc77054"}]}] Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 6cb497f7e81d4f7789e13e10efc77054 Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestEncryptedCinderVolumes-634067533-project Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: d269a24074194580972e03422b9ce3c6 Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestEncryptedCinderVolumes-634067533-project Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance e60fcf82-3902-4490-a74b-5a0ded5337ca is not attached to volume ab54f8c9-0c77-4e53-b581-0c4b60c1c9cc Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'server_id': 'e60fcf82-3902-4490-a74b-5a0ded5337ca', 'id': 'ab54f8c9-0c77-4e53-b581-0c4b60c1c9cc'} Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ab54f8c9-0c77-4e53-b581-0c4b60c1c9cc. Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e60fcf82-3902-4490-a74b-5a0ded5337ca is not attached to volume ab54f8c9-0c77-4e53-b581-0c4b60c1c9cc Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:33:14.306055 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:33:14.310424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:33:14.310424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:33:14.310424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e60fcf82-3902-4490-a74b-5a0ded5337ca is not attached to volume ab54f8c9-0c77-4e53-b581-0c4b60c1c9cc Aug 29 16:33:14.310424 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:33:14.310424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a82534a9-ecd3-431b-9f10-0ec25842bd2b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Returning 404 to user: Instance e60fcf82-3902-4490-a74b-5a0ded5337ca is not attached to volume ab54f8c9-0c77-4e53-b581-0c4b60c1c9cc {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:33:14.310424 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a82534a9-ecd3-431b-9f10-0ec25842bd2b tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments/ab54f8c9-0c77-4e53-b581-0c4b60c1c9cc" status: 404 len: 154 microversion: 2.1 time: 0.097400 Aug 29 16:33:14.310424 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3876/7975] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 16:33:14 2022] DELETE /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca/os-volume_attachments/ab54f8c9-0c77-4e53-b581-0c4b60c1c9cc => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:33:17.658079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9528d94a-3395-4756-9269-af9ede64d3a6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:17.658562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9528d94a-3395-4756-9269-af9ede64d3a6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:17.666164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9528d94a-3395-4756-9269-af9ede64d3a6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:17.666663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9528d94a-3395-4756-9269-af9ede64d3a6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:17.667320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9528d94a-3395-4756-9269-af9ede64d3a6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:17.668134 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9528d94a-3395-4756-9269-af9ede64d3a6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:17.668246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9528d94a-3395-4756-9269-af9ede64d3a6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:17.668729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9528d94a-3395-4756-9269-af9ede64d3a6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:17.697471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9528d94a-3395-4756-9269-af9ede64d3a6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:33:17.789104 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9528d94a-3395-4756-9269-af9ede64d3a6 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 204 len: 0 microversion: 2.1 time: 0.134547 Aug 29 16:33:17.789993 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4100/7976] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:33:17 2022] DELETE /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:33:17.799708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9b5c37d6-795c-4134-b05d-767ef1e6ee58 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:17.800328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9b5c37d6-795c-4134-b05d-767ef1e6ee58 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:17.807862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b5c37d6-795c-4134-b05d-767ef1e6ee58 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:17.808348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b5c37d6-795c-4134-b05d-767ef1e6ee58 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:17.808790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b5c37d6-795c-4134-b05d-767ef1e6ee58 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:17.809676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b5c37d6-795c-4134-b05d-767ef1e6ee58 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:17.810129 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b5c37d6-795c-4134-b05d-767ef1e6ee58 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:17.810555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9b5c37d6-795c-4134-b05d-767ef1e6ee58 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:17.946815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9b5c37d6-795c-4134-b05d-767ef1e6ee58 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:17.955003 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9b5c37d6-795c-4134-b05d-767ef1e6ee58 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 200 len: 1560 microversion: 2.1 time: 0.159813 Aug 29 16:33:17.955665 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3877/7977] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:17 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:18.982650 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4a02ca1c-6e1e-4814-880a-d841b0f43392 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:18.984235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4a02ca1c-6e1e-4814-880a-d841b0f43392 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:18.995820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a02ca1c-6e1e-4814-880a-d841b0f43392 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:18.996648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a02ca1c-6e1e-4814-880a-d841b0f43392 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:18.997334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a02ca1c-6e1e-4814-880a-d841b0f43392 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:18.998059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a02ca1c-6e1e-4814-880a-d841b0f43392 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:18.998534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a02ca1c-6e1e-4814-880a-d841b0f43392 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:18.998982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4a02ca1c-6e1e-4814-880a-d841b0f43392 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:19.143248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4a02ca1c-6e1e-4814-880a-d841b0f43392 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:19.151614 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4a02ca1c-6e1e-4814-880a-d841b0f43392 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 200 len: 1560 microversion: 2.1 time: 0.176260 Aug 29 16:33:19.152204 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4101/7978] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:18 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:20.002651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-3fa256da-8bc3-4ee8-9bf4-0397f9df12dc req-5c47337f-e854-47dd-a89d-e2d3e2da8033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60fcf82-3902-4490-a74b-5a0ded5337ca", "name": "network-vif-deleted", "tag": "95927091-6fae-4ef7-a355-884eb51f412c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:20.013924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3fa256da-8bc3-4ee8-9bf4-0397f9df12dc req-5c47337f-e854-47dd-a89d-e2d3e2da8033 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:20.014400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3fa256da-8bc3-4ee8-9bf4-0397f9df12dc req-5c47337f-e854-47dd-a89d-e2d3e2da8033 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:20.014823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3fa256da-8bc3-4ee8-9bf4-0397f9df12dc req-5c47337f-e854-47dd-a89d-e2d3e2da8033 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:20.029762 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-3fa256da-8bc3-4ee8-9bf4-0397f9df12dc req-5c47337f-e854-47dd-a89d-e2d3e2da8033 service nova] Creating event network-vif-deleted:95927091-6fae-4ef7-a355-884eb51f412c for instance e60fcf82-3902-4490-a74b-5a0ded5337ca on n-h2-839401-11 Aug 29 16:33:20.035189 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-3fa256da-8bc3-4ee8-9bf4-0397f9df12dc req-5c47337f-e854-47dd-a89d-e2d3e2da8033 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036149 Aug 29 16:33:20.036000 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3878/7979] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:20.174055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2e26aec9-e11d-4d2f-8774-a7e3db4abf1a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:20.174680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2e26aec9-e11d-4d2f-8774-a7e3db4abf1a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:20.182118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e26aec9-e11d-4d2f-8774-a7e3db4abf1a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:20.182629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e26aec9-e11d-4d2f-8774-a7e3db4abf1a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:20.183085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e26aec9-e11d-4d2f-8774-a7e3db4abf1a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:20.183805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e26aec9-e11d-4d2f-8774-a7e3db4abf1a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:20.184284 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e26aec9-e11d-4d2f-8774-a7e3db4abf1a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:20.184728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e26aec9-e11d-4d2f-8774-a7e3db4abf1a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:20.220623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e26aec9-e11d-4d2f-8774-a7e3db4abf1a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:20.221066 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e26aec9-e11d-4d2f-8774-a7e3db4abf1a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:20.221540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e26aec9-e11d-4d2f-8774-a7e3db4abf1a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:20.222001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-2e26aec9-e11d-4d2f-8774-a7e3db4abf1a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lazy-loading 'fault' on Instance uuid e60fcf82-3902-4490-a74b-5a0ded5337ca {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:33:20.277455 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2e26aec9-e11d-4d2f-8774-a7e3db4abf1a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a24074194580972e03422b9ce3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb497f7e81d4f7789e13e10efc77054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:20.290520 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2e26aec9-e11d-4d2f-8774-a7e3db4abf1a tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 200 len: 1351 microversion: 2.1 time: 0.120296 Aug 29 16:33:20.291319 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4102/7980] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:20 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 1351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:21.314577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b778ea82-a288-4619-ac13-4af39ef583a8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:21.315351 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b778ea82-a288-4619-ac13-4af39ef583a8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] [instance: e60fcf82-3902-4490-a74b-5a0ded5337ca] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:21.323013 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b778ea82-a288-4619-ac13-4af39ef583a8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:21.323553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b778ea82-a288-4619-ac13-4af39ef583a8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:21.324069 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b778ea82-a288-4619-ac13-4af39ef583a8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:21.324846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b778ea82-a288-4619-ac13-4af39ef583a8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:21.325390 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b778ea82-a288-4619-ac13-4af39ef583a8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:21.325868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b778ea82-a288-4619-ac13-4af39ef583a8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:21.342001 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-b778ea82-a288-4619-ac13-4af39ef583a8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] HTTP exception thrown: Instance e60fcf82-3902-4490-a74b-5a0ded5337ca could not be found. Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b778ea82-a288-4619-ac13-4af39ef583a8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Request method failure captured: Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca HTTP/1.1 Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOnXKNjOC748qJh_Cd1aoj5tLD1YyVb4nB2-AehuRjEfgBjAntC1F-_D1fOzMqrUpjZKRy1PzIMijKhx8nZ-CYQAUqcxukBaceIFbdLTTeBOcdXUwbJchcBdlvfkBQIefBy_F0NGNV4bFLarDXcjRjhIGlfMjtHFFOu9pn610SfqUfc Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 6cb497f7e81d4f7789e13e10efc77054 Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6cb497f7e81d4f7789e13e10efc77054", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6cb497f7e81d4f7789e13e10efc77054"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6cb497f7e81d4f7789e13e10efc77054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6cb497f7e81d4f7789e13e10efc77054"}]}] Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 6cb497f7e81d4f7789e13e10efc77054 Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-634067533 Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestEncryptedCinderVolumes-634067533-project Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: d269a24074194580972e03422b9ce3c6 Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestEncryptedCinderVolumes-634067533-project Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance e60fcf82-3902-4490-a74b-5a0ded5337ca could not be found. Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'e60fcf82-3902-4490-a74b-5a0ded5337ca'} Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e60fcf82-3902-4490-a74b-5a0ded5337ca could not be found. Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e60fcf82-3902-4490-a74b-5a0ded5337ca could not be found. Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:33:21.343627 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:33:21.348054 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:21.348054 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:33:21.348054 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:33:21.348054 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:33:21.348054 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:33:21.348054 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e60fcf82-3902-4490-a74b-5a0ded5337ca could not be found. Aug 29 16:33:21.348054 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:33:21.348054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b778ea82-a288-4619-ac13-4af39ef583a8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Returning 404 to user: Instance e60fcf82-3902-4490-a74b-5a0ded5337ca could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:33:21.348054 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b778ea82-a288-4619-ac13-4af39ef583a8 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca" status: 404 len: 111 microversion: 2.1 time: 0.036312 Aug 29 16:33:21.348054 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3879/7981] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:21 2022] GET /compute/v2.1/servers/e60fcf82-3902-4490-a74b-5a0ded5337ca => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:33:21.357992 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d67e587b-4ed7-4305-ae46-fb5e9d8b8228 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] Calling method '.version_select at 0x7fc433a51430>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:21.382543 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d67e587b-4ed7-4305-ae46-fb5e9d8b8228 tempest-TestEncryptedCinderVolumes-634067533 tempest-TestEncryptedCinderVolumes-634067533-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-840416668" status: 202 len: 0 microversion: 2.1 time: 0.031965 Aug 29 16:33:21.383164 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4103/7982] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 16:33:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-840416668 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:33:47.705448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-373e5ded-cf14-4d18-b42e-c7e84090d507 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Action: 'create', calling method: .version_select at 0x7fc42a5f3f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1515669195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWhWgN1n1DUM+YjOKFKnh74LEQHO8X7XoMKrQPbpohinhuHmzB4ZzIc6S8bTkyqx8M9XJLOcI3l49Pqz61caq8cGHO2vwkik9QH6qftX+NQrqnD9pfBmXjswSZ0Pls2tA=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:47.711182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=14 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:47.711836 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=34 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:47.725237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-373e5ded-cf14-4d18-b42e-c7e84090d507 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Getting quotas for project eb3d683e910d466db2dda3302e3c309f. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:33:47.730428 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-373e5ded-cf14-4d18-b42e-c7e84090d507 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Getting quotas for user 4ab82f9740ec4d119cfb03b1a1883b91 and project eb3d683e910d466db2dda3302e3c309f. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:33:47.756932 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-373e5ded-cf14-4d18-b42e-c7e84090d507 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055644 Aug 29 16:33:47.757568 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3880/7983] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:33:47 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:47.812489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:47.813280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:47.817956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1598847372", "imageRef": "8bddaf1e-4ac5-4707-91eb-7c2b5f4f6588", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1515669195", "networks": [{"uuid": "09716daf-4662-4c3c-aacf-e059ab71f49e"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:47.998702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] validate_networks() for [('09716daf-4662-4c3c-aacf-e059ab71f49e', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:33:48.736275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:33:48.736948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:33:48.737680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:33:48.738253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:33:48.738744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:33:48.752935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:48.753652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:48.754233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:48.755318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:48.756028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:48.756686 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:48.776326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Getting quotas for project eb3d683e910d466db2dda3302e3c309f. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:33:48.781877 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Getting quotas for user 4ab82f9740ec4d119cfb03b1a1883b91 and project eb3d683e910d466db2dda3302e3c309f. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:33:48.794842 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:33:48.797141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8bddaf1e-4ac5-4707-91eb-7c2b5f4f6588',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:33:48.850691 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ee56fdc4-9e32-4ef2-a863-f78e1730c4ec tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040320 Aug 29 16:33:48.851361 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4104/7984] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:33:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:33:48.863158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4803e34a-c2dd-4f65-a768-b7d40250302b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:48.863776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4803e34a-c2dd-4f65-a768-b7d40250302b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:49.034728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4803e34a-c2dd-4f65-a768-b7d40250302b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:49.041956 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4803e34a-c2dd-4f65-a768-b7d40250302b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1259 microversion: 2.1 time: 0.183698 Aug 29 16:33:49.042522 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3881/7985] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:48 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:50.066564 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-64310f08-aef9-4895-ab2d-307e7af64a6a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:50.067231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-64310f08-aef9-4895-ab2d-307e7af64a6a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:50.076549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64310f08-aef9-4895-ab2d-307e7af64a6a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:50.077364 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64310f08-aef9-4895-ab2d-307e7af64a6a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:50.078007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64310f08-aef9-4895-ab2d-307e7af64a6a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:50.078995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64310f08-aef9-4895-ab2d-307e7af64a6a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:50.079628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64310f08-aef9-4895-ab2d-307e7af64a6a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:50.080221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64310f08-aef9-4895-ab2d-307e7af64a6a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:50.147084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-64310f08-aef9-4895-ab2d-307e7af64a6a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:50.155231 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-64310f08-aef9-4895-ab2d-307e7af64a6a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1329 microversion: 2.1 time: 0.096352 Aug 29 16:33:50.155817 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4105/7986] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:50 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1329 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:51.176160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c7c673c2-b7f1-44ae-9bbf-aed3a1f89d3f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:51.176870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c7c673c2-b7f1-44ae-9bbf-aed3a1f89d3f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:51.188864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c673c2-b7f1-44ae-9bbf-aed3a1f89d3f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:51.189396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c673c2-b7f1-44ae-9bbf-aed3a1f89d3f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:51.190301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c673c2-b7f1-44ae-9bbf-aed3a1f89d3f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:51.191346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c673c2-b7f1-44ae-9bbf-aed3a1f89d3f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:51.191840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c673c2-b7f1-44ae-9bbf-aed3a1f89d3f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:51.192412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c7c673c2-b7f1-44ae-9bbf-aed3a1f89d3f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:51.335060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c7c673c2-b7f1-44ae-9bbf-aed3a1f89d3f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:51.343309 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c7c673c2-b7f1-44ae-9bbf-aed3a1f89d3f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.171383 Aug 29 16:33:51.343885 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3882/7987] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:51 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:52.364663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5d3ec6c9-252d-4ec0-afea-4a04008822a2 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:52.366038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5d3ec6c9-252d-4ec0-afea-4a04008822a2 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:52.374267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d3ec6c9-252d-4ec0-afea-4a04008822a2 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:52.375025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d3ec6c9-252d-4ec0-afea-4a04008822a2 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:52.375626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d3ec6c9-252d-4ec0-afea-4a04008822a2 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:52.376812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d3ec6c9-252d-4ec0-afea-4a04008822a2 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:52.377428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d3ec6c9-252d-4ec0-afea-4a04008822a2 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:52.378063 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5d3ec6c9-252d-4ec0-afea-4a04008822a2 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:52.532544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5d3ec6c9-252d-4ec0-afea-4a04008822a2 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:52.540897 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5d3ec6c9-252d-4ec0-afea-4a04008822a2 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.180616 Aug 29 16:33:52.545463 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4106/7988] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:52 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:53.566317 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-86c142ee-4a73-4f85-b96d-5d7067165bda tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:53.568220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-86c142ee-4a73-4f85-b96d-5d7067165bda tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:53.582492 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86c142ee-4a73-4f85-b96d-5d7067165bda tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:53.583738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86c142ee-4a73-4f85-b96d-5d7067165bda tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:53.584762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86c142ee-4a73-4f85-b96d-5d7067165bda tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:53.586348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86c142ee-4a73-4f85-b96d-5d7067165bda tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:53.587410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86c142ee-4a73-4f85-b96d-5d7067165bda tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:53.588967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-86c142ee-4a73-4f85-b96d-5d7067165bda tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:53.752453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-86c142ee-4a73-4f85-b96d-5d7067165bda tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:53.760963 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-86c142ee-4a73-4f85-b96d-5d7067165bda tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.201544 Aug 29 16:33:53.761833 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3883/7989] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:53 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:54.782463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-07f991df-448f-4ba5-ae9a-34a43d5853a0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:54.783467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-07f991df-448f-4ba5-ae9a-34a43d5853a0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:54.791251 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07f991df-448f-4ba5-ae9a-34a43d5853a0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:54.791973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07f991df-448f-4ba5-ae9a-34a43d5853a0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:54.792433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07f991df-448f-4ba5-ae9a-34a43d5853a0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:54.793485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07f991df-448f-4ba5-ae9a-34a43d5853a0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:54.794111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07f991df-448f-4ba5-ae9a-34a43d5853a0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:54.794543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-07f991df-448f-4ba5-ae9a-34a43d5853a0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:54.962324 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-07f991df-448f-4ba5-ae9a-34a43d5853a0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:54.971229 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-07f991df-448f-4ba5-ae9a-34a43d5853a0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.192781 Aug 29 16:33:54.972453 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4107/7990] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:54 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:55.992933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bf6789bf-c0d1-4065-9880-1ba1044afc10 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:55.993637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bf6789bf-c0d1-4065-9880-1ba1044afc10 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:56.000729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf6789bf-c0d1-4065-9880-1ba1044afc10 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:56.001267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf6789bf-c0d1-4065-9880-1ba1044afc10 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:56.001706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf6789bf-c0d1-4065-9880-1ba1044afc10 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:56.002620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf6789bf-c0d1-4065-9880-1ba1044afc10 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:56.003074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf6789bf-c0d1-4065-9880-1ba1044afc10 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:56.003853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bf6789bf-c0d1-4065-9880-1ba1044afc10 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:56.146548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bf6789bf-c0d1-4065-9880-1ba1044afc10 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:56.154939 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bf6789bf-c0d1-4065-9880-1ba1044afc10 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.166075 Aug 29 16:33:56.155775 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3884/7991] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:55 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:57.176925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0e90e5c3-abe1-4cda-8f93-835ad7a67e1a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:57.177666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0e90e5c3-abe1-4cda-8f93-835ad7a67e1a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:57.184736 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e90e5c3-abe1-4cda-8f93-835ad7a67e1a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:57.186166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e90e5c3-abe1-4cda-8f93-835ad7a67e1a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:57.186999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e90e5c3-abe1-4cda-8f93-835ad7a67e1a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:57.187946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e90e5c3-abe1-4cda-8f93-835ad7a67e1a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:57.188625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e90e5c3-abe1-4cda-8f93-835ad7a67e1a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:57.189300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0e90e5c3-abe1-4cda-8f93-835ad7a67e1a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:57.330048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0e90e5c3-abe1-4cda-8f93-835ad7a67e1a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:57.338282 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0e90e5c3-abe1-4cda-8f93-835ad7a67e1a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.165718 Aug 29 16:33:57.339440 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4108/7992] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:57 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:58.363949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-684a1d34-9458-42cf-96d3-64615349578d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:58.364950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-684a1d34-9458-42cf-96d3-64615349578d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:58.377165 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-684a1d34-9458-42cf-96d3-64615349578d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:58.377968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-684a1d34-9458-42cf-96d3-64615349578d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:58.378685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-684a1d34-9458-42cf-96d3-64615349578d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:58.379829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-684a1d34-9458-42cf-96d3-64615349578d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:58.380584 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-684a1d34-9458-42cf-96d3-64615349578d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:58.381336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-684a1d34-9458-42cf-96d3-64615349578d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:58.515049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-684a1d34-9458-42cf-96d3-64615349578d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:58.522848 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-684a1d34-9458-42cf-96d3-64615349578d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.165862 Aug 29 16:33:58.523442 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3885/7993] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:58 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:59.548494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-813bf1d4-7908-4e6a-8ccc-8c78c3a52cd0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:59.549544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-813bf1d4-7908-4e6a-8ccc-8c78c3a52cd0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:59.553931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:59.555076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:59.563055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-813bf1d4-7908-4e6a-8ccc-8c78c3a52cd0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:59.563573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-813bf1d4-7908-4e6a-8ccc-8c78c3a52cd0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:59.564027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-813bf1d4-7908-4e6a-8ccc-8c78c3a52cd0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:59.564756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-813bf1d4-7908-4e6a-8ccc-8c78c3a52cd0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:59.565258 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-813bf1d4-7908-4e6a-8ccc-8c78c3a52cd0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:59.565701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-813bf1d4-7908-4e6a-8ccc-8c78c3a52cd0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:59.705748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-813bf1d4-7908-4e6a-8ccc-8c78c3a52cd0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:59.718095 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-813bf1d4-7908-4e6a-8ccc-8c78c3a52cd0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.176269 Aug 29 16:33:59.718680 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4109/7994] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:59 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:00.742381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e0004098-16e5-47c8-811b-21b5a48ca1c8 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:00.742988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e0004098-16e5-47c8-811b-21b5a48ca1c8 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:00.745593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:00.754020 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0004098-16e5-47c8-811b-21b5a48ca1c8 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:00.754647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0004098-16e5-47c8-811b-21b5a48ca1c8 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:00.755287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0004098-16e5-47c8-811b-21b5a48ca1c8 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:00.756353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0004098-16e5-47c8-811b-21b5a48ca1c8 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:00.757006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0004098-16e5-47c8-811b-21b5a48ca1c8 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:00.757682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0004098-16e5-47c8-811b-21b5a48ca1c8 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:00.906991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e0004098-16e5-47c8-811b-21b5a48ca1c8 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:00.918809 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e0004098-16e5-47c8-811b-21b5a48ca1c8 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.182449 Aug 29 16:34:00.919591 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3886/7995] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:00 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:01.836224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-80ceec2a-2fce-4340-a6c6-8ba63e0a0c8c req-2d418f2c-2b06-4b37-8031-171d3013d8fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39b8493b-303c-4c16-9ffd-e1b1082e0f10", "tag": "1d007f83-10d6-4fa5-8335-398818804781"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:01.847740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-80ceec2a-2fce-4340-a6c6-8ba63e0a0c8c req-2d418f2c-2b06-4b37-8031-171d3013d8fc service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:01.848305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-80ceec2a-2fce-4340-a6c6-8ba63e0a0c8c req-2d418f2c-2b06-4b37-8031-171d3013d8fc service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:01.848816 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-80ceec2a-2fce-4340-a6c6-8ba63e0a0c8c req-2d418f2c-2b06-4b37-8031-171d3013d8fc service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:01.863118 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-80ceec2a-2fce-4340-a6c6-8ba63e0a0c8c req-2d418f2c-2b06-4b37-8031-171d3013d8fc service nova] Creating event network-changed:1d007f83-10d6-4fa5-8335-398818804781 for instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 on n-h1-839401-11 Aug 29 16:34:01.868236 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-80ceec2a-2fce-4340-a6c6-8ba63e0a0c8c req-2d418f2c-2b06-4b37-8031-171d3013d8fc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035924 Aug 29 16:34:01.869040 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4110/7996] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:34:01.939730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cc7de601-3fd8-474b-85a6-ca68f0aa3b24 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:01.940394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cc7de601-3fd8-474b-85a6-ca68f0aa3b24 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:01.947797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc7de601-3fd8-474b-85a6-ca68f0aa3b24 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:01.948287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc7de601-3fd8-474b-85a6-ca68f0aa3b24 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:01.948720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc7de601-3fd8-474b-85a6-ca68f0aa3b24 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:01.949456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc7de601-3fd8-474b-85a6-ca68f0aa3b24 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:01.949912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc7de601-3fd8-474b-85a6-ca68f0aa3b24 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:01.950343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc7de601-3fd8-474b-85a6-ca68f0aa3b24 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:02.095254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cc7de601-3fd8-474b-85a6-ca68f0aa3b24 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:02.103860 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cc7de601-3fd8-474b-85a6-ca68f0aa3b24 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.168316 Aug 29 16:34:02.104548 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3887/7997] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:01 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:03.125613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b5d58c19-1afd-4fb0-a81d-fe83350e2697 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:03.126399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b5d58c19-1afd-4fb0-a81d-fe83350e2697 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:03.133058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5d58c19-1afd-4fb0-a81d-fe83350e2697 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:03.133613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5d58c19-1afd-4fb0-a81d-fe83350e2697 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:03.134053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5d58c19-1afd-4fb0-a81d-fe83350e2697 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:03.134766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5d58c19-1afd-4fb0-a81d-fe83350e2697 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:03.135242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5d58c19-1afd-4fb0-a81d-fe83350e2697 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:03.135689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5d58c19-1afd-4fb0-a81d-fe83350e2697 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:03.270658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b5d58c19-1afd-4fb0-a81d-fe83350e2697 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:03.278772 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b5d58c19-1afd-4fb0-a81d-fe83350e2697 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.158448 Aug 29 16:34:03.279459 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4111/7998] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:03 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:04.304426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5215d4a4-32d9-407c-9c9b-64fd6d06c7f3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:04.305500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5215d4a4-32d9-407c-9c9b-64fd6d06c7f3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:04.317128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5215d4a4-32d9-407c-9c9b-64fd6d06c7f3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:04.317968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5215d4a4-32d9-407c-9c9b-64fd6d06c7f3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:04.318705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5215d4a4-32d9-407c-9c9b-64fd6d06c7f3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:04.319853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5215d4a4-32d9-407c-9c9b-64fd6d06c7f3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:04.320619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5215d4a4-32d9-407c-9c9b-64fd6d06c7f3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:04.321400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5215d4a4-32d9-407c-9c9b-64fd6d06c7f3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:04.461593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5215d4a4-32d9-407c-9c9b-64fd6d06c7f3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:04.473798 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5215d4a4-32d9-407c-9c9b-64fd6d06c7f3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.175772 Aug 29 16:34:04.474578 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3888/7999] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:04 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:05.499975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c51938f4-1d78-4841-8985-c33d074e4a1b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:05.500623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c51938f4-1d78-4841-8985-c33d074e4a1b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:05.508050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c51938f4-1d78-4841-8985-c33d074e4a1b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:05.508552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c51938f4-1d78-4841-8985-c33d074e4a1b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:05.509005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c51938f4-1d78-4841-8985-c33d074e4a1b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:05.509749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c51938f4-1d78-4841-8985-c33d074e4a1b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:05.510221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c51938f4-1d78-4841-8985-c33d074e4a1b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:05.510661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c51938f4-1d78-4841-8985-c33d074e4a1b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:05.655182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c51938f4-1d78-4841-8985-c33d074e4a1b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:05.663118 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c51938f4-1d78-4841-8985-c33d074e4a1b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.168757 Aug 29 16:34:05.663673 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4112/8000] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:05 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:06.686378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c5481242-e015-45c5-9f15-d9eaec9ec0a9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:06.687028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c5481242-e015-45c5-9f15-d9eaec9ec0a9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:06.697529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5481242-e015-45c5-9f15-d9eaec9ec0a9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:06.698114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5481242-e015-45c5-9f15-d9eaec9ec0a9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:06.698669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5481242-e015-45c5-9f15-d9eaec9ec0a9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:06.699571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5481242-e015-45c5-9f15-d9eaec9ec0a9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:06.700143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5481242-e015-45c5-9f15-d9eaec9ec0a9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:06.700669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5481242-e015-45c5-9f15-d9eaec9ec0a9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:06.832973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c5481242-e015-45c5-9f15-d9eaec9ec0a9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:06.841324 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c5481242-e015-45c5-9f15-d9eaec9ec0a9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.160848 Aug 29 16:34:06.841916 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3889/8001] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:06 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:07.861920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e190d8d0-3911-4bf6-b509-66262b7d1e65 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:07.862558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e190d8d0-3911-4bf6-b509-66262b7d1e65 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:07.869906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e190d8d0-3911-4bf6-b509-66262b7d1e65 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:07.870419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e190d8d0-3911-4bf6-b509-66262b7d1e65 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:07.870878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e190d8d0-3911-4bf6-b509-66262b7d1e65 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:07.871600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e190d8d0-3911-4bf6-b509-66262b7d1e65 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:07.872076 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e190d8d0-3911-4bf6-b509-66262b7d1e65 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:07.872522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e190d8d0-3911-4bf6-b509-66262b7d1e65 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:08.003359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e190d8d0-3911-4bf6-b509-66262b7d1e65 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:08.011320 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e190d8d0-3911-4bf6-b509-66262b7d1e65 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.153456 Aug 29 16:34:08.011912 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4113/8002] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:07 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:08.582822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-47ebd5bd-c341-4d5a-ac8e-6d33deb0f937 req-58d25646-92e3-4de5-a3a8-810c27f985ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b8493b-303c-4c16-9ffd-e1b1082e0f10", "name": "network-vif-plugged", "status": "completed", "tag": "1d007f83-10d6-4fa5-8335-398818804781"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:08.595595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-47ebd5bd-c341-4d5a-ac8e-6d33deb0f937 req-58d25646-92e3-4de5-a3a8-810c27f985ae service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:08.596124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-47ebd5bd-c341-4d5a-ac8e-6d33deb0f937 req-58d25646-92e3-4de5-a3a8-810c27f985ae service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:08.597470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-47ebd5bd-c341-4d5a-ac8e-6d33deb0f937 req-58d25646-92e3-4de5-a3a8-810c27f985ae service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:08.609408 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-47ebd5bd-c341-4d5a-ac8e-6d33deb0f937 req-58d25646-92e3-4de5-a3a8-810c27f985ae service nova] Creating event network-vif-plugged:1d007f83-10d6-4fa5-8335-398818804781 for instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 on n-h1-839401-11 Aug 29 16:34:08.614670 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-47ebd5bd-c341-4d5a-ac8e-6d33deb0f937 req-58d25646-92e3-4de5-a3a8-810c27f985ae service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036852 Aug 29 16:34:08.615260 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3890/8003] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:34:09.034969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c745b3c8-f806-4db2-943a-877ce53401e7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:09.035700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c745b3c8-f806-4db2-943a-877ce53401e7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:09.045122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c745b3c8-f806-4db2-943a-877ce53401e7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:09.045679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c745b3c8-f806-4db2-943a-877ce53401e7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:09.046129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c745b3c8-f806-4db2-943a-877ce53401e7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:09.046836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c745b3c8-f806-4db2-943a-877ce53401e7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:09.047299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c745b3c8-f806-4db2-943a-877ce53401e7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:09.047732 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c745b3c8-f806-4db2-943a-877ce53401e7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:09.186264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c745b3c8-f806-4db2-943a-877ce53401e7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:09.194538 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c745b3c8-f806-4db2-943a-877ce53401e7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.165501 Aug 29 16:34:09.195147 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4114/8004] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:09 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:10.216897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-49e8c3f1-0fec-449e-a3e6-71131d04f164 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:10.217604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-49e8c3f1-0fec-449e-a3e6-71131d04f164 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:10.224578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49e8c3f1-0fec-449e-a3e6-71131d04f164 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:10.225065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49e8c3f1-0fec-449e-a3e6-71131d04f164 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:10.225535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49e8c3f1-0fec-449e-a3e6-71131d04f164 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:10.226243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49e8c3f1-0fec-449e-a3e6-71131d04f164 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:10.226710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49e8c3f1-0fec-449e-a3e6-71131d04f164 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:10.227144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49e8c3f1-0fec-449e-a3e6-71131d04f164 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:10.375040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-49e8c3f1-0fec-449e-a3e6-71131d04f164 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:10.382982 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-49e8c3f1-0fec-449e-a3e6-71131d04f164 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1359 microversion: 2.1 time: 0.170941 Aug 29 16:34:10.383811 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3891/8005] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:10 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:11.404856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ddad188d-23a6-452c-95d7-8059bb1957b9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:11.406132 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ddad188d-23a6-452c-95d7-8059bb1957b9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:11.416075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddad188d-23a6-452c-95d7-8059bb1957b9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:11.416965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddad188d-23a6-452c-95d7-8059bb1957b9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:11.417837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddad188d-23a6-452c-95d7-8059bb1957b9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:11.418664 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddad188d-23a6-452c-95d7-8059bb1957b9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:11.419139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddad188d-23a6-452c-95d7-8059bb1957b9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:11.419588 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ddad188d-23a6-452c-95d7-8059bb1957b9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:11.570198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ddad188d-23a6-452c-95d7-8059bb1957b9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:11.580514 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ddad188d-23a6-452c-95d7-8059bb1957b9 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1549 microversion: 2.1 time: 0.179873 Aug 29 16:34:11.581118 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4115/8006] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:11 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1549 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:11.605806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e65887be-1544-4e8c-89ef-c1a872f2dd5e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:11.606460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e65887be-1544-4e8c-89ef-c1a872f2dd5e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:11.613646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e65887be-1544-4e8c-89ef-c1a872f2dd5e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:11.614127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e65887be-1544-4e8c-89ef-c1a872f2dd5e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:11.614568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e65887be-1544-4e8c-89ef-c1a872f2dd5e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:11.615268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e65887be-1544-4e8c-89ef-c1a872f2dd5e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:11.615730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e65887be-1544-4e8c-89ef-c1a872f2dd5e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:11.616179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e65887be-1544-4e8c-89ef-c1a872f2dd5e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:11.763855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e65887be-1544-4e8c-89ef-c1a872f2dd5e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:11.772587 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e65887be-1544-4e8c-89ef-c1a872f2dd5e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1549 microversion: 2.1 time: 0.170697 Aug 29 16:34:11.773384 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3892/8007] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:11 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:11.793494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f1c10927-c3b0-47e1-a0ca-a47dc9e48d04 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:11.798362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f1c10927-c3b0-47e1-a0ca-a47dc9e48d04 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:11.799136 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f1c10927-c3b0-47e1-a0ca-a47dc9e48d04 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Searching by: {'deleted': False, 'project_id': 'eb3d683e910d466db2dda3302e3c309f'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 16:34:11.804634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1c10927-c3b0-47e1-a0ca-a47dc9e48d04 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:11.805161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1c10927-c3b0-47e1-a0ca-a47dc9e48d04 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:11.805626 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1c10927-c3b0-47e1-a0ca-a47dc9e48d04 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:11.806396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1c10927-c3b0-47e1-a0ca-a47dc9e48d04 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:11.806866 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1c10927-c3b0-47e1-a0ca-a47dc9e48d04 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:11.807304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f1c10927-c3b0-47e1-a0ca-a47dc9e48d04 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:11.831248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-f1c10927-c3b0-47e1-a0ca-a47dc9e48d04 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 16:34:11.862583 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f1c10927-c3b0-47e1-a0ca-a47dc9e48d04 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.073014 Aug 29 16:34:11.863178 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4116/8008] 10.222.0.62 () {58 vars in 1125 bytes} [Mon Aug 29 16:34:11 2022] GET /compute/v2.1/servers => generated 343 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:34:11.876247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-1c80d560-ab3d-41d9-a456-b75ec4ba471c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:11.876894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-1c80d560-ab3d-41d9-a456-b75ec4ba471c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:11.883022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c80d560-ab3d-41d9-a456-b75ec4ba471c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:11.883507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c80d560-ab3d-41d9-a456-b75ec4ba471c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:11.883975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c80d560-ab3d-41d9-a456-b75ec4ba471c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:11.884670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c80d560-ab3d-41d9-a456-b75ec4ba471c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:11.885151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c80d560-ab3d-41d9-a456-b75ec4ba471c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:11.885577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-1c80d560-ab3d-41d9-a456-b75ec4ba471c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:12.017770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-1c80d560-ab3d-41d9-a456-b75ec4ba471c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:12.025983 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-1c80d560-ab3d-41d9-a456-b75ec4ba471c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1549 microversion: 2.1 time: 0.154757 Aug 29 16:34:12.026561 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3893/8009] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:11 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:34:13.619287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0ef9d371-d800-4f8a-b026-328c67c6d80f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2d1dc89-8aa4-407a-8f60-9022d0860b33"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:13.621688 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0ef9d371-d800-4f8a-b026-328c67c6d80f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:13.628762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef9d371-d800-4f8a-b026-328c67c6d80f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:13.629314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef9d371-d800-4f8a-b026-328c67c6d80f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:13.629734 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef9d371-d800-4f8a-b026-328c67c6d80f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:13.630434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef9d371-d800-4f8a-b026-328c67c6d80f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:13.630895 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef9d371-d800-4f8a-b026-328c67c6d80f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:13.631370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0ef9d371-d800-4f8a-b026-328c67c6d80f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:13.925214 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0ef9d371-d800-4f8a-b026-328c67c6d80f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "POST /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309657 Aug 29 16:34:13.926133 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4117/8010] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 16:34:13 2022] POST /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:34:27.017935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fe6d4c4d-bd0e-4c20-a2f2-090b05d9cd0f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:27.018539 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fe6d4c4d-bd0e-4c20-a2f2-090b05d9cd0f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:27.022608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:27.023268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=68 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:27.028740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6d4c4d-bd0e-4c20-a2f2-090b05d9cd0f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:27.029254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6d4c4d-bd0e-4c20-a2f2-090b05d9cd0f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:27.029688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6d4c4d-bd0e-4c20-a2f2-090b05d9cd0f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:27.030376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6d4c4d-bd0e-4c20-a2f2-090b05d9cd0f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:27.030829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6d4c4d-bd0e-4c20-a2f2-090b05d9cd0f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:27.031243 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fe6d4c4d-bd0e-4c20-a2f2-090b05d9cd0f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:27.164973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fe6d4c4d-bd0e-4c20-a2f2-090b05d9cd0f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:27.173816 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fe6d4c4d-bd0e-4c20-a2f2-090b05d9cd0f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1595 microversion: 2.1 time: 0.162158 Aug 29 16:34:27.174420 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3894/8011] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:27 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1595 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:28.917257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:28.926951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:28.927904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:29.006720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-613c1712-6a9f-4d1e-a0fd-2b5c34c55219 req-b46c1946-f25c-4155-a505-36e3ecde899a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39b8493b-303c-4c16-9ffd-e1b1082e0f10", "tag": "1d007f83-10d6-4fa5-8335-398818804781"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:29.017387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-613c1712-6a9f-4d1e-a0fd-2b5c34c55219 req-b46c1946-f25c-4155-a505-36e3ecde899a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:29.017993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-613c1712-6a9f-4d1e-a0fd-2b5c34c55219 req-b46c1946-f25c-4155-a505-36e3ecde899a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:29.018580 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-613c1712-6a9f-4d1e-a0fd-2b5c34c55219 req-b46c1946-f25c-4155-a505-36e3ecde899a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:29.031238 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-613c1712-6a9f-4d1e-a0fd-2b5c34c55219 req-b46c1946-f25c-4155-a505-36e3ecde899a service nova] Creating event network-changed:1d007f83-10d6-4fa5-8335-398818804781 for instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 on n-h1-839401-11 Aug 29 16:34:29.037795 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-613c1712-6a9f-4d1e-a0fd-2b5c34c55219 req-b46c1946-f25c-4155-a505-36e3ecde899a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126323 Aug 29 16:34:29.038808 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4118/8012] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:34:29.920128 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5a100827-2e13-43f8-8e0d-b9bafc7164cd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-796778559"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:29.920678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5a100827-2e13-43f8-8e0d-b9bafc7164cd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:29.928306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a100827-2e13-43f8-8e0d-b9bafc7164cd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:29.929653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a100827-2e13-43f8-8e0d-b9bafc7164cd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:29.930114 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a100827-2e13-43f8-8e0d-b9bafc7164cd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:29.930827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a100827-2e13-43f8-8e0d-b9bafc7164cd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:29.931288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a100827-2e13-43f8-8e0d-b9bafc7164cd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:29.931715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5a100827-2e13-43f8-8e0d-b9bafc7164cd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:30.064679 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.network.security_group_api [None req-5a100827-2e13-43f8-8e0d-b9bafc7164cd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Adding security group e174651c-c152-40db-94b6-faaaeb767c8b to port 1d007f83-10d6-4fa5-8335-398818804781 Aug 29 16:34:30.402482 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5a100827-2e13-43f8-8e0d-b9bafc7164cd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "POST /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/action" status: 202 len: 0 microversion: 2.1 time: 0.486163 Aug 29 16:34:30.403129 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3895/8013] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:34:29 2022] POST /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:34:30.412253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-54339188-8628-418c-946a-d861ffbc9e7a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:30.414090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-54339188-8628-418c-946a-d861ffbc9e7a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:30.422884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54339188-8628-418c-946a-d861ffbc9e7a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:30.423386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54339188-8628-418c-946a-d861ffbc9e7a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:30.423836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54339188-8628-418c-946a-d861ffbc9e7a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:30.424553 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54339188-8628-418c-946a-d861ffbc9e7a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:30.425020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54339188-8628-418c-946a-d861ffbc9e7a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:30.425681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-54339188-8628-418c-946a-d861ffbc9e7a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:30.478897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-dd7adf58-2907-4c99-b24c-c0c2bd903797 req-e1d29368-c98a-4276-8e28-a065dff9592d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39b8493b-303c-4c16-9ffd-e1b1082e0f10", "tag": "1d007f83-10d6-4fa5-8335-398818804781"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:30.489604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-dd7adf58-2907-4c99-b24c-c0c2bd903797 req-e1d29368-c98a-4276-8e28-a065dff9592d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:30.490715 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-dd7adf58-2907-4c99-b24c-c0c2bd903797 req-e1d29368-c98a-4276-8e28-a065dff9592d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:30.491160 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-dd7adf58-2907-4c99-b24c-c0c2bd903797 req-e1d29368-c98a-4276-8e28-a065dff9592d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:30.503493 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-dd7adf58-2907-4c99-b24c-c0c2bd903797 req-e1d29368-c98a-4276-8e28-a065dff9592d service nova] Creating event network-changed:1d007f83-10d6-4fa5-8335-398818804781 for instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 on n-h1-839401-11 Aug 29 16:34:30.509532 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-dd7adf58-2907-4c99-b24c-c0c2bd903797 req-e1d29368-c98a-4276-8e28-a065dff9592d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101426 Aug 29 16:34:30.510719 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3896/8014] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:34:30.589780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-54339188-8628-418c-946a-d861ffbc9e7a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:30.598551 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-54339188-8628-418c-946a-d861ffbc9e7a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1760 microversion: 2.1 time: 0.190395 Aug 29 16:34:30.599460 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4119/8015] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:30 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1760 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:43.513637 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eda7f439-560f-4fda-a0c4-47b93d5f6cfd] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:36:43.514613 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [-] [564df600-0953-4421-a68a-24b5a0a40919] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:36:43.515460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:43.516295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:43.517110 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:36:43.517255 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 16:36:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/action (ip 10.222.0.62) !!! Aug 29 16:36:43.524103 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-560ea38b-6e58-42d8-92b2-c65f199a7197 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:43.527594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-560ea38b-6e58-42d8-92b2-c65f199a7197 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:43.540489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-560ea38b-6e58-42d8-92b2-c65f199a7197 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:43.541161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-560ea38b-6e58-42d8-92b2-c65f199a7197 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:43.541785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-560ea38b-6e58-42d8-92b2-c65f199a7197 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:43.542772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-560ea38b-6e58-42d8-92b2-c65f199a7197 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:43.543383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-560ea38b-6e58-42d8-92b2-c65f199a7197 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:43.543959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-560ea38b-6e58-42d8-92b2-c65f199a7197 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:43.628381 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-560ea38b-6e58-42d8-92b2-c65f199a7197 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "POST /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/action" status: 202 len: 0 microversion: 2.1 time: 0.117012 Aug 29 16:36:43.629059 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3897/8016] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:36:43 2022] POST /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:36:43.635690 n-d-839401-11 devstack@n-api.service[122360]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edb16f3c-d8bd-4396-8d00-d7897b8393bf] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:36:43.636651 n-d-839401-11 devstack@n-api.service[122360]: ERROR oslo.messaging._drivers.impl_rabbit [-] [603d2cc2-3ad6-4419-8622-2fba015025b5] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:36:43.637442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:43.638200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:43.639861 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:36:43.640004 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:36:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 (ip 10.222.0.62) !!! Aug 29 16:36:43.646581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-360a4399-1b60-4b0c-9c59-a882fbf4bb9a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:43.647218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-360a4399-1b60-4b0c-9c59-a882fbf4bb9a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:43.657363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-360a4399-1b60-4b0c-9c59-a882fbf4bb9a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:43.657872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-360a4399-1b60-4b0c-9c59-a882fbf4bb9a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:43.658325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-360a4399-1b60-4b0c-9c59-a882fbf4bb9a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:43.659051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-360a4399-1b60-4b0c-9c59-a882fbf4bb9a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:43.659526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-360a4399-1b60-4b0c-9c59-a882fbf4bb9a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:43.659968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-360a4399-1b60-4b0c-9c59-a882fbf4bb9a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:43.816524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-360a4399-1b60-4b0c-9c59-a882fbf4bb9a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:43.825072 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-360a4399-1b60-4b0c-9c59-a882fbf4bb9a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1762 microversion: 2.1 time: 0.191410 Aug 29 16:36:43.825683 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4120/8017] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:43 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1762 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:36:44.854610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4ab0011a-e55f-4972-88bb-5f481a3493d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:44.855815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4ab0011a-e55f-4972-88bb-5f481a3493d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:44.865873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ab0011a-e55f-4972-88bb-5f481a3493d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:44.866363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ab0011a-e55f-4972-88bb-5f481a3493d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:44.866801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ab0011a-e55f-4972-88bb-5f481a3493d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:44.868259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ab0011a-e55f-4972-88bb-5f481a3493d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:44.868702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ab0011a-e55f-4972-88bb-5f481a3493d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:44.869191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4ab0011a-e55f-4972-88bb-5f481a3493d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:44.876780 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] [eda7f439-560f-4fda-a0c4-47b93d5f6cfd] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 41264. Aug 29 16:36:44.877649 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] [564df600-0953-4421-a68a-24b5a0a40919] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 41266. Aug 29 16:36:45.021120 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4ab0011a-e55f-4972-88bb-5f481a3493d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:45.032095 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4ab0011a-e55f-4972-88bb-5f481a3493d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1767 microversion: 2.1 time: 0.184995 Aug 29 16:36:45.032667 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3898/8018] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:44 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1767 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:46.058002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-56c2db1b-5719-4149-a8f7-10042891f1b4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:46.059010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-56c2db1b-5719-4149-a8f7-10042891f1b4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:46.073548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c2db1b-5719-4149-a8f7-10042891f1b4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:46.074401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c2db1b-5719-4149-a8f7-10042891f1b4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:46.075149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c2db1b-5719-4149-a8f7-10042891f1b4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:46.076434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c2db1b-5719-4149-a8f7-10042891f1b4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:46.076935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c2db1b-5719-4149-a8f7-10042891f1b4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:46.077373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56c2db1b-5719-4149-a8f7-10042891f1b4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:46.083444 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] [603d2cc2-3ad6-4419-8622-2fba015025b5] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 41272. Aug 29 16:36:46.094859 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] [edb16f3c-d8bd-4396-8d00-d7897b8393bf] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 41270. Aug 29 16:36:46.241829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-56c2db1b-5719-4149-a8f7-10042891f1b4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:46.254458 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-56c2db1b-5719-4149-a8f7-10042891f1b4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1760 microversion: 2.1 time: 0.202890 Aug 29 16:36:46.255162 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4121/8019] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:46 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1760 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:26.181063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:26.181953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:26.183319 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:38:26.183517 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 16:38:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/action (ip 10.222.0.62) !!! Aug 29 16:38:26.190257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-74b597ed-e9e3-4da8-a539-30eb5408714c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-796778559"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:26.190954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-74b597ed-e9e3-4da8-a539-30eb5408714c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:26.202206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74b597ed-e9e3-4da8-a539-30eb5408714c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:26.202847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74b597ed-e9e3-4da8-a539-30eb5408714c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:26.203416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74b597ed-e9e3-4da8-a539-30eb5408714c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:26.204222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74b597ed-e9e3-4da8-a539-30eb5408714c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:26.204709 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74b597ed-e9e3-4da8-a539-30eb5408714c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:26.205112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74b597ed-e9e3-4da8-a539-30eb5408714c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:26.335699 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.network.security_group_api [None req-74b597ed-e9e3-4da8-a539-30eb5408714c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Removing security group e174651c-c152-40db-94b6-faaaeb767c8b from port 1d007f83-10d6-4fa5-8335-398818804781 Aug 29 16:38:26.977460 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-74b597ed-e9e3-4da8-a539-30eb5408714c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "POST /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/action" status: 202 len: 0 microversion: 2.1 time: 0.799278 Aug 29 16:38:26.978075 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3899/8020] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:38:26 2022] POST /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/action => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:38:26.985517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:26.986308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=12 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:26.987227 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:38:26.987387 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:38:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Aug 29 16:38:26.988433 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:38:26.988549 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:38:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Aug 29 16:38:26.993702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-2e5153b4-7c62-4e58-a6a0-4717299bfee4 req-dd685c7c-67ee-459e-9f89-456790444f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39b8493b-303c-4c16-9ffd-e1b1082e0f10", "tag": "1d007f83-10d6-4fa5-8335-398818804781"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:27.009210 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2e5153b4-7c62-4e58-a6a0-4717299bfee4 req-dd685c7c-67ee-459e-9f89-456790444f12 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:27.009718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2e5153b4-7c62-4e58-a6a0-4717299bfee4 req-dd685c7c-67ee-459e-9f89-456790444f12 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:27.010346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2e5153b4-7c62-4e58-a6a0-4717299bfee4 req-dd685c7c-67ee-459e-9f89-456790444f12 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:27.023226 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-2e5153b4-7c62-4e58-a6a0-4717299bfee4 req-dd685c7c-67ee-459e-9f89-456790444f12 service nova] Creating event network-changed:1d007f83-10d6-4fa5-8335-398818804781 for instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 on n-h1-839401-11 Aug 29 16:38:27.029718 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-2e5153b4-7c62-4e58-a6a0-4717299bfee4 req-dd685c7c-67ee-459e-9f89-456790444f12 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048044 Aug 29 16:38:27.030469 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4122/8021] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:38:28.234283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-1aaacb14-66c3-48f5-bb88-d92bed8b70ac req-32db8d25-48c6-4dbc-b1e7-2a161dec5a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39b8493b-303c-4c16-9ffd-e1b1082e0f10", "tag": "1d007f83-10d6-4fa5-8335-398818804781"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:28.243942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1aaacb14-66c3-48f5-bb88-d92bed8b70ac req-32db8d25-48c6-4dbc-b1e7-2a161dec5a6b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:28.244427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1aaacb14-66c3-48f5-bb88-d92bed8b70ac req-32db8d25-48c6-4dbc-b1e7-2a161dec5a6b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:28.244857 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-1aaacb14-66c3-48f5-bb88-d92bed8b70ac req-32db8d25-48c6-4dbc-b1e7-2a161dec5a6b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:28.257037 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-1aaacb14-66c3-48f5-bb88-d92bed8b70ac req-32db8d25-48c6-4dbc-b1e7-2a161dec5a6b service nova] Creating event network-changed:1d007f83-10d6-4fa5-8335-398818804781 for instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 on n-h1-839401-11 Aug 29 16:38:28.262372 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-1aaacb14-66c3-48f5-bb88-d92bed8b70ac req-32db8d25-48c6-4dbc-b1e7-2a161dec5a6b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033093 Aug 29 16:38:28.263193 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3900/8022] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:38:28.279663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-effe8a2e-a695-4e4c-8e0d-70d163e4b64b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:28.280281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-effe8a2e-a695-4e4c-8e0d-70d163e4b64b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:28.286685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-effe8a2e-a695-4e4c-8e0d-70d163e4b64b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:28.287189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-effe8a2e-a695-4e4c-8e0d-70d163e4b64b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:28.287649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-effe8a2e-a695-4e4c-8e0d-70d163e4b64b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:28.288363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-effe8a2e-a695-4e4c-8e0d-70d163e4b64b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:28.288840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-effe8a2e-a695-4e4c-8e0d-70d163e4b64b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:28.289328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-effe8a2e-a695-4e4c-8e0d-70d163e4b64b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:28.380252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-effe8a2e-a695-4e4c-8e0d-70d163e4b64b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lazy-loading 'services' on Instance uuid 39b8493b-303c-4c16-9ffd-e1b1082e0f10 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:38:28.466447 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-effe8a2e-a695-4e4c-8e0d-70d163e4b64b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "DELETE /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments/a2d1dc89-8aa4-407a-8f60-9022d0860b33" status: 202 len: 0 microversion: 2.1 time: 0.192027 Aug 29 16:38:28.467068 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4123/8023] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 16:38:28 2022] DELETE /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments/a2d1dc89-8aa4-407a-8f60-9022d0860b33 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:38:28.481023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bd55c179-5c06-476f-89b8-9f06a23592dd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:28.487174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bd55c179-5c06-476f-89b8-9f06a23592dd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:28.496347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd55c179-5c06-476f-89b8-9f06a23592dd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:28.498965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd55c179-5c06-476f-89b8-9f06a23592dd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:28.500092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd55c179-5c06-476f-89b8-9f06a23592dd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:28.500962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd55c179-5c06-476f-89b8-9f06a23592dd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:28.501612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd55c179-5c06-476f-89b8-9f06a23592dd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:28.502247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bd55c179-5c06-476f-89b8-9f06a23592dd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:28.539264 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bd55c179-5c06-476f-89b8-9f06a23592dd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067343 Aug 29 16:38:28.539851 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3901/8024] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:38:28 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:38:29.553030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cc503966-d19f-418f-9575-96db5867922d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:29.555641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cc503966-d19f-418f-9575-96db5867922d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:29.563451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc503966-d19f-418f-9575-96db5867922d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:29.563962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc503966-d19f-418f-9575-96db5867922d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:29.564405 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc503966-d19f-418f-9575-96db5867922d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:29.565114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc503966-d19f-418f-9575-96db5867922d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:29.565613 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc503966-d19f-418f-9575-96db5867922d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:29.566056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cc503966-d19f-418f-9575-96db5867922d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:29.597989 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cc503966-d19f-418f-9575-96db5867922d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049395 Aug 29 16:38:29.598908 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4124/8025] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:38:29 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:38:30.611016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4080bf06-51b6-40ee-9826-fdf0b1f65177 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:30.613228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4080bf06-51b6-40ee-9826-fdf0b1f65177 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:30.620571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4080bf06-51b6-40ee-9826-fdf0b1f65177 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:30.621127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4080bf06-51b6-40ee-9826-fdf0b1f65177 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:30.621581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4080bf06-51b6-40ee-9826-fdf0b1f65177 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:30.622288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4080bf06-51b6-40ee-9826-fdf0b1f65177 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:30.622750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4080bf06-51b6-40ee-9826-fdf0b1f65177 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:30.623175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4080bf06-51b6-40ee-9826-fdf0b1f65177 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:30.672860 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4080bf06-51b6-40ee-9826-fdf0b1f65177 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065903 Aug 29 16:38:30.673526 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3902/8026] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:38:30 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:38:31.685735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4cca7fb7-354f-434e-9103-dcbb9587ff3c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:31.687943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4cca7fb7-354f-434e-9103-dcbb9587ff3c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:31.695367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cca7fb7-354f-434e-9103-dcbb9587ff3c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:31.695878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cca7fb7-354f-434e-9103-dcbb9587ff3c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:31.696334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cca7fb7-354f-434e-9103-dcbb9587ff3c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:31.697051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cca7fb7-354f-434e-9103-dcbb9587ff3c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:31.697597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cca7fb7-354f-434e-9103-dcbb9587ff3c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:31.698046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4cca7fb7-354f-434e-9103-dcbb9587ff3c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:31.729032 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4cca7fb7-354f-434e-9103-dcbb9587ff3c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047426 Aug 29 16:38:31.729652 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4125/8027] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:38:31 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:38:32.741801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-48b9d03a-764e-4350-a7e5-8aefb3b5d830 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:32.743989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-48b9d03a-764e-4350-a7e5-8aefb3b5d830 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:32.751490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48b9d03a-764e-4350-a7e5-8aefb3b5d830 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:32.751985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48b9d03a-764e-4350-a7e5-8aefb3b5d830 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:32.752427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48b9d03a-764e-4350-a7e5-8aefb3b5d830 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:32.753137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48b9d03a-764e-4350-a7e5-8aefb3b5d830 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:32.753627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48b9d03a-764e-4350-a7e5-8aefb3b5d830 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:32.754060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48b9d03a-764e-4350-a7e5-8aefb3b5d830 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:33.080461 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-48b9d03a-764e-4350-a7e5-8aefb3b5d830 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.342934 Aug 29 16:38:33.081354 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3903/8028] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:38:32 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments => generated 197 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:38:34.096949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-87f7ca78-a69f-4aeb-ba70-b51f6fcaebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:34.099683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-87f7ca78-a69f-4aeb-ba70-b51f6fcaebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:34.108534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87f7ca78-a69f-4aeb-ba70-b51f6fcaebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:34.109157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87f7ca78-a69f-4aeb-ba70-b51f6fcaebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:34.109750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87f7ca78-a69f-4aeb-ba70-b51f6fcaebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:34.110618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87f7ca78-a69f-4aeb-ba70-b51f6fcaebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:34.111203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87f7ca78-a69f-4aeb-ba70-b51f6fcaebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:34.111747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87f7ca78-a69f-4aeb-ba70-b51f6fcaebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:34.143502 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-87f7ca78-a69f-4aeb-ba70-b51f6fcaebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052810 Aug 29 16:38:34.144139 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4126/8029] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:38:34 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:38:34.158950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ebda723d-4895-43d6-9351-c2c1012d3dc5 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:34.159498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ebda723d-4895-43d6-9351-c2c1012d3dc5 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:34.166387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebda723d-4895-43d6-9351-c2c1012d3dc5 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:34.166881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebda723d-4895-43d6-9351-c2c1012d3dc5 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:34.167316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebda723d-4895-43d6-9351-c2c1012d3dc5 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:34.168015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebda723d-4895-43d6-9351-c2c1012d3dc5 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:34.168477 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebda723d-4895-43d6-9351-c2c1012d3dc5 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:34.168905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ebda723d-4895-43d6-9351-c2c1012d3dc5 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:34.245033 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-ebda723d-4895-43d6-9351-c2c1012d3dc5 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] HTTP exception thrown: Instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 is not attached to volume a2d1dc89-8aa4-407a-8f60-9022d0860b33 Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ebda723d-4895-43d6-9351-c2c1012d3dc5 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Request method failure captured: Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: request: DELETE /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments/a2d1dc89-8aa4-407a-8f60-9022d0860b33 HTTP/1.1 Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOpdYGQh9S5XvFAVFwN_E6Nc5hcV31VRpWbHZAYHwIFWPGT1fo4URLocVfBB9_kAWLyWxrPJ9KIm0pDgol5bHL79E8ZaCVt-P9bKsfIx67s5t7Ua7MvYpep1nrAlhJghLYJmCW2nPUKMteoU8RrEagJhDxfaHZp2wyUBtbMfQMXmI-o Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: eb3d683e910d466db2dda3302e3c309f Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestMinimumBasicScenario-1402166622 Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eb3d683e910d466db2dda3302e3c309f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eb3d683e910d466db2dda3302e3c309f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eb3d683e910d466db2dda3302e3c309f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eb3d683e910d466db2dda3302e3c309f"}]}] Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestMinimumBasicScenario-1402166622 Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: eb3d683e910d466db2dda3302e3c309f Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1402166622 Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestMinimumBasicScenario-1402166622-project Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 4ab82f9740ec4d119cfb03b1a1883b91 Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestMinimumBasicScenario-1402166622-project Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 is not attached to volume a2d1dc89-8aa4-407a-8f60-9022d0860b33 Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'server_id': '39b8493b-303c-4c16-9ffd-e1b1082e0f10', 'id': 'a2d1dc89-8aa4-407a-8f60-9022d0860b33'} Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a2d1dc89-8aa4-407a-8f60-9022d0860b33. Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 is not attached to volume a2d1dc89-8aa4-407a-8f60-9022d0860b33 Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:38:34.246751 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:38:34.251779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:38:34.251779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:38:34.251779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 is not attached to volume a2d1dc89-8aa4-407a-8f60-9022d0860b33 Aug 29 16:38:34.251779 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:38:34.251779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ebda723d-4895-43d6-9351-c2c1012d3dc5 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Returning 404 to user: Instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 is not attached to volume a2d1dc89-8aa4-407a-8f60-9022d0860b33 {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:38:34.251779 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ebda723d-4895-43d6-9351-c2c1012d3dc5 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "DELETE /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments/a2d1dc89-8aa4-407a-8f60-9022d0860b33" status: 404 len: 154 microversion: 2.1 time: 0.095382 Aug 29 16:38:34.252394 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3904/8030] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 16:38:34 2022] DELETE /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10/os-volume_attachments/a2d1dc89-8aa4-407a-8f60-9022d0860b33 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:38:37.509864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6cfeb624-f8f8-4162-a6bc-b437544825be tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:37.510413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6cfeb624-f8f8-4162-a6bc-b437544825be tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:37.518837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cfeb624-f8f8-4162-a6bc-b437544825be tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:37.519359 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cfeb624-f8f8-4162-a6bc-b437544825be tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:37.519808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cfeb624-f8f8-4162-a6bc-b437544825be tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:37.520515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cfeb624-f8f8-4162-a6bc-b437544825be tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:37.520983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cfeb624-f8f8-4162-a6bc-b437544825be tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:37.521460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cfeb624-f8f8-4162-a6bc-b437544825be tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:37.547084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6cfeb624-f8f8-4162-a6bc-b437544825be tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:38:37.634253 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6cfeb624-f8f8-4162-a6bc-b437544825be tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "DELETE /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 204 len: 0 microversion: 2.1 time: 0.130370 Aug 29 16:38:37.634810 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4127/8031] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:38:37 2022] DELETE /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:38:37.645251 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e789d32b-5bf0-4efd-b759-db70061087ed tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:37.646288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e789d32b-5bf0-4efd-b759-db70061087ed tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:37.654508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e789d32b-5bf0-4efd-b759-db70061087ed tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:37.655009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e789d32b-5bf0-4efd-b759-db70061087ed tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:37.655452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e789d32b-5bf0-4efd-b759-db70061087ed tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:37.656164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e789d32b-5bf0-4efd-b759-db70061087ed tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:37.656629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e789d32b-5bf0-4efd-b759-db70061087ed tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:37.657059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e789d32b-5bf0-4efd-b759-db70061087ed tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:37.790433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e789d32b-5bf0-4efd-b759-db70061087ed tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:37.799664 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e789d32b-5bf0-4efd-b759-db70061087ed tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1555 microversion: 2.1 time: 0.160039 Aug 29 16:38:37.800245 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3905/8032] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:37 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:38.879092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-60e0e973-7813-444f-b811-daa7e2d6d423 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:38.879820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-60e0e973-7813-444f-b811-daa7e2d6d423 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:38.886811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60e0e973-7813-444f-b811-daa7e2d6d423 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:38.887313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60e0e973-7813-444f-b811-daa7e2d6d423 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:38.887765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60e0e973-7813-444f-b811-daa7e2d6d423 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:38.888475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60e0e973-7813-444f-b811-daa7e2d6d423 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:38.888950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60e0e973-7813-444f-b811-daa7e2d6d423 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:38.889421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60e0e973-7813-444f-b811-daa7e2d6d423 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:39.031107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-60e0e973-7813-444f-b811-daa7e2d6d423 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:39.039383 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-60e0e973-7813-444f-b811-daa7e2d6d423 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1555 microversion: 2.1 time: 0.222520 Aug 29 16:38:39.039977 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4128/8033] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:38 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1555 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:40.060248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-496c3a4e-92df-4524-bf4e-fd8b3f02d152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:40.060826 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-496c3a4e-92df-4524-bf4e-fd8b3f02d152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:40.068277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-496c3a4e-92df-4524-bf4e-fd8b3f02d152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:40.068729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-496c3a4e-92df-4524-bf4e-fd8b3f02d152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:40.069231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-496c3a4e-92df-4524-bf4e-fd8b3f02d152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:40.069957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-496c3a4e-92df-4524-bf4e-fd8b3f02d152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:40.070412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-496c3a4e-92df-4524-bf4e-fd8b3f02d152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:40.070840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-496c3a4e-92df-4524-bf4e-fd8b3f02d152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:40.307018 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-d1ac1351-4dce-4c4c-a4be-df5c03caf40b req-0fb71409-de4b-49a8-9c25-d460344de92d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b8493b-303c-4c16-9ffd-e1b1082e0f10", "name": "network-vif-deleted", "tag": "1d007f83-10d6-4fa5-8335-398818804781"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:40.308053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-496c3a4e-92df-4524-bf4e-fd8b3f02d152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:40.317176 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-496c3a4e-92df-4524-bf4e-fd8b3f02d152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 200 len: 1555 microversion: 2.1 time: 0.260781 Aug 29 16:38:40.317683 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3906/8034] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:40 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 1555 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:40.320475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d1ac1351-4dce-4c4c-a4be-df5c03caf40b req-0fb71409-de4b-49a8-9c25-d460344de92d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:40.320997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d1ac1351-4dce-4c4c-a4be-df5c03caf40b req-0fb71409-de4b-49a8-9c25-d460344de92d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:40.321468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-d1ac1351-4dce-4c4c-a4be-df5c03caf40b req-0fb71409-de4b-49a8-9c25-d460344de92d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:40.336235 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-d1ac1351-4dce-4c4c-a4be-df5c03caf40b req-0fb71409-de4b-49a8-9c25-d460344de92d service nova] Creating event network-vif-deleted:1d007f83-10d6-4fa5-8335-398818804781 for instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 on n-h1-839401-11 Aug 29 16:38:40.342930 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-d1ac1351-4dce-4c4c-a4be-df5c03caf40b req-0fb71409-de4b-49a8-9c25-d460344de92d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039817 Aug 29 16:38:40.344073 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4129/8035] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:38:41.342958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-11afef95-fef9-469f-a7e2-8b948fdfc90f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:41.344054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-11afef95-fef9-469f-a7e2-8b948fdfc90f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: 39b8493b-303c-4c16-9ffd-e1b1082e0f10] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:41.352419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11afef95-fef9-469f-a7e2-8b948fdfc90f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:41.352922 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11afef95-fef9-469f-a7e2-8b948fdfc90f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:41.353395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11afef95-fef9-469f-a7e2-8b948fdfc90f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:41.354115 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11afef95-fef9-469f-a7e2-8b948fdfc90f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:41.354577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11afef95-fef9-469f-a7e2-8b948fdfc90f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:41.355014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11afef95-fef9-469f-a7e2-8b948fdfc90f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:41.368770 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-11afef95-fef9-469f-a7e2-8b948fdfc90f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] HTTP exception thrown: Instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 could not be found. Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-11afef95-fef9-469f-a7e2-8b948fdfc90f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Request method failure captured: Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 HTTP/1.1 Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOpdYGQh9S5XvFAVFwN_E6Nc5hcV31VRpWbHZAYHwIFWPGT1fo4URLocVfBB9_kAWLyWxrPJ9KIm0pDgol5bHL79E8ZaCVt-P9bKsfIx67s5t7Ua7MvYpep1nrAlhJghLYJmCW2nPUKMteoU8RrEagJhDxfaHZp2wyUBtbMfQMXmI-o Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: eb3d683e910d466db2dda3302e3c309f Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestMinimumBasicScenario-1402166622 Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eb3d683e910d466db2dda3302e3c309f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eb3d683e910d466db2dda3302e3c309f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eb3d683e910d466db2dda3302e3c309f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eb3d683e910d466db2dda3302e3c309f"}]}] Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestMinimumBasicScenario-1402166622 Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: eb3d683e910d466db2dda3302e3c309f Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1402166622 Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestMinimumBasicScenario-1402166622-project Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 4ab82f9740ec4d119cfb03b1a1883b91 Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestMinimumBasicScenario-1402166622-project Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 could not be found. Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '39b8493b-303c-4c16-9ffd-e1b1082e0f10'} Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 could not be found. Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 could not be found. Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:38:41.370379 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:38:41.375221 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:38:41.375221 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:38:41.375221 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:38:41.375221 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:38:41.375221 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:38:41.375221 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 could not be found. Aug 29 16:38:41.375221 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:38:41.375221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-11afef95-fef9-469f-a7e2-8b948fdfc90f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Returning 404 to user: Instance 39b8493b-303c-4c16-9ffd-e1b1082e0f10 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:38:41.375221 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-11afef95-fef9-469f-a7e2-8b948fdfc90f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10" status: 404 len: 111 microversion: 2.1 time: 0.035909 Aug 29 16:38:41.375221 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3907/8036] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:41 2022] GET /compute/v2.1/servers/39b8493b-303c-4c16-9ffd-e1b1082e0f10 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:38:41.381653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-de099d3c-0e2d-4ab5-8d33-398b4ee075f2 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '.version_select at 0x7fc42aab8f70>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:41.408874 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-de099d3c-0e2d-4ab5-8d33-398b4ee075f2 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1515669195" status: 202 len: 0 microversion: 2.1 time: 0.031551 Aug 29 16:38:41.409578 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4130/8037] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 16:38:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1515669195 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:38:50.198534 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7eb3a833-e438-49f9-9ffc-4accf8fb915f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Action: 'create', calling method: .version_select at 0x7fc42a8a9040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1056077013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgOV9DeTuIHxm8Cb0+Ast7X/ID/XN+nrfpAMBfOrYf6gPpy9jgYhZtfeEha5pY4MyYDRsAuq9On+z6G7ovOQYXvfGPJKprbPmnA2hk35cZLWCPYDEf3Fw74sxBqpc5ung=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:50.216259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-7eb3a833-e438-49f9-9ffc-4accf8fb915f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Getting quotas for project eb3d683e910d466db2dda3302e3c309f. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:38:50.222615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-7eb3a833-e438-49f9-9ffc-4accf8fb915f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Getting quotas for user 4ab82f9740ec4d119cfb03b1a1883b91 and project eb3d683e910d466db2dda3302e3c309f. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:38:50.252555 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7eb3a833-e438-49f9-9ffc-4accf8fb915f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058158 Aug 29 16:38:50.253163 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3908/8038] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:38:50 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:38:50.305968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-181098309", "imageRef": "ec402afd-1fb2-4e89-a994-7b0e2dc357f9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1056077013", "networks": [{"uuid": "09716daf-4662-4c3c-aacf-e059ab71f49e"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:50.328037 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:50.453928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] validate_networks() for [('09716daf-4662-4c3c-aacf-e059ab71f49e', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:38:50.899366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:38:50.899982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:38:50.900638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:38:50.901185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:38:50.901721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:38:50.914209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:50.914699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:50.915142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:50.915901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:50.916365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:50.916795 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:50.939889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Getting quotas for project eb3d683e910d466db2dda3302e3c309f. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:38:50.946465 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Getting quotas for user 4ab82f9740ec4d119cfb03b1a1883b91 and project eb3d683e910d466db2dda3302e3c309f. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:38:50.959638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:38:50.962423 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ec402afd-1fb2-4e89-a994-7b0e2dc357f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:38:51.013514 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5cd90563-1b2c-4751-bace-4b0dca2e6667 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711298 Aug 29 16:38:51.014196 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4131/8039] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:38:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:38:51.025861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-069c0756-2f4a-46ce-9d51-f95ab0c8d93e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:51.026571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-069c0756-2f4a-46ce-9d51-f95ab0c8d93e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:51.134323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-069c0756-2f4a-46ce-9d51-f95ab0c8d93e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:51.142254 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-069c0756-2f4a-46ce-9d51-f95ab0c8d93e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1258 microversion: 2.1 time: 0.120587 Aug 29 16:38:51.142844 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3909/8040] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:51 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1258 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:52.165182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-30b32976-5d6a-4d85-80cb-5af965302c44 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:52.165802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-30b32976-5d6a-4d85-80cb-5af965302c44 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:52.172803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30b32976-5d6a-4d85-80cb-5af965302c44 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:52.173360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30b32976-5d6a-4d85-80cb-5af965302c44 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:52.173790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30b32976-5d6a-4d85-80cb-5af965302c44 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:52.174542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30b32976-5d6a-4d85-80cb-5af965302c44 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:52.175020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30b32976-5d6a-4d85-80cb-5af965302c44 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:52.175464 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-30b32976-5d6a-4d85-80cb-5af965302c44 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:52.239511 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-30b32976-5d6a-4d85-80cb-5af965302c44 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:52.248925 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-30b32976-5d6a-4d85-80cb-5af965302c44 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1310 microversion: 2.1 time: 0.088623 Aug 29 16:38:52.249751 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4132/8041] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:52 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:53.271211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5097956f-5fbc-4c1b-ac1f-cd4fbed2a7b7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:53.271806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5097956f-5fbc-4c1b-ac1f-cd4fbed2a7b7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:53.286233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=44 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:53.287987 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5097956f-5fbc-4c1b-ac1f-cd4fbed2a7b7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:53.288525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5097956f-5fbc-4c1b-ac1f-cd4fbed2a7b7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:53.289045 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5097956f-5fbc-4c1b-ac1f-cd4fbed2a7b7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:53.289969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5097956f-5fbc-4c1b-ac1f-cd4fbed2a7b7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:53.290500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5097956f-5fbc-4c1b-ac1f-cd4fbed2a7b7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:53.290996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5097956f-5fbc-4c1b-ac1f-cd4fbed2a7b7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:53.456660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5097956f-5fbc-4c1b-ac1f-cd4fbed2a7b7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:53.465982 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5097956f-5fbc-4c1b-ac1f-cd4fbed2a7b7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.198668 Aug 29 16:38:53.467757 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3910/8042] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:53 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:54.487958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d4890e37-04eb-4fa1-aa17-e44113603aa7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:54.488654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d4890e37-04eb-4fa1-aa17-e44113603aa7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:54.496668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4890e37-04eb-4fa1-aa17-e44113603aa7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:54.497228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4890e37-04eb-4fa1-aa17-e44113603aa7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:54.497885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4890e37-04eb-4fa1-aa17-e44113603aa7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:54.499095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4890e37-04eb-4fa1-aa17-e44113603aa7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:54.503411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4890e37-04eb-4fa1-aa17-e44113603aa7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:54.503902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4890e37-04eb-4fa1-aa17-e44113603aa7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:54.644404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d4890e37-04eb-4fa1-aa17-e44113603aa7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:54.653880 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d4890e37-04eb-4fa1-aa17-e44113603aa7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.169582 Aug 29 16:38:54.655002 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4133/8043] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:54 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:55.676259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-200ec6a4-a1eb-4029-a91c-8b1197f09627 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:55.676938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-200ec6a4-a1eb-4029-a91c-8b1197f09627 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:55.684415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-200ec6a4-a1eb-4029-a91c-8b1197f09627 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:55.685202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-200ec6a4-a1eb-4029-a91c-8b1197f09627 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:55.685691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-200ec6a4-a1eb-4029-a91c-8b1197f09627 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:55.686410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-200ec6a4-a1eb-4029-a91c-8b1197f09627 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:55.686960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-200ec6a4-a1eb-4029-a91c-8b1197f09627 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:55.687410 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-200ec6a4-a1eb-4029-a91c-8b1197f09627 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:55.832876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-200ec6a4-a1eb-4029-a91c-8b1197f09627 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:55.841710 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-200ec6a4-a1eb-4029-a91c-8b1197f09627 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.170187 Aug 29 16:38:55.856703 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3911/8044] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:55 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:56.864173 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5457786f-4318-4660-a7f8-07a8130b70d3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:56.864836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5457786f-4318-4660-a7f8-07a8130b70d3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:56.872562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5457786f-4318-4660-a7f8-07a8130b70d3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:56.875803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5457786f-4318-4660-a7f8-07a8130b70d3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:56.876308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5457786f-4318-4660-a7f8-07a8130b70d3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:56.877065 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5457786f-4318-4660-a7f8-07a8130b70d3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:56.880198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5457786f-4318-4660-a7f8-07a8130b70d3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:56.880674 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5457786f-4318-4660-a7f8-07a8130b70d3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:57.045472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5457786f-4318-4660-a7f8-07a8130b70d3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:57.053659 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5457786f-4318-4660-a7f8-07a8130b70d3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.193956 Aug 29 16:38:57.054318 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4134/8045] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:56 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:58.074700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c1a26e70-c7f6-42f1-9e80-2565c1a86498 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:58.075340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c1a26e70-c7f6-42f1-9e80-2565c1a86498 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:58.078416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:58.085205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a26e70-c7f6-42f1-9e80-2565c1a86498 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:58.086685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a26e70-c7f6-42f1-9e80-2565c1a86498 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:58.087478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a26e70-c7f6-42f1-9e80-2565c1a86498 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:58.088585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a26e70-c7f6-42f1-9e80-2565c1a86498 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:58.089409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a26e70-c7f6-42f1-9e80-2565c1a86498 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:58.089969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1a26e70-c7f6-42f1-9e80-2565c1a86498 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:58.261123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c1a26e70-c7f6-42f1-9e80-2565c1a86498 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:58.270127 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c1a26e70-c7f6-42f1-9e80-2565c1a86498 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.199523 Aug 29 16:38:58.270646 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3912/8046] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:58 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:59.291562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0eefd37b-4144-4b76-9c44-6362bdc52aaf tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:59.292343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0eefd37b-4144-4b76-9c44-6362bdc52aaf tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:59.295411 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:59.301587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0eefd37b-4144-4b76-9c44-6362bdc52aaf tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:59.302187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0eefd37b-4144-4b76-9c44-6362bdc52aaf tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:59.302741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0eefd37b-4144-4b76-9c44-6362bdc52aaf tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:59.303537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0eefd37b-4144-4b76-9c44-6362bdc52aaf tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:59.304371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0eefd37b-4144-4b76-9c44-6362bdc52aaf tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:59.304937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0eefd37b-4144-4b76-9c44-6362bdc52aaf tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:59.453978 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0eefd37b-4144-4b76-9c44-6362bdc52aaf tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:59.462552 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0eefd37b-4144-4b76-9c44-6362bdc52aaf tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.175410 Aug 29 16:38:59.463356 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4135/8047] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:59 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:00.483588 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c94a4c5b-0b51-4ab4-b842-eca2742c5cfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:00.484209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c94a4c5b-0b51-4ab4-b842-eca2742c5cfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:00.491788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c94a4c5b-0b51-4ab4-b842-eca2742c5cfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:00.492283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c94a4c5b-0b51-4ab4-b842-eca2742c5cfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:00.492722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c94a4c5b-0b51-4ab4-b842-eca2742c5cfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:00.493468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c94a4c5b-0b51-4ab4-b842-eca2742c5cfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:00.493931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c94a4c5b-0b51-4ab4-b842-eca2742c5cfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:00.494361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c94a4c5b-0b51-4ab4-b842-eca2742c5cfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:00.632247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c94a4c5b-0b51-4ab4-b842-eca2742c5cfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:00.640822 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c94a4c5b-0b51-4ab4-b842-eca2742c5cfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.161273 Aug 29 16:39:00.641419 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3913/8048] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:00 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:01.666474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d339be0e-fce6-44fc-989b-c32d93424a39 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:01.667518 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d339be0e-fce6-44fc-989b-c32d93424a39 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:01.671974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:01.673143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:01.681934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d339be0e-fce6-44fc-989b-c32d93424a39 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:01.682440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d339be0e-fce6-44fc-989b-c32d93424a39 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:01.682927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d339be0e-fce6-44fc-989b-c32d93424a39 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:01.683677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d339be0e-fce6-44fc-989b-c32d93424a39 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:01.684150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d339be0e-fce6-44fc-989b-c32d93424a39 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:01.684593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d339be0e-fce6-44fc-989b-c32d93424a39 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:01.822713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d339be0e-fce6-44fc-989b-c32d93424a39 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:01.830963 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d339be0e-fce6-44fc-989b-c32d93424a39 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.171321 Aug 29 16:39:01.831753 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4136/8049] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:01 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:02.854664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-28ba5766-a8e7-4c27-a79b-85a94d282a75 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:02.855264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-28ba5766-a8e7-4c27-a79b-85a94d282a75 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:02.857185 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:02.863598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28ba5766-a8e7-4c27-a79b-85a94d282a75 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:02.864100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28ba5766-a8e7-4c27-a79b-85a94d282a75 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:02.864578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28ba5766-a8e7-4c27-a79b-85a94d282a75 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:02.865313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28ba5766-a8e7-4c27-a79b-85a94d282a75 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:02.865778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28ba5766-a8e7-4c27-a79b-85a94d282a75 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:02.866216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-28ba5766-a8e7-4c27-a79b-85a94d282a75 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:03.005298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-28ba5766-a8e7-4c27-a79b-85a94d282a75 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:03.013627 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-28ba5766-a8e7-4c27-a79b-85a94d282a75 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.164130 Aug 29 16:39:03.014205 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3914/8050] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:02 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:04.034918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-448b6ef8-8bfa-453f-92c4-ceb413c41244 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:04.035485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-448b6ef8-8bfa-453f-92c4-ceb413c41244 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:04.042960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-448b6ef8-8bfa-453f-92c4-ceb413c41244 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:04.043484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-448b6ef8-8bfa-453f-92c4-ceb413c41244 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:04.044004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-448b6ef8-8bfa-453f-92c4-ceb413c41244 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:04.044753 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-448b6ef8-8bfa-453f-92c4-ceb413c41244 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:04.045310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-448b6ef8-8bfa-453f-92c4-ceb413c41244 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:04.045748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-448b6ef8-8bfa-453f-92c4-ceb413c41244 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:04.182361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-448b6ef8-8bfa-453f-92c4-ceb413c41244 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:04.190419 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-448b6ef8-8bfa-453f-92c4-ceb413c41244 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.159783 Aug 29 16:39:04.191028 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4137/8051] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:04 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:04.561498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-afdc1ff9-e959-4159-95f8-df1e71f0611b req-e56bf73b-d595-406c-a10d-9dbb27fbe05c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b627fa08-5f94-4537-ba0c-4007aa88f9b4", "tag": "1a1b7a46-ef9b-422f-bf42-d86e16bf1be4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:04.572268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-afdc1ff9-e959-4159-95f8-df1e71f0611b req-e56bf73b-d595-406c-a10d-9dbb27fbe05c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:04.572946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-afdc1ff9-e959-4159-95f8-df1e71f0611b req-e56bf73b-d595-406c-a10d-9dbb27fbe05c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:04.573513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-afdc1ff9-e959-4159-95f8-df1e71f0611b req-e56bf73b-d595-406c-a10d-9dbb27fbe05c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:04.585853 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-afdc1ff9-e959-4159-95f8-df1e71f0611b req-e56bf73b-d595-406c-a10d-9dbb27fbe05c service nova] Creating event network-changed:1a1b7a46-ef9b-422f-bf42-d86e16bf1be4 for instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 on n-h2-839401-11 Aug 29 16:39:04.593097 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-afdc1ff9-e959-4159-95f8-df1e71f0611b req-e56bf73b-d595-406c-a10d-9dbb27fbe05c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035238 Aug 29 16:39:04.593973 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3915/8052] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:39:05.211414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fe44a812-6f4c-4ac3-b09a-7546d0326874 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:05.212020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fe44a812-6f4c-4ac3-b09a-7546d0326874 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:05.219355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe44a812-6f4c-4ac3-b09a-7546d0326874 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:05.219851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe44a812-6f4c-4ac3-b09a-7546d0326874 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:05.220297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe44a812-6f4c-4ac3-b09a-7546d0326874 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:05.221007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe44a812-6f4c-4ac3-b09a-7546d0326874 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:05.221512 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe44a812-6f4c-4ac3-b09a-7546d0326874 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:05.221952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe44a812-6f4c-4ac3-b09a-7546d0326874 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:05.357858 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fe44a812-6f4c-4ac3-b09a-7546d0326874 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:05.365833 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fe44a812-6f4c-4ac3-b09a-7546d0326874 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.158745 Aug 29 16:39:05.366446 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4138/8053] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:05 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:06.390437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-da9fcc5d-e022-46d0-b301-5fe1c28ef0a7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:06.391181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-da9fcc5d-e022-46d0-b301-5fe1c28ef0a7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:06.400549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da9fcc5d-e022-46d0-b301-5fe1c28ef0a7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:06.401039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da9fcc5d-e022-46d0-b301-5fe1c28ef0a7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:06.401514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da9fcc5d-e022-46d0-b301-5fe1c28ef0a7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:06.402211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da9fcc5d-e022-46d0-b301-5fe1c28ef0a7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:06.402669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da9fcc5d-e022-46d0-b301-5fe1c28ef0a7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:06.403098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-da9fcc5d-e022-46d0-b301-5fe1c28ef0a7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:06.540383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-da9fcc5d-e022-46d0-b301-5fe1c28ef0a7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:06.553299 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-da9fcc5d-e022-46d0-b301-5fe1c28ef0a7 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.169898 Aug 29 16:39:06.553961 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3916/8054] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:06 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:07.574832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-325ca713-af0f-4755-8f11-053326f7d838 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:07.575460 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-325ca713-af0f-4755-8f11-053326f7d838 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:07.583381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-325ca713-af0f-4755-8f11-053326f7d838 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:07.583885 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-325ca713-af0f-4755-8f11-053326f7d838 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:07.584336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-325ca713-af0f-4755-8f11-053326f7d838 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:07.585125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-325ca713-af0f-4755-8f11-053326f7d838 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:07.585950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-325ca713-af0f-4755-8f11-053326f7d838 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:07.586390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-325ca713-af0f-4755-8f11-053326f7d838 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:07.731859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-325ca713-af0f-4755-8f11-053326f7d838 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:07.740087 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-325ca713-af0f-4755-8f11-053326f7d838 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.169337 Aug 29 16:39:07.740640 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4139/8055] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:07 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:08.765615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cc3dd468-74ee-4b8d-a28d-b8fa19ecceac tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:08.766369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cc3dd468-74ee-4b8d-a28d-b8fa19ecceac tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:08.775263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc3dd468-74ee-4b8d-a28d-b8fa19ecceac tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:08.775882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc3dd468-74ee-4b8d-a28d-b8fa19ecceac tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:08.776436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc3dd468-74ee-4b8d-a28d-b8fa19ecceac tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:08.777368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc3dd468-74ee-4b8d-a28d-b8fa19ecceac tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:08.778856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc3dd468-74ee-4b8d-a28d-b8fa19ecceac tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:08.779401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cc3dd468-74ee-4b8d-a28d-b8fa19ecceac tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:08.923824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cc3dd468-74ee-4b8d-a28d-b8fa19ecceac tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:08.931989 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cc3dd468-74ee-4b8d-a28d-b8fa19ecceac tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.173490 Aug 29 16:39:08.932586 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3917/8056] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:08 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:09.953717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8757f80c-88a6-4081-811e-cd5b00959625 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:09.955100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8757f80c-88a6-4081-811e-cd5b00959625 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:09.962649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8757f80c-88a6-4081-811e-cd5b00959625 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:09.963152 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8757f80c-88a6-4081-811e-cd5b00959625 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:09.963604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8757f80c-88a6-4081-811e-cd5b00959625 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:09.964325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8757f80c-88a6-4081-811e-cd5b00959625 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:09.964928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8757f80c-88a6-4081-811e-cd5b00959625 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:09.965432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8757f80c-88a6-4081-811e-cd5b00959625 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:10.104716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8757f80c-88a6-4081-811e-cd5b00959625 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:10.112645 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8757f80c-88a6-4081-811e-cd5b00959625 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.162981 Aug 29 16:39:10.113265 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4140/8057] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:09 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:39:11.133965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-be01a6df-37e2-4620-99fd-03ef68fe522e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:11.134626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-be01a6df-37e2-4620-99fd-03ef68fe522e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:11.142485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be01a6df-37e2-4620-99fd-03ef68fe522e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:11.142990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be01a6df-37e2-4620-99fd-03ef68fe522e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:11.143421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be01a6df-37e2-4620-99fd-03ef68fe522e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:11.144136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be01a6df-37e2-4620-99fd-03ef68fe522e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:11.144594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be01a6df-37e2-4620-99fd-03ef68fe522e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:11.145021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be01a6df-37e2-4620-99fd-03ef68fe522e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:11.280634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-be01a6df-37e2-4620-99fd-03ef68fe522e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:11.293905 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-be01a6df-37e2-4620-99fd-03ef68fe522e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.164007 Aug 29 16:39:11.295349 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3918/8058] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:11 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:11.476548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-2189cce7-77f3-4030-8b87-92ec62e248c1 req-6504194a-25ff-4298-a1f9-ccc01196e895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b627fa08-5f94-4537-ba0c-4007aa88f9b4", "name": "network-vif-plugged", "status": "completed", "tag": "1a1b7a46-ef9b-422f-bf42-d86e16bf1be4"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:11.486702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2189cce7-77f3-4030-8b87-92ec62e248c1 req-6504194a-25ff-4298-a1f9-ccc01196e895 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:11.487266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2189cce7-77f3-4030-8b87-92ec62e248c1 req-6504194a-25ff-4298-a1f9-ccc01196e895 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:11.487772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2189cce7-77f3-4030-8b87-92ec62e248c1 req-6504194a-25ff-4298-a1f9-ccc01196e895 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:11.499013 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-2189cce7-77f3-4030-8b87-92ec62e248c1 req-6504194a-25ff-4298-a1f9-ccc01196e895 service nova] Creating event network-vif-plugged:1a1b7a46-ef9b-422f-bf42-d86e16bf1be4 for instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 on n-h2-839401-11 Aug 29 16:39:11.504424 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-2189cce7-77f3-4030-8b87-92ec62e248c1 req-6504194a-25ff-4298-a1f9-ccc01196e895 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116859 Aug 29 16:39:11.505223 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4141/8059] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:39:12.319729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c683b046-5275-43fb-a0a6-fcc96e38f452 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:12.320720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c683b046-5275-43fb-a0a6-fcc96e38f452 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:12.332458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c683b046-5275-43fb-a0a6-fcc96e38f452 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:12.333324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c683b046-5275-43fb-a0a6-fcc96e38f452 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:12.334057 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c683b046-5275-43fb-a0a6-fcc96e38f452 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:12.335216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c683b046-5275-43fb-a0a6-fcc96e38f452 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:12.336358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c683b046-5275-43fb-a0a6-fcc96e38f452 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:12.337076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c683b046-5275-43fb-a0a6-fcc96e38f452 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:12.467780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c683b046-5275-43fb-a0a6-fcc96e38f452 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:12.475679 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c683b046-5275-43fb-a0a6-fcc96e38f452 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1358 microversion: 2.1 time: 0.162592 Aug 29 16:39:12.476272 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3919/8060] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:12 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:13.503806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bf0cc8d5-d87b-4fc3-81ab-2a73b62dcc03 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:13.505007 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bf0cc8d5-d87b-4fc3-81ab-2a73b62dcc03 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:13.513923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf0cc8d5-d87b-4fc3-81ab-2a73b62dcc03 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:13.514425 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf0cc8d5-d87b-4fc3-81ab-2a73b62dcc03 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:13.514882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf0cc8d5-d87b-4fc3-81ab-2a73b62dcc03 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:13.515598 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf0cc8d5-d87b-4fc3-81ab-2a73b62dcc03 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:13.516053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf0cc8d5-d87b-4fc3-81ab-2a73b62dcc03 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:13.516522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf0cc8d5-d87b-4fc3-81ab-2a73b62dcc03 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:13.660995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bf0cc8d5-d87b-4fc3-81ab-2a73b62dcc03 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:13.673979 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bf0cc8d5-d87b-4fc3-81ab-2a73b62dcc03 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1549 microversion: 2.1 time: 0.178879 Aug 29 16:39:13.674799 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4142/8061] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:13 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1549 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:13.694278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d1941116-791b-4d10-90b6-82142208c622 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:13.694910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d1941116-791b-4d10-90b6-82142208c622 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:13.702256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1941116-791b-4d10-90b6-82142208c622 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:13.702746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1941116-791b-4d10-90b6-82142208c622 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:13.703182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1941116-791b-4d10-90b6-82142208c622 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:13.703881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1941116-791b-4d10-90b6-82142208c622 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:13.704339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1941116-791b-4d10-90b6-82142208c622 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:13.704765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d1941116-791b-4d10-90b6-82142208c622 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:13.852270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d1941116-791b-4d10-90b6-82142208c622 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:13.860341 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d1941116-791b-4d10-90b6-82142208c622 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1549 microversion: 2.1 time: 0.170009 Aug 29 16:39:13.860926 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3920/8062] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:13 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:13.880316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0d01d60c-64a1-474f-b630-9855bd9c1349 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:13.885255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0d01d60c-64a1-474f-b630-9855bd9c1349 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:13.886082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0d01d60c-64a1-474f-b630-9855bd9c1349 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Searching by: {'deleted': False, 'project_id': 'eb3d683e910d466db2dda3302e3c309f'} {{(pid=122360) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 16:39:13.891691 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d01d60c-64a1-474f-b630-9855bd9c1349 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:13.892206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d01d60c-64a1-474f-b630-9855bd9c1349 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:13.892645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d01d60c-64a1-474f-b630-9855bd9c1349 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:13.893419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d01d60c-64a1-474f-b630-9855bd9c1349 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:13.893892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d01d60c-64a1-474f-b630-9855bd9c1349 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:13.894329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0d01d60c-64a1-474f-b630-9855bd9c1349 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:13.919433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.multi_cell_list [None req-0d01d60c-64a1-474f-b630-9855bd9c1349 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122360) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 16:39:13.946438 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0d01d60c-64a1-474f-b630-9855bd9c1349 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070114 Aug 29 16:39:13.947022 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4143/8063] 10.222.0.62 () {58 vars in 1125 bytes} [Mon Aug 29 16:39:13 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:39:13.965292 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d0381ecc-b9c0-4de2-abea-0d080ab7ea78 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:13.966246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d0381ecc-b9c0-4de2-abea-0d080ab7ea78 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:13.976234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0381ecc-b9c0-4de2-abea-0d080ab7ea78 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:13.976779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0381ecc-b9c0-4de2-abea-0d080ab7ea78 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:13.977483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0381ecc-b9c0-4de2-abea-0d080ab7ea78 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:13.978043 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0381ecc-b9c0-4de2-abea-0d080ab7ea78 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:13.978760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0381ecc-b9c0-4de2-abea-0d080ab7ea78 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:13.979294 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0381ecc-b9c0-4de2-abea-0d080ab7ea78 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:14.114847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d0381ecc-b9c0-4de2-abea-0d080ab7ea78 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:14.125456 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d0381ecc-b9c0-4de2-abea-0d080ab7ea78 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1549 microversion: 2.1 time: 0.166812 Aug 29 16:39:14.126051 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3921/8064] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:13 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:15.852896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fd8e8168-caca-4253-91a3-0cba4b99bff0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0af0db01-7681-40bf-8ac7-694e988c87a3"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:15.856041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fd8e8168-caca-4253-91a3-0cba4b99bff0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:15.863469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd8e8168-caca-4253-91a3-0cba4b99bff0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:15.863977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd8e8168-caca-4253-91a3-0cba4b99bff0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:15.864433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd8e8168-caca-4253-91a3-0cba4b99bff0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:15.865176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd8e8168-caca-4253-91a3-0cba4b99bff0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:15.865706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd8e8168-caca-4253-91a3-0cba4b99bff0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:15.866098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd8e8168-caca-4253-91a3-0cba4b99bff0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:16.157701 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fd8e8168-caca-4253-91a3-0cba4b99bff0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "POST /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310904 Aug 29 16:39:16.158370 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4144/8065] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 16:39:15 2022] POST /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:39:27.172010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-48694cb1-8777-4a5a-b957-77e63f8286da tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:27.172631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-48694cb1-8777-4a5a-b957-77e63f8286da tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:27.175167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=19 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:27.175804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=68 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:27.181640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48694cb1-8777-4a5a-b957-77e63f8286da tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:27.182125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48694cb1-8777-4a5a-b957-77e63f8286da tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:27.182563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48694cb1-8777-4a5a-b957-77e63f8286da tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:27.183264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48694cb1-8777-4a5a-b957-77e63f8286da tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:27.183743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48694cb1-8777-4a5a-b957-77e63f8286da tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:27.184142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-48694cb1-8777-4a5a-b957-77e63f8286da tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:27.313671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-48694cb1-8777-4a5a-b957-77e63f8286da tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:27.322457 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-48694cb1-8777-4a5a-b957-77e63f8286da tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1595 microversion: 2.1 time: 0.154426 Aug 29 16:39:27.323045 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3922/8066] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:27 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1595 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:29.338164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-4696db50-747c-4e5b-86bd-cdf6e69979f2 req-319d0c72-3476-4eb3-a534-214bfec79f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b627fa08-5f94-4537-ba0c-4007aa88f9b4", "tag": "1a1b7a46-ef9b-422f-bf42-d86e16bf1be4"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:29.344694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:29.345759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=19 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:29.346474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:29.355289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4696db50-747c-4e5b-86bd-cdf6e69979f2 req-319d0c72-3476-4eb3-a534-214bfec79f5c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:29.355788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4696db50-747c-4e5b-86bd-cdf6e69979f2 req-319d0c72-3476-4eb3-a534-214bfec79f5c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:29.356261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4696db50-747c-4e5b-86bd-cdf6e69979f2 req-319d0c72-3476-4eb3-a534-214bfec79f5c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:29.369191 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-4696db50-747c-4e5b-86bd-cdf6e69979f2 req-319d0c72-3476-4eb3-a534-214bfec79f5c service nova] Creating event network-changed:1a1b7a46-ef9b-422f-bf42-d86e16bf1be4 for instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 on n-h2-839401-11 Aug 29 16:39:29.375246 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-4696db50-747c-4e5b-86bd-cdf6e69979f2 req-319d0c72-3476-4eb3-a534-214bfec79f5c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043687 Aug 29 16:39:29.376119 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4145/8067] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:39:30.334893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-87e8158c-e1b6-46de-aacb-234cd77b604b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-315364029"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:30.335769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-87e8158c-e1b6-46de-aacb-234cd77b604b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:30.342953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87e8158c-e1b6-46de-aacb-234cd77b604b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:30.343440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87e8158c-e1b6-46de-aacb-234cd77b604b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:30.343873 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87e8158c-e1b6-46de-aacb-234cd77b604b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:30.344561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87e8158c-e1b6-46de-aacb-234cd77b604b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:30.345010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87e8158c-e1b6-46de-aacb-234cd77b604b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:30.345486 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-87e8158c-e1b6-46de-aacb-234cd77b604b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:30.490595 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.network.security_group_api [None req-87e8158c-e1b6-46de-aacb-234cd77b604b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Adding security group 033c0d06-1480-4f7f-ab47-3cefeefcb527 to port 1a1b7a46-ef9b-422f-bf42-d86e16bf1be4 Aug 29 16:39:30.823977 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-87e8158c-e1b6-46de-aacb-234cd77b604b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "POST /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/action" status: 202 len: 0 microversion: 2.1 time: 0.493050 Aug 29 16:39:30.824606 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3923/8068] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:39:30 2022] POST /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:39:30.836191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bcead1b1-25c9-4898-a7b1-50e240816bc0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:30.838474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bcead1b1-25c9-4898-a7b1-50e240816bc0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:30.846899 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcead1b1-25c9-4898-a7b1-50e240816bc0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:30.847647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcead1b1-25c9-4898-a7b1-50e240816bc0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:30.848008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcead1b1-25c9-4898-a7b1-50e240816bc0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:30.848730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcead1b1-25c9-4898-a7b1-50e240816bc0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:30.849209 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcead1b1-25c9-4898-a7b1-50e240816bc0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:30.849643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bcead1b1-25c9-4898-a7b1-50e240816bc0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:30.999098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bcead1b1-25c9-4898-a7b1-50e240816bc0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:31.008180 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bcead1b1-25c9-4898-a7b1-50e240816bc0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1759 microversion: 2.1 time: 0.178359 Aug 29 16:39:31.008772 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4146/8069] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:30 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1759 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:31.446946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b5724130-8c99-4935-96e5-fb58e7b36a91 req-027f6124-e353-4c6b-8c3a-cc7b31bf65cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b627fa08-5f94-4537-ba0c-4007aa88f9b4", "tag": "1a1b7a46-ef9b-422f-bf42-d86e16bf1be4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:31.457699 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b5724130-8c99-4935-96e5-fb58e7b36a91 req-027f6124-e353-4c6b-8c3a-cc7b31bf65cb service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:31.458327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b5724130-8c99-4935-96e5-fb58e7b36a91 req-027f6124-e353-4c6b-8c3a-cc7b31bf65cb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:31.458827 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b5724130-8c99-4935-96e5-fb58e7b36a91 req-027f6124-e353-4c6b-8c3a-cc7b31bf65cb service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:31.473273 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b5724130-8c99-4935-96e5-fb58e7b36a91 req-027f6124-e353-4c6b-8c3a-cc7b31bf65cb service nova] Creating event network-changed:1a1b7a46-ef9b-422f-bf42-d86e16bf1be4 for instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 on n-h2-839401-11 Aug 29 16:39:31.478638 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b5724130-8c99-4935-96e5-fb58e7b36a91 req-027f6124-e353-4c6b-8c3a-cc7b31bf65cb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091412 Aug 29 16:39:31.479678 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3924/8070] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:40:29.503312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-56e90132-5b56-45b2-a2de-66a027d7a608 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:40:29.505607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-56e90132-5b56-45b2-a2de-66a027d7a608 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:29.508130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:29.508826 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:29.516011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56e90132-5b56-45b2-a2de-66a027d7a608 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:29.516508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56e90132-5b56-45b2-a2de-66a027d7a608 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:29.516956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56e90132-5b56-45b2-a2de-66a027d7a608 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:29.517694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56e90132-5b56-45b2-a2de-66a027d7a608 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:29.518171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56e90132-5b56-45b2-a2de-66a027d7a608 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:29.518618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-56e90132-5b56-45b2-a2de-66a027d7a608 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:29.607418 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-56e90132-5b56-45b2-a2de-66a027d7a608 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "POST /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/action" status: 202 len: 0 microversion: 2.1 time: 0.110698 Aug 29 16:40:29.608241 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4147/8071] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:40:29 2022] POST /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:40:29.617399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-75c0ad08-9dca-4d29-9228-158063df20e3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:29.618116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-75c0ad08-9dca-4d29-9228-158063df20e3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:29.620440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:29.621269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:29.622287 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:40:29.622440 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 16:40:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 (ip 10.222.0.62) !!! Aug 29 16:40:29.631633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75c0ad08-9dca-4d29-9228-158063df20e3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:29.632117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75c0ad08-9dca-4d29-9228-158063df20e3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:29.632560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75c0ad08-9dca-4d29-9228-158063df20e3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:29.633337 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75c0ad08-9dca-4d29-9228-158063df20e3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:29.633798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75c0ad08-9dca-4d29-9228-158063df20e3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:29.634233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-75c0ad08-9dca-4d29-9228-158063df20e3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:29.865860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-75c0ad08-9dca-4d29-9228-158063df20e3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:29.874492 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-75c0ad08-9dca-4d29-9228-158063df20e3 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1751 microversion: 2.1 time: 0.261614 Aug 29 16:40:29.875150 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3925/8072] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:29 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1751 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:30.896466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7707728c-10f6-4819-ba9a-0e341849391f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:30.897230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7707728c-10f6-4819-ba9a-0e341849391f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:30.905022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7707728c-10f6-4819-ba9a-0e341849391f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:30.905561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7707728c-10f6-4819-ba9a-0e341849391f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:30.906020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7707728c-10f6-4819-ba9a-0e341849391f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:30.906731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7707728c-10f6-4819-ba9a-0e341849391f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:30.907207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7707728c-10f6-4819-ba9a-0e341849391f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:30.907654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7707728c-10f6-4819-ba9a-0e341849391f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:31.062923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7707728c-10f6-4819-ba9a-0e341849391f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:31.071612 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7707728c-10f6-4819-ba9a-0e341849391f tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1756 microversion: 2.1 time: 0.179621 Aug 29 16:40:31.072166 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4148/8073] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:30 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:32.100976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2a20409a-66c6-4800-8abc-1eebfb264070 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:32.101637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2a20409a-66c6-4800-8abc-1eebfb264070 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:32.110769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a20409a-66c6-4800-8abc-1eebfb264070 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:32.111716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a20409a-66c6-4800-8abc-1eebfb264070 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:32.112199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a20409a-66c6-4800-8abc-1eebfb264070 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:32.113006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a20409a-66c6-4800-8abc-1eebfb264070 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:32.113591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a20409a-66c6-4800-8abc-1eebfb264070 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:32.114457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a20409a-66c6-4800-8abc-1eebfb264070 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:32.279533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2a20409a-66c6-4800-8abc-1eebfb264070 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:32.288475 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2a20409a-66c6-4800-8abc-1eebfb264070 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1756 microversion: 2.1 time: 0.197245 Aug 29 16:40:32.289029 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3926/8074] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:32 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:33.315155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e4c444af-893f-447a-9c2d-9e428a904a47 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:33.316121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e4c444af-893f-447a-9c2d-9e428a904a47 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:33.323809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4c444af-893f-447a-9c2d-9e428a904a47 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:33.324309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4c444af-893f-447a-9c2d-9e428a904a47 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:33.324759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4c444af-893f-447a-9c2d-9e428a904a47 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:33.325504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4c444af-893f-447a-9c2d-9e428a904a47 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:33.325977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4c444af-893f-447a-9c2d-9e428a904a47 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:33.326415 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e4c444af-893f-447a-9c2d-9e428a904a47 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:33.479568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e4c444af-893f-447a-9c2d-9e428a904a47 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:33.488108 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e4c444af-893f-447a-9c2d-9e428a904a47 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1756 microversion: 2.1 time: 0.179670 Aug 29 16:40:33.488712 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4149/8075] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:33 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:34.513929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ef46499c-5896-4227-a077-97fca7c89152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:34.514903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ef46499c-5896-4227-a077-97fca7c89152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:34.524087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef46499c-5896-4227-a077-97fca7c89152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:34.524580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef46499c-5896-4227-a077-97fca7c89152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:34.525025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef46499c-5896-4227-a077-97fca7c89152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:34.525807 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef46499c-5896-4227-a077-97fca7c89152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:34.526300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef46499c-5896-4227-a077-97fca7c89152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:34.526736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ef46499c-5896-4227-a077-97fca7c89152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:34.677688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ef46499c-5896-4227-a077-97fca7c89152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:34.686436 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ef46499c-5896-4227-a077-97fca7c89152 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1756 microversion: 2.1 time: 0.179496 Aug 29 16:40:34.687050 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3927/8076] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:34 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:35.712345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9f835f5b-d88a-4a93-906d-3b01464df2d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:35.713436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9f835f5b-d88a-4a93-906d-3b01464df2d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:35.724393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f835f5b-d88a-4a93-906d-3b01464df2d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:35.724934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f835f5b-d88a-4a93-906d-3b01464df2d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:35.725422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f835f5b-d88a-4a93-906d-3b01464df2d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:35.726257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f835f5b-d88a-4a93-906d-3b01464df2d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:35.726741 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f835f5b-d88a-4a93-906d-3b01464df2d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:35.727191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9f835f5b-d88a-4a93-906d-3b01464df2d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:35.879524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9f835f5b-d88a-4a93-906d-3b01464df2d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:35.888247 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9f835f5b-d88a-4a93-906d-3b01464df2d4 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1756 microversion: 2.1 time: 0.182902 Aug 29 16:40:35.888838 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4150/8077] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:35 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:36.914087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c29c2171-6268-49d2-aea5-268326ee5ffd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:36.915109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c29c2171-6268-49d2-aea5-268326ee5ffd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:36.926567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c29c2171-6268-49d2-aea5-268326ee5ffd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:36.927465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c29c2171-6268-49d2-aea5-268326ee5ffd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:36.927908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c29c2171-6268-49d2-aea5-268326ee5ffd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:36.928643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c29c2171-6268-49d2-aea5-268326ee5ffd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:36.929106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c29c2171-6268-49d2-aea5-268326ee5ffd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:36.929533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c29c2171-6268-49d2-aea5-268326ee5ffd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:37.094941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c29c2171-6268-49d2-aea5-268326ee5ffd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:37.104035 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c29c2171-6268-49d2-aea5-268326ee5ffd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1756 microversion: 2.1 time: 0.196483 Aug 29 16:40:37.104589 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3928/8078] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:36 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:38.130009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-345ece78-4086-4321-9ddb-6bd1b4e6e971 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:38.130910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-345ece78-4086-4321-9ddb-6bd1b4e6e971 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:38.142274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-345ece78-4086-4321-9ddb-6bd1b4e6e971 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:38.143067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-345ece78-4086-4321-9ddb-6bd1b4e6e971 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:38.143876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-345ece78-4086-4321-9ddb-6bd1b4e6e971 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:38.145128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-345ece78-4086-4321-9ddb-6bd1b4e6e971 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:38.145887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-345ece78-4086-4321-9ddb-6bd1b4e6e971 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:38.146352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-345ece78-4086-4321-9ddb-6bd1b4e6e971 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:38.299814 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-345ece78-4086-4321-9ddb-6bd1b4e6e971 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:38.308527 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-345ece78-4086-4321-9ddb-6bd1b4e6e971 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1756 microversion: 2.1 time: 0.185535 Aug 29 16:40:38.309115 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4151/8079] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:38 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:39.333141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a3216d0b-4e9e-405f-befa-dffe4a6ec1fd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:39.334143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a3216d0b-4e9e-405f-befa-dffe4a6ec1fd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:39.344941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3216d0b-4e9e-405f-befa-dffe4a6ec1fd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:39.345696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3216d0b-4e9e-405f-befa-dffe4a6ec1fd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:39.346329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3216d0b-4e9e-405f-befa-dffe4a6ec1fd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:39.347329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3216d0b-4e9e-405f-befa-dffe4a6ec1fd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:39.347995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3216d0b-4e9e-405f-befa-dffe4a6ec1fd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:39.348614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a3216d0b-4e9e-405f-befa-dffe4a6ec1fd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:39.511289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a3216d0b-4e9e-405f-befa-dffe4a6ec1fd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:39.524067 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a3216d0b-4e9e-405f-befa-dffe4a6ec1fd tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1756 microversion: 2.1 time: 0.196369 Aug 29 16:40:39.524893 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3929/8080] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:39 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:40.546412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b07bc24c-815e-4d6a-a69b-e6e61cd41401 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:40.547023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b07bc24c-815e-4d6a-a69b-e6e61cd41401 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:40.555240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b07bc24c-815e-4d6a-a69b-e6e61cd41401 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:40.555749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b07bc24c-815e-4d6a-a69b-e6e61cd41401 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:40.556207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b07bc24c-815e-4d6a-a69b-e6e61cd41401 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:40.556928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b07bc24c-815e-4d6a-a69b-e6e61cd41401 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:40.557437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b07bc24c-815e-4d6a-a69b-e6e61cd41401 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:40.557926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b07bc24c-815e-4d6a-a69b-e6e61cd41401 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:40.705035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b07bc24c-815e-4d6a-a69b-e6e61cd41401 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:40.713978 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b07bc24c-815e-4d6a-a69b-e6e61cd41401 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1756 microversion: 2.1 time: 0.171849 Aug 29 16:40:40.714555 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4152/8081] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:40 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:41.735775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-91ccfdec-be56-429b-92b4-bf7e0a4c6921 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:41.736420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-91ccfdec-be56-429b-92b4-bf7e0a4c6921 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:41.743844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91ccfdec-be56-429b-92b4-bf7e0a4c6921 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:41.744328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91ccfdec-be56-429b-92b4-bf7e0a4c6921 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:41.744768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91ccfdec-be56-429b-92b4-bf7e0a4c6921 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:41.745489 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91ccfdec-be56-429b-92b4-bf7e0a4c6921 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:41.745975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91ccfdec-be56-429b-92b4-bf7e0a4c6921 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:41.746407 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-91ccfdec-be56-429b-92b4-bf7e0a4c6921 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:41.916894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-91ccfdec-be56-429b-92b4-bf7e0a4c6921 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:41.929633 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-91ccfdec-be56-429b-92b4-bf7e0a4c6921 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1759 microversion: 2.1 time: 0.197895 Aug 29 16:40:41.930211 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3930/8082] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:41 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1759 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:45.302494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=12 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:41:45.303729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:41:45.310300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b2b53da-83c6-40a6-87f4-7b45cc53ebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-315364029"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:41:45.311237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8b2b53da-83c6-40a6-87f4-7b45cc53ebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:45.320955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b2b53da-83c6-40a6-87f4-7b45cc53ebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:45.321515 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b2b53da-83c6-40a6-87f4-7b45cc53ebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:45.321939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b2b53da-83c6-40a6-87f4-7b45cc53ebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:45.322647 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b2b53da-83c6-40a6-87f4-7b45cc53ebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:45.323121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b2b53da-83c6-40a6-87f4-7b45cc53ebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:45.323558 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b2b53da-83c6-40a6-87f4-7b45cc53ebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:45.458475 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.network.security_group_api [None req-8b2b53da-83c6-40a6-87f4-7b45cc53ebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Removing security group 033c0d06-1480-4f7f-ab47-3cefeefcb527 from port 1a1b7a46-ef9b-422f-bf42-d86e16bf1be4 Aug 29 16:41:45.779464 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8b2b53da-83c6-40a6-87f4-7b45cc53ebba tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "POST /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/action" status: 202 len: 0 microversion: 2.1 time: 0.480595 Aug 29 16:41:45.780150 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4153/8083] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:41:45 2022] POST /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:41:45.795165 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [-] [564df600-0953-4421-a68a-24b5a0a40919] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:41:45.796735 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eda7f439-560f-4fda-a0c4-47b93d5f6cfd] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:41:45.797499 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:41:45.798425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=36 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:41:45.866713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-69c5fb8c-cd76-4507-873c-0bd790e9160d req-5ccba98c-9602-4e3b-9a8f-117dafd9ccb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b627fa08-5f94-4537-ba0c-4007aa88f9b4", "tag": "1a1b7a46-ef9b-422f-bf42-d86e16bf1be4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:41:45.885652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-69c5fb8c-cd76-4507-873c-0bd790e9160d req-5ccba98c-9602-4e3b-9a8f-117dafd9ccb7 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:45.886138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-69c5fb8c-cd76-4507-873c-0bd790e9160d req-5ccba98c-9602-4e3b-9a8f-117dafd9ccb7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:45.890021 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-69c5fb8c-cd76-4507-873c-0bd790e9160d req-5ccba98c-9602-4e3b-9a8f-117dafd9ccb7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:45.904793 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-69c5fb8c-cd76-4507-873c-0bd790e9160d req-5ccba98c-9602-4e3b-9a8f-117dafd9ccb7 service nova] Creating event network-changed:1a1b7a46-ef9b-422f-bf42-d86e16bf1be4 for instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 on n-h2-839401-11 Aug 29 16:41:45.910570 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-69c5fb8c-cd76-4507-873c-0bd790e9160d req-5ccba98c-9602-4e3b-9a8f-117dafd9ccb7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117346 Aug 29 16:41:45.911245 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3931/8084] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:41:47.172958 n-d-839401-11 devstack@n-api.service[122360]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edb16f3c-d8bd-4396-8d00-d7897b8393bf] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:41:47.176849 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-998d4a06-ec48-4b98-b4e0-c72b499c2ba0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:47.177471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-998d4a06-ec48-4b98-b4e0-c72b499c2ba0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:47.184228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-998d4a06-ec48-4b98-b4e0-c72b499c2ba0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:47.184870 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-998d4a06-ec48-4b98-b4e0-c72b499c2ba0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:47.185356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-998d4a06-ec48-4b98-b4e0-c72b499c2ba0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:47.186078 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-998d4a06-ec48-4b98-b4e0-c72b499c2ba0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:47.186582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-998d4a06-ec48-4b98-b4e0-c72b499c2ba0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:47.187080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-998d4a06-ec48-4b98-b4e0-c72b499c2ba0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:47.271123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-998d4a06-ec48-4b98-b4e0-c72b499c2ba0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lazy-loading 'services' on Instance uuid b627fa08-5f94-4537-ba0c-4007aa88f9b4 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:41:47.354006 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-998d4a06-ec48-4b98-b4e0-c72b499c2ba0 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments/0af0db01-7681-40bf-8ac7-694e988c87a3" status: 202 len: 0 microversion: 2.1 time: 0.182709 Aug 29 16:41:47.354802 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4154/8085] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 16:41:47 2022] DELETE /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments/0af0db01-7681-40bf-8ac7-694e988c87a3 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:41:47.364054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cf8121c9-7b35-4062-a031-99f7237dfa9b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:47.366940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cf8121c9-7b35-4062-a031-99f7237dfa9b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:47.375587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf8121c9-7b35-4062-a031-99f7237dfa9b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:47.376182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf8121c9-7b35-4062-a031-99f7237dfa9b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:47.376701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf8121c9-7b35-4062-a031-99f7237dfa9b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:47.377675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf8121c9-7b35-4062-a031-99f7237dfa9b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:47.378465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf8121c9-7b35-4062-a031-99f7237dfa9b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:47.378971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf8121c9-7b35-4062-a031-99f7237dfa9b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:47.402308 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] [eda7f439-560f-4fda-a0c4-47b93d5f6cfd] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 41760. Aug 29 16:41:47.403342 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] [564df600-0953-4421-a68a-24b5a0a40919] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 41758. Aug 29 16:41:47.418484 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cf8121c9-7b35-4062-a031-99f7237dfa9b tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058901 Aug 29 16:41:47.419186 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3932/8086] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:41:47 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:41:47.927190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-05a0b464-9733-4d2d-858a-b11ca3e6a79c req-cd30e1fd-689c-40a0-b977-652f8097a1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b627fa08-5f94-4537-ba0c-4007aa88f9b4", "tag": "1a1b7a46-ef9b-422f-bf42-d86e16bf1be4"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:41:47.937663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-05a0b464-9733-4d2d-858a-b11ca3e6a79c req-cd30e1fd-689c-40a0-b977-652f8097a1d5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:47.938442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-05a0b464-9733-4d2d-858a-b11ca3e6a79c req-cd30e1fd-689c-40a0-b977-652f8097a1d5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:47.938958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-05a0b464-9733-4d2d-858a-b11ca3e6a79c req-cd30e1fd-689c-40a0-b977-652f8097a1d5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:47.950772 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-05a0b464-9733-4d2d-858a-b11ca3e6a79c req-cd30e1fd-689c-40a0-b977-652f8097a1d5 service nova] Creating event network-changed:1a1b7a46-ef9b-422f-bf42-d86e16bf1be4 for instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 on n-h2-839401-11 Aug 29 16:41:47.956122 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-05a0b464-9733-4d2d-858a-b11ca3e6a79c req-cd30e1fd-689c-40a0-b977-652f8097a1d5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033315 Aug 29 16:41:47.956826 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4155/8087] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:41:48.432362 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9942727b-e593-4686-9fd8-662593fed89e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:48.434782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9942727b-e593-4686-9fd8-662593fed89e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:48.442406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9942727b-e593-4686-9fd8-662593fed89e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:48.443628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9942727b-e593-4686-9fd8-662593fed89e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:48.443628 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9942727b-e593-4686-9fd8-662593fed89e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:48.444569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9942727b-e593-4686-9fd8-662593fed89e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:48.445152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9942727b-e593-4686-9fd8-662593fed89e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:48.445805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9942727b-e593-4686-9fd8-662593fed89e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:48.478301 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9942727b-e593-4686-9fd8-662593fed89e tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050209 Aug 29 16:41:48.479234 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3933/8088] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:41:48 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:41:49.494763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-73a12236-b9be-4c78-86f7-45801af00812 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:49.497143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-73a12236-b9be-4c78-86f7-45801af00812 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:49.504864 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73a12236-b9be-4c78-86f7-45801af00812 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:49.505446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73a12236-b9be-4c78-86f7-45801af00812 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:49.505901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73a12236-b9be-4c78-86f7-45801af00812 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:49.506631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73a12236-b9be-4c78-86f7-45801af00812 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:49.507095 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73a12236-b9be-4c78-86f7-45801af00812 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:49.507587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-73a12236-b9be-4c78-86f7-45801af00812 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:49.511215 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] [edb16f3c-d8bd-4396-8d00-d7897b8393bf] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 41768. Aug 29 16:41:49.544347 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-73a12236-b9be-4c78-86f7-45801af00812 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055687 Aug 29 16:41:49.544942 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4156/8089] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:41:49 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:41:50.556478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b9408a21-eac9-4ed1-9bd7-398c63423785 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:50.558881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b9408a21-eac9-4ed1-9bd7-398c63423785 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:50.566342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9408a21-eac9-4ed1-9bd7-398c63423785 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:50.566828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9408a21-eac9-4ed1-9bd7-398c63423785 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:50.567261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9408a21-eac9-4ed1-9bd7-398c63423785 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:50.568148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9408a21-eac9-4ed1-9bd7-398c63423785 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:50.568610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9408a21-eac9-4ed1-9bd7-398c63423785 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:50.569031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b9408a21-eac9-4ed1-9bd7-398c63423785 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:50.599457 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b9408a21-eac9-4ed1-9bd7-398c63423785 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047122 Aug 29 16:41:50.600025 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3934/8090] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:41:50 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:41:51.612308 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ae81b51b-e947-4aec-8ca6-cdbbbdc0da4d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:51.614700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ae81b51b-e947-4aec-8ca6-cdbbbdc0da4d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:51.623590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae81b51b-e947-4aec-8ca6-cdbbbdc0da4d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:51.624082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae81b51b-e947-4aec-8ca6-cdbbbdc0da4d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:51.624536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae81b51b-e947-4aec-8ca6-cdbbbdc0da4d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:51.625314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae81b51b-e947-4aec-8ca6-cdbbbdc0da4d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:51.625784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae81b51b-e947-4aec-8ca6-cdbbbdc0da4d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:51.626223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae81b51b-e947-4aec-8ca6-cdbbbdc0da4d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:51.656790 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ae81b51b-e947-4aec-8ca6-cdbbbdc0da4d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048624 Aug 29 16:41:51.657398 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4157/8091] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:41:51 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:41:52.669202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d2e76008-1eab-4040-b674-e9c531d1eeea tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:52.671448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d2e76008-1eab-4040-b674-e9c531d1eeea tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:52.678823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2e76008-1eab-4040-b674-e9c531d1eeea tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:52.679314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2e76008-1eab-4040-b674-e9c531d1eeea tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:52.679753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2e76008-1eab-4040-b674-e9c531d1eeea tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:52.680457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2e76008-1eab-4040-b674-e9c531d1eeea tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:52.680914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2e76008-1eab-4040-b674-e9c531d1eeea tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:52.681359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d2e76008-1eab-4040-b674-e9c531d1eeea tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:52.711768 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d2e76008-1eab-4040-b674-e9c531d1eeea tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046730 Aug 29 16:41:52.712309 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3935/8092] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 16:41:52 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:41:52.723259 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dbb667e8-359e-4f7c-b05c-84ea99b2ab0a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:52.723884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dbb667e8-359e-4f7c-b05c-84ea99b2ab0a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:52.731280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbb667e8-359e-4f7c-b05c-84ea99b2ab0a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:52.731787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbb667e8-359e-4f7c-b05c-84ea99b2ab0a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:52.732241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbb667e8-359e-4f7c-b05c-84ea99b2ab0a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:52.732955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbb667e8-359e-4f7c-b05c-84ea99b2ab0a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:52.733456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbb667e8-359e-4f7c-b05c-84ea99b2ab0a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:52.733909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dbb667e8-359e-4f7c-b05c-84ea99b2ab0a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:52.811776 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-dbb667e8-359e-4f7c-b05c-84ea99b2ab0a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] HTTP exception thrown: Instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 is not attached to volume 0af0db01-7681-40bf-8ac7-694e988c87a3 Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dbb667e8-359e-4f7c-b05c-84ea99b2ab0a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Request method failure captured: Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: request: DELETE /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments/0af0db01-7681-40bf-8ac7-694e988c87a3 HTTP/1.1 Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOpdYGQh9S5XvFAVFwN_E6Nc5hcV31VRpWbHZAYHwIFWPGT1fo4URLocVfBB9_kAWLyWxrPJ9KIm0pDgol5bHL79E8ZaCVt-P9bKsfIx67s5t7Ua7MvYpep1nrAlhJghLYJmCW2nPUKMteoU8RrEagJhDxfaHZp2wyUBtbMfQMXmI-o Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: eb3d683e910d466db2dda3302e3c309f Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestMinimumBasicScenario-1402166622 Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eb3d683e910d466db2dda3302e3c309f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eb3d683e910d466db2dda3302e3c309f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eb3d683e910d466db2dda3302e3c309f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eb3d683e910d466db2dda3302e3c309f"}]}] Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestMinimumBasicScenario-1402166622 Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: eb3d683e910d466db2dda3302e3c309f Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1402166622 Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestMinimumBasicScenario-1402166622-project Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 4ab82f9740ec4d119cfb03b1a1883b91 Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestMinimumBasicScenario-1402166622-project Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 is not attached to volume 0af0db01-7681-40bf-8ac7-694e988c87a3 Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'server_id': 'b627fa08-5f94-4537-ba0c-4007aa88f9b4', 'id': '0af0db01-7681-40bf-8ac7-694e988c87a3'} Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0af0db01-7681-40bf-8ac7-694e988c87a3. Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 is not attached to volume 0af0db01-7681-40bf-8ac7-694e988c87a3 Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:41:52.813808 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:41:52.818224 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:41:52.818224 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:41:52.818224 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 is not attached to volume 0af0db01-7681-40bf-8ac7-694e988c87a3 Aug 29 16:41:52.818224 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:41:52.818224 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dbb667e8-359e-4f7c-b05c-84ea99b2ab0a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Returning 404 to user: Instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 is not attached to volume 0af0db01-7681-40bf-8ac7-694e988c87a3 {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:41:52.818224 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dbb667e8-359e-4f7c-b05c-84ea99b2ab0a tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments/0af0db01-7681-40bf-8ac7-694e988c87a3" status: 404 len: 154 microversion: 2.1 time: 0.096226 Aug 29 16:41:52.818224 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4158/8093] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 16:41:52 2022] DELETE /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4/os-volume_attachments/0af0db01-7681-40bf-8ac7-694e988c87a3 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:41:56.071557 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8fac65c7-1a23-4e95-9081-c995408ea71d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:56.072056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8fac65c7-1a23-4e95-9081-c995408ea71d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:56.079395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fac65c7-1a23-4e95-9081-c995408ea71d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:56.079889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fac65c7-1a23-4e95-9081-c995408ea71d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:56.080327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fac65c7-1a23-4e95-9081-c995408ea71d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:56.081028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fac65c7-1a23-4e95-9081-c995408ea71d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:56.081515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fac65c7-1a23-4e95-9081-c995408ea71d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:56.081947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8fac65c7-1a23-4e95-9081-c995408ea71d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:56.107676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8fac65c7-1a23-4e95-9081-c995408ea71d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:41:56.196260 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8fac65c7-1a23-4e95-9081-c995408ea71d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 204 len: 0 microversion: 2.1 time: 0.127978 Aug 29 16:41:56.201044 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3936/8094] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:41:56 2022] DELETE /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:41:56.206901 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5fdffb9c-7045-4c13-9b91-521011600691 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:56.207745 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5fdffb9c-7045-4c13-9b91-521011600691 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:56.216217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fdffb9c-7045-4c13-9b91-521011600691 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:56.216914 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fdffb9c-7045-4c13-9b91-521011600691 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:56.217584 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fdffb9c-7045-4c13-9b91-521011600691 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:56.218305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fdffb9c-7045-4c13-9b91-521011600691 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:56.218769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fdffb9c-7045-4c13-9b91-521011600691 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:56.219202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5fdffb9c-7045-4c13-9b91-521011600691 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:56.357835 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5fdffb9c-7045-4c13-9b91-521011600691 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:56.366100 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5fdffb9c-7045-4c13-9b91-521011600691 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1555 microversion: 2.1 time: 0.163760 Aug 29 16:41:56.366765 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4159/8095] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:56 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:57.391866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f21970d1-48cb-4255-960d-5414fa44fdfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:57.393034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f21970d1-48cb-4255-960d-5414fa44fdfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:57.405562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21970d1-48cb-4255-960d-5414fa44fdfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:57.406372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21970d1-48cb-4255-960d-5414fa44fdfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:57.407110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21970d1-48cb-4255-960d-5414fa44fdfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:57.408272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21970d1-48cb-4255-960d-5414fa44fdfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:57.409039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21970d1-48cb-4255-960d-5414fa44fdfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:57.409819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f21970d1-48cb-4255-960d-5414fa44fdfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:57.557002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f21970d1-48cb-4255-960d-5414fa44fdfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:57.565262 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f21970d1-48cb-4255-960d-5414fa44fdfe tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1555 microversion: 2.1 time: 0.180739 Aug 29 16:41:57.565846 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3937/8096] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:57 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:58.587022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e2f28f37-dbe9-471e-98ba-aff9cf68012d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:58.587629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e2f28f37-dbe9-471e-98ba-aff9cf68012d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:58.595377 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2f28f37-dbe9-471e-98ba-aff9cf68012d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:58.595863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2f28f37-dbe9-471e-98ba-aff9cf68012d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:58.596340 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2f28f37-dbe9-471e-98ba-aff9cf68012d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:58.597042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2f28f37-dbe9-471e-98ba-aff9cf68012d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:58.597536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2f28f37-dbe9-471e-98ba-aff9cf68012d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:58.597997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2f28f37-dbe9-471e-98ba-aff9cf68012d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:58.750761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e2f28f37-dbe9-471e-98ba-aff9cf68012d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab82f9740ec4d119cfb03b1a1883b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3d683e910d466db2dda3302e3c309f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:58.760885 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e2f28f37-dbe9-471e-98ba-aff9cf68012d tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 200 len: 1555 microversion: 2.1 time: 0.178169 Aug 29 16:41:58.761701 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4160/8097] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:58 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:58.777535 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-3c921906-e867-49b9-a833-e915a1928613 req-d633604c-b231-428e-911b-d41bdd5ef381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b627fa08-5f94-4537-ba0c-4007aa88f9b4", "name": "network-vif-deleted", "tag": "1a1b7a46-ef9b-422f-bf42-d86e16bf1be4"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:41:58.790068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3c921906-e867-49b9-a833-e915a1928613 req-d633604c-b231-428e-911b-d41bdd5ef381 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:58.790532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3c921906-e867-49b9-a833-e915a1928613 req-d633604c-b231-428e-911b-d41bdd5ef381 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:58.790970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-3c921906-e867-49b9-a833-e915a1928613 req-d633604c-b231-428e-911b-d41bdd5ef381 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:58.806067 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-3c921906-e867-49b9-a833-e915a1928613 req-d633604c-b231-428e-911b-d41bdd5ef381 service nova] Creating event network-vif-deleted:1a1b7a46-ef9b-422f-bf42-d86e16bf1be4 for instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 on n-h2-839401-11 Aug 29 16:41:58.811129 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-3c921906-e867-49b9-a833-e915a1928613 req-d633604c-b231-428e-911b-d41bdd5ef381 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037871 Aug 29 16:41:58.811750 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3938/8098] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:41:59.784025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0b808b66-5ba3-47c1-befe-c0fa71758f5c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:59.784608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0b808b66-5ba3-47c1-befe-c0fa71758f5c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [instance: b627fa08-5f94-4537-ba0c-4007aa88f9b4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:59.792435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b808b66-5ba3-47c1-befe-c0fa71758f5c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:59.792934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b808b66-5ba3-47c1-befe-c0fa71758f5c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:59.793420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b808b66-5ba3-47c1-befe-c0fa71758f5c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:59.794123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b808b66-5ba3-47c1-befe-c0fa71758f5c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:59.794590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b808b66-5ba3-47c1-befe-c0fa71758f5c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:59.795016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b808b66-5ba3-47c1-befe-c0fa71758f5c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:59.808733 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-0b808b66-5ba3-47c1-befe-c0fa71758f5c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] HTTP exception thrown: Instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 could not be found. Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0b808b66-5ba3-47c1-befe-c0fa71758f5c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Request method failure captured: Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 HTTP/1.1 Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOpdYGQh9S5XvFAVFwN_E6Nc5hcV31VRpWbHZAYHwIFWPGT1fo4URLocVfBB9_kAWLyWxrPJ9KIm0pDgol5bHL79E8ZaCVt-P9bKsfIx67s5t7Ua7MvYpep1nrAlhJghLYJmCW2nPUKMteoU8RrEagJhDxfaHZp2wyUBtbMfQMXmI-o Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: eb3d683e910d466db2dda3302e3c309f Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestMinimumBasicScenario-1402166622 Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eb3d683e910d466db2dda3302e3c309f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eb3d683e910d466db2dda3302e3c309f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eb3d683e910d466db2dda3302e3c309f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eb3d683e910d466db2dda3302e3c309f"}]}] Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestMinimumBasicScenario-1402166622 Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: eb3d683e910d466db2dda3302e3c309f Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1402166622 Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestMinimumBasicScenario-1402166622-project Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 4ab82f9740ec4d119cfb03b1a1883b91 Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestMinimumBasicScenario-1402166622-project Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 could not be found. Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'b627fa08-5f94-4537-ba0c-4007aa88f9b4'} Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 could not be found. Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 could not be found. Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:41:59.810311 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:41:59.817504 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:41:59.817504 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:41:59.817504 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:41:59.817504 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:41:59.817504 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:41:59.817504 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 could not be found. Aug 29 16:41:59.817504 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:41:59.817504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0b808b66-5ba3-47c1-befe-c0fa71758f5c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Returning 404 to user: Instance b627fa08-5f94-4537-ba0c-4007aa88f9b4 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:41:59.817504 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0b808b66-5ba3-47c1-befe-c0fa71758f5c tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4" status: 404 len: 111 microversion: 2.1 time: 0.031825 Aug 29 16:41:59.817504 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4161/8099] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:59 2022] GET /compute/v2.1/servers/b627fa08-5f94-4537-ba0c-4007aa88f9b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:41:59.823781 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dccbb857-ba96-49b5-a62d-0eea7f9e9259 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] Calling method '.version_select at 0x7fc42a53c8b0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:59.828157 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dccbb857-ba96-49b5-a62d-0eea7f9e9259 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [5072c773-7cce-4f83-82c0-18bdcabe916e] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:42:00.837048 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [None req-dccbb857-ba96-49b5-a62d-0eea7f9e9259 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] [5072c773-7cce-4f83-82c0-18bdcabe916e] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 41804. Aug 29 16:42:00.862727 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dccbb857-ba96-49b5-a62d-0eea7f9e9259 tempest-TestMinimumBasicScenario-1402166622 tempest-TestMinimumBasicScenario-1402166622-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1056077013" status: 202 len: 0 microversion: 2.1 time: 1.044026 Aug 29 16:42:00.863275 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3939/8100] 10.222.0.62 () {58 vars in 1272 bytes} [Mon Aug 29 16:41:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1056077013 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:42:10.200931 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:42:10.201532 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:42:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.62) !!! Aug 29 16:42:10.202932 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:42:10.203055 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:42:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.62) !!! Aug 29 16:42:10.204699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=18 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:10.205525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:10.367916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-65b99c2e-193f-44fa-90e0-0a3f9d8d2f55 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'create', calling method: .version_select at 0x7fc42ac3e670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-38495309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1BaO5xn6lGfWbDCuD10ItN4m/e3fqwp16Z7gE4h3/tqje8evVk9ma8y6n1x7BaEib/aenMPtye4gDd7iM1ger4a5lAh+1pNQmem9SzcZxjxwvjDcArhZbsERNUhpEKTA=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:10.384001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-65b99c2e-193f-44fa-90e0-0a3f9d8d2f55 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:42:10.389430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-65b99c2e-193f-44fa-90e0-0a3f9d8d2f55 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for user c9565af0dfd0482f887f0eea2f3a1f4e and project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:42:10.423133 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-65b99c2e-193f-44fa-90e0-0a3f9d8d2f55 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.227935 Aug 29 16:42:10.423742 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4162/8101] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:42:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:42:16.785291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-630830108", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "33294a51-b4e4-49df-a54e-285b18f9270c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-38495309", "security_groups": [{"name": "tempest-secgroup-smoke-182996097"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:16.799725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:16.800738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:16.915913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] validate_networks() for [('33294a51-b4e4-49df-a54e-285b18f9270c', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:42:17.407748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:42:17.408544 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:42:17.409076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:42:17.409503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:42:17.410044 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:42:17.420035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:17.420525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:17.420963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:17.421719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:17.422171 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:17.422596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:17.442900 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:42:17.448767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for user c9565af0dfd0482f887f0eea2f3a1f4e and project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:42:17.463386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:42:17.465835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:42:17.516316 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-be246de9-5455-4e54-b1b9-8a8be73584e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.737964 Aug 29 16:42:17.517656 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3940/8102] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:42:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:42:17.529402 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85f63f7c-7097-4331-89dd-bf9c15b51c1e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:17.530193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-85f63f7c-7097-4331-89dd-bf9c15b51c1e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:17.589926 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-85f63f7c-7097-4331-89dd-bf9c15b51c1e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:17.598895 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85f63f7c-7097-4331-89dd-bf9c15b51c1e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1264 microversion: 2.1 time: 0.074411 Aug 29 16:42:17.599516 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4163/8103] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:17 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1264 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:18.621009 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-99856903-0494-4ec2-975b-0d55b4cdfeb1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:18.622525 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-99856903-0494-4ec2-975b-0d55b4cdfeb1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:18.630183 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99856903-0494-4ec2-975b-0d55b4cdfeb1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:18.631033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99856903-0494-4ec2-975b-0d55b4cdfeb1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:18.631488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99856903-0494-4ec2-975b-0d55b4cdfeb1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:18.632213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99856903-0494-4ec2-975b-0d55b4cdfeb1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:18.632686 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99856903-0494-4ec2-975b-0d55b4cdfeb1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:18.633373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99856903-0494-4ec2-975b-0d55b4cdfeb1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:18.701925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-99856903-0494-4ec2-975b-0d55b4cdfeb1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:18.711266 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-99856903-0494-4ec2-975b-0d55b4cdfeb1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1316 microversion: 2.1 time: 0.095283 Aug 29 16:42:18.712173 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3941/8104] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:18 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1316 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:19.732024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1d127329-30b5-41df-aad8-36c5393f687b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:19.732652 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1d127329-30b5-41df-aad8-36c5393f687b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:19.739646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d127329-30b5-41df-aad8-36c5393f687b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:19.740150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d127329-30b5-41df-aad8-36c5393f687b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:19.740600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d127329-30b5-41df-aad8-36c5393f687b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:19.741344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d127329-30b5-41df-aad8-36c5393f687b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:19.741898 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d127329-30b5-41df-aad8-36c5393f687b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:19.742341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1d127329-30b5-41df-aad8-36c5393f687b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:19.910994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1d127329-30b5-41df-aad8-36c5393f687b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:19.924440 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1d127329-30b5-41df-aad8-36c5393f687b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1389 microversion: 2.1 time: 0.196285 Aug 29 16:42:19.941170 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4164/8105] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:19 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1389 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:20.267866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-537b3be3-ec59-4b20-b6e8-39e82016b5f7 req-89df4c30-46f6-451c-a345-59d3f5d8afa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b22186a8-2ea4-4319-aaa0-a581eb132fd4", "tag": "cf76541d-8518-4c62-a113-771b91154a2e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:20.289157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-537b3be3-ec59-4b20-b6e8-39e82016b5f7 req-89df4c30-46f6-451c-a345-59d3f5d8afa5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:20.289948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-537b3be3-ec59-4b20-b6e8-39e82016b5f7 req-89df4c30-46f6-451c-a345-59d3f5d8afa5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:20.291618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-537b3be3-ec59-4b20-b6e8-39e82016b5f7 req-89df4c30-46f6-451c-a345-59d3f5d8afa5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:20.305729 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-537b3be3-ec59-4b20-b6e8-39e82016b5f7 req-89df4c30-46f6-451c-a345-59d3f5d8afa5 service nova] Creating event network-changed:cf76541d-8518-4c62-a113-771b91154a2e for instance b22186a8-2ea4-4319-aaa0-a581eb132fd4 on n-h2-839401-11 Aug 29 16:42:20.311724 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-537b3be3-ec59-4b20-b6e8-39e82016b5f7 req-89df4c30-46f6-451c-a345-59d3f5d8afa5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047878 Aug 29 16:42:20.312843 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3942/8106] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:42:20.948355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1296b96b-11dd-488a-95a9-ce18b2808a2e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:20.948942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1296b96b-11dd-488a-95a9-ce18b2808a2e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:20.956367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1296b96b-11dd-488a-95a9-ce18b2808a2e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:20.956875 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1296b96b-11dd-488a-95a9-ce18b2808a2e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:20.957365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1296b96b-11dd-488a-95a9-ce18b2808a2e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:20.958432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1296b96b-11dd-488a-95a9-ce18b2808a2e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:20.958909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1296b96b-11dd-488a-95a9-ce18b2808a2e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:20.959355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1296b96b-11dd-488a-95a9-ce18b2808a2e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:21.100622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1296b96b-11dd-488a-95a9-ce18b2808a2e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:21.109475 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1296b96b-11dd-488a-95a9-ce18b2808a2e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1389 microversion: 2.1 time: 0.165165 Aug 29 16:42:21.110065 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4165/8107] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:20 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:22.131660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3cb91972-5226-4b46-bfd8-107d0e4a4c90 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:22.132425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3cb91972-5226-4b46-bfd8-107d0e4a4c90 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:22.139313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cb91972-5226-4b46-bfd8-107d0e4a4c90 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:22.139797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cb91972-5226-4b46-bfd8-107d0e4a4c90 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:22.140232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cb91972-5226-4b46-bfd8-107d0e4a4c90 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:22.140931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cb91972-5226-4b46-bfd8-107d0e4a4c90 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:22.141427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cb91972-5226-4b46-bfd8-107d0e4a4c90 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:22.141856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3cb91972-5226-4b46-bfd8-107d0e4a4c90 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:22.281893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3cb91972-5226-4b46-bfd8-107d0e4a4c90 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:22.289999 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3cb91972-5226-4b46-bfd8-107d0e4a4c90 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1389 microversion: 2.1 time: 0.163533 Aug 29 16:42:22.290588 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3943/8108] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:22 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:23.310915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4ac8d7f9-0dc3-4c89-af11-4cd574183f56 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:23.311531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4ac8d7f9-0dc3-4c89-af11-4cd574183f56 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:23.318798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ac8d7f9-0dc3-4c89-af11-4cd574183f56 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:23.319304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ac8d7f9-0dc3-4c89-af11-4cd574183f56 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:23.319721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ac8d7f9-0dc3-4c89-af11-4cd574183f56 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:23.320483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ac8d7f9-0dc3-4c89-af11-4cd574183f56 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:23.320952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ac8d7f9-0dc3-4c89-af11-4cd574183f56 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:23.321689 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ac8d7f9-0dc3-4c89-af11-4cd574183f56 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:23.459203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4ac8d7f9-0dc3-4c89-af11-4cd574183f56 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:23.467489 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4ac8d7f9-0dc3-4c89-af11-4cd574183f56 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1389 microversion: 2.1 time: 0.160600 Aug 29 16:42:23.468085 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4166/8109] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:23 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:24.488496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7340857b-2b76-46c0-959d-7f319700d8d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:24.489077 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7340857b-2b76-46c0-959d-7f319700d8d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:24.496490 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7340857b-2b76-46c0-959d-7f319700d8d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:24.496980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7340857b-2b76-46c0-959d-7f319700d8d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:24.497449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7340857b-2b76-46c0-959d-7f319700d8d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:24.498148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7340857b-2b76-46c0-959d-7f319700d8d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:24.498607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7340857b-2b76-46c0-959d-7f319700d8d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:24.499039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7340857b-2b76-46c0-959d-7f319700d8d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:24.633676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7340857b-2b76-46c0-959d-7f319700d8d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:24.641623 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7340857b-2b76-46c0-959d-7f319700d8d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1389 microversion: 2.1 time: 0.157346 Aug 29 16:42:24.642210 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3944/8110] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:24 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:25.666489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c480abe8-bac6-43f3-9534-40c391984665 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:25.667025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c480abe8-bac6-43f3-9534-40c391984665 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:25.674605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c480abe8-bac6-43f3-9534-40c391984665 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:25.675109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c480abe8-bac6-43f3-9534-40c391984665 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:25.675565 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c480abe8-bac6-43f3-9534-40c391984665 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:25.676285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c480abe8-bac6-43f3-9534-40c391984665 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:25.676760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c480abe8-bac6-43f3-9534-40c391984665 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:25.677343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c480abe8-bac6-43f3-9534-40c391984665 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:25.826459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c480abe8-bac6-43f3-9534-40c391984665 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:25.838500 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c480abe8-bac6-43f3-9534-40c391984665 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1389 microversion: 2.1 time: 0.177940 Aug 29 16:42:25.839086 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4167/8111] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:25 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1389 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:26.681960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d53aea5e-158d-4473-960a-455e75f487e8 req-3b8e7dba-88f3-4285-92d1-7fd3f7723283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b22186a8-2ea4-4319-aaa0-a581eb132fd4", "name": "network-vif-plugged", "status": "completed", "tag": "cf76541d-8518-4c62-a113-771b91154a2e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:26.693629 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d53aea5e-158d-4473-960a-455e75f487e8 req-3b8e7dba-88f3-4285-92d1-7fd3f7723283 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:26.694122 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d53aea5e-158d-4473-960a-455e75f487e8 req-3b8e7dba-88f3-4285-92d1-7fd3f7723283 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:26.694563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d53aea5e-158d-4473-960a-455e75f487e8 req-3b8e7dba-88f3-4285-92d1-7fd3f7723283 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:26.706212 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d53aea5e-158d-4473-960a-455e75f487e8 req-3b8e7dba-88f3-4285-92d1-7fd3f7723283 service nova] Creating event network-vif-plugged:cf76541d-8518-4c62-a113-771b91154a2e for instance b22186a8-2ea4-4319-aaa0-a581eb132fd4 on n-h2-839401-11 Aug 29 16:42:26.711757 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d53aea5e-158d-4473-960a-455e75f487e8 req-3b8e7dba-88f3-4285-92d1-7fd3f7723283 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033785 Aug 29 16:42:26.712422 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3945/8112] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:42:26.862294 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ff888dd4-e27c-46ec-b12e-1fecb7fd5db0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:26.862923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ff888dd4-e27c-46ec-b12e-1fecb7fd5db0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:26.870547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff888dd4-e27c-46ec-b12e-1fecb7fd5db0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:26.871047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff888dd4-e27c-46ec-b12e-1fecb7fd5db0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:26.871489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff888dd4-e27c-46ec-b12e-1fecb7fd5db0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:26.872199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff888dd4-e27c-46ec-b12e-1fecb7fd5db0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:26.872663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff888dd4-e27c-46ec-b12e-1fecb7fd5db0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:26.873112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff888dd4-e27c-46ec-b12e-1fecb7fd5db0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:27.016927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ff888dd4-e27c-46ec-b12e-1fecb7fd5db0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:27.027467 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ff888dd4-e27c-46ec-b12e-1fecb7fd5db0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1389 microversion: 2.1 time: 0.169276 Aug 29 16:42:27.028052 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4168/8113] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:26 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1389 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:28.053406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:28.054197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:28.059677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4dbddc74-c5b8-4a21-a1c0-124554a2f413 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:28.060393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4dbddc74-c5b8-4a21-a1c0-124554a2f413 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:28.068578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbddc74-c5b8-4a21-a1c0-124554a2f413 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:28.069143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbddc74-c5b8-4a21-a1c0-124554a2f413 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:28.069582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbddc74-c5b8-4a21-a1c0-124554a2f413 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:28.070304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbddc74-c5b8-4a21-a1c0-124554a2f413 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:28.070755 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbddc74-c5b8-4a21-a1c0-124554a2f413 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:28.071175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dbddc74-c5b8-4a21-a1c0-124554a2f413 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:28.213454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4dbddc74-c5b8-4a21-a1c0-124554a2f413 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:28.221589 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4dbddc74-c5b8-4a21-a1c0-124554a2f413 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1389 microversion: 2.1 time: 0.169250 Aug 29 16:42:28.222230 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3946/8114] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:28 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1389 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:29.243054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-355a6a6e-96d0-4753-90c7-55a644fc40f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:29.243672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-355a6a6e-96d0-4753-90c7-55a644fc40f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:29.245623 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:29.251905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-355a6a6e-96d0-4753-90c7-55a644fc40f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:29.252412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-355a6a6e-96d0-4753-90c7-55a644fc40f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:29.252868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-355a6a6e-96d0-4753-90c7-55a644fc40f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:29.253607 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-355a6a6e-96d0-4753-90c7-55a644fc40f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:29.254098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-355a6a6e-96d0-4753-90c7-55a644fc40f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:29.254548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-355a6a6e-96d0-4753-90c7-55a644fc40f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:29.396083 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-355a6a6e-96d0-4753-90c7-55a644fc40f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:29.405694 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-355a6a6e-96d0-4753-90c7-55a644fc40f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1561 microversion: 2.1 time: 0.166771 Aug 29 16:42:29.406322 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4169/8115] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:29 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:29.425955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dcc781ed-75ee-4f8d-a723-0f944d6556f9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:29.426541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dcc781ed-75ee-4f8d-a723-0f944d6556f9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:29.433989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcc781ed-75ee-4f8d-a723-0f944d6556f9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:29.434484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcc781ed-75ee-4f8d-a723-0f944d6556f9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:29.434923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcc781ed-75ee-4f8d-a723-0f944d6556f9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:29.435619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcc781ed-75ee-4f8d-a723-0f944d6556f9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:29.436081 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcc781ed-75ee-4f8d-a723-0f944d6556f9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:29.436511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dcc781ed-75ee-4f8d-a723-0f944d6556f9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:29.592233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dcc781ed-75ee-4f8d-a723-0f944d6556f9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:29.600461 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dcc781ed-75ee-4f8d-a723-0f944d6556f9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1561 microversion: 2.1 time: 0.178432 Aug 29 16:42:29.601038 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3947/8116] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:29 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:31.261498 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a6ee58f7-430d-474a-b1e0-95bcccc3d313 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:31.262113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a6ee58f7-430d-474a-b1e0-95bcccc3d313 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:31.262984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-9a4bed24-a1b0-4ffc-825e-ac6824978772 req-f1253f9a-44e8-43b9-a2d9-c7aa0d2c97f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b22186a8-2ea4-4319-aaa0-a581eb132fd4", "tag": "cf76541d-8518-4c62-a113-771b91154a2e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:31.270344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6ee58f7-430d-474a-b1e0-95bcccc3d313 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:31.270970 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6ee58f7-430d-474a-b1e0-95bcccc3d313 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:31.271492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6ee58f7-430d-474a-b1e0-95bcccc3d313 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:31.272283 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6ee58f7-430d-474a-b1e0-95bcccc3d313 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:31.273052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6ee58f7-430d-474a-b1e0-95bcccc3d313 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:31.273278 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9a4bed24-a1b0-4ffc-825e-ac6824978772 req-f1253f9a-44e8-43b9-a2d9-c7aa0d2c97f4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:31.273711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a6ee58f7-430d-474a-b1e0-95bcccc3d313 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:31.273823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9a4bed24-a1b0-4ffc-825e-ac6824978772 req-f1253f9a-44e8-43b9-a2d9-c7aa0d2c97f4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:31.274276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9a4bed24-a1b0-4ffc-825e-ac6824978772 req-f1253f9a-44e8-43b9-a2d9-c7aa0d2c97f4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:31.285618 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-9a4bed24-a1b0-4ffc-825e-ac6824978772 req-f1253f9a-44e8-43b9-a2d9-c7aa0d2c97f4 service nova] Creating event network-changed:cf76541d-8518-4c62-a113-771b91154a2e for instance b22186a8-2ea4-4319-aaa0-a581eb132fd4 on n-h2-839401-11 Aug 29 16:42:31.291456 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-9a4bed24-a1b0-4ffc-825e-ac6824978772 req-f1253f9a-44e8-43b9-a2d9-c7aa0d2c97f4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032267 Aug 29 16:42:31.292295 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3948/8117] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:42:31.415618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a6ee58f7-430d-474a-b1e0-95bcccc3d313 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:31.424043 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a6ee58f7-430d-474a-b1e0-95bcccc3d313 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1561 microversion: 2.1 time: 0.167024 Aug 29 16:42:31.424855 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4170/8118] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:31 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:04.783003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:04.784191 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=38 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:04.788706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4dab019c-b38d-4312-9bf7-45db1b76d457 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:04.791003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4dab019c-b38d-4312-9bf7-45db1b76d457 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:04.798804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dab019c-b38d-4312-9bf7-45db1b76d457 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:04.799256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dab019c-b38d-4312-9bf7-45db1b76d457 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:04.799696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dab019c-b38d-4312-9bf7-45db1b76d457 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:04.800376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dab019c-b38d-4312-9bf7-45db1b76d457 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:04.800831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dab019c-b38d-4312-9bf7-45db1b76d457 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:04.801301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4dab019c-b38d-4312-9bf7-45db1b76d457 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:04.871146 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4dab019c-b38d-4312-9bf7-45db1b76d457 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4/action" status: 200 len: 24569 microversion: 2.1 time: 0.090807 Aug 29 16:43:04.871833 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3949/8119] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:43:04 2022] POST /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4/action => generated 24569 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:43:43.658770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:43.660039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=42 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:43.665329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-001a7839-0ec2-4fa3-87f8-46051e1ad2e8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:43.665882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-001a7839-0ec2-4fa3-87f8-46051e1ad2e8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:43.673401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-001a7839-0ec2-4fa3-87f8-46051e1ad2e8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:43.673900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-001a7839-0ec2-4fa3-87f8-46051e1ad2e8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:43.674349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-001a7839-0ec2-4fa3-87f8-46051e1ad2e8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:43.675051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-001a7839-0ec2-4fa3-87f8-46051e1ad2e8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:43.675521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-001a7839-0ec2-4fa3-87f8-46051e1ad2e8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:43.675958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-001a7839-0ec2-4fa3-87f8-46051e1ad2e8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:43.753147 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-001a7839-0ec2-4fa3-87f8-46051e1ad2e8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4/action" status: 202 len: 0 microversion: 2.1 time: 0.097226 Aug 29 16:43:43.754331 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4171/8120] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:43:43 2022] POST /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:43:43.764491 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b97c245d-b4c7-4d67-bb7f-da8833925410 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:43.765310 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b97c245d-b4c7-4d67-bb7f-da8833925410 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:43.767881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:43.768532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:43.774725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b97c245d-b4c7-4d67-bb7f-da8833925410 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:43.775209 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b97c245d-b4c7-4d67-bb7f-da8833925410 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:43.775654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b97c245d-b4c7-4d67-bb7f-da8833925410 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:43.776417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b97c245d-b4c7-4d67-bb7f-da8833925410 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:43.776941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b97c245d-b4c7-4d67-bb7f-da8833925410 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:43.777386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b97c245d-b4c7-4d67-bb7f-da8833925410 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:43.916449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b97c245d-b4c7-4d67-bb7f-da8833925410 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:43.924488 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b97c245d-b4c7-4d67-bb7f-da8833925410 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1685 microversion: 2.1 time: 0.164879 Aug 29 16:43:43.925041 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3950/8121] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:43 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:44.952744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-90f36c01-a766-412b-9aaf-2cca9a616da2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:44.953963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-90f36c01-a766-412b-9aaf-2cca9a616da2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:44.962976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90f36c01-a766-412b-9aaf-2cca9a616da2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:44.963483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90f36c01-a766-412b-9aaf-2cca9a616da2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:44.963937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90f36c01-a766-412b-9aaf-2cca9a616da2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:44.964659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90f36c01-a766-412b-9aaf-2cca9a616da2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:44.965144 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90f36c01-a766-412b-9aaf-2cca9a616da2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:44.965615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90f36c01-a766-412b-9aaf-2cca9a616da2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:45.116867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-90f36c01-a766-412b-9aaf-2cca9a616da2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:45.125385 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-90f36c01-a766-412b-9aaf-2cca9a616da2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1665 microversion: 2.1 time: 0.182011 Aug 29 16:43:45.125958 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4172/8122] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:44 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1665 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:46.226799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d50d15ee-90dc-402a-8467-6e5a8d15858d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:46.229024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d50d15ee-90dc-402a-8467-6e5a8d15858d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:46.237313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50d15ee-90dc-402a-8467-6e5a8d15858d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:46.237812 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50d15ee-90dc-402a-8467-6e5a8d15858d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:46.238286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50d15ee-90dc-402a-8467-6e5a8d15858d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:46.238990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50d15ee-90dc-402a-8467-6e5a8d15858d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:46.239454 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50d15ee-90dc-402a-8467-6e5a8d15858d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:46.239884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d50d15ee-90dc-402a-8467-6e5a8d15858d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:46.312102 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d50d15ee-90dc-402a-8467-6e5a8d15858d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4/action" status: 200 len: 32642 microversion: 2.1 time: 0.090448 Aug 29 16:43:46.313054 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3951/8123] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:43:46 2022] POST /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4/action => generated 32642 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:43:46.331094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-458bd0c0-bfa9-402b-9fcb-9e173bd3390d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:46.331953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-458bd0c0-bfa9-402b-9fcb-9e173bd3390d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:46.339767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-458bd0c0-bfa9-402b-9fcb-9e173bd3390d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:46.340272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-458bd0c0-bfa9-402b-9fcb-9e173bd3390d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:46.340727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-458bd0c0-bfa9-402b-9fcb-9e173bd3390d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:46.341485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-458bd0c0-bfa9-402b-9fcb-9e173bd3390d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:46.341965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-458bd0c0-bfa9-402b-9fcb-9e173bd3390d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:46.342408 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-458bd0c0-bfa9-402b-9fcb-9e173bd3390d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:46.414525 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-458bd0c0-bfa9-402b-9fcb-9e173bd3390d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4/action" status: 202 len: 0 microversion: 2.1 time: 0.089916 Aug 29 16:43:46.415270 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4173/8124] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:43:46 2022] POST /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:43:46.425508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4538be90-1945-41fb-9dae-bd08cd0170b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:46.426213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4538be90-1945-41fb-9dae-bd08cd0170b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:46.433445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4538be90-1945-41fb-9dae-bd08cd0170b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:46.433925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4538be90-1945-41fb-9dae-bd08cd0170b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:46.434361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4538be90-1945-41fb-9dae-bd08cd0170b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:46.435083 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4538be90-1945-41fb-9dae-bd08cd0170b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:46.435536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4538be90-1945-41fb-9dae-bd08cd0170b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:46.435958 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4538be90-1945-41fb-9dae-bd08cd0170b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:46.570344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4538be90-1945-41fb-9dae-bd08cd0170b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:46.580237 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4538be90-1945-41fb-9dae-bd08cd0170b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1672 microversion: 2.1 time: 0.158763 Aug 29 16:43:46.580823 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3952/8125] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:46 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:47.604929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-35483498-2c26-4ce0-9a6a-1c0402fc6fc7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:47.605848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-35483498-2c26-4ce0-9a6a-1c0402fc6fc7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:47.613027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35483498-2c26-4ce0-9a6a-1c0402fc6fc7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:47.613569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35483498-2c26-4ce0-9a6a-1c0402fc6fc7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:47.618545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35483498-2c26-4ce0-9a6a-1c0402fc6fc7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:47.622353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35483498-2c26-4ce0-9a6a-1c0402fc6fc7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:47.622840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35483498-2c26-4ce0-9a6a-1c0402fc6fc7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:47.623329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-35483498-2c26-4ce0-9a6a-1c0402fc6fc7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:47.793925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-35483498-2c26-4ce0-9a6a-1c0402fc6fc7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:47.809538 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-35483498-2c26-4ce0-9a6a-1c0402fc6fc7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1680 microversion: 2.1 time: 0.209022 Aug 29 16:43:47.810105 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4174/8126] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:47 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1680 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:47.934379 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0438e69d-c9eb-4174-aab4-687f8fe741a8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:47.936637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0438e69d-c9eb-4174-aab4-687f8fe741a8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:47.944341 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0438e69d-c9eb-4174-aab4-687f8fe741a8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:47.944816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0438e69d-c9eb-4174-aab4-687f8fe741a8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:47.945286 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0438e69d-c9eb-4174-aab4-687f8fe741a8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:47.946070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0438e69d-c9eb-4174-aab4-687f8fe741a8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:47.946523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0438e69d-c9eb-4174-aab4-687f8fe741a8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:47.946947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0438e69d-c9eb-4174-aab4-687f8fe741a8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:48.014886 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0438e69d-c9eb-4174-aab4-687f8fe741a8 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4/action" status: 200 len: 38582 microversion: 2.1 time: 0.087042 Aug 29 16:43:48.015564 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3953/8127] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:43:47 2022] POST /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4/action => generated 38582 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:43:49.130004 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-acff14cb-ea3b-4108-8e4b-ff50d6080e89 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:49.130581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-acff14cb-ea3b-4108-8e4b-ff50d6080e89 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:49.138024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acff14cb-ea3b-4108-8e4b-ff50d6080e89 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:49.138537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acff14cb-ea3b-4108-8e4b-ff50d6080e89 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:49.138994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acff14cb-ea3b-4108-8e4b-ff50d6080e89 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:49.139701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acff14cb-ea3b-4108-8e4b-ff50d6080e89 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:49.139815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-c4994e8f-4536-4ec0-9f26-89f5c8c7085d req-3fad59a4-166e-423d-8ce0-4b1bc8dea22b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b22186a8-2ea4-4319-aaa0-a581eb132fd4", "tag": "cf76541d-8518-4c62-a113-771b91154a2e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:49.140256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acff14cb-ea3b-4108-8e4b-ff50d6080e89 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:49.140608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-acff14cb-ea3b-4108-8e4b-ff50d6080e89 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:49.150984 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c4994e8f-4536-4ec0-9f26-89f5c8c7085d req-3fad59a4-166e-423d-8ce0-4b1bc8dea22b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:49.151437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c4994e8f-4536-4ec0-9f26-89f5c8c7085d req-3fad59a4-166e-423d-8ce0-4b1bc8dea22b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:49.152102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-c4994e8f-4536-4ec0-9f26-89f5c8c7085d req-3fad59a4-166e-423d-8ce0-4b1bc8dea22b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:49.164033 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-c4994e8f-4536-4ec0-9f26-89f5c8c7085d req-3fad59a4-166e-423d-8ce0-4b1bc8dea22b service nova] Creating event network-changed:cf76541d-8518-4c62-a113-771b91154a2e for instance b22186a8-2ea4-4319-aaa0-a581eb132fd4 on n-h2-839401-11 Aug 29 16:43:49.167315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-acff14cb-ea3b-4108-8e4b-ff50d6080e89 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:43:49.169078 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-c4994e8f-4536-4ec0-9f26-89f5c8c7085d req-3fad59a4-166e-423d-8ce0-4b1bc8dea22b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033397 Aug 29 16:43:49.169719 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3954/8128] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:43:49.254864 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-acff14cb-ea3b-4108-8e4b-ff50d6080e89 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 204 len: 0 microversion: 2.1 time: 0.128752 Aug 29 16:43:49.255949 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4175/8129] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:43:49 2022] DELETE /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:43:49.266080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f9d8d7f3-d341-4cf0-945f-18a860ade1e5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:49.266799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f9d8d7f3-d341-4cf0-945f-18a860ade1e5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:49.274533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9d8d7f3-d341-4cf0-945f-18a860ade1e5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:49.275036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9d8d7f3-d341-4cf0-945f-18a860ade1e5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:49.275478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9d8d7f3-d341-4cf0-945f-18a860ade1e5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:49.276420 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9d8d7f3-d341-4cf0-945f-18a860ade1e5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:49.277072 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9d8d7f3-d341-4cf0-945f-18a860ade1e5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:49.277702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f9d8d7f3-d341-4cf0-945f-18a860ade1e5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:49.416832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f9d8d7f3-d341-4cf0-945f-18a860ade1e5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:49.424830 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f9d8d7f3-d341-4cf0-945f-18a860ade1e5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1686 microversion: 2.1 time: 0.164098 Aug 29 16:43:49.425576 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3955/8130] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:49 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:43:50.449061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-63811df4-21a2-4a82-b4cc-f22235ca6a36 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:50.449845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-63811df4-21a2-4a82-b4cc-f22235ca6a36 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:50.458080 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63811df4-21a2-4a82-b4cc-f22235ca6a36 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:50.458581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63811df4-21a2-4a82-b4cc-f22235ca6a36 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:50.459029 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63811df4-21a2-4a82-b4cc-f22235ca6a36 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:50.459746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63811df4-21a2-4a82-b4cc-f22235ca6a36 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:50.460219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63811df4-21a2-4a82-b4cc-f22235ca6a36 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:50.460662 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63811df4-21a2-4a82-b4cc-f22235ca6a36 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:50.690889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-63811df4-21a2-4a82-b4cc-f22235ca6a36 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:50.699571 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-63811df4-21a2-4a82-b4cc-f22235ca6a36 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1686 microversion: 2.1 time: 0.254895 Aug 29 16:43:50.700203 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4176/8131] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:50 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1686 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:51.721385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-080254dc-226d-4a58-acee-899ef1a860a3 req-b41e1ff1-4cd0-4409-b6bb-d448bdad6767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b22186a8-2ea4-4319-aaa0-a581eb132fd4", "name": "network-vif-deleted", "tag": "cf76541d-8518-4c62-a113-771b91154a2e"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:51.721993 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1f72a442-aa61-4219-9f64-8cf5212c3fa7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:51.722355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1f72a442-aa61-4219-9f64-8cf5212c3fa7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:51.729727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f72a442-aa61-4219-9f64-8cf5212c3fa7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:51.730228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f72a442-aa61-4219-9f64-8cf5212c3fa7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:51.730683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f72a442-aa61-4219-9f64-8cf5212c3fa7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:51.731494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f72a442-aa61-4219-9f64-8cf5212c3fa7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:51.731966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f72a442-aa61-4219-9f64-8cf5212c3fa7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:51.732435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1f72a442-aa61-4219-9f64-8cf5212c3fa7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:51.737906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-080254dc-226d-4a58-acee-899ef1a860a3 req-b41e1ff1-4cd0-4409-b6bb-d448bdad6767 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:51.738396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-080254dc-226d-4a58-acee-899ef1a860a3 req-b41e1ff1-4cd0-4409-b6bb-d448bdad6767 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:51.739025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-080254dc-226d-4a58-acee-899ef1a860a3 req-b41e1ff1-4cd0-4409-b6bb-d448bdad6767 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:51.752842 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-080254dc-226d-4a58-acee-899ef1a860a3 req-b41e1ff1-4cd0-4409-b6bb-d448bdad6767 service nova] Creating event network-vif-deleted:cf76541d-8518-4c62-a113-771b91154a2e for instance b22186a8-2ea4-4319-aaa0-a581eb132fd4 on n-h2-839401-11 Aug 29 16:43:51.759423 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-080254dc-226d-4a58-acee-899ef1a860a3 req-b41e1ff1-4cd0-4409-b6bb-d448bdad6767 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041422 Aug 29 16:43:51.761026 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3956/8132] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:43:51.809934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1f72a442-aa61-4219-9f64-8cf5212c3fa7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:51.825311 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1f72a442-aa61-4219-9f64-8cf5212c3fa7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 200 len: 1500 microversion: 2.1 time: 0.107605 Aug 29 16:43:51.825891 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4177/8133] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:51 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 1500 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:52.863159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e472e797-648b-422b-988c-52848b135094 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:52.863859 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e472e797-648b-422b-988c-52848b135094 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: b22186a8-2ea4-4319-aaa0-a581eb132fd4] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:52.872039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e472e797-648b-422b-988c-52848b135094 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:52.872530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e472e797-648b-422b-988c-52848b135094 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:52.872966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e472e797-648b-422b-988c-52848b135094 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:52.873746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e472e797-648b-422b-988c-52848b135094 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:52.874211 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e472e797-648b-422b-988c-52848b135094 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:52.874642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e472e797-648b-422b-988c-52848b135094 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:52.890509 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-e472e797-648b-422b-988c-52848b135094 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] HTTP exception thrown: Instance b22186a8-2ea4-4319-aaa0-a581eb132fd4 could not be found. Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e472e797-648b-422b-988c-52848b135094 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Request method failure captured: Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 HTTP/1.1 Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOxhtoEToS3nQ4x7iVmKQZTqOC8mawYKijdPvY6Bh_MTssjj9rVe4heRLLbq4FF58bMfx8T4Eb3qq5MMGmLVsYPUFPe-ZvbGjTL-Bxl7OoI6lDRIRmK3ropbwVWSh1BWN2psc293apISyO1eYL1oyiROFjCcWD6TQJA8ehzovaaRd9w Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 3c4a511b63e449ad84d6b8172efa8f26 Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1448564924 Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3c4a511b63e449ad84d6b8172efa8f26", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3c4a511b63e449ad84d6b8172efa8f26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3c4a511b63e449ad84d6b8172efa8f26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3c4a511b63e449ad84d6b8172efa8f26"}]}] Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1448564924 Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 3c4a511b63e449ad84d6b8172efa8f26 Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1448564924 Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestNetworkAdvancedServerOps-1448564924-project Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: c9565af0dfd0482f887f0eea2f3a1f4e Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1448564924-project Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance b22186a8-2ea4-4319-aaa0-a581eb132fd4 could not be found. Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'b22186a8-2ea4-4319-aaa0-a581eb132fd4'} Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b22186a8-2ea4-4319-aaa0-a581eb132fd4 could not be found. Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b22186a8-2ea4-4319-aaa0-a581eb132fd4 could not be found. Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:43:52.892174 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:43:52.896821 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:43:52.896821 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:52.896821 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:43:52.896821 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:43:52.896821 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:43:52.896821 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:43:52.896821 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b22186a8-2ea4-4319-aaa0-a581eb132fd4 could not be found. Aug 29 16:43:52.896821 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:43:52.896821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e472e797-648b-422b-988c-52848b135094 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Returning 404 to user: Instance b22186a8-2ea4-4319-aaa0-a581eb132fd4 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:43:52.896821 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e472e797-648b-422b-988c-52848b135094 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4" status: 404 len: 111 microversion: 2.1 time: 0.036488 Aug 29 16:43:52.896821 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3957/8134] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:52 2022] GET /compute/v2.1/servers/b22186a8-2ea4-4319-aaa0-a581eb132fd4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:43:56.014778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a9bd8c98-3c12-4616-aee0-3e1b1dbe78a5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '.version_select at 0x7fc433a515e0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:56.041918 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a9bd8c98-3c12-4616-aee0-3e1b1dbe78a5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-38495309" status: 202 len: 0 microversion: 2.1 time: 0.030932 Aug 29 16:43:56.054355 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4178/8135] 10.222.0.62 () {58 vars in 1278 bytes} [Mon Aug 29 16:43:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-38495309 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:43:56.068493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6e763790-5d35-4445-bee9-d5376f6540e6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'create', calling method: .version_select at 0x7fc42a6d7670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1786312072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8uEglGAdzi4k0wJ6RcSQ0iF0ZOmzVoGznR5d3J2UBfWejWqXPGphQWjuc1ssFvmWYcGS++UhCJoop7a9G+gcLqblxbz0KzSy4HuD20TuH4dMo8qs85vToHCHjUsABfyg=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:56.087130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-6e763790-5d35-4445-bee9-d5376f6540e6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:43:56.092398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-6e763790-5d35-4445-bee9-d5376f6540e6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for user c9565af0dfd0482f887f0eea2f3a1f4e and project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:43:56.118327 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6e763790-5d35-4445-bee9-d5376f6540e6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054291 Aug 29 16:43:56.118950 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3958/8136] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:43:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:02.231434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1767744320", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "f3dc2150-89f3-4d66-88c4-eb8f6da731e9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1786312072", "security_groups": [{"name": "tempest-secgroup-smoke-908891320"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:02.248131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:02.361865 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] validate_networks() for [('f3dc2150-89f3-4d66-88c4-eb8f6da731e9', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:44:02.833836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:44:02.834267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:44:02.834752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:44:02.835166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:44:02.835592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:44:02.845892 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:02.846765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:02.847399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:02.848171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:02.848665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:02.849347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:02.868825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:44:02.874790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for user c9565af0dfd0482f887f0eea2f3a1f4e and project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:44:02.888378 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:44:02.890794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:44:02.942369 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c252180b-8af5-4834-a3ff-28bf5c318484 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.714710 Aug 29 16:44:02.943194 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4179/8137] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:44:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:44:02.952691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=32 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:02.958920 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-736884db-1cda-4591-b209-260a0a187a80 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:02.959552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-736884db-1cda-4591-b209-260a0a187a80 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:03.077416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-736884db-1cda-4591-b209-260a0a187a80 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:03.085538 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-736884db-1cda-4591-b209-260a0a187a80 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1267 microversion: 2.1 time: 0.135208 Aug 29 16:44:03.086213 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3959/8138] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:02 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:04.106466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4dd56635-9735-4319-a682-f7db7831fafd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:04.107752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4dd56635-9735-4319-a682-f7db7831fafd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:04.116958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4dd56635-9735-4319-a682-f7db7831fafd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:04.118014 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4dd56635-9735-4319-a682-f7db7831fafd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:04.118702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4dd56635-9735-4319-a682-f7db7831fafd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:04.119724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4dd56635-9735-4319-a682-f7db7831fafd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:04.120438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4dd56635-9735-4319-a682-f7db7831fafd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:04.120975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4dd56635-9735-4319-a682-f7db7831fafd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:04.195725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4dd56635-9735-4319-a682-f7db7831fafd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:04.207596 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4dd56635-9735-4319-a682-f7db7831fafd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1327 microversion: 2.1 time: 0.105117 Aug 29 16:44:04.209149 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4180/8139] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:04 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:05.229456 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b97b52a2-7bde-4144-8d06-4277de5bcd69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:05.230221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b97b52a2-7bde-4144-8d06-4277de5bcd69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:05.238299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b97b52a2-7bde-4144-8d06-4277de5bcd69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:05.238785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b97b52a2-7bde-4144-8d06-4277de5bcd69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:05.239299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b97b52a2-7bde-4144-8d06-4277de5bcd69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:05.240483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b97b52a2-7bde-4144-8d06-4277de5bcd69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:05.240954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b97b52a2-7bde-4144-8d06-4277de5bcd69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:05.241422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b97b52a2-7bde-4144-8d06-4277de5bcd69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:05.447496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b97b52a2-7bde-4144-8d06-4277de5bcd69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:05.456219 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b97b52a2-7bde-4144-8d06-4277de5bcd69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1392 microversion: 2.1 time: 0.231194 Aug 29 16:44:05.456839 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3960/8140] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:05 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1392 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:05.738212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-174fd704-52a5-49fe-a1b2-916100a73cd2 req-f6d4db55-5ab5-4298-9b3d-deecf1c1ac42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164ee53b-28aa-4e9f-9a36-0430f6473326", "tag": "3a8fc0a7-df8f-45f7-a782-b19007b79abf"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:05.750735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-174fd704-52a5-49fe-a1b2-916100a73cd2 req-f6d4db55-5ab5-4298-9b3d-deecf1c1ac42 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:05.751218 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-174fd704-52a5-49fe-a1b2-916100a73cd2 req-f6d4db55-5ab5-4298-9b3d-deecf1c1ac42 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:05.751661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-174fd704-52a5-49fe-a1b2-916100a73cd2 req-f6d4db55-5ab5-4298-9b3d-deecf1c1ac42 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:05.763551 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-174fd704-52a5-49fe-a1b2-916100a73cd2 req-f6d4db55-5ab5-4298-9b3d-deecf1c1ac42 service nova] Creating event network-changed:3a8fc0a7-df8f-45f7-a782-b19007b79abf for instance 164ee53b-28aa-4e9f-9a36-0430f6473326 on n-h1-839401-11 Aug 29 16:44:05.768747 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-174fd704-52a5-49fe-a1b2-916100a73cd2 req-f6d4db55-5ab5-4298-9b3d-deecf1c1ac42 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034485 Aug 29 16:44:05.769626 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4181/8141] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:06.477569 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5bf7ef17-c80d-41bb-adda-8167979bce5a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:06.478208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5bf7ef17-c80d-41bb-adda-8167979bce5a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:06.485466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bf7ef17-c80d-41bb-adda-8167979bce5a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:06.485948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bf7ef17-c80d-41bb-adda-8167979bce5a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:06.486383 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bf7ef17-c80d-41bb-adda-8167979bce5a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:06.487073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bf7ef17-c80d-41bb-adda-8167979bce5a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:06.487517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bf7ef17-c80d-41bb-adda-8167979bce5a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:06.487954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5bf7ef17-c80d-41bb-adda-8167979bce5a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:06.625723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5bf7ef17-c80d-41bb-adda-8167979bce5a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:06.633859 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5bf7ef17-c80d-41bb-adda-8167979bce5a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1392 microversion: 2.1 time: 0.160463 Aug 29 16:44:06.634438 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3961/8142] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:06 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:07.661832 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-98ec310e-088c-4e25-9eb8-5b69489e6f84 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:07.663162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-98ec310e-088c-4e25-9eb8-5b69489e6f84 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:07.670376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98ec310e-088c-4e25-9eb8-5b69489e6f84 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:07.670876 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98ec310e-088c-4e25-9eb8-5b69489e6f84 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:07.671326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98ec310e-088c-4e25-9eb8-5b69489e6f84 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:07.672034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98ec310e-088c-4e25-9eb8-5b69489e6f84 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:07.672502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98ec310e-088c-4e25-9eb8-5b69489e6f84 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:07.672937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-98ec310e-088c-4e25-9eb8-5b69489e6f84 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:07.810817 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-98ec310e-088c-4e25-9eb8-5b69489e6f84 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:07.819295 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-98ec310e-088c-4e25-9eb8-5b69489e6f84 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1392 microversion: 2.1 time: 0.166384 Aug 29 16:44:07.819886 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4182/8143] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:07 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:08.841533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-19822ecd-d3ff-4888-91a0-ac7dc491caaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:08.842100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-19822ecd-d3ff-4888-91a0-ac7dc491caaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:08.849555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19822ecd-d3ff-4888-91a0-ac7dc491caaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:08.850053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19822ecd-d3ff-4888-91a0-ac7dc491caaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:08.850476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19822ecd-d3ff-4888-91a0-ac7dc491caaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:08.851179 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19822ecd-d3ff-4888-91a0-ac7dc491caaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:08.851631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19822ecd-d3ff-4888-91a0-ac7dc491caaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:08.852053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19822ecd-d3ff-4888-91a0-ac7dc491caaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:08.991213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-19822ecd-d3ff-4888-91a0-ac7dc491caaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:08.999653 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-19822ecd-d3ff-4888-91a0-ac7dc491caaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1392 microversion: 2.1 time: 0.162328 Aug 29 16:44:09.000240 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3962/8144] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:08 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:10.021301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9c92a168-0c42-47b1-a84c-2afe2dc5d2f1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:10.021935 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9c92a168-0c42-47b1-a84c-2afe2dc5d2f1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:10.029535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c92a168-0c42-47b1-a84c-2afe2dc5d2f1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:10.030169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c92a168-0c42-47b1-a84c-2afe2dc5d2f1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:10.030622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c92a168-0c42-47b1-a84c-2afe2dc5d2f1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:10.031343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c92a168-0c42-47b1-a84c-2afe2dc5d2f1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:10.031811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c92a168-0c42-47b1-a84c-2afe2dc5d2f1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:10.032250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c92a168-0c42-47b1-a84c-2afe2dc5d2f1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:10.173329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9c92a168-0c42-47b1-a84c-2afe2dc5d2f1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:10.181748 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9c92a168-0c42-47b1-a84c-2afe2dc5d2f1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1392 microversion: 2.1 time: 0.164522 Aug 29 16:44:10.182434 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4183/8145] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:10 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:11.202989 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a8da7d65-5edb-4e4a-9cb2-befc31b0c096 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:11.203924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a8da7d65-5edb-4e4a-9cb2-befc31b0c096 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:11.211578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8da7d65-5edb-4e4a-9cb2-befc31b0c096 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:11.212125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8da7d65-5edb-4e4a-9cb2-befc31b0c096 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:11.212611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8da7d65-5edb-4e4a-9cb2-befc31b0c096 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:11.213332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8da7d65-5edb-4e4a-9cb2-befc31b0c096 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:11.213929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8da7d65-5edb-4e4a-9cb2-befc31b0c096 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:11.214289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a8da7d65-5edb-4e4a-9cb2-befc31b0c096 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:11.371007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a8da7d65-5edb-4e4a-9cb2-befc31b0c096 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:11.379864 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a8da7d65-5edb-4e4a-9cb2-befc31b0c096 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1392 microversion: 2.1 time: 0.180991 Aug 29 16:44:11.380742 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3963/8146] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:11 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:11.637024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-bbcd74b5-0192-4da8-ae1d-a85b141ad1f4 req-a70402ff-76e4-45f5-b662-a918628e51c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164ee53b-28aa-4e9f-9a36-0430f6473326", "name": "network-vif-plugged", "status": "completed", "tag": "3a8fc0a7-df8f-45f7-a782-b19007b79abf"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:11.647577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-bbcd74b5-0192-4da8-ae1d-a85b141ad1f4 req-a70402ff-76e4-45f5-b662-a918628e51c1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:11.648142 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-bbcd74b5-0192-4da8-ae1d-a85b141ad1f4 req-a70402ff-76e4-45f5-b662-a918628e51c1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:11.648593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-bbcd74b5-0192-4da8-ae1d-a85b141ad1f4 req-a70402ff-76e4-45f5-b662-a918628e51c1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:11.662880 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-bbcd74b5-0192-4da8-ae1d-a85b141ad1f4 req-a70402ff-76e4-45f5-b662-a918628e51c1 service nova] Creating event network-vif-plugged:3a8fc0a7-df8f-45f7-a782-b19007b79abf for instance 164ee53b-28aa-4e9f-9a36-0430f6473326 on n-h1-839401-11 Aug 29 16:44:11.668204 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-bbcd74b5-0192-4da8-ae1d-a85b141ad1f4 req-a70402ff-76e4-45f5-b662-a918628e51c1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093829 Aug 29 16:44:11.668835 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4184/8147] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:12.404620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8f821212-df5e-4abb-b18f-a76988cd1284 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:12.405662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8f821212-df5e-4abb-b18f-a76988cd1284 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:12.416205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f821212-df5e-4abb-b18f-a76988cd1284 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:12.416698 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f821212-df5e-4abb-b18f-a76988cd1284 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:12.417142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f821212-df5e-4abb-b18f-a76988cd1284 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:12.417881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f821212-df5e-4abb-b18f-a76988cd1284 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:12.418342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f821212-df5e-4abb-b18f-a76988cd1284 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:12.418788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8f821212-df5e-4abb-b18f-a76988cd1284 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:12.555513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8f821212-df5e-4abb-b18f-a76988cd1284 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:12.572884 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8f821212-df5e-4abb-b18f-a76988cd1284 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1392 microversion: 2.1 time: 0.174849 Aug 29 16:44:12.573506 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3964/8148] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:12 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:13.594705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:13.596041 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:13.603399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c6506116-467a-4389-a01f-8856b8f439cc tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:13.604563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c6506116-467a-4389-a01f-8856b8f439cc tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:13.613313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6506116-467a-4389-a01f-8856b8f439cc tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:13.613812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6506116-467a-4389-a01f-8856b8f439cc tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:13.614237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6506116-467a-4389-a01f-8856b8f439cc tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:13.614968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6506116-467a-4389-a01f-8856b8f439cc tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:13.615435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6506116-467a-4389-a01f-8856b8f439cc tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:13.615873 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c6506116-467a-4389-a01f-8856b8f439cc tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:13.755277 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c6506116-467a-4389-a01f-8856b8f439cc tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:13.763398 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c6506116-467a-4389-a01f-8856b8f439cc tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1563 microversion: 2.1 time: 0.171938 Aug 29 16:44:13.764004 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4185/8149] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:13 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:13.783549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-70de0f7d-5fed-455e-8072-732c278c7e2d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:13.784112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-70de0f7d-5fed-455e-8072-732c278c7e2d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:13.786071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:13.787703 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:13.793003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70de0f7d-5fed-455e-8072-732c278c7e2d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:13.793508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70de0f7d-5fed-455e-8072-732c278c7e2d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:13.793941 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70de0f7d-5fed-455e-8072-732c278c7e2d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:13.794625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70de0f7d-5fed-455e-8072-732c278c7e2d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:13.795080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70de0f7d-5fed-455e-8072-732c278c7e2d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:13.795502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70de0f7d-5fed-455e-8072-732c278c7e2d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:13.932429 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-70de0f7d-5fed-455e-8072-732c278c7e2d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:13.940701 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-70de0f7d-5fed-455e-8072-732c278c7e2d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1563 microversion: 2.1 time: 0.161059 Aug 29 16:44:13.941306 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3965/8150] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:13 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:15.915031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d5acfd5-0f5d-4840-9831-3b46577b0bc3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:15.915669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9d5acfd5-0f5d-4840-9831-3b46577b0bc3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:15.917948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-48bd79b7-5c29-40ea-9ff1-c00e5e748746 req-2d77b82e-24a9-4ec8-a068-d4b54411ac44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164ee53b-28aa-4e9f-9a36-0430f6473326", "tag": "3a8fc0a7-df8f-45f7-a782-b19007b79abf"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:15.918468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:15.929205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-48bd79b7-5c29-40ea-9ff1-c00e5e748746 req-2d77b82e-24a9-4ec8-a068-d4b54411ac44 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:15.929447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d5acfd5-0f5d-4840-9831-3b46577b0bc3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:15.929690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-48bd79b7-5c29-40ea-9ff1-c00e5e748746 req-2d77b82e-24a9-4ec8-a068-d4b54411ac44 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:15.929913 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d5acfd5-0f5d-4840-9831-3b46577b0bc3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:15.930105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-48bd79b7-5c29-40ea-9ff1-c00e5e748746 req-2d77b82e-24a9-4ec8-a068-d4b54411ac44 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:15.930366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d5acfd5-0f5d-4840-9831-3b46577b0bc3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:15.931100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d5acfd5-0f5d-4840-9831-3b46577b0bc3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:15.931581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d5acfd5-0f5d-4840-9831-3b46577b0bc3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:15.932010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d5acfd5-0f5d-4840-9831-3b46577b0bc3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:15.942455 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-48bd79b7-5c29-40ea-9ff1-c00e5e748746 req-2d77b82e-24a9-4ec8-a068-d4b54411ac44 service nova] Creating event network-changed:3a8fc0a7-df8f-45f7-a782-b19007b79abf for instance 164ee53b-28aa-4e9f-9a36-0430f6473326 on n-h1-839401-11 Aug 29 16:44:15.948126 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-48bd79b7-5c29-40ea-9ff1-c00e5e748746 req-2d77b82e-24a9-4ec8-a068-d4b54411ac44 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033954 Aug 29 16:44:15.949434 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3966/8151] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:16.082245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9d5acfd5-0f5d-4840-9831-3b46577b0bc3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:16.090669 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d5acfd5-0f5d-4840-9831-3b46577b0bc3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1563 microversion: 2.1 time: 0.179696 Aug 29 16:44:16.091534 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4186/8152] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:15 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:51.452795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:51.453950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=38 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:51.459332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7904c4e4-7b14-49b9-9411-efe281653e30 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:51.461683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7904c4e4-7b14-49b9-9411-efe281653e30 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:51.468856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7904c4e4-7b14-49b9-9411-efe281653e30 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:51.469413 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7904c4e4-7b14-49b9-9411-efe281653e30 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:51.469855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7904c4e4-7b14-49b9-9411-efe281653e30 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:51.470561 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7904c4e4-7b14-49b9-9411-efe281653e30 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:51.471019 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7904c4e4-7b14-49b9-9411-efe281653e30 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:51.471446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7904c4e4-7b14-49b9-9411-efe281653e30 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:51.550996 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7904c4e4-7b14-49b9-9411-efe281653e30 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326/action" status: 200 len: 24571 microversion: 2.1 time: 0.102008 Aug 29 16:44:51.551917 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3967/8153] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:44:51 2022] POST /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326/action => generated 24571 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:45:30.365060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:30.366371 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=36 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:30.370903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6d96801d-02ad-4177-a1c9-ace9815b3a49 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:45:30.373226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6d96801d-02ad-4177-a1c9-ace9815b3a49 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:30.380273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d96801d-02ad-4177-a1c9-ace9815b3a49 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:30.380786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d96801d-02ad-4177-a1c9-ace9815b3a49 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:30.381291 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d96801d-02ad-4177-a1c9-ace9815b3a49 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:30.382027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d96801d-02ad-4177-a1c9-ace9815b3a49 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:30.382508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d96801d-02ad-4177-a1c9-ace9815b3a49 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:30.382956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d96801d-02ad-4177-a1c9-ace9815b3a49 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:30.462683 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6d96801d-02ad-4177-a1c9-ace9815b3a49 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326/action" status: 202 len: 0 microversion: 2.1 time: 0.100421 Aug 29 16:45:30.463367 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4187/8154] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:45:30 2022] POST /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:45:30.473426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-065a675b-c201-4eb0-804b-05193509cdaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:30.474117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-065a675b-c201-4eb0-804b-05193509cdaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:30.476714 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:30.477404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:30.484161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-065a675b-c201-4eb0-804b-05193509cdaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:30.484705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-065a675b-c201-4eb0-804b-05193509cdaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:30.485247 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-065a675b-c201-4eb0-804b-05193509cdaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:30.486644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-065a675b-c201-4eb0-804b-05193509cdaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:30.487107 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-065a675b-c201-4eb0-804b-05193509cdaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:30.487674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-065a675b-c201-4eb0-804b-05193509cdaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:30.718684 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-065a675b-c201-4eb0-804b-05193509cdaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:30.727000 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-065a675b-c201-4eb0-804b-05193509cdaa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1674 microversion: 2.1 time: 0.258287 Aug 29 16:45:30.727590 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3968/8155] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:30 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1674 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:31.753938 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eb82732e-3755-4d28-9dfa-a1ed6e848ed9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:31.754934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eb82732e-3755-4d28-9dfa-a1ed6e848ed9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:31.764407 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb82732e-3755-4d28-9dfa-a1ed6e848ed9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:31.765146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb82732e-3755-4d28-9dfa-a1ed6e848ed9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:31.765848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb82732e-3755-4d28-9dfa-a1ed6e848ed9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:31.766884 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb82732e-3755-4d28-9dfa-a1ed6e848ed9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:31.767681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb82732e-3755-4d28-9dfa-a1ed6e848ed9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:31.768285 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eb82732e-3755-4d28-9dfa-a1ed6e848ed9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:31.910754 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eb82732e-3755-4d28-9dfa-a1ed6e848ed9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:31.918999 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eb82732e-3755-4d28-9dfa-a1ed6e848ed9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1679 microversion: 2.1 time: 0.172984 Aug 29 16:45:31.919591 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4188/8156] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:31 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:32.947441 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d3ff6b1b-2158-4b88-98e2-b8f0228b3f8b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:32.948036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d3ff6b1b-2158-4b88-98e2-b8f0228b3f8b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:32.956690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3ff6b1b-2158-4b88-98e2-b8f0228b3f8b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:32.957309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3ff6b1b-2158-4b88-98e2-b8f0228b3f8b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:32.957806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3ff6b1b-2158-4b88-98e2-b8f0228b3f8b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:32.958665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3ff6b1b-2158-4b88-98e2-b8f0228b3f8b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:32.959204 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3ff6b1b-2158-4b88-98e2-b8f0228b3f8b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:32.959705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d3ff6b1b-2158-4b88-98e2-b8f0228b3f8b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:33.111372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d3ff6b1b-2158-4b88-98e2-b8f0228b3f8b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:33.119469 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d3ff6b1b-2158-4b88-98e2-b8f0228b3f8b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1679 microversion: 2.1 time: 0.177385 Aug 29 16:45:33.120022 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3969/8157] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:32 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:34.145023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5192bb00-fc4d-459a-8c3c-3d0f18d19808 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:34.145940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5192bb00-fc4d-459a-8c3c-3d0f18d19808 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:34.154028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5192bb00-fc4d-459a-8c3c-3d0f18d19808 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:34.154551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5192bb00-fc4d-459a-8c3c-3d0f18d19808 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:34.154994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5192bb00-fc4d-459a-8c3c-3d0f18d19808 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:34.155702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5192bb00-fc4d-459a-8c3c-3d0f18d19808 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:34.156177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5192bb00-fc4d-459a-8c3c-3d0f18d19808 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:34.156620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5192bb00-fc4d-459a-8c3c-3d0f18d19808 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:34.293600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5192bb00-fc4d-459a-8c3c-3d0f18d19808 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:34.305580 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5192bb00-fc4d-459a-8c3c-3d0f18d19808 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1679 microversion: 2.1 time: 0.167017 Aug 29 16:45:34.306154 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4189/8158] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:34 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:35.335015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-131dc4bd-6700-4d3f-97f5-21adcb1d7d71 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:35.336098 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-131dc4bd-6700-4d3f-97f5-21adcb1d7d71 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:35.347835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-131dc4bd-6700-4d3f-97f5-21adcb1d7d71 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:35.348646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-131dc4bd-6700-4d3f-97f5-21adcb1d7d71 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:35.349457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-131dc4bd-6700-4d3f-97f5-21adcb1d7d71 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:35.350623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-131dc4bd-6700-4d3f-97f5-21adcb1d7d71 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:35.351263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-131dc4bd-6700-4d3f-97f5-21adcb1d7d71 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:35.351692 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-131dc4bd-6700-4d3f-97f5-21adcb1d7d71 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:35.501157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-131dc4bd-6700-4d3f-97f5-21adcb1d7d71 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:35.513549 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-131dc4bd-6700-4d3f-97f5-21adcb1d7d71 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1679 microversion: 2.1 time: 0.185020 Aug 29 16:45:35.514347 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3970/8159] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:35 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:36.538582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e5d906ed-ccb3-48da-ae8a-9e816d65b4f2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:36.539193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e5d906ed-ccb3-48da-ae8a-9e816d65b4f2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:36.546555 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5d906ed-ccb3-48da-ae8a-9e816d65b4f2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:36.547054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5d906ed-ccb3-48da-ae8a-9e816d65b4f2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:36.547495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5d906ed-ccb3-48da-ae8a-9e816d65b4f2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:36.548198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5d906ed-ccb3-48da-ae8a-9e816d65b4f2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:36.548661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5d906ed-ccb3-48da-ae8a-9e816d65b4f2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:36.549115 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e5d906ed-ccb3-48da-ae8a-9e816d65b4f2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:36.691401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e5d906ed-ccb3-48da-ae8a-9e816d65b4f2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:36.701050 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e5d906ed-ccb3-48da-ae8a-9e816d65b4f2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1679 microversion: 2.1 time: 0.166156 Aug 29 16:45:36.701700 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4190/8160] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:36 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:37.727213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-811341d2-34f8-4a2f-b530-9d4347bb8ec4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:37.728233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-811341d2-34f8-4a2f-b530-9d4347bb8ec4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:37.739834 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811341d2-34f8-4a2f-b530-9d4347bb8ec4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:37.740624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811341d2-34f8-4a2f-b530-9d4347bb8ec4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:37.741728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811341d2-34f8-4a2f-b530-9d4347bb8ec4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:37.742476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811341d2-34f8-4a2f-b530-9d4347bb8ec4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:37.742937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811341d2-34f8-4a2f-b530-9d4347bb8ec4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:37.743363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-811341d2-34f8-4a2f-b530-9d4347bb8ec4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:37.887548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-811341d2-34f8-4a2f-b530-9d4347bb8ec4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:37.895855 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-811341d2-34f8-4a2f-b530-9d4347bb8ec4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1679 microversion: 2.1 time: 0.175654 Aug 29 16:45:37.896436 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3971/8161] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:37 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:38.922010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-63579922-719a-4e4f-a422-0412691f8fc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:38.923087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-63579922-719a-4e4f-a422-0412691f8fc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:38.934909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63579922-719a-4e4f-a422-0412691f8fc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:38.935749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63579922-719a-4e4f-a422-0412691f8fc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:38.936644 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63579922-719a-4e4f-a422-0412691f8fc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:38.937760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63579922-719a-4e4f-a422-0412691f8fc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:38.938556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63579922-719a-4e4f-a422-0412691f8fc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:38.939353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-63579922-719a-4e4f-a422-0412691f8fc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:39.089110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-63579922-719a-4e4f-a422-0412691f8fc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:39.097168 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-63579922-719a-4e4f-a422-0412691f8fc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1679 microversion: 2.1 time: 0.181861 Aug 29 16:45:39.097662 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4191/8162] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:38 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:40.120612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-66b6c059-1845-406f-9b2e-b15d17661080 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:40.121303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-66b6c059-1845-406f-9b2e-b15d17661080 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:40.130339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b6c059-1845-406f-9b2e-b15d17661080 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:40.130983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b6c059-1845-406f-9b2e-b15d17661080 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:40.131560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b6c059-1845-406f-9b2e-b15d17661080 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:40.132460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b6c059-1845-406f-9b2e-b15d17661080 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:40.133117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b6c059-1845-406f-9b2e-b15d17661080 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:40.133784 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66b6c059-1845-406f-9b2e-b15d17661080 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:40.279810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-66b6c059-1845-406f-9b2e-b15d17661080 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:40.288387 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-66b6c059-1845-406f-9b2e-b15d17661080 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1679 microversion: 2.1 time: 0.173079 Aug 29 16:45:40.288972 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3972/8163] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:40 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:41.314062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c82ea909-8102-4f9d-a168-80883eb9867d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:41.315054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c82ea909-8102-4f9d-a168-80883eb9867d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:41.324358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c82ea909-8102-4f9d-a168-80883eb9867d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:41.324860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c82ea909-8102-4f9d-a168-80883eb9867d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:41.325345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c82ea909-8102-4f9d-a168-80883eb9867d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:41.326399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c82ea909-8102-4f9d-a168-80883eb9867d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:41.326863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c82ea909-8102-4f9d-a168-80883eb9867d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:41.327297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c82ea909-8102-4f9d-a168-80883eb9867d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:41.471216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c82ea909-8102-4f9d-a168-80883eb9867d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:41.479320 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c82ea909-8102-4f9d-a168-80883eb9867d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1679 microversion: 2.1 time: 0.171974 Aug 29 16:45:41.479897 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4192/8164] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:41 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:42.504908 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7e012c30-58cf-4859-a4ce-42df41c6d784 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:42.506121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7e012c30-58cf-4859-a4ce-42df41c6d784 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:42.513897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e012c30-58cf-4859-a4ce-42df41c6d784 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:42.514389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e012c30-58cf-4859-a4ce-42df41c6d784 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:42.514831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e012c30-58cf-4859-a4ce-42df41c6d784 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:42.515536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e012c30-58cf-4859-a4ce-42df41c6d784 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:42.515991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e012c30-58cf-4859-a4ce-42df41c6d784 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:42.516431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7e012c30-58cf-4859-a4ce-42df41c6d784 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:42.665228 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7e012c30-58cf-4859-a4ce-42df41c6d784 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:42.674118 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7e012c30-58cf-4859-a4ce-42df41c6d784 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1682 microversion: 2.1 time: 0.175893 Aug 29 16:45:42.674710 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3973/8165] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:42 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:18.955825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-685ea443-0a47-4a47-a9ba-632e70115a09 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:18.958088 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-685ea443-0a47-4a47-a9ba-632e70115a09 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:18.960442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=12 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:18.961180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:18.966980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-685ea443-0a47-4a47-a9ba-632e70115a09 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:18.967479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-685ea443-0a47-4a47-a9ba-632e70115a09 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:18.967932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-685ea443-0a47-4a47-a9ba-632e70115a09 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:18.968653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-685ea443-0a47-4a47-a9ba-632e70115a09 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:18.969154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-685ea443-0a47-4a47-a9ba-632e70115a09 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:18.969620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-685ea443-0a47-4a47-a9ba-632e70115a09 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:19.050559 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-685ea443-0a47-4a47-a9ba-632e70115a09 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326/action" status: 200 len: 68899 microversion: 2.1 time: 0.098492 Aug 29 16:46:19.051520 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4193/8166] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:46:18 2022] POST /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326/action => generated 68899 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:46:36.139006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-53da842b-eb34-4cad-9353-9fb4b7a8db46 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:36.139556 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-53da842b-eb34-4cad-9353-9fb4b7a8db46 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:36.143350 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:46:36.143499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:36.143878 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 16:46:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 (ip 10.222.0.62) !!! Aug 29 16:46:36.144490 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:46:36.144815 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 16:46:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 (ip 10.222.0.62) !!! Aug 29 16:46:36.146167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:36.147438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=36 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:36.147570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:36.155010 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53da842b-eb34-4cad-9353-9fb4b7a8db46 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:36.155782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53da842b-eb34-4cad-9353-9fb4b7a8db46 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:36.156460 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53da842b-eb34-4cad-9353-9fb4b7a8db46 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:36.157482 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53da842b-eb34-4cad-9353-9fb4b7a8db46 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:36.157950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53da842b-eb34-4cad-9353-9fb4b7a8db46 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:36.158392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-53da842b-eb34-4cad-9353-9fb4b7a8db46 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:36.192068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-53da842b-eb34-4cad-9353-9fb4b7a8db46 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:46:36.215980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-dcb7e358-b8b5-4844-86ee-896290849785 req-f50b0d75-9d7f-4378-89af-fd5536ce0eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164ee53b-28aa-4e9f-9a36-0430f6473326", "tag": "3a8fc0a7-df8f-45f7-a782-b19007b79abf"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:36.228071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dcb7e358-b8b5-4844-86ee-896290849785 req-f50b0d75-9d7f-4378-89af-fd5536ce0eb7 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:36.228657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dcb7e358-b8b5-4844-86ee-896290849785 req-f50b0d75-9d7f-4378-89af-fd5536ce0eb7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:36.229317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-dcb7e358-b8b5-4844-86ee-896290849785 req-f50b0d75-9d7f-4378-89af-fd5536ce0eb7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:36.242376 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-dcb7e358-b8b5-4844-86ee-896290849785 req-f50b0d75-9d7f-4378-89af-fd5536ce0eb7 service nova] Creating event network-changed:3a8fc0a7-df8f-45f7-a782-b19007b79abf for instance 164ee53b-28aa-4e9f-9a36-0430f6473326 on n-h1-839401-11 Aug 29 16:46:36.248337 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-dcb7e358-b8b5-4844-86ee-896290849785 req-f50b0d75-9d7f-4378-89af-fd5536ce0eb7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110967 Aug 29 16:46:36.249518 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4194/8167] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:46:36.281101 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-53da842b-eb34-4cad-9353-9fb4b7a8db46 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "DELETE /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 204 len: 0 microversion: 2.1 time: 0.145938 Aug 29 16:46:36.281926 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3974/8168] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:46:36 2022] DELETE /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:46:36.291003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c61ec654-8bc5-455c-b248-ce34fd72d20b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:36.291725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c61ec654-8bc5-455c-b248-ce34fd72d20b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:36.299031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c61ec654-8bc5-455c-b248-ce34fd72d20b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:36.299541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c61ec654-8bc5-455c-b248-ce34fd72d20b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:36.300418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c61ec654-8bc5-455c-b248-ce34fd72d20b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:36.301869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c61ec654-8bc5-455c-b248-ce34fd72d20b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:36.302356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c61ec654-8bc5-455c-b248-ce34fd72d20b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:36.302808 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c61ec654-8bc5-455c-b248-ce34fd72d20b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:36.442025 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c61ec654-8bc5-455c-b248-ce34fd72d20b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:36.450198 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c61ec654-8bc5-455c-b248-ce34fd72d20b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1688 microversion: 2.1 time: 0.163655 Aug 29 16:46:36.450871 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4195/8169] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:36 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:46:37.476968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ce619c92-5a43-4a07-b28a-d3da0e1051ce tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:37.478106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ce619c92-5a43-4a07-b28a-d3da0e1051ce tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:37.490170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce619c92-5a43-4a07-b28a-d3da0e1051ce tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:37.490990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce619c92-5a43-4a07-b28a-d3da0e1051ce tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:37.491723 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce619c92-5a43-4a07-b28a-d3da0e1051ce tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:37.492694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce619c92-5a43-4a07-b28a-d3da0e1051ce tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:37.493188 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce619c92-5a43-4a07-b28a-d3da0e1051ce tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:37.493625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ce619c92-5a43-4a07-b28a-d3da0e1051ce tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:37.713485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ce619c92-5a43-4a07-b28a-d3da0e1051ce tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:37.721847 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ce619c92-5a43-4a07-b28a-d3da0e1051ce tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1688 microversion: 2.1 time: 0.252176 Aug 29 16:46:37.722752 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3975/8170] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:37 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1688 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:38.563802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-0cee49ad-70b1-4547-9f84-6364b125d131 req-7066349b-6fe2-4860-b06b-bcf07c508b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164ee53b-28aa-4e9f-9a36-0430f6473326", "name": "network-vif-deleted", "tag": "3a8fc0a7-df8f-45f7-a782-b19007b79abf"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:38.574824 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0cee49ad-70b1-4547-9f84-6364b125d131 req-7066349b-6fe2-4860-b06b-bcf07c508b52 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:38.575311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0cee49ad-70b1-4547-9f84-6364b125d131 req-7066349b-6fe2-4860-b06b-bcf07c508b52 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:38.575748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-0cee49ad-70b1-4547-9f84-6364b125d131 req-7066349b-6fe2-4860-b06b-bcf07c508b52 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:38.587075 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-0cee49ad-70b1-4547-9f84-6364b125d131 req-7066349b-6fe2-4860-b06b-bcf07c508b52 service nova] Creating event network-vif-deleted:3a8fc0a7-df8f-45f7-a782-b19007b79abf for instance 164ee53b-28aa-4e9f-9a36-0430f6473326 on n-h1-839401-11 Aug 29 16:46:38.592422 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-0cee49ad-70b1-4547-9f84-6364b125d131 req-7066349b-6fe2-4860-b06b-bcf07c508b52 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032269 Aug 29 16:46:38.593060 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4196/8171] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:46:38.743898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-99f9166f-9eb8-43d3-bea9-582e3ed4a5b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:38.744543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-99f9166f-9eb8-43d3-bea9-582e3ed4a5b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:38.751802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99f9166f-9eb8-43d3-bea9-582e3ed4a5b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:38.752295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99f9166f-9eb8-43d3-bea9-582e3ed4a5b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:38.752740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99f9166f-9eb8-43d3-bea9-582e3ed4a5b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:38.753476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99f9166f-9eb8-43d3-bea9-582e3ed4a5b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:38.753937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99f9166f-9eb8-43d3-bea9-582e3ed4a5b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:38.754371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99f9166f-9eb8-43d3-bea9-582e3ed4a5b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:38.786976 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99f9166f-9eb8-43d3-bea9-582e3ed4a5b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:38.787459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99f9166f-9eb8-43d3-bea9-582e3ed4a5b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:38.787893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-99f9166f-9eb8-43d3-bea9-582e3ed4a5b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:38.788343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-99f9166f-9eb8-43d3-bea9-582e3ed4a5b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lazy-loading 'fault' on Instance uuid 164ee53b-28aa-4e9f-9a36-0430f6473326 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:46:38.830184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-99f9166f-9eb8-43d3-bea9-582e3ed4a5b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:38.838758 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-99f9166f-9eb8-43d3-bea9-582e3ed4a5b7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 200 len: 1357 microversion: 2.1 time: 0.099172 Aug 29 16:46:38.839385 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3976/8172] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:38 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 1357 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:39.862810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec8a4a53-40c5-42f0-b8c3-fb6b0a10d31a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:39.863546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ec8a4a53-40c5-42f0-b8c3-fb6b0a10d31a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 164ee53b-28aa-4e9f-9a36-0430f6473326] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:39.870546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec8a4a53-40c5-42f0-b8c3-fb6b0a10d31a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:39.871044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec8a4a53-40c5-42f0-b8c3-fb6b0a10d31a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:39.871497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec8a4a53-40c5-42f0-b8c3-fb6b0a10d31a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:39.872213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec8a4a53-40c5-42f0-b8c3-fb6b0a10d31a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:39.872684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec8a4a53-40c5-42f0-b8c3-fb6b0a10d31a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:39.873146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec8a4a53-40c5-42f0-b8c3-fb6b0a10d31a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:39.887659 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-ec8a4a53-40c5-42f0-b8c3-fb6b0a10d31a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] HTTP exception thrown: Instance 164ee53b-28aa-4e9f-9a36-0430f6473326 could not be found. Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec8a4a53-40c5-42f0-b8c3-fb6b0a10d31a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Request method failure captured: Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 HTTP/1.1 Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOxhtoEToS3nQ4x7iVmKQZTqOC8mawYKijdPvY6Bh_MTssjj9rVe4heRLLbq4FF58bMfx8T4Eb3qq5MMGmLVsYPUFPe-ZvbGjTL-Bxl7OoI6lDRIRmK3ropbwVWSh1BWN2psc293apISyO1eYL1oyiROFjCcWD6TQJA8ehzovaaRd9w Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 3c4a511b63e449ad84d6b8172efa8f26 Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1448564924 Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3c4a511b63e449ad84d6b8172efa8f26", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3c4a511b63e449ad84d6b8172efa8f26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3c4a511b63e449ad84d6b8172efa8f26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3c4a511b63e449ad84d6b8172efa8f26"}]}] Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1448564924 Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 3c4a511b63e449ad84d6b8172efa8f26 Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1448564924 Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestNetworkAdvancedServerOps-1448564924-project Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: c9565af0dfd0482f887f0eea2f3a1f4e Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1448564924-project Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 164ee53b-28aa-4e9f-9a36-0430f6473326 could not be found. Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '164ee53b-28aa-4e9f-9a36-0430f6473326'} Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164ee53b-28aa-4e9f-9a36-0430f6473326 could not be found. Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164ee53b-28aa-4e9f-9a36-0430f6473326 could not be found. Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:46:39.889367 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:46:39.894508 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:46:39.894508 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:46:39.894508 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:46:39.894508 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:46:39.894508 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:46:39.894508 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:46:39.894508 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164ee53b-28aa-4e9f-9a36-0430f6473326 could not be found. Aug 29 16:46:39.894508 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:46:39.894508 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec8a4a53-40c5-42f0-b8c3-fb6b0a10d31a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Returning 404 to user: Instance 164ee53b-28aa-4e9f-9a36-0430f6473326 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:46:39.894508 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ec8a4a53-40c5-42f0-b8c3-fb6b0a10d31a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326" status: 404 len: 111 microversion: 2.1 time: 0.033249 Aug 29 16:46:39.894508 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4197/8173] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:39 2022] GET /compute/v2.1/servers/164ee53b-28aa-4e9f-9a36-0430f6473326 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:46:43.337515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-477f68d0-b488-470e-8c81-c3b0da327bc3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '.version_select at 0x7fc42a5f3040>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:43.363305 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-477f68d0-b488-470e-8c81-c3b0da327bc3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1786312072" status: 202 len: 0 microversion: 2.1 time: 0.029656 Aug 29 16:46:43.364429 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3977/8174] 10.222.0.62 () {58 vars in 1284 bytes} [Mon Aug 29 16:46:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1786312072 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:46:43.390888 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7078cbba-ffe5-4508-8180-7d1fa85b3660 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'create', calling method: .version_select at 0x7fc42a5b69d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1812797133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJIPnreHozaeOS+USWWiDkFeS5EIDnLJbqFYQ/zysRl9Ja/k0WONYwiIzIUITW+N4djCCfiN05Ex6RNw7PMVZe4PEbo0PjtXowWPq2KwLJ4wxPFg6bs7mgM9CwjluZI8Q=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:43.409432 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-7078cbba-ffe5-4508-8180-7d1fa85b3660 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:46:43.414640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-7078cbba-ffe5-4508-8180-7d1fa85b3660 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for user c9565af0dfd0482f887f0eea2f3a1f4e and project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:46:43.427886 n-d-839401-11 devstack@n-api.service[122360]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7078cbba-ffe5-4508-8180-7d1fa85b3660 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [c4fea839-36b3-431f-8bb6-ddea9bf9c77e] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:46:44.436179 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [None req-7078cbba-ffe5-4508-8180-7d1fa85b3660 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [c4fea839-36b3-431f-8bb6-ddea9bf9c77e] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 42338. Aug 29 16:46:44.454977 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7078cbba-ffe5-4508-8180-7d1fa85b3660 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.069586 Aug 29 16:46:44.455645 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4198/8175] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:46:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:46:50.349008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:50.353625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1274844094", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "6d9c557a-727a-42f9-b613-aa58a807f8d9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1812797133", "security_groups": [{"name": "tempest-secgroup-smoke-425500126"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:50.472469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] validate_networks() for [('6d9c557a-727a-42f9-b613-aa58a807f8d9', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:46:50.906975 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:46:50.907881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:46:50.908437 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:46:50.908957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:46:50.909521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:46:50.919533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:50.920123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:50.920632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:50.921515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:50.922478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:50.922985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:50.951090 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:46:50.958980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for user c9565af0dfd0482f887f0eea2f3a1f4e and project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:46:50.980349 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:46:50.983791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:46:51.042571 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2176a652-1361-4e4d-9f82-6ba217317df2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.695401 Aug 29 16:46:51.049414 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3978/8176] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:46:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:46:51.052653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=12 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:51.058701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ef45d901-2ba9-41f3-95ca-a64fe77888e3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:51.059336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ef45d901-2ba9-41f3-95ca-a64fe77888e3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:51.132597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ef45d901-2ba9-41f3-95ca-a64fe77888e3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:51.147842 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ef45d901-2ba9-41f3-95ca-a64fe77888e3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1267 microversion: 2.1 time: 0.096881 Aug 29 16:46:51.149033 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4199/8177] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:51 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:52.169646 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dc05ccc2-5dfb-49ee-b6d3-ef4dd0117d3d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:52.170255 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dc05ccc2-5dfb-49ee-b6d3-ef4dd0117d3d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:52.176978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc05ccc2-5dfb-49ee-b6d3-ef4dd0117d3d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:52.177726 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc05ccc2-5dfb-49ee-b6d3-ef4dd0117d3d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:52.178367 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc05ccc2-5dfb-49ee-b6d3-ef4dd0117d3d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:52.179480 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc05ccc2-5dfb-49ee-b6d3-ef4dd0117d3d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:52.180376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc05ccc2-5dfb-49ee-b6d3-ef4dd0117d3d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:52.180970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dc05ccc2-5dfb-49ee-b6d3-ef4dd0117d3d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:52.311890 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-dc05ccc2-5dfb-49ee-b6d3-ef4dd0117d3d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:52.328495 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dc05ccc2-5dfb-49ee-b6d3-ef4dd0117d3d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1327 microversion: 2.1 time: 0.163940 Aug 29 16:46:52.369277 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3979/8178] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:52 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1327 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:53.358434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1157371f-67d2-4b00-845f-bca678b46e2b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:53.359071 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1157371f-67d2-4b00-845f-bca678b46e2b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:53.366189 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1157371f-67d2-4b00-845f-bca678b46e2b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:53.367750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1157371f-67d2-4b00-845f-bca678b46e2b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:53.368213 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1157371f-67d2-4b00-845f-bca678b46e2b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:53.368943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1157371f-67d2-4b00-845f-bca678b46e2b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:53.369470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1157371f-67d2-4b00-845f-bca678b46e2b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:53.369946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1157371f-67d2-4b00-845f-bca678b46e2b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:53.987615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1157371f-67d2-4b00-845f-bca678b46e2b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:53.995948 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1157371f-67d2-4b00-845f-bca678b46e2b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1392 microversion: 2.1 time: 0.641529 Aug 29 16:46:53.996624 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4200/8179] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:53 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1392 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:46:54.381587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-7e501b79-95c0-47cb-b6c1-53d3a0cc2433 req-99662737-6873-4b7d-ad66-db01495ae0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e784ac66-7b09-478a-ad55-612180e35737", "tag": "cda2e8f5-fb47-4eef-a0b5-c3c75d7c8444"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:54.391475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7e501b79-95c0-47cb-b6c1-53d3a0cc2433 req-99662737-6873-4b7d-ad66-db01495ae0a4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:54.391959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7e501b79-95c0-47cb-b6c1-53d3a0cc2433 req-99662737-6873-4b7d-ad66-db01495ae0a4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:54.392394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-7e501b79-95c0-47cb-b6c1-53d3a0cc2433 req-99662737-6873-4b7d-ad66-db01495ae0a4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:54.403534 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-7e501b79-95c0-47cb-b6c1-53d3a0cc2433 req-99662737-6873-4b7d-ad66-db01495ae0a4 service nova] Creating event network-changed:cda2e8f5-fb47-4eef-a0b5-c3c75d7c8444 for instance e784ac66-7b09-478a-ad55-612180e35737 on n-h2-839401-11 Aug 29 16:46:54.408525 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-7e501b79-95c0-47cb-b6c1-53d3a0cc2433 req-99662737-6873-4b7d-ad66-db01495ae0a4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099273 Aug 29 16:46:54.409179 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3980/8180] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:46:55.021240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9b32d845-1466-47d9-8f7b-e611172af53e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:55.022220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9b32d845-1466-47d9-8f7b-e611172af53e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:55.029939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b32d845-1466-47d9-8f7b-e611172af53e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:55.030442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b32d845-1466-47d9-8f7b-e611172af53e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:55.030868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b32d845-1466-47d9-8f7b-e611172af53e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:55.031615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b32d845-1466-47d9-8f7b-e611172af53e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:55.032087 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b32d845-1466-47d9-8f7b-e611172af53e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:55.032531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9b32d845-1466-47d9-8f7b-e611172af53e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:55.178055 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9b32d845-1466-47d9-8f7b-e611172af53e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:55.187155 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9b32d845-1466-47d9-8f7b-e611172af53e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1392 microversion: 2.1 time: 0.172593 Aug 29 16:46:55.187754 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4201/8181] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:55 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:56.209742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b7724d9f-08f4-4872-b9a4-6a826015f285 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:56.210448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b7724d9f-08f4-4872-b9a4-6a826015f285 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:56.216927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7724d9f-08f4-4872-b9a4-6a826015f285 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:56.217453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7724d9f-08f4-4872-b9a4-6a826015f285 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:56.217896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7724d9f-08f4-4872-b9a4-6a826015f285 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:56.218604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7724d9f-08f4-4872-b9a4-6a826015f285 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:56.219060 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7724d9f-08f4-4872-b9a4-6a826015f285 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:56.219493 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7724d9f-08f4-4872-b9a4-6a826015f285 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:56.366598 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b7724d9f-08f4-4872-b9a4-6a826015f285 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:56.375182 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b7724d9f-08f4-4872-b9a4-6a826015f285 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1392 microversion: 2.1 time: 0.170743 Aug 29 16:46:56.375792 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3981/8182] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:56 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:57.403671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-eef5dd4d-9b4f-464c-886d-fcd4f8a50a40 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:57.404417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-eef5dd4d-9b4f-464c-886d-fcd4f8a50a40 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:57.411959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eef5dd4d-9b4f-464c-886d-fcd4f8a50a40 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:57.412547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eef5dd4d-9b4f-464c-886d-fcd4f8a50a40 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:57.413011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eef5dd4d-9b4f-464c-886d-fcd4f8a50a40 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:57.413773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eef5dd4d-9b4f-464c-886d-fcd4f8a50a40 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:57.414253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eef5dd4d-9b4f-464c-886d-fcd4f8a50a40 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:57.414700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-eef5dd4d-9b4f-464c-886d-fcd4f8a50a40 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:57.560484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-eef5dd4d-9b4f-464c-886d-fcd4f8a50a40 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:57.569131 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-eef5dd4d-9b4f-464c-886d-fcd4f8a50a40 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1392 microversion: 2.1 time: 0.169606 Aug 29 16:46:57.569718 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4202/8183] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:57 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:58.593352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c407cc27-05e2-4ef5-94f9-9280bf426dbd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:58.593931 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c407cc27-05e2-4ef5-94f9-9280bf426dbd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:58.600947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c407cc27-05e2-4ef5-94f9-9280bf426dbd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:58.601552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c407cc27-05e2-4ef5-94f9-9280bf426dbd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:58.601995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c407cc27-05e2-4ef5-94f9-9280bf426dbd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:58.602693 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c407cc27-05e2-4ef5-94f9-9280bf426dbd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:58.603153 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c407cc27-05e2-4ef5-94f9-9280bf426dbd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:58.603654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c407cc27-05e2-4ef5-94f9-9280bf426dbd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:58.746192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c407cc27-05e2-4ef5-94f9-9280bf426dbd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:58.754674 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c407cc27-05e2-4ef5-94f9-9280bf426dbd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1392 microversion: 2.1 time: 0.167070 Aug 29 16:46:58.755264 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3982/8184] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:58 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:59.703601 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-2db8510f-3202-487b-8658-7ec262673d8e req-2937a32b-90bc-4a24-88fd-046f39be0104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e784ac66-7b09-478a-ad55-612180e35737", "name": "network-vif-plugged", "status": "completed", "tag": "cda2e8f5-fb47-4eef-a0b5-c3c75d7c8444"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:59.713958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2db8510f-3202-487b-8658-7ec262673d8e req-2937a32b-90bc-4a24-88fd-046f39be0104 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:59.714462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2db8510f-3202-487b-8658-7ec262673d8e req-2937a32b-90bc-4a24-88fd-046f39be0104 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:59.714918 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-2db8510f-3202-487b-8658-7ec262673d8e req-2937a32b-90bc-4a24-88fd-046f39be0104 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:59.726277 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-2db8510f-3202-487b-8658-7ec262673d8e req-2937a32b-90bc-4a24-88fd-046f39be0104 service nova] Creating event network-vif-plugged:cda2e8f5-fb47-4eef-a0b5-c3c75d7c8444 for instance e784ac66-7b09-478a-ad55-612180e35737 on n-h2-839401-11 Aug 29 16:46:59.731715 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-2db8510f-3202-487b-8658-7ec262673d8e req-2937a32b-90bc-4a24-88fd-046f39be0104 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031995 Aug 29 16:46:59.732587 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4203/8185] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:46:59.775036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e15b9b43-57ff-4e4d-ab07-ba70331e7092 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:59.775731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e15b9b43-57ff-4e4d-ab07-ba70331e7092 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:59.782815 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e15b9b43-57ff-4e4d-ab07-ba70331e7092 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:59.783369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e15b9b43-57ff-4e4d-ab07-ba70331e7092 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:59.783751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e15b9b43-57ff-4e4d-ab07-ba70331e7092 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:59.784457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e15b9b43-57ff-4e4d-ab07-ba70331e7092 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:59.784914 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e15b9b43-57ff-4e4d-ab07-ba70331e7092 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:59.785376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e15b9b43-57ff-4e4d-ab07-ba70331e7092 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:59.937203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e15b9b43-57ff-4e4d-ab07-ba70331e7092 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:59.949990 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e15b9b43-57ff-4e4d-ab07-ba70331e7092 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1392 microversion: 2.1 time: 0.178613 Aug 29 16:46:59.950724 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3983/8186] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:59 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:47:00.977702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6b1c5a6b-1a2b-4bc1-8971-e412a057a1a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:00.979017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6b1c5a6b-1a2b-4bc1-8971-e412a057a1a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:00.990070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b1c5a6b-1a2b-4bc1-8971-e412a057a1a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:00.990968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b1c5a6b-1a2b-4bc1-8971-e412a057a1a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:00.991752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b1c5a6b-1a2b-4bc1-8971-e412a057a1a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:00.992940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b1c5a6b-1a2b-4bc1-8971-e412a057a1a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:00.993782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b1c5a6b-1a2b-4bc1-8971-e412a057a1a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:00.994528 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6b1c5a6b-1a2b-4bc1-8971-e412a057a1a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:01.141746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:47:01.151124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6b1c5a6b-1a2b-4bc1-8971-e412a057a1a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:01.159079 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6b1c5a6b-1a2b-4bc1-8971-e412a057a1a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1392 microversion: 2.1 time: 0.190329 Aug 29 16:47:01.159659 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4204/8187] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:00 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1392 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:02.180783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9e2230cc-70cc-4cea-b34c-a06e5898a392 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:02.181385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9e2230cc-70cc-4cea-b34c-a06e5898a392 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:02.184280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:47:02.184951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:47:02.191439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e2230cc-70cc-4cea-b34c-a06e5898a392 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:02.191926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e2230cc-70cc-4cea-b34c-a06e5898a392 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:02.192371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e2230cc-70cc-4cea-b34c-a06e5898a392 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:02.193052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e2230cc-70cc-4cea-b34c-a06e5898a392 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:02.193530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e2230cc-70cc-4cea-b34c-a06e5898a392 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:02.193985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9e2230cc-70cc-4cea-b34c-a06e5898a392 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:02.341851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9e2230cc-70cc-4cea-b34c-a06e5898a392 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:02.350164 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9e2230cc-70cc-4cea-b34c-a06e5898a392 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1564 microversion: 2.1 time: 0.173510 Aug 29 16:47:02.350752 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3984/8188] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:02 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:02.370774 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8b5b1bac-ba3d-4de9-a7ba-eb27dc63c2de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:02.371397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8b5b1bac-ba3d-4de9-a7ba-eb27dc63c2de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:02.379393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b5b1bac-ba3d-4de9-a7ba-eb27dc63c2de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:02.379924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b5b1bac-ba3d-4de9-a7ba-eb27dc63c2de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:02.380369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b5b1bac-ba3d-4de9-a7ba-eb27dc63c2de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:02.381077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b5b1bac-ba3d-4de9-a7ba-eb27dc63c2de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:02.381621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b5b1bac-ba3d-4de9-a7ba-eb27dc63c2de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:02.382058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8b5b1bac-ba3d-4de9-a7ba-eb27dc63c2de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:02.529334 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8b5b1bac-ba3d-4de9-a7ba-eb27dc63c2de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:02.537262 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8b5b1bac-ba3d-4de9-a7ba-eb27dc63c2de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1564 microversion: 2.1 time: 0.170573 Aug 29 16:47:02.537854 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4205/8189] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:02 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:04.534421 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b582d3c7-bdc2-46a6-98bb-10cffbeea393 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:47:04.535035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b582d3c7-bdc2-46a6-98bb-10cffbeea393 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:04.535363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-f915808e-ffdf-4382-b56a-05531eede56c req-d8b9512e-c722-4b53-95ae-4f2bf6e82fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e784ac66-7b09-478a-ad55-612180e35737", "tag": "cda2e8f5-fb47-4eef-a0b5-c3c75d7c8444"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:47:04.542903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b582d3c7-bdc2-46a6-98bb-10cffbeea393 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:04.543819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b582d3c7-bdc2-46a6-98bb-10cffbeea393 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:04.544484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b582d3c7-bdc2-46a6-98bb-10cffbeea393 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:04.545231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b582d3c7-bdc2-46a6-98bb-10cffbeea393 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:04.545688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b582d3c7-bdc2-46a6-98bb-10cffbeea393 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:04.546340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b582d3c7-bdc2-46a6-98bb-10cffbeea393 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:04.548441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f915808e-ffdf-4382-b56a-05531eede56c req-d8b9512e-c722-4b53-95ae-4f2bf6e82fe2 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:04.549966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f915808e-ffdf-4382-b56a-05531eede56c req-d8b9512e-c722-4b53-95ae-4f2bf6e82fe2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:04.550809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f915808e-ffdf-4382-b56a-05531eede56c req-d8b9512e-c722-4b53-95ae-4f2bf6e82fe2 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:04.565882 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-f915808e-ffdf-4382-b56a-05531eede56c req-d8b9512e-c722-4b53-95ae-4f2bf6e82fe2 service nova] Creating event network-changed:cda2e8f5-fb47-4eef-a0b5-c3c75d7c8444 for instance e784ac66-7b09-478a-ad55-612180e35737 on n-h2-839401-11 Aug 29 16:47:04.571800 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-f915808e-ffdf-4382-b56a-05531eede56c req-d8b9512e-c722-4b53-95ae-4f2bf6e82fe2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040153 Aug 29 16:47:04.573686 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4206/8190] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:47:04.688552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b582d3c7-bdc2-46a6-98bb-10cffbeea393 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:47:04.696441 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b582d3c7-bdc2-46a6-98bb-10cffbeea393 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1564 microversion: 2.1 time: 0.167436 Aug 29 16:47:04.709108 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3985/8191] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:47:04 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:47:40.047389 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:47:40.048355 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:47:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737/action (ip 10.222.0.62) !!! Aug 29 16:47:40.050362 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:47:40.051175 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=34 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:47:40.108269 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-91e28856-de64-4705-bd21-d4268fe101fa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:47:40.110763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-91e28856-de64-4705-bd21-d4268fe101fa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:47:40.117643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91e28856-de64-4705-bd21-d4268fe101fa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:40.118148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91e28856-de64-4705-bd21-d4268fe101fa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:40.118608 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91e28856-de64-4705-bd21-d4268fe101fa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:40.119313 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91e28856-de64-4705-bd21-d4268fe101fa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:47:40.119787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91e28856-de64-4705-bd21-d4268fe101fa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:47:40.120232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-91e28856-de64-4705-bd21-d4268fe101fa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:47:40.190510 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-91e28856-de64-4705-bd21-d4268fe101fa tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737/action" status: 200 len: 24549 microversion: 2.1 time: 0.146772 Aug 29 16:47:40.191222 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4207/8192] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:47:40 2022] POST /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737/action => generated 24549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:48:19.116249 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:48:19.116960 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=40 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:48:19.123533 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-857a0eb0-9f8c-499e-b8e4-5a31fe495fd5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:48:19.127256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-857a0eb0-9f8c-499e-b8e4-5a31fe495fd5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:19.136769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-857a0eb0-9f8c-499e-b8e4-5a31fe495fd5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:19.137236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-857a0eb0-9f8c-499e-b8e4-5a31fe495fd5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:19.137794 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-857a0eb0-9f8c-499e-b8e4-5a31fe495fd5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:19.138524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-857a0eb0-9f8c-499e-b8e4-5a31fe495fd5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:19.139001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-857a0eb0-9f8c-499e-b8e4-5a31fe495fd5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:19.139426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-857a0eb0-9f8c-499e-b8e4-5a31fe495fd5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:19.222743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-857a0eb0-9f8c-499e-b8e4-5a31fe495fd5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:19.229606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-857a0eb0-9f8c-499e-b8e4-5a31fe495fd5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Old instance type m1.heat2, new instance type m1.heat {{(pid=122361) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:48:19.236416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-857a0eb0-9f8c-499e-b8e4-5a31fe495fd5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:48:19.236843 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-857a0eb0-9f8c-499e-b8e4-5a31fe495fd5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:48:19.237360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-857a0eb0-9f8c-499e-b8e4-5a31fe495fd5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:48:19.237775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-857a0eb0-9f8c-499e-b8e4-5a31fe495fd5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:48:19.238200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-857a0eb0-9f8c-499e-b8e4-5a31fe495fd5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:48:19.314111 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-857a0eb0-9f8c-499e-b8e4-5a31fe495fd5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737/action" status: 202 len: 0 microversion: 2.1 time: 0.200936 Aug 29 16:48:19.316450 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3986/8193] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:48:19 2022] POST /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:48:19.324767 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d42a91d4-6f3a-476e-9af9-5a88e60e2958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:19.325487 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d42a91d4-6f3a-476e-9af9-5a88e60e2958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:19.327856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:48:19.328666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:48:19.335694 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d42a91d4-6f3a-476e-9af9-5a88e60e2958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:19.336263 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d42a91d4-6f3a-476e-9af9-5a88e60e2958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:19.336751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d42a91d4-6f3a-476e-9af9-5a88e60e2958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:19.337550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d42a91d4-6f3a-476e-9af9-5a88e60e2958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:19.338329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d42a91d4-6f3a-476e-9af9-5a88e60e2958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:19.338743 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d42a91d4-6f3a-476e-9af9-5a88e60e2958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:19.478730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d42a91d4-6f3a-476e-9af9-5a88e60e2958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:19.487112 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d42a91d4-6f3a-476e-9af9-5a88e60e2958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1692 microversion: 2.1 time: 0.167392 Aug 29 16:48:19.487676 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4208/8194] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:19 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:20.512378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-20a25576-9615-4435-a612-e924fd3ecbcd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:20.513059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-20a25576-9615-4435-a612-e924fd3ecbcd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:20.524933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20a25576-9615-4435-a612-e924fd3ecbcd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:20.525474 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20a25576-9615-4435-a612-e924fd3ecbcd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:20.525916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20a25576-9615-4435-a612-e924fd3ecbcd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:20.526632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20a25576-9615-4435-a612-e924fd3ecbcd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:20.527093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20a25576-9615-4435-a612-e924fd3ecbcd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:20.527496 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-20a25576-9615-4435-a612-e924fd3ecbcd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:20.670326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-20a25576-9615-4435-a612-e924fd3ecbcd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:20.678617 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-20a25576-9615-4435-a612-e924fd3ecbcd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1692 microversion: 2.1 time: 0.173388 Aug 29 16:48:20.679149 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3987/8195] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:20 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:21.704192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7217de2d-4104-4956-a5b0-380042c106b0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:21.704769 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7217de2d-4104-4956-a5b0-380042c106b0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:21.711969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7217de2d-4104-4956-a5b0-380042c106b0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:21.712505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7217de2d-4104-4956-a5b0-380042c106b0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:21.712996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7217de2d-4104-4956-a5b0-380042c106b0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:21.713825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7217de2d-4104-4956-a5b0-380042c106b0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:21.714446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7217de2d-4104-4956-a5b0-380042c106b0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:21.714902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7217de2d-4104-4956-a5b0-380042c106b0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:21.857483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7217de2d-4104-4956-a5b0-380042c106b0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:21.865752 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7217de2d-4104-4956-a5b0-380042c106b0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1697 microversion: 2.1 time: 0.166245 Aug 29 16:48:21.866384 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4209/8196] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:21 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:22.887712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-70426325-7ead-478b-9e05-e4f3a138df3f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:22.888345 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-70426325-7ead-478b-9e05-e4f3a138df3f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:22.895734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70426325-7ead-478b-9e05-e4f3a138df3f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:22.896233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70426325-7ead-478b-9e05-e4f3a138df3f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:22.896682 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70426325-7ead-478b-9e05-e4f3a138df3f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:22.897431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70426325-7ead-478b-9e05-e4f3a138df3f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:22.897896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70426325-7ead-478b-9e05-e4f3a138df3f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:22.898327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-70426325-7ead-478b-9e05-e4f3a138df3f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:23.035595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-70426325-7ead-478b-9e05-e4f3a138df3f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:23.047448 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-70426325-7ead-478b-9e05-e4f3a138df3f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1697 microversion: 2.1 time: 0.163633 Aug 29 16:48:23.048317 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3988/8197] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:22 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:24.078991 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-381b5fce-047e-4c42-b5a1-324a8656a68f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:24.079995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-381b5fce-047e-4c42-b5a1-324a8656a68f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:24.086250 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-381b5fce-047e-4c42-b5a1-324a8656a68f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:24.086882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-381b5fce-047e-4c42-b5a1-324a8656a68f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:24.087333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-381b5fce-047e-4c42-b5a1-324a8656a68f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:24.088048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-381b5fce-047e-4c42-b5a1-324a8656a68f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:24.088721 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-381b5fce-047e-4c42-b5a1-324a8656a68f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:24.089191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-381b5fce-047e-4c42-b5a1-324a8656a68f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:24.227803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-381b5fce-047e-4c42-b5a1-324a8656a68f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:24.236162 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-381b5fce-047e-4c42-b5a1-324a8656a68f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1697 microversion: 2.1 time: 0.168293 Aug 29 16:48:24.236751 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4210/8198] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:24 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:25.260242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-862b3f24-136e-44f9-af2f-e9dc8e146291 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:25.260844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-862b3f24-136e-44f9-af2f-e9dc8e146291 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:25.268275 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-862b3f24-136e-44f9-af2f-e9dc8e146291 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:25.269008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-862b3f24-136e-44f9-af2f-e9dc8e146291 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:25.269485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-862b3f24-136e-44f9-af2f-e9dc8e146291 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:25.270194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-862b3f24-136e-44f9-af2f-e9dc8e146291 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:25.270659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-862b3f24-136e-44f9-af2f-e9dc8e146291 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:25.271100 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-862b3f24-136e-44f9-af2f-e9dc8e146291 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:25.413954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-862b3f24-136e-44f9-af2f-e9dc8e146291 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:25.422035 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-862b3f24-136e-44f9-af2f-e9dc8e146291 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1697 microversion: 2.1 time: 0.167335 Aug 29 16:48:25.422660 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3989/8199] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:25 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:26.445226 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-215ffb99-5eb8-49a8-a3ba-574eff5aa867 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:26.446245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-215ffb99-5eb8-49a8-a3ba-574eff5aa867 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:26.455225 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215ffb99-5eb8-49a8-a3ba-574eff5aa867 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:26.455850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215ffb99-5eb8-49a8-a3ba-574eff5aa867 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:26.456412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215ffb99-5eb8-49a8-a3ba-574eff5aa867 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:26.457349 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215ffb99-5eb8-49a8-a3ba-574eff5aa867 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:26.457955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215ffb99-5eb8-49a8-a3ba-574eff5aa867 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:26.458500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-215ffb99-5eb8-49a8-a3ba-574eff5aa867 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:26.608473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-215ffb99-5eb8-49a8-a3ba-574eff5aa867 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:26.617262 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-215ffb99-5eb8-49a8-a3ba-574eff5aa867 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1697 microversion: 2.1 time: 0.177164 Aug 29 16:48:26.617863 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4211/8200] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:26 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:27.643059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-66cd7b2c-01ef-4799-8bec-bede77805810 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:27.644032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-66cd7b2c-01ef-4799-8bec-bede77805810 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:27.655727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66cd7b2c-01ef-4799-8bec-bede77805810 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:27.656530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66cd7b2c-01ef-4799-8bec-bede77805810 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:27.657321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66cd7b2c-01ef-4799-8bec-bede77805810 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:27.658463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66cd7b2c-01ef-4799-8bec-bede77805810 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:27.659222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66cd7b2c-01ef-4799-8bec-bede77805810 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:27.659926 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-66cd7b2c-01ef-4799-8bec-bede77805810 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:27.805210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-66cd7b2c-01ef-4799-8bec-bede77805810 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:27.813743 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-66cd7b2c-01ef-4799-8bec-bede77805810 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1697 microversion: 2.1 time: 0.177447 Aug 29 16:48:27.814335 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3990/8201] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:27 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:28.838847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-482e8e93-9e46-42a0-91ef-2ae52b9e5958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:28.839648 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-482e8e93-9e46-42a0-91ef-2ae52b9e5958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:28.847190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-482e8e93-9e46-42a0-91ef-2ae52b9e5958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:28.847726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-482e8e93-9e46-42a0-91ef-2ae52b9e5958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:28.848168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-482e8e93-9e46-42a0-91ef-2ae52b9e5958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:28.848879 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-482e8e93-9e46-42a0-91ef-2ae52b9e5958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:28.849373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-482e8e93-9e46-42a0-91ef-2ae52b9e5958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:28.849813 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-482e8e93-9e46-42a0-91ef-2ae52b9e5958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:28.991247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-482e8e93-9e46-42a0-91ef-2ae52b9e5958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:29.003230 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-482e8e93-9e46-42a0-91ef-2ae52b9e5958 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1697 microversion: 2.1 time: 0.169853 Aug 29 16:48:29.004085 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4212/8202] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:28 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:30.030225 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f5c91ef6-6bc5-4e3a-b68d-d56c9b2a8497 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:30.031268 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f5c91ef6-6bc5-4e3a-b68d-d56c9b2a8497 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:30.043202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5c91ef6-6bc5-4e3a-b68d-d56c9b2a8497 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:30.043680 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5c91ef6-6bc5-4e3a-b68d-d56c9b2a8497 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:30.044142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5c91ef6-6bc5-4e3a-b68d-d56c9b2a8497 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:30.044861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5c91ef6-6bc5-4e3a-b68d-d56c9b2a8497 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:30.045353 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5c91ef6-6bc5-4e3a-b68d-d56c9b2a8497 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:30.045797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5c91ef6-6bc5-4e3a-b68d-d56c9b2a8497 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:30.189059 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f5c91ef6-6bc5-4e3a-b68d-d56c9b2a8497 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:30.197568 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f5c91ef6-6bc5-4e3a-b68d-d56c9b2a8497 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1697 microversion: 2.1 time: 0.173995 Aug 29 16:48:30.198124 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3991/8203] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:30 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:31.219749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-604e6da0-7a36-40e7-bc9d-6db5b6a3a2a5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:31.220311 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-604e6da0-7a36-40e7-bc9d-6db5b6a3a2a5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:31.227738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-604e6da0-7a36-40e7-bc9d-6db5b6a3a2a5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:31.228245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-604e6da0-7a36-40e7-bc9d-6db5b6a3a2a5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:31.228770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-604e6da0-7a36-40e7-bc9d-6db5b6a3a2a5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:31.229507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-604e6da0-7a36-40e7-bc9d-6db5b6a3a2a5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:31.229985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-604e6da0-7a36-40e7-bc9d-6db5b6a3a2a5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:31.230431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-604e6da0-7a36-40e7-bc9d-6db5b6a3a2a5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:31.637984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-604e6da0-7a36-40e7-bc9d-6db5b6a3a2a5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:31.646001 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-604e6da0-7a36-40e7-bc9d-6db5b6a3a2a5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1697 microversion: 2.1 time: 0.430367 Aug 29 16:48:31.646586 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4213/8204] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:31 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1697 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:32.670002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-73033785-b94c-49c2-a454-cb02a2680fb5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:32.670621 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-73033785-b94c-49c2-a454-cb02a2680fb5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:32.679585 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73033785-b94c-49c2-a454-cb02a2680fb5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:32.680348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73033785-b94c-49c2-a454-cb02a2680fb5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:32.681056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73033785-b94c-49c2-a454-cb02a2680fb5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:32.682239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73033785-b94c-49c2-a454-cb02a2680fb5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:32.682986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73033785-b94c-49c2-a454-cb02a2680fb5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:32.683685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73033785-b94c-49c2-a454-cb02a2680fb5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:32.826343 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-73033785-b94c-49c2-a454-cb02a2680fb5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:32.834687 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-73033785-b94c-49c2-a454-cb02a2680fb5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1697 microversion: 2.1 time: 0.169727 Aug 29 16:48:32.835275 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3992/8205] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:32 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:33.856290 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c754ce9a-a177-48ed-8644-017e524f7ce9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:33.857595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c754ce9a-a177-48ed-8644-017e524f7ce9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:33.865247 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c754ce9a-a177-48ed-8644-017e524f7ce9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:33.866021 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c754ce9a-a177-48ed-8644-017e524f7ce9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:33.866710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c754ce9a-a177-48ed-8644-017e524f7ce9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:33.867627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c754ce9a-a177-48ed-8644-017e524f7ce9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:33.868128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c754ce9a-a177-48ed-8644-017e524f7ce9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:33.868563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c754ce9a-a177-48ed-8644-017e524f7ce9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:34.064418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c754ce9a-a177-48ed-8644-017e524f7ce9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:34.073117 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c754ce9a-a177-48ed-8644-017e524f7ce9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1696 microversion: 2.1 time: 0.220764 Aug 29 16:48:34.073626 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4214/8206] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:33 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1696 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:34.369725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-90ee239e-e77c-4fec-8c0d-4f75f153463f req-8a2bef55-662d-464a-8c29-830d8f33c4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e784ac66-7b09-478a-ad55-612180e35737", "name": "network-vif-unplugged", "status": "completed", "tag": "cda2e8f5-fb47-4eef-a0b5-c3c75d7c8444"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:48:34.380575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-90ee239e-e77c-4fec-8c0d-4f75f153463f req-8a2bef55-662d-464a-8c29-830d8f33c4d0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:34.381050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-90ee239e-e77c-4fec-8c0d-4f75f153463f req-8a2bef55-662d-464a-8c29-830d8f33c4d0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:34.381528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-90ee239e-e77c-4fec-8c0d-4f75f153463f req-8a2bef55-662d-464a-8c29-830d8f33c4d0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:34.397066 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-90ee239e-e77c-4fec-8c0d-4f75f153463f req-8a2bef55-662d-464a-8c29-830d8f33c4d0 service nova] Creating event network-vif-unplugged:cda2e8f5-fb47-4eef-a0b5-c3c75d7c8444 for instance e784ac66-7b09-478a-ad55-612180e35737 on n-h1-839401-11 Aug 29 16:48:34.402797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-90ee239e-e77c-4fec-8c0d-4f75f153463f req-8a2bef55-662d-464a-8c29-830d8f33c4d0 service nova] Instance e784ac66-7b09-478a-ad55-612180e35737 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:48:34.413887 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-90ee239e-e77c-4fec-8c0d-4f75f153463f req-8a2bef55-662d-464a-8c29-830d8f33c4d0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048154 Aug 29 16:48:34.414522 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3993/8207] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:48:35.095760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a8ac05b0-a529-4079-aa2e-667f55c52fc6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:35.096398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a8ac05b0-a529-4079-aa2e-667f55c52fc6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:35.103646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8ac05b0-a529-4079-aa2e-667f55c52fc6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:35.104252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8ac05b0-a529-4079-aa2e-667f55c52fc6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:35.104717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8ac05b0-a529-4079-aa2e-667f55c52fc6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:35.105496 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8ac05b0-a529-4079-aa2e-667f55c52fc6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:35.105983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8ac05b0-a529-4079-aa2e-667f55c52fc6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:35.106437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a8ac05b0-a529-4079-aa2e-667f55c52fc6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:35.577797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a8ac05b0-a529-4079-aa2e-667f55c52fc6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:35.586878 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a8ac05b0-a529-4079-aa2e-667f55c52fc6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1696 microversion: 2.1 time: 0.494903 Aug 29 16:48:35.587594 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4215/8208] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:35 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1696 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:36.440946 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-4f307129-5789-49d1-b32b-ba3c93f75776 req-8fc75411-3ab0-4e9b-8828-ba46ea68dd7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e784ac66-7b09-478a-ad55-612180e35737", "tag": "cda2e8f5-fb47-4eef-a0b5-c3c75d7c8444"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:48:36.454453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4f307129-5789-49d1-b32b-ba3c93f75776 req-8fc75411-3ab0-4e9b-8828-ba46ea68dd7f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:36.454935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4f307129-5789-49d1-b32b-ba3c93f75776 req-8fc75411-3ab0-4e9b-8828-ba46ea68dd7f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:36.455369 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-4f307129-5789-49d1-b32b-ba3c93f75776 req-8fc75411-3ab0-4e9b-8828-ba46ea68dd7f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:36.467110 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-4f307129-5789-49d1-b32b-ba3c93f75776 req-8fc75411-3ab0-4e9b-8828-ba46ea68dd7f service nova] Creating event network-changed:cda2e8f5-fb47-4eef-a0b5-c3c75d7c8444 for instance e784ac66-7b09-478a-ad55-612180e35737 on n-h1-839401-11 Aug 29 16:48:36.472732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [req-4f307129-5789-49d1-b32b-ba3c93f75776 req-8fc75411-3ab0-4e9b-8828-ba46ea68dd7f service nova] Instance e784ac66-7b09-478a-ad55-612180e35737 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-839401-11', 'n-h2-839401-11'} {{(pid=122361) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:48:36.483888 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-4f307129-5789-49d1-b32b-ba3c93f75776 req-8fc75411-3ab0-4e9b-8828-ba46ea68dd7f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051248 Aug 29 16:48:36.484658 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3994/8209] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:48:36.608314 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c4230e56-2acc-49d4-93be-7c97f2d232fd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:36.608955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c4230e56-2acc-49d4-93be-7c97f2d232fd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:36.616461 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4230e56-2acc-49d4-93be-7c97f2d232fd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:36.616987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4230e56-2acc-49d4-93be-7c97f2d232fd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:36.617925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4230e56-2acc-49d4-93be-7c97f2d232fd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:36.618666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4230e56-2acc-49d4-93be-7c97f2d232fd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:36.619396 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4230e56-2acc-49d4-93be-7c97f2d232fd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:36.619833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c4230e56-2acc-49d4-93be-7c97f2d232fd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:36.761305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c4230e56-2acc-49d4-93be-7c97f2d232fd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:36.769433 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c4230e56-2acc-49d4-93be-7c97f2d232fd tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1694 microversion: 2.1 time: 0.165284 Aug 29 16:48:36.770027 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4216/8210] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:36 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:37.797595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3e6f478c-b2f7-485b-ab33-62fcba94bfc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:37.798762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3e6f478c-b2f7-485b-ab33-62fcba94bfc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:37.809340 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e6f478c-b2f7-485b-ab33-62fcba94bfc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:37.809858 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e6f478c-b2f7-485b-ab33-62fcba94bfc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:37.810303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e6f478c-b2f7-485b-ab33-62fcba94bfc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:37.811006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e6f478c-b2f7-485b-ab33-62fcba94bfc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:37.811450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e6f478c-b2f7-485b-ab33-62fcba94bfc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:37.811902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3e6f478c-b2f7-485b-ab33-62fcba94bfc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:37.957955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3e6f478c-b2f7-485b-ab33-62fcba94bfc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:37.971033 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3e6f478c-b2f7-485b-ab33-62fcba94bfc5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1694 microversion: 2.1 time: 0.181879 Aug 29 16:48:37.971887 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3995/8211] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:37 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1694 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:38.997388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f27855cf-9ca2-4ee5-9b7e-9584b6d28ce2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:38.998020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f27855cf-9ca2-4ee5-9b7e-9584b6d28ce2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:39.005520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f27855cf-9ca2-4ee5-9b7e-9584b6d28ce2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:39.006135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f27855cf-9ca2-4ee5-9b7e-9584b6d28ce2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:39.006922 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f27855cf-9ca2-4ee5-9b7e-9584b6d28ce2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:39.007670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f27855cf-9ca2-4ee5-9b7e-9584b6d28ce2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:39.008135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f27855cf-9ca2-4ee5-9b7e-9584b6d28ce2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:39.008581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f27855cf-9ca2-4ee5-9b7e-9584b6d28ce2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:39.144829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f27855cf-9ca2-4ee5-9b7e-9584b6d28ce2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:39.153125 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f27855cf-9ca2-4ee5-9b7e-9584b6d28ce2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1691 microversion: 2.1 time: 0.161117 Aug 29 16:48:39.153707 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4217/8212] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:38 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:39.173619 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a72b5901-d637-4180-a420-b45150f15022 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:48:39.174206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a72b5901-d637-4180-a420-b45150f15022 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:39.181574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a72b5901-d637-4180-a420-b45150f15022 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:39.182070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a72b5901-d637-4180-a420-b45150f15022 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:39.182516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a72b5901-d637-4180-a420-b45150f15022 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:39.183199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a72b5901-d637-4180-a420-b45150f15022 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:39.183734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a72b5901-d637-4180-a420-b45150f15022 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:39.184172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a72b5901-d637-4180-a420-b45150f15022 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:39.254476 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a72b5901-d637-4180-a420-b45150f15022 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737/action" status: 204 len: 0 microversion: 2.1 time: 0.084547 Aug 29 16:48:39.255231 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3996/8213] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:48:39 2022] POST /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:48:39.264680 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4d55c3fc-2f50-4a8f-bcc2-bc435cb02858 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:39.265386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4d55c3fc-2f50-4a8f-bcc2-bc435cb02858 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:39.272222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d55c3fc-2f50-4a8f-bcc2-bc435cb02858 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:39.272803 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d55c3fc-2f50-4a8f-bcc2-bc435cb02858 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:39.273538 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d55c3fc-2f50-4a8f-bcc2-bc435cb02858 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:39.274322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d55c3fc-2f50-4a8f-bcc2-bc435cb02858 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:39.274908 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d55c3fc-2f50-4a8f-bcc2-bc435cb02858 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:39.275382 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4d55c3fc-2f50-4a8f-bcc2-bc435cb02858 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:39.424309 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4d55c3fc-2f50-4a8f-bcc2-bc435cb02858 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:39.433832 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4d55c3fc-2f50-4a8f-bcc2-bc435cb02858 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1691 microversion: 2.1 time: 0.173160 Aug 29 16:48:39.435230 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4218/8214] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:39 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:39.455748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-2a311748-e1e2-4cba-b50e-0593ad8abdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:39.456444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-2a311748-e1e2-4cba-b50e-0593ad8abdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:39.463058 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a311748-e1e2-4cba-b50e-0593ad8abdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:39.463538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a311748-e1e2-4cba-b50e-0593ad8abdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:39.463966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a311748-e1e2-4cba-b50e-0593ad8abdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:39.464679 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a311748-e1e2-4cba-b50e-0593ad8abdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:39.465150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a311748-e1e2-4cba-b50e-0593ad8abdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:39.465575 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-2a311748-e1e2-4cba-b50e-0593ad8abdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:39.690138 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-2a311748-e1e2-4cba-b50e-0593ad8abdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:39.698676 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-2a311748-e1e2-4cba-b50e-0593ad8abdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1691 microversion: 2.1 time: 0.247129 Aug 29 16:48:39.699356 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3997/8215] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:39 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1691 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:40.720683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-028d7d3c-5132-465c-805a-119e724264c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:48:40.721354 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-028d7d3c-5132-465c-805a-119e724264c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:48:40.728494 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-028d7d3c-5132-465c-805a-119e724264c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:40.729003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-028d7d3c-5132-465c-805a-119e724264c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:40.729489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-028d7d3c-5132-465c-805a-119e724264c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:40.730216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-028d7d3c-5132-465c-805a-119e724264c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:40.730730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-028d7d3c-5132-465c-805a-119e724264c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:40.731171 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-028d7d3c-5132-465c-805a-119e724264c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:40.883282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-028d7d3c-5132-465c-805a-119e724264c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:48:40.891272 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-028d7d3c-5132-465c-805a-119e724264c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1683 microversion: 2.1 time: 0.174702 Aug 29 16:48:40.891839 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4219/8216] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:48:40 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:48:40.939893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-a8b6afc1-97cc-4349-8e4e-3fbdd78c38f2 req-a4a6b12a-f59f-48f8-a07a-78612cbc1327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e784ac66-7b09-478a-ad55-612180e35737", "name": "network-vif-plugged", "status": "completed", "tag": "cda2e8f5-fb47-4eef-a0b5-c3c75d7c8444"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:48:40.952567 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a8b6afc1-97cc-4349-8e4e-3fbdd78c38f2 req-a4a6b12a-f59f-48f8-a07a-78612cbc1327 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:48:40.953445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a8b6afc1-97cc-4349-8e4e-3fbdd78c38f2 req-a4a6b12a-f59f-48f8-a07a-78612cbc1327 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:48:40.954082 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a8b6afc1-97cc-4349-8e4e-3fbdd78c38f2 req-a4a6b12a-f59f-48f8-a07a-78612cbc1327 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:48:40.966109 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-a8b6afc1-97cc-4349-8e4e-3fbdd78c38f2 req-a4a6b12a-f59f-48f8-a07a-78612cbc1327 service nova] Creating event network-vif-plugged:cda2e8f5-fb47-4eef-a0b5-c3c75d7c8444 for instance e784ac66-7b09-478a-ad55-612180e35737 on n-h1-839401-11 Aug 29 16:48:40.974116 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-a8b6afc1-97cc-4349-8e4e-3fbdd78c38f2 req-a4a6b12a-f59f-48f8-a07a-78612cbc1327 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038056 Aug 29 16:48:40.975767 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3998/8217] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:49:15.169618 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dec1509a-4ac0-4bd5-86f6-79af50b8cdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:49:15.171861 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dec1509a-4ac0-4bd5-86f6-79af50b8cdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:15.174188 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=24 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:15.174910 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=72 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:15.183232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dec1509a-4ac0-4bd5-86f6-79af50b8cdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:15.183900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dec1509a-4ac0-4bd5-86f6-79af50b8cdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:15.184421 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dec1509a-4ac0-4bd5-86f6-79af50b8cdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:15.185369 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dec1509a-4ac0-4bd5-86f6-79af50b8cdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:15.185959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dec1509a-4ac0-4bd5-86f6-79af50b8cdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:15.186597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dec1509a-4ac0-4bd5-86f6-79af50b8cdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:15.269901 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dec1509a-4ac0-4bd5-86f6-79af50b8cdd0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737/action" status: 200 len: 24576 microversion: 2.1 time: 0.104300 Aug 29 16:49:15.270670 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4220/8218] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:49:15 2022] POST /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737/action => generated 24576 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:49:39.251309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=30 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:39.252226 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:39.255596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-74b5dd7a-b16e-43e9-9c33-7248af4c9194 req-2cda8ea6-b771-4a34-bdd7-86c35bf7a12d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e784ac66-7b09-478a-ad55-612180e35737", "tag": "cda2e8f5-fb47-4eef-a0b5-c3c75d7c8444"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:49:39.257325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-41c222d0-7e7e-4bb7-86ca-6c57f7f455ef tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:39.258113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-41c222d0-7e7e-4bb7-86ca-6c57f7f455ef tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:39.264033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:39.265033 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=4 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:39.266849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41c222d0-7e7e-4bb7-86ca-6c57f7f455ef tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:39.267007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41c222d0-7e7e-4bb7-86ca-6c57f7f455ef tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:39.267478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41c222d0-7e7e-4bb7-86ca-6c57f7f455ef tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:39.268263 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41c222d0-7e7e-4bb7-86ca-6c57f7f455ef tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:39.268756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41c222d0-7e7e-4bb7-86ca-6c57f7f455ef tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:39.269325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-41c222d0-7e7e-4bb7-86ca-6c57f7f455ef tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:39.270504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-74b5dd7a-b16e-43e9-9c33-7248af4c9194 req-2cda8ea6-b771-4a34-bdd7-86c35bf7a12d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:39.270983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-74b5dd7a-b16e-43e9-9c33-7248af4c9194 req-2cda8ea6-b771-4a34-bdd7-86c35bf7a12d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:39.271437 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-74b5dd7a-b16e-43e9-9c33-7248af4c9194 req-2cda8ea6-b771-4a34-bdd7-86c35bf7a12d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:39.286376 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-74b5dd7a-b16e-43e9-9c33-7248af4c9194 req-2cda8ea6-b771-4a34-bdd7-86c35bf7a12d service nova] Creating event network-changed:cda2e8f5-fb47-4eef-a0b5-c3c75d7c8444 for instance e784ac66-7b09-478a-ad55-612180e35737 on n-h1-839401-11 Aug 29 16:49:39.291706 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-74b5dd7a-b16e-43e9-9c33-7248af4c9194 req-2cda8ea6-b771-4a34-bdd7-86c35bf7a12d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041022 Aug 29 16:49:39.292570 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4221/8219] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:49:39.297892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-41c222d0-7e7e-4bb7-86ca-6c57f7f455ef tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:49:39.389418 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-41c222d0-7e7e-4bb7-86ca-6c57f7f455ef tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 204 len: 0 microversion: 2.1 time: 0.140488 Aug 29 16:49:39.390886 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 3999/8220] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:49:39 2022] DELETE /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:49:39.400310 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-650dcbd8-e5c2-464a-aa88-c8cc8da5b713 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:39.401030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-650dcbd8-e5c2-464a-aa88-c8cc8da5b713 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:39.414480 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-650dcbd8-e5c2-464a-aa88-c8cc8da5b713 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:39.415242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-650dcbd8-e5c2-464a-aa88-c8cc8da5b713 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:39.415693 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-650dcbd8-e5c2-464a-aa88-c8cc8da5b713 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:39.416419 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-650dcbd8-e5c2-464a-aa88-c8cc8da5b713 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:39.416915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-650dcbd8-e5c2-464a-aa88-c8cc8da5b713 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:39.417566 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-650dcbd8-e5c2-464a-aa88-c8cc8da5b713 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:39.607254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-650dcbd8-e5c2-464a-aa88-c8cc8da5b713 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:39.616026 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-650dcbd8-e5c2-464a-aa88-c8cc8da5b713 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1689 microversion: 2.1 time: 0.220645 Aug 29 16:49:39.616658 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4222/8221] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:39 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1689 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:40.639738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-5057c37d-1b9f-41c2-8976-99fab9324964 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:40.640438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-5057c37d-1b9f-41c2-8976-99fab9324964 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:40.647466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5057c37d-1b9f-41c2-8976-99fab9324964 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:40.647951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5057c37d-1b9f-41c2-8976-99fab9324964 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:40.648409 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5057c37d-1b9f-41c2-8976-99fab9324964 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:40.649113 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5057c37d-1b9f-41c2-8976-99fab9324964 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:40.649586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5057c37d-1b9f-41c2-8976-99fab9324964 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:40.650011 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-5057c37d-1b9f-41c2-8976-99fab9324964 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:40.840440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-5057c37d-1b9f-41c2-8976-99fab9324964 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:40.848469 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-5057c37d-1b9f-41c2-8976-99fab9324964 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1689 microversion: 2.1 time: 0.213131 Aug 29 16:49:40.849048 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4000/8222] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:40 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1689 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:41.544395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-6a25d384-817e-4f8d-98f5-9efe2a7d3c83 req-780f722b-55ee-4065-991b-6a0fb3b41169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e784ac66-7b09-478a-ad55-612180e35737", "name": "network-vif-deleted", "tag": "cda2e8f5-fb47-4eef-a0b5-c3c75d7c8444"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:49:41.555113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6a25d384-817e-4f8d-98f5-9efe2a7d3c83 req-780f722b-55ee-4065-991b-6a0fb3b41169 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:41.555616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6a25d384-817e-4f8d-98f5-9efe2a7d3c83 req-780f722b-55ee-4065-991b-6a0fb3b41169 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:41.556067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6a25d384-817e-4f8d-98f5-9efe2a7d3c83 req-780f722b-55ee-4065-991b-6a0fb3b41169 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:41.567618 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-6a25d384-817e-4f8d-98f5-9efe2a7d3c83 req-780f722b-55ee-4065-991b-6a0fb3b41169 service nova] Creating event network-vif-deleted:cda2e8f5-fb47-4eef-a0b5-c3c75d7c8444 for instance e784ac66-7b09-478a-ad55-612180e35737 on n-h1-839401-11 Aug 29 16:49:41.573232 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-6a25d384-817e-4f8d-98f5-9efe2a7d3c83 req-780f722b-55ee-4065-991b-6a0fb3b41169 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032613 Aug 29 16:49:41.573929 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4223/8223] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:49:41.870277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ca1a500f-dd0b-4d53-b5db-9c975eb50679 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:41.870947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ca1a500f-dd0b-4d53-b5db-9c975eb50679 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:41.878092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca1a500f-dd0b-4d53-b5db-9c975eb50679 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:41.878582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca1a500f-dd0b-4d53-b5db-9c975eb50679 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:41.878997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca1a500f-dd0b-4d53-b5db-9c975eb50679 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:41.879725 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca1a500f-dd0b-4d53-b5db-9c975eb50679 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:41.880222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca1a500f-dd0b-4d53-b5db-9c975eb50679 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:41.880640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca1a500f-dd0b-4d53-b5db-9c975eb50679 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:41.922213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca1a500f-dd0b-4d53-b5db-9c975eb50679 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:41.922691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca1a500f-dd0b-4d53-b5db-9c975eb50679 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:41.923164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ca1a500f-dd0b-4d53-b5db-9c975eb50679 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:41.923623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-ca1a500f-dd0b-4d53-b5db-9c975eb50679 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lazy-loading 'fault' on Instance uuid e784ac66-7b09-478a-ad55-612180e35737 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:49:41.966363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ca1a500f-dd0b-4d53-b5db-9c975eb50679 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:41.974262 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ca1a500f-dd0b-4d53-b5db-9c975eb50679 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 200 len: 1357 microversion: 2.1 time: 0.108096 Aug 29 16:49:41.974841 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4001/8224] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:41 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 1357 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:43.002665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-68b5fcce-23cd-4804-9d33-383e0189c327 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:43.004843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-68b5fcce-23cd-4804-9d33-383e0189c327 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: e784ac66-7b09-478a-ad55-612180e35737] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:43.015073 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68b5fcce-23cd-4804-9d33-383e0189c327 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:43.015592 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68b5fcce-23cd-4804-9d33-383e0189c327 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:43.016058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68b5fcce-23cd-4804-9d33-383e0189c327 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:43.016790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68b5fcce-23cd-4804-9d33-383e0189c327 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:43.017336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68b5fcce-23cd-4804-9d33-383e0189c327 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:43.017790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-68b5fcce-23cd-4804-9d33-383e0189c327 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:43.034009 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-68b5fcce-23cd-4804-9d33-383e0189c327 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] HTTP exception thrown: Instance e784ac66-7b09-478a-ad55-612180e35737 could not be found. Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-68b5fcce-23cd-4804-9d33-383e0189c327 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Request method failure captured: Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 HTTP/1.1 Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOxhtoEToS3nQ4x7iVmKQZTqOC8mawYKijdPvY6Bh_MTssjj9rVe4heRLLbq4FF58bMfx8T4Eb3qq5MMGmLVsYPUFPe-ZvbGjTL-Bxl7OoI6lDRIRmK3ropbwVWSh1BWN2psc293apISyO1eYL1oyiROFjCcWD6TQJA8ehzovaaRd9w Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 3c4a511b63e449ad84d6b8172efa8f26 Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1448564924 Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3c4a511b63e449ad84d6b8172efa8f26", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3c4a511b63e449ad84d6b8172efa8f26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3c4a511b63e449ad84d6b8172efa8f26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3c4a511b63e449ad84d6b8172efa8f26"}]}] Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1448564924 Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 3c4a511b63e449ad84d6b8172efa8f26 Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1448564924 Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestNetworkAdvancedServerOps-1448564924-project Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: c9565af0dfd0482f887f0eea2f3a1f4e Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1448564924-project Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance e784ac66-7b09-478a-ad55-612180e35737 could not be found. Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'e784ac66-7b09-478a-ad55-612180e35737'} Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e784ac66-7b09-478a-ad55-612180e35737 could not be found. Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e784ac66-7b09-478a-ad55-612180e35737 could not be found. Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:49:43.035728 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:49:43.040837 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:49:43.040837 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:49:43.040837 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:49:43.040837 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:49:43.040837 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:49:43.040837 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:49:43.040837 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e784ac66-7b09-478a-ad55-612180e35737 could not be found. Aug 29 16:49:43.040837 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:49:43.040837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-68b5fcce-23cd-4804-9d33-383e0189c327 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Returning 404 to user: Instance e784ac66-7b09-478a-ad55-612180e35737 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:49:43.040837 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-68b5fcce-23cd-4804-9d33-383e0189c327 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737" status: 404 len: 111 microversion: 2.1 time: 0.043935 Aug 29 16:49:43.040837 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4224/8225] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:42 2022] GET /compute/v2.1/servers/e784ac66-7b09-478a-ad55-612180e35737 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:49:46.433320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-50b57508-a598-4f6d-ace8-16b13c53576b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '.version_select at 0x7fc42b001a60>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:46.437991 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [None req-50b57508-a598-4f6d-ace8-16b13c53576b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [5072c773-7cce-4f83-82c0-18bdcabe916e] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:49:47.447174 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [None req-50b57508-a598-4f6d-ace8-16b13c53576b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [5072c773-7cce-4f83-82c0-18bdcabe916e] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 42604. Aug 29 16:49:47.470703 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-50b57508-a598-4f6d-ace8-16b13c53576b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1812797133" status: 202 len: 0 microversion: 2.1 time: 1.041594 Aug 29 16:49:47.471335 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4002/8226] 10.222.0.62 () {58 vars in 1284 bytes} [Mon Aug 29 16:49:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1812797133 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:49:47.498839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2d60842a-231b-40c9-be67-ac2b1ffab39d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'create', calling method: .version_select at 0x7fc428554a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-143451954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEhdhIon6QeK4ezC9RgDH23BRxR6w+6DIpmDZybl2oWT419prGKUTH5VDmwgYj5woA3A3N0yMb4hwuVUEBIuo8hWLwhyxzyvGVX8VHnJVvI+6s1h/pu2w9keut8ErYodA=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:49:47.516104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-2d60842a-231b-40c9-be67-ac2b1ffab39d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:49:47.521468 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-2d60842a-231b-40c9-be67-ac2b1ffab39d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for user c9565af0dfd0482f887f0eea2f3a1f4e and project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:49:47.547802 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2d60842a-231b-40c9-be67-ac2b1ffab39d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053270 Aug 29 16:49:47.548427 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4225/8227] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:49:47 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:49:53.290743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:53.295774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-549775400", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "8798a7b3-42ac-42a9-9b42-4774c7db89aa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-143451954", "security_groups": [{"name": "tempest-secgroup-smoke-655530101"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:49:53.419394 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] validate_networks() for [('8798a7b3-42ac-42a9-9b42-4774c7db89aa', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:49:53.837620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:49:53.838053 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:49:53.839350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:49:53.839778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:49:53.840336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:49:53.850633 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:53.851141 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:53.851626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:53.852372 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:53.852840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:53.853287 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:53.871713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:49:53.877338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for user c9565af0dfd0482f887f0eea2f3a1f4e and project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:49:53.889998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:49:53.892358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:49:53.942207 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fc8e6b36-7038-4afe-8d52-a88bfa2cbe08 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.653258 Aug 29 16:49:53.943045 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4003/8228] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:49:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:49:53.954760 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1b7dc7e7-4671-4646-98dd-08072eb3de5a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:53.956165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1b7dc7e7-4671-4646-98dd-08072eb3de5a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:53.962665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=12 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:54.015516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1b7dc7e7-4671-4646-98dd-08072eb3de5a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:54.023108 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1b7dc7e7-4671-4646-98dd-08072eb3de5a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1265 microversion: 2.1 time: 0.072619 Aug 29 16:49:54.023706 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4226/8229] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:53 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1265 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:55.048572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f9056a93-ad5b-4648-a939-c1f61148ef42 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:55.049240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f9056a93-ad5b-4648-a939-c1f61148ef42 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:55.480022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f9056a93-ad5b-4648-a939-c1f61148ef42 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:55.487326 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f9056a93-ad5b-4648-a939-c1f61148ef42 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1265 microversion: 2.1 time: 0.447248 Aug 29 16:49:55.488608 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4004/8230] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:55 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1265 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:56.508690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f0c51a19-c2f9-4124-9822-2e0b314e03d4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:56.509373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f0c51a19-c2f9-4124-9822-2e0b314e03d4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:56.570954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f0c51a19-c2f9-4124-9822-2e0b314e03d4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:56.578368 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f0c51a19-c2f9-4124-9822-2e0b314e03d4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1265 microversion: 2.1 time: 0.073806 Aug 29 16:49:56.578949 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4227/8231] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:56 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1265 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:57.603593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-94794d66-5b76-424d-a824-aef26d86d6af tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:57.604135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-94794d66-5b76-424d-a824-aef26d86d6af tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:57.611919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94794d66-5b76-424d-a824-aef26d86d6af tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:57.612417 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94794d66-5b76-424d-a824-aef26d86d6af tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:57.612863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94794d66-5b76-424d-a824-aef26d86d6af tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:57.613610 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94794d66-5b76-424d-a824-aef26d86d6af tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:57.614076 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94794d66-5b76-424d-a824-aef26d86d6af tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:57.614513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94794d66-5b76-424d-a824-aef26d86d6af tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:57.684339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-94794d66-5b76-424d-a824-aef26d86d6af tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:57.692489 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-94794d66-5b76-424d-a824-aef26d86d6af tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1269 microversion: 2.1 time: 0.095797 Aug 29 16:49:57.693075 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4005/8232] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:57 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1269 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:58.714782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fd68024e-714a-42c4-9d7b-5f555ebfb2eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:58.715454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fd68024e-714a-42c4-9d7b-5f555ebfb2eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:58.722546 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd68024e-714a-42c4-9d7b-5f555ebfb2eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:58.723057 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd68024e-714a-42c4-9d7b-5f555ebfb2eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:58.723516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd68024e-714a-42c4-9d7b-5f555ebfb2eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:58.724230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd68024e-714a-42c4-9d7b-5f555ebfb2eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:58.724722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd68024e-714a-42c4-9d7b-5f555ebfb2eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:58.725172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fd68024e-714a-42c4-9d7b-5f555ebfb2eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:58.791233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fd68024e-714a-42c4-9d7b-5f555ebfb2eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:58.799133 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fd68024e-714a-42c4-9d7b-5f555ebfb2eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1261 microversion: 2.1 time: 0.089778 Aug 29 16:49:58.799765 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4228/8233] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:58 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:59.820742 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3af71325-2fde-4955-9784-81fdb77ed849 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:59.821373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3af71325-2fde-4955-9784-81fdb77ed849 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:59.829049 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3af71325-2fde-4955-9784-81fdb77ed849 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:59.829581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3af71325-2fde-4955-9784-81fdb77ed849 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:59.830022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3af71325-2fde-4955-9784-81fdb77ed849 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:59.830738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3af71325-2fde-4955-9784-81fdb77ed849 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:59.831203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3af71325-2fde-4955-9784-81fdb77ed849 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:59.831624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3af71325-2fde-4955-9784-81fdb77ed849 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:59.904466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3af71325-2fde-4955-9784-81fdb77ed849 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:59.912990 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3af71325-2fde-4955-9784-81fdb77ed849 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1323 microversion: 2.1 time: 0.096596 Aug 29 16:49:59.913608 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4006/8234] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:59 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1323 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:50:00.682264 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-7a52ebb2-f20a-4ae7-88a8-c05c9a967891 req-ffcb7d29-ff15-4fd2-97e4-91795bc94eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578b8013-6be6-4cc4-8e10-eb4e526fd748", "tag": "785b52ec-201c-4383-8cbb-4ccc05599c0b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:50:00.693365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7a52ebb2-f20a-4ae7-88a8-c05c9a967891 req-ffcb7d29-ff15-4fd2-97e4-91795bc94eab service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:00.694215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7a52ebb2-f20a-4ae7-88a8-c05c9a967891 req-ffcb7d29-ff15-4fd2-97e4-91795bc94eab service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:00.694714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-7a52ebb2-f20a-4ae7-88a8-c05c9a967891 req-ffcb7d29-ff15-4fd2-97e4-91795bc94eab service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:00.707807 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-7a52ebb2-f20a-4ae7-88a8-c05c9a967891 req-ffcb7d29-ff15-4fd2-97e4-91795bc94eab service nova] Creating event network-changed:785b52ec-201c-4383-8cbb-4ccc05599c0b for instance 578b8013-6be6-4cc4-8e10-eb4e526fd748 on n-h2-839401-11 Aug 29 16:50:00.712881 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-7a52ebb2-f20a-4ae7-88a8-c05c9a967891 req-ffcb7d29-ff15-4fd2-97e4-91795bc94eab service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035957 Aug 29 16:50:00.713547 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4229/8235] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:50:00.934233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cf7c1a80-511c-4f52-aef0-897c3c5ae2c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:50:00.934855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cf7c1a80-511c-4f52-aef0-897c3c5ae2c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:50:00.942035 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf7c1a80-511c-4f52-aef0-897c3c5ae2c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:00.942524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf7c1a80-511c-4f52-aef0-897c3c5ae2c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:00.942967 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf7c1a80-511c-4f52-aef0-897c3c5ae2c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:00.944224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf7c1a80-511c-4f52-aef0-897c3c5ae2c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:00.944604 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf7c1a80-511c-4f52-aef0-897c3c5ae2c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:00.945004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cf7c1a80-511c-4f52-aef0-897c3c5ae2c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:01.158860 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cf7c1a80-511c-4f52-aef0-897c3c5ae2c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:50:01.166952 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cf7c1a80-511c-4f52-aef0-897c3c5ae2c0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1390 microversion: 2.1 time: 0.236797 Aug 29 16:50:01.167565 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4007/8236] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:50:00 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1390 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:50:02.192049 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-85165c79-a950-4f63-84cd-586712284781 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:50:02.193139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-85165c79-a950-4f63-84cd-586712284781 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:50:02.201921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85165c79-a950-4f63-84cd-586712284781 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:02.202426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85165c79-a950-4f63-84cd-586712284781 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:02.202887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85165c79-a950-4f63-84cd-586712284781 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:02.203606 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85165c79-a950-4f63-84cd-586712284781 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:02.204085 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85165c79-a950-4f63-84cd-586712284781 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:02.204530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-85165c79-a950-4f63-84cd-586712284781 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:02.342179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-85165c79-a950-4f63-84cd-586712284781 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:50:02.350164 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-85165c79-a950-4f63-84cd-586712284781 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1390 microversion: 2.1 time: 0.165051 Aug 29 16:50:02.350729 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4230/8237] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:50:02 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:50:03.371768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e9c322d8-0a78-4001-90c5-71165ea3bf9b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:50:03.372435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e9c322d8-0a78-4001-90c5-71165ea3bf9b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:50:03.382810 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9c322d8-0a78-4001-90c5-71165ea3bf9b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:03.383501 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9c322d8-0a78-4001-90c5-71165ea3bf9b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:03.384124 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9c322d8-0a78-4001-90c5-71165ea3bf9b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:03.385244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9c322d8-0a78-4001-90c5-71165ea3bf9b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:03.385925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9c322d8-0a78-4001-90c5-71165ea3bf9b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:03.386552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e9c322d8-0a78-4001-90c5-71165ea3bf9b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:03.619577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e9c322d8-0a78-4001-90c5-71165ea3bf9b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:50:03.630472 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e9c322d8-0a78-4001-90c5-71165ea3bf9b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1390 microversion: 2.1 time: 0.262859 Aug 29 16:50:03.631311 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4008/8238] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:50:03 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1390 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:50:04.651746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aaf14d54-b86c-4fd5-a28c-02b93c77c0b4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:50:04.652550 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aaf14d54-b86c-4fd5-a28c-02b93c77c0b4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:50:04.660174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf14d54-b86c-4fd5-a28c-02b93c77c0b4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:04.660677 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf14d54-b86c-4fd5-a28c-02b93c77c0b4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:04.661164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf14d54-b86c-4fd5-a28c-02b93c77c0b4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:04.661890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf14d54-b86c-4fd5-a28c-02b93c77c0b4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:04.662400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf14d54-b86c-4fd5-a28c-02b93c77c0b4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:04.662852 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aaf14d54-b86c-4fd5-a28c-02b93c77c0b4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:04.809428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aaf14d54-b86c-4fd5-a28c-02b93c77c0b4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:50:04.817386 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aaf14d54-b86c-4fd5-a28c-02b93c77c0b4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1390 microversion: 2.1 time: 0.169798 Aug 29 16:50:04.817982 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4231/8239] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:50:04 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:50:05.839147 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8a081f40-5a3e-4ff0-8e81-a21fa3b59a72 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:50:05.839728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8a081f40-5a3e-4ff0-8e81-a21fa3b59a72 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:50:05.841904 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:50:05.843639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=8 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:50:05.849751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a081f40-5a3e-4ff0-8e81-a21fa3b59a72 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:05.850252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a081f40-5a3e-4ff0-8e81-a21fa3b59a72 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:05.850717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a081f40-5a3e-4ff0-8e81-a21fa3b59a72 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:05.851434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a081f40-5a3e-4ff0-8e81-a21fa3b59a72 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:05.851898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a081f40-5a3e-4ff0-8e81-a21fa3b59a72 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:05.852330 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8a081f40-5a3e-4ff0-8e81-a21fa3b59a72 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:05.991961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8a081f40-5a3e-4ff0-8e81-a21fa3b59a72 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:50:06.002073 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8a081f40-5a3e-4ff0-8e81-a21fa3b59a72 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1390 microversion: 2.1 time: 0.166940 Aug 29 16:50:06.002653 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4009/8240] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:50:05 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:50:07.027436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-47a6552a-a022-4b4e-bb63-32f9f0fe69cf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:50:07.028451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-47a6552a-a022-4b4e-bb63-32f9f0fe69cf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:50:07.031837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:50:07.037530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-47a6552a-a022-4b4e-bb63-32f9f0fe69cf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:07.038032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-47a6552a-a022-4b4e-bb63-32f9f0fe69cf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:07.038484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-47a6552a-a022-4b4e-bb63-32f9f0fe69cf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:07.039198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-47a6552a-a022-4b4e-bb63-32f9f0fe69cf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:07.039796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-47a6552a-a022-4b4e-bb63-32f9f0fe69cf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:07.040245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-47a6552a-a022-4b4e-bb63-32f9f0fe69cf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:07.177215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-47a6552a-a022-4b4e-bb63-32f9f0fe69cf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:50:07.187377 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-47a6552a-a022-4b4e-bb63-32f9f0fe69cf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1390 microversion: 2.1 time: 0.166464 Aug 29 16:50:07.188163 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4232/8241] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:50:07 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:50:08.209245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-05cf5de6-c09b-4187-a3ac-3304b6ac47eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:50:08.209841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-05cf5de6-c09b-4187-a3ac-3304b6ac47eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:50:08.217373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05cf5de6-c09b-4187-a3ac-3304b6ac47eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:08.217865 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05cf5de6-c09b-4187-a3ac-3304b6ac47eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:08.218305 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05cf5de6-c09b-4187-a3ac-3304b6ac47eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:08.219005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05cf5de6-c09b-4187-a3ac-3304b6ac47eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:08.219469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05cf5de6-c09b-4187-a3ac-3304b6ac47eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:08.219896 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-05cf5de6-c09b-4187-a3ac-3304b6ac47eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:08.376411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-05cf5de6-c09b-4187-a3ac-3304b6ac47eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:50:08.384905 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-05cf5de6-c09b-4187-a3ac-3304b6ac47eb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1390 microversion: 2.1 time: 0.179758 Aug 29 16:50:08.385518 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4010/8242] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:50:08 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1390 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:50:08.616766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-c5d53c06-047b-4ce3-a3a4-bd72666ad69d req-8ee34acc-3c30-44d5-8745-6809249242c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578b8013-6be6-4cc4-8e10-eb4e526fd748", "name": "network-vif-plugged", "status": "completed", "tag": "785b52ec-201c-4383-8cbb-4ccc05599c0b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:50:08.627624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c5d53c06-047b-4ce3-a3a4-bd72666ad69d req-8ee34acc-3c30-44d5-8745-6809249242c5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:08.628124 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c5d53c06-047b-4ce3-a3a4-bd72666ad69d req-8ee34acc-3c30-44d5-8745-6809249242c5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:08.628562 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-c5d53c06-047b-4ce3-a3a4-bd72666ad69d req-8ee34acc-3c30-44d5-8745-6809249242c5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:08.640611 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-c5d53c06-047b-4ce3-a3a4-bd72666ad69d req-8ee34acc-3c30-44d5-8745-6809249242c5 service nova] Creating event network-vif-plugged:785b52ec-201c-4383-8cbb-4ccc05599c0b for instance 578b8013-6be6-4cc4-8e10-eb4e526fd748 on n-h2-839401-11 Aug 29 16:50:08.645952 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-c5d53c06-047b-4ce3-a3a4-bd72666ad69d req-8ee34acc-3c30-44d5-8745-6809249242c5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086030 Aug 29 16:50:08.646548 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4233/8243] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:50:09.408443 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-923365f7-c515-498d-9509-609d793f94c6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:50:09.409267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-923365f7-c515-498d-9509-609d793f94c6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:50:09.413555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:50:09.420804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-923365f7-c515-498d-9509-609d793f94c6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:09.421348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-923365f7-c515-498d-9509-609d793f94c6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:09.421796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-923365f7-c515-498d-9509-609d793f94c6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:09.422514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-923365f7-c515-498d-9509-609d793f94c6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:09.422978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-923365f7-c515-498d-9509-609d793f94c6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:09.423412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-923365f7-c515-498d-9509-609d793f94c6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:09.586981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-923365f7-c515-498d-9509-609d793f94c6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:50:09.595199 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-923365f7-c515-498d-9509-609d793f94c6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1390 microversion: 2.1 time: 0.193146 Aug 29 16:50:09.595791 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4011/8244] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:50:09 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1390 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:50:10.616951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-62a09e5c-223d-472c-97f6-05099a64d74d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:50:10.617707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-62a09e5c-223d-472c-97f6-05099a64d74d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:50:10.620611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:50:10.626640 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62a09e5c-223d-472c-97f6-05099a64d74d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:10.627147 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62a09e5c-223d-472c-97f6-05099a64d74d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:10.627612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62a09e5c-223d-472c-97f6-05099a64d74d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:10.628337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62a09e5c-223d-472c-97f6-05099a64d74d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:10.628837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62a09e5c-223d-472c-97f6-05099a64d74d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:10.629292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62a09e5c-223d-472c-97f6-05099a64d74d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:10.767297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-62a09e5c-223d-472c-97f6-05099a64d74d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:50:10.775431 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-62a09e5c-223d-472c-97f6-05099a64d74d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1562 microversion: 2.1 time: 0.162993 Aug 29 16:50:10.776057 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4234/8245] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:50:10 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:50:10.795677 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e541106a-4ca2-430d-9c7d-84961ddf6aad tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:50:10.797133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e541106a-4ca2-430d-9c7d-84961ddf6aad tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:50:10.811849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e541106a-4ca2-430d-9c7d-84961ddf6aad tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:10.812347 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e541106a-4ca2-430d-9c7d-84961ddf6aad tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:10.812841 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e541106a-4ca2-430d-9c7d-84961ddf6aad tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:10.813532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e541106a-4ca2-430d-9c7d-84961ddf6aad tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:10.814001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e541106a-4ca2-430d-9c7d-84961ddf6aad tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:10.814433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e541106a-4ca2-430d-9c7d-84961ddf6aad tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:10.951796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e541106a-4ca2-430d-9c7d-84961ddf6aad tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:50:10.959998 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e541106a-4ca2-430d-9c7d-84961ddf6aad tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1562 microversion: 2.1 time: 0.168391 Aug 29 16:50:10.960847 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4012/8246] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:50:10 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:50:12.669612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-089520f2-af2a-45d3-b009-4fafb03b9b60 req-06a0c79b-96cf-43b8-9296-b79679d0a7ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578b8013-6be6-4cc4-8e10-eb4e526fd748", "tag": "785b52ec-201c-4383-8cbb-4ccc05599c0b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:50:12.679281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d7af3105-e29f-45ef-b9bf-bf74f6ca685b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:50:12.679889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d7af3105-e29f-45ef-b9bf-bf74f6ca685b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:50:12.687973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7af3105-e29f-45ef-b9bf-bf74f6ca685b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:12.688205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-089520f2-af2a-45d3-b009-4fafb03b9b60 req-06a0c79b-96cf-43b8-9296-b79679d0a7ca service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:12.688447 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-089520f2-af2a-45d3-b009-4fafb03b9b60 req-06a0c79b-96cf-43b8-9296-b79679d0a7ca service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:12.688730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7af3105-e29f-45ef-b9bf-bf74f6ca685b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:12.688870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-089520f2-af2a-45d3-b009-4fafb03b9b60 req-06a0c79b-96cf-43b8-9296-b79679d0a7ca service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:12.689346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7af3105-e29f-45ef-b9bf-bf74f6ca685b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:12.690366 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7af3105-e29f-45ef-b9bf-bf74f6ca685b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:12.690916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7af3105-e29f-45ef-b9bf-bf74f6ca685b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:12.691513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7af3105-e29f-45ef-b9bf-bf74f6ca685b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:12.701608 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-089520f2-af2a-45d3-b009-4fafb03b9b60 req-06a0c79b-96cf-43b8-9296-b79679d0a7ca service nova] Creating event network-changed:785b52ec-201c-4383-8cbb-4ccc05599c0b for instance 578b8013-6be6-4cc4-8e10-eb4e526fd748 on n-h2-839401-11 Aug 29 16:50:12.707222 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-089520f2-af2a-45d3-b009-4fafb03b9b60 req-06a0c79b-96cf-43b8-9296-b79679d0a7ca service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041222 Aug 29 16:50:12.708093 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4013/8247] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:50:12.861551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d7af3105-e29f-45ef-b9bf-bf74f6ca685b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:50:12.871567 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d7af3105-e29f-45ef-b9bf-bf74f6ca685b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1562 microversion: 2.1 time: 0.208610 Aug 29 16:50:12.874305 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4235/8248] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:50:12 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1562 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:50:48.228902 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=5 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:50:48.229696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=52 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:50:48.233919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d741ab19-e495-4e69-9e7c-a7663f94b1a0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:50:48.236361 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d741ab19-e495-4e69-9e7c-a7663f94b1a0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:50:48.243674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d741ab19-e495-4e69-9e7c-a7663f94b1a0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:48.244193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d741ab19-e495-4e69-9e7c-a7663f94b1a0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:48.244638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d741ab19-e495-4e69-9e7c-a7663f94b1a0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:48.245387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d741ab19-e495-4e69-9e7c-a7663f94b1a0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:48.245844 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d741ab19-e495-4e69-9e7c-a7663f94b1a0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:48.246280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d741ab19-e495-4e69-9e7c-a7663f94b1a0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:48.320557 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d741ab19-e495-4e69-9e7c-a7663f94b1a0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748/action" status: 200 len: 24568 microversion: 2.1 time: 0.093791 Aug 29 16:50:48.321216 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4014/8249] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:50:48 2022] POST /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748/action => generated 24568 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:51:27.325154 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:27.326389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=40 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:27.328656 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:51:27.329064 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:51:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748/action (ip 10.222.0.62) !!! Aug 29 16:51:27.336957 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-36e30468-1090-4826-80e8-9500254bbf50 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:27.349981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36e30468-1090-4826-80e8-9500254bbf50 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:27.350514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36e30468-1090-4826-80e8-9500254bbf50 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:27.350972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-36e30468-1090-4826-80e8-9500254bbf50 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:27.374176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-36e30468-1090-4826-80e8-9500254bbf50 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Going to try to stop instance {{(pid=122360) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 16:51:27.421136 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-36e30468-1090-4826-80e8-9500254bbf50 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748/action" status: 202 len: 0 microversion: 2.1 time: 0.099312 Aug 29 16:51:27.421781 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4236/8250] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:51:27 2022] POST /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:51:27.430983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cb047be6-5264-481a-9440-17b62973b5e6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:27.431770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cb047be6-5264-481a-9440-17b62973b5e6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:27.434412 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:27.435174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:27.440200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb047be6-5264-481a-9440-17b62973b5e6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:27.440681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb047be6-5264-481a-9440-17b62973b5e6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:27.441142 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb047be6-5264-481a-9440-17b62973b5e6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:27.442346 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb047be6-5264-481a-9440-17b62973b5e6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:27.442798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb047be6-5264-481a-9440-17b62973b5e6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:27.443216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cb047be6-5264-481a-9440-17b62973b5e6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:27.594793 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cb047be6-5264-481a-9440-17b62973b5e6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:27.602994 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cb047be6-5264-481a-9440-17b62973b5e6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1691 microversion: 2.1 time: 0.176679 Aug 29 16:51:27.603573 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4015/8251] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:27 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:28.632031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ae90d6d2-8268-46ec-bd06-9d1cf1ba6abf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:28.633159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ae90d6d2-8268-46ec-bd06-9d1cf1ba6abf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:28.644242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae90d6d2-8268-46ec-bd06-9d1cf1ba6abf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:28.645279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae90d6d2-8268-46ec-bd06-9d1cf1ba6abf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:28.645752 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae90d6d2-8268-46ec-bd06-9d1cf1ba6abf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:28.646473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae90d6d2-8268-46ec-bd06-9d1cf1ba6abf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:28.646954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae90d6d2-8268-46ec-bd06-9d1cf1ba6abf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:28.647401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae90d6d2-8268-46ec-bd06-9d1cf1ba6abf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:28.790661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ae90d6d2-8268-46ec-bd06-9d1cf1ba6abf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:28.803750 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ae90d6d2-8268-46ec-bd06-9d1cf1ba6abf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1691 microversion: 2.1 time: 0.181716 Aug 29 16:51:28.804569 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4237/8252] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:28 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:29.834025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3ff5323a-5447-4a20-9a8f-8029f7a50150 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:29.834623 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3ff5323a-5447-4a20-9a8f-8029f7a50150 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:29.842055 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ff5323a-5447-4a20-9a8f-8029f7a50150 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:29.842553 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ff5323a-5447-4a20-9a8f-8029f7a50150 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:29.843001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ff5323a-5447-4a20-9a8f-8029f7a50150 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:29.843683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ff5323a-5447-4a20-9a8f-8029f7a50150 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:29.844177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ff5323a-5447-4a20-9a8f-8029f7a50150 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:29.844608 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3ff5323a-5447-4a20-9a8f-8029f7a50150 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:29.978722 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3ff5323a-5447-4a20-9a8f-8029f7a50150 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:29.986788 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3ff5323a-5447-4a20-9a8f-8029f7a50150 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1691 microversion: 2.1 time: 0.158875 Aug 29 16:51:29.987377 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4016/8253] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:29 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:31.010897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-3a2bb29a-c769-40bf-8bcc-a9f31576a380 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:31.011489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-3a2bb29a-c769-40bf-8bcc-a9f31576a380 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:31.018869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a2bb29a-c769-40bf-8bcc-a9f31576a380 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:31.019375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a2bb29a-c769-40bf-8bcc-a9f31576a380 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:31.019838 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a2bb29a-c769-40bf-8bcc-a9f31576a380 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:31.020570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a2bb29a-c769-40bf-8bcc-a9f31576a380 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:31.021027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a2bb29a-c769-40bf-8bcc-a9f31576a380 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:31.021472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-3a2bb29a-c769-40bf-8bcc-a9f31576a380 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:31.174451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-3a2bb29a-c769-40bf-8bcc-a9f31576a380 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:31.183090 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-3a2bb29a-c769-40bf-8bcc-a9f31576a380 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1691 microversion: 2.1 time: 0.177421 Aug 29 16:51:31.183670 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4238/8254] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:31 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:32.208511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f97fb349-e440-47c1-87e3-d34aa5b7c6e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:32.209434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f97fb349-e440-47c1-87e3-d34aa5b7c6e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:32.217436 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f97fb349-e440-47c1-87e3-d34aa5b7c6e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:32.217942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f97fb349-e440-47c1-87e3-d34aa5b7c6e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:32.218419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f97fb349-e440-47c1-87e3-d34aa5b7c6e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:32.219125 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f97fb349-e440-47c1-87e3-d34aa5b7c6e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:32.219590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f97fb349-e440-47c1-87e3-d34aa5b7c6e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:32.220024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f97fb349-e440-47c1-87e3-d34aa5b7c6e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:32.362695 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f97fb349-e440-47c1-87e3-d34aa5b7c6e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:32.371135 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f97fb349-e440-47c1-87e3-d34aa5b7c6e7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1691 microversion: 2.1 time: 0.169588 Aug 29 16:51:32.371724 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4017/8255] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:32 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:33.397217 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-8744c3ac-38c9-499e-88af-7a0dcb56a698 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:33.398262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-8744c3ac-38c9-499e-88af-7a0dcb56a698 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:33.406172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8744c3ac-38c9-499e-88af-7a0dcb56a698 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:33.406685 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8744c3ac-38c9-499e-88af-7a0dcb56a698 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:33.407143 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8744c3ac-38c9-499e-88af-7a0dcb56a698 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:33.407959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8744c3ac-38c9-499e-88af-7a0dcb56a698 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:33.408330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8744c3ac-38c9-499e-88af-7a0dcb56a698 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:33.408777 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-8744c3ac-38c9-499e-88af-7a0dcb56a698 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:33.551312 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-8744c3ac-38c9-499e-88af-7a0dcb56a698 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:33.559395 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-8744c3ac-38c9-499e-88af-7a0dcb56a698 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1691 microversion: 2.1 time: 0.169192 Aug 29 16:51:33.559987 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4239/8256] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:33 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:34.585365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c0c76e01-9a0b-415b-8223-1a9e293e8ad5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:34.586427 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c0c76e01-9a0b-415b-8223-1a9e293e8ad5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:34.594065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0c76e01-9a0b-415b-8223-1a9e293e8ad5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:34.594563 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0c76e01-9a0b-415b-8223-1a9e293e8ad5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:34.595005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0c76e01-9a0b-415b-8223-1a9e293e8ad5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:34.595705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0c76e01-9a0b-415b-8223-1a9e293e8ad5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:34.596166 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0c76e01-9a0b-415b-8223-1a9e293e8ad5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:34.596596 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c0c76e01-9a0b-415b-8223-1a9e293e8ad5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:34.730277 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c0c76e01-9a0b-415b-8223-1a9e293e8ad5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:34.738734 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c0c76e01-9a0b-415b-8223-1a9e293e8ad5 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1691 microversion: 2.1 time: 0.160024 Aug 29 16:51:34.739324 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4018/8257] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:34 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:35.771121 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b38230f6-1bcc-4332-b53a-7ad12b848761 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:35.772202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b38230f6-1bcc-4332-b53a-7ad12b848761 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:35.783921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b38230f6-1bcc-4332-b53a-7ad12b848761 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:35.784739 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b38230f6-1bcc-4332-b53a-7ad12b848761 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:35.785545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b38230f6-1bcc-4332-b53a-7ad12b848761 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:35.786713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b38230f6-1bcc-4332-b53a-7ad12b848761 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:35.787489 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b38230f6-1bcc-4332-b53a-7ad12b848761 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:35.788221 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b38230f6-1bcc-4332-b53a-7ad12b848761 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:35.929706 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b38230f6-1bcc-4332-b53a-7ad12b848761 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:35.942247 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b38230f6-1bcc-4332-b53a-7ad12b848761 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1691 microversion: 2.1 time: 0.176945 Aug 29 16:51:35.943147 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4240/8258] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:35 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:36.967163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c53687ce-51a9-4331-93e8-5db89d87ce6e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:36.968036 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c53687ce-51a9-4331-93e8-5db89d87ce6e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:36.977832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c53687ce-51a9-4331-93e8-5db89d87ce6e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:36.978528 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c53687ce-51a9-4331-93e8-5db89d87ce6e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:36.979395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c53687ce-51a9-4331-93e8-5db89d87ce6e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:36.980392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c53687ce-51a9-4331-93e8-5db89d87ce6e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:36.981034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c53687ce-51a9-4331-93e8-5db89d87ce6e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:36.981689 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c53687ce-51a9-4331-93e8-5db89d87ce6e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:37.129161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c53687ce-51a9-4331-93e8-5db89d87ce6e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:37.137762 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c53687ce-51a9-4331-93e8-5db89d87ce6e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1691 microversion: 2.1 time: 0.176854 Aug 29 16:51:37.138368 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4019/8259] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:36 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:38.161022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4c42700c-2649-4d27-b120-5777cf486c68 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:38.161847 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4c42700c-2649-4d27-b120-5777cf486c68 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:38.171176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c42700c-2649-4d27-b120-5777cf486c68 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:38.171810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c42700c-2649-4d27-b120-5777cf486c68 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:38.172401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c42700c-2649-4d27-b120-5777cf486c68 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:38.173343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c42700c-2649-4d27-b120-5777cf486c68 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:38.173977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c42700c-2649-4d27-b120-5777cf486c68 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:38.174513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4c42700c-2649-4d27-b120-5777cf486c68 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:38.340931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4c42700c-2649-4d27-b120-5777cf486c68 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:38.354162 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4c42700c-2649-4d27-b120-5777cf486c68 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1691 microversion: 2.1 time: 0.197864 Aug 29 16:51:38.354753 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4241/8260] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:38 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1691 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:39.375875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8c418db3-a76f-4887-8ce2-a7f6a576d57e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:39.376538 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8c418db3-a76f-4887-8ce2-a7f6a576d57e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:39.383746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c418db3-a76f-4887-8ce2-a7f6a576d57e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:39.384239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c418db3-a76f-4887-8ce2-a7f6a576d57e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:39.384676 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c418db3-a76f-4887-8ce2-a7f6a576d57e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:39.385401 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c418db3-a76f-4887-8ce2-a7f6a576d57e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:39.385959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c418db3-a76f-4887-8ce2-a7f6a576d57e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:39.386395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8c418db3-a76f-4887-8ce2-a7f6a576d57e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:39.543156 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8c418db3-a76f-4887-8ce2-a7f6a576d57e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:39.555141 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8c418db3-a76f-4887-8ce2-a7f6a576d57e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1691 microversion: 2.1 time: 0.183044 Aug 29 16:51:39.555886 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4020/8261] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:39 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:40.581789 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9c9cb1a9-751e-4044-a1d4-ddd686355d69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:40.582773 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9c9cb1a9-751e-4044-a1d4-ddd686355d69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:40.594604 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c9cb1a9-751e-4044-a1d4-ddd686355d69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:40.595473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c9cb1a9-751e-4044-a1d4-ddd686355d69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:40.596231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c9cb1a9-751e-4044-a1d4-ddd686355d69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:40.597459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c9cb1a9-751e-4044-a1d4-ddd686355d69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:40.598245 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c9cb1a9-751e-4044-a1d4-ddd686355d69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:40.598969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c9cb1a9-751e-4044-a1d4-ddd686355d69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:40.737431 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9c9cb1a9-751e-4044-a1d4-ddd686355d69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:40.745843 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9c9cb1a9-751e-4044-a1d4-ddd686355d69 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1691 microversion: 2.1 time: 0.170680 Aug 29 16:51:40.746429 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4242/8262] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:40 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:41.770757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-72432e53-0c8e-41a8-92d4-796dcf17becf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:41.771350 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-72432e53-0c8e-41a8-92d4-796dcf17becf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:41.781473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72432e53-0c8e-41a8-92d4-796dcf17becf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:41.781965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72432e53-0c8e-41a8-92d4-796dcf17becf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:41.782400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72432e53-0c8e-41a8-92d4-796dcf17becf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:41.783139 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72432e53-0c8e-41a8-92d4-796dcf17becf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:41.783802 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72432e53-0c8e-41a8-92d4-796dcf17becf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:41.784253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72432e53-0c8e-41a8-92d4-796dcf17becf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:41.919939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-72432e53-0c8e-41a8-92d4-796dcf17becf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:41.928259 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-72432e53-0c8e-41a8-92d4-796dcf17becf tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1691 microversion: 2.1 time: 0.163737 Aug 29 16:51:41.928860 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4021/8263] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:41 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:42.951843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f175069d-7ae4-4e05-aceb-1bb90b6984b2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:42.952448 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f175069d-7ae4-4e05-aceb-1bb90b6984b2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:42.959987 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f175069d-7ae4-4e05-aceb-1bb90b6984b2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:42.960484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f175069d-7ae4-4e05-aceb-1bb90b6984b2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:42.960961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f175069d-7ae4-4e05-aceb-1bb90b6984b2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:42.961717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f175069d-7ae4-4e05-aceb-1bb90b6984b2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:42.962195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f175069d-7ae4-4e05-aceb-1bb90b6984b2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:42.962641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f175069d-7ae4-4e05-aceb-1bb90b6984b2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:43.117682 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f175069d-7ae4-4e05-aceb-1bb90b6984b2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:43.125812 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f175069d-7ae4-4e05-aceb-1bb90b6984b2 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1668 microversion: 2.1 time: 0.178797 Aug 29 16:51:43.126397 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4243/8264] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:42 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1668 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:44.235529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-92fbceed-1b6a-4600-8bfa-e0f379df01de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:44.239162 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-92fbceed-1b6a-4600-8bfa-e0f379df01de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:44.248840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92fbceed-1b6a-4600-8bfa-e0f379df01de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:44.249358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92fbceed-1b6a-4600-8bfa-e0f379df01de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:44.249803 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92fbceed-1b6a-4600-8bfa-e0f379df01de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:44.250529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92fbceed-1b6a-4600-8bfa-e0f379df01de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:44.250962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92fbceed-1b6a-4600-8bfa-e0f379df01de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:44.251395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-92fbceed-1b6a-4600-8bfa-e0f379df01de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:44.314870 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-92fbceed-1b6a-4600-8bfa-e0f379df01de tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748/action" status: 200 len: 37844 microversion: 2.1 time: 0.086040 Aug 29 16:51:44.315532 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4022/8265] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:51:44 2022] POST /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748/action => generated 37844 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:51:44.328011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e630569a-7629-4df3-a6f4-d2b11b382f2b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:44.335467 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e630569a-7629-4df3-a6f4-d2b11b382f2b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:44.335971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e630569a-7629-4df3-a6f4-d2b11b382f2b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:44.336428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e630569a-7629-4df3-a6f4-d2b11b382f2b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:44.359576 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e630569a-7629-4df3-a6f4-d2b11b382f2b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Going to try to start instance {{(pid=122360) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 16:51:44.405750 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e630569a-7629-4df3-a6f4-d2b11b382f2b tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748/action" status: 202 len: 0 microversion: 2.1 time: 0.081516 Aug 29 16:51:44.406384 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4244/8266] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:51:44 2022] POST /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:51:44.415210 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a7ed1074-9bbe-4a3f-b092-82bc3e4b0b01 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:44.415923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a7ed1074-9bbe-4a3f-b092-82bc3e4b0b01 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:44.423498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7ed1074-9bbe-4a3f-b092-82bc3e4b0b01 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:44.424095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7ed1074-9bbe-4a3f-b092-82bc3e4b0b01 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:44.424583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7ed1074-9bbe-4a3f-b092-82bc3e4b0b01 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:44.425355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7ed1074-9bbe-4a3f-b092-82bc3e4b0b01 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:44.426344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7ed1074-9bbe-4a3f-b092-82bc3e4b0b01 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:44.426344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a7ed1074-9bbe-4a3f-b092-82bc3e4b0b01 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:44.620425 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a7ed1074-9bbe-4a3f-b092-82bc3e4b0b01 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:44.628861 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a7ed1074-9bbe-4a3f-b092-82bc3e4b0b01 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1677 microversion: 2.1 time: 0.217923 Aug 29 16:51:44.629497 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4023/8267] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:44 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:45.655552 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-90af1691-a6ae-4b4e-8825-0bddb1a63831 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:45.656271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-90af1691-a6ae-4b4e-8825-0bddb1a63831 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:45.662751 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90af1691-a6ae-4b4e-8825-0bddb1a63831 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:45.663255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90af1691-a6ae-4b4e-8825-0bddb1a63831 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:45.663704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90af1691-a6ae-4b4e-8825-0bddb1a63831 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:45.664414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90af1691-a6ae-4b4e-8825-0bddb1a63831 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:45.664906 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90af1691-a6ae-4b4e-8825-0bddb1a63831 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:45.665447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-90af1691-a6ae-4b4e-8825-0bddb1a63831 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:45.807416 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-90af1691-a6ae-4b4e-8825-0bddb1a63831 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:45.815936 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-90af1691-a6ae-4b4e-8825-0bddb1a63831 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1681 microversion: 2.1 time: 0.168253 Aug 29 16:51:45.816887 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4245/8268] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:45 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:52:22.117208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-74443716-b4a7-4d3c-8b12-465c353830fe tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:52:22.119450 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-74443716-b4a7-4d3c-8b12-465c353830fe tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:22.122306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=18 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:52:22.122938 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=52 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:52:22.131200 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74443716-b4a7-4d3c-8b12-465c353830fe tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:22.131986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74443716-b4a7-4d3c-8b12-465c353830fe tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:22.132434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74443716-b4a7-4d3c-8b12-465c353830fe tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:22.133181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74443716-b4a7-4d3c-8b12-465c353830fe tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:22.133647 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74443716-b4a7-4d3c-8b12-465c353830fe tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:22.134073 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-74443716-b4a7-4d3c-8b12-465c353830fe tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:22.234180 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-74443716-b4a7-4d3c-8b12-465c353830fe tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748/action" status: 200 len: 62401 microversion: 2.1 time: 0.122177 Aug 29 16:52:22.235242 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4024/8269] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:52:22 2022] POST /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748/action => generated 62401 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:52:46.011596 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=20 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:52:46.013056 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:52:46.017325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:52:46.018102 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:52:46.019181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c87eabcb-4ecd-4579-aeb6-149e3fecaee1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:46.019818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c87eabcb-4ecd-4579-aeb6-149e3fecaee1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:46.028794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87eabcb-4ecd-4579-aeb6-149e3fecaee1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:46.029605 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87eabcb-4ecd-4579-aeb6-149e3fecaee1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:46.029960 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87eabcb-4ecd-4579-aeb6-149e3fecaee1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:46.030673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87eabcb-4ecd-4579-aeb6-149e3fecaee1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:46.031183 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87eabcb-4ecd-4579-aeb6-149e3fecaee1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:46.031615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c87eabcb-4ecd-4579-aeb6-149e3fecaee1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:46.059805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c87eabcb-4ecd-4579-aeb6-149e3fecaee1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:52:46.139438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-134c86c0-68e1-40e1-97e1-44683b1cf129 req-e4a11d00-8ede-4343-8d8e-d14ca7d4e7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578b8013-6be6-4cc4-8e10-eb4e526fd748", "tag": "785b52ec-201c-4383-8cbb-4ccc05599c0b"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:52:46.152862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-134c86c0-68e1-40e1-97e1-44683b1cf129 req-e4a11d00-8ede-4343-8d8e-d14ca7d4e7c5 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:46.153514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-134c86c0-68e1-40e1-97e1-44683b1cf129 req-e4a11d00-8ede-4343-8d8e-d14ca7d4e7c5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:46.153968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-134c86c0-68e1-40e1-97e1-44683b1cf129 req-e4a11d00-8ede-4343-8d8e-d14ca7d4e7c5 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:46.155940 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c87eabcb-4ecd-4579-aeb6-149e3fecaee1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "DELETE /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 204 len: 0 microversion: 2.1 time: 0.146127 Aug 29 16:52:46.161162 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4246/8270] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:52:46 2022] DELETE /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:52:46.166424 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-134c86c0-68e1-40e1-97e1-44683b1cf129 req-e4a11d00-8ede-4343-8d8e-d14ca7d4e7c5 service nova] Creating event network-changed:785b52ec-201c-4383-8cbb-4ccc05599c0b for instance 578b8013-6be6-4cc4-8e10-eb4e526fd748 on n-h2-839401-11 Aug 29 16:52:46.168944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-02083f94-96e7-47d2-a75b-2b6c88347545 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:46.170504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-02083f94-96e7-47d2-a75b-2b6c88347545 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:46.172073 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-134c86c0-68e1-40e1-97e1-44683b1cf129 req-e4a11d00-8ede-4343-8d8e-d14ca7d4e7c5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160328 Aug 29 16:52:46.172860 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4025/8271] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:52:46.176535 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02083f94-96e7-47d2-a75b-2b6c88347545 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:46.177047 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02083f94-96e7-47d2-a75b-2b6c88347545 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:46.177668 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02083f94-96e7-47d2-a75b-2b6c88347545 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:46.178560 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02083f94-96e7-47d2-a75b-2b6c88347545 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:46.179031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02083f94-96e7-47d2-a75b-2b6c88347545 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:46.179476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-02083f94-96e7-47d2-a75b-2b6c88347545 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:46.323524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-02083f94-96e7-47d2-a75b-2b6c88347545 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:52:46.331766 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-02083f94-96e7-47d2-a75b-2b6c88347545 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1687 microversion: 2.1 time: 0.167726 Aug 29 16:52:46.332542 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4247/8272] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:52:46 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:52:47.360208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-85b7750b-853f-49f1-b7db-0185230f7b14 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:47.361329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-85b7750b-853f-49f1-b7db-0185230f7b14 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:47.371548 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85b7750b-853f-49f1-b7db-0185230f7b14 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:47.372034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85b7750b-853f-49f1-b7db-0185230f7b14 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:47.372475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85b7750b-853f-49f1-b7db-0185230f7b14 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:47.373207 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85b7750b-853f-49f1-b7db-0185230f7b14 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:47.373665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85b7750b-853f-49f1-b7db-0185230f7b14 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:47.374089 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-85b7750b-853f-49f1-b7db-0185230f7b14 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:47.597259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-85b7750b-853f-49f1-b7db-0185230f7b14 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:52:47.606058 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-85b7750b-853f-49f1-b7db-0185230f7b14 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1687 microversion: 2.1 time: 0.254466 Aug 29 16:52:47.606851 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4026/8273] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:52:47 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1687 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:52:48.392492 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-9a68ace9-c089-48a2-94f4-adae612cb71d req-1d8926f1-652c-439c-92a4-adf2f67ac40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578b8013-6be6-4cc4-8e10-eb4e526fd748", "name": "network-vif-deleted", "tag": "785b52ec-201c-4383-8cbb-4ccc05599c0b"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:52:48.405616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9a68ace9-c089-48a2-94f4-adae612cb71d req-1d8926f1-652c-439c-92a4-adf2f67ac40a service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:48.406128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9a68ace9-c089-48a2-94f4-adae612cb71d req-1d8926f1-652c-439c-92a4-adf2f67ac40a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:48.406569 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-9a68ace9-c089-48a2-94f4-adae612cb71d req-1d8926f1-652c-439c-92a4-adf2f67ac40a service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:48.418628 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-9a68ace9-c089-48a2-94f4-adae612cb71d req-1d8926f1-652c-439c-92a4-adf2f67ac40a service nova] Creating event network-vif-deleted:785b52ec-201c-4383-8cbb-4ccc05599c0b for instance 578b8013-6be6-4cc4-8e10-eb4e526fd748 on n-h2-839401-11 Aug 29 16:52:48.423787 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-9a68ace9-c089-48a2-94f4-adae612cb71d req-1d8926f1-652c-439c-92a4-adf2f67ac40a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035132 Aug 29 16:52:48.424588 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4248/8274] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:52:48.630396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-994f4723-1840-455e-b635-108c8ab6dc3e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:48.631029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-994f4723-1840-455e-b635-108c8ab6dc3e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:48.639398 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-994f4723-1840-455e-b635-108c8ab6dc3e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:48.639894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-994f4723-1840-455e-b635-108c8ab6dc3e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:48.640329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-994f4723-1840-455e-b635-108c8ab6dc3e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:48.641034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-994f4723-1840-455e-b635-108c8ab6dc3e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:48.641540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-994f4723-1840-455e-b635-108c8ab6dc3e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:48.641970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-994f4723-1840-455e-b635-108c8ab6dc3e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:48.680888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-994f4723-1840-455e-b635-108c8ab6dc3e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:48.681395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-994f4723-1840-455e-b635-108c8ab6dc3e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:48.681849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-994f4723-1840-455e-b635-108c8ab6dc3e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:48.682465 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-994f4723-1840-455e-b635-108c8ab6dc3e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lazy-loading 'fault' on Instance uuid 578b8013-6be6-4cc4-8e10-eb4e526fd748 {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:52:48.730126 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-994f4723-1840-455e-b635-108c8ab6dc3e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:52:48.738804 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-994f4723-1840-455e-b635-108c8ab6dc3e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 200 len: 1355 microversion: 2.1 time: 0.113556 Aug 29 16:52:48.739421 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4027/8275] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:52:48 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 1355 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:52:49.761902 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0b450981-5e66-4807-bf09-a04d5cc447d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:49.762620 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0b450981-5e66-4807-bf09-a04d5cc447d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: 578b8013-6be6-4cc4-8e10-eb4e526fd748] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:49.769462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b450981-5e66-4807-bf09-a04d5cc447d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:49.769971 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b450981-5e66-4807-bf09-a04d5cc447d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:49.770429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b450981-5e66-4807-bf09-a04d5cc447d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:49.771146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b450981-5e66-4807-bf09-a04d5cc447d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:49.771627 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b450981-5e66-4807-bf09-a04d5cc447d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:49.772075 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0b450981-5e66-4807-bf09-a04d5cc447d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:49.786060 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-0b450981-5e66-4807-bf09-a04d5cc447d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] HTTP exception thrown: Instance 578b8013-6be6-4cc4-8e10-eb4e526fd748 could not be found. Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0b450981-5e66-4807-bf09-a04d5cc447d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Request method failure captured: Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 HTTP/1.1 Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDOxhtoEToS3nQ4x7iVmKQZTqOC8mawYKijdPvY6Bh_MTssjj9rVe4heRLLbq4FF58bMfx8T4Eb3qq5MMGmLVsYPUFPe-ZvbGjTL-Bxl7OoI6lDRIRmK3ropbwVWSh1BWN2psc293apISyO1eYL1oyiROFjCcWD6TQJA8ehzovaaRd9w Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: 3c4a511b63e449ad84d6b8172efa8f26 Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1448564924 Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3c4a511b63e449ad84d6b8172efa8f26", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3c4a511b63e449ad84d6b8172efa8f26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3c4a511b63e449ad84d6b8172efa8f26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3c4a511b63e449ad84d6b8172efa8f26"}]}] Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1448564924 Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: 3c4a511b63e449ad84d6b8172efa8f26 Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1448564924 Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestNetworkAdvancedServerOps-1448564924-project Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: c9565af0dfd0482f887f0eea2f3a1f4e Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1448564924-project Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance 578b8013-6be6-4cc4-8e10-eb4e526fd748 could not be found. Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': '578b8013-6be6-4cc4-8e10-eb4e526fd748'} Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 578b8013-6be6-4cc4-8e10-eb4e526fd748 could not be found. Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 578b8013-6be6-4cc4-8e10-eb4e526fd748 could not be found. Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:52:49.787720 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:52:49.792696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:52:49.792696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:52:49.792696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:52:49.792696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:52:49.792696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:52:49.792696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:52:49.792696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 578b8013-6be6-4cc4-8e10-eb4e526fd748 could not be found. Aug 29 16:52:49.792696 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 16:52:49.792696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0b450981-5e66-4807-bf09-a04d5cc447d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Returning 404 to user: Instance 578b8013-6be6-4cc4-8e10-eb4e526fd748 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:52:49.792696 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0b450981-5e66-4807-bf09-a04d5cc447d3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748" status: 404 len: 111 microversion: 2.1 time: 0.032669 Aug 29 16:52:49.793550 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4249/8276] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:52:49 2022] GET /compute/v2.1/servers/578b8013-6be6-4cc4-8e10-eb4e526fd748 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:52:53.126966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a94cfc85-ae2c-4cf1-b8f6-3870c3ef78b4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '.version_select at 0x7fc433a123a0>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:53.154043 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a94cfc85-ae2c-4cf1-b8f6-3870c3ef78b4 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-143451954" status: 202 len: 0 microversion: 2.1 time: 0.031277 Aug 29 16:52:53.154658 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4028/8277] 10.222.0.62 () {58 vars in 1281 bytes} [Mon Aug 29 16:52:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-143451954 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:52:53.190157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1ec45951-3cde-4047-a115-c8bb07d84ff7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'create', calling method: .version_select at 0x7fc428542b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1131259456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvyzan6LgUwi9PB7Uw6gkty2v3XidJEOeWqnXZsytLbhAHlc+bRUdKRiWPnZdJW2i8VjC6oNeeSbTBwzD0umpKilr747Ggz4hBZrNflpYbNyyEQbdBl/5a7Xa2Fh/re/A=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:52:53.207735 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-1ec45951-3cde-4047-a115-c8bb07d84ff7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:52:53.213834 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-1ec45951-3cde-4047-a115-c8bb07d84ff7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for user c9565af0dfd0482f887f0eea2f3a1f4e and project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:52:53.227559 n-d-839401-11 devstack@n-api.service[122360]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1ec45951-3cde-4047-a115-c8bb07d84ff7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [c4fea839-36b3-431f-8bb6-ddea9bf9c77e] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:52:54.236928 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [None req-1ec45951-3cde-4047-a115-c8bb07d84ff7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [c4fea839-36b3-431f-8bb6-ddea9bf9c77e] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 42864. Aug 29 16:52:54.259505 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1ec45951-3cde-4047-a115-c8bb07d84ff7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.073732 Aug 29 16:52:54.260138 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4250/8278] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:52:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:00.256068 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-757228392", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "networks": [{"uuid": "7a6d21dc-9e1c-41f1-a479-1b2b6bb9f2ae"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1131259456", "security_groups": [{"name": "tempest-secgroup-smoke-67423160"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:00.268950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=16 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:00.385205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] validate_networks() for [('7a6d21dc-9e1c-41f1-a479-1b2b6bb9f2ae', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:53:00.874157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:53:00.874935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:53:00.875620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:53:00.876328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:53:00.877167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:53:00.887757 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:00.888594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:00.889282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:00.890618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:00.891314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:00.891962 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:00.914173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:53:00.920856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Getting quotas for user c9565af0dfd0482f887f0eea2f3a1f4e and project 3c4a511b63e449ad84d6b8172efa8f26. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:53:00.935333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:53:00.937969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:53:00.991151 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0bd687f1-c63d-4019-a3d5-8634e821ff79 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.739143 Aug 29 16:53:00.992211 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4029/8279] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:53:00 2022] POST /compute/v2.1/servers => generated 404 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:53:01.002948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d65fd8fd-95c2-433a-bb28-9ad6bd1698c7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:01.004232 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d65fd8fd-95c2-433a-bb28-9ad6bd1698c7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:01.007654 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:01.087905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d65fd8fd-95c2-433a-bb28-9ad6bd1698c7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:01.096383 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d65fd8fd-95c2-433a-bb28-9ad6bd1698c7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1266 microversion: 2.1 time: 0.097265 Aug 29 16:53:01.110220 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4251/8280] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:00 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:02.125734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-36bab2c7-25a3-46cc-936e-0796b8ce8d92 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:02.125734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-36bab2c7-25a3-46cc-936e-0796b8ce8d92 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:02.137763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36bab2c7-25a3-46cc-936e-0796b8ce8d92 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:02.138262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36bab2c7-25a3-46cc-936e-0796b8ce8d92 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:02.138705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36bab2c7-25a3-46cc-936e-0796b8ce8d92 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:02.139419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36bab2c7-25a3-46cc-936e-0796b8ce8d92 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:02.139867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36bab2c7-25a3-46cc-936e-0796b8ce8d92 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:02.140318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36bab2c7-25a3-46cc-936e-0796b8ce8d92 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:02.218884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36bab2c7-25a3-46cc-936e-0796b8ce8d92 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:02.227836 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-36bab2c7-25a3-46cc-936e-0796b8ce8d92 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1318 microversion: 2.1 time: 0.111485 Aug 29 16:53:02.228767 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4030/8281] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:02 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1318 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:03.249755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5f0e63dd-bc62-42ac-a870-337f4e016f4d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:03.251195 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5f0e63dd-bc62-42ac-a870-337f4e016f4d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:03.258916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f0e63dd-bc62-42ac-a870-337f4e016f4d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:03.259557 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f0e63dd-bc62-42ac-a870-337f4e016f4d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:03.260321 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f0e63dd-bc62-42ac-a870-337f4e016f4d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:03.261193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f0e63dd-bc62-42ac-a870-337f4e016f4d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:03.261776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f0e63dd-bc62-42ac-a870-337f4e016f4d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:03.262428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f0e63dd-bc62-42ac-a870-337f4e016f4d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:03.416624 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5f0e63dd-bc62-42ac-a870-337f4e016f4d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:03.424475 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5f0e63dd-bc62-42ac-a870-337f4e016f4d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1390 microversion: 2.1 time: 0.178932 Aug 29 16:53:03.425054 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4252/8282] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:03 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1390 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:03.756374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-fe07d1db-642e-4cdc-b68c-137461f10abc req-6749d836-8884-4561-b258-ea1dafcee002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c2f3fa-9a41-4530-9434-3fb99e864182", "tag": "48ac0239-78f8-4330-b5dd-c1704b60c684"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:03.766734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fe07d1db-642e-4cdc-b68c-137461f10abc req-6749d836-8884-4561-b258-ea1dafcee002 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:03.767213 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fe07d1db-642e-4cdc-b68c-137461f10abc req-6749d836-8884-4561-b258-ea1dafcee002 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:03.767653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fe07d1db-642e-4cdc-b68c-137461f10abc req-6749d836-8884-4561-b258-ea1dafcee002 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:03.779470 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-fe07d1db-642e-4cdc-b68c-137461f10abc req-6749d836-8884-4561-b258-ea1dafcee002 service nova] Creating event network-changed:48ac0239-78f8-4330-b5dd-c1704b60c684 for instance a7c2f3fa-9a41-4530-9434-3fb99e864182 on n-h1-839401-11 Aug 29 16:53:03.784637 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-fe07d1db-642e-4cdc-b68c-137461f10abc req-6749d836-8884-4561-b258-ea1dafcee002 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089745 Aug 29 16:53:03.785592 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4031/8283] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:04.446486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c2b42027-bb86-4a65-91de-d7ac1c75cada tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:04.447344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c2b42027-bb86-4a65-91de-d7ac1c75cada tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:04.456599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b42027-bb86-4a65-91de-d7ac1c75cada tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:04.457255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b42027-bb86-4a65-91de-d7ac1c75cada tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:04.457790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b42027-bb86-4a65-91de-d7ac1c75cada tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:04.458628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b42027-bb86-4a65-91de-d7ac1c75cada tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:04.459176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b42027-bb86-4a65-91de-d7ac1c75cada tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:04.459696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c2b42027-bb86-4a65-91de-d7ac1c75cada tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:04.607740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c2b42027-bb86-4a65-91de-d7ac1c75cada tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:04.615951 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c2b42027-bb86-4a65-91de-d7ac1c75cada tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1390 microversion: 2.1 time: 0.174075 Aug 29 16:53:04.616528 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4253/8284] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:04 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:05.641281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c1427d88-53c1-4fcb-a907-b3576c70ecb7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:05.642001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c1427d88-53c1-4fcb-a907-b3576c70ecb7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:05.648855 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1427d88-53c1-4fcb-a907-b3576c70ecb7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:05.649587 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1427d88-53c1-4fcb-a907-b3576c70ecb7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:05.650026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1427d88-53c1-4fcb-a907-b3576c70ecb7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:05.650728 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1427d88-53c1-4fcb-a907-b3576c70ecb7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:05.651180 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1427d88-53c1-4fcb-a907-b3576c70ecb7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:05.651586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c1427d88-53c1-4fcb-a907-b3576c70ecb7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:05.791607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c1427d88-53c1-4fcb-a907-b3576c70ecb7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:05.799832 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c1427d88-53c1-4fcb-a907-b3576c70ecb7 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1390 microversion: 2.1 time: 0.164783 Aug 29 16:53:05.800430 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4032/8285] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:05 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:06.825509 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e2b2f9fc-ce9f-4bdd-b4de-bb8672b7e474 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:06.826762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e2b2f9fc-ce9f-4bdd-b4de-bb8672b7e474 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:06.839260 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2b2f9fc-ce9f-4bdd-b4de-bb8672b7e474 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:06.840172 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2b2f9fc-ce9f-4bdd-b4de-bb8672b7e474 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:06.840761 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2b2f9fc-ce9f-4bdd-b4de-bb8672b7e474 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:06.841567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2b2f9fc-ce9f-4bdd-b4de-bb8672b7e474 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:06.842045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2b2f9fc-ce9f-4bdd-b4de-bb8672b7e474 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:06.842493 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e2b2f9fc-ce9f-4bdd-b4de-bb8672b7e474 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:06.982545 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e2b2f9fc-ce9f-4bdd-b4de-bb8672b7e474 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:06.990584 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e2b2f9fc-ce9f-4bdd-b4de-bb8672b7e474 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1390 microversion: 2.1 time: 0.171865 Aug 29 16:53:06.991211 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4254/8286] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:06 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:08.013217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-acade282-7ba6-40a4-93a8-aba845621359 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:08.013928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-acade282-7ba6-40a4-93a8-aba845621359 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:08.022438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acade282-7ba6-40a4-93a8-aba845621359 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:08.022932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acade282-7ba6-40a4-93a8-aba845621359 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:08.023375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acade282-7ba6-40a4-93a8-aba845621359 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:08.024094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acade282-7ba6-40a4-93a8-aba845621359 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:08.024560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acade282-7ba6-40a4-93a8-aba845621359 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:08.024996 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-acade282-7ba6-40a4-93a8-aba845621359 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:08.527024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-acade282-7ba6-40a4-93a8-aba845621359 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:08.537908 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-acade282-7ba6-40a4-93a8-aba845621359 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1390 microversion: 2.1 time: 0.528801 Aug 29 16:53:08.538767 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4033/8287] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:08 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1390 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:09.563150 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c581c7dd-6c13-4aac-84fa-456dcc4d5130 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:09.564109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c581c7dd-6c13-4aac-84fa-456dcc4d5130 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:09.576738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c581c7dd-6c13-4aac-84fa-456dcc4d5130 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:09.577280 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c581c7dd-6c13-4aac-84fa-456dcc4d5130 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:09.577733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c581c7dd-6c13-4aac-84fa-456dcc4d5130 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:09.578441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c581c7dd-6c13-4aac-84fa-456dcc4d5130 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:09.578909 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c581c7dd-6c13-4aac-84fa-456dcc4d5130 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:09.579348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c581c7dd-6c13-4aac-84fa-456dcc4d5130 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:09.719410 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c581c7dd-6c13-4aac-84fa-456dcc4d5130 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:09.731868 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c581c7dd-6c13-4aac-84fa-456dcc4d5130 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1390 microversion: 2.1 time: 0.175051 Aug 29 16:53:09.732685 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4255/8288] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:09 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:10.310521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-5e362bb1-b534-49fd-8404-3e519fa9708c req-513079b1-074a-4daa-ae9d-27b98f28b368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c2f3fa-9a41-4530-9434-3fb99e864182", "name": "network-vif-plugged", "status": "completed", "tag": "48ac0239-78f8-4330-b5dd-c1704b60c684"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:10.321864 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5e362bb1-b534-49fd-8404-3e519fa9708c req-513079b1-074a-4daa-ae9d-27b98f28b368 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:10.322354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5e362bb1-b534-49fd-8404-3e519fa9708c req-513079b1-074a-4daa-ae9d-27b98f28b368 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:10.322788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-5e362bb1-b534-49fd-8404-3e519fa9708c req-513079b1-074a-4daa-ae9d-27b98f28b368 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:10.334344 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-5e362bb1-b534-49fd-8404-3e519fa9708c req-513079b1-074a-4daa-ae9d-27b98f28b368 service nova] Creating event network-vif-plugged:48ac0239-78f8-4330-b5dd-c1704b60c684 for instance a7c2f3fa-9a41-4530-9434-3fb99e864182 on n-h1-839401-11 Aug 29 16:53:10.339829 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-5e362bb1-b534-49fd-8404-3e519fa9708c req-513079b1-074a-4daa-ae9d-27b98f28b368 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033138 Aug 29 16:53:10.340773 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4034/8289] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:10.758946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-87ea7294-04cd-4e97-9863-9c90d94ad6ed tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:10.759483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-87ea7294-04cd-4e97-9863-9c90d94ad6ed tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:10.767137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87ea7294-04cd-4e97-9863-9c90d94ad6ed tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:10.767729 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87ea7294-04cd-4e97-9863-9c90d94ad6ed tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:10.768271 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87ea7294-04cd-4e97-9863-9c90d94ad6ed tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:10.769118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87ea7294-04cd-4e97-9863-9c90d94ad6ed tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:10.769666 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87ea7294-04cd-4e97-9863-9c90d94ad6ed tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:10.770182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87ea7294-04cd-4e97-9863-9c90d94ad6ed tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:10.913304 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-87ea7294-04cd-4e97-9863-9c90d94ad6ed tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:10.921671 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-87ea7294-04cd-4e97-9863-9c90d94ad6ed tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1390 microversion: 2.1 time: 0.166936 Aug 29 16:53:10.922261 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4256/8290] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:10 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:11.942966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:11.944116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:11.951634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ac2d9cad-6f6a-4cc9-88cd-77d51bc8b55a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:11.952328 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ac2d9cad-6f6a-4cc9-88cd-77d51bc8b55a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:11.959737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac2d9cad-6f6a-4cc9-88cd-77d51bc8b55a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:11.960218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac2d9cad-6f6a-4cc9-88cd-77d51bc8b55a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:11.960658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac2d9cad-6f6a-4cc9-88cd-77d51bc8b55a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:11.962660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac2d9cad-6f6a-4cc9-88cd-77d51bc8b55a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:11.963137 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac2d9cad-6f6a-4cc9-88cd-77d51bc8b55a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:11.963559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ac2d9cad-6f6a-4cc9-88cd-77d51bc8b55a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:12.102730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ac2d9cad-6f6a-4cc9-88cd-77d51bc8b55a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:12.110717 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ac2d9cad-6f6a-4cc9-88cd-77d51bc8b55a tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1390 microversion: 2.1 time: 0.169587 Aug 29 16:53:12.111348 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4035/8291] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:11 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:13.130788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:13.138585 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-372f2a53-cbcb-44db-86f0-c45ae1464732 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:13.139632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-372f2a53-cbcb-44db-86f0-c45ae1464732 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:13.149645 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-372f2a53-cbcb-44db-86f0-c45ae1464732 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:13.150406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-372f2a53-cbcb-44db-86f0-c45ae1464732 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:13.151035 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-372f2a53-cbcb-44db-86f0-c45ae1464732 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:13.152145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-372f2a53-cbcb-44db-86f0-c45ae1464732 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:13.152815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-372f2a53-cbcb-44db-86f0-c45ae1464732 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:13.153466 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-372f2a53-cbcb-44db-86f0-c45ae1464732 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:13.299506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-372f2a53-cbcb-44db-86f0-c45ae1464732 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:13.307691 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-372f2a53-cbcb-44db-86f0-c45ae1464732 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1562 microversion: 2.1 time: 0.178674 Aug 29 16:53:13.308246 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4257/8292] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:13 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1562 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:13.328769 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-58a45d16-05e6-4abd-8bc3-4e9dcaed4946 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:13.329431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-58a45d16-05e6-4abd-8bc3-4e9dcaed4946 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:13.336637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58a45d16-05e6-4abd-8bc3-4e9dcaed4946 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:13.337148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58a45d16-05e6-4abd-8bc3-4e9dcaed4946 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:13.337581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58a45d16-05e6-4abd-8bc3-4e9dcaed4946 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:13.338272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58a45d16-05e6-4abd-8bc3-4e9dcaed4946 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:13.338756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58a45d16-05e6-4abd-8bc3-4e9dcaed4946 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:13.339175 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-58a45d16-05e6-4abd-8bc3-4e9dcaed4946 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:13.482999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-58a45d16-05e6-4abd-8bc3-4e9dcaed4946 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:13.491225 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-58a45d16-05e6-4abd-8bc3-4e9dcaed4946 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1562 microversion: 2.1 time: 0.166578 Aug 29 16:53:13.491807 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4036/8293] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:13 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:15.156344 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-10d9dc8e-bd07-4e90-86f5-bb1988aeaa42 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:15.156974 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-10d9dc8e-bd07-4e90-86f5-bb1988aeaa42 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:15.160121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-d402011a-a280-43ca-9ef1-02b54779773b req-18ad88ba-1e13-4551-bb02-6ff8498df18d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c2f3fa-9a41-4530-9434-3fb99e864182", "tag": "48ac0239-78f8-4330-b5dd-c1704b60c684"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:15.164167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10d9dc8e-bd07-4e90-86f5-bb1988aeaa42 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:15.164891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10d9dc8e-bd07-4e90-86f5-bb1988aeaa42 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:15.165554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10d9dc8e-bd07-4e90-86f5-bb1988aeaa42 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:15.166473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10d9dc8e-bd07-4e90-86f5-bb1988aeaa42 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:15.167118 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10d9dc8e-bd07-4e90-86f5-bb1988aeaa42 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:15.167575 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-10d9dc8e-bd07-4e90-86f5-bb1988aeaa42 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:15.171690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d402011a-a280-43ca-9ef1-02b54779773b req-18ad88ba-1e13-4551-bb02-6ff8498df18d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:15.172245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d402011a-a280-43ca-9ef1-02b54779773b req-18ad88ba-1e13-4551-bb02-6ff8498df18d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:15.172736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-d402011a-a280-43ca-9ef1-02b54779773b req-18ad88ba-1e13-4551-bb02-6ff8498df18d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:15.184494 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-d402011a-a280-43ca-9ef1-02b54779773b req-18ad88ba-1e13-4551-bb02-6ff8498df18d service nova] Creating event network-changed:48ac0239-78f8-4330-b5dd-c1704b60c684 for instance a7c2f3fa-9a41-4530-9434-3fb99e864182 on n-h1-839401-11 Aug 29 16:53:15.190517 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-d402011a-a280-43ca-9ef1-02b54779773b req-18ad88ba-1e13-4551-bb02-6ff8498df18d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035164 Aug 29 16:53:15.191381 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4037/8294] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:53:15.313890 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-10d9dc8e-bd07-4e90-86f5-bb1988aeaa42 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:15.322011 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-10d9dc8e-bd07-4e90-86f5-bb1988aeaa42 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1562 microversion: 2.1 time: 0.169644 Aug 29 16:53:15.323038 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4258/8295] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:15 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:52.704327 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:52.705611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=38 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:52.713159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ccb089a7-e6fc-4714-9f44-08dddef3e64d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:52.715475 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ccb089a7-e6fc-4714-9f44-08dddef3e64d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:52.723687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccb089a7-e6fc-4714-9f44-08dddef3e64d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:52.724218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccb089a7-e6fc-4714-9f44-08dddef3e64d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:52.724659 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccb089a7-e6fc-4714-9f44-08dddef3e64d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:52.725389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccb089a7-e6fc-4714-9f44-08dddef3e64d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:52.725847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccb089a7-e6fc-4714-9f44-08dddef3e64d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:52.726272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ccb089a7-e6fc-4714-9f44-08dddef3e64d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:52.801326 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ccb089a7-e6fc-4714-9f44-08dddef3e64d tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182/action" status: 200 len: 24570 microversion: 2.1 time: 0.102359 Aug 29 16:53:52.801974 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4038/8296] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:53:52 2022] POST /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182/action => generated 24570 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:54:31.599394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:31.600657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=42 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:31.606505 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6d1e1597-969f-415e-b07b-627dcdaef8a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:31.607145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6d1e1597-969f-415e-b07b-627dcdaef8a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:31.614540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d1e1597-969f-415e-b07b-627dcdaef8a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:31.615058 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d1e1597-969f-415e-b07b-627dcdaef8a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:31.615517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d1e1597-969f-415e-b07b-627dcdaef8a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:31.616234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d1e1597-969f-415e-b07b-627dcdaef8a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:31.616713 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d1e1597-969f-415e-b07b-627dcdaef8a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:31.617184 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d1e1597-969f-415e-b07b-627dcdaef8a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:31.641932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-6d1e1597-969f-415e-b07b-627dcdaef8a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lazy-loading 'flavor' on Instance uuid a7c2f3fa-9a41-4530-9434-3fb99e864182 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:54:31.715250 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6d1e1597-969f-415e-b07b-627dcdaef8a3 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182/action" status: 202 len: 0 microversion: 2.1 time: 0.119271 Aug 29 16:54:31.715941 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4259/8297] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:54:31 2022] POST /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:54:31.724964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-441f8b01-e04c-4f46-b366-3a7733baaf47 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:31.725706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-441f8b01-e04c-4f46-b366-3a7733baaf47 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:31.728298 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:31.729192 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:31.736158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-441f8b01-e04c-4f46-b366-3a7733baaf47 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:31.736654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-441f8b01-e04c-4f46-b366-3a7733baaf47 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:31.737104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-441f8b01-e04c-4f46-b366-3a7733baaf47 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:31.737838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-441f8b01-e04c-4f46-b366-3a7733baaf47 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:31.738308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-441f8b01-e04c-4f46-b366-3a7733baaf47 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:31.738847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-441f8b01-e04c-4f46-b366-3a7733baaf47 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:31.880357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-441f8b01-e04c-4f46-b366-3a7733baaf47 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:31.888804 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-441f8b01-e04c-4f46-b366-3a7733baaf47 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1688 microversion: 2.1 time: 0.168291 Aug 29 16:54:31.889422 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4039/8298] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:31 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:32.917442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-af9b3e1a-ebf8-4ad1-ac52-80c060da46f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:32.918158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-af9b3e1a-ebf8-4ad1-ac52-80c060da46f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:32.924932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af9b3e1a-ebf8-4ad1-ac52-80c060da46f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:32.925457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af9b3e1a-ebf8-4ad1-ac52-80c060da46f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:32.925912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af9b3e1a-ebf8-4ad1-ac52-80c060da46f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:32.926612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af9b3e1a-ebf8-4ad1-ac52-80c060da46f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:32.927082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af9b3e1a-ebf8-4ad1-ac52-80c060da46f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:32.927524 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-af9b3e1a-ebf8-4ad1-ac52-80c060da46f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:33.072186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-af9b3e1a-ebf8-4ad1-ac52-80c060da46f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:33.080812 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-af9b3e1a-ebf8-4ad1-ac52-80c060da46f6 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1688 microversion: 2.1 time: 0.172233 Aug 29 16:54:33.081458 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4260/8299] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:32 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:34.109724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ec084e65-4d23-4670-a039-05fd987bdd4e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:34.110323 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ec084e65-4d23-4670-a039-05fd987bdd4e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:34.117666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec084e65-4d23-4670-a039-05fd987bdd4e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:34.118167 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec084e65-4d23-4670-a039-05fd987bdd4e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:34.118609 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec084e65-4d23-4670-a039-05fd987bdd4e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:34.119320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec084e65-4d23-4670-a039-05fd987bdd4e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:34.119782 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec084e65-4d23-4670-a039-05fd987bdd4e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:34.120212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec084e65-4d23-4670-a039-05fd987bdd4e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:34.256234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ec084e65-4d23-4670-a039-05fd987bdd4e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:34.264394 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ec084e65-4d23-4670-a039-05fd987bdd4e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1671 microversion: 2.1 time: 0.158723 Aug 29 16:54:34.264970 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4040/8300] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:34 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:35.364491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cb1b4317-0144-4026-861a-7d0b52bce8fb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:35.367182 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cb1b4317-0144-4026-861a-7d0b52bce8fb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:35.375551 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb1b4317-0144-4026-861a-7d0b52bce8fb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:35.376062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb1b4317-0144-4026-861a-7d0b52bce8fb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:35.376521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb1b4317-0144-4026-861a-7d0b52bce8fb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:35.377279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb1b4317-0144-4026-861a-7d0b52bce8fb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:35.377792 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb1b4317-0144-4026-861a-7d0b52bce8fb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:35.378241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cb1b4317-0144-4026-861a-7d0b52bce8fb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:35.446131 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cb1b4317-0144-4026-861a-7d0b52bce8fb tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182/action" status: 200 len: 38221 microversion: 2.1 time: 0.086278 Aug 29 16:54:35.446787 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4261/8301] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:54:35 2022] POST /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182/action => generated 38221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:54:35.462444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d4e49a84-84fd-4d8c-9c6a-8e36ae6d5af0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:35.462995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d4e49a84-84fd-4d8c-9c6a-8e36ae6d5af0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:35.470694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4e49a84-84fd-4d8c-9c6a-8e36ae6d5af0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:35.471176 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4e49a84-84fd-4d8c-9c6a-8e36ae6d5af0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:35.471612 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4e49a84-84fd-4d8c-9c6a-8e36ae6d5af0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:35.472303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4e49a84-84fd-4d8c-9c6a-8e36ae6d5af0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:35.472752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4e49a84-84fd-4d8c-9c6a-8e36ae6d5af0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:35.473205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d4e49a84-84fd-4d8c-9c6a-8e36ae6d5af0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:35.547920 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d4e49a84-84fd-4d8c-9c6a-8e36ae6d5af0 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182/action" status: 202 len: 0 microversion: 2.1 time: 0.088923 Aug 29 16:54:35.548887 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4041/8302] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:54:35 2022] POST /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:54:35.558079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-0050780d-8d8b-4201-a17f-63eeedfe5840 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:35.558956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-0050780d-8d8b-4201-a17f-63eeedfe5840 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:35.566642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0050780d-8d8b-4201-a17f-63eeedfe5840 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:35.567186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0050780d-8d8b-4201-a17f-63eeedfe5840 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:35.567643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0050780d-8d8b-4201-a17f-63eeedfe5840 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:35.568338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0050780d-8d8b-4201-a17f-63eeedfe5840 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:35.568985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0050780d-8d8b-4201-a17f-63eeedfe5840 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:35.569458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-0050780d-8d8b-4201-a17f-63eeedfe5840 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:35.715939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-0050780d-8d8b-4201-a17f-63eeedfe5840 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:35.724404 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-0050780d-8d8b-4201-a17f-63eeedfe5840 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1677 microversion: 2.1 time: 0.170645 Aug 29 16:54:35.725165 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4262/8303] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:35 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:36.753700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-96389f8d-4c63-4486-b562-eb06e681906c tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:36.754658 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-96389f8d-4c63-4486-b562-eb06e681906c tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:36.764910 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96389f8d-4c63-4486-b562-eb06e681906c tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:36.765446 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96389f8d-4c63-4486-b562-eb06e681906c tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:36.765892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96389f8d-4c63-4486-b562-eb06e681906c tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:36.766593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96389f8d-4c63-4486-b562-eb06e681906c tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:36.767056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96389f8d-4c63-4486-b562-eb06e681906c tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:36.767485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-96389f8d-4c63-4486-b562-eb06e681906c tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:36.916752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-96389f8d-4c63-4486-b562-eb06e681906c tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:36.925132 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-96389f8d-4c63-4486-b562-eb06e681906c tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1677 microversion: 2.1 time: 0.180781 Aug 29 16:54:36.925730 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4042/8304] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:36 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:37.950776 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-99064a67-11e7-45b5-9f17-73601521aeac tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:37.951818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-99064a67-11e7-45b5-9f17-73601521aeac tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:37.959582 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99064a67-11e7-45b5-9f17-73601521aeac tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:37.960111 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99064a67-11e7-45b5-9f17-73601521aeac tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:37.960599 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99064a67-11e7-45b5-9f17-73601521aeac tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:37.961386 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99064a67-11e7-45b5-9f17-73601521aeac tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:37.961887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99064a67-11e7-45b5-9f17-73601521aeac tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:37.962357 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-99064a67-11e7-45b5-9f17-73601521aeac tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:38.111296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-99064a67-11e7-45b5-9f17-73601521aeac tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:38.119476 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-99064a67-11e7-45b5-9f17-73601521aeac tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1680 microversion: 2.1 time: 0.175302 Aug 29 16:54:38.120033 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4263/8305] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:37 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:38.221798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dd389bb9-2e3e-43aa-a970-29e7a37ef09f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:38.224172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dd389bb9-2e3e-43aa-a970-29e7a37ef09f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:38.231451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd389bb9-2e3e-43aa-a970-29e7a37ef09f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:38.231945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd389bb9-2e3e-43aa-a970-29e7a37ef09f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:38.232382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd389bb9-2e3e-43aa-a970-29e7a37ef09f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:38.233201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd389bb9-2e3e-43aa-a970-29e7a37ef09f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:38.233669 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd389bb9-2e3e-43aa-a970-29e7a37ef09f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:38.234099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd389bb9-2e3e-43aa-a970-29e7a37ef09f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:38.306387 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dd389bb9-2e3e-43aa-a970-29e7a37ef09f tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "POST /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182/action" status: 200 len: 38221 microversion: 2.1 time: 0.088616 Aug 29 16:54:38.307070 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4043/8306] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:54:38 2022] POST /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182/action => generated 38221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:54:39.375996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-972b3323-51cd-4564-a9c6-b3d794132037 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:39.376521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-972b3323-51cd-4564-a9c6-b3d794132037 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:39.381004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-e97caf8d-7754-44b1-85b2-0f24c42e81d2 req-878520b8-eab9-49d8-9dbd-d3a074779aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c2f3fa-9a41-4530-9434-3fb99e864182", "tag": "48ac0239-78f8-4330-b5dd-c1704b60c684"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:39.383809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-972b3323-51cd-4564-a9c6-b3d794132037 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:39.384330 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-972b3323-51cd-4564-a9c6-b3d794132037 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:39.384790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-972b3323-51cd-4564-a9c6-b3d794132037 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:39.385997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-972b3323-51cd-4564-a9c6-b3d794132037 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:39.386488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-972b3323-51cd-4564-a9c6-b3d794132037 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:39.386947 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-972b3323-51cd-4564-a9c6-b3d794132037 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:39.395318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e97caf8d-7754-44b1-85b2-0f24c42e81d2 req-878520b8-eab9-49d8-9dbd-d3a074779aca service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:39.396136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e97caf8d-7754-44b1-85b2-0f24c42e81d2 req-878520b8-eab9-49d8-9dbd-d3a074779aca service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:39.396838 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-e97caf8d-7754-44b1-85b2-0f24c42e81d2 req-878520b8-eab9-49d8-9dbd-d3a074779aca service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:39.408871 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-e97caf8d-7754-44b1-85b2-0f24c42e81d2 req-878520b8-eab9-49d8-9dbd-d3a074779aca service nova] Creating event network-changed:48ac0239-78f8-4330-b5dd-c1704b60c684 for instance a7c2f3fa-9a41-4530-9434-3fb99e864182 on n-h1-839401-11 Aug 29 16:54:39.414317 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-e97caf8d-7754-44b1-85b2-0f24c42e81d2 req-878520b8-eab9-49d8-9dbd-d3a074779aca service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039608 Aug 29 16:54:39.414932 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4044/8307] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:54:39.416434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-972b3323-51cd-4564-a9c6-b3d794132037 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:54:39.509727 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-972b3323-51cd-4564-a9c6-b3d794132037 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 204 len: 0 microversion: 2.1 time: 0.137623 Aug 29 16:54:39.514123 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4264/8308] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 16:54:39 2022] DELETE /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:54:39.521876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6006287c-12b5-4006-9eca-a1e86475b7a9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:39.522607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6006287c-12b5-4006-9eca-a1e86475b7a9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:39.533951 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6006287c-12b5-4006-9eca-a1e86475b7a9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:39.534451 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6006287c-12b5-4006-9eca-a1e86475b7a9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:39.535246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6006287c-12b5-4006-9eca-a1e86475b7a9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:39.535964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6006287c-12b5-4006-9eca-a1e86475b7a9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:39.536700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6006287c-12b5-4006-9eca-a1e86475b7a9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:39.537332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6006287c-12b5-4006-9eca-a1e86475b7a9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:39.704639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6006287c-12b5-4006-9eca-a1e86475b7a9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:39.712609 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6006287c-12b5-4006-9eca-a1e86475b7a9 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1686 microversion: 2.1 time: 0.196344 Aug 29 16:54:39.713202 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4045/8309] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:39 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1686 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:40.739393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fe4e6919-50d2-4844-8f25-5b78e96c1f59 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:40.740032 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fe4e6919-50d2-4844-8f25-5b78e96c1f59 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:40.750351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe4e6919-50d2-4844-8f25-5b78e96c1f59 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:40.750857 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe4e6919-50d2-4844-8f25-5b78e96c1f59 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:40.751319 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe4e6919-50d2-4844-8f25-5b78e96c1f59 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:40.752045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe4e6919-50d2-4844-8f25-5b78e96c1f59 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:40.752513 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe4e6919-50d2-4844-8f25-5b78e96c1f59 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:40.752959 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe4e6919-50d2-4844-8f25-5b78e96c1f59 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:40.982229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fe4e6919-50d2-4844-8f25-5b78e96c1f59 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:40.990907 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fe4e6919-50d2-4844-8f25-5b78e96c1f59 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1686 microversion: 2.1 time: 0.258509 Aug 29 16:54:40.991436 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4265/8310] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:40 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1686 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:41.893458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-69bd91e3-0932-46fb-9835-13a68aa6589d req-f270db6a-6aac-4121-80a5-3e5b75a5261b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c2f3fa-9a41-4530-9434-3fb99e864182", "name": "network-vif-deleted", "tag": "48ac0239-78f8-4330-b5dd-c1704b60c684"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:41.907819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-69bd91e3-0932-46fb-9835-13a68aa6589d req-f270db6a-6aac-4121-80a5-3e5b75a5261b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:41.908607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-69bd91e3-0932-46fb-9835-13a68aa6589d req-f270db6a-6aac-4121-80a5-3e5b75a5261b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:41.909276 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-69bd91e3-0932-46fb-9835-13a68aa6589d req-f270db6a-6aac-4121-80a5-3e5b75a5261b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:41.922305 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-69bd91e3-0932-46fb-9835-13a68aa6589d req-f270db6a-6aac-4121-80a5-3e5b75a5261b service nova] Creating event network-vif-deleted:48ac0239-78f8-4330-b5dd-c1704b60c684 for instance a7c2f3fa-9a41-4530-9434-3fb99e864182 on n-h1-839401-11 Aug 29 16:54:41.927219 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-69bd91e3-0932-46fb-9835-13a68aa6589d req-f270db6a-6aac-4121-80a5-3e5b75a5261b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037979 Aug 29 16:54:41.928224 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4046/8311] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:54:42.012301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-88764244-2d38-4e07-855a-5934c4145ef1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:42.012980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-88764244-2d38-4e07-855a-5934c4145ef1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:42.020202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88764244-2d38-4e07-855a-5934c4145ef1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:42.020701 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88764244-2d38-4e07-855a-5934c4145ef1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:42.021252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88764244-2d38-4e07-855a-5934c4145ef1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:42.021965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88764244-2d38-4e07-855a-5934c4145ef1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:42.022438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88764244-2d38-4e07-855a-5934c4145ef1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:42.022878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88764244-2d38-4e07-855a-5934c4145ef1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:42.054936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88764244-2d38-4e07-855a-5934c4145ef1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:42.055434 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88764244-2d38-4e07-855a-5934c4145ef1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:42.055886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-88764244-2d38-4e07-855a-5934c4145ef1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:42.056351 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-88764244-2d38-4e07-855a-5934c4145ef1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lazy-loading 'fault' on Instance uuid a7c2f3fa-9a41-4530-9434-3fb99e864182 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:54:42.099162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-88764244-2d38-4e07-855a-5934c4145ef1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9565af0dfd0482f887f0eea2f3a1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4a511b63e449ad84d6b8172efa8f26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:42.107706 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-88764244-2d38-4e07-855a-5934c4145ef1 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 200 len: 1356 microversion: 2.1 time: 0.099548 Aug 29 16:54:42.108294 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4266/8312] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:42 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:43.139933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-94a6e616-a4cb-432d-a023-d427c9c13d91 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:43.140690 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-94a6e616-a4cb-432d-a023-d427c9c13d91 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] [instance: a7c2f3fa-9a41-4530-9434-3fb99e864182] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:43.147705 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94a6e616-a4cb-432d-a023-d427c9c13d91 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:43.148193 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94a6e616-a4cb-432d-a023-d427c9c13d91 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:43.148639 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94a6e616-a4cb-432d-a023-d427c9c13d91 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:43.149375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94a6e616-a4cb-432d-a023-d427c9c13d91 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:43.149839 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94a6e616-a4cb-432d-a023-d427c9c13d91 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:43.150270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-94a6e616-a4cb-432d-a023-d427c9c13d91 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:43.164017 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-94a6e616-a4cb-432d-a023-d427c9c13d91 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] HTTP exception thrown: Instance a7c2f3fa-9a41-4530-9434-3fb99e864182 could not be found. Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-94a6e616-a4cb-432d-a023-d427c9c13d91 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Request method failure captured: Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 HTTP/1.1 Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDOxhtoEToS3nQ4x7iVmKQZTqOC8mawYKijdPvY6Bh_MTssjj9rVe4heRLLbq4FF58bMfx8T4Eb3qq5MMGmLVsYPUFPe-ZvbGjTL-Bxl7OoI6lDRIRmK3ropbwVWSh1BWN2psc293apISyO1eYL1oyiROFjCcWD6TQJA8ehzovaaRd9w Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: 3c4a511b63e449ad84d6b8172efa8f26 Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1448564924 Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3c4a511b63e449ad84d6b8172efa8f26", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3c4a511b63e449ad84d6b8172efa8f26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3c4a511b63e449ad84d6b8172efa8f26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3c4a511b63e449ad84d6b8172efa8f26"}]}] Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1448564924 Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: 3c4a511b63e449ad84d6b8172efa8f26 Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1448564924 Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestNetworkAdvancedServerOps-1448564924-project Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: c9565af0dfd0482f887f0eea2f3a1f4e Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1448564924-project Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance a7c2f3fa-9a41-4530-9434-3fb99e864182 could not be found. Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': 'a7c2f3fa-9a41-4530-9434-3fb99e864182'} Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c2f3fa-9a41-4530-9434-3fb99e864182 could not be found. Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c2f3fa-9a41-4530-9434-3fb99e864182 could not be found. Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:54:43.165696 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:54:43.171005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:54:43.171005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:54:43.171005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:54:43.171005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:54:43.171005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:54:43.171005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:54:43.171005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c2f3fa-9a41-4530-9434-3fb99e864182 could not be found. Aug 29 16:54:43.171005 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 16:54:43.171005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-94a6e616-a4cb-432d-a023-d427c9c13d91 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Returning 404 to user: Instance a7c2f3fa-9a41-4530-9434-3fb99e864182 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:54:43.171005 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-94a6e616-a4cb-432d-a023-d427c9c13d91 tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182" status: 404 len: 111 microversion: 2.1 time: 0.039258 Aug 29 16:54:43.171005 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4047/8313] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:43 2022] GET /compute/v2.1/servers/a7c2f3fa-9a41-4530-9434-3fb99e864182 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:54:46.512009 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c6c68f39-18d8-46e2-8ed0-6bdac697119e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] Calling method '.version_select at 0x7fc42a8dcca0>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:46.545569 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c6c68f39-18d8-46e2-8ed0-6bdac697119e tempest-TestNetworkAdvancedServerOps-1448564924 tempest-TestNetworkAdvancedServerOps-1448564924-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1131259456" status: 202 len: 0 microversion: 2.1 time: 0.037616 Aug 29 16:54:46.546205 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4267/8314] 10.222.0.62 () {58 vars in 1284 bytes} [Mon Aug 29 16:54:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1131259456 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:54:58.115484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=18 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:58.118740 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:58.338201 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-087f68f1-c15f-4d15-8f7a-a2c442fec706 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Action: 'create', calling method: .version_select at 0x7fc433a20e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-157925662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjCVDg2UBBdWTxxeE5Yg5XxRJB54H+v5WN1TRwYoyT3p9Y++e6x6nRl8DwTGMRnmAzREs1GnObQ355KxQe1gI9K2yVlSgEx0ifVs9oB2qkt7q5PXg2eO9RTesVTPYNReg=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:58.354773 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-087f68f1-c15f-4d15-8f7a-a2c442fec706 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Getting quotas for project df90138d350e4bc796a0d152a4af2dfc. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:54:58.364418 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-087f68f1-c15f-4d15-8f7a-a2c442fec706 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Getting quotas for user 6fdb91fd783e4589bd5ca7fe07ea0e91 and project df90138d350e4bc796a0d152a4af2dfc. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:54:58.402985 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-087f68f1-c15f-4d15-8f7a-a2c442fec706 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.293361 Aug 29 16:54:58.403683 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4048/8315] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 16:54:58 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:54:59.437873 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:54:59.438424 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:54:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.62) !!! Aug 29 16:54:59.439192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:59.440067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:59.449822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-386438949", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-157925662", "security_groups": [{"name": "tempest-secgroup-smoke-197036845"}], "networks": [{"uuid": "da599d20-c1af-4ea3-bf91-fb38cf525619"}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:59.562059 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] validate_networks() for [('da599d20-c1af-4ea3-bf91-fb38cf525619', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:55:00.065958 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:55:00.066517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:55:00.067114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:55:00.067665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:55:00.068104 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:55:00.077571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:00.078082 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:00.078570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:00.079325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:00.079801 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:00.080246 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:00.098806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Getting quotas for project df90138d350e4bc796a0d152a4af2dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:55:00.104514 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Getting quotas for user 6fdb91fd783e4589bd5ca7fe07ea0e91 and project df90138d350e4bc796a0d152a4af2dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:55:00.118138 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:55:00.120543 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:55:00.170226 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a1d5dbb6-a229-4418-b7d5-5a3d52b424eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.734956 Aug 29 16:55:00.171121 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4268/8316] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 16:54:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:55:00.182957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f2ca161b-02f9-4929-9251-b35bf0c8fa73 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:00.183581 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f2ca161b-02f9-4929-9251-b35bf0c8fa73 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:00.320944 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f2ca161b-02f9-4929-9251-b35bf0c8fa73 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:00.328511 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f2ca161b-02f9-4929-9251-b35bf0c8fa73 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1245 microversion: 2.1 time: 0.150459 Aug 29 16:55:00.329472 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4049/8317] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:00 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1245 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:01.350966 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ebe95455-c6c3-461c-9125-d06cf494c2e3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:01.351782 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ebe95455-c6c3-461c-9125-d06cf494c2e3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:01.431534 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ebe95455-c6c3-461c-9125-d06cf494c2e3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:01.440463 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ebe95455-c6c3-461c-9125-d06cf494c2e3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1245 microversion: 2.1 time: 0.094307 Aug 29 16:55:01.441134 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4269/8318] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:01 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:02.462393 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6e7d3650-40ce-49ad-8e0a-67f5825e8895 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:02.463697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6e7d3650-40ce-49ad-8e0a-67f5825e8895 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:02.528239 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6e7d3650-40ce-49ad-8e0a-67f5825e8895 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:02.543150 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6e7d3650-40ce-49ad-8e0a-67f5825e8895 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1245 microversion: 2.1 time: 0.080590 Aug 29 16:55:02.544174 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4050/8319] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:02 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:03.564631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9c352876-aadb-4bbc-9a00-d744bc6bb649 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:03.565502 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9c352876-aadb-4bbc-9a00-d744bc6bb649 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:03.572802 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c352876-aadb-4bbc-9a00-d744bc6bb649 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:03.573347 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c352876-aadb-4bbc-9a00-d744bc6bb649 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:03.573812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c352876-aadb-4bbc-9a00-d744bc6bb649 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:03.574568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c352876-aadb-4bbc-9a00-d744bc6bb649 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:03.575050 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c352876-aadb-4bbc-9a00-d744bc6bb649 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:03.575522 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9c352876-aadb-4bbc-9a00-d744bc6bb649 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:03.642081 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9c352876-aadb-4bbc-9a00-d744bc6bb649 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:03.650791 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9c352876-aadb-4bbc-9a00-d744bc6bb649 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1249 microversion: 2.1 time: 0.090496 Aug 29 16:55:03.651385 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4270/8320] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:03 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:04.671736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-97cbe5e5-1f7e-45b0-a3fc-96553e7d37f5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:04.672344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-97cbe5e5-1f7e-45b0-a3fc-96553e7d37f5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:04.680093 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97cbe5e5-1f7e-45b0-a3fc-96553e7d37f5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:04.680593 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97cbe5e5-1f7e-45b0-a3fc-96553e7d37f5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:04.681016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97cbe5e5-1f7e-45b0-a3fc-96553e7d37f5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:04.681849 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97cbe5e5-1f7e-45b0-a3fc-96553e7d37f5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:04.682306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97cbe5e5-1f7e-45b0-a3fc-96553e7d37f5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:04.682724 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-97cbe5e5-1f7e-45b0-a3fc-96553e7d37f5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:04.751643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-97cbe5e5-1f7e-45b0-a3fc-96553e7d37f5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:04.760001 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-97cbe5e5-1f7e-45b0-a3fc-96553e7d37f5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1303 microversion: 2.1 time: 0.092266 Aug 29 16:55:04.760608 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4051/8321] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:04 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:05.781619 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dfcc132d-3ae9-43d9-9dca-8ba1b158f6c7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:05.782372 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dfcc132d-3ae9-43d9-9dca-8ba1b158f6c7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:05.789785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfcc132d-3ae9-43d9-9dca-8ba1b158f6c7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:05.790376 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfcc132d-3ae9-43d9-9dca-8ba1b158f6c7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:05.790962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfcc132d-3ae9-43d9-9dca-8ba1b158f6c7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:05.791661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfcc132d-3ae9-43d9-9dca-8ba1b158f6c7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:05.792162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfcc132d-3ae9-43d9-9dca-8ba1b158f6c7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:05.792798 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dfcc132d-3ae9-43d9-9dca-8ba1b158f6c7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:05.990230 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-a96b0b1a-6d88-493e-8bda-6298ed9d7d74 req-adaecc16-1eca-4694-a2e2-345bc9a8d9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b76c0cf-b737-4fa9-9ffa-4029998f26f9", "tag": "969394cd-2669-452b-be36-7349619696ec"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:55:06.001591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a96b0b1a-6d88-493e-8bda-6298ed9d7d74 req-adaecc16-1eca-4694-a2e2-345bc9a8d9e0 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:06.002382 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a96b0b1a-6d88-493e-8bda-6298ed9d7d74 req-adaecc16-1eca-4694-a2e2-345bc9a8d9e0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:06.002816 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a96b0b1a-6d88-493e-8bda-6298ed9d7d74 req-adaecc16-1eca-4694-a2e2-345bc9a8d9e0 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:06.009533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dfcc132d-3ae9-43d9-9dca-8ba1b158f6c7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:06.014946 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-a96b0b1a-6d88-493e-8bda-6298ed9d7d74 req-adaecc16-1eca-4694-a2e2-345bc9a8d9e0 service nova] Creating event network-changed:969394cd-2669-452b-be36-7349619696ec for instance 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 on n-h2-839401-11 Aug 29 16:55:06.019064 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dfcc132d-3ae9-43d9-9dca-8ba1b158f6c7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1370 microversion: 2.1 time: 0.241475 Aug 29 16:55:06.020139 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4271/8322] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:05 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:06.020370 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-a96b0b1a-6d88-493e-8bda-6298ed9d7d74 req-adaecc16-1eca-4694-a2e2-345bc9a8d9e0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033889 Aug 29 16:55:06.021230 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4052/8323] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:55:07.043920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f08f53c1-917d-41b2-b58a-5d94e4b112bd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:07.044951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f08f53c1-917d-41b2-b58a-5d94e4b112bd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:07.054207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f08f53c1-917d-41b2-b58a-5d94e4b112bd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:07.054715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f08f53c1-917d-41b2-b58a-5d94e4b112bd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:07.055169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f08f53c1-917d-41b2-b58a-5d94e4b112bd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:07.055889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f08f53c1-917d-41b2-b58a-5d94e4b112bd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:07.056370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f08f53c1-917d-41b2-b58a-5d94e4b112bd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:07.056815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f08f53c1-917d-41b2-b58a-5d94e4b112bd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:07.209288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f08f53c1-917d-41b2-b58a-5d94e4b112bd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:07.217345 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f08f53c1-917d-41b2-b58a-5d94e4b112bd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1370 microversion: 2.1 time: 0.180182 Aug 29 16:55:07.217933 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4272/8324] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:07 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:08.242318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-259da0a7-5e70-4460-a3f7-9e4ab4f26ee5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:08.243178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-259da0a7-5e70-4460-a3f7-9e4ab4f26ee5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:08.251371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-259da0a7-5e70-4460-a3f7-9e4ab4f26ee5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:08.251970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-259da0a7-5e70-4460-a3f7-9e4ab4f26ee5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:08.252518 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-259da0a7-5e70-4460-a3f7-9e4ab4f26ee5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:08.253478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-259da0a7-5e70-4460-a3f7-9e4ab4f26ee5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:08.253933 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-259da0a7-5e70-4460-a3f7-9e4ab4f26ee5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:08.254358 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-259da0a7-5e70-4460-a3f7-9e4ab4f26ee5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:08.398237 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-259da0a7-5e70-4460-a3f7-9e4ab4f26ee5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:08.410360 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-259da0a7-5e70-4460-a3f7-9e4ab4f26ee5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1370 microversion: 2.1 time: 0.174811 Aug 29 16:55:08.410951 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4053/8325] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:08 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:09.430617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-81e31e6a-e8f2-4329-a1a0-362deae93ae2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:09.431249 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-81e31e6a-e8f2-4329-a1a0-362deae93ae2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:09.439146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81e31e6a-e8f2-4329-a1a0-362deae93ae2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:09.439649 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81e31e6a-e8f2-4329-a1a0-362deae93ae2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:09.440149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81e31e6a-e8f2-4329-a1a0-362deae93ae2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:09.440820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81e31e6a-e8f2-4329-a1a0-362deae93ae2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:09.441335 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81e31e6a-e8f2-4329-a1a0-362deae93ae2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:09.441788 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-81e31e6a-e8f2-4329-a1a0-362deae93ae2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:09.584657 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-81e31e6a-e8f2-4329-a1a0-362deae93ae2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:09.593236 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-81e31e6a-e8f2-4329-a1a0-362deae93ae2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1370 microversion: 2.1 time: 0.166612 Aug 29 16:55:09.593822 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4273/8326] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:09 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:10.614963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e63affc6-cee8-4659-8869-63667375e7ac tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:10.615618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e63affc6-cee8-4659-8869-63667375e7ac tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:10.622495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e63affc6-cee8-4659-8869-63667375e7ac tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:10.622982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e63affc6-cee8-4659-8869-63667375e7ac tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:10.623424 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e63affc6-cee8-4659-8869-63667375e7ac tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:10.624131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e63affc6-cee8-4659-8869-63667375e7ac tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:10.624718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e63affc6-cee8-4659-8869-63667375e7ac tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:10.625172 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e63affc6-cee8-4659-8869-63667375e7ac tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:11.124751 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e63affc6-cee8-4659-8869-63667375e7ac tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:11.137880 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e63affc6-cee8-4659-8869-63667375e7ac tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1370 microversion: 2.1 time: 0.527033 Aug 29 16:55:11.138593 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4054/8327] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:10 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1370 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:11.936704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:55:11.940048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=8 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:55:11.994839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-999e6ec2-55c2-4da1-9d62-bc21a6fbd8f8 req-4b71177d-c4da-4f29-8166-03e143a321d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b76c0cf-b737-4fa9-9ffa-4029998f26f9", "name": "network-vif-plugged", "status": "completed", "tag": "969394cd-2669-452b-be36-7349619696ec"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:55:12.004451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-999e6ec2-55c2-4da1-9d62-bc21a6fbd8f8 req-4b71177d-c4da-4f29-8166-03e143a321d3 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:12.004944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-999e6ec2-55c2-4da1-9d62-bc21a6fbd8f8 req-4b71177d-c4da-4f29-8166-03e143a321d3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:12.005428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-999e6ec2-55c2-4da1-9d62-bc21a6fbd8f8 req-4b71177d-c4da-4f29-8166-03e143a321d3 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:12.016327 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-999e6ec2-55c2-4da1-9d62-bc21a6fbd8f8 req-4b71177d-c4da-4f29-8166-03e143a321d3 service nova] Creating event network-vif-plugged:969394cd-2669-452b-be36-7349619696ec for instance 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 on n-h2-839401-11 Aug 29 16:55:12.021396 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-999e6ec2-55c2-4da1-9d62-bc21a6fbd8f8 req-4b71177d-c4da-4f29-8166-03e143a321d3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099861 Aug 29 16:55:12.021996 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4274/8328] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:55:12.159344 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-cffe6c46-eb65-4d94-9fba-e68b6542862c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:12.159746 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-cffe6c46-eb65-4d94-9fba-e68b6542862c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:12.167236 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffe6c46-eb65-4d94-9fba-e68b6542862c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:12.167735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffe6c46-eb65-4d94-9fba-e68b6542862c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:12.168178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffe6c46-eb65-4d94-9fba-e68b6542862c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:12.168888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffe6c46-eb65-4d94-9fba-e68b6542862c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:12.169516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffe6c46-eb65-4d94-9fba-e68b6542862c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:12.169949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-cffe6c46-eb65-4d94-9fba-e68b6542862c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:12.319300 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-cffe6c46-eb65-4d94-9fba-e68b6542862c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:12.331810 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-cffe6c46-eb65-4d94-9fba-e68b6542862c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1370 microversion: 2.1 time: 0.176847 Aug 29 16:55:12.332621 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4055/8329] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:12 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:13.359070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-bf10163a-0b3d-47e4-a439-4b9868dcc8de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:13.359825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-bf10163a-0b3d-47e4-a439-4b9868dcc8de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:13.369458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf10163a-0b3d-47e4-a439-4b9868dcc8de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:13.370114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf10163a-0b3d-47e4-a439-4b9868dcc8de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:13.370738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf10163a-0b3d-47e4-a439-4b9868dcc8de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:13.371805 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf10163a-0b3d-47e4-a439-4b9868dcc8de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:13.372451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf10163a-0b3d-47e4-a439-4b9868dcc8de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:13.372943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-bf10163a-0b3d-47e4-a439-4b9868dcc8de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:13.526227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-bf10163a-0b3d-47e4-a439-4b9868dcc8de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:13.534363 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-bf10163a-0b3d-47e4-a439-4b9868dcc8de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1370 microversion: 2.1 time: 0.183490 Aug 29 16:55:13.535324 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4275/8330] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:13 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:14.555627 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fdb4055d-dc26-45d3-b951-0db2f39a08db tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:14.556293 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fdb4055d-dc26-45d3-b951-0db2f39a08db tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:14.558259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=8 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:55:14.564954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fdb4055d-dc26-45d3-b951-0db2f39a08db tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:14.565444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fdb4055d-dc26-45d3-b951-0db2f39a08db tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:14.565881 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fdb4055d-dc26-45d3-b951-0db2f39a08db tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:14.566571 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fdb4055d-dc26-45d3-b951-0db2f39a08db tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:14.567024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fdb4055d-dc26-45d3-b951-0db2f39a08db tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:14.567448 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fdb4055d-dc26-45d3-b951-0db2f39a08db tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:14.708373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fdb4055d-dc26-45d3-b951-0db2f39a08db tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:14.716300 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fdb4055d-dc26-45d3-b951-0db2f39a08db tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1552 microversion: 2.1 time: 0.164917 Aug 29 16:55:14.716884 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4056/8331] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:14 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:14.736436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fe43e00d-8c11-4584-8b2b-bf48626c007a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:14.737070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fe43e00d-8c11-4584-8b2b-bf48626c007a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:14.745237 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe43e00d-8c11-4584-8b2b-bf48626c007a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:14.745740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe43e00d-8c11-4584-8b2b-bf48626c007a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:14.746197 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe43e00d-8c11-4584-8b2b-bf48626c007a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:14.746916 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe43e00d-8c11-4584-8b2b-bf48626c007a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:14.747390 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe43e00d-8c11-4584-8b2b-bf48626c007a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:14.747833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe43e00d-8c11-4584-8b2b-bf48626c007a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:14.893541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fe43e00d-8c11-4584-8b2b-bf48626c007a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:14.902339 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fe43e00d-8c11-4584-8b2b-bf48626c007a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1552 microversion: 2.1 time: 0.169825 Aug 29 16:55:14.902920 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4276/8332] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:14 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:16.906190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-a8eab45b-a99b-4bcb-9fcd-a6b85b09f837 req-6df31f84-9e3b-476b-a9dd-e1b953944c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b76c0cf-b737-4fa9-9ffa-4029998f26f9", "tag": "969394cd-2669-452b-be36-7349619696ec"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:55:16.916823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a8eab45b-a99b-4bcb-9fcd-a6b85b09f837 req-6df31f84-9e3b-476b-a9dd-e1b953944c9e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:16.917435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a8eab45b-a99b-4bcb-9fcd-a6b85b09f837 req-6df31f84-9e3b-476b-a9dd-e1b953944c9e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:16.917942 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a8eab45b-a99b-4bcb-9fcd-a6b85b09f837 req-6df31f84-9e3b-476b-a9dd-e1b953944c9e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:16.930029 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-a8eab45b-a99b-4bcb-9fcd-a6b85b09f837 req-6df31f84-9e3b-476b-a9dd-e1b953944c9e service nova] Creating event network-changed:969394cd-2669-452b-be36-7349619696ec for instance 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 on n-h2-839401-11 Aug 29 16:55:16.935313 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-a8eab45b-a99b-4bcb-9fcd-a6b85b09f837 req-6df31f84-9e3b-476b-a9dd-e1b953944c9e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033014 Aug 29 16:55:16.936499 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4057/8333] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:57:53.313355 n-d-839401-11 devstack@n-api.service[122360]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edb16f3c-d8bd-4396-8d00-d7897b8393bf] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:57:53.314871 n-d-839401-11 devstack@n-api.service[122360]: ERROR oslo.messaging._drivers.impl_rabbit [-] [603d2cc2-3ad6-4419-8622-2fba015025b5] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:57:53.316215 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:57:53.318445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=40 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:57:53.320854 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 16:57:53.321164 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:57:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9/action (ip 10.222.0.62) !!! Aug 29 16:57:53.324081 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:57:53.324360 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 16:57:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9/action (ip 10.222.0.62) !!! Aug 29 16:57:53.332449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-18cf5c10-8792-4ffa-a4d2-0a52a78de733 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:57:53.332984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-18cf5c10-8792-4ffa-a4d2-0a52a78de733 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:53.344166 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18cf5c10-8792-4ffa-a4d2-0a52a78de733 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:53.344659 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18cf5c10-8792-4ffa-a4d2-0a52a78de733 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:53.345106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18cf5c10-8792-4ffa-a4d2-0a52a78de733 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:53.345839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18cf5c10-8792-4ffa-a4d2-0a52a78de733 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:53.346305 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18cf5c10-8792-4ffa-a4d2-0a52a78de733 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:53.346738 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-18cf5c10-8792-4ffa-a4d2-0a52a78de733 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:53.370965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-18cf5c10-8792-4ffa-a4d2-0a52a78de733 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lazy-loading 'flavor' on Instance uuid 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:57:53.606868 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-18cf5c10-8792-4ffa-a4d2-0a52a78de733 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "POST /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9/action" status: 202 len: 0 microversion: 2.1 time: 0.296478 Aug 29 16:57:53.607487 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4277/8334] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:57:53 2022] POST /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:57:53.615581 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [-] [564df600-0953-4421-a68a-24b5a0a40919] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:57:53.616496 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eda7f439-560f-4fda-a0c4-47b93d5f6cfd] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:57:53.617253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:57:53.618526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=34 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:57:53.620026 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 16:57:53.620166 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 16:57:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 (ip 10.222.0.62) !!! Aug 29 16:57:53.621326 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:57:53.621447 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 16:57:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 (ip 10.222.0.62) !!! Aug 29 16:57:53.627743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eb511f54-a05f-43b4-be61-429889e02598 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:53.628488 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eb511f54-a05f-43b4-be61-429889e02598 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:53.640939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb511f54-a05f-43b4-be61-429889e02598 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:53.641611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb511f54-a05f-43b4-be61-429889e02598 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:53.642445 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb511f54-a05f-43b4-be61-429889e02598 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:53.643170 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb511f54-a05f-43b4-be61-429889e02598 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:53.643632 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb511f54-a05f-43b4-be61-429889e02598 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:53.644063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eb511f54-a05f-43b4-be61-429889e02598 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:53.793150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eb511f54-a05f-43b4-be61-429889e02598 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:53.805889 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eb511f54-a05f-43b4-be61-429889e02598 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1677 microversion: 2.1 time: 0.191864 Aug 29 16:57:53.806756 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4058/8335] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:53 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:54.837191 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ec87a9c9-b646-40c3-bd0a-4623da77bcdb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:54.838046 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ec87a9c9-b646-40c3-bd0a-4623da77bcdb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:54.858451 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] [edb16f3c-d8bd-4396-8d00-d7897b8393bf] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 43292. Aug 29 16:57:54.859616 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] [603d2cc2-3ad6-4419-8622-2fba015025b5] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 43294. Aug 29 16:57:54.862223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec87a9c9-b646-40c3-bd0a-4623da77bcdb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:54.862731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec87a9c9-b646-40c3-bd0a-4623da77bcdb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:54.863193 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec87a9c9-b646-40c3-bd0a-4623da77bcdb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:54.863919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec87a9c9-b646-40c3-bd0a-4623da77bcdb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:54.864394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec87a9c9-b646-40c3-bd0a-4623da77bcdb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:54.864822 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ec87a9c9-b646-40c3-bd0a-4623da77bcdb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:55.009850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ec87a9c9-b646-40c3-bd0a-4623da77bcdb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:55.018452 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ec87a9c9-b646-40c3-bd0a-4623da77bcdb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1677 microversion: 2.1 time: 0.188936 Aug 29 16:57:55.018995 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4278/8336] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:54 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:56.044434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-54213120-eee1-42ad-a06c-f9361570f6a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:56.045511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-54213120-eee1-42ad-a06c-f9361570f6a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:56.059282 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54213120-eee1-42ad-a06c-f9361570f6a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:56.060464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54213120-eee1-42ad-a06c-f9361570f6a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:56.061233 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54213120-eee1-42ad-a06c-f9361570f6a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:56.062370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54213120-eee1-42ad-a06c-f9361570f6a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:56.063309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54213120-eee1-42ad-a06c-f9361570f6a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:56.064025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-54213120-eee1-42ad-a06c-f9361570f6a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:56.071679 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] [564df600-0953-4421-a68a-24b5a0a40919] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 43298. Aug 29 16:57:56.083183 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] [eda7f439-560f-4fda-a0c4-47b93d5f6cfd] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 43300. Aug 29 16:57:56.214774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-54213120-eee1-42ad-a06c-f9361570f6a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:56.222940 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-54213120-eee1-42ad-a06c-f9361570f6a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1677 microversion: 2.1 time: 0.185258 Aug 29 16:57:56.223543 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4059/8337] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:56 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:57.248563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b2bf9c2d-8553-417e-8c1d-db620a6e9d27 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:57.249532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b2bf9c2d-8553-417e-8c1d-db620a6e9d27 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:57.261570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2bf9c2d-8553-417e-8c1d-db620a6e9d27 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:57.262399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2bf9c2d-8553-417e-8c1d-db620a6e9d27 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:57.263153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2bf9c2d-8553-417e-8c1d-db620a6e9d27 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:57.264329 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2bf9c2d-8553-417e-8c1d-db620a6e9d27 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:57.265165 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2bf9c2d-8553-417e-8c1d-db620a6e9d27 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:57.265887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b2bf9c2d-8553-417e-8c1d-db620a6e9d27 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:57.417107 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b2bf9c2d-8553-417e-8c1d-db620a6e9d27 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:57.425476 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b2bf9c2d-8553-417e-8c1d-db620a6e9d27 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1677 microversion: 2.1 time: 0.183908 Aug 29 16:57:57.426067 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4279/8338] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:57 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:58.451471 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7aa5a5de-837f-4afb-8edb-efbb168e6f4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:58.452599 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7aa5a5de-837f-4afb-8edb-efbb168e6f4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:58.464254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7aa5a5de-837f-4afb-8edb-efbb168e6f4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:58.465065 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7aa5a5de-837f-4afb-8edb-efbb168e6f4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:58.465846 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7aa5a5de-837f-4afb-8edb-efbb168e6f4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:58.467001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7aa5a5de-837f-4afb-8edb-efbb168e6f4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:58.467765 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7aa5a5de-837f-4afb-8edb-efbb168e6f4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:58.468476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7aa5a5de-837f-4afb-8edb-efbb168e6f4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:58.617928 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7aa5a5de-837f-4afb-8edb-efbb168e6f4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:58.626016 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7aa5a5de-837f-4afb-8edb-efbb168e6f4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1677 microversion: 2.1 time: 0.181271 Aug 29 16:57:58.626647 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4060/8339] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:58 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:59.657961 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-deea9acd-929b-4430-8746-2d9add31ec57 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:59.658683 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-deea9acd-929b-4430-8746-2d9add31ec57 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:59.666772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-deea9acd-929b-4430-8746-2d9add31ec57 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:59.667520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-deea9acd-929b-4430-8746-2d9add31ec57 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:59.668325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-deea9acd-929b-4430-8746-2d9add31ec57 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:59.669374 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-deea9acd-929b-4430-8746-2d9add31ec57 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:59.670242 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-deea9acd-929b-4430-8746-2d9add31ec57 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:59.670995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-deea9acd-929b-4430-8746-2d9add31ec57 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:59.818655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-deea9acd-929b-4430-8746-2d9add31ec57 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:59.830078 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-deea9acd-929b-4430-8746-2d9add31ec57 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1677 microversion: 2.1 time: 0.178225 Aug 29 16:57:59.831194 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4280/8340] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:59 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:00.860242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-715ac6d6-b91b-432a-b771-399375f13561 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:00.860845 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-715ac6d6-b91b-432a-b771-399375f13561 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:00.868267 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-715ac6d6-b91b-432a-b771-399375f13561 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:00.869662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-715ac6d6-b91b-432a-b771-399375f13561 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:00.869662 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-715ac6d6-b91b-432a-b771-399375f13561 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:00.869970 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-715ac6d6-b91b-432a-b771-399375f13561 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:00.870457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-715ac6d6-b91b-432a-b771-399375f13561 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:00.871321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-715ac6d6-b91b-432a-b771-399375f13561 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:01.020734 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-715ac6d6-b91b-432a-b771-399375f13561 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:01.028746 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-715ac6d6-b91b-432a-b771-399375f13561 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1677 microversion: 2.1 time: 0.173736 Aug 29 16:58:01.029388 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4061/8341] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:00 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:02.049811 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a1bfc4a0-da7d-4948-b39d-ba84832d1366 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:02.050726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a1bfc4a0-da7d-4948-b39d-ba84832d1366 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:02.057897 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1bfc4a0-da7d-4948-b39d-ba84832d1366 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:02.058412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1bfc4a0-da7d-4948-b39d-ba84832d1366 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:02.058868 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1bfc4a0-da7d-4948-b39d-ba84832d1366 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:02.059923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1bfc4a0-da7d-4948-b39d-ba84832d1366 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:02.060399 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1bfc4a0-da7d-4948-b39d-ba84832d1366 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:02.060844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1bfc4a0-da7d-4948-b39d-ba84832d1366 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:02.224238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a1bfc4a0-da7d-4948-b39d-ba84832d1366 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:02.234406 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a1bfc4a0-da7d-4948-b39d-ba84832d1366 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1677 microversion: 2.1 time: 0.188488 Aug 29 16:58:02.235148 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4281/8342] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:02 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:03.265915 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d0a88b56-3490-4f24-b80a-3d59ff852d42 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:03.266791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d0a88b56-3490-4f24-b80a-3d59ff852d42 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:03.274851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0a88b56-3490-4f24-b80a-3d59ff852d42 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:03.275363 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0a88b56-3490-4f24-b80a-3d59ff852d42 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:03.275800 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0a88b56-3490-4f24-b80a-3d59ff852d42 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:03.276507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0a88b56-3490-4f24-b80a-3d59ff852d42 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:03.276969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0a88b56-3490-4f24-b80a-3d59ff852d42 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:03.277435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d0a88b56-3490-4f24-b80a-3d59ff852d42 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:03.424912 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d0a88b56-3490-4f24-b80a-3d59ff852d42 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:03.436115 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d0a88b56-3490-4f24-b80a-3d59ff852d42 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1677 microversion: 2.1 time: 0.176839 Aug 29 16:58:03.437077 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4062/8343] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:03 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:04.461632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aa559c1a-dadf-4948-83cd-1c8c950b34fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:04.462617 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aa559c1a-dadf-4948-83cd-1c8c950b34fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:04.473547 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa559c1a-dadf-4948-83cd-1c8c950b34fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:04.474061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa559c1a-dadf-4948-83cd-1c8c950b34fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:04.474520 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa559c1a-dadf-4948-83cd-1c8c950b34fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:04.475241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa559c1a-dadf-4948-83cd-1c8c950b34fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:04.475748 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa559c1a-dadf-4948-83cd-1c8c950b34fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:04.476192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa559c1a-dadf-4948-83cd-1c8c950b34fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:04.616709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aa559c1a-dadf-4948-83cd-1c8c950b34fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:04.628986 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aa559c1a-dadf-4948-83cd-1c8c950b34fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1677 microversion: 2.1 time: 0.173762 Aug 29 16:58:04.629891 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4282/8344] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:04 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:05.659453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4116fcd7-c25e-4575-a007-5050756eaf46 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:05.660070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4116fcd7-c25e-4575-a007-5050756eaf46 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:05.667638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4116fcd7-c25e-4575-a007-5050756eaf46 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:05.668135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4116fcd7-c25e-4575-a007-5050756eaf46 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:05.668582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4116fcd7-c25e-4575-a007-5050756eaf46 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:05.669356 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4116fcd7-c25e-4575-a007-5050756eaf46 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:05.669795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4116fcd7-c25e-4575-a007-5050756eaf46 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:05.670262 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4116fcd7-c25e-4575-a007-5050756eaf46 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:05.803459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4116fcd7-c25e-4575-a007-5050756eaf46 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:05.812354 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4116fcd7-c25e-4575-a007-5050756eaf46 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1698 microversion: 2.1 time: 0.159356 Aug 29 16:58:05.812911 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4063/8345] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:05 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:06.834690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-09f14be5-57d7-47c7-8cb6-fd544a41acae tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:06.835417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-09f14be5-57d7-47c7-8cb6-fd544a41acae tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:06.843418 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09f14be5-57d7-47c7-8cb6-fd544a41acae tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:06.843915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09f14be5-57d7-47c7-8cb6-fd544a41acae tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:06.844479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09f14be5-57d7-47c7-8cb6-fd544a41acae tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:06.845360 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09f14be5-57d7-47c7-8cb6-fd544a41acae tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:06.845886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09f14be5-57d7-47c7-8cb6-fd544a41acae tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:06.846346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-09f14be5-57d7-47c7-8cb6-fd544a41acae tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:07.005030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-09f14be5-57d7-47c7-8cb6-fd544a41acae tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:07.013341 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-09f14be5-57d7-47c7-8cb6-fd544a41acae tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1698 microversion: 2.1 time: 0.182831 Aug 29 16:58:07.014572 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4283/8346] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:06 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1698 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:08.035311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3a62381b-e93a-4dde-b77f-c1c4d7dd7d6f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:08.035950 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3a62381b-e93a-4dde-b77f-c1c4d7dd7d6f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:08.043397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a62381b-e93a-4dde-b77f-c1c4d7dd7d6f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:08.043892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a62381b-e93a-4dde-b77f-c1c4d7dd7d6f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:08.044333 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a62381b-e93a-4dde-b77f-c1c4d7dd7d6f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:08.045042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a62381b-e93a-4dde-b77f-c1c4d7dd7d6f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:08.045542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a62381b-e93a-4dde-b77f-c1c4d7dd7d6f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:08.045978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3a62381b-e93a-4dde-b77f-c1c4d7dd7d6f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:08.191508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3a62381b-e93a-4dde-b77f-c1c4d7dd7d6f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:08.200883 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3a62381b-e93a-4dde-b77f-c1c4d7dd7d6f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1698 microversion: 2.1 time: 0.169791 Aug 29 16:58:08.201515 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4064/8347] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:08 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1698 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:08.713785 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-87a5a4a6-b3ef-42d8-a905-c9a17d9c5150 req-d5d1a43f-ef5a-4db5-b2c3-e833b91f4a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b76c0cf-b737-4fa9-9ffa-4029998f26f9", "name": "network-vif-plugged", "status": "completed", "tag": "969394cd-2669-452b-be36-7349619696ec"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:58:08.724967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-87a5a4a6-b3ef-42d8-a905-c9a17d9c5150 req-d5d1a43f-ef5a-4db5-b2c3-e833b91f4a7b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:08.725504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-87a5a4a6-b3ef-42d8-a905-c9a17d9c5150 req-d5d1a43f-ef5a-4db5-b2c3-e833b91f4a7b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:08.725956 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-87a5a4a6-b3ef-42d8-a905-c9a17d9c5150 req-d5d1a43f-ef5a-4db5-b2c3-e833b91f4a7b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:08.740286 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-87a5a4a6-b3ef-42d8-a905-c9a17d9c5150 req-d5d1a43f-ef5a-4db5-b2c3-e833b91f4a7b service nova] Creating event network-vif-plugged:969394cd-2669-452b-be36-7349619696ec for instance 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 on n-h2-839401-11 Aug 29 16:58:08.745633 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-87a5a4a6-b3ef-42d8-a905-c9a17d9c5150 req-d5d1a43f-ef5a-4db5-b2c3-e833b91f4a7b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035647 Aug 29 16:58:08.746298 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4284/8348] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:58:09.223732 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-913ab45f-0dfb-4b9a-9e89-7903411364de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:09.224378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-913ab45f-0dfb-4b9a-9e89-7903411364de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:09.240154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-913ab45f-0dfb-4b9a-9e89-7903411364de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:09.241355 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-913ab45f-0dfb-4b9a-9e89-7903411364de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:09.242472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-913ab45f-0dfb-4b9a-9e89-7903411364de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:09.244558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-913ab45f-0dfb-4b9a-9e89-7903411364de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:09.245995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-913ab45f-0dfb-4b9a-9e89-7903411364de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:09.246819 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-913ab45f-0dfb-4b9a-9e89-7903411364de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:09.400666 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-913ab45f-0dfb-4b9a-9e89-7903411364de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:09.409148 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-913ab45f-0dfb-4b9a-9e89-7903411364de tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1698 microversion: 2.1 time: 0.189597 Aug 29 16:58:09.410208 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4065/8349] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:09 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1698 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:10.437176 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-cd7a9ae0-497e-4187-9d60-0a61ba14c594 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:10.437920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-cd7a9ae0-497e-4187-9d60-0a61ba14c594 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:10.445996 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd7a9ae0-497e-4187-9d60-0a61ba14c594 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:10.446495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd7a9ae0-497e-4187-9d60-0a61ba14c594 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:10.446955 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd7a9ae0-497e-4187-9d60-0a61ba14c594 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:10.447676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd7a9ae0-497e-4187-9d60-0a61ba14c594 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:10.448148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd7a9ae0-497e-4187-9d60-0a61ba14c594 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:10.448571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-cd7a9ae0-497e-4187-9d60-0a61ba14c594 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:10.596272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-cd7a9ae0-497e-4187-9d60-0a61ba14c594 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:10.605063 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-cd7a9ae0-497e-4187-9d60-0a61ba14c594 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1698 microversion: 2.1 time: 0.176582 Aug 29 16:58:10.605783 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4285/8350] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:10 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1698 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:11.627202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7691718a-690c-493a-a8c1-4a8f76bcdb63 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:11.627825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7691718a-690c-493a-a8c1-4a8f76bcdb63 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:11.635579 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7691718a-690c-493a-a8c1-4a8f76bcdb63 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:11.636498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7691718a-690c-493a-a8c1-4a8f76bcdb63 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:11.637116 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7691718a-690c-493a-a8c1-4a8f76bcdb63 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:11.637899 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7691718a-690c-493a-a8c1-4a8f76bcdb63 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:11.638487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7691718a-690c-493a-a8c1-4a8f76bcdb63 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:11.638961 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7691718a-690c-493a-a8c1-4a8f76bcdb63 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:11.788675 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7691718a-690c-493a-a8c1-4a8f76bcdb63 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:11.798497 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7691718a-690c-493a-a8c1-4a8f76bcdb63 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1693 microversion: 2.1 time: 0.175121 Aug 29 16:58:11.799883 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4066/8351] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:11 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:12.823440 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-a1ec2ef0-1ae5-4954-b219-f93f7c65e9c6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:12.824766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-a1ec2ef0-1ae5-4954-b219-f93f7c65e9c6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:12.836163 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ec2ef0-1ae5-4954-b219-f93f7c65e9c6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:12.836968 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ec2ef0-1ae5-4954-b219-f93f7c65e9c6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:12.837479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ec2ef0-1ae5-4954-b219-f93f7c65e9c6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:12.838488 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ec2ef0-1ae5-4954-b219-f93f7c65e9c6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:12.839206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ec2ef0-1ae5-4954-b219-f93f7c65e9c6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:12.839953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-a1ec2ef0-1ae5-4954-b219-f93f7c65e9c6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:13.010995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-a1ec2ef0-1ae5-4954-b219-f93f7c65e9c6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:13.024091 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-a1ec2ef0-1ae5-4954-b219-f93f7c65e9c6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1693 microversion: 2.1 time: 0.205414 Aug 29 16:58:13.025344 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4286/8352] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:12 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1693 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:14.046573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-296d119d-a4ac-4d33-999d-1178490217e0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:14.047907 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-296d119d-a4ac-4d33-999d-1178490217e0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:14.055504 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-296d119d-a4ac-4d33-999d-1178490217e0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:14.056002 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-296d119d-a4ac-4d33-999d-1178490217e0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:14.056440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-296d119d-a4ac-4d33-999d-1178490217e0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:14.057178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-296d119d-a4ac-4d33-999d-1178490217e0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:14.057640 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-296d119d-a4ac-4d33-999d-1178490217e0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:14.058074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-296d119d-a4ac-4d33-999d-1178490217e0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:14.214105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-296d119d-a4ac-4d33-999d-1178490217e0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:14.223057 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-296d119d-a4ac-4d33-999d-1178490217e0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1693 microversion: 2.1 time: 0.180488 Aug 29 16:58:14.236591 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4067/8353] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:14 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:15.250388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-864ea8cd-c76b-4012-a58c-f16c12bdce53 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:15.253516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-864ea8cd-c76b-4012-a58c-f16c12bdce53 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:15.290008 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-864ea8cd-c76b-4012-a58c-f16c12bdce53 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:15.292643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-864ea8cd-c76b-4012-a58c-f16c12bdce53 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:15.295005 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-864ea8cd-c76b-4012-a58c-f16c12bdce53 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:15.298381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-864ea8cd-c76b-4012-a58c-f16c12bdce53 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:15.299544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-864ea8cd-c76b-4012-a58c-f16c12bdce53 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:15.302345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-864ea8cd-c76b-4012-a58c-f16c12bdce53 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:15.596612 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-864ea8cd-c76b-4012-a58c-f16c12bdce53 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:15.611313 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-864ea8cd-c76b-4012-a58c-f16c12bdce53 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1693 microversion: 2.1 time: 0.368739 Aug 29 16:58:15.613121 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4287/8354] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:15 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1693 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:16.646805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7a05d4d2-4b94-48ba-9487-35392491c4eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:16.647574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7a05d4d2-4b94-48ba-9487-35392491c4eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:16.655395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a05d4d2-4b94-48ba-9487-35392491c4eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:16.655893 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a05d4d2-4b94-48ba-9487-35392491c4eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:16.656439 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a05d4d2-4b94-48ba-9487-35392491c4eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:16.657313 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a05d4d2-4b94-48ba-9487-35392491c4eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:16.658702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a05d4d2-4b94-48ba-9487-35392491c4eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:16.659136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7a05d4d2-4b94-48ba-9487-35392491c4eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:16.803161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7a05d4d2-4b94-48ba-9487-35392491c4eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:16.811781 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7a05d4d2-4b94-48ba-9487-35392491c4eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1693 microversion: 2.1 time: 0.172247 Aug 29 16:58:16.812570 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4068/8355] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:16 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:17.833356 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ebd7c93-da79-4467-8463-c86aaf2b8e37 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:17.834462 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ebd7c93-da79-4467-8463-c86aaf2b8e37 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:17.844248 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ebd7c93-da79-4467-8463-c86aaf2b8e37 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:17.844878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ebd7c93-da79-4467-8463-c86aaf2b8e37 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:17.845963 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ebd7c93-da79-4467-8463-c86aaf2b8e37 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:17.846794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ebd7c93-da79-4467-8463-c86aaf2b8e37 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:17.847486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ebd7c93-da79-4467-8463-c86aaf2b8e37 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:17.848497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ebd7c93-da79-4467-8463-c86aaf2b8e37 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:17.990282 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5ebd7c93-da79-4467-8463-c86aaf2b8e37 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:17.998626 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ebd7c93-da79-4467-8463-c86aaf2b8e37 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1693 microversion: 2.1 time: 0.169987 Aug 29 16:58:17.999188 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4288/8356] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:17 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:19.021216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-36e937ee-8fbe-4e8f-9a54-531dca0d53e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:19.021992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-36e937ee-8fbe-4e8f-9a54-531dca0d53e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:19.028768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e937ee-8fbe-4e8f-9a54-531dca0d53e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:19.029289 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e937ee-8fbe-4e8f-9a54-531dca0d53e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:19.032161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e937ee-8fbe-4e8f-9a54-531dca0d53e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:19.032161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e937ee-8fbe-4e8f-9a54-531dca0d53e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:19.032161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e937ee-8fbe-4e8f-9a54-531dca0d53e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:19.032161 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-36e937ee-8fbe-4e8f-9a54-531dca0d53e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:19.189056 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-36e937ee-8fbe-4e8f-9a54-531dca0d53e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:19.197359 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-36e937ee-8fbe-4e8f-9a54-531dca0d53e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1693 microversion: 2.1 time: 0.180279 Aug 29 16:58:19.198955 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4069/8357] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:19 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1693 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:20.223064 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d7b1e33b-3487-48bc-8255-d343b33449e2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:20.223927 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d7b1e33b-3487-48bc-8255-d343b33449e2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:20.232079 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7b1e33b-3487-48bc-8255-d343b33449e2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:20.232695 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7b1e33b-3487-48bc-8255-d343b33449e2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:20.233268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7b1e33b-3487-48bc-8255-d343b33449e2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:20.234279 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7b1e33b-3487-48bc-8255-d343b33449e2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:20.234800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7b1e33b-3487-48bc-8255-d343b33449e2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:20.235320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d7b1e33b-3487-48bc-8255-d343b33449e2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:20.399180 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d7b1e33b-3487-48bc-8255-d343b33449e2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:20.410607 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d7b1e33b-3487-48bc-8255-d343b33449e2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1693 microversion: 2.1 time: 0.192638 Aug 29 16:58:20.411592 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4289/8358] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:20 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1693 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:21.432851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6c08aae2-4490-4893-997a-c95708d2d66a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:21.433940 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6c08aae2-4490-4893-997a-c95708d2d66a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:21.442105 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c08aae2-4490-4893-997a-c95708d2d66a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:21.442737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c08aae2-4490-4893-997a-c95708d2d66a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:21.443274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c08aae2-4490-4893-997a-c95708d2d66a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:21.444134 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c08aae2-4490-4893-997a-c95708d2d66a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:21.444694 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c08aae2-4490-4893-997a-c95708d2d66a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:21.445281 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6c08aae2-4490-4893-997a-c95708d2d66a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:21.597736 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6c08aae2-4490-4893-997a-c95708d2d66a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:21.606636 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6c08aae2-4490-4893-997a-c95708d2d66a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1693 microversion: 2.1 time: 0.177803 Aug 29 16:58:21.607269 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4070/8359] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:21 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:22.628563 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-64f3dcbf-6230-4e08-bb42-4f8c6640ac85 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:22.629239 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-64f3dcbf-6230-4e08-bb42-4f8c6640ac85 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:22.636413 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3dcbf-6230-4e08-bb42-4f8c6640ac85 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:22.636920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3dcbf-6230-4e08-bb42-4f8c6640ac85 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:22.637436 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3dcbf-6230-4e08-bb42-4f8c6640ac85 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:22.638157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3dcbf-6230-4e08-bb42-4f8c6640ac85 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:22.638634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3dcbf-6230-4e08-bb42-4f8c6640ac85 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:22.639084 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-64f3dcbf-6230-4e08-bb42-4f8c6640ac85 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:22.812060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-64f3dcbf-6230-4e08-bb42-4f8c6640ac85 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:22.820654 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-64f3dcbf-6230-4e08-bb42-4f8c6640ac85 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1675 microversion: 2.1 time: 0.196054 Aug 29 16:58:22.821277 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4290/8360] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:22 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1675 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:23.842888 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-613d2269-a6b1-4483-bc53-d85ac406ff2c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:23.843502 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-613d2269-a6b1-4483-bc53-d85ac406ff2c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:23.846322 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=27 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:23.852031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-613d2269-a6b1-4483-bc53-d85ac406ff2c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:23.852514 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-613d2269-a6b1-4483-bc53-d85ac406ff2c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:23.852986 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-613d2269-a6b1-4483-bc53-d85ac406ff2c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:23.853718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-613d2269-a6b1-4483-bc53-d85ac406ff2c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:23.854177 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-613d2269-a6b1-4483-bc53-d85ac406ff2c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:23.854606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-613d2269-a6b1-4483-bc53-d85ac406ff2c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:23.857519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=79 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:23.991574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-613d2269-a6b1-4483-bc53-d85ac406ff2c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:23.999856 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-613d2269-a6b1-4483-bc53-d85ac406ff2c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1675 microversion: 2.1 time: 0.161100 Aug 29 16:58:24.000449 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4071/8361] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:23 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:25.021923 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-19bcd637-9863-4ff7-83b6-64f0badc1345 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:25.022581 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-19bcd637-9863-4ff7-83b6-64f0badc1345 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:25.024635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=29 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:25.030442 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19bcd637-9863-4ff7-83b6-64f0badc1345 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:25.031072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19bcd637-9863-4ff7-83b6-64f0badc1345 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:25.031526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19bcd637-9863-4ff7-83b6-64f0badc1345 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:25.032234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19bcd637-9863-4ff7-83b6-64f0badc1345 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:25.032707 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19bcd637-9863-4ff7-83b6-64f0badc1345 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:25.033177 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-19bcd637-9863-4ff7-83b6-64f0badc1345 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:25.036447 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:25.175758 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-19bcd637-9863-4ff7-83b6-64f0badc1345 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:25.184605 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-19bcd637-9863-4ff7-83b6-64f0badc1345 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1678 microversion: 2.1 time: 0.166826 Aug 29 16:58:25.185221 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4291/8362] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:25 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:25.207426 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7c93417c-83be-4bb2-b6e9-a148e4adf5fa tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:58:25.208070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7c93417c-83be-4bb2-b6e9-a148e4adf5fa tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:25.215868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c93417c-83be-4bb2-b6e9-a148e4adf5fa tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:25.216352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c93417c-83be-4bb2-b6e9-a148e4adf5fa tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:25.216821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c93417c-83be-4bb2-b6e9-a148e4adf5fa tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:25.217549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c93417c-83be-4bb2-b6e9-a148e4adf5fa tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:25.218008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c93417c-83be-4bb2-b6e9-a148e4adf5fa tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:25.218433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7c93417c-83be-4bb2-b6e9-a148e4adf5fa tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:25.315370 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7c93417c-83be-4bb2-b6e9-a148e4adf5fa tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122361) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 16:58:25.388465 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7c93417c-83be-4bb2-b6e9-a148e4adf5fa tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "POST /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9/action" status: 202 len: 0 microversion: 2.1 time: 0.185095 Aug 29 16:58:25.389281 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4072/8363] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 16:58:25 2022] POST /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:58:25.397896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-1ba5a588-c93e-4a7b-982d-8d33a8c369e8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:25.398533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-1ba5a588-c93e-4a7b-982d-8d33a8c369e8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:25.404969 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ba5a588-c93e-4a7b-982d-8d33a8c369e8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:25.405516 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ba5a588-c93e-4a7b-982d-8d33a8c369e8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:25.405975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ba5a588-c93e-4a7b-982d-8d33a8c369e8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:25.406696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ba5a588-c93e-4a7b-982d-8d33a8c369e8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:25.407174 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ba5a588-c93e-4a7b-982d-8d33a8c369e8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:25.407616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-1ba5a588-c93e-4a7b-982d-8d33a8c369e8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:25.542631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-1ba5a588-c93e-4a7b-982d-8d33a8c369e8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:25.550358 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-1ba5a588-c93e-4a7b-982d-8d33a8c369e8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1626 microversion: 2.1 time: 0.156470 Aug 29 16:58:25.550949 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4292/8364] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:25 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1626 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:26.572980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c5708567-77b2-43d9-9b9e-78fd58f411eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:26.573683 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c5708567-77b2-43d9-9b9e-78fd58f411eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:26.580301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5708567-77b2-43d9-9b9e-78fd58f411eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:26.580806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5708567-77b2-43d9-9b9e-78fd58f411eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:26.581280 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5708567-77b2-43d9-9b9e-78fd58f411eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:26.581997 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5708567-77b2-43d9-9b9e-78fd58f411eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:26.582462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5708567-77b2-43d9-9b9e-78fd58f411eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:26.582923 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c5708567-77b2-43d9-9b9e-78fd58f411eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:26.725697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c5708567-77b2-43d9-9b9e-78fd58f411eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:26.734307 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c5708567-77b2-43d9-9b9e-78fd58f411eb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.166259 Aug 29 16:58:26.734904 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4073/8365] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:26 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:26.787401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-e2d89dda-aa06-4d75-ad3c-70eacb05ce38 req-c9b20c99-973c-4797-9b51-4edd9f42eb03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b76c0cf-b737-4fa9-9ffa-4029998f26f9", "name": "network-vif-unplugged", "status": "completed", "tag": "969394cd-2669-452b-be36-7349619696ec"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:58:26.798510 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e2d89dda-aa06-4d75-ad3c-70eacb05ce38 req-c9b20c99-973c-4797-9b51-4edd9f42eb03 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:26.799012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e2d89dda-aa06-4d75-ad3c-70eacb05ce38 req-c9b20c99-973c-4797-9b51-4edd9f42eb03 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:26.799470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-e2d89dda-aa06-4d75-ad3c-70eacb05ce38 req-c9b20c99-973c-4797-9b51-4edd9f42eb03 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:26.814722 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-e2d89dda-aa06-4d75-ad3c-70eacb05ce38 req-c9b20c99-973c-4797-9b51-4edd9f42eb03 service nova] Creating event network-vif-unplugged:969394cd-2669-452b-be36-7349619696ec for instance 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 on n-h1-839401-11 Aug 29 16:58:26.820226 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-e2d89dda-aa06-4d75-ad3c-70eacb05ce38 req-c9b20c99-973c-4797-9b51-4edd9f42eb03 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036898 Aug 29 16:58:26.821062 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4293/8366] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:58:27.757252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7bacbac2-8c2d-4120-b6be-b60d16a89a16 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:27.757975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7bacbac2-8c2d-4120-b6be-b60d16a89a16 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:27.760508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b5d7fdc0-50f3-4ba3-8002-69943fec0aa3 req-01d3235b-a014-485c-8bc9-400161fa60df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b76c0cf-b737-4fa9-9ffa-4029998f26f9", "tag": "969394cd-2669-452b-be36-7349619696ec"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:58:27.766719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bacbac2-8c2d-4120-b6be-b60d16a89a16 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:27.767230 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bacbac2-8c2d-4120-b6be-b60d16a89a16 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:27.767681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bacbac2-8c2d-4120-b6be-b60d16a89a16 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:27.768428 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bacbac2-8c2d-4120-b6be-b60d16a89a16 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:27.768905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bacbac2-8c2d-4120-b6be-b60d16a89a16 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:27.769400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7bacbac2-8c2d-4120-b6be-b60d16a89a16 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:27.770469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b5d7fdc0-50f3-4ba3-8002-69943fec0aa3 req-01d3235b-a014-485c-8bc9-400161fa60df service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:27.770968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b5d7fdc0-50f3-4ba3-8002-69943fec0aa3 req-01d3235b-a014-485c-8bc9-400161fa60df service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:27.771397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b5d7fdc0-50f3-4ba3-8002-69943fec0aa3 req-01d3235b-a014-485c-8bc9-400161fa60df service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:27.784337 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b5d7fdc0-50f3-4ba3-8002-69943fec0aa3 req-01d3235b-a014-485c-8bc9-400161fa60df service nova] Creating event network-changed:969394cd-2669-452b-be36-7349619696ec for instance 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 on n-h1-839401-11 Aug 29 16:58:27.788136 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [req-b5d7fdc0-50f3-4ba3-8002-69943fec0aa3 req-01d3235b-a014-485c-8bc9-400161fa60df service nova] [2b957879-3d60-47da-b78d-8daa058cad0e] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:58:27.915161 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7bacbac2-8c2d-4120-b6be-b60d16a89a16 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:27.923540 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7bacbac2-8c2d-4120-b6be-b60d16a89a16 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.171352 Aug 29 16:58:27.924173 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4294/8367] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:27 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:28.796122 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [req-b5d7fdc0-50f3-4ba3-8002-69943fec0aa3 req-01d3235b-a014-485c-8bc9-400161fa60df service nova] [2b957879-3d60-47da-b78d-8daa058cad0e] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 43472. Aug 29 16:58:28.799618 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b5d7fdc0-50f3-4ba3-8002-69943fec0aa3 req-01d3235b-a014-485c-8bc9-400161fa60df service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.101562 Aug 29 16:58:28.800245 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4074/8368] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:58:28.945946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-03e15067-0aac-4845-9466-33fc73a6297d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:28.947394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-03e15067-0aac-4845-9466-33fc73a6297d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:28.955393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03e15067-0aac-4845-9466-33fc73a6297d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:28.956254 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03e15067-0aac-4845-9466-33fc73a6297d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:28.956965 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03e15067-0aac-4845-9466-33fc73a6297d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:28.957985 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03e15067-0aac-4845-9466-33fc73a6297d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:28.958669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03e15067-0aac-4845-9466-33fc73a6297d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:28.959323 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-03e15067-0aac-4845-9466-33fc73a6297d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:29.144631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-03e15067-0aac-4845-9466-33fc73a6297d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:29.153387 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-03e15067-0aac-4845-9466-33fc73a6297d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.211603 Aug 29 16:58:29.153983 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4295/8369] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:28 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:30.176822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e373b241-064f-4b54-808f-599261ce6474 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:30.177484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e373b241-064f-4b54-808f-599261ce6474 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:30.184560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e373b241-064f-4b54-808f-599261ce6474 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:30.185026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e373b241-064f-4b54-808f-599261ce6474 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:30.185503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e373b241-064f-4b54-808f-599261ce6474 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:30.186203 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e373b241-064f-4b54-808f-599261ce6474 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:30.186664 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e373b241-064f-4b54-808f-599261ce6474 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:30.187080 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e373b241-064f-4b54-808f-599261ce6474 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:30.334245 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e373b241-064f-4b54-808f-599261ce6474 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:30.345952 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e373b241-064f-4b54-808f-599261ce6474 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.174339 Aug 29 16:58:30.346841 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4075/8370] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:30 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:31.369525 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c9415d8e-9b8d-4a63-9407-0efe1e1158cc tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:31.370146 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c9415d8e-9b8d-4a63-9407-0efe1e1158cc tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:31.377397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9415d8e-9b8d-4a63-9407-0efe1e1158cc tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:31.377907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9415d8e-9b8d-4a63-9407-0efe1e1158cc tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:31.378370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9415d8e-9b8d-4a63-9407-0efe1e1158cc tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:31.379086 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9415d8e-9b8d-4a63-9407-0efe1e1158cc tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:31.379700 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9415d8e-9b8d-4a63-9407-0efe1e1158cc tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:31.380148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c9415d8e-9b8d-4a63-9407-0efe1e1158cc tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:31.520048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c9415d8e-9b8d-4a63-9407-0efe1e1158cc tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:31.530327 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c9415d8e-9b8d-4a63-9407-0efe1e1158cc tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.164832 Aug 29 16:58:31.531358 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4296/8371] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:31 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:32.552779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b619542a-a3ee-4079-8716-6a9d2ef0c10f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:32.553473 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b619542a-a3ee-4079-8716-6a9d2ef0c10f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:32.561570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b619542a-a3ee-4079-8716-6a9d2ef0c10f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:32.562063 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b619542a-a3ee-4079-8716-6a9d2ef0c10f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:32.562507 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b619542a-a3ee-4079-8716-6a9d2ef0c10f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:32.563221 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b619542a-a3ee-4079-8716-6a9d2ef0c10f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:32.563681 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b619542a-a3ee-4079-8716-6a9d2ef0c10f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:32.564254 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b619542a-a3ee-4079-8716-6a9d2ef0c10f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:32.707862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b619542a-a3ee-4079-8716-6a9d2ef0c10f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:32.731590 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b619542a-a3ee-4079-8716-6a9d2ef0c10f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.181929 Aug 29 16:58:32.732413 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4076/8372] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:32 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:33.753268 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b710936c-17b5-477d-93ee-970c15f5f4c1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:33.753905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b710936c-17b5-477d-93ee-970c15f5f4c1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:33.760937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b710936c-17b5-477d-93ee-970c15f5f4c1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:33.761475 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b710936c-17b5-477d-93ee-970c15f5f4c1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:33.761924 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b710936c-17b5-477d-93ee-970c15f5f4c1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:33.762633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b710936c-17b5-477d-93ee-970c15f5f4c1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:33.763099 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b710936c-17b5-477d-93ee-970c15f5f4c1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:33.763536 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b710936c-17b5-477d-93ee-970c15f5f4c1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:33.919733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b710936c-17b5-477d-93ee-970c15f5f4c1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:33.928135 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b710936c-17b5-477d-93ee-970c15f5f4c1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.179150 Aug 29 16:58:33.928731 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4297/8373] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:33 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:34.950252 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a99c8f84-ceca-4b7e-ba99-6b15dd9da243 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:34.950829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a99c8f84-ceca-4b7e-ba99-6b15dd9da243 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:34.962981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a99c8f84-ceca-4b7e-ba99-6b15dd9da243 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:34.963626 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a99c8f84-ceca-4b7e-ba99-6b15dd9da243 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:34.964190 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a99c8f84-ceca-4b7e-ba99-6b15dd9da243 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:34.965217 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a99c8f84-ceca-4b7e-ba99-6b15dd9da243 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:34.965939 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a99c8f84-ceca-4b7e-ba99-6b15dd9da243 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:34.966642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a99c8f84-ceca-4b7e-ba99-6b15dd9da243 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:35.128861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a99c8f84-ceca-4b7e-ba99-6b15dd9da243 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:35.137538 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a99c8f84-ceca-4b7e-ba99-6b15dd9da243 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.191252 Aug 29 16:58:35.138189 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4077/8374] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:34 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:36.159430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d4abaece-bfe0-4593-a40e-ced244dccc5b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:36.160031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d4abaece-bfe0-4593-a40e-ced244dccc5b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:36.167400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4abaece-bfe0-4593-a40e-ced244dccc5b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:36.167889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4abaece-bfe0-4593-a40e-ced244dccc5b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:36.168336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4abaece-bfe0-4593-a40e-ced244dccc5b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:36.169045 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4abaece-bfe0-4593-a40e-ced244dccc5b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:36.169541 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4abaece-bfe0-4593-a40e-ced244dccc5b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:36.169975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d4abaece-bfe0-4593-a40e-ced244dccc5b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:36.308199 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d4abaece-bfe0-4593-a40e-ced244dccc5b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:36.323654 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d4abaece-bfe0-4593-a40e-ced244dccc5b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.168400 Aug 29 16:58:36.324256 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4298/8375] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:36 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:37.345648 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8d0d7d68-b940-4a1b-a897-bcd267ca7225 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:37.346291 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8d0d7d68-b940-4a1b-a897-bcd267ca7225 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:37.353744 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d0d7d68-b940-4a1b-a897-bcd267ca7225 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:37.354234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d0d7d68-b940-4a1b-a897-bcd267ca7225 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:37.354779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d0d7d68-b940-4a1b-a897-bcd267ca7225 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:37.355373 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d0d7d68-b940-4a1b-a897-bcd267ca7225 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:37.355833 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d0d7d68-b940-4a1b-a897-bcd267ca7225 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:37.356250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8d0d7d68-b940-4a1b-a897-bcd267ca7225 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:37.501074 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8d0d7d68-b940-4a1b-a897-bcd267ca7225 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:37.509742 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8d0d7d68-b940-4a1b-a897-bcd267ca7225 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.168392 Aug 29 16:58:37.510328 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4078/8376] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:37 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:38.531325 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-24a65aae-2a76-4c73-b752-a7e8004dc7a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:38.532940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-24a65aae-2a76-4c73-b752-a7e8004dc7a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:38.540730 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24a65aae-2a76-4c73-b752-a7e8004dc7a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:38.541616 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24a65aae-2a76-4c73-b752-a7e8004dc7a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:38.542306 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24a65aae-2a76-4c73-b752-a7e8004dc7a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:38.543385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24a65aae-2a76-4c73-b752-a7e8004dc7a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:38.544365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24a65aae-2a76-4c73-b752-a7e8004dc7a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:38.545157 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-24a65aae-2a76-4c73-b752-a7e8004dc7a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:38.691766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-24a65aae-2a76-4c73-b752-a7e8004dc7a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:38.701808 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-24a65aae-2a76-4c73-b752-a7e8004dc7a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.174398 Aug 29 16:58:38.702497 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4299/8377] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:38 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:39.723500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-583a2e06-2bfb-4731-954d-0d7cd6fb9653 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:39.724155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-583a2e06-2bfb-4731-954d-0d7cd6fb9653 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:39.731570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-583a2e06-2bfb-4731-954d-0d7cd6fb9653 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:39.732066 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-583a2e06-2bfb-4731-954d-0d7cd6fb9653 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:39.732517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-583a2e06-2bfb-4731-954d-0d7cd6fb9653 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:39.733261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-583a2e06-2bfb-4731-954d-0d7cd6fb9653 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:39.733780 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-583a2e06-2bfb-4731-954d-0d7cd6fb9653 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:39.734195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-583a2e06-2bfb-4731-954d-0d7cd6fb9653 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:39.882123 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-583a2e06-2bfb-4731-954d-0d7cd6fb9653 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:39.891769 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-583a2e06-2bfb-4731-954d-0d7cd6fb9653 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.172530 Aug 29 16:58:39.892337 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4079/8378] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:39 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:40.914020 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-60fa36f1-b3a9-4845-aae3-94eba405f2fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:40.915140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-60fa36f1-b3a9-4845-aae3-94eba405f2fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:40.924127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60fa36f1-b3a9-4845-aae3-94eba405f2fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:40.924661 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60fa36f1-b3a9-4845-aae3-94eba405f2fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:40.925288 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60fa36f1-b3a9-4845-aae3-94eba405f2fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:40.926469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60fa36f1-b3a9-4845-aae3-94eba405f2fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:40.926950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60fa36f1-b3a9-4845-aae3-94eba405f2fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:40.927422 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-60fa36f1-b3a9-4845-aae3-94eba405f2fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:41.108404 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-60fa36f1-b3a9-4845-aae3-94eba405f2fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:41.116522 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-60fa36f1-b3a9-4845-aae3-94eba405f2fb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.206985 Aug 29 16:58:41.117131 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4300/8379] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:40 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:42.138453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-add69608-28dd-4681-ab88-626f3ca7c7e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:42.139041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-add69608-28dd-4681-ab88-626f3ca7c7e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:42.146750 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-add69608-28dd-4681-ab88-626f3ca7c7e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:42.147231 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-add69608-28dd-4681-ab88-626f3ca7c7e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:42.147663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-add69608-28dd-4681-ab88-626f3ca7c7e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:42.148359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-add69608-28dd-4681-ab88-626f3ca7c7e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:42.148808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-add69608-28dd-4681-ab88-626f3ca7c7e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:42.149272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-add69608-28dd-4681-ab88-626f3ca7c7e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:42.308215 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-add69608-28dd-4681-ab88-626f3ca7c7e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:42.317152 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-add69608-28dd-4681-ab88-626f3ca7c7e7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.182790 Aug 29 16:58:42.317745 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4080/8380] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:42 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:43.346343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-49f26b15-b62f-48c4-80d2-e98d531414d7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:43.346973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-49f26b15-b62f-48c4-80d2-e98d531414d7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:43.354158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49f26b15-b62f-48c4-80d2-e98d531414d7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:43.354667 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49f26b15-b62f-48c4-80d2-e98d531414d7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:43.355125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49f26b15-b62f-48c4-80d2-e98d531414d7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:43.355839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49f26b15-b62f-48c4-80d2-e98d531414d7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:43.356317 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49f26b15-b62f-48c4-80d2-e98d531414d7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:43.356763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-49f26b15-b62f-48c4-80d2-e98d531414d7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:43.502090 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-49f26b15-b62f-48c4-80d2-e98d531414d7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:43.510588 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-49f26b15-b62f-48c4-80d2-e98d531414d7 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.168706 Aug 29 16:58:43.511185 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4301/8381] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:43 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:44.532095 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e4d112b0-27b1-4435-84ef-2b0d4bd66272 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:44.532718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e4d112b0-27b1-4435-84ef-2b0d4bd66272 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:44.540144 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4d112b0-27b1-4435-84ef-2b0d4bd66272 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:44.540687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4d112b0-27b1-4435-84ef-2b0d4bd66272 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:44.541130 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4d112b0-27b1-4435-84ef-2b0d4bd66272 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:44.541868 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4d112b0-27b1-4435-84ef-2b0d4bd66272 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:44.542331 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4d112b0-27b1-4435-84ef-2b0d4bd66272 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:44.542783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e4d112b0-27b1-4435-84ef-2b0d4bd66272 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:44.693558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e4d112b0-27b1-4435-84ef-2b0d4bd66272 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:44.701841 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e4d112b0-27b1-4435-84ef-2b0d4bd66272 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.173778 Aug 29 16:58:44.702460 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4081/8382] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:44 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:45.728385 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ce619893-e656-43e4-90a9-0601435fe058 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:45.729054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ce619893-e656-43e4-90a9-0601435fe058 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:45.736123 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce619893-e656-43e4-90a9-0601435fe058 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:45.736635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce619893-e656-43e4-90a9-0601435fe058 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:45.737114 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce619893-e656-43e4-90a9-0601435fe058 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:45.737859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce619893-e656-43e4-90a9-0601435fe058 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:45.738343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce619893-e656-43e4-90a9-0601435fe058 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:45.738778 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ce619893-e656-43e4-90a9-0601435fe058 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:45.884257 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ce619893-e656-43e4-90a9-0601435fe058 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:45.893124 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ce619893-e656-43e4-90a9-0601435fe058 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.169033 Aug 29 16:58:45.893652 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4302/8383] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:45 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:46.915223 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8541baf4-5fce-4b50-9632-ad79b2b48de4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:46.915866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8541baf4-5fce-4b50-9632-ad79b2b48de4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:46.923208 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8541baf4-5fce-4b50-9632-ad79b2b48de4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:46.923717 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8541baf4-5fce-4b50-9632-ad79b2b48de4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:46.924155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8541baf4-5fce-4b50-9632-ad79b2b48de4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:46.924856 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8541baf4-5fce-4b50-9632-ad79b2b48de4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:46.925397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8541baf4-5fce-4b50-9632-ad79b2b48de4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:46.925792 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8541baf4-5fce-4b50-9632-ad79b2b48de4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:47.087384 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8541baf4-5fce-4b50-9632-ad79b2b48de4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:47.095445 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8541baf4-5fce-4b50-9632-ad79b2b48de4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.184274 Aug 29 16:58:47.096015 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4082/8384] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:46 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:47.832793 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-73e955f4-9996-4a02-9bea-eb16075ffda2 req-a6d34eb8-c90e-4db9-bc45-7c897d89e887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b76c0cf-b737-4fa9-9ffa-4029998f26f9", "name": "network-vif-plugged", "status": "completed", "tag": "969394cd-2669-452b-be36-7349619696ec"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:58:47.846655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-73e955f4-9996-4a02-9bea-eb16075ffda2 req-a6d34eb8-c90e-4db9-bc45-7c897d89e887 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:47.847162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-73e955f4-9996-4a02-9bea-eb16075ffda2 req-a6d34eb8-c90e-4db9-bc45-7c897d89e887 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:47.847880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-73e955f4-9996-4a02-9bea-eb16075ffda2 req-a6d34eb8-c90e-4db9-bc45-7c897d89e887 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:47.859628 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-73e955f4-9996-4a02-9bea-eb16075ffda2 req-a6d34eb8-c90e-4db9-bc45-7c897d89e887 service nova] Creating event network-vif-plugged:969394cd-2669-452b-be36-7349619696ec for instance 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 on n-h1-839401-11 Aug 29 16:58:47.864935 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-73e955f4-9996-4a02-9bea-eb16075ffda2 req-a6d34eb8-c90e-4db9-bc45-7c897d89e887 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041696 Aug 29 16:58:47.865830 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4303/8385] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 16:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:58:48.124325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a5ba0565-57e7-4341-8acd-2feec0bddb4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:48.125158 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a5ba0565-57e7-4341-8acd-2feec0bddb4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:48.132764 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5ba0565-57e7-4341-8acd-2feec0bddb4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:48.133435 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5ba0565-57e7-4341-8acd-2feec0bddb4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:48.133872 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5ba0565-57e7-4341-8acd-2feec0bddb4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:48.134586 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5ba0565-57e7-4341-8acd-2feec0bddb4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:48.135039 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5ba0565-57e7-4341-8acd-2feec0bddb4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:48.135467 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a5ba0565-57e7-4341-8acd-2feec0bddb4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:48.273108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a5ba0565-57e7-4341-8acd-2feec0bddb4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:48.281839 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a5ba0565-57e7-4341-8acd-2feec0bddb4e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.161711 Aug 29 16:58:48.282456 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4083/8386] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:48 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:49.307133 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d724efe3-5c3e-42d5-b8c5-ac87d2ee76e4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:49.307844 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d724efe3-5c3e-42d5-b8c5-ac87d2ee76e4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:49.315238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d724efe3-5c3e-42d5-b8c5-ac87d2ee76e4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:49.315746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d724efe3-5c3e-42d5-b8c5-ac87d2ee76e4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:49.316205 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d724efe3-5c3e-42d5-b8c5-ac87d2ee76e4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:49.316929 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d724efe3-5c3e-42d5-b8c5-ac87d2ee76e4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:49.317439 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d724efe3-5c3e-42d5-b8c5-ac87d2ee76e4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:49.317896 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d724efe3-5c3e-42d5-b8c5-ac87d2ee76e4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:49.461100 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d724efe3-5c3e-42d5-b8c5-ac87d2ee76e4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:49.469691 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d724efe3-5c3e-42d5-b8c5-ac87d2ee76e4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1684 microversion: 2.1 time: 0.169886 Aug 29 16:58:49.470285 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4304/8387] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:49 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:50.493014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0c27820a-0c46-4b4e-85ba-9960ffc3f80d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:50.493591 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0c27820a-0c46-4b4e-85ba-9960ffc3f80d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:50.501667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c27820a-0c46-4b4e-85ba-9960ffc3f80d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:50.502163 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c27820a-0c46-4b4e-85ba-9960ffc3f80d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:50.502652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c27820a-0c46-4b4e-85ba-9960ffc3f80d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:50.503338 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c27820a-0c46-4b4e-85ba-9960ffc3f80d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:50.503937 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c27820a-0c46-4b4e-85ba-9960ffc3f80d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:50.504212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0c27820a-0c46-4b4e-85ba-9960ffc3f80d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:50.670817 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-0c27820a-0c46-4b4e-85ba-9960ffc3f80d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:50.683329 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0c27820a-0c46-4b4e-85ba-9960ffc3f80d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1671 microversion: 2.1 time: 0.195043 Aug 29 16:58:50.684403 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4084/8388] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:50 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1671 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:39.314809 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=27 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:39.315637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=75 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:39.317252 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 17:00:39.317583 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 17:00:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 (ip 10.222.0.62) !!! Aug 29 17:00:39.322184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-fa0670dd-707a-49d1-aaa6-2d6b50e95717 req-376a646a-8467-462e-8ec7-6e55c3a031d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b76c0cf-b737-4fa9-9ffa-4029998f26f9", "tag": "969394cd-2669-452b-be36-7349619696ec"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:00:39.324137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6cce1d72-66b5-4227-b243-3d8eb15a0752 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:39.324660 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6cce1d72-66b5-4227-b243-3d8eb15a0752 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:39.328935 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:39.329978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:39.336590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fa0670dd-707a-49d1-aaa6-2d6b50e95717 req-376a646a-8467-462e-8ec7-6e55c3a031d7 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:39.337070 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fa0670dd-707a-49d1-aaa6-2d6b50e95717 req-376a646a-8467-462e-8ec7-6e55c3a031d7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:39.337835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-fa0670dd-707a-49d1-aaa6-2d6b50e95717 req-376a646a-8467-462e-8ec7-6e55c3a031d7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:39.339928 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cce1d72-66b5-4227-b243-3d8eb15a0752 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:39.340445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cce1d72-66b5-4227-b243-3d8eb15a0752 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:39.340903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cce1d72-66b5-4227-b243-3d8eb15a0752 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:39.341881 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cce1d72-66b5-4227-b243-3d8eb15a0752 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:39.342365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cce1d72-66b5-4227-b243-3d8eb15a0752 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:39.342815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6cce1d72-66b5-4227-b243-3d8eb15a0752 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:39.351899 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-fa0670dd-707a-49d1-aaa6-2d6b50e95717 req-376a646a-8467-462e-8ec7-6e55c3a031d7 service nova] Creating event network-changed:969394cd-2669-452b-be36-7349619696ec for instance 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 on n-h1-839401-11 Aug 29 17:00:39.358529 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-fa0670dd-707a-49d1-aaa6-2d6b50e95717 req-376a646a-8467-462e-8ec7-6e55c3a031d7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043540 Aug 29 17:00:39.359580 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4085/8389] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:00:39.374274 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6cce1d72-66b5-4227-b243-3d8eb15a0752 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 17:00:39.502422 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6cce1d72-66b5-4227-b243-3d8eb15a0752 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 204 len: 0 microversion: 2.1 time: 0.189360 Aug 29 17:00:39.503528 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4305/8390] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 17:00:39 2022] DELETE /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 17:00:39.525840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bcee4f3d-fecc-4e6c-95a4-59f5682423d8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:39.532613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bcee4f3d-fecc-4e6c-95a4-59f5682423d8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:39.550005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcee4f3d-fecc-4e6c-95a4-59f5682423d8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:39.551618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcee4f3d-fecc-4e6c-95a4-59f5682423d8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:39.553614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcee4f3d-fecc-4e6c-95a4-59f5682423d8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:39.555559 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcee4f3d-fecc-4e6c-95a4-59f5682423d8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:39.556790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcee4f3d-fecc-4e6c-95a4-59f5682423d8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:39.558234 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bcee4f3d-fecc-4e6c-95a4-59f5682423d8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:39.807653 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bcee4f3d-fecc-4e6c-95a4-59f5682423d8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:39.824383 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bcee4f3d-fecc-4e6c-95a4-59f5682423d8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1677 microversion: 2.1 time: 0.312878 Aug 29 17:00:39.825738 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4086/8391] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:39 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1677 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:40.854523 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-da90999f-341d-46fc-bc9b-3c3932b6715e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:40.855301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-da90999f-341d-46fc-bc9b-3c3932b6715e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:40.867208 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da90999f-341d-46fc-bc9b-3c3932b6715e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:40.867724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da90999f-341d-46fc-bc9b-3c3932b6715e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:40.868159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da90999f-341d-46fc-bc9b-3c3932b6715e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:40.868972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da90999f-341d-46fc-bc9b-3c3932b6715e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:40.869574 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da90999f-341d-46fc-bc9b-3c3932b6715e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:40.870023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-da90999f-341d-46fc-bc9b-3c3932b6715e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:41.093952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-da90999f-341d-46fc-bc9b-3c3932b6715e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:41.106887 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-da90999f-341d-46fc-bc9b-3c3932b6715e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1677 microversion: 2.1 time: 0.256550 Aug 29 17:00:41.107485 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4306/8392] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:40 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1677 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:41.882718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-6a3c827a-bbc4-4a15-94bf-67a7e58f9809 req-885c001a-191d-41ef-aca7-4ae512573ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b76c0cf-b737-4fa9-9ffa-4029998f26f9", "name": "network-vif-deleted", "tag": "969394cd-2669-452b-be36-7349619696ec"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:00:41.894212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6a3c827a-bbc4-4a15-94bf-67a7e58f9809 req-885c001a-191d-41ef-aca7-4ae512573ac4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:41.894743 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6a3c827a-bbc4-4a15-94bf-67a7e58f9809 req-885c001a-191d-41ef-aca7-4ae512573ac4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:41.895173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-6a3c827a-bbc4-4a15-94bf-67a7e58f9809 req-885c001a-191d-41ef-aca7-4ae512573ac4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:41.907498 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-6a3c827a-bbc4-4a15-94bf-67a7e58f9809 req-885c001a-191d-41ef-aca7-4ae512573ac4 service nova] Creating event network-vif-deleted:969394cd-2669-452b-be36-7349619696ec for instance 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 on n-h1-839401-11 Aug 29 17:00:41.913504 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-6a3c827a-bbc4-4a15-94bf-67a7e58f9809 req-885c001a-191d-41ef-aca7-4ae512573ac4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034415 Aug 29 17:00:41.914291 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4087/8393] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:00:42.134845 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-62461658-e863-4169-b7ee-94f39d8f6061 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:42.135486 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-62461658-e863-4169-b7ee-94f39d8f6061 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:42.142967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62461658-e863-4169-b7ee-94f39d8f6061 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:42.143477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62461658-e863-4169-b7ee-94f39d8f6061 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:42.144098 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62461658-e863-4169-b7ee-94f39d8f6061 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:42.144829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62461658-e863-4169-b7ee-94f39d8f6061 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:42.145327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62461658-e863-4169-b7ee-94f39d8f6061 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:42.145997 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62461658-e863-4169-b7ee-94f39d8f6061 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:42.182345 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62461658-e863-4169-b7ee-94f39d8f6061 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:42.182872 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62461658-e863-4169-b7ee-94f39d8f6061 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:42.183327 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-62461658-e863-4169-b7ee-94f39d8f6061 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:42.183797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.objects.instance [None req-62461658-e863-4169-b7ee-94f39d8f6061 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lazy-loading 'fault' on Instance uuid 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 {{(pid=122360) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 17:00:42.228040 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-62461658-e863-4169-b7ee-94f39d8f6061 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:42.236324 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-62461658-e863-4169-b7ee-94f39d8f6061 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 200 len: 1335 microversion: 2.1 time: 0.107189 Aug 29 17:00:42.237064 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4307/8394] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:42 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 1335 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:43.262990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-022e955a-41c9-46ed-977c-93a24bf16e23 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:43.263580 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-022e955a-41c9-46ed-977c-93a24bf16e23 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: 6b76c0cf-b737-4fa9-9ffa-4029998f26f9] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:43.273853 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-022e955a-41c9-46ed-977c-93a24bf16e23 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:43.274654 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-022e955a-41c9-46ed-977c-93a24bf16e23 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:43.275463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-022e955a-41c9-46ed-977c-93a24bf16e23 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:43.276164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-022e955a-41c9-46ed-977c-93a24bf16e23 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:43.276614 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-022e955a-41c9-46ed-977c-93a24bf16e23 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:43.277042 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-022e955a-41c9-46ed-977c-93a24bf16e23 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:43.291251 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-022e955a-41c9-46ed-977c-93a24bf16e23 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] HTTP exception thrown: Instance 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 could not be found. Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-022e955a-41c9-46ed-977c-93a24bf16e23 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Request method failure captured: Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 HTTP/1.1 Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDO9d0-Ds3JY08oSbX1sgtZw7PdsxMe_xJk2Iow1zVdEOEBphCN_BkLdvQP51SDi1AE_DEk-dIrARG4566Is8BQH5N2uulCD3tF8GjrgGsTY8hPmRM_WdaGuBhPULO421T5n8lEDfsdjBtWQf77nwvzq7VoLYz8U0sr3JkhVTxPZ_8Ww Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: df90138d350e4bc796a0d152a4af2dfc Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestShelveInstance-1115830045 Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_df90138d350e4bc796a0d152a4af2dfc", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/df90138d350e4bc796a0d152a4af2dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/df90138d350e4bc796a0d152a4af2dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/df90138d350e4bc796a0d152a4af2dfc"}]}] Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestShelveInstance-1115830045 Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: df90138d350e4bc796a0d152a4af2dfc Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestShelveInstance-1115830045 Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestShelveInstance-1115830045-project Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 6fdb91fd783e4589bd5ca7fe07ea0e91 Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestShelveInstance-1115830045-project Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 could not be found. Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '6b76c0cf-b737-4fa9-9ffa-4029998f26f9'} Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 could not be found. Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 could not be found. Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:00:43.292955 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 17:00:43.298453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:00:43.298453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:00:43.298453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:00:43.298453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 17:00:43.298453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 17:00:43.298453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 could not be found. Aug 29 17:00:43.298453 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 17:00:43.298453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-022e955a-41c9-46ed-977c-93a24bf16e23 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Returning 404 to user: Instance 6b76c0cf-b737-4fa9-9ffa-4029998f26f9 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 17:00:43.298453 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-022e955a-41c9-46ed-977c-93a24bf16e23 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9" status: 404 len: 111 microversion: 2.1 time: 0.040017 Aug 29 17:00:43.298453 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4088/8395] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:43 2022] GET /compute/v2.1/servers/6b76c0cf-b737-4fa9-9ffa-4029998f26f9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 17:00:43.473756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-682c9eeb-9855-4aee-977b-b4c1c9dc9697 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '.version_select at 0x7fc42a5c1e50>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:43.504533 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-682c9eeb-9855-4aee-977b-b4c1c9dc9697 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-157925662" status: 202 len: 0 microversion: 2.1 time: 0.035112 Aug 29 17:00:43.505180 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4308/8396] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 17:00:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-157925662 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 17:00:43.534256 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7f3bedaf-209a-4d18-a4ef-52289bcac914 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Action: 'create', calling method: .version_select at 0x7fc433a123a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1756349972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxtO+J6qhZO+eymWldfi4qCCjYYAx22j1NdUrHGRZ9bSdQGKm1Xm/gPJRFX9Lh9CKCTUoHuGGzcGtJuNYPM2kAegtGyXV9wziiImwcuD9InrfB/XgrzKFdCPXx/6PpdLA=="}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:00:43.552719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-7f3bedaf-209a-4d18-a4ef-52289bcac914 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Getting quotas for project df90138d350e4bc796a0d152a4af2dfc. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 17:00:43.560487 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-7f3bedaf-209a-4d18-a4ef-52289bcac914 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Getting quotas for user 6fdb91fd783e4589bd5ca7fe07ea0e91 and project df90138d350e4bc796a0d152a4af2dfc. Resources: {'key_pairs'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 17:00:43.590488 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7f3bedaf-209a-4d18-a4ef-52289bcac914 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.060516 Aug 29 17:00:43.591116 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4089/8397] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 17:00:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:01:02.222984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-196703736", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1756349972", "security_groups": [{"name": "tempest-secgroup-smoke-1949707281"}], "networks": [{"uuid": "da599d20-c1af-4ea3-bf91-fb38cf525619"}], "block_device_mapping_v2": [{"uuid": "9610085e-c3d3-4775-b78d-3718b18c2ae3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:01:02.234531 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:02.235187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:02.353781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.network.neutron [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] validate_networks() for [('da599d20-c1af-4ea3-bf91-fb38cf525619', None, None, None, None, None)] {{(pid=122360) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 17:01:03.077457 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Flavor limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 17:01:03.077912 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Image limits 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 17:01:03.078406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Flavor pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 17:01:03.078846 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Image pref 0:0:0 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 17:01:03.079272 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.virt.hardware [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122360) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 17:01:03.088663 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:03.089192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:03.089655 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:03.090403 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:03.090856 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:03.091341 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:03.119141 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Getting quotas for project df90138d350e4bc796a0d152a4af2dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 17:01:03.124780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Getting quotas for user 6fdb91fd783e4589bd5ca7fe07ea0e91 and project df90138d350e4bc796a0d152a4af2dfc. Resources: {'ram', 'instances', 'cores'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 17:01:03.204454 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Going to run 1 instances... {{(pid=122360) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 17:01:03.207995 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9610085e-c3d3-4775-b78d-3718b18c2ae3',volume_size=None,volume_type=None)] {{(pid=122360) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 17:01:03.353421 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-630f10eb-401e-48ac-b4ca-505620ba62b0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.134686 Aug 29 17:01:03.354148 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4309/8398] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 17:01:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 17:01:03.363269 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=12 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:03.364040 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=4 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:03.365023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:03.370438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c21d3a8e-c18a-46ec-8635-144923e8114f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:03.370992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c21d3a8e-c18a-46ec-8635-144923e8114f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:03.433206 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c21d3a8e-c18a-46ec-8635-144923e8114f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:03.440700 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c21d3a8e-c18a-46ec-8635-144923e8114f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1088 microversion: 2.1 time: 0.079315 Aug 29 17:01:03.441313 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4090/8399] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:03 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:04.465590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5520ab32-28e2-453d-8e50-f4b94028603b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:04.466231 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5520ab32-28e2-453d-8e50-f4b94028603b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:04.475016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5520ab32-28e2-453d-8e50-f4b94028603b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:04.475678 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5520ab32-28e2-453d-8e50-f4b94028603b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:04.476441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5520ab32-28e2-453d-8e50-f4b94028603b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:04.477495 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5520ab32-28e2-453d-8e50-f4b94028603b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:04.478381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5520ab32-28e2-453d-8e50-f4b94028603b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:04.479003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5520ab32-28e2-453d-8e50-f4b94028603b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:04.546333 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5520ab32-28e2-453d-8e50-f4b94028603b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:04.554836 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5520ab32-28e2-453d-8e50-f4b94028603b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1186 microversion: 2.1 time: 0.096856 Aug 29 17:01:04.555619 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4310/8400] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:04 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1186 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:05.578954 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4da255c4-2bb4-4f2e-aa45-ec75fb9ef9cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:05.579549 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4da255c4-2bb4-4f2e-aa45-ec75fb9ef9cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:05.596101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4da255c4-2bb4-4f2e-aa45-ec75fb9ef9cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:05.596603 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4da255c4-2bb4-4f2e-aa45-ec75fb9ef9cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:05.597054 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4da255c4-2bb4-4f2e-aa45-ec75fb9ef9cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:05.597791 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4da255c4-2bb4-4f2e-aa45-ec75fb9ef9cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:05.598248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4da255c4-2bb4-4f2e-aa45-ec75fb9ef9cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:05.598663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4da255c4-2bb4-4f2e-aa45-ec75fb9ef9cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:05.762932 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4da255c4-2bb4-4f2e-aa45-ec75fb9ef9cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:05.771113 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4da255c4-2bb4-4f2e-aa45-ec75fb9ef9cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1272 microversion: 2.1 time: 0.196682 Aug 29 17:01:05.771706 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4091/8401] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:05 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:06.046561 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-09258b7c-466c-445b-92c6-61bf84ee0cff req-92673808-736b-446b-b089-163e1c671758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0cbb653-475d-4f40-82e0-64573cbff57b", "tag": "61f96d85-37f2-4a83-aad8-031e7e615b0c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:01:06.058016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-09258b7c-466c-445b-92c6-61bf84ee0cff req-92673808-736b-446b-b089-163e1c671758 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:06.058519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-09258b7c-466c-445b-92c6-61bf84ee0cff req-92673808-736b-446b-b089-163e1c671758 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:06.058972 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-09258b7c-466c-445b-92c6-61bf84ee0cff req-92673808-736b-446b-b089-163e1c671758 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:06.070196 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-09258b7c-466c-445b-92c6-61bf84ee0cff req-92673808-736b-446b-b089-163e1c671758 service nova] Creating event network-changed:61f96d85-37f2-4a83-aad8-031e7e615b0c for instance a0cbb653-475d-4f40-82e0-64573cbff57b on n-h2-839401-11 Aug 29 17:01:06.075519 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-09258b7c-466c-445b-92c6-61bf84ee0cff req-92673808-736b-446b-b089-163e1c671758 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098074 Aug 29 17:01:06.076285 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4311/8402] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:01:06.797889 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d45c7307-9d11-447d-bfa5-3c826cddefc6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:06.799357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d45c7307-9d11-447d-bfa5-3c826cddefc6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:06.811919 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d45c7307-9d11-447d-bfa5-3c826cddefc6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:06.813306 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d45c7307-9d11-447d-bfa5-3c826cddefc6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:06.814419 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d45c7307-9d11-447d-bfa5-3c826cddefc6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:06.815985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d45c7307-9d11-447d-bfa5-3c826cddefc6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:06.816905 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d45c7307-9d11-447d-bfa5-3c826cddefc6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:06.817953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d45c7307-9d11-447d-bfa5-3c826cddefc6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:07.009730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d45c7307-9d11-447d-bfa5-3c826cddefc6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:07.018504 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d45c7307-9d11-447d-bfa5-3c826cddefc6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1272 microversion: 2.1 time: 0.228947 Aug 29 17:01:07.019445 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4092/8403] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:06 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:08.041733 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b5ef9020-e42d-40f5-9e35-3079e018a7b3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:08.042458 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b5ef9020-e42d-40f5-9e35-3079e018a7b3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:08.050039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5ef9020-e42d-40f5-9e35-3079e018a7b3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:08.050573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5ef9020-e42d-40f5-9e35-3079e018a7b3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:08.051051 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5ef9020-e42d-40f5-9e35-3079e018a7b3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:08.051977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5ef9020-e42d-40f5-9e35-3079e018a7b3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:08.052316 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5ef9020-e42d-40f5-9e35-3079e018a7b3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:08.052762 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b5ef9020-e42d-40f5-9e35-3079e018a7b3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:08.213907 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b5ef9020-e42d-40f5-9e35-3079e018a7b3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:08.223606 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b5ef9020-e42d-40f5-9e35-3079e018a7b3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1272 microversion: 2.1 time: 0.187384 Aug 29 17:01:08.224196 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4312/8404] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:08 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:09.246169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b32d540d-1cda-4774-b697-1d063e3bf8e3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:09.246799 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b32d540d-1cda-4774-b697-1d063e3bf8e3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:09.254515 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b32d540d-1cda-4774-b697-1d063e3bf8e3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:09.255219 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b32d540d-1cda-4774-b697-1d063e3bf8e3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:09.255578 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b32d540d-1cda-4774-b697-1d063e3bf8e3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:09.256311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b32d540d-1cda-4774-b697-1d063e3bf8e3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:09.256760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b32d540d-1cda-4774-b697-1d063e3bf8e3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:09.257302 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b32d540d-1cda-4774-b697-1d063e3bf8e3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:09.418685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b32d540d-1cda-4774-b697-1d063e3bf8e3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:09.428373 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b32d540d-1cda-4774-b697-1d063e3bf8e3 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1272 microversion: 2.1 time: 0.186351 Aug 29 17:01:09.428993 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4093/8405] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:09 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:10.451628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d8f399e8-f786-49fa-ba96-73e1c334ae0e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:10.452266 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d8f399e8-f786-49fa-ba96-73e1c334ae0e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:10.459806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8f399e8-f786-49fa-ba96-73e1c334ae0e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:10.460315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8f399e8-f786-49fa-ba96-73e1c334ae0e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:10.460771 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8f399e8-f786-49fa-ba96-73e1c334ae0e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:10.461532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8f399e8-f786-49fa-ba96-73e1c334ae0e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:10.462010 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8f399e8-f786-49fa-ba96-73e1c334ae0e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:10.462453 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d8f399e8-f786-49fa-ba96-73e1c334ae0e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:10.626052 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d8f399e8-f786-49fa-ba96-73e1c334ae0e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:10.635040 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d8f399e8-f786-49fa-ba96-73e1c334ae0e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1260 microversion: 2.1 time: 0.187520 Aug 29 17:01:10.635647 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4313/8406] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:10 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:11.658995 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-be8d6318-38a2-460d-8fa7-1721c0f5ab6c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:11.659620 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-be8d6318-38a2-460d-8fa7-1721c0f5ab6c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:11.667494 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be8d6318-38a2-460d-8fa7-1721c0f5ab6c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:11.668001 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be8d6318-38a2-460d-8fa7-1721c0f5ab6c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:11.668449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be8d6318-38a2-460d-8fa7-1721c0f5ab6c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:11.669202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be8d6318-38a2-460d-8fa7-1721c0f5ab6c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:11.669674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be8d6318-38a2-460d-8fa7-1721c0f5ab6c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:11.670109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-be8d6318-38a2-460d-8fa7-1721c0f5ab6c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:11.818006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-be8d6318-38a2-460d-8fa7-1721c0f5ab6c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:11.829282 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-be8d6318-38a2-460d-8fa7-1721c0f5ab6c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1260 microversion: 2.1 time: 0.175391 Aug 29 17:01:11.829893 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4094/8407] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:11 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:12.855867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5b8130c9-aa4b-4574-931f-afbf22a1184a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:12.857303 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5b8130c9-aa4b-4574-931f-afbf22a1184a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:12.866287 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b8130c9-aa4b-4574-931f-afbf22a1184a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:12.866787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b8130c9-aa4b-4574-931f-afbf22a1184a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:12.867229 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b8130c9-aa4b-4574-931f-afbf22a1184a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:12.867934 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b8130c9-aa4b-4574-931f-afbf22a1184a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:12.868406 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b8130c9-aa4b-4574-931f-afbf22a1184a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:12.868818 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5b8130c9-aa4b-4574-931f-afbf22a1184a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:13.017633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5b8130c9-aa4b-4574-931f-afbf22a1184a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:13.028577 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5b8130c9-aa4b-4574-931f-afbf22a1184a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1260 microversion: 2.1 time: 0.179394 Aug 29 17:01:13.029563 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4314/8408] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:12 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:14.051392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-03336e1d-4e56-4aa0-9a60-26f6cc8bb3ab tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:14.052003 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-03336e1d-4e56-4aa0-9a60-26f6cc8bb3ab tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:14.054804 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:14.060876 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03336e1d-4e56-4aa0-9a60-26f6cc8bb3ab tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:14.061402 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03336e1d-4e56-4aa0-9a60-26f6cc8bb3ab tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:14.061825 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03336e1d-4e56-4aa0-9a60-26f6cc8bb3ab tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:14.062524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03336e1d-4e56-4aa0-9a60-26f6cc8bb3ab tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:14.062978 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03336e1d-4e56-4aa0-9a60-26f6cc8bb3ab tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:14.063400 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-03336e1d-4e56-4aa0-9a60-26f6cc8bb3ab tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:14.233212 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-03336e1d-4e56-4aa0-9a60-26f6cc8bb3ab tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:14.241602 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-03336e1d-4e56-4aa0-9a60-26f6cc8bb3ab tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1260 microversion: 2.1 time: 0.194181 Aug 29 17:01:14.242187 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4095/8409] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:14 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:15.262067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5976befe-ced3-4acb-8f2c-625c45b050dd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:15.262633 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5976befe-ced3-4acb-8f2c-625c45b050dd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:15.264775 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:15.265482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:15.272170 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5976befe-ced3-4acb-8f2c-625c45b050dd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:15.272679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5976befe-ced3-4acb-8f2c-625c45b050dd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:15.273167 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5976befe-ced3-4acb-8f2c-625c45b050dd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:15.273894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5976befe-ced3-4acb-8f2c-625c45b050dd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:15.274381 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5976befe-ced3-4acb-8f2c-625c45b050dd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:15.274810 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5976befe-ced3-4acb-8f2c-625c45b050dd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:15.416976 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5976befe-ced3-4acb-8f2c-625c45b050dd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:15.426028 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5976befe-ced3-4acb-8f2c-625c45b050dd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1260 microversion: 2.1 time: 0.167969 Aug 29 17:01:15.426632 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4315/8410] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:15 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:16.449730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f5496db7-cfc1-484a-a413-b20f24d745cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:16.450536 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f5496db7-cfc1-484a-a413-b20f24d745cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:16.459131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5496db7-cfc1-484a-a413-b20f24d745cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:16.459652 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5496db7-cfc1-484a-a413-b20f24d745cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:16.460087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5496db7-cfc1-484a-a413-b20f24d745cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:16.460790 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5496db7-cfc1-484a-a413-b20f24d745cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:16.461308 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5496db7-cfc1-484a-a413-b20f24d745cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:16.461720 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5496db7-cfc1-484a-a413-b20f24d745cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:16.628359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f5496db7-cfc1-484a-a413-b20f24d745cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:16.638275 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f5496db7-cfc1-484a-a413-b20f24d745cd tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1260 microversion: 2.1 time: 0.194504 Aug 29 17:01:16.638876 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4096/8411] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:16 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:17.661501 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5e6c0000-7d55-449d-86ac-02ae288cce6b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:17.662137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5e6c0000-7d55-449d-86ac-02ae288cce6b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:17.669628 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e6c0000-7d55-449d-86ac-02ae288cce6b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:17.670135 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e6c0000-7d55-449d-86ac-02ae288cce6b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:17.670593 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e6c0000-7d55-449d-86ac-02ae288cce6b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:17.671352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e6c0000-7d55-449d-86ac-02ae288cce6b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:17.671942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e6c0000-7d55-449d-86ac-02ae288cce6b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:17.672395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5e6c0000-7d55-449d-86ac-02ae288cce6b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:17.833355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5e6c0000-7d55-449d-86ac-02ae288cce6b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:17.841798 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5e6c0000-7d55-449d-86ac-02ae288cce6b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1260 microversion: 2.1 time: 0.184550 Aug 29 17:01:17.842390 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4316/8412] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:17 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:18.862956 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9437a788-1c7e-47f6-a132-8d6d120ef813 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:18.863785 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9437a788-1c7e-47f6-a132-8d6d120ef813 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:18.871775 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9437a788-1c7e-47f6-a132-8d6d120ef813 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:18.872265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9437a788-1c7e-47f6-a132-8d6d120ef813 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:18.872752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9437a788-1c7e-47f6-a132-8d6d120ef813 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:18.873495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9437a788-1c7e-47f6-a132-8d6d120ef813 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:18.873947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9437a788-1c7e-47f6-a132-8d6d120ef813 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:18.874366 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9437a788-1c7e-47f6-a132-8d6d120ef813 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:19.016449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9437a788-1c7e-47f6-a132-8d6d120ef813 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:19.024708 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9437a788-1c7e-47f6-a132-8d6d120ef813 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1260 microversion: 2.1 time: 0.165884 Aug 29 17:01:19.025326 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4097/8413] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:18 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:20.045977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-dd5edcb7-d250-465b-ab76-77cd8179b6bb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:20.046631 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-dd5edcb7-d250-465b-ab76-77cd8179b6bb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:20.054168 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd5edcb7-d250-465b-ab76-77cd8179b6bb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:20.054675 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd5edcb7-d250-465b-ab76-77cd8179b6bb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:20.055131 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd5edcb7-d250-465b-ab76-77cd8179b6bb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:20.055851 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd5edcb7-d250-465b-ab76-77cd8179b6bb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:20.056653 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd5edcb7-d250-465b-ab76-77cd8179b6bb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:20.057122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-dd5edcb7-d250-465b-ab76-77cd8179b6bb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:20.199235 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-dd5edcb7-d250-465b-ab76-77cd8179b6bb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:20.208182 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-dd5edcb7-d250-465b-ab76-77cd8179b6bb tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1260 microversion: 2.1 time: 0.166262 Aug 29 17:01:20.208781 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4317/8414] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:20 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:21.228466 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-c43263b1-cc47-4ef7-860d-16d462f5df6d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:21.229110 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-c43263b1-cc47-4ef7-860d-16d462f5df6d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:21.237483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c43263b1-cc47-4ef7-860d-16d462f5df6d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:21.237974 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c43263b1-cc47-4ef7-860d-16d462f5df6d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:21.238404 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c43263b1-cc47-4ef7-860d-16d462f5df6d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:21.239099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c43263b1-cc47-4ef7-860d-16d462f5df6d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:21.239560 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c43263b1-cc47-4ef7-860d-16d462f5df6d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:21.239971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-c43263b1-cc47-4ef7-860d-16d462f5df6d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:21.382121 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-c43263b1-cc47-4ef7-860d-16d462f5df6d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:21.390423 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-c43263b1-cc47-4ef7-860d-16d462f5df6d tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1260 microversion: 2.1 time: 0.166078 Aug 29 17:01:21.391016 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4098/8415] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:21 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:21.686130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-4c5815c0-6ba5-48ca-bd93-d3079cb5695a req-a838c92a-361c-4c2b-b8b2-71e6b1e041f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0cbb653-475d-4f40-82e0-64573cbff57b", "name": "network-vif-plugged", "status": "completed", "tag": "61f96d85-37f2-4a83-aad8-031e7e615b0c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:01:21.697044 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4c5815c0-6ba5-48ca-bd93-d3079cb5695a req-a838c92a-361c-4c2b-b8b2-71e6b1e041f8 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:21.697577 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4c5815c0-6ba5-48ca-bd93-d3079cb5695a req-a838c92a-361c-4c2b-b8b2-71e6b1e041f8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:21.698028 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-4c5815c0-6ba5-48ca-bd93-d3079cb5695a req-a838c92a-361c-4c2b-b8b2-71e6b1e041f8 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:21.710133 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-4c5815c0-6ba5-48ca-bd93-d3079cb5695a req-a838c92a-361c-4c2b-b8b2-71e6b1e041f8 service nova] Creating event network-vif-plugged:61f96d85-37f2-4a83-aad8-031e7e615b0c for instance a0cbb653-475d-4f40-82e0-64573cbff57b on n-h2-839401-11 Aug 29 17:01:21.715375 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-4c5815c0-6ba5-48ca-bd93-d3079cb5695a req-a838c92a-361c-4c2b-b8b2-71e6b1e041f8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088708 Aug 29 17:01:21.716000 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4318/8416] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:01:22.412015 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-88d79072-af2c-4763-bbb4-a2e1e28fc1f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:22.412625 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-88d79072-af2c-4763-bbb4-a2e1e28fc1f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:22.420182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d79072-af2c-4763-bbb4-a2e1e28fc1f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:22.420685 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d79072-af2c-4763-bbb4-a2e1e28fc1f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:22.421133 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d79072-af2c-4763-bbb4-a2e1e28fc1f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:22.421850 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d79072-af2c-4763-bbb4-a2e1e28fc1f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:22.422335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d79072-af2c-4763-bbb4-a2e1e28fc1f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:22.422768 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-88d79072-af2c-4763-bbb4-a2e1e28fc1f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:22.563981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-88d79072-af2c-4763-bbb4-a2e1e28fc1f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:22.572131 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-88d79072-af2c-4763-bbb4-a2e1e28fc1f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1260 microversion: 2.1 time: 0.164173 Aug 29 17:01:22.572728 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4099/8417] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:22 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:23.595482 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c3247e3b-d2df-4094-93d5-1eabc2cb271a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:23.596255 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c3247e3b-d2df-4094-93d5-1eabc2cb271a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:23.603011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3247e3b-d2df-4094-93d5-1eabc2cb271a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:23.603503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3247e3b-d2df-4094-93d5-1eabc2cb271a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:23.603952 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3247e3b-d2df-4094-93d5-1eabc2cb271a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:23.604658 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3247e3b-d2df-4094-93d5-1eabc2cb271a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:23.605139 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3247e3b-d2df-4094-93d5-1eabc2cb271a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:23.605595 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c3247e3b-d2df-4094-93d5-1eabc2cb271a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:23.756710 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c3247e3b-d2df-4094-93d5-1eabc2cb271a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:23.766480 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c3247e3b-d2df-4094-93d5-1eabc2cb271a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1442 microversion: 2.1 time: 0.176923 Aug 29 17:01:23.767189 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4319/8418] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:23 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1442 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:23.787227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f5971694-667b-419b-a9bf-deb985f680f0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:23.787828 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f5971694-667b-419b-a9bf-deb985f680f0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:23.795151 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5971694-667b-419b-a9bf-deb985f680f0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:23.795636 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5971694-667b-419b-a9bf-deb985f680f0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:23.796136 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5971694-667b-419b-a9bf-deb985f680f0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:23.796797 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5971694-667b-419b-a9bf-deb985f680f0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:23.797304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5971694-667b-419b-a9bf-deb985f680f0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:23.797739 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f5971694-667b-419b-a9bf-deb985f680f0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:23.955874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f5971694-667b-419b-a9bf-deb985f680f0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:23.966783 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f5971694-667b-419b-a9bf-deb985f680f0 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1442 microversion: 2.1 time: 0.183488 Aug 29 17:01:23.967338 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4100/8419] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:23 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1442 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:26.086031 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-8da0895e-e812-435a-93fb-d3eddfbb943e req-b646ae0b-74b0-4c01-9586-11f2095284cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0cbb653-475d-4f40-82e0-64573cbff57b", "tag": "61f96d85-37f2-4a83-aad8-031e7e615b0c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:01:26.097794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8da0895e-e812-435a-93fb-d3eddfbb943e req-b646ae0b-74b0-4c01-9586-11f2095284cf service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:26.098352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8da0895e-e812-435a-93fb-d3eddfbb943e req-b646ae0b-74b0-4c01-9586-11f2095284cf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:26.098757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-8da0895e-e812-435a-93fb-d3eddfbb943e req-b646ae0b-74b0-4c01-9586-11f2095284cf service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:26.111437 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-8da0895e-e812-435a-93fb-d3eddfbb943e req-b646ae0b-74b0-4c01-9586-11f2095284cf service nova] Creating event network-changed:61f96d85-37f2-4a83-aad8-031e7e615b0c for instance a0cbb653-475d-4f40-82e0-64573cbff57b on n-h2-839401-11 Aug 29 17:01:26.117051 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-8da0895e-e812-435a-93fb-d3eddfbb943e req-b646ae0b-74b0-4c01-9586-11f2095284cf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035178 Aug 29 17:01:26.118101 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4320/8420] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:03:22.442426 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eda7f439-560f-4fda-a0c4-47b93d5f6cfd] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 17:03:22.443597 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [-] [564df600-0953-4421-a68a-24b5a0a40919] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 17:03:22.444253 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=24 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:03:22.445030 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=60 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:03:22.446266 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 17:03:22.446447 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 17:03:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b/action (ip 10.222.0.62) !!! Aug 29 17:03:22.448792 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 17:03:22.448997 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 17:03:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b/action (ip 10.222.0.62) !!! Aug 29 17:03:22.460399 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7ea5c396-6f7c-4d52-b1da-177f634dfbce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:03:22.460948 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7ea5c396-6f7c-4d52-b1da-177f634dfbce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:22.474503 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ea5c396-6f7c-4d52-b1da-177f634dfbce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:22.475006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ea5c396-6f7c-4d52-b1da-177f634dfbce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:22.475462 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ea5c396-6f7c-4d52-b1da-177f634dfbce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:22.476197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ea5c396-6f7c-4d52-b1da-177f634dfbce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:22.476670 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ea5c396-6f7c-4d52-b1da-177f634dfbce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:22.477109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7ea5c396-6f7c-4d52-b1da-177f634dfbce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:22.502555 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.objects.instance [None req-7ea5c396-6f7c-4d52-b1da-177f634dfbce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lazy-loading 'flavor' on Instance uuid a0cbb653-475d-4f40-82e0-64573cbff57b {{(pid=122361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 17:03:22.585602 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7ea5c396-6f7c-4d52-b1da-177f634dfbce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "POST /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b/action" status: 202 len: 0 microversion: 2.1 time: 0.144847 Aug 29 17:03:22.586302 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4101/8421] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 17:03:22 2022] POST /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 17:03:22.593712 n-d-839401-11 devstack@n-api.service[122360]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edb16f3c-d8bd-4396-8d00-d7897b8393bf] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 17:03:22.594639 n-d-839401-11 devstack@n-api.service[122360]: ERROR oslo.messaging._drivers.impl_rabbit [-] [603d2cc2-3ad6-4419-8622-2fba015025b5] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 17:03:22.595262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:03:22.596030 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=56 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:03:22.597957 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 17:03:22.598135 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 17:03:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b (ip 10.222.0.62) !!! Aug 29 17:03:22.603387 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-33a8f823-5956-4792-bdb6-53fbf1cb3893 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:22.604223 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-33a8f823-5956-4792-bdb6-53fbf1cb3893 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:22.623363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33a8f823-5956-4792-bdb6-53fbf1cb3893 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:22.624158 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33a8f823-5956-4792-bdb6-53fbf1cb3893 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:22.624621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33a8f823-5956-4792-bdb6-53fbf1cb3893 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:22.625398 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33a8f823-5956-4792-bdb6-53fbf1cb3893 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:22.625939 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33a8f823-5956-4792-bdb6-53fbf1cb3893 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:22.626519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-33a8f823-5956-4792-bdb6-53fbf1cb3893 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:22.787725 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-33a8f823-5956-4792-bdb6-53fbf1cb3893 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:22.798204 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-33a8f823-5956-4792-bdb6-53fbf1cb3893 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1566 microversion: 2.1 time: 0.206726 Aug 29 17:03:22.798897 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4321/8422] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:22 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1566 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:23.824730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-00cf8c9e-d3fe-4652-92f1-5e96a186d393 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:23.825464 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-00cf8c9e-d3fe-4652-92f1-5e96a186d393 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:23.834808 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00cf8c9e-d3fe-4652-92f1-5e96a186d393 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:23.835314 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00cf8c9e-d3fe-4652-92f1-5e96a186d393 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:23.835759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00cf8c9e-d3fe-4652-92f1-5e96a186d393 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:23.836485 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00cf8c9e-d3fe-4652-92f1-5e96a186d393 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:23.836957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00cf8c9e-d3fe-4652-92f1-5e96a186d393 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:23.837416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-00cf8c9e-d3fe-4652-92f1-5e96a186d393 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:23.843198 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] [564df600-0953-4421-a68a-24b5a0a40919] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 43896. Aug 29 17:03:23.843954 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] [eda7f439-560f-4fda-a0c4-47b93d5f6cfd] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 43894. Aug 29 17:03:24.005787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-00cf8c9e-d3fe-4652-92f1-5e96a186d393 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:24.014299 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-00cf8c9e-d3fe-4652-92f1-5e96a186d393 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1566 microversion: 2.1 time: 0.197246 Aug 29 17:03:24.014919 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4102/8423] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:23 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:25.038786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f102d3e6-cd15-47e8-bc4f-eac348af8d33 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:25.039622 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f102d3e6-cd15-47e8-bc4f-eac348af8d33 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:25.058164 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f102d3e6-cd15-47e8-bc4f-eac348af8d33 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:25.058673 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f102d3e6-cd15-47e8-bc4f-eac348af8d33 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:25.059126 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f102d3e6-cd15-47e8-bc4f-eac348af8d33 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:25.059855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f102d3e6-cd15-47e8-bc4f-eac348af8d33 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:25.060322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f102d3e6-cd15-47e8-bc4f-eac348af8d33 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:25.060787 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f102d3e6-cd15-47e8-bc4f-eac348af8d33 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:25.061475 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] [edb16f3c-d8bd-4396-8d00-d7897b8393bf] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 43902. Aug 29 17:03:25.065491 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] [603d2cc2-3ad6-4419-8622-2fba015025b5] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 43904. Aug 29 17:03:25.223843 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f102d3e6-cd15-47e8-bc4f-eac348af8d33 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:25.234922 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f102d3e6-cd15-47e8-bc4f-eac348af8d33 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1566 microversion: 2.1 time: 0.200352 Aug 29 17:03:25.235522 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4322/8424] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:25 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 17:03:26.260651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ec62974a-071b-4c64-b234-8082b8b9d503 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:26.261264 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ec62974a-071b-4c64-b234-8082b8b9d503 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:26.268861 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec62974a-071b-4c64-b234-8082b8b9d503 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:26.269375 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec62974a-071b-4c64-b234-8082b8b9d503 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:26.269811 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec62974a-071b-4c64-b234-8082b8b9d503 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:26.270511 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec62974a-071b-4c64-b234-8082b8b9d503 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:26.270966 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec62974a-071b-4c64-b234-8082b8b9d503 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:26.271392 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec62974a-071b-4c64-b234-8082b8b9d503 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:26.417537 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ec62974a-071b-4c64-b234-8082b8b9d503 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:26.426219 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ec62974a-071b-4c64-b234-8082b8b9d503 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1566 microversion: 2.1 time: 0.171224 Aug 29 17:03:26.426782 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4103/8425] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:26 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:27.447484 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ee417395-d585-46d8-a094-99d360bcdb4b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:27.448129 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ee417395-d585-46d8-a094-99d360bcdb4b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:27.455951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee417395-d585-46d8-a094-99d360bcdb4b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:27.456483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee417395-d585-46d8-a094-99d360bcdb4b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:27.456943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee417395-d585-46d8-a094-99d360bcdb4b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:27.457722 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee417395-d585-46d8-a094-99d360bcdb4b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:27.458201 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee417395-d585-46d8-a094-99d360bcdb4b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:27.458646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ee417395-d585-46d8-a094-99d360bcdb4b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:27.613149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ee417395-d585-46d8-a094-99d360bcdb4b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:27.622049 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ee417395-d585-46d8-a094-99d360bcdb4b tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1566 microversion: 2.1 time: 0.178607 Aug 29 17:03:27.622646 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4323/8426] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:27 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:28.644566 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-f04e3fff-4d04-460f-9f91-1c9e3017ddce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:28.645342 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-f04e3fff-4d04-460f-9f91-1c9e3017ddce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:28.652869 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f04e3fff-4d04-460f-9f91-1c9e3017ddce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:28.653380 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f04e3fff-4d04-460f-9f91-1c9e3017ddce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:28.653851 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f04e3fff-4d04-460f-9f91-1c9e3017ddce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:28.654572 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f04e3fff-4d04-460f-9f91-1c9e3017ddce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:28.655034 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f04e3fff-4d04-460f-9f91-1c9e3017ddce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:28.655469 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-f04e3fff-4d04-460f-9f91-1c9e3017ddce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:28.812643 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-f04e3fff-4d04-460f-9f91-1c9e3017ddce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:28.821503 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-f04e3fff-4d04-460f-9f91-1c9e3017ddce tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1566 microversion: 2.1 time: 0.180910 Aug 29 17:03:28.822163 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4104/8427] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:28 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:29.843533 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-77e22722-2d59-4d49-acf7-1f311a2c4fe4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:29.844747 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-77e22722-2d59-4d49-acf7-1f311a2c4fe4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:29.854643 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77e22722-2d59-4d49-acf7-1f311a2c4fe4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:29.855348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77e22722-2d59-4d49-acf7-1f311a2c4fe4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:29.856001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77e22722-2d59-4d49-acf7-1f311a2c4fe4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:29.857054 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77e22722-2d59-4d49-acf7-1f311a2c4fe4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:29.857709 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77e22722-2d59-4d49-acf7-1f311a2c4fe4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:29.858265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-77e22722-2d59-4d49-acf7-1f311a2c4fe4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:30.013485 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-77e22722-2d59-4d49-acf7-1f311a2c4fe4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:30.022578 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-77e22722-2d59-4d49-acf7-1f311a2c4fe4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1566 microversion: 2.1 time: 0.183343 Aug 29 17:03:30.023205 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4324/8428] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:29 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:31.044777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-02fd3fbd-5437-46eb-ae34-d396dcc9e518 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:31.045470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-02fd3fbd-5437-46eb-ae34-d396dcc9e518 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:31.053283 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02fd3fbd-5437-46eb-ae34-d396dcc9e518 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:31.053806 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02fd3fbd-5437-46eb-ae34-d396dcc9e518 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:31.054244 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02fd3fbd-5437-46eb-ae34-d396dcc9e518 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:31.055312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02fd3fbd-5437-46eb-ae34-d396dcc9e518 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:31.055748 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02fd3fbd-5437-46eb-ae34-d396dcc9e518 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:31.056205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-02fd3fbd-5437-46eb-ae34-d396dcc9e518 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:31.198718 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-02fd3fbd-5437-46eb-ae34-d396dcc9e518 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:31.207486 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-02fd3fbd-5437-46eb-ae34-d396dcc9e518 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1566 microversion: 2.1 time: 0.166628 Aug 29 17:03:31.208113 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4105/8429] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:31 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:32.230348 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5ce9004f-4cd1-4e98-868a-71cefc2aabba tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:32.232006 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5ce9004f-4cd1-4e98-868a-71cefc2aabba tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:32.239757 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce9004f-4cd1-4e98-868a-71cefc2aabba tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:32.240261 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce9004f-4cd1-4e98-868a-71cefc2aabba tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:32.240704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce9004f-4cd1-4e98-868a-71cefc2aabba tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:32.241503 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce9004f-4cd1-4e98-868a-71cefc2aabba tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:32.241962 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce9004f-4cd1-4e98-868a-71cefc2aabba tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:32.242389 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5ce9004f-4cd1-4e98-868a-71cefc2aabba tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:32.411911 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5ce9004f-4cd1-4e98-868a-71cefc2aabba tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:32.420321 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5ce9004f-4cd1-4e98-868a-71cefc2aabba tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1566 microversion: 2.1 time: 0.194093 Aug 29 17:03:32.420915 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4325/8430] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:32 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:33.446238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7b63719c-fb94-4726-a877-f83f6c81ed25 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:33.447220 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7b63719c-fb94-4726-a877-f83f6c81ed25 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:33.459023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b63719c-fb94-4726-a877-f83f6c81ed25 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:33.459741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b63719c-fb94-4726-a877-f83f6c81ed25 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:33.460470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b63719c-fb94-4726-a877-f83f6c81ed25 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:33.461634 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b63719c-fb94-4726-a877-f83f6c81ed25 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:33.462272 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b63719c-fb94-4726-a877-f83f6c81ed25 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:33.462971 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7b63719c-fb94-4726-a877-f83f6c81ed25 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:33.630014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7b63719c-fb94-4726-a877-f83f6c81ed25 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:33.639187 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7b63719c-fb94-4726-a877-f83f6c81ed25 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1566 microversion: 2.1 time: 0.199185 Aug 29 17:03:33.639801 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4106/8431] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:33 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:34.664904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-86135b74-6b2b-425d-b0b4-67cce4e3f79c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:34.666003 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-86135b74-6b2b-425d-b0b4-67cce4e3f79c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:34.676671 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86135b74-6b2b-425d-b0b4-67cce4e3f79c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:34.677212 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86135b74-6b2b-425d-b0b4-67cce4e3f79c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:34.677670 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86135b74-6b2b-425d-b0b4-67cce4e3f79c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:34.678393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86135b74-6b2b-425d-b0b4-67cce4e3f79c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:34.678871 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86135b74-6b2b-425d-b0b4-67cce4e3f79c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:34.679315 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-86135b74-6b2b-425d-b0b4-67cce4e3f79c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:34.828919 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-86135b74-6b2b-425d-b0b4-67cce4e3f79c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:34.837804 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-86135b74-6b2b-425d-b0b4-67cce4e3f79c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1566 microversion: 2.1 time: 0.180089 Aug 29 17:03:34.838435 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4326/8432] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:34 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:35.858452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b3da1829-2620-417a-9f79-4d880d5ac3f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:35.859028 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b3da1829-2620-417a-9f79-4d880d5ac3f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:35.866990 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3da1829-2620-417a-9f79-4d880d5ac3f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:35.867595 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3da1829-2620-417a-9f79-4d880d5ac3f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:35.868048 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3da1829-2620-417a-9f79-4d880d5ac3f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:35.868770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3da1829-2620-417a-9f79-4d880d5ac3f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:35.869316 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3da1829-2620-417a-9f79-4d880d5ac3f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:35.869706 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b3da1829-2620-417a-9f79-4d880d5ac3f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:36.013440 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b3da1829-2620-417a-9f79-4d880d5ac3f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:36.022335 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b3da1829-2620-417a-9f79-4d880d5ac3f6 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1566 microversion: 2.1 time: 0.167865 Aug 29 17:03:36.022920 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4107/8433] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:35 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:37.044358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5728ea1a-651f-4665-978f-70ff709a7c32 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:37.045241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5728ea1a-651f-4665-978f-70ff709a7c32 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:37.052665 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5728ea1a-651f-4665-978f-70ff709a7c32 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:37.053203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5728ea1a-651f-4665-978f-70ff709a7c32 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:37.053744 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5728ea1a-651f-4665-978f-70ff709a7c32 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:37.054825 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5728ea1a-651f-4665-978f-70ff709a7c32 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:37.055295 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5728ea1a-651f-4665-978f-70ff709a7c32 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:37.055766 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5728ea1a-651f-4665-978f-70ff709a7c32 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:37.201072 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5728ea1a-651f-4665-978f-70ff709a7c32 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:37.209742 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5728ea1a-651f-4665-978f-70ff709a7c32 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1567 microversion: 2.1 time: 0.169322 Aug 29 17:03:37.210343 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4327/8434] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:37 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:37.230157 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-72d52e0e-fb2b-421c-b904-62258b8097f2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:03:37.230763 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-72d52e0e-fb2b-421c-b904-62258b8097f2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:37.238222 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72d52e0e-fb2b-421c-b904-62258b8097f2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:37.238708 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72d52e0e-fb2b-421c-b904-62258b8097f2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:37.239152 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72d52e0e-fb2b-421c-b904-62258b8097f2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:37.239867 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72d52e0e-fb2b-421c-b904-62258b8097f2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:37.240329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72d52e0e-fb2b-421c-b904-62258b8097f2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:37.240762 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-72d52e0e-fb2b-421c-b904-62258b8097f2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:37.273795 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-72d52e0e-fb2b-421c-b904-62258b8097f2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122361) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 17:03:37.345257 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-72d52e0e-fb2b-421c-b904-62258b8097f2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "POST /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b/action" status: 202 len: 0 microversion: 2.1 time: 0.119141 Aug 29 17:03:37.346098 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4108/8435] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 17:03:37 2022] POST /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 17:03:37.354401 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e3894f91-9a53-4d67-8390-10b26d9dcdde tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:37.355034 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e3894f91-9a53-4d67-8390-10b26d9dcdde tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:37.362117 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3894f91-9a53-4d67-8390-10b26d9dcdde tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:37.362634 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3894f91-9a53-4d67-8390-10b26d9dcdde tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:37.363093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3894f91-9a53-4d67-8390-10b26d9dcdde tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:37.363819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3894f91-9a53-4d67-8390-10b26d9dcdde tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:37.364301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3894f91-9a53-4d67-8390-10b26d9dcdde tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:37.364749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3894f91-9a53-4d67-8390-10b26d9dcdde tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:37.515819 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e3894f91-9a53-4d67-8390-10b26d9dcdde tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:37.527574 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e3894f91-9a53-4d67-8390-10b26d9dcdde tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1575 microversion: 2.1 time: 0.177034 Aug 29 17:03:37.533140 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4328/8436] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:37 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:38.143513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-ad9514e2-5fd2-43d8-beaf-2125fe0ead71 req-81271fb9-849f-4e3d-91f4-eaf51dcd5296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0cbb653-475d-4f40-82e0-64573cbff57b", "name": "network-vif-unplugged", "status": "completed", "tag": "61f96d85-37f2-4a83-aad8-031e7e615b0c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:03:38.154805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ad9514e2-5fd2-43d8-beaf-2125fe0ead71 req-81271fb9-849f-4e3d-91f4-eaf51dcd5296 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:38.155411 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ad9514e2-5fd2-43d8-beaf-2125fe0ead71 req-81271fb9-849f-4e3d-91f4-eaf51dcd5296 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:38.155735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ad9514e2-5fd2-43d8-beaf-2125fe0ead71 req-81271fb9-849f-4e3d-91f4-eaf51dcd5296 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:38.168438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.compute.server_external_events [req-ad9514e2-5fd2-43d8-beaf-2125fe0ead71 req-81271fb9-849f-4e3d-91f4-eaf51dcd5296 service nova] Unable to find a host for instance a0cbb653-475d-4f40-82e0-64573cbff57b. Dropping event network-vif-unplugged {{(pid=122361) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 17:03:38.169405 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-ad9514e2-5fd2-43d8-beaf-2125fe0ead71 req-81271fb9-849f-4e3d-91f4-eaf51dcd5296 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029874 Aug 29 17:03:38.170014 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4109/8437] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 17:03:38.549451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-84aba45d-c029-42e2-802f-3e5352907444 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:38.550238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-84aba45d-c029-42e2-802f-3e5352907444 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:38.558125 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84aba45d-c029-42e2-802f-3e5352907444 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:38.558635 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84aba45d-c029-42e2-802f-3e5352907444 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:38.559093 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84aba45d-c029-42e2-802f-3e5352907444 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:38.559831 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84aba45d-c029-42e2-802f-3e5352907444 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:38.560346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84aba45d-c029-42e2-802f-3e5352907444 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:38.560794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-84aba45d-c029-42e2-802f-3e5352907444 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:38.702155 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-84aba45d-c029-42e2-802f-3e5352907444 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:38.710475 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-84aba45d-c029-42e2-802f-3e5352907444 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1517 microversion: 2.1 time: 0.165149 Aug 29 17:03:38.711074 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4329/8438] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:38 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:39.732194 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a57c1da5-4a65-456d-a2c7-47007ff5a05e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:39.732977 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a57c1da5-4a65-456d-a2c7-47007ff5a05e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:39.741135 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a57c1da5-4a65-456d-a2c7-47007ff5a05e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:39.741644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a57c1da5-4a65-456d-a2c7-47007ff5a05e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:39.742088 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a57c1da5-4a65-456d-a2c7-47007ff5a05e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:39.742796 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a57c1da5-4a65-456d-a2c7-47007ff5a05e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:39.743248 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a57c1da5-4a65-456d-a2c7-47007ff5a05e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:39.743674 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a57c1da5-4a65-456d-a2c7-47007ff5a05e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:39.899894 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a57c1da5-4a65-456d-a2c7-47007ff5a05e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:39.908697 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a57c1da5-4a65-456d-a2c7-47007ff5a05e tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1517 microversion: 2.1 time: 0.180429 Aug 29 17:03:39.909370 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4110/8439] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:39 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:40.933122 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4bf8c9b1-04f1-435f-99bc-b0ce14b23902 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:40.934153 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4bf8c9b1-04f1-435f-99bc-b0ce14b23902 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:40.941759 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bf8c9b1-04f1-435f-99bc-b0ce14b23902 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:40.942281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bf8c9b1-04f1-435f-99bc-b0ce14b23902 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:40.943642 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bf8c9b1-04f1-435f-99bc-b0ce14b23902 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:40.944980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bf8c9b1-04f1-435f-99bc-b0ce14b23902 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:40.945497 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bf8c9b1-04f1-435f-99bc-b0ce14b23902 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:40.945945 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4bf8c9b1-04f1-435f-99bc-b0ce14b23902 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:41.101477 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4bf8c9b1-04f1-435f-99bc-b0ce14b23902 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:41.109811 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4bf8c9b1-04f1-435f-99bc-b0ce14b23902 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1517 microversion: 2.1 time: 0.182267 Aug 29 17:03:41.110576 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4330/8440] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:40 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:42.132018 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-73a4edda-90c6-4283-b9a8-15cb008d40a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:42.132656 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-73a4edda-90c6-4283-b9a8-15cb008d40a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:42.139988 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73a4edda-90c6-4283-b9a8-15cb008d40a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:42.140483 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73a4edda-90c6-4283-b9a8-15cb008d40a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:42.140903 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73a4edda-90c6-4283-b9a8-15cb008d40a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:42.141660 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73a4edda-90c6-4283-b9a8-15cb008d40a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:42.142117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73a4edda-90c6-4283-b9a8-15cb008d40a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:42.142543 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-73a4edda-90c6-4283-b9a8-15cb008d40a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:42.302408 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-73a4edda-90c6-4283-b9a8-15cb008d40a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:42.311431 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-73a4edda-90c6-4283-b9a8-15cb008d40a5 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1517 microversion: 2.1 time: 0.183366 Aug 29 17:03:42.312139 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4111/8441] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:42 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:43.332500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fe60822d-f8de-44ef-aab1-e7097586c03f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:43.333302 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fe60822d-f8de-44ef-aab1-e7097586c03f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:43.341343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe60822d-f8de-44ef-aab1-e7097586c03f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:43.342077 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe60822d-f8de-44ef-aab1-e7097586c03f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:43.342690 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe60822d-f8de-44ef-aab1-e7097586c03f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:43.343262 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe60822d-f8de-44ef-aab1-e7097586c03f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:43.343794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe60822d-f8de-44ef-aab1-e7097586c03f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:43.344220 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fe60822d-f8de-44ef-aab1-e7097586c03f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:43.504848 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fe60822d-f8de-44ef-aab1-e7097586c03f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:43.513937 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fe60822d-f8de-44ef-aab1-e7097586c03f tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1573 microversion: 2.1 time: 0.185750 Aug 29 17:03:43.514526 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4331/8442] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:43 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1573 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:44.535949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ae13e586-24d6-4c1b-b34e-b677abf2a344 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:44.536571 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ae13e586-24d6-4c1b-b34e-b677abf2a344 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:44.544103 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae13e586-24d6-4c1b-b34e-b677abf2a344 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:44.544611 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae13e586-24d6-4c1b-b34e-b677abf2a344 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:44.545292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae13e586-24d6-4c1b-b34e-b677abf2a344 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:44.546001 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae13e586-24d6-4c1b-b34e-b677abf2a344 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:44.546473 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae13e586-24d6-4c1b-b34e-b677abf2a344 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:44.547109 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ae13e586-24d6-4c1b-b34e-b677abf2a344 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:44.566324 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b9c3819d-d570-4d04-b31e-e0af19166ba4 req-bf062346-5b03-409a-9fc8-058b2c65cd33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0cbb653-475d-4f40-82e0-64573cbff57b", "tag": "61f96d85-37f2-4a83-aad8-031e7e615b0c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:03:44.576688 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b9c3819d-d570-4d04-b31e-e0af19166ba4 req-bf062346-5b03-409a-9fc8-058b2c65cd33 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:44.577197 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b9c3819d-d570-4d04-b31e-e0af19166ba4 req-bf062346-5b03-409a-9fc8-058b2c65cd33 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:44.577637 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b9c3819d-d570-4d04-b31e-e0af19166ba4 req-bf062346-5b03-409a-9fc8-058b2c65cd33 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:44.589582 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b9c3819d-d570-4d04-b31e-e0af19166ba4 req-bf062346-5b03-409a-9fc8-058b2c65cd33 service nova] Creating event network-changed:61f96d85-37f2-4a83-aad8-031e7e615b0c for instance a0cbb653-475d-4f40-82e0-64573cbff57b on n-h1-839401-11 Aug 29 17:03:44.596062 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b9c3819d-d570-4d04-b31e-e0af19166ba4 req-bf062346-5b03-409a-9fc8-058b2c65cd33 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092454 Aug 29 17:03:44.596783 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4112/8443] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:03:44.694343 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ae13e586-24d6-4c1b-b34e-b677abf2a344 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:44.702886 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ae13e586-24d6-4c1b-b34e-b677abf2a344 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1573 microversion: 2.1 time: 0.170860 Aug 29 17:03:44.703688 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4332/8444] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:44 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 17:03:45.733184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d5a77f33-2be1-44e0-98d7-6298192254ea tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:45.734359 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d5a77f33-2be1-44e0-98d7-6298192254ea tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:45.742032 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5a77f33-2be1-44e0-98d7-6298192254ea tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:45.742513 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5a77f33-2be1-44e0-98d7-6298192254ea tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:45.742947 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5a77f33-2be1-44e0-98d7-6298192254ea tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:45.743624 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5a77f33-2be1-44e0-98d7-6298192254ea tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:45.744368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5a77f33-2be1-44e0-98d7-6298192254ea tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:45.744704 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d5a77f33-2be1-44e0-98d7-6298192254ea tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:45.899678 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d5a77f33-2be1-44e0-98d7-6298192254ea tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:45.912086 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d5a77f33-2be1-44e0-98d7-6298192254ea tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1573 microversion: 2.1 time: 0.187433 Aug 29 17:03:45.912880 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4113/8445] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:45 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1573 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:46.943746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-d157f99b-6137-435e-b70e-c28f18613822 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:46.944549 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-d157f99b-6137-435e-b70e-c28f18613822 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:46.952982 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d157f99b-6137-435e-b70e-c28f18613822 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:46.953703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d157f99b-6137-435e-b70e-c28f18613822 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:46.954281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d157f99b-6137-435e-b70e-c28f18613822 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:46.955181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d157f99b-6137-435e-b70e-c28f18613822 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:46.955781 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d157f99b-6137-435e-b70e-c28f18613822 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:46.956346 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-d157f99b-6137-435e-b70e-c28f18613822 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:47.103179 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-d157f99b-6137-435e-b70e-c28f18613822 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:47.111299 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-d157f99b-6137-435e-b70e-c28f18613822 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1573 microversion: 2.1 time: 0.174781 Aug 29 17:03:47.111892 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4333/8446] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:46 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1573 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:48.134583 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-4bb1011f-330b-478f-a122-859c89c0962a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:48.135199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-4bb1011f-330b-478f-a122-859c89c0962a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:48.142972 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bb1011f-330b-478f-a122-859c89c0962a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:48.143590 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bb1011f-330b-478f-a122-859c89c0962a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:48.144037 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bb1011f-330b-478f-a122-859c89c0962a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:48.144767 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bb1011f-330b-478f-a122-859c89c0962a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:48.145257 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bb1011f-330b-478f-a122-859c89c0962a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:48.145697 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-4bb1011f-330b-478f-a122-859c89c0962a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:48.297985 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-4bb1011f-330b-478f-a122-859c89c0962a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:48.306691 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-4bb1011f-330b-478f-a122-859c89c0962a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1573 microversion: 2.1 time: 0.177143 Aug 29 17:03:48.307304 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4114/8447] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:48 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1573 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:49.328615 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f7645b44-8fb9-4059-a27f-691d913ae4a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:49.329267 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f7645b44-8fb9-4059-a27f-691d913ae4a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:49.336942 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7645b44-8fb9-4059-a27f-691d913ae4a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:49.337483 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7645b44-8fb9-4059-a27f-691d913ae4a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:49.337931 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7645b44-8fb9-4059-a27f-691d913ae4a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:49.338765 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7645b44-8fb9-4059-a27f-691d913ae4a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:49.339234 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7645b44-8fb9-4059-a27f-691d913ae4a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:49.339833 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f7645b44-8fb9-4059-a27f-691d913ae4a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:49.489433 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f7645b44-8fb9-4059-a27f-691d913ae4a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:49.499904 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f7645b44-8fb9-4059-a27f-691d913ae4a4 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1573 microversion: 2.1 time: 0.175269 Aug 29 17:03:49.500834 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4334/8448] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:49 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:50.526295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-fff5021f-7931-47cb-8fff-bd022ad04c95 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:50.526965 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-fff5021f-7931-47cb-8fff-bd022ad04c95 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:50.534386 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff5021f-7931-47cb-8fff-bd022ad04c95 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:50.534871 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff5021f-7931-47cb-8fff-bd022ad04c95 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:50.535303 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff5021f-7931-47cb-8fff-bd022ad04c95 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:50.535998 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff5021f-7931-47cb-8fff-bd022ad04c95 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:50.536453 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff5021f-7931-47cb-8fff-bd022ad04c95 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:50.536875 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-fff5021f-7931-47cb-8fff-bd022ad04c95 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:50.676444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-fff5021f-7931-47cb-8fff-bd022ad04c95 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:50.680301 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:03:50.686207 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-fff5021f-7931-47cb-8fff-bd022ad04c95 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1573 microversion: 2.1 time: 0.164070 Aug 29 17:03:50.686798 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4115/8449] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:50 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:51.708526 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-40cfc9a5-7fb0-4cce-a4ae-b6c944805a47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:51.709192 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-40cfc9a5-7fb0-4cce-a4ae-b6c944805a47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:51.716737 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40cfc9a5-7fb0-4cce-a4ae-b6c944805a47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:51.717275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40cfc9a5-7fb0-4cce-a4ae-b6c944805a47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:51.717711 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40cfc9a5-7fb0-4cce-a4ae-b6c944805a47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:51.718435 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40cfc9a5-7fb0-4cce-a4ae-b6c944805a47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:51.718900 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40cfc9a5-7fb0-4cce-a4ae-b6c944805a47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:51.719367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-40cfc9a5-7fb0-4cce-a4ae-b6c944805a47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:51.861253 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-40cfc9a5-7fb0-4cce-a4ae-b6c944805a47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:51.870888 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-40cfc9a5-7fb0-4cce-a4ae-b6c944805a47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1573 microversion: 2.1 time: 0.166138 Aug 29 17:03:51.871474 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4335/8450] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:51 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:52.892959 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d42e6ba5-b119-4d88-8149-8e5e9ca53cb2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:52.893592 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d42e6ba5-b119-4d88-8149-8e5e9ca53cb2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:52.896414 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:03:52.903927 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d42e6ba5-b119-4d88-8149-8e5e9ca53cb2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:52.904541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d42e6ba5-b119-4d88-8149-8e5e9ca53cb2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:52.904983 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d42e6ba5-b119-4d88-8149-8e5e9ca53cb2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:52.905741 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d42e6ba5-b119-4d88-8149-8e5e9ca53cb2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:52.906199 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d42e6ba5-b119-4d88-8149-8e5e9ca53cb2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:52.906605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d42e6ba5-b119-4d88-8149-8e5e9ca53cb2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:53.067265 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d42e6ba5-b119-4d88-8149-8e5e9ca53cb2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:53.077195 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d42e6ba5-b119-4d88-8149-8e5e9ca53cb2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1573 microversion: 2.1 time: 0.188881 Aug 29 17:03:53.077782 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4116/8451] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:52 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1573 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:54.099768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6bfe7162-3b42-4c93-bd53-4f3690ea21d1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:54.100573 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6bfe7162-3b42-4c93-bd53-4f3690ea21d1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:54.103337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=35 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:03:54.110869 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bfe7162-3b42-4c93-bd53-4f3690ea21d1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:54.112227 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bfe7162-3b42-4c93-bd53-4f3690ea21d1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:54.112699 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bfe7162-3b42-4c93-bd53-4f3690ea21d1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:54.113794 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bfe7162-3b42-4c93-bd53-4f3690ea21d1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:54.113948 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bfe7162-3b42-4c93-bd53-4f3690ea21d1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:54.114373 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6bfe7162-3b42-4c93-bd53-4f3690ea21d1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:54.117702 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=91 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:03:54.252862 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-6bfe7162-3b42-4c93-bd53-4f3690ea21d1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:54.261064 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6bfe7162-3b42-4c93-bd53-4f3690ea21d1 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1573 microversion: 2.1 time: 0.165567 Aug 29 17:03:54.261675 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4336/8452] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:54 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:55.283008 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-b7cb23ee-5481-40b5-a261-f873490a338c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:55.283642 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-b7cb23ee-5481-40b5-a261-f873490a338c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:55.290444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7cb23ee-5481-40b5-a261-f873490a338c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:55.290945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7cb23ee-5481-40b5-a261-f873490a338c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:55.291378 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7cb23ee-5481-40b5-a261-f873490a338c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:55.292092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7cb23ee-5481-40b5-a261-f873490a338c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:55.292712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7cb23ee-5481-40b5-a261-f873490a338c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:55.293318 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-b7cb23ee-5481-40b5-a261-f873490a338c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:55.435086 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-b7cb23ee-5481-40b5-a261-f873490a338c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:55.444148 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-b7cb23ee-5481-40b5-a261-f873490a338c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1573 microversion: 2.1 time: 0.165419 Aug 29 17:03:55.444728 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4117/8453] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:55 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:56.467292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-01e7e0ab-dde3-42f9-a75c-1479f5bae623 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:56.467944 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-01e7e0ab-dde3-42f9-a75c-1479f5bae623 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:56.477414 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01e7e0ab-dde3-42f9-a75c-1479f5bae623 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:56.477933 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01e7e0ab-dde3-42f9-a75c-1479f5bae623 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:56.478393 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01e7e0ab-dde3-42f9-a75c-1479f5bae623 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:56.479252 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01e7e0ab-dde3-42f9-a75c-1479f5bae623 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:56.479728 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01e7e0ab-dde3-42f9-a75c-1479f5bae623 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:56.480194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-01e7e0ab-dde3-42f9-a75c-1479f5bae623 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:56.639983 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-01e7e0ab-dde3-42f9-a75c-1479f5bae623 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:56.654638 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-01e7e0ab-dde3-42f9-a75c-1479f5bae623 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1573 microversion: 2.1 time: 0.193141 Aug 29 17:03:56.655337 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4337/8454] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:56 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1573 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:57.343332 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-36d1ffb8-13e7-46aa-97a5-672c3d7a6d1b req-2676f038-38ec-4196-a54b-2b678144ce3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0cbb653-475d-4f40-82e0-64573cbff57b", "name": "network-vif-plugged", "status": "completed", "tag": "61f96d85-37f2-4a83-aad8-031e7e615b0c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:03:57.356574 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-36d1ffb8-13e7-46aa-97a5-672c3d7a6d1b req-2676f038-38ec-4196-a54b-2b678144ce3e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:57.357067 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-36d1ffb8-13e7-46aa-97a5-672c3d7a6d1b req-2676f038-38ec-4196-a54b-2b678144ce3e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:57.357529 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-36d1ffb8-13e7-46aa-97a5-672c3d7a6d1b req-2676f038-38ec-4196-a54b-2b678144ce3e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:57.370625 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-36d1ffb8-13e7-46aa-97a5-672c3d7a6d1b req-2676f038-38ec-4196-a54b-2b678144ce3e service nova] Creating event network-vif-plugged:61f96d85-37f2-4a83-aad8-031e7e615b0c for instance a0cbb653-475d-4f40-82e0-64573cbff57b on n-h1-839401-11 Aug 29 17:03:57.375734 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-36d1ffb8-13e7-46aa-97a5-672c3d7a6d1b req-2676f038-38ec-4196-a54b-2b678144ce3e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036348 Aug 29 17:03:57.376352 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4118/8455] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:03:57.676337 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e3c1d7ce-12c4-49ec-afe0-81187dd0dff8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:57.676905 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e3c1d7ce-12c4-49ec-afe0-81187dd0dff8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:57.684863 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3c1d7ce-12c4-49ec-afe0-81187dd0dff8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:57.685400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3c1d7ce-12c4-49ec-afe0-81187dd0dff8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:57.685850 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3c1d7ce-12c4-49ec-afe0-81187dd0dff8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:57.686568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3c1d7ce-12c4-49ec-afe0-81187dd0dff8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:57.687038 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3c1d7ce-12c4-49ec-afe0-81187dd0dff8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:57.687470 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e3c1d7ce-12c4-49ec-afe0-81187dd0dff8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:57.840746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e3c1d7ce-12c4-49ec-afe0-81187dd0dff8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:57.849274 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e3c1d7ce-12c4-49ec-afe0-81187dd0dff8 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1573 microversion: 2.1 time: 0.176960 Aug 29 17:03:57.849866 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4338/8456] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:57 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1573 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:58.872131 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a06c25a1-53ea-4b80-8098-78c87f6cf6ca tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:58.872829 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a06c25a1-53ea-4b80-8098-78c87f6cf6ca tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:58.881288 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a06c25a1-53ea-4b80-8098-78c87f6cf6ca tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:58.881778 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a06c25a1-53ea-4b80-8098-78c87f6cf6ca tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:58.882216 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a06c25a1-53ea-4b80-8098-78c87f6cf6ca tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:58.882925 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a06c25a1-53ea-4b80-8098-78c87f6cf6ca tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:58.883381 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a06c25a1-53ea-4b80-8098-78c87f6cf6ca tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:58.883813 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a06c25a1-53ea-4b80-8098-78c87f6cf6ca tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:59.018570 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a06c25a1-53ea-4b80-8098-78c87f6cf6ca tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:59.027175 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a06c25a1-53ea-4b80-8098-78c87f6cf6ca tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1573 microversion: 2.1 time: 0.160185 Aug 29 17:03:59.027796 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4119/8457] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:58 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:00.049946 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-fbaaa2f6-ee55-49d8-accd-3af1284252f9 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:00.050637 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-fbaaa2f6-ee55-49d8-accd-3af1284252f9 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:00.059724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbaaa2f6-ee55-49d8-accd-3af1284252f9 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:00.060276 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbaaa2f6-ee55-49d8-accd-3af1284252f9 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:00.060724 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbaaa2f6-ee55-49d8-accd-3af1284252f9 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:00.061537 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbaaa2f6-ee55-49d8-accd-3af1284252f9 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:00.062145 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbaaa2f6-ee55-49d8-accd-3af1284252f9 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:00.062746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-fbaaa2f6-ee55-49d8-accd-3af1284252f9 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:00.210967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-fbaaa2f6-ee55-49d8-accd-3af1284252f9 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:00.221408 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-fbaaa2f6-ee55-49d8-accd-3af1284252f9 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1560 microversion: 2.1 time: 0.176128 Aug 29 17:04:00.222003 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4339/8458] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:00 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:17.221667 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-49cbe425-bf39-456b-9554-7461946ca255 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:17.225609 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=7 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:17.226903 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=23 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:17.228110 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 17:05:17.228277 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 17:05:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Aug 29 17:05:17.230992 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 17:05:17.231644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-49cbe425-bf39-456b-9554-7461946ca255 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:17.231962 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 17:05:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Aug 29 17:05:17.238326 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-184cc6fc-8fca-4897-94da-ee2cd76e3570 req-65b95016-af71-444d-bef2-97a65a8519db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0cbb653-475d-4f40-82e0-64573cbff57b", "tag": "61f96d85-37f2-4a83-aad8-031e7e615b0c"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:05:17.246897 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=7 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:17.247573 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=20 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:17.255041 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49cbe425-bf39-456b-9554-7461946ca255 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:17.255540 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49cbe425-bf39-456b-9554-7461946ca255 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:17.255981 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49cbe425-bf39-456b-9554-7461946ca255 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:17.256701 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49cbe425-bf39-456b-9554-7461946ca255 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:17.257181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49cbe425-bf39-456b-9554-7461946ca255 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:17.257605 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-49cbe425-bf39-456b-9554-7461946ca255 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:17.278300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-184cc6fc-8fca-4897-94da-ee2cd76e3570 req-65b95016-af71-444d-bef2-97a65a8519db service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:17.278796 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-184cc6fc-8fca-4897-94da-ee2cd76e3570 req-65b95016-af71-444d-bef2-97a65a8519db service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:17.279238 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-184cc6fc-8fca-4897-94da-ee2cd76e3570 req-65b95016-af71-444d-bef2-97a65a8519db service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:17.291982 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-184cc6fc-8fca-4897-94da-ee2cd76e3570 req-65b95016-af71-444d-bef2-97a65a8519db service nova] Creating event network-changed:61f96d85-37f2-4a83-aad8-031e7e615b0c for instance a0cbb653-475d-4f40-82e0-64573cbff57b on n-h1-839401-11 Aug 29 17:05:17.299163 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-184cc6fc-8fca-4897-94da-ee2cd76e3570 req-65b95016-af71-444d-bef2-97a65a8519db service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075351 Aug 29 17:05:17.300523 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4340/8459] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:05:17.306415 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-49cbe425-bf39-456b-9554-7461946ca255 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 17:05:17.396152 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-49cbe425-bf39-456b-9554-7461946ca255 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 204 len: 0 microversion: 2.1 time: 0.178147 Aug 29 17:05:17.398449 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4120/8460] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 17:05:17 2022] DELETE /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 17:05:17.409322 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ff728e08-c7f9-4b44-bb5d-8132a43c2c77 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:17.409943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ff728e08-c7f9-4b44-bb5d-8132a43c2c77 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:17.416696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff728e08-c7f9-4b44-bb5d-8132a43c2c77 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:17.417296 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff728e08-c7f9-4b44-bb5d-8132a43c2c77 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:17.417749 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff728e08-c7f9-4b44-bb5d-8132a43c2c77 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:17.418463 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff728e08-c7f9-4b44-bb5d-8132a43c2c77 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:17.418932 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff728e08-c7f9-4b44-bb5d-8132a43c2c77 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:17.419368 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ff728e08-c7f9-4b44-bb5d-8132a43c2c77 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:17.567756 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ff728e08-c7f9-4b44-bb5d-8132a43c2c77 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:17.576368 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ff728e08-c7f9-4b44-bb5d-8132a43c2c77 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1566 microversion: 2.1 time: 0.173898 Aug 29 17:05:17.576980 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4341/8461] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:17 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:18.600143 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-57d356f6-dd97-459e-af25-da9ac301f74c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:18.600884 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-57d356f6-dd97-459e-af25-da9ac301f74c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:18.611205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57d356f6-dd97-459e-af25-da9ac301f74c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:18.611756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57d356f6-dd97-459e-af25-da9ac301f74c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:18.612196 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57d356f6-dd97-459e-af25-da9ac301f74c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:18.613761 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57d356f6-dd97-459e-af25-da9ac301f74c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:18.614187 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57d356f6-dd97-459e-af25-da9ac301f74c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:18.614638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-57d356f6-dd97-459e-af25-da9ac301f74c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:18.768155 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-57d356f6-dd97-459e-af25-da9ac301f74c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:18.776895 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-57d356f6-dd97-459e-af25-da9ac301f74c tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1566 microversion: 2.1 time: 0.181038 Aug 29 17:05:18.778105 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4121/8462] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:18 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:19.800684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-223260d3-8906-4913-ba15-c61548f18bf2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:19.801363 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-223260d3-8906-4913-ba15-c61548f18bf2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:19.814318 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-223260d3-8906-4913-ba15-c61548f18bf2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:19.814840 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-223260d3-8906-4913-ba15-c61548f18bf2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:19.815300 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-223260d3-8906-4913-ba15-c61548f18bf2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:19.816022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-223260d3-8906-4913-ba15-c61548f18bf2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:19.816519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-223260d3-8906-4913-ba15-c61548f18bf2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:19.816967 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-223260d3-8906-4913-ba15-c61548f18bf2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:19.860452 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-56654410-be6e-40bd-87de-09833c8d1cdd req-84bd3c67-2ca3-4fe4-98ad-b5a37265158d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0cbb653-475d-4f40-82e0-64573cbff57b", "name": "network-vif-deleted", "tag": "61f96d85-37f2-4a83-aad8-031e7e615b0c"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:05:19.872870 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-56654410-be6e-40bd-87de-09833c8d1cdd req-84bd3c67-2ca3-4fe4-98ad-b5a37265158d service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:19.873389 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-56654410-be6e-40bd-87de-09833c8d1cdd req-84bd3c67-2ca3-4fe4-98ad-b5a37265158d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:19.873821 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-56654410-be6e-40bd-87de-09833c8d1cdd req-84bd3c67-2ca3-4fe4-98ad-b5a37265158d service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:19.888124 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-56654410-be6e-40bd-87de-09833c8d1cdd req-84bd3c67-2ca3-4fe4-98ad-b5a37265158d service nova] Creating event network-vif-deleted:61f96d85-37f2-4a83-aad8-031e7e615b0c for instance a0cbb653-475d-4f40-82e0-64573cbff57b on n-h1-839401-11 Aug 29 17:05:19.889770 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-223260d3-8906-4913-ba15-c61548f18bf2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:19.900247 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-223260d3-8906-4913-ba15-c61548f18bf2 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1380 microversion: 2.1 time: 0.103962 Aug 29 17:05:19.900455 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4342/8463] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:19 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1380 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:19.901030 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-56654410-be6e-40bd-87de-09833c8d1cdd req-84bd3c67-2ca3-4fe4-98ad-b5a37265158d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038977 Aug 29 17:05:19.901980 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4122/8464] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 17:05:20.922684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e23d6ffc-5f69-42d4-bf9b-26f0c5e25631 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:20.923703 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e23d6ffc-5f69-42d4-bf9b-26f0c5e25631 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:20.931994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23d6ffc-5f69-42d4-bf9b-26f0c5e25631 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:20.932507 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23d6ffc-5f69-42d4-bf9b-26f0c5e25631 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:20.933211 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23d6ffc-5f69-42d4-bf9b-26f0c5e25631 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:20.934000 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23d6ffc-5f69-42d4-bf9b-26f0c5e25631 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:20.934474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23d6ffc-5f69-42d4-bf9b-26f0c5e25631 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:20.934949 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e23d6ffc-5f69-42d4-bf9b-26f0c5e25631 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:21.007370 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e23d6ffc-5f69-42d4-bf9b-26f0c5e25631 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:21.016078 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e23d6ffc-5f69-42d4-bf9b-26f0c5e25631 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1219 microversion: 2.1 time: 0.097506 Aug 29 17:05:21.029188 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4343/8465] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:20 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:22.041924 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6097e9c6-6ee0-45ce-a053-35f8b54e1510 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:22.042753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-6097e9c6-6ee0-45ce-a053-35f8b54e1510 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:22.049242 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6097e9c6-6ee0-45ce-a053-35f8b54e1510 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:22.049738 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6097e9c6-6ee0-45ce-a053-35f8b54e1510 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:22.050164 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6097e9c6-6ee0-45ce-a053-35f8b54e1510 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:22.050863 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6097e9c6-6ee0-45ce-a053-35f8b54e1510 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:22.051307 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6097e9c6-6ee0-45ce-a053-35f8b54e1510 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:22.051730 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-6097e9c6-6ee0-45ce-a053-35f8b54e1510 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:22.128921 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-6097e9c6-6ee0-45ce-a053-35f8b54e1510 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:22.140459 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6097e9c6-6ee0-45ce-a053-35f8b54e1510 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1219 microversion: 2.1 time: 0.103839 Aug 29 17:05:22.141059 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4123/8466] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:22 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:23.161941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4ace2dbd-0b2b-4c1b-8e21-0c02f64bc216 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:23.162589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4ace2dbd-0b2b-4c1b-8e21-0c02f64bc216 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:23.170331 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ace2dbd-0b2b-4c1b-8e21-0c02f64bc216 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:23.170836 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ace2dbd-0b2b-4c1b-8e21-0c02f64bc216 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:23.171292 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ace2dbd-0b2b-4c1b-8e21-0c02f64bc216 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:23.172011 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ace2dbd-0b2b-4c1b-8e21-0c02f64bc216 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:23.172481 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ace2dbd-0b2b-4c1b-8e21-0c02f64bc216 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:23.172921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4ace2dbd-0b2b-4c1b-8e21-0c02f64bc216 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:23.241994 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4ace2dbd-0b2b-4c1b-8e21-0c02f64bc216 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:23.251070 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4ace2dbd-0b2b-4c1b-8e21-0c02f64bc216 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1219 microversion: 2.1 time: 0.093016 Aug 29 17:05:23.251696 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4344/8467] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:23 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:24.272731 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-19237ebf-1a94-47f4-ad98-974d8a084e47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:24.273406 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-19237ebf-1a94-47f4-ad98-974d8a084e47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:24.281422 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19237ebf-1a94-47f4-ad98-974d8a084e47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:24.282031 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19237ebf-1a94-47f4-ad98-974d8a084e47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:24.282472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19237ebf-1a94-47f4-ad98-974d8a084e47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:24.283240 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19237ebf-1a94-47f4-ad98-974d8a084e47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:24.283691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19237ebf-1a94-47f4-ad98-974d8a084e47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:24.284112 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-19237ebf-1a94-47f4-ad98-974d8a084e47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:24.358033 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-19237ebf-1a94-47f4-ad98-974d8a084e47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdb91fd783e4589bd5ca7fe07ea0e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df90138d350e4bc796a0d152a4af2dfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:24.367423 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-19237ebf-1a94-47f4-ad98-974d8a084e47 tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 200 len: 1219 microversion: 2.1 time: 0.098696 Aug 29 17:05:24.368297 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4124/8468] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:24 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:25.392705 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-709c6594-3e4d-40d8-b1e0-63d7ec78092a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:25.393336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-709c6594-3e4d-40d8-b1e0-63d7ec78092a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] [instance: a0cbb653-475d-4f40-82e0-64573cbff57b] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:25.400206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-709c6594-3e4d-40d8-b1e0-63d7ec78092a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:25.400717 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-709c6594-3e4d-40d8-b1e0-63d7ec78092a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:25.401206 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-709c6594-3e4d-40d8-b1e0-63d7ec78092a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:25.402026 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-709c6594-3e4d-40d8-b1e0-63d7ec78092a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:25.402504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-709c6594-3e4d-40d8-b1e0-63d7ec78092a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:25.402950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-709c6594-3e4d-40d8-b1e0-63d7ec78092a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:25.422760 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-709c6594-3e4d-40d8-b1e0-63d7ec78092a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] HTTP exception thrown: Instance a0cbb653-475d-4f40-82e0-64573cbff57b could not be found. Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-709c6594-3e4d-40d8-b1e0-63d7ec78092a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Request method failure captured: Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b HTTP/1.1 Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDO9d0-Ds3JY08oSbX1sgtZw7PdsxMe_xJk2Iow1zVdEOEBphCN_BkLdvQP51SDi1AE_DEk-dIrARG4566Is8BQH5N2uulCD3tF8GjrgGsTY8hPmRM_WdaGuBhPULO421T5n8lEDfsdjBtWQf77nwvzq7VoLYz8U0sr3JkhVTxPZ_8Ww Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: df90138d350e4bc796a0d152a4af2dfc Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestShelveInstance-1115830045 Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_df90138d350e4bc796a0d152a4af2dfc", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/df90138d350e4bc796a0d152a4af2dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/df90138d350e4bc796a0d152a4af2dfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/df90138d350e4bc796a0d152a4af2dfc"}]}] Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestShelveInstance-1115830045 Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: df90138d350e4bc796a0d152a4af2dfc Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestShelveInstance-1115830045 Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestShelveInstance-1115830045-project Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 6fdb91fd783e4589bd5ca7fe07ea0e91 Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestShelveInstance-1115830045-project Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance a0cbb653-475d-4f40-82e0-64573cbff57b could not be found. Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'a0cbb653-475d-4f40-82e0-64573cbff57b'} Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0cbb653-475d-4f40-82e0-64573cbff57b could not be found. Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0cbb653-475d-4f40-82e0-64573cbff57b could not be found. Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:05:25.425352 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 17:05:25.431772 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:05:25.431772 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:05:25.431772 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:05:25.431772 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 17:05:25.431772 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 17:05:25.431772 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0cbb653-475d-4f40-82e0-64573cbff57b could not be found. Aug 29 17:05:25.431772 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 17:05:25.431772 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-709c6594-3e4d-40d8-b1e0-63d7ec78092a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Returning 404 to user: Instance a0cbb653-475d-4f40-82e0-64573cbff57b could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 17:05:25.435421 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-709c6594-3e4d-40d8-b1e0-63d7ec78092a tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b" status: 404 len: 111 microversion: 2.1 time: 0.047365 Aug 29 17:05:25.436277 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4345/8469] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:25 2022] GET /compute/v2.1/servers/a0cbb653-475d-4f40-82e0-64573cbff57b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 17:05:25.624874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-6ebdd260-175a-4e3f-b620-0881b6c962ff tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] Calling method '.version_select at 0x7fc42a5d8550>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:25.654881 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-6ebdd260-175a-4e3f-b620-0881b6c962ff tempest-TestShelveInstance-1115830045 tempest-TestShelveInstance-1115830045-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1756349972" status: 202 len: 0 microversion: 2.1 time: 0.033937 Aug 29 17:05:25.655744 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4125/8470] 10.222.0.62 () {58 vars in 1254 bytes} [Mon Aug 29 17:05:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1756349972 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 17:05:44.731886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=12 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:44.732723 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=28 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:45.002456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-71ace7d8-21e5-4ab5-803e-aa218e365fa3 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Action: 'create', calling method: .version_select at 0x7fc42b71a160>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-365291319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOT/wbtTdM3RsRhzu1QBNXwdKy5ZJLjgVKTgYs+nV4Cek7UF+fJXcGUBifH6xbRT8IJBPerogRI8H7tqMLU67m9DnOQQzZYPMKCV16yQ1bLVg4yAXNA2yXs3fNxa0fZQJA=="}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:05:45.019355 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-71ace7d8-21e5-4ab5-803e-aa218e365fa3 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Getting quotas for project b1489464a7ad432e8da0068bb43a787e. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 17:05:45.026338 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.quota [None req-71ace7d8-21e5-4ab5-803e-aa218e365fa3 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Getting quotas for user 44ec90cb493b488f98e901f0faf316f7 and project b1489464a7ad432e8da0068bb43a787e. Resources: {'key_pairs'} {{(pid=122360) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 17:05:45.071990 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-71ace7d8-21e5-4ab5-803e-aa218e365fa3 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.347840 Aug 29 17:05:45.073988 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4346/8471] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 17:05:44 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:05:46.237568 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:46.238721 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:46.251516 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-857689373", "imageRef": "2c042d4c-e5f7-47c3-ac9e-1fb093df192c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-365291319", "security_groups": [{"name": "tempest-secgroup-smoke-1118436863"}], "networks": [{"uuid": "3fe7ab89-7ebd-4ce4-8ce1-df82ffc5ba77"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:05:46.469898 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] validate_networks() for [('3fe7ab89-7ebd-4ce4-8ce1-df82ffc5ba77', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 17:05:46.987029 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 17:05:46.987710 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 17:05:46.988250 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 17:05:46.988727 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 17:05:46.989299 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 17:05:46.999007 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:46.999478 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:46.999917 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:47.000638 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:47.001106 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:47.001562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:47.019969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Getting quotas for project b1489464a7ad432e8da0068bb43a787e. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 17:05:47.025774 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Getting quotas for user 44ec90cb493b488f98e901f0faf316f7 and project b1489464a7ad432e8da0068bb43a787e. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 17:05:47.038532 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 17:05:47.041024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2c042d4c-e5f7-47c3-ac9e-1fb093df192c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 17:05:47.089614 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-0ea919ad-0c3d-4a8f-8e1d-7b1a619bd89e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.855367 Aug 29 17:05:47.090608 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4126/8472] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 17:05:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 17:05:47.101336 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-91d2cb79-602f-4598-aa38-0f50bed875d5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:47.101980 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-91d2cb79-602f-4598-aa38-0f50bed875d5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:47.234886 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-91d2cb79-602f-4598-aa38-0f50bed875d5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:47.242457 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-91d2cb79-602f-4598-aa38-0f50bed875d5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346" status: 200 len: 1247 microversion: 2.1 time: 0.144841 Aug 29 17:05:47.243492 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4347/8473] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:47 2022] GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 => generated 1247 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 17:05:48.264788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-8225ac0d-bfcf-4caa-b0f2-dfd2d5e04de2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:48.265468 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-8225ac0d-bfcf-4caa-b0f2-dfd2d5e04de2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:48.272014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8225ac0d-bfcf-4caa-b0f2-dfd2d5e04de2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:48.272530 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8225ac0d-bfcf-4caa-b0f2-dfd2d5e04de2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:48.272973 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8225ac0d-bfcf-4caa-b0f2-dfd2d5e04de2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:48.273713 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8225ac0d-bfcf-4caa-b0f2-dfd2d5e04de2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:48.274169 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8225ac0d-bfcf-4caa-b0f2-dfd2d5e04de2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:48.274600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-8225ac0d-bfcf-4caa-b0f2-dfd2d5e04de2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:48.343099 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-8225ac0d-bfcf-4caa-b0f2-dfd2d5e04de2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:48.353964 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-8225ac0d-bfcf-4caa-b0f2-dfd2d5e04de2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346" status: 200 len: 1307 microversion: 2.1 time: 0.094064 Aug 29 17:05:48.354911 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4127/8474] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:48 2022] GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:49.377715 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e47cc60e-7102-4783-81ae-07c7a83c2543 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:49.378358 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e47cc60e-7102-4783-81ae-07c7a83c2543 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:49.386517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e47cc60e-7102-4783-81ae-07c7a83c2543 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:49.387222 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e47cc60e-7102-4783-81ae-07c7a83c2543 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:49.387681 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e47cc60e-7102-4783-81ae-07c7a83c2543 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:49.388400 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e47cc60e-7102-4783-81ae-07c7a83c2543 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:49.388874 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e47cc60e-7102-4783-81ae-07c7a83c2543 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:49.389367 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e47cc60e-7102-4783-81ae-07c7a83c2543 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:49.622544 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-e47cc60e-7102-4783-81ae-07c7a83c2543 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:49.630737 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e47cc60e-7102-4783-81ae-07c7a83c2543 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346" status: 200 len: 1373 microversion: 2.1 time: 0.258387 Aug 29 17:05:49.631696 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4348/8475] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:49 2022] GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 => generated 1373 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:49.827866 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-ef26d9c3-4dc4-4b25-b970-8ce8f542bba6 req-157469f6-7b47-4950-ad9a-1cc8e32b5f71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "536736b4-5253-4e25-a748-6ee4c8f94346", "tag": "f7e9e999-561d-4d2f-9ad8-7d87879d79fa"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:05:49.839943 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ef26d9c3-4dc4-4b25-b970-8ce8f542bba6 req-157469f6-7b47-4950-ad9a-1cc8e32b5f71 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:49.840752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ef26d9c3-4dc4-4b25-b970-8ce8f542bba6 req-157469f6-7b47-4950-ad9a-1cc8e32b5f71 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:49.841238 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-ef26d9c3-4dc4-4b25-b970-8ce8f542bba6 req-157469f6-7b47-4950-ad9a-1cc8e32b5f71 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:49.853462 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-ef26d9c3-4dc4-4b25-b970-8ce8f542bba6 req-157469f6-7b47-4950-ad9a-1cc8e32b5f71 service nova] Creating event network-changed:f7e9e999-561d-4d2f-9ad8-7d87879d79fa for instance 536736b4-5253-4e25-a748-6ee4c8f94346 on n-h2-839401-11 Aug 29 17:05:49.868856 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-ef26d9c3-4dc4-4b25-b970-8ce8f542bba6 req-157469f6-7b47-4950-ad9a-1cc8e32b5f71 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044699 Aug 29 17:05:49.870267 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4128/8476] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:05:50.653048 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-94ee0a5e-22b3-4449-ad15-b6e8e6c617f8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:50.653672 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-94ee0a5e-22b3-4449-ad15-b6e8e6c617f8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:50.662289 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ee0a5e-22b3-4449-ad15-b6e8e6c617f8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:50.662797 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ee0a5e-22b3-4449-ad15-b6e8e6c617f8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:50.663256 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ee0a5e-22b3-4449-ad15-b6e8e6c617f8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:50.663973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ee0a5e-22b3-4449-ad15-b6e8e6c617f8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:50.664451 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ee0a5e-22b3-4449-ad15-b6e8e6c617f8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:50.664878 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-94ee0a5e-22b3-4449-ad15-b6e8e6c617f8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:50.810704 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-94ee0a5e-22b3-4449-ad15-b6e8e6c617f8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:50.818742 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-94ee0a5e-22b3-4449-ad15-b6e8e6c617f8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346" status: 200 len: 1373 microversion: 2.1 time: 0.169796 Aug 29 17:05:50.819343 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4349/8477] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:50 2022] GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:51.840712 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-9780d225-b86d-43aa-b8bd-2883670891e3 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:51.841416 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-9780d225-b86d-43aa-b8bd-2883670891e3 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:51.848026 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9780d225-b86d-43aa-b8bd-2883670891e3 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:51.848523 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9780d225-b86d-43aa-b8bd-2883670891e3 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:51.848968 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9780d225-b86d-43aa-b8bd-2883670891e3 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:51.849711 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9780d225-b86d-43aa-b8bd-2883670891e3 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:51.850174 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9780d225-b86d-43aa-b8bd-2883670891e3 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:51.850606 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-9780d225-b86d-43aa-b8bd-2883670891e3 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:52.005184 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-9780d225-b86d-43aa-b8bd-2883670891e3 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:52.013978 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-9780d225-b86d-43aa-b8bd-2883670891e3 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346" status: 200 len: 1373 microversion: 2.1 time: 0.178632 Aug 29 17:05:52.014560 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4129/8478] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:51 2022] GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:53.035106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-029e3e48-ea1f-4629-a0ea-e1d5359c4ac5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:53.035950 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-029e3e48-ea1f-4629-a0ea-e1d5359c4ac5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:53.043676 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-029e3e48-ea1f-4629-a0ea-e1d5359c4ac5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:53.044587 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-029e3e48-ea1f-4629-a0ea-e1d5359c4ac5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:53.045286 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-029e3e48-ea1f-4629-a0ea-e1d5359c4ac5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:53.046023 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-029e3e48-ea1f-4629-a0ea-e1d5359c4ac5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:53.046504 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-029e3e48-ea1f-4629-a0ea-e1d5359c4ac5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:53.046937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-029e3e48-ea1f-4629-a0ea-e1d5359c4ac5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:53.393429 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-029e3e48-ea1f-4629-a0ea-e1d5359c4ac5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:53.402014 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-029e3e48-ea1f-4629-a0ea-e1d5359c4ac5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346" status: 200 len: 1373 microversion: 2.1 time: 0.371348 Aug 29 17:05:53.402622 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4350/8479] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:53 2022] GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 => generated 1373 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:54.424444 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d6c56eee-4fce-4923-a0f5-0476c1dd86d2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:54.425050 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d6c56eee-4fce-4923-a0f5-0476c1dd86d2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:54.432463 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6c56eee-4fce-4923-a0f5-0476c1dd86d2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:54.432953 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6c56eee-4fce-4923-a0f5-0476c1dd86d2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:54.433430 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6c56eee-4fce-4923-a0f5-0476c1dd86d2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:54.434127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6c56eee-4fce-4923-a0f5-0476c1dd86d2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:54.434582 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6c56eee-4fce-4923-a0f5-0476c1dd86d2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:54.435004 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d6c56eee-4fce-4923-a0f5-0476c1dd86d2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:54.573916 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-d6c56eee-4fce-4923-a0f5-0476c1dd86d2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:54.581582 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d6c56eee-4fce-4923-a0f5-0476c1dd86d2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346" status: 200 len: 1373 microversion: 2.1 time: 0.161582 Aug 29 17:05:54.582155 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4130/8480] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:54 2022] GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:55.604053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-251fc7de-f01b-4208-89cb-c9aaf1e2408f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:55.604053 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-251fc7de-f01b-4208-89cb-c9aaf1e2408f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:55.610815 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-251fc7de-f01b-4208-89cb-c9aaf1e2408f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:55.611320 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-251fc7de-f01b-4208-89cb-c9aaf1e2408f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:55.611791 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-251fc7de-f01b-4208-89cb-c9aaf1e2408f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:55.612530 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-251fc7de-f01b-4208-89cb-c9aaf1e2408f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:55.613301 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-251fc7de-f01b-4208-89cb-c9aaf1e2408f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:55.614012 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-251fc7de-f01b-4208-89cb-c9aaf1e2408f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:55.757148 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-251fc7de-f01b-4208-89cb-c9aaf1e2408f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:55.766153 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-251fc7de-f01b-4208-89cb-c9aaf1e2408f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346" status: 200 len: 1373 microversion: 2.1 time: 0.167147 Aug 29 17:05:55.767247 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4351/8481] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:55 2022] GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:56.786615 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-a2135bd3-b572-4087-bff2-8e62135bcac5 req-747daaab-b4d5-4b15-a298-6a511f2f484f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536736b4-5253-4e25-a748-6ee4c8f94346", "name": "network-vif-plugged", "status": "completed", "tag": "f7e9e999-561d-4d2f-9ad8-7d87879d79fa"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:05:56.789445 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-87fde62f-7b4c-4789-93da-531c862d88f7 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:56.790240 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-87fde62f-7b4c-4789-93da-531c862d88f7 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:56.800832 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a2135bd3-b572-4087-bff2-8e62135bcac5 req-747daaab-b4d5-4b15-a298-6a511f2f484f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:56.801062 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87fde62f-7b4c-4789-93da-531c862d88f7 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:56.801521 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a2135bd3-b572-4087-bff2-8e62135bcac5 req-747daaab-b4d5-4b15-a298-6a511f2f484f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:56.802185 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87fde62f-7b4c-4789-93da-531c862d88f7 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:56.802777 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-a2135bd3-b572-4087-bff2-8e62135bcac5 req-747daaab-b4d5-4b15-a298-6a511f2f484f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:56.803016 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87fde62f-7b4c-4789-93da-531c862d88f7 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:56.803889 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87fde62f-7b4c-4789-93da-531c862d88f7 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:56.806106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87fde62f-7b4c-4789-93da-531c862d88f7 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:56.807060 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-87fde62f-7b4c-4789-93da-531c862d88f7 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:56.818943 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-a2135bd3-b572-4087-bff2-8e62135bcac5 req-747daaab-b4d5-4b15-a298-6a511f2f484f service nova] Creating event network-vif-plugged:f7e9e999-561d-4d2f-9ad8-7d87879d79fa for instance 536736b4-5253-4e25-a748-6ee4c8f94346 on n-h2-839401-11 Aug 29 17:05:56.824574 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-a2135bd3-b572-4087-bff2-8e62135bcac5 req-747daaab-b4d5-4b15-a298-6a511f2f484f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045475 Aug 29 17:05:56.825737 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4131/8482] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 17:05:56.996275 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-87fde62f-7b4c-4789-93da-531c862d88f7 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:57.005048 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-87fde62f-7b4c-4789-93da-531c862d88f7 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346" status: 200 len: 1373 microversion: 2.1 time: 0.219815 Aug 29 17:05:57.005691 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4352/8483] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:56 2022] GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 => generated 1373 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:58.033025 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e50dee21-9eb6-469a-a5ba-60b6df3d40f1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:58.033776 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e50dee21-9eb6-469a-a5ba-60b6df3d40f1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:58.035992 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:58.036663 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:58.044702 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e50dee21-9eb6-469a-a5ba-60b6df3d40f1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:58.045527 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e50dee21-9eb6-469a-a5ba-60b6df3d40f1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:58.046038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e50dee21-9eb6-469a-a5ba-60b6df3d40f1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:58.047038 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e50dee21-9eb6-469a-a5ba-60b6df3d40f1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:58.047552 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e50dee21-9eb6-469a-a5ba-60b6df3d40f1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:58.047982 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e50dee21-9eb6-469a-a5ba-60b6df3d40f1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:58.197594 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e50dee21-9eb6-469a-a5ba-60b6df3d40f1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:58.206011 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e50dee21-9eb6-469a-a5ba-60b6df3d40f1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346" status: 200 len: 1373 microversion: 2.1 time: 0.177790 Aug 29 17:05:58.206596 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4132/8484] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:58 2022] GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:59.234417 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9d1ff4b4-4758-490a-b5c1-37a8de16b7bf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:59.235039 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-9d1ff4b4-4758-490a-b5c1-37a8de16b7bf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:59.236984 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=6 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:59.243812 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d1ff4b4-4758-490a-b5c1-37a8de16b7bf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:59.244328 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d1ff4b4-4758-490a-b5c1-37a8de16b7bf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:59.244790 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d1ff4b4-4758-490a-b5c1-37a8de16b7bf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:59.245548 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d1ff4b4-4758-490a-b5c1-37a8de16b7bf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:59.246024 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d1ff4b4-4758-490a-b5c1-37a8de16b7bf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:59.246471 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-9d1ff4b4-4758-490a-b5c1-37a8de16b7bf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:59.394469 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-9d1ff4b4-4758-490a-b5c1-37a8de16b7bf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:59.402907 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9d1ff4b4-4758-490a-b5c1-37a8de16b7bf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346" status: 200 len: 1557 microversion: 2.1 time: 0.172659 Aug 29 17:05:59.403513 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4353/8485] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:59 2022] GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 => generated 1557 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:59.423108 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-11a45b18-b312-4cb0-9def-95d42f33986f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:59.423729 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-11a45b18-b312-4cb0-9def-95d42f33986f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:59.431949 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11a45b18-b312-4cb0-9def-95d42f33986f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:59.432459 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11a45b18-b312-4cb0-9def-95d42f33986f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:59.432906 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11a45b18-b312-4cb0-9def-95d42f33986f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:59.433649 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11a45b18-b312-4cb0-9def-95d42f33986f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:59.434127 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11a45b18-b312-4cb0-9def-95d42f33986f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:59.434558 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-11a45b18-b312-4cb0-9def-95d42f33986f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:59.584360 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-11a45b18-b312-4cb0-9def-95d42f33986f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:59.595506 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-11a45b18-b312-4cb0-9def-95d42f33986f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346" status: 200 len: 1557 microversion: 2.1 time: 0.176355 Aug 29 17:05:59.596114 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4133/8486] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:59 2022] GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:01.731297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-6b71aa92-3b97-435b-b2b8-8c2a24432072 req-e2e52ff5-dfb8-4246-a517-518257a8f3e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "536736b4-5253-4e25-a748-6ee4c8f94346", "tag": "f7e9e999-561d-4d2f-9ad8-7d87879d79fa"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:06:01.742094 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6b71aa92-3b97-435b-b2b8-8c2a24432072 req-e2e52ff5-dfb8-4246-a517-518257a8f3e7 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:01.742594 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6b71aa92-3b97-435b-b2b8-8c2a24432072 req-e2e52ff5-dfb8-4246-a517-518257a8f3e7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:01.743042 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6b71aa92-3b97-435b-b2b8-8c2a24432072 req-e2e52ff5-dfb8-4246-a517-518257a8f3e7 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:01.756575 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-6b71aa92-3b97-435b-b2b8-8c2a24432072 req-e2e52ff5-dfb8-4246-a517-518257a8f3e7 service nova] Creating event network-changed:f7e9e999-561d-4d2f-9ad8-7d87879d79fa for instance 536736b4-5253-4e25-a748-6ee4c8f94346 on n-h2-839401-11 Aug 29 17:06:01.762286 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-6b71aa92-3b97-435b-b2b8-8c2a24432072 req-e2e52ff5-dfb8-4246-a517-518257a8f3e7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035080 Aug 29 17:06:01.762999 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4354/8487] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:08:50.304152 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [-] [564df600-0953-4421-a68a-24b5a0a40919] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 17:08:50.305034 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eda7f439-560f-4fda-a0c4-47b93d5f6cfd] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 17:08:50.305657 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:08:50.306449 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=36 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:08:50.307382 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 17:08:50.307548 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 17:08:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346/action (ip 10.222.0.62) !!! Aug 29 17:08:50.308814 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 17:08:50.308961 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 17:08:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346/action (ip 10.222.0.62) !!! Aug 29 17:08:50.310058 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 17:08:50.310211 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 17:08:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346/action (ip 10.222.0.62) !!! Aug 29 17:08:50.314878 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-dd70a01f-c294-4927-ad92-b41171c0064a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1915566294"}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:08:50.317259 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-dd70a01f-c294-4927-ad92-b41171c0064a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:50.330737 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd70a01f-c294-4927-ad92-b41171c0064a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:50.331271 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd70a01f-c294-4927-ad92-b41171c0064a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:50.331716 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd70a01f-c294-4927-ad92-b41171c0064a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:50.332431 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd70a01f-c294-4927-ad92-b41171c0064a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:50.332882 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd70a01f-c294-4927-ad92-b41171c0064a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:50.333339 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-dd70a01f-c294-4927-ad92-b41171c0064a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:50.552587 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-dd70a01f-c294-4927-ad92-b41171c0064a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "POST /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346/action" status: 202 len: 0 microversion: 2.1 time: 0.249813 Aug 29 17:08:50.559204 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4134/8488] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 17:08:50 2022] POST /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 17:08:59.504863 n-d-839401-11 devstack@n-api.service[122360]: ERROR oslo.messaging._drivers.impl_rabbit [-] [603d2cc2-3ad6-4419-8622-2fba015025b5] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 17:08:59.505784 n-d-839401-11 devstack@n-api.service[122360]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edb16f3c-d8bd-4396-8d00-d7897b8393bf] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 17:08:59.506430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:08:59.507198 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=38 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:08:59.508261 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 17:08:59.508500 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 17:08:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Aug 29 17:08:59.509696 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 17:08:59.509839 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 17:08:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Aug 29 17:08:59.511436 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 17:08:59.511583 n-d-839401-11 devstack@n-api.service[122360]: Mon Aug 29 17:08:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Aug 29 17:08:59.581233 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-14335bf5-a4f3-4a76-9cc7-494eb777e369 req-893b6e96-5ce2-4ba0-9414-161bf52f6c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536736b4-5253-4e25-a748-6ee4c8f94346", "name": "network-vif-plugged", "status": "completed", "tag": "f7e9e999-561d-4d2f-9ad8-7d87879d79fa"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:08:59.591684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-14335bf5-a4f3-4a76-9cc7-494eb777e369 req-893b6e96-5ce2-4ba0-9414-161bf52f6c9c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:59.592101 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-14335bf5-a4f3-4a76-9cc7-494eb777e369 req-893b6e96-5ce2-4ba0-9414-161bf52f6c9c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:59.592540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-14335bf5-a4f3-4a76-9cc7-494eb777e369 req-893b6e96-5ce2-4ba0-9414-161bf52f6c9c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:59.604980 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-14335bf5-a4f3-4a76-9cc7-494eb777e369 req-893b6e96-5ce2-4ba0-9414-161bf52f6c9c service nova] Creating event network-vif-plugged:f7e9e999-561d-4d2f-9ad8-7d87879d79fa for instance 536736b4-5253-4e25-a748-6ee4c8f94346 on n-h2-839401-11 Aug 29 17:08:59.611569 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-14335bf5-a4f3-4a76-9cc7-494eb777e369 req-893b6e96-5ce2-4ba0-9414-161bf52f6c9c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108836 Aug 29 17:08:59.612591 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4355/8489] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:09:13.391760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:09:13.392519 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:09:13.397517 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-696453330", "imageRef": "4dd99de5-8dd2-4344-90fc-bc1808507894", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-365291319", "security_groups": [{"name": "tempest-secgroup-smoke-1118436863"}], "networks": [{"uuid": "3fe7ab89-7ebd-4ce4-8ce1-df82ffc5ba77"}]}} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:09:13.422304 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] [eda7f439-560f-4fda-a0c4-47b93d5f6cfd] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 44488. Aug 29 17:09:13.422983 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] [564df600-0953-4421-a68a-24b5a0a40919] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 44486. Aug 29 17:09:13.510397 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.network.neutron [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] validate_networks() for [('3fe7ab89-7ebd-4ce4-8ce1-df82ffc5ba77', None, None, None, None, None)] {{(pid=122361) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 17:09:13.921651 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Flavor limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 17:09:13.922104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Image limits 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 17:09:13.922607 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Flavor pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 17:09:13.923022 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Image pref 0:0:0 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 17:09:13.923438 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.virt.hardware [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 17:09:13.933824 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:13.934319 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:13.934760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:13.935500 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:13.935964 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:13.936396 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:13.954613 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Getting quotas for project b1489464a7ad432e8da0068bb43a787e. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 17:09:13.960311 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.quota [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Getting quotas for user 44ec90cb493b488f98e901f0faf316f7 and project b1489464a7ad432e8da0068bb43a787e. Resources: {'ram', 'instances', 'cores'} {{(pid=122361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 17:09:13.974759 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Going to run 1 instances... {{(pid=122361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 17:09:13.977321 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dd99de5-8dd2-4344-90fc-bc1808507894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 17:09:14.030212 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bb50afb3-d6b1-4f4d-afe4-0927dbd87764 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.640670 Aug 29 17:09:14.030893 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4135/8490] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 17:09:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 17:09:14.042975 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-610ff129-67c6-4035-8c60-f55e42839c4b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:14.043977 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-610ff129-67c6-4035-8c60-f55e42839c4b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:14.049430 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:09:14.050696 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:09:14.072456 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] [603d2cc2-3ad6-4419-8622-2fba015025b5] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 44502. Aug 29 17:09:14.074991 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [-] [edb16f3c-d8bd-4396-8d00-d7897b8393bf] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 44504. Aug 29 17:09:14.124361 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-610ff129-67c6-4035-8c60-f55e42839c4b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:14.133185 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-610ff129-67c6-4035-8c60-f55e42839c4b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1247 microversion: 2.1 time: 0.094268 Aug 29 17:09:14.133384 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4356/8491] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:14 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1247 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:15.158788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-aa206750-e9ec-4438-896c-21600b2df7ef tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:15.158788 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-aa206750-e9ec-4438-896c-21600b2df7ef tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:15.162854 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa206750-e9ec-4438-896c-21600b2df7ef tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:15.163348 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa206750-e9ec-4438-896c-21600b2df7ef tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:15.163753 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa206750-e9ec-4438-896c-21600b2df7ef tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:15.164476 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa206750-e9ec-4438-896c-21600b2df7ef tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:15.164929 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa206750-e9ec-4438-896c-21600b2df7ef tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:15.165387 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-aa206750-e9ec-4438-896c-21600b2df7ef tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:15.233957 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-aa206750-e9ec-4438-896c-21600b2df7ef tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:15.242584 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-aa206750-e9ec-4438-896c-21600b2df7ef tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1299 microversion: 2.1 time: 0.092981 Aug 29 17:09:15.243596 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4136/8492] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:15 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:16.265027 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-2e9d4372-9ec1-4d86-b35e-d034cee2504f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:16.266786 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-2e9d4372-9ec1-4d86-b35e-d034cee2504f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:16.280837 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e9d4372-9ec1-4d86-b35e-d034cee2504f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:16.283904 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e9d4372-9ec1-4d86-b35e-d034cee2504f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:16.284684 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e9d4372-9ec1-4d86-b35e-d034cee2504f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:16.285800 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e9d4372-9ec1-4d86-b35e-d034cee2504f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:16.286630 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e9d4372-9ec1-4d86-b35e-d034cee2504f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:16.289880 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-2e9d4372-9ec1-4d86-b35e-d034cee2504f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:16.466017 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-2e9d4372-9ec1-4d86-b35e-d034cee2504f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:16.474878 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-2e9d4372-9ec1-4d86-b35e-d034cee2504f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1373 microversion: 2.1 time: 0.214579 Aug 29 17:09:16.492866 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4357/8493] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:16 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1373 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:17.503747 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-313e6643-96aa-48b1-960f-4f3c657f0d11 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:17.504376 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-313e6643-96aa-48b1-960f-4f3c657f0d11 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:17.517371 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-313e6643-96aa-48b1-960f-4f3c657f0d11 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:17.518470 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-313e6643-96aa-48b1-960f-4f3c657f0d11 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:17.519241 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-313e6643-96aa-48b1-960f-4f3c657f0d11 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:17.520385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-313e6643-96aa-48b1-960f-4f3c657f0d11 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:17.521117 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-313e6643-96aa-48b1-960f-4f3c657f0d11 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:17.521840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-313e6643-96aa-48b1-960f-4f3c657f0d11 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:17.600540 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-f9ed9b36-14b8-43c1-98cb-0a78283bb3e1 req-841167ec-7135-424f-ae0a-af50bf14430b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536736b4-5253-4e25-a748-6ee4c8f94346", "name": "network-vif-unplugged", "status": "completed", "tag": "f7e9e999-561d-4d2f-9ad8-7d87879d79fa"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:09:17.618621 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f9ed9b36-14b8-43c1-98cb-0a78283bb3e1 req-841167ec-7135-424f-ae0a-af50bf14430b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:17.619203 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f9ed9b36-14b8-43c1-98cb-0a78283bb3e1 req-841167ec-7135-424f-ae0a-af50bf14430b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:17.620149 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-f9ed9b36-14b8-43c1-98cb-0a78283bb3e1 req-841167ec-7135-424f-ae0a-af50bf14430b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:17.635146 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-f9ed9b36-14b8-43c1-98cb-0a78283bb3e1 req-841167ec-7135-424f-ae0a-af50bf14430b service nova] Creating event network-vif-unplugged:f7e9e999-561d-4d2f-9ad8-7d87879d79fa for instance 536736b4-5253-4e25-a748-6ee4c8f94346 on n-h2-839401-11 Aug 29 17:09:17.640912 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-f9ed9b36-14b8-43c1-98cb-0a78283bb3e1 req-841167ec-7135-424f-ae0a-af50bf14430b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044263 Aug 29 17:09:17.642484 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4358/8494] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 17:09:17.713993 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-313e6643-96aa-48b1-960f-4f3c657f0d11 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:17.722383 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-313e6643-96aa-48b1-960f-4f3c657f0d11 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1373 microversion: 2.1 time: 0.225771 Aug 29 17:09:17.735861 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4137/8495] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:17 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1373 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:18.745110 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-962f9f1c-c6e6-41a1-af15-57676f6626ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:18.745839 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-962f9f1c-c6e6-41a1-af15-57676f6626ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:18.753570 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-962f9f1c-c6e6-41a1-af15-57676f6626ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:18.754070 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-962f9f1c-c6e6-41a1-af15-57676f6626ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:18.754519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-962f9f1c-c6e6-41a1-af15-57676f6626ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:18.755589 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-962f9f1c-c6e6-41a1-af15-57676f6626ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:18.756216 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-962f9f1c-c6e6-41a1-af15-57676f6626ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:18.756726 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-962f9f1c-c6e6-41a1-af15-57676f6626ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:18.913190 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-962f9f1c-c6e6-41a1-af15-57676f6626ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:18.922054 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-962f9f1c-c6e6-41a1-af15-57676f6626ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1373 microversion: 2.1 time: 0.181579 Aug 29 17:09:18.922873 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4359/8496] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:18 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 17:09:19.946457 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-eae61699-e006-46c3-bd2c-8474c026bde8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:19.947092 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-eae61699-e006-46c3-bd2c-8474c026bde8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:19.956181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eae61699-e006-46c3-bd2c-8474c026bde8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:19.956687 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eae61699-e006-46c3-bd2c-8474c026bde8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:19.957154 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eae61699-e006-46c3-bd2c-8474c026bde8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:19.957891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eae61699-e006-46c3-bd2c-8474c026bde8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:19.958352 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eae61699-e006-46c3-bd2c-8474c026bde8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:19.958779 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-eae61699-e006-46c3-bd2c-8474c026bde8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:20.115787 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-eae61699-e006-46c3-bd2c-8474c026bde8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:20.124852 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-eae61699-e006-46c3-bd2c-8474c026bde8 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1373 microversion: 2.1 time: 0.185040 Aug 29 17:09:20.126339 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4138/8497] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:19 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1373 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:21.146106 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-f9061681-202b-4548-8093-15a39841022f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:21.146780 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-f9061681-202b-4548-8093-15a39841022f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:21.154219 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f9061681-202b-4548-8093-15a39841022f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:21.154718 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f9061681-202b-4548-8093-15a39841022f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:21.155194 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f9061681-202b-4548-8093-15a39841022f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:21.155925 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f9061681-202b-4548-8093-15a39841022f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:21.156646 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f9061681-202b-4548-8093-15a39841022f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:21.157375 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-f9061681-202b-4548-8093-15a39841022f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:21.314746 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-f9061681-202b-4548-8093-15a39841022f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:21.324004 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-f9061681-202b-4548-8093-15a39841022f tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1373 microversion: 2.1 time: 0.181934 Aug 29 17:09:21.324604 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4360/8498] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:21 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:22.344618 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-3b880c56-87df-4ebf-8cd8-a7b068778760 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:22.345374 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-3b880c56-87df-4ebf-8cd8-a7b068778760 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:22.355182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b880c56-87df-4ebf-8cd8-a7b068778760 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:22.355672 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b880c56-87df-4ebf-8cd8-a7b068778760 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:22.356104 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b880c56-87df-4ebf-8cd8-a7b068778760 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:22.356823 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b880c56-87df-4ebf-8cd8-a7b068778760 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:22.357336 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b880c56-87df-4ebf-8cd8-a7b068778760 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:22.357798 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-3b880c56-87df-4ebf-8cd8-a7b068778760 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:22.519024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-3b880c56-87df-4ebf-8cd8-a7b068778760 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:22.527376 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-3b880c56-87df-4ebf-8cd8-a7b068778760 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1373 microversion: 2.1 time: 0.186595 Aug 29 17:09:22.527984 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4139/8499] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:22 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1373 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:23.552981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-4fcc5443-22c2-43fb-bc72-2801f5014d8b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:23.553829 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-4fcc5443-22c2-43fb-bc72-2801f5014d8b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:23.561420 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fcc5443-22c2-43fb-bc72-2801f5014d8b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:23.561940 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fcc5443-22c2-43fb-bc72-2801f5014d8b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:23.562394 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fcc5443-22c2-43fb-bc72-2801f5014d8b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:23.563130 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fcc5443-22c2-43fb-bc72-2801f5014d8b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:23.563625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fcc5443-22c2-43fb-bc72-2801f5014d8b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:23.564067 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-4fcc5443-22c2-43fb-bc72-2801f5014d8b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:23.718860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-4fcc5443-22c2-43fb-bc72-2801f5014d8b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:23.727610 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-4fcc5443-22c2-43fb-bc72-2801f5014d8b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1373 microversion: 2.1 time: 0.178941 Aug 29 17:09:23.728229 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4361/8500] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:23 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:24.749877 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a2baa5aa-ddfc-4fec-b58d-79c456dc027b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:24.750801 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a2baa5aa-ddfc-4fec-b58d-79c456dc027b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:24.753295 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:09:24.753963 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell0:SELECT=6 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:09:24.760087 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2baa5aa-ddfc-4fec-b58d-79c456dc027b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:24.760600 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2baa5aa-ddfc-4fec-b58d-79c456dc027b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:24.761325 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2baa5aa-ddfc-4fec-b58d-79c456dc027b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:24.763892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2baa5aa-ddfc-4fec-b58d-79c456dc027b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:24.763892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2baa5aa-ddfc-4fec-b58d-79c456dc027b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:24.763892 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a2baa5aa-ddfc-4fec-b58d-79c456dc027b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:24.920173 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a2baa5aa-ddfc-4fec-b58d-79c456dc027b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:24.929686 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a2baa5aa-ddfc-4fec-b58d-79c456dc027b tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1373 microversion: 2.1 time: 0.183759 Aug 29 17:09:24.930332 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4140/8501] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:24 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1373 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:25.956092 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-89f1a5c9-22da-4b94-ab61-f0cbd65658e5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:25.957299 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-89f1a5c9-22da-4b94-ab61-f0cbd65658e5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:25.960887 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell0:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:09:25.972936 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89f1a5c9-22da-4b94-ab61-f0cbd65658e5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:25.973937 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89f1a5c9-22da-4b94-ab61-f0cbd65658e5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:25.974727 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89f1a5c9-22da-4b94-ab61-f0cbd65658e5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:25.975750 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89f1a5c9-22da-4b94-ab61-f0cbd65658e5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:25.976456 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89f1a5c9-22da-4b94-ab61-f0cbd65658e5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:25.977293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-89f1a5c9-22da-4b94-ab61-f0cbd65658e5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:26.120140 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-89f1a5c9-22da-4b94-ab61-f0cbd65658e5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:26.128838 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-89f1a5c9-22da-4b94-ab61-f0cbd65658e5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1373 microversion: 2.1 time: 0.181682 Aug 29 17:09:26.130058 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4362/8502] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:25 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:26.497109 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-28090da9-ae51-4445-9c2b-4acd3ec3c091 req-5af1b83f-4a2c-4cdc-bbd2-e7329545e93b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4019e14-d0da-4d23-95aa-a322d2c1b8e2", "tag": "5fe31056-369d-4353-94f1-9c381d224728"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:09:26.507840 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-28090da9-ae51-4445-9c2b-4acd3ec3c091 req-5af1b83f-4a2c-4cdc-bbd2-e7329545e93b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:26.508320 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-28090da9-ae51-4445-9c2b-4acd3ec3c091 req-5af1b83f-4a2c-4cdc-bbd2-e7329545e93b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:26.508752 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-28090da9-ae51-4445-9c2b-4acd3ec3c091 req-5af1b83f-4a2c-4cdc-bbd2-e7329545e93b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:26.521046 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-28090da9-ae51-4445-9c2b-4acd3ec3c091 req-5af1b83f-4a2c-4cdc-bbd2-e7329545e93b service nova] Creating event network-changed:5fe31056-369d-4353-94f1-9c381d224728 for instance f4019e14-d0da-4d23-95aa-a322d2c1b8e2 on n-h1-839401-11 Aug 29 17:09:26.531416 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-28090da9-ae51-4445-9c2b-4acd3ec3c091 req-5af1b83f-4a2c-4cdc-bbd2-e7329545e93b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107510 Aug 29 17:09:26.531416 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4141/8503] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:09:27.150273 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7325f5d4-731e-4905-b859-c1a259cd8085 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:27.150867 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7325f5d4-731e-4905-b859-c1a259cd8085 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:27.158763 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7325f5d4-731e-4905-b859-c1a259cd8085 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:27.159265 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7325f5d4-731e-4905-b859-c1a259cd8085 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:27.159712 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7325f5d4-731e-4905-b859-c1a259cd8085 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:27.160519 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7325f5d4-731e-4905-b859-c1a259cd8085 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:27.161187 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7325f5d4-731e-4905-b859-c1a259cd8085 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:27.161638 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7325f5d4-731e-4905-b859-c1a259cd8085 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:27.311353 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7325f5d4-731e-4905-b859-c1a259cd8085 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:27.320177 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7325f5d4-731e-4905-b859-c1a259cd8085 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1373 microversion: 2.1 time: 0.173852 Aug 29 17:09:27.320763 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4363/8504] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:27 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:28.342783 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-a915d4d9-3fb9-4b8a-901c-9553928c59a2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:28.343434 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-a915d4d9-3fb9-4b8a-901c-9553928c59a2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:28.351541 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a915d4d9-3fb9-4b8a-901c-9553928c59a2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:28.352181 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a915d4d9-3fb9-4b8a-901c-9553928c59a2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:28.352822 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a915d4d9-3fb9-4b8a-901c-9553928c59a2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:28.353969 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a915d4d9-3fb9-4b8a-901c-9553928c59a2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:28.354635 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a915d4d9-3fb9-4b8a-901c-9553928c59a2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:28.355232 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-a915d4d9-3fb9-4b8a-901c-9553928c59a2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:28.504205 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-a915d4d9-3fb9-4b8a-901c-9553928c59a2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:28.514355 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-a915d4d9-3fb9-4b8a-901c-9553928c59a2 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1373 microversion: 2.1 time: 0.176612 Aug 29 17:09:28.515112 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4142/8505] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:28 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:29.536137 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-7f03356a-712f-4578-9cc9-cf7c6b4dded5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:29.536740 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-7f03356a-712f-4578-9cc9-cf7c6b4dded5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:29.545438 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f03356a-712f-4578-9cc9-cf7c6b4dded5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:29.546293 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f03356a-712f-4578-9cc9-cf7c6b4dded5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:29.546784 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f03356a-712f-4578-9cc9-cf7c6b4dded5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:29.547506 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f03356a-712f-4578-9cc9-cf7c6b4dded5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:29.547999 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f03356a-712f-4578-9cc9-cf7c6b4dded5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:29.548449 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-7f03356a-712f-4578-9cc9-cf7c6b4dded5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:29.689542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-7f03356a-712f-4578-9cc9-cf7c6b4dded5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:29.698150 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-7f03356a-712f-4578-9cc9-cf7c6b4dded5 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1373 microversion: 2.1 time: 0.165973 Aug 29 17:09:29.698780 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4364/8506] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:29 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:30.727270 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-84f64c3e-d8d7-441d-bf3c-b2f3c3813c59 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:30.727895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-84f64c3e-d8d7-441d-bf3c-b2f3c3813c59 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:30.735309 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f64c3e-d8d7-441d-bf3c-b2f3c3813c59 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:30.735809 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f64c3e-d8d7-441d-bf3c-b2f3c3813c59 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:30.736304 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f64c3e-d8d7-441d-bf3c-b2f3c3813c59 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:30.737023 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f64c3e-d8d7-441d-bf3c-b2f3c3813c59 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:30.737562 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f64c3e-d8d7-441d-bf3c-b2f3c3813c59 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:30.737999 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-84f64c3e-d8d7-441d-bf3c-b2f3c3813c59 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:30.880835 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-84f64c3e-d8d7-441d-bf3c-b2f3c3813c59 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:30.891171 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-84f64c3e-d8d7-441d-bf3c-b2f3c3813c59 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1373 microversion: 2.1 time: 0.167913 Aug 29 17:09:30.891804 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4143/8507] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:30 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:31.912491 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-b9941e72-c3da-4e39-80ec-44a0514eee40 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:31.913159 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-b9941e72-c3da-4e39-80ec-44a0514eee40 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:31.920859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9941e72-c3da-4e39-80ec-44a0514eee40 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:31.921397 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9941e72-c3da-4e39-80ec-44a0514eee40 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:31.921855 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9941e72-c3da-4e39-80ec-44a0514eee40 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:31.922590 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9941e72-c3da-4e39-80ec-44a0514eee40 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:31.923069 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9941e72-c3da-4e39-80ec-44a0514eee40 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:31.923517 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-b9941e72-c3da-4e39-80ec-44a0514eee40 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:32.065632 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-b9941e72-c3da-4e39-80ec-44a0514eee40 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:32.075733 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-b9941e72-c3da-4e39-80ec-44a0514eee40 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1373 microversion: 2.1 time: 0.167094 Aug 29 17:09:32.076537 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4365/8508] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:31 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:32.594195 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-9357ee96-f934-4a26-b66f-543a6a84e768 req-6eb92eac-e9ce-43f6-8834-69d8b71768d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4019e14-d0da-4d23-95aa-a322d2c1b8e2", "name": "network-vif-plugged", "status": "completed", "tag": "5fe31056-369d-4353-94f1-9c381d224728"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:09:32.605524 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9357ee96-f934-4a26-b66f-543a6a84e768 req-6eb92eac-e9ce-43f6-8834-69d8b71768d4 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:32.606016 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9357ee96-f934-4a26-b66f-543a6a84e768 req-6eb92eac-e9ce-43f6-8834-69d8b71768d4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:32.607178 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-9357ee96-f934-4a26-b66f-543a6a84e768 req-6eb92eac-e9ce-43f6-8834-69d8b71768d4 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:32.621553 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-9357ee96-f934-4a26-b66f-543a6a84e768 req-6eb92eac-e9ce-43f6-8834-69d8b71768d4 service nova] Creating event network-vif-plugged:5fe31056-369d-4353-94f1-9c381d224728 for instance f4019e14-d0da-4d23-95aa-a322d2c1b8e2 on n-h1-839401-11 Aug 29 17:09:32.626932 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-9357ee96-f934-4a26-b66f-543a6a84e768 req-6eb92eac-e9ce-43f6-8834-69d8b71768d4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036509 Aug 29 17:09:32.627569 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4144/8509] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:09:33.101499 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-5f044088-0fa3-42bc-b70f-508b933b587a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:33.102459 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-5f044088-0fa3-42bc-b70f-508b933b587a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:33.113532 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f044088-0fa3-42bc-b70f-508b933b587a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:33.114113 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f044088-0fa3-42bc-b70f-508b933b587a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:33.114597 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f044088-0fa3-42bc-b70f-508b933b587a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:33.115297 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f044088-0fa3-42bc-b70f-508b933b587a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:33.115768 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f044088-0fa3-42bc-b70f-508b933b587a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:33.116200 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-5f044088-0fa3-42bc-b70f-508b933b587a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:33.268669 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-5f044088-0fa3-42bc-b70f-508b933b587a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:33.276879 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-5f044088-0fa3-42bc-b70f-508b933b587a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1373 microversion: 2.1 time: 0.182406 Aug 29 17:09:33.277500 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4366/8510] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:33 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:34.299024 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-bdd1a1ce-aa59-4744-aaa7-b0ff9f3314fb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:34.300101 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-bdd1a1ce-aa59-4744-aaa7-b0ff9f3314fb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:34.306913 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bdd1a1ce-aa59-4744-aaa7-b0ff9f3314fb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:34.307405 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bdd1a1ce-aa59-4744-aaa7-b0ff9f3314fb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:34.307847 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bdd1a1ce-aa59-4744-aaa7-b0ff9f3314fb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:34.308545 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bdd1a1ce-aa59-4744-aaa7-b0ff9f3314fb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:34.309005 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bdd1a1ce-aa59-4744-aaa7-b0ff9f3314fb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:34.309472 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-bdd1a1ce-aa59-4744-aaa7-b0ff9f3314fb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:34.446760 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-bdd1a1ce-aa59-4744-aaa7-b0ff9f3314fb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:34.454859 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-bdd1a1ce-aa59-4744-aaa7-b0ff9f3314fb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1557 microversion: 2.1 time: 0.161132 Aug 29 17:09:34.455443 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4145/8511] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:34 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:34.477714 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-ef7fb87b-881c-496a-90fd-d8376f879bd1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:09:34.478542 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-ef7fb87b-881c-496a-90fd-d8376f879bd1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:09:34.488981 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef7fb87b-881c-496a-90fd-d8376f879bd1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:34.489521 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef7fb87b-881c-496a-90fd-d8376f879bd1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:34.489973 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef7fb87b-881c-496a-90fd-d8376f879bd1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:34.490697 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef7fb87b-881c-496a-90fd-d8376f879bd1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:34.491181 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef7fb87b-881c-496a-90fd-d8376f879bd1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:34.491625 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-ef7fb87b-881c-496a-90fd-d8376f879bd1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:34.648108 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-ef7fb87b-881c-496a-90fd-d8376f879bd1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:09:34.656298 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-ef7fb87b-881c-496a-90fd-d8376f879bd1 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1557 microversion: 2.1 time: 0.184714 Aug 29 17:09:34.656898 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4367/8512] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:09:34 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1557 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:09:36.413071 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-0ccc9ddb-3d3e-40b8-9f37-b77ac2ce1675 req-dc3b69ab-07f6-4759-b780-b68294f9538e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4019e14-d0da-4d23-95aa-a322d2c1b8e2", "tag": "5fe31056-369d-4353-94f1-9c381d224728"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:09:36.423611 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0ccc9ddb-3d3e-40b8-9f37-b77ac2ce1675 req-dc3b69ab-07f6-4759-b780-b68294f9538e service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:09:36.424094 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0ccc9ddb-3d3e-40b8-9f37-b77ac2ce1675 req-dc3b69ab-07f6-4759-b780-b68294f9538e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:09:36.424526 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-0ccc9ddb-3d3e-40b8-9f37-b77ac2ce1675 req-dc3b69ab-07f6-4759-b780-b68294f9538e service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:09:36.436730 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-0ccc9ddb-3d3e-40b8-9f37-b77ac2ce1675 req-dc3b69ab-07f6-4759-b780-b68294f9538e service nova] Creating event network-changed:5fe31056-369d-4353-94f1-9c381d224728 for instance f4019e14-d0da-4d23-95aa-a322d2c1b8e2 on n-h1-839401-11 Aug 29 17:09:36.442254 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-0ccc9ddb-3d3e-40b8-9f37-b77ac2ce1675 req-dc3b69ab-07f6-4759-b780-b68294f9538e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033095 Aug 29 17:09:36.442921 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4146/8513] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:11:53.100169 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=26 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:11:53.101412 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=62 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:11:53.175207 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-e0455564-8c22-44ff-b954-102a73fd6f5a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-376222515"}} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:11:53.179162 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-e0455564-8c22-44ff-b954-102a73fd6f5a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:11:53.186719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0455564-8c22-44ff-b954-102a73fd6f5a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:11:53.187228 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0455564-8c22-44ff-b954-102a73fd6f5a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:11:53.187679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0455564-8c22-44ff-b954-102a73fd6f5a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:11:53.188388 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0455564-8c22-44ff-b954-102a73fd6f5a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:11:53.188859 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0455564-8c22-44ff-b954-102a73fd6f5a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:11:53.189332 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-e0455564-8c22-44ff-b954-102a73fd6f5a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:11:53.469435 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-e0455564-8c22-44ff-b954-102a73fd6f5a tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "POST /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2/action" status: 202 len: 0 microversion: 2.1 time: 0.373065 Aug 29 17:11:53.470116 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4368/8514] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 17:11:53 2022] POST /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 17:12:01.118613 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eda7f439-560f-4fda-a0c4-47b93d5f6cfd] AMQP server on 10.222.0.62:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 17:12:01.119588 n-d-839401-11 devstack@n-api.service[122361]: ERROR oslo.messaging._drivers.impl_rabbit [-] [564df600-0953-4421-a68a-24b5a0a40919] AMQP server on 10.222.0.62:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 17:12:01.120385 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:01.121326 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=56 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:01.122434 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 17:12:01.122622 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 17:12:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Aug 29 17:12:01.123678 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 17:12:01.123804 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 17:12:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Aug 29 17:12:01.124991 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 17:12:01.125149 n-d-839401-11 devstack@n-api.service[122361]: Mon Aug 29 17:12:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Aug 29 17:12:01.136756 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-debad7b0-f8b6-4c0f-86b9-299124e81b58 req-d97c4283-8503-4985-895c-efa2ab402bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4019e14-d0da-4d23-95aa-a322d2c1b8e2", "name": "network-vif-plugged", "status": "completed", "tag": "5fe31056-369d-4353-94f1-9c381d224728"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:12:01.155484 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-debad7b0-f8b6-4c0f-86b9-299124e81b58 req-d97c4283-8503-4985-895c-efa2ab402bd1 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:01.156329 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-debad7b0-f8b6-4c0f-86b9-299124e81b58 req-d97c4283-8503-4985-895c-efa2ab402bd1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:01.157014 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-debad7b0-f8b6-4c0f-86b9-299124e81b58 req-d97c4283-8503-4985-895c-efa2ab402bd1 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:01.172060 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-debad7b0-f8b6-4c0f-86b9-299124e81b58 req-d97c4283-8503-4985-895c-efa2ab402bd1 service nova] Creating event network-vif-plugged:5fe31056-369d-4353-94f1-9c381d224728 for instance f4019e14-d0da-4d23-95aa-a322d2c1b8e2 on n-h1-839401-11 Aug 29 17:12:01.182299 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-debad7b0-f8b6-4c0f-86b9-299124e81b58 req-d97c4283-8503-4985-895c-efa2ab402bd1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065429 Aug 29 17:12:01.183248 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4147/8515] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:12:11.649241 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-42060dc7-f49f-498a-879c-f8dec599b0ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:11.650554 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-42060dc7-f49f-498a-879c-f8dec599b0ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:11.655365 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_api:SELECT=2 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:11.656806 n-d-839401-11 devstack@n-api.service[122360]: DEBUG dbcounter [-] [122360] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:11.657719 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_cell1:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:11.659805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG dbcounter [-] [122361] Writing DB stats nova_api:SELECT=2 {{(pid=122361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:11.663641 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42060dc7-f49f-498a-879c-f8dec599b0ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:11.664719 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42060dc7-f49f-498a-879c-f8dec599b0ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:11.665500 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42060dc7-f49f-498a-879c-f8dec599b0ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:11.677202 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42060dc7-f49f-498a-879c-f8dec599b0ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:11.678240 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] [564df600-0953-4421-a68a-24b5a0a40919] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 44840. Aug 29 17:12:11.679731 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42060dc7-f49f-498a-879c-f8dec599b0ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:11.680120 n-d-839401-11 devstack@n-api.service[122361]: INFO oslo.messaging._drivers.impl_rabbit [-] [eda7f439-560f-4fda-a0c4-47b93d5f6cfd] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 44838. Aug 29 17:12:11.680281 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-42060dc7-f49f-498a-879c-f8dec599b0ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:11.713941 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-42060dc7-f49f-498a-879c-f8dec599b0ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Going to try to terminate instance {{(pid=122360) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 17:12:11.748279 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-b1cb8dda-ab77-4e57-972f-866191d375ab req-4dfae96d-8840-4e12-8680-56266f50b77b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4019e14-d0da-4d23-95aa-a322d2c1b8e2", "tag": "5fe31056-369d-4353-94f1-9c381d224728"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:12:11.762182 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b1cb8dda-ab77-4e57-972f-866191d375ab req-4dfae96d-8840-4e12-8680-56266f50b77b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:11.763365 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b1cb8dda-ab77-4e57-972f-866191d375ab req-4dfae96d-8840-4e12-8680-56266f50b77b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:11.763991 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-b1cb8dda-ab77-4e57-972f-866191d375ab req-4dfae96d-8840-4e12-8680-56266f50b77b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:11.777786 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-b1cb8dda-ab77-4e57-972f-866191d375ab req-4dfae96d-8840-4e12-8680-56266f50b77b service nova] Creating event network-changed:5fe31056-369d-4353-94f1-9c381d224728 for instance f4019e14-d0da-4d23-95aa-a322d2c1b8e2 on n-h1-839401-11 Aug 29 17:12:11.783814 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-b1cb8dda-ab77-4e57-972f-866191d375ab req-4dfae96d-8840-4e12-8680-56266f50b77b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140392 Aug 29 17:12:11.785064 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4148/8516] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:12:11.813541 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-42060dc7-f49f-498a-879c-f8dec599b0ab tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 204 len: 0 microversion: 2.1 time: 0.172030 Aug 29 17:12:11.814169 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4369/8517] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 17:12:11 2022] DELETE /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 17:12:11.826246 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7f8fcde7-3281-4caa-863d-fc3863000e13 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:11.827770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7f8fcde7-3281-4caa-863d-fc3863000e13 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:11.836770 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f8fcde7-3281-4caa-863d-fc3863000e13 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:11.837831 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f8fcde7-3281-4caa-863d-fc3863000e13 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:11.838479 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f8fcde7-3281-4caa-863d-fc3863000e13 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:11.839673 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f8fcde7-3281-4caa-863d-fc3863000e13 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:11.840458 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f8fcde7-3281-4caa-863d-fc3863000e13 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:11.841218 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7f8fcde7-3281-4caa-863d-fc3863000e13 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:12.072357 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-7f8fcde7-3281-4caa-863d-fc3863000e13 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:12:12.082059 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7f8fcde7-3281-4caa-863d-fc3863000e13 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1680 microversion: 2.1 time: 0.262284 Aug 29 17:12:12.082959 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4149/8518] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:12:11 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1680 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 17:12:13.106755 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-aa23eb94-19b1-4940-8d04-12b620b3319d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:13.107479 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-aa23eb94-19b1-4940-8d04-12b620b3319d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:13.114920 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa23eb94-19b1-4940-8d04-12b620b3319d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:13.115441 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa23eb94-19b1-4940-8d04-12b620b3319d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:13.115915 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa23eb94-19b1-4940-8d04-12b620b3319d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:13.116629 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa23eb94-19b1-4940-8d04-12b620b3319d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:13.117127 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa23eb94-19b1-4940-8d04-12b620b3319d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:13.117579 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-aa23eb94-19b1-4940-8d04-12b620b3319d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:13.145644 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [req-f8dc0d49-49f9-4d2a-8a3b-5dd5edb65946 req-644a8028-cc88-407e-ace9-7dd36820017f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4019e14-d0da-4d23-95aa-a322d2c1b8e2", "name": "network-vif-unplugged", "status": "completed", "tag": "5fe31056-369d-4353-94f1-9c381d224728"}]} {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:12:13.159891 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f8dc0d49-49f9-4d2a-8a3b-5dd5edb65946 req-644a8028-cc88-407e-ace9-7dd36820017f service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:13.160772 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f8dc0d49-49f9-4d2a-8a3b-5dd5edb65946 req-644a8028-cc88-407e-ace9-7dd36820017f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:13.161665 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [req-f8dc0d49-49f9-4d2a-8a3b-5dd5edb65946 req-644a8028-cc88-407e-ace9-7dd36820017f service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:13.175514 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.compute.server_external_events [req-f8dc0d49-49f9-4d2a-8a3b-5dd5edb65946 req-644a8028-cc88-407e-ace9-7dd36820017f service nova] Creating event network-vif-unplugged:5fe31056-369d-4353-94f1-9c381d224728 for instance f4019e14-d0da-4d23-95aa-a322d2c1b8e2 on n-h1-839401-11 Aug 29 17:12:13.183217 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [req-f8dc0d49-49f9-4d2a-8a3b-5dd5edb65946 req-644a8028-cc88-407e-ace9-7dd36820017f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041371 Aug 29 17:12:13.184795 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4150/8519] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:12:13.273894 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-aa23eb94-19b1-4940-8d04-12b620b3319d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:12:13.281928 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-aa23eb94-19b1-4940-8d04-12b620b3319d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1680 microversion: 2.1 time: 0.179811 Aug 29 17:12:13.282492 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4370/8520] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:12:13 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:12:14.310508 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-e0928fc6-80ea-4dba-993f-35a2a583cf7e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:14.311354 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-e0928fc6-80ea-4dba-993f-35a2a583cf7e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:14.324567 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-ff85c457-3a8b-4e78-a85d-dc9e49f4b4e4 req-ea4b8519-efa8-487a-a240-8faae3ee9b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4019e14-d0da-4d23-95aa-a322d2c1b8e2", "name": "network-vif-deleted", "tag": "5fe31056-369d-4353-94f1-9c381d224728"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:12:14.325224 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0928fc6-80ea-4dba-993f-35a2a583cf7e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:14.325395 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0928fc6-80ea-4dba-993f-35a2a583cf7e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:14.325805 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0928fc6-80ea-4dba-993f-35a2a583cf7e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:14.326577 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0928fc6-80ea-4dba-993f-35a2a583cf7e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:14.327006 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0928fc6-80ea-4dba-993f-35a2a583cf7e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:14.327495 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-e0928fc6-80ea-4dba-993f-35a2a583cf7e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:14.334954 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ff85c457-3a8b-4e78-a85d-dc9e49f4b4e4 req-ea4b8519-efa8-487a-a240-8faae3ee9b5b service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:14.335446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ff85c457-3a8b-4e78-a85d-dc9e49f4b4e4 req-ea4b8519-efa8-487a-a240-8faae3ee9b5b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:14.335891 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-ff85c457-3a8b-4e78-a85d-dc9e49f4b4e4 req-ea4b8519-efa8-487a-a240-8faae3ee9b5b service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:14.348935 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-ff85c457-3a8b-4e78-a85d-dc9e49f4b4e4 req-ea4b8519-efa8-487a-a240-8faae3ee9b5b service nova] Creating event network-vif-deleted:5fe31056-369d-4353-94f1-9c381d224728 for instance f4019e14-d0da-4d23-95aa-a322d2c1b8e2 on n-h1-839401-11 Aug 29 17:12:14.354516 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-ff85c457-3a8b-4e78-a85d-dc9e49f4b4e4 req-ea4b8519-efa8-487a-a240-8faae3ee9b5b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034041 Aug 29 17:12:14.355252 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4371/8521] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 17:12:14.394274 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-e0928fc6-80ea-4dba-993f-35a2a583cf7e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:12:14.402552 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-e0928fc6-80ea-4dba-993f-35a2a583cf7e tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 200 len: 1495 microversion: 2.1 time: 0.101826 Aug 29 17:12:14.403205 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4151/8522] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:12:14 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 1495 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:12:15.429446 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6d41279f-88e2-47d7-a677-4322ff4aaeb6 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:15.430061 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-6d41279f-88e2-47d7-a677-4322ff4aaeb6 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: f4019e14-d0da-4d23-95aa-a322d2c1b8e2] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:15.436921 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d41279f-88e2-47d7-a677-4322ff4aaeb6 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:15.437472 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d41279f-88e2-47d7-a677-4322ff4aaeb6 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:15.437943 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d41279f-88e2-47d7-a677-4322ff4aaeb6 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:15.438679 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d41279f-88e2-47d7-a677-4322ff4aaeb6 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:15.439474 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d41279f-88e2-47d7-a677-4322ff4aaeb6 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:15.440022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-6d41279f-88e2-47d7-a677-4322ff4aaeb6 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:15.457886 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.wsgi [None req-6d41279f-88e2-47d7-a677-4322ff4aaeb6 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] HTTP exception thrown: Instance f4019e14-d0da-4d23-95aa-a322d2c1b8e2 could not be found. Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6d41279f-88e2-47d7-a677-4322ff4aaeb6 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Request method failure captured: Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: request: GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 HTTP/1.1 Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: Accept: application/json Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: Accept-Encoding: identity Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: Connection: close Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: Content-Length: 0 Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: Content-Type: application/json Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: Host: 10.222.0.62 Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: Openstack-System-Scope: None Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: User-Agent: python-urllib3/1.26.12 Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-Auth-Token: gAAAAABjDPHjP7CdJItIslOVYFll1KXZdl4WfB2lPKx7j0iZ5q5Sjo1TqfjBlxnqWgAmeUTDl3ms7D2XSlc6rlSjJFhsfbVeghGYjloU3nfULiYimMERwLnCdVsSl4tOFhDK5KoBiIZ_YcYxyEODt8bPVHMA3e5ZOvMDc5-79FO8y1E8EGbT3o0 Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Id: None Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-Domain-Name: None Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-Identity-Status: Confirmed Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-Is-Admin-Project: True Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Id: default Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Domain-Name: Default Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Id: b1489464a7ad432e8da0068bb43a787e Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-Project-Name: tempest-TestSnapshotPattern-562917034 Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-Role: reader,member Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-Roles: reader,member Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b1489464a7ad432e8da0068bb43a787e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b1489464a7ad432e8da0068bb43a787e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1489464a7ad432e8da0068bb43a787e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1489464a7ad432e8da0068bb43a787e"}]}] Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant: tempest-TestSnapshotPattern-562917034 Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Id: b1489464a7ad432e8da0068bb43a787e Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-Tenant-Name: tempest-TestSnapshotPattern-562917034 Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-User: tempest-TestSnapshotPattern-562917034-project Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Id: default Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-User-Domain-Name: Default Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-User-Id: 44ec90cb493b488f98e901f0faf316f7 Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: X-User-Name: tempest-TestSnapshotPattern-562917034-project Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: method: > Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: exception: Instance f4019e14-d0da-4d23-95aa-a322d2c1b8e2 could not be found. Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: action_args: {'id': 'f4019e14-d0da-4d23-95aa-a322d2c1b8e2'} Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4019e14-d0da-4d23-95aa-a322d2c1b8e2 could not be found. Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4019e14-d0da-4d23-95aa-a322d2c1b8e2 could not be found. Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:12:15.459578 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 17:12:15.467426 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:12:15.467426 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:12:15.467426 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:12:15.467426 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 17:12:15.467426 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 17:12:15.467426 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4019e14-d0da-4d23-95aa-a322d2c1b8e2 could not be found. Aug 29 17:12:15.467426 n-d-839401-11 devstack@n-api.service[122360]: ERROR nova.api.openstack.wsgi Aug 29 17:12:15.467426 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-6d41279f-88e2-47d7-a677-4322ff4aaeb6 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Returning 404 to user: Instance f4019e14-d0da-4d23-95aa-a322d2c1b8e2 could not be found. {{(pid=122360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 17:12:15.467426 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-6d41279f-88e2-47d7-a677-4322ff4aaeb6 tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2" status: 404 len: 111 microversion: 2.1 time: 0.039148 Aug 29 17:12:15.467426 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4372/8523] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:12:15 2022] GET /compute/v2.1/servers/f4019e14-d0da-4d23-95aa-a322d2c1b8e2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 17:12:16.982945 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-7bd449de-9ea3-4e53-ba07-176de748483d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:16.983498 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7bd449de-9ea3-4e53-ba07-176de748483d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:16.986002 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-fce8fd69-2b9e-41c3-9171-c44b5599c0e3 req-5c422ea1-6110-4d52-9e18-7f366db6e42c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "536736b4-5253-4e25-a748-6ee4c8f94346", "tag": "f7e9e999-561d-4d2f-9ad8-7d87879d79fa"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:12:16.992061 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bd449de-9ea3-4e53-ba07-176de748483d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:16.992542 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bd449de-9ea3-4e53-ba07-176de748483d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:16.993227 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bd449de-9ea3-4e53-ba07-176de748483d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:16.994150 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bd449de-9ea3-4e53-ba07-176de748483d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:16.994631 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bd449de-9ea3-4e53-ba07-176de748483d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:16.995052 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-7bd449de-9ea3-4e53-ba07-176de748483d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:16.998860 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fce8fd69-2b9e-41c3-9171-c44b5599c0e3 req-5c422ea1-6110-4d52-9e18-7f366db6e42c service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:16.999568 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fce8fd69-2b9e-41c3-9171-c44b5599c0e3 req-5c422ea1-6110-4d52-9e18-7f366db6e42c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:17.001128 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-fce8fd69-2b9e-41c3-9171-c44b5599c0e3 req-5c422ea1-6110-4d52-9e18-7f366db6e42c service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:17.011946 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-fce8fd69-2b9e-41c3-9171-c44b5599c0e3 req-5c422ea1-6110-4d52-9e18-7f366db6e42c service nova] Creating event network-changed:f7e9e999-561d-4d2f-9ad8-7d87879d79fa for instance 536736b4-5253-4e25-a748-6ee4c8f94346 on n-h2-839401-11 Aug 29 17:12:17.018282 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-fce8fd69-2b9e-41c3-9171-c44b5599c0e3 req-5c422ea1-6110-4d52-9e18-7f366db6e42c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036002 Aug 29 17:12:17.019584 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4373/8524] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 17:12:17.023895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-7bd449de-9ea3-4e53-ba07-176de748483d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Going to try to terminate instance {{(pid=122361) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 17:12:17.118840 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-7bd449de-9ea3-4e53-ba07-176de748483d tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "DELETE /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346" status: 204 len: 0 microversion: 2.1 time: 0.139528 Aug 29 17:12:17.129119 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-c945a586-03f8-42e6-83b3-5003652cb6bb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:17.129882 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.compute.api [None req-c945a586-03f8-42e6-83b3-5003652cb6bb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122360) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:17.132743 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4152/8525] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 17:12:16 2022] DELETE /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 17:12:17.136556 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c945a586-03f8-42e6-83b3-5003652cb6bb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:17.137112 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c945a586-03f8-42e6-83b3-5003652cb6bb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:17.137716 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c945a586-03f8-42e6-83b3-5003652cb6bb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:17.138476 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c945a586-03f8-42e6-83b3-5003652cb6bb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:17.138951 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c945a586-03f8-42e6-83b3-5003652cb6bb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:17.139395 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [None req-c945a586-03f8-42e6-83b3-5003652cb6bb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:17.288953 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.policy [None req-c945a586-03f8-42e6-83b3-5003652cb6bb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122360) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:12:17.298562 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-c945a586-03f8-42e6-83b3-5003652cb6bb tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346" status: 200 len: 1680 microversion: 2.1 time: 0.173751 Aug 29 17:12:17.299201 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4374/8526] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:12:17 2022] GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:12:18.320700 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-ec2ae0aa-1594-4382-aa35-b7ca68c4becf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:18.321433 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-ec2ae0aa-1594-4382-aa35-b7ca68c4becf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:18.328377 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec2ae0aa-1594-4382-aa35-b7ca68c4becf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:18.328874 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec2ae0aa-1594-4382-aa35-b7ca68c4becf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:18.329335 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec2ae0aa-1594-4382-aa35-b7ca68c4becf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:18.330261 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec2ae0aa-1594-4382-aa35-b7ca68c4becf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:18.330733 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec2ae0aa-1594-4382-aa35-b7ca68c4becf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:18.331148 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-ec2ae0aa-1594-4382-aa35-b7ca68c4becf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:18.549671 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.policy [None req-ec2ae0aa-1594-4382-aa35-b7ca68c4becf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ec90cb493b488f98e901f0faf316f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1489464a7ad432e8da0068bb43a787e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122361) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:12:18.558005 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-ec2ae0aa-1594-4382-aa35-b7ca68c4becf tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346" status: 200 len: 1563 microversion: 2.1 time: 0.241698 Aug 29 17:12:18.558628 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4153/8527] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:12:18 2022] GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:12:19.033820 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [req-6843801b-e8cf-48a1-9804-04bc0a48db76 req-08401a4c-92fa-47a5-a624-df6a119039d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536736b4-5253-4e25-a748-6ee4c8f94346", "name": "network-vif-deleted", "tag": "f7e9e999-561d-4d2f-9ad8-7d87879d79fa"}]} {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:12:19.048022 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6843801b-e8cf-48a1-9804-04bc0a48db76 req-08401a4c-92fa-47a5-a624-df6a119039d9 service nova] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:19.048600 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6843801b-e8cf-48a1-9804-04bc0a48db76 req-08401a4c-92fa-47a5-a624-df6a119039d9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:19.049186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG oslo_concurrency.lockutils [req-6843801b-e8cf-48a1-9804-04bc0a48db76 req-08401a4c-92fa-47a5-a624-df6a119039d9 service nova] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:19.063029 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.compute.server_external_events [req-6843801b-e8cf-48a1-9804-04bc0a48db76 req-08401a4c-92fa-47a5-a624-df6a119039d9 service nova] Creating event network-vif-deleted:f7e9e999-561d-4d2f-9ad8-7d87879d79fa for instance 536736b4-5253-4e25-a748-6ee4c8f94346 on n-h2-839401-11 Aug 29 17:12:19.069143 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [req-6843801b-e8cf-48a1-9804-04bc0a48db76 req-08401a4c-92fa-47a5-a624-df6a119039d9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039108 Aug 29 17:12:19.070179 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4375/8528] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 17:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:12:19.580589 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d84585ff-287b-492f-b354-923f843def9c tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '>' {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:19.581368 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.compute.api [None req-d84585ff-287b-492f-b354-923f843def9c tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [instance: 536736b4-5253-4e25-a748-6ee4c8f94346] Fetching instance by UUID {{(pid=122361) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:19.588202 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d84585ff-287b-492f-b354-923f843def9c tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:19.588691 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d84585ff-287b-492f-b354-923f843def9c tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:19.589159 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d84585ff-287b-492f-b354-923f843def9c tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:19.589862 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d84585ff-287b-492f-b354-923f843def9c tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Acquiring lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:19.590312 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d84585ff-287b-492f-b354-923f843def9c tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:19.590735 n-d-839401-11 devstack@n-api.service[122361]: DEBUG oslo_concurrency.lockutils [None req-d84585ff-287b-492f-b354-923f843def9c tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Lock "dcf211bc-da73-4d63-b885-2b9e7c1e329b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:19.608167 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.wsgi [None req-d84585ff-287b-492f-b354-923f843def9c tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] HTTP exception thrown: Instance 536736b4-5253-4e25-a748-6ee4c8f94346 could not be found. Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d84585ff-287b-492f-b354-923f843def9c tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Request method failure captured: Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: request: GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 HTTP/1.1 Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: Accept: application/json Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: Accept-Encoding: identity Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: Connection: close Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: Content-Length: 0 Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: Content-Type: application/json Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: Host: 10.222.0.62 Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: Openstack-System-Scope: None Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: User-Agent: python-urllib3/1.26.12 Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-Auth-Token: gAAAAABjDPHjP7CdJItIslOVYFll1KXZdl4WfB2lPKx7j0iZ5q5Sjo1TqfjBlxnqWgAmeUTDl3ms7D2XSlc6rlSjJFhsfbVeghGYjloU3nfULiYimMERwLnCdVsSl4tOFhDK5KoBiIZ_YcYxyEODt8bPVHMA3e5ZOvMDc5-79FO8y1E8EGbT3o0 Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Id: None Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-Domain-Name: None Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-Identity-Status: Confirmed Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-Is-Admin-Project: True Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Id: default Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Domain-Name: Default Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Id: b1489464a7ad432e8da0068bb43a787e Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-Project-Name: tempest-TestSnapshotPattern-562917034 Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-Role: reader,member Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-Roles: reader,member Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b1489464a7ad432e8da0068bb43a787e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b1489464a7ad432e8da0068bb43a787e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1489464a7ad432e8da0068bb43a787e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1489464a7ad432e8da0068bb43a787e"}]}] Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant: tempest-TestSnapshotPattern-562917034 Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Id: b1489464a7ad432e8da0068bb43a787e Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-Tenant-Name: tempest-TestSnapshotPattern-562917034 Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-User: tempest-TestSnapshotPattern-562917034-project Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Id: default Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-User-Domain-Name: Default Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-User-Id: 44ec90cb493b488f98e901f0faf316f7 Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: X-User-Name: tempest-TestSnapshotPattern-562917034-project Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: method: > Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: exception: Instance 536736b4-5253-4e25-a748-6ee4c8f94346 could not be found. Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: action_args: {'id': '536736b4-5253-4e25-a748-6ee4c8f94346'} Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: {{(pid=122361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 536736b4-5253-4e25-a748-6ee4c8f94346 could not be found. Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 536736b4-5253-4e25-a748-6ee4c8f94346 could not be found. Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:12:19.609895 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 17:12:19.614980 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:12:19.614980 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:12:19.614980 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:12:19.614980 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 17:12:19.614980 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 17:12:19.614980 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 536736b4-5253-4e25-a748-6ee4c8f94346 could not be found. Aug 29 17:12:19.614980 n-d-839401-11 devstack@n-api.service[122361]: ERROR nova.api.openstack.wsgi Aug 29 17:12:19.614980 n-d-839401-11 devstack@n-api.service[122361]: DEBUG nova.api.openstack.wsgi [None req-d84585ff-287b-492f-b354-923f843def9c tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Returning 404 to user: Instance 536736b4-5253-4e25-a748-6ee4c8f94346 could not be found. {{(pid=122361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 17:12:19.614980 n-d-839401-11 devstack@n-api.service[122361]: INFO nova.api.openstack.requestlog [None req-d84585ff-287b-492f-b354-923f843def9c tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346" status: 404 len: 111 microversion: 2.1 time: 0.034817 Aug 29 17:12:19.614980 n-d-839401-11 devstack@n-api.service[122361]: [pid: 122361|app: 0|req: 4154/8529] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 17:12:19 2022] GET /compute/v2.1/servers/536736b4-5253-4e25-a748-6ee4c8f94346 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 17:12:19.800186 n-d-839401-11 devstack@n-api.service[122360]: DEBUG nova.api.openstack.wsgi [None req-9a9f628c-eb87-420f-865e-b0f8c94d97bd tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] Calling method '.version_select at 0x7fc42bc6c670>' {{(pid=122360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:19.805036 n-d-839401-11 devstack@n-api.service[122360]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9a9f628c-eb87-420f-865e-b0f8c94d97bd tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [c4fea839-36b3-431f-8bb6-ddea9bf9c77e] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 17:12:20.815698 n-d-839401-11 devstack@n-api.service[122360]: INFO oslo.messaging._drivers.impl_rabbit [None req-9a9f628c-eb87-420f-865e-b0f8c94d97bd tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] [c4fea839-36b3-431f-8bb6-ddea9bf9c77e] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 44916. Aug 29 17:12:20.841970 n-d-839401-11 devstack@n-api.service[122360]: INFO nova.api.openstack.requestlog [None req-9a9f628c-eb87-420f-865e-b0f8c94d97bd tempest-TestSnapshotPattern-562917034 tempest-TestSnapshotPattern-562917034-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-365291319" status: 202 len: 0 microversion: 2.1 time: 1.046665 Aug 29 17:12:20.842608 n-d-839401-11 devstack@n-api.service[122360]: [pid: 122360|app: 0|req: 4376/8530] 10.222.0.62 () {58 vars in 1254 bytes} [Mon Aug 29 17:12:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-365291319 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)